diff --git a/microbench/connector_tax/cache_sweep/REPORT_TRACE_REPLAY.md b/microbench/connector_tax/cache_sweep/REPORT_TRACE_REPLAY.md new file mode 100644 index 0000000..255913d --- /dev/null +++ b/microbench/connector_tax/cache_sweep/REPORT_TRACE_REPLAY.md @@ -0,0 +1,117 @@ +# Trace-replay re-test with DR-fix + +Run: `results/trace_replay_20260526_1652/` +Trace: `traces/w600_r0.0015_st30.jsonl` (1214 reqs, 274 sessions, 53.3 M tokens) +Topology: 8 × TP1 vLLM + `cache_aware_proxy`, Qwen3-Coder-30B-A3B-Instruct +Same trace, same proxy, same machine that produced the original +`analysis/characterization/elastic_migration_v2/` paper. + +## TL;DR + +The original elastic_migration_v2 paper claimed `kv_role=kv_both` (Mooncake) cost +TTFT p90 **+45 %** vs plain `unified`. **That gap no longer exists.** In a +same-day re-run on the same trace with the same 8-instance topology: + +| metric | unified (plain) | unified_kv_both (baseline) | unified_kv_both_drfix | +|---|---:|---:|---:| +| TTFT p90 | **11 971 ms** | **9 744 ms** (−18.6 % vs plain) | **7 584 ms** (−36.6 % vs plain) | +| TPOT p90 | 20 ms | 22 ms (+10 %) | 18 ms (−10 %) | +| E2E p90 | 23 475 ms | 21 254 ms (−9.5 %) | 17 931 ms (−23.6 %) | + +Two findings: + +1. **The +45 % is gone.** kv_both without any fix is now *faster* than + plain `unified` at p90 (−18.6 %). Likely culprits in the commit chain + since the elastic_migration_v2 paper: `a7df84b` (direct RDMA read), + `0500350` (token-based lookup), `08d5e12` (NONE_HASH import fix), + and especially **`e3a1d70` (switch from RDMA READ to bootstrap-triggered + PUSH)** which restructured the producer-side critical path. +2. **DR-fix still helps.** Disabling the O(\|cache\|) hash sync removes + another 22 % from TTFT p90 (9.7 s → 7.6 s) and 16 % from E2E p90 + (21.3 s → 17.9 s). The cache-sweep finding (+85 μs/1k blocks slope) + translates into measurable p90/p99 wins under high APC + agentic + session coupling. + +## How this changes the elastic_migration_v2 narrative + +Original paper's four claims, re-checked today: + +| original claim | today's status | +|---|---| +| "kv_role=kv_both costs TTFT p90 +45 % even without PD-sep" | **OBSOLETE** (now −18.6 % vs plain) | +| "Mooncake−NIXL gap of 7 pp is implementation cost" | **NOT TESTED** (NIXL not re-run here) | +| "PD-sep rarely fires (0.41 % trigger rate)" | unchanged — trace property | +| "When PD-sep fires, mechanism is 10-20× slower than model predicts" | **NOT TESTED** (v2 policy not re-run) | + +The elastic_migration_v2 README should be marked as containing **historical +data that is no longer reproducible on the current codebase**. The story +ought to be re-cast as: "+45 % was a transient bug we fixed (whether +intentionally as part of `e3a1d70` or accidentally), and the +remaining headroom (15-20 % p90) is recovered by the DR-fix." + +## Full per-metric A/B/C table + +(10 s warmup discarded by the replayer; n=1214 each) + +| metric | unified | unified_kv_both | drfix | mc vs plain | drfix vs plain | drfix vs mc | +|---|---:|---:|---:|---:|---:|---:| +| TTFT mean | 4 018 ms | 3 552 ms | 3 103 ms | −11.6 % | −22.8 % | −12.6 % | +| TTFT p50 | 500 ms | 501 ms | 485 ms | +0.2 % | −3.0 % | −3.2 % | +| **TTFT p90** | 11 971 ms | 9 744 ms | **7 584 ms** | **−18.6 %** | **−36.6 %** | **−22.2 %** | +| TTFT p99 | 46 695 ms | 42 432 ms | 41 883 ms | −9.1 % | −10.3 % | −1.3 % | +| TPOT mean | 15.3 ms | 14.4 ms | 14.0 ms | −5.9 % | −8.5 % | −2.8 % | +| TPOT p50 | 8.4 ms | 8.3 ms | 8.0 ms | −0.9 % | −3.9 % | −3.1 % | +| **TPOT p90** | 19.6 ms | 21.6 ms | **17.7 ms** | +10.0 % | **−9.7 %** | **−17.9 %** | +| **TPOT p99** | 151.6 ms | 127.8 ms | **112.4 ms** | −15.7 % | **−25.9 %** | **−12.1 %** | +| E2E mean | 8 180 ms | 7 967 ms | 7 184 ms | −2.6 % | −12.2 % | −9.8 % | +| E2E p50 | 1 942 ms | 1 995 ms | 1 806 ms | +2.7 % | −7.0 % | −9.5 % | +| **E2E p90** | 23 475 ms | 21 254 ms | **17 931 ms** | −9.5 % | **−23.6 %** | **−15.6 %** | +| E2E p99 | 73 709 ms | 76 630 ms | 71 958 ms | +4.0 % | −2.4 % | −6.1 % | + +## Why kv_both already beats plain (without DR-fix) + +A connector-loaded vLLM has `delay_free_blocks=True` by default — block +eviction is deferred until the connector's bookkeeping signals it is +safe. On a 93 %-intra-session-reuse trace, this **extends prefix-cache +hit windows across session turns**, which more than compensates for the +per-step connector cost on the codebase as it exists today. With the +DR-fix removing the remaining O(\|cache\|) tax, the net swings strongly +positive. + +This was also one of the explanations proposed in the cache_sweep report +("connector mode has higher effective cache utilisation") and is now +confirmed at the trace-replay scale. + +## Reproducibility + +``` +bash microbench/connector_tax/cache_sweep/run_trace_replay_drfix.sh +``` + +Runtime: ~2.5 h on 8 × H20. The orchestrator applies CT_DR_FIX, runs +the three policies serially (plain → mc baseline → mc drfix via env +var), reverts the patch, and emits per-policy metrics.jsonl. Analyse +with: + +``` +python microbench/connector_tax/cache_sweep/analyze_trace_replay.py \\ + --root microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652 +``` + +## Files + +``` +trace_replay_20260526_1652/ +├── trace_replay_summary.json — machine-readable per-config TTFT/TPOT/E2E +├── unified/ — plain control +│ ├── metrics.jsonl — per-request timings (1214 rows) +│ ├── metrics.summary.json — replayer's own summary +│ ├── breakdown.json — proxy per-decision metadata +│ ├── stats.json — proxy aggregate counters +│ └── run_window.json — t_start/t_end + policy + trace +├── unified_kv_both/ — Mooncake kv_both, hash sync ON +└── unified_kv_both_drfix/ — Mooncake kv_both, hash sync OFF (env-gated) +``` + +Heavy artifacts (engine_state/, vllm logs, replayer.log, proxy.log) +are `.gitignore`d — re-derive with `run_trace_replay_drfix.sh`. diff --git a/microbench/connector_tax/cache_sweep/analyze_trace_replay.py b/microbench/connector_tax/cache_sweep/analyze_trace_replay.py new file mode 100755 index 0000000..2527501 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/analyze_trace_replay.py @@ -0,0 +1,115 @@ +#!/usr/bin/env python3 +"""Compute TTFT/TPOT/E2E mean/p50/p90/p99 from trace-replay metrics.jsonl. + +Usage: + python analyze_trace_replay.py --root +where /{unified,unified_kv_both,unified_kv_both_drfix}/metrics.jsonl +each contain one JSONL object per request (with ttft_s, tpot_s, latency_s). +""" + +import argparse +import json +import statistics +from pathlib import Path + + +def pct(xs, p): + if not xs: + return None + xs = sorted(xs) + k = max(0, min(len(xs) - 1, int(p / 100.0 * (len(xs) - 1)))) + return xs[k] + + +def summarise(rows): + ok = [r for r in rows if not r.get("error")] + ttft = [r["ttft_s"] * 1000 for r in ok if r.get("ttft_s") is not None] + tpot = [r["tpot_s"] * 1000 for r in ok if r.get("tpot_s")] + e2e = [r["latency_s"] * 1000 for r in ok if r.get("latency_s") is not None] + return { + "n_total": len(rows), + "n_ok": len(ok), + "n_err": len(rows) - len(ok), + "ttft_mean_ms": statistics.mean(ttft) if ttft else None, + "ttft_p50_ms": pct(ttft, 50), + "ttft_p90_ms": pct(ttft, 90), + "ttft_p99_ms": pct(ttft, 99), + "tpot_mean_ms": statistics.mean(tpot) if tpot else None, + "tpot_p50_ms": pct(tpot, 50), + "tpot_p90_ms": pct(tpot, 90), + "tpot_p99_ms": pct(tpot, 99), + "e2e_mean_ms": statistics.mean(e2e) if e2e else None, + "e2e_p50_ms": pct(e2e, 50), + "e2e_p90_ms": pct(e2e, 90), + "e2e_p99_ms": pct(e2e, 99), + } + + +def main(): + ap = argparse.ArgumentParser() + ap.add_argument("--root", type=Path, required=True) + ap.add_argument("--configs", nargs="+", + default=["unified", "unified_kv_both", "unified_kv_both_drfix"]) + args = ap.parse_args() + + results = {} + for cfg in args.configs: + p = args.root / cfg / "metrics.jsonl" + if not p.exists(): + print(f"MISSING: {p}") + continue + rows = [json.loads(l) for l in open(p) if l.strip()] + results[cfg] = summarise(rows) + + def fmt(v): + return f"{v:.0f}" if v is not None else "-" + + def pctd(a, b): + if a is None or b is None or a == 0: + return "-" + return f"{(b/a-1)*100:+.1f}%" + + print(f"{'metric':<14}", end="") + for cfg in args.configs: + print(f"{cfg[:20]:>22}", end="") + print() + print("-" * (14 + 22 * len(args.configs))) + + for m in ["n_ok", "ttft_mean_ms", "ttft_p50_ms", "ttft_p90_ms", "ttft_p99_ms", + "tpot_mean_ms", "tpot_p50_ms", "tpot_p90_ms", "tpot_p99_ms", + "e2e_mean_ms", "e2e_p50_ms", "e2e_p90_ms", "e2e_p99_ms"]: + print(f"{m:<14}", end="") + for cfg in args.configs: + if cfg not in results: + print(f"{'-':>22}", end="") + else: + print(f"{fmt(results[cfg][m]):>22}", end="") + print() + + # Tax tables + if len(args.configs) >= 2 and all(c in results for c in args.configs): + plain = args.configs[0] + for ref_cfg in args.configs[1:]: + print(f"\n=== {ref_cfg} vs {plain} ===") + for m in ["ttft_p50_ms", "ttft_p90_ms", "ttft_p99_ms", + "tpot_p50_ms", "tpot_p90_ms", "tpot_p99_ms", + "e2e_p50_ms", "e2e_p90_ms", "e2e_p99_ms"]: + a = results[plain][m]; b = results[ref_cfg][m] + print(f" {m:<14} {fmt(a):>10} → {fmt(b):>10} ({pctd(a, b)})") + if "unified_kv_both" in results and "unified_kv_both_drfix" in results: + print(f"\n=== DR-fix improvement: unified_kv_both_drfix vs unified_kv_both ===") + for m in ["ttft_p50_ms", "ttft_p90_ms", "ttft_p99_ms", + "tpot_p50_ms", "tpot_p90_ms", "tpot_p99_ms", + "e2e_p50_ms", "e2e_p90_ms", "e2e_p99_ms"]: + a = results["unified_kv_both"][m] + b = results["unified_kv_both_drfix"][m] + print(f" {m:<14} {fmt(a):>10} → {fmt(b):>10} ({pctd(a, b)})") + + # Save machine-readable + with open(args.root / "trace_replay_summary.json", "w") as f: + json.dump(results, f, indent=2) + print(f"\nWrote {args.root}/trace_replay_summary.json") + + +if __name__ == "__main__": + main() diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/SUMMARY.md b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/SUMMARY.md new file mode 100644 index 0000000..efccb27 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/SUMMARY.md @@ -0,0 +1,89 @@ +# Cache-size sweep — summary + +Run root: `/home/admin/cpfs/wjh/agentic-kv/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix` + +## Per-config fit (`step_duration_us ≈ a + b · cache_size`) + +| config | n steps | cache max | step_dur p50 (μs) | build_meta p50 (μs) | slope (μs / 1k blocks) | intercept (μs) | +|---|---:|---:|---:|---:|---:|---:| +| mooncake_both | 15022 | 17533 | 1555 | 1450 | 94.5 | 85.7 | +| mooncake_both_drfix | 14938 | 17533 | 97 | 6 | 2.3 | 66.4 | +| plain | 15126 | 17533 | 87 | 0 | 2.6 | 51.1 | + +### mooncake_both — per-bin + +| bin | cache mid | n | step_dur p50 | step_dur p90 | build_meta p50 | build_meta p90 | +|---:|---:|---:|---:|---:|---:|---:| +| 3 | 6137 | 183 | 753 | 1105 | 639 | 968 | +| 4 | 7890 | 921 | 763 | 1102 | 694 | 983 | +| 5 | 9643 | 223 | 933 | 1336 | 834 | 1223 | +| 6 | 11396 | 404 | 1039 | 1488 | 954 | 1363 | +| 7 | 13150 | 367 | 1174 | 1659 | 1078 | 1540 | +| 8 | 14903 | 468 | 1211 | 1685 | 1136 | 1593 | +| 9 | 16656 | 12079 | 1555 | 2204 | 1450 | 2051 | + +*worker side (n=15522)* — get_finished p50/p90/p99 = 180/255/349 μs; start_load_kv p50/p90 = 2/5 μs + + +### mooncake_both_drfix — per-bin + +| bin | cache mid | n | step_dur p50 | step_dur p90 | build_meta p50 | build_meta p90 | +|---:|---:|---:|---:|---:|---:|---:| +| 3 | 6137 | 180 | 125 | 144 | 6 | 7 | +| 4 | 7890 | 921 | 66 | 99 | 6 | 7 | +| 5 | 9643 | 217 | 102 | 120 | 6 | 7 | +| 6 | 11396 | 384 | 91 | 119 | 6 | 7 | +| 7 | 13150 | 344 | 98 | 124 | 6 | 7 | +| 8 | 14903 | 456 | 73 | 100 | 6 | 7 | +| 9 | 16656 | 12060 | 97 | 169 | 6 | 7 | + +*worker side (n=15438)* — get_finished p50/p90/p99 = 180/256/345 μs; start_load_kv p50/p90 = 2/2 μs + + +### plain — per-bin + +| bin | cache mid | n | step_dur p50 | step_dur p90 | build_meta p50 | build_meta p90 | +|---:|---:|---:|---:|---:|---:|---:| +| 3 | 6137 | 215 | 105 | 135 | 0 | 0 | +| 4 | 7890 | 979 | 54 | 81 | 0 | 0 | +| 5 | 9643 | 230 | 83 | 104 | 0 | 0 | +| 6 | 11396 | 402 | 78 | 101 | 0 | 0 | +| 7 | 13150 | 371 | 81 | 103 | 0 | 0 | +| 8 | 14903 | 468 | 61 | 83 | 0 | 0 | +| 9 | 16656 | 12086 | 87 | 157 | 0 | 0 | + +## Connector tax(cache_size) — mooncake_both vs plain + +| bin | cache mid | baseline step p50 | target step p50 | tax (μs) | tax (%) | +|---:|---:|---:|---:|---:|---:| +| 3 | 6137 | 105 | 753 | +648 | +617.1 | +| 4 | 7890 | 54 | 763 | +709 | +1313.0 | +| 5 | 9643 | 83 | 933 | +850 | +1024.1 | +| 6 | 11396 | 78 | 1039 | +961 | +1232.1 | +| 7 | 13150 | 81 | 1174 | +1093 | +1349.4 | +| 8 | 14903 | 61 | 1211 | +1150 | +1885.2 | +| 9 | 16656 | 87 | 1555 | +1468 | +1687.4 | + +## Connector tax(cache_size) — mooncake_both_drfix vs plain + +| bin | cache mid | baseline step p50 | target step p50 | tax (μs) | tax (%) | +|---:|---:|---:|---:|---:|---:| +| 3 | 6137 | 105 | 125 | +20 | +19.0 | +| 4 | 7890 | 54 | 66 | +12 | +22.2 | +| 5 | 9643 | 83 | 102 | +19 | +22.9 | +| 6 | 11396 | 78 | 91 | +13 | +16.7 | +| 7 | 13150 | 81 | 98 | +17 | +21.0 | +| 8 | 14903 | 61 | 73 | +12 | +19.7 | +| 9 | 16656 | 87 | 97 | +10 | +11.5 | + +## DR-fix savings — mooncake_both vs mooncake_both_drfix + +| bin | cache mid | baseline step p50 | target step p50 | tax (μs) | tax (%) | +|---:|---:|---:|---:|---:|---:| +| 3 | 6137 | 125 | 753 | +628 | +502.4 | +| 4 | 7890 | 66 | 763 | +697 | +1056.1 | +| 5 | 9643 | 102 | 933 | +831 | +814.7 | +| 6 | 11396 | 91 | 1039 | +948 | +1041.8 | +| 7 | 13150 | 98 | 1174 | +1076 | +1098.0 | +| 8 | 14903 | 73 | 1211 | +1138 | +1558.9 | +| 9 | 16656 | 97 | 1555 | +1458 | +1503.1 | diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/metrics_final.txt b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/metrics_final.txt new file mode 100644 index 0000000..66f6785 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/metrics_final.txt @@ -0,0 +1,624 @@ +# HELP python_gc_objects_collected_total Objects collected during gc +# TYPE python_gc_objects_collected_total counter +python_gc_objects_collected_total{generation="0"} 11855.0 +python_gc_objects_collected_total{generation="1"} 1664.0 +python_gc_objects_collected_total{generation="2"} 855.0 +# HELP python_gc_objects_uncollectable_total Uncollectable objects found during GC +# TYPE python_gc_objects_uncollectable_total counter +python_gc_objects_uncollectable_total{generation="0"} 0.0 +python_gc_objects_uncollectable_total{generation="1"} 0.0 +python_gc_objects_uncollectable_total{generation="2"} 0.0 +# HELP python_gc_collections_total Number of times this generation was collected +# TYPE python_gc_collections_total counter +python_gc_collections_total{generation="0"} 1344.0 +python_gc_collections_total{generation="1"} 123.0 +python_gc_collections_total{generation="2"} 9.0 +# HELP python_info Python platform information +# TYPE python_info gauge +python_info{implementation="CPython",major="3",minor="12",patchlevel="3",version="3.12.3"} 1.0 +# HELP process_virtual_memory_bytes Virtual memory size in bytes. +# TYPE process_virtual_memory_bytes gauge +process_virtual_memory_bytes 4.1068527616e+010 +# HELP process_resident_memory_bytes Resident memory size in bytes. +# TYPE process_resident_memory_bytes gauge +process_resident_memory_bytes 1.3826048e+09 +# HELP process_start_time_seconds Start time of the process since unix epoch in seconds. +# TYPE process_start_time_seconds gauge +process_start_time_seconds 1.77981319578e+09 +# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. +# TYPE process_cpu_seconds_total counter +process_cpu_seconds_total 39.28 +# HELP process_open_fds Number of open file descriptors. +# TYPE process_open_fds gauge +process_open_fds 67.0 +# HELP process_max_fds Maximum number of open file descriptors. +# TYPE process_max_fds gauge +process_max_fds 1.048575e+06 +# HELP vllm:estimated_flops_per_gpu_total Estimated number of floating point operations per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_flops_per_gpu_total counter +vllm:estimated_flops_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_flops_per_gpu_created Estimated number of floating point operations per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_flops_per_gpu_created gauge +vllm:estimated_flops_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003540344e+09 +# HELP vllm:estimated_read_bytes_per_gpu_total Estimated number of bytes read from memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_read_bytes_per_gpu_total counter +vllm:estimated_read_bytes_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_read_bytes_per_gpu_created Estimated number of bytes read from memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_read_bytes_per_gpu_created gauge +vllm:estimated_read_bytes_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354065e+09 +# HELP vllm:estimated_write_bytes_per_gpu_total Estimated number of bytes written to memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_write_bytes_per_gpu_total counter +vllm:estimated_write_bytes_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_write_bytes_per_gpu_created Estimated number of bytes written to memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_write_bytes_per_gpu_created gauge +vllm:estimated_write_bytes_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003540845e+09 +# HELP vllm:num_requests_running Number of requests in model execution batches. +# TYPE vllm:num_requests_running gauge +vllm:num_requests_running{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:num_requests_waiting Number of requests waiting to be processed. +# TYPE vllm:num_requests_waiting gauge +vllm:num_requests_waiting{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:engine_sleep_state Engine sleep state; awake = 0 means engine is sleeping; awake = 1 means engine is awake; weights_offloaded = 1 means sleep level 1; discard_all = 1 means sleep level 2. +# TYPE vllm:engine_sleep_state gauge +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="awake"} 1.0 +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="weights_offloaded"} 0.0 +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="discard_all"} 0.0 +# HELP vllm:kv_cache_usage_perc KV-cache usage. 1 means 100 percent usage. +# TYPE vllm:kv_cache_usage_perc gauge +vllm:kv_cache_usage_perc{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prefix_cache_queries_total Prefix cache queries, in terms of number of queried tokens. +# TYPE vllm:prefix_cache_queries_total counter +vllm:prefix_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:prefix_cache_queries_created Prefix cache queries, in terms of number of queried tokens. +# TYPE vllm:prefix_cache_queries_created gauge +vllm:prefix_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003542354e+09 +# HELP vllm:prefix_cache_hits_total Prefix cache hits, in terms of number of cached tokens. +# TYPE vllm:prefix_cache_hits_total counter +vllm:prefix_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prefix_cache_hits_created Prefix cache hits, in terms of number of cached tokens. +# TYPE vllm:prefix_cache_hits_created gauge +vllm:prefix_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003542495e+09 +# HELP vllm:external_prefix_cache_queries_total External prefix cache queries from KV connector cross-instance cache sharing, in terms of number of queried tokens. +# TYPE vllm:external_prefix_cache_queries_total counter +vllm:external_prefix_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:external_prefix_cache_queries_created External prefix cache queries from KV connector cross-instance cache sharing, in terms of number of queried tokens. +# TYPE vllm:external_prefix_cache_queries_created gauge +vllm:external_prefix_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003542619e+09 +# HELP vllm:external_prefix_cache_hits_total External prefix cache hits from KV connector cross-instance cache sharing, in terms of number of cached tokens. +# TYPE vllm:external_prefix_cache_hits_total counter +vllm:external_prefix_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:external_prefix_cache_hits_created External prefix cache hits from KV connector cross-instance cache sharing, in terms of number of cached tokens. +# TYPE vllm:external_prefix_cache_hits_created gauge +vllm:external_prefix_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354274e+09 +# HELP vllm:mm_cache_queries_total Multi-modal cache queries, in terms of number of queried items. +# TYPE vllm:mm_cache_queries_total counter +vllm:mm_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:mm_cache_queries_created Multi-modal cache queries, in terms of number of queried items. +# TYPE vllm:mm_cache_queries_created gauge +vllm:mm_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003542848e+09 +# HELP vllm:mm_cache_hits_total Multi-modal cache hits, in terms of number of cached items. +# TYPE vllm:mm_cache_hits_total counter +vllm:mm_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:mm_cache_hits_created Multi-modal cache hits, in terms of number of cached items. +# TYPE vllm:mm_cache_hits_created gauge +vllm:mm_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003542967e+09 +# HELP vllm:num_preemptions_total Cumulative number of preemption from the engine. +# TYPE vllm:num_preemptions_total counter +vllm:num_preemptions_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:num_preemptions_created Cumulative number of preemption from the engine. +# TYPE vllm:num_preemptions_created gauge +vllm:num_preemptions_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003543088e+09 +# HELP vllm:prompt_tokens_total Number of prefill tokens processed. +# TYPE vllm:prompt_tokens_total counter +vllm:prompt_tokens_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:prompt_tokens_created Number of prefill tokens processed. +# TYPE vllm:prompt_tokens_created gauge +vllm:prompt_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003543196e+09 +# HELP vllm:prompt_tokens_by_source_total Number of prompt tokens by source. +# TYPE vllm:prompt_tokens_by_source_total counter +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_compute"} 1.563446e+06 +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_cache_hit"} 0.0 +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="external_kv_transfer"} 0.0 +# HELP vllm:prompt_tokens_by_source_created Number of prompt tokens by source. +# TYPE vllm:prompt_tokens_by_source_created gauge +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_compute"} 1.7798133003543339e+09 +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_cache_hit"} 1.7798133003543391e+09 +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="external_kv_transfer"} 1.779813300354344e+09 +# HELP vllm:prompt_tokens_cached_total Number of cached prompt tokens (local + external). +# TYPE vllm:prompt_tokens_cached_total counter +vllm:prompt_tokens_cached_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prompt_tokens_cached_created Number of cached prompt tokens (local + external). +# TYPE vllm:prompt_tokens_cached_created gauge +vllm:prompt_tokens_cached_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003543563e+09 +# HELP vllm:prompt_tokens_recomputed_total Number of cached tokens recomputed for forward pass. +# TYPE vllm:prompt_tokens_recomputed_total counter +vllm:prompt_tokens_recomputed_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prompt_tokens_recomputed_created Number of cached tokens recomputed for forward pass. +# TYPE vllm:prompt_tokens_recomputed_created gauge +vllm:prompt_tokens_recomputed_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003543699e+09 +# HELP vllm:generation_tokens_total Number of generation tokens processed. +# TYPE vllm:generation_tokens_total counter +vllm:generation_tokens_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:generation_tokens_created Number of generation tokens processed. +# TYPE vllm:generation_tokens_created gauge +vllm:generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003543828e+09 +# HELP vllm:request_success_total Count of successfully processed requests. +# TYPE vllm:request_success_total counter +vllm:request_success_total{engine="0",finished_reason="stop",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="length",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_success_total{engine="0",finished_reason="abort",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="error",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="repetition",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:request_success_created Count of successfully processed requests. +# TYPE vllm:request_success_created gauge +vllm:request_success_created{engine="0",finished_reason="stop",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003544142e+09 +vllm:request_success_created{engine="0",finished_reason="length",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354424e+09 +vllm:request_success_created{engine="0",finished_reason="abort",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003544307e+09 +vllm:request_success_created{engine="0",finished_reason="error",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354447e+09 +vllm:request_success_created{engine="0",finished_reason="repetition",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003544533e+09 +# HELP vllm:request_prompt_tokens Number of prefill tokens processed. +# TYPE vllm:request_prompt_tokens histogram +vllm:request_prompt_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:request_prompt_tokens_created Number of prefill tokens processed. +# TYPE vllm:request_prompt_tokens_created gauge +vllm:request_prompt_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354504e+09 +# HELP vllm:request_generation_tokens Number of generation tokens processed. +# TYPE vllm:request_generation_tokens histogram +vllm:request_generation_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_generation_tokens_created Number of generation tokens processed. +# TYPE vllm:request_generation_tokens_created gauge +vllm:request_generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003545852e+09 +# HELP vllm:iteration_tokens_total Histogram of number of tokens per engine_step. +# TYPE vllm:iteration_tokens_total histogram +vllm:iteration_tokens_total_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3053.0 +vllm:iteration_tokens_total_bucket{engine="0",le="8.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 10439.0 +vllm:iteration_tokens_total_bucket{engine="0",le="16.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 14463.0 +vllm:iteration_tokens_total_bucket{engine="0",le="32.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="64.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="128.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="256.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="512.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="1024.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="2048.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15126.0 +vllm:iteration_tokens_total_bucket{engine="0",le="4096.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15474.0 +vllm:iteration_tokens_total_bucket{engine="0",le="8192.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15496.0 +vllm:iteration_tokens_total_bucket{engine="0",le="16384.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15496.0 +vllm:iteration_tokens_total_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15496.0 +vllm:iteration_tokens_total_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15496.0 +vllm:iteration_tokens_total_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.663798e+06 +# HELP vllm:iteration_tokens_total_created Histogram of number of tokens per engine_step. +# TYPE vllm:iteration_tokens_total_created gauge +vllm:iteration_tokens_total_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003546233e+09 +# HELP vllm:request_max_num_generation_tokens Histogram of maximum number of requested generation tokens. +# TYPE vllm:request_max_num_generation_tokens histogram +vllm:request_max_num_generation_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_max_num_generation_tokens_created Histogram of maximum number of requested generation tokens. +# TYPE vllm:request_max_num_generation_tokens_created gauge +vllm:request_max_num_generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003546584e+09 +# HELP vllm:request_params_n Histogram of the n request parameter. +# TYPE vllm:request_params_n histogram +vllm:request_params_n_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +# HELP vllm:request_params_n_created Histogram of the n request parameter. +# TYPE vllm:request_params_n_created gauge +vllm:request_params_n_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003546975e+09 +# HELP vllm:request_params_max_tokens Histogram of the max_tokens request parameter. +# TYPE vllm:request_params_max_tokens histogram +vllm:request_params_max_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_params_max_tokens_created Histogram of the max_tokens request parameter. +# TYPE vllm:request_params_max_tokens_created gauge +vllm:request_params_max_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354721e+09 +# HELP vllm:time_to_first_token_seconds Histogram of time to first token in seconds. +# TYPE vllm:time_to_first_token_seconds histogram +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.001",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.005",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.02",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.04",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.06",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.08",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.25",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 335.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 385.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 391.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="160.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="640.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="2560.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 140.4927158355713 +# HELP vllm:time_to_first_token_seconds_created Histogram of time to first token in seconds. +# TYPE vllm:time_to_first_token_seconds_created gauge +vllm:time_to_first_token_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813300354762e+09 +# HELP vllm:inter_token_latency_seconds Histogram of inter-token latency in seconds. +# TYPE vllm:inter_token_latency_seconds histogram +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 24758.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.025",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 93979.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.05",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96677.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.075",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96768.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96768.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.15",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96768.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.2",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 97006.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99764.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.4",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99764.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2025.8075081515126 +# HELP vllm:inter_token_latency_seconds_created Histogram of inter-token latency in seconds. +# TYPE vllm:inter_token_latency_seconds_created gauge +vllm:inter_token_latency_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003548026e+09 +# HELP vllm:request_time_per_output_token_seconds Histogram of time_per_output_token_seconds per request. +# TYPE vllm:request_time_per_output_token_seconds histogram +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 32.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.025",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 276.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.05",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.075",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.15",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.2",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.4",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 7.944343169221613 +# HELP vllm:request_time_per_output_token_seconds_created Histogram of time_per_output_token_seconds per request. +# TYPE vllm:request_time_per_output_token_seconds_created gauge +vllm:request_time_per_output_token_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003548424e+09 +# HELP vllm:e2e_request_latency_seconds Histogram of e2e request latency in seconds. +# TYPE vllm:e2e_request_latency_seconds histogram +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 12.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 16.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 168.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2166.030620574951 +# HELP vllm:e2e_request_latency_seconds_created Histogram of e2e request latency in seconds. +# TYPE vllm:e2e_request_latency_seconds_created gauge +vllm:e2e_request_latency_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003549252e+09 +# HELP vllm:request_queue_time_seconds Histogram of time spent in WAITING phase for request. +# TYPE vllm:request_queue_time_seconds histogram +vllm:request_queue_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0029499955708160996 +# HELP vllm:request_queue_time_seconds_created Histogram of time spent in WAITING phase for request. +# TYPE vllm:request_queue_time_seconds_created gauge +vllm:request_queue_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003549771e+09 +# HELP vllm:request_inference_time_seconds Histogram of time spent in RUNNING phase for request. +# TYPE vllm:request_inference_time_seconds histogram +vllm:request_inference_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 12.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 19.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 171.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2144.0190685334965 +# HELP vllm:request_inference_time_seconds_created Histogram of time spent in RUNNING phase for request. +# TYPE vllm:request_inference_time_seconds_created gauge +vllm:request_inference_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003550127e+09 +# HELP vllm:request_prefill_time_seconds Histogram of time spent in PREFILL phase for request. +# TYPE vllm:request_prefill_time_seconds histogram +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 306.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 378.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 118.21156038198387 +# HELP vllm:request_prefill_time_seconds_created Histogram of time spent in PREFILL phase for request. +# TYPE vllm:request_prefill_time_seconds_created gauge +vllm:request_prefill_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003550553e+09 +# HELP vllm:request_decode_time_seconds Histogram of time spent in DECODE phase for request. +# TYPE vllm:request_decode_time_seconds histogram +vllm:request_decode_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 6.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 32.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 188.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2025.8075081515126 +# HELP vllm:request_decode_time_seconds_created Histogram of time spent in DECODE phase for request. +# TYPE vllm:request_decode_time_seconds_created gauge +vllm:request_decode_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003550992e+09 +# HELP vllm:request_prefill_kv_computed_tokens Histogram of new KV tokens computed during prefill (excluding cached tokens). +# TYPE vllm:request_prefill_kv_computed_tokens histogram +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:request_prefill_kv_computed_tokens_created Histogram of new KV tokens computed during prefill (excluding cached tokens). +# TYPE vllm:request_prefill_kv_computed_tokens_created gauge +vllm:request_prefill_kv_computed_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798133003551395e+09 +# HELP vllm:cache_config_info Information of the LLMEngine CacheConfig +# TYPE vllm:cache_config_info gauge +vllm:cache_config_info{_block_size_resolved="True",block_size="16",cache_dtype="auto",calculate_kv_scales="False",cpu_kvcache_space_bytes="None",enable_prefix_caching="True",engine="0",gpu_memory_utilization="0.9",is_attention_free="False",kv_cache_memory_bytes="None",kv_offloading_backend="native",kv_offloading_size="None",kv_sharing_fast_prefill="False",mamba_block_size="None",mamba_cache_dtype="auto",mamba_cache_mode="none",mamba_page_size_padded="None",mamba_ssm_cache_dtype="auto",num_cpu_blocks="None",num_gpu_blocks="17590",num_gpu_blocks_override="None",prefix_caching_hash_algo="sha256",sliding_window="None",user_specified_block_size="False"} 1.0 +# HELP http_requests_total Total number of requests by method, status and handler. +# TYPE http_requests_total counter +http_requests_total{handler="/v1/models",method="GET",status="2xx"} 1.0 +http_requests_total{handler="/v1/chat/completions",method="POST",status="2xx"} 392.0 +# HELP http_requests_created Total number of requests by method, status and handler. +# TYPE http_requests_created gauge +http_requests_created{handler="/v1/models",method="GET",status="2xx"} 1.7798133015051112e+09 +http_requests_created{handler="/v1/chat/completions",method="POST",status="2xx"} 1.7798133101895015e+09 +# HELP http_request_size_bytes Content length of incoming requests by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_request_size_bytes summary +http_request_size_bytes_count{handler="/v1/models"} 1.0 +http_request_size_bytes_sum{handler="/v1/models"} 0.0 +http_request_size_bytes_count{handler="/v1/chat/completions"} 392.0 +http_request_size_bytes_sum{handler="/v1/chat/completions"} 2.067408e+06 +# HELP http_request_size_bytes_created Content length of incoming requests by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_request_size_bytes_created gauge +http_request_size_bytes_created{handler="/v1/models"} 1.779813301505138e+09 +http_request_size_bytes_created{handler="/v1/chat/completions"} 1.779813310189524e+09 +# HELP http_response_size_bytes Content length of outgoing responses by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_response_size_bytes summary +http_response_size_bytes_count{handler="/v1/models"} 1.0 +http_response_size_bytes_sum{handler="/v1/models"} 558.0 +http_response_size_bytes_count{handler="/v1/chat/completions"} 392.0 +http_response_size_bytes_sum{handler="/v1/chat/completions"} 0.0 +# HELP http_response_size_bytes_created Content length of outgoing responses by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_response_size_bytes_created gauge +http_response_size_bytes_created{handler="/v1/models"} 1.7798133015051622e+09 +http_response_size_bytes_created{handler="/v1/chat/completions"} 1.779813310189559e+09 +# HELP http_request_duration_highr_seconds Latency with many buckets but no API specific labels. Made for more accurate percentile calculations. +# TYPE http_request_duration_highr_seconds histogram +http_request_duration_highr_seconds_bucket{le="0.01"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.025"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.05"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.075"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.1"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.25"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.5"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.75"} 1.0 +http_request_duration_highr_seconds_bucket{le="1.0"} 1.0 +http_request_duration_highr_seconds_bucket{le="1.5"} 4.0 +http_request_duration_highr_seconds_bucket{le="2.0"} 13.0 +http_request_duration_highr_seconds_bucket{le="2.5"} 17.0 +http_request_duration_highr_seconds_bucket{le="3.0"} 38.0 +http_request_duration_highr_seconds_bucket{le="3.5"} 64.0 +http_request_duration_highr_seconds_bucket{le="4.0"} 97.0 +http_request_duration_highr_seconds_bucket{le="4.5"} 137.0 +http_request_duration_highr_seconds_bucket{le="5.0"} 168.0 +http_request_duration_highr_seconds_bucket{le="7.5"} 317.0 +http_request_duration_highr_seconds_bucket{le="10.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="30.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="60.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="+Inf"} 393.0 +http_request_duration_highr_seconds_count 393.0 +http_request_duration_highr_seconds_sum 2166.610084610991 +# HELP http_request_duration_highr_seconds_created Latency with many buckets but no API specific labels. Made for more accurate percentile calculations. +# TYPE http_request_duration_highr_seconds_created gauge +http_request_duration_highr_seconds_created 1.7798133008326678e+09 +# HELP http_request_duration_seconds Latency with only few buckets by handler. Made to be only used if aggregation by handler is important. +# TYPE http_request_duration_seconds histogram +http_request_duration_seconds_bucket{handler="/v1/models",le="0.1",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="0.5",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="1.0",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="+Inf",method="GET"} 1.0 +http_request_duration_seconds_count{handler="/v1/models",method="GET"} 1.0 +http_request_duration_seconds_sum{handler="/v1/models",method="GET"} 0.002584011002909392 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="0.1",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="0.5",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="1.0",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="+Inf",method="POST"} 392.0 +http_request_duration_seconds_count{handler="/v1/chat/completions",method="POST"} 392.0 +http_request_duration_seconds_sum{handler="/v1/chat/completions",method="POST"} 2166.6075005999883 +# HELP http_request_duration_seconds_created Latency with only few buckets by handler. Made to be only used if aggregation by handler is important. +# TYPE http_request_duration_seconds_created gauge +http_request_duration_seconds_created{handler="/v1/models",method="GET"} 1.7798133015051963e+09 +http_request_duration_seconds_created{handler="/v1/chat/completions",method="POST"} 1.7798133101895926e+09 diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/requests.jsonl b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/requests.jsonl new file mode 100644 index 0000000..9175f16 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/requests.jsonl @@ -0,0 +1,392 @@ +{"req_id": "f9f8f44fd4964565", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382437389577401, "t_first_token_ns": 382438624486558, "t_last_token_ns": 382445176383671, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "36bbb6c17a024be2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382437758622379, "t_first_token_ns": 382438628930287, "t_last_token_ns": 382445191700409, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "accbc730595b4e03", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382437750767014, "t_first_token_ns": 382438628800887, "t_last_token_ns": 382445192711752, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "95ac8f889eb69b61", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382438922597478, "t_first_token_ns": 382439185252921, "t_last_token_ns": 382445905930298, "prompt_tokens": 4026, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "70cae603829190e5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382439160927208, "t_first_token_ns": 382439428846049, "t_last_token_ns": 382445935280706, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "2769a82161526fa2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382439467984936, "t_first_token_ns": 382439737177607, "t_last_token_ns": 382446054712022, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "7a3ae284fd025e54", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382439612710610, "t_first_token_ns": 382439979195013, "t_last_token_ns": 382446083950577, "prompt_tokens": 3951, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8c7ebece6fc8ef96", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382440170206384, "t_first_token_ns": 382440442066324, "t_last_token_ns": 382446377633851, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8a6e9ed8388bab88", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382440289587605, "t_first_token_ns": 382440950969850, "t_last_token_ns": 382446401628484, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "291192528bfcd0d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382440378392441, "t_first_token_ns": 382440950474266, "t_last_token_ns": 382446401778723, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "29aa5369f15ef8ed", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382440757795029, "t_first_token_ns": 382441144284197, "t_last_token_ns": 382446412736549, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "7d168f7f34914df8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382441309388810, "t_first_token_ns": 382441592635961, "t_last_token_ns": 382446570064080, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "5949b30b5660db44", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382441438015460, "t_first_token_ns": 382441859834831, "t_last_token_ns": 382446590096511, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "dee2814e53c1133c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382441975959999, "t_first_token_ns": 382442256420634, "t_last_token_ns": 382446701824931, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "d3d6d687b1270d0c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382442269107707, "t_first_token_ns": 382442541951337, "t_last_token_ns": 382446731430437, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "0114c7c017f510dc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382444384297948, "t_first_token_ns": 382444666814468, "t_last_token_ns": 382448570089387, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "6b23ad60e8365056", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382444448698891, "t_first_token_ns": 382444928950527, "t_last_token_ns": 382448590598469, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "c147b43b07e42731", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382447013425270, "t_first_token_ns": 382447266047466, "t_last_token_ns": 382451710024007, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "d6e4d018b0cbaea9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382447368720581, "t_first_token_ns": 382447631457694, "t_last_token_ns": 382452146409124, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "6a3c0ae558f764fa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382447837183982, "t_first_token_ns": 382448097688268, "t_last_token_ns": 382452506332984, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "6f4afc5b3b7d8068", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382447945273506, "t_first_token_ns": 382448341929293, "t_last_token_ns": 382452530649478, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "e2a3bc5ca5dd8e06", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382448792375180, "t_first_token_ns": 382449057720674, "t_last_token_ns": 382453092189001, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "750b6e6f651a9619", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382448933775290, "t_first_token_ns": 382449304107276, "t_last_token_ns": 382453112039595, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "088884483a9971d8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382449212908720, "t_first_token_ns": 382449765983825, "t_last_token_ns": 382453127777284, "prompt_tokens": 4025, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "318a0f6dc8a5806d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382449229982668, "t_first_token_ns": 382449766179480, "t_last_token_ns": 382453127902117, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "60fa44dd296e868f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382449506948011, "t_first_token_ns": 382450014265300, "t_last_token_ns": 382453140448338, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "be5160126f3a14e8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382451792046929, "t_first_token_ns": 382452064186965, "t_last_token_ns": 382453925982691, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "31994709d9d43ecc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382454362144895, "t_first_token_ns": 382454617475530, "t_last_token_ns": 382456677101078, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "ebb3f3698c984adb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382455272303246, "t_first_token_ns": 382455529012501, "t_last_token_ns": 382457792269315, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "a0f7008353f8beb2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382455275527482, "t_first_token_ns": 382455763865191, "t_last_token_ns": 382457798590489, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "7eac0cde0fd34276", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382457154279527, "t_first_token_ns": 382457415663145, "t_last_token_ns": 382459136315954, "prompt_tokens": 4019, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "95601ae65eae9166", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382458519014415, "t_first_token_ns": 382458775363414, "t_last_token_ns": 382461775777394, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "189d08c7b9ae2624", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382459502179916, "t_first_token_ns": 382459760837769, "t_last_token_ns": 382463993698558, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "607beffbb7acca39", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382459634061552, "t_first_token_ns": 382460219885361, "t_last_token_ns": 382464016879370, "prompt_tokens": 3953, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "93918e85acdf8b5d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382459705304225, "t_first_token_ns": 382460220190030, "t_last_token_ns": 382464017362528, "prompt_tokens": 4052, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "de6c910bd8be862f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382460062778526, "t_first_token_ns": 382460462139348, "t_last_token_ns": 382464034152066, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "776a9724799617aa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382461508843542, "t_first_token_ns": 382461775693883, "t_last_token_ns": 382465384806618, "prompt_tokens": 3955, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "b6357510a726d24b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382462084901575, "t_first_token_ns": 382462357246820, "t_last_token_ns": 382465970711712, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "7814350e435d2264", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382462974956284, "t_first_token_ns": 382463244583335, "t_last_token_ns": 382466653527027, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "c354ffa98aea604a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382463152644356, "t_first_token_ns": 382463495303606, "t_last_token_ns": 382466668212875, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "b95654a80317948f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382463647248147, "t_first_token_ns": 382463916896184, "t_last_token_ns": 382467265576288, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "d3983c9d6e42e3df", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382464472111144, "t_first_token_ns": 382464734089563, "t_last_token_ns": 382467738975882, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f12e1b2630a2dfcc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382465634355094, "t_first_token_ns": 382465897675055, "t_last_token_ns": 382468970527033, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "26aa2698c0cddf5a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382466732208704, "t_first_token_ns": 382466994108335, "t_last_token_ns": 382469959668954, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "1dd5dcf6889436bf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382466909538981, "t_first_token_ns": 382467238570993, "t_last_token_ns": 382469974719268, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "55f20a37c1e89743", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382468287338760, "t_first_token_ns": 382468551454768, "t_last_token_ns": 382472309585383, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "e013af03a51488e2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382468450592952, "t_first_token_ns": 382468795594395, "t_last_token_ns": 382472328366364, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4fefe92b23621583", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382469530792393, "t_first_token_ns": 382469795228681, "t_last_token_ns": 382473260671312, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "5af9d220c4dd9318", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382470071632420, "t_first_token_ns": 382470331206993, "t_last_token_ns": 382474272253525, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "a3ff67ad251967cf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382470210283982, "t_first_token_ns": 382470573707444, "t_last_token_ns": 382474291068276, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "c9258f74cc827511", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382470803017339, "t_first_token_ns": 382471065284026, "t_last_token_ns": 382474556321540, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "140eb88bb615ba37", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382471290160497, "t_first_token_ns": 382471559753754, "t_last_token_ns": 382474770567684, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "d4a164b2ff3b3509", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382473414542570, "t_first_token_ns": 382473679724791, "t_last_token_ns": 382476127118405, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "9f1266f29a9e8b28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382473445005968, "t_first_token_ns": 382473916338608, "t_last_token_ns": 382476132562562, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "57c78bedb1e5433a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382473566563150, "t_first_token_ns": 382474151063736, "t_last_token_ns": 382476136336060, "prompt_tokens": 3957, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "08ff3938b9e3ae71", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382476295109479, "t_first_token_ns": 382476550216865, "t_last_token_ns": 382480084840128, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "fc976d1e97a41cca", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382477486016430, "t_first_token_ns": 382477745650670, "t_last_token_ns": 382482414526694, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "6c45ae3b99de1e62", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382477594839270, "t_first_token_ns": 382478026788300, "t_last_token_ns": 382482437249163, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "417d200da6fc7d82", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382477768996297, "t_first_token_ns": 382478224680993, "t_last_token_ns": 382482447676552, "prompt_tokens": 4042, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "2b45e140974d73b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382478286209490, "t_first_token_ns": 382478546159467, "t_last_token_ns": 382482571618890, "prompt_tokens": 3948, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4809e923113cfa22", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382478400750739, "t_first_token_ns": 382478794183956, "t_last_token_ns": 382482591954567, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "b80243b2ea980e07", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382478697175974, "t_first_token_ns": 382479253383133, "t_last_token_ns": 382482607560641, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "1baef27c84916aa0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382478662567849, "t_first_token_ns": 382479253272657, "t_last_token_ns": 382482607838615, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "efd5183f824026cc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382479526718914, "t_first_token_ns": 382479803334785, "t_last_token_ns": 382482781775044, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "df3338f95a55a940", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382479582470896, "t_first_token_ns": 382480047354178, "t_last_token_ns": 382482790919117, "prompt_tokens": 3921, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "973d64287adcd8a7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382483064886146, "t_first_token_ns": 382483315719026, "t_last_token_ns": 382484536420131, "prompt_tokens": 3934, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "19674684ced3de91", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382484754332925, "t_first_token_ns": 382485009723647, "t_last_token_ns": 382486562576231, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "e6fa68dd3de56239", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382485791833395, "t_first_token_ns": 382486050153133, "t_last_token_ns": 382488348675781, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "ec06f5beb70436d9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382486778895482, "t_first_token_ns": 382487037893477, "t_last_token_ns": 382490624167990, "prompt_tokens": 4040, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "034f1151aa2d2bdd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382487085210739, "t_first_token_ns": 382487343912089, "t_last_token_ns": 382490772830448, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "d156973f3cae174d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382487842932072, "t_first_token_ns": 382488107761289, "t_last_token_ns": 382492064647727, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "c2a0107acab59bd0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382488798198258, "t_first_token_ns": 382489061893733, "t_last_token_ns": 382493232248598, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "25faaab088637291", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382489235731063, "t_first_token_ns": 382489497882232, "t_last_token_ns": 382493975534288, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4a6ff2135636c100", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382489280247392, "t_first_token_ns": 382489735263829, "t_last_token_ns": 382493986443913, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "70f1b6f6bad6005a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382489936547679, "t_first_token_ns": 382490201628971, "t_last_token_ns": 382494219336248, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "485e723c2b84eb6b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382490200994411, "t_first_token_ns": 382490474208550, "t_last_token_ns": 382494255288383, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "6be120b83e225aa3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382490829087298, "t_first_token_ns": 382491096050472, "t_last_token_ns": 382494799554578, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "291a0df34911423c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382491194007215, "t_first_token_ns": 382491460992366, "t_last_token_ns": 382494890810440, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "9a771254d6418297", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382493226986312, "t_first_token_ns": 382493499283891, "t_last_token_ns": 382497243595179, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "3d63e1d817747a07", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382493377569753, "t_first_token_ns": 382493749298011, "t_last_token_ns": 382497262616849, "prompt_tokens": 4011, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "a85143fddaf4a5d9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382494354993420, "t_first_token_ns": 382494615993462, "t_last_token_ns": 382497929637802, "prompt_tokens": 3953, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "ed998b60c04d0117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382495155354715, "t_first_token_ns": 382495421665947, "t_last_token_ns": 382500920313094, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "10c050e2cad99a17", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382495697920101, "t_first_token_ns": 382495963228080, "t_last_token_ns": 382501748435860, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "03bc3ccba18fc900", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382495754699453, "t_first_token_ns": 382496426353180, "t_last_token_ns": 382501776136824, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "6ca800f53f978a58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382495875735543, "t_first_token_ns": 382496426442487, "t_last_token_ns": 382501776330229, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "0d6ebbadc6b6f44a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382498155875052, "t_first_token_ns": 382498446433637, "t_last_token_ns": 382505462079780, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "2225316b65c25005", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382498332760132, "t_first_token_ns": 382498690592166, "t_last_token_ns": 382505494237853, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "48f171c96419c86f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382498452220455, "t_first_token_ns": 382498929296884, "t_last_token_ns": 382505511018130, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "53e2a3f9153c46d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382498680321517, "t_first_token_ns": 382499174378195, "t_last_token_ns": 382505539491266, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8f000c5b2b8ac58e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382499194643124, "t_first_token_ns": 382499468350138, "t_last_token_ns": 382505626778294, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "601066832f30b428", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382499684243574, "t_first_token_ns": 382499960670296, "t_last_token_ns": 382505955281317, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "bf6ab969a046d65b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382499690680877, "t_first_token_ns": 382500413097914, "t_last_token_ns": 382505969596833, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "d417d380a4f40330", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382499687588662, "t_first_token_ns": 382500413986604, "t_last_token_ns": 382505970138023, "prompt_tokens": 3970, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "d23fe5d3ae909682", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382500148946424, "t_first_token_ns": 382500880741948, "t_last_token_ns": 382505993874864, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "08d7416f17740d2e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382500285778410, "t_first_token_ns": 382500881197127, "t_last_token_ns": 382505994237693, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "f63c4d00aca7e8d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382500910329182, "t_first_token_ns": 382501189339488, "t_last_token_ns": 382506284106012, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "72e028e252e47e71", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382501978976396, "t_first_token_ns": 382502261558163, "t_last_token_ns": 382507367884139, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "90e18fcccb2043f7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382502046453211, "t_first_token_ns": 382502511742224, "t_last_token_ns": 382507390351589, "prompt_tokens": 3956, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "7e9fdd59228f0876", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382502516188899, "t_first_token_ns": 382502795910463, "t_last_token_ns": 382507429090512, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "245bf7e5865d03d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382502865829021, "t_first_token_ns": 382503143740173, "t_last_token_ns": 382507507343488, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "2033b1bb6c32c79a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382503908780746, "t_first_token_ns": 382504191323242, "t_last_token_ns": 382507936069608, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "0f0a89285f54e2c1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382505974184533, "t_first_token_ns": 382506240719957, "t_last_token_ns": 382512575213051, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "da6f35b293578e17", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382506334792956, "t_first_token_ns": 382506597397852, "t_last_token_ns": 382512754521545, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "6c160ab03b66d81b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382506521102124, "t_first_token_ns": 382506844462678, "t_last_token_ns": 382512783409796, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "acad4eb8b9a0e9f6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382507927324678, "t_first_token_ns": 382508184796558, "t_last_token_ns": 382516793729695, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "502a12aa8ba51234", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382507946485977, "t_first_token_ns": 382508420349646, "t_last_token_ns": 382516813996890, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "c0e0a7d3c8cf4b95", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382508215141384, "t_first_token_ns": 382508664942341, "t_last_token_ns": 382516852847142, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "541738310001dd1c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382508550871264, "t_first_token_ns": 382508908224668, "t_last_token_ns": 382516887643500, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "525463c05dc42958", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382508682327065, "t_first_token_ns": 382509142379808, "t_last_token_ns": 382516903692291, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "3926bdb966d6e395", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382509442789565, "t_first_token_ns": 382509715139829, "t_last_token_ns": 382517692214247, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "586a0d3540151470", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382509931249037, "t_first_token_ns": 382510200647732, "t_last_token_ns": 382518077571210, "prompt_tokens": 3929, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "37c5cdb56477a163", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382510122966465, "t_first_token_ns": 382510451647261, "t_last_token_ns": 382518107973431, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "5947be4f56ddbab5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382510479547209, "t_first_token_ns": 382510757565536, "t_last_token_ns": 382518430502259, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "2fe62cb82ee987a4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382511265191378, "t_first_token_ns": 382511544026473, "t_last_token_ns": 382520010758384, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "8c278419850c8b5e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382511528235553, "t_first_token_ns": 382511812071381, "t_last_token_ns": 382520064199218, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "021ff28eaacd14c5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382511576266103, "t_first_token_ns": 382512054538001, "t_last_token_ns": 382520081980815, "prompt_tokens": 3959, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "faaf800e58c8f85f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382511988602843, "t_first_token_ns": 382512305847801, "t_last_token_ns": 382520138797371, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "744f358ad7f63e97", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382512134262340, "t_first_token_ns": 382512558259585, "t_last_token_ns": 382520368976103, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "927918347bcc40c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382512782697171, "t_first_token_ns": 382513072882974, "t_last_token_ns": 382520676841536, "prompt_tokens": 4032, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "2fcef28ebf707351", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382512933430842, "t_first_token_ns": 382513539463682, "t_last_token_ns": 382520707349885, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "fe233f2c57e680fd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382513030737352, "t_first_token_ns": 382513539792576, "t_last_token_ns": 382520707639984, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "b95acf9eb3705d28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382514527718437, "t_first_token_ns": 382514811760873, "t_last_token_ns": 382522795028695, "prompt_tokens": 4011, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "96b58f314a838835", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382514795552424, "t_first_token_ns": 382515090939441, "t_last_token_ns": 382522839641262, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "08456882f8d362d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382515026862060, "t_first_token_ns": 382515348875802, "t_last_token_ns": 382522870704951, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "4c8bd15a715f7720", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382515543192642, "t_first_token_ns": 382515845820383, "t_last_token_ns": 382523290208732, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "6949ec56d00ce8b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382516331822228, "t_first_token_ns": 382516614480687, "t_last_token_ns": 382523929889233, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "0fce2da54ec51dfd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382517073924545, "t_first_token_ns": 382517351952672, "t_last_token_ns": 382525062155518, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "4238f6957ae36e57", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382518142696218, "t_first_token_ns": 382518429368359, "t_last_token_ns": 382526993670530, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "943ff34258d40d28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382518344386201, "t_first_token_ns": 382518682842460, "t_last_token_ns": 382527033833241, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "dfca62202759aa8a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382518716450255, "t_first_token_ns": 382518998315088, "t_last_token_ns": 382527133404845, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "4397f621098474f5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382519019117753, "t_first_token_ns": 382519313348320, "t_last_token_ns": 382527216881599, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "beebd08c7cc682ce", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382519504991884, "t_first_token_ns": 382519793548537, "t_last_token_ns": 382527496248745, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "7c168a9454ca5620", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382520074984992, "t_first_token_ns": 382520355215427, "t_last_token_ns": 382527794548337, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "affa6c57b9777216", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382520737406251, "t_first_token_ns": 382521021190792, "t_last_token_ns": 382528454442242, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "e5ffcb3c7f664dc7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382520785147939, "t_first_token_ns": 382521263319061, "t_last_token_ns": 382528470519248, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "a024c6b1441ebbd3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382521095248115, "t_first_token_ns": 382521517865045, "t_last_token_ns": 382528500130872, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "17af21e67df524a9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382521917465814, "t_first_token_ns": 382522214574313, "t_last_token_ns": 382529162055877, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "80ff547317c08b98", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382521942946875, "t_first_token_ns": 382522446209121, "t_last_token_ns": 382529175209725, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "70a5b87cfadecff6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382522858195956, "t_first_token_ns": 382523139238024, "t_last_token_ns": 382529549448010, "prompt_tokens": 3945, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "843c0165f72929a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382523630626089, "t_first_token_ns": 382523916049615, "t_last_token_ns": 382530284140975, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "73b4128afce8e243", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382523975291321, "t_first_token_ns": 382524252905006, "t_last_token_ns": 382530385318937, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "205e89d222fdda00", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382524374438289, "t_first_token_ns": 382524661860477, "t_last_token_ns": 382530557660267, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "7117082172557ca5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382524579480604, "t_first_token_ns": 382524918039124, "t_last_token_ns": 382530581854788, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "7cc19a30a453f5f4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382525471524807, "t_first_token_ns": 382525754941155, "t_last_token_ns": 382531044787077, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "8ba8086b8eec10d6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382525909213754, "t_first_token_ns": 382526201111035, "t_last_token_ns": 382531185251712, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "ec1a4c4a2ea7ed12", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382526137329232, "t_first_token_ns": 382526672910762, "t_last_token_ns": 382531204541312, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "6b0f100f2f9945ac", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382526115532501, "t_first_token_ns": 382526672077235, "t_last_token_ns": 382531204891242, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "768828307182d0ad", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382526420089946, "t_first_token_ns": 382526934569338, "t_last_token_ns": 382531220875941, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "034e749c721e456f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382528112549250, "t_first_token_ns": 382528398152142, "t_last_token_ns": 382533588060933, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "73a8827fa8847e13", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382528865442733, "t_first_token_ns": 382529149305356, "t_last_token_ns": 382534012442599, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "bbcdf2009f998102", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382529521405698, "t_first_token_ns": 382529805468501, "t_last_token_ns": 382534359967723, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "9fa8ae1957c0f1d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382531332708291, "t_first_token_ns": 382531589103058, "t_last_token_ns": 382536344777554, "prompt_tokens": 3937, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "b11891ac95fc3b64", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382531354393380, "t_first_token_ns": 382531823645133, "t_last_token_ns": 382536356702087, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "59a9a00a0d3a1563", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382531969815276, "t_first_token_ns": 382532239742398, "t_last_token_ns": 382537050425487, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "d8bfc0767d724848", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382532109765524, "t_first_token_ns": 382532480545077, "t_last_token_ns": 382537303115064, "prompt_tokens": 3937, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "345d39ae3777d415", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382532447480238, "t_first_token_ns": 382532729127077, "t_last_token_ns": 382537324636915, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "9866cbc828a4fca8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382532582135674, "t_first_token_ns": 382532977638830, "t_last_token_ns": 382537345989837, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "af397ebf951c7719", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382532868973643, "t_first_token_ns": 382533224383475, "t_last_token_ns": 382537364615236, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "65c0b4265eb5dd19", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382534414068559, "t_first_token_ns": 382534680950229, "t_last_token_ns": 382539810900573, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "89dffa88c862c5b0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382535276693870, "t_first_token_ns": 382535553025833, "t_last_token_ns": 382542180226043, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "dc476408b33fbf5a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382536525865820, "t_first_token_ns": 382536802140386, "t_last_token_ns": 382545196588445, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "319a82c9b4681316", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382536578569866, "t_first_token_ns": 382537050342553, "t_last_token_ns": 382545238586382, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "71d7c157bf1ea669", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382536817959306, "t_first_token_ns": 382537292206399, "t_last_token_ns": 382545258834833, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "2cc13ac9d11806a5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382537840579422, "t_first_token_ns": 382538112365538, "t_last_token_ns": 382546901356847, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "129148915a429e01", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382537868701528, "t_first_token_ns": 382538348065041, "t_last_token_ns": 382546923475828, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8b0e7810ec937f82", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382538067394897, "t_first_token_ns": 382538796559997, "t_last_token_ns": 382546939714805, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "df7587e4a3d50532", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382538009748837, "t_first_token_ns": 382538797411685, "t_last_token_ns": 382546940241100, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "fb520fc29874b954", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382539202081711, "t_first_token_ns": 382539477823824, "t_last_token_ns": 382548591985918, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "dd803dc1b0f0a741", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382539379029004, "t_first_token_ns": 382539727913056, "t_last_token_ns": 382548633670640, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "93327e2e45a9ea52", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382539747532476, "t_first_token_ns": 382540028246626, "t_last_token_ns": 382548719023767, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "f37f16b87565dc53", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382539757628771, "t_first_token_ns": 382540265122286, "t_last_token_ns": 382548735706172, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "3bcfa41060f2dd80", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382539839084215, "t_first_token_ns": 382540505269875, "t_last_token_ns": 382548751340308, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "5badec87742c1dc2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382540320649291, "t_first_token_ns": 382540758594664, "t_last_token_ns": 382548781037008, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "d1e7b052e89f38f0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382541366643409, "t_first_token_ns": 382541641863947, "t_last_token_ns": 382550199617221, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "36a41522c4af841a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382541645803795, "t_first_token_ns": 382541926952432, "t_last_token_ns": 382550273163689, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "56afd7a006446ce0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382541903505384, "t_first_token_ns": 382542179827927, "t_last_token_ns": 382550300301587, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "1ec26802903d0510", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382541931639474, "t_first_token_ns": 382542419352459, "t_last_token_ns": 382550315423716, "prompt_tokens": 3947, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "a642c8cc74bcd308", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382542002654835, "t_first_token_ns": 382542872366762, "t_last_token_ns": 382550329902956, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "16ab6647bde110e0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382542110595693, "t_first_token_ns": 382542871172933, "t_last_token_ns": 382550330042072, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "ab5eaa452796e93b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382542265151880, "t_first_token_ns": 382543112170170, "t_last_token_ns": 382550343382527, "prompt_tokens": 4016, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "57388896a658fda9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382542829871132, "t_first_token_ns": 382543356622004, "t_last_token_ns": 382550357334738, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "74e18421d9a9571b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382543127745832, "t_first_token_ns": 382543617624562, "t_last_token_ns": 382550383309596, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "51627206c78da939", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382545664613837, "t_first_token_ns": 382545953714992, "t_last_token_ns": 382552728980875, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "ce0e4f081e4c436a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382545888426694, "t_first_token_ns": 382546215268879, "t_last_token_ns": 382552757199943, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "9826eaf60529d07a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382547183633361, "t_first_token_ns": 382547468425600, "t_last_token_ns": 382554628407483, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f06c8516cb43f569", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382547248159920, "t_first_token_ns": 382547727188400, "t_last_token_ns": 382554657382891, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "a2fcaaf1ad76b0b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382547749305957, "t_first_token_ns": 382548035998553, "t_last_token_ns": 382554731970397, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "0edc9b51f130a612", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382548281546192, "t_first_token_ns": 382548572326827, "t_last_token_ns": 382554946612409, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "ab79c0a9dc372db9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382548996595119, "t_first_token_ns": 382549285030314, "t_last_token_ns": 382555384059798, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "284610eaafd0e42a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382549349094595, "t_first_token_ns": 382549631425279, "t_last_token_ns": 382555501894184, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "89cb2a334a9f6238", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382549844906315, "t_first_token_ns": 382550135311004, "t_last_token_ns": 382555939724336, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "7ea2d46c75d8fe9a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382550848584015, "t_first_token_ns": 382551122653883, "t_last_token_ns": 382557020885060, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "024f2a25db9d388f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382550958759520, "t_first_token_ns": 382551373648056, "t_last_token_ns": 382557049054869, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "4bff469af089d526", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382551464967050, "t_first_token_ns": 382551739366012, "t_last_token_ns": 382557407256291, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "700bf9b5ddd3a040", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382552057083001, "t_first_token_ns": 382552337968074, "t_last_token_ns": 382557717340011, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "56c8618490819588", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382553072592691, "t_first_token_ns": 382553349038330, "t_last_token_ns": 382559586778068, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "897a93d4897b76cf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382553192957626, "t_first_token_ns": 382553605272662, "t_last_token_ns": 382559645432890, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fa28b6fdceb04b0a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382553568184682, "t_first_token_ns": 382554075554532, "t_last_token_ns": 382559904878853, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "9d6d324a99e130fb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382553550527913, "t_first_token_ns": 382554075833888, "t_last_token_ns": 382559905146499, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "2b3fcd354a2135a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382554293518390, "t_first_token_ns": 382554576785937, "t_last_token_ns": 382561034799423, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "e29b1c49a4e6562a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382555644551640, "t_first_token_ns": 382555927355314, "t_last_token_ns": 382562123804150, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "729dbd22ce5934ca", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382555935793265, "t_first_token_ns": 382556207273448, "t_last_token_ns": 382562181599030, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "150d24a23cc28808", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382557066488596, "t_first_token_ns": 382557336207968, "t_last_token_ns": 382563798671707, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "1247310989ae8f13", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382557782459484, "t_first_token_ns": 382558048740890, "t_last_token_ns": 382564376890772, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "e40763fc59ed0799", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382557794629036, "t_first_token_ns": 382558288738142, "t_last_token_ns": 382564391218633, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "7db7d42bc0b6e636", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382558251041036, "t_first_token_ns": 382558757058302, "t_last_token_ns": 382564417783559, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "a0ed26ee4cdfed05", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382558218648750, "t_first_token_ns": 382558757471640, "t_last_token_ns": 382564418328997, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "c81fd9769ec09a5f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382558502828703, "t_first_token_ns": 382559008057576, "t_last_token_ns": 382564441400816, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "8a5e9c377ef0f53c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382559578902820, "t_first_token_ns": 382559859996023, "t_last_token_ns": 382567308062492, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "3bb8df688946d953", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382559669094788, "t_first_token_ns": 382560114470598, "t_last_token_ns": 382567344245123, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "448dfb7bcf90f1f3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382560225661693, "t_first_token_ns": 382560501719488, "t_last_token_ns": 382567993931385, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "33ee8dfa5d511f36", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382560266757746, "t_first_token_ns": 382560737065548, "t_last_token_ns": 382568011710697, "prompt_tokens": 3947, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fe73928ec06f2ffd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382560345407185, "t_first_token_ns": 382560975847633, "t_last_token_ns": 382568025666052, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "b3b98aab260b94f5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382562373129078, "t_first_token_ns": 382562648740542, "t_last_token_ns": 382569588593134, "prompt_tokens": 3962, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "ea50a73400df1150", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382562571701115, "t_first_token_ns": 382563117337441, "t_last_token_ns": 382569617372914, "prompt_tokens": 4063, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "0616a2c3128fe7ad", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382562441514880, "t_first_token_ns": 382563117511254, "t_last_token_ns": 382569617663398, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "4608dc5a783e53a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382564449347157, "t_first_token_ns": 382564725894402, "t_last_token_ns": 382570925571422, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "d2629c04025d1ad2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382564696510896, "t_first_token_ns": 382564973569712, "t_last_token_ns": 382570953214148, "prompt_tokens": 3959, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "871a29b70510a5f2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382564860143833, "t_first_token_ns": 382565437437664, "t_last_token_ns": 382570980983956, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "78ec14117dc5c5e0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382564928741655, "t_first_token_ns": 382565437734558, "t_last_token_ns": 382570981215086, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "83b69b3a671f955d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382565390713102, "t_first_token_ns": 382565691330741, "t_last_token_ns": 382571034768598, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "7174a671812eb138", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382565431953109, "t_first_token_ns": 382565931902618, "t_last_token_ns": 382571249452883, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "51ff885b54684fc5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382565598437190, "t_first_token_ns": 382566171529197, "t_last_token_ns": 382571257834811, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "37f77dec01a5a091", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382565766199083, "t_first_token_ns": 382566411909532, "t_last_token_ns": 382571266591490, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "280e5ba3748db94d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382566678906660, "t_first_token_ns": 382566968474355, "t_last_token_ns": 382571486280077, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "e4a29ae517fc90cb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382566797223086, "t_first_token_ns": 382567225346580, "t_last_token_ns": 382571501103915, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "191f846cb9f66a8d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382567389123840, "t_first_token_ns": 382567676808515, "t_last_token_ns": 382571603445113, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "35f7d27c1cba45d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382567574174075, "t_first_token_ns": 382567936852443, "t_last_token_ns": 382571615902759, "prompt_tokens": 4008, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "7c00e83d6e1dd0e6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382570966429048, "t_first_token_ns": 382571249315667, "t_last_token_ns": 382572627166715, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "3d4d2bb9bff4449a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382574080931525, "t_first_token_ns": 382574338697970, "t_last_token_ns": 382575560814792, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "7272725ee8fd0540", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382575799750264, "t_first_token_ns": 382576055222955, "t_last_token_ns": 382577278144728, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "a2fea85d23f1bda3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382577335846602, "t_first_token_ns": 382577590433097, "t_last_token_ns": 382579243658877, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "011158111ca19afe", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382577874140165, "t_first_token_ns": 382578130799988, "t_last_token_ns": 382579553343952, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "8da37110844555c6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382579656166374, "t_first_token_ns": 382579912533024, "t_last_token_ns": 382582250437266, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "d8b99c661f516313", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382580337338311, "t_first_token_ns": 382580597104657, "t_last_token_ns": 382583718961424, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "a02c08c718952117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382580453669521, "t_first_token_ns": 382580835793972, "t_last_token_ns": 382583739085671, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "85285854a309da38", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382581332761994, "t_first_token_ns": 382581592624269, "t_last_token_ns": 382584661887497, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "7ddc31684732a450", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382582595348050, "t_first_token_ns": 382582861458895, "t_last_token_ns": 382587175204698, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "536791c815121f58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382582605773245, "t_first_token_ns": 382583097875675, "t_last_token_ns": 382587185679221, "prompt_tokens": 4023, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "8576f22a0c427bbf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382582751115895, "t_first_token_ns": 382583331982632, "t_last_token_ns": 382587196964924, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "ca99a4a5056f40d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382583774507189, "t_first_token_ns": 382584037681433, "t_last_token_ns": 382587698640192, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "5838d0fe27e1457f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382584749198686, "t_first_token_ns": 382585018681905, "t_last_token_ns": 382588960257822, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "816823128084eebd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382585298111091, "t_first_token_ns": 382585562600934, "t_last_token_ns": 382589553589211, "prompt_tokens": 3932, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "bb0921b5e49295ee", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382585385854383, "t_first_token_ns": 382585808354347, "t_last_token_ns": 382589572713505, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "346cf978d3834bc0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382585592478956, "t_first_token_ns": 382586271411803, "t_last_token_ns": 382589592712137, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "c886d982435860b7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382585772484656, "t_first_token_ns": 382586271515796, "t_last_token_ns": 382589592845374, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "fdbc4ac00b838337", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382588401071195, "t_first_token_ns": 382588673725478, "t_last_token_ns": 382592472661119, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "fa46f37dea905ba5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382588571935919, "t_first_token_ns": 382588919256100, "t_last_token_ns": 382592491429134, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3e44df05b71a3966", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382588881307614, "t_first_token_ns": 382589173162091, "t_last_token_ns": 382592510106245, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8ee00ef0ad273d5c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382589660512707, "t_first_token_ns": 382589919211203, "t_last_token_ns": 382592910991737, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "abfce48fa7fd10f9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382590386545936, "t_first_token_ns": 382590641286113, "t_last_token_ns": 382593640080068, "prompt_tokens": 3927, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4f100560326929ab", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382590937795484, "t_first_token_ns": 382591204098999, "t_last_token_ns": 382593899241616, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f83672c4afe7b491", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382591640783966, "t_first_token_ns": 382591907718982, "t_last_token_ns": 382594204090484, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8683501cd7f36932", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382592976712053, "t_first_token_ns": 382593237180182, "t_last_token_ns": 382595488124510, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "3ce62a1f03d2a106", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382594612744689, "t_first_token_ns": 382594871240230, "t_last_token_ns": 382597428559484, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "34360b76a6f05a1c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382594710568633, "t_first_token_ns": 382595322953692, "t_last_token_ns": 382597442699065, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "0b7dbbfb7b402e80", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382594689869866, "t_first_token_ns": 382595323250425, "t_last_token_ns": 382597442838083, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "9ca5d6660027739d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382596343868776, "t_first_token_ns": 382596603679810, "t_last_token_ns": 382598898246971, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "1fe7cbb011f5427a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382597951767532, "t_first_token_ns": 382598209244942, "t_last_token_ns": 382603111407515, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "dffdc06a4b36683c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382598258107446, "t_first_token_ns": 382598518078461, "t_last_token_ns": 382603302383564, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "caced4db24115828", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382598598969736, "t_first_token_ns": 382598862406811, "t_last_token_ns": 382603483417617, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "9b16f710bda9505d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382599369464812, "t_first_token_ns": 382599630674292, "t_last_token_ns": 382604776662918, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "cb7c10754f5ce5fe", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382599734831951, "t_first_token_ns": 382599996914894, "t_last_token_ns": 382604986444551, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "88ffbcb6bc7f56b1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382599813931783, "t_first_token_ns": 382600241912454, "t_last_token_ns": 382605009405734, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "78e331e87c45a189", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382600007211604, "t_first_token_ns": 382600481649840, "t_last_token_ns": 382605020451011, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "456ef7ed125277b0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382600249709097, "t_first_token_ns": 382600728664289, "t_last_token_ns": 382605039352293, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "89f55bed6ffb548a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382600807260847, "t_first_token_ns": 382601082572196, "t_last_token_ns": 382605378318623, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3d3ab1fae05f0d2a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382600934668608, "t_first_token_ns": 382601329509161, "t_last_token_ns": 382605398328110, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "335bb26db7a2003b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382601804697441, "t_first_token_ns": 382602081057022, "t_last_token_ns": 382605703794103, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "dfbdddceda574c5e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382604138808006, "t_first_token_ns": 382604417109275, "t_last_token_ns": 382607780724734, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "59fcfa5724d8e7b3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382604463399434, "t_first_token_ns": 382604737711650, "t_last_token_ns": 382607858135168, "prompt_tokens": 4019, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "cfe7772de6d17d6b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382605027417738, "t_first_token_ns": 382605296610285, "t_last_token_ns": 382608341548119, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "59bba69a8d667e3e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382605702810796, "t_first_token_ns": 382605962106250, "t_last_token_ns": 382608761880958, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "108739472aeef7cd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382606769506495, "t_first_token_ns": 382607031901233, "t_last_token_ns": 382610251468021, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "7912548face9904f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382607431429213, "t_first_token_ns": 382607701453591, "t_last_token_ns": 382610597334965, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9ad61f308977eb83", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382607916873006, "t_first_token_ns": 382608179456333, "t_last_token_ns": 382611038121273, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "3491e86c0fd93ddb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382608767732849, "t_first_token_ns": 382609029865383, "t_last_token_ns": 382611584171990, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "48e9daddae7ddfde", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382608784823455, "t_first_token_ns": 382609259091611, "t_last_token_ns": 382611590752625, "prompt_tokens": 3921, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "30336ab3d8b85b24", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382610658711582, "t_first_token_ns": 382610920092059, "t_last_token_ns": 382612627197968, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "9a3fd26f54c1be0a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382612185934681, "t_first_token_ns": 382612441911073, "t_last_token_ns": 382617752860247, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "6b4b03f7f400b478", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382612975456832, "t_first_token_ns": 382613236139936, "t_last_token_ns": 382619830767298, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "79c09b32b572e89b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382613126145106, "t_first_token_ns": 382613474638939, "t_last_token_ns": 382620088647314, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "96d046514314461d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382613781568005, "t_first_token_ns": 382614046072206, "t_last_token_ns": 382622324692434, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "185f1dbdea6d23c0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382613801771400, "t_first_token_ns": 382614282813567, "t_last_token_ns": 382622546584608, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1d800c9aabc32617", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382614140534238, "t_first_token_ns": 382614528629372, "t_last_token_ns": 382622586903252, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "6c8d620872c9187d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382614303396558, "t_first_token_ns": 382614766305061, "t_last_token_ns": 382622603304503, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "48598702f53ca2f3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382614853586256, "t_first_token_ns": 382615127444049, "t_last_token_ns": 382623035928644, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "f2db9e461e72ad78", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382615047039537, "t_first_token_ns": 382615375390439, "t_last_token_ns": 382623070540173, "prompt_tokens": 4022, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "f80c2c460ec65e32", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382615112254296, "t_first_token_ns": 382615612938994, "t_last_token_ns": 382623090782483, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "ab3000c06ac776bf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382616166292054, "t_first_token_ns": 382616446936306, "t_last_token_ns": 382624111749835, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "0bf5905c1e8121bd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382616359836484, "t_first_token_ns": 382616695469738, "t_last_token_ns": 382624138513963, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "1098d56d526989cc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382616907328585, "t_first_token_ns": 382617184597708, "t_last_token_ns": 382624646061823, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "137d70d1f46c03a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382616918886513, "t_first_token_ns": 382617424718378, "t_last_token_ns": 382624660854127, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "cebd470b51f7fe4e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382617471888185, "t_first_token_ns": 382617753286606, "t_last_token_ns": 382624766884824, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "a151e7b5b68ad9ae", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382618510166978, "t_first_token_ns": 382618798558045, "t_last_token_ns": 382625794212452, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "4eca794d265710c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382619535415276, "t_first_token_ns": 382619817483411, "t_last_token_ns": 382626839078789, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "dff220b2b2e49d3a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382619801849885, "t_first_token_ns": 382620089116455, "t_last_token_ns": 382626884459900, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "82efcb8a8e11e6c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382619893994646, "t_first_token_ns": 382620343025535, "t_last_token_ns": 382626913631946, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "2b2b27c2bbba748c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382620522125017, "t_first_token_ns": 382620809172432, "t_last_token_ns": 382627155310471, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "22232cfe893b9166", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382620766452730, "t_first_token_ns": 382621067966093, "t_last_token_ns": 382627184013886, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "139fa79bf7516bed", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382620992774617, "t_first_token_ns": 382621326474415, "t_last_token_ns": 382627206539923, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "d725af190f423c10", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382621151041603, "t_first_token_ns": 382621585834867, "t_last_token_ns": 382627229353932, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "1d3e84737b4620da", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382621484792832, "t_first_token_ns": 382621848389552, "t_last_token_ns": 382627253438175, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "2375944c4224b637", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382622250265387, "t_first_token_ns": 382622546427396, "t_last_token_ns": 382627472390105, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "657154f7593762d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382622593318594, "t_first_token_ns": 382622885049345, "t_last_token_ns": 382627533520468, "prompt_tokens": 4032, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "4e50ce56d0618fec", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382623287183845, "t_first_token_ns": 382623567840547, "t_last_token_ns": 382627784378581, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "cea59338a3b0a9b3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382624155490889, "t_first_token_ns": 382624441285825, "t_last_token_ns": 382628052105141, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "f4dd02509a77bddd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382625265836301, "t_first_token_ns": 382625552422283, "t_last_token_ns": 382628428544692, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "0e7beafea7584ff7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382625830855653, "t_first_token_ns": 382626107186652, "t_last_token_ns": 382628533811478, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "b97b84e328b625d3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382628923914909, "t_first_token_ns": 382629180169679, "t_last_token_ns": 382631589018567, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "651186d1dd6c15a6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382629389956720, "t_first_token_ns": 382629650650655, "t_last_token_ns": 382631952646134, "prompt_tokens": 4033, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "b6350e463220e4e6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382629904813735, "t_first_token_ns": 382630164883485, "t_last_token_ns": 382632244227486, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "358015cbb66d10de", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382630621381850, "t_first_token_ns": 382630887387303, "t_last_token_ns": 382632568227979, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "50705bd15064c6d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382632990383086, "t_first_token_ns": 382633247972576, "t_last_token_ns": 382634850918943, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "ecb80a17721044a3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382633798340499, "t_first_token_ns": 382634057916373, "t_last_token_ns": 382635439704921, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "41abb79477b47f91", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382635457515427, "t_first_token_ns": 382635713454340, "t_last_token_ns": 382638716266599, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "721ebf229a030a95", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382635574712257, "t_first_token_ns": 382635948997253, "t_last_token_ns": 382638732869989, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "3a340945700f2c58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382635941067708, "t_first_token_ns": 382636201410606, "t_last_token_ns": 382638761450073, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "2170390234b5ae2d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382636752761436, "t_first_token_ns": 382637010645268, "t_last_token_ns": 382641373829182, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "076476fea8382967", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382637633177994, "t_first_token_ns": 382637898506646, "t_last_token_ns": 382643094635091, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "ff52490f95172d67", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382638815463934, "t_first_token_ns": 382639076874831, "t_last_token_ns": 382645669974580, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "e924d3bcedd387fb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382639023211601, "t_first_token_ns": 382639318160388, "t_last_token_ns": 382645700044826, "prompt_tokens": 3970, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "b877892f91ecec34", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382639276272651, "t_first_token_ns": 382639560938630, "t_last_token_ns": 382645731114800, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1caf880a2fbf12e5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382639631702127, "t_first_token_ns": 382639900222621, "t_last_token_ns": 382645908429837, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9a1cf60f1b871ded", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382639964919019, "t_first_token_ns": 382640237664723, "t_last_token_ns": 382646078192685, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "a95165328c12522a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382640030166019, "t_first_token_ns": 382640485104982, "t_last_token_ns": 382646106175075, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "db3cb451a123fd7b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382640359872632, "t_first_token_ns": 382640732399370, "t_last_token_ns": 382646134528413, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "ec19d55d7bc56117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382641045919245, "t_first_token_ns": 382641320145087, "t_last_token_ns": 382647212193436, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "45f17bcf193b6eb1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382641943386257, "t_first_token_ns": 382642214367593, "t_last_token_ns": 382649410290192, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "0a1426ca17d726a2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382642118594502, "t_first_token_ns": 382642465926278, "t_last_token_ns": 382649648227693, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "85f92136d0577f5c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382642765354378, "t_first_token_ns": 382643041491261, "t_last_token_ns": 382650521986283, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "c68c8ac2cefadeda", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382643694656559, "t_first_token_ns": 382643979069890, "t_last_token_ns": 382651818444024, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "39ec2bfef2cc660c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382643819274870, "t_first_token_ns": 382644495852057, "t_last_token_ns": 382651851998171, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "5c5ae6e010163893", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382643807866370, "t_first_token_ns": 382644495740634, "t_last_token_ns": 382651852134928, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "bc830bbd57c31dfd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382643936258268, "t_first_token_ns": 382644683876827, "t_last_token_ns": 382651866994160, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "f8dfa76d3272924c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382644694178075, "t_first_token_ns": 382644981867664, "t_last_token_ns": 382652162169643, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "6a0616efb0ee2261", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382646325160423, "t_first_token_ns": 382646598800794, "t_last_token_ns": 382653847139926, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "9be8cd07b75dc5e7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382646652025676, "t_first_token_ns": 382646934746011, "t_last_token_ns": 382653967232416, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "213c753a2902d374", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382646902773735, "t_first_token_ns": 382647185543008, "t_last_token_ns": 382654222739778, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "4e27c91846d4e17d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382647562720414, "t_first_token_ns": 382647847796746, "t_last_token_ns": 382654699488115, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "1b02d1736bed2783", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382647816876012, "t_first_token_ns": 382648099191597, "t_last_token_ns": 382654728705328, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "044505f55ee8eb29", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382647844155053, "t_first_token_ns": 382648339645763, "t_last_token_ns": 382654737811643, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "9b6468d2f524b689", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382648033644327, "t_first_token_ns": 382648581315896, "t_last_token_ns": 382654751281718, "prompt_tokens": 4015, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "0576ac2b072d4f41", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382648646217023, "t_first_token_ns": 382648925414862, "t_last_token_ns": 382654866453891, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "1904f89e3ffa195e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382649055063227, "t_first_token_ns": 382649334800922, "t_last_token_ns": 382655022297548, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "278330e7e052f152", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382649339549243, "t_first_token_ns": 382649632097745, "t_last_token_ns": 382655518210936, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "783382169706baf2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382649671953950, "t_first_token_ns": 382649949800213, "t_last_token_ns": 382656044365014, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "fd3f7b073d883ae7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382649771409823, "t_first_token_ns": 382650207119581, "t_last_token_ns": 382656070426675, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "16236450faab7663", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382650744705993, "t_first_token_ns": 382651026020413, "t_last_token_ns": 382656506025336, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f702da4e623d7579", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382651057413341, "t_first_token_ns": 382651348808768, "t_last_token_ns": 382657009927202, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "d9555469adb82bd6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382651839186630, "t_first_token_ns": 382652123180589, "t_last_token_ns": 382657392297966, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "47bdac1c5663cca9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382652400437898, "t_first_token_ns": 382652680543786, "t_last_token_ns": 382657642326492, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "af1d9e8359f64baa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382653937346143, "t_first_token_ns": 382654223640193, "t_last_token_ns": 382658708662957, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "b27e960445b0e807", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382654999326504, "t_first_token_ns": 382655272338666, "t_last_token_ns": 382659741984406, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "3877cb03f6ea4711", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382655095076921, "t_first_token_ns": 382655518139966, "t_last_token_ns": 382659764392054, "prompt_tokens": 3955, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "cee027f56ae5f140", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382655496234489, "t_first_token_ns": 382655767133736, "t_last_token_ns": 382659784267972, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "336f49e040184b00", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382655504658967, "t_first_token_ns": 382656007212163, "t_last_token_ns": 382659827147960, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "9cc7dafc187ac5a5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382656443549536, "t_first_token_ns": 382656720871279, "t_last_token_ns": 382660679510823, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "8363103077032c09", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382656619133639, "t_first_token_ns": 382656971953988, "t_last_token_ns": 382660699301265, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "288e93bd46cfc9ea", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382659122633624, "t_first_token_ns": 382659388576647, "t_last_token_ns": 382662855694897, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "9e4a220b3cf1ed89", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382659294185950, "t_first_token_ns": 382659636713044, "t_last_token_ns": 382662876486229, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "d553f356441ca287", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382659768127486, "t_first_token_ns": 382660038759405, "t_last_token_ns": 382663006438202, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "5c8b375f370a610c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382660219887225, "t_first_token_ns": 382660487772037, "t_last_token_ns": 382663174184970, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "c8b0fc76cafef753", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382661391829786, "t_first_token_ns": 382661654846923, "t_last_token_ns": 382665778942135, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "72e7e5c0e7f2b84f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382661995811822, "t_first_token_ns": 382662268455557, "t_last_token_ns": 382666241877475, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9e7ed7f0ec538c3f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382663416482197, "t_first_token_ns": 382663678627359, "t_last_token_ns": 382669818556992, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "ff133c5d58ab656f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382663674182007, "t_first_token_ns": 382663940191582, "t_last_token_ns": 382669878267913, "prompt_tokens": 4023, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "a729629242e95560", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382663744469504, "t_first_token_ns": 382664404831691, "t_last_token_ns": 382669908251579, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "0b005fe06300469f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382663882620010, "t_first_token_ns": 382664405294993, "t_last_token_ns": 382669909157472, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f9fef77febb3a101", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382663914995073, "t_first_token_ns": 382664630966929, "t_last_token_ns": 382669955072489, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3a56a9b9fbaf16ef", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382664735323983, "t_first_token_ns": 382665014060740, "t_last_token_ns": 382670343961146, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "a4b8f1dd0a833ac0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382665508920092, "t_first_token_ns": 382665779666477, "t_last_token_ns": 382671239051711, "prompt_tokens": 4015, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "bc1ce14acfb8f5b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382666446333308, "t_first_token_ns": 382666722183364, "t_last_token_ns": 382672080662324, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "550870cf62cf7dc8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382667459434773, "t_first_token_ns": 382667733545775, "t_last_token_ns": 382673216377615, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "2affef463ea83fb5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382667549515357, "t_first_token_ns": 382668193431746, "t_last_token_ns": 382673241015066, "prompt_tokens": 3963, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "3bed9c08ecc0735e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382667594478674, "t_first_token_ns": 382668193651132, "t_last_token_ns": 382673241228350, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "aebd728fac5eb7c9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382668312966747, "t_first_token_ns": 382668803340245, "t_last_token_ns": 382673388368613, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "80bee31a1295953e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382668314082437, "t_first_token_ns": 382668803737279, "t_last_token_ns": 382673388833168, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fc6cfd2270ab2581", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382668590269702, "t_first_token_ns": 382669054973519, "t_last_token_ns": 382673408464474, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "f4a15b0e0da21586", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382669181937394, "t_first_token_ns": 382669465704116, "t_last_token_ns": 382673506939336, "prompt_tokens": 3916, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "1ff7c31e57e00bcb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382669887634415, "t_first_token_ns": 382670164098978, "t_last_token_ns": 382673743701891, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "c1fecd97b2361f3e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382670525721204, "t_first_token_ns": 382670805068704, "t_last_token_ns": 382673920346517, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "d167f8efb80215a9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382672515196376, "t_first_token_ns": 382672788378920, "t_last_token_ns": 382674557882485, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "c52bced31247e27d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382674966056409, "t_first_token_ns": 382675219557327, "t_last_token_ns": 382679820887381, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "431a39693928917a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382675215727203, "t_first_token_ns": 382675477963765, "t_last_token_ns": 382679884781332, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "bf8d7bba7096d325", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382675468689698, "t_first_token_ns": 382675732134076, "t_last_token_ns": 382679931209303, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "abfb5bfd5d68dc8d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382675483549852, "t_first_token_ns": 382675967814585, "t_last_token_ns": 382679940307805, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "5142ba1e759d7807", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382675570390467, "t_first_token_ns": 382676205112673, "t_last_token_ns": 382679949383699, "prompt_tokens": 4016, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "911dfbd9a5da2f3a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382675955694748, "t_first_token_ns": 382676450059359, "t_last_token_ns": 382679966150192, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "d4ec1ed768d3128b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382676640431240, "t_first_token_ns": 382676906275613, "t_last_token_ns": 382680152652520, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8ecca9914ec9afd1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382676821435761, "t_first_token_ns": 382677153704976, "t_last_token_ns": 382680164044629, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "94e98c79036fdaf0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382676893138484, "t_first_token_ns": 382677391558538, "t_last_token_ns": 382680168053920, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 9, "error": null} diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/run_summary.json b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/run_summary.json new file mode 100644 index 0000000..7a63589 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/run_summary.json @@ -0,0 +1,8 @@ +{ + "rate": 1.5, + "input_tokens": 4096, + "output_tokens": 256, + "duration_target_s": 240.0, + "duration_actual_s": 243.1126050199964, + "n_requests": 392 +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/worker_step.r0.jsonl b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/worker_step.r0.jsonl new file mode 100644 index 0000000..93582a3 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both/worker_step.r0.jsonl @@ -0,0 +1,15522 @@ +{"t_unix": 1779813302.9474459, "step_id": 0, "start_load_kv_us": 18, "get_finished_us": 420} +{"t_unix": 1779813303.1944447, "step_id": 1, "start_load_kv_us": 50, "get_finished_us": 353} +{"t_unix": 1779813303.637683, "step_id": 2, "start_load_kv_us": 4, "get_finished_us": 400} +{"t_unix": 1779813303.6405702, "step_id": 3, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813303.646004, "step_id": 4, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813303.6529806, "step_id": 5, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813303.6595228, "step_id": 6, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813303.6662984, "step_id": 7, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813303.67339, "step_id": 8, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813303.6800086, "step_id": 9, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813303.6867397, "step_id": 10, "start_load_kv_us": 3, "get_finished_us": 225} +{"t_unix": 1779813303.6938674, "step_id": 11, "start_load_kv_us": 3, "get_finished_us": 214} +{"t_unix": 1779813303.7012582, "step_id": 12, "start_load_kv_us": 4, "get_finished_us": 326} +{"t_unix": 1779813303.7082253, "step_id": 13, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813303.7158625, "step_id": 14, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813303.7232533, "step_id": 15, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813303.7302616, "step_id": 16, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813303.737701, "step_id": 17, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813303.7450266, "step_id": 18, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813303.7520986, "step_id": 19, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813303.7593722, "step_id": 20, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813303.766484, "step_id": 21, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813303.773195, "step_id": 22, "start_load_kv_us": 3, "get_finished_us": 211} +{"t_unix": 1779813303.7803073, "step_id": 23, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813303.7873592, "step_id": 24, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813303.7945416, "step_id": 25, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813303.8016574, "step_id": 26, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813303.8089948, "step_id": 27, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813303.8163118, "step_id": 28, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813303.8234081, "step_id": 29, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813303.830941, "step_id": 30, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813303.8382046, "step_id": 31, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813303.845596, "step_id": 32, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813303.8531296, "step_id": 33, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813303.860543, "step_id": 34, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813303.8684273, "step_id": 35, "start_load_kv_us": 3, "get_finished_us": 408} +{"t_unix": 1779813303.876115, "step_id": 36, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813303.8834708, "step_id": 37, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813303.8908813, "step_id": 38, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813303.898464, "step_id": 39, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813303.906315, "step_id": 40, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813303.9138706, "step_id": 41, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813303.921644, "step_id": 42, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813303.9292932, "step_id": 43, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813303.937006, "step_id": 44, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813303.9446087, "step_id": 45, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813303.9954717, "step_id": 46, "start_load_kv_us": 26, "get_finished_us": 262} +{"t_unix": 1779813303.9980872, "step_id": 47, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813304.2399664, "step_id": 48, "start_load_kv_us": 28, "get_finished_us": 330} +{"t_unix": 1779813304.2433424, "step_id": 49, "start_load_kv_us": 3, "get_finished_us": 197} +{"t_unix": 1779813304.4411228, "step_id": 50, "start_load_kv_us": 3, "get_finished_us": 347} +{"t_unix": 1779813304.4510322, "step_id": 51, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813304.4611762, "step_id": 52, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813304.471861, "step_id": 53, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813304.4815845, "step_id": 54, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813304.4917722, "step_id": 55, "start_load_kv_us": 14, "get_finished_us": 171} +{"t_unix": 1779813304.5447133, "step_id": 56, "start_load_kv_us": 42, "get_finished_us": 254} +{"t_unix": 1779813304.5477288, "step_id": 57, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813304.7963057, "step_id": 58, "start_load_kv_us": 27, "get_finished_us": 336} +{"t_unix": 1779813304.7992003, "step_id": 59, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813304.991383, "step_id": 60, "start_load_kv_us": 5, "get_finished_us": 299} +{"t_unix": 1779813305.0028, "step_id": 61, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813305.0149612, "step_id": 62, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813305.0267382, "step_id": 63, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813305.0387354, "step_id": 64, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813305.0502305, "step_id": 65, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813305.0618598, "step_id": 66, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813305.0735972, "step_id": 67, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813305.0855815, "step_id": 68, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813305.0971587, "step_id": 69, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813305.108622, "step_id": 70, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813305.120319, "step_id": 71, "start_load_kv_us": 3, "get_finished_us": 217} +{"t_unix": 1779813305.132506, "step_id": 72, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813305.144053, "step_id": 73, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813305.1558611, "step_id": 74, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813305.1678562, "step_id": 75, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813305.1794717, "step_id": 76, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813305.1909003, "step_id": 77, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813305.2455428, "step_id": 78, "start_load_kv_us": 29, "get_finished_us": 328} +{"t_unix": 1779813305.2484703, "step_id": 79, "start_load_kv_us": 3, "get_finished_us": 282} +{"t_unix": 1779813305.5027142, "step_id": 80, "start_load_kv_us": 65, "get_finished_us": 405} +{"t_unix": 1779813305.9585822, "step_id": 81, "start_load_kv_us": 153, "get_finished_us": 462} +{"t_unix": 1779813305.9636772, "step_id": 82, "start_load_kv_us": 3, "get_finished_us": 214} +{"t_unix": 1779813306.1566417, "step_id": 83, "start_load_kv_us": 5, "get_finished_us": 405} +{"t_unix": 1779813306.1682706, "step_id": 84, "start_load_kv_us": 3, "get_finished_us": 197} +{"t_unix": 1779813306.1818905, "step_id": 85, "start_load_kv_us": 11, "get_finished_us": 210} +{"t_unix": 1779813306.1942487, "step_id": 86, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813306.2074575, "step_id": 87, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813306.2205234, "step_id": 88, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813306.2333632, "step_id": 89, "start_load_kv_us": 5, "get_finished_us": 239} +{"t_unix": 1779813306.246894, "step_id": 90, "start_load_kv_us": 2, "get_finished_us": 987} +{"t_unix": 1779813306.259507, "step_id": 91, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813306.2732651, "step_id": 92, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813306.2867994, "step_id": 93, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813306.3008745, "step_id": 94, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813306.31433, "step_id": 95, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813306.3276303, "step_id": 96, "start_load_kv_us": 3, "get_finished_us": 262} +{"t_unix": 1779813306.388174, "step_id": 97, "start_load_kv_us": 27, "get_finished_us": 281} +{"t_unix": 1779813306.3912287, "step_id": 98, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813306.6678638, "step_id": 99, "start_load_kv_us": 32, "get_finished_us": 339} +{"t_unix": 1779813306.6711164, "step_id": 100, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813306.871677, "step_id": 101, "start_load_kv_us": 11, "get_finished_us": 354} +{"t_unix": 1779813306.8745668, "step_id": 102, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813306.8875396, "step_id": 103, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813306.9080687, "step_id": 104, "start_load_kv_us": 303, "get_finished_us": 1395} +{"t_unix": 1779813306.916932, "step_id": 105, "start_load_kv_us": 10, "get_finished_us": 200} +{"t_unix": 1779813306.9283087, "step_id": 106, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813306.9434407, "step_id": 107, "start_load_kv_us": 3, "get_finished_us": 203} +{"t_unix": 1779813306.9598129, "step_id": 108, "start_load_kv_us": 63, "get_finished_us": 412} +{"t_unix": 1779813306.9696252, "step_id": 109, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813306.9836476, "step_id": 110, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813306.9987166, "step_id": 111, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813307.0557995, "step_id": 112, "start_load_kv_us": 65, "get_finished_us": 318} +{"t_unix": 1779813307.0591297, "step_id": 113, "start_load_kv_us": 7, "get_finished_us": 191} +{"t_unix": 1779813307.2676811, "step_id": 114, "start_load_kv_us": 4, "get_finished_us": 351} +{"t_unix": 1779813307.2836483, "step_id": 115, "start_load_kv_us": 12, "get_finished_us": 232} +{"t_unix": 1779813307.3408356, "step_id": 116, "start_load_kv_us": 110, "get_finished_us": 292} +{"t_unix": 1779813307.3441758, "step_id": 117, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813307.5532224, "step_id": 118, "start_load_kv_us": 3, "get_finished_us": 437} +{"t_unix": 1779813307.5660925, "step_id": 119, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813307.5804613, "step_id": 120, "start_load_kv_us": 8, "get_finished_us": 247} +{"t_unix": 1779813307.594715, "step_id": 121, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813307.6089833, "step_id": 122, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813307.6236062, "step_id": 123, "start_load_kv_us": 2, "get_finished_us": 348} +{"t_unix": 1779813307.638767, "step_id": 124, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813307.6534789, "step_id": 125, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813307.6693401, "step_id": 126, "start_load_kv_us": 4, "get_finished_us": 752} +{"t_unix": 1779813307.6853557, "step_id": 127, "start_load_kv_us": 4, "get_finished_us": 269} +{"t_unix": 1779813307.6981235, "step_id": 128, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813307.7126303, "step_id": 129, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813307.727763, "step_id": 130, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813307.7427325, "step_id": 131, "start_load_kv_us": 5, "get_finished_us": 276} +{"t_unix": 1779813307.7573905, "step_id": 132, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813307.7724729, "step_id": 133, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813307.7876694, "step_id": 134, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813307.802759, "step_id": 135, "start_load_kv_us": 3, "get_finished_us": 239} +{"t_unix": 1779813307.8192043, "step_id": 136, "start_load_kv_us": 6, "get_finished_us": 287} +{"t_unix": 1779813307.8333104, "step_id": 137, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813307.8482263, "step_id": 138, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813307.8631287, "step_id": 139, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813307.8783, "step_id": 140, "start_load_kv_us": 6, "get_finished_us": 285} +{"t_unix": 1779813307.8917885, "step_id": 141, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813307.9062052, "step_id": 142, "start_load_kv_us": 4, "get_finished_us": 300} +{"t_unix": 1779813307.9208333, "step_id": 143, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813307.9348433, "step_id": 144, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813307.9494605, "step_id": 145, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813307.9652696, "step_id": 146, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813307.980211, "step_id": 147, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813307.9951537, "step_id": 148, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813308.0104642, "step_id": 149, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813308.0249531, "step_id": 150, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813308.0397882, "step_id": 151, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813308.05467, "step_id": 152, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813308.0696824, "step_id": 153, "start_load_kv_us": 27, "get_finished_us": 185} +{"t_unix": 1779813308.0845318, "step_id": 154, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813308.0995016, "step_id": 155, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813308.1145217, "step_id": 156, "start_load_kv_us": 9, "get_finished_us": 163} +{"t_unix": 1779813308.1290255, "step_id": 157, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813308.1446257, "step_id": 158, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813308.1589956, "step_id": 159, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813308.173685, "step_id": 160, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813308.1886928, "step_id": 161, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813308.2033772, "step_id": 162, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813308.2190244, "step_id": 163, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813308.233985, "step_id": 164, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813308.2493978, "step_id": 165, "start_load_kv_us": 4, "get_finished_us": 327} +{"t_unix": 1779813308.264023, "step_id": 166, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813308.2792892, "step_id": 167, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813308.294558, "step_id": 168, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813308.3095014, "step_id": 169, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813308.324337, "step_id": 170, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813308.3397348, "step_id": 171, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813308.355473, "step_id": 172, "start_load_kv_us": 5, "get_finished_us": 287} +{"t_unix": 1779813308.3702607, "step_id": 173, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813308.3860734, "step_id": 174, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813308.401214, "step_id": 175, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813308.4164596, "step_id": 176, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813308.4313672, "step_id": 177, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813308.4465165, "step_id": 178, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813308.462396, "step_id": 179, "start_load_kv_us": 13, "get_finished_us": 223} +{"t_unix": 1779813308.4778135, "step_id": 180, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813308.4938269, "step_id": 181, "start_load_kv_us": 3, "get_finished_us": 232} +{"t_unix": 1779813308.5092192, "step_id": 182, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813308.5246527, "step_id": 183, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813308.5404792, "step_id": 184, "start_load_kv_us": 11, "get_finished_us": 218} +{"t_unix": 1779813308.5558753, "step_id": 185, "start_load_kv_us": 14, "get_finished_us": 225} +{"t_unix": 1779813308.5716233, "step_id": 186, "start_load_kv_us": 10, "get_finished_us": 303} +{"t_unix": 1779813308.5865273, "step_id": 187, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813308.6023533, "step_id": 188, "start_load_kv_us": 10, "get_finished_us": 197} +{"t_unix": 1779813308.6172018, "step_id": 189, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813308.6327763, "step_id": 190, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813308.648299, "step_id": 191, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813308.6640186, "step_id": 192, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813308.6799006, "step_id": 193, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813308.695332, "step_id": 194, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813308.7114658, "step_id": 195, "start_load_kv_us": 4, "get_finished_us": 552} +{"t_unix": 1779813308.726534, "step_id": 196, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813308.7423923, "step_id": 197, "start_load_kv_us": 12, "get_finished_us": 224} +{"t_unix": 1779813308.757614, "step_id": 198, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813308.7734535, "step_id": 199, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813308.7894828, "step_id": 200, "start_load_kv_us": 10, "get_finished_us": 181} +{"t_unix": 1779813308.8048143, "step_id": 201, "start_load_kv_us": 13, "get_finished_us": 151} +{"t_unix": 1779813308.8202012, "step_id": 202, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813308.8360772, "step_id": 203, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813308.8523057, "step_id": 204, "start_load_kv_us": 19, "get_finished_us": 215} +{"t_unix": 1779813308.8695066, "step_id": 205, "start_load_kv_us": 3, "get_finished_us": 269} +{"t_unix": 1779813308.8849308, "step_id": 206, "start_load_kv_us": 8, "get_finished_us": 205} +{"t_unix": 1779813308.901089, "step_id": 207, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813308.9179673, "step_id": 208, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813308.9328976, "step_id": 209, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813308.9488225, "step_id": 210, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813308.9647777, "step_id": 211, "start_load_kv_us": 4, "get_finished_us": 294} +{"t_unix": 1779813308.9802551, "step_id": 212, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813308.996164, "step_id": 213, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813309.0117962, "step_id": 214, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813309.0276752, "step_id": 215, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813309.0449593, "step_id": 216, "start_load_kv_us": 15, "get_finished_us": 349} +{"t_unix": 1779813309.0594165, "step_id": 217, "start_load_kv_us": 12, "get_finished_us": 218} +{"t_unix": 1779813309.0749686, "step_id": 218, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813309.090417, "step_id": 219, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813309.1062472, "step_id": 220, "start_load_kv_us": 11, "get_finished_us": 229} +{"t_unix": 1779813309.1216686, "step_id": 221, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813309.1373215, "step_id": 222, "start_load_kv_us": 9, "get_finished_us": 168} +{"t_unix": 1779813309.152905, "step_id": 223, "start_load_kv_us": 9, "get_finished_us": 214} +{"t_unix": 1779813309.1716235, "step_id": 224, "start_load_kv_us": 2, "get_finished_us": 358} +{"t_unix": 1779813309.1838315, "step_id": 225, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813309.1998506, "step_id": 226, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813309.2153323, "step_id": 227, "start_load_kv_us": 14, "get_finished_us": 257} +{"t_unix": 1779813309.2306857, "step_id": 228, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813309.2463536, "step_id": 229, "start_load_kv_us": 12, "get_finished_us": 256} +{"t_unix": 1779813309.2616103, "step_id": 230, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813309.277148, "step_id": 231, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813309.2932703, "step_id": 232, "start_load_kv_us": 17, "get_finished_us": 171} +{"t_unix": 1779813309.309273, "step_id": 233, "start_load_kv_us": 9, "get_finished_us": 186} +{"t_unix": 1779813309.3250012, "step_id": 234, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813309.340896, "step_id": 235, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813309.3571122, "step_id": 236, "start_load_kv_us": 17, "get_finished_us": 243} +{"t_unix": 1779813309.3727546, "step_id": 237, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813309.3883107, "step_id": 238, "start_load_kv_us": 7, "get_finished_us": 263} +{"t_unix": 1779813309.4040554, "step_id": 239, "start_load_kv_us": 12, "get_finished_us": 324} +{"t_unix": 1779813309.4652033, "step_id": 240, "start_load_kv_us": 99, "get_finished_us": 336} +{"t_unix": 1779813309.468522, "step_id": 241, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813309.721184, "step_id": 242, "start_load_kv_us": 57, "get_finished_us": 446} +{"t_unix": 1779813309.9359636, "step_id": 243, "start_load_kv_us": 6, "get_finished_us": 352} +{"t_unix": 1779813309.9397788, "step_id": 244, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813309.9584138, "step_id": 245, "start_load_kv_us": 5, "get_finished_us": 286} +{"t_unix": 1779813309.977141, "step_id": 246, "start_load_kv_us": 3, "get_finished_us": 321} +{"t_unix": 1779813309.9960237, "step_id": 247, "start_load_kv_us": 3, "get_finished_us": 254} +{"t_unix": 1779813310.0154493, "step_id": 248, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813310.034499, "step_id": 249, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813310.0534594, "step_id": 250, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813310.072716, "step_id": 251, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813310.0926483, "step_id": 252, "start_load_kv_us": 5, "get_finished_us": 309} +{"t_unix": 1779813310.1111147, "step_id": 253, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813310.1308467, "step_id": 254, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813310.150042, "step_id": 255, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813310.1702158, "step_id": 256, "start_load_kv_us": 3, "get_finished_us": 286} +{"t_unix": 1779813310.1891263, "step_id": 257, "start_load_kv_us": 3, "get_finished_us": 226} +{"t_unix": 1779813310.2045007, "step_id": 258, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813310.22042, "step_id": 259, "start_load_kv_us": 4, "get_finished_us": 246} +{"t_unix": 1779813310.2370229, "step_id": 260, "start_load_kv_us": 5, "get_finished_us": 306} +{"t_unix": 1779813310.2527509, "step_id": 261, "start_load_kv_us": 20, "get_finished_us": 254} +{"t_unix": 1779813310.268708, "step_id": 262, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813310.2840312, "step_id": 263, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813310.3002715, "step_id": 264, "start_load_kv_us": 16, "get_finished_us": 245} +{"t_unix": 1779813310.3154936, "step_id": 265, "start_load_kv_us": 6, "get_finished_us": 192} +{"t_unix": 1779813310.3318648, "step_id": 266, "start_load_kv_us": 2, "get_finished_us": 394} +{"t_unix": 1779813310.3474152, "step_id": 267, "start_load_kv_us": 2, "get_finished_us": 446} +{"t_unix": 1779813310.3629801, "step_id": 268, "start_load_kv_us": 7, "get_finished_us": 282} +{"t_unix": 1779813310.3782978, "step_id": 269, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813310.3942986, "step_id": 270, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813310.410845, "step_id": 271, "start_load_kv_us": 6, "get_finished_us": 218} +{"t_unix": 1779813310.4262695, "step_id": 272, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813310.442755, "step_id": 273, "start_load_kv_us": 9, "get_finished_us": 325} +{"t_unix": 1779813310.458039, "step_id": 274, "start_load_kv_us": 15, "get_finished_us": 229} +{"t_unix": 1779813310.4739811, "step_id": 275, "start_load_kv_us": 7, "get_finished_us": 196} +{"t_unix": 1779813310.4898992, "step_id": 276, "start_load_kv_us": 11, "get_finished_us": 180} +{"t_unix": 1779813310.5059917, "step_id": 277, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813310.5216885, "step_id": 278, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813310.5373156, "step_id": 279, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813310.5529609, "step_id": 280, "start_load_kv_us": 15, "get_finished_us": 205} +{"t_unix": 1779813310.568679, "step_id": 281, "start_load_kv_us": 11, "get_finished_us": 274} +{"t_unix": 1779813310.5842798, "step_id": 282, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813310.6000283, "step_id": 283, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813310.6162963, "step_id": 284, "start_load_kv_us": 4, "get_finished_us": 271} +{"t_unix": 1779813310.6317642, "step_id": 285, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813310.6477928, "step_id": 286, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813310.6640987, "step_id": 287, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813310.6798122, "step_id": 288, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813310.6956823, "step_id": 289, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813310.711888, "step_id": 290, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813310.7279081, "step_id": 291, "start_load_kv_us": 11, "get_finished_us": 256} +{"t_unix": 1779813310.743889, "step_id": 292, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813310.7600389, "step_id": 293, "start_load_kv_us": 3, "get_finished_us": 220} +{"t_unix": 1779813310.7756178, "step_id": 294, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813310.7931173, "step_id": 295, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813310.8083673, "step_id": 296, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813310.824362, "step_id": 297, "start_load_kv_us": 23, "get_finished_us": 168} +{"t_unix": 1779813310.839908, "step_id": 298, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813310.8558838, "step_id": 299, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813310.8720803, "step_id": 300, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813310.887685, "step_id": 301, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813310.9036682, "step_id": 302, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813310.9188972, "step_id": 303, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813310.9333756, "step_id": 304, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813310.9480824, "step_id": 305, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813310.963052, "step_id": 306, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813310.9788692, "step_id": 307, "start_load_kv_us": 23, "get_finished_us": 367} +{"t_unix": 1779813310.9931536, "step_id": 308, "start_load_kv_us": 14, "get_finished_us": 211} +{"t_unix": 1779813311.0078871, "step_id": 309, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813311.0224504, "step_id": 310, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813311.0372682, "step_id": 311, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813311.052743, "step_id": 312, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813311.0673418, "step_id": 313, "start_load_kv_us": 8, "get_finished_us": 195} +{"t_unix": 1779813311.0819564, "step_id": 314, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813311.0966437, "step_id": 315, "start_load_kv_us": 3, "get_finished_us": 238} +{"t_unix": 1779813311.1112754, "step_id": 316, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813311.125908, "step_id": 317, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813311.1404054, "step_id": 318, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813311.1559234, "step_id": 319, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813311.16994, "step_id": 320, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813311.184868, "step_id": 321, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813311.1995592, "step_id": 322, "start_load_kv_us": 12, "get_finished_us": 203} +{"t_unix": 1779813311.21414, "step_id": 323, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813311.228988, "step_id": 324, "start_load_kv_us": 3, "get_finished_us": 167} +{"t_unix": 1779813311.2431931, "step_id": 325, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813311.2575176, "step_id": 326, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813311.2721856, "step_id": 327, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813311.286695, "step_id": 328, "start_load_kv_us": 3, "get_finished_us": 149} +{"t_unix": 1779813311.3015742, "step_id": 329, "start_load_kv_us": 13, "get_finished_us": 240} +{"t_unix": 1779813311.3160505, "step_id": 330, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813311.3306062, "step_id": 331, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813311.3452785, "step_id": 332, "start_load_kv_us": 11, "get_finished_us": 215} +{"t_unix": 1779813311.3596466, "step_id": 333, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813311.375294, "step_id": 334, "start_load_kv_us": 2, "get_finished_us": 428} +{"t_unix": 1779813311.389985, "step_id": 335, "start_load_kv_us": 16, "get_finished_us": 248} +{"t_unix": 1779813311.402412, "step_id": 336, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813311.4144604, "step_id": 337, "start_load_kv_us": 3, "get_finished_us": 226} +{"t_unix": 1779813311.4262102, "step_id": 338, "start_load_kv_us": 13, "get_finished_us": 218} +{"t_unix": 1779813311.4360504, "step_id": 339, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813311.4457946, "step_id": 340, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813311.4556632, "step_id": 341, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813311.4660206, "step_id": 342, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813311.476516, "step_id": 343, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813311.486838, "step_id": 344, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813311.497075, "step_id": 345, "start_load_kv_us": 13, "get_finished_us": 161} +{"t_unix": 1779813311.5067801, "step_id": 346, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813311.5167906, "step_id": 347, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813311.5262837, "step_id": 348, "start_load_kv_us": 11, "get_finished_us": 148} +{"t_unix": 1779813311.5361295, "step_id": 349, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813311.5455248, "step_id": 350, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813311.555259, "step_id": 351, "start_load_kv_us": 3, "get_finished_us": 146} +{"t_unix": 1779813311.5643132, "step_id": 352, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813311.5739896, "step_id": 353, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813311.5838573, "step_id": 354, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813311.5938504, "step_id": 355, "start_load_kv_us": 10, "get_finished_us": 206} +{"t_unix": 1779813311.6038392, "step_id": 356, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813311.6116655, "step_id": 357, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813311.6203792, "step_id": 358, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813311.6292927, "step_id": 359, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813311.638097, "step_id": 360, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813311.6470485, "step_id": 361, "start_load_kv_us": 7, "get_finished_us": 160} +{"t_unix": 1779813311.655411, "step_id": 362, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813311.6641831, "step_id": 363, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813311.672894, "step_id": 364, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813311.6816888, "step_id": 365, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813311.6902807, "step_id": 366, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813311.6990523, "step_id": 367, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813311.7074292, "step_id": 368, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813311.7155201, "step_id": 369, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813311.7231038, "step_id": 370, "start_load_kv_us": 5, "get_finished_us": 148} +{"t_unix": 1779813311.730262, "step_id": 371, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813311.7397478, "step_id": 372, "start_load_kv_us": 9, "get_finished_us": 173} +{"t_unix": 1779813311.7453573, "step_id": 373, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813311.7516634, "step_id": 374, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813311.75785, "step_id": 375, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813311.7641962, "step_id": 376, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813311.7703986, "step_id": 377, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813311.77661, "step_id": 378, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813311.7826276, "step_id": 379, "start_load_kv_us": 3, "get_finished_us": 226} +{"t_unix": 1779813311.7890244, "step_id": 380, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813311.7952096, "step_id": 381, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813311.8010654, "step_id": 382, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813311.8070884, "step_id": 383, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813311.813122, "step_id": 384, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813311.8192763, "step_id": 385, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813311.8257236, "step_id": 386, "start_load_kv_us": 3, "get_finished_us": 212} +{"t_unix": 1779813311.8315148, "step_id": 387, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813311.8378923, "step_id": 388, "start_load_kv_us": 3, "get_finished_us": 141} +{"t_unix": 1779813311.8434632, "step_id": 389, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813311.8496907, "step_id": 390, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813311.8558764, "step_id": 391, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813311.862203, "step_id": 392, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813311.8680866, "step_id": 393, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813311.8740053, "step_id": 394, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813311.8800645, "step_id": 395, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813311.8859212, "step_id": 396, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813311.8920417, "step_id": 397, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813311.8983974, "step_id": 398, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813311.9047463, "step_id": 399, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813311.9103577, "step_id": 400, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813311.916463, "step_id": 401, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813311.922753, "step_id": 402, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813311.9286656, "step_id": 403, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813311.9348857, "step_id": 404, "start_load_kv_us": 3, "get_finished_us": 142} +{"t_unix": 1779813311.940681, "step_id": 405, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813311.9468548, "step_id": 406, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813311.9527957, "step_id": 407, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813311.9586015, "step_id": 408, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813311.964496, "step_id": 409, "start_load_kv_us": 3, "get_finished_us": 167} +{"t_unix": 1779813311.970302, "step_id": 410, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813311.976307, "step_id": 411, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813311.9822931, "step_id": 412, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813311.9884636, "step_id": 413, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813311.9946907, "step_id": 414, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813312.0008247, "step_id": 415, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813312.007104, "step_id": 416, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813312.0135145, "step_id": 417, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813312.0200405, "step_id": 418, "start_load_kv_us": 11, "get_finished_us": 152} +{"t_unix": 1779813312.0262797, "step_id": 419, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813312.0326724, "step_id": 420, "start_load_kv_us": 3, "get_finished_us": 147} +{"t_unix": 1779813312.0855193, "step_id": 421, "start_load_kv_us": 102, "get_finished_us": 265} +{"t_unix": 1779813312.0880735, "step_id": 422, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813312.2784903, "step_id": 423, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813312.2855651, "step_id": 424, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813312.2931147, "step_id": 425, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813312.3010097, "step_id": 426, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813312.309, "step_id": 427, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813312.3166087, "step_id": 428, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813312.3247507, "step_id": 429, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813312.3322632, "step_id": 430, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813312.3399673, "step_id": 431, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813312.3476937, "step_id": 432, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813312.3552618, "step_id": 433, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813312.3627932, "step_id": 434, "start_load_kv_us": 3, "get_finished_us": 144} +{"t_unix": 1779813312.3700264, "step_id": 435, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813312.3775134, "step_id": 436, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813312.384466, "step_id": 437, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813312.3920681, "step_id": 438, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813312.444539, "step_id": 439, "start_load_kv_us": 50, "get_finished_us": 286} +{"t_unix": 1779813312.447836, "step_id": 440, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813312.643812, "step_id": 441, "start_load_kv_us": 16, "get_finished_us": 314} +{"t_unix": 1779813312.652524, "step_id": 442, "start_load_kv_us": 13, "get_finished_us": 285} +{"t_unix": 1779813312.659963, "step_id": 443, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813312.6675296, "step_id": 444, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813312.6756768, "step_id": 445, "start_load_kv_us": 41, "get_finished_us": 180} +{"t_unix": 1779813312.6829376, "step_id": 446, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813312.690682, "step_id": 447, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813312.6987855, "step_id": 448, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813312.7066913, "step_id": 449, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813312.7153075, "step_id": 450, "start_load_kv_us": 24, "get_finished_us": 150} +{"t_unix": 1779813312.7228932, "step_id": 451, "start_load_kv_us": 3, "get_finished_us": 139} +{"t_unix": 1779813312.7305863, "step_id": 452, "start_load_kv_us": 12, "get_finished_us": 172} +{"t_unix": 1779813312.738253, "step_id": 453, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813312.7462142, "step_id": 454, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813312.7541869, "step_id": 455, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813312.7620156, "step_id": 456, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813312.7698684, "step_id": 457, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813312.7776556, "step_id": 458, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813312.7857528, "step_id": 459, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813312.7935379, "step_id": 460, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813312.8015208, "step_id": 461, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813312.8091273, "step_id": 462, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813312.8167589, "step_id": 463, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813312.8243484, "step_id": 464, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813312.8322964, "step_id": 465, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813312.840809, "step_id": 466, "start_load_kv_us": 17, "get_finished_us": 141} +{"t_unix": 1779813312.8488626, "step_id": 467, "start_load_kv_us": 13, "get_finished_us": 138} +{"t_unix": 1779813312.857116, "step_id": 468, "start_load_kv_us": 3, "get_finished_us": 136} +{"t_unix": 1779813312.9108207, "step_id": 469, "start_load_kv_us": 458, "get_finished_us": 173} +{"t_unix": 1779813312.9136586, "step_id": 470, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813313.151017, "step_id": 471, "start_load_kv_us": 121, "get_finished_us": 335} +{"t_unix": 1779813313.15398, "step_id": 472, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813313.3540912, "step_id": 473, "start_load_kv_us": 2, "get_finished_us": 396} +{"t_unix": 1779813313.3630283, "step_id": 474, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813313.372188, "step_id": 475, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813313.3821447, "step_id": 476, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813313.391841, "step_id": 477, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813313.4006813, "step_id": 478, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813313.410002, "step_id": 479, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813313.4193146, "step_id": 480, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813313.4286935, "step_id": 481, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813313.4383821, "step_id": 482, "start_load_kv_us": 4, "get_finished_us": 268} +{"t_unix": 1779813313.4477465, "step_id": 483, "start_load_kv_us": 3, "get_finished_us": 312} +{"t_unix": 1779813313.4573476, "step_id": 484, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813313.4665263, "step_id": 485, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813313.4760883, "step_id": 486, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813313.4857585, "step_id": 487, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813313.495738, "step_id": 488, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813313.5061283, "step_id": 489, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813313.5158162, "step_id": 490, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813313.525113, "step_id": 491, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813313.5351672, "step_id": 492, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813313.545848, "step_id": 493, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813313.5547478, "step_id": 494, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813313.5643873, "step_id": 495, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813313.5744941, "step_id": 496, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813313.5839176, "step_id": 497, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813313.5941043, "step_id": 498, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813313.6042478, "step_id": 499, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813313.6117737, "step_id": 500, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813313.6191924, "step_id": 501, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813313.6271074, "step_id": 502, "start_load_kv_us": 3, "get_finished_us": 167} +{"t_unix": 1779813313.6350203, "step_id": 503, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813313.6429067, "step_id": 504, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813313.6507728, "step_id": 505, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813313.6591823, "step_id": 506, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813313.6669188, "step_id": 507, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813313.6750772, "step_id": 508, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813313.683368, "step_id": 509, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813313.6909509, "step_id": 510, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813313.6986616, "step_id": 511, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813313.7067645, "step_id": 512, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813313.7149582, "step_id": 513, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813313.722923, "step_id": 514, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813313.7311685, "step_id": 515, "start_load_kv_us": 3, "get_finished_us": 148} +{"t_unix": 1779813313.7388005, "step_id": 516, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813313.7462459, "step_id": 517, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813313.75472, "step_id": 518, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813313.7619395, "step_id": 519, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813313.7695112, "step_id": 520, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813313.777257, "step_id": 521, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813313.785377, "step_id": 522, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813313.7927473, "step_id": 523, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813313.801056, "step_id": 524, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813313.8089135, "step_id": 525, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813313.8165073, "step_id": 526, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813313.8673966, "step_id": 527, "start_load_kv_us": 32, "get_finished_us": 274} +{"t_unix": 1779813313.870191, "step_id": 528, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813314.112296, "step_id": 529, "start_load_kv_us": 30, "get_finished_us": 294} +{"t_unix": 1779813314.1151686, "step_id": 530, "start_load_kv_us": 3, "get_finished_us": 237} +{"t_unix": 1779813314.359878, "step_id": 531, "start_load_kv_us": 70, "get_finished_us": 337} +{"t_unix": 1779813314.3631597, "step_id": 532, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813314.8180037, "step_id": 533, "start_load_kv_us": 38, "get_finished_us": 369} +{"t_unix": 1779813314.8214712, "step_id": 534, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813315.025982, "step_id": 535, "start_load_kv_us": 4, "get_finished_us": 353} +{"t_unix": 1779813315.036503, "step_id": 536, "start_load_kv_us": 3, "get_finished_us": 222} +{"t_unix": 1779813315.0473328, "step_id": 537, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813315.0593195, "step_id": 538, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813315.0710511, "step_id": 539, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813315.0834882, "step_id": 540, "start_load_kv_us": 11, "get_finished_us": 350} +{"t_unix": 1779813315.0940537, "step_id": 541, "start_load_kv_us": 8, "get_finished_us": 242} +{"t_unix": 1779813315.104965, "step_id": 542, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813315.1163123, "step_id": 543, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813315.12794, "step_id": 544, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813315.1395192, "step_id": 545, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813315.1508398, "step_id": 546, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813315.162746, "step_id": 547, "start_load_kv_us": 9, "get_finished_us": 242} +{"t_unix": 1779813315.1741788, "step_id": 548, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813315.1856747, "step_id": 549, "start_load_kv_us": 10, "get_finished_us": 262} +{"t_unix": 1779813315.196966, "step_id": 550, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813315.2092643, "step_id": 551, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813315.2206233, "step_id": 552, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813315.23156, "step_id": 553, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813315.2426481, "step_id": 554, "start_load_kv_us": 13, "get_finished_us": 245} +{"t_unix": 1779813315.2533038, "step_id": 555, "start_load_kv_us": 3, "get_finished_us": 230} +{"t_unix": 1779813315.264158, "step_id": 556, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813315.2755291, "step_id": 557, "start_load_kv_us": 11, "get_finished_us": 182} +{"t_unix": 1779813315.2869968, "step_id": 558, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813315.2984693, "step_id": 559, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813315.309967, "step_id": 560, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813315.321471, "step_id": 561, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813315.3336663, "step_id": 562, "start_load_kv_us": 7, "get_finished_us": 284} +{"t_unix": 1779813315.3446946, "step_id": 563, "start_load_kv_us": 8, "get_finished_us": 213} +{"t_unix": 1779813315.3559923, "step_id": 564, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813315.3674636, "step_id": 565, "start_load_kv_us": 9, "get_finished_us": 169} +{"t_unix": 1779813315.378606, "step_id": 566, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813315.3900063, "step_id": 567, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813315.4017856, "step_id": 568, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813315.4132392, "step_id": 569, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813315.4254217, "step_id": 570, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813315.437125, "step_id": 571, "start_load_kv_us": 9, "get_finished_us": 160} +{"t_unix": 1779813315.4480865, "step_id": 572, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813315.4598687, "step_id": 573, "start_load_kv_us": 15, "get_finished_us": 155} +{"t_unix": 1779813315.4709961, "step_id": 574, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813315.4826782, "step_id": 575, "start_load_kv_us": 17, "get_finished_us": 190} +{"t_unix": 1779813315.4943504, "step_id": 576, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813315.506203, "step_id": 577, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813315.518366, "step_id": 578, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813315.5309289, "step_id": 579, "start_load_kv_us": 13, "get_finished_us": 188} +{"t_unix": 1779813315.5427744, "step_id": 580, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813315.5579593, "step_id": 581, "start_load_kv_us": 4, "get_finished_us": 303} +{"t_unix": 1779813315.5667617, "step_id": 582, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813315.5788338, "step_id": 583, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813315.5911539, "step_id": 584, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813315.6030922, "step_id": 585, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813315.6155837, "step_id": 586, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813315.6279602, "step_id": 587, "start_load_kv_us": 11, "get_finished_us": 212} +{"t_unix": 1779813315.6402545, "step_id": 588, "start_load_kv_us": 12, "get_finished_us": 157} +{"t_unix": 1779813315.6525276, "step_id": 589, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813315.6643808, "step_id": 590, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813315.6768734, "step_id": 591, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813315.6889174, "step_id": 592, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813315.7008195, "step_id": 593, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813315.712805, "step_id": 594, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813315.7251844, "step_id": 595, "start_load_kv_us": 10, "get_finished_us": 165} +{"t_unix": 1779813315.7374842, "step_id": 596, "start_load_kv_us": 9, "get_finished_us": 152} +{"t_unix": 1779813315.7497876, "step_id": 597, "start_load_kv_us": 9, "get_finished_us": 148} +{"t_unix": 1779813315.7621083, "step_id": 598, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813315.7746682, "step_id": 599, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813315.7875216, "step_id": 600, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813315.8000042, "step_id": 601, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813315.8127882, "step_id": 602, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813315.82527, "step_id": 603, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813315.837854, "step_id": 604, "start_load_kv_us": 8, "get_finished_us": 142} +{"t_unix": 1779813315.8513763, "step_id": 605, "start_load_kv_us": 6, "get_finished_us": 169} +{"t_unix": 1779813315.8626423, "step_id": 606, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813315.8749645, "step_id": 607, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813315.8871462, "step_id": 608, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813315.8989155, "step_id": 609, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813315.9110935, "step_id": 610, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813315.9237876, "step_id": 611, "start_load_kv_us": 13, "get_finished_us": 142} +{"t_unix": 1779813315.9361105, "step_id": 612, "start_load_kv_us": 3, "get_finished_us": 145} +{"t_unix": 1779813315.9486072, "step_id": 613, "start_load_kv_us": 9, "get_finished_us": 193} +{"t_unix": 1779813315.96068, "step_id": 614, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813315.9729388, "step_id": 615, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813315.9845798, "step_id": 616, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813315.9964204, "step_id": 617, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813316.008777, "step_id": 618, "start_load_kv_us": 18, "get_finished_us": 191} +{"t_unix": 1779813316.0201356, "step_id": 619, "start_load_kv_us": 11, "get_finished_us": 201} +{"t_unix": 1779813316.0311317, "step_id": 620, "start_load_kv_us": 3, "get_finished_us": 204} +{"t_unix": 1779813316.0424263, "step_id": 621, "start_load_kv_us": 9, "get_finished_us": 195} +{"t_unix": 1779813316.0534842, "step_id": 622, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813316.065027, "step_id": 623, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813316.0769691, "step_id": 624, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813316.0886393, "step_id": 625, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813316.1002653, "step_id": 626, "start_load_kv_us": 14, "get_finished_us": 272} +{"t_unix": 1779813316.1124027, "step_id": 627, "start_load_kv_us": 9, "get_finished_us": 237} +{"t_unix": 1779813316.123886, "step_id": 628, "start_load_kv_us": 3, "get_finished_us": 178} +{"t_unix": 1779813316.1370883, "step_id": 629, "start_load_kv_us": 4, "get_finished_us": 312} +{"t_unix": 1779813316.147786, "step_id": 630, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813316.1598058, "step_id": 631, "start_load_kv_us": 15, "get_finished_us": 207} +{"t_unix": 1779813316.1716428, "step_id": 632, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813316.1833792, "step_id": 633, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813316.1960297, "step_id": 634, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813316.2074234, "step_id": 635, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813316.2193038, "step_id": 636, "start_load_kv_us": 11, "get_finished_us": 208} +{"t_unix": 1779813316.2309954, "step_id": 637, "start_load_kv_us": 9, "get_finished_us": 237} +{"t_unix": 1779813316.242502, "step_id": 638, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813316.2542155, "step_id": 639, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813316.265588, "step_id": 640, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813316.2774239, "step_id": 641, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813316.2886527, "step_id": 642, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813316.3002007, "step_id": 643, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813316.311365, "step_id": 644, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813316.3232296, "step_id": 645, "start_load_kv_us": 14, "get_finished_us": 161} +{"t_unix": 1779813316.3344095, "step_id": 646, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813316.3463922, "step_id": 647, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813316.3585334, "step_id": 648, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813316.3703122, "step_id": 649, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813316.3823197, "step_id": 650, "start_load_kv_us": 18, "get_finished_us": 168} +{"t_unix": 1779813316.394683, "step_id": 651, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813316.4062216, "step_id": 652, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813316.418204, "step_id": 653, "start_load_kv_us": 13, "get_finished_us": 176} +{"t_unix": 1779813316.4297228, "step_id": 654, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813316.4412253, "step_id": 655, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813316.4529889, "step_id": 656, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813316.4649649, "step_id": 657, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813316.4772048, "step_id": 658, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813316.4897165, "step_id": 659, "start_load_kv_us": 3, "get_finished_us": 250} +{"t_unix": 1779813316.501361, "step_id": 660, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813316.5134525, "step_id": 661, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813316.5253062, "step_id": 662, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813316.5374684, "step_id": 663, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813316.5495713, "step_id": 664, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813316.5621338, "step_id": 665, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813316.574733, "step_id": 666, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813316.5870628, "step_id": 667, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813316.5991063, "step_id": 668, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813316.6113904, "step_id": 669, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813316.6232414, "step_id": 670, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813316.6365428, "step_id": 671, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813316.6486964, "step_id": 672, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813316.6609585, "step_id": 673, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813316.6735666, "step_id": 674, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813316.6863751, "step_id": 675, "start_load_kv_us": 8, "get_finished_us": 259} +{"t_unix": 1779813316.6985703, "step_id": 676, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813316.712172, "step_id": 677, "start_load_kv_us": 4, "get_finished_us": 246} +{"t_unix": 1779813316.7236297, "step_id": 678, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813316.735265, "step_id": 679, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813316.7467022, "step_id": 680, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813316.7581012, "step_id": 681, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813316.7697864, "step_id": 682, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813316.780866, "step_id": 683, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813316.792335, "step_id": 684, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813316.8041277, "step_id": 685, "start_load_kv_us": 15, "get_finished_us": 154} +{"t_unix": 1779813316.8157737, "step_id": 686, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813316.8711498, "step_id": 687, "start_load_kv_us": 125, "get_finished_us": 271} +{"t_unix": 1779813316.8740811, "step_id": 688, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813317.076863, "step_id": 689, "start_load_kv_us": 3, "get_finished_us": 281} +{"t_unix": 1779813317.0871618, "step_id": 690, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813317.0993063, "step_id": 691, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813317.1113658, "step_id": 692, "start_load_kv_us": 10, "get_finished_us": 203} +{"t_unix": 1779813317.1236143, "step_id": 693, "start_load_kv_us": 8, "get_finished_us": 239} +{"t_unix": 1779813317.1352212, "step_id": 694, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813317.1476045, "step_id": 695, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813317.1595178, "step_id": 696, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813317.171005, "step_id": 697, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813317.1830864, "step_id": 698, "start_load_kv_us": 3, "get_finished_us": 182} +{"t_unix": 1779813317.194334, "step_id": 699, "start_load_kv_us": 3, "get_finished_us": 146} +{"t_unix": 1779813317.2065225, "step_id": 700, "start_load_kv_us": 10, "get_finished_us": 196} +{"t_unix": 1779813317.2187033, "step_id": 701, "start_load_kv_us": 20, "get_finished_us": 212} +{"t_unix": 1779813317.230371, "step_id": 702, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813317.2426834, "step_id": 703, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813317.2544107, "step_id": 704, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813317.2655947, "step_id": 705, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813317.2775917, "step_id": 706, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813317.2900336, "step_id": 707, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813317.3019187, "step_id": 708, "start_load_kv_us": 3, "get_finished_us": 208} +{"t_unix": 1779813317.3141358, "step_id": 709, "start_load_kv_us": 3, "get_finished_us": 212} +{"t_unix": 1779813317.3256912, "step_id": 710, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813317.3375409, "step_id": 711, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813317.349592, "step_id": 712, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813317.36181, "step_id": 713, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813317.3743157, "step_id": 714, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813317.3861606, "step_id": 715, "start_load_kv_us": 13, "get_finished_us": 225} +{"t_unix": 1779813317.398351, "step_id": 716, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813317.4102933, "step_id": 717, "start_load_kv_us": 9, "get_finished_us": 189} +{"t_unix": 1779813317.4220324, "step_id": 718, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813317.4341466, "step_id": 719, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813317.4463725, "step_id": 720, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813317.4583216, "step_id": 721, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813317.470775, "step_id": 722, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813317.4837208, "step_id": 723, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813317.4963057, "step_id": 724, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813317.5086486, "step_id": 725, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813317.5196228, "step_id": 726, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813317.5319037, "step_id": 727, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813317.5439339, "step_id": 728, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813317.5537078, "step_id": 729, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813317.5631924, "step_id": 730, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813317.5731301, "step_id": 731, "start_load_kv_us": 3, "get_finished_us": 145} +{"t_unix": 1779813317.5825045, "step_id": 732, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813317.5921052, "step_id": 733, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813317.6023526, "step_id": 734, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813317.6119995, "step_id": 735, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813317.621927, "step_id": 736, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813317.6316524, "step_id": 737, "start_load_kv_us": 16, "get_finished_us": 165} +{"t_unix": 1779813317.641574, "step_id": 738, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813317.651563, "step_id": 739, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813317.661374, "step_id": 740, "start_load_kv_us": 8, "get_finished_us": 217} +{"t_unix": 1779813317.6707332, "step_id": 741, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813317.6807342, "step_id": 742, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813317.691158, "step_id": 743, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813317.70192, "step_id": 744, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813317.7124884, "step_id": 745, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813317.722917, "step_id": 746, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813317.7337365, "step_id": 747, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813317.7443218, "step_id": 748, "start_load_kv_us": 9, "get_finished_us": 174} +{"t_unix": 1779813317.7538166, "step_id": 749, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813317.7638283, "step_id": 750, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813317.7732553, "step_id": 751, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813317.7833223, "step_id": 752, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813317.7933304, "step_id": 753, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813317.803106, "step_id": 754, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813317.8144047, "step_id": 755, "start_load_kv_us": 4, "get_finished_us": 335} +{"t_unix": 1779813317.8241878, "step_id": 756, "start_load_kv_us": 4, "get_finished_us": 308} +{"t_unix": 1779813317.8370864, "step_id": 757, "start_load_kv_us": 14, "get_finished_us": 370} +{"t_unix": 1779813317.8444445, "step_id": 758, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813317.8549886, "step_id": 759, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813317.8649044, "step_id": 760, "start_load_kv_us": 3, "get_finished_us": 243} +{"t_unix": 1779813317.875489, "step_id": 761, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813317.885571, "step_id": 762, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813317.8966675, "step_id": 763, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813317.9072278, "step_id": 764, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813317.9166617, "step_id": 765, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813317.9270318, "step_id": 766, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813317.937593, "step_id": 767, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813317.947934, "step_id": 768, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813317.9579036, "step_id": 769, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813317.9680796, "step_id": 770, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813317.978623, "step_id": 771, "start_load_kv_us": 3, "get_finished_us": 230} +{"t_unix": 1779813317.9885337, "step_id": 772, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813317.99854, "step_id": 773, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813318.0078423, "step_id": 774, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813318.0175662, "step_id": 775, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813318.0270727, "step_id": 776, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813318.0368009, "step_id": 777, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.046197, "step_id": 778, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.0562882, "step_id": 779, "start_load_kv_us": 14, "get_finished_us": 151} +{"t_unix": 1779813318.0660775, "step_id": 780, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813318.075463, "step_id": 781, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813318.085405, "step_id": 782, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813318.0954833, "step_id": 783, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813318.1053762, "step_id": 784, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.1157823, "step_id": 785, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813318.1256547, "step_id": 786, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813318.1341858, "step_id": 787, "start_load_kv_us": 3, "get_finished_us": 150} +{"t_unix": 1779813318.141463, "step_id": 788, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813318.1494792, "step_id": 789, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813318.1544766, "step_id": 790, "start_load_kv_us": 7, "get_finished_us": 150} +{"t_unix": 1779813318.1591156, "step_id": 791, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.164195, "step_id": 792, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.1692712, "step_id": 793, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813318.1743453, "step_id": 794, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813318.1794262, "step_id": 795, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813318.1845322, "step_id": 796, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.189623, "step_id": 797, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813318.1947007, "step_id": 798, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813318.199839, "step_id": 799, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.2048864, "step_id": 800, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813318.2100198, "step_id": 801, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813318.215073, "step_id": 802, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813318.220539, "step_id": 803, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813318.2252436, "step_id": 804, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.2303514, "step_id": 805, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.2354136, "step_id": 806, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813318.2406182, "step_id": 807, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813318.245643, "step_id": 808, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813318.2507432, "step_id": 809, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.255802, "step_id": 810, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.2616038, "step_id": 811, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813318.2660463, "step_id": 812, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813318.2711115, "step_id": 813, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813318.2761915, "step_id": 814, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813318.2812827, "step_id": 815, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813318.2864263, "step_id": 816, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.2915761, "step_id": 817, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813318.2965994, "step_id": 818, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813318.30229, "step_id": 819, "start_load_kv_us": 9, "get_finished_us": 218} +{"t_unix": 1779813318.3068593, "step_id": 820, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813318.3119178, "step_id": 821, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813318.3170023, "step_id": 822, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813318.3220747, "step_id": 823, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813318.3271704, "step_id": 824, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.33226, "step_id": 825, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813318.3372872, "step_id": 826, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813318.3424668, "step_id": 827, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813318.3475559, "step_id": 828, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813318.3526552, "step_id": 829, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813318.3577955, "step_id": 830, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813318.3628726, "step_id": 831, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813318.3679693, "step_id": 832, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813318.3731034, "step_id": 833, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813318.3781977, "step_id": 834, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813318.3836896, "step_id": 835, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813318.3883991, "step_id": 836, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813318.393524, "step_id": 837, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813318.3986225, "step_id": 838, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813318.4037647, "step_id": 839, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813318.4089212, "step_id": 840, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813318.4140337, "step_id": 841, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813318.419065, "step_id": 842, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813318.4241545, "step_id": 843, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813318.4294877, "step_id": 844, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813318.4344604, "step_id": 845, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813318.439531, "step_id": 846, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813318.4447112, "step_id": 847, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813318.449786, "step_id": 848, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813318.4548383, "step_id": 849, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813318.4598918, "step_id": 850, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813318.4654136, "step_id": 851, "start_load_kv_us": 6, "get_finished_us": 153} +{"t_unix": 1779813318.4701576, "step_id": 852, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813318.4752135, "step_id": 853, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813318.4803705, "step_id": 854, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813318.4854753, "step_id": 855, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813318.490575, "step_id": 856, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813318.4956753, "step_id": 857, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813318.5008793, "step_id": 858, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813318.505878, "step_id": 859, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.5109978, "step_id": 860, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813318.5161088, "step_id": 861, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813318.5212278, "step_id": 862, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813318.5263135, "step_id": 863, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813318.531413, "step_id": 864, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813318.5365136, "step_id": 865, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813318.5416307, "step_id": 866, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813318.5471296, "step_id": 867, "start_load_kv_us": 25, "get_finished_us": 139} +{"t_unix": 1779813318.5518687, "step_id": 868, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.5569758, "step_id": 869, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813318.5620697, "step_id": 870, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813318.5671844, "step_id": 871, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.5731041, "step_id": 872, "start_load_kv_us": 9, "get_finished_us": 291} +{"t_unix": 1779813318.5774, "step_id": 873, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813318.582517, "step_id": 874, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813318.5876253, "step_id": 875, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813318.5927215, "step_id": 876, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813318.5978177, "step_id": 877, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813318.6029367, "step_id": 878, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813318.6080692, "step_id": 879, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813318.613132, "step_id": 880, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813318.618272, "step_id": 881, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813318.6233304, "step_id": 882, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813318.628961, "step_id": 883, "start_load_kv_us": 9, "get_finished_us": 148} +{"t_unix": 1779813318.6336212, "step_id": 884, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813318.6387377, "step_id": 885, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813318.643823, "step_id": 886, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813318.6488857, "step_id": 887, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813318.6540039, "step_id": 888, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813318.659169, "step_id": 889, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813318.6642528, "step_id": 890, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813318.6695106, "step_id": 891, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813318.6745589, "step_id": 892, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813318.6796718, "step_id": 893, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813318.6847744, "step_id": 894, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813318.6898682, "step_id": 895, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813318.695039, "step_id": 896, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813318.7001486, "step_id": 897, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813318.7052343, "step_id": 898, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813318.7107108, "step_id": 899, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813318.715433, "step_id": 900, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813318.7205281, "step_id": 901, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813318.72565, "step_id": 902, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813318.7307324, "step_id": 903, "start_load_kv_us": 14, "get_finished_us": 136} +{"t_unix": 1779813318.7359293, "step_id": 904, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813318.7410173, "step_id": 905, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813318.7460628, "step_id": 906, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813318.75119, "step_id": 907, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813318.756251, "step_id": 908, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813318.7613423, "step_id": 909, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813318.7665408, "step_id": 910, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813318.7716498, "step_id": 911, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813318.7767947, "step_id": 912, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813318.781818, "step_id": 913, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813318.7868905, "step_id": 914, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813318.792408, "step_id": 915, "start_load_kv_us": 10, "get_finished_us": 145} +{"t_unix": 1779813318.7971087, "step_id": 916, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813318.802283, "step_id": 917, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813318.807344, "step_id": 918, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813318.8124099, "step_id": 919, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813318.8175309, "step_id": 920, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813318.8226469, "step_id": 921, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813318.8279214, "step_id": 922, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813318.8329363, "step_id": 923, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813318.8380415, "step_id": 924, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813318.843157, "step_id": 925, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813318.8482811, "step_id": 926, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813318.853297, "step_id": 927, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813318.858392, "step_id": 928, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813318.8635144, "step_id": 929, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813318.8686638, "step_id": 930, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813318.8741724, "step_id": 931, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813318.8788667, "step_id": 932, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813318.8842745, "step_id": 933, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813318.8890686, "step_id": 934, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813318.894139, "step_id": 935, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813318.8992708, "step_id": 936, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813318.90439, "step_id": 937, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813318.9094687, "step_id": 938, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813318.9146001, "step_id": 939, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813318.919712, "step_id": 940, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813318.9248316, "step_id": 941, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813318.929904, "step_id": 942, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813318.9346046, "step_id": 943, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813318.9395363, "step_id": 944, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813319.435326, "step_id": 945, "start_load_kv_us": 173, "get_finished_us": 350} +{"t_unix": 1779813319.438589, "step_id": 946, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813319.6305125, "step_id": 947, "start_load_kv_us": 5, "get_finished_us": 360} +{"t_unix": 1779813319.6337152, "step_id": 948, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813319.6386058, "step_id": 949, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813319.6436024, "step_id": 950, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813319.648752, "step_id": 951, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813319.6538217, "step_id": 952, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813319.6589804, "step_id": 953, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813319.6640358, "step_id": 954, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813319.6691928, "step_id": 955, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813319.6742623, "step_id": 956, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813319.6793487, "step_id": 957, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813319.684955, "step_id": 958, "start_load_kv_us": 16, "get_finished_us": 164} +{"t_unix": 1779813319.6896205, "step_id": 959, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813319.6952171, "step_id": 960, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813319.699865, "step_id": 961, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813319.7049322, "step_id": 962, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813319.7099664, "step_id": 963, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813319.715022, "step_id": 964, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813319.7200937, "step_id": 965, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813319.7251737, "step_id": 966, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813319.730283, "step_id": 967, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813319.7354496, "step_id": 968, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813319.7405324, "step_id": 969, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813319.7456474, "step_id": 970, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813319.7507887, "step_id": 971, "start_load_kv_us": 16, "get_finished_us": 190} +{"t_unix": 1779813319.7558563, "step_id": 972, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813319.7609012, "step_id": 973, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813319.766545, "step_id": 974, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813319.7712038, "step_id": 975, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813319.7762673, "step_id": 976, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813319.7812982, "step_id": 977, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813319.7864068, "step_id": 978, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813319.7915142, "step_id": 979, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813319.7966466, "step_id": 980, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813319.8017538, "step_id": 981, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813319.8069143, "step_id": 982, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813319.8118932, "step_id": 983, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813319.8169649, "step_id": 984, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813319.8220322, "step_id": 985, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813319.8271286, "step_id": 986, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813319.8322403, "step_id": 987, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813319.837314, "step_id": 988, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813319.8424222, "step_id": 989, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813319.8479986, "step_id": 990, "start_load_kv_us": 17, "get_finished_us": 149} +{"t_unix": 1779813319.8527105, "step_id": 991, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813319.8578672, "step_id": 992, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813319.8630486, "step_id": 993, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813319.8680346, "step_id": 994, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813319.8731077, "step_id": 995, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813319.8782117, "step_id": 996, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813319.883293, "step_id": 997, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813319.8884633, "step_id": 998, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813319.8935375, "step_id": 999, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813319.8987439, "step_id": 1000, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813319.903816, "step_id": 1001, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813319.9089136, "step_id": 1002, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813319.913993, "step_id": 1003, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813319.91916, "step_id": 1004, "start_load_kv_us": 14, "get_finished_us": 169} +{"t_unix": 1779813319.924162, "step_id": 1005, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813319.9296958, "step_id": 1006, "start_load_kv_us": 3, "get_finished_us": 155} +{"t_unix": 1779813319.934714, "step_id": 1007, "start_load_kv_us": 3, "get_finished_us": 364} +{"t_unix": 1779813319.9424949, "step_id": 1008, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813319.9450803, "step_id": 1009, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813319.9497948, "step_id": 1010, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813319.9548497, "step_id": 1011, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813319.9606504, "step_id": 1012, "start_load_kv_us": 2, "get_finished_us": 340} +{"t_unix": 1779813319.9651532, "step_id": 1013, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813319.9702342, "step_id": 1014, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813319.9752893, "step_id": 1015, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813319.9803398, "step_id": 1016, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813319.9855309, "step_id": 1017, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813319.990633, "step_id": 1018, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813319.9956913, "step_id": 1019, "start_load_kv_us": 17, "get_finished_us": 205} +{"t_unix": 1779813320.0007768, "step_id": 1020, "start_load_kv_us": 12, "get_finished_us": 184} +{"t_unix": 1779813320.005967, "step_id": 1021, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813320.0114644, "step_id": 1022, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813320.016106, "step_id": 1023, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813320.0211482, "step_id": 1024, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813320.0262423, "step_id": 1025, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813320.031332, "step_id": 1026, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813320.0431402, "step_id": 1027, "start_load_kv_us": 35, "get_finished_us": 1254} +{"t_unix": 1779813320.0458581, "step_id": 1028, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813320.0492282, "step_id": 1029, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813320.0544326, "step_id": 1030, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813320.0593693, "step_id": 1031, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813320.0645165, "step_id": 1032, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813320.0696383, "step_id": 1033, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813320.0746942, "step_id": 1034, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813320.0798905, "step_id": 1035, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813320.084906, "step_id": 1036, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813320.0900106, "step_id": 1037, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813320.0955105, "step_id": 1038, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813320.1002421, "step_id": 1039, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813320.1053243, "step_id": 1040, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813320.1104314, "step_id": 1041, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813320.1155167, "step_id": 1042, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813320.1206877, "step_id": 1043, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813320.1257925, "step_id": 1044, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813320.1308978, "step_id": 1045, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813320.1360302, "step_id": 1046, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813320.1411254, "step_id": 1047, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813320.146235, "step_id": 1048, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813320.151364, "step_id": 1049, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813320.156483, "step_id": 1050, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813320.1616051, "step_id": 1051, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813320.1667333, "step_id": 1052, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813320.171904, "step_id": 1053, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813320.177373, "step_id": 1054, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813320.1821303, "step_id": 1055, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813320.1872828, "step_id": 1056, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813320.1923363, "step_id": 1057, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813320.1973886, "step_id": 1058, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813320.202507, "step_id": 1059, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813320.207764, "step_id": 1060, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813320.2128062, "step_id": 1061, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813320.2178817, "step_id": 1062, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813320.2230108, "step_id": 1063, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813320.2280817, "step_id": 1064, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813320.2332795, "step_id": 1065, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813320.238391, "step_id": 1066, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813320.243511, "step_id": 1067, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813320.2485678, "step_id": 1068, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813320.2536025, "step_id": 1069, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813320.2592058, "step_id": 1070, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813320.2638671, "step_id": 1071, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813320.2689786, "step_id": 1072, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813320.2744246, "step_id": 1073, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813320.2791579, "step_id": 1074, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813320.2842686, "step_id": 1075, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813320.2893624, "step_id": 1076, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813320.2944932, "step_id": 1077, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813320.3442302, "step_id": 1078, "start_load_kv_us": 90, "get_finished_us": 298} +{"t_unix": 1779813320.5307493, "step_id": 1079, "start_load_kv_us": 84, "get_finished_us": 379} +{"t_unix": 1779813320.5414128, "step_id": 1080, "start_load_kv_us": 3, "get_finished_us": 205} +{"t_unix": 1779813320.7761383, "step_id": 1081, "start_load_kv_us": 3, "get_finished_us": 363} +{"t_unix": 1779813320.7832754, "step_id": 1082, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813320.7897868, "step_id": 1083, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813320.796568, "step_id": 1084, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813320.8041742, "step_id": 1085, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813320.8112514, "step_id": 1086, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813320.8179965, "step_id": 1087, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813320.8251176, "step_id": 1088, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813320.8320553, "step_id": 1089, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813320.8395271, "step_id": 1090, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813320.8470905, "step_id": 1091, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813320.8546083, "step_id": 1092, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813320.8623154, "step_id": 1093, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813320.8699825, "step_id": 1094, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813320.877394, "step_id": 1095, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813320.8849292, "step_id": 1096, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813320.8919365, "step_id": 1097, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813320.8997505, "step_id": 1098, "start_load_kv_us": 15, "get_finished_us": 153} +{"t_unix": 1779813320.90674, "step_id": 1099, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813320.9138432, "step_id": 1100, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813320.921831, "step_id": 1101, "start_load_kv_us": 3, "get_finished_us": 146} +{"t_unix": 1779813320.9292572, "step_id": 1102, "start_load_kv_us": 3, "get_finished_us": 138} +{"t_unix": 1779813320.935878, "step_id": 1103, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813320.9429586, "step_id": 1104, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813320.9503772, "step_id": 1105, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813320.9578667, "step_id": 1106, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813320.9650984, "step_id": 1107, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813320.9724267, "step_id": 1108, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813320.9799366, "step_id": 1109, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813320.9873853, "step_id": 1110, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813320.9945207, "step_id": 1111, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813321.001412, "step_id": 1112, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813321.0089903, "step_id": 1113, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813321.016919, "step_id": 1114, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813321.0240397, "step_id": 1115, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813321.0314026, "step_id": 1116, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813321.0388534, "step_id": 1117, "start_load_kv_us": 3, "get_finished_us": 155} +{"t_unix": 1779813321.0459042, "step_id": 1118, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813321.0524254, "step_id": 1119, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813321.059403, "step_id": 1120, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813321.0667522, "step_id": 1121, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813321.0738025, "step_id": 1122, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813321.0810804, "step_id": 1123, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813321.088334, "step_id": 1124, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813321.0955422, "step_id": 1125, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813321.1025803, "step_id": 1126, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813321.1097665, "step_id": 1127, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813321.1167326, "step_id": 1128, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813321.1237586, "step_id": 1129, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813321.1313853, "step_id": 1130, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813321.1382196, "step_id": 1131, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813321.1451206, "step_id": 1132, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813321.152627, "step_id": 1133, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813321.1597943, "step_id": 1134, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813321.1664643, "step_id": 1135, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813321.173658, "step_id": 1136, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813321.18078, "step_id": 1137, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813321.1878755, "step_id": 1138, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813321.1948285, "step_id": 1139, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813321.2021928, "step_id": 1140, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813321.2097383, "step_id": 1141, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813321.2176752, "step_id": 1142, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813321.2254221, "step_id": 1143, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813321.2333446, "step_id": 1144, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813321.2411258, "step_id": 1145, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813321.2491474, "step_id": 1146, "start_load_kv_us": 17, "get_finished_us": 154} +{"t_unix": 1779813321.256313, "step_id": 1147, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813321.264024, "step_id": 1148, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813321.2720852, "step_id": 1149, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813321.2795947, "step_id": 1150, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813321.2870502, "step_id": 1151, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813321.2944837, "step_id": 1152, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813321.3023298, "step_id": 1153, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813321.3101678, "step_id": 1154, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813321.318134, "step_id": 1155, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813321.3261857, "step_id": 1156, "start_load_kv_us": 15, "get_finished_us": 193} +{"t_unix": 1779813321.333896, "step_id": 1157, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813321.3417141, "step_id": 1158, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813321.349454, "step_id": 1159, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813321.3573968, "step_id": 1160, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813321.3650277, "step_id": 1161, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813321.3734658, "step_id": 1162, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813321.3808732, "step_id": 1163, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813321.3887076, "step_id": 1164, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813321.3968308, "step_id": 1165, "start_load_kv_us": 3, "get_finished_us": 142} +{"t_unix": 1779813321.4045308, "step_id": 1166, "start_load_kv_us": 14, "get_finished_us": 154} +{"t_unix": 1779813321.4118817, "step_id": 1167, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813321.4198446, "step_id": 1168, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813321.4277499, "step_id": 1169, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813321.4356303, "step_id": 1170, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813321.4435692, "step_id": 1171, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813321.4517567, "step_id": 1172, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813321.4597962, "step_id": 1173, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813321.4678242, "step_id": 1174, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813321.475903, "step_id": 1175, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813321.4838192, "step_id": 1176, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813321.4918692, "step_id": 1177, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813321.5002902, "step_id": 1178, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813321.507867, "step_id": 1179, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813321.5157664, "step_id": 1180, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813321.5242286, "step_id": 1181, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813321.532272, "step_id": 1182, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813321.5398722, "step_id": 1183, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813321.5480714, "step_id": 1184, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813321.556159, "step_id": 1185, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813321.5642436, "step_id": 1186, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813321.5722854, "step_id": 1187, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813321.5803456, "step_id": 1188, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813321.5883267, "step_id": 1189, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813321.5962489, "step_id": 1190, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813321.60436, "step_id": 1191, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813321.6121168, "step_id": 1192, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813321.620013, "step_id": 1193, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813321.6284163, "step_id": 1194, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813321.6359284, "step_id": 1195, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813321.643863, "step_id": 1196, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813321.6522863, "step_id": 1197, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813321.6602335, "step_id": 1198, "start_load_kv_us": 3, "get_finished_us": 160} +{"t_unix": 1779813321.6678283, "step_id": 1199, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813321.6754956, "step_id": 1200, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813321.683653, "step_id": 1201, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813321.691013, "step_id": 1202, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813321.6967263, "step_id": 1203, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813321.702432, "step_id": 1204, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813321.7088614, "step_id": 1205, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813321.7148545, "step_id": 1206, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813321.7209253, "step_id": 1207, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813321.727103, "step_id": 1208, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813321.7330735, "step_id": 1209, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813321.73942, "step_id": 1210, "start_load_kv_us": 3, "get_finished_us": 142} +{"t_unix": 1779813321.7450256, "step_id": 1211, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813321.7511756, "step_id": 1212, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813321.757601, "step_id": 1213, "start_load_kv_us": 3, "get_finished_us": 183} +{"t_unix": 1779813321.7633188, "step_id": 1214, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813321.7694077, "step_id": 1215, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813321.775658, "step_id": 1216, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813321.7818563, "step_id": 1217, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813321.7879908, "step_id": 1218, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813321.7941928, "step_id": 1219, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813321.8001828, "step_id": 1220, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813321.8064296, "step_id": 1221, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813321.8127728, "step_id": 1222, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813321.8190536, "step_id": 1223, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813321.8251772, "step_id": 1224, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813321.8314764, "step_id": 1225, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813321.8382936, "step_id": 1226, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813321.8443134, "step_id": 1227, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813321.8508296, "step_id": 1228, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813321.8575797, "step_id": 1229, "start_load_kv_us": 3, "get_finished_us": 166} +{"t_unix": 1779813321.863417, "step_id": 1230, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813321.869408, "step_id": 1231, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813321.8755438, "step_id": 1232, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813321.8817325, "step_id": 1233, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813321.8880167, "step_id": 1234, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813321.8941386, "step_id": 1235, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813321.9002483, "step_id": 1236, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813321.906378, "step_id": 1237, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813321.9125721, "step_id": 1238, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813321.9187799, "step_id": 1239, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813321.9249077, "step_id": 1240, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813321.9312983, "step_id": 1241, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813321.937933, "step_id": 1242, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813321.943606, "step_id": 1243, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813321.9497373, "step_id": 1244, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813321.9564147, "step_id": 1245, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813321.9619794, "step_id": 1246, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813321.9678407, "step_id": 1247, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813321.9738107, "step_id": 1248, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813321.9798217, "step_id": 1249, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813321.985926, "step_id": 1250, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813321.991996, "step_id": 1251, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813321.9982088, "step_id": 1252, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813322.0072317, "step_id": 1253, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813322.0101628, "step_id": 1254, "start_load_kv_us": 2, "get_finished_us": 379} +{"t_unix": 1779813322.016259, "step_id": 1255, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813322.0222678, "step_id": 1256, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813322.0283902, "step_id": 1257, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813322.0347965, "step_id": 1258, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813322.0403142, "step_id": 1259, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813322.0462112, "step_id": 1260, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813322.0527067, "step_id": 1261, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813322.058686, "step_id": 1262, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813322.0648847, "step_id": 1263, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813322.071023, "step_id": 1264, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813322.0770936, "step_id": 1265, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813322.083133, "step_id": 1266, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813322.089384, "step_id": 1267, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813322.0951414, "step_id": 1268, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813322.101116, "step_id": 1269, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813322.1070318, "step_id": 1270, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813322.1132684, "step_id": 1271, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813322.1195915, "step_id": 1272, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813322.1257756, "step_id": 1273, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813322.1322803, "step_id": 1274, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813322.1383178, "step_id": 1275, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813322.144133, "step_id": 1276, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813322.1502523, "step_id": 1277, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813322.1555896, "step_id": 1278, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813322.1612186, "step_id": 1279, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813322.1671264, "step_id": 1280, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813322.173142, "step_id": 1281, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813322.1801543, "step_id": 1282, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813322.2269254, "step_id": 1283, "start_load_kv_us": 49, "get_finished_us": 183} +{"t_unix": 1779813322.2297812, "step_id": 1284, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813322.4279187, "step_id": 1285, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813322.4352238, "step_id": 1286, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813322.442871, "step_id": 1287, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813322.450784, "step_id": 1288, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813322.4585414, "step_id": 1289, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813322.4666975, "step_id": 1290, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813322.4736972, "step_id": 1291, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813322.4812245, "step_id": 1292, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813322.489577, "step_id": 1293, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813322.496963, "step_id": 1294, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813322.505055, "step_id": 1295, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813322.5136483, "step_id": 1296, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813322.5212545, "step_id": 1297, "start_load_kv_us": 11, "get_finished_us": 158} +{"t_unix": 1779813322.528725, "step_id": 1298, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813322.5362904, "step_id": 1299, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813322.5439057, "step_id": 1300, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813322.5512612, "step_id": 1301, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813322.5589812, "step_id": 1302, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813322.5667582, "step_id": 1303, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813322.5743508, "step_id": 1304, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813322.581772, "step_id": 1305, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813322.589671, "step_id": 1306, "start_load_kv_us": 3, "get_finished_us": 204} +{"t_unix": 1779813322.5971236, "step_id": 1307, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813322.604991, "step_id": 1308, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813322.613201, "step_id": 1309, "start_load_kv_us": 11, "get_finished_us": 178} +{"t_unix": 1779813322.6200988, "step_id": 1310, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813322.6276877, "step_id": 1311, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813322.6348836, "step_id": 1312, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813322.643068, "step_id": 1313, "start_load_kv_us": 8, "get_finished_us": 254} +{"t_unix": 1779813322.649746, "step_id": 1314, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813322.6569974, "step_id": 1315, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813322.6641884, "step_id": 1316, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813322.6716592, "step_id": 1317, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813322.6794634, "step_id": 1318, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813322.6868768, "step_id": 1319, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813322.694474, "step_id": 1320, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813322.7022226, "step_id": 1321, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813322.7102652, "step_id": 1322, "start_load_kv_us": 9, "get_finished_us": 178} +{"t_unix": 1779813322.7173786, "step_id": 1323, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813322.7249026, "step_id": 1324, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813322.733041, "step_id": 1325, "start_load_kv_us": 3, "get_finished_us": 207} +{"t_unix": 1779813322.7396562, "step_id": 1326, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813322.7467868, "step_id": 1327, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813322.7539258, "step_id": 1328, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813322.7616484, "step_id": 1329, "start_load_kv_us": 3, "get_finished_us": 250} +{"t_unix": 1779813322.7685006, "step_id": 1330, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813322.7758412, "step_id": 1331, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813322.7828832, "step_id": 1332, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813322.790513, "step_id": 1333, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813322.798651, "step_id": 1334, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813322.8065994, "step_id": 1335, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813322.8124692, "step_id": 1336, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813322.8172448, "step_id": 1337, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813322.8223224, "step_id": 1338, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813322.827365, "step_id": 1339, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813322.8324816, "step_id": 1340, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813322.8376276, "step_id": 1341, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813322.8427315, "step_id": 1342, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813322.8478234, "step_id": 1343, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813322.8529031, "step_id": 1344, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813322.8584201, "step_id": 1345, "start_load_kv_us": 6, "get_finished_us": 165} +{"t_unix": 1779813322.8630981, "step_id": 1346, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813322.868152, "step_id": 1347, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813322.873266, "step_id": 1348, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813322.8783605, "step_id": 1349, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813322.883476, "step_id": 1350, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813322.8895974, "step_id": 1351, "start_load_kv_us": 9, "get_finished_us": 253} +{"t_unix": 1779813322.8938234, "step_id": 1352, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813322.8987648, "step_id": 1353, "start_load_kv_us": 14, "get_finished_us": 169} +{"t_unix": 1779813322.903875, "step_id": 1354, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813322.9089038, "step_id": 1355, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813322.9140596, "step_id": 1356, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813322.9191108, "step_id": 1357, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813322.9241567, "step_id": 1358, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813322.9292772, "step_id": 1359, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813322.9343836, "step_id": 1360, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813322.9399507, "step_id": 1361, "start_load_kv_us": 9, "get_finished_us": 173} +{"t_unix": 1779813322.9446676, "step_id": 1362, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813322.9498384, "step_id": 1363, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813322.954881, "step_id": 1364, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813322.9599886, "step_id": 1365, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813322.9650288, "step_id": 1366, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813322.9701452, "step_id": 1367, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813322.9752088, "step_id": 1368, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813322.980343, "step_id": 1369, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813322.9854116, "step_id": 1370, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813322.99062, "step_id": 1371, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813322.9957106, "step_id": 1372, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813323.0007622, "step_id": 1373, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813323.0058584, "step_id": 1374, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813323.0110137, "step_id": 1375, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813323.0160952, "step_id": 1376, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813323.0216448, "step_id": 1377, "start_load_kv_us": 12, "get_finished_us": 185} +{"t_unix": 1779813323.0262709, "step_id": 1378, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813323.0313454, "step_id": 1379, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813323.0364864, "step_id": 1380, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813323.0415795, "step_id": 1381, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813323.0466797, "step_id": 1382, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813323.051869, "step_id": 1383, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813323.0569513, "step_id": 1384, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813323.0621033, "step_id": 1385, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813323.0671778, "step_id": 1386, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813323.0722945, "step_id": 1387, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813323.0773425, "step_id": 1388, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813323.082501, "step_id": 1389, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813323.0875735, "step_id": 1390, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813323.0927036, "step_id": 1391, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813323.0977795, "step_id": 1392, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813323.1033535, "step_id": 1393, "start_load_kv_us": 15, "get_finished_us": 177} +{"t_unix": 1779813323.108034, "step_id": 1394, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813323.113188, "step_id": 1395, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813323.118238, "step_id": 1396, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813323.1233263, "step_id": 1397, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813323.1284194, "step_id": 1398, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813323.133528, "step_id": 1399, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813323.138645, "step_id": 1400, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813323.1437407, "step_id": 1401, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813323.1488564, "step_id": 1402, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813323.1539397, "step_id": 1403, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813323.159063, "step_id": 1404, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813323.1641767, "step_id": 1405, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813323.1692302, "step_id": 1406, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813323.1743908, "step_id": 1407, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813323.1794617, "step_id": 1408, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813323.1849647, "step_id": 1409, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813323.1897118, "step_id": 1410, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813323.1947944, "step_id": 1411, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813323.1998703, "step_id": 1412, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813323.2049634, "step_id": 1413, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813323.2100751, "step_id": 1414, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813323.2151577, "step_id": 1415, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813323.2203, "step_id": 1416, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813323.2253506, "step_id": 1417, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813323.2305138, "step_id": 1418, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813323.2356646, "step_id": 1419, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813323.2407537, "step_id": 1420, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813323.2458255, "step_id": 1421, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813323.2509289, "step_id": 1422, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813323.2560592, "step_id": 1423, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813323.2611773, "step_id": 1424, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813323.2671075, "step_id": 1425, "start_load_kv_us": 9, "get_finished_us": 231} +{"t_unix": 1779813323.2714589, "step_id": 1426, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813323.2766075, "step_id": 1427, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813323.2817879, "step_id": 1428, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813323.2868738, "step_id": 1429, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813323.2920191, "step_id": 1430, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813323.2970726, "step_id": 1431, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813323.302138, "step_id": 1432, "start_load_kv_us": 14, "get_finished_us": 148} +{"t_unix": 1779813323.307269, "step_id": 1433, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813323.3123276, "step_id": 1434, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813323.3174615, "step_id": 1435, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813323.3225448, "step_id": 1436, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813323.32764, "step_id": 1437, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813323.3327565, "step_id": 1438, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813323.337864, "step_id": 1439, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813323.3429608, "step_id": 1440, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813323.348494, "step_id": 1441, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813323.3531878, "step_id": 1442, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813323.3582695, "step_id": 1443, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813323.3633664, "step_id": 1444, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813323.3684838, "step_id": 1445, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813323.3736038, "step_id": 1446, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813323.3787282, "step_id": 1447, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813323.383831, "step_id": 1448, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813323.3890445, "step_id": 1449, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813323.3941064, "step_id": 1450, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813323.3991919, "step_id": 1451, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813323.4042637, "step_id": 1452, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813323.4094193, "step_id": 1453, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813323.4146256, "step_id": 1454, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813323.4195764, "step_id": 1455, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813323.4248002, "step_id": 1456, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813323.4301693, "step_id": 1457, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813323.4348671, "step_id": 1458, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813323.4399266, "step_id": 1459, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813323.4451258, "step_id": 1460, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813323.4501824, "step_id": 1461, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813323.4552295, "step_id": 1462, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813323.4603188, "step_id": 1463, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813323.4653916, "step_id": 1464, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813323.4705298, "step_id": 1465, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813323.4756768, "step_id": 1466, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813323.4807293, "step_id": 1467, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813323.4858737, "step_id": 1468, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813323.4909954, "step_id": 1469, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813323.4960525, "step_id": 1470, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813323.501201, "step_id": 1471, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813323.5063334, "step_id": 1472, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813323.5118346, "step_id": 1473, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813323.5165575, "step_id": 1474, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813323.5216978, "step_id": 1475, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813323.5268917, "step_id": 1476, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813323.5320036, "step_id": 1477, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813323.537008, "step_id": 1478, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813323.5420682, "step_id": 1479, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813323.5887218, "step_id": 1480, "start_load_kv_us": 218, "get_finished_us": 255} +{"t_unix": 1779813323.591579, "step_id": 1481, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813323.7881615, "step_id": 1482, "start_load_kv_us": 4, "get_finished_us": 337} +{"t_unix": 1779813323.7930434, "step_id": 1483, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813323.7990034, "step_id": 1484, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813323.8055975, "step_id": 1485, "start_load_kv_us": 3, "get_finished_us": 184} +{"t_unix": 1779813323.8111312, "step_id": 1486, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813323.8171191, "step_id": 1487, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813323.8230085, "step_id": 1488, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813323.829709, "step_id": 1489, "start_load_kv_us": 13, "get_finished_us": 146} +{"t_unix": 1779813323.835231, "step_id": 1490, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813323.8412755, "step_id": 1491, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813323.8474658, "step_id": 1492, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813323.8537292, "step_id": 1493, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813323.8601084, "step_id": 1494, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813323.8664489, "step_id": 1495, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813323.8728771, "step_id": 1496, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813323.8790405, "step_id": 1497, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813323.8850274, "step_id": 1498, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813323.891333, "step_id": 1499, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813323.897597, "step_id": 1500, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813323.9042516, "step_id": 1501, "start_load_kv_us": 4, "get_finished_us": 137} +{"t_unix": 1779813323.9099257, "step_id": 1502, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813323.9163573, "step_id": 1503, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813323.9224136, "step_id": 1504, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813323.929219, "step_id": 1505, "start_load_kv_us": 8, "get_finished_us": 199} +{"t_unix": 1779813323.9349573, "step_id": 1506, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813323.941286, "step_id": 1507, "start_load_kv_us": 3, "get_finished_us": 213} +{"t_unix": 1779813323.9474494, "step_id": 1508, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813323.9535275, "step_id": 1509, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813323.959932, "step_id": 1510, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813323.966259, "step_id": 1511, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813323.972532, "step_id": 1512, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813323.978807, "step_id": 1513, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813323.9851308, "step_id": 1514, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813323.9913068, "step_id": 1515, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813323.9976664, "step_id": 1516, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813324.004398, "step_id": 1517, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813324.0103815, "step_id": 1518, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813324.0170012, "step_id": 1519, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813324.023227, "step_id": 1520, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813324.0298893, "step_id": 1521, "start_load_kv_us": 9, "get_finished_us": 203} +{"t_unix": 1779813324.0354838, "step_id": 1522, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813324.0417955, "step_id": 1523, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813324.0479677, "step_id": 1524, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813324.0552356, "step_id": 1525, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813324.0608785, "step_id": 1526, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813324.0673113, "step_id": 1527, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813324.0737412, "step_id": 1528, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813324.0801246, "step_id": 1529, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813324.086486, "step_id": 1530, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813324.0929072, "step_id": 1531, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813324.099264, "step_id": 1532, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813324.1062386, "step_id": 1533, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813324.1120868, "step_id": 1534, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813324.1185439, "step_id": 1535, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813324.1247191, "step_id": 1536, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813324.1315358, "step_id": 1537, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813324.1372821, "step_id": 1538, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813324.1440735, "step_id": 1539, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813324.15019, "step_id": 1540, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813324.1550043, "step_id": 1541, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813324.16011, "step_id": 1542, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813324.165232, "step_id": 1543, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813324.1703153, "step_id": 1544, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813324.1753948, "step_id": 1545, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813324.1805007, "step_id": 1546, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813324.1855419, "step_id": 1547, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813324.1906695, "step_id": 1548, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813324.1961515, "step_id": 1549, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813324.2008207, "step_id": 1550, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813324.205922, "step_id": 1551, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813324.2110562, "step_id": 1552, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813324.216124, "step_id": 1553, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813324.2211814, "step_id": 1554, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813324.2262626, "step_id": 1555, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813324.2314126, "step_id": 1556, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813324.2365203, "step_id": 1557, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813324.2415802, "step_id": 1558, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813324.2466857, "step_id": 1559, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813324.2518349, "step_id": 1560, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813324.2569156, "step_id": 1561, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813324.262031, "step_id": 1562, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813324.2671268, "step_id": 1563, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813324.2721806, "step_id": 1564, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813324.2776792, "step_id": 1565, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813324.2823384, "step_id": 1566, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813324.28745, "step_id": 1567, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813324.2925835, "step_id": 1568, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813324.2976725, "step_id": 1569, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813324.302879, "step_id": 1570, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813324.307865, "step_id": 1571, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813324.3129096, "step_id": 1572, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813324.3180997, "step_id": 1573, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813324.3230827, "step_id": 1574, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813324.328197, "step_id": 1575, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813324.3332882, "step_id": 1576, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813324.3384614, "step_id": 1577, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813324.3435435, "step_id": 1578, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813324.348666, "step_id": 1579, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813324.3537111, "step_id": 1580, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813324.359229, "step_id": 1581, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813324.3638933, "step_id": 1582, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813324.3689823, "step_id": 1583, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813324.3740907, "step_id": 1584, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813324.3791552, "step_id": 1585, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813324.3842447, "step_id": 1586, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813324.389455, "step_id": 1587, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813324.394501, "step_id": 1588, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813324.399626, "step_id": 1589, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813324.4046953, "step_id": 1590, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813324.4098008, "step_id": 1591, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813324.4148479, "step_id": 1592, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813324.4200559, "step_id": 1593, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813324.42506, "step_id": 1594, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813324.4307399, "step_id": 1595, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813324.4352784, "step_id": 1596, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813324.440963, "step_id": 1597, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813324.4454997, "step_id": 1598, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813324.4506953, "step_id": 1599, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813324.4557846, "step_id": 1600, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813324.4608243, "step_id": 1601, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813324.4659836, "step_id": 1602, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813324.4710953, "step_id": 1603, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813324.476128, "step_id": 1604, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813324.4812167, "step_id": 1605, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813324.486315, "step_id": 1606, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813324.4914186, "step_id": 1607, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813324.4965305, "step_id": 1608, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813324.5016503, "step_id": 1609, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813324.5067413, "step_id": 1610, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813324.5119205, "step_id": 1611, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813324.516987, "step_id": 1612, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813324.5225089, "step_id": 1613, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813324.5282693, "step_id": 1614, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813324.5748684, "step_id": 1615, "start_load_kv_us": 107, "get_finished_us": 265} +{"t_unix": 1779813324.577827, "step_id": 1616, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813324.8119993, "step_id": 1617, "start_load_kv_us": 118, "get_finished_us": 338} +{"t_unix": 1779813324.8151035, "step_id": 1618, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813325.2712498, "step_id": 1619, "start_load_kv_us": 52, "get_finished_us": 393} +{"t_unix": 1779813325.2749186, "step_id": 1620, "start_load_kv_us": 3, "get_finished_us": 249} +{"t_unix": 1779813325.4746022, "step_id": 1621, "start_load_kv_us": 3, "get_finished_us": 342} +{"t_unix": 1779813325.48366, "step_id": 1622, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813325.4930599, "step_id": 1623, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813325.5017428, "step_id": 1624, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813325.510666, "step_id": 1625, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813325.5199804, "step_id": 1626, "start_load_kv_us": 5, "get_finished_us": 243} +{"t_unix": 1779813325.5286334, "step_id": 1627, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813325.5376034, "step_id": 1628, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813325.547396, "step_id": 1629, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813325.5564868, "step_id": 1630, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813325.5657141, "step_id": 1631, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813325.5752947, "step_id": 1632, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813325.5852728, "step_id": 1633, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813325.594279, "step_id": 1634, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813325.6036236, "step_id": 1635, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813325.6131232, "step_id": 1636, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813325.6221447, "step_id": 1637, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813325.631937, "step_id": 1638, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813325.641203, "step_id": 1639, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813325.6500638, "step_id": 1640, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813325.659111, "step_id": 1641, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813325.668579, "step_id": 1642, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813325.6780758, "step_id": 1643, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813325.6876385, "step_id": 1644, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813325.6975374, "step_id": 1645, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813325.7071252, "step_id": 1646, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813325.7159605, "step_id": 1647, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813325.7252126, "step_id": 1648, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813325.7343335, "step_id": 1649, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813325.7426815, "step_id": 1650, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813325.7518246, "step_id": 1651, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813325.761303, "step_id": 1652, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813325.7706692, "step_id": 1653, "start_load_kv_us": 17, "get_finished_us": 180} +{"t_unix": 1779813325.7801344, "step_id": 1654, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813325.7895103, "step_id": 1655, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813325.7984543, "step_id": 1656, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813325.80729, "step_id": 1657, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813325.816727, "step_id": 1658, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813325.8257596, "step_id": 1659, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813325.834983, "step_id": 1660, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813325.844836, "step_id": 1661, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813325.8544743, "step_id": 1662, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813325.8639827, "step_id": 1663, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813325.8738105, "step_id": 1664, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813325.884147, "step_id": 1665, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813325.894087, "step_id": 1666, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813325.9035635, "step_id": 1667, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813325.9129786, "step_id": 1668, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813325.9221432, "step_id": 1669, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813325.9321613, "step_id": 1670, "start_load_kv_us": 3, "get_finished_us": 190} +{"t_unix": 1779813325.9415677, "step_id": 1671, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813325.950721, "step_id": 1672, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813325.9600213, "step_id": 1673, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813325.9692626, "step_id": 1674, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813325.978914, "step_id": 1675, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813325.988125, "step_id": 1676, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813325.997583, "step_id": 1677, "start_load_kv_us": 3, "get_finished_us": 206} +{"t_unix": 1779813326.0068355, "step_id": 1678, "start_load_kv_us": 3, "get_finished_us": 154} +{"t_unix": 1779813326.0155199, "step_id": 1679, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813326.0242033, "step_id": 1680, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813326.032744, "step_id": 1681, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813326.0412033, "step_id": 1682, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813326.0502796, "step_id": 1683, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813326.0599692, "step_id": 1684, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813326.069194, "step_id": 1685, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813326.0787299, "step_id": 1686, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813326.088278, "step_id": 1687, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813326.0972126, "step_id": 1688, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813326.1065934, "step_id": 1689, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813326.1158953, "step_id": 1690, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813326.1252587, "step_id": 1691, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813326.1344287, "step_id": 1692, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813326.1439903, "step_id": 1693, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813326.1532602, "step_id": 1694, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813326.16257, "step_id": 1695, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813326.1723945, "step_id": 1696, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813326.182757, "step_id": 1697, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813326.192067, "step_id": 1698, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813326.2015984, "step_id": 1699, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813326.2109902, "step_id": 1700, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813326.2205048, "step_id": 1701, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813326.2303653, "step_id": 1702, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813326.2399268, "step_id": 1703, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813326.2495375, "step_id": 1704, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813326.25898, "step_id": 1705, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813326.2681913, "step_id": 1706, "start_load_kv_us": 14, "get_finished_us": 199} +{"t_unix": 1779813326.2778103, "step_id": 1707, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813326.287372, "step_id": 1708, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813326.2974763, "step_id": 1709, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813326.3068547, "step_id": 1710, "start_load_kv_us": 4, "get_finished_us": 247} +{"t_unix": 1779813326.315965, "step_id": 1711, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813326.3257005, "step_id": 1712, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813326.335765, "step_id": 1713, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813326.3445408, "step_id": 1714, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813326.3540373, "step_id": 1715, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813326.3633862, "step_id": 1716, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813326.3727922, "step_id": 1717, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813326.3825278, "step_id": 1718, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813326.3915288, "step_id": 1719, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813326.4006886, "step_id": 1720, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813326.410211, "step_id": 1721, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813326.4197314, "step_id": 1722, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813326.429271, "step_id": 1723, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813326.4385364, "step_id": 1724, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813326.4482365, "step_id": 1725, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813326.4578485, "step_id": 1726, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813326.4668834, "step_id": 1727, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813326.4771135, "step_id": 1728, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813326.486814, "step_id": 1729, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813326.495785, "step_id": 1730, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813326.5049102, "step_id": 1731, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813326.5141308, "step_id": 1732, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813326.5233772, "step_id": 1733, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813326.533087, "step_id": 1734, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813326.5832422, "step_id": 1735, "start_load_kv_us": 49, "get_finished_us": 339} +{"t_unix": 1779813326.5866737, "step_id": 1736, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813326.7875006, "step_id": 1737, "start_load_kv_us": 3, "get_finished_us": 301} +{"t_unix": 1779813326.7963889, "step_id": 1738, "start_load_kv_us": 3, "get_finished_us": 228} +{"t_unix": 1779813326.805705, "step_id": 1739, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813326.8150756, "step_id": 1740, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813326.8247352, "step_id": 1741, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813326.8345737, "step_id": 1742, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813326.8431776, "step_id": 1743, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813326.8520706, "step_id": 1744, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813326.8613622, "step_id": 1745, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813326.8697822, "step_id": 1746, "start_load_kv_us": 3, "get_finished_us": 184} +{"t_unix": 1779813326.878995, "step_id": 1747, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813326.8882535, "step_id": 1748, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813326.8981483, "step_id": 1749, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813326.9075265, "step_id": 1750, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813326.9172933, "step_id": 1751, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813326.926729, "step_id": 1752, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813326.9362676, "step_id": 1753, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813326.945966, "step_id": 1754, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813326.9556205, "step_id": 1755, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813326.9648023, "step_id": 1756, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813326.9743369, "step_id": 1757, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813326.9846482, "step_id": 1758, "start_load_kv_us": 3, "get_finished_us": 261} +{"t_unix": 1779813326.9947083, "step_id": 1759, "start_load_kv_us": 16, "get_finished_us": 220} +{"t_unix": 1779813327.0042388, "step_id": 1760, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813327.0141346, "step_id": 1761, "start_load_kv_us": 3, "get_finished_us": 226} +{"t_unix": 1779813327.0232742, "step_id": 1762, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813327.0325363, "step_id": 1763, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813327.0421836, "step_id": 1764, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813327.0528154, "step_id": 1765, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813327.0626972, "step_id": 1766, "start_load_kv_us": 17, "get_finished_us": 209} +{"t_unix": 1779813327.0723464, "step_id": 1767, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813327.081651, "step_id": 1768, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813327.0913308, "step_id": 1769, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813327.1010156, "step_id": 1770, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813327.1118057, "step_id": 1771, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813327.1622586, "step_id": 1772, "start_load_kv_us": 114, "get_finished_us": 292} +{"t_unix": 1779813327.1656246, "step_id": 1773, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813327.3690202, "step_id": 1774, "start_load_kv_us": 4, "get_finished_us": 307} +{"t_unix": 1779813327.3770032, "step_id": 1775, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813327.3854513, "step_id": 1776, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813327.3947449, "step_id": 1777, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813327.4033995, "step_id": 1778, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813327.4122815, "step_id": 1779, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813327.4211297, "step_id": 1780, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813327.4307506, "step_id": 1781, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813327.4398816, "step_id": 1782, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813327.44914, "step_id": 1783, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813327.4579525, "step_id": 1784, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813327.4671242, "step_id": 1785, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813327.4761896, "step_id": 1786, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813327.4853477, "step_id": 1787, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813327.494832, "step_id": 1788, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813327.5040092, "step_id": 1789, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813327.513634, "step_id": 1790, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813327.5227988, "step_id": 1791, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813327.5314772, "step_id": 1792, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813327.541353, "step_id": 1793, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813327.550281, "step_id": 1794, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813327.560969, "step_id": 1795, "start_load_kv_us": 13, "get_finished_us": 288} +{"t_unix": 1779813327.5696685, "step_id": 1796, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813327.5787582, "step_id": 1797, "start_load_kv_us": 11, "get_finished_us": 223} +{"t_unix": 1779813327.5875242, "step_id": 1798, "start_load_kv_us": 7, "get_finished_us": 196} +{"t_unix": 1779813327.5966094, "step_id": 1799, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813327.6053073, "step_id": 1800, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813327.6145205, "step_id": 1801, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813327.6240435, "step_id": 1802, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813327.6336339, "step_id": 1803, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813327.6432877, "step_id": 1804, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813327.6526713, "step_id": 1805, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813327.6628075, "step_id": 1806, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813327.672173, "step_id": 1807, "start_load_kv_us": 11, "get_finished_us": 205} +{"t_unix": 1779813327.681209, "step_id": 1808, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813327.6910386, "step_id": 1809, "start_load_kv_us": 12, "get_finished_us": 181} +{"t_unix": 1779813327.6995308, "step_id": 1810, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813327.7087982, "step_id": 1811, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813327.7180102, "step_id": 1812, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813327.727471, "step_id": 1813, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813327.736396, "step_id": 1814, "start_load_kv_us": 8, "get_finished_us": 240} +{"t_unix": 1779813327.7456958, "step_id": 1815, "start_load_kv_us": 10, "get_finished_us": 189} +{"t_unix": 1779813327.7546456, "step_id": 1816, "start_load_kv_us": 3, "get_finished_us": 157} +{"t_unix": 1779813327.764005, "step_id": 1817, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813327.773136, "step_id": 1818, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813327.7824464, "step_id": 1819, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813327.7919235, "step_id": 1820, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813327.8009844, "step_id": 1821, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813327.8101075, "step_id": 1822, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813327.819241, "step_id": 1823, "start_load_kv_us": 16, "get_finished_us": 258} +{"t_unix": 1779813327.8277204, "step_id": 1824, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813327.8372366, "step_id": 1825, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813327.845488, "step_id": 1826, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813327.8546739, "step_id": 1827, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813327.8638387, "step_id": 1828, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813327.8737106, "step_id": 1829, "start_load_kv_us": 10, "get_finished_us": 284} +{"t_unix": 1779813327.8830721, "step_id": 1830, "start_load_kv_us": 10, "get_finished_us": 258} +{"t_unix": 1779813327.892409, "step_id": 1831, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813327.9011757, "step_id": 1832, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813327.9111001, "step_id": 1833, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813327.9209552, "step_id": 1834, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813327.9311337, "step_id": 1835, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813327.9414208, "step_id": 1836, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813327.9515276, "step_id": 1837, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813327.9620388, "step_id": 1838, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813327.9712996, "step_id": 1839, "start_load_kv_us": 10, "get_finished_us": 213} +{"t_unix": 1779813327.9801204, "step_id": 1840, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813327.9900255, "step_id": 1841, "start_load_kv_us": 13, "get_finished_us": 293} +{"t_unix": 1779813327.9983747, "step_id": 1842, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813328.051464, "step_id": 1843, "start_load_kv_us": 244, "get_finished_us": 226} +{"t_unix": 1779813328.054651, "step_id": 1844, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813328.296421, "step_id": 1845, "start_load_kv_us": 92, "get_finished_us": 302} +{"t_unix": 1779813328.300167, "step_id": 1846, "start_load_kv_us": 11, "get_finished_us": 225} +{"t_unix": 1779813328.5068042, "step_id": 1847, "start_load_kv_us": 8, "get_finished_us": 346} +{"t_unix": 1779813328.515318, "step_id": 1848, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813328.525744, "step_id": 1849, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813328.5364015, "step_id": 1850, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813328.5466266, "step_id": 1851, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813328.5570672, "step_id": 1852, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813328.568047, "step_id": 1853, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813328.579684, "step_id": 1854, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813328.5906708, "step_id": 1855, "start_load_kv_us": 4, "get_finished_us": 290} +{"t_unix": 1779813328.601113, "step_id": 1856, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813328.612525, "step_id": 1857, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813328.623073, "step_id": 1858, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813328.634265, "step_id": 1859, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813328.644981, "step_id": 1860, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813328.6563525, "step_id": 1861, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813328.667679, "step_id": 1862, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813328.7213063, "step_id": 1863, "start_load_kv_us": 67, "get_finished_us": 306} +{"t_unix": 1779813328.724771, "step_id": 1864, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813328.9281845, "step_id": 1865, "start_load_kv_us": 3, "get_finished_us": 335} +{"t_unix": 1779813328.9399395, "step_id": 1866, "start_load_kv_us": 2, "get_finished_us": 338} +{"t_unix": 1779813328.9503117, "step_id": 1867, "start_load_kv_us": 3, "get_finished_us": 215} +{"t_unix": 1779813328.9616082, "step_id": 1868, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813328.9728599, "step_id": 1869, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813328.9847603, "step_id": 1870, "start_load_kv_us": 6, "get_finished_us": 263} +{"t_unix": 1779813328.9962502, "step_id": 1871, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813329.0066977, "step_id": 1872, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813329.0183237, "step_id": 1873, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813329.030238, "step_id": 1874, "start_load_kv_us": 4, "get_finished_us": 433} +{"t_unix": 1779813329.038758, "step_id": 1875, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813329.047721, "step_id": 1876, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813329.0599253, "step_id": 1877, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813329.0669374, "step_id": 1878, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813329.0770762, "step_id": 1879, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813329.0861824, "step_id": 1880, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813329.095771, "step_id": 1881, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813329.1050484, "step_id": 1882, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813329.1144233, "step_id": 1883, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813329.124112, "step_id": 1884, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813329.1339512, "step_id": 1885, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813329.1445298, "step_id": 1886, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813329.1541054, "step_id": 1887, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813329.1635423, "step_id": 1888, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813329.1736655, "step_id": 1889, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813329.182926, "step_id": 1890, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813329.1931987, "step_id": 1891, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813329.2028792, "step_id": 1892, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813329.2130296, "step_id": 1893, "start_load_kv_us": 5, "get_finished_us": 273} +{"t_unix": 1779813329.222425, "step_id": 1894, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813329.2328408, "step_id": 1895, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813329.2423248, "step_id": 1896, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813329.2524214, "step_id": 1897, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813329.2622836, "step_id": 1898, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813329.272097, "step_id": 1899, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813329.2821414, "step_id": 1900, "start_load_kv_us": 16, "get_finished_us": 148} +{"t_unix": 1779813329.2919374, "step_id": 1901, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813329.3023481, "step_id": 1902, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813329.312083, "step_id": 1903, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813329.3214731, "step_id": 1904, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813329.3317618, "step_id": 1905, "start_load_kv_us": 18, "get_finished_us": 271} +{"t_unix": 1779813329.3409107, "step_id": 1906, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813329.350903, "step_id": 1907, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813329.3613663, "step_id": 1908, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813329.371878, "step_id": 1909, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813329.3818376, "step_id": 1910, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813329.3918679, "step_id": 1911, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813329.401344, "step_id": 1912, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813329.4112449, "step_id": 1913, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813329.421187, "step_id": 1914, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813329.4316227, "step_id": 1915, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813329.4417362, "step_id": 1916, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813329.451374, "step_id": 1917, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813329.4614053, "step_id": 1918, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813329.4711478, "step_id": 1919, "start_load_kv_us": 19, "get_finished_us": 152} +{"t_unix": 1779813329.4804053, "step_id": 1920, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813329.4905756, "step_id": 1921, "start_load_kv_us": 3, "get_finished_us": 219} +{"t_unix": 1779813329.5413675, "step_id": 1922, "start_load_kv_us": 197, "get_finished_us": 271} +{"t_unix": 1779813329.5446177, "step_id": 1923, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813329.7466025, "step_id": 1924, "start_load_kv_us": 3, "get_finished_us": 338} +{"t_unix": 1779813329.7555149, "step_id": 1925, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813329.764287, "step_id": 1926, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813329.7745605, "step_id": 1927, "start_load_kv_us": 4, "get_finished_us": 290} +{"t_unix": 1779813329.7841156, "step_id": 1928, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813329.7932568, "step_id": 1929, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813329.8024619, "step_id": 1930, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813329.811618, "step_id": 1931, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813329.8206062, "step_id": 1932, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813329.8299634, "step_id": 1933, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813329.8405006, "step_id": 1934, "start_load_kv_us": 4, "get_finished_us": 553} +{"t_unix": 1779813329.8493178, "step_id": 1935, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813329.8586502, "step_id": 1936, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813329.868726, "step_id": 1937, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813329.8780584, "step_id": 1938, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813329.8876662, "step_id": 1939, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813329.8975444, "step_id": 1940, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813329.9070566, "step_id": 1941, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813329.9162107, "step_id": 1942, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813329.925952, "step_id": 1943, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813329.9352055, "step_id": 1944, "start_load_kv_us": 3, "get_finished_us": 154} +{"t_unix": 1779813329.9445622, "step_id": 1945, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813329.9542649, "step_id": 1946, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813329.9642174, "step_id": 1947, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813329.974168, "step_id": 1948, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813329.9846067, "step_id": 1949, "start_load_kv_us": 3, "get_finished_us": 413} +{"t_unix": 1779813329.9952881, "step_id": 1950, "start_load_kv_us": 5, "get_finished_us": 291} +{"t_unix": 1779813330.0050998, "step_id": 1951, "start_load_kv_us": 4, "get_finished_us": 274} +{"t_unix": 1779813330.0143838, "step_id": 1952, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813330.0253117, "step_id": 1953, "start_load_kv_us": 3, "get_finished_us": 443} +{"t_unix": 1779813330.03483, "step_id": 1954, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813330.0447803, "step_id": 1955, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813330.0583599, "step_id": 1956, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813330.0655153, "step_id": 1957, "start_load_kv_us": 4, "get_finished_us": 282} +{"t_unix": 1779813330.075045, "step_id": 1958, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813330.0853896, "step_id": 1959, "start_load_kv_us": 3, "get_finished_us": 245} +{"t_unix": 1779813330.0993454, "step_id": 1960, "start_load_kv_us": 4, "get_finished_us": 279} +{"t_unix": 1779813330.1041536, "step_id": 1961, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813330.1136882, "step_id": 1962, "start_load_kv_us": 3, "get_finished_us": 198} +{"t_unix": 1779813330.1232584, "step_id": 1963, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813330.1325414, "step_id": 1964, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813330.141518, "step_id": 1965, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813330.1514163, "step_id": 1966, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813330.1607153, "step_id": 1967, "start_load_kv_us": 3, "get_finished_us": 210} +{"t_unix": 1779813330.1698375, "step_id": 1968, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813330.1796753, "step_id": 1969, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813330.1883106, "step_id": 1970, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813330.1973677, "step_id": 1971, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813330.2065175, "step_id": 1972, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813330.2163246, "step_id": 1973, "start_load_kv_us": 3, "get_finished_us": 199} +{"t_unix": 1779813330.2251837, "step_id": 1974, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813330.2352173, "step_id": 1975, "start_load_kv_us": 3, "get_finished_us": 175} +{"t_unix": 1779813330.2443075, "step_id": 1976, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813330.2533853, "step_id": 1977, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813330.262777, "step_id": 1978, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813330.272071, "step_id": 1979, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813330.2816358, "step_id": 1980, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813330.2912726, "step_id": 1981, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813330.301263, "step_id": 1982, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813330.3111422, "step_id": 1983, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813330.3203492, "step_id": 1984, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813330.3304102, "step_id": 1985, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813330.339464, "step_id": 1986, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813330.3491669, "step_id": 1987, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813330.3587084, "step_id": 1988, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813330.368781, "step_id": 1989, "start_load_kv_us": 3, "get_finished_us": 159} +{"t_unix": 1779813330.378487, "step_id": 1990, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813330.3893087, "step_id": 1991, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813330.398794, "step_id": 1992, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813330.4082744, "step_id": 1993, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813330.418632, "step_id": 1994, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813330.42824, "step_id": 1995, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813330.43842, "step_id": 1996, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813330.4485314, "step_id": 1997, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813330.459637, "step_id": 1998, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813330.469725, "step_id": 1999, "start_load_kv_us": 4, "get_finished_us": 269} +{"t_unix": 1779813330.479143, "step_id": 2000, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813330.4893558, "step_id": 2001, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813330.498834, "step_id": 2002, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813330.5083425, "step_id": 2003, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813330.517707, "step_id": 2004, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813330.5273478, "step_id": 2005, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813330.5368443, "step_id": 2006, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813330.5465915, "step_id": 2007, "start_load_kv_us": 3, "get_finished_us": 194} +{"t_unix": 1779813330.556047, "step_id": 2008, "start_load_kv_us": 3, "get_finished_us": 157} +{"t_unix": 1779813330.565375, "step_id": 2009, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813330.575006, "step_id": 2010, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813330.584133, "step_id": 2011, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813330.593787, "step_id": 2012, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813330.6032283, "step_id": 2013, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813330.6133864, "step_id": 2014, "start_load_kv_us": 3, "get_finished_us": 231} +{"t_unix": 1779813330.6233575, "step_id": 2015, "start_load_kv_us": 3, "get_finished_us": 283} +{"t_unix": 1779813330.6324086, "step_id": 2016, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813330.6430259, "step_id": 2017, "start_load_kv_us": 3, "get_finished_us": 285} +{"t_unix": 1779813330.6522398, "step_id": 2018, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813330.70469, "step_id": 2019, "start_load_kv_us": 36, "get_finished_us": 309} +{"t_unix": 1779813330.7079768, "step_id": 2020, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813330.9097626, "step_id": 2021, "start_load_kv_us": 3, "get_finished_us": 334} +{"t_unix": 1779813330.9186797, "step_id": 2022, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813330.928636, "step_id": 2023, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813330.9381804, "step_id": 2024, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813330.9470184, "step_id": 2025, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813330.956281, "step_id": 2026, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813330.9654763, "step_id": 2027, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813330.9751434, "step_id": 2028, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813330.9841712, "step_id": 2029, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813330.994455, "step_id": 2030, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813331.0032527, "step_id": 2031, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813331.0126324, "step_id": 2032, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813331.0223835, "step_id": 2033, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813331.0311818, "step_id": 2034, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813331.0407603, "step_id": 2035, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813331.0501134, "step_id": 2036, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813331.0595198, "step_id": 2037, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813331.0691009, "step_id": 2038, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813331.0789373, "step_id": 2039, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813331.0883853, "step_id": 2040, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813331.0974867, "step_id": 2041, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813331.106741, "step_id": 2042, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813331.116334, "step_id": 2043, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813331.1259909, "step_id": 2044, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813331.1356304, "step_id": 2045, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813331.1454203, "step_id": 2046, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813331.1544826, "step_id": 2047, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813331.1639163, "step_id": 2048, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813331.1738098, "step_id": 2049, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813331.1826367, "step_id": 2050, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813331.192112, "step_id": 2051, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813331.2013872, "step_id": 2052, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813331.2107663, "step_id": 2053, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813331.220247, "step_id": 2054, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813331.2302105, "step_id": 2055, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813331.2399883, "step_id": 2056, "start_load_kv_us": 5, "get_finished_us": 304} +{"t_unix": 1779813331.2488952, "step_id": 2057, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813331.2584264, "step_id": 2058, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813331.2684696, "step_id": 2059, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813331.278066, "step_id": 2060, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813331.2960272, "step_id": 2061, "start_load_kv_us": 88, "get_finished_us": 1890} +{"t_unix": 1779813331.2998142, "step_id": 2062, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813331.3074176, "step_id": 2063, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813331.3175075, "step_id": 2064, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813331.3275003, "step_id": 2065, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813331.337042, "step_id": 2066, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813331.3472958, "step_id": 2067, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813331.357512, "step_id": 2068, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813331.3674705, "step_id": 2069, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813331.3769803, "step_id": 2070, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813331.3872488, "step_id": 2071, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813331.3968885, "step_id": 2072, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813331.4065235, "step_id": 2073, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813331.416232, "step_id": 2074, "start_load_kv_us": 3, "get_finished_us": 263} +{"t_unix": 1779813331.4260027, "step_id": 2075, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813331.4358733, "step_id": 2076, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813331.4456708, "step_id": 2077, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813331.4562302, "step_id": 2078, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813331.4660563, "step_id": 2079, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813331.4758766, "step_id": 2080, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813331.4855437, "step_id": 2081, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813331.4945211, "step_id": 2082, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813331.503427, "step_id": 2083, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813331.5126789, "step_id": 2084, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813331.5219808, "step_id": 2085, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813331.5316777, "step_id": 2086, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813331.5418422, "step_id": 2087, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813331.551168, "step_id": 2088, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813331.5603366, "step_id": 2089, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813331.5700178, "step_id": 2090, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813331.5800989, "step_id": 2091, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813331.5898216, "step_id": 2092, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813331.5998359, "step_id": 2093, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813331.6102114, "step_id": 2094, "start_load_kv_us": 15, "get_finished_us": 219} +{"t_unix": 1779813331.6193502, "step_id": 2095, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813331.6288831, "step_id": 2096, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813331.638865, "step_id": 2097, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813331.6477907, "step_id": 2098, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813331.6577072, "step_id": 2099, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813331.6668656, "step_id": 2100, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813331.674491, "step_id": 2101, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813331.6820886, "step_id": 2102, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813331.689095, "step_id": 2103, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813331.6969142, "step_id": 2104, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813331.703988, "step_id": 2105, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813331.7112892, "step_id": 2106, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813331.7182958, "step_id": 2107, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813331.7255418, "step_id": 2108, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813331.7325337, "step_id": 2109, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813331.7399542, "step_id": 2110, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813331.7473361, "step_id": 2111, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813331.7544959, "step_id": 2112, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813331.8022952, "step_id": 2113, "start_load_kv_us": 39, "get_finished_us": 300} +{"t_unix": 1779813331.805527, "step_id": 2114, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813332.047061, "step_id": 2115, "start_load_kv_us": 38, "get_finished_us": 357} +{"t_unix": 1779813332.0505269, "step_id": 2116, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813332.251047, "step_id": 2117, "start_load_kv_us": 3, "get_finished_us": 356} +{"t_unix": 1779813332.2595825, "step_id": 2118, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813332.2697551, "step_id": 2119, "start_load_kv_us": 5, "get_finished_us": 285} +{"t_unix": 1779813332.2791095, "step_id": 2120, "start_load_kv_us": 5, "get_finished_us": 313} +{"t_unix": 1779813332.2858155, "step_id": 2121, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813332.2933462, "step_id": 2122, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813332.300801, "step_id": 2123, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813332.3084292, "step_id": 2124, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813332.3160973, "step_id": 2125, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813332.323534, "step_id": 2126, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813332.3312144, "step_id": 2127, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813332.339198, "step_id": 2128, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813332.347379, "step_id": 2129, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813332.3554618, "step_id": 2130, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813332.3636281, "step_id": 2131, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813332.3718681, "step_id": 2132, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813332.3800406, "step_id": 2133, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813332.3881412, "step_id": 2134, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813332.3970094, "step_id": 2135, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813332.4049048, "step_id": 2136, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813332.4120615, "step_id": 2137, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813332.4202814, "step_id": 2138, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813332.4279144, "step_id": 2139, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813332.436003, "step_id": 2140, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813332.4440966, "step_id": 2141, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813332.4522376, "step_id": 2142, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813332.4602532, "step_id": 2143, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813332.4687166, "step_id": 2144, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813332.4765718, "step_id": 2145, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813332.4848173, "step_id": 2146, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813332.4930336, "step_id": 2147, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813332.5013027, "step_id": 2148, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813332.5089662, "step_id": 2149, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813332.5169635, "step_id": 2150, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813332.525486, "step_id": 2151, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813332.533765, "step_id": 2152, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813332.541275, "step_id": 2153, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813332.5495431, "step_id": 2154, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813332.5577464, "step_id": 2155, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813332.5657506, "step_id": 2156, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813332.5738258, "step_id": 2157, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813332.581987, "step_id": 2158, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813332.590261, "step_id": 2159, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813332.5983696, "step_id": 2160, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813332.6064658, "step_id": 2161, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813332.6152935, "step_id": 2162, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813332.6225708, "step_id": 2163, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813332.6307318, "step_id": 2164, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813332.6389701, "step_id": 2165, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813332.6471796, "step_id": 2166, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813332.6558564, "step_id": 2167, "start_load_kv_us": 11, "get_finished_us": 146} +{"t_unix": 1779813332.664066, "step_id": 2168, "start_load_kv_us": 10, "get_finished_us": 259} +{"t_unix": 1779813332.671953, "step_id": 2169, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813332.6802049, "step_id": 2170, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813332.6883163, "step_id": 2171, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813332.696689, "step_id": 2172, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813332.7046869, "step_id": 2173, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813332.7128189, "step_id": 2174, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813332.7206972, "step_id": 2175, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813332.7287617, "step_id": 2176, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813332.736633, "step_id": 2177, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813332.7451262, "step_id": 2178, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813332.7529037, "step_id": 2179, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813332.760228, "step_id": 2180, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813332.7679236, "step_id": 2181, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813332.7756708, "step_id": 2182, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813332.783739, "step_id": 2183, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813332.7913806, "step_id": 2184, "start_load_kv_us": 11, "get_finished_us": 211} +{"t_unix": 1779813332.7984297, "step_id": 2185, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813332.8060234, "step_id": 2186, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813332.8131795, "step_id": 2187, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813332.820586, "step_id": 2188, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813332.828038, "step_id": 2189, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813332.8356473, "step_id": 2190, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813332.8434646, "step_id": 2191, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813332.8512113, "step_id": 2192, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813332.85884, "step_id": 2193, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813332.8664114, "step_id": 2194, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813332.874184, "step_id": 2195, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813332.8818586, "step_id": 2196, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813332.889463, "step_id": 2197, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813332.8971055, "step_id": 2198, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813332.9052374, "step_id": 2199, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813332.9128473, "step_id": 2200, "start_load_kv_us": 9, "get_finished_us": 146} +{"t_unix": 1779813332.9200969, "step_id": 2201, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813332.927605, "step_id": 2202, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813332.935273, "step_id": 2203, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813332.9429572, "step_id": 2204, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813332.9506254, "step_id": 2205, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813332.9577808, "step_id": 2206, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813332.96518, "step_id": 2207, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813332.9728942, "step_id": 2208, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813332.9802442, "step_id": 2209, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813332.9878504, "step_id": 2210, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813332.9954212, "step_id": 2211, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813333.0030575, "step_id": 2212, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813333.01053, "step_id": 2213, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813333.0181725, "step_id": 2214, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813333.0263636, "step_id": 2215, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813333.0340414, "step_id": 2216, "start_load_kv_us": 10, "get_finished_us": 177} +{"t_unix": 1779813333.0411882, "step_id": 2217, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813333.0486913, "step_id": 2218, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813333.0562787, "step_id": 2219, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813333.0635934, "step_id": 2220, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813333.0711255, "step_id": 2221, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813333.0786543, "step_id": 2222, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813333.086384, "step_id": 2223, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813333.09392, "step_id": 2224, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813333.1017613, "step_id": 2225, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813333.1093495, "step_id": 2226, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813333.1169965, "step_id": 2227, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813333.124509, "step_id": 2228, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813333.1321425, "step_id": 2229, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813333.1395745, "step_id": 2230, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813333.1480315, "step_id": 2231, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813333.1562464, "step_id": 2232, "start_load_kv_us": 35, "get_finished_us": 228} +{"t_unix": 1779813333.1626627, "step_id": 2233, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813333.1702862, "step_id": 2234, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813333.178084, "step_id": 2235, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813333.1857803, "step_id": 2236, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813333.1933312, "step_id": 2237, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813333.2009845, "step_id": 2238, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813333.2084649, "step_id": 2239, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813333.2158384, "step_id": 2240, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813333.2234516, "step_id": 2241, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813333.2311728, "step_id": 2242, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813333.2388673, "step_id": 2243, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813333.246262, "step_id": 2244, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813333.2534077, "step_id": 2245, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813333.2607713, "step_id": 2246, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813333.2687714, "step_id": 2247, "start_load_kv_us": 27, "get_finished_us": 159} +{"t_unix": 1779813333.2760093, "step_id": 2248, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813333.2829852, "step_id": 2249, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813333.290415, "step_id": 2250, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813333.2981312, "step_id": 2251, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813333.3057296, "step_id": 2252, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813333.3141525, "step_id": 2253, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813333.3645883, "step_id": 2254, "start_load_kv_us": 180, "get_finished_us": 305} +{"t_unix": 1779813333.367837, "step_id": 2255, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813333.6023688, "step_id": 2256, "start_load_kv_us": 108, "get_finished_us": 340} +{"t_unix": 1779813333.6061528, "step_id": 2257, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813333.8066616, "step_id": 2258, "start_load_kv_us": 3, "get_finished_us": 365} +{"t_unix": 1779813333.8157456, "step_id": 2259, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813333.8255305, "step_id": 2260, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813333.8360164, "step_id": 2261, "start_load_kv_us": 4, "get_finished_us": 296} +{"t_unix": 1779813333.845315, "step_id": 2262, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813333.854965, "step_id": 2263, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813333.8645177, "step_id": 2264, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813333.873537, "step_id": 2265, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813333.8835363, "step_id": 2266, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813333.8933477, "step_id": 2267, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813333.903191, "step_id": 2268, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813333.9133458, "step_id": 2269, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813333.9234173, "step_id": 2270, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813333.9333677, "step_id": 2271, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813333.9434597, "step_id": 2272, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813333.9538393, "step_id": 2273, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813333.9639852, "step_id": 2274, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813333.9743145, "step_id": 2275, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813333.98414, "step_id": 2276, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813333.9923646, "step_id": 2277, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813334.0000544, "step_id": 2278, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813334.0079865, "step_id": 2279, "start_load_kv_us": 10, "get_finished_us": 213} +{"t_unix": 1779813334.0151916, "step_id": 2280, "start_load_kv_us": 9, "get_finished_us": 161} +{"t_unix": 1779813334.022277, "step_id": 2281, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813334.0296175, "step_id": 2282, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813334.0372717, "step_id": 2283, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813334.045176, "step_id": 2284, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813334.0529137, "step_id": 2285, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813334.0608313, "step_id": 2286, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813334.0687363, "step_id": 2287, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813334.076677, "step_id": 2288, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813334.084356, "step_id": 2289, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813334.0923376, "step_id": 2290, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813334.1001232, "step_id": 2291, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813334.1079285, "step_id": 2292, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813334.1159203, "step_id": 2293, "start_load_kv_us": 10, "get_finished_us": 146} +{"t_unix": 1779813334.1236022, "step_id": 2294, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813334.1309674, "step_id": 2295, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813334.138543, "step_id": 2296, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813334.1458323, "step_id": 2297, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813334.1533246, "step_id": 2298, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813334.1607695, "step_id": 2299, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813334.1683145, "step_id": 2300, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813334.1760433, "step_id": 2301, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813334.1838777, "step_id": 2302, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813334.1917052, "step_id": 2303, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813334.1995316, "step_id": 2304, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813334.2073143, "step_id": 2305, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813334.2152474, "step_id": 2306, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813334.2243783, "step_id": 2307, "start_load_kv_us": 2, "get_finished_us": 1437} +{"t_unix": 1779813334.2317452, "step_id": 2308, "start_load_kv_us": 3, "get_finished_us": 147} +{"t_unix": 1779813334.2397983, "step_id": 2309, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813334.2476091, "step_id": 2310, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813334.25486, "step_id": 2311, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813334.2623303, "step_id": 2312, "start_load_kv_us": 3, "get_finished_us": 147} +{"t_unix": 1779813334.2693412, "step_id": 2313, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813334.276921, "step_id": 2314, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813334.2842882, "step_id": 2315, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813334.2917776, "step_id": 2316, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813334.2993262, "step_id": 2317, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813334.3067174, "step_id": 2318, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813334.314428, "step_id": 2319, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813334.3220518, "step_id": 2320, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813334.329487, "step_id": 2321, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813334.3372743, "step_id": 2322, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813334.3448117, "step_id": 2323, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813334.352645, "step_id": 2324, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813334.3607712, "step_id": 2325, "start_load_kv_us": 3, "get_finished_us": 143} +{"t_unix": 1779813334.3683045, "step_id": 2326, "start_load_kv_us": 3, "get_finished_us": 140} +{"t_unix": 1779813334.3757396, "step_id": 2327, "start_load_kv_us": 15, "get_finished_us": 141} +{"t_unix": 1779813334.3832307, "step_id": 2328, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813334.390377, "step_id": 2329, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813334.3980782, "step_id": 2330, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813334.4059405, "step_id": 2331, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813334.4136508, "step_id": 2332, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813334.4214163, "step_id": 2333, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813334.4291532, "step_id": 2334, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813334.4368203, "step_id": 2335, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813334.4444973, "step_id": 2336, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813334.4521992, "step_id": 2337, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813334.4600453, "step_id": 2338, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813334.4679585, "step_id": 2339, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813334.4757965, "step_id": 2340, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813334.4843297, "step_id": 2341, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813334.4919732, "step_id": 2342, "start_load_kv_us": 16, "get_finished_us": 163} +{"t_unix": 1779813334.499909, "step_id": 2343, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813334.5078652, "step_id": 2344, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813334.5150506, "step_id": 2345, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813334.522705, "step_id": 2346, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813334.5302987, "step_id": 2347, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813334.5383167, "step_id": 2348, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813334.546017, "step_id": 2349, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813334.5540502, "step_id": 2350, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813334.6046996, "step_id": 2351, "start_load_kv_us": 82, "get_finished_us": 235} +{"t_unix": 1779813334.6080241, "step_id": 2352, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813334.8076298, "step_id": 2353, "start_load_kv_us": 3, "get_finished_us": 417} +{"t_unix": 1779813334.8157942, "step_id": 2354, "start_load_kv_us": 3, "get_finished_us": 186} +{"t_unix": 1779813334.8254716, "step_id": 2355, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813334.8354642, "step_id": 2356, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813334.846148, "step_id": 2357, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813334.8560457, "step_id": 2358, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813334.8655932, "step_id": 2359, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813334.8754952, "step_id": 2360, "start_load_kv_us": 15, "get_finished_us": 180} +{"t_unix": 1779813334.885, "step_id": 2361, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813334.8948507, "step_id": 2362, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813334.9045396, "step_id": 2363, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813334.9143739, "step_id": 2364, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813334.9246976, "step_id": 2365, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813334.933916, "step_id": 2366, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813334.9437373, "step_id": 2367, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813334.9532313, "step_id": 2368, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813334.9632006, "step_id": 2369, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813334.9729006, "step_id": 2370, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813334.9809299, "step_id": 2371, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813334.9884868, "step_id": 2372, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813334.9963424, "step_id": 2373, "start_load_kv_us": 7, "get_finished_us": 234} +{"t_unix": 1779813335.0035057, "step_id": 2374, "start_load_kv_us": 3, "get_finished_us": 208} +{"t_unix": 1779813335.0099816, "step_id": 2375, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813335.0171607, "step_id": 2376, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813335.0246925, "step_id": 2377, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813335.032289, "step_id": 2378, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813335.0398107, "step_id": 2379, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813335.047217, "step_id": 2380, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813335.0550768, "step_id": 2381, "start_load_kv_us": 3, "get_finished_us": 170} +{"t_unix": 1779813335.0619864, "step_id": 2382, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813335.069305, "step_id": 2383, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813335.0768065, "step_id": 2384, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813335.0841298, "step_id": 2385, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813335.091272, "step_id": 2386, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813335.1419678, "step_id": 2387, "start_load_kv_us": 87, "get_finished_us": 312} +{"t_unix": 1779813335.14542, "step_id": 2388, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813335.3823974, "step_id": 2389, "start_load_kv_us": 85, "get_finished_us": 397} +{"t_unix": 1779813335.3865082, "step_id": 2390, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813335.586016, "step_id": 2391, "start_load_kv_us": 4, "get_finished_us": 301} +{"t_unix": 1779813335.5947068, "step_id": 2392, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813335.603912, "step_id": 2393, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813335.6131017, "step_id": 2394, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813335.6222215, "step_id": 2395, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813335.6315954, "step_id": 2396, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813335.641136, "step_id": 2397, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813335.6496437, "step_id": 2398, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813335.659104, "step_id": 2399, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813335.6686776, "step_id": 2400, "start_load_kv_us": 17, "get_finished_us": 188} +{"t_unix": 1779813335.6782153, "step_id": 2401, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813335.6885133, "step_id": 2402, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813335.6973715, "step_id": 2403, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813335.7076654, "step_id": 2404, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813335.7172904, "step_id": 2405, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813335.726725, "step_id": 2406, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813335.7361212, "step_id": 2407, "start_load_kv_us": 7, "get_finished_us": 378} +{"t_unix": 1779813335.745355, "step_id": 2408, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813335.7547777, "step_id": 2409, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813335.7639172, "step_id": 2410, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813335.7731683, "step_id": 2411, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813335.7823908, "step_id": 2412, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813335.7923703, "step_id": 2413, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813335.8009884, "step_id": 2414, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813335.8104753, "step_id": 2415, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813335.820175, "step_id": 2416, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813335.872114, "step_id": 2417, "start_load_kv_us": 61, "get_finished_us": 310} +{"t_unix": 1779813335.876043, "step_id": 2418, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813336.0771184, "step_id": 2419, "start_load_kv_us": 3, "get_finished_us": 349} +{"t_unix": 1779813336.0862591, "step_id": 2420, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813336.0949166, "step_id": 2421, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813336.1037724, "step_id": 2422, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813336.112754, "step_id": 2423, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813336.122053, "step_id": 2424, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813336.1311119, "step_id": 2425, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813336.1402104, "step_id": 2426, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813336.149782, "step_id": 2427, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813336.159035, "step_id": 2428, "start_load_kv_us": 3, "get_finished_us": 175} +{"t_unix": 1779813336.169071, "step_id": 2429, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813336.1776786, "step_id": 2430, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813336.1872349, "step_id": 2431, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813336.1962028, "step_id": 2432, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813336.2059746, "step_id": 2433, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813336.2160678, "step_id": 2434, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813336.2251306, "step_id": 2435, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813336.2355442, "step_id": 2436, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813336.2455204, "step_id": 2437, "start_load_kv_us": 3, "get_finished_us": 288} +{"t_unix": 1779813336.2555249, "step_id": 2438, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813336.2649655, "step_id": 2439, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813336.274671, "step_id": 2440, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813336.2842517, "step_id": 2441, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813336.293686, "step_id": 2442, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813336.3034635, "step_id": 2443, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813336.3134134, "step_id": 2444, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813336.365016, "step_id": 2445, "start_load_kv_us": 58, "get_finished_us": 248} +{"t_unix": 1779813336.3684978, "step_id": 2446, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813336.571734, "step_id": 2447, "start_load_kv_us": 4, "get_finished_us": 296} +{"t_unix": 1779813336.5825891, "step_id": 2448, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813336.5939167, "step_id": 2449, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813336.606039, "step_id": 2450, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813336.6172285, "step_id": 2451, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813336.629189, "step_id": 2452, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813336.6407363, "step_id": 2453, "start_load_kv_us": 14, "get_finished_us": 159} +{"t_unix": 1779813336.652656, "step_id": 2454, "start_load_kv_us": 3, "get_finished_us": 193} +{"t_unix": 1779813336.6641006, "step_id": 2455, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813336.675911, "step_id": 2456, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813336.6878395, "step_id": 2457, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813336.6996305, "step_id": 2458, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813336.7116115, "step_id": 2459, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813336.722677, "step_id": 2460, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813336.7349296, "step_id": 2461, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813336.7461245, "step_id": 2462, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813336.7583926, "step_id": 2463, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813336.7698298, "step_id": 2464, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813336.7815695, "step_id": 2465, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813336.793845, "step_id": 2466, "start_load_kv_us": 9, "get_finished_us": 185} +{"t_unix": 1779813336.8053164, "step_id": 2467, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813336.8176703, "step_id": 2468, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813336.8296185, "step_id": 2469, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813336.8413143, "step_id": 2470, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813336.8524787, "step_id": 2471, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813336.8645384, "step_id": 2472, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813336.8762686, "step_id": 2473, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813336.8875647, "step_id": 2474, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813336.9001307, "step_id": 2475, "start_load_kv_us": 3, "get_finished_us": 209} +{"t_unix": 1779813336.9116058, "step_id": 2476, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813336.9241486, "step_id": 2477, "start_load_kv_us": 8, "get_finished_us": 252} +{"t_unix": 1779813336.9350536, "step_id": 2478, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813336.9471948, "step_id": 2479, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813336.958581, "step_id": 2480, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813336.9700377, "step_id": 2481, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813336.9824271, "step_id": 2482, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813336.9939115, "step_id": 2483, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813337.0062945, "step_id": 2484, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813337.0182383, "step_id": 2485, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813337.0301704, "step_id": 2486, "start_load_kv_us": 3, "get_finished_us": 160} +{"t_unix": 1779813337.0414898, "step_id": 2487, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813337.0536022, "step_id": 2488, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813337.0656366, "step_id": 2489, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813337.0775042, "step_id": 2490, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813337.0901148, "step_id": 2491, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813337.1018014, "step_id": 2492, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813337.114232, "step_id": 2493, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813337.1256638, "step_id": 2494, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813337.138464, "step_id": 2495, "start_load_kv_us": 3, "get_finished_us": 229} +{"t_unix": 1779813337.1503134, "step_id": 2496, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813337.162472, "step_id": 2497, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813337.1751542, "step_id": 2498, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813337.1866643, "step_id": 2499, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813337.198912, "step_id": 2500, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813337.210317, "step_id": 2501, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813337.2216334, "step_id": 2502, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813337.2321482, "step_id": 2503, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813337.2435436, "step_id": 2504, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813337.2547462, "step_id": 2505, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813337.2659721, "step_id": 2506, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813337.277263, "step_id": 2507, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813337.2882955, "step_id": 2508, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813337.300363, "step_id": 2509, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813337.3116744, "step_id": 2510, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813337.3232255, "step_id": 2511, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813337.3325076, "step_id": 2512, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813337.3418007, "step_id": 2513, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813337.3518763, "step_id": 2514, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813337.3613198, "step_id": 2515, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813337.3716881, "step_id": 2516, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813337.3809829, "step_id": 2517, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813337.3911614, "step_id": 2518, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813337.4012299, "step_id": 2519, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813337.4114094, "step_id": 2520, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813337.4214272, "step_id": 2521, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813337.4314885, "step_id": 2522, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813337.4425771, "step_id": 2523, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813337.451673, "step_id": 2524, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813337.461817, "step_id": 2525, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813337.4713914, "step_id": 2526, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813337.481614, "step_id": 2527, "start_load_kv_us": 3, "get_finished_us": 235} +{"t_unix": 1779813337.491384, "step_id": 2528, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813337.5013227, "step_id": 2529, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813337.5123765, "step_id": 2530, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813337.521868, "step_id": 2531, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813337.5327368, "step_id": 2532, "start_load_kv_us": 18, "get_finished_us": 247} +{"t_unix": 1779813337.542279, "step_id": 2533, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813337.552506, "step_id": 2534, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813337.5628111, "step_id": 2535, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813337.5730076, "step_id": 2536, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813337.5834005, "step_id": 2537, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813337.5936203, "step_id": 2538, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813337.6043866, "step_id": 2539, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813337.6139913, "step_id": 2540, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813337.6244605, "step_id": 2541, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813337.6339045, "step_id": 2542, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813337.6441824, "step_id": 2543, "start_load_kv_us": 3, "get_finished_us": 160} +{"t_unix": 1779813337.653844, "step_id": 2544, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813337.6644704, "step_id": 2545, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813337.6753347, "step_id": 2546, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813337.6848588, "step_id": 2547, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813337.695343, "step_id": 2548, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813337.7050595, "step_id": 2549, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813337.7148292, "step_id": 2550, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813337.7249608, "step_id": 2551, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813337.7349062, "step_id": 2552, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813337.7446353, "step_id": 2553, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813337.7542567, "step_id": 2554, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813337.7647293, "step_id": 2555, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813337.7737541, "step_id": 2556, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813337.7840683, "step_id": 2557, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813337.7931597, "step_id": 2558, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813337.8032062, "step_id": 2559, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813337.8123531, "step_id": 2560, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813337.8219745, "step_id": 2561, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813337.8322682, "step_id": 2562, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813337.841602, "step_id": 2563, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813337.8521194, "step_id": 2564, "start_load_kv_us": 4, "get_finished_us": 284} +{"t_unix": 1779813337.8611243, "step_id": 2565, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813337.870787, "step_id": 2566, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813337.8803024, "step_id": 2567, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813337.890037, "step_id": 2568, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813337.8996863, "step_id": 2569, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813337.9092972, "step_id": 2570, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813337.9196484, "step_id": 2571, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813337.9287746, "step_id": 2572, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813337.9391656, "step_id": 2573, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813337.9480278, "step_id": 2574, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813337.9583693, "step_id": 2575, "start_load_kv_us": 15, "get_finished_us": 221} +{"t_unix": 1779813337.967518, "step_id": 2576, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813337.9769373, "step_id": 2577, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813337.9868941, "step_id": 2578, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813337.9957361, "step_id": 2579, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813338.0076888, "step_id": 2580, "start_load_kv_us": 18, "get_finished_us": 1121} +{"t_unix": 1779813338.019402, "step_id": 2581, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813338.024381, "step_id": 2582, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813338.03392, "step_id": 2583, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813338.0434725, "step_id": 2584, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813338.0531952, "step_id": 2585, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813338.0628972, "step_id": 2586, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813338.0728269, "step_id": 2587, "start_load_kv_us": 3, "get_finished_us": 149} +{"t_unix": 1779813338.0820506, "step_id": 2588, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813338.092146, "step_id": 2589, "start_load_kv_us": 16, "get_finished_us": 153} +{"t_unix": 1779813338.1012945, "step_id": 2590, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813338.1117103, "step_id": 2591, "start_load_kv_us": 3, "get_finished_us": 200} +{"t_unix": 1779813338.1210077, "step_id": 2592, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813338.1306477, "step_id": 2593, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813338.141075, "step_id": 2594, "start_load_kv_us": 3, "get_finished_us": 227} +{"t_unix": 1779813338.150184, "step_id": 2595, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813338.1602075, "step_id": 2596, "start_load_kv_us": 14, "get_finished_us": 221} +{"t_unix": 1779813338.168702, "step_id": 2597, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813338.1780722, "step_id": 2598, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813338.1874552, "step_id": 2599, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813338.1968062, "step_id": 2600, "start_load_kv_us": 12, "get_finished_us": 213} +{"t_unix": 1779813338.2063706, "step_id": 2601, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813338.2163584, "step_id": 2602, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813338.226636, "step_id": 2603, "start_load_kv_us": 3, "get_finished_us": 214} +{"t_unix": 1779813338.2354803, "step_id": 2604, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813338.2456024, "step_id": 2605, "start_load_kv_us": 3, "get_finished_us": 238} +{"t_unix": 1779813338.2546084, "step_id": 2606, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813338.2652533, "step_id": 2607, "start_load_kv_us": 3, "get_finished_us": 144} +{"t_unix": 1779813338.2745209, "step_id": 2608, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813338.2828386, "step_id": 2609, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813338.2913797, "step_id": 2610, "start_load_kv_us": 3, "get_finished_us": 145} +{"t_unix": 1779813338.298886, "step_id": 2611, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813338.3076644, "step_id": 2612, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813338.3152773, "step_id": 2613, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813338.323333, "step_id": 2614, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813338.33146, "step_id": 2615, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813338.339457, "step_id": 2616, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813338.3476307, "step_id": 2617, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813338.3559794, "step_id": 2618, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813338.364898, "step_id": 2619, "start_load_kv_us": 3, "get_finished_us": 166} +{"t_unix": 1779813338.3728802, "step_id": 2620, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813338.3813674, "step_id": 2621, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813338.390009, "step_id": 2622, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813338.398892, "step_id": 2623, "start_load_kv_us": 3, "get_finished_us": 144} +{"t_unix": 1779813338.4067204, "step_id": 2624, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813338.4147923, "step_id": 2625, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813338.4231503, "step_id": 2626, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813338.430679, "step_id": 2627, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813338.440298, "step_id": 2628, "start_load_kv_us": 4, "get_finished_us": 1046} +{"t_unix": 1779813338.4874022, "step_id": 2629, "start_load_kv_us": 49, "get_finished_us": 248} +{"t_unix": 1779813338.680235, "step_id": 2630, "start_load_kv_us": 57, "get_finished_us": 305} +{"t_unix": 1779813338.9171898, "step_id": 2631, "start_load_kv_us": 44, "get_finished_us": 306} +{"t_unix": 1779813338.9286814, "step_id": 2632, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813339.163045, "step_id": 2633, "start_load_kv_us": 3, "get_finished_us": 310} +{"t_unix": 1779813339.1736343, "step_id": 2634, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813339.1850193, "step_id": 2635, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813339.1960359, "step_id": 2636, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813339.2074153, "step_id": 2637, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813339.2183888, "step_id": 2638, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813339.2298667, "step_id": 2639, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813339.2402115, "step_id": 2640, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813339.2513819, "step_id": 2641, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813339.2630136, "step_id": 2642, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813339.274981, "step_id": 2643, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813339.285938, "step_id": 2644, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813339.2960553, "step_id": 2645, "start_load_kv_us": 3, "get_finished_us": 171} +{"t_unix": 1779813339.3046072, "step_id": 2646, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813339.313923, "step_id": 2647, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813339.3238254, "step_id": 2648, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813339.332413, "step_id": 2649, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813339.3417566, "step_id": 2650, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813339.351756, "step_id": 2651, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813339.360433, "step_id": 2652, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813339.3697705, "step_id": 2653, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813339.3789845, "step_id": 2654, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813339.3886435, "step_id": 2655, "start_load_kv_us": 3, "get_finished_us": 169} +{"t_unix": 1779813339.397347, "step_id": 2656, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813339.4065983, "step_id": 2657, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813339.4161603, "step_id": 2658, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813339.42639, "step_id": 2659, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813339.4355175, "step_id": 2660, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813339.445299, "step_id": 2661, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813339.4601843, "step_id": 2662, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813339.463975, "step_id": 2663, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813339.474167, "step_id": 2664, "start_load_kv_us": 9, "get_finished_us": 243} +{"t_unix": 1779813339.482848, "step_id": 2665, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813339.4925807, "step_id": 2666, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813339.502836, "step_id": 2667, "start_load_kv_us": 15, "get_finished_us": 237} +{"t_unix": 1779813339.5117888, "step_id": 2668, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813339.5213876, "step_id": 2669, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813339.5308857, "step_id": 2670, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813339.540915, "step_id": 2671, "start_load_kv_us": 8, "get_finished_us": 166} +{"t_unix": 1779813339.5500538, "step_id": 2672, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813339.5602965, "step_id": 2673, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813339.5697517, "step_id": 2674, "start_load_kv_us": 13, "get_finished_us": 152} +{"t_unix": 1779813339.5780454, "step_id": 2675, "start_load_kv_us": 9, "get_finished_us": 177} +{"t_unix": 1779813339.5850265, "step_id": 2676, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813339.5935357, "step_id": 2677, "start_load_kv_us": 8, "get_finished_us": 159} +{"t_unix": 1779813339.6006227, "step_id": 2678, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813339.6084657, "step_id": 2679, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813339.6167867, "step_id": 2680, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813339.6230628, "step_id": 2681, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813339.6304708, "step_id": 2682, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813339.6386397, "step_id": 2683, "start_load_kv_us": 8, "get_finished_us": 173} +{"t_unix": 1779813339.645519, "step_id": 2684, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813339.6526518, "step_id": 2685, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813339.660344, "step_id": 2686, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813339.6678317, "step_id": 2687, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813339.6749737, "step_id": 2688, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813339.6826227, "step_id": 2689, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813339.690232, "step_id": 2690, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813339.6979759, "step_id": 2691, "start_load_kv_us": 10, "get_finished_us": 165} +{"t_unix": 1779813339.704907, "step_id": 2692, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813339.7131763, "step_id": 2693, "start_load_kv_us": 25, "get_finished_us": 175} +{"t_unix": 1779813339.7206886, "step_id": 2694, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813339.7287657, "step_id": 2695, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813339.7374585, "step_id": 2696, "start_load_kv_us": 16, "get_finished_us": 202} +{"t_unix": 1779813339.7450478, "step_id": 2697, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813339.753017, "step_id": 2698, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813339.7615032, "step_id": 2699, "start_load_kv_us": 8, "get_finished_us": 161} +{"t_unix": 1779813339.7688756, "step_id": 2700, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813339.776975, "step_id": 2701, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813339.7842028, "step_id": 2702, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813339.791299, "step_id": 2703, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813339.7986872, "step_id": 2704, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813339.8061678, "step_id": 2705, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813339.8135555, "step_id": 2706, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813339.8214679, "step_id": 2707, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813339.8282654, "step_id": 2708, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813339.836157, "step_id": 2709, "start_load_kv_us": 9, "get_finished_us": 170} +{"t_unix": 1779813339.843452, "step_id": 2710, "start_load_kv_us": 2, "get_finished_us": 568} +{"t_unix": 1779813339.8525949, "step_id": 2711, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813339.8581433, "step_id": 2712, "start_load_kv_us": 11, "get_finished_us": 257} +{"t_unix": 1779813339.8646934, "step_id": 2713, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813339.872083, "step_id": 2714, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813339.8794937, "step_id": 2715, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813339.8870156, "step_id": 2716, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813339.8943973, "step_id": 2717, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813339.9017437, "step_id": 2718, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813339.9092307, "step_id": 2719, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813339.916516, "step_id": 2720, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813339.9240737, "step_id": 2721, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813339.931052, "step_id": 2722, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813339.9388428, "step_id": 2723, "start_load_kv_us": 9, "get_finished_us": 160} +{"t_unix": 1779813339.9458928, "step_id": 2724, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813339.9535875, "step_id": 2725, "start_load_kv_us": 12, "get_finished_us": 181} +{"t_unix": 1779813339.9597113, "step_id": 2726, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813339.9669764, "step_id": 2727, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813339.9747381, "step_id": 2728, "start_load_kv_us": 3, "get_finished_us": 218} +{"t_unix": 1779813339.9812012, "step_id": 2729, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813339.9878109, "step_id": 2730, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813339.994991, "step_id": 2731, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813340.002565, "step_id": 2732, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813340.0099227, "step_id": 2733, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813340.0174952, "step_id": 2734, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813340.0249684, "step_id": 2735, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813340.0322359, "step_id": 2736, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813340.0396042, "step_id": 2737, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813340.0478363, "step_id": 2738, "start_load_kv_us": 24, "get_finished_us": 229} +{"t_unix": 1779813340.055545, "step_id": 2739, "start_load_kv_us": 12, "get_finished_us": 184} +{"t_unix": 1779813340.0622659, "step_id": 2740, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813340.070268, "step_id": 2741, "start_load_kv_us": 10, "get_finished_us": 188} +{"t_unix": 1779813340.0769255, "step_id": 2742, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813340.084307, "step_id": 2743, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813340.0920742, "step_id": 2744, "start_load_kv_us": 4, "get_finished_us": 315} +{"t_unix": 1779813340.0982788, "step_id": 2745, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813340.1052535, "step_id": 2746, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813340.1121824, "step_id": 2747, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813340.1191936, "step_id": 2748, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813340.1264033, "step_id": 2749, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813340.1334753, "step_id": 2750, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813340.1404827, "step_id": 2751, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813340.1476042, "step_id": 2752, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813340.154203, "step_id": 2753, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813340.160772, "step_id": 2754, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813340.1684968, "step_id": 2755, "start_load_kv_us": 3, "get_finished_us": 217} +{"t_unix": 1779813340.1751444, "step_id": 2756, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813340.1830425, "step_id": 2757, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813340.1902206, "step_id": 2758, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813340.1973705, "step_id": 2759, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813340.2053685, "step_id": 2760, "start_load_kv_us": 7, "get_finished_us": 167} +{"t_unix": 1779813340.2120614, "step_id": 2761, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813340.219166, "step_id": 2762, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813340.2261956, "step_id": 2763, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813340.233266, "step_id": 2764, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813340.2406712, "step_id": 2765, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813340.2477038, "step_id": 2766, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813340.2546794, "step_id": 2767, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813340.2619298, "step_id": 2768, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813340.2688057, "step_id": 2769, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813340.275701, "step_id": 2770, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813340.2831087, "step_id": 2771, "start_load_kv_us": 11, "get_finished_us": 143} +{"t_unix": 1779813340.2895002, "step_id": 2772, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813340.2968044, "step_id": 2773, "start_load_kv_us": 10, "get_finished_us": 169} +{"t_unix": 1779813340.3035645, "step_id": 2774, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813340.3111365, "step_id": 2775, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813340.3238945, "step_id": 2776, "start_load_kv_us": 114, "get_finished_us": 3134} +{"t_unix": 1779813340.3271675, "step_id": 2777, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813340.3332546, "step_id": 2778, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813340.340774, "step_id": 2779, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813340.3483193, "step_id": 2780, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813340.35558, "step_id": 2781, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813340.3631818, "step_id": 2782, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813340.370587, "step_id": 2783, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813340.3780797, "step_id": 2784, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813340.3855095, "step_id": 2785, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813340.3931599, "step_id": 2786, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813340.4014654, "step_id": 2787, "start_load_kv_us": 3, "get_finished_us": 212} +{"t_unix": 1779813340.408667, "step_id": 2788, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813340.416815, "step_id": 2789, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813340.423715, "step_id": 2790, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813340.4312804, "step_id": 2791, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813340.4392161, "step_id": 2792, "start_load_kv_us": 3, "get_finished_us": 214} +{"t_unix": 1779813340.4463086, "step_id": 2793, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813340.4539304, "step_id": 2794, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813340.461445, "step_id": 2795, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813340.4690685, "step_id": 2796, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813340.4766672, "step_id": 2797, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813340.484326, "step_id": 2798, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813340.4920423, "step_id": 2799, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813340.4996245, "step_id": 2800, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813340.507343, "step_id": 2801, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813340.5149672, "step_id": 2802, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813340.5231574, "step_id": 2803, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813340.5304537, "step_id": 2804, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813340.538656, "step_id": 2805, "start_load_kv_us": 18, "get_finished_us": 188} +{"t_unix": 1779813340.5458026, "step_id": 2806, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813340.5536697, "step_id": 2807, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813340.5618396, "step_id": 2808, "start_load_kv_us": 14, "get_finished_us": 159} +{"t_unix": 1779813340.5690517, "step_id": 2809, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813340.5765376, "step_id": 2810, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813340.5840802, "step_id": 2811, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813340.5916388, "step_id": 2812, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813340.598964, "step_id": 2813, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813340.606033, "step_id": 2814, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813340.6126444, "step_id": 2815, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813340.6193545, "step_id": 2816, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813340.6260946, "step_id": 2817, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813340.6332464, "step_id": 2818, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813340.6407979, "step_id": 2819, "start_load_kv_us": 3, "get_finished_us": 208} +{"t_unix": 1779813340.647845, "step_id": 2820, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813340.655584, "step_id": 2821, "start_load_kv_us": 11, "get_finished_us": 238} +{"t_unix": 1779813340.6622233, "step_id": 2822, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813340.6693673, "step_id": 2823, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813340.6770782, "step_id": 2824, "start_load_kv_us": 11, "get_finished_us": 226} +{"t_unix": 1779813340.683719, "step_id": 2825, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813340.6912937, "step_id": 2826, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813340.6985736, "step_id": 2827, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813340.7061524, "step_id": 2828, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813340.7134926, "step_id": 2829, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813340.7205625, "step_id": 2830, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813340.7281003, "step_id": 2831, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813340.7353005, "step_id": 2832, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813340.742336, "step_id": 2833, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813340.7492058, "step_id": 2834, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813340.757386, "step_id": 2835, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813340.7641554, "step_id": 2836, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813340.7721176, "step_id": 2837, "start_load_kv_us": 8, "get_finished_us": 178} +{"t_unix": 1779813340.7790782, "step_id": 2838, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813340.7864609, "step_id": 2839, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813340.7941387, "step_id": 2840, "start_load_kv_us": 20, "get_finished_us": 148} +{"t_unix": 1779813340.8009782, "step_id": 2841, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813340.8083715, "step_id": 2842, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813340.8156621, "step_id": 2843, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813340.823213, "step_id": 2844, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813340.8308392, "step_id": 2845, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813340.838464, "step_id": 2846, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813340.8462834, "step_id": 2847, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813340.8538601, "step_id": 2848, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813340.8614607, "step_id": 2849, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813340.8686562, "step_id": 2850, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813340.8764477, "step_id": 2851, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813340.8832273, "step_id": 2852, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813340.891203, "step_id": 2853, "start_load_kv_us": 3, "get_finished_us": 210} +{"t_unix": 1779813340.898162, "step_id": 2854, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813340.9056845, "step_id": 2855, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813340.913877, "step_id": 2856, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813340.9208145, "step_id": 2857, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813340.9285207, "step_id": 2858, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813340.9361258, "step_id": 2859, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813340.9436216, "step_id": 2860, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813340.951052, "step_id": 2861, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813340.958741, "step_id": 2862, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813340.9666586, "step_id": 2863, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813340.9742904, "step_id": 2864, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813340.9820082, "step_id": 2865, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813340.9896972, "step_id": 2866, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813340.9981344, "step_id": 2867, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813341.0050814, "step_id": 2868, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813341.0132854, "step_id": 2869, "start_load_kv_us": 3, "get_finished_us": 155} +{"t_unix": 1779813341.0204086, "step_id": 2870, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813341.0281715, "step_id": 2871, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813341.036248, "step_id": 2872, "start_load_kv_us": 3, "get_finished_us": 155} +{"t_unix": 1779813341.043414, "step_id": 2873, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813341.051115, "step_id": 2874, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813341.0588014, "step_id": 2875, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813341.0661843, "step_id": 2876, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813341.0729778, "step_id": 2877, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813341.0802164, "step_id": 2878, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813341.087642, "step_id": 2879, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813341.0950801, "step_id": 2880, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813341.102515, "step_id": 2881, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813341.1101568, "step_id": 2882, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813341.1183846, "step_id": 2883, "start_load_kv_us": 4, "get_finished_us": 274} +{"t_unix": 1779813341.1252306, "step_id": 2884, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813341.1328816, "step_id": 2885, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813341.141243, "step_id": 2886, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813341.1458855, "step_id": 2887, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813341.1498039, "step_id": 2888, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813341.3654754, "step_id": 2889, "start_load_kv_us": 198, "get_finished_us": 323} +{"t_unix": 1779813341.3686802, "step_id": 2890, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813341.5631378, "step_id": 2891, "start_load_kv_us": 4, "get_finished_us": 352} +{"t_unix": 1779813341.566674, "step_id": 2892, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813341.5712483, "step_id": 2893, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813341.576062, "step_id": 2894, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813341.5807514, "step_id": 2895, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813341.585545, "step_id": 2896, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813341.5903316, "step_id": 2897, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813341.5951278, "step_id": 2898, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813341.5999017, "step_id": 2899, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813341.604582, "step_id": 2900, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813341.6094108, "step_id": 2901, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813341.6141737, "step_id": 2902, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813341.61892, "step_id": 2903, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813341.6243553, "step_id": 2904, "start_load_kv_us": 12, "get_finished_us": 163} +{"t_unix": 1779813341.628516, "step_id": 2905, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813341.6332834, "step_id": 2906, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813341.6381488, "step_id": 2907, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813341.6429849, "step_id": 2908, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813341.6477637, "step_id": 2909, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813341.6525242, "step_id": 2910, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813341.6573458, "step_id": 2911, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813341.6621697, "step_id": 2912, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813341.667019, "step_id": 2913, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813341.6716597, "step_id": 2914, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813341.6766021, "step_id": 2915, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813341.6812642, "step_id": 2916, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813341.6860533, "step_id": 2917, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813341.6908598, "step_id": 2918, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813341.695624, "step_id": 2919, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813341.7009182, "step_id": 2920, "start_load_kv_us": 3, "get_finished_us": 169} +{"t_unix": 1779813341.7051597, "step_id": 2921, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813341.7100444, "step_id": 2922, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813341.7146988, "step_id": 2923, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813341.719482, "step_id": 2924, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813341.7242744, "step_id": 2925, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813341.729064, "step_id": 2926, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813341.7338524, "step_id": 2927, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813341.7386487, "step_id": 2928, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813341.7435699, "step_id": 2929, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813341.7483504, "step_id": 2930, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813341.7530375, "step_id": 2931, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813341.7577524, "step_id": 2932, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813341.7625651, "step_id": 2933, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813341.7674112, "step_id": 2934, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813341.77221, "step_id": 2935, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813341.7775278, "step_id": 2936, "start_load_kv_us": 13, "get_finished_us": 177} +{"t_unix": 1779813341.7817566, "step_id": 2937, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813341.786577, "step_id": 2938, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813341.791275, "step_id": 2939, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813341.7960916, "step_id": 2940, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813341.8009033, "step_id": 2941, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813341.8056586, "step_id": 2942, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813341.8103905, "step_id": 2943, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813341.8152628, "step_id": 2944, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813341.8200395, "step_id": 2945, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813341.8249307, "step_id": 2946, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813341.8296683, "step_id": 2947, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813341.8344228, "step_id": 2948, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813341.839204, "step_id": 2949, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813341.8440092, "step_id": 2950, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813341.8487298, "step_id": 2951, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813341.8540955, "step_id": 2952, "start_load_kv_us": 11, "get_finished_us": 184} +{"t_unix": 1779813341.8583128, "step_id": 2953, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813341.8631198, "step_id": 2954, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813341.8679554, "step_id": 2955, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813341.8726327, "step_id": 2956, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813341.877459, "step_id": 2957, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813341.8822517, "step_id": 2958, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813341.8871415, "step_id": 2959, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813341.891961, "step_id": 2960, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813341.896647, "step_id": 2961, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813341.9013593, "step_id": 2962, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813341.9062197, "step_id": 2963, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813341.911005, "step_id": 2964, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813341.9157813, "step_id": 2965, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813341.9205627, "step_id": 2966, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813341.9253445, "step_id": 2967, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813341.9306211, "step_id": 2968, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813341.934894, "step_id": 2969, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813341.939706, "step_id": 2970, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813341.9444723, "step_id": 2971, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813341.9493668, "step_id": 2972, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813341.9541082, "step_id": 2973, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813341.958887, "step_id": 2974, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813341.9638638, "step_id": 2975, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813341.9685187, "step_id": 2976, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813341.973208, "step_id": 2977, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813341.9780056, "step_id": 2978, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813341.982781, "step_id": 2979, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813341.9875927, "step_id": 2980, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813341.9923308, "step_id": 2981, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813341.9971743, "step_id": 2982, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813342.0020506, "step_id": 2983, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813342.0073352, "step_id": 2984, "start_load_kv_us": 13, "get_finished_us": 188} +{"t_unix": 1779813342.0115583, "step_id": 2985, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813342.0163743, "step_id": 2986, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813342.0211287, "step_id": 2987, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813342.0259125, "step_id": 2988, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813342.030655, "step_id": 2989, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813342.0354626, "step_id": 2990, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813342.0402262, "step_id": 2991, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813342.0464146, "step_id": 2992, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813342.0500498, "step_id": 2993, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813342.054703, "step_id": 2994, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813342.05941, "step_id": 2995, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813342.0642757, "step_id": 2996, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813342.0693743, "step_id": 2997, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813342.0738084, "step_id": 2998, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813342.0785904, "step_id": 2999, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813342.0838938, "step_id": 3000, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813342.0881126, "step_id": 3001, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813342.0929015, "step_id": 3002, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813342.0976777, "step_id": 3003, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813342.1024292, "step_id": 3004, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813342.1072931, "step_id": 3005, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813342.1121247, "step_id": 3006, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813342.116882, "step_id": 3007, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813342.121663, "step_id": 3008, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813342.1264176, "step_id": 3009, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813342.131247, "step_id": 3010, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813342.1360822, "step_id": 3011, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813342.1408668, "step_id": 3012, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813342.1456115, "step_id": 3013, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813342.1503897, "step_id": 3014, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813342.1552017, "step_id": 3015, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813342.1606123, "step_id": 3016, "start_load_kv_us": 16, "get_finished_us": 149} +{"t_unix": 1779813342.1648927, "step_id": 3017, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813342.1697917, "step_id": 3018, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813342.1744962, "step_id": 3019, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813342.1792662, "step_id": 3020, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813342.1841426, "step_id": 3021, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813342.1888878, "step_id": 3022, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813342.193635, "step_id": 3023, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813342.198429, "step_id": 3024, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813342.2032604, "step_id": 3025, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813342.2080262, "step_id": 3026, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813342.212874, "step_id": 3027, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813342.217644, "step_id": 3028, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813342.222363, "step_id": 3029, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813342.2272139, "step_id": 3030, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813342.2320356, "step_id": 3031, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813342.2373333, "step_id": 3032, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813342.2415795, "step_id": 3033, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813342.246427, "step_id": 3034, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813342.2511404, "step_id": 3035, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813342.2559276, "step_id": 3036, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813342.2607224, "step_id": 3037, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813342.265523, "step_id": 3038, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813342.2703962, "step_id": 3039, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813342.275137, "step_id": 3040, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813342.280106, "step_id": 3041, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813342.285114, "step_id": 3042, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813342.2894826, "step_id": 3043, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813342.294307, "step_id": 3044, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813342.2991147, "step_id": 3045, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813342.3038728, "step_id": 3046, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813342.3088279, "step_id": 3047, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813342.3140905, "step_id": 3048, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813342.3182466, "step_id": 3049, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813342.3231614, "step_id": 3050, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813342.3278596, "step_id": 3051, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813342.3328428, "step_id": 3052, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813342.3374238, "step_id": 3053, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813342.3424094, "step_id": 3054, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813342.3470914, "step_id": 3055, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813342.351951, "step_id": 3056, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813342.3566906, "step_id": 3057, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813342.3615885, "step_id": 3058, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813342.3664181, "step_id": 3059, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813342.3712523, "step_id": 3060, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813342.376029, "step_id": 3061, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813342.380627, "step_id": 3062, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813342.3855107, "step_id": 3063, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813342.3909328, "step_id": 3064, "start_load_kv_us": 4, "get_finished_us": 247} +{"t_unix": 1779813342.395205, "step_id": 3065, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813342.3999033, "step_id": 3066, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813342.4047365, "step_id": 3067, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813342.4095318, "step_id": 3068, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813342.4142728, "step_id": 3069, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813342.419153, "step_id": 3070, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813342.423956, "step_id": 3071, "start_load_kv_us": 1, "get_finished_us": 219} +{"t_unix": 1779813342.428737, "step_id": 3072, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813342.4334986, "step_id": 3073, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813342.4383473, "step_id": 3074, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813342.4431875, "step_id": 3075, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813342.4479399, "step_id": 3076, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813342.4526906, "step_id": 3077, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813342.4574738, "step_id": 3078, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813342.4623406, "step_id": 3079, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813342.4675899, "step_id": 3080, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813342.4720457, "step_id": 3081, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813342.4768312, "step_id": 3082, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813342.481513, "step_id": 3083, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813342.4865818, "step_id": 3084, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813342.491188, "step_id": 3085, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813342.4959645, "step_id": 3086, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813342.5009222, "step_id": 3087, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813342.5055995, "step_id": 3088, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813342.5103717, "step_id": 3089, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813342.55706, "step_id": 3090, "start_load_kv_us": 152, "get_finished_us": 285} +{"t_unix": 1779813342.5603833, "step_id": 3091, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813342.7975326, "step_id": 3092, "start_load_kv_us": 115, "get_finished_us": 337} +{"t_unix": 1779813343.035105, "step_id": 3093, "start_load_kv_us": 94, "get_finished_us": 375} +{"t_unix": 1779813343.0392709, "step_id": 3094, "start_load_kv_us": 3, "get_finished_us": 272} +{"t_unix": 1779813343.2371893, "step_id": 3095, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813343.2448404, "step_id": 3096, "start_load_kv_us": 5, "get_finished_us": 310} +{"t_unix": 1779813343.2511094, "step_id": 3097, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813343.258003, "step_id": 3098, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813343.2653112, "step_id": 3099, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813343.2730675, "step_id": 3100, "start_load_kv_us": 15, "get_finished_us": 249} +{"t_unix": 1779813343.2792933, "step_id": 3101, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813343.2869694, "step_id": 3102, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813343.2936194, "step_id": 3103, "start_load_kv_us": 3, "get_finished_us": 265} +{"t_unix": 1779813343.3006797, "step_id": 3104, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813343.308365, "step_id": 3105, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813343.3602152, "step_id": 3106, "start_load_kv_us": 66, "get_finished_us": 339} +{"t_unix": 1779813343.3638983, "step_id": 3107, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813343.5958464, "step_id": 3108, "start_load_kv_us": 61, "get_finished_us": 316} +{"t_unix": 1779813343.599536, "step_id": 3109, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813343.844585, "step_id": 3110, "start_load_kv_us": 111, "get_finished_us": 336} +{"t_unix": 1779813343.8494794, "step_id": 3111, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813344.264725, "step_id": 3112, "start_load_kv_us": 4, "get_finished_us": 338} +{"t_unix": 1779813344.274189, "step_id": 3113, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813344.2847931, "step_id": 3114, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813344.2951345, "step_id": 3115, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813344.3069887, "step_id": 3116, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813344.3173463, "step_id": 3117, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813344.3285668, "step_id": 3118, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813344.338874, "step_id": 3119, "start_load_kv_us": 10, "get_finished_us": 143} +{"t_unix": 1779813344.349133, "step_id": 3120, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813344.360846, "step_id": 3121, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813344.371365, "step_id": 3122, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813344.3824978, "step_id": 3123, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813344.3935614, "step_id": 3124, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813344.4043758, "step_id": 3125, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813344.4151604, "step_id": 3126, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813344.4264922, "step_id": 3127, "start_load_kv_us": 3, "get_finished_us": 190} +{"t_unix": 1779813344.4374828, "step_id": 3128, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813344.4480312, "step_id": 3129, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813344.4590933, "step_id": 3130, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813344.4702706, "step_id": 3131, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813344.4821942, "step_id": 3132, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813344.492914, "step_id": 3133, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813344.5054615, "step_id": 3134, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813344.5169783, "step_id": 3135, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813344.5278823, "step_id": 3136, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813344.5397792, "step_id": 3137, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813344.5505369, "step_id": 3138, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813344.6014605, "step_id": 3139, "start_load_kv_us": 53, "get_finished_us": 214} +{"t_unix": 1779813344.605281, "step_id": 3140, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813344.8601267, "step_id": 3141, "start_load_kv_us": 47, "get_finished_us": 360} +{"t_unix": 1779813344.8642287, "step_id": 3142, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813345.059524, "step_id": 3143, "start_load_kv_us": 5, "get_finished_us": 342} +{"t_unix": 1779813345.0721223, "step_id": 3144, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813345.085057, "step_id": 3145, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813345.0979073, "step_id": 3146, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813345.1086946, "step_id": 3147, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813345.1204886, "step_id": 3148, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813345.1309166, "step_id": 3149, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813345.1425874, "step_id": 3150, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813345.1540327, "step_id": 3151, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813345.1647072, "step_id": 3152, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813345.176657, "step_id": 3153, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813345.1873612, "step_id": 3154, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813345.1990535, "step_id": 3155, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813345.2108653, "step_id": 3156, "start_load_kv_us": 2, "get_finished_us": 380} +{"t_unix": 1779813345.2231684, "step_id": 3157, "start_load_kv_us": 4, "get_finished_us": 301} +{"t_unix": 1779813345.234281, "step_id": 3158, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813345.24656, "step_id": 3159, "start_load_kv_us": 4, "get_finished_us": 269} +{"t_unix": 1779813345.258191, "step_id": 3160, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813345.268544, "step_id": 3161, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813345.2803125, "step_id": 3162, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813345.2922199, "step_id": 3163, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813345.3049822, "step_id": 3164, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813345.3159163, "step_id": 3165, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813345.328302, "step_id": 3166, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813345.3403573, "step_id": 3167, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813345.351206, "step_id": 3168, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813345.3635418, "step_id": 3169, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813345.3751318, "step_id": 3170, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813345.3870327, "step_id": 3171, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813345.3987088, "step_id": 3172, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813345.411018, "step_id": 3173, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813345.421864, "step_id": 3174, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813345.4340513, "step_id": 3175, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813345.445279, "step_id": 3176, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813345.4562194, "step_id": 3177, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813345.4675887, "step_id": 3178, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813345.4785173, "step_id": 3179, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813345.4903386, "step_id": 3180, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813345.5010078, "step_id": 3181, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813345.513076, "step_id": 3182, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813345.5246646, "step_id": 3183, "start_load_kv_us": 17, "get_finished_us": 176} +{"t_unix": 1779813345.5360296, "step_id": 3184, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813345.548776, "step_id": 3185, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813345.5597808, "step_id": 3186, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813345.5714061, "step_id": 3187, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813345.5831902, "step_id": 3188, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813345.5953472, "step_id": 3189, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813345.6062098, "step_id": 3190, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813345.6180787, "step_id": 3191, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813345.6293404, "step_id": 3192, "start_load_kv_us": 3, "get_finished_us": 146} +{"t_unix": 1779813345.6405191, "step_id": 3193, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813345.6522942, "step_id": 3194, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813345.6639526, "step_id": 3195, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813345.6762319, "step_id": 3196, "start_load_kv_us": 18, "get_finished_us": 224} +{"t_unix": 1779813345.6869547, "step_id": 3197, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813345.69919, "step_id": 3198, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813345.7108283, "step_id": 3199, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813345.7219715, "step_id": 3200, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813345.734266, "step_id": 3201, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813345.7449937, "step_id": 3202, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813345.756724, "step_id": 3203, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813345.7681854, "step_id": 3204, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813345.7804708, "step_id": 3205, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813345.790952, "step_id": 3206, "start_load_kv_us": 3, "get_finished_us": 150} +{"t_unix": 1779813345.8030686, "step_id": 3207, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813345.8145978, "step_id": 3208, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813345.8256643, "step_id": 3209, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813345.8367202, "step_id": 3210, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813345.8480623, "step_id": 3211, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813345.859899, "step_id": 3212, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813345.8705146, "step_id": 3213, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813345.8826323, "step_id": 3214, "start_load_kv_us": 3, "get_finished_us": 164} +{"t_unix": 1779813345.893798, "step_id": 3215, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813345.9043171, "step_id": 3216, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813345.9159749, "step_id": 3217, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813345.926054, "step_id": 3218, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813345.9372168, "step_id": 3219, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813345.9486167, "step_id": 3220, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813345.9609323, "step_id": 3221, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813345.9717007, "step_id": 3222, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813345.9834936, "step_id": 3223, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813345.9951105, "step_id": 3224, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813346.006016, "step_id": 3225, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813346.0175092, "step_id": 3226, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813346.0290701, "step_id": 3227, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813346.0413647, "step_id": 3228, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813346.0524697, "step_id": 3229, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813346.0649161, "step_id": 3230, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813346.0760703, "step_id": 3231, "start_load_kv_us": 11, "get_finished_us": 171} +{"t_unix": 1779813346.0865738, "step_id": 3232, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813346.0986333, "step_id": 3233, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813346.1098337, "step_id": 3234, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813346.1214473, "step_id": 3235, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813346.1334329, "step_id": 3236, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813346.1457474, "step_id": 3237, "start_load_kv_us": 3, "get_finished_us": 207} +{"t_unix": 1779813346.1568415, "step_id": 3238, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813346.169091, "step_id": 3239, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813346.180592, "step_id": 3240, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813346.1912942, "step_id": 3241, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813346.2027547, "step_id": 3242, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813346.2143629, "step_id": 3243, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813346.2264185, "step_id": 3244, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813346.2372103, "step_id": 3245, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813346.248906, "step_id": 3246, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813346.2603438, "step_id": 3247, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813346.2711537, "step_id": 3248, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813346.2831974, "step_id": 3249, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813346.2944925, "step_id": 3250, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813346.3058498, "step_id": 3251, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813346.316989, "step_id": 3252, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813346.3287892, "step_id": 3253, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813346.3396149, "step_id": 3254, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813346.351857, "step_id": 3255, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813346.3632689, "step_id": 3256, "start_load_kv_us": 3, "get_finished_us": 152} +{"t_unix": 1779813346.3740096, "step_id": 3257, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813346.3855867, "step_id": 3258, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813346.3970954, "step_id": 3259, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813346.4091613, "step_id": 3260, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813346.4202783, "step_id": 3261, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813346.4326112, "step_id": 3262, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813346.4441981, "step_id": 3263, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813346.4546518, "step_id": 3264, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813346.4666228, "step_id": 3265, "start_load_kv_us": 3, "get_finished_us": 200} +{"t_unix": 1779813346.477398, "step_id": 3266, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813346.489128, "step_id": 3267, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813346.501343, "step_id": 3268, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813346.5142915, "step_id": 3269, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813346.5253904, "step_id": 3270, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813346.5377796, "step_id": 3271, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813346.5497863, "step_id": 3272, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813346.5608895, "step_id": 3273, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813346.572662, "step_id": 3274, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813346.5844142, "step_id": 3275, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813346.5969808, "step_id": 3276, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813346.6082163, "step_id": 3277, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813346.6208127, "step_id": 3278, "start_load_kv_us": 3, "get_finished_us": 164} +{"t_unix": 1779813346.6331735, "step_id": 3279, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813346.644718, "step_id": 3280, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813346.6578608, "step_id": 3281, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813346.6694267, "step_id": 3282, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813346.6817956, "step_id": 3283, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813346.6934164, "step_id": 3284, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813346.7058675, "step_id": 3285, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813346.7170994, "step_id": 3286, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813346.7292418, "step_id": 3287, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813346.7402358, "step_id": 3288, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813346.7509043, "step_id": 3289, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813346.7623026, "step_id": 3290, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813346.7738125, "step_id": 3291, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813346.7852788, "step_id": 3292, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813346.795697, "step_id": 3293, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813346.8073728, "step_id": 3294, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813346.819097, "step_id": 3295, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813346.830216, "step_id": 3296, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813346.8426836, "step_id": 3297, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813346.8538568, "step_id": 3298, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813346.865465, "step_id": 3299, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813346.8768506, "step_id": 3300, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813346.8892076, "step_id": 3301, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813346.899742, "step_id": 3302, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813346.9117422, "step_id": 3303, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813346.923456, "step_id": 3304, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813346.9342554, "step_id": 3305, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813346.9450603, "step_id": 3306, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813346.9560733, "step_id": 3307, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813346.9680629, "step_id": 3308, "start_load_kv_us": 11, "get_finished_us": 180} +{"t_unix": 1779813346.978761, "step_id": 3309, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813346.9908102, "step_id": 3310, "start_load_kv_us": 3, "get_finished_us": 207} +{"t_unix": 1779813347.002612, "step_id": 3311, "start_load_kv_us": 4, "get_finished_us": 299} +{"t_unix": 1779813347.0133424, "step_id": 3312, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813347.0259233, "step_id": 3313, "start_load_kv_us": 3, "get_finished_us": 205} +{"t_unix": 1779813347.0371366, "step_id": 3314, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813347.0489411, "step_id": 3315, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813347.060386, "step_id": 3316, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813347.0731392, "step_id": 3317, "start_load_kv_us": 4, "get_finished_us": 268} +{"t_unix": 1779813347.084564, "step_id": 3318, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813347.0964553, "step_id": 3319, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813347.1082122, "step_id": 3320, "start_load_kv_us": 8, "get_finished_us": 171} +{"t_unix": 1779813347.1196754, "step_id": 3321, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813347.131822, "step_id": 3322, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813347.143283, "step_id": 3323, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813347.155938, "step_id": 3324, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813347.1669922, "step_id": 3325, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813347.1790736, "step_id": 3326, "start_load_kv_us": 3, "get_finished_us": 221} +{"t_unix": 1779813347.1906943, "step_id": 3327, "start_load_kv_us": 5, "get_finished_us": 261} +{"t_unix": 1779813347.2019322, "step_id": 3328, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813347.2147255, "step_id": 3329, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813347.2262275, "step_id": 3330, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813347.2385697, "step_id": 3331, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813347.2505887, "step_id": 3332, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813347.2635987, "step_id": 3333, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813347.2752683, "step_id": 3334, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813347.287805, "step_id": 3335, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813347.2997603, "step_id": 3336, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813347.310622, "step_id": 3337, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813347.3224778, "step_id": 3338, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813347.334087, "step_id": 3339, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813347.34659, "step_id": 3340, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813347.3575695, "step_id": 3341, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813347.3697133, "step_id": 3342, "start_load_kv_us": 3, "get_finished_us": 195} +{"t_unix": 1779813347.3815148, "step_id": 3343, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813347.3930352, "step_id": 3344, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813347.4052613, "step_id": 3345, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813347.4166226, "step_id": 3346, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813347.4276083, "step_id": 3347, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813347.441385, "step_id": 3348, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813347.450869, "step_id": 3349, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813347.4611735, "step_id": 3350, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813347.4709074, "step_id": 3351, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813347.4807706, "step_id": 3352, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813347.4896762, "step_id": 3353, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813347.4992042, "step_id": 3354, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813347.5091343, "step_id": 3355, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813347.5188339, "step_id": 3356, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813347.5284133, "step_id": 3357, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813347.5381153, "step_id": 3358, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813347.5482388, "step_id": 3359, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813347.5568752, "step_id": 3360, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813347.566624, "step_id": 3361, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813347.575601, "step_id": 3362, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813347.5850115, "step_id": 3363, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813347.5948446, "step_id": 3364, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813347.6052728, "step_id": 3365, "start_load_kv_us": 3, "get_finished_us": 189} +{"t_unix": 1779813347.613069, "step_id": 3366, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813347.6212823, "step_id": 3367, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813347.6267934, "step_id": 3368, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813347.6326354, "step_id": 3369, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813347.63838, "step_id": 3370, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813347.644293, "step_id": 3371, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813347.6501274, "step_id": 3372, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813347.656139, "step_id": 3373, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813347.66188, "step_id": 3374, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813347.668325, "step_id": 3375, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813347.673617, "step_id": 3376, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813347.6792836, "step_id": 3377, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813347.6853945, "step_id": 3378, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813347.6915014, "step_id": 3379, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813347.697506, "step_id": 3380, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813347.7047784, "step_id": 3381, "start_load_kv_us": 6, "get_finished_us": 171} +{"t_unix": 1779813347.709788, "step_id": 3382, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813347.7158663, "step_id": 3383, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813347.7220285, "step_id": 3384, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813347.72809, "step_id": 3385, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813347.7341971, "step_id": 3386, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813347.7403018, "step_id": 3387, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813347.7463684, "step_id": 3388, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813347.7525163, "step_id": 3389, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813347.758699, "step_id": 3390, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813347.765578, "step_id": 3391, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813347.7710316, "step_id": 3392, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813347.7772224, "step_id": 3393, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813347.783265, "step_id": 3394, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813347.7895844, "step_id": 3395, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813347.7956917, "step_id": 3396, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813347.799874, "step_id": 3397, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813347.8045926, "step_id": 3398, "start_load_kv_us": 3, "get_finished_us": 220} +{"t_unix": 1779813348.135581, "step_id": 3399, "start_load_kv_us": 55, "get_finished_us": 358} +{"t_unix": 1779813348.1391485, "step_id": 3400, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813348.328361, "step_id": 3401, "start_load_kv_us": 3, "get_finished_us": 314} +{"t_unix": 1779813348.3333387, "step_id": 3402, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813348.3373942, "step_id": 3403, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813348.3422105, "step_id": 3404, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813348.3469224, "step_id": 3405, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813348.3516865, "step_id": 3406, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813348.3564577, "step_id": 3407, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813348.3612018, "step_id": 3408, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813348.3660007, "step_id": 3409, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813348.3707137, "step_id": 3410, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813348.3754644, "step_id": 3411, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813348.380253, "step_id": 3412, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813348.3850894, "step_id": 3413, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813348.389817, "step_id": 3414, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813348.3946738, "step_id": 3415, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813348.3994632, "step_id": 3416, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813348.4042625, "step_id": 3417, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813348.409627, "step_id": 3418, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813348.4137118, "step_id": 3419, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813348.4187071, "step_id": 3420, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813348.423309, "step_id": 3421, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813348.4281628, "step_id": 3422, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813348.432869, "step_id": 3423, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813348.4377222, "step_id": 3424, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813348.442478, "step_id": 3425, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813348.4473479, "step_id": 3426, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813348.4521325, "step_id": 3427, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813348.4569318, "step_id": 3428, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813348.4617846, "step_id": 3429, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813348.4664257, "step_id": 3430, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813348.4712276, "step_id": 3431, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813348.4759603, "step_id": 3432, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813348.480757, "step_id": 3433, "start_load_kv_us": 12, "get_finished_us": 163} +{"t_unix": 1779813348.4861844, "step_id": 3434, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813348.4903352, "step_id": 3435, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813348.4951358, "step_id": 3436, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813348.4998736, "step_id": 3437, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813348.5046704, "step_id": 3438, "start_load_kv_us": 16, "get_finished_us": 184} +{"t_unix": 1779813348.5094843, "step_id": 3439, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813348.5142543, "step_id": 3440, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813348.5189996, "step_id": 3441, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813348.5237787, "step_id": 3442, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813348.5285125, "step_id": 3443, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813348.5333412, "step_id": 3444, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813348.538112, "step_id": 3445, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813348.542874, "step_id": 3446, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813348.5476892, "step_id": 3447, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813348.5524755, "step_id": 3448, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813348.557395, "step_id": 3449, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813348.562752, "step_id": 3450, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813348.5668235, "step_id": 3451, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813348.5716398, "step_id": 3452, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813348.576353, "step_id": 3453, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813348.5811353, "step_id": 3454, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813348.585928, "step_id": 3455, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813348.5907123, "step_id": 3456, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813348.5955703, "step_id": 3457, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813348.6003733, "step_id": 3458, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813348.6051185, "step_id": 3459, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813348.6099021, "step_id": 3460, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813348.6147807, "step_id": 3461, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813348.619663, "step_id": 3462, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813348.624429, "step_id": 3463, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813348.629063, "step_id": 3464, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813348.6338336, "step_id": 3465, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813348.6392531, "step_id": 3466, "start_load_kv_us": 3, "get_finished_us": 159} +{"t_unix": 1779813348.6434255, "step_id": 3467, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813348.6482165, "step_id": 3468, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813348.6529806, "step_id": 3469, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813348.6578019, "step_id": 3470, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813348.6625957, "step_id": 3471, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813348.6672845, "step_id": 3472, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813348.6721833, "step_id": 3473, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813348.676995, "step_id": 3474, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813348.6817667, "step_id": 3475, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813348.6865351, "step_id": 3476, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813348.6912746, "step_id": 3477, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813348.696128, "step_id": 3478, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813348.700868, "step_id": 3479, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813348.7055378, "step_id": 3480, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813348.7103992, "step_id": 3481, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813348.7158859, "step_id": 3482, "start_load_kv_us": 3, "get_finished_us": 189} +{"t_unix": 1779813348.7199795, "step_id": 3483, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813348.7247949, "step_id": 3484, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813348.7295918, "step_id": 3485, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813348.7344005, "step_id": 3486, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813348.739182, "step_id": 3487, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813348.7439125, "step_id": 3488, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813348.7487025, "step_id": 3489, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813348.7534566, "step_id": 3490, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813348.7582927, "step_id": 3491, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813348.7630029, "step_id": 3492, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813348.7679012, "step_id": 3493, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813348.7725794, "step_id": 3494, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813348.7774618, "step_id": 3495, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813348.782207, "step_id": 3496, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813348.786978, "step_id": 3497, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813348.7923782, "step_id": 3498, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813348.7965395, "step_id": 3499, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813348.8013039, "step_id": 3500, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813348.8060994, "step_id": 3501, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813348.8108544, "step_id": 3502, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813348.8156502, "step_id": 3503, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813348.8204012, "step_id": 3504, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813348.825227, "step_id": 3505, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813348.830047, "step_id": 3506, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813348.8348107, "step_id": 3507, "start_load_kv_us": 15, "get_finished_us": 213} +{"t_unix": 1779813348.8395662, "step_id": 3508, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813348.8443506, "step_id": 3509, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813348.8491871, "step_id": 3510, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813348.8538947, "step_id": 3511, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813348.8587594, "step_id": 3512, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813348.8636622, "step_id": 3513, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813348.8689988, "step_id": 3514, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813348.8730192, "step_id": 3515, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813348.877808, "step_id": 3516, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813348.8825138, "step_id": 3517, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813348.8873582, "step_id": 3518, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813348.8921437, "step_id": 3519, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813348.896906, "step_id": 3520, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813348.9016821, "step_id": 3521, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813348.906463, "step_id": 3522, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813348.9113538, "step_id": 3523, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813348.916155, "step_id": 3524, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813348.920983, "step_id": 3525, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813348.9256663, "step_id": 3526, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813348.9304514, "step_id": 3527, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813348.935305, "step_id": 3528, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813348.940043, "step_id": 3529, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813348.9455225, "step_id": 3530, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813348.9496505, "step_id": 3531, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813348.9544528, "step_id": 3532, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813348.9593444, "step_id": 3533, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813348.9640312, "step_id": 3534, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813348.9687781, "step_id": 3535, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813348.9735878, "step_id": 3536, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813348.9783778, "step_id": 3537, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813348.9831448, "step_id": 3538, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813348.987988, "step_id": 3539, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813348.9926858, "step_id": 3540, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813348.997524, "step_id": 3541, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813349.0022821, "step_id": 3542, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813349.0076613, "step_id": 3543, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813349.0119, "step_id": 3544, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813349.0166385, "step_id": 3545, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813349.0221045, "step_id": 3546, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813349.026262, "step_id": 3547, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813349.031016, "step_id": 3548, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813349.0357857, "step_id": 3549, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813349.0405905, "step_id": 3550, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813349.0453968, "step_id": 3551, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813349.0501368, "step_id": 3552, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813349.0549312, "step_id": 3553, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813349.059689, "step_id": 3554, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813349.06454, "step_id": 3555, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813349.073979, "step_id": 3556, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813349.077348, "step_id": 3557, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813349.081452, "step_id": 3558, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813349.0861976, "step_id": 3559, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813349.0909867, "step_id": 3560, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813349.0957975, "step_id": 3561, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813349.1013062, "step_id": 3562, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813349.1053455, "step_id": 3563, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813349.1101625, "step_id": 3564, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813349.1150124, "step_id": 3565, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813349.1197493, "step_id": 3566, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813349.1245835, "step_id": 3567, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813349.1293035, "step_id": 3568, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813349.1341047, "step_id": 3569, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813349.1389325, "step_id": 3570, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813349.1436534, "step_id": 3571, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813349.1484644, "step_id": 3572, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813349.1532986, "step_id": 3573, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813349.1581187, "step_id": 3574, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813349.1628678, "step_id": 3575, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813349.1677294, "step_id": 3576, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813349.1724823, "step_id": 3577, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813349.1780221, "step_id": 3578, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813349.1821313, "step_id": 3579, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813349.1868343, "step_id": 3580, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813349.1916597, "step_id": 3581, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813349.1963837, "step_id": 3582, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813349.2012813, "step_id": 3583, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813349.2059724, "step_id": 3584, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813349.2107878, "step_id": 3585, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813349.2156575, "step_id": 3586, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813349.2204146, "step_id": 3587, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813349.225259, "step_id": 3588, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813349.2299912, "step_id": 3589, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813349.2347448, "step_id": 3590, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813349.2395344, "step_id": 3591, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813349.2443998, "step_id": 3592, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813349.2491562, "step_id": 3593, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813349.2545984, "step_id": 3594, "start_load_kv_us": 3, "get_finished_us": 170} +{"t_unix": 1779813349.2588503, "step_id": 3595, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813349.2635024, "step_id": 3596, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813349.2683027, "step_id": 3597, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813349.2730834, "step_id": 3598, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813349.2778647, "step_id": 3599, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813349.2826896, "step_id": 3600, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813349.2874112, "step_id": 3601, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813349.292225, "step_id": 3602, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813349.2970304, "step_id": 3603, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813349.3018289, "step_id": 3604, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813349.3065915, "step_id": 3605, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813349.3114586, "step_id": 3606, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813349.3162374, "step_id": 3607, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813349.322078, "step_id": 3608, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813349.3258247, "step_id": 3609, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813349.3316948, "step_id": 3610, "start_load_kv_us": 9, "get_finished_us": 197} +{"t_unix": 1779813349.3354545, "step_id": 3611, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813349.3402476, "step_id": 3612, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813349.3450334, "step_id": 3613, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813349.349758, "step_id": 3614, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813349.3545952, "step_id": 3615, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813349.359355, "step_id": 3616, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813349.3642197, "step_id": 3617, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813349.3690028, "step_id": 3618, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813349.373896, "step_id": 3619, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813349.3786578, "step_id": 3620, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813349.383393, "step_id": 3621, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813349.3881245, "step_id": 3622, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813349.3929348, "step_id": 3623, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813349.397795, "step_id": 3624, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813349.4025972, "step_id": 3625, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813349.408124, "step_id": 3626, "start_load_kv_us": 9, "get_finished_us": 222} +{"t_unix": 1779813349.4121854, "step_id": 3627, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813349.4183307, "step_id": 3628, "start_load_kv_us": 2, "get_finished_us": 622} +{"t_unix": 1779813349.423809, "step_id": 3629, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813349.4272275, "step_id": 3630, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813349.4315124, "step_id": 3631, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813349.4362066, "step_id": 3632, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813349.4410255, "step_id": 3633, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813349.4457726, "step_id": 3634, "start_load_kv_us": 13, "get_finished_us": 178} +{"t_unix": 1779813349.450573, "step_id": 3635, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813349.4553175, "step_id": 3636, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813349.4602692, "step_id": 3637, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813349.4649403, "step_id": 3638, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813349.4697583, "step_id": 3639, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813349.4744897, "step_id": 3640, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813349.4793372, "step_id": 3641, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813349.4847524, "step_id": 3642, "start_load_kv_us": 12, "get_finished_us": 146} +{"t_unix": 1779813349.4888809, "step_id": 3643, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813349.4936936, "step_id": 3644, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813349.4984539, "step_id": 3645, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813349.5032392, "step_id": 3646, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813349.5080779, "step_id": 3647, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813349.5128124, "step_id": 3648, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813349.517587, "step_id": 3649, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813349.5223315, "step_id": 3650, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813349.5271628, "step_id": 3651, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813349.5319247, "step_id": 3652, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813349.5367665, "step_id": 3653, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813349.5414648, "step_id": 3654, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813349.5459087, "step_id": 3655, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813349.5499847, "step_id": 3656, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813349.8282444, "step_id": 3657, "start_load_kv_us": 204, "get_finished_us": 373} +{"t_unix": 1779813349.832786, "step_id": 3658, "start_load_kv_us": 4, "get_finished_us": 298} +{"t_unix": 1779813350.0223382, "step_id": 3659, "start_load_kv_us": 3, "get_finished_us": 330} +{"t_unix": 1779813350.026261, "step_id": 3660, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813350.030814, "step_id": 3661, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813350.0357425, "step_id": 3662, "start_load_kv_us": 2, "get_finished_us": 335} +{"t_unix": 1779813350.0404782, "step_id": 3663, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813350.0451405, "step_id": 3664, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813350.0499122, "step_id": 3665, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813350.054692, "step_id": 3666, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813350.0593932, "step_id": 3667, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813350.0641627, "step_id": 3668, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813350.0689964, "step_id": 3669, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813350.0736973, "step_id": 3670, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813350.0784478, "step_id": 3671, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813350.0832875, "step_id": 3672, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813350.0880837, "step_id": 3673, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813350.0936174, "step_id": 3674, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813350.097607, "step_id": 3675, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813350.1024666, "step_id": 3676, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813350.107145, "step_id": 3677, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813350.11194, "step_id": 3678, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813350.116784, "step_id": 3679, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813350.1215436, "step_id": 3680, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813350.126269, "step_id": 3681, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813350.1311173, "step_id": 3682, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813350.1358874, "step_id": 3683, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813350.1406581, "step_id": 3684, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813350.145386, "step_id": 3685, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813350.1502664, "step_id": 3686, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813350.1549726, "step_id": 3687, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813350.1597729, "step_id": 3688, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813350.1644974, "step_id": 3689, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813350.1700957, "step_id": 3690, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813350.1741908, "step_id": 3691, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813350.1789222, "step_id": 3692, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.1836574, "step_id": 3693, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813350.188471, "step_id": 3694, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813350.1932518, "step_id": 3695, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813350.1980627, "step_id": 3696, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813350.2027986, "step_id": 3697, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813350.2076046, "step_id": 3698, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813350.212327, "step_id": 3699, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813350.2171707, "step_id": 3700, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813350.221903, "step_id": 3701, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813350.2266898, "step_id": 3702, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813350.231516, "step_id": 3703, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813350.2362661, "step_id": 3704, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813350.2410636, "step_id": 3705, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813350.2470431, "step_id": 3706, "start_load_kv_us": 28, "get_finished_us": 263} +{"t_unix": 1779813350.2512596, "step_id": 3707, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.255413, "step_id": 3708, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813350.2602522, "step_id": 3709, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813350.2650816, "step_id": 3710, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813350.2698274, "step_id": 3711, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813350.2745745, "step_id": 3712, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813350.279355, "step_id": 3713, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813350.2842846, "step_id": 3714, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813350.2895193, "step_id": 3715, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813350.293803, "step_id": 3716, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813350.298832, "step_id": 3717, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813350.3033965, "step_id": 3718, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813350.3082159, "step_id": 3719, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813350.3129299, "step_id": 3720, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813350.3176966, "step_id": 3721, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813350.3232217, "step_id": 3722, "start_load_kv_us": 11, "get_finished_us": 195} +{"t_unix": 1779813350.3272731, "step_id": 3723, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813350.332292, "step_id": 3724, "start_load_kv_us": 2, "get_finished_us": 355} +{"t_unix": 1779813350.3391333, "step_id": 3725, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813350.3424993, "step_id": 3726, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813350.346758, "step_id": 3727, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813350.3515584, "step_id": 3728, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813350.3562367, "step_id": 3729, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813350.3610935, "step_id": 3730, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813350.365844, "step_id": 3731, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813350.3706665, "step_id": 3732, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813350.375424, "step_id": 3733, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813350.3802876, "step_id": 3734, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813350.3851187, "step_id": 3735, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813350.3898387, "step_id": 3736, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813350.3945434, "step_id": 3737, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813350.4001896, "step_id": 3738, "start_load_kv_us": 16, "get_finished_us": 152} +{"t_unix": 1779813350.4041338, "step_id": 3739, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813350.4089177, "step_id": 3740, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813350.4136224, "step_id": 3741, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813350.418497, "step_id": 3742, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813350.423313, "step_id": 3743, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.4280593, "step_id": 3744, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813350.4333653, "step_id": 3745, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813350.4377804, "step_id": 3746, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813350.4424288, "step_id": 3747, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813350.447246, "step_id": 3748, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813350.452011, "step_id": 3749, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813350.4568086, "step_id": 3750, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813350.4616091, "step_id": 3751, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813350.4663465, "step_id": 3752, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813350.471195, "step_id": 3753, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813350.476767, "step_id": 3754, "start_load_kv_us": 28, "get_finished_us": 155} +{"t_unix": 1779813350.4807608, "step_id": 3755, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813350.48549, "step_id": 3756, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813350.4903574, "step_id": 3757, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813350.4950712, "step_id": 3758, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813350.5000405, "step_id": 3759, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813350.504626, "step_id": 3760, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813350.5094893, "step_id": 3761, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813350.5142229, "step_id": 3762, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813350.5190437, "step_id": 3763, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813350.5236998, "step_id": 3764, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.5284922, "step_id": 3765, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813350.5333538, "step_id": 3766, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813350.5381503, "step_id": 3767, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813350.5429018, "step_id": 3768, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813350.5477128, "step_id": 3769, "start_load_kv_us": 17, "get_finished_us": 227} +{"t_unix": 1779813350.5532007, "step_id": 3770, "start_load_kv_us": 15, "get_finished_us": 172} +{"t_unix": 1779813350.5572658, "step_id": 3771, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813350.5620668, "step_id": 3772, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813350.5668414, "step_id": 3773, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813350.5715852, "step_id": 3774, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813350.5765443, "step_id": 3775, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813350.581268, "step_id": 3776, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813350.58605, "step_id": 3777, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813350.5908628, "step_id": 3778, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813350.5956385, "step_id": 3779, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813350.6004522, "step_id": 3780, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813350.6052427, "step_id": 3781, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813350.6099555, "step_id": 3782, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.6148221, "step_id": 3783, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813350.6195283, "step_id": 3784, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813350.6243823, "step_id": 3785, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813350.629953, "step_id": 3786, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813350.6339564, "step_id": 3787, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813350.6387806, "step_id": 3788, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813350.6435044, "step_id": 3789, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813350.648353, "step_id": 3790, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813350.6531649, "step_id": 3791, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.6578414, "step_id": 3792, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813350.6627023, "step_id": 3793, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813350.6675174, "step_id": 3794, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.6723323, "step_id": 3795, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813350.6771383, "step_id": 3796, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813350.6818097, "step_id": 3797, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813350.686615, "step_id": 3798, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813350.6914163, "step_id": 3799, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813350.6964295, "step_id": 3800, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813350.7010539, "step_id": 3801, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813350.7064984, "step_id": 3802, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813350.710626, "step_id": 3803, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813350.715469, "step_id": 3804, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813350.7202911, "step_id": 3805, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813350.724921, "step_id": 3806, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813350.7297175, "step_id": 3807, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813350.734601, "step_id": 3808, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813350.7393541, "step_id": 3809, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813350.7441437, "step_id": 3810, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813350.7489018, "step_id": 3811, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813350.753694, "step_id": 3812, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813350.7584722, "step_id": 3813, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813350.7633278, "step_id": 3814, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813350.7680988, "step_id": 3815, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813350.7729807, "step_id": 3816, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813350.7777145, "step_id": 3817, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813350.7843869, "step_id": 3818, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813350.7877142, "step_id": 3819, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813350.792059, "step_id": 3820, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813350.796863, "step_id": 3821, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813350.8017986, "step_id": 3822, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813350.806489, "step_id": 3823, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813350.811246, "step_id": 3824, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813350.8161097, "step_id": 3825, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813350.864368, "step_id": 3826, "start_load_kv_us": 338, "get_finished_us": 214} +{"t_unix": 1779813350.8680458, "step_id": 3827, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813351.0625434, "step_id": 3828, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813351.0684304, "step_id": 3829, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813351.0744684, "step_id": 3830, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813351.0803921, "step_id": 3831, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813351.0865302, "step_id": 3832, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813351.0927365, "step_id": 3833, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813351.099571, "step_id": 3834, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813351.1141105, "step_id": 3835, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813351.1175542, "step_id": 3836, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813351.1238241, "step_id": 3837, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813351.1291697, "step_id": 3838, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813351.1350796, "step_id": 3839, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813351.140782, "step_id": 3840, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813351.1468089, "step_id": 3841, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813351.1527793, "step_id": 3842, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813351.1586385, "step_id": 3843, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813351.1642203, "step_id": 3844, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813351.1699934, "step_id": 3845, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813351.1755571, "step_id": 3846, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813351.1816375, "step_id": 3847, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813351.1873527, "step_id": 3848, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813351.1932352, "step_id": 3849, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813351.1994827, "step_id": 3850, "start_load_kv_us": 15, "get_finished_us": 172} +{"t_unix": 1779813351.2043936, "step_id": 3851, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813351.21002, "step_id": 3852, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813351.2166367, "step_id": 3853, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813351.2217798, "step_id": 3854, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813351.2277806, "step_id": 3855, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813351.233397, "step_id": 3856, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813351.2390337, "step_id": 3857, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813351.245041, "step_id": 3858, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813351.2506692, "step_id": 3859, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813351.256615, "step_id": 3860, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813351.2627542, "step_id": 3861, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813351.268665, "step_id": 3862, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813351.2745252, "step_id": 3863, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813351.280599, "step_id": 3864, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813351.2862377, "step_id": 3865, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813351.2925768, "step_id": 3866, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813351.2974002, "step_id": 3867, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813351.303148, "step_id": 3868, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813351.3096678, "step_id": 3869, "start_load_kv_us": 13, "get_finished_us": 154} +{"t_unix": 1779813351.3150806, "step_id": 3870, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813351.321008, "step_id": 3871, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813351.3272004, "step_id": 3872, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813351.3333201, "step_id": 3873, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813351.3391635, "step_id": 3874, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813351.3451252, "step_id": 3875, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813351.3512428, "step_id": 3876, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813351.3573346, "step_id": 3877, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813351.3634832, "step_id": 3878, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813351.369408, "step_id": 3879, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813351.3754282, "step_id": 3880, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813351.3815315, "step_id": 3881, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813351.3884299, "step_id": 3882, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813351.3934636, "step_id": 3883, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813351.3991778, "step_id": 3884, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813351.4057982, "step_id": 3885, "start_load_kv_us": 12, "get_finished_us": 135} +{"t_unix": 1779813351.4109066, "step_id": 3886, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813351.4164991, "step_id": 3887, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813351.4223957, "step_id": 3888, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813351.428229, "step_id": 3889, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813351.4341528, "step_id": 3890, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813351.4401054, "step_id": 3891, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813351.4463122, "step_id": 3892, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813351.4522047, "step_id": 3893, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813351.458358, "step_id": 3894, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813351.4642942, "step_id": 3895, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813351.4703531, "step_id": 3896, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813351.4764795, "step_id": 3897, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813351.4830735, "step_id": 3898, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813351.488047, "step_id": 3899, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813351.4937568, "step_id": 3900, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813351.5002685, "step_id": 3901, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813351.5055768, "step_id": 3902, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813351.5110035, "step_id": 3903, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813351.5168974, "step_id": 3904, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813351.5226212, "step_id": 3905, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813351.528617, "step_id": 3906, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813351.5345342, "step_id": 3907, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813351.5406475, "step_id": 3908, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813351.546592, "step_id": 3909, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813351.5526555, "step_id": 3910, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813351.5584037, "step_id": 3911, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813351.5644155, "step_id": 3912, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813351.570682, "step_id": 3913, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813351.5764856, "step_id": 3914, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813351.5811915, "step_id": 3915, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813351.585872, "step_id": 3916, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813351.5913923, "step_id": 3917, "start_load_kv_us": 10, "get_finished_us": 153} +{"t_unix": 1779813351.5955346, "step_id": 3918, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813351.6002755, "step_id": 3919, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813351.6051676, "step_id": 3920, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813351.609851, "step_id": 3921, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813351.614606, "step_id": 3922, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813351.6193895, "step_id": 3923, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813351.6242013, "step_id": 3924, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813351.6291375, "step_id": 3925, "start_load_kv_us": 3, "get_finished_us": 164} +{"t_unix": 1779813351.6338594, "step_id": 3926, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813351.6386056, "step_id": 3927, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813351.6434152, "step_id": 3928, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813351.6481493, "step_id": 3929, "start_load_kv_us": 17, "get_finished_us": 156} +{"t_unix": 1779813351.6530247, "step_id": 3930, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813351.6578627, "step_id": 3931, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813351.66258, "step_id": 3932, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813351.667993, "step_id": 3933, "start_load_kv_us": 10, "get_finished_us": 154} +{"t_unix": 1779813351.6720877, "step_id": 3934, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813351.6768873, "step_id": 3935, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813351.6817446, "step_id": 3936, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813351.6864803, "step_id": 3937, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813351.691234, "step_id": 3938, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813351.6960428, "step_id": 3939, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813351.7009535, "step_id": 3940, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813351.705705, "step_id": 3941, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813351.7103672, "step_id": 3942, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813351.7151735, "step_id": 3943, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813351.7201407, "step_id": 3944, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813351.7248287, "step_id": 3945, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813351.729563, "step_id": 3946, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813351.7343915, "step_id": 3947, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813351.7392073, "step_id": 3948, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813351.7446132, "step_id": 3949, "start_load_kv_us": 12, "get_finished_us": 182} +{"t_unix": 1779813351.7487347, "step_id": 3950, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813351.7535079, "step_id": 3951, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813351.7582915, "step_id": 3952, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813351.7630882, "step_id": 3953, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813351.7678666, "step_id": 3954, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813351.7726588, "step_id": 3955, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813351.7774475, "step_id": 3956, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813351.7822936, "step_id": 3957, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813351.7870471, "step_id": 3958, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813351.7918444, "step_id": 3959, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813351.7966068, "step_id": 3960, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813351.801485, "step_id": 3961, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813351.8482134, "step_id": 3962, "start_load_kv_us": 228, "get_finished_us": 288} +{"t_unix": 1779813351.8518012, "step_id": 3963, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813352.0503757, "step_id": 3964, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813352.0564508, "step_id": 3965, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813352.061488, "step_id": 3966, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813352.0672526, "step_id": 3967, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813352.073111, "step_id": 3968, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813352.079, "step_id": 3969, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813352.084651, "step_id": 3970, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813352.091033, "step_id": 3971, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813352.0960348, "step_id": 3972, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813352.1018205, "step_id": 3973, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813352.107864, "step_id": 3974, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813352.1543324, "step_id": 3975, "start_load_kv_us": 176, "get_finished_us": 239} +{"t_unix": 1779813352.1580348, "step_id": 3976, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813352.356484, "step_id": 3977, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813352.363626, "step_id": 3978, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813352.370463, "step_id": 3979, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813352.3778112, "step_id": 3980, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813352.3853955, "step_id": 3981, "start_load_kv_us": 6, "get_finished_us": 155} +{"t_unix": 1779813352.392523, "step_id": 3982, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813352.3990538, "step_id": 3983, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813352.4077706, "step_id": 3984, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813352.4132268, "step_id": 3985, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813352.4204025, "step_id": 3986, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813352.428393, "step_id": 3987, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813352.4347124, "step_id": 3988, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813352.4417045, "step_id": 3989, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813352.4486952, "step_id": 3990, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813352.456223, "step_id": 3991, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813352.4635139, "step_id": 3992, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813352.4708707, "step_id": 3993, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813352.47817, "step_id": 3994, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813352.4856377, "step_id": 3995, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813352.4927664, "step_id": 3996, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813352.50064, "step_id": 3997, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813352.507802, "step_id": 3998, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813352.5142877, "step_id": 3999, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813352.5215971, "step_id": 4000, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813352.528561, "step_id": 4001, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813352.5356622, "step_id": 4002, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813352.5431921, "step_id": 4003, "start_load_kv_us": 18, "get_finished_us": 153} +{"t_unix": 1779813352.549754, "step_id": 4004, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813352.556833, "step_id": 4005, "start_load_kv_us": 3, "get_finished_us": 236} +{"t_unix": 1779813352.5640466, "step_id": 4006, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813352.5709898, "step_id": 4007, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813352.57785, "step_id": 4008, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813352.5850673, "step_id": 4009, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813352.5919526, "step_id": 4010, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813352.5993328, "step_id": 4011, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813352.6068478, "step_id": 4012, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813352.614983, "step_id": 4013, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813352.6221416, "step_id": 4014, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813352.628693, "step_id": 4015, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813352.6361332, "step_id": 4016, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813352.6436203, "step_id": 4017, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813352.6504962, "step_id": 4018, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813352.6579134, "step_id": 4019, "start_load_kv_us": 10, "get_finished_us": 147} +{"t_unix": 1779813352.6639957, "step_id": 4020, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813352.670652, "step_id": 4021, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813352.6776443, "step_id": 4022, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813352.6845393, "step_id": 4023, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813352.6918628, "step_id": 4024, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813352.6992266, "step_id": 4025, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813352.7062418, "step_id": 4026, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813352.7139008, "step_id": 4027, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813352.7211819, "step_id": 4028, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813352.7292566, "step_id": 4029, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813352.7365613, "step_id": 4030, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813352.7432957, "step_id": 4031, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813352.7507095, "step_id": 4032, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813352.7579021, "step_id": 4033, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813352.7652607, "step_id": 4034, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813352.7732072, "step_id": 4035, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813352.7798324, "step_id": 4036, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813352.7869627, "step_id": 4037, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813352.7942398, "step_id": 4038, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813352.8018737, "step_id": 4039, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813352.809335, "step_id": 4040, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813352.816663, "step_id": 4041, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813352.8241816, "step_id": 4042, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813352.8316488, "step_id": 4043, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813352.8392696, "step_id": 4044, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813352.8473036, "step_id": 4045, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813352.854721, "step_id": 4046, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813352.861627, "step_id": 4047, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813352.8701105, "step_id": 4048, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813352.920037, "step_id": 4049, "start_load_kv_us": 168, "get_finished_us": 266} +{"t_unix": 1779813352.9237025, "step_id": 4050, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813353.1207154, "step_id": 4051, "start_load_kv_us": 7, "get_finished_us": 446} +{"t_unix": 1779813353.124891, "step_id": 4052, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813353.1322331, "step_id": 4053, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813353.140185, "step_id": 4054, "start_load_kv_us": 18, "get_finished_us": 188} +{"t_unix": 1779813353.146458, "step_id": 4055, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813353.1539848, "step_id": 4056, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813353.1616657, "step_id": 4057, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813353.1692045, "step_id": 4058, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813353.177019, "step_id": 4059, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813353.1849198, "step_id": 4060, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813353.1935573, "step_id": 4061, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813353.201394, "step_id": 4062, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813353.2087123, "step_id": 4063, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813353.2165902, "step_id": 4064, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813353.2242827, "step_id": 4065, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813353.2318518, "step_id": 4066, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813353.2404034, "step_id": 4067, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813353.2476695, "step_id": 4068, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813353.2551095, "step_id": 4069, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813353.2631803, "step_id": 4070, "start_load_kv_us": 6, "get_finished_us": 172} +{"t_unix": 1779813353.2700832, "step_id": 4071, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813353.2775722, "step_id": 4072, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813353.2850513, "step_id": 4073, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813353.292741, "step_id": 4074, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813353.3004239, "step_id": 4075, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813353.3081152, "step_id": 4076, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813353.3161623, "step_id": 4077, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813353.32352, "step_id": 4078, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813353.3304837, "step_id": 4079, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813353.3381748, "step_id": 4080, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813353.345602, "step_id": 4081, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813353.3537405, "step_id": 4082, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813353.3623304, "step_id": 4083, "start_load_kv_us": 5, "get_finished_us": 253} +{"t_unix": 1779813353.3690393, "step_id": 4084, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813353.3764923, "step_id": 4085, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813353.384226, "step_id": 4086, "start_load_kv_us": 6, "get_finished_us": 156} +{"t_unix": 1779813353.3908055, "step_id": 4087, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813353.398299, "step_id": 4088, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813353.405417, "step_id": 4089, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813353.4130733, "step_id": 4090, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813353.4201002, "step_id": 4091, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813353.4276094, "step_id": 4092, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813353.434939, "step_id": 4093, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813353.4432285, "step_id": 4094, "start_load_kv_us": 5, "get_finished_us": 255} +{"t_unix": 1779813353.4497943, "step_id": 4095, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813353.4569583, "step_id": 4096, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813353.4641898, "step_id": 4097, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813353.4713392, "step_id": 4098, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813353.4793468, "step_id": 4099, "start_load_kv_us": 6, "get_finished_us": 200} +{"t_unix": 1779813353.4862616, "step_id": 4100, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813353.4936059, "step_id": 4101, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813353.5015063, "step_id": 4102, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813353.5083504, "step_id": 4103, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813353.515393, "step_id": 4104, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813353.5224586, "step_id": 4105, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813353.52933, "step_id": 4106, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813353.5365822, "step_id": 4107, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813353.544378, "step_id": 4108, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813353.55137, "step_id": 4109, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813353.5594, "step_id": 4110, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813353.5660746, "step_id": 4111, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813353.5734117, "step_id": 4112, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813353.5804775, "step_id": 4113, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813353.5877864, "step_id": 4114, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813353.5960536, "step_id": 4115, "start_load_kv_us": 18, "get_finished_us": 150} +{"t_unix": 1779813353.6027873, "step_id": 4116, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813353.6107962, "step_id": 4117, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813353.6182277, "step_id": 4118, "start_load_kv_us": 6, "get_finished_us": 209} +{"t_unix": 1779813353.6246817, "step_id": 4119, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813353.6320508, "step_id": 4120, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813353.639617, "step_id": 4121, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813353.6469576, "step_id": 4122, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813353.6545272, "step_id": 4123, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813353.661981, "step_id": 4124, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813353.6694825, "step_id": 4125, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813353.6774883, "step_id": 4126, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813353.6840603, "step_id": 4127, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813353.6916275, "step_id": 4128, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813353.699039, "step_id": 4129, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813353.7063777, "step_id": 4130, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813353.7144952, "step_id": 4131, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813353.720901, "step_id": 4132, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813353.7281206, "step_id": 4133, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813353.7364328, "step_id": 4134, "start_load_kv_us": 50, "get_finished_us": 364} +{"t_unix": 1779813353.7423587, "step_id": 4135, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813353.7493892, "step_id": 4136, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813353.7569835, "step_id": 4137, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813353.7643888, "step_id": 4138, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813353.7719657, "step_id": 4139, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813353.7792766, "step_id": 4140, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813353.7865262, "step_id": 4141, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813353.7946367, "step_id": 4142, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813353.8014743, "step_id": 4143, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813353.8089287, "step_id": 4144, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813353.816572, "step_id": 4145, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813353.8248363, "step_id": 4146, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813353.87549, "step_id": 4147, "start_load_kv_us": 140, "get_finished_us": 318} +{"t_unix": 1779813353.8792238, "step_id": 4148, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813354.0743327, "step_id": 4149, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813354.0823772, "step_id": 4150, "start_load_kv_us": 6, "get_finished_us": 203} +{"t_unix": 1779813354.0900183, "step_id": 4151, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813354.0972483, "step_id": 4152, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813354.10502, "step_id": 4153, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813354.1128628, "step_id": 4154, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813354.120735, "step_id": 4155, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813354.1286328, "step_id": 4156, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813354.1364546, "step_id": 4157, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813354.1452782, "step_id": 4158, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813354.1528153, "step_id": 4159, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813354.160728, "step_id": 4160, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813354.1681905, "step_id": 4161, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813354.1758554, "step_id": 4162, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813354.1840606, "step_id": 4163, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813354.1906471, "step_id": 4164, "start_load_kv_us": 16, "get_finished_us": 159} +{"t_unix": 1779813354.1976318, "step_id": 4165, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813354.2053905, "step_id": 4166, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813354.2127714, "step_id": 4167, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813354.2194908, "step_id": 4168, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813354.227092, "step_id": 4169, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813354.2348073, "step_id": 4170, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813354.242322, "step_id": 4171, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813354.2499883, "step_id": 4172, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813354.257496, "step_id": 4173, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813354.3075783, "step_id": 4174, "start_load_kv_us": 127, "get_finished_us": 272} +{"t_unix": 1779813354.499004, "step_id": 4175, "start_load_kv_us": 120, "get_finished_us": 349} +{"t_unix": 1779813354.5101945, "step_id": 4176, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813354.7476273, "step_id": 4177, "start_load_kv_us": 3, "get_finished_us": 356} +{"t_unix": 1779813354.755871, "step_id": 4178, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813354.7658565, "step_id": 4179, "start_load_kv_us": 15, "get_finished_us": 179} +{"t_unix": 1779813354.774739, "step_id": 4180, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813354.783291, "step_id": 4181, "start_load_kv_us": 3, "get_finished_us": 295} +{"t_unix": 1779813354.7932148, "step_id": 4182, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813354.8025296, "step_id": 4183, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813354.8119926, "step_id": 4184, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813354.820508, "step_id": 4185, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813354.8298247, "step_id": 4186, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813354.8393257, "step_id": 4187, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813354.8484952, "step_id": 4188, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813354.8580275, "step_id": 4189, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813354.8682978, "step_id": 4190, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813354.877141, "step_id": 4191, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813354.8867967, "step_id": 4192, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813354.8959064, "step_id": 4193, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813354.9057553, "step_id": 4194, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813354.9162943, "step_id": 4195, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813354.9259522, "step_id": 4196, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813354.935276, "step_id": 4197, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813354.9459662, "step_id": 4198, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813354.9563541, "step_id": 4199, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813355.0065975, "step_id": 4200, "start_load_kv_us": 146, "get_finished_us": 265} +{"t_unix": 1779813355.0102909, "step_id": 4201, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813355.212822, "step_id": 4202, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813355.2246766, "step_id": 4203, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813355.2774677, "step_id": 4204, "start_load_kv_us": 118, "get_finished_us": 281} +{"t_unix": 1779813355.281138, "step_id": 4205, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813355.4864259, "step_id": 4206, "start_load_kv_us": 7, "get_finished_us": 271} +{"t_unix": 1779813355.49687, "step_id": 4207, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813355.5085204, "step_id": 4208, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813355.5200968, "step_id": 4209, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813355.5320737, "step_id": 4210, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813355.544286, "step_id": 4211, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813355.5563328, "step_id": 4212, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813355.5674498, "step_id": 4213, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813355.5798035, "step_id": 4214, "start_load_kv_us": 5, "get_finished_us": 217} +{"t_unix": 1779813355.5916607, "step_id": 4215, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813355.603122, "step_id": 4216, "start_load_kv_us": 5, "get_finished_us": 156} +{"t_unix": 1779813355.6135974, "step_id": 4217, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813355.625399, "step_id": 4218, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813355.63722, "step_id": 4219, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813355.6483674, "step_id": 4220, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813355.6602705, "step_id": 4221, "start_load_kv_us": 3, "get_finished_us": 254} +{"t_unix": 1779813355.6728673, "step_id": 4222, "start_load_kv_us": 7, "get_finished_us": 225} +{"t_unix": 1779813355.683958, "step_id": 4223, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813355.6955376, "step_id": 4224, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813355.7070816, "step_id": 4225, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813355.718053, "step_id": 4226, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813355.7297423, "step_id": 4227, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813355.741188, "step_id": 4228, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813355.7514803, "step_id": 4229, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813355.7631793, "step_id": 4230, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813355.7748852, "step_id": 4231, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813355.7861667, "step_id": 4232, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813355.7941942, "step_id": 4233, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813355.803058, "step_id": 4234, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813355.8122861, "step_id": 4235, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813355.8218744, "step_id": 4236, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813355.8314266, "step_id": 4237, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813355.8414838, "step_id": 4238, "start_load_kv_us": 6, "get_finished_us": 157} +{"t_unix": 1779813355.8502095, "step_id": 4239, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813355.8998804, "step_id": 4240, "start_load_kv_us": 124, "get_finished_us": 218} +{"t_unix": 1779813355.9034915, "step_id": 4241, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813356.108018, "step_id": 4242, "start_load_kv_us": 3, "get_finished_us": 322} +{"t_unix": 1779813356.1206865, "step_id": 4243, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813356.1325717, "step_id": 4244, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813356.1437097, "step_id": 4245, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813356.1560123, "step_id": 4246, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813356.167459, "step_id": 4247, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813356.1787915, "step_id": 4248, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813356.1894867, "step_id": 4249, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813356.2011707, "step_id": 4250, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813356.2124283, "step_id": 4251, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813356.2629356, "step_id": 4252, "start_load_kv_us": 121, "get_finished_us": 292} +{"t_unix": 1779813356.2665977, "step_id": 4253, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813356.473335, "step_id": 4254, "start_load_kv_us": 7, "get_finished_us": 310} +{"t_unix": 1779813356.4833171, "step_id": 4255, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813356.4937248, "step_id": 4256, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813356.5043862, "step_id": 4257, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813356.5150266, "step_id": 4258, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813356.526633, "step_id": 4259, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813356.5373573, "step_id": 4260, "start_load_kv_us": 7, "get_finished_us": 148} +{"t_unix": 1779813356.5478272, "step_id": 4261, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813356.5597467, "step_id": 4262, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813356.5712476, "step_id": 4263, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813356.582603, "step_id": 4264, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813356.593545, "step_id": 4265, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813356.6051733, "step_id": 4266, "start_load_kv_us": 16, "get_finished_us": 177} +{"t_unix": 1779813356.616615, "step_id": 4267, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813356.628389, "step_id": 4268, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813356.6400125, "step_id": 4269, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813356.6524255, "step_id": 4270, "start_load_kv_us": 6, "get_finished_us": 317} +{"t_unix": 1779813356.6632204, "step_id": 4271, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813356.6751204, "step_id": 4272, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813356.6867003, "step_id": 4273, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813356.698115, "step_id": 4274, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813356.7106335, "step_id": 4275, "start_load_kv_us": 6, "get_finished_us": 235} +{"t_unix": 1779813356.7224965, "step_id": 4276, "start_load_kv_us": 6, "get_finished_us": 167} +{"t_unix": 1779813356.7336154, "step_id": 4277, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813356.7461529, "step_id": 4278, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813356.7584002, "step_id": 4279, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813356.7703834, "step_id": 4280, "start_load_kv_us": 5, "get_finished_us": 274} +{"t_unix": 1779813356.7819312, "step_id": 4281, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813356.7937837, "step_id": 4282, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813356.805209, "step_id": 4283, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813356.8166418, "step_id": 4284, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813356.828594, "step_id": 4285, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813356.840713, "step_id": 4286, "start_load_kv_us": 6, "get_finished_us": 166} +{"t_unix": 1779813356.8518257, "step_id": 4287, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813356.8635354, "step_id": 4288, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813356.875227, "step_id": 4289, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813356.8869402, "step_id": 4290, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813356.899633, "step_id": 4291, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813356.9118292, "step_id": 4292, "start_load_kv_us": 6, "get_finished_us": 153} +{"t_unix": 1779813356.9231985, "step_id": 4293, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813356.9359808, "step_id": 4294, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813356.9479017, "step_id": 4295, "start_load_kv_us": 5, "get_finished_us": 147} +{"t_unix": 1779813356.9598129, "step_id": 4296, "start_load_kv_us": 16, "get_finished_us": 212} +{"t_unix": 1779813356.9707768, "step_id": 4297, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813356.98247, "step_id": 4298, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813356.994222, "step_id": 4299, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813357.006005, "step_id": 4300, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813357.0178118, "step_id": 4301, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813357.0304139, "step_id": 4302, "start_load_kv_us": 6, "get_finished_us": 187} +{"t_unix": 1779813357.0417976, "step_id": 4303, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813357.0538683, "step_id": 4304, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813357.0663276, "step_id": 4305, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813357.078194, "step_id": 4306, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813357.0906153, "step_id": 4307, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813357.1025093, "step_id": 4308, "start_load_kv_us": 6, "get_finished_us": 216} +{"t_unix": 1779813357.1136556, "step_id": 4309, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813357.1256473, "step_id": 4310, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813357.138316, "step_id": 4311, "start_load_kv_us": 5, "get_finished_us": 143} +{"t_unix": 1779813357.1503665, "step_id": 4312, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813357.1620479, "step_id": 4313, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813357.174316, "step_id": 4314, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813357.1863554, "step_id": 4315, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813357.198188, "step_id": 4316, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813357.2104678, "step_id": 4317, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813357.2235255, "step_id": 4318, "start_load_kv_us": 7, "get_finished_us": 181} +{"t_unix": 1779813357.2350633, "step_id": 4319, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813357.2464144, "step_id": 4320, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813357.258371, "step_id": 4321, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813357.2703035, "step_id": 4322, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813357.2830746, "step_id": 4323, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813357.295299, "step_id": 4324, "start_load_kv_us": 6, "get_finished_us": 217} +{"t_unix": 1779813357.3064525, "step_id": 4325, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813357.318646, "step_id": 4326, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813357.3312771, "step_id": 4327, "start_load_kv_us": 5, "get_finished_us": 161} +{"t_unix": 1779813357.3433218, "step_id": 4328, "start_load_kv_us": 5, "get_finished_us": 148} +{"t_unix": 1779813357.3547516, "step_id": 4329, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813357.366653, "step_id": 4330, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813357.3786852, "step_id": 4331, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813357.3906162, "step_id": 4332, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813357.4021683, "step_id": 4333, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813357.415106, "step_id": 4334, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813357.426461, "step_id": 4335, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813357.4385319, "step_id": 4336, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813357.4504719, "step_id": 4337, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813357.4620233, "step_id": 4338, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813357.4742362, "step_id": 4339, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813357.4858675, "step_id": 4340, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813357.4969308, "step_id": 4341, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813357.5088394, "step_id": 4342, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813357.5214984, "step_id": 4343, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813357.5334792, "step_id": 4344, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813357.5446992, "step_id": 4345, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813357.5570822, "step_id": 4346, "start_load_kv_us": 1, "get_finished_us": 295} +{"t_unix": 1779813357.569018, "step_id": 4347, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813357.5807126, "step_id": 4348, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813357.5927906, "step_id": 4349, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813357.6052892, "step_id": 4350, "start_load_kv_us": 6, "get_finished_us": 181} +{"t_unix": 1779813357.6168091, "step_id": 4351, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813357.6290548, "step_id": 4352, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813357.6414015, "step_id": 4353, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813357.6531725, "step_id": 4354, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813357.666171, "step_id": 4355, "start_load_kv_us": 4, "get_finished_us": 251} +{"t_unix": 1779813357.6781013, "step_id": 4356, "start_load_kv_us": 6, "get_finished_us": 184} +{"t_unix": 1779813357.6896122, "step_id": 4357, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813357.701368, "step_id": 4358, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813357.7142584, "step_id": 4359, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813357.7261477, "step_id": 4360, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813357.7377338, "step_id": 4361, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813357.7501643, "step_id": 4362, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813357.7624626, "step_id": 4363, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813357.7748094, "step_id": 4364, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813357.7869241, "step_id": 4365, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813357.7998595, "step_id": 4366, "start_load_kv_us": 6, "get_finished_us": 221} +{"t_unix": 1779813357.8117132, "step_id": 4367, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813357.823584, "step_id": 4368, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813357.8358512, "step_id": 4369, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813357.848099, "step_id": 4370, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813357.8608687, "step_id": 4371, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813357.873226, "step_id": 4372, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813357.8847685, "step_id": 4373, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813357.896743, "step_id": 4374, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813357.9094465, "step_id": 4375, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813357.9211361, "step_id": 4376, "start_load_kv_us": 6, "get_finished_us": 163} +{"t_unix": 1779813357.9319088, "step_id": 4377, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813357.9436684, "step_id": 4378, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813357.9558887, "step_id": 4379, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813357.967954, "step_id": 4380, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813357.9795296, "step_id": 4381, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813357.9917147, "step_id": 4382, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813358.0022707, "step_id": 4383, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813358.0138705, "step_id": 4384, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813358.025619, "step_id": 4385, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813358.0372536, "step_id": 4386, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813358.0496476, "step_id": 4387, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813358.0612328, "step_id": 4388, "start_load_kv_us": 6, "get_finished_us": 140} +{"t_unix": 1779813358.0721326, "step_id": 4389, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813358.0840263, "step_id": 4390, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813358.095531, "step_id": 4391, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813358.1069155, "step_id": 4392, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813358.1173897, "step_id": 4393, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813358.1290336, "step_id": 4394, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813358.1407478, "step_id": 4395, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813358.1525798, "step_id": 4396, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813358.1643465, "step_id": 4397, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813358.1770358, "step_id": 4398, "start_load_kv_us": 6, "get_finished_us": 170} +{"t_unix": 1779813358.1881034, "step_id": 4399, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813358.1998823, "step_id": 4400, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813358.211264, "step_id": 4401, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813358.2225811, "step_id": 4402, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813358.2347953, "step_id": 4403, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813358.2454631, "step_id": 4404, "start_load_kv_us": 6, "get_finished_us": 220} +{"t_unix": 1779813358.2545295, "step_id": 4405, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813358.3039176, "step_id": 4406, "start_load_kv_us": 127, "get_finished_us": 235} +{"t_unix": 1779813358.3076537, "step_id": 4407, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813358.549735, "step_id": 4408, "start_load_kv_us": 118, "get_finished_us": 355} +{"t_unix": 1779813358.553643, "step_id": 4409, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813358.7612119, "step_id": 4410, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813358.7715268, "step_id": 4411, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813358.7819164, "step_id": 4412, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813358.7925272, "step_id": 4413, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813358.8044264, "step_id": 4414, "start_load_kv_us": 7, "get_finished_us": 201} +{"t_unix": 1779813358.8147452, "step_id": 4415, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813358.8252614, "step_id": 4416, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813358.835846, "step_id": 4417, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813358.846571, "step_id": 4418, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813358.858199, "step_id": 4419, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813358.8693223, "step_id": 4420, "start_load_kv_us": 7, "get_finished_us": 157} +{"t_unix": 1779813358.8794785, "step_id": 4421, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813358.8904934, "step_id": 4422, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813358.9018002, "step_id": 4423, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813358.9137735, "step_id": 4424, "start_load_kv_us": 5, "get_finished_us": 273} +{"t_unix": 1779813358.9241807, "step_id": 4425, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813358.935871, "step_id": 4426, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813358.9455914, "step_id": 4427, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813358.9564247, "step_id": 4428, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813358.967176, "step_id": 4429, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813358.9792662, "step_id": 4430, "start_load_kv_us": 32, "get_finished_us": 255} +{"t_unix": 1779813358.9888153, "step_id": 4431, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813358.9997616, "step_id": 4432, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813359.0085206, "step_id": 4433, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813359.017619, "step_id": 4434, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813359.0275671, "step_id": 4435, "start_load_kv_us": 13, "get_finished_us": 300} +{"t_unix": 1779813359.0363758, "step_id": 4436, "start_load_kv_us": 23, "get_finished_us": 187} +{"t_unix": 1779813359.0443761, "step_id": 4437, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813359.0532372, "step_id": 4438, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813359.0623498, "step_id": 4439, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813359.071635, "step_id": 4440, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813359.0806432, "step_id": 4441, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813359.0898118, "step_id": 4442, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813359.099349, "step_id": 4443, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813359.1084473, "step_id": 4444, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813359.11761, "step_id": 4445, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813359.1273198, "step_id": 4446, "start_load_kv_us": 16, "get_finished_us": 148} +{"t_unix": 1779813359.1357493, "step_id": 4447, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813359.1450565, "step_id": 4448, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813359.1544538, "step_id": 4449, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813359.1637597, "step_id": 4450, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813359.17419, "step_id": 4451, "start_load_kv_us": 13, "get_finished_us": 150} +{"t_unix": 1779813359.1836302, "step_id": 4452, "start_load_kv_us": 10, "get_finished_us": 198} +{"t_unix": 1779813359.192021, "step_id": 4453, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813359.2013981, "step_id": 4454, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813359.2108643, "step_id": 4455, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813359.2205718, "step_id": 4456, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813359.232362, "step_id": 4457, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813359.2396767, "step_id": 4458, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813359.2495267, "step_id": 4459, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813359.2595184, "step_id": 4460, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813359.268608, "step_id": 4461, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813359.2767432, "step_id": 4462, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813359.2836745, "step_id": 4463, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813359.291283, "step_id": 4464, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813359.2983887, "step_id": 4465, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813359.3054562, "step_id": 4466, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813359.313649, "step_id": 4467, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813359.3217978, "step_id": 4468, "start_load_kv_us": 19, "get_finished_us": 277} +{"t_unix": 1779813359.3288007, "step_id": 4469, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813359.3368688, "step_id": 4470, "start_load_kv_us": 3, "get_finished_us": 171} +{"t_unix": 1779813359.3447201, "step_id": 4471, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813359.352577, "step_id": 4472, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813359.3604014, "step_id": 4473, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813359.368494, "step_id": 4474, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813359.3766406, "step_id": 4475, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813359.4251184, "step_id": 4476, "start_load_kv_us": 213, "get_finished_us": 266} +{"t_unix": 1779813359.4287984, "step_id": 4477, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813359.628221, "step_id": 4478, "start_load_kv_us": 5, "get_finished_us": 313} +{"t_unix": 1779813359.6369884, "step_id": 4479, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813359.6467822, "step_id": 4480, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813359.6567554, "step_id": 4481, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813359.6667247, "step_id": 4482, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813359.677489, "step_id": 4483, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813359.687408, "step_id": 4484, "start_load_kv_us": 6, "get_finished_us": 175} +{"t_unix": 1779813359.6969132, "step_id": 4485, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813359.7064779, "step_id": 4486, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813359.7167299, "step_id": 4487, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813359.7261355, "step_id": 4488, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813359.7357898, "step_id": 4489, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813359.745041, "step_id": 4490, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813359.7548265, "step_id": 4491, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813359.765048, "step_id": 4492, "start_load_kv_us": 5, "get_finished_us": 245} +{"t_unix": 1779813359.7739842, "step_id": 4493, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813359.7860599, "step_id": 4494, "start_load_kv_us": 19, "get_finished_us": 335} +{"t_unix": 1779813359.7935817, "step_id": 4495, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813359.8034062, "step_id": 4496, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813359.8130956, "step_id": 4497, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813359.8206697, "step_id": 4498, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813359.8284886, "step_id": 4499, "start_load_kv_us": 1, "get_finished_us": 263} +{"t_unix": 1779813359.8368428, "step_id": 4500, "start_load_kv_us": 13, "get_finished_us": 189} +{"t_unix": 1779813359.8438673, "step_id": 4501, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813359.8517354, "step_id": 4502, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813359.8593802, "step_id": 4503, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813359.8666093, "step_id": 4504, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813359.8738742, "step_id": 4505, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813359.8811777, "step_id": 4506, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813359.8887603, "step_id": 4507, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813359.8970327, "step_id": 4508, "start_load_kv_us": 10, "get_finished_us": 172} +{"t_unix": 1779813359.9040725, "step_id": 4509, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813359.9120662, "step_id": 4510, "start_load_kv_us": 13, "get_finished_us": 214} +{"t_unix": 1779813359.9188004, "step_id": 4511, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813359.926406, "step_id": 4512, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813359.9339294, "step_id": 4513, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813359.941255, "step_id": 4514, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813359.9488251, "step_id": 4515, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813359.9588852, "step_id": 4516, "start_load_kv_us": 64, "get_finished_us": 1214} +{"t_unix": 1779813359.9709053, "step_id": 4517, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813359.974355, "step_id": 4518, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813359.9811158, "step_id": 4519, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813359.98827, "step_id": 4520, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813359.9955788, "step_id": 4521, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813360.0026233, "step_id": 4522, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813360.0109527, "step_id": 4523, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813360.0184538, "step_id": 4524, "start_load_kv_us": 11, "get_finished_us": 226} +{"t_unix": 1779813360.0248857, "step_id": 4525, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813360.0358775, "step_id": 4526, "start_load_kv_us": 10, "get_finished_us": 259} +{"t_unix": 1779813360.039685, "step_id": 4527, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813360.0521572, "step_id": 4528, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813360.0555558, "step_id": 4529, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813360.0624335, "step_id": 4530, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813360.0695708, "step_id": 4531, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813360.0776887, "step_id": 4532, "start_load_kv_us": 12, "get_finished_us": 177} +{"t_unix": 1779813360.084303, "step_id": 4533, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813360.0917962, "step_id": 4534, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813360.0991137, "step_id": 4535, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813360.1063178, "step_id": 4536, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813360.1137962, "step_id": 4537, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813360.1213706, "step_id": 4538, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813360.1291509, "step_id": 4539, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813360.1371098, "step_id": 4540, "start_load_kv_us": 5, "get_finished_us": 145} +{"t_unix": 1779813360.1437898, "step_id": 4541, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813360.1522386, "step_id": 4542, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813360.158784, "step_id": 4543, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813360.1659174, "step_id": 4544, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813360.1732903, "step_id": 4545, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813360.180724, "step_id": 4546, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813360.2309608, "step_id": 4547, "start_load_kv_us": 372, "get_finished_us": 276} +{"t_unix": 1779813360.235203, "step_id": 4548, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813360.433818, "step_id": 4549, "start_load_kv_us": 3, "get_finished_us": 294} +{"t_unix": 1779813360.4413142, "step_id": 4550, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813360.4488533, "step_id": 4551, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813360.4570355, "step_id": 4552, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813360.46491, "step_id": 4553, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813360.4726877, "step_id": 4554, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813360.4802406, "step_id": 4555, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813360.4885066, "step_id": 4556, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813360.4954488, "step_id": 4557, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813360.5036106, "step_id": 4558, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813360.510893, "step_id": 4559, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813360.5182183, "step_id": 4560, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813360.525582, "step_id": 4561, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813360.5340552, "step_id": 4562, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813360.541261, "step_id": 4563, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813360.5494835, "step_id": 4564, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813360.5563073, "step_id": 4565, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813360.5637872, "step_id": 4566, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813360.5713952, "step_id": 4567, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813360.5785332, "step_id": 4568, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813360.585356, "step_id": 4569, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813360.5927365, "step_id": 4570, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813360.6004672, "step_id": 4571, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813360.6086576, "step_id": 4572, "start_load_kv_us": 5, "get_finished_us": 254} +{"t_unix": 1779813360.6153872, "step_id": 4573, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813360.6234517, "step_id": 4574, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813360.630258, "step_id": 4575, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813360.638348, "step_id": 4576, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813360.64564, "step_id": 4577, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813360.653928, "step_id": 4578, "start_load_kv_us": 5, "get_finished_us": 245} +{"t_unix": 1779813360.6609662, "step_id": 4579, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813360.6696022, "step_id": 4580, "start_load_kv_us": 15, "get_finished_us": 187} +{"t_unix": 1779813360.6766112, "step_id": 4581, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813360.6847985, "step_id": 4582, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813360.6926932, "step_id": 4583, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813360.7005312, "step_id": 4584, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813360.7084572, "step_id": 4585, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813360.7162545, "step_id": 4586, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813360.724921, "step_id": 4587, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813360.775282, "step_id": 4588, "start_load_kv_us": 635, "get_finished_us": 285} +{"t_unix": 1779813360.7799244, "step_id": 4589, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813361.0144665, "step_id": 4590, "start_load_kv_us": 186, "get_finished_us": 293} +{"t_unix": 1779813361.0181744, "step_id": 4591, "start_load_kv_us": 3, "get_finished_us": 171} +{"t_unix": 1779813361.4375865, "step_id": 4592, "start_load_kv_us": 6, "get_finished_us": 310} +{"t_unix": 1779813361.4484026, "step_id": 4593, "start_load_kv_us": 6, "get_finished_us": 228} +{"t_unix": 1779813361.4594977, "step_id": 4594, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813361.470408, "step_id": 4595, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813361.4827356, "step_id": 4596, "start_load_kv_us": 6, "get_finished_us": 253} +{"t_unix": 1779813361.4942296, "step_id": 4597, "start_load_kv_us": 3, "get_finished_us": 242} +{"t_unix": 1779813361.5049362, "step_id": 4598, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813361.516579, "step_id": 4599, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813361.5281212, "step_id": 4600, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813361.5391145, "step_id": 4601, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813361.550715, "step_id": 4602, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813361.562146, "step_id": 4603, "start_load_kv_us": 17, "get_finished_us": 151} +{"t_unix": 1779813361.5744767, "step_id": 4604, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813361.5853627, "step_id": 4605, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813361.5975428, "step_id": 4606, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813361.6080604, "step_id": 4607, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813361.620083, "step_id": 4608, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813361.6316183, "step_id": 4609, "start_load_kv_us": 13, "get_finished_us": 211} +{"t_unix": 1779813361.642882, "step_id": 4610, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813361.653183, "step_id": 4611, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813361.6651936, "step_id": 4612, "start_load_kv_us": 6, "get_finished_us": 233} +{"t_unix": 1779813361.6756194, "step_id": 4613, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813361.6867979, "step_id": 4614, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813361.6984806, "step_id": 4615, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813361.709834, "step_id": 4616, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813361.7212002, "step_id": 4617, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813361.7322705, "step_id": 4618, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813361.7438574, "step_id": 4619, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813361.756013, "step_id": 4620, "start_load_kv_us": 5, "get_finished_us": 255} +{"t_unix": 1779813361.7671115, "step_id": 4621, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813361.7791865, "step_id": 4622, "start_load_kv_us": 6, "get_finished_us": 253} +{"t_unix": 1779813361.7898998, "step_id": 4623, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813361.8022912, "step_id": 4624, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813361.8138285, "step_id": 4625, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813361.8252964, "step_id": 4626, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813361.836376, "step_id": 4627, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813361.8489387, "step_id": 4628, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813361.8599305, "step_id": 4629, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813361.8712893, "step_id": 4630, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813361.8824084, "step_id": 4631, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813361.8934536, "step_id": 4632, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813361.905095, "step_id": 4633, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813361.916312, "step_id": 4634, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813361.933591, "step_id": 4635, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813361.940283, "step_id": 4636, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813361.9513555, "step_id": 4637, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813361.964063, "step_id": 4638, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813361.9752219, "step_id": 4639, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813361.9874175, "step_id": 4640, "start_load_kv_us": 6, "get_finished_us": 168} +{"t_unix": 1779813361.9992697, "step_id": 4641, "start_load_kv_us": 6, "get_finished_us": 162} +{"t_unix": 1779813362.011127, "step_id": 4642, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813362.022745, "step_id": 4643, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813362.035362, "step_id": 4644, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813362.0469174, "step_id": 4645, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813362.058373, "step_id": 4646, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813362.070096, "step_id": 4647, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813362.0813746, "step_id": 4648, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813362.0925806, "step_id": 4649, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813362.1039062, "step_id": 4650, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813362.1154537, "step_id": 4651, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813362.1281865, "step_id": 4652, "start_load_kv_us": 6, "get_finished_us": 154} +{"t_unix": 1779813362.1390786, "step_id": 4653, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813362.15138, "step_id": 4654, "start_load_kv_us": 6, "get_finished_us": 162} +{"t_unix": 1779813362.1626697, "step_id": 4655, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813362.1752794, "step_id": 4656, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813362.1869829, "step_id": 4657, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813362.1991258, "step_id": 4658, "start_load_kv_us": 5, "get_finished_us": 286} +{"t_unix": 1779813362.2102044, "step_id": 4659, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813362.222844, "step_id": 4660, "start_load_kv_us": 6, "get_finished_us": 156} +{"t_unix": 1779813362.236061, "step_id": 4661, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813362.245994, "step_id": 4662, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813362.2572446, "step_id": 4663, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813362.266598, "step_id": 4664, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813362.276037, "step_id": 4665, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813362.2853584, "step_id": 4666, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813362.295292, "step_id": 4667, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813362.3055875, "step_id": 4668, "start_load_kv_us": 6, "get_finished_us": 228} +{"t_unix": 1779813362.3145127, "step_id": 4669, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813362.3249888, "step_id": 4670, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813362.3340566, "step_id": 4671, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813362.3444939, "step_id": 4672, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813362.3548725, "step_id": 4673, "start_load_kv_us": 6, "get_finished_us": 203} +{"t_unix": 1779813362.3645043, "step_id": 4674, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813362.3744318, "step_id": 4675, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813362.3834825, "step_id": 4676, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813362.393301, "step_id": 4677, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813362.4032116, "step_id": 4678, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813362.4131775, "step_id": 4679, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813362.4231668, "step_id": 4680, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813362.432932, "step_id": 4681, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813362.4428713, "step_id": 4682, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813362.4521658, "step_id": 4683, "start_load_kv_us": 15, "get_finished_us": 172} +{"t_unix": 1779813362.462675, "step_id": 4684, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813362.47161, "step_id": 4685, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813362.481928, "step_id": 4686, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813362.4907167, "step_id": 4687, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813362.5008934, "step_id": 4688, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813362.510342, "step_id": 4689, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813362.5199847, "step_id": 4690, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813362.5290408, "step_id": 4691, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813362.5390518, "step_id": 4692, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813362.5488548, "step_id": 4693, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813362.5589335, "step_id": 4694, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813362.5687337, "step_id": 4695, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813362.578478, "step_id": 4696, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813362.5879996, "step_id": 4697, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813362.5972226, "step_id": 4698, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813362.6067877, "step_id": 4699, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813362.6168091, "step_id": 4700, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813362.625897, "step_id": 4701, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813362.6362062, "step_id": 4702, "start_load_kv_us": 19, "get_finished_us": 208} +{"t_unix": 1779813362.6451368, "step_id": 4703, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813362.6549714, "step_id": 4704, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813362.6642277, "step_id": 4705, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813362.674169, "step_id": 4706, "start_load_kv_us": 7, "get_finished_us": 167} +{"t_unix": 1779813362.6829753, "step_id": 4707, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813362.6925879, "step_id": 4708, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813362.7027273, "step_id": 4709, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813362.7122455, "step_id": 4710, "start_load_kv_us": 3, "get_finished_us": 196} +{"t_unix": 1779813362.7217915, "step_id": 4711, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813362.7313452, "step_id": 4712, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813362.7409618, "step_id": 4713, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813362.7516363, "step_id": 4714, "start_load_kv_us": 2, "get_finished_us": 403} +{"t_unix": 1779813362.7619696, "step_id": 4715, "start_load_kv_us": 2, "get_finished_us": 344} +{"t_unix": 1779813362.771847, "step_id": 4716, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813362.7811184, "step_id": 4717, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813362.7920802, "step_id": 4718, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813362.8014066, "step_id": 4719, "start_load_kv_us": 2, "get_finished_us": 357} +{"t_unix": 1779813362.8118675, "step_id": 4720, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813362.8217304, "step_id": 4721, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813362.8314295, "step_id": 4722, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813362.8410215, "step_id": 4723, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813362.851733, "step_id": 4724, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813362.862982, "step_id": 4725, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813362.8750532, "step_id": 4726, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813362.8823347, "step_id": 4727, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813362.8922086, "step_id": 4728, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813362.9025023, "step_id": 4729, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813362.9129283, "step_id": 4730, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813362.9226906, "step_id": 4731, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813362.9370773, "step_id": 4732, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813362.9433482, "step_id": 4733, "start_load_kv_us": 3, "get_finished_us": 153} +{"t_unix": 1779813362.95133, "step_id": 4734, "start_load_kv_us": 5, "get_finished_us": 147} +{"t_unix": 1779813362.959156, "step_id": 4735, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813362.9681866, "step_id": 4736, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813362.9766932, "step_id": 4737, "start_load_kv_us": 5, "get_finished_us": 421} +{"t_unix": 1779813362.9853454, "step_id": 4738, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813362.9943135, "step_id": 4739, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813363.0018709, "step_id": 4740, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813363.0105612, "step_id": 4741, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813363.0201116, "step_id": 4742, "start_load_kv_us": 2, "get_finished_us": 353} +{"t_unix": 1779813363.0280194, "step_id": 4743, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813363.036909, "step_id": 4744, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813363.0455909, "step_id": 4745, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813363.0543838, "step_id": 4746, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813363.0628786, "step_id": 4747, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813363.071289, "step_id": 4748, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813363.080975, "step_id": 4749, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813363.0892482, "step_id": 4750, "start_load_kv_us": 5, "get_finished_us": 356} +{"t_unix": 1779813363.0969694, "step_id": 4751, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813363.106186, "step_id": 4752, "start_load_kv_us": 6, "get_finished_us": 166} +{"t_unix": 1779813363.1143632, "step_id": 4753, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813363.122983, "step_id": 4754, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813363.1308596, "step_id": 4755, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813363.1397572, "step_id": 4756, "start_load_kv_us": 10, "get_finished_us": 163} +{"t_unix": 1779813363.1490562, "step_id": 4757, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813363.156673, "step_id": 4758, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813363.166218, "step_id": 4759, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813363.173582, "step_id": 4760, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813363.1829062, "step_id": 4761, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813363.2682195, "step_id": 4762, "start_load_kv_us": 129, "get_finished_us": 332} +{"t_unix": 1779813363.2737706, "step_id": 4763, "start_load_kv_us": 3, "get_finished_us": 370} +{"t_unix": 1779813363.5065374, "step_id": 4764, "start_load_kv_us": 124, "get_finished_us": 371} +{"t_unix": 1779813363.6901069, "step_id": 4765, "start_load_kv_us": 107, "get_finished_us": 381} +{"t_unix": 1779813363.7025907, "step_id": 4766, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813363.9795208, "step_id": 4767, "start_load_kv_us": 109, "get_finished_us": 387} +{"t_unix": 1779813363.9843047, "step_id": 4768, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813364.1865273, "step_id": 4769, "start_load_kv_us": 5, "get_finished_us": 378} +{"t_unix": 1779813364.1961613, "step_id": 4770, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813364.2069, "step_id": 4771, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813364.2169118, "step_id": 4772, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813364.2661488, "step_id": 4773, "start_load_kv_us": 124, "get_finished_us": 337} +{"t_unix": 1779813364.2699528, "step_id": 4774, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813364.4797847, "step_id": 4775, "start_load_kv_us": 6, "get_finished_us": 368} +{"t_unix": 1779813364.4900455, "step_id": 4776, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813364.5018275, "step_id": 4777, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813364.5136545, "step_id": 4778, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813364.5253346, "step_id": 4779, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813364.5369263, "step_id": 4780, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813364.5489545, "step_id": 4781, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813364.560525, "step_id": 4782, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813364.5709736, "step_id": 4783, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813364.5831618, "step_id": 4784, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813364.5944707, "step_id": 4785, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813364.605528, "step_id": 4786, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813364.6170807, "step_id": 4787, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813364.6277976, "step_id": 4788, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813364.6392634, "step_id": 4789, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813364.6509843, "step_id": 4790, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813364.663166, "step_id": 4791, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813364.6740043, "step_id": 4792, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813364.6858425, "step_id": 4793, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813364.6974876, "step_id": 4794, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813364.7097208, "step_id": 4795, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813364.7598, "step_id": 4796, "start_load_kv_us": 127, "get_finished_us": 288} +{"t_unix": 1779813364.9603198, "step_id": 4797, "start_load_kv_us": 221, "get_finished_us": 327} +{"t_unix": 1779813364.9724905, "step_id": 4798, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813365.4707, "step_id": 4799, "start_load_kv_us": 199, "get_finished_us": 356} +{"t_unix": 1779813365.475374, "step_id": 4800, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813365.8914745, "step_id": 4801, "start_load_kv_us": 6, "get_finished_us": 337} +{"t_unix": 1779813365.9054282, "step_id": 4802, "start_load_kv_us": 5, "get_finished_us": 250} +{"t_unix": 1779813365.9200456, "step_id": 4803, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813365.933185, "step_id": 4804, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813365.9845176, "step_id": 4805, "start_load_kv_us": 99, "get_finished_us": 245} +{"t_unix": 1779813365.9882565, "step_id": 4806, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813366.2005033, "step_id": 4807, "start_load_kv_us": 5, "get_finished_us": 304} +{"t_unix": 1779813366.2143135, "step_id": 4808, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813366.229576, "step_id": 4809, "start_load_kv_us": 4, "get_finished_us": 264} +{"t_unix": 1779813366.243788, "step_id": 4810, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813366.2588875, "step_id": 4811, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813366.2737982, "step_id": 4812, "start_load_kv_us": 4, "get_finished_us": 270} +{"t_unix": 1779813366.288487, "step_id": 4813, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813366.3033376, "step_id": 4814, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813366.317329, "step_id": 4815, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813366.3325808, "step_id": 4816, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813366.3473454, "step_id": 4817, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813366.361463, "step_id": 4818, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813366.3772542, "step_id": 4819, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813366.3919067, "step_id": 4820, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813366.4062445, "step_id": 4821, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813366.4206915, "step_id": 4822, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813366.4360561, "step_id": 4823, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813366.4500682, "step_id": 4824, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813366.4657714, "step_id": 4825, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813366.4802475, "step_id": 4826, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813366.4951952, "step_id": 4827, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813366.5107977, "step_id": 4828, "start_load_kv_us": 17, "get_finished_us": 202} +{"t_unix": 1779813366.5254695, "step_id": 4829, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813366.540141, "step_id": 4830, "start_load_kv_us": 19, "get_finished_us": 149} +{"t_unix": 1779813366.554036, "step_id": 4831, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813366.5695896, "step_id": 4832, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813366.5846713, "step_id": 4833, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813366.598901, "step_id": 4834, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813366.6145942, "step_id": 4835, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813366.629451, "step_id": 4836, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813366.6435623, "step_id": 4837, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813366.6583195, "step_id": 4838, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813366.6737373, "step_id": 4839, "start_load_kv_us": 6, "get_finished_us": 219} +{"t_unix": 1779813366.687669, "step_id": 4840, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813366.7030208, "step_id": 4841, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813366.7167013, "step_id": 4842, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813366.731181, "step_id": 4843, "start_load_kv_us": 1, "get_finished_us": 278} +{"t_unix": 1779813366.7467628, "step_id": 4844, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813366.7611187, "step_id": 4845, "start_load_kv_us": 5, "get_finished_us": 283} +{"t_unix": 1779813366.7750514, "step_id": 4846, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813366.7887042, "step_id": 4847, "start_load_kv_us": 3, "get_finished_us": 209} +{"t_unix": 1779813366.802113, "step_id": 4848, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813366.8154938, "step_id": 4849, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813366.828209, "step_id": 4850, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813366.8419304, "step_id": 4851, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813366.8555205, "step_id": 4852, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813366.8683925, "step_id": 4853, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813366.8822656, "step_id": 4854, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813366.896537, "step_id": 4855, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813366.9098363, "step_id": 4856, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813366.9241354, "step_id": 4857, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813366.9369247, "step_id": 4858, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813366.9502406, "step_id": 4859, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813366.9642806, "step_id": 4860, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813366.9780583, "step_id": 4861, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813366.9918802, "step_id": 4862, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813367.0061057, "step_id": 4863, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813367.0567982, "step_id": 4864, "start_load_kv_us": 100, "get_finished_us": 233} +{"t_unix": 1779813367.0611098, "step_id": 4865, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813367.308887, "step_id": 4866, "start_load_kv_us": 97, "get_finished_us": 267} +{"t_unix": 1779813367.3132043, "step_id": 4867, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813367.5231984, "step_id": 4868, "start_load_kv_us": 5, "get_finished_us": 292} +{"t_unix": 1779813367.5367644, "step_id": 4869, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813367.6105576, "step_id": 4870, "start_load_kv_us": 163, "get_finished_us": 301} +{"t_unix": 1779813367.6150465, "step_id": 4871, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813367.8069263, "step_id": 4872, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813367.822643, "step_id": 4873, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813367.8375258, "step_id": 4874, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813367.8518863, "step_id": 4875, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813367.8679996, "step_id": 4876, "start_load_kv_us": 5, "get_finished_us": 239} +{"t_unix": 1779813367.8835816, "step_id": 4877, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813367.9363065, "step_id": 4878, "start_load_kv_us": 109, "get_finished_us": 246} +{"t_unix": 1779813367.9407263, "step_id": 4879, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813368.155395, "step_id": 4880, "start_load_kv_us": 5, "get_finished_us": 274} +{"t_unix": 1779813368.1700096, "step_id": 4881, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813368.184215, "step_id": 4882, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813368.1993625, "step_id": 4883, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813368.214194, "step_id": 4884, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813368.2281675, "step_id": 4885, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813368.243038, "step_id": 4886, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813368.2580533, "step_id": 4887, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813368.2720704, "step_id": 4888, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813368.2871108, "step_id": 4889, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813368.3013318, "step_id": 4890, "start_load_kv_us": 6, "get_finished_us": 166} +{"t_unix": 1779813368.3147926, "step_id": 4891, "start_load_kv_us": 12, "get_finished_us": 202} +{"t_unix": 1779813368.3296585, "step_id": 4892, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813368.3440602, "step_id": 4893, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813368.3584628, "step_id": 4894, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813368.3728127, "step_id": 4895, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813368.3870995, "step_id": 4896, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813368.401701, "step_id": 4897, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813368.415894, "step_id": 4898, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813368.431368, "step_id": 4899, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813368.4460251, "step_id": 4900, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813368.4600728, "step_id": 4901, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813368.4748585, "step_id": 4902, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813368.4902816, "step_id": 4903, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813368.5043027, "step_id": 4904, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813368.5199654, "step_id": 4905, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813368.5348473, "step_id": 4906, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813368.5493112, "step_id": 4907, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813368.5650878, "step_id": 4908, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813368.5804143, "step_id": 4909, "start_load_kv_us": 4, "get_finished_us": 135} +{"t_unix": 1779813368.5953023, "step_id": 4910, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813368.61031, "step_id": 4911, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813368.6255124, "step_id": 4912, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813368.640706, "step_id": 4913, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813368.6554098, "step_id": 4914, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813368.6715403, "step_id": 4915, "start_load_kv_us": 4, "get_finished_us": 283} +{"t_unix": 1779813368.6865735, "step_id": 4916, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813368.701038, "step_id": 4917, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813368.7163515, "step_id": 4918, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813368.732042, "step_id": 4919, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813368.7466364, "step_id": 4920, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813368.7628522, "step_id": 4921, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813368.7780507, "step_id": 4922, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813368.793047, "step_id": 4923, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813368.8089044, "step_id": 4924, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813368.8239822, "step_id": 4925, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813368.839192, "step_id": 4926, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813368.8543773, "step_id": 4927, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813368.8694804, "step_id": 4928, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813368.8844507, "step_id": 4929, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813368.8991325, "step_id": 4930, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813368.915256, "step_id": 4931, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813368.9308057, "step_id": 4932, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813368.9838643, "step_id": 4933, "start_load_kv_us": 104, "get_finished_us": 248} +{"t_unix": 1779813368.9877133, "step_id": 4934, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813369.2028732, "step_id": 4935, "start_load_kv_us": 6, "get_finished_us": 289} +{"t_unix": 1779813369.2170312, "step_id": 4936, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813369.2325802, "step_id": 4937, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813369.2475567, "step_id": 4938, "start_load_kv_us": 6, "get_finished_us": 174} +{"t_unix": 1779813369.2620087, "step_id": 4939, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813369.2776031, "step_id": 4940, "start_load_kv_us": 5, "get_finished_us": 239} +{"t_unix": 1779813369.292483, "step_id": 4941, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813369.3077223, "step_id": 4942, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813369.3275037, "step_id": 4943, "start_load_kv_us": 4, "get_finished_us": 269} +{"t_unix": 1779813369.3379598, "step_id": 4944, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813369.3528788, "step_id": 4945, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813369.366868, "step_id": 4946, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813369.3824766, "step_id": 4947, "start_load_kv_us": 4, "get_finished_us": 261} +{"t_unix": 1779813369.3973918, "step_id": 4948, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813369.4118047, "step_id": 4949, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813369.4271178, "step_id": 4950, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813369.4430943, "step_id": 4951, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813369.4574776, "step_id": 4952, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813369.4730532, "step_id": 4953, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813369.4881804, "step_id": 4954, "start_load_kv_us": 6, "get_finished_us": 170} +{"t_unix": 1779813369.50303, "step_id": 4955, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813369.5192559, "step_id": 4956, "start_load_kv_us": 6, "get_finished_us": 179} +{"t_unix": 1779813369.534579, "step_id": 4957, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813369.5502963, "step_id": 4958, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813369.5660093, "step_id": 4959, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813369.5814714, "step_id": 4960, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813369.597067, "step_id": 4961, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813369.6118376, "step_id": 4962, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813369.627622, "step_id": 4963, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813369.6431513, "step_id": 4964, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813369.6578891, "step_id": 4965, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813369.6730292, "step_id": 4966, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813369.688731, "step_id": 4967, "start_load_kv_us": 6, "get_finished_us": 204} +{"t_unix": 1779813369.7028246, "step_id": 4968, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813369.7198756, "step_id": 4969, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813369.7343576, "step_id": 4970, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813369.7493396, "step_id": 4971, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813369.7647238, "step_id": 4972, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813369.7802632, "step_id": 4973, "start_load_kv_us": 4, "get_finished_us": 283} +{"t_unix": 1779813369.7950928, "step_id": 4974, "start_load_kv_us": 4, "get_finished_us": 299} +{"t_unix": 1779813369.8105664, "step_id": 4975, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813369.8251503, "step_id": 4976, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813369.840158, "step_id": 4977, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813369.8544528, "step_id": 4978, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813369.8698163, "step_id": 4979, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813369.8842623, "step_id": 4980, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813369.8983107, "step_id": 4981, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813369.913279, "step_id": 4982, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813369.929486, "step_id": 4983, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813369.943814, "step_id": 4984, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813369.9590943, "step_id": 4985, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813369.9744172, "step_id": 4986, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813369.9886272, "step_id": 4987, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813370.0041687, "step_id": 4988, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813370.018855, "step_id": 4989, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813370.0337608, "step_id": 4990, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813370.0488863, "step_id": 4991, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813370.0640233, "step_id": 4992, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813370.0792713, "step_id": 4993, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813370.0939248, "step_id": 4994, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813370.1095917, "step_id": 4995, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813370.1245816, "step_id": 4996, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813370.1386683, "step_id": 4997, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813370.1536496, "step_id": 4998, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813370.1694622, "step_id": 4999, "start_load_kv_us": 5, "get_finished_us": 266} +{"t_unix": 1779813370.184099, "step_id": 5000, "start_load_kv_us": 2, "get_finished_us": 342} +{"t_unix": 1779813370.200259, "step_id": 5001, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813370.2155895, "step_id": 5002, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813370.23026, "step_id": 5003, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813370.245996, "step_id": 5004, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813370.2609887, "step_id": 5005, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813370.2763548, "step_id": 5006, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813370.2914653, "step_id": 5007, "start_load_kv_us": 3, "get_finished_us": 182} +{"t_unix": 1779813370.306999, "step_id": 5008, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813370.322885, "step_id": 5009, "start_load_kv_us": 4, "get_finished_us": 267} +{"t_unix": 1779813370.3375835, "step_id": 5010, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813370.3532333, "step_id": 5011, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813370.3682675, "step_id": 5012, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813370.3831344, "step_id": 5013, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813370.398369, "step_id": 5014, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813370.4145305, "step_id": 5015, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813370.4291935, "step_id": 5016, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813370.4453168, "step_id": 5017, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813370.4610498, "step_id": 5018, "start_load_kv_us": 5, "get_finished_us": 331} +{"t_unix": 1779813370.4753723, "step_id": 5019, "start_load_kv_us": 1, "get_finished_us": 241} +{"t_unix": 1779813370.4921403, "step_id": 5020, "start_load_kv_us": 4, "get_finished_us": 303} +{"t_unix": 1779813370.5073316, "step_id": 5021, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813370.523363, "step_id": 5022, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813370.5379922, "step_id": 5023, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813370.5522573, "step_id": 5024, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813370.5658128, "step_id": 5025, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813370.5799065, "step_id": 5026, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813370.594202, "step_id": 5027, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813370.6095862, "step_id": 5028, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813370.6241176, "step_id": 5029, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813370.639288, "step_id": 5030, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813370.6542041, "step_id": 5031, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813370.6677628, "step_id": 5032, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813370.6827056, "step_id": 5033, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813370.6973438, "step_id": 5034, "start_load_kv_us": 6, "get_finished_us": 287} +{"t_unix": 1779813370.7107131, "step_id": 5035, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813370.7254221, "step_id": 5036, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813370.7389865, "step_id": 5037, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813370.7541285, "step_id": 5038, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813370.7690566, "step_id": 5039, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813370.7825186, "step_id": 5040, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813370.796655, "step_id": 5041, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813370.8113456, "step_id": 5042, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813370.825876, "step_id": 5043, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813370.8411632, "step_id": 5044, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813370.854428, "step_id": 5045, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813370.8690038, "step_id": 5046, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813370.8839025, "step_id": 5047, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813370.8973944, "step_id": 5048, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813370.9121065, "step_id": 5049, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813370.9263659, "step_id": 5050, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813370.939851, "step_id": 5051, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813370.9553049, "step_id": 5052, "start_load_kv_us": 5, "get_finished_us": 231} +{"t_unix": 1779813370.968843, "step_id": 5053, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813370.983128, "step_id": 5054, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813370.994628, "step_id": 5055, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813371.0452666, "step_id": 5056, "start_load_kv_us": 112, "get_finished_us": 257} +{"t_unix": 1779813371.0490685, "step_id": 5057, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813371.2534575, "step_id": 5058, "start_load_kv_us": 6, "get_finished_us": 366} +{"t_unix": 1779813371.2661307, "step_id": 5059, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813371.2758, "step_id": 5060, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813371.286289, "step_id": 5061, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813371.2974024, "step_id": 5062, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813371.3068757, "step_id": 5063, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813371.3154624, "step_id": 5064, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813371.324544, "step_id": 5065, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813371.3343966, "step_id": 5066, "start_load_kv_us": 11, "get_finished_us": 150} +{"t_unix": 1779813371.3431127, "step_id": 5067, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813371.3526213, "step_id": 5068, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813371.4023392, "step_id": 5069, "start_load_kv_us": 115, "get_finished_us": 240} +{"t_unix": 1779813371.4059165, "step_id": 5070, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813371.6456032, "step_id": 5071, "start_load_kv_us": 123, "get_finished_us": 304} +{"t_unix": 1779813371.6492662, "step_id": 5072, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813371.8563902, "step_id": 5073, "start_load_kv_us": 5, "get_finished_us": 299} +{"t_unix": 1779813371.8671901, "step_id": 5074, "start_load_kv_us": 22, "get_finished_us": 193} +{"t_unix": 1779813371.8776195, "step_id": 5075, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813371.8894846, "step_id": 5076, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813371.8993647, "step_id": 5077, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813371.9096394, "step_id": 5078, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813371.9212744, "step_id": 5079, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813371.9319234, "step_id": 5080, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813371.9428313, "step_id": 5081, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813371.9543092, "step_id": 5082, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813371.9646628, "step_id": 5083, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813371.9757893, "step_id": 5084, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813371.98739, "step_id": 5085, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813371.9988198, "step_id": 5086, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813372.0109236, "step_id": 5087, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813372.0209672, "step_id": 5088, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813372.0328202, "step_id": 5089, "start_load_kv_us": 15, "get_finished_us": 147} +{"t_unix": 1779813372.0431557, "step_id": 5090, "start_load_kv_us": 6, "get_finished_us": 153} +{"t_unix": 1779813372.053026, "step_id": 5091, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813372.0651996, "step_id": 5092, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813372.075901, "step_id": 5093, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813372.08704, "step_id": 5094, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813372.0990112, "step_id": 5095, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813372.1097517, "step_id": 5096, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813372.1206927, "step_id": 5097, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813372.1322472, "step_id": 5098, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813372.1417294, "step_id": 5099, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813372.1525688, "step_id": 5100, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813372.1632614, "step_id": 5101, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813372.1741343, "step_id": 5102, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813372.185503, "step_id": 5103, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813372.1960096, "step_id": 5104, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813372.207432, "step_id": 5105, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813372.2186701, "step_id": 5106, "start_load_kv_us": 19, "get_finished_us": 186} +{"t_unix": 1779813372.2284577, "step_id": 5107, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813372.2400353, "step_id": 5108, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813372.250614, "step_id": 5109, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813372.2620335, "step_id": 5110, "start_load_kv_us": 1, "get_finished_us": 244} +{"t_unix": 1779813372.2742357, "step_id": 5111, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813372.2848973, "step_id": 5112, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813372.2961156, "step_id": 5113, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813372.3074186, "step_id": 5114, "start_load_kv_us": 5, "get_finished_us": 219} +{"t_unix": 1779813372.3173318, "step_id": 5115, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813372.3275797, "step_id": 5116, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813372.3381164, "step_id": 5117, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813372.348207, "step_id": 5118, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813372.3593209, "step_id": 5119, "start_load_kv_us": 3, "get_finished_us": 154} +{"t_unix": 1779813372.369738, "step_id": 5120, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813372.3811345, "step_id": 5121, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813372.3926919, "step_id": 5122, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813372.4036832, "step_id": 5123, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813372.4136827, "step_id": 5124, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813372.4226992, "step_id": 5125, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813372.4327009, "step_id": 5126, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813372.4424057, "step_id": 5127, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813372.4524324, "step_id": 5128, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813372.468125, "step_id": 5129, "start_load_kv_us": 3, "get_finished_us": 318} +{"t_unix": 1779813372.4732282, "step_id": 5130, "start_load_kv_us": 5, "get_finished_us": 257} +{"t_unix": 1779813372.4816904, "step_id": 5131, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813372.4911036, "step_id": 5132, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813372.5007324, "step_id": 5133, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813372.5114853, "step_id": 5134, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813372.5210032, "step_id": 5135, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813372.5286956, "step_id": 5136, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813372.5369906, "step_id": 5137, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813372.5445747, "step_id": 5138, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813372.5513976, "step_id": 5139, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813372.5596063, "step_id": 5140, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813372.5668085, "step_id": 5141, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813372.574768, "step_id": 5142, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813372.5822525, "step_id": 5143, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813372.589789, "step_id": 5144, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813372.5975966, "step_id": 5145, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813372.6060088, "step_id": 5146, "start_load_kv_us": 3, "get_finished_us": 142} +{"t_unix": 1779813372.613466, "step_id": 5147, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813372.62135, "step_id": 5148, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813372.6291695, "step_id": 5149, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813372.6370277, "step_id": 5150, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813372.6448908, "step_id": 5151, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813372.652383, "step_id": 5152, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813372.6611917, "step_id": 5153, "start_load_kv_us": 6, "get_finished_us": 156} +{"t_unix": 1779813372.6684186, "step_id": 5154, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813372.6753, "step_id": 5155, "start_load_kv_us": 1, "get_finished_us": 195} +{"t_unix": 1779813372.6834993, "step_id": 5156, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813372.6906765, "step_id": 5157, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813372.6985848, "step_id": 5158, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813372.7065716, "step_id": 5159, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813372.7147658, "step_id": 5160, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813372.7226827, "step_id": 5161, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813372.7311723, "step_id": 5162, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813372.738427, "step_id": 5163, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813372.7462144, "step_id": 5164, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813372.753969, "step_id": 5165, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813372.762528, "step_id": 5166, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813372.7697232, "step_id": 5167, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813372.7774875, "step_id": 5168, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813372.7858567, "step_id": 5169, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813372.79351, "step_id": 5170, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813372.8007205, "step_id": 5171, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813372.809408, "step_id": 5172, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813372.8165867, "step_id": 5173, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813372.8244903, "step_id": 5174, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813372.8324656, "step_id": 5175, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813372.840456, "step_id": 5176, "start_load_kv_us": 1, "get_finished_us": 241} +{"t_unix": 1779813372.8480403, "step_id": 5177, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813372.856186, "step_id": 5178, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813372.8636465, "step_id": 5179, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813372.8707666, "step_id": 5180, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813372.8785062, "step_id": 5181, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813372.8861678, "step_id": 5182, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813372.8938115, "step_id": 5183, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813372.901566, "step_id": 5184, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813372.9100733, "step_id": 5185, "start_load_kv_us": 10, "get_finished_us": 150} +{"t_unix": 1779813372.9180431, "step_id": 5186, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813372.925209, "step_id": 5187, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813372.9338686, "step_id": 5188, "start_load_kv_us": 9, "get_finished_us": 154} +{"t_unix": 1779813372.9412677, "step_id": 5189, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813372.9494743, "step_id": 5190, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813373.0000181, "step_id": 5191, "start_load_kv_us": 119, "get_finished_us": 331} +{"t_unix": 1779813373.1860526, "step_id": 5192, "start_load_kv_us": 120, "get_finished_us": 322} +{"t_unix": 1779813373.1968343, "step_id": 5193, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813373.4703486, "step_id": 5194, "start_load_kv_us": 119, "get_finished_us": 298} +{"t_unix": 1779813373.474834, "step_id": 5195, "start_load_kv_us": 6, "get_finished_us": 208} +{"t_unix": 1779813373.715563, "step_id": 5196, "start_load_kv_us": 140, "get_finished_us": 300} +{"t_unix": 1779813373.909145, "step_id": 5197, "start_load_kv_us": 114, "get_finished_us": 314} +{"t_unix": 1779813373.9202902, "step_id": 5198, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813374.1547503, "step_id": 5199, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813374.1651733, "step_id": 5200, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813374.176219, "step_id": 5201, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813374.1863644, "step_id": 5202, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813374.1958854, "step_id": 5203, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813374.2068114, "step_id": 5204, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813374.2166498, "step_id": 5205, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813374.2278402, "step_id": 5206, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813374.2377448, "step_id": 5207, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813374.2483323, "step_id": 5208, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813374.2589896, "step_id": 5209, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813374.2692523, "step_id": 5210, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813374.280754, "step_id": 5211, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813374.2918236, "step_id": 5212, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813374.3010135, "step_id": 5213, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813374.3120131, "step_id": 5214, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813374.3224602, "step_id": 5215, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813374.3328311, "step_id": 5216, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813374.3438032, "step_id": 5217, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813374.354336, "step_id": 5218, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813374.3639083, "step_id": 5219, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813374.3751307, "step_id": 5220, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813374.384635, "step_id": 5221, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813374.3954785, "step_id": 5222, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813374.4053578, "step_id": 5223, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813374.4160805, "step_id": 5224, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813374.42674, "step_id": 5225, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813374.4376938, "step_id": 5226, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813374.4489017, "step_id": 5227, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813374.4594216, "step_id": 5228, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813374.470236, "step_id": 5229, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813374.5198658, "step_id": 5230, "start_load_kv_us": 125, "get_finished_us": 263} +{"t_unix": 1779813374.5236254, "step_id": 5231, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813374.7272441, "step_id": 5232, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813374.7382894, "step_id": 5233, "start_load_kv_us": 5, "get_finished_us": 219} +{"t_unix": 1779813374.7486756, "step_id": 5234, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813374.759832, "step_id": 5235, "start_load_kv_us": 5, "get_finished_us": 305} +{"t_unix": 1779813374.7711914, "step_id": 5236, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813374.7817712, "step_id": 5237, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813374.7936842, "step_id": 5238, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813374.8044162, "step_id": 5239, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813374.816042, "step_id": 5240, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813374.827774, "step_id": 5241, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813374.8395925, "step_id": 5242, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813374.8517654, "step_id": 5243, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813374.8634083, "step_id": 5244, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813374.87482, "step_id": 5245, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813374.886174, "step_id": 5246, "start_load_kv_us": 2, "get_finished_us": 390} +{"t_unix": 1779813374.8973937, "step_id": 5247, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813374.9088805, "step_id": 5248, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813374.9210842, "step_id": 5249, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813374.9327025, "step_id": 5250, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813374.9444258, "step_id": 5251, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813374.9556394, "step_id": 5252, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813375.006029, "step_id": 5253, "start_load_kv_us": 107, "get_finished_us": 243} +{"t_unix": 1779813375.010506, "step_id": 5254, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813375.2495692, "step_id": 5255, "start_load_kv_us": 116, "get_finished_us": 358} +{"t_unix": 1779813375.2537673, "step_id": 5256, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813375.4629025, "step_id": 5257, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813375.4755054, "step_id": 5258, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813375.4898324, "step_id": 5259, "start_load_kv_us": 7, "get_finished_us": 293} +{"t_unix": 1779813375.5030525, "step_id": 5260, "start_load_kv_us": 5, "get_finished_us": 274} +{"t_unix": 1779813375.5538943, "step_id": 5261, "start_load_kv_us": 114, "get_finished_us": 273} +{"t_unix": 1779813375.558353, "step_id": 5262, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813375.7688696, "step_id": 5263, "start_load_kv_us": 5, "get_finished_us": 301} +{"t_unix": 1779813375.7815826, "step_id": 5264, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813375.795889, "step_id": 5265, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813375.8093643, "step_id": 5266, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813375.8230433, "step_id": 5267, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813375.8368604, "step_id": 5268, "start_load_kv_us": 16, "get_finished_us": 262} +{"t_unix": 1779813375.8500316, "step_id": 5269, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813375.864, "step_id": 5270, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813375.8770618, "step_id": 5271, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813375.890732, "step_id": 5272, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813375.9042962, "step_id": 5273, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813375.9177814, "step_id": 5274, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813375.9317398, "step_id": 5275, "start_load_kv_us": 15, "get_finished_us": 144} +{"t_unix": 1779813375.945309, "step_id": 5276, "start_load_kv_us": 5, "get_finished_us": 156} +{"t_unix": 1779813375.9585426, "step_id": 5277, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813375.9723594, "step_id": 5278, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813375.985968, "step_id": 5279, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813375.9987905, "step_id": 5280, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813376.0129778, "step_id": 5281, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813376.026345, "step_id": 5282, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813376.0396223, "step_id": 5283, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813376.0535657, "step_id": 5284, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813376.0668716, "step_id": 5285, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813376.0814714, "step_id": 5286, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813376.09505, "step_id": 5287, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813376.10863, "step_id": 5288, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813376.1224225, "step_id": 5289, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813376.1364279, "step_id": 5290, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813376.1509886, "step_id": 5291, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813376.1649172, "step_id": 5292, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813376.1788774, "step_id": 5293, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813376.1927137, "step_id": 5294, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813376.206264, "step_id": 5295, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813376.2193277, "step_id": 5296, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813376.233254, "step_id": 5297, "start_load_kv_us": 5, "get_finished_us": 268} +{"t_unix": 1779813376.2467434, "step_id": 5298, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813376.2601564, "step_id": 5299, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813376.274008, "step_id": 5300, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813376.2875717, "step_id": 5301, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813376.3395367, "step_id": 5302, "start_load_kv_us": 133, "get_finished_us": 271} +{"t_unix": 1779813376.343328, "step_id": 5303, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813376.556134, "step_id": 5304, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813376.6091988, "step_id": 5305, "start_load_kv_us": 107, "get_finished_us": 283} +{"t_unix": 1779813376.811127, "step_id": 5306, "start_load_kv_us": 126, "get_finished_us": 344} +{"t_unix": 1779813376.8231227, "step_id": 5307, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813377.1024299, "step_id": 5308, "start_load_kv_us": 114, "get_finished_us": 291} +{"t_unix": 1779813377.1071038, "step_id": 5309, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813377.3535557, "step_id": 5310, "start_load_kv_us": 110, "get_finished_us": 299} +{"t_unix": 1779813377.3581653, "step_id": 5311, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813377.5696983, "step_id": 5312, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813377.5878246, "step_id": 5313, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813377.6004612, "step_id": 5314, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813377.6144168, "step_id": 5315, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813377.6277943, "step_id": 5316, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813377.6410992, "step_id": 5317, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813377.6547816, "step_id": 5318, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813377.6686606, "step_id": 5319, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813377.6826506, "step_id": 5320, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813377.6971092, "step_id": 5321, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813377.711058, "step_id": 5322, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813377.7257795, "step_id": 5323, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813377.739589, "step_id": 5324, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813377.7539792, "step_id": 5325, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813377.7675803, "step_id": 5326, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813377.7821631, "step_id": 5327, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813377.7954948, "step_id": 5328, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813377.8111577, "step_id": 5329, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813377.8644655, "step_id": 5330, "start_load_kv_us": 110, "get_finished_us": 334} +{"t_unix": 1779813377.8692768, "step_id": 5331, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813378.1213427, "step_id": 5332, "start_load_kv_us": 242, "get_finished_us": 289} +{"t_unix": 1779813378.1259632, "step_id": 5333, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813378.5500393, "step_id": 5334, "start_load_kv_us": 5, "get_finished_us": 331} +{"t_unix": 1779813378.5656266, "step_id": 5335, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813378.581357, "step_id": 5336, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813378.5981903, "step_id": 5337, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813378.6148279, "step_id": 5338, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813378.6317973, "step_id": 5339, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813378.6482627, "step_id": 5340, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813378.6643188, "step_id": 5341, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813378.6806893, "step_id": 5342, "start_load_kv_us": 6, "get_finished_us": 176} +{"t_unix": 1779813378.6970444, "step_id": 5343, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813378.7129207, "step_id": 5344, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813378.7292788, "step_id": 5345, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813378.7462535, "step_id": 5346, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813378.762766, "step_id": 5347, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813378.77937, "step_id": 5348, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813378.7958355, "step_id": 5349, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813378.8121417, "step_id": 5350, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813378.82841, "step_id": 5351, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813378.8441494, "step_id": 5352, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813378.8606625, "step_id": 5353, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813378.8771207, "step_id": 5354, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813378.8944542, "step_id": 5355, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813378.9111316, "step_id": 5356, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813378.9277613, "step_id": 5357, "start_load_kv_us": 3, "get_finished_us": 189} +{"t_unix": 1779813378.944506, "step_id": 5358, "start_load_kv_us": 6, "get_finished_us": 169} +{"t_unix": 1779813378.9611876, "step_id": 5359, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813378.9792325, "step_id": 5360, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813378.9978187, "step_id": 5361, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813379.0167675, "step_id": 5362, "start_load_kv_us": 5, "get_finished_us": 249} +{"t_unix": 1779813379.035044, "step_id": 5363, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813379.0530207, "step_id": 5364, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813379.0708048, "step_id": 5365, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813379.088675, "step_id": 5366, "start_load_kv_us": 4, "get_finished_us": 317} +{"t_unix": 1779813379.1062834, "step_id": 5367, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813379.1242802, "step_id": 5368, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813379.1418355, "step_id": 5369, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813379.160449, "step_id": 5370, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813379.1801257, "step_id": 5371, "start_load_kv_us": 6, "get_finished_us": 256} +{"t_unix": 1779813379.1972723, "step_id": 5372, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813379.2148032, "step_id": 5373, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813379.2330732, "step_id": 5374, "start_load_kv_us": 6, "get_finished_us": 222} +{"t_unix": 1779813379.2521796, "step_id": 5375, "start_load_kv_us": 4, "get_finished_us": 279} +{"t_unix": 1779813379.2699888, "step_id": 5376, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813379.2885168, "step_id": 5377, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813379.3075044, "step_id": 5378, "start_load_kv_us": 4, "get_finished_us": 287} +{"t_unix": 1779813379.3324907, "step_id": 5379, "start_load_kv_us": 5, "get_finished_us": 287} +{"t_unix": 1779813379.3442822, "step_id": 5380, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813379.3622575, "step_id": 5381, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813379.380327, "step_id": 5382, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813379.3988001, "step_id": 5383, "start_load_kv_us": 5, "get_finished_us": 231} +{"t_unix": 1779813379.4168377, "step_id": 5384, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813379.4349518, "step_id": 5385, "start_load_kv_us": 1, "get_finished_us": 251} +{"t_unix": 1779813379.4530008, "step_id": 5386, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813379.4719088, "step_id": 5387, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813379.4897163, "step_id": 5388, "start_load_kv_us": 5, "get_finished_us": 260} +{"t_unix": 1779813379.507478, "step_id": 5389, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813379.5256019, "step_id": 5390, "start_load_kv_us": 6, "get_finished_us": 215} +{"t_unix": 1779813379.5435312, "step_id": 5391, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813379.606696, "step_id": 5392, "start_load_kv_us": 112, "get_finished_us": 316} +{"t_unix": 1779813379.6107914, "step_id": 5393, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813379.8246844, "step_id": 5394, "start_load_kv_us": 4, "get_finished_us": 329} +{"t_unix": 1779813379.879747, "step_id": 5395, "start_load_kv_us": 115, "get_finished_us": 309} +{"t_unix": 1779813379.884647, "step_id": 5396, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813380.1388628, "step_id": 5397, "start_load_kv_us": 129, "get_finished_us": 299} +{"t_unix": 1779813380.1438084, "step_id": 5398, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813380.3598435, "step_id": 5399, "start_load_kv_us": 5, "get_finished_us": 274} +{"t_unix": 1779813380.3795218, "step_id": 5400, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813380.4007442, "step_id": 5401, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813380.4218223, "step_id": 5402, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813380.4437003, "step_id": 5403, "start_load_kv_us": 5, "get_finished_us": 287} +{"t_unix": 1779813380.4643106, "step_id": 5404, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813380.4847174, "step_id": 5405, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813380.5060556, "step_id": 5406, "start_load_kv_us": 7, "get_finished_us": 178} +{"t_unix": 1779813380.5272117, "step_id": 5407, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813380.5479257, "step_id": 5408, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813380.5709035, "step_id": 5409, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813380.632106, "step_id": 5410, "start_load_kv_us": 112, "get_finished_us": 276} +{"t_unix": 1779813380.637046, "step_id": 5411, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813380.8559816, "step_id": 5412, "start_load_kv_us": 5, "get_finished_us": 317} +{"t_unix": 1779813380.8766043, "step_id": 5413, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813380.897995, "step_id": 5414, "start_load_kv_us": 5, "get_finished_us": 335} +{"t_unix": 1779813380.918144, "step_id": 5415, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813380.9380097, "step_id": 5416, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813380.9590607, "step_id": 5417, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813380.9806554, "step_id": 5418, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813381.0010147, "step_id": 5419, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813381.0218513, "step_id": 5420, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813381.0420666, "step_id": 5421, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813381.06251, "step_id": 5422, "start_load_kv_us": 6, "get_finished_us": 198} +{"t_unix": 1779813381.0829744, "step_id": 5423, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813381.1023324, "step_id": 5424, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813381.1228497, "step_id": 5425, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813381.1431332, "step_id": 5426, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813381.1631553, "step_id": 5427, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813381.1829574, "step_id": 5428, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813381.2027352, "step_id": 5429, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813381.2229083, "step_id": 5430, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813381.2431154, "step_id": 5431, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813381.263148, "step_id": 5432, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813381.2832289, "step_id": 5433, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813381.3034766, "step_id": 5434, "start_load_kv_us": 5, "get_finished_us": 248} +{"t_unix": 1779813381.3233192, "step_id": 5435, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813381.3434784, "step_id": 5436, "start_load_kv_us": 5, "get_finished_us": 266} +{"t_unix": 1779813381.4016576, "step_id": 5437, "start_load_kv_us": 109, "get_finished_us": 277} +{"t_unix": 1779813381.4067333, "step_id": 5438, "start_load_kv_us": 6, "get_finished_us": 170} +{"t_unix": 1779813381.6262352, "step_id": 5439, "start_load_kv_us": 4, "get_finished_us": 267} +{"t_unix": 1779813381.6454144, "step_id": 5440, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813381.6663535, "step_id": 5441, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813381.6866593, "step_id": 5442, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813381.7066877, "step_id": 5443, "start_load_kv_us": 6, "get_finished_us": 311} +{"t_unix": 1779813381.7261689, "step_id": 5444, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813381.7462049, "step_id": 5445, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813381.7663736, "step_id": 5446, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813381.7867587, "step_id": 5447, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813381.8059926, "step_id": 5448, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813381.825814, "step_id": 5449, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813381.8466387, "step_id": 5450, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813381.866073, "step_id": 5451, "start_load_kv_us": 1, "get_finished_us": 225} +{"t_unix": 1779813381.8834114, "step_id": 5452, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813381.9005694, "step_id": 5453, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813381.916539, "step_id": 5454, "start_load_kv_us": 5, "get_finished_us": 257} +{"t_unix": 1779813381.934622, "step_id": 5455, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813381.9521155, "step_id": 5456, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813381.970797, "step_id": 5457, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813381.9887693, "step_id": 5458, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813382.006832, "step_id": 5459, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813382.023315, "step_id": 5460, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813382.0393918, "step_id": 5461, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813382.0556736, "step_id": 5462, "start_load_kv_us": 4, "get_finished_us": 275} +{"t_unix": 1779813382.0720897, "step_id": 5463, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813382.0881076, "step_id": 5464, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813382.142383, "step_id": 5465, "start_load_kv_us": 107, "get_finished_us": 280} +{"t_unix": 1779813382.1467495, "step_id": 5466, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813382.3632078, "step_id": 5467, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813382.3795424, "step_id": 5468, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813382.3965077, "step_id": 5469, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813382.41339, "step_id": 5470, "start_load_kv_us": 7, "get_finished_us": 233} +{"t_unix": 1779813382.430298, "step_id": 5471, "start_load_kv_us": 5, "get_finished_us": 219} +{"t_unix": 1779813382.4463692, "step_id": 5472, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813382.463726, "step_id": 5473, "start_load_kv_us": 5, "get_finished_us": 239} +{"t_unix": 1779813382.4806216, "step_id": 5474, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813382.4977715, "step_id": 5475, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813382.5148234, "step_id": 5476, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813382.5320385, "step_id": 5477, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813382.5494316, "step_id": 5478, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813382.5664492, "step_id": 5479, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813382.5832567, "step_id": 5480, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813382.6010935, "step_id": 5481, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813382.6191537, "step_id": 5482, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813382.6358025, "step_id": 5483, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813382.6530502, "step_id": 5484, "start_load_kv_us": 1, "get_finished_us": 227} +{"t_unix": 1779813382.6711764, "step_id": 5485, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813382.6882782, "step_id": 5486, "start_load_kv_us": 7, "get_finished_us": 193} +{"t_unix": 1779813382.7052352, "step_id": 5487, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813382.7211485, "step_id": 5488, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813382.738747, "step_id": 5489, "start_load_kv_us": 15, "get_finished_us": 154} +{"t_unix": 1779813382.7557518, "step_id": 5490, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813382.773071, "step_id": 5491, "start_load_kv_us": 5, "get_finished_us": 233} +{"t_unix": 1779813382.7896156, "step_id": 5492, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813382.8065617, "step_id": 5493, "start_load_kv_us": 3, "get_finished_us": 226} +{"t_unix": 1779813382.8234599, "step_id": 5494, "start_load_kv_us": 5, "get_finished_us": 271} +{"t_unix": 1779813382.8402553, "step_id": 5495, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813382.85622, "step_id": 5496, "start_load_kv_us": 14, "get_finished_us": 233} +{"t_unix": 1779813382.8727272, "step_id": 5497, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813382.8898754, "step_id": 5498, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813382.9060113, "step_id": 5499, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813382.9226232, "step_id": 5500, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813382.9399145, "step_id": 5501, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813382.9569128, "step_id": 5502, "start_load_kv_us": 7, "get_finished_us": 169} +{"t_unix": 1779813382.9740996, "step_id": 5503, "start_load_kv_us": 4, "get_finished_us": 267} +{"t_unix": 1779813382.990631, "step_id": 5504, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813383.007767, "step_id": 5505, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813383.0245867, "step_id": 5506, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813383.0412138, "step_id": 5507, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813383.0571115, "step_id": 5508, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813383.0741374, "step_id": 5509, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813383.0907469, "step_id": 5510, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813383.1060524, "step_id": 5511, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813383.1201816, "step_id": 5512, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813383.1352112, "step_id": 5513, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813383.1510634, "step_id": 5514, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813383.165511, "step_id": 5515, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813383.2196047, "step_id": 5516, "start_load_kv_us": 113, "get_finished_us": 272} +{"t_unix": 1779813383.223659, "step_id": 5517, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813383.4769802, "step_id": 5518, "start_load_kv_us": 116, "get_finished_us": 323} +{"t_unix": 1779813383.4809, "step_id": 5519, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813383.6938589, "step_id": 5520, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813383.708909, "step_id": 5521, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813383.7237651, "step_id": 5522, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813383.7383714, "step_id": 5523, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813383.7920063, "step_id": 5524, "start_load_kv_us": 153, "get_finished_us": 298} +{"t_unix": 1779813383.7965107, "step_id": 5525, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813384.0091367, "step_id": 5526, "start_load_kv_us": 5, "get_finished_us": 301} +{"t_unix": 1779813384.0272925, "step_id": 5527, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813384.0461445, "step_id": 5528, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813384.1024039, "step_id": 5529, "start_load_kv_us": 135, "get_finished_us": 221} +{"t_unix": 1779813384.1068525, "step_id": 5530, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813384.324562, "step_id": 5531, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813384.3420515, "step_id": 5532, "start_load_kv_us": 10, "get_finished_us": 241} +{"t_unix": 1779813384.358324, "step_id": 5533, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813384.3759046, "step_id": 5534, "start_load_kv_us": 6, "get_finished_us": 183} +{"t_unix": 1779813384.3919296, "step_id": 5535, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813384.4091623, "step_id": 5536, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813384.4268107, "step_id": 5537, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813384.4436681, "step_id": 5538, "start_load_kv_us": 6, "get_finished_us": 192} +{"t_unix": 1779813384.4608507, "step_id": 5539, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813384.4780502, "step_id": 5540, "start_load_kv_us": 4, "get_finished_us": 270} +{"t_unix": 1779813384.4952269, "step_id": 5541, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813384.512296, "step_id": 5542, "start_load_kv_us": 9, "get_finished_us": 225} +{"t_unix": 1779813384.5289123, "step_id": 5543, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813384.5824077, "step_id": 5544, "start_load_kv_us": 142, "get_finished_us": 281} +{"t_unix": 1779813384.5863283, "step_id": 5545, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813384.8047717, "step_id": 5546, "start_load_kv_us": 6, "get_finished_us": 308} +{"t_unix": 1779813384.819871, "step_id": 5547, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813384.8373585, "step_id": 5548, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813384.853656, "step_id": 5549, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813384.8711598, "step_id": 5550, "start_load_kv_us": 6, "get_finished_us": 173} +{"t_unix": 1779813384.8871796, "step_id": 5551, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813384.9037068, "step_id": 5552, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813384.9212766, "step_id": 5553, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813384.9384103, "step_id": 5554, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813384.9551542, "step_id": 5555, "start_load_kv_us": 6, "get_finished_us": 174} +{"t_unix": 1779813384.9722393, "step_id": 5556, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813384.9896126, "step_id": 5557, "start_load_kv_us": 5, "get_finished_us": 314} +{"t_unix": 1779813385.0067902, "step_id": 5558, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813385.0236833, "step_id": 5559, "start_load_kv_us": 4, "get_finished_us": 246} +{"t_unix": 1779813385.0403214, "step_id": 5560, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813385.0581348, "step_id": 5561, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813385.0763433, "step_id": 5562, "start_load_kv_us": 5, "get_finished_us": 279} +{"t_unix": 1779813385.094213, "step_id": 5563, "start_load_kv_us": 16, "get_finished_us": 219} +{"t_unix": 1779813385.147741, "step_id": 5564, "start_load_kv_us": 121, "get_finished_us": 241} +{"t_unix": 1779813385.1517723, "step_id": 5565, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813385.3669648, "step_id": 5566, "start_load_kv_us": 6, "get_finished_us": 319} +{"t_unix": 1779813385.3811574, "step_id": 5567, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813385.3957708, "step_id": 5568, "start_load_kv_us": 12, "get_finished_us": 177} +{"t_unix": 1779813385.4116786, "step_id": 5569, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813385.4270754, "step_id": 5570, "start_load_kv_us": 5, "get_finished_us": 240} +{"t_unix": 1779813385.4423347, "step_id": 5571, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813385.457465, "step_id": 5572, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813385.4727538, "step_id": 5573, "start_load_kv_us": 5, "get_finished_us": 161} +{"t_unix": 1779813385.4880173, "step_id": 5574, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813385.5025694, "step_id": 5575, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813385.5180402, "step_id": 5576, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813385.5336757, "step_id": 5577, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813385.5502656, "step_id": 5578, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813385.56511, "step_id": 5579, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813385.5814087, "step_id": 5580, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813385.5963092, "step_id": 5581, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813385.612479, "step_id": 5582, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813385.6268628, "step_id": 5583, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813385.6419134, "step_id": 5584, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813385.6580966, "step_id": 5585, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813385.6739175, "step_id": 5586, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813385.6892574, "step_id": 5587, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813385.7048328, "step_id": 5588, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813385.7200208, "step_id": 5589, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813385.7338667, "step_id": 5590, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813385.7478487, "step_id": 5591, "start_load_kv_us": 1, "get_finished_us": 217} +{"t_unix": 1779813385.7632165, "step_id": 5592, "start_load_kv_us": 2, "get_finished_us": 1163} +{"t_unix": 1779813385.8160043, "step_id": 5593, "start_load_kv_us": 134, "get_finished_us": 288} +{"t_unix": 1779813386.0204637, "step_id": 5594, "start_load_kv_us": 155, "get_finished_us": 359} +{"t_unix": 1779813386.0324008, "step_id": 5595, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813386.3107913, "step_id": 5596, "start_load_kv_us": 146, "get_finished_us": 375} +{"t_unix": 1779813386.3174326, "step_id": 5597, "start_load_kv_us": 8, "get_finished_us": 211} +{"t_unix": 1779813386.529148, "step_id": 5598, "start_load_kv_us": 6, "get_finished_us": 308} +{"t_unix": 1779813386.5423691, "step_id": 5599, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813386.5574481, "step_id": 5600, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813386.5728302, "step_id": 5601, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813386.5874002, "step_id": 5602, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813386.6017942, "step_id": 5603, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813386.6164327, "step_id": 5604, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813386.6314635, "step_id": 5605, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813386.6466253, "step_id": 5606, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813386.6608071, "step_id": 5607, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813386.6755846, "step_id": 5608, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813386.6903691, "step_id": 5609, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813386.7057192, "step_id": 5610, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813386.7201092, "step_id": 5611, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813386.7354155, "step_id": 5612, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813386.7502174, "step_id": 5613, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813386.7647352, "step_id": 5614, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813386.7790418, "step_id": 5615, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813386.7941527, "step_id": 5616, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813386.8099675, "step_id": 5617, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813386.8252869, "step_id": 5618, "start_load_kv_us": 5, "get_finished_us": 314} +{"t_unix": 1779813386.8397639, "step_id": 5619, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813386.8549645, "step_id": 5620, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813386.8698146, "step_id": 5621, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813386.8845341, "step_id": 5622, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813386.8990164, "step_id": 5623, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813386.9141982, "step_id": 5624, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813386.9295125, "step_id": 5625, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813386.9459956, "step_id": 5626, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813386.9994936, "step_id": 5627, "start_load_kv_us": 136, "get_finished_us": 295} +{"t_unix": 1779813387.2037723, "step_id": 5628, "start_load_kv_us": 131, "get_finished_us": 307} +{"t_unix": 1779813387.2254195, "step_id": 5629, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813387.4569862, "step_id": 5630, "start_load_kv_us": 5, "get_finished_us": 281} +{"t_unix": 1779813387.4739983, "step_id": 5631, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813387.4926734, "step_id": 5632, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813387.511532, "step_id": 5633, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813387.5300756, "step_id": 5634, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813387.549106, "step_id": 5635, "start_load_kv_us": 4, "get_finished_us": 321} +{"t_unix": 1779813387.5671089, "step_id": 5636, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813387.5854077, "step_id": 5637, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813387.6037796, "step_id": 5638, "start_load_kv_us": 24, "get_finished_us": 182} +{"t_unix": 1779813387.621744, "step_id": 5639, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813387.64016, "step_id": 5640, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813387.6588237, "step_id": 5641, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813387.6779022, "step_id": 5642, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813387.6965175, "step_id": 5643, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813387.715195, "step_id": 5644, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813387.733898, "step_id": 5645, "start_load_kv_us": 4, "get_finished_us": 270} +{"t_unix": 1779813387.7524095, "step_id": 5646, "start_load_kv_us": 5, "get_finished_us": 250} +{"t_unix": 1779813387.7705915, "step_id": 5647, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813387.789757, "step_id": 5648, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813387.8083549, "step_id": 5649, "start_load_kv_us": 5, "get_finished_us": 269} +{"t_unix": 1779813387.8226464, "step_id": 5650, "start_load_kv_us": 5, "get_finished_us": 255} +{"t_unix": 1779813387.8374221, "step_id": 5651, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813387.8525681, "step_id": 5652, "start_load_kv_us": 5, "get_finished_us": 266} +{"t_unix": 1779813387.8678832, "step_id": 5653, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813387.8825166, "step_id": 5654, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813387.9382691, "step_id": 5655, "start_load_kv_us": 123, "get_finished_us": 263} +{"t_unix": 1779813387.9422085, "step_id": 5656, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813388.1509142, "step_id": 5657, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813388.1668284, "step_id": 5658, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813388.1819215, "step_id": 5659, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813388.1972127, "step_id": 5660, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813388.2123811, "step_id": 5661, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813388.227762, "step_id": 5662, "start_load_kv_us": 5, "get_finished_us": 147} +{"t_unix": 1779813388.242954, "step_id": 5663, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813388.2574873, "step_id": 5664, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813388.2734146, "step_id": 5665, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813388.288487, "step_id": 5666, "start_load_kv_us": 6, "get_finished_us": 169} +{"t_unix": 1779813388.3030207, "step_id": 5667, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813388.3191466, "step_id": 5668, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813388.3347318, "step_id": 5669, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813388.3492212, "step_id": 5670, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813388.3641212, "step_id": 5671, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813388.3791265, "step_id": 5672, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813388.394079, "step_id": 5673, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813388.4098215, "step_id": 5674, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813388.4253955, "step_id": 5675, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813388.440773, "step_id": 5676, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813388.4560668, "step_id": 5677, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813388.4713168, "step_id": 5678, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813388.4866507, "step_id": 5679, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813388.5012436, "step_id": 5680, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813388.5171535, "step_id": 5681, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813388.5324068, "step_id": 5682, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813388.5469291, "step_id": 5683, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813388.5625412, "step_id": 5684, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813388.5776985, "step_id": 5685, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813388.592333, "step_id": 5686, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813388.6077778, "step_id": 5687, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813388.6231654, "step_id": 5688, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813388.6387165, "step_id": 5689, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813388.6550558, "step_id": 5690, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813388.7079966, "step_id": 5691, "start_load_kv_us": 132, "get_finished_us": 255} +{"t_unix": 1779813388.71246, "step_id": 5692, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813388.9282708, "step_id": 5693, "start_load_kv_us": 4, "get_finished_us": 297} +{"t_unix": 1779813388.9428365, "step_id": 5694, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813388.9581854, "step_id": 5695, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813388.9733465, "step_id": 5696, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813388.9901237, "step_id": 5697, "start_load_kv_us": 6, "get_finished_us": 265} +{"t_unix": 1779813389.0441597, "step_id": 5698, "start_load_kv_us": 125, "get_finished_us": 351} +{"t_unix": 1779813389.0481117, "step_id": 5699, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813389.2641523, "step_id": 5700, "start_load_kv_us": 5, "get_finished_us": 334} +{"t_unix": 1779813389.27914, "step_id": 5701, "start_load_kv_us": 5, "get_finished_us": 217} +{"t_unix": 1779813389.293924, "step_id": 5702, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813389.309689, "step_id": 5703, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813389.3253443, "step_id": 5704, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813389.340826, "step_id": 5705, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813389.356658, "step_id": 5706, "start_load_kv_us": 18, "get_finished_us": 175} +{"t_unix": 1779813389.3722148, "step_id": 5707, "start_load_kv_us": 17, "get_finished_us": 222} +{"t_unix": 1779813389.3875837, "step_id": 5708, "start_load_kv_us": 7, "get_finished_us": 219} +{"t_unix": 1779813389.403519, "step_id": 5709, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813389.45496, "step_id": 5710, "start_load_kv_us": 120, "get_finished_us": 263} +{"t_unix": 1779813389.4594178, "step_id": 5711, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813389.7092087, "step_id": 5712, "start_load_kv_us": 131, "get_finished_us": 328} +{"t_unix": 1779813389.7141786, "step_id": 5713, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813389.929348, "step_id": 5714, "start_load_kv_us": 7, "get_finished_us": 324} +{"t_unix": 1779813389.9467278, "step_id": 5715, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813389.9658756, "step_id": 5716, "start_load_kv_us": 5, "get_finished_us": 299} +{"t_unix": 1779813389.9838004, "step_id": 5717, "start_load_kv_us": 5, "get_finished_us": 282} +{"t_unix": 1779813390.0019085, "step_id": 5718, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813390.019023, "step_id": 5719, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813390.0373538, "step_id": 5720, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813390.0559413, "step_id": 5721, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813390.0747263, "step_id": 5722, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813390.0885763, "step_id": 5723, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813390.1026065, "step_id": 5724, "start_load_kv_us": 6, "get_finished_us": 181} +{"t_unix": 1779813390.1169863, "step_id": 5725, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813390.1315556, "step_id": 5726, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813390.1461413, "step_id": 5727, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813390.1600401, "step_id": 5728, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813390.1754518, "step_id": 5729, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813390.190305, "step_id": 5730, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813390.2041943, "step_id": 5731, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813390.2188895, "step_id": 5732, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813390.233687, "step_id": 5733, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813390.2475667, "step_id": 5734, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813390.2617145, "step_id": 5735, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813390.2756255, "step_id": 5736, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813390.2895746, "step_id": 5737, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813390.3044257, "step_id": 5738, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813390.3187587, "step_id": 5739, "start_load_kv_us": 5, "get_finished_us": 141} +{"t_unix": 1779813390.3336382, "step_id": 5740, "start_load_kv_us": 19, "get_finished_us": 156} +{"t_unix": 1779813390.3482187, "step_id": 5741, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813390.3629608, "step_id": 5742, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813390.377454, "step_id": 5743, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813390.3916483, "step_id": 5744, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813390.4071772, "step_id": 5745, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813390.4218335, "step_id": 5746, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813390.4359262, "step_id": 5747, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813390.4511688, "step_id": 5748, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813390.4660897, "step_id": 5749, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813390.4806519, "step_id": 5750, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813390.4944503, "step_id": 5751, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813390.5471623, "step_id": 5752, "start_load_kv_us": 134, "get_finished_us": 246} +{"t_unix": 1779813390.5510678, "step_id": 5753, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813390.7656693, "step_id": 5754, "start_load_kv_us": 4, "get_finished_us": 315} +{"t_unix": 1779813390.7839916, "step_id": 5755, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813390.8028066, "step_id": 5756, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813390.8217134, "step_id": 5757, "start_load_kv_us": 4, "get_finished_us": 319} +{"t_unix": 1779813390.8399367, "step_id": 5758, "start_load_kv_us": 3, "get_finished_us": 250} +{"t_unix": 1779813390.8580797, "step_id": 5759, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813390.8758032, "step_id": 5760, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813390.8948205, "step_id": 5761, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813390.913361, "step_id": 5762, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813390.931121, "step_id": 5763, "start_load_kv_us": 2, "get_finished_us": 345} +{"t_unix": 1779813390.9893918, "step_id": 5764, "start_load_kv_us": 138, "get_finished_us": 353} +{"t_unix": 1779813390.9948, "step_id": 5765, "start_load_kv_us": 7, "get_finished_us": 227} +{"t_unix": 1779813391.2618978, "step_id": 5766, "start_load_kv_us": 270, "get_finished_us": 355} +{"t_unix": 1779813391.2662733, "step_id": 5767, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813391.7189739, "step_id": 5768, "start_load_kv_us": 139, "get_finished_us": 360} +{"t_unix": 1779813391.7233713, "step_id": 5769, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813391.9448574, "step_id": 5770, "start_load_kv_us": 6, "get_finished_us": 322} +{"t_unix": 1779813391.9647565, "step_id": 5771, "start_load_kv_us": 5, "get_finished_us": 268} +{"t_unix": 1779813391.9853592, "step_id": 5772, "start_load_kv_us": 7, "get_finished_us": 264} +{"t_unix": 1779813392.005637, "step_id": 5773, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813392.0263004, "step_id": 5774, "start_load_kv_us": 5, "get_finished_us": 253} +{"t_unix": 1779813392.0463512, "step_id": 5775, "start_load_kv_us": 5, "get_finished_us": 195} +{"t_unix": 1779813392.0623448, "step_id": 5776, "start_load_kv_us": 1, "get_finished_us": 218} +{"t_unix": 1779813392.0791233, "step_id": 5777, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813392.095877, "step_id": 5778, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813392.1118305, "step_id": 5779, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813392.1296263, "step_id": 5780, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813392.146097, "step_id": 5781, "start_load_kv_us": 7, "get_finished_us": 179} +{"t_unix": 1779813392.162588, "step_id": 5782, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813392.1786208, "step_id": 5783, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813392.1952994, "step_id": 5784, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813392.2126672, "step_id": 5785, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813392.2295008, "step_id": 5786, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813392.248391, "step_id": 5787, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813392.2673874, "step_id": 5788, "start_load_kv_us": 6, "get_finished_us": 245} +{"t_unix": 1779813392.2857172, "step_id": 5789, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813392.3040516, "step_id": 5790, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813392.3226793, "step_id": 5791, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813392.3407466, "step_id": 5792, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813392.3606064, "step_id": 5793, "start_load_kv_us": 6, "get_finished_us": 290} +{"t_unix": 1779813392.3792112, "step_id": 5794, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813392.3973596, "step_id": 5795, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813392.4162176, "step_id": 5796, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813392.4347184, "step_id": 5797, "start_load_kv_us": 6, "get_finished_us": 199} +{"t_unix": 1779813392.4533677, "step_id": 5798, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813392.4712129, "step_id": 5799, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813392.4905086, "step_id": 5800, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813392.5094578, "step_id": 5801, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813392.5240386, "step_id": 5802, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813392.539739, "step_id": 5803, "start_load_kv_us": 19, "get_finished_us": 249} +{"t_unix": 1779813392.5546954, "step_id": 5804, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813392.5697381, "step_id": 5805, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813392.584014, "step_id": 5806, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813392.598967, "step_id": 5807, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813392.6130974, "step_id": 5808, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813392.6279109, "step_id": 5809, "start_load_kv_us": 6, "get_finished_us": 214} +{"t_unix": 1779813392.642776, "step_id": 5810, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813392.6570785, "step_id": 5811, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813392.6724653, "step_id": 5812, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813392.6870637, "step_id": 5813, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813392.7016032, "step_id": 5814, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813392.7153535, "step_id": 5815, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813392.730492, "step_id": 5816, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813392.7454815, "step_id": 5817, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813392.7601833, "step_id": 5818, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813392.7757738, "step_id": 5819, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813392.7915876, "step_id": 5820, "start_load_kv_us": 6, "get_finished_us": 294} +{"t_unix": 1779813392.806375, "step_id": 5821, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813392.8214016, "step_id": 5822, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813392.8365033, "step_id": 5823, "start_load_kv_us": 6, "get_finished_us": 200} +{"t_unix": 1779813392.851196, "step_id": 5824, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813392.8672183, "step_id": 5825, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813392.8822386, "step_id": 5826, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813392.8962932, "step_id": 5827, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813392.9119337, "step_id": 5828, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813392.927044, "step_id": 5829, "start_load_kv_us": 6, "get_finished_us": 188} +{"t_unix": 1779813392.9417727, "step_id": 5830, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813392.956474, "step_id": 5831, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813392.9718814, "step_id": 5832, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813392.9871173, "step_id": 5833, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813393.0020485, "step_id": 5834, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813393.0180044, "step_id": 5835, "start_load_kv_us": 4, "get_finished_us": 324} +{"t_unix": 1779813393.032866, "step_id": 5836, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813393.0481236, "step_id": 5837, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813393.0634131, "step_id": 5838, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813393.078038, "step_id": 5839, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813393.0921528, "step_id": 5840, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813393.10777, "step_id": 5841, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813393.122803, "step_id": 5842, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813393.1383233, "step_id": 5843, "start_load_kv_us": 2, "get_finished_us": 1037} +{"t_unix": 1779813393.1921072, "step_id": 5844, "start_load_kv_us": 156, "get_finished_us": 230} +{"t_unix": 1779813393.1966898, "step_id": 5845, "start_load_kv_us": 6, "get_finished_us": 171} +{"t_unix": 1779813393.4097788, "step_id": 5846, "start_load_kv_us": 5, "get_finished_us": 373} +{"t_unix": 1779813393.4236712, "step_id": 5847, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813393.4386013, "step_id": 5848, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813393.4533637, "step_id": 5849, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813393.4676065, "step_id": 5850, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813393.4828928, "step_id": 5851, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813393.4983191, "step_id": 5852, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813393.512527, "step_id": 5853, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813393.5265164, "step_id": 5854, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813393.5415363, "step_id": 5855, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813393.5550165, "step_id": 5856, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813393.5702422, "step_id": 5857, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813393.5843663, "step_id": 5858, "start_load_kv_us": 6, "get_finished_us": 223} +{"t_unix": 1779813393.5982203, "step_id": 5859, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813393.6132312, "step_id": 5860, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813393.6275077, "step_id": 5861, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813393.6417475, "step_id": 5862, "start_load_kv_us": 5, "get_finished_us": 248} +{"t_unix": 1779813393.6550887, "step_id": 5863, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813393.669106, "step_id": 5864, "start_load_kv_us": 1, "get_finished_us": 239} +{"t_unix": 1779813393.6825793, "step_id": 5865, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813393.6959393, "step_id": 5866, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813393.7100632, "step_id": 5867, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813393.7235694, "step_id": 5868, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813393.7369783, "step_id": 5869, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813393.751193, "step_id": 5870, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813393.7661402, "step_id": 5871, "start_load_kv_us": 5, "get_finished_us": 243} +{"t_unix": 1779813393.779921, "step_id": 5872, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813393.794472, "step_id": 5873, "start_load_kv_us": 5, "get_finished_us": 318} +{"t_unix": 1779813393.8082964, "step_id": 5874, "start_load_kv_us": 5, "get_finished_us": 285} +{"t_unix": 1779813393.8219988, "step_id": 5875, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813393.8363824, "step_id": 5876, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813393.8502107, "step_id": 5877, "start_load_kv_us": 7, "get_finished_us": 223} +{"t_unix": 1779813393.864371, "step_id": 5878, "start_load_kv_us": 7, "get_finished_us": 250} +{"t_unix": 1779813393.8777025, "step_id": 5879, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813393.8924835, "step_id": 5880, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813393.9433377, "step_id": 5881, "start_load_kv_us": 125, "get_finished_us": 214} +{"t_unix": 1779813393.9472735, "step_id": 5882, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813394.160498, "step_id": 5883, "start_load_kv_us": 5, "get_finished_us": 320} +{"t_unix": 1779813394.1746979, "step_id": 5884, "start_load_kv_us": 5, "get_finished_us": 267} +{"t_unix": 1779813394.1874769, "step_id": 5885, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813394.2010179, "step_id": 5886, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813394.2152915, "step_id": 5887, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813394.2281017, "step_id": 5888, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813394.2421963, "step_id": 5889, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813394.2560637, "step_id": 5890, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813394.269403, "step_id": 5891, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813394.2840264, "step_id": 5892, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813394.2979262, "step_id": 5893, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813394.3122146, "step_id": 5894, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813394.3250327, "step_id": 5895, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813394.3387613, "step_id": 5896, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813394.3523571, "step_id": 5897, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813394.366167, "step_id": 5898, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813394.38013, "step_id": 5899, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813394.393504, "step_id": 5900, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813394.4069767, "step_id": 5901, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813394.42097, "step_id": 5902, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813394.435344, "step_id": 5903, "start_load_kv_us": 5, "get_finished_us": 256} +{"t_unix": 1779813394.4487522, "step_id": 5904, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813394.4638743, "step_id": 5905, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813394.4781172, "step_id": 5906, "start_load_kv_us": 5, "get_finished_us": 321} +{"t_unix": 1779813394.4914203, "step_id": 5907, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813394.5058162, "step_id": 5908, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813394.5197043, "step_id": 5909, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813394.5338733, "step_id": 5910, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813394.5484195, "step_id": 5911, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813394.6000917, "step_id": 5912, "start_load_kv_us": 132, "get_finished_us": 282} +{"t_unix": 1779813394.6039524, "step_id": 5913, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813394.815832, "step_id": 5914, "start_load_kv_us": 3, "get_finished_us": 335} +{"t_unix": 1779813394.8306596, "step_id": 5915, "start_load_kv_us": 5, "get_finished_us": 258} +{"t_unix": 1779813394.8451402, "step_id": 5916, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813394.8590083, "step_id": 5917, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813394.873494, "step_id": 5918, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813394.8883598, "step_id": 5919, "start_load_kv_us": 5, "get_finished_us": 249} +{"t_unix": 1779813394.9024131, "step_id": 5920, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813394.9167213, "step_id": 5921, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813394.930666, "step_id": 5922, "start_load_kv_us": 5, "get_finished_us": 243} +{"t_unix": 1779813394.9439316, "step_id": 5923, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813394.9589024, "step_id": 5924, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813394.973322, "step_id": 5925, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813394.987922, "step_id": 5926, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813395.0016098, "step_id": 5927, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813395.0157368, "step_id": 5928, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813395.0294745, "step_id": 5929, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813395.0430298, "step_id": 5930, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813395.0574615, "step_id": 5931, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813395.07104, "step_id": 5932, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813395.0851114, "step_id": 5933, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813395.0997977, "step_id": 5934, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813395.1148515, "step_id": 5935, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813395.1292183, "step_id": 5936, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813395.1432369, "step_id": 5937, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813395.157149, "step_id": 5938, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813395.1700904, "step_id": 5939, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813395.1845448, "step_id": 5940, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813395.1987123, "step_id": 5941, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813395.2128935, "step_id": 5942, "start_load_kv_us": 5, "get_finished_us": 311} +{"t_unix": 1779813395.2264447, "step_id": 5943, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813395.240237, "step_id": 5944, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813395.2538393, "step_id": 5945, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813395.26836, "step_id": 5946, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813395.2835715, "step_id": 5947, "start_load_kv_us": 4, "get_finished_us": 344} +{"t_unix": 1779813395.2975774, "step_id": 5948, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813395.3109255, "step_id": 5949, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813395.3254645, "step_id": 5950, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813395.340178, "step_id": 5951, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813395.3547103, "step_id": 5952, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813395.369454, "step_id": 5953, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813395.3841333, "step_id": 5954, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813395.3982728, "step_id": 5955, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813395.4124095, "step_id": 5956, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813395.4266138, "step_id": 5957, "start_load_kv_us": 5, "get_finished_us": 297} +{"t_unix": 1779813395.44105, "step_id": 5958, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813395.4546313, "step_id": 5959, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813395.4688776, "step_id": 5960, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813395.4831524, "step_id": 5961, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813395.4976752, "step_id": 5962, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813395.5155938, "step_id": 5963, "start_load_kv_us": 5, "get_finished_us": 330} +{"t_unix": 1779813395.5271654, "step_id": 5964, "start_load_kv_us": 4, "get_finished_us": 298} +{"t_unix": 1779813395.5407808, "step_id": 5965, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813395.5554576, "step_id": 5966, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813395.5705411, "step_id": 5967, "start_load_kv_us": 4, "get_finished_us": 284} +{"t_unix": 1779813395.5826313, "step_id": 5968, "start_load_kv_us": 4, "get_finished_us": 294} +{"t_unix": 1779813395.5949888, "step_id": 5969, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813395.606984, "step_id": 5970, "start_load_kv_us": 4, "get_finished_us": 268} +{"t_unix": 1779813395.6181803, "step_id": 5971, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813395.6307745, "step_id": 5972, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813395.642526, "step_id": 5973, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813395.6533084, "step_id": 5974, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813395.6640685, "step_id": 5975, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813395.6759005, "step_id": 5976, "start_load_kv_us": 1, "get_finished_us": 205} +{"t_unix": 1779813395.6875648, "step_id": 5977, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813395.6996462, "step_id": 5978, "start_load_kv_us": 1, "get_finished_us": 284} +{"t_unix": 1779813395.711999, "step_id": 5979, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813395.7238495, "step_id": 5980, "start_load_kv_us": 2, "get_finished_us": 379} +{"t_unix": 1779813395.734769, "step_id": 5981, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813395.7462342, "step_id": 5982, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813395.7585056, "step_id": 5983, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813395.77018, "step_id": 5984, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813395.782092, "step_id": 5985, "start_load_kv_us": 5, "get_finished_us": 248} +{"t_unix": 1779813395.7937224, "step_id": 5986, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813395.8053014, "step_id": 5987, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813395.8180692, "step_id": 5988, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813395.8299406, "step_id": 5989, "start_load_kv_us": 6, "get_finished_us": 265} +{"t_unix": 1779813395.840652, "step_id": 5990, "start_load_kv_us": 1, "get_finished_us": 295} +{"t_unix": 1779813395.8522565, "step_id": 5991, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813395.8634202, "step_id": 5992, "start_load_kv_us": 1, "get_finished_us": 240} +{"t_unix": 1779813395.8744216, "step_id": 5993, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813395.886094, "step_id": 5994, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813395.8979385, "step_id": 5995, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813395.9085288, "step_id": 5996, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813395.9196408, "step_id": 5997, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813395.9310768, "step_id": 5998, "start_load_kv_us": 1, "get_finished_us": 222} +{"t_unix": 1779813395.9433496, "step_id": 5999, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813395.9548354, "step_id": 6000, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813395.966626, "step_id": 6001, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813395.978278, "step_id": 6002, "start_load_kv_us": 4, "get_finished_us": 313} +{"t_unix": 1779813395.989179, "step_id": 6003, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813396.001306, "step_id": 6004, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813396.012471, "step_id": 6005, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813396.0232987, "step_id": 6006, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813396.035034, "step_id": 6007, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813396.0470147, "step_id": 6008, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813396.058117, "step_id": 6009, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813396.069307, "step_id": 6010, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813396.0816157, "step_id": 6011, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813396.0928023, "step_id": 6012, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813396.1040578, "step_id": 6013, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813396.1158059, "step_id": 6014, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813396.1282372, "step_id": 6015, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813396.140128, "step_id": 6016, "start_load_kv_us": 4, "get_finished_us": 302} +{"t_unix": 1779813396.1521113, "step_id": 6017, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813396.1641617, "step_id": 6018, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813396.1749685, "step_id": 6019, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813396.1875975, "step_id": 6020, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813396.1987062, "step_id": 6021, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813396.208363, "step_id": 6022, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813396.2178168, "step_id": 6023, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813396.22632, "step_id": 6024, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813396.2345908, "step_id": 6025, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813396.2421048, "step_id": 6026, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813396.2502606, "step_id": 6027, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813396.2572207, "step_id": 6028, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813396.2644825, "step_id": 6029, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813396.2718408, "step_id": 6030, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813396.2794259, "step_id": 6031, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813396.2877622, "step_id": 6032, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813396.2946458, "step_id": 6033, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813396.302731, "step_id": 6034, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813396.3098772, "step_id": 6035, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813396.3176699, "step_id": 6036, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813396.325323, "step_id": 6037, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813396.3328454, "step_id": 6038, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813396.340463, "step_id": 6039, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813396.3481514, "step_id": 6040, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813396.3559391, "step_id": 6041, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813396.4040036, "step_id": 6042, "start_load_kv_us": 138, "get_finished_us": 320} +{"t_unix": 1779813396.5900564, "step_id": 6043, "start_load_kv_us": 145, "get_finished_us": 365} +{"t_unix": 1779813396.60119, "step_id": 6044, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813396.8360317, "step_id": 6045, "start_load_kv_us": 5, "get_finished_us": 298} +{"t_unix": 1779813396.8447416, "step_id": 6046, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813396.8544104, "step_id": 6047, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813396.864644, "step_id": 6048, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813396.8738184, "step_id": 6049, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813396.8842616, "step_id": 6050, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813396.8929632, "step_id": 6051, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813396.9021692, "step_id": 6052, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813396.9111683, "step_id": 6053, "start_load_kv_us": 13, "get_finished_us": 181} +{"t_unix": 1779813396.920461, "step_id": 6054, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813396.930028, "step_id": 6055, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813396.939465, "step_id": 6056, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813396.9490783, "step_id": 6057, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813396.959522, "step_id": 6058, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813396.9686995, "step_id": 6059, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813396.9770777, "step_id": 6060, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813396.986828, "step_id": 6061, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813396.996196, "step_id": 6062, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813397.042569, "step_id": 6063, "start_load_kv_us": 145, "get_finished_us": 241} +{"t_unix": 1779813397.0469196, "step_id": 6064, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813397.289207, "step_id": 6065, "start_load_kv_us": 136, "get_finished_us": 281} +{"t_unix": 1779813397.2935119, "step_id": 6066, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813397.5278132, "step_id": 6067, "start_load_kv_us": 122, "get_finished_us": 302} +{"t_unix": 1779813397.5322576, "step_id": 6068, "start_load_kv_us": 19, "get_finished_us": 259} +{"t_unix": 1779813397.7768338, "step_id": 6069, "start_load_kv_us": 127, "get_finished_us": 335} +{"t_unix": 1779813397.780661, "step_id": 6070, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813398.0260603, "step_id": 6071, "start_load_kv_us": 140, "get_finished_us": 368} +{"t_unix": 1779813398.0303211, "step_id": 6072, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813398.2359254, "step_id": 6073, "start_load_kv_us": 2, "get_finished_us": 329} +{"t_unix": 1779813398.2487261, "step_id": 6074, "start_load_kv_us": 4, "get_finished_us": 252} +{"t_unix": 1779813398.2612193, "step_id": 6075, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813398.2739315, "step_id": 6076, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813398.2870183, "step_id": 6077, "start_load_kv_us": 5, "get_finished_us": 247} +{"t_unix": 1779813398.2995586, "step_id": 6078, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813398.312428, "step_id": 6079, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813398.3258572, "step_id": 6080, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813398.338661, "step_id": 6081, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813398.3519957, "step_id": 6082, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813398.3647487, "step_id": 6083, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813398.3785317, "step_id": 6084, "start_load_kv_us": 4, "get_finished_us": 304} +{"t_unix": 1779813398.3914602, "step_id": 6085, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813398.4048069, "step_id": 6086, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813398.4175332, "step_id": 6087, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813398.4305816, "step_id": 6088, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813398.4430776, "step_id": 6089, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813398.4564621, "step_id": 6090, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813398.469337, "step_id": 6091, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813398.4825943, "step_id": 6092, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813398.4957252, "step_id": 6093, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813398.508196, "step_id": 6094, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813398.5215204, "step_id": 6095, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813398.5353878, "step_id": 6096, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813398.5490987, "step_id": 6097, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813398.5626621, "step_id": 6098, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813398.5751216, "step_id": 6099, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813398.589508, "step_id": 6100, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813398.6014612, "step_id": 6101, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813398.612471, "step_id": 6102, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813398.6234086, "step_id": 6103, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813398.634508, "step_id": 6104, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813398.6458154, "step_id": 6105, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813398.6572027, "step_id": 6106, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813398.668568, "step_id": 6107, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813398.6800232, "step_id": 6108, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813398.6912215, "step_id": 6109, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813398.702024, "step_id": 6110, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813398.7135878, "step_id": 6111, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813398.7255988, "step_id": 6112, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813398.737011, "step_id": 6113, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813398.7487645, "step_id": 6114, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813398.7599185, "step_id": 6115, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813398.771954, "step_id": 6116, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813398.7831185, "step_id": 6117, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813398.7951732, "step_id": 6118, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813398.8069043, "step_id": 6119, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813398.81884, "step_id": 6120, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813398.8305576, "step_id": 6121, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813398.84262, "step_id": 6122, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813398.8534863, "step_id": 6123, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813398.8649676, "step_id": 6124, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813398.8765037, "step_id": 6125, "start_load_kv_us": 6, "get_finished_us": 208} +{"t_unix": 1779813398.88741, "step_id": 6126, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813398.8984108, "step_id": 6127, "start_load_kv_us": 1, "get_finished_us": 232} +{"t_unix": 1779813398.9105997, "step_id": 6128, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813398.9219344, "step_id": 6129, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813398.9333618, "step_id": 6130, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813398.9441383, "step_id": 6131, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813398.9572783, "step_id": 6132, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813398.9675663, "step_id": 6133, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813398.979263, "step_id": 6134, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813398.9906874, "step_id": 6135, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813399.001935, "step_id": 6136, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813399.013676, "step_id": 6137, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813399.025486, "step_id": 6138, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813399.035727, "step_id": 6139, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813399.0474675, "step_id": 6140, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813399.05957, "step_id": 6141, "start_load_kv_us": 6, "get_finished_us": 200} +{"t_unix": 1779813399.069623, "step_id": 6142, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813399.080835, "step_id": 6143, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813399.0929663, "step_id": 6144, "start_load_kv_us": 9, "get_finished_us": 168} +{"t_unix": 1779813399.1041517, "step_id": 6145, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813399.1153321, "step_id": 6146, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813399.1260524, "step_id": 6147, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813399.138011, "step_id": 6148, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813399.148649, "step_id": 6149, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813399.1597579, "step_id": 6150, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813399.1744466, "step_id": 6151, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813399.182036, "step_id": 6152, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813399.1930935, "step_id": 6153, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813399.2046676, "step_id": 6154, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813399.214886, "step_id": 6155, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813399.2267416, "step_id": 6156, "start_load_kv_us": 10, "get_finished_us": 221} +{"t_unix": 1779813399.2381916, "step_id": 6157, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813399.2488632, "step_id": 6158, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813399.260465, "step_id": 6159, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813399.2722938, "step_id": 6160, "start_load_kv_us": 3, "get_finished_us": 153} +{"t_unix": 1779813399.2835977, "step_id": 6161, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813399.2946968, "step_id": 6162, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813399.3055048, "step_id": 6163, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813399.3179367, "step_id": 6164, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813399.328745, "step_id": 6165, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813399.3401186, "step_id": 6166, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813399.35123, "step_id": 6167, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813399.3620548, "step_id": 6168, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813399.3729677, "step_id": 6169, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813399.385333, "step_id": 6170, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813399.3967106, "step_id": 6171, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813399.4093206, "step_id": 6172, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813399.4212232, "step_id": 6173, "start_load_kv_us": 22, "get_finished_us": 212} +{"t_unix": 1779813399.431869, "step_id": 6174, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813399.481412, "step_id": 6175, "start_load_kv_us": 153, "get_finished_us": 264} +{"t_unix": 1779813399.4852083, "step_id": 6176, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813399.6928082, "step_id": 6177, "start_load_kv_us": 5, "get_finished_us": 289} +{"t_unix": 1779813399.7042272, "step_id": 6178, "start_load_kv_us": 4, "get_finished_us": 286} +{"t_unix": 1779813399.7141778, "step_id": 6179, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813399.7254622, "step_id": 6180, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813399.7361715, "step_id": 6181, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813399.7467597, "step_id": 6182, "start_load_kv_us": 14, "get_finished_us": 164} +{"t_unix": 1779813399.7577524, "step_id": 6183, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813399.768652, "step_id": 6184, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813399.7793148, "step_id": 6185, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813399.7907062, "step_id": 6186, "start_load_kv_us": 5, "get_finished_us": 287} +{"t_unix": 1779813399.802145, "step_id": 6187, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813399.8134751, "step_id": 6188, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813399.8245924, "step_id": 6189, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813399.8353498, "step_id": 6190, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813399.846905, "step_id": 6191, "start_load_kv_us": 1, "get_finished_us": 218} +{"t_unix": 1779813399.857654, "step_id": 6192, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813399.8697307, "step_id": 6193, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813399.8813596, "step_id": 6194, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813399.8916235, "step_id": 6195, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813399.9036384, "step_id": 6196, "start_load_kv_us": 4, "get_finished_us": 288} +{"t_unix": 1779813399.9147716, "step_id": 6197, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813399.9264836, "step_id": 6198, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813399.9384053, "step_id": 6199, "start_load_kv_us": 1, "get_finished_us": 215} +{"t_unix": 1779813399.949877, "step_id": 6200, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813399.9613483, "step_id": 6201, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813399.9732835, "step_id": 6202, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813399.9850526, "step_id": 6203, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813399.9968312, "step_id": 6204, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813400.0086718, "step_id": 6205, "start_load_kv_us": 18, "get_finished_us": 188} +{"t_unix": 1779813400.0231159, "step_id": 6206, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813400.0320873, "step_id": 6207, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813400.0440643, "step_id": 6208, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813400.0564642, "step_id": 6209, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813400.0684955, "step_id": 6210, "start_load_kv_us": 5, "get_finished_us": 233} +{"t_unix": 1779813400.07967, "step_id": 6211, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813400.0923707, "step_id": 6212, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813400.1036892, "step_id": 6213, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813400.1157084, "step_id": 6214, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813400.1276956, "step_id": 6215, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813400.1399047, "step_id": 6216, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813400.1518881, "step_id": 6217, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813400.16451, "step_id": 6218, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813400.1763492, "step_id": 6219, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813400.1881943, "step_id": 6220, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813400.2000546, "step_id": 6221, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813400.211424, "step_id": 6222, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813400.223044, "step_id": 6223, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813400.2347813, "step_id": 6224, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813400.2471886, "step_id": 6225, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813400.2589605, "step_id": 6226, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813400.2701762, "step_id": 6227, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813400.281766, "step_id": 6228, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813400.2921536, "step_id": 6229, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813400.3045275, "step_id": 6230, "start_load_kv_us": 1, "get_finished_us": 219} +{"t_unix": 1779813400.354393, "step_id": 6231, "start_load_kv_us": 165, "get_finished_us": 268} +{"t_unix": 1779813400.35834, "step_id": 6232, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813400.564535, "step_id": 6233, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813400.5765617, "step_id": 6234, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813400.588344, "step_id": 6235, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813400.600136, "step_id": 6236, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813400.6117752, "step_id": 6237, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813400.6230083, "step_id": 6238, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813400.6350186, "step_id": 6239, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813400.647015, "step_id": 6240, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813400.6599393, "step_id": 6241, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813400.6724792, "step_id": 6242, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813400.6839538, "step_id": 6243, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813400.6966445, "step_id": 6244, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813400.7077627, "step_id": 6245, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813400.7196014, "step_id": 6246, "start_load_kv_us": 1, "get_finished_us": 211} +{"t_unix": 1779813400.7312763, "step_id": 6247, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813400.7434084, "step_id": 6248, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813400.755592, "step_id": 6249, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813400.7681155, "step_id": 6250, "start_load_kv_us": 4, "get_finished_us": 278} +{"t_unix": 1779813400.780348, "step_id": 6251, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813400.792393, "step_id": 6252, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813400.8041956, "step_id": 6253, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813400.815011, "step_id": 6254, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813400.8267345, "step_id": 6255, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813400.8384783, "step_id": 6256, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813400.8511486, "step_id": 6257, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813400.8632834, "step_id": 6258, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813400.8747523, "step_id": 6259, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813400.8871849, "step_id": 6260, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813400.8984184, "step_id": 6261, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813400.9103534, "step_id": 6262, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813400.9225826, "step_id": 6263, "start_load_kv_us": 1, "get_finished_us": 245} +{"t_unix": 1779813400.9342914, "step_id": 6264, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813400.9461255, "step_id": 6265, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813400.9588125, "step_id": 6266, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813400.9710357, "step_id": 6267, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813400.983397, "step_id": 6268, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813400.996134, "step_id": 6269, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813401.0076933, "step_id": 6270, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813401.0198517, "step_id": 6271, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813401.0319963, "step_id": 6272, "start_load_kv_us": 1, "get_finished_us": 281} +{"t_unix": 1779813401.0446854, "step_id": 6273, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813401.0571408, "step_id": 6274, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813401.0686958, "step_id": 6275, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813401.0812674, "step_id": 6276, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813401.0928824, "step_id": 6277, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813401.105135, "step_id": 6278, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813401.1174655, "step_id": 6279, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813401.1294632, "step_id": 6280, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813401.1415973, "step_id": 6281, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813401.1544662, "step_id": 6282, "start_load_kv_us": 4, "get_finished_us": 268} +{"t_unix": 1779813401.1666481, "step_id": 6283, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813401.178563, "step_id": 6284, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813401.1903212, "step_id": 6285, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813401.201494, "step_id": 6286, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813401.2134333, "step_id": 6287, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813401.2250588, "step_id": 6288, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813401.2376678, "step_id": 6289, "start_load_kv_us": 4, "get_finished_us": 247} +{"t_unix": 1779813401.2493036, "step_id": 6290, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813401.2605765, "step_id": 6291, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813401.2801235, "step_id": 6292, "start_load_kv_us": 5, "get_finished_us": 278} +{"t_unix": 1779813401.2844465, "step_id": 6293, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813401.2965007, "step_id": 6294, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813401.3086464, "step_id": 6295, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813401.3210866, "step_id": 6296, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813401.3327923, "step_id": 6297, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813401.3451397, "step_id": 6298, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813401.3583436, "step_id": 6299, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813401.3699777, "step_id": 6300, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813401.3819528, "step_id": 6301, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813401.3931546, "step_id": 6302, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813401.4051335, "step_id": 6303, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813401.4166965, "step_id": 6304, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813401.4293168, "step_id": 6305, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813401.4414217, "step_id": 6306, "start_load_kv_us": 11, "get_finished_us": 230} +{"t_unix": 1779813401.4527621, "step_id": 6307, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813401.465029, "step_id": 6308, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813401.4775145, "step_id": 6309, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813401.4887922, "step_id": 6310, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813401.5009263, "step_id": 6311, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813401.5128922, "step_id": 6312, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813401.5248747, "step_id": 6313, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813401.5370467, "step_id": 6314, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813401.5496855, "step_id": 6315, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813401.5987875, "step_id": 6316, "start_load_kv_us": 145, "get_finished_us": 216} +{"t_unix": 1779813401.6040792, "step_id": 6317, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813401.8518891, "step_id": 6318, "start_load_kv_us": 162, "get_finished_us": 359} +{"t_unix": 1779813402.0495038, "step_id": 6319, "start_load_kv_us": 120, "get_finished_us": 379} +{"t_unix": 1779813402.0622847, "step_id": 6320, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813402.3042011, "step_id": 6321, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813402.3161154, "step_id": 6322, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813402.326567, "step_id": 6323, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813402.3383353, "step_id": 6324, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813402.3490975, "step_id": 6325, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813402.359826, "step_id": 6326, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813402.3687236, "step_id": 6327, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813402.3782327, "step_id": 6328, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813402.3873382, "step_id": 6329, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813402.396259, "step_id": 6330, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813402.4067516, "step_id": 6331, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813402.4157374, "step_id": 6332, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813402.425472, "step_id": 6333, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813402.435301, "step_id": 6334, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813402.4447367, "step_id": 6335, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813402.4544892, "step_id": 6336, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813402.4634142, "step_id": 6337, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813402.4728184, "step_id": 6338, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813402.4823744, "step_id": 6339, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813402.4923587, "step_id": 6340, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813402.5012455, "step_id": 6341, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813402.510763, "step_id": 6342, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813402.5203326, "step_id": 6343, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813402.5304017, "step_id": 6344, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813402.5394099, "step_id": 6345, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813402.5478046, "step_id": 6346, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813402.5576138, "step_id": 6347, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813402.5660179, "step_id": 6348, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813402.575429, "step_id": 6349, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813402.5850172, "step_id": 6350, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813402.5943403, "step_id": 6351, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813402.6043754, "step_id": 6352, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813402.6132498, "step_id": 6353, "start_load_kv_us": 1, "get_finished_us": 246} +{"t_unix": 1779813402.6223466, "step_id": 6354, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813402.6316395, "step_id": 6355, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813402.6415951, "step_id": 6356, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813402.6497676, "step_id": 6357, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813402.6589077, "step_id": 6358, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813402.668396, "step_id": 6359, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813402.6785452, "step_id": 6360, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813402.687688, "step_id": 6361, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813402.6962838, "step_id": 6362, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813402.706491, "step_id": 6363, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813402.7156014, "step_id": 6364, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813402.7248209, "step_id": 6365, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813402.7342296, "step_id": 6366, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813402.7434788, "step_id": 6367, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813402.7536325, "step_id": 6368, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813402.762679, "step_id": 6369, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813402.772696, "step_id": 6370, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813402.7823217, "step_id": 6371, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813402.7923796, "step_id": 6372, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813402.8014235, "step_id": 6373, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813402.810891, "step_id": 6374, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813402.8204224, "step_id": 6375, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813402.8303509, "step_id": 6376, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813402.8401344, "step_id": 6377, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813402.8489087, "step_id": 6378, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813402.8587546, "step_id": 6379, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813402.8683467, "step_id": 6380, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813402.9166, "step_id": 6381, "start_load_kv_us": 148, "get_finished_us": 259} +{"t_unix": 1779813403.1112084, "step_id": 6382, "start_load_kv_us": 128, "get_finished_us": 292} +{"t_unix": 1779813403.3477154, "step_id": 6383, "start_load_kv_us": 245, "get_finished_us": 324} +{"t_unix": 1779813403.3602955, "step_id": 6384, "start_load_kv_us": 5, "get_finished_us": 257} +{"t_unix": 1779813403.808026, "step_id": 6385, "start_load_kv_us": 3, "get_finished_us": 430} +{"t_unix": 1779813403.8173888, "step_id": 6386, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813403.8287086, "step_id": 6387, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813403.8397114, "step_id": 6388, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813403.8492918, "step_id": 6389, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813403.8598878, "step_id": 6390, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813403.869999, "step_id": 6391, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813403.8818047, "step_id": 6392, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813403.89303, "step_id": 6393, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813403.903703, "step_id": 6394, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813403.91514, "step_id": 6395, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813403.9255571, "step_id": 6396, "start_load_kv_us": 1, "get_finished_us": 209} +{"t_unix": 1779813403.937715, "step_id": 6397, "start_load_kv_us": 1, "get_finished_us": 230} +{"t_unix": 1779813403.9488297, "step_id": 6398, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813403.9594705, "step_id": 6399, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813403.9705977, "step_id": 6400, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813403.9803686, "step_id": 6401, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813403.9915621, "step_id": 6402, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813404.002635, "step_id": 6403, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813404.013047, "step_id": 6404, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813404.023287, "step_id": 6405, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813404.0341022, "step_id": 6406, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813404.0452385, "step_id": 6407, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813404.0567436, "step_id": 6408, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813404.06765, "step_id": 6409, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813404.0782456, "step_id": 6410, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813404.0898743, "step_id": 6411, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813404.099961, "step_id": 6412, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813404.1111398, "step_id": 6413, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813404.123344, "step_id": 6414, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813404.134464, "step_id": 6415, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813404.1454544, "step_id": 6416, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813404.156045, "step_id": 6417, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813404.167632, "step_id": 6418, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813404.1800017, "step_id": 6419, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813404.1916106, "step_id": 6420, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813404.2021115, "step_id": 6421, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813404.213323, "step_id": 6422, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813404.224742, "step_id": 6423, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813404.2744913, "step_id": 6424, "start_load_kv_us": 138, "get_finished_us": 225} +{"t_unix": 1779813404.278822, "step_id": 6425, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813404.5261347, "step_id": 6426, "start_load_kv_us": 128, "get_finished_us": 344} +{"t_unix": 1779813404.5309656, "step_id": 6427, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813404.7393625, "step_id": 6428, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813404.7530868, "step_id": 6429, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813404.767171, "step_id": 6430, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813404.8184683, "step_id": 6431, "start_load_kv_us": 136, "get_finished_us": 417} +{"t_unix": 1779813405.025904, "step_id": 6432, "start_load_kv_us": 124, "get_finished_us": 383} +{"t_unix": 1779813405.2643535, "step_id": 6433, "start_load_kv_us": 125, "get_finished_us": 340} +{"t_unix": 1779813405.276269, "step_id": 6434, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813405.5547771, "step_id": 6435, "start_load_kv_us": 131, "get_finished_us": 317} +{"t_unix": 1779813405.5600855, "step_id": 6436, "start_load_kv_us": 7, "get_finished_us": 216} +{"t_unix": 1779813405.7701597, "step_id": 6437, "start_load_kv_us": 3, "get_finished_us": 402} +{"t_unix": 1779813405.7842474, "step_id": 6438, "start_load_kv_us": 5, "get_finished_us": 289} +{"t_unix": 1779813405.7975657, "step_id": 6439, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813405.8121438, "step_id": 6440, "start_load_kv_us": 5, "get_finished_us": 261} +{"t_unix": 1779813405.8262453, "step_id": 6441, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813405.8405728, "step_id": 6442, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813405.8545952, "step_id": 6443, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813405.8679578, "step_id": 6444, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813405.8821435, "step_id": 6445, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813405.8970752, "step_id": 6446, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813405.911705, "step_id": 6447, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813405.9261687, "step_id": 6448, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813405.939807, "step_id": 6449, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813405.9544463, "step_id": 6450, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813405.9693549, "step_id": 6451, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813405.9840553, "step_id": 6452, "start_load_kv_us": 6, "get_finished_us": 226} +{"t_unix": 1779813405.998079, "step_id": 6453, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813406.0130694, "step_id": 6454, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813406.0274634, "step_id": 6455, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813406.042919, "step_id": 6456, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813406.0581322, "step_id": 6457, "start_load_kv_us": 6, "get_finished_us": 292} +{"t_unix": 1779813406.0725224, "step_id": 6458, "start_load_kv_us": 5, "get_finished_us": 233} +{"t_unix": 1779813406.0868602, "step_id": 6459, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813406.1004975, "step_id": 6460, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813406.1149929, "step_id": 6461, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813406.1301174, "step_id": 6462, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813406.144962, "step_id": 6463, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813406.1592522, "step_id": 6464, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813406.1727934, "step_id": 6465, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813406.187475, "step_id": 6466, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813406.2031205, "step_id": 6467, "start_load_kv_us": 6, "get_finished_us": 236} +{"t_unix": 1779813406.2182374, "step_id": 6468, "start_load_kv_us": 6, "get_finished_us": 231} +{"t_unix": 1779813406.2324264, "step_id": 6469, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813406.2478747, "step_id": 6470, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813406.2616765, "step_id": 6471, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813406.2774215, "step_id": 6472, "start_load_kv_us": 5, "get_finished_us": 239} +{"t_unix": 1779813406.2927845, "step_id": 6473, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813406.3079553, "step_id": 6474, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813406.323149, "step_id": 6475, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813406.3377035, "step_id": 6476, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813406.3530269, "step_id": 6477, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813406.3685396, "step_id": 6478, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813406.383337, "step_id": 6479, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813406.4362004, "step_id": 6480, "start_load_kv_us": 132, "get_finished_us": 237} +{"t_unix": 1779813406.440767, "step_id": 6481, "start_load_kv_us": 17, "get_finished_us": 168} +{"t_unix": 1779813406.6534147, "step_id": 6482, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813406.668081, "step_id": 6483, "start_load_kv_us": 6, "get_finished_us": 210} +{"t_unix": 1779813406.7203984, "step_id": 6484, "start_load_kv_us": 147, "get_finished_us": 230} +{"t_unix": 1779813406.7244294, "step_id": 6485, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813406.9793844, "step_id": 6486, "start_load_kv_us": 140, "get_finished_us": 363} +{"t_unix": 1779813407.1758492, "step_id": 6487, "start_load_kv_us": 140, "get_finished_us": 393} +{"t_unix": 1779813407.4159112, "step_id": 6488, "start_load_kv_us": 261, "get_finished_us": 349} +{"t_unix": 1779813407.8614597, "step_id": 6489, "start_load_kv_us": 137, "get_finished_us": 377} +{"t_unix": 1779813408.1108217, "step_id": 6490, "start_load_kv_us": 137, "get_finished_us": 346} +{"t_unix": 1779813408.1236484, "step_id": 6491, "start_load_kv_us": 5, "get_finished_us": 253} +{"t_unix": 1779813408.4031918, "step_id": 6492, "start_load_kv_us": 135, "get_finished_us": 345} +{"t_unix": 1779813408.4083507, "step_id": 6493, "start_load_kv_us": 6, "get_finished_us": 205} +{"t_unix": 1779813408.6286104, "step_id": 6494, "start_load_kv_us": 5, "get_finished_us": 313} +{"t_unix": 1779813408.6479373, "step_id": 6495, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813408.6676939, "step_id": 6496, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813408.687311, "step_id": 6497, "start_load_kv_us": 6, "get_finished_us": 185} +{"t_unix": 1779813408.706334, "step_id": 6498, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813408.7267184, "step_id": 6499, "start_load_kv_us": 6, "get_finished_us": 217} +{"t_unix": 1779813408.745832, "step_id": 6500, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813408.7647774, "step_id": 6501, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813408.7852223, "step_id": 6502, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813408.8043702, "step_id": 6503, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813408.8245125, "step_id": 6504, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813408.844496, "step_id": 6505, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813408.8644085, "step_id": 6506, "start_load_kv_us": 8, "get_finished_us": 168} +{"t_unix": 1779813408.8841243, "step_id": 6507, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813408.9031966, "step_id": 6508, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813408.9230244, "step_id": 6509, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813408.9425704, "step_id": 6510, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813408.9623365, "step_id": 6511, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813408.9819748, "step_id": 6512, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813409.001676, "step_id": 6513, "start_load_kv_us": 6, "get_finished_us": 181} +{"t_unix": 1779813409.0204568, "step_id": 6514, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813409.0410087, "step_id": 6515, "start_load_kv_us": 7, "get_finished_us": 196} +{"t_unix": 1779813409.0655653, "step_id": 6516, "start_load_kv_us": 5, "get_finished_us": 245} +{"t_unix": 1779813409.0803835, "step_id": 6517, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813409.101099, "step_id": 6518, "start_load_kv_us": 6, "get_finished_us": 218} +{"t_unix": 1779813409.1201298, "step_id": 6519, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813409.1405883, "step_id": 6520, "start_load_kv_us": 3, "get_finished_us": 218} +{"t_unix": 1779813409.1604319, "step_id": 6521, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813409.1802003, "step_id": 6522, "start_load_kv_us": 7, "get_finished_us": 168} +{"t_unix": 1779813409.1998239, "step_id": 6523, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813409.218605, "step_id": 6524, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813409.2389557, "step_id": 6525, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813409.2588997, "step_id": 6526, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813409.2786403, "step_id": 6527, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813409.298631, "step_id": 6528, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813409.3188853, "step_id": 6529, "start_load_kv_us": 6, "get_finished_us": 169} +{"t_unix": 1779813409.338327, "step_id": 6530, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813409.3586898, "step_id": 6531, "start_load_kv_us": 7, "get_finished_us": 208} +{"t_unix": 1779813409.3788466, "step_id": 6532, "start_load_kv_us": 5, "get_finished_us": 275} +{"t_unix": 1779813409.3977807, "step_id": 6533, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813409.4179387, "step_id": 6534, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813409.4371471, "step_id": 6535, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813409.45761, "step_id": 6536, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813409.4773293, "step_id": 6537, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813409.4973419, "step_id": 6538, "start_load_kv_us": 7, "get_finished_us": 198} +{"t_unix": 1779813409.5167434, "step_id": 6539, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813409.5356843, "step_id": 6540, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813409.5562847, "step_id": 6541, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813409.5766277, "step_id": 6542, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813409.5964544, "step_id": 6543, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813409.6166573, "step_id": 6544, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813409.6369185, "step_id": 6545, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813409.6569047, "step_id": 6546, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813409.678145, "step_id": 6547, "start_load_kv_us": 6, "get_finished_us": 231} +{"t_unix": 1779813409.6979735, "step_id": 6548, "start_load_kv_us": 6, "get_finished_us": 238} +{"t_unix": 1779813409.7175899, "step_id": 6549, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813409.7387905, "step_id": 6550, "start_load_kv_us": 5, "get_finished_us": 311} +{"t_unix": 1779813409.7630699, "step_id": 6551, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813409.7788782, "step_id": 6552, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813409.7989767, "step_id": 6553, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813409.8192418, "step_id": 6554, "start_load_kv_us": 8, "get_finished_us": 204} +{"t_unix": 1779813409.8391526, "step_id": 6555, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813409.8587935, "step_id": 6556, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813409.8795316, "step_id": 6557, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813409.8998663, "step_id": 6558, "start_load_kv_us": 5, "get_finished_us": 141} +{"t_unix": 1779813409.9201803, "step_id": 6559, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813409.9403164, "step_id": 6560, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813409.960504, "step_id": 6561, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813409.9801433, "step_id": 6562, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813410.0013266, "step_id": 6563, "start_load_kv_us": 6, "get_finished_us": 195} +{"t_unix": 1779813410.0221, "step_id": 6564, "start_load_kv_us": 6, "get_finished_us": 185} +{"t_unix": 1779813410.0420902, "step_id": 6565, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813410.0634995, "step_id": 6566, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813410.083271, "step_id": 6567, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813410.1042986, "step_id": 6568, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813410.1250105, "step_id": 6569, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813410.1459625, "step_id": 6570, "start_load_kv_us": 8, "get_finished_us": 288} +{"t_unix": 1779813410.1664088, "step_id": 6571, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813410.1870568, "step_id": 6572, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813410.208277, "step_id": 6573, "start_load_kv_us": 5, "get_finished_us": 285} +{"t_unix": 1779813410.2295067, "step_id": 6574, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813410.2505593, "step_id": 6575, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813410.2709572, "step_id": 6576, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813410.2890015, "step_id": 6577, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813410.3060966, "step_id": 6578, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813410.3241727, "step_id": 6579, "start_load_kv_us": 7, "get_finished_us": 251} +{"t_unix": 1779813410.3415446, "step_id": 6580, "start_load_kv_us": 6, "get_finished_us": 268} +{"t_unix": 1779813410.3580348, "step_id": 6581, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813410.3760402, "step_id": 6582, "start_load_kv_us": 6, "get_finished_us": 192} +{"t_unix": 1779813410.392756, "step_id": 6583, "start_load_kv_us": 3, "get_finished_us": 212} +{"t_unix": 1779813410.4103613, "step_id": 6584, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813410.4279392, "step_id": 6585, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813410.4462996, "step_id": 6586, "start_load_kv_us": 7, "get_finished_us": 202} +{"t_unix": 1779813410.463517, "step_id": 6587, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813410.4805422, "step_id": 6588, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813410.4986465, "step_id": 6589, "start_load_kv_us": 5, "get_finished_us": 255} +{"t_unix": 1779813410.516048, "step_id": 6590, "start_load_kv_us": 4, "get_finished_us": 252} +{"t_unix": 1779813410.5333846, "step_id": 6591, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813410.5496845, "step_id": 6592, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813410.5674305, "step_id": 6593, "start_load_kv_us": 6, "get_finished_us": 174} +{"t_unix": 1779813410.5836267, "step_id": 6594, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813410.6013782, "step_id": 6595, "start_load_kv_us": 6, "get_finished_us": 182} +{"t_unix": 1779813410.6183236, "step_id": 6596, "start_load_kv_us": 6, "get_finished_us": 231} +{"t_unix": 1779813410.6344056, "step_id": 6597, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813410.6521127, "step_id": 6598, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813410.66842, "step_id": 6599, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813410.6856933, "step_id": 6600, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813410.7436712, "step_id": 6601, "start_load_kv_us": 616, "get_finished_us": 328} +{"t_unix": 1779813410.748914, "step_id": 6602, "start_load_kv_us": 6, "get_finished_us": 178} +{"t_unix": 1779813411.003808, "step_id": 6603, "start_load_kv_us": 112, "get_finished_us": 332} +{"t_unix": 1779813411.0083246, "step_id": 6604, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813411.2271657, "step_id": 6605, "start_load_kv_us": 6, "get_finished_us": 305} +{"t_unix": 1779813411.2470424, "step_id": 6606, "start_load_kv_us": 5, "get_finished_us": 219} +{"t_unix": 1779813411.2668731, "step_id": 6607, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813411.2868335, "step_id": 6608, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813411.3078358, "step_id": 6609, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813411.3279693, "step_id": 6610, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813411.3494837, "step_id": 6611, "start_load_kv_us": 6, "get_finished_us": 162} +{"t_unix": 1779813411.3704169, "step_id": 6612, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813411.3911965, "step_id": 6613, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813411.4122696, "step_id": 6614, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813411.4328454, "step_id": 6615, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813411.4537835, "step_id": 6616, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813411.475077, "step_id": 6617, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813411.4969282, "step_id": 6618, "start_load_kv_us": 7, "get_finished_us": 195} +{"t_unix": 1779813411.5184457, "step_id": 6619, "start_load_kv_us": 5, "get_finished_us": 282} +{"t_unix": 1779813411.5380182, "step_id": 6620, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813411.5594466, "step_id": 6621, "start_load_kv_us": 5, "get_finished_us": 195} +{"t_unix": 1779813411.5802393, "step_id": 6622, "start_load_kv_us": 5, "get_finished_us": 247} +{"t_unix": 1779813411.6009579, "step_id": 6623, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813411.6212206, "step_id": 6624, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813411.6427252, "step_id": 6625, "start_load_kv_us": 19, "get_finished_us": 237} +{"t_unix": 1779813411.663324, "step_id": 6626, "start_load_kv_us": 3, "get_finished_us": 296} +{"t_unix": 1779813411.6845865, "step_id": 6627, "start_load_kv_us": 5, "get_finished_us": 302} +{"t_unix": 1779813411.7052262, "step_id": 6628, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813411.725859, "step_id": 6629, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813411.7466009, "step_id": 6630, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813411.76681, "step_id": 6631, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813411.7875645, "step_id": 6632, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813411.8082337, "step_id": 6633, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813411.8292613, "step_id": 6634, "start_load_kv_us": 7, "get_finished_us": 209} +{"t_unix": 1779813411.8498678, "step_id": 6635, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813411.870498, "step_id": 6636, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813411.8928337, "step_id": 6637, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813411.9144225, "step_id": 6638, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813411.9354768, "step_id": 6639, "start_load_kv_us": 3, "get_finished_us": 182} +{"t_unix": 1779813411.952116, "step_id": 6640, "start_load_kv_us": 3, "get_finished_us": 190} +{"t_unix": 1779813411.9691007, "step_id": 6641, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813411.9852712, "step_id": 6642, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813412.002961, "step_id": 6643, "start_load_kv_us": 5, "get_finished_us": 244} +{"t_unix": 1779813412.0199163, "step_id": 6644, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813412.0369163, "step_id": 6645, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813412.053133, "step_id": 6646, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813412.0692754, "step_id": 6647, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813412.0859742, "step_id": 6648, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813412.1026392, "step_id": 6649, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813412.1199071, "step_id": 6650, "start_load_kv_us": 7, "get_finished_us": 197} +{"t_unix": 1779813412.136678, "step_id": 6651, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813412.1526837, "step_id": 6652, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813412.1698513, "step_id": 6653, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813412.186177, "step_id": 6654, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813412.2024577, "step_id": 6655, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813412.2599714, "step_id": 6656, "start_load_kv_us": 112, "get_finished_us": 306} +{"t_unix": 1779813412.2646453, "step_id": 6657, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813412.51677, "step_id": 6658, "start_load_kv_us": 105, "get_finished_us": 298} +{"t_unix": 1779813412.521564, "step_id": 6659, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813412.738991, "step_id": 6660, "start_load_kv_us": 6, "get_finished_us": 391} +{"t_unix": 1779813412.7549603, "step_id": 6661, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813412.7715447, "step_id": 6662, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813412.8253665, "step_id": 6663, "start_load_kv_us": 106, "get_finished_us": 255} +{"t_unix": 1779813412.8293812, "step_id": 6664, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813413.047213, "step_id": 6665, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813413.06866, "step_id": 6666, "start_load_kv_us": 7, "get_finished_us": 261} +{"t_unix": 1779813413.08981, "step_id": 6667, "start_load_kv_us": 4, "get_finished_us": 277} +{"t_unix": 1779813413.1106517, "step_id": 6668, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813413.1329644, "step_id": 6669, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813413.1536877, "step_id": 6670, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813413.174389, "step_id": 6671, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813413.1960983, "step_id": 6672, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813413.2169306, "step_id": 6673, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813413.2369065, "step_id": 6674, "start_load_kv_us": 1, "get_finished_us": 280} +{"t_unix": 1779813413.2579968, "step_id": 6675, "start_load_kv_us": 5, "get_finished_us": 244} +{"t_unix": 1779813413.2784166, "step_id": 6676, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813413.2989345, "step_id": 6677, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813413.358008, "step_id": 6678, "start_load_kv_us": 128, "get_finished_us": 254} +{"t_unix": 1779813413.362004, "step_id": 6679, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813413.5840063, "step_id": 6680, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813413.6041925, "step_id": 6681, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813413.6259887, "step_id": 6682, "start_load_kv_us": 7, "get_finished_us": 165} +{"t_unix": 1779813413.6461668, "step_id": 6683, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813413.6621025, "step_id": 6684, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813413.6795926, "step_id": 6685, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813413.6966438, "step_id": 6686, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813413.713939, "step_id": 6687, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813413.7313306, "step_id": 6688, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813413.7482545, "step_id": 6689, "start_load_kv_us": 5, "get_finished_us": 144} +{"t_unix": 1779813413.7638564, "step_id": 6690, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813413.779316, "step_id": 6691, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813413.7936375, "step_id": 6692, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813413.8083603, "step_id": 6693, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813413.8234608, "step_id": 6694, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813413.8378088, "step_id": 6695, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813413.8529966, "step_id": 6696, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813413.8679106, "step_id": 6697, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813413.8837278, "step_id": 6698, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813413.898144, "step_id": 6699, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813413.9136164, "step_id": 6700, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813413.929847, "step_id": 6701, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813413.945352, "step_id": 6702, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813413.9600623, "step_id": 6703, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813413.9760735, "step_id": 6704, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813413.9917893, "step_id": 6705, "start_load_kv_us": 5, "get_finished_us": 288} +{"t_unix": 1779813414.0067375, "step_id": 6706, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813414.0236235, "step_id": 6707, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813414.075227, "step_id": 6708, "start_load_kv_us": 111, "get_finished_us": 258} +{"t_unix": 1779813414.0796766, "step_id": 6709, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813414.2961938, "step_id": 6710, "start_load_kv_us": 5, "get_finished_us": 329} +{"t_unix": 1779813414.309415, "step_id": 6711, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813414.3240716, "step_id": 6712, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813414.3392913, "step_id": 6713, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813414.3553371, "step_id": 6714, "start_load_kv_us": 6, "get_finished_us": 160} +{"t_unix": 1779813414.3699794, "step_id": 6715, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813414.4229271, "step_id": 6716, "start_load_kv_us": 109, "get_finished_us": 297} +{"t_unix": 1779813414.4275248, "step_id": 6717, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813414.6427073, "step_id": 6718, "start_load_kv_us": 4, "get_finished_us": 322} +{"t_unix": 1779813414.6607704, "step_id": 6719, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813414.680379, "step_id": 6720, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813414.6992462, "step_id": 6721, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813414.717661, "step_id": 6722, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813414.7371435, "step_id": 6723, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813414.7560499, "step_id": 6724, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813414.7746732, "step_id": 6725, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813414.793252, "step_id": 6726, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813414.8114893, "step_id": 6727, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813414.8302035, "step_id": 6728, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813414.8489945, "step_id": 6729, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813414.8684888, "step_id": 6730, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813414.9243035, "step_id": 6731, "start_load_kv_us": 107, "get_finished_us": 237} +{"t_unix": 1779813414.9289145, "step_id": 6732, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813415.1467075, "step_id": 6733, "start_load_kv_us": 6, "get_finished_us": 332} +{"t_unix": 1779813415.1627243, "step_id": 6734, "start_load_kv_us": 4, "get_finished_us": 264} +{"t_unix": 1779813415.1781654, "step_id": 6735, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813415.195421, "step_id": 6736, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813415.2121308, "step_id": 6737, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813415.2293935, "step_id": 6738, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813415.2483988, "step_id": 6739, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813415.2677205, "step_id": 6740, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813415.2856305, "step_id": 6741, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813415.3000827, "step_id": 6742, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813415.313693, "step_id": 6743, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813415.328008, "step_id": 6744, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813415.342465, "step_id": 6745, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813415.356218, "step_id": 6746, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813415.3701506, "step_id": 6747, "start_load_kv_us": 3, "get_finished_us": 174} +{"t_unix": 1779813415.383722, "step_id": 6748, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813415.3965893, "step_id": 6749, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813415.4088013, "step_id": 6750, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813415.4197986, "step_id": 6751, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813415.43187, "step_id": 6752, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813415.4433627, "step_id": 6753, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813415.4547544, "step_id": 6754, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813415.4667783, "step_id": 6755, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813415.4794319, "step_id": 6756, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813415.4912848, "step_id": 6757, "start_load_kv_us": 5, "get_finished_us": 264} +{"t_unix": 1779813415.5028768, "step_id": 6758, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813415.5133717, "step_id": 6759, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813415.5242822, "step_id": 6760, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813415.5353088, "step_id": 6761, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813415.5469203, "step_id": 6762, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813415.5581048, "step_id": 6763, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813415.57081, "step_id": 6764, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813415.582149, "step_id": 6765, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813415.594893, "step_id": 6766, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813415.606107, "step_id": 6767, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813415.618508, "step_id": 6768, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813415.6306486, "step_id": 6769, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813415.6419642, "step_id": 6770, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813415.6533349, "step_id": 6771, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813415.6654253, "step_id": 6772, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813415.6767695, "step_id": 6773, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813415.6882024, "step_id": 6774, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813415.6988883, "step_id": 6775, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813415.7102542, "step_id": 6776, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813415.7215996, "step_id": 6777, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813415.7331328, "step_id": 6778, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813415.74485, "step_id": 6779, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813415.7568753, "step_id": 6780, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813415.7674625, "step_id": 6781, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813415.7792685, "step_id": 6782, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813415.7901242, "step_id": 6783, "start_load_kv_us": 1, "get_finished_us": 205} +{"t_unix": 1779813415.802382, "step_id": 6784, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813415.8139858, "step_id": 6785, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813415.825134, "step_id": 6786, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813415.8366983, "step_id": 6787, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813415.8489761, "step_id": 6788, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813415.8606346, "step_id": 6789, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813415.8722594, "step_id": 6790, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813415.9206426, "step_id": 6791, "start_load_kv_us": 107, "get_finished_us": 246} +{"t_unix": 1779813415.924272, "step_id": 6792, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813416.1701844, "step_id": 6793, "start_load_kv_us": 111, "get_finished_us": 242} +{"t_unix": 1779813416.1738367, "step_id": 6794, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813416.3853037, "step_id": 6795, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813416.3998253, "step_id": 6796, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813416.4131658, "step_id": 6797, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813416.427752, "step_id": 6798, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813416.441188, "step_id": 6799, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813416.4559674, "step_id": 6800, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813416.469918, "step_id": 6801, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813416.4829903, "step_id": 6802, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813416.5339386, "step_id": 6803, "start_load_kv_us": 109, "get_finished_us": 251} +{"t_unix": 1779813416.5384033, "step_id": 6804, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813416.7512834, "step_id": 6805, "start_load_kv_us": 5, "get_finished_us": 298} +{"t_unix": 1779813416.7651489, "step_id": 6806, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813416.7792015, "step_id": 6807, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813416.7935224, "step_id": 6808, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813416.809145, "step_id": 6809, "start_load_kv_us": 19, "get_finished_us": 148} +{"t_unix": 1779813416.8234644, "step_id": 6810, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813416.8383358, "step_id": 6811, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813416.8535163, "step_id": 6812, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813416.867399, "step_id": 6813, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813416.8825831, "step_id": 6814, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813416.8966227, "step_id": 6815, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813416.9119031, "step_id": 6816, "start_load_kv_us": 5, "get_finished_us": 135} +{"t_unix": 1779813416.9261644, "step_id": 6817, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813416.9396057, "step_id": 6818, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813416.9538896, "step_id": 6819, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813416.9684584, "step_id": 6820, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813416.9824274, "step_id": 6821, "start_load_kv_us": 6, "get_finished_us": 167} +{"t_unix": 1779813416.9962683, "step_id": 6822, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813417.0095966, "step_id": 6823, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813417.024031, "step_id": 6824, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813417.0389223, "step_id": 6825, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813417.0528452, "step_id": 6826, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813417.0668664, "step_id": 6827, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813417.081389, "step_id": 6828, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813417.132387, "step_id": 6829, "start_load_kv_us": 105, "get_finished_us": 220} +{"t_unix": 1779813417.1367722, "step_id": 6830, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813417.3497474, "step_id": 6831, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813417.3642907, "step_id": 6832, "start_load_kv_us": 6, "get_finished_us": 216} +{"t_unix": 1779813417.3784323, "step_id": 6833, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813417.3927162, "step_id": 6834, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813417.4064245, "step_id": 6835, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813417.4210868, "step_id": 6836, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813417.435768, "step_id": 6837, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813417.45051, "step_id": 6838, "start_load_kv_us": 6, "get_finished_us": 181} +{"t_unix": 1779813417.464191, "step_id": 6839, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813417.4783552, "step_id": 6840, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813417.4936998, "step_id": 6841, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813417.5079808, "step_id": 6842, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813417.5226443, "step_id": 6843, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813417.537725, "step_id": 6844, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813417.5518227, "step_id": 6845, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813417.5671535, "step_id": 6846, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813417.5811024, "step_id": 6847, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813417.5962777, "step_id": 6848, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813417.6106067, "step_id": 6849, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813417.6253662, "step_id": 6850, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813417.6390932, "step_id": 6851, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813417.6545708, "step_id": 6852, "start_load_kv_us": 5, "get_finished_us": 294} +{"t_unix": 1779813417.6699207, "step_id": 6853, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813417.68392, "step_id": 6854, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813417.6977477, "step_id": 6855, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813417.711965, "step_id": 6856, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813417.727485, "step_id": 6857, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813417.7414267, "step_id": 6858, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813417.7558324, "step_id": 6859, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813417.7707832, "step_id": 6860, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813417.7842598, "step_id": 6861, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813417.7983425, "step_id": 6862, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813417.8119853, "step_id": 6863, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813417.826356, "step_id": 6864, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813417.839833, "step_id": 6865, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813417.853522, "step_id": 6866, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813417.8670285, "step_id": 6867, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813417.8811307, "step_id": 6868, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813417.8945358, "step_id": 6869, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813417.908605, "step_id": 6870, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813417.9216669, "step_id": 6871, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813417.9350462, "step_id": 6872, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813417.9496548, "step_id": 6873, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813417.963864, "step_id": 6874, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813417.9775293, "step_id": 6875, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813417.992483, "step_id": 6876, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813418.006472, "step_id": 6877, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813418.0202017, "step_id": 6878, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813418.0341392, "step_id": 6879, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813418.0489845, "step_id": 6880, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813418.0631158, "step_id": 6881, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813418.0772846, "step_id": 6882, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813418.0913143, "step_id": 6883, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813418.1494088, "step_id": 6884, "start_load_kv_us": 136, "get_finished_us": 298} +{"t_unix": 1779813418.1541433, "step_id": 6885, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813418.3991575, "step_id": 6886, "start_load_kv_us": 141, "get_finished_us": 339} +{"t_unix": 1779813418.4032204, "step_id": 6887, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813418.6557205, "step_id": 6888, "start_load_kv_us": 237, "get_finished_us": 348} +{"t_unix": 1779813418.660768, "step_id": 6889, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813419.0864706, "step_id": 6890, "start_load_kv_us": 3, "get_finished_us": 344} +{"t_unix": 1779813419.0956154, "step_id": 6891, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813419.1105103, "step_id": 6892, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813419.1251175, "step_id": 6893, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813419.1388881, "step_id": 6894, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813419.154358, "step_id": 6895, "start_load_kv_us": 6, "get_finished_us": 170} +{"t_unix": 1779813419.1691494, "step_id": 6896, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813419.1840096, "step_id": 6897, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813419.1987302, "step_id": 6898, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813419.212835, "step_id": 6899, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813419.228583, "step_id": 6900, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813419.2434652, "step_id": 6901, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813419.2582812, "step_id": 6902, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813419.2723873, "step_id": 6903, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813419.287967, "step_id": 6904, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813419.302734, "step_id": 6905, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813419.3165283, "step_id": 6906, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813419.3708835, "step_id": 6907, "start_load_kv_us": 119, "get_finished_us": 216} +{"t_unix": 1779813419.3754966, "step_id": 6908, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813419.5872653, "step_id": 6909, "start_load_kv_us": 4, "get_finished_us": 284} +{"t_unix": 1779813419.599895, "step_id": 6910, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813419.6141438, "step_id": 6911, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813419.6281786, "step_id": 6912, "start_load_kv_us": 21, "get_finished_us": 183} +{"t_unix": 1779813419.6420453, "step_id": 6913, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813419.6562505, "step_id": 6914, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813419.6697712, "step_id": 6915, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813419.6849885, "step_id": 6916, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813419.699837, "step_id": 6917, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813419.7146358, "step_id": 6918, "start_load_kv_us": 4, "get_finished_us": 259} +{"t_unix": 1779813419.7298436, "step_id": 6919, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813419.7445736, "step_id": 6920, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813419.758463, "step_id": 6921, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813419.7717922, "step_id": 6922, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813419.7861931, "step_id": 6923, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813419.8010778, "step_id": 6924, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813419.8152807, "step_id": 6925, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813419.8287225, "step_id": 6926, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813419.8436854, "step_id": 6927, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813419.8576822, "step_id": 6928, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813419.8716857, "step_id": 6929, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813419.8860912, "step_id": 6930, "start_load_kv_us": 5, "get_finished_us": 280} +{"t_unix": 1779813419.8996723, "step_id": 6931, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813419.9151943, "step_id": 6932, "start_load_kv_us": 6, "get_finished_us": 178} +{"t_unix": 1779813419.9294922, "step_id": 6933, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813419.9494631, "step_id": 6934, "start_load_kv_us": 5, "get_finished_us": 261} +{"t_unix": 1779813419.959997, "step_id": 6935, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813419.9745095, "step_id": 6936, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813419.9893115, "step_id": 6937, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813420.004461, "step_id": 6938, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813420.0197392, "step_id": 6939, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813420.0331504, "step_id": 6940, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813420.0473294, "step_id": 6941, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813420.060791, "step_id": 6942, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813420.0756905, "step_id": 6943, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813420.0904486, "step_id": 6944, "start_load_kv_us": 5, "get_finished_us": 270} +{"t_unix": 1779813420.1043456, "step_id": 6945, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813420.1187947, "step_id": 6946, "start_load_kv_us": 15, "get_finished_us": 202} +{"t_unix": 1779813420.1322935, "step_id": 6947, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813420.1466458, "step_id": 6948, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813420.1616187, "step_id": 6949, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813420.1759574, "step_id": 6950, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813420.190509, "step_id": 6951, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813420.2054167, "step_id": 6952, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813420.2204015, "step_id": 6953, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813420.2348006, "step_id": 6954, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813420.2497568, "step_id": 6955, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813420.2652433, "step_id": 6956, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813420.2798681, "step_id": 6957, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813420.2937615, "step_id": 6958, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813420.3090818, "step_id": 6959, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813420.3238142, "step_id": 6960, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813420.3387024, "step_id": 6961, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813420.3536835, "step_id": 6962, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813420.367567, "step_id": 6963, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813420.3821096, "step_id": 6964, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813420.3965898, "step_id": 6965, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813420.411405, "step_id": 6966, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813420.4260113, "step_id": 6967, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813420.4409795, "step_id": 6968, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813420.455606, "step_id": 6969, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813420.4701848, "step_id": 6970, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813420.48503, "step_id": 6971, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813420.499938, "step_id": 6972, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813420.51473, "step_id": 6973, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813420.5278947, "step_id": 6974, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813420.542838, "step_id": 6975, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813420.556972, "step_id": 6976, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813420.5712163, "step_id": 6977, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813420.5853314, "step_id": 6978, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813420.5990767, "step_id": 6979, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813420.6133904, "step_id": 6980, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813420.6280694, "step_id": 6981, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813420.6430724, "step_id": 6982, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813420.6573749, "step_id": 6983, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813420.6729398, "step_id": 6984, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813420.7238855, "step_id": 6985, "start_load_kv_us": 124, "get_finished_us": 280} +{"t_unix": 1779813420.7277842, "step_id": 6986, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813420.9395173, "step_id": 6987, "start_load_kv_us": 3, "get_finished_us": 294} +{"t_unix": 1779813420.9527032, "step_id": 6988, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813421.006659, "step_id": 6989, "start_load_kv_us": 141, "get_finished_us": 329} +{"t_unix": 1779813421.0104742, "step_id": 6990, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813421.219086, "step_id": 6991, "start_load_kv_us": 5, "get_finished_us": 316} +{"t_unix": 1779813421.2331047, "step_id": 6992, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813421.246449, "step_id": 6993, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813421.261184, "step_id": 6994, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813421.2744215, "step_id": 6995, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813421.2882931, "step_id": 6996, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813421.3029702, "step_id": 6997, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813421.3171363, "step_id": 6998, "start_load_kv_us": 5, "get_finished_us": 257} +{"t_unix": 1779813421.331161, "step_id": 6999, "start_load_kv_us": 3, "get_finished_us": 180} +{"t_unix": 1779813421.3454566, "step_id": 7000, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813421.3596694, "step_id": 7001, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813421.3732073, "step_id": 7002, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813421.3874624, "step_id": 7003, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813421.402255, "step_id": 7004, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813421.4177423, "step_id": 7005, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813421.4315288, "step_id": 7006, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813421.446557, "step_id": 7007, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813421.4608624, "step_id": 7008, "start_load_kv_us": 5, "get_finished_us": 156} +{"t_unix": 1779813421.474595, "step_id": 7009, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813421.48956, "step_id": 7010, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813421.5031908, "step_id": 7011, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813421.5178761, "step_id": 7012, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813421.5328884, "step_id": 7013, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813421.5470576, "step_id": 7014, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813421.5612864, "step_id": 7015, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813421.575659, "step_id": 7016, "start_load_kv_us": 4, "get_finished_us": 284} +{"t_unix": 1779813421.5896423, "step_id": 7017, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813421.6030264, "step_id": 7018, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813421.617086, "step_id": 7019, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813421.6317472, "step_id": 7020, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813421.6467679, "step_id": 7021, "start_load_kv_us": 16, "get_finished_us": 172} +{"t_unix": 1779813421.660643, "step_id": 7022, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813421.6756828, "step_id": 7023, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813421.6904268, "step_id": 7024, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813421.7042708, "step_id": 7025, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813421.7190561, "step_id": 7026, "start_load_kv_us": 5, "get_finished_us": 195} +{"t_unix": 1779813421.7325678, "step_id": 7027, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813421.746263, "step_id": 7028, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813421.761111, "step_id": 7029, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813421.7753463, "step_id": 7030, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813421.7897053, "step_id": 7031, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813421.8042724, "step_id": 7032, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813421.8186066, "step_id": 7033, "start_load_kv_us": 3, "get_finished_us": 240} +{"t_unix": 1779813421.8321424, "step_id": 7034, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813421.846498, "step_id": 7035, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813421.8618703, "step_id": 7036, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813421.8755758, "step_id": 7037, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813421.8895652, "step_id": 7038, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813421.904817, "step_id": 7039, "start_load_kv_us": 5, "get_finished_us": 428} +{"t_unix": 1779813421.9191031, "step_id": 7040, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813421.9328876, "step_id": 7041, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813421.947775, "step_id": 7042, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813421.9618165, "step_id": 7043, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813421.9768298, "step_id": 7044, "start_load_kv_us": 2, "get_finished_us": 398} +{"t_unix": 1779813421.9916334, "step_id": 7045, "start_load_kv_us": 5, "get_finished_us": 307} +{"t_unix": 1779813422.0058365, "step_id": 7046, "start_load_kv_us": 6, "get_finished_us": 248} +{"t_unix": 1779813422.0201395, "step_id": 7047, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813422.0338147, "step_id": 7048, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813422.0474887, "step_id": 7049, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813422.0617466, "step_id": 7050, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813422.072968, "step_id": 7051, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813422.0850203, "step_id": 7052, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813422.1367362, "step_id": 7053, "start_load_kv_us": 143, "get_finished_us": 258} +{"t_unix": 1779813422.14064, "step_id": 7054, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813422.3479724, "step_id": 7055, "start_load_kv_us": 4, "get_finished_us": 283} +{"t_unix": 1779813422.3614626, "step_id": 7056, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813422.3759258, "step_id": 7057, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813422.391912, "step_id": 7058, "start_load_kv_us": 6, "get_finished_us": 284} +{"t_unix": 1779813422.40618, "step_id": 7059, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813422.4204814, "step_id": 7060, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813422.4329405, "step_id": 7061, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813422.4448273, "step_id": 7062, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813422.45704, "step_id": 7063, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813422.4693782, "step_id": 7064, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813422.480663, "step_id": 7065, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813422.4928596, "step_id": 7066, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813422.504908, "step_id": 7067, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813422.5170133, "step_id": 7068, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813422.5297818, "step_id": 7069, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813422.541056, "step_id": 7070, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813422.5537732, "step_id": 7071, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813422.565276, "step_id": 7072, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813422.5772223, "step_id": 7073, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813422.5898004, "step_id": 7074, "start_load_kv_us": 6, "get_finished_us": 290} +{"t_unix": 1779813422.6007326, "step_id": 7075, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813422.6134086, "step_id": 7076, "start_load_kv_us": 2, "get_finished_us": 346} +{"t_unix": 1779813422.6242723, "step_id": 7077, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813422.6359656, "step_id": 7078, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813422.6477187, "step_id": 7079, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813422.6592684, "step_id": 7080, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813422.6703107, "step_id": 7081, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813422.6822925, "step_id": 7082, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813422.6945353, "step_id": 7083, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813422.7064202, "step_id": 7084, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813422.71939, "step_id": 7085, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813422.7308455, "step_id": 7086, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813422.7433698, "step_id": 7087, "start_load_kv_us": 5, "get_finished_us": 273} +{"t_unix": 1779813422.7546315, "step_id": 7088, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813422.7662764, "step_id": 7089, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813422.7784123, "step_id": 7090, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813422.7892084, "step_id": 7091, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813422.8009093, "step_id": 7092, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813422.8522632, "step_id": 7093, "start_load_kv_us": 114, "get_finished_us": 322} +{"t_unix": 1779813423.048735, "step_id": 7094, "start_load_kv_us": 113, "get_finished_us": 313} +{"t_unix": 1779813423.060758, "step_id": 7095, "start_load_kv_us": 5, "get_finished_us": 245} +{"t_unix": 1779813423.3386416, "step_id": 7096, "start_load_kv_us": 216, "get_finished_us": 334} +{"t_unix": 1779813423.342902, "step_id": 7097, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813423.8058522, "step_id": 7098, "start_load_kv_us": 124, "get_finished_us": 352} +{"t_unix": 1779813423.8108928, "step_id": 7099, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813424.019393, "step_id": 7100, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813424.033705, "step_id": 7101, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813424.0479755, "step_id": 7102, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813424.0620625, "step_id": 7103, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813424.0762267, "step_id": 7104, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813424.0898657, "step_id": 7105, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813424.104488, "step_id": 7106, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813424.1178691, "step_id": 7107, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813424.1321173, "step_id": 7108, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813424.1471784, "step_id": 7109, "start_load_kv_us": 18, "get_finished_us": 186} +{"t_unix": 1779813424.1612267, "step_id": 7110, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813424.1748333, "step_id": 7111, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813424.1888702, "step_id": 7112, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813424.2022438, "step_id": 7113, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813424.2164683, "step_id": 7114, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813424.2309775, "step_id": 7115, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813424.2443888, "step_id": 7116, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813424.2592928, "step_id": 7117, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813424.2731342, "step_id": 7118, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813424.287067, "step_id": 7119, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813424.301472, "step_id": 7120, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813424.3151937, "step_id": 7121, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813424.330057, "step_id": 7122, "start_load_kv_us": 6, "get_finished_us": 233} +{"t_unix": 1779813424.3436713, "step_id": 7123, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813424.3578873, "step_id": 7124, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813424.373297, "step_id": 7125, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813424.3866944, "step_id": 7126, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813424.4007602, "step_id": 7127, "start_load_kv_us": 5, "get_finished_us": 266} +{"t_unix": 1779813424.4145088, "step_id": 7128, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813424.4279237, "step_id": 7129, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813424.4420419, "step_id": 7130, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813424.456761, "step_id": 7131, "start_load_kv_us": 4, "get_finished_us": 292} +{"t_unix": 1779813424.4705367, "step_id": 7132, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813424.4855363, "step_id": 7133, "start_load_kv_us": 4, "get_finished_us": 259} +{"t_unix": 1779813424.4997253, "step_id": 7134, "start_load_kv_us": 5, "get_finished_us": 291} +{"t_unix": 1779813424.513775, "step_id": 7135, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813424.5281272, "step_id": 7136, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813424.5418189, "step_id": 7137, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813424.5565221, "step_id": 7138, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813424.570005, "step_id": 7139, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813424.5848298, "step_id": 7140, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813424.5998666, "step_id": 7141, "start_load_kv_us": 4, "get_finished_us": 247} +{"t_unix": 1779813424.6532314, "step_id": 7142, "start_load_kv_us": 117, "get_finished_us": 343} +{"t_unix": 1779813424.657888, "step_id": 7143, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813424.9125402, "step_id": 7144, "start_load_kv_us": 119, "get_finished_us": 318} +{"t_unix": 1779813424.9178479, "step_id": 7145, "start_load_kv_us": 3, "get_finished_us": 212} +{"t_unix": 1779813425.1256642, "step_id": 7146, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813425.1397715, "step_id": 7147, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813425.152426, "step_id": 7148, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813425.1662114, "step_id": 7149, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813425.1786473, "step_id": 7150, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813425.1911242, "step_id": 7151, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813425.205324, "step_id": 7152, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813425.2183692, "step_id": 7153, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813425.2323403, "step_id": 7154, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813425.2453158, "step_id": 7155, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813425.2977316, "step_id": 7156, "start_load_kv_us": 132, "get_finished_us": 298} +{"t_unix": 1779813425.5003312, "step_id": 7157, "start_load_kv_us": 124, "get_finished_us": 301} +{"t_unix": 1779813425.7367573, "step_id": 7158, "start_load_kv_us": 126, "get_finished_us": 330} +{"t_unix": 1779813425.7488708, "step_id": 7159, "start_load_kv_us": 6, "get_finished_us": 211} +{"t_unix": 1779813425.9880111, "step_id": 7160, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813426.002471, "step_id": 7161, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813426.0169797, "step_id": 7162, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813426.0326295, "step_id": 7163, "start_load_kv_us": 5, "get_finished_us": 254} +{"t_unix": 1779813426.0463898, "step_id": 7164, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813426.060124, "step_id": 7165, "start_load_kv_us": 5, "get_finished_us": 250} +{"t_unix": 1779813426.0730515, "step_id": 7166, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813426.086241, "step_id": 7167, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813426.1005707, "step_id": 7168, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813426.1138387, "step_id": 7169, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813426.1283615, "step_id": 7170, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813426.1414719, "step_id": 7171, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813426.1550162, "step_id": 7172, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813426.1692195, "step_id": 7173, "start_load_kv_us": 5, "get_finished_us": 307} +{"t_unix": 1779813426.18284, "step_id": 7174, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813426.1964653, "step_id": 7175, "start_load_kv_us": 5, "get_finished_us": 286} +{"t_unix": 1779813426.2093735, "step_id": 7176, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813426.2225869, "step_id": 7177, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813426.2361922, "step_id": 7178, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813426.250786, "step_id": 7179, "start_load_kv_us": 5, "get_finished_us": 259} +{"t_unix": 1779813426.2641442, "step_id": 7180, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813426.2785008, "step_id": 7181, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813426.2921908, "step_id": 7182, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813426.3049858, "step_id": 7183, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813426.3191767, "step_id": 7184, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813426.332253, "step_id": 7185, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813426.3468635, "step_id": 7186, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813426.360189, "step_id": 7187, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813426.3742056, "step_id": 7188, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813426.388527, "step_id": 7189, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813426.402318, "step_id": 7190, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813426.415862, "step_id": 7191, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813426.4287705, "step_id": 7192, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813426.442622, "step_id": 7193, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813426.4569848, "step_id": 7194, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813426.4716308, "step_id": 7195, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813426.4856377, "step_id": 7196, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813426.5005176, "step_id": 7197, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813426.5147011, "step_id": 7198, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813426.5279021, "step_id": 7199, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813426.5427341, "step_id": 7200, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813426.55608, "step_id": 7201, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813426.570649, "step_id": 7202, "start_load_kv_us": 19, "get_finished_us": 162} +{"t_unix": 1779813426.583536, "step_id": 7203, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813426.5970485, "step_id": 7204, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813426.611674, "step_id": 7205, "start_load_kv_us": 6, "get_finished_us": 164} +{"t_unix": 1779813426.6262357, "step_id": 7206, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813426.6410162, "step_id": 7207, "start_load_kv_us": 6, "get_finished_us": 175} +{"t_unix": 1779813426.6551425, "step_id": 7208, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813426.6696684, "step_id": 7209, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813426.6845903, "step_id": 7210, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813426.7001143, "step_id": 7211, "start_load_kv_us": 6, "get_finished_us": 145} +{"t_unix": 1779813426.7135022, "step_id": 7212, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813426.7282662, "step_id": 7213, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813426.742433, "step_id": 7214, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813426.7559097, "step_id": 7215, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813426.7707837, "step_id": 7216, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813426.784101, "step_id": 7217, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813426.7991831, "step_id": 7218, "start_load_kv_us": 5, "get_finished_us": 145} +{"t_unix": 1779813426.812495, "step_id": 7219, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813426.826457, "step_id": 7220, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813426.84082, "step_id": 7221, "start_load_kv_us": 5, "get_finished_us": 255} +{"t_unix": 1779813426.8547115, "step_id": 7222, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813426.868916, "step_id": 7223, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813426.8827455, "step_id": 7224, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813426.897284, "step_id": 7225, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813426.9117866, "step_id": 7226, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813426.9264262, "step_id": 7227, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813426.9396164, "step_id": 7228, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813426.9542105, "step_id": 7229, "start_load_kv_us": 6, "get_finished_us": 173} +{"t_unix": 1779813426.9679713, "step_id": 7230, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813426.9811397, "step_id": 7231, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813426.9955077, "step_id": 7232, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813427.0090282, "step_id": 7233, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813427.023503, "step_id": 7234, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813427.037232, "step_id": 7235, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813427.0513527, "step_id": 7236, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813427.066619, "step_id": 7237, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813427.08092, "step_id": 7238, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813427.0951939, "step_id": 7239, "start_load_kv_us": 6, "get_finished_us": 183} +{"t_unix": 1779813427.1081555, "step_id": 7240, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813427.1224172, "step_id": 7241, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813427.1364977, "step_id": 7242, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813427.1516676, "step_id": 7243, "start_load_kv_us": 20, "get_finished_us": 178} +{"t_unix": 1779813427.1658216, "step_id": 7244, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813427.1808524, "step_id": 7245, "start_load_kv_us": 6, "get_finished_us": 200} +{"t_unix": 1779813427.1943486, "step_id": 7246, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813427.2079172, "step_id": 7247, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813427.2227879, "step_id": 7248, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813427.2364538, "step_id": 7249, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813427.2514014, "step_id": 7250, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813427.2649128, "step_id": 7251, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813427.2788773, "step_id": 7252, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813427.2933295, "step_id": 7253, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813427.3067024, "step_id": 7254, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813427.3210835, "step_id": 7255, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813427.33429, "step_id": 7256, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813427.3483407, "step_id": 7257, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813427.362405, "step_id": 7258, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813427.377641, "step_id": 7259, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813427.391325, "step_id": 7260, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813427.4434812, "step_id": 7261, "start_load_kv_us": 135, "get_finished_us": 241} +{"t_unix": 1779813427.4479878, "step_id": 7262, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813427.6969793, "step_id": 7263, "start_load_kv_us": 251, "get_finished_us": 297} +{"t_unix": 1779813427.701674, "step_id": 7264, "start_load_kv_us": 4, "get_finished_us": 266} +{"t_unix": 1779813428.127975, "step_id": 7265, "start_load_kv_us": 5, "get_finished_us": 329} +{"t_unix": 1779813428.1424465, "step_id": 7266, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813428.156571, "step_id": 7267, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813428.1719055, "step_id": 7268, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813428.1867478, "step_id": 7269, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813428.2009244, "step_id": 7270, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813428.2163851, "step_id": 7271, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813428.2310545, "step_id": 7272, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813428.2460136, "step_id": 7273, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813428.2613118, "step_id": 7274, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813428.277412, "step_id": 7275, "start_load_kv_us": 6, "get_finished_us": 206} +{"t_unix": 1779813428.292505, "step_id": 7276, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813428.3088262, "step_id": 7277, "start_load_kv_us": 6, "get_finished_us": 194} +{"t_unix": 1779813428.3241785, "step_id": 7278, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813428.338896, "step_id": 7279, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813428.3549087, "step_id": 7280, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813428.3704693, "step_id": 7281, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813428.3856695, "step_id": 7282, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813428.4002378, "step_id": 7283, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813428.41617, "step_id": 7284, "start_load_kv_us": 4, "get_finished_us": 278} +{"t_unix": 1779813428.431395, "step_id": 7285, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813428.4462357, "step_id": 7286, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813428.4618316, "step_id": 7287, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813428.476279, "step_id": 7288, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813428.4912734, "step_id": 7289, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813428.5062, "step_id": 7290, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813428.5217137, "step_id": 7291, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813428.5360065, "step_id": 7292, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813428.5519898, "step_id": 7293, "start_load_kv_us": 6, "get_finished_us": 206} +{"t_unix": 1779813428.5668252, "step_id": 7294, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813428.5816429, "step_id": 7295, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813428.5972784, "step_id": 7296, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813428.6123967, "step_id": 7297, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813428.627139, "step_id": 7298, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813428.6418557, "step_id": 7299, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813428.657467, "step_id": 7300, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813428.6730645, "step_id": 7301, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813428.6880164, "step_id": 7302, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813428.7039266, "step_id": 7303, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813428.7183468, "step_id": 7304, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813428.7335277, "step_id": 7305, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813428.74888, "step_id": 7306, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813428.7648535, "step_id": 7307, "start_load_kv_us": 6, "get_finished_us": 160} +{"t_unix": 1779813428.779508, "step_id": 7308, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813428.7960265, "step_id": 7309, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813428.8114307, "step_id": 7310, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813428.8247702, "step_id": 7311, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813428.839763, "step_id": 7312, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813428.8547244, "step_id": 7313, "start_load_kv_us": 3, "get_finished_us": 150} +{"t_unix": 1779813428.8689313, "step_id": 7314, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813428.8838425, "step_id": 7315, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813428.899515, "step_id": 7316, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813428.914565, "step_id": 7317, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813428.9291177, "step_id": 7318, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813428.9441688, "step_id": 7319, "start_load_kv_us": 6, "get_finished_us": 206} +{"t_unix": 1779813428.9576778, "step_id": 7320, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813428.97231, "step_id": 7321, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813428.9867218, "step_id": 7322, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813429.0023146, "step_id": 7323, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813429.0162306, "step_id": 7324, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813429.0313363, "step_id": 7325, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813429.046301, "step_id": 7326, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813429.0608473, "step_id": 7327, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813429.0763013, "step_id": 7328, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813429.091795, "step_id": 7329, "start_load_kv_us": 5, "get_finished_us": 283} +{"t_unix": 1779813429.106085, "step_id": 7330, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813429.1207228, "step_id": 7331, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813429.1354222, "step_id": 7332, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813429.1492956, "step_id": 7333, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813429.1627576, "step_id": 7334, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813429.1774554, "step_id": 7335, "start_load_kv_us": 6, "get_finished_us": 239} +{"t_unix": 1779813429.190844, "step_id": 7336, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813429.2064512, "step_id": 7337, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813429.2200725, "step_id": 7338, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813429.2349162, "step_id": 7339, "start_load_kv_us": 6, "get_finished_us": 201} +{"t_unix": 1779813429.2482047, "step_id": 7340, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813429.2630842, "step_id": 7341, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813429.2768807, "step_id": 7342, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813429.2905922, "step_id": 7343, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813429.3049726, "step_id": 7344, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813429.3192225, "step_id": 7345, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813429.3324926, "step_id": 7346, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813429.3467677, "step_id": 7347, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813429.3616533, "step_id": 7348, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813429.3765185, "step_id": 7349, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813429.3903165, "step_id": 7350, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813429.4046476, "step_id": 7351, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813429.4176972, "step_id": 7352, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813429.431367, "step_id": 7353, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813429.4429204, "step_id": 7354, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813429.4546666, "step_id": 7355, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813429.4650044, "step_id": 7356, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813429.477556, "step_id": 7357, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813429.524315, "step_id": 7358, "start_load_kv_us": 148, "get_finished_us": 251} +{"t_unix": 1779813429.528034, "step_id": 7359, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813429.774664, "step_id": 7360, "start_load_kv_us": 127, "get_finished_us": 354} +{"t_unix": 1779813429.7794595, "step_id": 7361, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813430.027141, "step_id": 7362, "start_load_kv_us": 231, "get_finished_us": 335} +{"t_unix": 1779813430.0317254, "step_id": 7363, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813430.48517, "step_id": 7364, "start_load_kv_us": 133, "get_finished_us": 290} +{"t_unix": 1779813430.6894073, "step_id": 7365, "start_load_kv_us": 121, "get_finished_us": 337} +{"t_unix": 1779813430.929488, "step_id": 7366, "start_load_kv_us": 125, "get_finished_us": 321} +{"t_unix": 1779813431.1707668, "step_id": 7367, "start_load_kv_us": 124, "get_finished_us": 329} +{"t_unix": 1779813431.182558, "step_id": 7368, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813431.423363, "step_id": 7369, "start_load_kv_us": 5, "get_finished_us": 271} +{"t_unix": 1779813431.4363961, "step_id": 7370, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813431.4498231, "step_id": 7371, "start_load_kv_us": 6, "get_finished_us": 169} +{"t_unix": 1779813431.4635594, "step_id": 7372, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813431.4772508, "step_id": 7373, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813431.4909315, "step_id": 7374, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813431.5048246, "step_id": 7375, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813431.519116, "step_id": 7376, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813431.5331874, "step_id": 7377, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813431.546661, "step_id": 7378, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813431.5615582, "step_id": 7379, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813431.5759842, "step_id": 7380, "start_load_kv_us": 5, "get_finished_us": 156} +{"t_unix": 1779813431.5906594, "step_id": 7381, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813431.6053128, "step_id": 7382, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813431.6198583, "step_id": 7383, "start_load_kv_us": 5, "get_finished_us": 144} +{"t_unix": 1779813431.633652, "step_id": 7384, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813431.6488304, "step_id": 7385, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813431.6631682, "step_id": 7386, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813431.67738, "step_id": 7387, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813431.691911, "step_id": 7388, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813431.7073557, "step_id": 7389, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813431.759039, "step_id": 7390, "start_load_kv_us": 118, "get_finished_us": 271} +{"t_unix": 1779813431.763059, "step_id": 7391, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813432.0169373, "step_id": 7392, "start_load_kv_us": 131, "get_finished_us": 337} +{"t_unix": 1779813432.021905, "step_id": 7393, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813432.236891, "step_id": 7394, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813432.2532938, "step_id": 7395, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813432.270115, "step_id": 7396, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813432.2866757, "step_id": 7397, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813432.3037589, "step_id": 7398, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813432.3202462, "step_id": 7399, "start_load_kv_us": 6, "get_finished_us": 157} +{"t_unix": 1779813432.337877, "step_id": 7400, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813432.3563814, "step_id": 7401, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813432.370018, "step_id": 7402, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813432.3842292, "step_id": 7403, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813432.3985205, "step_id": 7404, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813432.4128284, "step_id": 7405, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813432.4662206, "step_id": 7406, "start_load_kv_us": 119, "get_finished_us": 244} +{"t_unix": 1779813432.470058, "step_id": 7407, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813432.7241557, "step_id": 7408, "start_load_kv_us": 119, "get_finished_us": 343} +{"t_unix": 1779813432.7289095, "step_id": 7409, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813432.9477112, "step_id": 7410, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813432.9670892, "step_id": 7411, "start_load_kv_us": 6, "get_finished_us": 276} +{"t_unix": 1779813432.9864542, "step_id": 7412, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813433.0071526, "step_id": 7413, "start_load_kv_us": 6, "get_finished_us": 222} +{"t_unix": 1779813433.0249863, "step_id": 7414, "start_load_kv_us": 6, "get_finished_us": 227} +{"t_unix": 1779813433.0388386, "step_id": 7415, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813433.0534797, "step_id": 7416, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813433.0696075, "step_id": 7417, "start_load_kv_us": 6, "get_finished_us": 307} +{"t_unix": 1779813433.084498, "step_id": 7418, "start_load_kv_us": 4, "get_finished_us": 247} +{"t_unix": 1779813433.0996654, "step_id": 7419, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813433.1148384, "step_id": 7420, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813433.1292207, "step_id": 7421, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813433.1447687, "step_id": 7422, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813433.1583865, "step_id": 7423, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813433.1732724, "step_id": 7424, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813433.1875434, "step_id": 7425, "start_load_kv_us": 4, "get_finished_us": 271} +{"t_unix": 1779813433.201471, "step_id": 7426, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813433.217261, "step_id": 7427, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813433.2321706, "step_id": 7428, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813433.2474294, "step_id": 7429, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813433.2624257, "step_id": 7430, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813433.2764645, "step_id": 7431, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813433.291559, "step_id": 7432, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813433.3072731, "step_id": 7433, "start_load_kv_us": 6, "get_finished_us": 178} +{"t_unix": 1779813433.3221815, "step_id": 7434, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813433.3374624, "step_id": 7435, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813433.352507, "step_id": 7436, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813433.3668785, "step_id": 7437, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813433.382421, "step_id": 7438, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813433.3967698, "step_id": 7439, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813433.4127283, "step_id": 7440, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813433.4281862, "step_id": 7441, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813433.4425898, "step_id": 7442, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813433.4583805, "step_id": 7443, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813433.473471, "step_id": 7444, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813433.4886892, "step_id": 7445, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813433.5041957, "step_id": 7446, "start_load_kv_us": 5, "get_finished_us": 268} +{"t_unix": 1779813433.5185716, "step_id": 7447, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813433.5339625, "step_id": 7448, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813433.5500667, "step_id": 7449, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813433.565535, "step_id": 7450, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813433.5809667, "step_id": 7451, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813433.5964048, "step_id": 7452, "start_load_kv_us": 8, "get_finished_us": 150} +{"t_unix": 1779813433.611259, "step_id": 7453, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813433.6272264, "step_id": 7454, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813433.6418264, "step_id": 7455, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813433.657908, "step_id": 7456, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813433.6735442, "step_id": 7457, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813433.6878748, "step_id": 7458, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813433.7037947, "step_id": 7459, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813433.7190387, "step_id": 7460, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813433.7344131, "step_id": 7461, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813433.7497191, "step_id": 7462, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813433.764605, "step_id": 7463, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813433.7803552, "step_id": 7464, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813433.7962425, "step_id": 7465, "start_load_kv_us": 6, "get_finished_us": 156} +{"t_unix": 1779813433.811999, "step_id": 7466, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813433.8275454, "step_id": 7467, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813433.8433416, "step_id": 7468, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813433.8582313, "step_id": 7469, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813433.874316, "step_id": 7470, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813433.889, "step_id": 7471, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813433.9047236, "step_id": 7472, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813433.9201872, "step_id": 7473, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813433.934762, "step_id": 7474, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813433.950965, "step_id": 7475, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813433.966267, "step_id": 7476, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813433.981464, "step_id": 7477, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813433.9967809, "step_id": 7478, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813434.011666, "step_id": 7479, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813434.026918, "step_id": 7480, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813434.0427504, "step_id": 7481, "start_load_kv_us": 6, "get_finished_us": 180} +{"t_unix": 1779813434.0578468, "step_id": 7482, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813434.0730605, "step_id": 7483, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813434.0881562, "step_id": 7484, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813434.102797, "step_id": 7485, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813434.118883, "step_id": 7486, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813434.1336818, "step_id": 7487, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813434.1496701, "step_id": 7488, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813434.1652143, "step_id": 7489, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813434.1799662, "step_id": 7490, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813434.195782, "step_id": 7491, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813434.2108457, "step_id": 7492, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813434.2255974, "step_id": 7493, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813434.2405314, "step_id": 7494, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813434.2550066, "step_id": 7495, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813434.2698455, "step_id": 7496, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813434.285015, "step_id": 7497, "start_load_kv_us": 6, "get_finished_us": 228} +{"t_unix": 1779813434.3000581, "step_id": 7498, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813434.3152924, "step_id": 7499, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813434.3309364, "step_id": 7500, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813434.3459258, "step_id": 7501, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813434.361556, "step_id": 7502, "start_load_kv_us": 3, "get_finished_us": 157} +{"t_unix": 1779813434.3760498, "step_id": 7503, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813434.39216, "step_id": 7504, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813434.4070861, "step_id": 7505, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813434.421053, "step_id": 7506, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813434.436615, "step_id": 7507, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813434.4516163, "step_id": 7508, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813434.4671137, "step_id": 7509, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813434.482166, "step_id": 7510, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813434.4963627, "step_id": 7511, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813434.5116022, "step_id": 7512, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813434.5272353, "step_id": 7513, "start_load_kv_us": 6, "get_finished_us": 151} +{"t_unix": 1779813434.5422127, "step_id": 7514, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813434.556952, "step_id": 7515, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813434.5716536, "step_id": 7516, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813434.58596, "step_id": 7517, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813434.6008675, "step_id": 7518, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813434.6152248, "step_id": 7519, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813434.630288, "step_id": 7520, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813434.643347, "step_id": 7521, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813434.657195, "step_id": 7522, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813434.671996, "step_id": 7523, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813434.6848643, "step_id": 7524, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813434.6991541, "step_id": 7525, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813434.7126305, "step_id": 7526, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813434.7252793, "step_id": 7527, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813434.7388692, "step_id": 7528, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813434.7539694, "step_id": 7529, "start_load_kv_us": 6, "get_finished_us": 200} +{"t_unix": 1779813434.767456, "step_id": 7530, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813434.7806947, "step_id": 7531, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813434.795387, "step_id": 7532, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813434.808685, "step_id": 7533, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813434.8233478, "step_id": 7534, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813434.8367171, "step_id": 7535, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813434.850905, "step_id": 7536, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813434.8636978, "step_id": 7537, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813434.877206, "step_id": 7538, "start_load_kv_us": 16, "get_finished_us": 212} +{"t_unix": 1779813434.8919177, "step_id": 7539, "start_load_kv_us": 16, "get_finished_us": 318} +{"t_unix": 1779813434.9050884, "step_id": 7540, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813434.9196637, "step_id": 7541, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813434.934, "step_id": 7542, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813434.9473293, "step_id": 7543, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813434.9609685, "step_id": 7544, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813434.9757884, "step_id": 7545, "start_load_kv_us": 6, "get_finished_us": 290} +{"t_unix": 1779813434.9894803, "step_id": 7546, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813435.0027995, "step_id": 7547, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813435.017135, "step_id": 7548, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813435.031411, "step_id": 7549, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813435.0451438, "step_id": 7550, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813435.0585284, "step_id": 7551, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813435.0733297, "step_id": 7552, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813435.0863972, "step_id": 7553, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813435.0998063, "step_id": 7554, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813435.114276, "step_id": 7555, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813435.1270907, "step_id": 7556, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813435.1411843, "step_id": 7557, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813435.1544, "step_id": 7558, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813435.1675618, "step_id": 7559, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813435.1812036, "step_id": 7560, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813435.1957686, "step_id": 7561, "start_load_kv_us": 6, "get_finished_us": 261} +{"t_unix": 1779813435.2101655, "step_id": 7562, "start_load_kv_us": 4, "get_finished_us": 305} +{"t_unix": 1779813435.2263877, "step_id": 7563, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813435.236459, "step_id": 7564, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813435.2493062, "step_id": 7565, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813435.2634807, "step_id": 7566, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813435.2762961, "step_id": 7567, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813435.2904992, "step_id": 7568, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813435.3028917, "step_id": 7569, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813435.3168812, "step_id": 7570, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813435.3308196, "step_id": 7571, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813435.343668, "step_id": 7572, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813435.3580456, "step_id": 7573, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813435.3715715, "step_id": 7574, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813435.3909879, "step_id": 7575, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813435.3983614, "step_id": 7576, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813435.4126062, "step_id": 7577, "start_load_kv_us": 5, "get_finished_us": 247} +{"t_unix": 1779813435.4260314, "step_id": 7578, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813435.4392328, "step_id": 7579, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813435.4535213, "step_id": 7580, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813435.4664226, "step_id": 7581, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813435.480576, "step_id": 7582, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813435.4932468, "step_id": 7583, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813435.5078359, "step_id": 7584, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813435.5210936, "step_id": 7585, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813435.535156, "step_id": 7586, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813435.549582, "step_id": 7587, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813435.562369, "step_id": 7588, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813435.5762265, "step_id": 7589, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813435.5895796, "step_id": 7590, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813435.6023417, "step_id": 7591, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813435.6159258, "step_id": 7592, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813435.6296296, "step_id": 7593, "start_load_kv_us": 6, "get_finished_us": 166} +{"t_unix": 1779813435.6427698, "step_id": 7594, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813435.6554923, "step_id": 7595, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813435.6698396, "step_id": 7596, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813435.6824653, "step_id": 7597, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813435.6964176, "step_id": 7598, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813435.7092197, "step_id": 7599, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813435.724173, "step_id": 7600, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813435.7389314, "step_id": 7601, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813435.752243, "step_id": 7602, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813435.7670994, "step_id": 7603, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813435.7805598, "step_id": 7604, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813435.795642, "step_id": 7605, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813435.8103504, "step_id": 7606, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813435.8240356, "step_id": 7607, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813435.8382387, "step_id": 7608, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813435.8533177, "step_id": 7609, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813435.8676057, "step_id": 7610, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813435.8812604, "step_id": 7611, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813435.8960526, "step_id": 7612, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813435.90956, "step_id": 7613, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813435.9247994, "step_id": 7614, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813435.938335, "step_id": 7615, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813435.952965, "step_id": 7616, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813435.9659975, "step_id": 7617, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813435.9798949, "step_id": 7618, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813435.995139, "step_id": 7619, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813436.044124, "step_id": 7620, "start_load_kv_us": 128, "get_finished_us": 269} +{"t_unix": 1779813436.0483286, "step_id": 7621, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813436.2613645, "step_id": 7622, "start_load_kv_us": 5, "get_finished_us": 296} +{"t_unix": 1779813436.2714252, "step_id": 7623, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813436.2802014, "step_id": 7624, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813436.2903066, "step_id": 7625, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813436.298929, "step_id": 7626, "start_load_kv_us": 7, "get_finished_us": 157} +{"t_unix": 1779813436.3080287, "step_id": 7627, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813436.3176918, "step_id": 7628, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813436.3270864, "step_id": 7629, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813436.3369188, "step_id": 7630, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813436.3456414, "step_id": 7631, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813436.3550224, "step_id": 7632, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813436.3651695, "step_id": 7633, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813436.3737247, "step_id": 7634, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813436.3838308, "step_id": 7635, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813436.3927286, "step_id": 7636, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813436.4025238, "step_id": 7637, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813436.4130127, "step_id": 7638, "start_load_kv_us": 3, "get_finished_us": 174} +{"t_unix": 1779813436.4222493, "step_id": 7639, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813436.4318087, "step_id": 7640, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813436.442159, "step_id": 7641, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813436.4508376, "step_id": 7642, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813436.4609127, "step_id": 7643, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813436.470659, "step_id": 7644, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813436.4799623, "step_id": 7645, "start_load_kv_us": 1, "get_finished_us": 237} +{"t_unix": 1779813436.4898105, "step_id": 7646, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813436.5000615, "step_id": 7647, "start_load_kv_us": 3, "get_finished_us": 149} +{"t_unix": 1779813436.507074, "step_id": 7648, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813436.515011, "step_id": 7649, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813436.5216494, "step_id": 7650, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813436.52917, "step_id": 7651, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813436.5368078, "step_id": 7652, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813436.543967, "step_id": 7653, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813436.5519772, "step_id": 7654, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813436.558648, "step_id": 7655, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813436.5659537, "step_id": 7656, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813436.5741606, "step_id": 7657, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813436.5809216, "step_id": 7658, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813436.5883207, "step_id": 7659, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813436.595716, "step_id": 7660, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813436.6028864, "step_id": 7661, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813436.6099102, "step_id": 7662, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813436.6173565, "step_id": 7663, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813436.6232588, "step_id": 7664, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813436.6298459, "step_id": 7665, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813436.6338975, "step_id": 7666, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813436.638641, "step_id": 7667, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813436.643326, "step_id": 7668, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813436.648209, "step_id": 7669, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813436.6529164, "step_id": 7670, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813436.6577415, "step_id": 7671, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813436.6628258, "step_id": 7672, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813436.6672642, "step_id": 7673, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813436.6719613, "step_id": 7674, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813436.676738, "step_id": 7675, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813436.6816213, "step_id": 7676, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813436.6863291, "step_id": 7677, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813436.6910713, "step_id": 7678, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813436.6959941, "step_id": 7679, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813436.7006717, "step_id": 7680, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813436.7060976, "step_id": 7681, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813436.7101448, "step_id": 7682, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813436.7149904, "step_id": 7683, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813436.7197156, "step_id": 7684, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813436.7245185, "step_id": 7685, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813436.729219, "step_id": 7686, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813436.7339983, "step_id": 7687, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813436.7389677, "step_id": 7688, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813436.74358, "step_id": 7689, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813436.7483516, "step_id": 7690, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813436.753049, "step_id": 7691, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813436.758241, "step_id": 7692, "start_load_kv_us": 2, "get_finished_us": 362} +{"t_unix": 1779813436.7630374, "step_id": 7693, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813436.7675629, "step_id": 7694, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813436.772273, "step_id": 7695, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813436.7770808, "step_id": 7696, "start_load_kv_us": 1, "get_finished_us": 198} +{"t_unix": 1779813436.782719, "step_id": 7697, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813436.786619, "step_id": 7698, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813436.7913203, "step_id": 7699, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813436.796111, "step_id": 7700, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813436.8009233, "step_id": 7701, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813436.8057358, "step_id": 7702, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813436.8104212, "step_id": 7703, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813436.8152628, "step_id": 7704, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813436.8200107, "step_id": 7705, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813436.8248577, "step_id": 7706, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813436.829515, "step_id": 7707, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813436.8343961, "step_id": 7708, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813436.8391123, "step_id": 7709, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813436.843913, "step_id": 7710, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813436.8486989, "step_id": 7711, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813436.8533673, "step_id": 7712, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813436.8589203, "step_id": 7713, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813436.8629766, "step_id": 7714, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813436.8677778, "step_id": 7715, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813436.8725138, "step_id": 7716, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813436.8773706, "step_id": 7717, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813436.8821216, "step_id": 7718, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813436.8869581, "step_id": 7719, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813436.891728, "step_id": 7720, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813436.8965578, "step_id": 7721, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813436.9012535, "step_id": 7722, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813436.905979, "step_id": 7723, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813436.9108176, "step_id": 7724, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813436.9157245, "step_id": 7725, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813436.9203265, "step_id": 7726, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813436.925044, "step_id": 7727, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813436.9298472, "step_id": 7728, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813436.9353688, "step_id": 7729, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813436.9394798, "step_id": 7730, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813436.944198, "step_id": 7731, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813436.9489527, "step_id": 7732, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813436.9537394, "step_id": 7733, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813436.9586997, "step_id": 7734, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813436.964394, "step_id": 7735, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813436.9682868, "step_id": 7736, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813436.9730775, "step_id": 7737, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813436.9780045, "step_id": 7738, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813436.9825811, "step_id": 7739, "start_load_kv_us": 1, "get_finished_us": 266} +{"t_unix": 1779813436.9871936, "step_id": 7740, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813436.9920733, "step_id": 7741, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813436.997026, "step_id": 7742, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813437.0016701, "step_id": 7743, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813437.0064085, "step_id": 7744, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813437.0119188, "step_id": 7745, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813437.015953, "step_id": 7746, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813437.0206273, "step_id": 7747, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813437.025426, "step_id": 7748, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813437.0301752, "step_id": 7749, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813437.0349336, "step_id": 7750, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813437.039701, "step_id": 7751, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813437.0444262, "step_id": 7752, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813437.0492759, "step_id": 7753, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813437.054024, "step_id": 7754, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813437.058808, "step_id": 7755, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813437.0636945, "step_id": 7756, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813437.0684593, "step_id": 7757, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813437.0731864, "step_id": 7758, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813437.0786712, "step_id": 7759, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813437.082779, "step_id": 7760, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813437.0881455, "step_id": 7761, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813437.0922987, "step_id": 7762, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813437.0970502, "step_id": 7763, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813437.10178, "step_id": 7764, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813437.106564, "step_id": 7765, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813437.1113722, "step_id": 7766, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813437.1161263, "step_id": 7767, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813437.1209924, "step_id": 7768, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813437.1257412, "step_id": 7769, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813437.1305304, "step_id": 7770, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813437.1353288, "step_id": 7771, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813437.1400135, "step_id": 7772, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813437.144864, "step_id": 7773, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813437.149658, "step_id": 7774, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813437.1544192, "step_id": 7775, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813437.1592264, "step_id": 7776, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813437.164695, "step_id": 7777, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813437.1688056, "step_id": 7778, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813437.1736207, "step_id": 7779, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813437.1783748, "step_id": 7780, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813437.1832747, "step_id": 7781, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813437.1879303, "step_id": 7782, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813437.192835, "step_id": 7783, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813437.1975431, "step_id": 7784, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813437.2022145, "step_id": 7785, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813437.2070446, "step_id": 7786, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813437.2117867, "step_id": 7787, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813437.2166548, "step_id": 7788, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813437.2213807, "step_id": 7789, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813437.226189, "step_id": 7790, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813437.23098, "step_id": 7791, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813437.235742, "step_id": 7792, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813437.2411864, "step_id": 7793, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813437.2453184, "step_id": 7794, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813437.2501152, "step_id": 7795, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813437.2549007, "step_id": 7796, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813437.259607, "step_id": 7797, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813437.2643805, "step_id": 7798, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813437.2691593, "step_id": 7799, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813437.2739594, "step_id": 7800, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813437.2786837, "step_id": 7801, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813437.2836058, "step_id": 7802, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813437.288338, "step_id": 7803, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813437.2930284, "step_id": 7804, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813437.2977562, "step_id": 7805, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813437.3025885, "step_id": 7806, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813437.307304, "step_id": 7807, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813437.3121002, "step_id": 7808, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813437.3176258, "step_id": 7809, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813437.3216765, "step_id": 7810, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813437.3265202, "step_id": 7811, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813437.3313053, "step_id": 7812, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813437.336084, "step_id": 7813, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813437.340816, "step_id": 7814, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813437.3455787, "step_id": 7815, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813437.3503823, "step_id": 7816, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813437.3551948, "step_id": 7817, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813437.3599079, "step_id": 7818, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813437.3647218, "step_id": 7819, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813437.3694813, "step_id": 7820, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813437.3742955, "step_id": 7821, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813437.3790965, "step_id": 7822, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813437.3838997, "step_id": 7823, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813437.388621, "step_id": 7824, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813437.3940783, "step_id": 7825, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813437.3982382, "step_id": 7826, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813437.4029994, "step_id": 7827, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813437.407749, "step_id": 7828, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813437.4125834, "step_id": 7829, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813437.4172838, "step_id": 7830, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813437.4220834, "step_id": 7831, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813437.426852, "step_id": 7832, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813437.4316366, "step_id": 7833, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813437.4364314, "step_id": 7834, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813437.4412556, "step_id": 7835, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813437.4459636, "step_id": 7836, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813437.4507463, "step_id": 7837, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813437.455469, "step_id": 7838, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813437.4602468, "step_id": 7839, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813437.4650424, "step_id": 7840, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813437.4704084, "step_id": 7841, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813437.4745867, "step_id": 7842, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813437.4793594, "step_id": 7843, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813437.4841795, "step_id": 7844, "start_load_kv_us": 1, "get_finished_us": 131} +{"t_unix": 1779813437.4889798, "step_id": 7845, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813437.4937131, "step_id": 7846, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813437.498515, "step_id": 7847, "start_load_kv_us": 1, "get_finished_us": 195} +{"t_unix": 1779813437.5032651, "step_id": 7848, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813437.5080783, "step_id": 7849, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813437.5128205, "step_id": 7850, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813437.5175893, "step_id": 7851, "start_load_kv_us": 1, "get_finished_us": 182} +{"t_unix": 1779813437.5223348, "step_id": 7852, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813437.527182, "step_id": 7853, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813437.5318844, "step_id": 7854, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813437.5367048, "step_id": 7855, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813437.5415156, "step_id": 7856, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813437.5468538, "step_id": 7857, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813437.5510101, "step_id": 7858, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813437.5558026, "step_id": 7859, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813437.5606065, "step_id": 7860, "start_load_kv_us": 1, "get_finished_us": 241} +{"t_unix": 1779813437.5653965, "step_id": 7861, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813437.5701556, "step_id": 7862, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813437.5749795, "step_id": 7863, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813437.5796945, "step_id": 7864, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813437.584475, "step_id": 7865, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813437.5892687, "step_id": 7866, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813437.5940087, "step_id": 7867, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813437.5988073, "step_id": 7868, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813437.6035779, "step_id": 7869, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813437.608386, "step_id": 7870, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813437.613154, "step_id": 7871, "start_load_kv_us": 13, "get_finished_us": 170} +{"t_unix": 1779813437.617977, "step_id": 7872, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813437.6234877, "step_id": 7873, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813437.627508, "step_id": 7874, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813437.632347, "step_id": 7875, "start_load_kv_us": 1, "get_finished_us": 209} +{"t_unix": 1779813437.6366787, "step_id": 7876, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813437.6407166, "step_id": 7877, "start_load_kv_us": 1, "get_finished_us": 207} +{"t_unix": 1779813439.159886, "step_id": 7878, "start_load_kv_us": 158, "get_finished_us": 382} +{"t_unix": 1779813439.1641848, "step_id": 7879, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813439.351421, "step_id": 7880, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813439.3554566, "step_id": 7881, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813439.3601036, "step_id": 7882, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813439.3644667, "step_id": 7883, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813439.369503, "step_id": 7884, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813439.3742101, "step_id": 7885, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813439.3798172, "step_id": 7886, "start_load_kv_us": 6, "get_finished_us": 174} +{"t_unix": 1779813439.3835382, "step_id": 7887, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813439.3884573, "step_id": 7888, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813439.393308, "step_id": 7889, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813439.3981607, "step_id": 7890, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813439.402705, "step_id": 7891, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813439.4074807, "step_id": 7892, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813439.4123144, "step_id": 7893, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813439.4168804, "step_id": 7894, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813439.421665, "step_id": 7895, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813439.4264524, "step_id": 7896, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813439.4311595, "step_id": 7897, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813439.4360328, "step_id": 7898, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813439.44097, "step_id": 7899, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813439.4457974, "step_id": 7900, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813439.450475, "step_id": 7901, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813439.455988, "step_id": 7902, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813439.4598236, "step_id": 7903, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813439.4649608, "step_id": 7904, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813439.469648, "step_id": 7905, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813439.4743557, "step_id": 7906, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813439.4790943, "step_id": 7907, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813439.4836674, "step_id": 7908, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813439.4883277, "step_id": 7909, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813439.4933524, "step_id": 7910, "start_load_kv_us": 3, "get_finished_us": 204} +{"t_unix": 1779813439.4978647, "step_id": 7911, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813439.5027194, "step_id": 7912, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813439.5136194, "step_id": 7913, "start_load_kv_us": 2, "get_finished_us": 1261} +{"t_unix": 1779813439.5175655, "step_id": 7914, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813439.521294, "step_id": 7915, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813439.525277, "step_id": 7916, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813439.5299904, "step_id": 7917, "start_load_kv_us": 1, "get_finished_us": 212} +{"t_unix": 1779813439.5360162, "step_id": 7918, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813439.5399265, "step_id": 7919, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813439.5444944, "step_id": 7920, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813439.549296, "step_id": 7921, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813439.5543013, "step_id": 7922, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813439.5588772, "step_id": 7923, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813439.5632288, "step_id": 7924, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813439.5679386, "step_id": 7925, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813439.5727768, "step_id": 7926, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813439.5774894, "step_id": 7927, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813439.5822718, "step_id": 7928, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813439.587046, "step_id": 7929, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813439.5918398, "step_id": 7930, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813439.596599, "step_id": 7931, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813439.6014621, "step_id": 7932, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813439.606186, "step_id": 7933, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813439.6115735, "step_id": 7934, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813439.6156485, "step_id": 7935, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813439.620451, "step_id": 7936, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813439.625238, "step_id": 7937, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813439.6301503, "step_id": 7938, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813439.634805, "step_id": 7939, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813439.6395602, "step_id": 7940, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813439.644406, "step_id": 7941, "start_load_kv_us": 1, "get_finished_us": 225} +{"t_unix": 1779813439.6491125, "step_id": 7942, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813439.6539946, "step_id": 7943, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813439.6586998, "step_id": 7944, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813439.663474, "step_id": 7945, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813439.6683402, "step_id": 7946, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813439.673067, "step_id": 7947, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813439.6777747, "step_id": 7948, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813439.6826499, "step_id": 7949, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813439.688198, "step_id": 7950, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813439.6921723, "step_id": 7951, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813439.6969264, "step_id": 7952, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813439.7016675, "step_id": 7953, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813439.70642, "step_id": 7954, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813439.7112446, "step_id": 7955, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813439.7160773, "step_id": 7956, "start_load_kv_us": 1, "get_finished_us": 248} +{"t_unix": 1779813439.7207923, "step_id": 7957, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813439.7256036, "step_id": 7958, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813439.730377, "step_id": 7959, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813439.7351518, "step_id": 7960, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813439.7399337, "step_id": 7961, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813439.7446702, "step_id": 7962, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813439.7494903, "step_id": 7963, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813439.7542474, "step_id": 7964, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813439.7590508, "step_id": 7965, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813439.7645853, "step_id": 7966, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813439.7686408, "step_id": 7967, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813439.7734797, "step_id": 7968, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813439.7781913, "step_id": 7969, "start_load_kv_us": 1, "get_finished_us": 255} +{"t_unix": 1779813439.7828305, "step_id": 7970, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813439.7876105, "step_id": 7971, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813439.7924764, "step_id": 7972, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813439.797141, "step_id": 7973, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813439.8019042, "step_id": 7974, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813439.8067312, "step_id": 7975, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813439.8116562, "step_id": 7976, "start_load_kv_us": 2, "get_finished_us": 333} +{"t_unix": 1779813439.816364, "step_id": 7977, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813439.8209822, "step_id": 7978, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813439.8256953, "step_id": 7979, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813439.8304608, "step_id": 7980, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813439.835269, "step_id": 7981, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813439.840723, "step_id": 7982, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813439.844886, "step_id": 7983, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813439.8495638, "step_id": 7984, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813439.854399, "step_id": 7985, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813439.8591745, "step_id": 7986, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813439.8639846, "step_id": 7987, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813439.8688068, "step_id": 7988, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813439.8735187, "step_id": 7989, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813439.878418, "step_id": 7990, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813439.8831267, "step_id": 7991, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813439.8879008, "step_id": 7992, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813439.8926442, "step_id": 7993, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813439.8974, "step_id": 7994, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813439.9022431, "step_id": 7995, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813439.907043, "step_id": 7996, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813439.9118571, "step_id": 7997, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813439.9173386, "step_id": 7998, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813439.9215088, "step_id": 7999, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813439.9262774, "step_id": 8000, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813439.9310014, "step_id": 8001, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813439.9357593, "step_id": 8002, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813439.9405565, "step_id": 8003, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813439.9453425, "step_id": 8004, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813439.9521098, "step_id": 8005, "start_load_kv_us": 2, "get_finished_us": 1259} +{"t_unix": 1779813439.9590127, "step_id": 8006, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813439.9623716, "step_id": 8007, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813439.9666216, "step_id": 8008, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813439.9714234, "step_id": 8009, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813439.9762232, "step_id": 8010, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813439.9810069, "step_id": 8011, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813439.985924, "step_id": 8012, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813439.9908063, "step_id": 8013, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813439.9962335, "step_id": 8014, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813440.00022, "step_id": 8015, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813440.0049994, "step_id": 8016, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813440.0096946, "step_id": 8017, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813440.014525, "step_id": 8018, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813440.0192192, "step_id": 8019, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813440.0240436, "step_id": 8020, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813440.0287392, "step_id": 8021, "start_load_kv_us": 13, "get_finished_us": 148} +{"t_unix": 1779813440.0335803, "step_id": 8022, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813440.0383356, "step_id": 8023, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813440.0431101, "step_id": 8024, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813440.0478532, "step_id": 8025, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813440.0526922, "step_id": 8026, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813440.057413, "step_id": 8027, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813440.0622225, "step_id": 8028, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813440.0669365, "step_id": 8029, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813440.0724573, "step_id": 8030, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813440.076646, "step_id": 8031, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813440.0813632, "step_id": 8032, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813440.0861673, "step_id": 8033, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813440.0910127, "step_id": 8034, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813440.0956707, "step_id": 8035, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813440.100474, "step_id": 8036, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813440.1053169, "step_id": 8037, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813440.1101253, "step_id": 8038, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813440.1148953, "step_id": 8039, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813440.1196964, "step_id": 8040, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813440.1243875, "step_id": 8041, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813440.1291418, "step_id": 8042, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813440.1340282, "step_id": 8043, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813440.138904, "step_id": 8044, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813440.143607, "step_id": 8045, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813440.1491842, "step_id": 8046, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813440.1531217, "step_id": 8047, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813440.1578667, "step_id": 8048, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813440.1627097, "step_id": 8049, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813440.167392, "step_id": 8050, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813440.172263, "step_id": 8051, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813440.1770098, "step_id": 8052, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813440.1817577, "step_id": 8053, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813440.1865854, "step_id": 8054, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813440.1913817, "step_id": 8055, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.196157, "step_id": 8056, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813440.2008822, "step_id": 8057, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813440.2068899, "step_id": 8058, "start_load_kv_us": 2, "get_finished_us": 1383} +{"t_unix": 1779813440.2104628, "step_id": 8059, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813440.215299, "step_id": 8060, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813440.2200375, "step_id": 8061, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.2255442, "step_id": 8062, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813440.2296007, "step_id": 8063, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813440.2343457, "step_id": 8064, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813440.2391129, "step_id": 8065, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813440.2439816, "step_id": 8066, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813440.2487438, "step_id": 8067, "start_load_kv_us": 11, "get_finished_us": 155} +{"t_unix": 1779813440.2535057, "step_id": 8068, "start_load_kv_us": 7, "get_finished_us": 156} +{"t_unix": 1779813440.2583334, "step_id": 8069, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813440.2631454, "step_id": 8070, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813440.2680323, "step_id": 8071, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813440.2727494, "step_id": 8072, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.2774646, "step_id": 8073, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813440.2822978, "step_id": 8074, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813440.2871017, "step_id": 8075, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813440.2919002, "step_id": 8076, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813440.2965627, "step_id": 8077, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813440.3020518, "step_id": 8078, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813440.306398, "step_id": 8079, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813440.3109972, "step_id": 8080, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813440.3157463, "step_id": 8081, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813440.3205605, "step_id": 8082, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813440.3253605, "step_id": 8083, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813440.3301394, "step_id": 8084, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813440.3348768, "step_id": 8085, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813440.3396764, "step_id": 8086, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813440.3444571, "step_id": 8087, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813440.3492374, "step_id": 8088, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813440.354031, "step_id": 8089, "start_load_kv_us": 3, "get_finished_us": 195} +{"t_unix": 1779813440.358795, "step_id": 8090, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813440.3635588, "step_id": 8091, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813440.3683853, "step_id": 8092, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813440.3733313, "step_id": 8093, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813440.3786314, "step_id": 8094, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813440.3827543, "step_id": 8095, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813440.3876207, "step_id": 8096, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813440.3923855, "step_id": 8097, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813440.397049, "step_id": 8098, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813440.401869, "step_id": 8099, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813440.4066691, "step_id": 8100, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813440.411456, "step_id": 8101, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813440.416114, "step_id": 8102, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813440.4223464, "step_id": 8103, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813440.425756, "step_id": 8104, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813440.4304688, "step_id": 8105, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813440.4352937, "step_id": 8106, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813440.4400837, "step_id": 8107, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813440.4448235, "step_id": 8108, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813440.449646, "step_id": 8109, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813440.4552102, "step_id": 8110, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813440.4592843, "step_id": 8111, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813440.4640284, "step_id": 8112, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813440.468792, "step_id": 8113, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813440.4735637, "step_id": 8114, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813440.4783123, "step_id": 8115, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813440.4830663, "step_id": 8116, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813440.487854, "step_id": 8117, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813440.4961605, "step_id": 8118, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813440.4993818, "step_id": 8119, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.5037777, "step_id": 8120, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.5085816, "step_id": 8121, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813440.5134962, "step_id": 8122, "start_load_kv_us": 1, "get_finished_us": 238} +{"t_unix": 1779813440.518164, "step_id": 8123, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813440.5229008, "step_id": 8124, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813440.5276031, "step_id": 8125, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.5330906, "step_id": 8126, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813440.5372612, "step_id": 8127, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813440.5419781, "step_id": 8128, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813440.5467715, "step_id": 8129, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813440.5514834, "step_id": 8130, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813440.5562727, "step_id": 8131, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813440.561066, "step_id": 8132, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813440.5658486, "step_id": 8133, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813440.5701208, "step_id": 8134, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813440.5743778, "step_id": 8135, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813440.87128, "step_id": 8136, "start_load_kv_us": 135, "get_finished_us": 291} +{"t_unix": 1779813440.8748188, "step_id": 8137, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813441.0679138, "step_id": 8138, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813441.072114, "step_id": 8139, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813441.076874, "step_id": 8140, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813441.0815237, "step_id": 8141, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813441.0863783, "step_id": 8142, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813441.0911102, "step_id": 8143, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.0958388, "step_id": 8144, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.1006243, "step_id": 8145, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813441.1053896, "step_id": 8146, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813441.110923, "step_id": 8147, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813441.1149988, "step_id": 8148, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813441.1197274, "step_id": 8149, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813441.1244688, "step_id": 8150, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813441.129252, "step_id": 8151, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813441.1340413, "step_id": 8152, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813441.138813, "step_id": 8153, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813441.1435983, "step_id": 8154, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.148357, "step_id": 8155, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.153148, "step_id": 8156, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813441.1579564, "step_id": 8157, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813441.1626909, "step_id": 8158, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813441.1676164, "step_id": 8159, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813441.1726377, "step_id": 8160, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813441.1770303, "step_id": 8161, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813441.1818109, "step_id": 8162, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813441.1871765, "step_id": 8163, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813441.1912732, "step_id": 8164, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813441.196078, "step_id": 8165, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813441.2008708, "step_id": 8166, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813441.2054865, "step_id": 8167, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813441.2102559, "step_id": 8168, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.215042, "step_id": 8169, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813441.219793, "step_id": 8170, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.2245421, "step_id": 8171, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813441.2293394, "step_id": 8172, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813441.2341192, "step_id": 8173, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813441.2388859, "step_id": 8174, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813441.2435827, "step_id": 8175, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813441.2483902, "step_id": 8176, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813441.2531443, "step_id": 8177, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813441.2579303, "step_id": 8178, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.2633667, "step_id": 8179, "start_load_kv_us": 5, "get_finished_us": 140} +{"t_unix": 1779813441.2674878, "step_id": 8180, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813441.272315, "step_id": 8181, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.277131, "step_id": 8182, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.2818584, "step_id": 8183, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.2865405, "step_id": 8184, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.2914596, "step_id": 8185, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813441.2963047, "step_id": 8186, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813441.3010728, "step_id": 8187, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813441.3058462, "step_id": 8188, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813441.3106356, "step_id": 8189, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813441.3153965, "step_id": 8190, "start_load_kv_us": 1, "get_finished_us": 253} +{"t_unix": 1779813441.320076, "step_id": 8191, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813441.3248448, "step_id": 8192, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813441.3296008, "step_id": 8193, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813441.3343422, "step_id": 8194, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813441.3400269, "step_id": 8195, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813441.343938, "step_id": 8196, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.3486745, "step_id": 8197, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813441.3534548, "step_id": 8198, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813441.3581738, "step_id": 8199, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.3629596, "step_id": 8200, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813441.3676693, "step_id": 8201, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813441.3725739, "step_id": 8202, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813441.3773577, "step_id": 8203, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.3820403, "step_id": 8204, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.3867676, "step_id": 8205, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813441.3915315, "step_id": 8206, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.3963184, "step_id": 8207, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813441.4010906, "step_id": 8208, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813441.4058757, "step_id": 8209, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813441.4106283, "step_id": 8210, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.4161122, "step_id": 8211, "start_load_kv_us": 4, "get_finished_us": 138} +{"t_unix": 1779813441.42021, "step_id": 8212, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813441.424935, "step_id": 8213, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.4297605, "step_id": 8214, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813441.4344969, "step_id": 8215, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813441.439322, "step_id": 8216, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.4441016, "step_id": 8217, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813441.4489582, "step_id": 8218, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813441.453657, "step_id": 8219, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813441.4583895, "step_id": 8220, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813441.4631748, "step_id": 8221, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.4679403, "step_id": 8222, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813441.4727218, "step_id": 8223, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.477635, "step_id": 8224, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813441.4823084, "step_id": 8225, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813441.48711, "step_id": 8226, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813441.4924662, "step_id": 8227, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813441.4966612, "step_id": 8228, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813441.501409, "step_id": 8229, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.506384, "step_id": 8230, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813441.5109766, "step_id": 8231, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813441.5157838, "step_id": 8232, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813441.5205348, "step_id": 8233, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813441.525312, "step_id": 8234, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813441.5300403, "step_id": 8235, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813441.5347824, "step_id": 8236, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.5396237, "step_id": 8237, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813441.5444021, "step_id": 8238, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813441.5491648, "step_id": 8239, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813441.5538993, "step_id": 8240, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813441.558662, "step_id": 8241, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813441.563431, "step_id": 8242, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813441.5688515, "step_id": 8243, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813441.57299, "step_id": 8244, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813441.5778174, "step_id": 8245, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.5825324, "step_id": 8246, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813441.587297, "step_id": 8247, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813441.592062, "step_id": 8248, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.5968335, "step_id": 8249, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813441.6016417, "step_id": 8250, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813441.6063657, "step_id": 8251, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813441.6111724, "step_id": 8252, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813441.6159668, "step_id": 8253, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813441.620726, "step_id": 8254, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813441.6255617, "step_id": 8255, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813441.6303294, "step_id": 8256, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813441.6350787, "step_id": 8257, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813441.6398861, "step_id": 8258, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813441.6453013, "step_id": 8259, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813441.6494691, "step_id": 8260, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813441.6542828, "step_id": 8261, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813441.659053, "step_id": 8262, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813441.663886, "step_id": 8263, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.6686742, "step_id": 8264, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813441.673474, "step_id": 8265, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813441.678296, "step_id": 8266, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.683049, "step_id": 8267, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813441.6877844, "step_id": 8268, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.692527, "step_id": 8269, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813441.6972885, "step_id": 8270, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813441.7021115, "step_id": 8271, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.7069187, "step_id": 8272, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813441.711649, "step_id": 8273, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813441.7164798, "step_id": 8274, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813441.7218812, "step_id": 8275, "start_load_kv_us": 4, "get_finished_us": 132} +{"t_unix": 1779813441.7260573, "step_id": 8276, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813441.7308633, "step_id": 8277, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.7356691, "step_id": 8278, "start_load_kv_us": 16, "get_finished_us": 185} +{"t_unix": 1779813441.740469, "step_id": 8279, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813441.7451782, "step_id": 8280, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813441.7498782, "step_id": 8281, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813441.7547028, "step_id": 8282, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813441.7594087, "step_id": 8283, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813441.7642097, "step_id": 8284, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.7690506, "step_id": 8285, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813441.7738128, "step_id": 8286, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813441.7785995, "step_id": 8287, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813441.7833917, "step_id": 8288, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813441.7881303, "step_id": 8289, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813441.7929218, "step_id": 8290, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813441.7984278, "step_id": 8291, "start_load_kv_us": 4, "get_finished_us": 137} +{"t_unix": 1779813441.802534, "step_id": 8292, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.8072665, "step_id": 8293, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813441.8121138, "step_id": 8294, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813441.8168464, "step_id": 8295, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813441.8216405, "step_id": 8296, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813441.8264546, "step_id": 8297, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813441.8311567, "step_id": 8298, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813441.8360164, "step_id": 8299, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813441.84077, "step_id": 8300, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813441.845584, "step_id": 8301, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813441.850371, "step_id": 8302, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.855195, "step_id": 8303, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.8599784, "step_id": 8304, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813441.8647072, "step_id": 8305, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813441.8694677, "step_id": 8306, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813441.874874, "step_id": 8307, "start_load_kv_us": 19, "get_finished_us": 132} +{"t_unix": 1779813441.8790724, "step_id": 8308, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813441.883955, "step_id": 8309, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813441.8886335, "step_id": 8310, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.8934636, "step_id": 8311, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813441.8983219, "step_id": 8312, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.9029915, "step_id": 8313, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813441.9078362, "step_id": 8314, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.9126081, "step_id": 8315, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813441.91738, "step_id": 8316, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813441.922166, "step_id": 8317, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813441.926952, "step_id": 8318, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813441.9317408, "step_id": 8319, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813441.9364953, "step_id": 8320, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813441.9412951, "step_id": 8321, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813441.9461737, "step_id": 8322, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813441.9516482, "step_id": 8323, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813441.9558015, "step_id": 8324, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813441.9605088, "step_id": 8325, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.9652734, "step_id": 8326, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.9701376, "step_id": 8327, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813441.9748504, "step_id": 8328, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813441.9796052, "step_id": 8329, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813441.984473, "step_id": 8330, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813441.9892442, "step_id": 8331, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813441.994064, "step_id": 8332, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813441.998892, "step_id": 8333, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813442.003595, "step_id": 8334, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813442.008416, "step_id": 8335, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813442.0132012, "step_id": 8336, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813442.017885, "step_id": 8337, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813442.0226536, "step_id": 8338, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813442.0281355, "step_id": 8339, "start_load_kv_us": 5, "get_finished_us": 141} +{"t_unix": 1779813442.0321956, "step_id": 8340, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813442.037017, "step_id": 8341, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813442.0417824, "step_id": 8342, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813442.0465775, "step_id": 8343, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813442.0513656, "step_id": 8344, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813442.0562246, "step_id": 8345, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813442.060909, "step_id": 8346, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813442.0656784, "step_id": 8347, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813442.070498, "step_id": 8348, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813442.0753825, "step_id": 8349, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813442.0801551, "step_id": 8350, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813442.084915, "step_id": 8351, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813442.0896142, "step_id": 8352, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813442.0943606, "step_id": 8353, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813442.0991728, "step_id": 8354, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813442.1046512, "step_id": 8355, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813442.1086957, "step_id": 8356, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813442.113584, "step_id": 8357, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813442.1189806, "step_id": 8358, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813442.1233, "step_id": 8359, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813442.1279318, "step_id": 8360, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813442.1326277, "step_id": 8361, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813442.137404, "step_id": 8362, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813442.142185, "step_id": 8363, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813442.1470299, "step_id": 8364, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813442.1555533, "step_id": 8365, "start_load_kv_us": 15, "get_finished_us": 2377} +{"t_unix": 1779813442.165798, "step_id": 8366, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813442.1691272, "step_id": 8367, "start_load_kv_us": 1, "get_finished_us": 211} +{"t_unix": 1779813442.1733127, "step_id": 8368, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813442.1780882, "step_id": 8369, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813442.1829355, "step_id": 8370, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813442.1883054, "step_id": 8371, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813442.1924324, "step_id": 8372, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813442.1972318, "step_id": 8373, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813442.202043, "step_id": 8374, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813442.2067919, "step_id": 8375, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813442.211461, "step_id": 8376, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813442.2162356, "step_id": 8377, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813442.2210615, "step_id": 8378, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813442.2258112, "step_id": 8379, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813442.2305698, "step_id": 8380, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813442.2353804, "step_id": 8381, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813442.2401385, "step_id": 8382, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813442.2449746, "step_id": 8383, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813442.2496912, "step_id": 8384, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813442.2545588, "step_id": 8385, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813442.2592773, "step_id": 8386, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813442.2646854, "step_id": 8387, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813442.2688932, "step_id": 8388, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813442.2735791, "step_id": 8389, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813442.278388, "step_id": 8390, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813442.2831192, "step_id": 8391, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813442.2874694, "step_id": 8392, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813442.2916787, "step_id": 8393, "start_load_kv_us": 1, "get_finished_us": 209} +{"t_unix": 1779813442.4029813, "step_id": 8394, "start_load_kv_us": 139, "get_finished_us": 302} +{"t_unix": 1779813442.4062858, "step_id": 8395, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813442.6031806, "step_id": 8396, "start_load_kv_us": 2, "get_finished_us": 346} +{"t_unix": 1779813442.6072903, "step_id": 8397, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813442.6124697, "step_id": 8398, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813442.616501, "step_id": 8399, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813442.6212778, "step_id": 8400, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813442.6260211, "step_id": 8401, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813442.6307821, "step_id": 8402, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813442.635511, "step_id": 8403, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813442.6403039, "step_id": 8404, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813442.6450741, "step_id": 8405, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813442.649879, "step_id": 8406, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813442.6547267, "step_id": 8407, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813442.6594532, "step_id": 8408, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813442.664177, "step_id": 8409, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813442.6689987, "step_id": 8410, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813442.6737673, "step_id": 8411, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813442.678512, "step_id": 8412, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813442.6833115, "step_id": 8413, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813442.6887088, "step_id": 8414, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813442.692928, "step_id": 8415, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813442.697693, "step_id": 8416, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813442.70254, "step_id": 8417, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813442.7072165, "step_id": 8418, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813442.7119792, "step_id": 8419, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813442.7168071, "step_id": 8420, "start_load_kv_us": 23, "get_finished_us": 207} +{"t_unix": 1779813442.721574, "step_id": 8421, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813442.7262669, "step_id": 8422, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813442.7310448, "step_id": 8423, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813442.7358093, "step_id": 8424, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813442.7406204, "step_id": 8425, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813442.7453387, "step_id": 8426, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813442.7501242, "step_id": 8427, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813442.7549016, "step_id": 8428, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813442.7597, "step_id": 8429, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813442.765253, "step_id": 8430, "start_load_kv_us": 5, "get_finished_us": 255} +{"t_unix": 1779813442.7693613, "step_id": 8431, "start_load_kv_us": 1, "get_finished_us": 232} +{"t_unix": 1779813442.774111, "step_id": 8432, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813442.778969, "step_id": 8433, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813442.7836344, "step_id": 8434, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813442.7883682, "step_id": 8435, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813442.7931514, "step_id": 8436, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813442.7979224, "step_id": 8437, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813442.8027632, "step_id": 8438, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813442.8074274, "step_id": 8439, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813442.812274, "step_id": 8440, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813442.8169782, "step_id": 8441, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813442.8218102, "step_id": 8442, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813442.8265202, "step_id": 8443, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813442.8313272, "step_id": 8444, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813442.83623, "step_id": 8445, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813442.8415213, "step_id": 8446, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813442.8456514, "step_id": 8447, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813442.8504622, "step_id": 8448, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813442.855261, "step_id": 8449, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813442.8600442, "step_id": 8450, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813442.8648334, "step_id": 8451, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813442.869532, "step_id": 8452, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813442.8743908, "step_id": 8453, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813442.8791249, "step_id": 8454, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813442.883903, "step_id": 8455, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813442.888744, "step_id": 8456, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813442.8935297, "step_id": 8457, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813442.89833, "step_id": 8458, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813442.940588, "step_id": 8459, "start_load_kv_us": 167, "get_finished_us": 246} +{"t_unix": 1779813442.9440978, "step_id": 8460, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813443.1433246, "step_id": 8461, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813443.1491644, "step_id": 8462, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813443.1543233, "step_id": 8463, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813443.1603825, "step_id": 8464, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813443.166477, "step_id": 8465, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813443.17247, "step_id": 8466, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813443.178584, "step_id": 8467, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813443.1845064, "step_id": 8468, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813443.1902735, "step_id": 8469, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813443.196055, "step_id": 8470, "start_load_kv_us": 1, "get_finished_us": 235} +{"t_unix": 1779813443.2019932, "step_id": 8471, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813443.2078614, "step_id": 8472, "start_load_kv_us": 1, "get_finished_us": 217} +{"t_unix": 1779813443.2143476, "step_id": 8473, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813443.2194092, "step_id": 8474, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813443.224906, "step_id": 8475, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813443.230589, "step_id": 8476, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813443.236248, "step_id": 8477, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813443.2426934, "step_id": 8478, "start_load_kv_us": 16, "get_finished_us": 211} +{"t_unix": 1779813443.247805, "step_id": 8479, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813443.253498, "step_id": 8480, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813443.2590868, "step_id": 8481, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813443.2647307, "step_id": 8482, "start_load_kv_us": 1, "get_finished_us": 216} +{"t_unix": 1779813443.2704954, "step_id": 8483, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813443.2763748, "step_id": 8484, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813443.2822547, "step_id": 8485, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813443.2882745, "step_id": 8486, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813443.2940679, "step_id": 8487, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813443.2996485, "step_id": 8488, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813443.306079, "step_id": 8489, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813443.3109024, "step_id": 8490, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813443.3168535, "step_id": 8491, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813443.322762, "step_id": 8492, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813443.3284323, "step_id": 8493, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813443.3351064, "step_id": 8494, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813443.3400097, "step_id": 8495, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813443.3474188, "step_id": 8496, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813443.3516421, "step_id": 8497, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813443.3576405, "step_id": 8498, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813443.3634636, "step_id": 8499, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813443.3695116, "step_id": 8500, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813443.3752584, "step_id": 8501, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813443.3808668, "step_id": 8502, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813443.3868139, "step_id": 8503, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813443.3927045, "step_id": 8504, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813443.3990595, "step_id": 8505, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813443.4042053, "step_id": 8506, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813443.4098096, "step_id": 8507, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813443.415613, "step_id": 8508, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813443.421502, "step_id": 8509, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813443.428246, "step_id": 8510, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813443.4335268, "step_id": 8511, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813443.43922, "step_id": 8512, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813443.4447289, "step_id": 8513, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813443.4501982, "step_id": 8514, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813443.455873, "step_id": 8515, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813443.4619868, "step_id": 8516, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813443.4675126, "step_id": 8517, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813443.4732385, "step_id": 8518, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813443.4792995, "step_id": 8519, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813443.4850929, "step_id": 8520, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813443.4916973, "step_id": 8521, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813443.4972546, "step_id": 8522, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813443.5031407, "step_id": 8523, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813443.5091503, "step_id": 8524, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813443.5150065, "step_id": 8525, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813443.5213263, "step_id": 8526, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813443.5261254, "step_id": 8527, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813443.53178, "step_id": 8528, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813443.5374713, "step_id": 8529, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813443.5435417, "step_id": 8530, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813443.5492363, "step_id": 8531, "start_load_kv_us": 1, "get_finished_us": 191} +{"t_unix": 1779813443.5550358, "step_id": 8532, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813443.5608747, "step_id": 8533, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813443.5667632, "step_id": 8534, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813443.572838, "step_id": 8535, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813443.5785708, "step_id": 8536, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813443.5850108, "step_id": 8537, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813443.5902545, "step_id": 8538, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813443.5962393, "step_id": 8539, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813443.6022055, "step_id": 8540, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813443.6081712, "step_id": 8541, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813443.6147838, "step_id": 8542, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813443.6202493, "step_id": 8543, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813443.626216, "step_id": 8544, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813443.6324482, "step_id": 8545, "start_load_kv_us": 1, "get_finished_us": 268} +{"t_unix": 1779813443.6384997, "step_id": 8546, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813443.6444979, "step_id": 8547, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813443.6507044, "step_id": 8548, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813443.656582, "step_id": 8549, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813443.662474, "step_id": 8550, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813443.6682208, "step_id": 8551, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813443.6741436, "step_id": 8552, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813443.6805792, "step_id": 8553, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813443.6855865, "step_id": 8554, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813443.691199, "step_id": 8555, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813443.697124, "step_id": 8556, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813443.7031062, "step_id": 8557, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813443.7098398, "step_id": 8558, "start_load_kv_us": 4, "get_finished_us": 133} +{"t_unix": 1779813443.71519, "step_id": 8559, "start_load_kv_us": 1, "get_finished_us": 129} +{"t_unix": 1779813443.7214043, "step_id": 8560, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813443.7272997, "step_id": 8561, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813443.7333698, "step_id": 8562, "start_load_kv_us": 1, "get_finished_us": 130} +{"t_unix": 1779813443.7395275, "step_id": 8563, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813443.745719, "step_id": 8564, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813443.751643, "step_id": 8565, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813443.7574615, "step_id": 8566, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813443.762915, "step_id": 8567, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813443.7684119, "step_id": 8568, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813443.7748158, "step_id": 8569, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813443.7798803, "step_id": 8570, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813443.785397, "step_id": 8571, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813443.7911043, "step_id": 8572, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813443.796858, "step_id": 8573, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813443.8030567, "step_id": 8574, "start_load_kv_us": 4, "get_finished_us": 271} +{"t_unix": 1779813443.808199, "step_id": 8575, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813443.8140554, "step_id": 8576, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813443.8197331, "step_id": 8577, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813443.8255687, "step_id": 8578, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813443.8312893, "step_id": 8579, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813443.837281, "step_id": 8580, "start_load_kv_us": 1, "get_finished_us": 211} +{"t_unix": 1779813443.843001, "step_id": 8581, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813443.8488655, "step_id": 8582, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813443.854737, "step_id": 8583, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813443.860459, "step_id": 8584, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813443.8671286, "step_id": 8585, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813443.8723094, "step_id": 8586, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813443.8782828, "step_id": 8587, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813443.8842142, "step_id": 8588, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813443.8898401, "step_id": 8589, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813443.8964746, "step_id": 8590, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813443.9019592, "step_id": 8591, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813443.907809, "step_id": 8592, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813443.9137998, "step_id": 8593, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813443.9198983, "step_id": 8594, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813443.9260042, "step_id": 8595, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813443.9321933, "step_id": 8596, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813443.9383087, "step_id": 8597, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813443.9444642, "step_id": 8598, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813443.9504564, "step_id": 8599, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813443.9566302, "step_id": 8600, "start_load_kv_us": 14, "get_finished_us": 152} +{"t_unix": 1779813443.9633465, "step_id": 8601, "start_load_kv_us": 3, "get_finished_us": 144} +{"t_unix": 1779813443.9689171, "step_id": 8602, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813443.9749753, "step_id": 8603, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813443.9811041, "step_id": 8604, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813443.987082, "step_id": 8605, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813443.99386, "step_id": 8606, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813443.9993954, "step_id": 8607, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813444.0056956, "step_id": 8608, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813444.0118012, "step_id": 8609, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813444.0176606, "step_id": 8610, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813444.02349, "step_id": 8611, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813444.0293412, "step_id": 8612, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813444.034976, "step_id": 8613, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813444.0409138, "step_id": 8614, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813444.046821, "step_id": 8615, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813444.0522702, "step_id": 8616, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813444.0587494, "step_id": 8617, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813444.0636632, "step_id": 8618, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813444.0696583, "step_id": 8619, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813444.075452, "step_id": 8620, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813444.081307, "step_id": 8621, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813444.0878859, "step_id": 8622, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813444.0929172, "step_id": 8623, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813444.0988572, "step_id": 8624, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813444.1044326, "step_id": 8625, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813444.109872, "step_id": 8626, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813444.1157327, "step_id": 8627, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813444.1215887, "step_id": 8628, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813444.1276855, "step_id": 8629, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813444.133625, "step_id": 8630, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813444.139567, "step_id": 8631, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813444.1456802, "step_id": 8632, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813444.152248, "step_id": 8633, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813444.1576228, "step_id": 8634, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813444.163483, "step_id": 8635, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813444.1694934, "step_id": 8636, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813444.1753175, "step_id": 8637, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813444.1816826, "step_id": 8638, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813444.1867762, "step_id": 8639, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813444.1924813, "step_id": 8640, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813444.1984334, "step_id": 8641, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813444.204086, "step_id": 8642, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813444.2098768, "step_id": 8643, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813444.2157388, "step_id": 8644, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813444.221659, "step_id": 8645, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813444.2275302, "step_id": 8646, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813444.2334316, "step_id": 8647, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813444.2392817, "step_id": 8648, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813444.2458851, "step_id": 8649, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813444.2515366, "step_id": 8650, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813444.2574618, "step_id": 8651, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813444.2620986, "step_id": 8652, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813444.2668276, "step_id": 8653, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813444.2718704, "step_id": 8654, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813444.2767088, "step_id": 8655, "start_load_kv_us": 16, "get_finished_us": 226} +{"t_unix": 1779813444.281279, "step_id": 8656, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813444.286115, "step_id": 8657, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813444.2909968, "step_id": 8658, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813444.2956207, "step_id": 8659, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813444.3003964, "step_id": 8660, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813444.3052497, "step_id": 8661, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813444.309898, "step_id": 8662, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813444.3147151, "step_id": 8663, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813444.3195171, "step_id": 8664, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813444.3248882, "step_id": 8665, "start_load_kv_us": 5, "get_finished_us": 148} +{"t_unix": 1779813444.329053, "step_id": 8666, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813444.3338635, "step_id": 8667, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813444.3386705, "step_id": 8668, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813444.3434622, "step_id": 8669, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813444.3481636, "step_id": 8670, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813444.3529017, "step_id": 8671, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813444.357696, "step_id": 8672, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813444.3624644, "step_id": 8673, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813444.3671582, "step_id": 8674, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813444.371921, "step_id": 8675, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813444.376745, "step_id": 8676, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813444.3815572, "step_id": 8677, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813444.3863614, "step_id": 8678, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813444.3911643, "step_id": 8679, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813444.3961685, "step_id": 8680, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813444.4014277, "step_id": 8681, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813444.4055905, "step_id": 8682, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813444.4103477, "step_id": 8683, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813444.415141, "step_id": 8684, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813444.4199944, "step_id": 8685, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813444.4246647, "step_id": 8686, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813444.4294612, "step_id": 8687, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813444.4342487, "step_id": 8688, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813444.439006, "step_id": 8689, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813444.443899, "step_id": 8690, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813444.4484813, "step_id": 8691, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813444.4533398, "step_id": 8692, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813444.4582298, "step_id": 8693, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813444.463042, "step_id": 8694, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813444.4676692, "step_id": 8695, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813444.4724107, "step_id": 8696, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813444.4778938, "step_id": 8697, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813444.4820256, "step_id": 8698, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813444.4867725, "step_id": 8699, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813444.4915993, "step_id": 8700, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813444.4964, "step_id": 8701, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813444.50124, "step_id": 8702, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813444.50603, "step_id": 8703, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813444.510757, "step_id": 8704, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813444.5154965, "step_id": 8705, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813444.5203004, "step_id": 8706, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813444.5251114, "step_id": 8707, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813444.5298693, "step_id": 8708, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813444.5345945, "step_id": 8709, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813444.5394645, "step_id": 8710, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813444.5441127, "step_id": 8711, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813444.5488126, "step_id": 8712, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813444.5543382, "step_id": 8713, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813444.558509, "step_id": 8714, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813444.5628145, "step_id": 8715, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813444.5668766, "step_id": 8716, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813444.7233295, "step_id": 8717, "start_load_kv_us": 136, "get_finished_us": 314} +{"t_unix": 1779813444.7268384, "step_id": 8718, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813444.925242, "step_id": 8719, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813444.929143, "step_id": 8720, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813444.9337857, "step_id": 8721, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813444.9385264, "step_id": 8722, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813444.9434168, "step_id": 8723, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813444.9480984, "step_id": 8724, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813444.9529355, "step_id": 8725, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813444.9576287, "step_id": 8726, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813444.962338, "step_id": 8727, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813444.9671276, "step_id": 8728, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813444.971866, "step_id": 8729, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813444.9767618, "step_id": 8730, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813444.9814134, "step_id": 8731, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813444.9870627, "step_id": 8732, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813444.9910514, "step_id": 8733, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813444.9958215, "step_id": 8734, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813445.0005789, "step_id": 8735, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813445.0055602, "step_id": 8736, "start_load_kv_us": 1, "get_finished_us": 242} +{"t_unix": 1779813445.010212, "step_id": 8737, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813445.014928, "step_id": 8738, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813445.0196629, "step_id": 8739, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813445.0244725, "step_id": 8740, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813445.0291913, "step_id": 8741, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813445.034049, "step_id": 8742, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813445.038782, "step_id": 8743, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813445.0435073, "step_id": 8744, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813445.04827, "step_id": 8745, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813445.0530398, "step_id": 8746, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813445.0578141, "step_id": 8747, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813445.063199, "step_id": 8748, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813445.0675113, "step_id": 8749, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813445.0722253, "step_id": 8750, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813445.0769634, "step_id": 8751, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813445.0817628, "step_id": 8752, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813445.0866232, "step_id": 8753, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813445.0913465, "step_id": 8754, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813445.096072, "step_id": 8755, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813445.1008303, "step_id": 8756, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813445.1056783, "step_id": 8757, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813445.110597, "step_id": 8758, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813445.1153665, "step_id": 8759, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813445.1201031, "step_id": 8760, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813445.1247525, "step_id": 8761, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813445.1295736, "step_id": 8762, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813445.1343489, "step_id": 8763, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813445.1397717, "step_id": 8764, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813445.1437926, "step_id": 8765, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813445.148677, "step_id": 8766, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813445.1533983, "step_id": 8767, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813445.1581557, "step_id": 8768, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813445.164658, "step_id": 8769, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813445.1678867, "step_id": 8770, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813445.1725757, "step_id": 8771, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813445.17728, "step_id": 8772, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813445.1820245, "step_id": 8773, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813445.1867874, "step_id": 8774, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813445.1915627, "step_id": 8775, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813445.1963599, "step_id": 8776, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813445.2012386, "step_id": 8777, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813445.2060034, "step_id": 8778, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813445.2107465, "step_id": 8779, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813445.2161572, "step_id": 8780, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813445.220274, "step_id": 8781, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813445.225016, "step_id": 8782, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813445.2298245, "step_id": 8783, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813445.234579, "step_id": 8784, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813445.2394598, "step_id": 8785, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813445.2442815, "step_id": 8786, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813445.2490752, "step_id": 8787, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813445.253706, "step_id": 8788, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813445.2584724, "step_id": 8789, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813445.2633173, "step_id": 8790, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813445.2682638, "step_id": 8791, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813445.2728813, "step_id": 8792, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813445.2777374, "step_id": 8793, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813445.2824054, "step_id": 8794, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813445.2872307, "step_id": 8795, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813445.2927, "step_id": 8796, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813445.2969038, "step_id": 8797, "start_load_kv_us": 1, "get_finished_us": 220} +{"t_unix": 1779813445.301588, "step_id": 8798, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813445.3064835, "step_id": 8799, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813445.3111804, "step_id": 8800, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813445.3159328, "step_id": 8801, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813445.3206947, "step_id": 8802, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813445.32552, "step_id": 8803, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813445.3302257, "step_id": 8804, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813445.3349576, "step_id": 8805, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813445.339746, "step_id": 8806, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813445.3444674, "step_id": 8807, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813445.3493223, "step_id": 8808, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813445.3541036, "step_id": 8809, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813445.3589268, "step_id": 8810, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813445.3645215, "step_id": 8811, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813445.4085195, "step_id": 8812, "start_load_kv_us": 150, "get_finished_us": 239} +{"t_unix": 1779813445.4126549, "step_id": 8813, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813445.64757, "step_id": 8814, "start_load_kv_us": 143, "get_finished_us": 304} +{"t_unix": 1779813445.6512642, "step_id": 8815, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813445.8482041, "step_id": 8816, "start_load_kv_us": 3, "get_finished_us": 315} +{"t_unix": 1779813445.8538232, "step_id": 8817, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813445.860274, "step_id": 8818, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813445.8669114, "step_id": 8819, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813445.8736835, "step_id": 8820, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813445.8801498, "step_id": 8821, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813445.8871257, "step_id": 8822, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813445.8939564, "step_id": 8823, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813445.902059, "step_id": 8824, "start_load_kv_us": 5, "get_finished_us": 273} +{"t_unix": 1779813445.9086125, "step_id": 8825, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813445.915848, "step_id": 8826, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813445.9230702, "step_id": 8827, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813445.9311347, "step_id": 8828, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813445.9378307, "step_id": 8829, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813445.9460378, "step_id": 8830, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813445.952913, "step_id": 8831, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813445.9603486, "step_id": 8832, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813445.9670901, "step_id": 8833, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813445.973818, "step_id": 8834, "start_load_kv_us": 14, "get_finished_us": 221} +{"t_unix": 1779813445.9800968, "step_id": 8835, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813445.9864666, "step_id": 8836, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813445.99319, "step_id": 8837, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813446.0003603, "step_id": 8838, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813446.0077617, "step_id": 8839, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813446.0158725, "step_id": 8840, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813446.0229409, "step_id": 8841, "start_load_kv_us": 3, "get_finished_us": 257} +{"t_unix": 1779813446.0302436, "step_id": 8842, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813446.037196, "step_id": 8843, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813446.0451643, "step_id": 8844, "start_load_kv_us": 18, "get_finished_us": 171} +{"t_unix": 1779813446.0517287, "step_id": 8845, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813446.0595996, "step_id": 8846, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813446.0663178, "step_id": 8847, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813446.0737848, "step_id": 8848, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813446.0809362, "step_id": 8849, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813446.0885394, "step_id": 8850, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813446.0960665, "step_id": 8851, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813446.1029587, "step_id": 8852, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813446.1103272, "step_id": 8853, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813446.117514, "step_id": 8854, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813446.1247363, "step_id": 8855, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813446.1324763, "step_id": 8856, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813446.139075, "step_id": 8857, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813446.1464117, "step_id": 8858, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813446.1538422, "step_id": 8859, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813446.1616418, "step_id": 8860, "start_load_kv_us": 4, "get_finished_us": 264} +{"t_unix": 1779813446.1676142, "step_id": 8861, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813446.175328, "step_id": 8862, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813446.1818144, "step_id": 8863, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813446.188545, "step_id": 8864, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813446.195896, "step_id": 8865, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813446.2029052, "step_id": 8866, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813446.209868, "step_id": 8867, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813446.2168155, "step_id": 8868, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813446.2240133, "step_id": 8869, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813446.2312543, "step_id": 8870, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813446.2383125, "step_id": 8871, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813446.2459328, "step_id": 8872, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813446.2524846, "step_id": 8873, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813446.2591188, "step_id": 8874, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813446.2660747, "step_id": 8875, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813446.274273, "step_id": 8876, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813446.2807202, "step_id": 8877, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813446.2884119, "step_id": 8878, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813446.2946286, "step_id": 8879, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813446.3017313, "step_id": 8880, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813446.309262, "step_id": 8881, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813446.3167434, "step_id": 8882, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813446.324227, "step_id": 8883, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813446.3315287, "step_id": 8884, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813446.339069, "step_id": 8885, "start_load_kv_us": 1, "get_finished_us": 266} +{"t_unix": 1779813446.346568, "step_id": 8886, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813446.35408, "step_id": 8887, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813446.4002082, "step_id": 8888, "start_load_kv_us": 131, "get_finished_us": 222} +{"t_unix": 1779813446.4038374, "step_id": 8889, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813446.6051123, "step_id": 8890, "start_load_kv_us": 3, "get_finished_us": 322} +{"t_unix": 1779813446.6123264, "step_id": 8891, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813446.620573, "step_id": 8892, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813446.627856, "step_id": 8893, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813446.6362796, "step_id": 8894, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813446.643759, "step_id": 8895, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813446.6516316, "step_id": 8896, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813446.6593633, "step_id": 8897, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813446.667128, "step_id": 8898, "start_load_kv_us": 12, "get_finished_us": 141} +{"t_unix": 1779813446.6751323, "step_id": 8899, "start_load_kv_us": 13, "get_finished_us": 145} +{"t_unix": 1779813446.6829054, "step_id": 8900, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813446.6906269, "step_id": 8901, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813446.6987925, "step_id": 8902, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813446.7066603, "step_id": 8903, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813446.7154818, "step_id": 8904, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813446.7228093, "step_id": 8905, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813446.7310715, "step_id": 8906, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813446.7390077, "step_id": 8907, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813446.7476687, "step_id": 8908, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813446.7550325, "step_id": 8909, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813446.7634208, "step_id": 8910, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813446.7701926, "step_id": 8911, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813446.7779825, "step_id": 8912, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813446.7858434, "step_id": 8913, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813446.7933512, "step_id": 8914, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813446.8012748, "step_id": 8915, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813446.8093038, "step_id": 8916, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813446.8171208, "step_id": 8917, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813446.8247976, "step_id": 8918, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813446.832047, "step_id": 8919, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813446.8399916, "step_id": 8920, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813446.846714, "step_id": 8921, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813446.8540905, "step_id": 8922, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813446.8620822, "step_id": 8923, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813446.8703344, "step_id": 8924, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813446.8773222, "step_id": 8925, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813446.8852167, "step_id": 8926, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813446.8919592, "step_id": 8927, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813446.8999112, "step_id": 8928, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813446.907643, "step_id": 8929, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813446.9152987, "step_id": 8930, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813446.9231627, "step_id": 8931, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813446.9312086, "step_id": 8932, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813446.9391298, "step_id": 8933, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813446.94678, "step_id": 8934, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813446.9548934, "step_id": 8935, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813446.9632235, "step_id": 8936, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813446.9704187, "step_id": 8937, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813446.9784892, "step_id": 8938, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813446.9861813, "step_id": 8939, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813446.9943519, "step_id": 8940, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813447.0016222, "step_id": 8941, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813447.0101833, "step_id": 8942, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813447.0170128, "step_id": 8943, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813447.0246196, "step_id": 8944, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813447.0321894, "step_id": 8945, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813447.0399072, "step_id": 8946, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813447.0476851, "step_id": 8947, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813447.0554628, "step_id": 8948, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813447.0634062, "step_id": 8949, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813447.071382, "step_id": 8950, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813447.0792587, "step_id": 8951, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813447.087674, "step_id": 8952, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813447.0949366, "step_id": 8953, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813447.1028998, "step_id": 8954, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813447.1109684, "step_id": 8955, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813447.1195664, "step_id": 8956, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813447.126954, "step_id": 8957, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813447.1357315, "step_id": 8958, "start_load_kv_us": 6, "get_finished_us": 171} +{"t_unix": 1779813447.143235, "step_id": 8959, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813447.1512468, "step_id": 8960, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813447.1591556, "step_id": 8961, "start_load_kv_us": 3, "get_finished_us": 152} +{"t_unix": 1779813447.1670508, "step_id": 8962, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813447.1751177, "step_id": 8963, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813447.183265, "step_id": 8964, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813447.1912396, "step_id": 8965, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813447.1993148, "step_id": 8966, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813447.207139, "step_id": 8967, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813447.2157962, "step_id": 8968, "start_load_kv_us": 5, "get_finished_us": 144} +{"t_unix": 1779813447.2231557, "step_id": 8969, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813447.2311006, "step_id": 8970, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813447.2391338, "step_id": 8971, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813447.2476687, "step_id": 8972, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813447.255707, "step_id": 8973, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813447.264097, "step_id": 8974, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813447.270983, "step_id": 8975, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813447.27873, "step_id": 8976, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813447.2864974, "step_id": 8977, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813447.2942472, "step_id": 8978, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813447.3019817, "step_id": 8979, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813447.3097358, "step_id": 8980, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813447.3176816, "step_id": 8981, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813447.3252907, "step_id": 8982, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813447.333057, "step_id": 8983, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813447.3414142, "step_id": 8984, "start_load_kv_us": 6, "get_finished_us": 141} +{"t_unix": 1779813447.3486142, "step_id": 8985, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813447.3563256, "step_id": 8986, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813447.363893, "step_id": 8987, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813447.3713603, "step_id": 8988, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813447.3790815, "step_id": 8989, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813447.3873072, "step_id": 8990, "start_load_kv_us": 5, "get_finished_us": 161} +{"t_unix": 1779813447.394205, "step_id": 8991, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813447.4017835, "step_id": 8992, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813447.40917, "step_id": 8993, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813447.416876, "step_id": 8994, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813447.4244235, "step_id": 8995, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813447.4321423, "step_id": 8996, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813447.4397163, "step_id": 8997, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813447.44733, "step_id": 8998, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813447.45483, "step_id": 8999, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813447.463157, "step_id": 9000, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813447.4701736, "step_id": 9001, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813447.4777627, "step_id": 9002, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813447.4853606, "step_id": 9003, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813447.493073, "step_id": 9004, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813447.5007768, "step_id": 9005, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813447.509087, "step_id": 9006, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813447.5161142, "step_id": 9007, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813447.5249913, "step_id": 9008, "start_load_kv_us": 2, "get_finished_us": 341} +{"t_unix": 1779813447.5313866, "step_id": 9009, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813447.5390038, "step_id": 9010, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813447.5464797, "step_id": 9011, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813447.5540886, "step_id": 9012, "start_load_kv_us": 1, "get_finished_us": 280} +{"t_unix": 1779813447.5616589, "step_id": 9013, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813447.569344, "step_id": 9014, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813447.57708, "step_id": 9015, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813447.5852714, "step_id": 9016, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813447.5922172, "step_id": 9017, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813447.5994115, "step_id": 9018, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813447.6068807, "step_id": 9019, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813447.6141164, "step_id": 9020, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813447.6223183, "step_id": 9021, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813447.666618, "step_id": 9022, "start_load_kv_us": 145, "get_finished_us": 258} +{"t_unix": 1779813447.8606133, "step_id": 9023, "start_load_kv_us": 123, "get_finished_us": 344} +{"t_unix": 1779813448.0974538, "step_id": 9024, "start_load_kv_us": 132, "get_finished_us": 347} +{"t_unix": 1779813448.1098545, "step_id": 9025, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813448.3440545, "step_id": 9026, "start_load_kv_us": 3, "get_finished_us": 336} +{"t_unix": 1779813448.3517764, "step_id": 9027, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813448.3603027, "step_id": 9028, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813448.3693676, "step_id": 9029, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813448.3780432, "step_id": 9030, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813448.3867357, "step_id": 9031, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813448.396217, "step_id": 9032, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813448.4049368, "step_id": 9033, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813448.4129727, "step_id": 9034, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813448.4227812, "step_id": 9035, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813448.431137, "step_id": 9036, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813448.4402196, "step_id": 9037, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813448.4499078, "step_id": 9038, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813448.4580407, "step_id": 9039, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813448.466961, "step_id": 9040, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813448.476473, "step_id": 9041, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813448.4847066, "step_id": 9042, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813448.4934278, "step_id": 9043, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813448.5022855, "step_id": 9044, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813448.5114033, "step_id": 9045, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813448.520631, "step_id": 9046, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813448.5296257, "step_id": 9047, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813448.5392601, "step_id": 9048, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813448.5487456, "step_id": 9049, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813448.5573123, "step_id": 9050, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813448.567225, "step_id": 9051, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813448.5756032, "step_id": 9052, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813448.5849226, "step_id": 9053, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813448.5949328, "step_id": 9054, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813448.603501, "step_id": 9055, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813448.6124685, "step_id": 9056, "start_load_kv_us": 6, "get_finished_us": 164} +{"t_unix": 1779813448.6222968, "step_id": 9057, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813448.6304178, "step_id": 9058, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813448.639136, "step_id": 9059, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813448.6483054, "step_id": 9060, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813448.657513, "step_id": 9061, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813448.6670475, "step_id": 9062, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813448.6764035, "step_id": 9063, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813448.6863246, "step_id": 9064, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813448.695761, "step_id": 9065, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813448.7043004, "step_id": 9066, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813448.714415, "step_id": 9067, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813448.7234557, "step_id": 9068, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813448.7327354, "step_id": 9069, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813448.742641, "step_id": 9070, "start_load_kv_us": 1, "get_finished_us": 205} +{"t_unix": 1779813448.7526057, "step_id": 9071, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813448.7596736, "step_id": 9072, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813448.7678232, "step_id": 9073, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813448.774892, "step_id": 9074, "start_load_kv_us": 1, "get_finished_us": 203} +{"t_unix": 1779813448.7821493, "step_id": 9075, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813448.7898142, "step_id": 9076, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813448.7974312, "step_id": 9077, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813448.8435075, "step_id": 9078, "start_load_kv_us": 139, "get_finished_us": 273} +{"t_unix": 1779813448.8472311, "step_id": 9079, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813449.049705, "step_id": 9080, "start_load_kv_us": 6, "get_finished_us": 300} +{"t_unix": 1779813449.0587714, "step_id": 9081, "start_load_kv_us": 16, "get_finished_us": 173} +{"t_unix": 1779813449.067369, "step_id": 9082, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813449.077316, "step_id": 9083, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813449.0858164, "step_id": 9084, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813449.0953665, "step_id": 9085, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813449.1049588, "step_id": 9086, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813449.1146665, "step_id": 9087, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813449.1237943, "step_id": 9088, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813449.1335783, "step_id": 9089, "start_load_kv_us": 5, "get_finished_us": 273} +{"t_unix": 1779813449.1423063, "step_id": 9090, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813449.1518505, "step_id": 9091, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813449.1611795, "step_id": 9092, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813449.1711862, "step_id": 9093, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813449.1805205, "step_id": 9094, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813449.1901174, "step_id": 9095, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813449.2006261, "step_id": 9096, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813449.210387, "step_id": 9097, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813449.2196841, "step_id": 9098, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813449.229862, "step_id": 9099, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813449.2386117, "step_id": 9100, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813449.2482183, "step_id": 9101, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813449.258254, "step_id": 9102, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813449.267821, "step_id": 9103, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813449.2778118, "step_id": 9104, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813449.2882886, "step_id": 9105, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813449.2973237, "step_id": 9106, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813449.306796, "step_id": 9107, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813449.316695, "step_id": 9108, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813449.327182, "step_id": 9109, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813449.336596, "step_id": 9110, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813449.3461215, "step_id": 9111, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813449.3562853, "step_id": 9112, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813449.3656483, "step_id": 9113, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813449.3745039, "step_id": 9114, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813449.3848412, "step_id": 9115, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813449.394007, "step_id": 9116, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813449.403656, "step_id": 9117, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813449.4132254, "step_id": 9118, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813449.4231088, "step_id": 9119, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813449.4328272, "step_id": 9120, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813449.443293, "step_id": 9121, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813449.4524682, "step_id": 9122, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813449.4621205, "step_id": 9123, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813449.4717999, "step_id": 9124, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813449.4809666, "step_id": 9125, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813449.490504, "step_id": 9126, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813449.4999123, "step_id": 9127, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813449.5098288, "step_id": 9128, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813449.5193803, "step_id": 9129, "start_load_kv_us": 6, "get_finished_us": 150} +{"t_unix": 1779813449.5284007, "step_id": 9130, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813449.5389566, "step_id": 9131, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813449.5478735, "step_id": 9132, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813449.557601, "step_id": 9133, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813449.5672555, "step_id": 9134, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813449.5767715, "step_id": 9135, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813449.5865135, "step_id": 9136, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813449.5968547, "step_id": 9137, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813449.605953, "step_id": 9138, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813449.6167698, "step_id": 9139, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813449.6257954, "step_id": 9140, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813449.6354825, "step_id": 9141, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813449.6456597, "step_id": 9142, "start_load_kv_us": 1, "get_finished_us": 260} +{"t_unix": 1779813449.6552799, "step_id": 9143, "start_load_kv_us": 1, "get_finished_us": 182} +{"t_unix": 1779813449.6660283, "step_id": 9144, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813449.6755085, "step_id": 9145, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813449.6825433, "step_id": 9146, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813449.6909776, "step_id": 9147, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813449.698143, "step_id": 9148, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813449.7061772, "step_id": 9149, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813449.714269, "step_id": 9150, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813449.72183, "step_id": 9151, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813449.7294683, "step_id": 9152, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813449.7378566, "step_id": 9153, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813449.7453887, "step_id": 9154, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813449.7527974, "step_id": 9155, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813449.7608213, "step_id": 9156, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813449.768995, "step_id": 9157, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813449.7779033, "step_id": 9158, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813449.8242376, "step_id": 9159, "start_load_kv_us": 149, "get_finished_us": 347} +{"t_unix": 1779813449.8288102, "step_id": 9160, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813450.0310204, "step_id": 9161, "start_load_kv_us": 6, "get_finished_us": 344} +{"t_unix": 1779813450.0373402, "step_id": 9162, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813450.050733, "step_id": 9163, "start_load_kv_us": 4, "get_finished_us": 298} +{"t_unix": 1779813450.0562623, "step_id": 9164, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813450.0662992, "step_id": 9165, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813450.0756116, "step_id": 9166, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813450.088784, "step_id": 9167, "start_load_kv_us": 2, "get_finished_us": 513} +{"t_unix": 1779813450.094117, "step_id": 9168, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813450.1045766, "step_id": 9169, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813450.113335, "step_id": 9170, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813450.1231844, "step_id": 9171, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813450.1335597, "step_id": 9172, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813450.1423185, "step_id": 9173, "start_load_kv_us": 1, "get_finished_us": 210} +{"t_unix": 1779813450.1519048, "step_id": 9174, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813450.1614041, "step_id": 9175, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813450.1712563, "step_id": 9176, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813450.180771, "step_id": 9177, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813450.1890194, "step_id": 9178, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813450.1988423, "step_id": 9179, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813450.2078464, "step_id": 9180, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813450.2177262, "step_id": 9181, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813450.2273374, "step_id": 9182, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813450.2372081, "step_id": 9183, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813450.246676, "step_id": 9184, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813450.2566438, "step_id": 9185, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813450.2655342, "step_id": 9186, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813450.2752318, "step_id": 9187, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813450.2856603, "step_id": 9188, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813450.294729, "step_id": 9189, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813450.3042998, "step_id": 9190, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813450.3134923, "step_id": 9191, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813450.3236587, "step_id": 9192, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813450.3724232, "step_id": 9193, "start_load_kv_us": 129, "get_finished_us": 321} +{"t_unix": 1779813450.3767114, "step_id": 9194, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813450.6110141, "step_id": 9195, "start_load_kv_us": 142, "get_finished_us": 345} +{"t_unix": 1779813450.61508, "step_id": 9196, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813450.8601577, "step_id": 9197, "start_load_kv_us": 246, "get_finished_us": 335} +{"t_unix": 1779813450.8651009, "step_id": 9198, "start_load_kv_us": 5, "get_finished_us": 195} +{"t_unix": 1779813451.282212, "step_id": 9199, "start_load_kv_us": 3, "get_finished_us": 328} +{"t_unix": 1779813451.2918475, "step_id": 9200, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813451.3027458, "step_id": 9201, "start_load_kv_us": 11, "get_finished_us": 173} +{"t_unix": 1779813451.3123095, "step_id": 9202, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813451.322638, "step_id": 9203, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813451.334347, "step_id": 9204, "start_load_kv_us": 6, "get_finished_us": 202} +{"t_unix": 1779813451.3454225, "step_id": 9205, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813451.3561652, "step_id": 9206, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813451.3682196, "step_id": 9207, "start_load_kv_us": 21, "get_finished_us": 214} +{"t_unix": 1779813451.3796914, "step_id": 9208, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813451.3908455, "step_id": 9209, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813451.4011683, "step_id": 9210, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813451.4130845, "step_id": 9211, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813451.4241207, "step_id": 9212, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813451.4342701, "step_id": 9213, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813451.445499, "step_id": 9214, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813451.455505, "step_id": 9215, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813451.4672973, "step_id": 9216, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813451.4792058, "step_id": 9217, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813451.4897504, "step_id": 9218, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813451.5012386, "step_id": 9219, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813451.5135176, "step_id": 9220, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813451.5248933, "step_id": 9221, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813451.535524, "step_id": 9222, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813451.5469248, "step_id": 9223, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813451.5574818, "step_id": 9224, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813451.5684178, "step_id": 9225, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813451.5782006, "step_id": 9226, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813451.5897043, "step_id": 9227, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813451.600236, "step_id": 9228, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813451.611305, "step_id": 9229, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813451.6234128, "step_id": 9230, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813451.634051, "step_id": 9231, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813451.6449082, "step_id": 9232, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813451.656531, "step_id": 9233, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813451.6675296, "step_id": 9234, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813451.6786947, "step_id": 9235, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813451.6908836, "step_id": 9236, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813451.7022476, "step_id": 9237, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813451.7129314, "step_id": 9238, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813451.725869, "step_id": 9239, "start_load_kv_us": 5, "get_finished_us": 271} +{"t_unix": 1779813451.7375255, "step_id": 9240, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813451.749248, "step_id": 9241, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813451.760208, "step_id": 9242, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813451.7728076, "step_id": 9243, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813451.7840292, "step_id": 9244, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813451.795566, "step_id": 9245, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813451.8078365, "step_id": 9246, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813451.818984, "step_id": 9247, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813451.8313246, "step_id": 9248, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813451.8438337, "step_id": 9249, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813451.855002, "step_id": 9250, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813451.8669686, "step_id": 9251, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813451.878968, "step_id": 9252, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813451.8901815, "step_id": 9253, "start_load_kv_us": 6, "get_finished_us": 165} +{"t_unix": 1779813451.9009044, "step_id": 9254, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813451.9128263, "step_id": 9255, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813451.9243302, "step_id": 9256, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813451.9359903, "step_id": 9257, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813451.9476101, "step_id": 9258, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813451.9602597, "step_id": 9259, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813451.9713256, "step_id": 9260, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813451.982573, "step_id": 9261, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813451.9946935, "step_id": 9262, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813452.0065563, "step_id": 9263, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813452.0179577, "step_id": 9264, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813452.030735, "step_id": 9265, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813452.0420628, "step_id": 9266, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813452.0535567, "step_id": 9267, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813452.0653315, "step_id": 9268, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813452.0761735, "step_id": 9269, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813452.0868752, "step_id": 9270, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813452.0982497, "step_id": 9271, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813452.1096718, "step_id": 9272, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813452.1208982, "step_id": 9273, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813452.1314635, "step_id": 9274, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813452.1432443, "step_id": 9275, "start_load_kv_us": 9, "get_finished_us": 196} +{"t_unix": 1779813452.1532903, "step_id": 9276, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813452.1648254, "step_id": 9277, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813452.1773705, "step_id": 9278, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813452.1890037, "step_id": 9279, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813452.1991556, "step_id": 9280, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813452.210293, "step_id": 9281, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813452.219355, "step_id": 9282, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813452.2285287, "step_id": 9283, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813452.23909, "step_id": 9284, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813452.2483737, "step_id": 9285, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813452.2569733, "step_id": 9286, "start_load_kv_us": 1, "get_finished_us": 293} +{"t_unix": 1779813452.266868, "step_id": 9287, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813452.2760983, "step_id": 9288, "start_load_kv_us": 4, "get_finished_us": 278} +{"t_unix": 1779813452.284485, "step_id": 9289, "start_load_kv_us": 1, "get_finished_us": 272} +{"t_unix": 1779813452.2933016, "step_id": 9290, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813452.302148, "step_id": 9291, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813452.3127537, "step_id": 9292, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813452.322661, "step_id": 9293, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813452.3329306, "step_id": 9294, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813452.3420887, "step_id": 9295, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813452.3508506, "step_id": 9296, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813452.3607326, "step_id": 9297, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813452.3699694, "step_id": 9298, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813452.3793535, "step_id": 9299, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813452.389454, "step_id": 9300, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813452.3984296, "step_id": 9301, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813452.4069293, "step_id": 9302, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813452.417056, "step_id": 9303, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813452.4267154, "step_id": 9304, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813452.4352684, "step_id": 9305, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813452.444352, "step_id": 9306, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813452.4533901, "step_id": 9307, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813452.4623911, "step_id": 9308, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813452.4718013, "step_id": 9309, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813452.481647, "step_id": 9310, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813452.4903102, "step_id": 9311, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813452.4996367, "step_id": 9312, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813452.5089626, "step_id": 9313, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813452.5183167, "step_id": 9314, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813452.5275588, "step_id": 9315, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813452.5376089, "step_id": 9316, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813452.546517, "step_id": 9317, "start_load_kv_us": 3, "get_finished_us": 199} +{"t_unix": 1779813452.5553255, "step_id": 9318, "start_load_kv_us": 1, "get_finished_us": 191} +{"t_unix": 1779813452.5653028, "step_id": 9319, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813452.574413, "step_id": 9320, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813452.582967, "step_id": 9321, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813452.591894, "step_id": 9322, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813452.6008914, "step_id": 9323, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813452.6102898, "step_id": 9324, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813452.619526, "step_id": 9325, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813452.6289268, "step_id": 9326, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813452.6371996, "step_id": 9327, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813452.646292, "step_id": 9328, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813452.6558769, "step_id": 9329, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813452.6652184, "step_id": 9330, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813452.674477, "step_id": 9331, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813452.6841645, "step_id": 9332, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813452.6931574, "step_id": 9333, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813452.701808, "step_id": 9334, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813452.7115803, "step_id": 9335, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813452.7205985, "step_id": 9336, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813452.730131, "step_id": 9337, "start_load_kv_us": 1, "get_finished_us": 238} +{"t_unix": 1779813452.7394662, "step_id": 9338, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813452.74884, "step_id": 9339, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813452.7585278, "step_id": 9340, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813452.7675903, "step_id": 9341, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813452.7790866, "step_id": 9342, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813452.7875714, "step_id": 9343, "start_load_kv_us": 3, "get_finished_us": 218} +{"t_unix": 1779813452.7966979, "step_id": 9344, "start_load_kv_us": 3, "get_finished_us": 234} +{"t_unix": 1779813452.8059323, "step_id": 9345, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813452.8150826, "step_id": 9346, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813452.8244796, "step_id": 9347, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813452.8350658, "step_id": 9348, "start_load_kv_us": 7, "get_finished_us": 236} +{"t_unix": 1779813452.8442714, "step_id": 9349, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813452.852456, "step_id": 9350, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813452.862888, "step_id": 9351, "start_load_kv_us": 6, "get_finished_us": 226} +{"t_unix": 1779813452.8712137, "step_id": 9352, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813452.8807716, "step_id": 9353, "start_load_kv_us": 3, "get_finished_us": 170} +{"t_unix": 1779813452.8900967, "step_id": 9354, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813452.898567, "step_id": 9355, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813452.9075742, "step_id": 9356, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813452.917112, "step_id": 9357, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813452.9275646, "step_id": 9358, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813452.9367619, "step_id": 9359, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813452.9463906, "step_id": 9360, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813452.9557562, "step_id": 9361, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813452.965453, "step_id": 9362, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813452.9751983, "step_id": 9363, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813452.9904447, "step_id": 9364, "start_load_kv_us": 5, "get_finished_us": 301} +{"t_unix": 1779813452.9949534, "step_id": 9365, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813453.0040672, "step_id": 9366, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813453.0146224, "step_id": 9367, "start_load_kv_us": 6, "get_finished_us": 239} +{"t_unix": 1779813453.023216, "step_id": 9368, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813453.0325744, "step_id": 9369, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813453.0427003, "step_id": 9370, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813453.0528736, "step_id": 9371, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813453.062756, "step_id": 9372, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813453.072925, "step_id": 9373, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813453.0834763, "step_id": 9374, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813453.0925868, "step_id": 9375, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813453.1024544, "step_id": 9376, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813453.1121955, "step_id": 9377, "start_load_kv_us": 3, "get_finished_us": 178} +{"t_unix": 1779813453.1214623, "step_id": 9378, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813453.1308227, "step_id": 9379, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813453.141262, "step_id": 9380, "start_load_kv_us": 6, "get_finished_us": 181} +{"t_unix": 1779813453.151165, "step_id": 9381, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813453.1601849, "step_id": 9382, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813453.1700683, "step_id": 9383, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813453.1790636, "step_id": 9384, "start_load_kv_us": 1, "get_finished_us": 226} +{"t_unix": 1779813453.1889641, "step_id": 9385, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813453.1987464, "step_id": 9386, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813453.20854, "step_id": 9387, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813453.2181494, "step_id": 9388, "start_load_kv_us": 1, "get_finished_us": 268} +{"t_unix": 1779813453.2275717, "step_id": 9389, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813453.239212, "step_id": 9390, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813453.2461302, "step_id": 9391, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813453.2553859, "step_id": 9392, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813453.2648647, "step_id": 9393, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813453.274568, "step_id": 9394, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813453.2839885, "step_id": 9395, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813453.2940907, "step_id": 9396, "start_load_kv_us": 5, "get_finished_us": 243} +{"t_unix": 1779813453.3034706, "step_id": 9397, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813453.3125205, "step_id": 9398, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813453.3228118, "step_id": 9399, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813453.3318212, "step_id": 9400, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813453.3414028, "step_id": 9401, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813453.350469, "step_id": 9402, "start_load_kv_us": 1, "get_finished_us": 288} +{"t_unix": 1779813453.3598006, "step_id": 9403, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813453.369354, "step_id": 9404, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813453.3794255, "step_id": 9405, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813453.3896472, "step_id": 9406, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813453.3983452, "step_id": 9407, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813453.4082174, "step_id": 9408, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813453.417921, "step_id": 9409, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813453.4288254, "step_id": 9410, "start_load_kv_us": 1, "get_finished_us": 1061} +{"t_unix": 1779813453.4803565, "step_id": 9411, "start_load_kv_us": 129, "get_finished_us": 301} +{"t_unix": 1779813453.4849598, "step_id": 9412, "start_load_kv_us": 5, "get_finished_us": 195} +{"t_unix": 1779813453.7231703, "step_id": 9413, "start_load_kv_us": 149, "get_finished_us": 401} +{"t_unix": 1779813453.7279553, "step_id": 9414, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813453.9690392, "step_id": 9415, "start_load_kv_us": 153, "get_finished_us": 372} +{"t_unix": 1779813453.9734905, "step_id": 9416, "start_load_kv_us": 3, "get_finished_us": 198} +{"t_unix": 1779813454.1848233, "step_id": 9417, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813454.1953442, "step_id": 9418, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813454.2065861, "step_id": 9419, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813454.2180848, "step_id": 9420, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813454.2294245, "step_id": 9421, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813454.241496, "step_id": 9422, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813454.2533712, "step_id": 9423, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813454.264527, "step_id": 9424, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813454.2753158, "step_id": 9425, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813454.28671, "step_id": 9426, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813454.2981198, "step_id": 9427, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813454.310363, "step_id": 9428, "start_load_kv_us": 6, "get_finished_us": 160} +{"t_unix": 1779813454.321984, "step_id": 9429, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813454.333285, "step_id": 9430, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813454.3455985, "step_id": 9431, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813454.3564634, "step_id": 9432, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813454.3681748, "step_id": 9433, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813454.3799047, "step_id": 9434, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813454.3913343, "step_id": 9435, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813454.4022882, "step_id": 9436, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813454.413748, "step_id": 9437, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813454.4258292, "step_id": 9438, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813454.4375339, "step_id": 9439, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813454.4492183, "step_id": 9440, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813454.4603405, "step_id": 9441, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813454.472321, "step_id": 9442, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813454.48403, "step_id": 9443, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813454.4965556, "step_id": 9444, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813454.5086613, "step_id": 9445, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813454.5199275, "step_id": 9446, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813454.5325005, "step_id": 9447, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813454.54373, "step_id": 9448, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813454.5557692, "step_id": 9449, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813454.5670748, "step_id": 9450, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813454.576966, "step_id": 9451, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813454.5863793, "step_id": 9452, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813454.5963273, "step_id": 9453, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813454.6062567, "step_id": 9454, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813454.614025, "step_id": 9455, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813454.6214294, "step_id": 9456, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813454.6283646, "step_id": 9457, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813454.635894, "step_id": 9458, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813454.6434295, "step_id": 9459, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813454.651455, "step_id": 9460, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813454.658226, "step_id": 9461, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813454.6659274, "step_id": 9462, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813454.6732664, "step_id": 9463, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813454.680797, "step_id": 9464, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813454.7272465, "step_id": 9465, "start_load_kv_us": 133, "get_finished_us": 326} +{"t_unix": 1779813454.7310748, "step_id": 9466, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813454.9314227, "step_id": 9467, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813454.938337, "step_id": 9468, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813454.9460251, "step_id": 9469, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813454.9539227, "step_id": 9470, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813454.9623, "step_id": 9471, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813454.9696581, "step_id": 9472, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813454.9765174, "step_id": 9473, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813454.984296, "step_id": 9474, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813454.9920244, "step_id": 9475, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813455.0003085, "step_id": 9476, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813455.0072079, "step_id": 9477, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813455.0148165, "step_id": 9478, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813455.0226235, "step_id": 9479, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813455.030531, "step_id": 9480, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813455.0382872, "step_id": 9481, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813455.045641, "step_id": 9482, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813455.0534294, "step_id": 9483, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813455.061228, "step_id": 9484, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813455.0690656, "step_id": 9485, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813455.0767753, "step_id": 9486, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813455.0849042, "step_id": 9487, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813455.092543, "step_id": 9488, "start_load_kv_us": 6, "get_finished_us": 171} +{"t_unix": 1779813455.0992007, "step_id": 9489, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813455.1065414, "step_id": 9490, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813455.1144667, "step_id": 9491, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813455.123067, "step_id": 9492, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813455.130238, "step_id": 9493, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813455.1380653, "step_id": 9494, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813455.146172, "step_id": 9495, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813455.154079, "step_id": 9496, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813455.1617794, "step_id": 9497, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813455.1697085, "step_id": 9498, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813455.1773725, "step_id": 9499, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813455.1851537, "step_id": 9500, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813455.192363, "step_id": 9501, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813455.200059, "step_id": 9502, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813455.2081933, "step_id": 9503, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813455.2154622, "step_id": 9504, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813455.2220216, "step_id": 9505, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813455.2296505, "step_id": 9506, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813455.2372296, "step_id": 9507, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813455.2456846, "step_id": 9508, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813455.2528296, "step_id": 9509, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813455.2604783, "step_id": 9510, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813455.2682178, "step_id": 9511, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813455.2758958, "step_id": 9512, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813455.2839396, "step_id": 9513, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813455.2917256, "step_id": 9514, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813455.299873, "step_id": 9515, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813455.3080359, "step_id": 9516, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813455.3158436, "step_id": 9517, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813455.3235643, "step_id": 9518, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813455.3318927, "step_id": 9519, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813455.339582, "step_id": 9520, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813455.3463576, "step_id": 9521, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813455.354104, "step_id": 9522, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813455.3614728, "step_id": 9523, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813455.369861, "step_id": 9524, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813455.3766708, "step_id": 9525, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813455.3844254, "step_id": 9526, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813455.3922827, "step_id": 9527, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813455.4002757, "step_id": 9528, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813455.4080584, "step_id": 9529, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813455.4554222, "step_id": 9530, "start_load_kv_us": 154, "get_finished_us": 258} +{"t_unix": 1779813455.4592125, "step_id": 9531, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813455.6540177, "step_id": 9532, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813455.6632507, "step_id": 9533, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813455.6728418, "step_id": 9534, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813455.683208, "step_id": 9535, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813455.6928349, "step_id": 9536, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813455.7015069, "step_id": 9537, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813455.7107444, "step_id": 9538, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813455.7201662, "step_id": 9539, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813455.7303293, "step_id": 9540, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813455.739243, "step_id": 9541, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813455.7484891, "step_id": 9542, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813455.758157, "step_id": 9543, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813455.7673998, "step_id": 9544, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813455.7772264, "step_id": 9545, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813455.7873013, "step_id": 9546, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813455.797117, "step_id": 9547, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813455.8072174, "step_id": 9548, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813455.8173687, "step_id": 9549, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813455.8271718, "step_id": 9550, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813455.8376215, "step_id": 9551, "start_load_kv_us": 4, "get_finished_us": 288} +{"t_unix": 1779813455.8474915, "step_id": 9552, "start_load_kv_us": 4, "get_finished_us": 261} +{"t_unix": 1779813455.856615, "step_id": 9553, "start_load_kv_us": 1, "get_finished_us": 282} +{"t_unix": 1779813455.8660994, "step_id": 9554, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813455.8755026, "step_id": 9555, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813455.8855426, "step_id": 9556, "start_load_kv_us": 5, "get_finished_us": 264} +{"t_unix": 1779813455.894607, "step_id": 9557, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813455.9042468, "step_id": 9558, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813455.9137557, "step_id": 9559, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813455.92337, "step_id": 9560, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813455.933176, "step_id": 9561, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813455.9432244, "step_id": 9562, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813455.9527035, "step_id": 9563, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813455.9624481, "step_id": 9564, "start_load_kv_us": 1, "get_finished_us": 195} +{"t_unix": 1779813456.0105765, "step_id": 9565, "start_load_kv_us": 139, "get_finished_us": 290} +{"t_unix": 1779813456.0142913, "step_id": 9566, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813456.2164416, "step_id": 9567, "start_load_kv_us": 4, "get_finished_us": 291} +{"t_unix": 1779813456.2243314, "step_id": 9568, "start_load_kv_us": 6, "get_finished_us": 170} +{"t_unix": 1779813456.2327518, "step_id": 9569, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813456.2415147, "step_id": 9570, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813456.250429, "step_id": 9571, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813456.260163, "step_id": 9572, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813456.268315, "step_id": 9573, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813456.2775593, "step_id": 9574, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813456.285986, "step_id": 9575, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813456.2947824, "step_id": 9576, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813456.3036225, "step_id": 9577, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813456.3127277, "step_id": 9578, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813456.321717, "step_id": 9579, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813456.3308575, "step_id": 9580, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813456.3400674, "step_id": 9581, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813456.3492625, "step_id": 9582, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813456.359489, "step_id": 9583, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813456.3686934, "step_id": 9584, "start_load_kv_us": 5, "get_finished_us": 283} +{"t_unix": 1779813456.3770278, "step_id": 9585, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813456.3855593, "step_id": 9586, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813456.3946052, "step_id": 9587, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813456.4043887, "step_id": 9588, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813456.4127064, "step_id": 9589, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813456.4229722, "step_id": 9590, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813456.4316826, "step_id": 9591, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813456.4410603, "step_id": 9592, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813456.4503264, "step_id": 9593, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813456.4592924, "step_id": 9594, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813456.4684901, "step_id": 9595, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813456.4777381, "step_id": 9596, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813456.4868462, "step_id": 9597, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813456.4965806, "step_id": 9598, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813456.5064774, "step_id": 9599, "start_load_kv_us": 4, "get_finished_us": 325} +{"t_unix": 1779813456.5155041, "step_id": 9600, "start_load_kv_us": 5, "get_finished_us": 279} +{"t_unix": 1779813456.523762, "step_id": 9601, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813456.5327787, "step_id": 9602, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813456.542019, "step_id": 9603, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813456.5519998, "step_id": 9604, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813456.5605602, "step_id": 9605, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813456.5702808, "step_id": 9606, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813456.57887, "step_id": 9607, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813456.587513, "step_id": 9608, "start_load_kv_us": 1, "get_finished_us": 195} +{"t_unix": 1779813456.5967157, "step_id": 9609, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813456.606459, "step_id": 9610, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813456.6155818, "step_id": 9611, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813456.6252403, "step_id": 9612, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813456.6349335, "step_id": 9613, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813456.6441426, "step_id": 9614, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813456.6547632, "step_id": 9615, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813456.66434, "step_id": 9616, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813456.7115989, "step_id": 9617, "start_load_kv_us": 135, "get_finished_us": 244} +{"t_unix": 1779813456.7153797, "step_id": 9618, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813456.9198573, "step_id": 9619, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813456.9315705, "step_id": 9620, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813456.942598, "step_id": 9621, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813456.9551125, "step_id": 9622, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813456.9660246, "step_id": 9623, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813456.9773092, "step_id": 9624, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813456.9883652, "step_id": 9625, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813457.0001013, "step_id": 9626, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813457.0121195, "step_id": 9627, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813457.0229795, "step_id": 9628, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813457.040478, "step_id": 9629, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813457.0459297, "step_id": 9630, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813457.0584102, "step_id": 9631, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813457.070624, "step_id": 9632, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813457.0817945, "step_id": 9633, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813457.0932465, "step_id": 9634, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813457.104958, "step_id": 9635, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813457.1173866, "step_id": 9636, "start_load_kv_us": 5, "get_finished_us": 138} +{"t_unix": 1779813457.128481, "step_id": 9637, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813457.1412165, "step_id": 9638, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813457.152404, "step_id": 9639, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813457.1643925, "step_id": 9640, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813457.1762376, "step_id": 9641, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813457.187653, "step_id": 9642, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813457.199889, "step_id": 9643, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813457.2113638, "step_id": 9644, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813457.2232537, "step_id": 9645, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813457.234867, "step_id": 9646, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813457.2471514, "step_id": 9647, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813457.2588406, "step_id": 9648, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813457.269622, "step_id": 9649, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813457.280994, "step_id": 9650, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813457.2927225, "step_id": 9651, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813457.3048375, "step_id": 9652, "start_load_kv_us": 5, "get_finished_us": 143} +{"t_unix": 1779813457.3158991, "step_id": 9653, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813457.32805, "step_id": 9654, "start_load_kv_us": 5, "get_finished_us": 147} +{"t_unix": 1779813457.3386981, "step_id": 9655, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813457.349779, "step_id": 9656, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813457.3609366, "step_id": 9657, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813457.372422, "step_id": 9658, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813457.384234, "step_id": 9659, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813457.39519, "step_id": 9660, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813457.4064167, "step_id": 9661, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813457.4169104, "step_id": 9662, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813457.4288163, "step_id": 9663, "start_load_kv_us": 4, "get_finished_us": 138} +{"t_unix": 1779813457.439914, "step_id": 9664, "start_load_kv_us": 5, "get_finished_us": 136} +{"t_unix": 1779813457.4502335, "step_id": 9665, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813457.4617531, "step_id": 9666, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813457.4735212, "step_id": 9667, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813457.4859812, "step_id": 9668, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813457.4947844, "step_id": 9669, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813457.5050461, "step_id": 9670, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813457.5144546, "step_id": 9671, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813457.523726, "step_id": 9672, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813457.5312803, "step_id": 9673, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813457.5390322, "step_id": 9674, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813457.5473087, "step_id": 9675, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813457.5542707, "step_id": 9676, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813457.561586, "step_id": 9677, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813457.5693843, "step_id": 9678, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813457.5770469, "step_id": 9679, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813457.5855892, "step_id": 9680, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813457.5926852, "step_id": 9681, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813457.6006088, "step_id": 9682, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813457.6085184, "step_id": 9683, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813457.6230347, "step_id": 9684, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813457.6264052, "step_id": 9685, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813457.6344817, "step_id": 9686, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813457.6414812, "step_id": 9687, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813457.6495144, "step_id": 9688, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813457.6577237, "step_id": 9689, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813457.665587, "step_id": 9690, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813457.674212, "step_id": 9691, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813457.6813831, "step_id": 9692, "start_load_kv_us": 1, "get_finished_us": 212} +{"t_unix": 1779813457.6895165, "step_id": 9693, "start_load_kv_us": 2, "get_finished_us": 365} +{"t_unix": 1779813457.6974702, "step_id": 9694, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813457.7054548, "step_id": 9695, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813457.7139661, "step_id": 9696, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813457.7214305, "step_id": 9697, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813457.7294245, "step_id": 9698, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813457.7377465, "step_id": 9699, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813457.7465653, "step_id": 9700, "start_load_kv_us": 4, "get_finished_us": 296} +{"t_unix": 1779813457.7540252, "step_id": 9701, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813457.7624633, "step_id": 9702, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813457.7699273, "step_id": 9703, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813457.7779353, "step_id": 9704, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813457.786117, "step_id": 9705, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813457.794821, "step_id": 9706, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813457.8032377, "step_id": 9707, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813457.8107173, "step_id": 9708, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813457.8188791, "step_id": 9709, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813457.8269355, "step_id": 9710, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813457.8352716, "step_id": 9711, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813457.84408, "step_id": 9712, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813457.851389, "step_id": 9713, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813457.8597972, "step_id": 9714, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813457.8679333, "step_id": 9715, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813457.8763778, "step_id": 9716, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813457.8837461, "step_id": 9717, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813457.8924096, "step_id": 9718, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813457.8999639, "step_id": 9719, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813457.9079068, "step_id": 9720, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813457.9163709, "step_id": 9721, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813457.9243946, "step_id": 9722, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813457.9326332, "step_id": 9723, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813457.939734, "step_id": 9724, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813457.9470856, "step_id": 9725, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813457.95454, "step_id": 9726, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813457.9621491, "step_id": 9727, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813457.9697216, "step_id": 9728, "start_load_kv_us": 16, "get_finished_us": 240} +{"t_unix": 1779813457.9772828, "step_id": 9729, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813457.9851947, "step_id": 9730, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813457.9925425, "step_id": 9731, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813458.000921, "step_id": 9732, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813458.0463045, "step_id": 9733, "start_load_kv_us": 163, "get_finished_us": 223} +{"t_unix": 1779813458.0505228, "step_id": 9734, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813458.2493713, "step_id": 9735, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813458.2565916, "step_id": 9736, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813458.2644112, "step_id": 9737, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813458.27233, "step_id": 9738, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813458.2809217, "step_id": 9739, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813458.2881474, "step_id": 9740, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813458.2959325, "step_id": 9741, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813458.3037534, "step_id": 9742, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813458.3118382, "step_id": 9743, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813458.3204272, "step_id": 9744, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813458.3278146, "step_id": 9745, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813458.3359382, "step_id": 9746, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813458.3438175, "step_id": 9747, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813458.352456, "step_id": 9748, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813458.3596048, "step_id": 9749, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813458.3685308, "step_id": 9750, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813458.3759642, "step_id": 9751, "start_load_kv_us": 1, "get_finished_us": 219} +{"t_unix": 1779813458.3840296, "step_id": 9752, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813458.3921854, "step_id": 9753, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813458.4003973, "step_id": 9754, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813458.4092185, "step_id": 9755, "start_load_kv_us": 4, "get_finished_us": 281} +{"t_unix": 1779813458.4166005, "step_id": 9756, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813458.424455, "step_id": 9757, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813458.4322968, "step_id": 9758, "start_load_kv_us": 1, "get_finished_us": 212} +{"t_unix": 1779813458.440138, "step_id": 9759, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813458.4485424, "step_id": 9760, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813458.4555962, "step_id": 9761, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813458.4634492, "step_id": 9762, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813458.4709525, "step_id": 9763, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813458.4792295, "step_id": 9764, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813458.4861438, "step_id": 9765, "start_load_kv_us": 16, "get_finished_us": 156} +{"t_unix": 1779813458.4943006, "step_id": 9766, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813458.5010474, "step_id": 9767, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813458.508626, "step_id": 9768, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813458.5160303, "step_id": 9769, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813458.5238667, "step_id": 9770, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813458.53194, "step_id": 9771, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813458.5387557, "step_id": 9772, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813458.5462732, "step_id": 9773, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813458.5536685, "step_id": 9774, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813458.5613012, "step_id": 9775, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813458.5691078, "step_id": 9776, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813458.5761182, "step_id": 9777, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813458.5838459, "step_id": 9778, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813458.591522, "step_id": 9779, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813458.5997126, "step_id": 9780, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813458.606904, "step_id": 9781, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813458.615467, "step_id": 9782, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813458.6223154, "step_id": 9783, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813458.629764, "step_id": 9784, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813458.6376534, "step_id": 9785, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813458.6455798, "step_id": 9786, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813458.6538587, "step_id": 9787, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813458.6604002, "step_id": 9788, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813458.6679263, "step_id": 9789, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813458.6756327, "step_id": 9790, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813458.6832376, "step_id": 9791, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813458.691397, "step_id": 9792, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813458.6979043, "step_id": 9793, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813458.7056038, "step_id": 9794, "start_load_kv_us": 1, "get_finished_us": 276} +{"t_unix": 1779813458.7128696, "step_id": 9795, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813458.7204912, "step_id": 9796, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813458.7279217, "step_id": 9797, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813458.7360256, "step_id": 9798, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813458.7430515, "step_id": 9799, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813458.7505374, "step_id": 9800, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813458.7583795, "step_id": 9801, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813458.7654927, "step_id": 9802, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813458.7736287, "step_id": 9803, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813458.7803218, "step_id": 9804, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813458.7876413, "step_id": 9805, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813458.7950802, "step_id": 9806, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813458.8021262, "step_id": 9807, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813458.8102398, "step_id": 9808, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813458.8171344, "step_id": 9809, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813458.8243706, "step_id": 9810, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813458.8321118, "step_id": 9811, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813458.8397646, "step_id": 9812, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813458.84736, "step_id": 9813, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813458.855352, "step_id": 9814, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813458.8620417, "step_id": 9815, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813458.8689537, "step_id": 9816, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813458.87577, "step_id": 9817, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813458.8831387, "step_id": 9818, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813458.8910558, "step_id": 9819, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813458.8980298, "step_id": 9820, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813458.9059556, "step_id": 9821, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813458.9130535, "step_id": 9822, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813458.919011, "step_id": 9823, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813458.9255743, "step_id": 9824, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813458.9305856, "step_id": 9825, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813458.936703, "step_id": 9826, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813458.9426816, "step_id": 9827, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813458.9483907, "step_id": 9828, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813458.9544835, "step_id": 9829, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813458.9607155, "step_id": 9830, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813458.966989, "step_id": 9831, "start_load_kv_us": 8, "get_finished_us": 314} +{"t_unix": 1779813458.973286, "step_id": 9832, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813458.9782875, "step_id": 9833, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813458.984123, "step_id": 9834, "start_load_kv_us": 1, "get_finished_us": 228} +{"t_unix": 1779813458.9908502, "step_id": 9835, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813458.9962683, "step_id": 9836, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813459.0023322, "step_id": 9837, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813459.0083976, "step_id": 9838, "start_load_kv_us": 1, "get_finished_us": 204} +{"t_unix": 1779813459.0142949, "step_id": 9839, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813459.020992, "step_id": 9840, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813459.0264606, "step_id": 9841, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.0320857, "step_id": 9842, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813459.037355, "step_id": 9843, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813459.043301, "step_id": 9844, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813459.0487156, "step_id": 9845, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813459.05453, "step_id": 9846, "start_load_kv_us": 1, "get_finished_us": 247} +{"t_unix": 1779813459.0606372, "step_id": 9847, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813459.0659046, "step_id": 9848, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813459.071457, "step_id": 9849, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.0770001, "step_id": 9850, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813459.0832856, "step_id": 9851, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813459.0885031, "step_id": 9852, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813459.0941525, "step_id": 9853, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813459.099908, "step_id": 9854, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813459.1058972, "step_id": 9855, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.112371, "step_id": 9856, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813459.1177328, "step_id": 9857, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813459.1235447, "step_id": 9858, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813459.1294858, "step_id": 9859, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813459.1350513, "step_id": 9860, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813459.1406567, "step_id": 9861, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813459.1462612, "step_id": 9862, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813459.1516933, "step_id": 9863, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813459.1571968, "step_id": 9864, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813459.1632602, "step_id": 9865, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813459.168925, "step_id": 9866, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813459.1755617, "step_id": 9867, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813459.180821, "step_id": 9868, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813459.1867979, "step_id": 9869, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813459.1928518, "step_id": 9870, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813459.1988227, "step_id": 9871, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813459.2053044, "step_id": 9872, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813459.210416, "step_id": 9873, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813459.2177815, "step_id": 9874, "start_load_kv_us": 2, "get_finished_us": 412} +{"t_unix": 1779813459.2211401, "step_id": 9875, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813459.2253704, "step_id": 9876, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813459.2301311, "step_id": 9877, "start_load_kv_us": 13, "get_finished_us": 145} +{"t_unix": 1779813459.2350194, "step_id": 9878, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813459.239723, "step_id": 9879, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813459.244509, "step_id": 9880, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813459.249285, "step_id": 9881, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.2540646, "step_id": 9882, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813459.2588258, "step_id": 9883, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813459.263816, "step_id": 9884, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813459.2683911, "step_id": 9885, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813459.2731855, "step_id": 9886, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813459.2779806, "step_id": 9887, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813459.2834132, "step_id": 9888, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813459.2874718, "step_id": 9889, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813459.2922947, "step_id": 9890, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813459.2971754, "step_id": 9891, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813459.301902, "step_id": 9892, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813459.3066173, "step_id": 9893, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813459.3113925, "step_id": 9894, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813459.316139, "step_id": 9895, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813459.320906, "step_id": 9896, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813459.3257139, "step_id": 9897, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813459.3304303, "step_id": 9898, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813459.3353083, "step_id": 9899, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813459.3400488, "step_id": 9900, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813459.344796, "step_id": 9901, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813459.349585, "step_id": 9902, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813459.3543906, "step_id": 9903, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813459.359911, "step_id": 9904, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813459.3641338, "step_id": 9905, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813459.3688033, "step_id": 9906, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813459.3735158, "step_id": 9907, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813459.3783233, "step_id": 9908, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813459.383095, "step_id": 9909, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813459.387888, "step_id": 9910, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813459.3927696, "step_id": 9911, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813459.3974605, "step_id": 9912, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813459.402263, "step_id": 9913, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813459.4071307, "step_id": 9914, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813459.4118686, "step_id": 9915, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813459.4167063, "step_id": 9916, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813459.421486, "step_id": 9917, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813459.4262502, "step_id": 9918, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813459.430986, "step_id": 9919, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813459.4364784, "step_id": 9920, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813459.4405382, "step_id": 9921, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813459.4452934, "step_id": 9922, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813459.4500952, "step_id": 9923, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813459.454877, "step_id": 9924, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813459.4597025, "step_id": 9925, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813459.4646099, "step_id": 9926, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813459.4692545, "step_id": 9927, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813459.4740288, "step_id": 9928, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813459.4787698, "step_id": 9929, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813459.483634, "step_id": 9930, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813459.4883614, "step_id": 9931, "start_load_kv_us": 1, "get_finished_us": 133} +{"t_unix": 1779813459.4931586, "step_id": 9932, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813459.4979818, "step_id": 9933, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813459.5028312, "step_id": 9934, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813459.507586, "step_id": 9935, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813459.5129535, "step_id": 9936, "start_load_kv_us": 4, "get_finished_us": 137} +{"t_unix": 1779813459.5170765, "step_id": 9937, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813459.5220277, "step_id": 9938, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813459.5266604, "step_id": 9939, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813459.5314825, "step_id": 9940, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813459.5363314, "step_id": 9941, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.541057, "step_id": 9942, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.545788, "step_id": 9943, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813459.5505333, "step_id": 9944, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813459.5553102, "step_id": 9945, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813459.5601726, "step_id": 9946, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813459.5650446, "step_id": 9947, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813459.5696948, "step_id": 9948, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813459.574427, "step_id": 9949, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813459.579368, "step_id": 9950, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813459.5862033, "step_id": 9951, "start_load_kv_us": 1, "get_finished_us": 210} +{"t_unix": 1779813459.590055, "step_id": 9952, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813459.5938442, "step_id": 9953, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813459.598621, "step_id": 9954, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813459.60339, "step_id": 9955, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813459.6082015, "step_id": 9956, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813459.6129327, "step_id": 9957, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813459.6176767, "step_id": 9958, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813459.6225202, "step_id": 9959, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813459.627245, "step_id": 9960, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813459.632015, "step_id": 9961, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813459.6368642, "step_id": 9962, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813459.679082, "step_id": 9963, "start_load_kv_us": 145, "get_finished_us": 234} +{"t_unix": 1779813459.682543, "step_id": 9964, "start_load_kv_us": 1, "get_finished_us": 189} +{"t_unix": 1779813459.920935, "step_id": 9965, "start_load_kv_us": 264, "get_finished_us": 309} +{"t_unix": 1779813459.924801, "step_id": 9966, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813460.3347025, "step_id": 9967, "start_load_kv_us": 3, "get_finished_us": 342} +{"t_unix": 1779813460.341878, "step_id": 9968, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813460.3483908, "step_id": 9969, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813460.3560097, "step_id": 9970, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813460.3634188, "step_id": 9971, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813460.3707244, "step_id": 9972, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813460.377606, "step_id": 9973, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813460.3843875, "step_id": 9974, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813460.3914566, "step_id": 9975, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813460.398112, "step_id": 9976, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813460.405395, "step_id": 9977, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813460.4126856, "step_id": 9978, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813460.420702, "step_id": 9979, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813460.4280527, "step_id": 9980, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813460.434744, "step_id": 9981, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813460.442392, "step_id": 9982, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813460.4499002, "step_id": 9983, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813460.4578137, "step_id": 9984, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813460.4643562, "step_id": 9985, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813460.4719748, "step_id": 9986, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813460.4794533, "step_id": 9987, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813460.487127, "step_id": 9988, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813460.4943967, "step_id": 9989, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813460.5016642, "step_id": 9990, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813460.5087059, "step_id": 9991, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813460.515403, "step_id": 9992, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813460.522113, "step_id": 9993, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813460.5291553, "step_id": 9994, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813460.5372157, "step_id": 9995, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813460.544151, "step_id": 9996, "start_load_kv_us": 17, "get_finished_us": 160} +{"t_unix": 1779813460.5505981, "step_id": 9997, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813460.5577, "step_id": 9998, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813460.5647697, "step_id": 9999, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813460.5725822, "step_id": 10000, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813460.5791495, "step_id": 10001, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813460.5861435, "step_id": 10002, "start_load_kv_us": 14, "get_finished_us": 154} +{"t_unix": 1779813460.5933576, "step_id": 10003, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813460.6003273, "step_id": 10004, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813460.6075778, "step_id": 10005, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813460.615091, "step_id": 10006, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813460.622419, "step_id": 10007, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813460.6295383, "step_id": 10008, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813460.636919, "step_id": 10009, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813460.6441648, "step_id": 10010, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813460.651752, "step_id": 10011, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813460.6587508, "step_id": 10012, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813460.6655662, "step_id": 10013, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813460.6726232, "step_id": 10014, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813460.6802027, "step_id": 10015, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813460.687895, "step_id": 10016, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813460.694253, "step_id": 10017, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813460.7015278, "step_id": 10018, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813460.7085435, "step_id": 10019, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813460.7152245, "step_id": 10020, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813460.7218242, "step_id": 10021, "start_load_kv_us": 1, "get_finished_us": 238} +{"t_unix": 1779813460.7284758, "step_id": 10022, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813460.735496, "step_id": 10023, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813460.7422917, "step_id": 10024, "start_load_kv_us": 1, "get_finished_us": 254} +{"t_unix": 1779813460.7493384, "step_id": 10025, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813460.756458, "step_id": 10026, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813460.7640433, "step_id": 10027, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813460.7712538, "step_id": 10028, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813460.7779593, "step_id": 10029, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813460.7847776, "step_id": 10030, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813460.7919981, "step_id": 10031, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813460.8001366, "step_id": 10032, "start_load_kv_us": 5, "get_finished_us": 137} +{"t_unix": 1779813460.8068337, "step_id": 10033, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813460.8143961, "step_id": 10034, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813460.821901, "step_id": 10035, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813460.829361, "step_id": 10036, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813460.836678, "step_id": 10037, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813460.8438842, "step_id": 10038, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813460.851063, "step_id": 10039, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813460.858423, "step_id": 10040, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813460.865536, "step_id": 10041, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813460.8729975, "step_id": 10042, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813460.8809326, "step_id": 10043, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813460.8880985, "step_id": 10044, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813460.8947742, "step_id": 10045, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813460.9018595, "step_id": 10046, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813460.908984, "step_id": 10047, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813460.916965, "step_id": 10048, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813460.92384, "step_id": 10049, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813460.9317245, "step_id": 10050, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813460.9391255, "step_id": 10051, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813460.946482, "step_id": 10052, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813460.95387, "step_id": 10053, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813460.961142, "step_id": 10054, "start_load_kv_us": 3, "get_finished_us": 152} +{"t_unix": 1779813460.9685907, "step_id": 10055, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813460.9753497, "step_id": 10056, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813460.9827642, "step_id": 10057, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813460.9899921, "step_id": 10058, "start_load_kv_us": 1, "get_finished_us": 247} +{"t_unix": 1779813460.9978144, "step_id": 10059, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813461.0050442, "step_id": 10060, "start_load_kv_us": 5, "get_finished_us": 221} +{"t_unix": 1779813461.011832, "step_id": 10061, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813461.0192437, "step_id": 10062, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813461.026636, "step_id": 10063, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813461.0348556, "step_id": 10064, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813461.04157, "step_id": 10065, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813461.0490365, "step_id": 10066, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813461.0564997, "step_id": 10067, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813461.0641303, "step_id": 10068, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813461.0720775, "step_id": 10069, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813461.0791838, "step_id": 10070, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813461.0864108, "step_id": 10071, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813461.093938, "step_id": 10072, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813461.1015823, "step_id": 10073, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813461.1092377, "step_id": 10074, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813461.1171613, "step_id": 10075, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813461.124411, "step_id": 10076, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813461.1310077, "step_id": 10077, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813461.1379275, "step_id": 10078, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813461.1447716, "step_id": 10079, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813461.152459, "step_id": 10080, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813461.1591504, "step_id": 10081, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813461.1667275, "step_id": 10082, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813461.1736846, "step_id": 10083, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813461.1811347, "step_id": 10084, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813461.188628, "step_id": 10085, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813461.196008, "step_id": 10086, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813461.2032833, "step_id": 10087, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813461.210191, "step_id": 10088, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813461.2175672, "step_id": 10089, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813461.2246764, "step_id": 10090, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813461.2326798, "step_id": 10091, "start_load_kv_us": 7, "get_finished_us": 165} +{"t_unix": 1779813461.239589, "step_id": 10092, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813461.24619, "step_id": 10093, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813461.2535017, "step_id": 10094, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813461.2608478, "step_id": 10095, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813461.2685435, "step_id": 10096, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813461.2748928, "step_id": 10097, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813461.2823744, "step_id": 10098, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813461.2898488, "step_id": 10099, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813461.2967813, "step_id": 10100, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813461.3038418, "step_id": 10101, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813461.3107479, "step_id": 10102, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813461.3182874, "step_id": 10103, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813461.325533, "step_id": 10104, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813461.3329077, "step_id": 10105, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813461.3400083, "step_id": 10106, "start_load_kv_us": 1, "get_finished_us": 211} +{"t_unix": 1779813461.3476367, "step_id": 10107, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813461.3542445, "step_id": 10108, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813461.3606567, "step_id": 10109, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813461.3675637, "step_id": 10110, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813461.411879, "step_id": 10111, "start_load_kv_us": 138, "get_finished_us": 288} +{"t_unix": 1779813461.4163327, "step_id": 10112, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813461.6158035, "step_id": 10113, "start_load_kv_us": 3, "get_finished_us": 298} +{"t_unix": 1779813461.6227918, "step_id": 10114, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813461.6301305, "step_id": 10115, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813461.6376507, "step_id": 10116, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813461.6450653, "step_id": 10117, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813461.652663, "step_id": 10118, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813461.6602237, "step_id": 10119, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813461.667834, "step_id": 10120, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813461.6754253, "step_id": 10121, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813461.682833, "step_id": 10122, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813461.691178, "step_id": 10123, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813461.6983283, "step_id": 10124, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813461.7054536, "step_id": 10125, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813461.7127094, "step_id": 10126, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813461.7205753, "step_id": 10127, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813461.729054, "step_id": 10128, "start_load_kv_us": 6, "get_finished_us": 183} +{"t_unix": 1779813461.7360554, "step_id": 10129, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813461.743705, "step_id": 10130, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813461.7514014, "step_id": 10131, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813461.7591174, "step_id": 10132, "start_load_kv_us": 1, "get_finished_us": 256} +{"t_unix": 1779813461.7663264, "step_id": 10133, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813461.773993, "step_id": 10134, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813461.7811499, "step_id": 10135, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813461.7887495, "step_id": 10136, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813461.7964587, "step_id": 10137, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813461.8038507, "step_id": 10138, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813461.8123164, "step_id": 10139, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813461.8199081, "step_id": 10140, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813461.827242, "step_id": 10141, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813461.8350542, "step_id": 10142, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813461.8429606, "step_id": 10143, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813461.8515038, "step_id": 10144, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813461.8586183, "step_id": 10145, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813461.8665001, "step_id": 10146, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813461.8743281, "step_id": 10147, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813461.8822515, "step_id": 10148, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813461.8901968, "step_id": 10149, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813461.8975816, "step_id": 10150, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813461.9056177, "step_id": 10151, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813461.9136677, "step_id": 10152, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813461.921563, "step_id": 10153, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813461.9293568, "step_id": 10154, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813461.9379816, "step_id": 10155, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813461.9460487, "step_id": 10156, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813461.9534614, "step_id": 10157, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813461.9614472, "step_id": 10158, "start_load_kv_us": 1, "get_finished_us": 240} +{"t_unix": 1779813461.96908, "step_id": 10159, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813461.9774988, "step_id": 10160, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813461.984523, "step_id": 10161, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813461.9924116, "step_id": 10162, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813462.000029, "step_id": 10163, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813462.007374, "step_id": 10164, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813462.015608, "step_id": 10165, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813462.0233035, "step_id": 10166, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813462.031274, "step_id": 10167, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813462.0392768, "step_id": 10168, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813462.0465152, "step_id": 10169, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813462.0533888, "step_id": 10170, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813462.0616584, "step_id": 10171, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813462.0691235, "step_id": 10172, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813462.0762415, "step_id": 10173, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813462.0838847, "step_id": 10174, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813462.0916655, "step_id": 10175, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813462.1003616, "step_id": 10176, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813462.1073759, "step_id": 10177, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813462.1152003, "step_id": 10178, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813462.122768, "step_id": 10179, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813462.129865, "step_id": 10180, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813462.1372085, "step_id": 10181, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813462.144932, "step_id": 10182, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813462.1527364, "step_id": 10183, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813462.159916, "step_id": 10184, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813462.167789, "step_id": 10185, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813462.1755311, "step_id": 10186, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813462.184224, "step_id": 10187, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813462.1918805, "step_id": 10188, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813462.1991665, "step_id": 10189, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813462.2069814, "step_id": 10190, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813462.215034, "step_id": 10191, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813462.2237482, "step_id": 10192, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813462.230974, "step_id": 10193, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813462.2390163, "step_id": 10194, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813462.246963, "step_id": 10195, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813462.2550397, "step_id": 10196, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813462.2627525, "step_id": 10197, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813462.2702818, "step_id": 10198, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813462.277858, "step_id": 10199, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813462.2858515, "step_id": 10200, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813462.2935343, "step_id": 10201, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813462.3011935, "step_id": 10202, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813462.3095312, "step_id": 10203, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813462.3171344, "step_id": 10204, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813462.3242123, "step_id": 10205, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813462.3319304, "step_id": 10206, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813462.339912, "step_id": 10207, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813462.3482037, "step_id": 10208, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813462.3555586, "step_id": 10209, "start_load_kv_us": 1, "get_finished_us": 205} +{"t_unix": 1779813462.3635037, "step_id": 10210, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813462.3716178, "step_id": 10211, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813462.37931, "step_id": 10212, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813462.3870814, "step_id": 10213, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813462.39548, "step_id": 10214, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813462.4028494, "step_id": 10215, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813462.4103248, "step_id": 10216, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813462.4180427, "step_id": 10217, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813462.42571, "step_id": 10218, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813462.4337578, "step_id": 10219, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813462.4423537, "step_id": 10220, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813462.4492307, "step_id": 10221, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813462.4564483, "step_id": 10222, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813462.4609203, "step_id": 10223, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813462.4663374, "step_id": 10224, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813462.470473, "step_id": 10225, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813462.4752493, "step_id": 10226, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813462.4799998, "step_id": 10227, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813462.484811, "step_id": 10228, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813462.4895403, "step_id": 10229, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813462.4943376, "step_id": 10230, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813462.4991064, "step_id": 10231, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813462.503923, "step_id": 10232, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813462.5137992, "step_id": 10233, "start_load_kv_us": 1, "get_finished_us": 277} +{"t_unix": 1779813462.517128, "step_id": 10234, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813462.5213304, "step_id": 10235, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813462.5260916, "step_id": 10236, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813462.5308385, "step_id": 10237, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813462.535692, "step_id": 10238, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813462.5404034, "step_id": 10239, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813462.545979, "step_id": 10240, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813462.5500014, "step_id": 10241, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813462.5554001, "step_id": 10242, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813462.5597641, "step_id": 10243, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813462.5644262, "step_id": 10244, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813462.569195, "step_id": 10245, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813462.5740316, "step_id": 10246, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813462.5787358, "step_id": 10247, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813462.5835445, "step_id": 10248, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813462.5883796, "step_id": 10249, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813462.5930767, "step_id": 10250, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813462.597917, "step_id": 10251, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813462.6026845, "step_id": 10252, "start_load_kv_us": 16, "get_finished_us": 203} +{"t_unix": 1779813462.6077075, "step_id": 10253, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813462.6124585, "step_id": 10254, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813462.6171627, "step_id": 10255, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813462.6225982, "step_id": 10256, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813462.6265433, "step_id": 10257, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813462.6313617, "step_id": 10258, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813462.6361368, "step_id": 10259, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813462.640925, "step_id": 10260, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813462.6456366, "step_id": 10261, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813462.6504834, "step_id": 10262, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813462.6552286, "step_id": 10263, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813462.6600688, "step_id": 10264, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813462.664787, "step_id": 10265, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813462.6696215, "step_id": 10266, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813462.6744318, "step_id": 10267, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813462.6792405, "step_id": 10268, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813462.68413, "step_id": 10269, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813462.688814, "step_id": 10270, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813462.693555, "step_id": 10271, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813462.6990864, "step_id": 10272, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813462.7031422, "step_id": 10273, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813462.7079778, "step_id": 10274, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813462.712703, "step_id": 10275, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813462.7175274, "step_id": 10276, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813462.7222955, "step_id": 10277, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813462.7270381, "step_id": 10278, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813462.7318583, "step_id": 10279, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813462.7366052, "step_id": 10280, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813462.741489, "step_id": 10281, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813462.7462182, "step_id": 10282, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813462.7510076, "step_id": 10283, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813462.7557678, "step_id": 10284, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813462.7605894, "step_id": 10285, "start_load_kv_us": 1, "get_finished_us": 228} +{"t_unix": 1779813462.7654116, "step_id": 10286, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813462.7701857, "step_id": 10287, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813462.775569, "step_id": 10288, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813462.7798784, "step_id": 10289, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813462.7845201, "step_id": 10290, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813462.7893448, "step_id": 10291, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813462.7941248, "step_id": 10292, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813462.7989066, "step_id": 10293, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813462.8036535, "step_id": 10294, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813462.8084948, "step_id": 10295, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813462.8133545, "step_id": 10296, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813462.8181152, "step_id": 10297, "start_load_kv_us": 3, "get_finished_us": 147} +{"t_unix": 1779813462.8227863, "step_id": 10298, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813462.8275778, "step_id": 10299, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813462.8324518, "step_id": 10300, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813462.8372374, "step_id": 10301, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813462.84196, "step_id": 10302, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813462.8467462, "step_id": 10303, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813462.8521965, "step_id": 10304, "start_load_kv_us": 4, "get_finished_us": 137} +{"t_unix": 1779813462.8563058, "step_id": 10305, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813462.8611643, "step_id": 10306, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813462.8658981, "step_id": 10307, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813462.8707106, "step_id": 10308, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813462.8755076, "step_id": 10309, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813462.8803222, "step_id": 10310, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813462.8851035, "step_id": 10311, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813462.889813, "step_id": 10312, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813462.8946211, "step_id": 10313, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813462.899426, "step_id": 10314, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813462.9041693, "step_id": 10315, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813462.9090042, "step_id": 10316, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813462.913777, "step_id": 10317, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813462.9186287, "step_id": 10318, "start_load_kv_us": 1, "get_finished_us": 215} +{"t_unix": 1779813462.9234054, "step_id": 10319, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813462.928818, "step_id": 10320, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813462.93294, "step_id": 10321, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813462.9377477, "step_id": 10322, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813462.9425702, "step_id": 10323, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813462.9472237, "step_id": 10324, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813462.9521093, "step_id": 10325, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813462.9568357, "step_id": 10326, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813462.9616742, "step_id": 10327, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813462.9665062, "step_id": 10328, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813462.9713094, "step_id": 10329, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813462.9760036, "step_id": 10330, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813463.0193324, "step_id": 10331, "start_load_kv_us": 155, "get_finished_us": 298} +{"t_unix": 1779813463.0231416, "step_id": 10332, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813463.2215798, "step_id": 10333, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813463.2280278, "step_id": 10334, "start_load_kv_us": 5, "get_finished_us": 247} +{"t_unix": 1779813463.2329822, "step_id": 10335, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813463.239408, "step_id": 10336, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813463.2444084, "step_id": 10337, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813463.2501507, "step_id": 10338, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813463.2559555, "step_id": 10339, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813463.2616093, "step_id": 10340, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813463.2676203, "step_id": 10341, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813463.2737913, "step_id": 10342, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813463.279626, "step_id": 10343, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813463.286486, "step_id": 10344, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813463.3315787, "step_id": 10345, "start_load_kv_us": 137, "get_finished_us": 219} +{"t_unix": 1779813463.3353803, "step_id": 10346, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813463.5307186, "step_id": 10347, "start_load_kv_us": 2, "get_finished_us": 386} +{"t_unix": 1779813463.5373318, "step_id": 10348, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813463.5442095, "step_id": 10349, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813463.5524664, "step_id": 10350, "start_load_kv_us": 5, "get_finished_us": 186} +{"t_unix": 1779813463.5592678, "step_id": 10351, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813463.566851, "step_id": 10352, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813463.57313, "step_id": 10353, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813463.5812778, "step_id": 10354, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813463.5875664, "step_id": 10355, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813463.5942712, "step_id": 10356, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813463.6014495, "step_id": 10357, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813463.6086187, "step_id": 10358, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813463.6156693, "step_id": 10359, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813463.623147, "step_id": 10360, "start_load_kv_us": 1, "get_finished_us": 216} +{"t_unix": 1779813463.668037, "step_id": 10361, "start_load_kv_us": 131, "get_finished_us": 276} +{"t_unix": 1779813463.6716678, "step_id": 10362, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813463.8748848, "step_id": 10363, "start_load_kv_us": 2, "get_finished_us": 342} +{"t_unix": 1779813463.8813283, "step_id": 10364, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813463.889484, "step_id": 10365, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813463.8970225, "step_id": 10366, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813463.9044487, "step_id": 10367, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813463.911801, "step_id": 10368, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813463.918759, "step_id": 10369, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813463.9265168, "step_id": 10370, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813463.932623, "step_id": 10371, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813463.9394195, "step_id": 10372, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813463.9466243, "step_id": 10373, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813463.9540513, "step_id": 10374, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813463.9613173, "step_id": 10375, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813463.9686031, "step_id": 10376, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813463.9758785, "step_id": 10377, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813463.982867, "step_id": 10378, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813463.9901516, "step_id": 10379, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813463.9971182, "step_id": 10380, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813464.0047395, "step_id": 10381, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813464.0121539, "step_id": 10382, "start_load_kv_us": 17, "get_finished_us": 151} +{"t_unix": 1779813464.0188725, "step_id": 10383, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813464.0264525, "step_id": 10384, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813464.0339165, "step_id": 10385, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813464.041828, "step_id": 10386, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813464.048352, "step_id": 10387, "start_load_kv_us": 1, "get_finished_us": 210} +{"t_unix": 1779813464.0559626, "step_id": 10388, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813464.0633538, "step_id": 10389, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813464.0705829, "step_id": 10390, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813464.0781424, "step_id": 10391, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813464.0854495, "step_id": 10392, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813464.092404, "step_id": 10393, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813464.0993764, "step_id": 10394, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813464.1066105, "step_id": 10395, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813464.1141627, "step_id": 10396, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813464.1222017, "step_id": 10397, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813464.1295319, "step_id": 10398, "start_load_kv_us": 3, "get_finished_us": 147} +{"t_unix": 1779813464.1363544, "step_id": 10399, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813464.1438193, "step_id": 10400, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813464.1510198, "step_id": 10401, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813464.1589034, "step_id": 10402, "start_load_kv_us": 4, "get_finished_us": 135} +{"t_unix": 1779813464.1654243, "step_id": 10403, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813464.1724856, "step_id": 10404, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813464.1797557, "step_id": 10405, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813464.1868284, "step_id": 10406, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813464.1941237, "step_id": 10407, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813464.2013462, "step_id": 10408, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813464.2083948, "step_id": 10409, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813464.2156723, "step_id": 10410, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813464.223074, "step_id": 10411, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813464.2305942, "step_id": 10412, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813464.238625, "step_id": 10413, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813464.2461553, "step_id": 10414, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813464.253008, "step_id": 10415, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813464.2604282, "step_id": 10416, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813464.267805, "step_id": 10417, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813464.2756295, "step_id": 10418, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813464.2824638, "step_id": 10419, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813464.2899399, "step_id": 10420, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813464.2974813, "step_id": 10421, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813464.305148, "step_id": 10422, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813464.3123999, "step_id": 10423, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813464.3195784, "step_id": 10424, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813464.3270178, "step_id": 10425, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813464.3343825, "step_id": 10426, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813464.3418067, "step_id": 10427, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813464.3490608, "step_id": 10428, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813464.3573096, "step_id": 10429, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813464.3645625, "step_id": 10430, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813464.3708994, "step_id": 10431, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813464.3779814, "step_id": 10432, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813464.385642, "step_id": 10433, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813464.3935578, "step_id": 10434, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813464.4381087, "step_id": 10435, "start_load_kv_us": 154, "get_finished_us": 303} +{"t_unix": 1779813464.4418359, "step_id": 10436, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813464.6425838, "step_id": 10437, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813464.6497242, "step_id": 10438, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813464.65747, "step_id": 10439, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813464.665261, "step_id": 10440, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813464.6726236, "step_id": 10441, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813464.6800578, "step_id": 10442, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813464.6870594, "step_id": 10443, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813464.6944637, "step_id": 10444, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813464.7031708, "step_id": 10445, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813464.7105722, "step_id": 10446, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813464.7176063, "step_id": 10447, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813464.7253616, "step_id": 10448, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813464.7330341, "step_id": 10449, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813464.7411265, "step_id": 10450, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813464.748457, "step_id": 10451, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813464.7553704, "step_id": 10452, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813464.8013818, "step_id": 10453, "start_load_kv_us": 141, "get_finished_us": 265} +{"t_unix": 1779813464.8051422, "step_id": 10454, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813465.0468724, "step_id": 10455, "start_load_kv_us": 140, "get_finished_us": 349} +{"t_unix": 1779813465.241975, "step_id": 10456, "start_load_kv_us": 158, "get_finished_us": 381} +{"t_unix": 1779813465.2537742, "step_id": 10457, "start_load_kv_us": 3, "get_finished_us": 254} +{"t_unix": 1779813465.5298147, "step_id": 10458, "start_load_kv_us": 162, "get_finished_us": 318} +{"t_unix": 1779813465.533901, "step_id": 10459, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813465.7403312, "step_id": 10460, "start_load_kv_us": 5, "get_finished_us": 296} +{"t_unix": 1779813465.7504184, "step_id": 10461, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813465.761081, "step_id": 10462, "start_load_kv_us": 5, "get_finished_us": 239} +{"t_unix": 1779813465.7713008, "step_id": 10463, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813465.7818851, "step_id": 10464, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813465.7931015, "step_id": 10465, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813465.803052, "step_id": 10466, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813465.8133714, "step_id": 10467, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813465.823718, "step_id": 10468, "start_load_kv_us": 2, "get_finished_us": 341} +{"t_unix": 1779813465.8354504, "step_id": 10469, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813465.8826632, "step_id": 10470, "start_load_kv_us": 149, "get_finished_us": 368} +{"t_unix": 1779813465.887333, "step_id": 10471, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813466.131208, "step_id": 10472, "start_load_kv_us": 149, "get_finished_us": 312} +{"t_unix": 1779813466.1350703, "step_id": 10473, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813466.340957, "step_id": 10474, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813466.3537476, "step_id": 10475, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813466.3675272, "step_id": 10476, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813466.380651, "step_id": 10477, "start_load_kv_us": 17, "get_finished_us": 164} +{"t_unix": 1779813466.3939042, "step_id": 10478, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813466.4063864, "step_id": 10479, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813466.4193163, "step_id": 10480, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813466.4326575, "step_id": 10481, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813466.4453478, "step_id": 10482, "start_load_kv_us": 10, "get_finished_us": 203} +{"t_unix": 1779813466.4580483, "step_id": 10483, "start_load_kv_us": 10, "get_finished_us": 211} +{"t_unix": 1779813466.470797, "step_id": 10484, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813466.4845164, "step_id": 10485, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813466.497717, "step_id": 10486, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813466.5110679, "step_id": 10487, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813466.5239608, "step_id": 10488, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813466.537007, "step_id": 10489, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813466.5498488, "step_id": 10490, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813466.5633402, "step_id": 10491, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813466.5776412, "step_id": 10492, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813466.5906608, "step_id": 10493, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813466.6039257, "step_id": 10494, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813466.6166208, "step_id": 10495, "start_load_kv_us": 1, "get_finished_us": 189} +{"t_unix": 1779813466.6303499, "step_id": 10496, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813466.6445875, "step_id": 10497, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813466.657935, "step_id": 10498, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813466.6716158, "step_id": 10499, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813466.6846378, "step_id": 10500, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813466.6986547, "step_id": 10501, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813466.712208, "step_id": 10502, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813466.7256973, "step_id": 10503, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813466.738834, "step_id": 10504, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813466.752623, "step_id": 10505, "start_load_kv_us": 1, "get_finished_us": 244} +{"t_unix": 1779813466.76639, "step_id": 10506, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813466.780594, "step_id": 10507, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813466.7953308, "step_id": 10508, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813466.8095074, "step_id": 10509, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813466.823356, "step_id": 10510, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813466.8748636, "step_id": 10511, "start_load_kv_us": 168, "get_finished_us": 314} +{"t_unix": 1779813466.8787687, "step_id": 10512, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813467.092315, "step_id": 10513, "start_load_kv_us": 5, "get_finished_us": 268} +{"t_unix": 1779813467.1049361, "step_id": 10514, "start_load_kv_us": 17, "get_finished_us": 172} +{"t_unix": 1779813467.1185303, "step_id": 10515, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813467.1315656, "step_id": 10516, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813467.145742, "step_id": 10517, "start_load_kv_us": 5, "get_finished_us": 195} +{"t_unix": 1779813467.1597626, "step_id": 10518, "start_load_kv_us": 4, "get_finished_us": 260} +{"t_unix": 1779813467.17368, "step_id": 10519, "start_load_kv_us": 4, "get_finished_us": 283} +{"t_unix": 1779813467.1876938, "step_id": 10520, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813467.2011695, "step_id": 10521, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813467.215368, "step_id": 10522, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813467.229786, "step_id": 10523, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813467.2446766, "step_id": 10524, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813467.258257, "step_id": 10525, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813467.2725117, "step_id": 10526, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813467.2857027, "step_id": 10527, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813467.2995682, "step_id": 10528, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813467.3142629, "step_id": 10529, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813467.3284185, "step_id": 10530, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813467.342306, "step_id": 10531, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813467.3550591, "step_id": 10532, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813467.369397, "step_id": 10533, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813467.3830032, "step_id": 10534, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813467.396598, "step_id": 10535, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813467.4102159, "step_id": 10536, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813467.4231472, "step_id": 10537, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813467.4365013, "step_id": 10538, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813467.4495826, "step_id": 10539, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813467.4633439, "step_id": 10540, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813467.4771047, "step_id": 10541, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813467.490781, "step_id": 10542, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813467.5037827, "step_id": 10543, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813467.5176816, "step_id": 10544, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813467.5319018, "step_id": 10545, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813467.5456643, "step_id": 10546, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813467.5597558, "step_id": 10547, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813467.5731347, "step_id": 10548, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813467.587869, "step_id": 10549, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813467.6019664, "step_id": 10550, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813467.6157804, "step_id": 10551, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813467.6300898, "step_id": 10552, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813467.643499, "step_id": 10553, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813467.6570659, "step_id": 10554, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813467.6707003, "step_id": 10555, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813467.6844225, "step_id": 10556, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813467.69815, "step_id": 10557, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813467.7120664, "step_id": 10558, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813467.7253563, "step_id": 10559, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813467.7396572, "step_id": 10560, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813467.754427, "step_id": 10561, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813467.7682474, "step_id": 10562, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813467.7818046, "step_id": 10563, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813467.7950797, "step_id": 10564, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813467.8088486, "step_id": 10565, "start_load_kv_us": 5, "get_finished_us": 243} +{"t_unix": 1779813467.8225694, "step_id": 10566, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813467.8358996, "step_id": 10567, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813467.849871, "step_id": 10568, "start_load_kv_us": 9, "get_finished_us": 183} +{"t_unix": 1779813467.8631618, "step_id": 10569, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813467.8767703, "step_id": 10570, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813467.890607, "step_id": 10571, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813467.904545, "step_id": 10572, "start_load_kv_us": 4, "get_finished_us": 264} +{"t_unix": 1779813467.9182153, "step_id": 10573, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813467.9321225, "step_id": 10574, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813467.94567, "step_id": 10575, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813467.959414, "step_id": 10576, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813467.9737127, "step_id": 10577, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813467.988022, "step_id": 10578, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813468.0016873, "step_id": 10579, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813468.0141807, "step_id": 10580, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813468.0285149, "step_id": 10581, "start_load_kv_us": 5, "get_finished_us": 219} +{"t_unix": 1779813468.041902, "step_id": 10582, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813468.0554996, "step_id": 10583, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813468.068768, "step_id": 10584, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813468.0818613, "step_id": 10585, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813468.0956843, "step_id": 10586, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813468.110219, "step_id": 10587, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813468.1246324, "step_id": 10588, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813468.1379323, "step_id": 10589, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813468.151059, "step_id": 10590, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813468.1648564, "step_id": 10591, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813468.178613, "step_id": 10592, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813468.1929703, "step_id": 10593, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813468.207004, "step_id": 10594, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813468.2208745, "step_id": 10595, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813468.2339582, "step_id": 10596, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813468.2486794, "step_id": 10597, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813468.262375, "step_id": 10598, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813468.2763221, "step_id": 10599, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813468.289882, "step_id": 10600, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813468.3025243, "step_id": 10601, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813468.3157415, "step_id": 10602, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813468.3267639, "step_id": 10603, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813468.3392372, "step_id": 10604, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813468.3510118, "step_id": 10605, "start_load_kv_us": 5, "get_finished_us": 207} +{"t_unix": 1779813468.3619175, "step_id": 10606, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813468.373533, "step_id": 10607, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813468.3849952, "step_id": 10608, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813468.3968353, "step_id": 10609, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813468.408563, "step_id": 10610, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813468.4202487, "step_id": 10611, "start_load_kv_us": 10, "get_finished_us": 178} +{"t_unix": 1779813468.430926, "step_id": 10612, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813468.4423902, "step_id": 10613, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813468.4528208, "step_id": 10614, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813468.4638102, "step_id": 10615, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813468.4748592, "step_id": 10616, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813468.4857032, "step_id": 10617, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813468.496916, "step_id": 10618, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813468.5080276, "step_id": 10619, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813468.5193818, "step_id": 10620, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813468.5303407, "step_id": 10621, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813468.5419202, "step_id": 10622, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813468.552887, "step_id": 10623, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813468.5642543, "step_id": 10624, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813468.5762308, "step_id": 10625, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813468.5876913, "step_id": 10626, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813468.5991282, "step_id": 10627, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813468.6092527, "step_id": 10628, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813468.6204894, "step_id": 10629, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813468.6313915, "step_id": 10630, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813468.642689, "step_id": 10631, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813468.6536815, "step_id": 10632, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813468.664131, "step_id": 10633, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813468.675346, "step_id": 10634, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813468.6866984, "step_id": 10635, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813468.6987844, "step_id": 10636, "start_load_kv_us": 16, "get_finished_us": 189} +{"t_unix": 1779813468.7099085, "step_id": 10637, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813468.721197, "step_id": 10638, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813468.7331932, "step_id": 10639, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813468.7448912, "step_id": 10640, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813468.7571225, "step_id": 10641, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813468.7678907, "step_id": 10642, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813468.7786899, "step_id": 10643, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813468.788587, "step_id": 10644, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813468.8002803, "step_id": 10645, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813468.8113232, "step_id": 10646, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813468.822026, "step_id": 10647, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813468.833609, "step_id": 10648, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813468.8441792, "step_id": 10649, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813468.855041, "step_id": 10650, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813468.8659983, "step_id": 10651, "start_load_kv_us": 1, "get_finished_us": 251} +{"t_unix": 1779813468.877725, "step_id": 10652, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813468.8877597, "step_id": 10653, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813468.898358, "step_id": 10654, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813468.9090683, "step_id": 10655, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813468.9198685, "step_id": 10656, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813468.9310021, "step_id": 10657, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813468.941716, "step_id": 10658, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813468.9530787, "step_id": 10659, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813468.9635932, "step_id": 10660, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813468.9755058, "step_id": 10661, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813468.9871564, "step_id": 10662, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813468.9983938, "step_id": 10663, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813469.0101647, "step_id": 10664, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813469.0207171, "step_id": 10665, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813469.0318897, "step_id": 10666, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813469.0437396, "step_id": 10667, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813469.0602841, "step_id": 10668, "start_load_kv_us": 127, "get_finished_us": 2101} +{"t_unix": 1779813469.0659592, "step_id": 10669, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813469.0771286, "step_id": 10670, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813469.0882876, "step_id": 10671, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813469.1000886, "step_id": 10672, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813469.112045, "step_id": 10673, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813469.1235878, "step_id": 10674, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813469.1343281, "step_id": 10675, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813469.1446228, "step_id": 10676, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813469.1567926, "step_id": 10677, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813469.1685655, "step_id": 10678, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813469.2169912, "step_id": 10679, "start_load_kv_us": 157, "get_finished_us": 255} +{"t_unix": 1779813469.2213984, "step_id": 10680, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813469.4285324, "step_id": 10681, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813469.4390173, "step_id": 10682, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813469.44999, "step_id": 10683, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813469.4613698, "step_id": 10684, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813469.4721532, "step_id": 10685, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813469.4839401, "step_id": 10686, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813469.533665, "step_id": 10687, "start_load_kv_us": 144, "get_finished_us": 306} +{"t_unix": 1779813469.537539, "step_id": 10688, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813469.749189, "step_id": 10689, "start_load_kv_us": 5, "get_finished_us": 274} +{"t_unix": 1779813469.762857, "step_id": 10690, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813469.7763188, "step_id": 10691, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813469.7899528, "step_id": 10692, "start_load_kv_us": 3, "get_finished_us": 245} +{"t_unix": 1779813469.8059075, "step_id": 10693, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813469.814116, "step_id": 10694, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813469.8265681, "step_id": 10695, "start_load_kv_us": 5, "get_finished_us": 269} +{"t_unix": 1779813469.8384926, "step_id": 10696, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813469.8490984, "step_id": 10697, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813469.8596766, "step_id": 10698, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813469.870975, "step_id": 10699, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813469.8830981, "step_id": 10700, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813469.8950946, "step_id": 10701, "start_load_kv_us": 4, "get_finished_us": 339} +{"t_unix": 1779813469.906151, "step_id": 10702, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813469.9176004, "step_id": 10703, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813469.9292, "step_id": 10704, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813469.941572, "step_id": 10705, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813469.953207, "step_id": 10706, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813469.9638958, "step_id": 10707, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813469.975363, "step_id": 10708, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813469.9882755, "step_id": 10709, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813469.9997203, "step_id": 10710, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813470.011558, "step_id": 10711, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813470.0231268, "step_id": 10712, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813470.0338953, "step_id": 10713, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813470.0432003, "step_id": 10714, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813470.0524065, "step_id": 10715, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813470.099452, "step_id": 10716, "start_load_kv_us": 143, "get_finished_us": 217} +{"t_unix": 1779813470.1037762, "step_id": 10717, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813470.3092794, "step_id": 10718, "start_load_kv_us": 2, "get_finished_us": 345} +{"t_unix": 1779813470.318274, "step_id": 10719, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813470.3263953, "step_id": 10720, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813470.3354783, "step_id": 10721, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813470.3442967, "step_id": 10722, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813470.3537567, "step_id": 10723, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813470.362998, "step_id": 10724, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813470.3730106, "step_id": 10725, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813470.382188, "step_id": 10726, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813470.391871, "step_id": 10727, "start_load_kv_us": 3, "get_finished_us": 218} +{"t_unix": 1779813470.4017444, "step_id": 10728, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813470.4114306, "step_id": 10729, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813470.419184, "step_id": 10730, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813470.427029, "step_id": 10731, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813470.4357922, "step_id": 10732, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813470.4435322, "step_id": 10733, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813470.4507282, "step_id": 10734, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813470.4592624, "step_id": 10735, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813470.4666388, "step_id": 10736, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813470.474162, "step_id": 10737, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813470.4817088, "step_id": 10738, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813470.4890418, "step_id": 10739, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813470.4968257, "step_id": 10740, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813470.504626, "step_id": 10741, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813470.5125194, "step_id": 10742, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813470.5205855, "step_id": 10743, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813470.5291975, "step_id": 10744, "start_load_kv_us": 4, "get_finished_us": 239} +{"t_unix": 1779813470.5365443, "step_id": 10745, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813470.5447032, "step_id": 10746, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813470.5526507, "step_id": 10747, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813470.5612245, "step_id": 10748, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813470.5692253, "step_id": 10749, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813470.5763638, "step_id": 10750, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813470.5848222, "step_id": 10751, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813470.5919209, "step_id": 10752, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813470.599535, "step_id": 10753, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813470.6071165, "step_id": 10754, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813470.6147127, "step_id": 10755, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813470.6223547, "step_id": 10756, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813470.6301458, "step_id": 10757, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813470.6380847, "step_id": 10758, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813470.6460247, "step_id": 10759, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813470.6541712, "step_id": 10760, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813470.6610281, "step_id": 10761, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813470.6697154, "step_id": 10762, "start_load_kv_us": 3, "get_finished_us": 168} +{"t_unix": 1779813470.6768594, "step_id": 10763, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813470.6853685, "step_id": 10764, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813470.6932979, "step_id": 10765, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813470.7006795, "step_id": 10766, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813470.709666, "step_id": 10767, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813470.7170813, "step_id": 10768, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813470.724225, "step_id": 10769, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813470.7717502, "step_id": 10770, "start_load_kv_us": 142, "get_finished_us": 318} +{"t_unix": 1779813470.7754424, "step_id": 10771, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813470.974311, "step_id": 10772, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813470.9820647, "step_id": 10773, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813470.989804, "step_id": 10774, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813470.99741, "step_id": 10775, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813471.0051532, "step_id": 10776, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813471.0129325, "step_id": 10777, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813471.0233917, "step_id": 10778, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813471.0287488, "step_id": 10779, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813471.0384874, "step_id": 10780, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813471.045191, "step_id": 10781, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813471.0526779, "step_id": 10782, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813471.0612283, "step_id": 10783, "start_load_kv_us": 6, "get_finished_us": 185} +{"t_unix": 1779813471.0681055, "step_id": 10784, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813471.0758257, "step_id": 10785, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813471.0833068, "step_id": 10786, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813471.091178, "step_id": 10787, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813471.0988977, "step_id": 10788, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813471.106522, "step_id": 10789, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813471.1138225, "step_id": 10790, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813471.1212473, "step_id": 10791, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813471.1284976, "step_id": 10792, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813471.1357, "step_id": 10793, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813471.1433668, "step_id": 10794, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813471.1506984, "step_id": 10795, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813471.1589687, "step_id": 10796, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813471.1666682, "step_id": 10797, "start_load_kv_us": 6, "get_finished_us": 162} +{"t_unix": 1779813471.1733766, "step_id": 10798, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813471.1818697, "step_id": 10799, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813471.1886396, "step_id": 10800, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813471.1963408, "step_id": 10801, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813471.2036228, "step_id": 10802, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813471.2113056, "step_id": 10803, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813471.2188754, "step_id": 10804, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813471.2267392, "step_id": 10805, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813471.2343965, "step_id": 10806, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813471.2421653, "step_id": 10807, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813471.2494166, "step_id": 10808, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813471.2573426, "step_id": 10809, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813471.2651737, "step_id": 10810, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813471.2730124, "step_id": 10811, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813471.281334, "step_id": 10812, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813471.2886522, "step_id": 10813, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813471.2956882, "step_id": 10814, "start_load_kv_us": 1, "get_finished_us": 210} +{"t_unix": 1779813471.3036087, "step_id": 10815, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813471.3104663, "step_id": 10816, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813471.3180695, "step_id": 10817, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813471.325887, "step_id": 10818, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813471.3336616, "step_id": 10819, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813471.3409803, "step_id": 10820, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813471.3488967, "step_id": 10821, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813471.3569617, "step_id": 10822, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813471.3647678, "step_id": 10823, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813471.372692, "step_id": 10824, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813471.3804226, "step_id": 10825, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813471.3881664, "step_id": 10826, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813471.3959146, "step_id": 10827, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813471.404383, "step_id": 10828, "start_load_kv_us": 5, "get_finished_us": 147} +{"t_unix": 1779813471.412062, "step_id": 10829, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813471.4190478, "step_id": 10830, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813471.4274654, "step_id": 10831, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813471.4340966, "step_id": 10832, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813471.4421, "step_id": 10833, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813471.449698, "step_id": 10834, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813471.457556, "step_id": 10835, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813471.4651484, "step_id": 10836, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813471.473036, "step_id": 10837, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813471.4809377, "step_id": 10838, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813471.4887564, "step_id": 10839, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813471.4966033, "step_id": 10840, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813471.5046706, "step_id": 10841, "start_load_kv_us": 1, "get_finished_us": 272} +{"t_unix": 1779813471.5129879, "step_id": 10842, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813471.5202017, "step_id": 10843, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813471.5284452, "step_id": 10844, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813471.5362978, "step_id": 10845, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813471.5435898, "step_id": 10846, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813471.55218, "step_id": 10847, "start_load_kv_us": 4, "get_finished_us": 141} +{"t_unix": 1779813471.5595062, "step_id": 10848, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813471.567079, "step_id": 10849, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813471.5750165, "step_id": 10850, "start_load_kv_us": 1, "get_finished_us": 236} +{"t_unix": 1779813471.5830247, "step_id": 10851, "start_load_kv_us": 1, "get_finished_us": 236} +{"t_unix": 1779813471.5913477, "step_id": 10852, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813471.5991294, "step_id": 10853, "start_load_kv_us": 1, "get_finished_us": 321} +{"t_unix": 1779813471.6070642, "step_id": 10854, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813471.614991, "step_id": 10855, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813471.6229842, "step_id": 10856, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813471.6308775, "step_id": 10857, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813471.638426, "step_id": 10858, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813471.6459267, "step_id": 10859, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813471.6545064, "step_id": 10860, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813471.6623194, "step_id": 10861, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813471.6696584, "step_id": 10862, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813471.6782382, "step_id": 10863, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813471.6854057, "step_id": 10864, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813471.6933358, "step_id": 10865, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813471.7012825, "step_id": 10866, "start_load_kv_us": 1, "get_finished_us": 244} +{"t_unix": 1779813471.7090712, "step_id": 10867, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813471.7168903, "step_id": 10868, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813471.7248175, "step_id": 10869, "start_load_kv_us": 1, "get_finished_us": 217} +{"t_unix": 1779813471.7327662, "step_id": 10870, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813471.740526, "step_id": 10871, "start_load_kv_us": 1, "get_finished_us": 230} +{"t_unix": 1779813471.747893, "step_id": 10872, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813471.7552447, "step_id": 10873, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813471.7630408, "step_id": 10874, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813471.7707717, "step_id": 10875, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813471.7790542, "step_id": 10876, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813471.7868357, "step_id": 10877, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813471.7939103, "step_id": 10878, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813471.840404, "step_id": 10879, "start_load_kv_us": 146, "get_finished_us": 217} +{"t_unix": 1779813471.8441286, "step_id": 10880, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813472.0440242, "step_id": 10881, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813472.0528204, "step_id": 10882, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813472.062212, "step_id": 10883, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813472.0725858, "step_id": 10884, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813472.0816221, "step_id": 10885, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813472.0910697, "step_id": 10886, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813472.1005251, "step_id": 10887, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813472.1102083, "step_id": 10888, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813472.1202524, "step_id": 10889, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813472.1302838, "step_id": 10890, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813472.140116, "step_id": 10891, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813472.150606, "step_id": 10892, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813472.1604536, "step_id": 10893, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813472.1691327, "step_id": 10894, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813472.1791425, "step_id": 10895, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813472.1876895, "step_id": 10896, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813472.196921, "step_id": 10897, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813472.2065032, "step_id": 10898, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813472.2158604, "step_id": 10899, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813472.226142, "step_id": 10900, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813472.2347085, "step_id": 10901, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813472.244179, "step_id": 10902, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813472.2537658, "step_id": 10903, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813472.2634192, "step_id": 10904, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813472.272655, "step_id": 10905, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813472.2821515, "step_id": 10906, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813472.2914655, "step_id": 10907, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813472.301586, "step_id": 10908, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813472.3113484, "step_id": 10909, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813472.3201516, "step_id": 10910, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813472.3303177, "step_id": 10911, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813472.3391786, "step_id": 10912, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813472.3484833, "step_id": 10913, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813472.3580327, "step_id": 10914, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813472.3675902, "step_id": 10915, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813472.3792405, "step_id": 10916, "start_load_kv_us": 24, "get_finished_us": 234} +{"t_unix": 1779813472.3878863, "step_id": 10917, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813472.3979766, "step_id": 10918, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813472.4078329, "step_id": 10919, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813472.4174945, "step_id": 10920, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813472.4272258, "step_id": 10921, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813472.4368415, "step_id": 10922, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813472.4465835, "step_id": 10923, "start_load_kv_us": 3, "get_finished_us": 193} +{"t_unix": 1779813472.4572906, "step_id": 10924, "start_load_kv_us": 5, "get_finished_us": 1007} +{"t_unix": 1779813472.5028198, "step_id": 10925, "start_load_kv_us": 138, "get_finished_us": 181} +{"t_unix": 1779813472.506493, "step_id": 10926, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813472.7135122, "step_id": 10927, "start_load_kv_us": 6, "get_finished_us": 349} +{"t_unix": 1779813472.721828, "step_id": 10928, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813472.7304807, "step_id": 10929, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813472.7400286, "step_id": 10930, "start_load_kv_us": 1, "get_finished_us": 261} +{"t_unix": 1779813472.749181, "step_id": 10931, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813472.7592754, "step_id": 10932, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813472.767855, "step_id": 10933, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813472.7765722, "step_id": 10934, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813472.7857022, "step_id": 10935, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813472.7943113, "step_id": 10936, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813472.8037055, "step_id": 10937, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813472.8134968, "step_id": 10938, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813472.8227897, "step_id": 10939, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813472.832362, "step_id": 10940, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813472.8428571, "step_id": 10941, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813472.8517303, "step_id": 10942, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813472.8620055, "step_id": 10943, "start_load_kv_us": 5, "get_finished_us": 283} +{"t_unix": 1779813472.8715076, "step_id": 10944, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813472.878415, "step_id": 10945, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813472.8861172, "step_id": 10946, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813472.893595, "step_id": 10947, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813472.90215, "step_id": 10948, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813472.9093027, "step_id": 10949, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813472.9166822, "step_id": 10950, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813472.9243557, "step_id": 10951, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813472.9321175, "step_id": 10952, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813472.9397194, "step_id": 10953, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813472.9850109, "step_id": 10954, "start_load_kv_us": 150, "get_finished_us": 331} +{"t_unix": 1779813472.988757, "step_id": 10955, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813473.19192, "step_id": 10956, "start_load_kv_us": 2, "get_finished_us": 406} +{"t_unix": 1779813473.2010765, "step_id": 10957, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813473.209902, "step_id": 10958, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813473.2200136, "step_id": 10959, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813473.22967, "step_id": 10960, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813473.238492, "step_id": 10961, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813473.2486362, "step_id": 10962, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813473.25753, "step_id": 10963, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813473.267505, "step_id": 10964, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813473.2762616, "step_id": 10965, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813473.2858005, "step_id": 10966, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813473.2952127, "step_id": 10967, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813473.3045425, "step_id": 10968, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813473.3139997, "step_id": 10969, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813473.3235238, "step_id": 10970, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813473.3332047, "step_id": 10971, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813473.350724, "step_id": 10972, "start_load_kv_us": 10, "get_finished_us": 2188} +{"t_unix": 1779813473.3551993, "step_id": 10973, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813473.3603768, "step_id": 10974, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813473.36827, "step_id": 10975, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813473.3766448, "step_id": 10976, "start_load_kv_us": 19, "get_finished_us": 160} +{"t_unix": 1779813473.3836985, "step_id": 10977, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813473.3925192, "step_id": 10978, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813473.3999925, "step_id": 10979, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813473.4091144, "step_id": 10980, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813473.4164681, "step_id": 10981, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813473.4245758, "step_id": 10982, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813473.4327264, "step_id": 10983, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813473.440756, "step_id": 10984, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813473.448308, "step_id": 10985, "start_load_kv_us": 1, "get_finished_us": 222} +{"t_unix": 1779813473.4560893, "step_id": 10986, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813473.4640634, "step_id": 10987, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813473.4721913, "step_id": 10988, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813473.4808156, "step_id": 10989, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813473.4879525, "step_id": 10990, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813473.4958625, "step_id": 10991, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813473.504417, "step_id": 10992, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813473.5117834, "step_id": 10993, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813473.5203195, "step_id": 10994, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813473.5274727, "step_id": 10995, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813473.5359833, "step_id": 10996, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813473.5431054, "step_id": 10997, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813473.5504625, "step_id": 10998, "start_load_kv_us": 1, "get_finished_us": 299} +{"t_unix": 1779813473.5580895, "step_id": 10999, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813473.5657618, "step_id": 11000, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813473.5735214, "step_id": 11001, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813473.5813565, "step_id": 11002, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813473.5889268, "step_id": 11003, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813473.5966868, "step_id": 11004, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813473.6049242, "step_id": 11005, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813473.6118555, "step_id": 11006, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813473.6194708, "step_id": 11007, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813473.6276383, "step_id": 11008, "start_load_kv_us": 18, "get_finished_us": 154} +{"t_unix": 1779813473.6350746, "step_id": 11009, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813473.6431267, "step_id": 11010, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813473.6504743, "step_id": 11011, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813473.659059, "step_id": 11012, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813473.6665635, "step_id": 11013, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813473.674272, "step_id": 11014, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813473.6821811, "step_id": 11015, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813473.6901302, "step_id": 11016, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813473.6974063, "step_id": 11017, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813473.7050076, "step_id": 11018, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813473.712721, "step_id": 11019, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813473.720603, "step_id": 11020, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813473.7290862, "step_id": 11021, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813473.7359092, "step_id": 11022, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813473.7437103, "step_id": 11023, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813473.752219, "step_id": 11024, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813473.759597, "step_id": 11025, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813473.7685976, "step_id": 11026, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813473.775626, "step_id": 11027, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813473.7836173, "step_id": 11028, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813473.7904506, "step_id": 11029, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813473.8378685, "step_id": 11030, "start_load_kv_us": 161, "get_finished_us": 233} +{"t_unix": 1779813474.0310256, "step_id": 11031, "start_load_kv_us": 145, "get_finished_us": 315} +{"t_unix": 1779813474.0422795, "step_id": 11032, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813474.271697, "step_id": 11033, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813474.281542, "step_id": 11034, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813474.2902741, "step_id": 11035, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813474.2994902, "step_id": 11036, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813474.309267, "step_id": 11037, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813474.3187945, "step_id": 11038, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813474.3284738, "step_id": 11039, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813474.3386571, "step_id": 11040, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813474.3472362, "step_id": 11041, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813474.3571723, "step_id": 11042, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813474.36597, "step_id": 11043, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813474.3761027, "step_id": 11044, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813474.3848517, "step_id": 11045, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813474.39437, "step_id": 11046, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813474.4043686, "step_id": 11047, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813474.4133272, "step_id": 11048, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813474.4230478, "step_id": 11049, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813474.433375, "step_id": 11050, "start_load_kv_us": 5, "get_finished_us": 272} +{"t_unix": 1779813474.4423206, "step_id": 11051, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813474.451512, "step_id": 11052, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813474.4608793, "step_id": 11053, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813474.4702911, "step_id": 11054, "start_load_kv_us": 3, "get_finished_us": 216} +{"t_unix": 1779813474.4796102, "step_id": 11055, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813474.4898841, "step_id": 11056, "start_load_kv_us": 9, "get_finished_us": 180} +{"t_unix": 1779813474.498729, "step_id": 11057, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813474.5088663, "step_id": 11058, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813474.5173876, "step_id": 11059, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813474.5273192, "step_id": 11060, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813474.5361571, "step_id": 11061, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813474.545651, "step_id": 11062, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813474.5559127, "step_id": 11063, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813474.5652056, "step_id": 11064, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813474.575033, "step_id": 11065, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813474.5853674, "step_id": 11066, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813474.5943186, "step_id": 11067, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813474.6036322, "step_id": 11068, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813474.6130106, "step_id": 11069, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813474.6225562, "step_id": 11070, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813474.6321766, "step_id": 11071, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813474.6423357, "step_id": 11072, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813474.6513195, "step_id": 11073, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813474.6614642, "step_id": 11074, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813474.6704025, "step_id": 11075, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813474.680394, "step_id": 11076, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813474.6891277, "step_id": 11077, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813474.698703, "step_id": 11078, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813474.7088225, "step_id": 11079, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813474.71831, "step_id": 11080, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813474.7278044, "step_id": 11081, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813474.738423, "step_id": 11082, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813474.7475672, "step_id": 11083, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813474.7573195, "step_id": 11084, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813474.7669635, "step_id": 11085, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813474.776535, "step_id": 11086, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813474.7861319, "step_id": 11087, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813474.7962537, "step_id": 11088, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813474.8051908, "step_id": 11089, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813474.815638, "step_id": 11090, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813474.8245199, "step_id": 11091, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813474.8349025, "step_id": 11092, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813474.844837, "step_id": 11093, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813474.8543062, "step_id": 11094, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813474.8654072, "step_id": 11095, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813474.8747988, "step_id": 11096, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813474.8848073, "step_id": 11097, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813474.8957844, "step_id": 11098, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813474.9051077, "step_id": 11099, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813474.9147713, "step_id": 11100, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813474.9246273, "step_id": 11101, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813474.9342792, "step_id": 11102, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813474.943975, "step_id": 11103, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813474.9541383, "step_id": 11104, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813474.963029, "step_id": 11105, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813474.9731603, "step_id": 11106, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813474.9823084, "step_id": 11107, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813474.9925168, "step_id": 11108, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813475.0016065, "step_id": 11109, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813475.0115817, "step_id": 11110, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813475.021982, "step_id": 11111, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813475.0310397, "step_id": 11112, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813475.04059, "step_id": 11113, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813475.051019, "step_id": 11114, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813475.0602417, "step_id": 11115, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813475.0701494, "step_id": 11116, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813475.0800347, "step_id": 11117, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813475.0897472, "step_id": 11118, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813475.0993924, "step_id": 11119, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813475.1098845, "step_id": 11120, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813475.1188278, "step_id": 11121, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813475.128742, "step_id": 11122, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813475.1377807, "step_id": 11123, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813475.1480548, "step_id": 11124, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813475.1570528, "step_id": 11125, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813475.1669, "step_id": 11126, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813475.1773078, "step_id": 11127, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813475.1870198, "step_id": 11128, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813475.1972, "step_id": 11129, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813475.2079237, "step_id": 11130, "start_load_kv_us": 4, "get_finished_us": 300} +{"t_unix": 1779813475.216951, "step_id": 11131, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813475.2266314, "step_id": 11132, "start_load_kv_us": 3, "get_finished_us": 293} +{"t_unix": 1779813475.2361977, "step_id": 11133, "start_load_kv_us": 2, "get_finished_us": 329} +{"t_unix": 1779813475.2452188, "step_id": 11134, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813475.2550397, "step_id": 11135, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813475.2650142, "step_id": 11136, "start_load_kv_us": 4, "get_finished_us": 240} +{"t_unix": 1779813475.2718735, "step_id": 11137, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813475.2797847, "step_id": 11138, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813475.2869234, "step_id": 11139, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813475.2943127, "step_id": 11140, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813475.3014705, "step_id": 11141, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813475.3089144, "step_id": 11142, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813475.3172772, "step_id": 11143, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813475.3239808, "step_id": 11144, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813475.3318396, "step_id": 11145, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813475.3398702, "step_id": 11146, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813475.3467114, "step_id": 11147, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813475.3544233, "step_id": 11148, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813475.3617406, "step_id": 11149, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813475.3692412, "step_id": 11150, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813475.3769803, "step_id": 11151, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813475.385279, "step_id": 11152, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813475.3920138, "step_id": 11153, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813475.4001868, "step_id": 11154, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813475.4076376, "step_id": 11155, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813475.4150648, "step_id": 11156, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813475.4223866, "step_id": 11157, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813475.4301696, "step_id": 11158, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813475.4384944, "step_id": 11159, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813475.4457617, "step_id": 11160, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813475.4533448, "step_id": 11161, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813475.4619641, "step_id": 11162, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813475.4691818, "step_id": 11163, "start_load_kv_us": 3, "get_finished_us": 190} +{"t_unix": 1779813475.4770157, "step_id": 11164, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813475.4850035, "step_id": 11165, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813475.4925852, "step_id": 11166, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813475.4996235, "step_id": 11167, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813475.5077147, "step_id": 11168, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813475.5142558, "step_id": 11169, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813475.5226684, "step_id": 11170, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813475.529817, "step_id": 11171, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813475.537281, "step_id": 11172, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813475.544202, "step_id": 11173, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813475.5516722, "step_id": 11174, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813475.559985, "step_id": 11175, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813475.566876, "step_id": 11176, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813475.5742383, "step_id": 11177, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813475.5821617, "step_id": 11178, "start_load_kv_us": 17, "get_finished_us": 169} +{"t_unix": 1779813475.588229, "step_id": 11179, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813475.595712, "step_id": 11180, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813475.6036532, "step_id": 11181, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813475.610778, "step_id": 11182, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813475.6176443, "step_id": 11183, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813475.6247602, "step_id": 11184, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813475.6314776, "step_id": 11185, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813475.6387844, "step_id": 11186, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813475.645225, "step_id": 11187, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813475.6523263, "step_id": 11188, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813475.6594088, "step_id": 11189, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813475.6661716, "step_id": 11190, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813475.6738298, "step_id": 11191, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813475.6802862, "step_id": 11192, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813475.7263231, "step_id": 11193, "start_load_kv_us": 145, "get_finished_us": 193} +{"t_unix": 1779813475.7305982, "step_id": 11194, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813475.9323125, "step_id": 11195, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813475.9396055, "step_id": 11196, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813475.947044, "step_id": 11197, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813475.9546528, "step_id": 11198, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813475.9621747, "step_id": 11199, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813475.9698243, "step_id": 11200, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813475.9778802, "step_id": 11201, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813475.9857903, "step_id": 11202, "start_load_kv_us": 5, "get_finished_us": 143} +{"t_unix": 1779813475.9925592, "step_id": 11203, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813475.9997666, "step_id": 11204, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813476.0074797, "step_id": 11205, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813476.015046, "step_id": 11206, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813476.0234096, "step_id": 11207, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813476.0304332, "step_id": 11208, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813476.037598, "step_id": 11209, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813476.0454872, "step_id": 11210, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813476.0519207, "step_id": 11211, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813476.0584633, "step_id": 11212, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813476.0651178, "step_id": 11213, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813476.0721452, "step_id": 11214, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813476.0794237, "step_id": 11215, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813476.08681, "step_id": 11216, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813476.0940573, "step_id": 11217, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813476.1016896, "step_id": 11218, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813476.1078959, "step_id": 11219, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813476.1148705, "step_id": 11220, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.122337, "step_id": 11221, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813476.1293068, "step_id": 11222, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813476.137114, "step_id": 11223, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813476.1437805, "step_id": 11224, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813476.1512659, "step_id": 11225, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813476.1589367, "step_id": 11226, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813476.165528, "step_id": 11227, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813476.1723, "step_id": 11228, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813476.1792312, "step_id": 11229, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813476.1861417, "step_id": 11230, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813476.1934016, "step_id": 11231, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813476.2011216, "step_id": 11232, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813476.2085063, "step_id": 11233, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813476.2164657, "step_id": 11234, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813476.2229323, "step_id": 11235, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813476.2302852, "step_id": 11236, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813476.2375994, "step_id": 11237, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813476.2446728, "step_id": 11238, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813476.2527552, "step_id": 11239, "start_load_kv_us": 4, "get_finished_us": 136} +{"t_unix": 1779813476.2595232, "step_id": 11240, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813476.2665315, "step_id": 11241, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813476.2742739, "step_id": 11242, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813476.280907, "step_id": 11243, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813476.2883222, "step_id": 11244, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813476.2953036, "step_id": 11245, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813476.3028724, "step_id": 11246, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813476.3103793, "step_id": 11247, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813476.317632, "step_id": 11248, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813476.3247468, "step_id": 11249, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813476.3326507, "step_id": 11250, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813476.3391194, "step_id": 11251, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813476.3461456, "step_id": 11252, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813476.3531275, "step_id": 11253, "start_load_kv_us": 15, "get_finished_us": 138} +{"t_unix": 1779813476.360456, "step_id": 11254, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813476.3682952, "step_id": 11255, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813476.3748853, "step_id": 11256, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813476.3822334, "step_id": 11257, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813476.390451, "step_id": 11258, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813476.3972497, "step_id": 11259, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813476.404708, "step_id": 11260, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813476.41222, "step_id": 11261, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813476.4199674, "step_id": 11262, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813476.4270012, "step_id": 11263, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813476.4339387, "step_id": 11264, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813476.4408748, "step_id": 11265, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.44889, "step_id": 11266, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813476.45521, "step_id": 11267, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813476.4623923, "step_id": 11268, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813476.4693491, "step_id": 11269, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813476.4767294, "step_id": 11270, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813476.4848857, "step_id": 11271, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813476.4917796, "step_id": 11272, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813476.4992466, "step_id": 11273, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813476.5071292, "step_id": 11274, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813476.5136566, "step_id": 11275, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813476.5209136, "step_id": 11276, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813476.5282147, "step_id": 11277, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813476.5355709, "step_id": 11278, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813476.5428026, "step_id": 11279, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813476.5496886, "step_id": 11280, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813476.556611, "step_id": 11281, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813476.563982, "step_id": 11282, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813476.5699615, "step_id": 11283, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813476.5765595, "step_id": 11284, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813476.5834253, "step_id": 11285, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813476.590781, "step_id": 11286, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813476.5982275, "step_id": 11287, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.6046126, "step_id": 11288, "start_load_kv_us": 3, "get_finished_us": 153} +{"t_unix": 1779813476.6086032, "step_id": 11289, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813476.6133707, "step_id": 11290, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813476.6181147, "step_id": 11291, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813476.6229603, "step_id": 11292, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813476.6276433, "step_id": 11293, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813476.6324828, "step_id": 11294, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813476.6372757, "step_id": 11295, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813476.642012, "step_id": 11296, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813476.6467912, "step_id": 11297, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813476.6522112, "step_id": 11298, "start_load_kv_us": 4, "get_finished_us": 136} +{"t_unix": 1779813476.656332, "step_id": 11299, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813476.6611469, "step_id": 11300, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.665871, "step_id": 11301, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813476.6706944, "step_id": 11302, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813476.675505, "step_id": 11303, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813476.680226, "step_id": 11304, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813476.6849957, "step_id": 11305, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813476.6898422, "step_id": 11306, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813476.6945922, "step_id": 11307, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813476.6993494, "step_id": 11308, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813476.70411, "step_id": 11309, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813476.7088923, "step_id": 11310, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813476.713664, "step_id": 11311, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813476.7184215, "step_id": 11312, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813476.723335, "step_id": 11313, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813476.7286763, "step_id": 11314, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813476.7329044, "step_id": 11315, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813476.7376156, "step_id": 11316, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813476.7423968, "step_id": 11317, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813476.74752, "step_id": 11318, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813476.751983, "step_id": 11319, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813476.7568023, "step_id": 11320, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813476.7615988, "step_id": 11321, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813476.766311, "step_id": 11322, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813476.7711623, "step_id": 11323, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813476.7759626, "step_id": 11324, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813476.7807086, "step_id": 11325, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813476.785478, "step_id": 11326, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813476.790288, "step_id": 11327, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813476.79505, "step_id": 11328, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813476.7998717, "step_id": 11329, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813476.805319, "step_id": 11330, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813476.8094504, "step_id": 11331, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813476.8142436, "step_id": 11332, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813476.8189938, "step_id": 11333, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813476.8239324, "step_id": 11334, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813476.8287048, "step_id": 11335, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813476.8334959, "step_id": 11336, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813476.838327, "step_id": 11337, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813476.8430169, "step_id": 11338, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813476.8478224, "step_id": 11339, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813476.8525603, "step_id": 11340, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813476.857368, "step_id": 11341, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813476.8622031, "step_id": 11342, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813476.8669214, "step_id": 11343, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813476.871702, "step_id": 11344, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813476.8764262, "step_id": 11345, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813476.8819652, "step_id": 11346, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813476.8860486, "step_id": 11347, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813476.8908372, "step_id": 11348, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.8956149, "step_id": 11349, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813476.9003568, "step_id": 11350, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.9051645, "step_id": 11351, "start_load_kv_us": 17, "get_finished_us": 162} +{"t_unix": 1779813476.9099195, "step_id": 11352, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813476.9147666, "step_id": 11353, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813476.919484, "step_id": 11354, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813476.924317, "step_id": 11355, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813476.9290774, "step_id": 11356, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813476.9338584, "step_id": 11357, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813476.9387543, "step_id": 11358, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813476.9435103, "step_id": 11359, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813476.9482796, "step_id": 11360, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813476.953015, "step_id": 11361, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813476.9584208, "step_id": 11362, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813476.9626117, "step_id": 11363, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813476.9673615, "step_id": 11364, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813476.9720914, "step_id": 11365, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813476.9768782, "step_id": 11366, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813476.9817345, "step_id": 11367, "start_load_kv_us": 3, "get_finished_us": 140} +{"t_unix": 1779813476.9864578, "step_id": 11368, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813476.9912615, "step_id": 11369, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813476.9959865, "step_id": 11370, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813477.000787, "step_id": 11371, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813477.00553, "step_id": 11372, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813477.0103395, "step_id": 11373, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813477.0151339, "step_id": 11374, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813477.02, "step_id": 11375, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813477.0248199, "step_id": 11376, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813477.0296278, "step_id": 11377, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813477.0349329, "step_id": 11378, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813477.0390587, "step_id": 11379, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813477.0439308, "step_id": 11380, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813477.0486057, "step_id": 11381, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813477.0533926, "step_id": 11382, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813477.058167, "step_id": 11383, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813477.062973, "step_id": 11384, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813477.0677567, "step_id": 11385, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813477.0726612, "step_id": 11386, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813477.077333, "step_id": 11387, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813477.0820904, "step_id": 11388, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813477.0868726, "step_id": 11389, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813477.0916913, "step_id": 11390, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813477.0964592, "step_id": 11391, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813477.1011963, "step_id": 11392, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813477.1059906, "step_id": 11393, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813477.1114666, "step_id": 11394, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813477.1155615, "step_id": 11395, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813477.120293, "step_id": 11396, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813477.1251647, "step_id": 11397, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813477.1299136, "step_id": 11398, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813477.1346502, "step_id": 11399, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813477.1394188, "step_id": 11400, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813477.1441891, "step_id": 11401, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813477.1489706, "step_id": 11402, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813477.1537406, "step_id": 11403, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813477.1586044, "step_id": 11404, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813477.1633306, "step_id": 11405, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813477.1681085, "step_id": 11406, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813477.1728792, "step_id": 11407, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813477.177699, "step_id": 11408, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813477.1824648, "step_id": 11409, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813477.1879563, "step_id": 11410, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813477.192031, "step_id": 11411, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813477.196837, "step_id": 11412, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813477.2016418, "step_id": 11413, "start_load_kv_us": 16, "get_finished_us": 160} +{"t_unix": 1779813477.2064695, "step_id": 11414, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813477.211214, "step_id": 11415, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813477.2539675, "step_id": 11416, "start_load_kv_us": 159, "get_finished_us": 195} +{"t_unix": 1779813477.257529, "step_id": 11417, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813477.454471, "step_id": 11418, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813477.4602368, "step_id": 11419, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813477.465994, "step_id": 11420, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813477.47154, "step_id": 11421, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813477.4772506, "step_id": 11422, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813477.4827538, "step_id": 11423, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813477.4885836, "step_id": 11424, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813477.494574, "step_id": 11425, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813477.5010557, "step_id": 11426, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813477.5061104, "step_id": 11427, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813477.511915, "step_id": 11428, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813477.5176172, "step_id": 11429, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813477.5243015, "step_id": 11430, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813477.5296137, "step_id": 11431, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813477.5357273, "step_id": 11432, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813477.54164, "step_id": 11433, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813477.5475435, "step_id": 11434, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813477.5533683, "step_id": 11435, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813477.559157, "step_id": 11436, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813477.5651574, "step_id": 11437, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813477.5709639, "step_id": 11438, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813477.576792, "step_id": 11439, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813477.582706, "step_id": 11440, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813477.588498, "step_id": 11441, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813477.594766, "step_id": 11442, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813477.5998414, "step_id": 11443, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813477.6058574, "step_id": 11444, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813477.6114016, "step_id": 11445, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813477.6178272, "step_id": 11446, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813477.6232018, "step_id": 11447, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813477.6290898, "step_id": 11448, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813477.635159, "step_id": 11449, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813477.6410365, "step_id": 11450, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813477.6456854, "step_id": 11451, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813477.6503856, "step_id": 11452, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813477.655171, "step_id": 11453, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813477.6599114, "step_id": 11454, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813477.6646311, "step_id": 11455, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813477.669391, "step_id": 11456, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813477.6741083, "step_id": 11457, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813477.6789918, "step_id": 11458, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813477.6837387, "step_id": 11459, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813477.688491, "step_id": 11460, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813477.6932838, "step_id": 11461, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813477.698668, "step_id": 11462, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813477.7027707, "step_id": 11463, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813477.7075953, "step_id": 11464, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813477.71241, "step_id": 11465, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813477.717146, "step_id": 11466, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813477.721934, "step_id": 11467, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813477.7267816, "step_id": 11468, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813477.7314095, "step_id": 11469, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813477.7361972, "step_id": 11470, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813477.7409842, "step_id": 11471, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813477.7457588, "step_id": 11472, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813477.7505696, "step_id": 11473, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813477.7553508, "step_id": 11474, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813477.7600772, "step_id": 11475, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813477.7648547, "step_id": 11476, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813477.769712, "step_id": 11477, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813477.775609, "step_id": 11478, "start_load_kv_us": 4, "get_finished_us": 311} +{"t_unix": 1779813477.779292, "step_id": 11479, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813477.783956, "step_id": 11480, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813477.7887614, "step_id": 11481, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813477.7935166, "step_id": 11482, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813477.7982774, "step_id": 11483, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813477.803, "step_id": 11484, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813477.8078556, "step_id": 11485, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813477.8125813, "step_id": 11486, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813477.817399, "step_id": 11487, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813477.8222396, "step_id": 11488, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813477.827007, "step_id": 11489, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813477.8317413, "step_id": 11490, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813477.8364916, "step_id": 11491, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813477.8412669, "step_id": 11492, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813477.8459868, "step_id": 11493, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813477.8515208, "step_id": 11494, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813477.8556373, "step_id": 11495, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813477.8603113, "step_id": 11496, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813477.8651614, "step_id": 11497, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813477.870075, "step_id": 11498, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813477.8747594, "step_id": 11499, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813477.8793879, "step_id": 11500, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813477.8842454, "step_id": 11501, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813477.8889656, "step_id": 11502, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813477.8937278, "step_id": 11503, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813477.8984272, "step_id": 11504, "start_load_kv_us": 1, "get_finished_us": 131} +{"t_unix": 1779813477.9033313, "step_id": 11505, "start_load_kv_us": 1, "get_finished_us": 215} +{"t_unix": 1779813477.9080887, "step_id": 11506, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813477.9128075, "step_id": 11507, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813477.9175854, "step_id": 11508, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813477.9224281, "step_id": 11509, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813477.9279919, "step_id": 11510, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813477.9319627, "step_id": 11511, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813477.9367106, "step_id": 11512, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813477.9415283, "step_id": 11513, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813477.94626, "step_id": 11514, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813477.9510589, "step_id": 11515, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813477.9558477, "step_id": 11516, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813477.9606533, "step_id": 11517, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813477.965497, "step_id": 11518, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813477.9701943, "step_id": 11519, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813477.974986, "step_id": 11520, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813477.9797947, "step_id": 11521, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813477.9845407, "step_id": 11522, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813477.9894145, "step_id": 11523, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813477.9941392, "step_id": 11524, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813477.9990404, "step_id": 11525, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813478.0422957, "step_id": 11526, "start_load_kv_us": 157, "get_finished_us": 253} +{"t_unix": 1779813478.0459101, "step_id": 11527, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813478.2857, "step_id": 11528, "start_load_kv_us": 528, "get_finished_us": 370} +{"t_unix": 1779813478.289752, "step_id": 11529, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813478.487269, "step_id": 11530, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813478.4942908, "step_id": 11531, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813478.5002155, "step_id": 11532, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813478.5070167, "step_id": 11533, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813478.5139284, "step_id": 11534, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813478.5208795, "step_id": 11535, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813478.5287788, "step_id": 11536, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813478.5350378, "step_id": 11537, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813478.542128, "step_id": 11538, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813478.5491457, "step_id": 11539, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813478.5563335, "step_id": 11540, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813478.5634544, "step_id": 11541, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813478.5713575, "step_id": 11542, "start_load_kv_us": 4, "get_finished_us": 253} +{"t_unix": 1779813478.5776033, "step_id": 11543, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813478.5846899, "step_id": 11544, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813478.591599, "step_id": 11545, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813478.5985065, "step_id": 11546, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813478.6057732, "step_id": 11547, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813478.6121278, "step_id": 11548, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813478.6190424, "step_id": 11549, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813478.626066, "step_id": 11550, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813478.6324503, "step_id": 11551, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813478.6396782, "step_id": 11552, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813478.6458755, "step_id": 11553, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813478.6526453, "step_id": 11554, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813478.6591935, "step_id": 11555, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813478.6659656, "step_id": 11556, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813478.673228, "step_id": 11557, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813478.680812, "step_id": 11558, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813478.6867156, "step_id": 11559, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813478.6931157, "step_id": 11560, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813478.6998127, "step_id": 11561, "start_load_kv_us": 3, "get_finished_us": 217} +{"t_unix": 1779813478.7063804, "step_id": 11562, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813478.714107, "step_id": 11563, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813478.7206385, "step_id": 11564, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813478.727534, "step_id": 11565, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813478.734844, "step_id": 11566, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813478.7421622, "step_id": 11567, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813478.7498658, "step_id": 11568, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813478.7567391, "step_id": 11569, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813478.7641652, "step_id": 11570, "start_load_kv_us": 1, "get_finished_us": 233} +{"t_unix": 1779813478.7715673, "step_id": 11571, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813478.7787056, "step_id": 11572, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813478.786153, "step_id": 11573, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813478.7943103, "step_id": 11574, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813478.8010914, "step_id": 11575, "start_load_kv_us": 1, "get_finished_us": 216} +{"t_unix": 1779813478.8094778, "step_id": 11576, "start_load_kv_us": 1, "get_finished_us": 226} +{"t_unix": 1779813478.854714, "step_id": 11577, "start_load_kv_us": 110, "get_finished_us": 290} +{"t_unix": 1779813479.046582, "step_id": 11578, "start_load_kv_us": 103, "get_finished_us": 306} +{"t_unix": 1779813479.0583513, "step_id": 11579, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813479.3327825, "step_id": 11580, "start_load_kv_us": 118, "get_finished_us": 303} +{"t_unix": 1779813479.5294595, "step_id": 11581, "start_load_kv_us": 113, "get_finished_us": 310} +{"t_unix": 1779813479.540822, "step_id": 11582, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813479.7786906, "step_id": 11583, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813479.7905302, "step_id": 11584, "start_load_kv_us": 6, "get_finished_us": 258} +{"t_unix": 1779813479.800886, "step_id": 11585, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813479.8116384, "step_id": 11586, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813479.8223526, "step_id": 11587, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813479.8334036, "step_id": 11588, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813479.8444054, "step_id": 11589, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813479.85979, "step_id": 11590, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813479.8667114, "step_id": 11591, "start_load_kv_us": 2, "get_finished_us": 458} +{"t_unix": 1779813479.8772743, "step_id": 11592, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813479.9295692, "step_id": 11593, "start_load_kv_us": 138, "get_finished_us": 304} +{"t_unix": 1779813479.9338222, "step_id": 11594, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813480.1776674, "step_id": 11595, "start_load_kv_us": 118, "get_finished_us": 323} +{"t_unix": 1779813480.3756378, "step_id": 11596, "start_load_kv_us": 111, "get_finished_us": 360} +{"t_unix": 1779813480.3872356, "step_id": 11597, "start_load_kv_us": 17, "get_finished_us": 228} +{"t_unix": 1779813480.6243484, "step_id": 11598, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813480.6369905, "step_id": 11599, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813480.6506474, "step_id": 11600, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813480.6628199, "step_id": 11601, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813480.6752598, "step_id": 11602, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813480.6878195, "step_id": 11603, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813480.7004158, "step_id": 11604, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813480.7140281, "step_id": 11605, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813480.7269192, "step_id": 11606, "start_load_kv_us": 6, "get_finished_us": 202} +{"t_unix": 1779813480.73926, "step_id": 11607, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813480.7523038, "step_id": 11608, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813480.765888, "step_id": 11609, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813480.7785292, "step_id": 11610, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813480.7923474, "step_id": 11611, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813480.8049254, "step_id": 11612, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813480.817176, "step_id": 11613, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813480.8298202, "step_id": 11614, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813480.8427155, "step_id": 11615, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813480.8568246, "step_id": 11616, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813480.8696957, "step_id": 11617, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813480.883293, "step_id": 11618, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813480.8968046, "step_id": 11619, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813480.9115367, "step_id": 11620, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813480.9243042, "step_id": 11621, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813480.9374611, "step_id": 11622, "start_load_kv_us": 6, "get_finished_us": 252} +{"t_unix": 1779813480.9497285, "step_id": 11623, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813480.96269, "step_id": 11624, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813480.9766524, "step_id": 11625, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813480.9893146, "step_id": 11626, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813481.003815, "step_id": 11627, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813481.0176427, "step_id": 11628, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813481.0303886, "step_id": 11629, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813481.0436957, "step_id": 11630, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813481.0572996, "step_id": 11631, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813481.0715992, "step_id": 11632, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813481.0841684, "step_id": 11633, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813481.0976245, "step_id": 11634, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813481.1107273, "step_id": 11635, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813481.1242073, "step_id": 11636, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813481.137934, "step_id": 11637, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813481.151427, "step_id": 11638, "start_load_kv_us": 6, "get_finished_us": 150} +{"t_unix": 1779813481.1642041, "step_id": 11639, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813481.1778417, "step_id": 11640, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813481.1932747, "step_id": 11641, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813481.2437587, "step_id": 11642, "start_load_kv_us": 130, "get_finished_us": 299} +{"t_unix": 1779813481.2481985, "step_id": 11643, "start_load_kv_us": 17, "get_finished_us": 207} +{"t_unix": 1779813481.4943635, "step_id": 11644, "start_load_kv_us": 125, "get_finished_us": 281} +{"t_unix": 1779813481.4981685, "step_id": 11645, "start_load_kv_us": 16, "get_finished_us": 173} +{"t_unix": 1779813481.7075443, "step_id": 11646, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813481.721266, "step_id": 11647, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813481.7345138, "step_id": 11648, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813481.7473252, "step_id": 11649, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813481.760563, "step_id": 11650, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813481.7742023, "step_id": 11651, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813481.7884634, "step_id": 11652, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813481.8024101, "step_id": 11653, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813481.816481, "step_id": 11654, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813481.8298848, "step_id": 11655, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813481.844189, "step_id": 11656, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813481.8589897, "step_id": 11657, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813481.8724747, "step_id": 11658, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813481.8868759, "step_id": 11659, "start_load_kv_us": 5, "get_finished_us": 265} +{"t_unix": 1779813481.9000828, "step_id": 11660, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813481.9131594, "step_id": 11661, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813481.9268456, "step_id": 11662, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813481.9789746, "step_id": 11663, "start_load_kv_us": 126, "get_finished_us": 332} +{"t_unix": 1779813482.183536, "step_id": 11664, "start_load_kv_us": 132, "get_finished_us": 360} +{"t_unix": 1779813482.195483, "step_id": 11665, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813482.4355674, "step_id": 11666, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813482.4497073, "step_id": 11667, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813482.4652884, "step_id": 11668, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813482.4802487, "step_id": 11669, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813482.4951992, "step_id": 11670, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813482.5470724, "step_id": 11671, "start_load_kv_us": 128, "get_finished_us": 340} +{"t_unix": 1779813482.5514722, "step_id": 11672, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813482.7647135, "step_id": 11673, "start_load_kv_us": 6, "get_finished_us": 299} +{"t_unix": 1779813482.7779918, "step_id": 11674, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813482.7933326, "step_id": 11675, "start_load_kv_us": 6, "get_finished_us": 180} +{"t_unix": 1779813482.808104, "step_id": 11676, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813482.8231535, "step_id": 11677, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813482.8376336, "step_id": 11678, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813482.8532372, "step_id": 11679, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813482.8676746, "step_id": 11680, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813482.881924, "step_id": 11681, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813482.8966901, "step_id": 11682, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813482.9124553, "step_id": 11683, "start_load_kv_us": 5, "get_finished_us": 249} +{"t_unix": 1779813482.9266958, "step_id": 11684, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813482.9409952, "step_id": 11685, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813482.95585, "step_id": 11686, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813482.9701579, "step_id": 11687, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813482.9854202, "step_id": 11688, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813483.0004513, "step_id": 11689, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813483.0148711, "step_id": 11690, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813483.0302243, "step_id": 11691, "start_load_kv_us": 6, "get_finished_us": 181} +{"t_unix": 1779813483.0452359, "step_id": 11692, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813483.0603511, "step_id": 11693, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813483.074518, "step_id": 11694, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813483.0905638, "step_id": 11695, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813483.1057339, "step_id": 11696, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813483.1200306, "step_id": 11697, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813483.134586, "step_id": 11698, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813483.1500332, "step_id": 11699, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813483.1650238, "step_id": 11700, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813483.1796114, "step_id": 11701, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813483.1944244, "step_id": 11702, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813483.2086027, "step_id": 11703, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813483.2233486, "step_id": 11704, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813483.2385237, "step_id": 11705, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813483.2526991, "step_id": 11706, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813483.2682707, "step_id": 11707, "start_load_kv_us": 6, "get_finished_us": 214} +{"t_unix": 1779813483.2831588, "step_id": 11708, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813483.297712, "step_id": 11709, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813483.312182, "step_id": 11710, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813483.3270855, "step_id": 11711, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813483.3421507, "step_id": 11712, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813483.3560224, "step_id": 11713, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813483.3710248, "step_id": 11714, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813483.3864822, "step_id": 11715, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813483.4017594, "step_id": 11716, "start_load_kv_us": 4, "get_finished_us": 295} +{"t_unix": 1779813483.4172993, "step_id": 11717, "start_load_kv_us": 5, "get_finished_us": 260} +{"t_unix": 1779813483.4330256, "step_id": 11718, "start_load_kv_us": 5, "get_finished_us": 306} +{"t_unix": 1779813483.448058, "step_id": 11719, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813483.4625065, "step_id": 11720, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813483.4782526, "step_id": 11721, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813483.492169, "step_id": 11722, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813483.5076418, "step_id": 11723, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813483.522668, "step_id": 11724, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813483.539404, "step_id": 11725, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813483.5920181, "step_id": 11726, "start_load_kv_us": 109, "get_finished_us": 288} +{"t_unix": 1779813483.5966494, "step_id": 11727, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813483.8098662, "step_id": 11728, "start_load_kv_us": 5, "get_finished_us": 325} +{"t_unix": 1779813483.8235545, "step_id": 11729, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813483.8374114, "step_id": 11730, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813483.853089, "step_id": 11731, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813483.868341, "step_id": 11732, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813483.883118, "step_id": 11733, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813483.8975735, "step_id": 11734, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813483.9116325, "step_id": 11735, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813483.9262083, "step_id": 11736, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813483.9415734, "step_id": 11737, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813483.955773, "step_id": 11738, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813483.9714787, "step_id": 11739, "start_load_kv_us": 6, "get_finished_us": 253} +{"t_unix": 1779813483.9868386, "step_id": 11740, "start_load_kv_us": 5, "get_finished_us": 276} +{"t_unix": 1779813484.0015965, "step_id": 11741, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813484.0159833, "step_id": 11742, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813484.0310912, "step_id": 11743, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813484.0451276, "step_id": 11744, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813484.0591722, "step_id": 11745, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813484.0728567, "step_id": 11746, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813484.0885901, "step_id": 11747, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813484.1035595, "step_id": 11748, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813484.1183171, "step_id": 11749, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813484.1332483, "step_id": 11750, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813484.147706, "step_id": 11751, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813484.162573, "step_id": 11752, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813484.1783628, "step_id": 11753, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813484.1927004, "step_id": 11754, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813484.2082124, "step_id": 11755, "start_load_kv_us": 6, "get_finished_us": 164} +{"t_unix": 1779813484.2226143, "step_id": 11756, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813484.2367702, "step_id": 11757, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813484.250471, "step_id": 11758, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813484.265825, "step_id": 11759, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813484.2803273, "step_id": 11760, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813484.295097, "step_id": 11761, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813484.309271, "step_id": 11762, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813484.3251712, "step_id": 11763, "start_load_kv_us": 4, "get_finished_us": 286} +{"t_unix": 1779813484.339928, "step_id": 11764, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813484.3546, "step_id": 11765, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813484.3689294, "step_id": 11766, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813484.3826833, "step_id": 11767, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813484.3972, "step_id": 11768, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813484.4121308, "step_id": 11769, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813484.425815, "step_id": 11770, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813484.4411213, "step_id": 11771, "start_load_kv_us": 5, "get_finished_us": 248} +{"t_unix": 1779813484.4554558, "step_id": 11772, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813484.4699266, "step_id": 11773, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813484.483998, "step_id": 11774, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813484.4996815, "step_id": 11775, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813484.514382, "step_id": 11776, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813484.5295296, "step_id": 11777, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813484.5438392, "step_id": 11778, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813484.559644, "step_id": 11779, "start_load_kv_us": 4, "get_finished_us": 273} +{"t_unix": 1779813484.6116512, "step_id": 11780, "start_load_kv_us": 119, "get_finished_us": 314} +{"t_unix": 1779813484.6164827, "step_id": 11781, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813484.8300943, "step_id": 11782, "start_load_kv_us": 5, "get_finished_us": 304} +{"t_unix": 1779813484.8798985, "step_id": 11783, "start_load_kv_us": 125, "get_finished_us": 283} +{"t_unix": 1779813484.8842497, "step_id": 11784, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813485.1363013, "step_id": 11785, "start_load_kv_us": 129, "get_finished_us": 288} +{"t_unix": 1779813485.1403754, "step_id": 11786, "start_load_kv_us": 3, "get_finished_us": 208} +{"t_unix": 1779813485.3543105, "step_id": 11787, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813485.3676147, "step_id": 11788, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813485.3813107, "step_id": 11789, "start_load_kv_us": 5, "get_finished_us": 230} +{"t_unix": 1779813485.39518, "step_id": 11790, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813485.4091282, "step_id": 11791, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813485.4230952, "step_id": 11792, "start_load_kv_us": 5, "get_finished_us": 213} +{"t_unix": 1779813485.4370553, "step_id": 11793, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813485.4505138, "step_id": 11794, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813485.4653802, "step_id": 11795, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813485.4793162, "step_id": 11796, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813485.4937098, "step_id": 11797, "start_load_kv_us": 7, "get_finished_us": 180} +{"t_unix": 1779813485.5078366, "step_id": 11798, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813485.521162, "step_id": 11799, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813485.5351627, "step_id": 11800, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813485.550674, "step_id": 11801, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813485.601503, "step_id": 11802, "start_load_kv_us": 119, "get_finished_us": 246} +{"t_unix": 1779813485.6061616, "step_id": 11803, "start_load_kv_us": 20, "get_finished_us": 154} +{"t_unix": 1779813485.8567955, "step_id": 11804, "start_load_kv_us": 117, "get_finished_us": 363} +{"t_unix": 1779813485.8615153, "step_id": 11805, "start_load_kv_us": 5, "get_finished_us": 234} +{"t_unix": 1779813486.116165, "step_id": 11806, "start_load_kv_us": 115, "get_finished_us": 311} +{"t_unix": 1779813486.1208944, "step_id": 11807, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813486.376368, "step_id": 11808, "start_load_kv_us": 114, "get_finished_us": 290} +{"t_unix": 1779813486.3810737, "step_id": 11809, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813486.6354678, "step_id": 11810, "start_load_kv_us": 112, "get_finished_us": 296} +{"t_unix": 1779813486.6401253, "step_id": 11811, "start_load_kv_us": 6, "get_finished_us": 183} +{"t_unix": 1779813486.8593864, "step_id": 11812, "start_load_kv_us": 5, "get_finished_us": 285} +{"t_unix": 1779813486.8797185, "step_id": 11813, "start_load_kv_us": 6, "get_finished_us": 236} +{"t_unix": 1779813486.9003408, "step_id": 11814, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813486.9201818, "step_id": 11815, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813486.940592, "step_id": 11816, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813486.9618537, "step_id": 11817, "start_load_kv_us": 5, "get_finished_us": 231} +{"t_unix": 1779813486.9816797, "step_id": 11818, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813487.0025418, "step_id": 11819, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813487.0230987, "step_id": 11820, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813487.0440915, "step_id": 11821, "start_load_kv_us": 5, "get_finished_us": 253} +{"t_unix": 1779813487.0646617, "step_id": 11822, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813487.085613, "step_id": 11823, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813487.1066983, "step_id": 11824, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813487.1275175, "step_id": 11825, "start_load_kv_us": 6, "get_finished_us": 161} +{"t_unix": 1779813487.1479042, "step_id": 11826, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813487.1761615, "step_id": 11827, "start_load_kv_us": 5, "get_finished_us": 278} +{"t_unix": 1779813487.189924, "step_id": 11828, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813487.2104952, "step_id": 11829, "start_load_kv_us": 6, "get_finished_us": 183} +{"t_unix": 1779813487.2315836, "step_id": 11830, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813487.2516465, "step_id": 11831, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813487.2723818, "step_id": 11832, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813487.3314064, "step_id": 11833, "start_load_kv_us": 128, "get_finished_us": 264} +{"t_unix": 1779813487.3366168, "step_id": 11834, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813487.5575902, "step_id": 11835, "start_load_kv_us": 5, "get_finished_us": 286} +{"t_unix": 1779813487.5780528, "step_id": 11836, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813487.599734, "step_id": 11837, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813487.6165698, "step_id": 11838, "start_load_kv_us": 6, "get_finished_us": 191} +{"t_unix": 1779813487.6734834, "step_id": 11839, "start_load_kv_us": 129, "get_finished_us": 333} +{"t_unix": 1779813487.6781366, "step_id": 11840, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813487.8961751, "step_id": 11841, "start_load_kv_us": 6, "get_finished_us": 332} +{"t_unix": 1779813487.9112508, "step_id": 11842, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813487.9287412, "step_id": 11843, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813487.9459789, "step_id": 11844, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813487.9627059, "step_id": 11845, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813487.9797838, "step_id": 11846, "start_load_kv_us": 5, "get_finished_us": 279} +{"t_unix": 1779813487.9964619, "step_id": 11847, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813488.013563, "step_id": 11848, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813488.031844, "step_id": 11849, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813488.0487077, "step_id": 11850, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813488.066623, "step_id": 11851, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813488.083571, "step_id": 11852, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813488.103115, "step_id": 11853, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813488.1177788, "step_id": 11854, "start_load_kv_us": 6, "get_finished_us": 163} +{"t_unix": 1779813488.1325145, "step_id": 11855, "start_load_kv_us": 4, "get_finished_us": 278} +{"t_unix": 1779813488.147267, "step_id": 11856, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813488.1630297, "step_id": 11857, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813488.1774938, "step_id": 11858, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813488.192582, "step_id": 11859, "start_load_kv_us": 6, "get_finished_us": 179} +{"t_unix": 1779813488.207046, "step_id": 11860, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813488.221579, "step_id": 11861, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813488.2352087, "step_id": 11862, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813488.2495842, "step_id": 11863, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813488.264298, "step_id": 11864, "start_load_kv_us": 3, "get_finished_us": 193} +{"t_unix": 1779813488.2794986, "step_id": 11865, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813488.293462, "step_id": 11866, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813488.3081822, "step_id": 11867, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813488.3604274, "step_id": 11868, "start_load_kv_us": 118, "get_finished_us": 248} +{"t_unix": 1779813488.3650713, "step_id": 11869, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813488.5791326, "step_id": 11870, "start_load_kv_us": 6, "get_finished_us": 326} +{"t_unix": 1779813488.5975027, "step_id": 11871, "start_load_kv_us": 5, "get_finished_us": 281} +{"t_unix": 1779813488.61591, "step_id": 11872, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813488.6345809, "step_id": 11873, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813488.6528006, "step_id": 11874, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813488.6722429, "step_id": 11875, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813488.691199, "step_id": 11876, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813488.7103179, "step_id": 11877, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813488.7280545, "step_id": 11878, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813488.746701, "step_id": 11879, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813488.7653425, "step_id": 11880, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813488.7844784, "step_id": 11881, "start_load_kv_us": 4, "get_finished_us": 282} +{"t_unix": 1779813488.8029664, "step_id": 11882, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813488.8217676, "step_id": 11883, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813488.8401647, "step_id": 11884, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813488.8595939, "step_id": 11885, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813488.8793871, "step_id": 11886, "start_load_kv_us": 6, "get_finished_us": 246} +{"t_unix": 1779813488.8983643, "step_id": 11887, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813488.9170022, "step_id": 11888, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813488.935692, "step_id": 11889, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813488.9539168, "step_id": 11890, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813488.973679, "step_id": 11891, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813488.9929116, "step_id": 11892, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813489.0117846, "step_id": 11893, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813489.0302186, "step_id": 11894, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813489.049414, "step_id": 11895, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813489.0680232, "step_id": 11896, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813489.08702, "step_id": 11897, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813489.109663, "step_id": 11898, "start_load_kv_us": 25, "get_finished_us": 1170} +{"t_unix": 1779813489.124245, "step_id": 11899, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813489.1374815, "step_id": 11900, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813489.1519146, "step_id": 11901, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813489.1666272, "step_id": 11902, "start_load_kv_us": 6, "get_finished_us": 237} +{"t_unix": 1779813489.1822755, "step_id": 11903, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813489.2333493, "step_id": 11904, "start_load_kv_us": 119, "get_finished_us": 303} +{"t_unix": 1779813489.2378361, "step_id": 11905, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813489.4532545, "step_id": 11906, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813489.4730344, "step_id": 11907, "start_load_kv_us": 6, "get_finished_us": 290} +{"t_unix": 1779813489.4817424, "step_id": 11908, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813489.4965935, "step_id": 11909, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813489.5106344, "step_id": 11910, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813489.525404, "step_id": 11911, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813489.5404587, "step_id": 11912, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813489.555966, "step_id": 11913, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813489.570764, "step_id": 11914, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813489.585514, "step_id": 11915, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813489.5996044, "step_id": 11916, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813489.6142764, "step_id": 11917, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813489.6287603, "step_id": 11918, "start_load_kv_us": 6, "get_finished_us": 150} +{"t_unix": 1779813489.643751, "step_id": 11919, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813489.6586132, "step_id": 11920, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813489.6730194, "step_id": 11921, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813489.687739, "step_id": 11922, "start_load_kv_us": 3, "get_finished_us": 146} +{"t_unix": 1779813489.7037709, "step_id": 11923, "start_load_kv_us": 6, "get_finished_us": 149} +{"t_unix": 1779813489.7186189, "step_id": 11924, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813489.7349312, "step_id": 11925, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813489.7495713, "step_id": 11926, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813489.7651825, "step_id": 11927, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813489.7799187, "step_id": 11928, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813489.7946744, "step_id": 11929, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813489.8088508, "step_id": 11930, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813489.8224056, "step_id": 11931, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813489.8361406, "step_id": 11932, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813489.8505685, "step_id": 11933, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813489.8657463, "step_id": 11934, "start_load_kv_us": 6, "get_finished_us": 283} +{"t_unix": 1779813489.880644, "step_id": 11935, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813489.8954616, "step_id": 11936, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813489.9098613, "step_id": 11937, "start_load_kv_us": 5, "get_finished_us": 250} +{"t_unix": 1779813489.9230342, "step_id": 11938, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813489.9374676, "step_id": 11939, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813489.9510536, "step_id": 11940, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813489.9655948, "step_id": 11941, "start_load_kv_us": 4, "get_finished_us": 281} +{"t_unix": 1779813489.9790957, "step_id": 11942, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813489.9935782, "step_id": 11943, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813490.0075324, "step_id": 11944, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813490.0217547, "step_id": 11945, "start_load_kv_us": 4, "get_finished_us": 277} +{"t_unix": 1779813490.0359879, "step_id": 11946, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813490.0488684, "step_id": 11947, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813490.063248, "step_id": 11948, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813490.077396, "step_id": 11949, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813490.0918138, "step_id": 11950, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813490.1057293, "step_id": 11951, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813490.120042, "step_id": 11952, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813490.134423, "step_id": 11953, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813490.147803, "step_id": 11954, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813490.1630826, "step_id": 11955, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813490.1768372, "step_id": 11956, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813490.1916692, "step_id": 11957, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813490.2052867, "step_id": 11958, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813490.2201319, "step_id": 11959, "start_load_kv_us": 1, "get_finished_us": 232} +{"t_unix": 1779813490.2349045, "step_id": 11960, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813490.2500172, "step_id": 11961, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813490.2644324, "step_id": 11962, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813490.2787018, "step_id": 11963, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813490.2945209, "step_id": 11964, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813490.346565, "step_id": 11965, "start_load_kv_us": 131, "get_finished_us": 320} +{"t_unix": 1779813490.3511684, "step_id": 11966, "start_load_kv_us": 6, "get_finished_us": 239} +{"t_unix": 1779813490.5642068, "step_id": 11967, "start_load_kv_us": 5, "get_finished_us": 320} +{"t_unix": 1779813490.5790226, "step_id": 11968, "start_load_kv_us": 5, "get_finished_us": 248} +{"t_unix": 1779813490.5940087, "step_id": 11969, "start_load_kv_us": 5, "get_finished_us": 248} +{"t_unix": 1779813490.6086135, "step_id": 11970, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813490.624471, "step_id": 11971, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813490.6390305, "step_id": 11972, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813490.6547954, "step_id": 11973, "start_load_kv_us": 14, "get_finished_us": 199} +{"t_unix": 1779813490.6692054, "step_id": 11974, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813490.684131, "step_id": 11975, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813490.6993556, "step_id": 11976, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813490.7153704, "step_id": 11977, "start_load_kv_us": 4, "get_finished_us": 292} +{"t_unix": 1779813490.7307632, "step_id": 11978, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813490.7454152, "step_id": 11979, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813490.7611556, "step_id": 11980, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813490.776296, "step_id": 11981, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813490.7922206, "step_id": 11982, "start_load_kv_us": 6, "get_finished_us": 160} +{"t_unix": 1779813490.807384, "step_id": 11983, "start_load_kv_us": 5, "get_finished_us": 291} +{"t_unix": 1779813490.8212447, "step_id": 11984, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813490.8353164, "step_id": 11985, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813490.8493412, "step_id": 11986, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813490.90146, "step_id": 11987, "start_load_kv_us": 134, "get_finished_us": 281} +{"t_unix": 1779813490.9053357, "step_id": 11988, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813491.1193004, "step_id": 11989, "start_load_kv_us": 5, "get_finished_us": 304} +{"t_unix": 1779813491.1329944, "step_id": 11990, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813491.1477463, "step_id": 11991, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813491.1628332, "step_id": 11992, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813491.1773117, "step_id": 11993, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813491.1919308, "step_id": 11994, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813491.206275, "step_id": 11995, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813491.2208412, "step_id": 11996, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813491.2353585, "step_id": 11997, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813491.2504787, "step_id": 11998, "start_load_kv_us": 6, "get_finished_us": 150} +{"t_unix": 1779813491.265428, "step_id": 11999, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813491.2807333, "step_id": 12000, "start_load_kv_us": 6, "get_finished_us": 204} +{"t_unix": 1779813491.2960997, "step_id": 12001, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813491.3106475, "step_id": 12002, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813491.3261101, "step_id": 12003, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813491.3398757, "step_id": 12004, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813491.3549156, "step_id": 12005, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813491.3686173, "step_id": 12006, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813491.3832204, "step_id": 12007, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813491.398701, "step_id": 12008, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813491.4140759, "step_id": 12009, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813491.4294486, "step_id": 12010, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813491.4441323, "step_id": 12011, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813491.4593668, "step_id": 12012, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813491.4747, "step_id": 12013, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813491.4906445, "step_id": 12014, "start_load_kv_us": 6, "get_finished_us": 274} +{"t_unix": 1779813491.5064561, "step_id": 12015, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813491.522113, "step_id": 12016, "start_load_kv_us": 6, "get_finished_us": 296} +{"t_unix": 1779813491.5374906, "step_id": 12017, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813491.552609, "step_id": 12018, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813491.5689092, "step_id": 12019, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813491.5841434, "step_id": 12020, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813491.6004035, "step_id": 12021, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813491.615332, "step_id": 12022, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813491.631193, "step_id": 12023, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813491.6472123, "step_id": 12024, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813491.6627715, "step_id": 12025, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813491.6789784, "step_id": 12026, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813491.693822, "step_id": 12027, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813491.709742, "step_id": 12028, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813491.7254045, "step_id": 12029, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813491.7418797, "step_id": 12030, "start_load_kv_us": 5, "get_finished_us": 272} +{"t_unix": 1779813491.7571287, "step_id": 12031, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813491.772677, "step_id": 12032, "start_load_kv_us": 5, "get_finished_us": 161} +{"t_unix": 1779813491.7882905, "step_id": 12033, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813491.8033726, "step_id": 12034, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813491.8199754, "step_id": 12035, "start_load_kv_us": 5, "get_finished_us": 253} +{"t_unix": 1779813491.835337, "step_id": 12036, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813491.8517919, "step_id": 12037, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813491.8661191, "step_id": 12038, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813491.8817153, "step_id": 12039, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813491.896842, "step_id": 12040, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813491.9113846, "step_id": 12041, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813491.9262307, "step_id": 12042, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813491.940393, "step_id": 12043, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813491.9551091, "step_id": 12044, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813491.969835, "step_id": 12045, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813491.9849002, "step_id": 12046, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813491.998869, "step_id": 12047, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813492.0130255, "step_id": 12048, "start_load_kv_us": 5, "get_finished_us": 254} +{"t_unix": 1779813492.026699, "step_id": 12049, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813492.0400808, "step_id": 12050, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813492.0547843, "step_id": 12051, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813492.0682929, "step_id": 12052, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813492.08247, "step_id": 12053, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813492.0963495, "step_id": 12054, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813492.110654, "step_id": 12055, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813492.1257336, "step_id": 12056, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813492.1402607, "step_id": 12057, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813492.154618, "step_id": 12058, "start_load_kv_us": 5, "get_finished_us": 156} +{"t_unix": 1779813492.1682506, "step_id": 12059, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813492.183387, "step_id": 12060, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813492.1967697, "step_id": 12061, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813492.2085059, "step_id": 12062, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813492.2196903, "step_id": 12063, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813492.2316885, "step_id": 12064, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813492.2425597, "step_id": 12065, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813492.2544768, "step_id": 12066, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813492.2668397, "step_id": 12067, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813492.2757337, "step_id": 12068, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813492.285193, "step_id": 12069, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813492.2941773, "step_id": 12070, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813492.3031511, "step_id": 12071, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813492.3135169, "step_id": 12072, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813492.3228426, "step_id": 12073, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813492.333126, "step_id": 12074, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813492.3422894, "step_id": 12075, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813492.3520854, "step_id": 12076, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813492.3613746, "step_id": 12077, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813492.3709593, "step_id": 12078, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813492.3813326, "step_id": 12079, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813492.3908591, "step_id": 12080, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813492.3998702, "step_id": 12081, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813492.4093015, "step_id": 12082, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813492.4192123, "step_id": 12083, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813492.4281144, "step_id": 12084, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813492.4377882, "step_id": 12085, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813492.4470851, "step_id": 12086, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813492.4568667, "step_id": 12087, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813492.467193, "step_id": 12088, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813492.4761083, "step_id": 12089, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813492.486023, "step_id": 12090, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813492.495632, "step_id": 12091, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813492.505659, "step_id": 12092, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813492.515602, "step_id": 12093, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813492.5259075, "step_id": 12094, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813492.537157, "step_id": 12095, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813492.5472457, "step_id": 12096, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813492.55515, "step_id": 12097, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813492.563905, "step_id": 12098, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813492.5734723, "step_id": 12099, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813492.5813367, "step_id": 12100, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813492.5901225, "step_id": 12101, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813492.5988164, "step_id": 12102, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813492.6075797, "step_id": 12103, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813492.6170373, "step_id": 12104, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813492.6252, "step_id": 12105, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813492.633658, "step_id": 12106, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813492.6424277, "step_id": 12107, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813492.6511335, "step_id": 12108, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813492.6598105, "step_id": 12109, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813492.6685355, "step_id": 12110, "start_load_kv_us": 1, "get_finished_us": 249} +{"t_unix": 1779813492.678028, "step_id": 12111, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813492.6868322, "step_id": 12112, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813492.694734, "step_id": 12113, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813492.703486, "step_id": 12114, "start_load_kv_us": 1, "get_finished_us": 212} +{"t_unix": 1779813492.7126877, "step_id": 12115, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813492.7205703, "step_id": 12116, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813492.729056, "step_id": 12117, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813492.7375681, "step_id": 12118, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813492.7460287, "step_id": 12119, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813492.7553287, "step_id": 12120, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813492.7635388, "step_id": 12121, "start_load_kv_us": 1, "get_finished_us": 253} +{"t_unix": 1779813492.7720776, "step_id": 12122, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813492.7806664, "step_id": 12123, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813492.7893274, "step_id": 12124, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813492.7978058, "step_id": 12125, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813492.8053048, "step_id": 12126, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813492.8129911, "step_id": 12127, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813492.8212647, "step_id": 12128, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813492.8282754, "step_id": 12129, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813492.8358784, "step_id": 12130, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813492.8442557, "step_id": 12131, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813492.8514605, "step_id": 12132, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813492.8591008, "step_id": 12133, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813492.8668065, "step_id": 12134, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813492.8743472, "step_id": 12135, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813492.8825166, "step_id": 12136, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813492.8895657, "step_id": 12137, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813492.8971143, "step_id": 12138, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813492.9047809, "step_id": 12139, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813492.9123006, "step_id": 12140, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813492.9199867, "step_id": 12141, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813492.92754, "step_id": 12142, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813492.9348824, "step_id": 12143, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813492.9430466, "step_id": 12144, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813492.9500937, "step_id": 12145, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813492.9576259, "step_id": 12146, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813492.9657445, "step_id": 12147, "start_load_kv_us": 5, "get_finished_us": 144} +{"t_unix": 1779813492.9727662, "step_id": 12148, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813492.9801328, "step_id": 12149, "start_load_kv_us": 17, "get_finished_us": 141} +{"t_unix": 1779813492.9873188, "step_id": 12150, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813492.994452, "step_id": 12151, "start_load_kv_us": 1, "get_finished_us": 207} +{"t_unix": 1779813493.0022168, "step_id": 12152, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813493.008184, "step_id": 12153, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813493.0152736, "step_id": 12154, "start_load_kv_us": 1, "get_finished_us": 218} +{"t_unix": 1779813493.022281, "step_id": 12155, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813493.029509, "step_id": 12156, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813493.0364988, "step_id": 12157, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813493.0434513, "step_id": 12158, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813493.0509567, "step_id": 12159, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813493.0587885, "step_id": 12160, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813493.0655336, "step_id": 12161, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813493.0713913, "step_id": 12162, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813493.0774024, "step_id": 12163, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813493.083528, "step_id": 12164, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813493.0897186, "step_id": 12165, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813493.095871, "step_id": 12166, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813493.1021497, "step_id": 12167, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813493.108991, "step_id": 12168, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813493.1144223, "step_id": 12169, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813493.1205266, "step_id": 12170, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813493.127092, "step_id": 12171, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813493.1328816, "step_id": 12172, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813493.1390288, "step_id": 12173, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813493.1450622, "step_id": 12174, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813493.1511457, "step_id": 12175, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813493.1579971, "step_id": 12176, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813493.1635067, "step_id": 12177, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813493.1696334, "step_id": 12178, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813493.1757772, "step_id": 12179, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813493.1820312, "step_id": 12180, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813493.1897337, "step_id": 12181, "start_load_kv_us": 4, "get_finished_us": 968} +{"t_unix": 1779813493.199111, "step_id": 12182, "start_load_kv_us": 2, "get_finished_us": 350} +{"t_unix": 1779813493.2030036, "step_id": 12183, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813493.2089908, "step_id": 12184, "start_load_kv_us": 4, "get_finished_us": 327} +{"t_unix": 1779813493.214204, "step_id": 12185, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813493.2202735, "step_id": 12186, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813493.2264097, "step_id": 12187, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813493.2325244, "step_id": 12188, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813493.2386777, "step_id": 12189, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813493.2448282, "step_id": 12190, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813493.2510216, "step_id": 12191, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813493.257833, "step_id": 12192, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813493.2632575, "step_id": 12193, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813493.2693589, "step_id": 12194, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813493.2755256, "step_id": 12195, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813493.281584, "step_id": 12196, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813493.287778, "step_id": 12197, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813493.2938957, "step_id": 12198, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813493.3000412, "step_id": 12199, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813493.3069587, "step_id": 12200, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813493.3124545, "step_id": 12201, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813493.318616, "step_id": 12202, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813493.3247716, "step_id": 12203, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813493.3309615, "step_id": 12204, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813493.3371353, "step_id": 12205, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813493.343388, "step_id": 12206, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813493.3495655, "step_id": 12207, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813493.356415, "step_id": 12208, "start_load_kv_us": 4, "get_finished_us": 249} +{"t_unix": 1779813493.3618052, "step_id": 12209, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813493.3680384, "step_id": 12210, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813493.3741353, "step_id": 12211, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813493.3803132, "step_id": 12212, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813493.3865802, "step_id": 12213, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813493.3926165, "step_id": 12214, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813493.398782, "step_id": 12215, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813493.4056232, "step_id": 12216, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813493.4111516, "step_id": 12217, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813493.417411, "step_id": 12218, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813493.4236536, "step_id": 12219, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813493.4297884, "step_id": 12220, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813493.436139, "step_id": 12221, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813493.4422812, "step_id": 12222, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813493.446906, "step_id": 12223, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813493.4515982, "step_id": 12224, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813493.4563665, "step_id": 12225, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813493.4611015, "step_id": 12226, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813493.4658377, "step_id": 12227, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813493.4706278, "step_id": 12228, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813493.4754639, "step_id": 12229, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813493.4802685, "step_id": 12230, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813493.48508, "step_id": 12231, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813493.4905128, "step_id": 12232, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813493.494654, "step_id": 12233, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813493.499415, "step_id": 12234, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813493.5041654, "step_id": 12235, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813493.5089815, "step_id": 12236, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813493.5137618, "step_id": 12237, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813493.5184984, "step_id": 12238, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813493.5232842, "step_id": 12239, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813493.5280855, "step_id": 12240, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813493.5328643, "step_id": 12241, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813493.5376887, "step_id": 12242, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813493.5420778, "step_id": 12243, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813493.5461144, "step_id": 12244, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813493.992851, "step_id": 12245, "start_load_kv_us": 124, "get_finished_us": 348} +{"t_unix": 1779813493.9966643, "step_id": 12246, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813494.1928468, "step_id": 12247, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813494.1969135, "step_id": 12248, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813494.2014194, "step_id": 12249, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813494.2062054, "step_id": 12250, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813494.2108598, "step_id": 12251, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813494.2156303, "step_id": 12252, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813494.2204473, "step_id": 12253, "start_load_kv_us": 1, "get_finished_us": 230} +{"t_unix": 1779813494.2251756, "step_id": 12254, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813494.2299497, "step_id": 12255, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813494.2353592, "step_id": 12256, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813494.2394183, "step_id": 12257, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813494.244235, "step_id": 12258, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813494.2490087, "step_id": 12259, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813494.2537582, "step_id": 12260, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813494.2585196, "step_id": 12261, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813494.2632933, "step_id": 12262, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813494.2681618, "step_id": 12263, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813494.2728503, "step_id": 12264, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813494.2776635, "step_id": 12265, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813494.282465, "step_id": 12266, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813494.2871883, "step_id": 12267, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813494.2919397, "step_id": 12268, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813494.2967267, "step_id": 12269, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813494.3015308, "step_id": 12270, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813494.3062592, "step_id": 12271, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813494.311776, "step_id": 12272, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813494.315852, "step_id": 12273, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813494.3206747, "step_id": 12274, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813494.325492, "step_id": 12275, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813494.3303516, "step_id": 12276, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813494.335037, "step_id": 12277, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813494.3398523, "step_id": 12278, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813494.3446302, "step_id": 12279, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813494.349303, "step_id": 12280, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813494.3540978, "step_id": 12281, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813494.358957, "step_id": 12282, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813494.3636506, "step_id": 12283, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813494.3684225, "step_id": 12284, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813494.3732462, "step_id": 12285, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813494.378107, "step_id": 12286, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813494.382804, "step_id": 12287, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813494.3882875, "step_id": 12288, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813494.3923967, "step_id": 12289, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813494.3971786, "step_id": 12290, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813494.401915, "step_id": 12291, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813494.4067156, "step_id": 12292, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813494.4113913, "step_id": 12293, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813494.4171202, "step_id": 12294, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813494.4582784, "step_id": 12295, "start_load_kv_us": 140, "get_finished_us": 228} +{"t_unix": 1779813494.4619071, "step_id": 12296, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813494.662958, "step_id": 12297, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813494.668102, "step_id": 12298, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813494.6736767, "step_id": 12299, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813494.6791186, "step_id": 12300, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813494.6848557, "step_id": 12301, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813494.6902745, "step_id": 12302, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813494.6956449, "step_id": 12303, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813494.702119, "step_id": 12304, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813494.706993, "step_id": 12305, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813494.712766, "step_id": 12306, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813494.7186608, "step_id": 12307, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813494.7242672, "step_id": 12308, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813494.7301667, "step_id": 12309, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813494.7363176, "step_id": 12310, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813494.7432504, "step_id": 12311, "start_load_kv_us": 5, "get_finished_us": 231} +{"t_unix": 1779813494.748363, "step_id": 12312, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813494.754397, "step_id": 12313, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813494.7604196, "step_id": 12314, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813494.766243, "step_id": 12315, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813494.772104, "step_id": 12316, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813494.7779953, "step_id": 12317, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813494.7840223, "step_id": 12318, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813494.7898602, "step_id": 12319, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813494.7968779, "step_id": 12320, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813494.8015985, "step_id": 12321, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813494.807584, "step_id": 12322, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813494.8133848, "step_id": 12323, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813494.8193438, "step_id": 12324, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813494.8252618, "step_id": 12325, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813494.83105, "step_id": 12326, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813494.8373075, "step_id": 12327, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813494.8424246, "step_id": 12328, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813494.8482497, "step_id": 12329, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813494.8539343, "step_id": 12330, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813494.859668, "step_id": 12331, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813494.8656478, "step_id": 12332, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813494.8715665, "step_id": 12333, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813494.8776958, "step_id": 12334, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813494.88362, "step_id": 12335, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813494.8904898, "step_id": 12336, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813494.8958294, "step_id": 12337, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813494.901845, "step_id": 12338, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813494.9076984, "step_id": 12339, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813494.9134989, "step_id": 12340, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813494.9193335, "step_id": 12341, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813494.9254756, "step_id": 12342, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813494.9328215, "step_id": 12343, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813494.9809291, "step_id": 12344, "start_load_kv_us": 119, "get_finished_us": 309} +{"t_unix": 1779813494.984678, "step_id": 12345, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813495.1774015, "step_id": 12346, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813495.1841984, "step_id": 12347, "start_load_kv_us": 1, "get_finished_us": 263} +{"t_unix": 1779813495.1916826, "step_id": 12348, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813495.1990712, "step_id": 12349, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813495.2064438, "step_id": 12350, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813495.213652, "step_id": 12351, "start_load_kv_us": 1, "get_finished_us": 300} +{"t_unix": 1779813495.2215662, "step_id": 12352, "start_load_kv_us": 5, "get_finished_us": 279} +{"t_unix": 1779813495.2280724, "step_id": 12353, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813495.234891, "step_id": 12354, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813495.242204, "step_id": 12355, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813495.250068, "step_id": 12356, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813495.2562807, "step_id": 12357, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813495.263426, "step_id": 12358, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813495.2713382, "step_id": 12359, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813495.278007, "step_id": 12360, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813495.28497, "step_id": 12361, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813495.293349, "step_id": 12362, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813495.2997332, "step_id": 12363, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813495.3065963, "step_id": 12364, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813495.3138938, "step_id": 12365, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813495.32115, "step_id": 12366, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813495.3286002, "step_id": 12367, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813495.3360934, "step_id": 12368, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813495.3427784, "step_id": 12369, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813495.3500545, "step_id": 12370, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813495.3572998, "step_id": 12371, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813495.3645222, "step_id": 12372, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813495.370572, "step_id": 12373, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813495.3775263, "step_id": 12374, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813495.3854878, "step_id": 12375, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813495.391996, "step_id": 12376, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813495.3991153, "step_id": 12377, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813495.4056563, "step_id": 12378, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813495.4128366, "step_id": 12379, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813495.4205124, "step_id": 12380, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813495.4280722, "step_id": 12381, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813495.435697, "step_id": 12382, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813495.443136, "step_id": 12383, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813495.451146, "step_id": 12384, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813495.4578805, "step_id": 12385, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813495.4652615, "step_id": 12386, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813495.4725354, "step_id": 12387, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813495.4804509, "step_id": 12388, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813495.486924, "step_id": 12389, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813495.4943407, "step_id": 12390, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813495.502217, "step_id": 12391, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813495.5090125, "step_id": 12392, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813495.5162976, "step_id": 12393, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813495.523674, "step_id": 12394, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813495.531084, "step_id": 12395, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813495.538504, "step_id": 12396, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813495.5459821, "step_id": 12397, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813495.55337, "step_id": 12398, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813495.5606394, "step_id": 12399, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813495.5682814, "step_id": 12400, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813495.5749972, "step_id": 12401, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813495.5825067, "step_id": 12402, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813495.5900943, "step_id": 12403, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813495.5981495, "step_id": 12404, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813495.6049616, "step_id": 12405, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813495.6123822, "step_id": 12406, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813495.62013, "step_id": 12407, "start_load_kv_us": 4, "get_finished_us": 138} +{"t_unix": 1779813495.626877, "step_id": 12408, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813495.6340942, "step_id": 12409, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813495.6414645, "step_id": 12410, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813495.6498578, "step_id": 12411, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813495.6949155, "step_id": 12412, "start_load_kv_us": 128, "get_finished_us": 307} +{"t_unix": 1779813495.6984475, "step_id": 12413, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813495.8997104, "step_id": 12414, "start_load_kv_us": 4, "get_finished_us": 297} +{"t_unix": 1779813495.9061973, "step_id": 12415, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813495.9147823, "step_id": 12416, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813495.9219983, "step_id": 12417, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813495.930194, "step_id": 12418, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813495.938185, "step_id": 12419, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813495.9469955, "step_id": 12420, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813495.9542997, "step_id": 12421, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813495.9623706, "step_id": 12422, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813495.971036, "step_id": 12423, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813495.9784493, "step_id": 12424, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813495.9865675, "step_id": 12425, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813495.9947646, "step_id": 12426, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813496.0028212, "step_id": 12427, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813496.0111635, "step_id": 12428, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813496.0190961, "step_id": 12429, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813496.0278866, "step_id": 12430, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813496.0353894, "step_id": 12431, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813496.0441842, "step_id": 12432, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813496.0516443, "step_id": 12433, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813496.0598247, "step_id": 12434, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813496.0681784, "step_id": 12435, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813496.0779393, "step_id": 12436, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813496.084343, "step_id": 12437, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813496.0922318, "step_id": 12438, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813496.1008875, "step_id": 12439, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813496.1082547, "step_id": 12440, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813496.1167097, "step_id": 12441, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813496.124762, "step_id": 12442, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813496.1328504, "step_id": 12443, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813496.1409638, "step_id": 12444, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813496.149215, "step_id": 12445, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813496.158195, "step_id": 12446, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813496.1655164, "step_id": 12447, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813496.1741965, "step_id": 12448, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813496.1814775, "step_id": 12449, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813496.189692, "step_id": 12450, "start_load_kv_us": 16, "get_finished_us": 213} +{"t_unix": 1779813496.197745, "step_id": 12451, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813496.206239, "step_id": 12452, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813496.213786, "step_id": 12453, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813496.2216399, "step_id": 12454, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813496.2305188, "step_id": 12455, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813496.2377753, "step_id": 12456, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813496.2457569, "step_id": 12457, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813496.2539752, "step_id": 12458, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813496.262124, "step_id": 12459, "start_load_kv_us": 1, "get_finished_us": 214} +{"t_unix": 1779813496.2701087, "step_id": 12460, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813496.2783089, "step_id": 12461, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813496.286923, "step_id": 12462, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813496.29458, "step_id": 12463, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813496.3032668, "step_id": 12464, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813496.3108904, "step_id": 12465, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813496.3186636, "step_id": 12466, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813496.3267088, "step_id": 12467, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813496.335565, "step_id": 12468, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813496.3427038, "step_id": 12469, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813496.3505018, "step_id": 12470, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813496.3591104, "step_id": 12471, "start_load_kv_us": 4, "get_finished_us": 138} +{"t_unix": 1779813496.3663597, "step_id": 12472, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813496.374426, "step_id": 12473, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813496.3825858, "step_id": 12474, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813496.3906136, "step_id": 12475, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813496.398699, "step_id": 12476, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813496.4067748, "step_id": 12477, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813496.4154491, "step_id": 12478, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813496.4227538, "step_id": 12479, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813496.431291, "step_id": 12480, "start_load_kv_us": 4, "get_finished_us": 138} +{"t_unix": 1779813496.438076, "step_id": 12481, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813496.4456282, "step_id": 12482, "start_load_kv_us": 15, "get_finished_us": 145} +{"t_unix": 1779813496.4532797, "step_id": 12483, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813496.4615984, "step_id": 12484, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813496.468535, "step_id": 12485, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813496.4763994, "step_id": 12486, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813496.4848745, "step_id": 12487, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813496.4920745, "step_id": 12488, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813496.4998062, "step_id": 12489, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813496.5076954, "step_id": 12490, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813496.5158246, "step_id": 12491, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813496.5237575, "step_id": 12492, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813496.5316622, "step_id": 12493, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813496.5397465, "step_id": 12494, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813496.54707, "step_id": 12495, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813496.555815, "step_id": 12496, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813496.563071, "step_id": 12497, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813496.570772, "step_id": 12498, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813496.5786116, "step_id": 12499, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813496.5872023, "step_id": 12500, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813496.594856, "step_id": 12501, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813496.6026304, "step_id": 12502, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813496.610518, "step_id": 12503, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813496.6173496, "step_id": 12504, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813496.625059, "step_id": 12505, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813496.6325257, "step_id": 12506, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813496.6402965, "step_id": 12507, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813496.6478808, "step_id": 12508, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813496.655536, "step_id": 12509, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813496.6638007, "step_id": 12510, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813496.6706743, "step_id": 12511, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813496.6781516, "step_id": 12512, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813496.6857545, "step_id": 12513, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813496.6933355, "step_id": 12514, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813496.7008755, "step_id": 12515, "start_load_kv_us": 1, "get_finished_us": 133} +{"t_unix": 1779813496.7092552, "step_id": 12516, "start_load_kv_us": 5, "get_finished_us": 141} +{"t_unix": 1779813496.7161336, "step_id": 12517, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813496.7237387, "step_id": 12518, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813496.7322114, "step_id": 12519, "start_load_kv_us": 4, "get_finished_us": 136} +{"t_unix": 1779813496.739253, "step_id": 12520, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813496.7470028, "step_id": 12521, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813496.7547126, "step_id": 12522, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813496.7626343, "step_id": 12523, "start_load_kv_us": 1, "get_finished_us": 257} +{"t_unix": 1779813496.770086, "step_id": 12524, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813496.7775965, "step_id": 12525, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813496.785779, "step_id": 12526, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813496.7925167, "step_id": 12527, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813496.7991774, "step_id": 12528, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813496.8057227, "step_id": 12529, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813496.8122122, "step_id": 12530, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813496.8183982, "step_id": 12531, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813496.825491, "step_id": 12532, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813496.831368, "step_id": 12533, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813496.8379579, "step_id": 12534, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813496.8456762, "step_id": 12535, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813496.8522532, "step_id": 12536, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813496.859614, "step_id": 12537, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813496.8664548, "step_id": 12538, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813496.8737273, "step_id": 12539, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813496.88068, "step_id": 12540, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813496.8879209, "step_id": 12541, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813496.8959002, "step_id": 12542, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813496.9019904, "step_id": 12543, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813496.908693, "step_id": 12544, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813496.9152784, "step_id": 12545, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813496.922501, "step_id": 12546, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813496.9299643, "step_id": 12547, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813496.93753, "step_id": 12548, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813496.9440312, "step_id": 12549, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813496.9515362, "step_id": 12550, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813496.9586155, "step_id": 12551, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813496.9664254, "step_id": 12552, "start_load_kv_us": 3, "get_finished_us": 142} +{"t_unix": 1779813496.9719493, "step_id": 12553, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813496.9775872, "step_id": 12554, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813496.9832833, "step_id": 12555, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813496.9893959, "step_id": 12556, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813496.9945734, "step_id": 12557, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813497.0011199, "step_id": 12558, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813497.006564, "step_id": 12559, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813497.0120423, "step_id": 12560, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813497.0180843, "step_id": 12561, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813497.0237286, "step_id": 12562, "start_load_kv_us": 12, "get_finished_us": 137} +{"t_unix": 1779813497.0296147, "step_id": 12563, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813497.036411, "step_id": 12564, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813497.0414746, "step_id": 12565, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813497.047259, "step_id": 12566, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813497.0531085, "step_id": 12567, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813497.0586507, "step_id": 12568, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813497.06449, "step_id": 12569, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813497.0704522, "step_id": 12570, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813497.0763526, "step_id": 12571, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813497.0823867, "step_id": 12572, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813497.0883734, "step_id": 12573, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813497.0947337, "step_id": 12574, "start_load_kv_us": 4, "get_finished_us": 131} +{"t_unix": 1779813497.1005228, "step_id": 12575, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813497.106622, "step_id": 12576, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813497.1132095, "step_id": 12577, "start_load_kv_us": 3, "get_finished_us": 186} +{"t_unix": 1779813497.1192973, "step_id": 12578, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813497.1246293, "step_id": 12579, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813497.1317463, "step_id": 12580, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813497.1374247, "step_id": 12581, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813497.1429794, "step_id": 12582, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813497.1493158, "step_id": 12583, "start_load_kv_us": 3, "get_finished_us": 229} +{"t_unix": 1779813497.1553118, "step_id": 12584, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813497.1611717, "step_id": 12585, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813497.1677682, "step_id": 12586, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813497.1733127, "step_id": 12587, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813497.1790571, "step_id": 12588, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813497.1855206, "step_id": 12589, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813497.1915245, "step_id": 12590, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813497.1970184, "step_id": 12591, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813497.2030473, "step_id": 12592, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813497.2091277, "step_id": 12593, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813497.2152586, "step_id": 12594, "start_load_kv_us": 3, "get_finished_us": 225} +{"t_unix": 1779813497.2212818, "step_id": 12595, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813497.2281375, "step_id": 12596, "start_load_kv_us": 4, "get_finished_us": 254} +{"t_unix": 1779813497.2335167, "step_id": 12597, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813497.2396672, "step_id": 12598, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813497.2456393, "step_id": 12599, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813497.2517648, "step_id": 12600, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813497.2579122, "step_id": 12601, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813497.2625113, "step_id": 12602, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813497.2672968, "step_id": 12603, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813497.2720714, "step_id": 12604, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813497.2768483, "step_id": 12605, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813497.2822797, "step_id": 12606, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813497.286347, "step_id": 12607, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813497.2911947, "step_id": 12608, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813497.2960057, "step_id": 12609, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813497.300762, "step_id": 12610, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813497.3056247, "step_id": 12611, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813497.3105729, "step_id": 12612, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813497.3152514, "step_id": 12613, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813497.3200233, "step_id": 12614, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813497.3249276, "step_id": 12615, "start_load_kv_us": 1, "get_finished_us": 258} +{"t_unix": 1779813497.3296113, "step_id": 12616, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813497.3343585, "step_id": 12617, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813497.3390746, "step_id": 12618, "start_load_kv_us": 1, "get_finished_us": 191} +{"t_unix": 1779813497.3438334, "step_id": 12619, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813497.348674, "step_id": 12620, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813497.3533258, "step_id": 12621, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813497.358782, "step_id": 12622, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813497.3628843, "step_id": 12623, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813497.367813, "step_id": 12624, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813497.372421, "step_id": 12625, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813497.3772001, "step_id": 12626, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813497.38196, "step_id": 12627, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813497.3866973, "step_id": 12628, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813497.3914745, "step_id": 12629, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813497.3962553, "step_id": 12630, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813497.4010508, "step_id": 12631, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813497.4057996, "step_id": 12632, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813497.4105966, "step_id": 12633, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813497.4153574, "step_id": 12634, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813497.4200912, "step_id": 12635, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813497.4249306, "step_id": 12636, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813497.4297063, "step_id": 12637, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813497.4356625, "step_id": 12638, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813497.4393144, "step_id": 12639, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813497.4440937, "step_id": 12640, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813497.4489157, "step_id": 12641, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813497.4536376, "step_id": 12642, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813497.458346, "step_id": 12643, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813497.4631429, "step_id": 12644, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813497.4680305, "step_id": 12645, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813497.4726877, "step_id": 12646, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813497.4775736, "step_id": 12647, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813497.4822881, "step_id": 12648, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813497.4872062, "step_id": 12649, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813497.4919958, "step_id": 12650, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813497.4967353, "step_id": 12651, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813497.5014246, "step_id": 12652, "start_load_kv_us": 1, "get_finished_us": 128} +{"t_unix": 1779813497.5063365, "step_id": 12653, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813497.511713, "step_id": 12654, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813497.515867, "step_id": 12655, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813497.5206378, "step_id": 12656, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813497.5254118, "step_id": 12657, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813497.5301647, "step_id": 12658, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813497.5348864, "step_id": 12659, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813497.5397425, "step_id": 12660, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813497.544482, "step_id": 12661, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813497.5492933, "step_id": 12662, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813497.5540512, "step_id": 12663, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813497.5588808, "step_id": 12664, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813497.5635955, "step_id": 12665, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813497.568336, "step_id": 12666, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813497.573188, "step_id": 12667, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813497.5774813, "step_id": 12668, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813497.5816681, "step_id": 12669, "start_load_kv_us": 1, "get_finished_us": 293} +{"t_unix": 1779813498.0593798, "step_id": 12670, "start_load_kv_us": 150, "get_finished_us": 341} +{"t_unix": 1779813498.063761, "step_id": 12671, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813498.2606466, "step_id": 12672, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813498.2647398, "step_id": 12673, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813498.2692955, "step_id": 12674, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813498.2740734, "step_id": 12675, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813498.2788029, "step_id": 12676, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813498.2835362, "step_id": 12677, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813498.2882962, "step_id": 12678, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813498.2930975, "step_id": 12679, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813498.297854, "step_id": 12680, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813498.303331, "step_id": 12681, "start_load_kv_us": 4, "get_finished_us": 137} +{"t_unix": 1779813498.30754, "step_id": 12682, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813498.3124638, "step_id": 12683, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813498.3169758, "step_id": 12684, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813498.3217676, "step_id": 12685, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813498.3265152, "step_id": 12686, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813498.3312857, "step_id": 12687, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813498.3361344, "step_id": 12688, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813498.340781, "step_id": 12689, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813498.345592, "step_id": 12690, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813498.3503473, "step_id": 12691, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813498.3551195, "step_id": 12692, "start_load_kv_us": 2, "get_finished_us": 129} +{"t_unix": 1779813498.3598933, "step_id": 12693, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813498.3646514, "step_id": 12694, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813498.3695016, "step_id": 12695, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813498.3744545, "step_id": 12696, "start_load_kv_us": 3, "get_finished_us": 159} +{"t_unix": 1779813498.379719, "step_id": 12697, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813498.3838706, "step_id": 12698, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813498.3885696, "step_id": 12699, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813498.3933413, "step_id": 12700, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813498.398091, "step_id": 12701, "start_load_kv_us": 1, "get_finished_us": 131} +{"t_unix": 1779813498.4028566, "step_id": 12702, "start_load_kv_us": 1, "get_finished_us": 129} +{"t_unix": 1779813498.4076219, "step_id": 12703, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813498.4125235, "step_id": 12704, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813498.4171798, "step_id": 12705, "start_load_kv_us": 2, "get_finished_us": 128} +{"t_unix": 1779813498.42198, "step_id": 12706, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813498.4267817, "step_id": 12707, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813498.4316068, "step_id": 12708, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813498.4363463, "step_id": 12709, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813498.441296, "step_id": 12710, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813498.4461362, "step_id": 12711, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813498.450975, "step_id": 12712, "start_load_kv_us": 1, "get_finished_us": 262} +{"t_unix": 1779813498.4563684, "step_id": 12713, "start_load_kv_us": 5, "get_finished_us": 219} +{"t_unix": 1779813498.4603167, "step_id": 12714, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813498.4649713, "step_id": 12715, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813498.4697149, "step_id": 12716, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813498.4744678, "step_id": 12717, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813498.47931, "step_id": 12718, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813498.484038, "step_id": 12719, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813498.4887803, "step_id": 12720, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813498.4935427, "step_id": 12721, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813498.4983432, "step_id": 12722, "start_load_kv_us": 2, "get_finished_us": 126} +{"t_unix": 1779813498.5031767, "step_id": 12723, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813498.507929, "step_id": 12724, "start_load_kv_us": 1, "get_finished_us": 133} +{"t_unix": 1779813498.5129647, "step_id": 12725, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813498.5176423, "step_id": 12726, "start_load_kv_us": 14, "get_finished_us": 150} +{"t_unix": 1779813498.5223277, "step_id": 12727, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813498.5271266, "step_id": 12728, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813498.5324664, "step_id": 12729, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813498.5366745, "step_id": 12730, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813498.5413742, "step_id": 12731, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813498.5461707, "step_id": 12732, "start_load_kv_us": 1, "get_finished_us": 133} +{"t_unix": 1779813498.5509682, "step_id": 12733, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813498.5558598, "step_id": 12734, "start_load_kv_us": 1, "get_finished_us": 229} +{"t_unix": 1779813498.5606449, "step_id": 12735, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813498.565401, "step_id": 12736, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813498.5701497, "step_id": 12737, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813498.5749063, "step_id": 12738, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813498.5797226, "step_id": 12739, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813498.584525, "step_id": 12740, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813498.5892756, "step_id": 12741, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813498.5940738, "step_id": 12742, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813498.598794, "step_id": 12743, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813498.6036005, "step_id": 12744, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813498.6089654, "step_id": 12745, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813498.613121, "step_id": 12746, "start_load_kv_us": 14, "get_finished_us": 136} +{"t_unix": 1779813498.6178687, "step_id": 12747, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813498.6226263, "step_id": 12748, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813498.6274283, "step_id": 12749, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813498.6321754, "step_id": 12750, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813498.6369822, "step_id": 12751, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813498.6417334, "step_id": 12752, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813498.6465983, "step_id": 12753, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813498.6513557, "step_id": 12754, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813498.656093, "step_id": 12755, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813498.6608574, "step_id": 12756, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813498.6656542, "step_id": 12757, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813498.6706603, "step_id": 12758, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813498.675315, "step_id": 12759, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813498.6801972, "step_id": 12760, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813498.685508, "step_id": 12761, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813498.6896014, "step_id": 12762, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813498.6943831, "step_id": 12763, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813498.6991894, "step_id": 12764, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813498.7039511, "step_id": 12765, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813498.7088053, "step_id": 12766, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813498.7136912, "step_id": 12767, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813498.7186077, "step_id": 12768, "start_load_kv_us": 1, "get_finished_us": 335} +{"t_unix": 1779813498.7232156, "step_id": 12769, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813498.7281218, "step_id": 12770, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813498.7330763, "step_id": 12771, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813498.738075, "step_id": 12772, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813498.7425876, "step_id": 12773, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813498.7471666, "step_id": 12774, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813498.7519908, "step_id": 12775, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813498.7567494, "step_id": 12776, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813498.7622046, "step_id": 12777, "start_load_kv_us": 8, "get_finished_us": 158} +{"t_unix": 1779813498.766293, "step_id": 12778, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813498.7710316, "step_id": 12779, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813498.775814, "step_id": 12780, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813498.7805583, "step_id": 12781, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813498.7853234, "step_id": 12782, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813498.7901173, "step_id": 12783, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813498.7948747, "step_id": 12784, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813498.799712, "step_id": 12785, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813498.8044577, "step_id": 12786, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813498.8092287, "step_id": 12787, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813498.8140786, "step_id": 12788, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813498.8188188, "step_id": 12789, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813498.8235948, "step_id": 12790, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813498.866244, "step_id": 12791, "start_load_kv_us": 148, "get_finished_us": 248} +{"t_unix": 1779813498.8697498, "step_id": 12792, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813499.070324, "step_id": 12793, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813499.07527, "step_id": 12794, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813499.0810122, "step_id": 12795, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813499.0866444, "step_id": 12796, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813499.0931158, "step_id": 12797, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813499.098462, "step_id": 12798, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813499.1046305, "step_id": 12799, "start_load_kv_us": 1, "get_finished_us": 252} +{"t_unix": 1779813499.1106021, "step_id": 12800, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813499.1165724, "step_id": 12801, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813499.1224236, "step_id": 12802, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813499.1281059, "step_id": 12803, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813499.1341138, "step_id": 12804, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813499.1399076, "step_id": 12805, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813499.1458335, "step_id": 12806, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813499.1513946, "step_id": 12807, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813499.1571422, "step_id": 12808, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813499.1633594, "step_id": 12809, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813499.1689122, "step_id": 12810, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813499.17426, "step_id": 12811, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813499.1799936, "step_id": 12812, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813499.1863298, "step_id": 12813, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813499.1917188, "step_id": 12814, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813499.197619, "step_id": 12815, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813499.2032917, "step_id": 12816, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813499.2091575, "step_id": 12817, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813499.2150815, "step_id": 12818, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813499.2206004, "step_id": 12819, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813499.2265553, "step_id": 12820, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813499.232327, "step_id": 12821, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813499.2382798, "step_id": 12822, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813499.2441294, "step_id": 12823, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813499.2499115, "step_id": 12824, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813499.2565715, "step_id": 12825, "start_load_kv_us": 3, "get_finished_us": 216} +{"t_unix": 1779813499.2618995, "step_id": 12826, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813499.267828, "step_id": 12827, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813499.2740064, "step_id": 12828, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813499.2806692, "step_id": 12829, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813499.285865, "step_id": 12830, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813499.2918704, "step_id": 12831, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813499.2977219, "step_id": 12832, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813499.303627, "step_id": 12833, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813499.3096135, "step_id": 12834, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813499.3155313, "step_id": 12835, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813499.3216352, "step_id": 12836, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813499.3328378, "step_id": 12837, "start_load_kv_us": 14, "get_finished_us": 244} +{"t_unix": 1779813499.3362823, "step_id": 12838, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813499.3416793, "step_id": 12839, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813499.3474252, "step_id": 12840, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813499.354136, "step_id": 12841, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813499.3596575, "step_id": 12842, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813499.3656673, "step_id": 12843, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813499.3717349, "step_id": 12844, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813499.3783896, "step_id": 12845, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813499.3836358, "step_id": 12846, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813499.3896906, "step_id": 12847, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813499.395581, "step_id": 12848, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813499.4016926, "step_id": 12849, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813499.4074097, "step_id": 12850, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813499.4131517, "step_id": 12851, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813499.4190004, "step_id": 12852, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813499.4247627, "step_id": 12853, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813499.4308033, "step_id": 12854, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813499.4367452, "step_id": 12855, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813499.4426823, "step_id": 12856, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813499.4493454, "step_id": 12857, "start_load_kv_us": 4, "get_finished_us": 138} +{"t_unix": 1779813499.4548745, "step_id": 12858, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813499.4608195, "step_id": 12859, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813499.466727, "step_id": 12860, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813499.4732862, "step_id": 12861, "start_load_kv_us": 16, "get_finished_us": 153} +{"t_unix": 1779813499.4786615, "step_id": 12862, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813499.4846454, "step_id": 12863, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813499.490661, "step_id": 12864, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813499.4967494, "step_id": 12865, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813499.5028954, "step_id": 12866, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813499.5085416, "step_id": 12867, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813499.514505, "step_id": 12868, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813499.5206335, "step_id": 12869, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813499.5258968, "step_id": 12870, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813499.5316913, "step_id": 12871, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813499.537224, "step_id": 12872, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813499.5440006, "step_id": 12873, "start_load_kv_us": 4, "get_finished_us": 151} +{"t_unix": 1779813499.5493782, "step_id": 12874, "start_load_kv_us": 1, "get_finished_us": 237} +{"t_unix": 1779813499.5555046, "step_id": 12875, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813499.5616093, "step_id": 12876, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813499.5681777, "step_id": 12877, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813499.5733643, "step_id": 12878, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813499.5792997, "step_id": 12879, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813499.5854185, "step_id": 12880, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813499.5915687, "step_id": 12881, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813499.5975947, "step_id": 12882, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813499.603782, "step_id": 12883, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813499.6097753, "step_id": 12884, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813499.6155896, "step_id": 12885, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813499.6213658, "step_id": 12886, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813499.6273334, "step_id": 12887, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813499.6334095, "step_id": 12888, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813499.6398976, "step_id": 12889, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813499.6451194, "step_id": 12890, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813499.6509564, "step_id": 12891, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813499.6570308, "step_id": 12892, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813499.6635716, "step_id": 12893, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813499.668626, "step_id": 12894, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813499.6746128, "step_id": 12895, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813499.6802158, "step_id": 12896, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813499.6859174, "step_id": 12897, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813499.691716, "step_id": 12898, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813499.6972454, "step_id": 12899, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813499.7072434, "step_id": 12900, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813499.7105758, "step_id": 12901, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813499.7161508, "step_id": 12902, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813499.7222733, "step_id": 12903, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813499.728094, "step_id": 12904, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813499.7343888, "step_id": 12905, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813499.739676, "step_id": 12906, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813499.7454665, "step_id": 12907, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813499.7513225, "step_id": 12908, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813499.758052, "step_id": 12909, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813499.763481, "step_id": 12910, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813499.7695632, "step_id": 12911, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813499.775562, "step_id": 12912, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813499.7814822, "step_id": 12913, "start_load_kv_us": 1, "get_finished_us": 212} +{"t_unix": 1779813499.787271, "step_id": 12914, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813499.7933214, "step_id": 12915, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813499.7995274, "step_id": 12916, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813499.805512, "step_id": 12917, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813499.8114173, "step_id": 12918, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813499.8171816, "step_id": 12919, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813499.8228333, "step_id": 12920, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813499.8292887, "step_id": 12921, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813499.834671, "step_id": 12922, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813499.8405426, "step_id": 12923, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813499.846316, "step_id": 12924, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813499.8530006, "step_id": 12925, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813499.858859, "step_id": 12926, "start_load_kv_us": 2, "get_finished_us": 377} +{"t_unix": 1779813499.8646657, "step_id": 12927, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813499.8692663, "step_id": 12928, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813499.8740525, "step_id": 12929, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813499.878776, "step_id": 12930, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813499.88354, "step_id": 12931, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813499.888473, "step_id": 12932, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813499.8931668, "step_id": 12933, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813499.8980289, "step_id": 12934, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813499.902718, "step_id": 12935, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813499.9076087, "step_id": 12936, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813499.9123363, "step_id": 12937, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813499.917158, "step_id": 12938, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813499.921961, "step_id": 12939, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813499.9266624, "step_id": 12940, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813499.9321473, "step_id": 12941, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813499.9362307, "step_id": 12942, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813499.941082, "step_id": 12943, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813499.945857, "step_id": 12944, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813499.9506001, "step_id": 12945, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813499.9553545, "step_id": 12946, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813499.9601808, "step_id": 12947, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813499.9649837, "step_id": 12948, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813499.9697492, "step_id": 12949, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813499.9751432, "step_id": 12950, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813499.9801211, "step_id": 12951, "start_load_kv_us": 2, "get_finished_us": 341} +{"t_unix": 1779813499.9842606, "step_id": 12952, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813499.9889715, "step_id": 12953, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813499.993668, "step_id": 12954, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813499.9984298, "step_id": 12955, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813500.003269, "step_id": 12956, "start_load_kv_us": 1, "get_finished_us": 204} +{"t_unix": 1779813500.0089228, "step_id": 12957, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813500.0128067, "step_id": 12958, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813500.0176141, "step_id": 12959, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813500.0223608, "step_id": 12960, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813500.0271423, "step_id": 12961, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813500.0319304, "step_id": 12962, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813500.036828, "step_id": 12963, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813500.0415819, "step_id": 12964, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813500.0462801, "step_id": 12965, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813500.0511394, "step_id": 12966, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813500.0558636, "step_id": 12967, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813500.0617025, "step_id": 12968, "start_load_kv_us": 5, "get_finished_us": 438} +{"t_unix": 1779813500.0742636, "step_id": 12969, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813500.0775325, "step_id": 12970, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813500.0818503, "step_id": 12971, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813500.0866513, "step_id": 12972, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813500.0921063, "step_id": 12973, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813500.0962029, "step_id": 12974, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813500.1010344, "step_id": 12975, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813500.105695, "step_id": 12976, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813500.1107183, "step_id": 12977, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813500.1153524, "step_id": 12978, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813500.120095, "step_id": 12979, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813500.124846, "step_id": 12980, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813500.1296809, "step_id": 12981, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813500.1344275, "step_id": 12982, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813500.139312, "step_id": 12983, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813500.1471574, "step_id": 12984, "start_load_kv_us": 2, "get_finished_us": 1325} +{"t_unix": 1779813500.1540847, "step_id": 12985, "start_load_kv_us": 1, "get_finished_us": 265} +{"t_unix": 1779813500.1573794, "step_id": 12986, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813500.161572, "step_id": 12987, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813500.1663635, "step_id": 12988, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813500.1718874, "step_id": 12989, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813500.1760125, "step_id": 12990, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813500.1807148, "step_id": 12991, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813500.185598, "step_id": 12992, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813500.1903157, "step_id": 12993, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813500.1951022, "step_id": 12994, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813500.1999083, "step_id": 12995, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813500.2046278, "step_id": 12996, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813500.2095072, "step_id": 12997, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813500.214229, "step_id": 12998, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813500.21905, "step_id": 12999, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813500.2238913, "step_id": 13000, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813500.2285917, "step_id": 13001, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813500.2333252, "step_id": 13002, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813500.2381124, "step_id": 13003, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813500.2429092, "step_id": 13004, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813500.2483437, "step_id": 13005, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813500.2524621, "step_id": 13006, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813500.2572794, "step_id": 13007, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813500.262037, "step_id": 13008, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813500.266813, "step_id": 13009, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813500.2715335, "step_id": 13010, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813500.2763925, "step_id": 13011, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813500.281309, "step_id": 13012, "start_load_kv_us": 1, "get_finished_us": 225} +{"t_unix": 1779813500.2860172, "step_id": 13013, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813500.2907803, "step_id": 13014, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813500.2956, "step_id": 13015, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813500.30037, "step_id": 13016, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813500.305174, "step_id": 13017, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813500.309991, "step_id": 13018, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813500.3148327, "step_id": 13019, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813500.3196304, "step_id": 13020, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813500.3250887, "step_id": 13021, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813500.3291285, "step_id": 13022, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813500.3339229, "step_id": 13023, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813500.338701, "step_id": 13024, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813500.3434863, "step_id": 13025, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813500.3483095, "step_id": 13026, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813500.3530405, "step_id": 13027, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813500.3578804, "step_id": 13028, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813500.3627007, "step_id": 13029, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813500.367485, "step_id": 13030, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813500.3722932, "step_id": 13031, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813500.3771071, "step_id": 13032, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813500.3818307, "step_id": 13033, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813500.3866422, "step_id": 13034, "start_load_kv_us": 15, "get_finished_us": 161} +{"t_unix": 1779813500.3914835, "step_id": 13035, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813500.396229, "step_id": 13036, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813500.4017797, "step_id": 13037, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813500.405871, "step_id": 13038, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813500.410699, "step_id": 13039, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813500.4155185, "step_id": 13040, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813500.4202113, "step_id": 13041, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813500.4249947, "step_id": 13042, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813500.4297976, "step_id": 13043, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813500.43463, "step_id": 13044, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813500.4393764, "step_id": 13045, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813500.4442542, "step_id": 13046, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813500.4485059, "step_id": 13047, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813500.4526803, "step_id": 13048, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813500.5244515, "step_id": 13049, "start_load_kv_us": 154, "get_finished_us": 299} +{"t_unix": 1779813500.5278287, "step_id": 13050, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813500.7636888, "step_id": 13051, "start_load_kv_us": 133, "get_finished_us": 319} +{"t_unix": 1779813500.7672741, "step_id": 13052, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813500.961616, "step_id": 13053, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813500.9677186, "step_id": 13054, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813501.0097153, "step_id": 13055, "start_load_kv_us": 125, "get_finished_us": 216} +{"t_unix": 1779813501.0132864, "step_id": 13056, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813501.2138395, "step_id": 13057, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813501.220199, "step_id": 13058, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813501.2268567, "step_id": 13059, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813501.2335083, "step_id": 13060, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813501.2406209, "step_id": 13061, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813501.2481112, "step_id": 13062, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813501.2545664, "step_id": 13063, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813501.2617624, "step_id": 13064, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813501.2690132, "step_id": 13065, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813501.2762387, "step_id": 13066, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813501.283901, "step_id": 13067, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813501.2902012, "step_id": 13068, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813501.2974257, "step_id": 13069, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813501.3046381, "step_id": 13070, "start_load_kv_us": 14, "get_finished_us": 159} +{"t_unix": 1779813501.3124115, "step_id": 13071, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813501.3187737, "step_id": 13072, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813501.325566, "step_id": 13073, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813501.3327339, "step_id": 13074, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813501.339522, "step_id": 13075, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813501.3463728, "step_id": 13076, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813501.3534153, "step_id": 13077, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813501.3609624, "step_id": 13078, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813501.3673651, "step_id": 13079, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813501.3740747, "step_id": 13080, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813501.3814588, "step_id": 13081, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813501.3887022, "step_id": 13082, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813501.396157, "step_id": 13083, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813501.4027362, "step_id": 13084, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813501.4097414, "step_id": 13085, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813501.4169858, "step_id": 13086, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813501.4247613, "step_id": 13087, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813501.4312184, "step_id": 13088, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813501.4383683, "step_id": 13089, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813501.4454722, "step_id": 13090, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813501.4527695, "step_id": 13091, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813501.460007, "step_id": 13092, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813501.467324, "step_id": 13093, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813501.4746144, "step_id": 13094, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813501.4811056, "step_id": 13095, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813501.4882257, "step_id": 13096, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813501.495397, "step_id": 13097, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813501.5034087, "step_id": 13098, "start_load_kv_us": 3, "get_finished_us": 174} +{"t_unix": 1779813501.510276, "step_id": 13099, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813501.5166116, "step_id": 13100, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813501.52318, "step_id": 13101, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813501.5295377, "step_id": 13102, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813501.537545, "step_id": 13103, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813501.5443983, "step_id": 13104, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813501.551722, "step_id": 13105, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813501.558709, "step_id": 13106, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813501.5658145, "step_id": 13107, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813501.573095, "step_id": 13108, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813501.5802479, "step_id": 13109, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813501.5883691, "step_id": 13110, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813501.5953054, "step_id": 13111, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813501.6027596, "step_id": 13112, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813501.6103396, "step_id": 13113, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813501.6177032, "step_id": 13114, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813501.6255875, "step_id": 13115, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813501.6322, "step_id": 13116, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813501.6397135, "step_id": 13117, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813501.6470814, "step_id": 13118, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813501.6550264, "step_id": 13119, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813501.6615956, "step_id": 13120, "start_load_kv_us": 1, "get_finished_us": 247} +{"t_unix": 1779813501.6688468, "step_id": 13121, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813501.6760228, "step_id": 13122, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813501.6830394, "step_id": 13123, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813501.6902215, "step_id": 13124, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813501.697594, "step_id": 13125, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813501.705646, "step_id": 13126, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813501.7122586, "step_id": 13127, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813501.7191682, "step_id": 13128, "start_load_kv_us": 1, "get_finished_us": 226} +{"t_unix": 1779813501.7264094, "step_id": 13129, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813501.7326264, "step_id": 13130, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813501.7400763, "step_id": 13131, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813501.746816, "step_id": 13132, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813501.7539926, "step_id": 13133, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813501.7612386, "step_id": 13134, "start_load_kv_us": 17, "get_finished_us": 239} +{"t_unix": 1779813501.7686317, "step_id": 13135, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813501.774672, "step_id": 13136, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813501.8216283, "step_id": 13137, "start_load_kv_us": 151, "get_finished_us": 325} +{"t_unix": 1779813501.8253756, "step_id": 13138, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813502.0229373, "step_id": 13139, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813502.030388, "step_id": 13140, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813502.0381236, "step_id": 13141, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813502.046655, "step_id": 13142, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813502.0535567, "step_id": 13143, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813502.0613537, "step_id": 13144, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813502.0691986, "step_id": 13145, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813502.0769255, "step_id": 13146, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813502.0852206, "step_id": 13147, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813502.0932496, "step_id": 13148, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813502.100416, "step_id": 13149, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813502.1079836, "step_id": 13150, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813502.116294, "step_id": 13151, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813502.1234536, "step_id": 13152, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813502.1311064, "step_id": 13153, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813502.1389096, "step_id": 13154, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813502.146887, "step_id": 13155, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813502.1544569, "step_id": 13156, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813502.1623712, "step_id": 13157, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813502.1708012, "step_id": 13158, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813502.1782415, "step_id": 13159, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813502.1862128, "step_id": 13160, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813502.1939673, "step_id": 13161, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813502.201697, "step_id": 13162, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813502.2100217, "step_id": 13163, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813502.2178483, "step_id": 13164, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813502.2249236, "step_id": 13165, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813502.2323096, "step_id": 13166, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813502.2409942, "step_id": 13167, "start_load_kv_us": 4, "get_finished_us": 312} +{"t_unix": 1779813502.2478836, "step_id": 13168, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813502.255007, "step_id": 13169, "start_load_kv_us": 1, "get_finished_us": 240} +{"t_unix": 1779813502.2623868, "step_id": 13170, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813502.269332, "step_id": 13171, "start_load_kv_us": 1, "get_finished_us": 215} +{"t_unix": 1779813502.276911, "step_id": 13172, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813502.2842636, "step_id": 13173, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813502.2926466, "step_id": 13174, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813502.299419, "step_id": 13175, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813502.307174, "step_id": 13176, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813502.314911, "step_id": 13177, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813502.3225238, "step_id": 13178, "start_load_kv_us": 1, "get_finished_us": 228} +{"t_unix": 1779813502.3308203, "step_id": 13179, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813502.3382237, "step_id": 13180, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813502.3450103, "step_id": 13181, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813502.3523064, "step_id": 13182, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813502.3603513, "step_id": 13183, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813502.367521, "step_id": 13184, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813502.3754091, "step_id": 13185, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813502.3834748, "step_id": 13186, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813502.3911226, "step_id": 13187, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813502.398634, "step_id": 13188, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813502.4064665, "step_id": 13189, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813502.4148972, "step_id": 13190, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813502.4216256, "step_id": 13191, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813502.4291506, "step_id": 13192, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813502.4365091, "step_id": 13193, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813502.4441402, "step_id": 13194, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813502.4525552, "step_id": 13195, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813502.460333, "step_id": 13196, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813502.467429, "step_id": 13197, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813502.4752352, "step_id": 13198, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813502.4837227, "step_id": 13199, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813502.4907892, "step_id": 13200, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813502.4987164, "step_id": 13201, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813502.5066242, "step_id": 13202, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813502.5147145, "step_id": 13203, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813502.522788, "step_id": 13204, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813502.5309017, "step_id": 13205, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813502.5396419, "step_id": 13206, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813502.5471728, "step_id": 13207, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813502.555216, "step_id": 13208, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813502.5632174, "step_id": 13209, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813502.571004, "step_id": 13210, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813502.579673, "step_id": 13211, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813502.5878043, "step_id": 13212, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813502.5951202, "step_id": 13213, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813502.603187, "step_id": 13214, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813502.6121182, "step_id": 13215, "start_load_kv_us": 4, "get_finished_us": 264} +{"t_unix": 1779813502.6196446, "step_id": 13216, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813502.627664, "step_id": 13217, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813502.6356168, "step_id": 13218, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813502.643691, "step_id": 13219, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813502.651667, "step_id": 13220, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813502.6606255, "step_id": 13221, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813502.7056327, "step_id": 13222, "start_load_kv_us": 127, "get_finished_us": 248} +{"t_unix": 1779813502.7098243, "step_id": 13223, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813502.91063, "step_id": 13224, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813502.9199963, "step_id": 13225, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813502.9299865, "step_id": 13226, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813502.94088, "step_id": 13227, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813502.9513032, "step_id": 13228, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813502.960805, "step_id": 13229, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813502.970971, "step_id": 13230, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813502.9813654, "step_id": 13231, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813502.9905107, "step_id": 13232, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813503.0002599, "step_id": 13233, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813503.0104475, "step_id": 13234, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813503.020767, "step_id": 13235, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813503.0310857, "step_id": 13236, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813503.0411847, "step_id": 13237, "start_load_kv_us": 1, "get_finished_us": 227} +{"t_unix": 1779813503.0519958, "step_id": 13238, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813503.0621982, "step_id": 13239, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813503.0718524, "step_id": 13240, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813503.0821264, "step_id": 13241, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813503.0922441, "step_id": 13242, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813503.102845, "step_id": 13243, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813503.112885, "step_id": 13244, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813503.1220212, "step_id": 13245, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813503.1315262, "step_id": 13246, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813503.1420891, "step_id": 13247, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813503.1509864, "step_id": 13248, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813503.1607323, "step_id": 13249, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813503.1703634, "step_id": 13250, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813503.1799989, "step_id": 13251, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813503.1896827, "step_id": 13252, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813503.1993666, "step_id": 13253, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813503.2098114, "step_id": 13254, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813503.219413, "step_id": 13255, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813503.228773, "step_id": 13256, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813503.2392178, "step_id": 13257, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813503.249664, "step_id": 13258, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813503.2605276, "step_id": 13259, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813503.2703795, "step_id": 13260, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813503.2798247, "step_id": 13261, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813503.2895167, "step_id": 13262, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813503.2997491, "step_id": 13263, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813503.3089213, "step_id": 13264, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813503.3187342, "step_id": 13265, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813503.3286684, "step_id": 13266, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813503.3383923, "step_id": 13267, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813503.3481345, "step_id": 13268, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813503.3581295, "step_id": 13269, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813503.368876, "step_id": 13270, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813503.3787417, "step_id": 13271, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813503.3875246, "step_id": 13272, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813503.3979266, "step_id": 13273, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813503.4077542, "step_id": 13274, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813503.418072, "step_id": 13275, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813503.427923, "step_id": 13276, "start_load_kv_us": 4, "get_finished_us": 390} +{"t_unix": 1779813503.4379768, "step_id": 13277, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813503.4471984, "step_id": 13278, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813503.4579606, "step_id": 13279, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813503.4670281, "step_id": 13280, "start_load_kv_us": 1, "get_finished_us": 189} +{"t_unix": 1779813503.4767895, "step_id": 13281, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813503.4868164, "step_id": 13282, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813503.4964883, "step_id": 13283, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813503.5063648, "step_id": 13284, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813503.516727, "step_id": 13285, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813503.5274107, "step_id": 13286, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813503.5376089, "step_id": 13287, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813503.547161, "step_id": 13288, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813503.5573385, "step_id": 13289, "start_load_kv_us": 1, "get_finished_us": 227} +{"t_unix": 1779813503.567459, "step_id": 13290, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813503.578231, "step_id": 13291, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813503.5883188, "step_id": 13292, "start_load_kv_us": 10, "get_finished_us": 198} +{"t_unix": 1779813503.5977154, "step_id": 13293, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813503.6076596, "step_id": 13294, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813503.6182866, "step_id": 13295, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813503.62758, "step_id": 13296, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813503.6377347, "step_id": 13297, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813503.6476483, "step_id": 13298, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813503.657265, "step_id": 13299, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813503.6672568, "step_id": 13300, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813503.6776097, "step_id": 13301, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813503.6884904, "step_id": 13302, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813503.6984603, "step_id": 13303, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813503.708463, "step_id": 13304, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813503.7192569, "step_id": 13305, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813503.7295818, "step_id": 13306, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813503.7377858, "step_id": 13307, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813503.746469, "step_id": 13308, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813503.7530627, "step_id": 13309, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813503.7603805, "step_id": 13310, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813503.7677524, "step_id": 13311, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813503.7749608, "step_id": 13312, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813503.7808132, "step_id": 13313, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813503.7867122, "step_id": 13314, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813503.7926853, "step_id": 13315, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813503.79875, "step_id": 13316, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813503.8048055, "step_id": 13317, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813503.8106613, "step_id": 13318, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813503.8170853, "step_id": 13319, "start_load_kv_us": 5, "get_finished_us": 198} +{"t_unix": 1779813503.8221714, "step_id": 13320, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813503.8281324, "step_id": 13321, "start_load_kv_us": 15, "get_finished_us": 144} +{"t_unix": 1779813503.8339972, "step_id": 13322, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813503.8400297, "step_id": 13323, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813503.883884, "step_id": 13324, "start_load_kv_us": 134, "get_finished_us": 227} +{"t_unix": 1779813503.8875005, "step_id": 13325, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813504.1254208, "step_id": 13326, "start_load_kv_us": 128, "get_finished_us": 307} +{"t_unix": 1779813504.1293201, "step_id": 13327, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813504.3697608, "step_id": 13328, "start_load_kv_us": 138, "get_finished_us": 469} +{"t_unix": 1779813504.3748887, "step_id": 13329, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813504.5729582, "step_id": 13330, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813504.5817766, "step_id": 13331, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813504.5914137, "step_id": 13332, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813504.6009305, "step_id": 13333, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813504.610059, "step_id": 13334, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813504.619993, "step_id": 13335, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813504.6287699, "step_id": 13336, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813504.6381269, "step_id": 13337, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813504.6476595, "step_id": 13338, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813504.657152, "step_id": 13339, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813504.704569, "step_id": 13340, "start_load_kv_us": 136, "get_finished_us": 229} +{"t_unix": 1779813504.7089832, "step_id": 13341, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813504.9122946, "step_id": 13342, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813504.921598, "step_id": 13343, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813504.9306061, "step_id": 13344, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813504.9401546, "step_id": 13345, "start_load_kv_us": 5, "get_finished_us": 161} +{"t_unix": 1779813504.9490316, "step_id": 13346, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813504.9570885, "step_id": 13347, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813504.9668493, "step_id": 13348, "start_load_kv_us": 8, "get_finished_us": 686} +{"t_unix": 1779813504.9751782, "step_id": 13349, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813504.9843192, "step_id": 13350, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813504.9943454, "step_id": 13351, "start_load_kv_us": 5, "get_finished_us": 261} +{"t_unix": 1779813505.0406392, "step_id": 13352, "start_load_kv_us": 149, "get_finished_us": 346} +{"t_unix": 1779813505.0445611, "step_id": 13353, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813505.2868319, "step_id": 13354, "start_load_kv_us": 134, "get_finished_us": 335} +{"t_unix": 1779813505.2909012, "step_id": 13355, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813505.533856, "step_id": 13356, "start_load_kv_us": 124, "get_finished_us": 343} +{"t_unix": 1779813505.538533, "step_id": 13357, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813505.744338, "step_id": 13358, "start_load_kv_us": 5, "get_finished_us": 332} +{"t_unix": 1779813505.7542825, "step_id": 13359, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813505.7653728, "step_id": 13360, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813505.7773583, "step_id": 13361, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813505.7885063, "step_id": 13362, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813505.7990658, "step_id": 13363, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813505.8108246, "step_id": 13364, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813505.8211346, "step_id": 13365, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813505.832145, "step_id": 13366, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813505.8435006, "step_id": 13367, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813505.8539743, "step_id": 13368, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813505.8658788, "step_id": 13369, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813505.8764424, "step_id": 13370, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813505.8880167, "step_id": 13371, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813505.8997028, "step_id": 13372, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813505.911157, "step_id": 13373, "start_load_kv_us": 5, "get_finished_us": 284} +{"t_unix": 1779813505.9221313, "step_id": 13374, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813505.9321573, "step_id": 13375, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813505.943333, "step_id": 13376, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813505.9553177, "step_id": 13377, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813505.9668417, "step_id": 13378, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813505.9777517, "step_id": 13379, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813505.9898522, "step_id": 13380, "start_load_kv_us": 5, "get_finished_us": 142} +{"t_unix": 1779813506.0005643, "step_id": 13381, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813506.0122607, "step_id": 13382, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813506.0246475, "step_id": 13383, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813506.035291, "step_id": 13384, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813506.0474753, "step_id": 13385, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813506.057914, "step_id": 13386, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813506.0688324, "step_id": 13387, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813506.1180694, "step_id": 13388, "start_load_kv_us": 139, "get_finished_us": 322} +{"t_unix": 1779813506.1225173, "step_id": 13389, "start_load_kv_us": 5, "get_finished_us": 240} +{"t_unix": 1779813506.3321865, "step_id": 13390, "start_load_kv_us": 5, "get_finished_us": 298} +{"t_unix": 1779813506.3444824, "step_id": 13391, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813506.3581274, "step_id": 13392, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813506.3736134, "step_id": 13393, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813506.3870628, "step_id": 13394, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813506.3975282, "step_id": 13395, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813506.4095392, "step_id": 13396, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813506.4203246, "step_id": 13397, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813506.4312792, "step_id": 13398, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813506.4429955, "step_id": 13399, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813506.453417, "step_id": 13400, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813506.4648836, "step_id": 13401, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813506.4755425, "step_id": 13402, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813506.4872286, "step_id": 13403, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813506.4980974, "step_id": 13404, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813506.510612, "step_id": 13405, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813506.522329, "step_id": 13406, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813506.533329, "step_id": 13407, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813506.5449557, "step_id": 13408, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813506.5597029, "step_id": 13409, "start_load_kv_us": 5, "get_finished_us": 244} +{"t_unix": 1779813506.5680587, "step_id": 13410, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813506.5784495, "step_id": 13411, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813506.5902088, "step_id": 13412, "start_load_kv_us": 16, "get_finished_us": 216} +{"t_unix": 1779813506.6011555, "step_id": 13413, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813506.6128774, "step_id": 13414, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813506.6251354, "step_id": 13415, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813506.636081, "step_id": 13416, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813506.648332, "step_id": 13417, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813506.6593003, "step_id": 13418, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813506.6716774, "step_id": 13419, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813506.6823096, "step_id": 13420, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813506.694657, "step_id": 13421, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813506.7060304, "step_id": 13422, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813506.7169983, "step_id": 13423, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813506.7284777, "step_id": 13424, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813506.7406774, "step_id": 13425, "start_load_kv_us": 5, "get_finished_us": 296} +{"t_unix": 1779813506.7522936, "step_id": 13426, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813506.7633116, "step_id": 13427, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813506.7756171, "step_id": 13428, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813506.7864606, "step_id": 13429, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813506.7980418, "step_id": 13430, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813506.810313, "step_id": 13431, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813506.821422, "step_id": 13432, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813506.8340645, "step_id": 13433, "start_load_kv_us": 5, "get_finished_us": 273} +{"t_unix": 1779813506.8446114, "step_id": 13434, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813506.8567007, "step_id": 13435, "start_load_kv_us": 19, "get_finished_us": 216} +{"t_unix": 1779813506.8674924, "step_id": 13436, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813506.8798635, "step_id": 13437, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813506.8913713, "step_id": 13438, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813506.9021916, "step_id": 13439, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813506.913426, "step_id": 13440, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813506.925742, "step_id": 13441, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813506.937813, "step_id": 13442, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813506.9492896, "step_id": 13443, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813506.961905, "step_id": 13444, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813507.0113387, "step_id": 13445, "start_load_kv_us": 131, "get_finished_us": 207} +{"t_unix": 1779813507.015111, "step_id": 13446, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813507.263566, "step_id": 13447, "start_load_kv_us": 129, "get_finished_us": 349} +{"t_unix": 1779813507.2676585, "step_id": 13448, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813507.4778128, "step_id": 13449, "start_load_kv_us": 5, "get_finished_us": 293} +{"t_unix": 1779813507.490482, "step_id": 13450, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813507.504461, "step_id": 13451, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813507.5173893, "step_id": 13452, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813507.531469, "step_id": 13453, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813507.5443773, "step_id": 13454, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813507.5570643, "step_id": 13455, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813507.5699914, "step_id": 13456, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813507.5836854, "step_id": 13457, "start_load_kv_us": 6, "get_finished_us": 268} +{"t_unix": 1779813507.5970662, "step_id": 13458, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813507.6100285, "step_id": 13459, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813507.6242697, "step_id": 13460, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813507.6375864, "step_id": 13461, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813507.6516159, "step_id": 13462, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813507.6662092, "step_id": 13463, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813507.679343, "step_id": 13464, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813507.6939354, "step_id": 13465, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813507.7064672, "step_id": 13466, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813507.7200534, "step_id": 13467, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813507.7325184, "step_id": 13468, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813507.745936, "step_id": 13469, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813507.7593262, "step_id": 13470, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813507.7720816, "step_id": 13471, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813507.786002, "step_id": 13472, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813507.8379378, "step_id": 13473, "start_load_kv_us": 144, "get_finished_us": 294} +{"t_unix": 1779813507.8426678, "step_id": 13474, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813508.0530798, "step_id": 13475, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813508.0665085, "step_id": 13476, "start_load_kv_us": 5, "get_finished_us": 233} +{"t_unix": 1779813508.079305, "step_id": 13477, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813508.0934641, "step_id": 13478, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813508.1071987, "step_id": 13479, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813508.1207323, "step_id": 13480, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813508.1350234, "step_id": 13481, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813508.1481645, "step_id": 13482, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813508.1622546, "step_id": 13483, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813508.1750166, "step_id": 13484, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813508.1893625, "step_id": 13485, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813508.2032926, "step_id": 13486, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813508.2164545, "step_id": 13487, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813508.230373, "step_id": 13488, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813508.2449028, "step_id": 13489, "start_load_kv_us": 6, "get_finished_us": 183} +{"t_unix": 1779813508.2587566, "step_id": 13490, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813508.2723308, "step_id": 13491, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813508.2869937, "step_id": 13492, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813508.3003955, "step_id": 13493, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813508.322328, "step_id": 13494, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813508.3289819, "step_id": 13495, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813508.3435793, "step_id": 13496, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813508.3582468, "step_id": 13497, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813508.3714552, "step_id": 13498, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813508.3861558, "step_id": 13499, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813508.39956, "step_id": 13500, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813508.4140203, "step_id": 13501, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813508.4281213, "step_id": 13502, "start_load_kv_us": 4, "get_finished_us": 313} +{"t_unix": 1779813508.4409304, "step_id": 13503, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813508.4547079, "step_id": 13504, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813508.4693017, "step_id": 13505, "start_load_kv_us": 6, "get_finished_us": 171} +{"t_unix": 1779813508.4831243, "step_id": 13506, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813508.496305, "step_id": 13507, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813508.5111165, "step_id": 13508, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813508.524479, "step_id": 13509, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813508.5384681, "step_id": 13510, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813508.552285, "step_id": 13511, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813508.5663342, "step_id": 13512, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813508.5812905, "step_id": 13513, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813508.5946524, "step_id": 13514, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813508.6093447, "step_id": 13515, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813508.6228826, "step_id": 13516, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813508.6373765, "step_id": 13517, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813508.6511106, "step_id": 13518, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813508.6644874, "step_id": 13519, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813508.6784666, "step_id": 13520, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813508.6933494, "step_id": 13521, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813508.7077994, "step_id": 13522, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813508.722, "step_id": 13523, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813508.7733023, "step_id": 13524, "start_load_kv_us": 139, "get_finished_us": 281} +{"t_unix": 1779813508.777226, "step_id": 13525, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813509.0288491, "step_id": 13526, "start_load_kv_us": 271, "get_finished_us": 1340} +{"t_unix": 1779813509.5006318, "step_id": 13527, "start_load_kv_us": 122, "get_finished_us": 368} +{"t_unix": 1779813509.5061557, "step_id": 13528, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813509.6945896, "step_id": 13529, "start_load_kv_us": 7, "get_finished_us": 339} +{"t_unix": 1779813509.707835, "step_id": 13530, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813509.7242308, "step_id": 13531, "start_load_kv_us": 16, "get_finished_us": 233} +{"t_unix": 1779813509.7762873, "step_id": 13532, "start_load_kv_us": 128, "get_finished_us": 347} +{"t_unix": 1779813509.7816708, "step_id": 13533, "start_load_kv_us": 6, "get_finished_us": 259} +{"t_unix": 1779813509.9939888, "step_id": 13534, "start_load_kv_us": 6, "get_finished_us": 304} +{"t_unix": 1779813510.0077074, "step_id": 13535, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813510.0222144, "step_id": 13536, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813510.0363827, "step_id": 13537, "start_load_kv_us": 6, "get_finished_us": 249} +{"t_unix": 1779813510.0513253, "step_id": 13538, "start_load_kv_us": 5, "get_finished_us": 261} +{"t_unix": 1779813510.065187, "step_id": 13539, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813510.0804293, "step_id": 13540, "start_load_kv_us": 5, "get_finished_us": 231} +{"t_unix": 1779813510.0944095, "step_id": 13541, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813510.1089692, "step_id": 13542, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813510.1231163, "step_id": 13543, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813510.137516, "step_id": 13544, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813510.1518674, "step_id": 13545, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813510.1655746, "step_id": 13546, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813510.1809707, "step_id": 13547, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813510.1948934, "step_id": 13548, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813510.2098413, "step_id": 13549, "start_load_kv_us": 20, "get_finished_us": 243} +{"t_unix": 1779813510.2238967, "step_id": 13550, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813510.2381036, "step_id": 13551, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813510.2518272, "step_id": 13552, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813510.267267, "step_id": 13553, "start_load_kv_us": 6, "get_finished_us": 161} +{"t_unix": 1779813510.281838, "step_id": 13554, "start_load_kv_us": 6, "get_finished_us": 159} +{"t_unix": 1779813510.2955196, "step_id": 13555, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813510.310906, "step_id": 13556, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813510.3252141, "step_id": 13557, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813510.3400788, "step_id": 13558, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813510.354784, "step_id": 13559, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813510.369884, "step_id": 13560, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813510.384304, "step_id": 13561, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813510.3981633, "step_id": 13562, "start_load_kv_us": 16, "get_finished_us": 173} +{"t_unix": 1779813510.413366, "step_id": 13563, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813510.427049, "step_id": 13564, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813510.442715, "step_id": 13565, "start_load_kv_us": 6, "get_finished_us": 247} +{"t_unix": 1779813510.4567022, "step_id": 13566, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813510.4709597, "step_id": 13567, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813510.4853613, "step_id": 13568, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813510.5010002, "step_id": 13569, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813510.5156825, "step_id": 13570, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813510.5296924, "step_id": 13571, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813510.5453734, "step_id": 13572, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813510.5599778, "step_id": 13573, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813510.5752687, "step_id": 13574, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813510.5903294, "step_id": 13575, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813510.6065934, "step_id": 13576, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813510.6222136, "step_id": 13577, "start_load_kv_us": 6, "get_finished_us": 198} +{"t_unix": 1779813510.637117, "step_id": 13578, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813510.6524553, "step_id": 13579, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813510.6669722, "step_id": 13580, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813510.6823583, "step_id": 13581, "start_load_kv_us": 6, "get_finished_us": 212} +{"t_unix": 1779813510.6972783, "step_id": 13582, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813510.712387, "step_id": 13583, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813510.7278724, "step_id": 13584, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813510.7434814, "step_id": 13585, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813510.75845, "step_id": 13586, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813510.7724288, "step_id": 13587, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813510.7874417, "step_id": 13588, "start_load_kv_us": 5, "get_finished_us": 240} +{"t_unix": 1779813510.801306, "step_id": 13589, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813510.8160212, "step_id": 13590, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813510.8310552, "step_id": 13591, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813510.8467252, "step_id": 13592, "start_load_kv_us": 5, "get_finished_us": 260} +{"t_unix": 1779813510.8616817, "step_id": 13593, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813510.8758323, "step_id": 13594, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813510.891733, "step_id": 13595, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813510.9059763, "step_id": 13596, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813510.9211843, "step_id": 13597, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813510.9351764, "step_id": 13598, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813510.9496298, "step_id": 13599, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813510.9636586, "step_id": 13600, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813510.9789345, "step_id": 13601, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813510.9935992, "step_id": 13602, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813511.0071623, "step_id": 13603, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813511.0220542, "step_id": 13604, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813511.035229, "step_id": 13605, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813511.049145, "step_id": 13606, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813511.062926, "step_id": 13607, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813511.0776417, "step_id": 13608, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813511.0916173, "step_id": 13609, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813511.1049712, "step_id": 13610, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813511.1191444, "step_id": 13611, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813511.132638, "step_id": 13612, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813511.147139, "step_id": 13613, "start_load_kv_us": 6, "get_finished_us": 208} +{"t_unix": 1779813511.157998, "step_id": 13614, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813511.1703432, "step_id": 13615, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813511.1812408, "step_id": 13616, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813511.1936407, "step_id": 13617, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813511.205544, "step_id": 13618, "start_load_kv_us": 5, "get_finished_us": 148} +{"t_unix": 1779813511.2168696, "step_id": 13619, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813511.2293475, "step_id": 13620, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813511.2404628, "step_id": 13621, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813511.2522314, "step_id": 13622, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813511.263923, "step_id": 13623, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813511.2757788, "step_id": 13624, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813511.2874162, "step_id": 13625, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813511.2988963, "step_id": 13626, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813511.3110125, "step_id": 13627, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813511.3222694, "step_id": 13628, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813511.3350675, "step_id": 13629, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813511.3465946, "step_id": 13630, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813511.396911, "step_id": 13631, "start_load_kv_us": 138, "get_finished_us": 240} +{"t_unix": 1779813511.4006615, "step_id": 13632, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813511.6102667, "step_id": 13633, "start_load_kv_us": 5, "get_finished_us": 328} +{"t_unix": 1779813511.622966, "step_id": 13634, "start_load_kv_us": 5, "get_finished_us": 220} +{"t_unix": 1779813511.635468, "step_id": 13635, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813511.6492965, "step_id": 13636, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813511.66196, "step_id": 13637, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813511.6761484, "step_id": 13638, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813511.7287107, "step_id": 13639, "start_load_kv_us": 128, "get_finished_us": 303} +{"t_unix": 1779813511.733192, "step_id": 13640, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813511.9828043, "step_id": 13641, "start_load_kv_us": 133, "get_finished_us": 344} +{"t_unix": 1779813511.9868484, "step_id": 13642, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813512.1976368, "step_id": 13643, "start_load_kv_us": 5, "get_finished_us": 300} +{"t_unix": 1779813512.2109842, "step_id": 13644, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813512.225359, "step_id": 13645, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813512.2386103, "step_id": 13646, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813512.2531643, "step_id": 13647, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813512.2669282, "step_id": 13648, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813512.280899, "step_id": 13649, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813512.2948225, "step_id": 13650, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813512.3086386, "step_id": 13651, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813512.3222828, "step_id": 13652, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813512.3353255, "step_id": 13653, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813512.3494172, "step_id": 13654, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813512.3641114, "step_id": 13655, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813512.3780026, "step_id": 13656, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813512.3918512, "step_id": 13657, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813512.4059398, "step_id": 13658, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813512.4198794, "step_id": 13659, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813512.434025, "step_id": 13660, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813512.4494193, "step_id": 13661, "start_load_kv_us": 5, "get_finished_us": 182} +{"t_unix": 1779813512.4637153, "step_id": 13662, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813512.4784966, "step_id": 13663, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813512.4926612, "step_id": 13664, "start_load_kv_us": 19, "get_finished_us": 175} +{"t_unix": 1779813512.5064034, "step_id": 13665, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813512.5203755, "step_id": 13666, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813512.5339947, "step_id": 13667, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813512.5479758, "step_id": 13668, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813512.5616555, "step_id": 13669, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813512.5758488, "step_id": 13670, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813512.5916572, "step_id": 13671, "start_load_kv_us": 5, "get_finished_us": 278} +{"t_unix": 1779813512.6425667, "step_id": 13672, "start_load_kv_us": 131, "get_finished_us": 271} +{"t_unix": 1779813512.6470678, "step_id": 13673, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813512.8962831, "step_id": 13674, "start_load_kv_us": 132, "get_finished_us": 325} +{"t_unix": 1779813513.0973208, "step_id": 13675, "start_load_kv_us": 152, "get_finished_us": 332} +{"t_unix": 1779813513.3376732, "step_id": 13676, "start_load_kv_us": 137, "get_finished_us": 347} +{"t_unix": 1779813513.3504715, "step_id": 13677, "start_load_kv_us": 6, "get_finished_us": 216} +{"t_unix": 1779813513.5927827, "step_id": 13678, "start_load_kv_us": 6, "get_finished_us": 324} +{"t_unix": 1779813513.6071641, "step_id": 13679, "start_load_kv_us": 5, "get_finished_us": 297} +{"t_unix": 1779813513.621812, "step_id": 13680, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813513.636164, "step_id": 13681, "start_load_kv_us": 5, "get_finished_us": 264} +{"t_unix": 1779813513.6504068, "step_id": 13682, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813513.6654203, "step_id": 13683, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813513.7177377, "step_id": 13684, "start_load_kv_us": 127, "get_finished_us": 317} +{"t_unix": 1779813513.7216623, "step_id": 13685, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813513.937145, "step_id": 13686, "start_load_kv_us": 5, "get_finished_us": 304} +{"t_unix": 1779813513.950357, "step_id": 13687, "start_load_kv_us": 5, "get_finished_us": 245} +{"t_unix": 1779813513.9641345, "step_id": 13688, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813513.977715, "step_id": 13689, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813513.9908514, "step_id": 13690, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813514.005216, "step_id": 13691, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813514.0190172, "step_id": 13692, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813514.032601, "step_id": 13693, "start_load_kv_us": 6, "get_finished_us": 185} +{"t_unix": 1779813514.0464737, "step_id": 13694, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813514.0600498, "step_id": 13695, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813514.0739765, "step_id": 13696, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813514.1255143, "step_id": 13697, "start_load_kv_us": 136, "get_finished_us": 322} +{"t_unix": 1779813514.1302087, "step_id": 13698, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813514.3457127, "step_id": 13699, "start_load_kv_us": 6, "get_finished_us": 327} +{"t_unix": 1779813514.363108, "step_id": 13700, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813514.418228, "step_id": 13701, "start_load_kv_us": 158, "get_finished_us": 341} +{"t_unix": 1779813514.4232056, "step_id": 13702, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813514.643487, "step_id": 13703, "start_load_kv_us": 5, "get_finished_us": 276} +{"t_unix": 1779813514.6610782, "step_id": 13704, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813514.673995, "step_id": 13705, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813514.6875243, "step_id": 13706, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813514.7417562, "step_id": 13707, "start_load_kv_us": 139, "get_finished_us": 281} +{"t_unix": 1779813514.7464056, "step_id": 13708, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813514.997821, "step_id": 13709, "start_load_kv_us": 136, "get_finished_us": 336} +{"t_unix": 1779813515.0028973, "step_id": 13710, "start_load_kv_us": 5, "get_finished_us": 252} +{"t_unix": 1779813515.2188125, "step_id": 13711, "start_load_kv_us": 6, "get_finished_us": 296} +{"t_unix": 1779813515.234669, "step_id": 13712, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813515.2508574, "step_id": 13713, "start_load_kv_us": 5, "get_finished_us": 190} +{"t_unix": 1779813515.2674153, "step_id": 13714, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813515.283686, "step_id": 13715, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813515.300356, "step_id": 13716, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813515.3161373, "step_id": 13717, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813515.3332949, "step_id": 13718, "start_load_kv_us": 5, "get_finished_us": 233} +{"t_unix": 1779813515.3493826, "step_id": 13719, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813515.3659744, "step_id": 13720, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813515.382399, "step_id": 13721, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813515.3992832, "step_id": 13722, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813515.416636, "step_id": 13723, "start_load_kv_us": 5, "get_finished_us": 233} +{"t_unix": 1779813515.4333887, "step_id": 13724, "start_load_kv_us": 5, "get_finished_us": 253} +{"t_unix": 1779813515.4503348, "step_id": 13725, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813515.467429, "step_id": 13726, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813515.4847314, "step_id": 13727, "start_load_kv_us": 4, "get_finished_us": 258} +{"t_unix": 1779813515.5013988, "step_id": 13728, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813515.5186355, "step_id": 13729, "start_load_kv_us": 5, "get_finished_us": 229} +{"t_unix": 1779813515.534784, "step_id": 13730, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813515.5502753, "step_id": 13731, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813515.5655184, "step_id": 13732, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813515.5815835, "step_id": 13733, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813515.5985932, "step_id": 13734, "start_load_kv_us": 5, "get_finished_us": 214} +{"t_unix": 1779813515.6148334, "step_id": 13735, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813515.631266, "step_id": 13736, "start_load_kv_us": 5, "get_finished_us": 201} +{"t_unix": 1779813515.6467855, "step_id": 13737, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813515.6631334, "step_id": 13738, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813515.6801353, "step_id": 13739, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813515.6962755, "step_id": 13740, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813515.7128706, "step_id": 13741, "start_load_kv_us": 17, "get_finished_us": 270} +{"t_unix": 1779813515.7291377, "step_id": 13742, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813515.7454808, "step_id": 13743, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813515.7620668, "step_id": 13744, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813515.821135, "step_id": 13745, "start_load_kv_us": 152, "get_finished_us": 265} +{"t_unix": 1779813515.82591, "step_id": 13746, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813516.0372362, "step_id": 13747, "start_load_kv_us": 5, "get_finished_us": 344} +{"t_unix": 1779813516.0527773, "step_id": 13748, "start_load_kv_us": 2, "get_finished_us": 349} +{"t_unix": 1779813516.0693605, "step_id": 13749, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813516.0876155, "step_id": 13750, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813516.1407838, "step_id": 13751, "start_load_kv_us": 138, "get_finished_us": 196} +{"t_unix": 1779813516.1456056, "step_id": 13752, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813516.36064, "step_id": 13753, "start_load_kv_us": 2, "get_finished_us": 332} +{"t_unix": 1779813516.376802, "step_id": 13754, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813516.3939812, "step_id": 13755, "start_load_kv_us": 7, "get_finished_us": 181} +{"t_unix": 1779813516.4104216, "step_id": 13756, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813516.4270287, "step_id": 13757, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813516.443247, "step_id": 13758, "start_load_kv_us": 5, "get_finished_us": 148} +{"t_unix": 1779813516.4597394, "step_id": 13759, "start_load_kv_us": 4, "get_finished_us": 150} +{"t_unix": 1779813516.476487, "step_id": 13760, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813516.493448, "step_id": 13761, "start_load_kv_us": 5, "get_finished_us": 140} +{"t_unix": 1779813516.510609, "step_id": 13762, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813516.5277157, "step_id": 13763, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813516.5440805, "step_id": 13764, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813516.561656, "step_id": 13765, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813516.5785398, "step_id": 13766, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813516.5958114, "step_id": 13767, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813516.6128466, "step_id": 13768, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813516.6290698, "step_id": 13769, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813516.6455147, "step_id": 13770, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813516.6626852, "step_id": 13771, "start_load_kv_us": 6, "get_finished_us": 171} +{"t_unix": 1779813516.679068, "step_id": 13772, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813516.695672, "step_id": 13773, "start_load_kv_us": 6, "get_finished_us": 161} +{"t_unix": 1779813516.712032, "step_id": 13774, "start_load_kv_us": 5, "get_finished_us": 167} +{"t_unix": 1779813516.7287512, "step_id": 13775, "start_load_kv_us": 5, "get_finished_us": 146} +{"t_unix": 1779813516.7457027, "step_id": 13776, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813516.7628367, "step_id": 13777, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813516.7801588, "step_id": 13778, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813516.7971668, "step_id": 13779, "start_load_kv_us": 4, "get_finished_us": 235} +{"t_unix": 1779813516.8138971, "step_id": 13780, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813516.830676, "step_id": 13781, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813516.84754, "step_id": 13782, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813516.8647766, "step_id": 13783, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813516.9157963, "step_id": 13784, "start_load_kv_us": 135, "get_finished_us": 262} +{"t_unix": 1779813516.9197192, "step_id": 13785, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813517.1337364, "step_id": 13786, "start_load_kv_us": 3, "get_finished_us": 346} +{"t_unix": 1779813517.1476421, "step_id": 13787, "start_load_kv_us": 7, "get_finished_us": 293} +{"t_unix": 1779813517.1619585, "step_id": 13788, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813517.175334, "step_id": 13789, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813517.190804, "step_id": 13790, "start_load_kv_us": 5, "get_finished_us": 161} +{"t_unix": 1779813517.2048793, "step_id": 13791, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813517.2205768, "step_id": 13792, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813517.2353008, "step_id": 13793, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813517.249524, "step_id": 13794, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813517.2654157, "step_id": 13795, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813517.2803319, "step_id": 13796, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813517.2962694, "step_id": 13797, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813517.311613, "step_id": 13798, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813517.3269014, "step_id": 13799, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813517.3415744, "step_id": 13800, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813517.356623, "step_id": 13801, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813517.3718762, "step_id": 13802, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813517.3878362, "step_id": 13803, "start_load_kv_us": 6, "get_finished_us": 212} +{"t_unix": 1779813517.4032636, "step_id": 13804, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813517.4180508, "step_id": 13805, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813517.4718323, "step_id": 13806, "start_load_kv_us": 149, "get_finished_us": 230} +{"t_unix": 1779813517.4756875, "step_id": 13807, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813517.6922636, "step_id": 13808, "start_load_kv_us": 7, "get_finished_us": 359} +{"t_unix": 1779813517.7063751, "step_id": 13809, "start_load_kv_us": 6, "get_finished_us": 221} +{"t_unix": 1779813517.7204828, "step_id": 13810, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813517.7364624, "step_id": 13811, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813517.7511609, "step_id": 13812, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813517.7672234, "step_id": 13813, "start_load_kv_us": 4, "get_finished_us": 209} +{"t_unix": 1779813517.7823474, "step_id": 13814, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813517.7976604, "step_id": 13815, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813517.8119774, "step_id": 13816, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813517.8277683, "step_id": 13817, "start_load_kv_us": 5, "get_finished_us": 235} +{"t_unix": 1779813517.8424702, "step_id": 13818, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813517.8585417, "step_id": 13819, "start_load_kv_us": 6, "get_finished_us": 223} +{"t_unix": 1779813517.8739722, "step_id": 13820, "start_load_kv_us": 5, "get_finished_us": 303} +{"t_unix": 1779813517.888617, "step_id": 13821, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813517.9038224, "step_id": 13822, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813517.9173336, "step_id": 13823, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813517.9324074, "step_id": 13824, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813517.9467175, "step_id": 13825, "start_load_kv_us": 6, "get_finished_us": 174} +{"t_unix": 1779813517.9603517, "step_id": 13826, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813517.9747787, "step_id": 13827, "start_load_kv_us": 16, "get_finished_us": 181} +{"t_unix": 1779813517.9882047, "step_id": 13828, "start_load_kv_us": 2, "get_finished_us": 342} +{"t_unix": 1779813518.0027714, "step_id": 13829, "start_load_kv_us": 5, "get_finished_us": 316} +{"t_unix": 1779813518.0167336, "step_id": 13830, "start_load_kv_us": 19, "get_finished_us": 243} +{"t_unix": 1779813518.0308044, "step_id": 13831, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813518.0443833, "step_id": 13832, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813518.0586493, "step_id": 13833, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813518.071039, "step_id": 13834, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813518.0856292, "step_id": 13835, "start_load_kv_us": 6, "get_finished_us": 217} +{"t_unix": 1779813518.0993242, "step_id": 13836, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813518.112558, "step_id": 13837, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813518.1275737, "step_id": 13838, "start_load_kv_us": 5, "get_finished_us": 225} +{"t_unix": 1779813518.1412606, "step_id": 13839, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813518.1559954, "step_id": 13840, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813518.1700819, "step_id": 13841, "start_load_kv_us": 5, "get_finished_us": 179} +{"t_unix": 1779813518.1836247, "step_id": 13842, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813518.1980517, "step_id": 13843, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813518.2115448, "step_id": 13844, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813518.2266333, "step_id": 13845, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813518.241054, "step_id": 13846, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813518.2553563, "step_id": 13847, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813518.2688413, "step_id": 13848, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813518.284054, "step_id": 13849, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813518.298316, "step_id": 13850, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813518.3138564, "step_id": 13851, "start_load_kv_us": 6, "get_finished_us": 151} +{"t_unix": 1779813518.3285313, "step_id": 13852, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813518.3425097, "step_id": 13853, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813518.3582704, "step_id": 13854, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813518.3724148, "step_id": 13855, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813518.3874555, "step_id": 13856, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813518.4021595, "step_id": 13857, "start_load_kv_us": 6, "get_finished_us": 199} +{"t_unix": 1779813518.4163427, "step_id": 13858, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813518.43222, "step_id": 13859, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813518.4466913, "step_id": 13860, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813518.4619093, "step_id": 13861, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813518.4768233, "step_id": 13862, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813518.4918118, "step_id": 13863, "start_load_kv_us": 14, "get_finished_us": 221} +{"t_unix": 1779813518.5059593, "step_id": 13864, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813518.521232, "step_id": 13865, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813518.5349615, "step_id": 13866, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813518.5501068, "step_id": 13867, "start_load_kv_us": 6, "get_finished_us": 167} +{"t_unix": 1779813518.5648477, "step_id": 13868, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813518.578917, "step_id": 13869, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813518.5944514, "step_id": 13870, "start_load_kv_us": 5, "get_finished_us": 280} +{"t_unix": 1779813518.6083596, "step_id": 13871, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813518.6236613, "step_id": 13872, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813518.6380634, "step_id": 13873, "start_load_kv_us": 6, "get_finished_us": 184} +{"t_unix": 1779813518.6521707, "step_id": 13874, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813518.667225, "step_id": 13875, "start_load_kv_us": 4, "get_finished_us": 145} +{"t_unix": 1779813518.6816604, "step_id": 13876, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813518.6969075, "step_id": 13877, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813518.711709, "step_id": 13878, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813518.726289, "step_id": 13879, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813518.740362, "step_id": 13880, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813518.7556105, "step_id": 13881, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813518.769515, "step_id": 13882, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813518.7844887, "step_id": 13883, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813518.7993937, "step_id": 13884, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813518.8136468, "step_id": 13885, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813518.8293767, "step_id": 13886, "start_load_kv_us": 5, "get_finished_us": 177} +{"t_unix": 1779813518.8442352, "step_id": 13887, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813518.8597498, "step_id": 13888, "start_load_kv_us": 20, "get_finished_us": 155} +{"t_unix": 1779813518.8754191, "step_id": 13889, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813518.8899605, "step_id": 13890, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813518.90583, "step_id": 13891, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813518.9204314, "step_id": 13892, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813518.9355648, "step_id": 13893, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813518.9502208, "step_id": 13894, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813518.9652612, "step_id": 13895, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813519.0164323, "step_id": 13896, "start_load_kv_us": 141, "get_finished_us": 229} +{"t_unix": 1779813519.0212874, "step_id": 13897, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813519.2341173, "step_id": 13898, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813519.2489657, "step_id": 13899, "start_load_kv_us": 6, "get_finished_us": 204} +{"t_unix": 1779813519.2635388, "step_id": 13900, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813519.27792, "step_id": 13901, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813519.2938004, "step_id": 13902, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813519.3085287, "step_id": 13903, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813519.3241355, "step_id": 13904, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813519.339033, "step_id": 13905, "start_load_kv_us": 6, "get_finished_us": 289} +{"t_unix": 1779813519.3535135, "step_id": 13906, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813519.3688385, "step_id": 13907, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813519.384861, "step_id": 13908, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813519.3998291, "step_id": 13909, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813519.4147344, "step_id": 13910, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813519.4293356, "step_id": 13911, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813519.4446883, "step_id": 13912, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813519.4607701, "step_id": 13913, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813519.4755297, "step_id": 13914, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813519.491841, "step_id": 13915, "start_load_kv_us": 6, "get_finished_us": 258} +{"t_unix": 1779813519.5070686, "step_id": 13916, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813519.5217683, "step_id": 13917, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813519.5380914, "step_id": 13918, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813519.5527358, "step_id": 13919, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813519.5685053, "step_id": 13920, "start_load_kv_us": 4, "get_finished_us": 259} +{"t_unix": 1779813519.5834994, "step_id": 13921, "start_load_kv_us": 5, "get_finished_us": 249} +{"t_unix": 1779813519.5980911, "step_id": 13922, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813519.6134233, "step_id": 13923, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813519.6294281, "step_id": 13924, "start_load_kv_us": 4, "get_finished_us": 228} +{"t_unix": 1779813519.6449025, "step_id": 13925, "start_load_kv_us": 4, "get_finished_us": 250} +{"t_unix": 1779813519.6602726, "step_id": 13926, "start_load_kv_us": 5, "get_finished_us": 257} +{"t_unix": 1779813519.6753364, "step_id": 13927, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813519.6909776, "step_id": 13928, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813519.7116375, "step_id": 13929, "start_load_kv_us": 5, "get_finished_us": 290} +{"t_unix": 1779813519.7208722, "step_id": 13930, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813519.7369263, "step_id": 13931, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813519.7505257, "step_id": 13932, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813519.7642782, "step_id": 13933, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813519.777958, "step_id": 13934, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813519.7917476, "step_id": 13935, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813519.8065774, "step_id": 13936, "start_load_kv_us": 4, "get_finished_us": 236} +{"t_unix": 1779813519.8211079, "step_id": 13937, "start_load_kv_us": 6, "get_finished_us": 202} +{"t_unix": 1779813519.834713, "step_id": 13938, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813519.8489408, "step_id": 13939, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813519.8649564, "step_id": 13940, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813519.879867, "step_id": 13941, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813519.8913493, "step_id": 13942, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813519.9035604, "step_id": 13943, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813519.9154184, "step_id": 13944, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813519.9278047, "step_id": 13945, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813519.9394128, "step_id": 13946, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813519.9522595, "step_id": 13947, "start_load_kv_us": 6, "get_finished_us": 255} +{"t_unix": 1779813519.9636421, "step_id": 13948, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813519.9767814, "step_id": 13949, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813519.9875772, "step_id": 13950, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813519.999321, "step_id": 13951, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813520.0118139, "step_id": 13952, "start_load_kv_us": 5, "get_finished_us": 236} +{"t_unix": 1779813520.023699, "step_id": 13953, "start_load_kv_us": 6, "get_finished_us": 182} +{"t_unix": 1779813520.0718296, "step_id": 13954, "start_load_kv_us": 147, "get_finished_us": 315} +{"t_unix": 1779813520.07564, "step_id": 13955, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813520.3201377, "step_id": 13956, "start_load_kv_us": 132, "get_finished_us": 312} +{"t_unix": 1779813520.325035, "step_id": 13957, "start_load_kv_us": 4, "get_finished_us": 230} +{"t_unix": 1779813520.5673268, "step_id": 13958, "start_load_kv_us": 151, "get_finished_us": 318} +{"t_unix": 1779813520.766967, "step_id": 13959, "start_load_kv_us": 143, "get_finished_us": 318} +{"t_unix": 1779813520.7787626, "step_id": 13960, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813521.0186603, "step_id": 13961, "start_load_kv_us": 5, "get_finished_us": 296} +{"t_unix": 1779813521.0316246, "step_id": 13962, "start_load_kv_us": 4, "get_finished_us": 255} +{"t_unix": 1779813521.0451458, "step_id": 13963, "start_load_kv_us": 5, "get_finished_us": 277} +{"t_unix": 1779813521.0576558, "step_id": 13964, "start_load_kv_us": 3, "get_finished_us": 234} +{"t_unix": 1779813521.0703921, "step_id": 13965, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813521.0836408, "step_id": 13966, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813521.093105, "step_id": 13967, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813521.1038058, "step_id": 13968, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813521.1148243, "step_id": 13969, "start_load_kv_us": 5, "get_finished_us": 217} +{"t_unix": 1779813521.1255224, "step_id": 13970, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813521.1362567, "step_id": 13971, "start_load_kv_us": 5, "get_finished_us": 152} +{"t_unix": 1779813521.147465, "step_id": 13972, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813521.1587305, "step_id": 13973, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813521.1690571, "step_id": 13974, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813521.1800416, "step_id": 13975, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813521.1911623, "step_id": 13976, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813521.2030826, "step_id": 13977, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813521.2142758, "step_id": 13978, "start_load_kv_us": 5, "get_finished_us": 145} +{"t_unix": 1779813521.22535, "step_id": 13979, "start_load_kv_us": 4, "get_finished_us": 160} +{"t_unix": 1779813521.2358313, "step_id": 13980, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813521.2468815, "step_id": 13981, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813521.2587163, "step_id": 13982, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813521.2694905, "step_id": 13983, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813521.2810876, "step_id": 13984, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813521.293295, "step_id": 13985, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813521.3046503, "step_id": 13986, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813521.3163612, "step_id": 13987, "start_load_kv_us": 4, "get_finished_us": 146} +{"t_unix": 1779813521.3278108, "step_id": 13988, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813521.3393245, "step_id": 13989, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813521.3496554, "step_id": 13990, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813521.3605318, "step_id": 13991, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813521.371687, "step_id": 13992, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813521.3840265, "step_id": 13993, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813521.3954759, "step_id": 13994, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813521.4066875, "step_id": 13995, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813521.4177468, "step_id": 13996, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813521.4293315, "step_id": 13997, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813521.4416623, "step_id": 13998, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813521.4527755, "step_id": 13999, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813521.4646442, "step_id": 14000, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813521.514673, "step_id": 14001, "start_load_kv_us": 139, "get_finished_us": 310} +{"t_unix": 1779813521.5193448, "step_id": 14002, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813521.7694192, "step_id": 14003, "start_load_kv_us": 135, "get_finished_us": 287} +{"t_unix": 1779813521.7739313, "step_id": 14004, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813521.9836123, "step_id": 14005, "start_load_kv_us": 5, "get_finished_us": 358} +{"t_unix": 1779813521.9960544, "step_id": 14006, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813522.0094278, "step_id": 14007, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813522.0233693, "step_id": 14008, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813522.0348732, "step_id": 14009, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813522.046415, "step_id": 14010, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813522.0571694, "step_id": 14011, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813522.0690265, "step_id": 14012, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813522.0808213, "step_id": 14013, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813522.0930307, "step_id": 14014, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813522.1039987, "step_id": 14015, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813522.1156309, "step_id": 14016, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813522.1279628, "step_id": 14017, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813522.139628, "step_id": 14018, "start_load_kv_us": 5, "get_finished_us": 160} +{"t_unix": 1779813522.1513739, "step_id": 14019, "start_load_kv_us": 5, "get_finished_us": 147} +{"t_unix": 1779813522.1627643, "step_id": 14020, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813522.1735168, "step_id": 14021, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813522.185052, "step_id": 14022, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813522.1959274, "step_id": 14023, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813522.2081149, "step_id": 14024, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813522.2196524, "step_id": 14025, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813522.2315001, "step_id": 14026, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813522.2427819, "step_id": 14027, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813522.2544513, "step_id": 14028, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813522.266217, "step_id": 14029, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813522.278456, "step_id": 14030, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813522.289144, "step_id": 14031, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813522.3002262, "step_id": 14032, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813522.31232, "step_id": 14033, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813522.3238297, "step_id": 14034, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813522.3354921, "step_id": 14035, "start_load_kv_us": 5, "get_finished_us": 168} +{"t_unix": 1779813522.3469727, "step_id": 14036, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813522.357809, "step_id": 14037, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813522.3696337, "step_id": 14038, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813522.3813193, "step_id": 14039, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813522.3940363, "step_id": 14040, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813522.4053307, "step_id": 14041, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813522.416334, "step_id": 14042, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813522.426475, "step_id": 14043, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813522.4376009, "step_id": 14044, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813522.448836, "step_id": 14045, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813522.460778, "step_id": 14046, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813522.4709814, "step_id": 14047, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813522.482678, "step_id": 14048, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813522.494425, "step_id": 14049, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813522.506729, "step_id": 14050, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813522.5182462, "step_id": 14051, "start_load_kv_us": 16, "get_finished_us": 255} +{"t_unix": 1779813522.5294623, "step_id": 14052, "start_load_kv_us": 4, "get_finished_us": 263} +{"t_unix": 1779813522.540405, "step_id": 14053, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813522.5519288, "step_id": 14054, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813522.5636272, "step_id": 14055, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813522.5762608, "step_id": 14056, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813522.5881386, "step_id": 14057, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813522.599909, "step_id": 14058, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813522.6104283, "step_id": 14059, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813522.6221092, "step_id": 14060, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813522.633722, "step_id": 14061, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813522.6459794, "step_id": 14062, "start_load_kv_us": 6, "get_finished_us": 218} +{"t_unix": 1779813522.6559837, "step_id": 14063, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813522.666923, "step_id": 14064, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813522.678262, "step_id": 14065, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813522.69079, "step_id": 14066, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813522.7021224, "step_id": 14067, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813522.713726, "step_id": 14068, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813522.7246742, "step_id": 14069, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813522.7363236, "step_id": 14070, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813522.7481523, "step_id": 14071, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813522.7607877, "step_id": 14072, "start_load_kv_us": 4, "get_finished_us": 207} +{"t_unix": 1779813522.7721126, "step_id": 14073, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813522.7844129, "step_id": 14074, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813522.7953722, "step_id": 14075, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813522.8060865, "step_id": 14076, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813522.8172202, "step_id": 14077, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813522.829531, "step_id": 14078, "start_load_kv_us": 5, "get_finished_us": 170} +{"t_unix": 1779813522.840633, "step_id": 14079, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813522.852601, "step_id": 14080, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813522.8644145, "step_id": 14081, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813522.877192, "step_id": 14082, "start_load_kv_us": 5, "get_finished_us": 288} +{"t_unix": 1779813522.8887246, "step_id": 14083, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813522.900539, "step_id": 14084, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813522.9116576, "step_id": 14085, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813522.9235833, "step_id": 14086, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813522.935621, "step_id": 14087, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813522.9482727, "step_id": 14088, "start_load_kv_us": 5, "get_finished_us": 141} +{"t_unix": 1779813522.9597387, "step_id": 14089, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813522.9725306, "step_id": 14090, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813522.9840877, "step_id": 14091, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813522.9962835, "step_id": 14092, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813523.0081742, "step_id": 14093, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813523.0209234, "step_id": 14094, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813523.0324545, "step_id": 14095, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813523.0441575, "step_id": 14096, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813523.0558789, "step_id": 14097, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813523.0683203, "step_id": 14098, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813523.0802238, "step_id": 14099, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813523.0923529, "step_id": 14100, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813523.1036434, "step_id": 14101, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813523.1155667, "step_id": 14102, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813523.1275442, "step_id": 14103, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813523.1394773, "step_id": 14104, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813523.150233, "step_id": 14105, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813523.1627865, "step_id": 14106, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813523.1742132, "step_id": 14107, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813523.186406, "step_id": 14108, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813523.1987543, "step_id": 14109, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813523.2110357, "step_id": 14110, "start_load_kv_us": 4, "get_finished_us": 161} +{"t_unix": 1779813523.2224717, "step_id": 14111, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813523.234005, "step_id": 14112, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813523.24563, "step_id": 14113, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813523.2578013, "step_id": 14114, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813523.269303, "step_id": 14115, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813523.2808695, "step_id": 14116, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813523.2915635, "step_id": 14117, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813523.3032584, "step_id": 14118, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813523.3150852, "step_id": 14119, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813523.3276048, "step_id": 14120, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813523.3388124, "step_id": 14121, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813523.3515067, "step_id": 14122, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813523.36254, "step_id": 14123, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813523.3741353, "step_id": 14124, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813523.3859584, "step_id": 14125, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813523.3980327, "step_id": 14126, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813523.409107, "step_id": 14127, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813523.4208684, "step_id": 14128, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813523.4328332, "step_id": 14129, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813523.4451046, "step_id": 14130, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813523.4570174, "step_id": 14131, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813523.469131, "step_id": 14132, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813523.4806917, "step_id": 14133, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813523.4923952, "step_id": 14134, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813523.5042276, "step_id": 14135, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813523.5167856, "step_id": 14136, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813523.5283, "step_id": 14137, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813523.541273, "step_id": 14138, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813523.5525346, "step_id": 14139, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813523.5643132, "step_id": 14140, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813523.576229, "step_id": 14141, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813523.5889397, "step_id": 14142, "start_load_kv_us": 4, "get_finished_us": 217} +{"t_unix": 1779813523.6003878, "step_id": 14143, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813523.6125064, "step_id": 14144, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813523.624778, "step_id": 14145, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813523.6372032, "step_id": 14146, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813523.6491766, "step_id": 14147, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813523.6610188, "step_id": 14148, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813523.67258, "step_id": 14149, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813523.6848443, "step_id": 14150, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813523.6970398, "step_id": 14151, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813523.7100427, "step_id": 14152, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813523.721392, "step_id": 14153, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813523.7343316, "step_id": 14154, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813523.741173, "step_id": 14155, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813523.7510805, "step_id": 14156, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813523.7612545, "step_id": 14157, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813523.771889, "step_id": 14158, "start_load_kv_us": 5, "get_finished_us": 162} +{"t_unix": 1779813523.7813306, "step_id": 14159, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813523.7913039, "step_id": 14160, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813523.8014147, "step_id": 14161, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813523.812059, "step_id": 14162, "start_load_kv_us": 5, "get_finished_us": 215} +{"t_unix": 1779813523.8215373, "step_id": 14163, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813523.8303835, "step_id": 14164, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813523.8405151, "step_id": 14165, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813523.850061, "step_id": 14166, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813523.8599148, "step_id": 14167, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813523.8702064, "step_id": 14168, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813523.8794591, "step_id": 14169, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813523.889813, "step_id": 14170, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813523.8991659, "step_id": 14171, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813523.9089193, "step_id": 14172, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813523.9189236, "step_id": 14173, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813523.9293873, "step_id": 14174, "start_load_kv_us": 4, "get_finished_us": 142} +{"t_unix": 1779813523.9386435, "step_id": 14175, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813523.9486446, "step_id": 14176, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813523.958311, "step_id": 14177, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813523.9683585, "step_id": 14178, "start_load_kv_us": 5, "get_finished_us": 141} +{"t_unix": 1779813523.9783847, "step_id": 14179, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813523.9878128, "step_id": 14180, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813523.9976187, "step_id": 14181, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813524.0074317, "step_id": 14182, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813524.017458, "step_id": 14183, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813524.0277727, "step_id": 14184, "start_load_kv_us": 4, "get_finished_us": 139} +{"t_unix": 1779813524.0371363, "step_id": 14185, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813524.0475152, "step_id": 14186, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813524.0569751, "step_id": 14187, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813524.0671299, "step_id": 14188, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813524.0771666, "step_id": 14189, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813524.0877938, "step_id": 14190, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813524.09671, "step_id": 14191, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813524.1062963, "step_id": 14192, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813524.1156256, "step_id": 14193, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813524.125537, "step_id": 14194, "start_load_kv_us": 5, "get_finished_us": 169} +{"t_unix": 1779813524.1350882, "step_id": 14195, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813524.1439373, "step_id": 14196, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813524.19102, "step_id": 14197, "start_load_kv_us": 139, "get_finished_us": 213} +{"t_unix": 1779813524.1952703, "step_id": 14198, "start_load_kv_us": 3, "get_finished_us": 150} +{"t_unix": 1779813524.436921, "step_id": 14199, "start_load_kv_us": 149, "get_finished_us": 305} +{"t_unix": 1779813524.4413524, "step_id": 14200, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813524.6486444, "step_id": 14201, "start_load_kv_us": 2, "get_finished_us": 339} +{"t_unix": 1779813524.6595612, "step_id": 14202, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813524.669418, "step_id": 14203, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813524.6799648, "step_id": 14204, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813524.6904166, "step_id": 14205, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813524.701639, "step_id": 14206, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813524.7113667, "step_id": 14207, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813524.7217486, "step_id": 14208, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813524.7323523, "step_id": 14209, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813524.7442014, "step_id": 14210, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813524.7550411, "step_id": 14211, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813524.7661781, "step_id": 14212, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813524.7775352, "step_id": 14213, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813524.7875967, "step_id": 14214, "start_load_kv_us": 5, "get_finished_us": 238} +{"t_unix": 1779813524.8356905, "step_id": 14215, "start_load_kv_us": 143, "get_finished_us": 219} +{"t_unix": 1779813524.840239, "step_id": 14216, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813525.050217, "step_id": 14217, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813525.0593464, "step_id": 14218, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813525.0689826, "step_id": 14219, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813525.0790915, "step_id": 14220, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813525.0897303, "step_id": 14221, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813525.0989742, "step_id": 14222, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813525.1089363, "step_id": 14223, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813525.1193633, "step_id": 14224, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813525.1294634, "step_id": 14225, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813525.1402352, "step_id": 14226, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813525.1499376, "step_id": 14227, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813525.1601934, "step_id": 14228, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813525.1704862, "step_id": 14229, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813525.181659, "step_id": 14230, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813525.1913419, "step_id": 14231, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813525.2024555, "step_id": 14232, "start_load_kv_us": 5, "get_finished_us": 318} +{"t_unix": 1779813525.211568, "step_id": 14233, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813525.2219296, "step_id": 14234, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813525.2320573, "step_id": 14235, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813525.2423806, "step_id": 14236, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813525.2906003, "step_id": 14237, "start_load_kv_us": 135, "get_finished_us": 278} +{"t_unix": 1779813525.294329, "step_id": 14238, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813525.5000935, "step_id": 14239, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813525.5092564, "step_id": 14240, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813525.518903, "step_id": 14241, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813525.5297937, "step_id": 14242, "start_load_kv_us": 5, "get_finished_us": 247} +{"t_unix": 1779813525.538857, "step_id": 14243, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813525.5491338, "step_id": 14244, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813525.55939, "step_id": 14245, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813525.57039, "step_id": 14246, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813525.5797708, "step_id": 14247, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813525.5907123, "step_id": 14248, "start_load_kv_us": 6, "get_finished_us": 249} +{"t_unix": 1779813525.599879, "step_id": 14249, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813525.6098619, "step_id": 14250, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813525.6203458, "step_id": 14251, "start_load_kv_us": 2, "get_finished_us": 395} +{"t_unix": 1779813525.6306312, "step_id": 14252, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813525.6410472, "step_id": 14253, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813525.6506739, "step_id": 14254, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813525.6610813, "step_id": 14255, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813525.671417, "step_id": 14256, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813525.6822577, "step_id": 14257, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813525.6933184, "step_id": 14258, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813525.7028296, "step_id": 14259, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813525.7128773, "step_id": 14260, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813525.7206516, "step_id": 14261, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813525.7293792, "step_id": 14262, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813525.7367256, "step_id": 14263, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813525.7455585, "step_id": 14264, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813525.752659, "step_id": 14265, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813525.760004, "step_id": 14266, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813525.7672558, "step_id": 14267, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813525.7751682, "step_id": 14268, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813525.7837894, "step_id": 14269, "start_load_kv_us": 4, "get_finished_us": 158} +{"t_unix": 1779813525.7910814, "step_id": 14270, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813525.7987921, "step_id": 14271, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813525.806596, "step_id": 14272, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813525.8144486, "step_id": 14273, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813525.8221915, "step_id": 14274, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813525.8301582, "step_id": 14275, "start_load_kv_us": 16, "get_finished_us": 167} +{"t_unix": 1779813525.8378656, "step_id": 14276, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813525.845572, "step_id": 14277, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813525.8542018, "step_id": 14278, "start_load_kv_us": 18, "get_finished_us": 209} +{"t_unix": 1779813525.8615177, "step_id": 14279, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813525.8698542, "step_id": 14280, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813525.8766854, "step_id": 14281, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813525.8843982, "step_id": 14282, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813525.8922324, "step_id": 14283, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813525.8999565, "step_id": 14284, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813525.908136, "step_id": 14285, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813525.9149735, "step_id": 14286, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813525.922697, "step_id": 14287, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813525.9306593, "step_id": 14288, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813525.93872, "step_id": 14289, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813525.946589, "step_id": 14290, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813525.9545853, "step_id": 14291, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813525.9626906, "step_id": 14292, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813525.9705157, "step_id": 14293, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813525.9788885, "step_id": 14294, "start_load_kv_us": 4, "get_finished_us": 169} +{"t_unix": 1779813525.9854133, "step_id": 14295, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813525.9932969, "step_id": 14296, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813526.0001001, "step_id": 14297, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813526.007998, "step_id": 14298, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813526.0154529, "step_id": 14299, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813526.0225337, "step_id": 14300, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813526.0306575, "step_id": 14301, "start_load_kv_us": 4, "get_finished_us": 270} +{"t_unix": 1779813526.037715, "step_id": 14302, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813526.045335, "step_id": 14303, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813526.0533, "step_id": 14304, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813526.0611668, "step_id": 14305, "start_load_kv_us": 4, "get_finished_us": 208} +{"t_unix": 1779813526.0689075, "step_id": 14306, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813526.0762906, "step_id": 14307, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813526.0839515, "step_id": 14308, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813526.0916965, "step_id": 14309, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813526.0997987, "step_id": 14310, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813526.1068995, "step_id": 14311, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813526.1152554, "step_id": 14312, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813526.1222515, "step_id": 14313, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813526.130052, "step_id": 14314, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813526.137899, "step_id": 14315, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813526.1458175, "step_id": 14316, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813526.1542616, "step_id": 14317, "start_load_kv_us": 5, "get_finished_us": 151} +{"t_unix": 1779813526.1613212, "step_id": 14318, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813526.1692796, "step_id": 14319, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813526.1771772, "step_id": 14320, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813526.1845696, "step_id": 14321, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813526.1923473, "step_id": 14322, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813526.200072, "step_id": 14323, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813526.2078059, "step_id": 14324, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813526.2157493, "step_id": 14325, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813526.2243636, "step_id": 14326, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813526.2314684, "step_id": 14327, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813526.240094, "step_id": 14328, "start_load_kv_us": 5, "get_finished_us": 181} +{"t_unix": 1779813526.2471023, "step_id": 14329, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813526.254872, "step_id": 14330, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813526.2626307, "step_id": 14331, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813526.2704635, "step_id": 14332, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813526.2788372, "step_id": 14333, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813526.2862816, "step_id": 14334, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813526.2942958, "step_id": 14335, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813526.3021712, "step_id": 14336, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813526.3098412, "step_id": 14337, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813526.3172696, "step_id": 14338, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813526.3248842, "step_id": 14339, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813526.3327556, "step_id": 14340, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813526.3406112, "step_id": 14341, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813526.3491247, "step_id": 14342, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813526.3561435, "step_id": 14343, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813526.3646958, "step_id": 14344, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813526.3717256, "step_id": 14345, "start_load_kv_us": 1, "get_finished_us": 204} +{"t_unix": 1779813526.3801486, "step_id": 14346, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813526.388471, "step_id": 14347, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813526.3967512, "step_id": 14348, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813526.4054687, "step_id": 14349, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813526.413172, "step_id": 14350, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813526.4594836, "step_id": 14351, "start_load_kv_us": 137, "get_finished_us": 253} +{"t_unix": 1779813526.4632282, "step_id": 14352, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813526.6670034, "step_id": 14353, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813526.6762571, "step_id": 14354, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813526.685779, "step_id": 14355, "start_load_kv_us": 15, "get_finished_us": 180} +{"t_unix": 1779813526.6951718, "step_id": 14356, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813526.7043526, "step_id": 14357, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813526.7143044, "step_id": 14358, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813526.7229142, "step_id": 14359, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813526.7332075, "step_id": 14360, "start_load_kv_us": 6, "get_finished_us": 169} +{"t_unix": 1779813526.742104, "step_id": 14361, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813526.751458, "step_id": 14362, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813526.7611783, "step_id": 14363, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813526.7705107, "step_id": 14364, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813526.7806928, "step_id": 14365, "start_load_kv_us": 6, "get_finished_us": 175} +{"t_unix": 1779813526.7896514, "step_id": 14366, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813526.7992857, "step_id": 14367, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813526.8088543, "step_id": 14368, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813526.8181827, "step_id": 14369, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813526.8276448, "step_id": 14370, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813526.8369362, "step_id": 14371, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813526.8464, "step_id": 14372, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813526.8558383, "step_id": 14373, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813526.8664808, "step_id": 14374, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813526.8753335, "step_id": 14375, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813526.885635, "step_id": 14376, "start_load_kv_us": 5, "get_finished_us": 279} +{"t_unix": 1779813526.894283, "step_id": 14377, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813526.904236, "step_id": 14378, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813526.9139233, "step_id": 14379, "start_load_kv_us": 1, "get_finished_us": 234} +{"t_unix": 1779813526.9235892, "step_id": 14380, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813526.934077, "step_id": 14381, "start_load_kv_us": 6, "get_finished_us": 217} +{"t_unix": 1779813526.9431813, "step_id": 14382, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813526.952877, "step_id": 14383, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813526.9627247, "step_id": 14384, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813526.9721842, "step_id": 14385, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813526.982129, "step_id": 14386, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813526.9919899, "step_id": 14387, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813527.0021987, "step_id": 14388, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813527.0124714, "step_id": 14389, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813527.0242522, "step_id": 14390, "start_load_kv_us": 5, "get_finished_us": 250} +{"t_unix": 1779813527.071055, "step_id": 14391, "start_load_kv_us": 142, "get_finished_us": 327} +{"t_unix": 1779813527.0757408, "step_id": 14392, "start_load_kv_us": 6, "get_finished_us": 222} +{"t_unix": 1779813527.2803123, "step_id": 14393, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813527.2902617, "step_id": 14394, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813527.2990677, "step_id": 14395, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813527.3090644, "step_id": 14396, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813527.3196287, "step_id": 14397, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813527.3287897, "step_id": 14398, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813527.338955, "step_id": 14399, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813527.3489313, "step_id": 14400, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813527.359295, "step_id": 14401, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813527.3689606, "step_id": 14402, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813527.3791661, "step_id": 14403, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813527.3890457, "step_id": 14404, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813527.3991697, "step_id": 14405, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813527.4101534, "step_id": 14406, "start_load_kv_us": 4, "get_finished_us": 180} +{"t_unix": 1779813527.4191196, "step_id": 14407, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813527.4293704, "step_id": 14408, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813527.4377458, "step_id": 14409, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813527.4479866, "step_id": 14410, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813527.456885, "step_id": 14411, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813527.466136, "step_id": 14412, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813527.4765143, "step_id": 14413, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813527.485884, "step_id": 14414, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813527.4954226, "step_id": 14415, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813527.5052, "step_id": 14416, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813527.5148504, "step_id": 14417, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813527.5242977, "step_id": 14418, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813527.533328, "step_id": 14419, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813527.5429685, "step_id": 14420, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813527.5523486, "step_id": 14421, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813527.562271, "step_id": 14422, "start_load_kv_us": 5, "get_finished_us": 145} +{"t_unix": 1779813527.5709803, "step_id": 14423, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813527.5810468, "step_id": 14424, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813527.5902321, "step_id": 14425, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813527.6004689, "step_id": 14426, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813527.6096277, "step_id": 14427, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813527.6192243, "step_id": 14428, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813527.6292045, "step_id": 14429, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813527.6381755, "step_id": 14430, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813527.6475935, "step_id": 14431, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813527.6568027, "step_id": 14432, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813527.6662006, "step_id": 14433, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813527.6755931, "step_id": 14434, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813527.6852095, "step_id": 14435, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813527.6946223, "step_id": 14436, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813527.7041433, "step_id": 14437, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813527.7142975, "step_id": 14438, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813527.7236285, "step_id": 14439, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813527.7341216, "step_id": 14440, "start_load_kv_us": 4, "get_finished_us": 143} +{"t_unix": 1779813527.7433977, "step_id": 14441, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813527.7533243, "step_id": 14442, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813527.7622936, "step_id": 14443, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813527.7718234, "step_id": 14444, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813527.7822964, "step_id": 14445, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813527.791344, "step_id": 14446, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813527.8009307, "step_id": 14447, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813527.8102484, "step_id": 14448, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813527.819741, "step_id": 14449, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813527.829482, "step_id": 14450, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813527.8392525, "step_id": 14451, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813527.8491762, "step_id": 14452, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813527.8595147, "step_id": 14453, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813527.869141, "step_id": 14454, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813527.8795044, "step_id": 14455, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813527.8900228, "step_id": 14456, "start_load_kv_us": 4, "get_finished_us": 244} +{"t_unix": 1779813527.8971066, "step_id": 14457, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813527.9054549, "step_id": 14458, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813527.9127457, "step_id": 14459, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813527.9208384, "step_id": 14460, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813527.9294646, "step_id": 14461, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813527.9369583, "step_id": 14462, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813527.9451234, "step_id": 14463, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813527.95353, "step_id": 14464, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813527.9617667, "step_id": 14465, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813527.9699893, "step_id": 14466, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813527.9781601, "step_id": 14467, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813527.9863586, "step_id": 14468, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813527.994683, "step_id": 14469, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813528.0028236, "step_id": 14470, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813528.011248, "step_id": 14471, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813528.0200996, "step_id": 14472, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813528.0269804, "step_id": 14473, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813528.035316, "step_id": 14474, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813528.0423975, "step_id": 14475, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813528.049932, "step_id": 14476, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813528.0582902, "step_id": 14477, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813528.0653377, "step_id": 14478, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813528.0729713, "step_id": 14479, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813528.080573, "step_id": 14480, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813528.0882857, "step_id": 14481, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813528.095875, "step_id": 14482, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813528.103644, "step_id": 14483, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813528.1111898, "step_id": 14484, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813528.118802, "step_id": 14485, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813528.1262188, "step_id": 14486, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813528.1337621, "step_id": 14487, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813528.14214, "step_id": 14488, "start_load_kv_us": 20, "get_finished_us": 147} +{"t_unix": 1779813528.1490574, "step_id": 14489, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813528.1574774, "step_id": 14490, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813528.1646504, "step_id": 14491, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813528.1723912, "step_id": 14492, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813528.181048, "step_id": 14493, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813528.1879766, "step_id": 14494, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813528.1939664, "step_id": 14495, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813528.2000792, "step_id": 14496, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813528.2062688, "step_id": 14497, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813528.2123632, "step_id": 14498, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813528.218505, "step_id": 14499, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813528.2246537, "step_id": 14500, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813528.2308528, "step_id": 14501, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813528.2368724, "step_id": 14502, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813528.2428546, "step_id": 14503, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813528.2489994, "step_id": 14504, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813528.2550213, "step_id": 14505, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813528.2616522, "step_id": 14506, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813528.2670968, "step_id": 14507, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813528.2731056, "step_id": 14508, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813528.2799706, "step_id": 14509, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813528.2854505, "step_id": 14510, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813528.2915645, "step_id": 14511, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813528.297685, "step_id": 14512, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813528.303736, "step_id": 14513, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813528.310005, "step_id": 14514, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813528.3161123, "step_id": 14515, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813528.322171, "step_id": 14516, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813528.3281646, "step_id": 14517, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813528.3343968, "step_id": 14518, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813528.3405848, "step_id": 14519, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813528.3465984, "step_id": 14520, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813528.3525054, "step_id": 14521, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813528.3591657, "step_id": 14522, "start_load_kv_us": 5, "get_finished_us": 143} +{"t_unix": 1779813528.3646412, "step_id": 14523, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813528.3707788, "step_id": 14524, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813528.377585, "step_id": 14525, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813528.383068, "step_id": 14526, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813528.3892078, "step_id": 14527, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813528.39539, "step_id": 14528, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813528.4015384, "step_id": 14529, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813528.4077501, "step_id": 14530, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813528.4138856, "step_id": 14531, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813528.4200826, "step_id": 14532, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813528.4262106, "step_id": 14533, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813528.432419, "step_id": 14534, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813528.4385061, "step_id": 14535, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813528.4454575, "step_id": 14536, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813528.488452, "step_id": 14537, "start_load_kv_us": 135, "get_finished_us": 212} +{"t_unix": 1779813528.492736, "step_id": 14538, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813528.6910932, "step_id": 14539, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813528.6982791, "step_id": 14540, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813528.7438235, "step_id": 14541, "start_load_kv_us": 135, "get_finished_us": 261} +{"t_unix": 1779813528.7476153, "step_id": 14542, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813528.9965003, "step_id": 14543, "start_load_kv_us": 283, "get_finished_us": 349} +{"t_unix": 1779813529.3973632, "step_id": 14544, "start_load_kv_us": 124, "get_finished_us": 334} +{"t_unix": 1779813529.416206, "step_id": 14545, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813529.6428792, "step_id": 14546, "start_load_kv_us": 5, "get_finished_us": 309} +{"t_unix": 1779813529.651902, "step_id": 14547, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813529.6627371, "step_id": 14548, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813529.6781673, "step_id": 14549, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813529.684663, "step_id": 14550, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813529.6963484, "step_id": 14551, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813529.706828, "step_id": 14552, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813529.7187095, "step_id": 14553, "start_load_kv_us": 19, "get_finished_us": 220} +{"t_unix": 1779813529.7295587, "step_id": 14554, "start_load_kv_us": 6, "get_finished_us": 166} +{"t_unix": 1779813529.7404892, "step_id": 14555, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813529.751819, "step_id": 14556, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813529.765502, "step_id": 14557, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813529.81416, "step_id": 14558, "start_load_kv_us": 141, "get_finished_us": 333} +{"t_unix": 1779813529.8188963, "step_id": 14559, "start_load_kv_us": 4, "get_finished_us": 231} +{"t_unix": 1779813530.0260382, "step_id": 14560, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813530.036626, "step_id": 14561, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813530.0481913, "step_id": 14562, "start_load_kv_us": 5, "get_finished_us": 227} +{"t_unix": 1779813530.0585158, "step_id": 14563, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813530.069688, "step_id": 14564, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813530.0804307, "step_id": 14565, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813530.091729, "step_id": 14566, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813530.1037145, "step_id": 14567, "start_load_kv_us": 5, "get_finished_us": 180} +{"t_unix": 1779813530.1145315, "step_id": 14568, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813530.1263397, "step_id": 14569, "start_load_kv_us": 5, "get_finished_us": 272} +{"t_unix": 1779813530.142581, "step_id": 14570, "start_load_kv_us": 6, "get_finished_us": 298} +{"t_unix": 1779813530.1488426, "step_id": 14571, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813530.1594977, "step_id": 14572, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813530.1709626, "step_id": 14573, "start_load_kv_us": 4, "get_finished_us": 256} +{"t_unix": 1779813530.1811268, "step_id": 14574, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813530.1925778, "step_id": 14575, "start_load_kv_us": 5, "get_finished_us": 268} +{"t_unix": 1779813530.2025726, "step_id": 14576, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813530.2130928, "step_id": 14577, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813530.224312, "step_id": 14578, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813530.2344313, "step_id": 14579, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813530.2454908, "step_id": 14580, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813530.256953, "step_id": 14581, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813530.268183, "step_id": 14582, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813530.2799604, "step_id": 14583, "start_load_kv_us": 5, "get_finished_us": 294} +{"t_unix": 1779813530.2900686, "step_id": 14584, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813530.301383, "step_id": 14585, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813530.312468, "step_id": 14586, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813530.3237746, "step_id": 14587, "start_load_kv_us": 6, "get_finished_us": 175} +{"t_unix": 1779813530.3341532, "step_id": 14588, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813530.3461623, "step_id": 14589, "start_load_kv_us": 4, "get_finished_us": 281} +{"t_unix": 1779813530.3562086, "step_id": 14590, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813530.3679297, "step_id": 14591, "start_load_kv_us": 4, "get_finished_us": 251} +{"t_unix": 1779813530.3785183, "step_id": 14592, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813530.3901513, "step_id": 14593, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813530.4018476, "step_id": 14594, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813530.4126203, "step_id": 14595, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813530.4239993, "step_id": 14596, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813530.4354155, "step_id": 14597, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813530.446538, "step_id": 14598, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813530.4588318, "step_id": 14599, "start_load_kv_us": 5, "get_finished_us": 246} +{"t_unix": 1779813530.4692788, "step_id": 14600, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813530.4814558, "step_id": 14601, "start_load_kv_us": 5, "get_finished_us": 178} +{"t_unix": 1779813530.4931781, "step_id": 14602, "start_load_kv_us": 5, "get_finished_us": 174} +{"t_unix": 1779813530.5049934, "step_id": 14603, "start_load_kv_us": 4, "get_finished_us": 164} +{"t_unix": 1779813530.5160758, "step_id": 14604, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813530.5281181, "step_id": 14605, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813530.5774882, "step_id": 14606, "start_load_kv_us": 137, "get_finished_us": 247} +{"t_unix": 1779813530.5822382, "step_id": 14607, "start_load_kv_us": 5, "get_finished_us": 157} +{"t_unix": 1779813530.790756, "step_id": 14608, "start_load_kv_us": 6, "get_finished_us": 340} +{"t_unix": 1779813530.8011658, "step_id": 14609, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813530.8138375, "step_id": 14610, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813530.8250477, "step_id": 14611, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813530.836779, "step_id": 14612, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813530.84851, "step_id": 14613, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813530.8598895, "step_id": 14614, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813530.8721206, "step_id": 14615, "start_load_kv_us": 5, "get_finished_us": 269} +{"t_unix": 1779813530.883155, "step_id": 14616, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813530.8955152, "step_id": 14617, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813530.9074557, "step_id": 14618, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813530.9190812, "step_id": 14619, "start_load_kv_us": 4, "get_finished_us": 176} +{"t_unix": 1779813530.9299982, "step_id": 14620, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813530.9416153, "step_id": 14621, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813530.953726, "step_id": 14622, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813530.9663088, "step_id": 14623, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813530.9778183, "step_id": 14624, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813530.9888415, "step_id": 14625, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813531.0007374, "step_id": 14626, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813531.0106606, "step_id": 14627, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813531.0217636, "step_id": 14628, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813531.0331664, "step_id": 14629, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813531.044847, "step_id": 14630, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813531.0570078, "step_id": 14631, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813531.0683134, "step_id": 14632, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813531.0804615, "step_id": 14633, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813531.0919793, "step_id": 14634, "start_load_kv_us": 5, "get_finished_us": 224} +{"t_unix": 1779813531.1033664, "step_id": 14635, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813531.1143386, "step_id": 14636, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813531.125602, "step_id": 14637, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813531.1372256, "step_id": 14638, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813531.1492648, "step_id": 14639, "start_load_kv_us": 4, "get_finished_us": 153} +{"t_unix": 1779813531.1611269, "step_id": 14640, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813531.1722686, "step_id": 14641, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813531.1846957, "step_id": 14642, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813531.1957421, "step_id": 14643, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813531.2072732, "step_id": 14644, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813531.2191422, "step_id": 14645, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813531.2309942, "step_id": 14646, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813531.2439604, "step_id": 14647, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813531.2550023, "step_id": 14648, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813531.2673054, "step_id": 14649, "start_load_kv_us": 9, "get_finished_us": 171} +{"t_unix": 1779813531.2790453, "step_id": 14650, "start_load_kv_us": 5, "get_finished_us": 264} +{"t_unix": 1779813531.2900841, "step_id": 14651, "start_load_kv_us": 4, "get_finished_us": 261} +{"t_unix": 1779813531.300233, "step_id": 14652, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813531.311625, "step_id": 14653, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813531.322998, "step_id": 14654, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813531.335215, "step_id": 14655, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813531.3470705, "step_id": 14656, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813531.3582954, "step_id": 14657, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813531.370857, "step_id": 14658, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813531.3816555, "step_id": 14659, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813531.393425, "step_id": 14660, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813531.4047165, "step_id": 14661, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813531.4163015, "step_id": 14662, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813531.4286501, "step_id": 14663, "start_load_kv_us": 5, "get_finished_us": 237} +{"t_unix": 1779813531.4395766, "step_id": 14664, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813531.4516218, "step_id": 14665, "start_load_kv_us": 10, "get_finished_us": 198} +{"t_unix": 1779813531.462832, "step_id": 14666, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813531.475633, "step_id": 14667, "start_load_kv_us": 4, "get_finished_us": 222} +{"t_unix": 1779813531.5302474, "step_id": 14668, "start_load_kv_us": 170, "get_finished_us": 247} +{"t_unix": 1779813531.534063, "step_id": 14669, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813531.7339191, "step_id": 14670, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813531.745364, "step_id": 14671, "start_load_kv_us": 6, "get_finished_us": 223} +{"t_unix": 1779813531.7565408, "step_id": 14672, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813531.7669177, "step_id": 14673, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813531.778378, "step_id": 14674, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813531.788973, "step_id": 14675, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813531.8006186, "step_id": 14676, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813531.811681, "step_id": 14677, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813531.8224256, "step_id": 14678, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813531.8341565, "step_id": 14679, "start_load_kv_us": 5, "get_finished_us": 173} +{"t_unix": 1779813531.844662, "step_id": 14680, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813531.856018, "step_id": 14681, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813531.8666294, "step_id": 14682, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813531.8773706, "step_id": 14683, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813531.8874867, "step_id": 14684, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813531.8979957, "step_id": 14685, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813531.908687, "step_id": 14686, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813531.9199395, "step_id": 14687, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813531.9305942, "step_id": 14688, "start_load_kv_us": 5, "get_finished_us": 257} +{"t_unix": 1779813531.9408476, "step_id": 14689, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813531.9521518, "step_id": 14690, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813531.9620988, "step_id": 14691, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813531.9728317, "step_id": 14692, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813531.983481, "step_id": 14693, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813531.9937909, "step_id": 14694, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813532.0061054, "step_id": 14695, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813532.0148802, "step_id": 14696, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813532.0259314, "step_id": 14697, "start_load_kv_us": 4, "get_finished_us": 218} +{"t_unix": 1779813532.0367317, "step_id": 14698, "start_load_kv_us": 5, "get_finished_us": 228} +{"t_unix": 1779813532.0481431, "step_id": 14699, "start_load_kv_us": 4, "get_finished_us": 252} +{"t_unix": 1779813532.0578506, "step_id": 14700, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813532.0683765, "step_id": 14701, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813532.0792618, "step_id": 14702, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813532.0906694, "step_id": 14703, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813532.1018443, "step_id": 14704, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813532.1122603, "step_id": 14705, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813532.1235135, "step_id": 14706, "start_load_kv_us": 4, "get_finished_us": 182} +{"t_unix": 1779813532.1330469, "step_id": 14707, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813532.144045, "step_id": 14708, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813532.1554897, "step_id": 14709, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813532.1669927, "step_id": 14710, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813532.1792138, "step_id": 14711, "start_load_kv_us": 4, "get_finished_us": 274} +{"t_unix": 1779813532.1900456, "step_id": 14712, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813532.201673, "step_id": 14713, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813532.2128942, "step_id": 14714, "start_load_kv_us": 5, "get_finished_us": 153} +{"t_unix": 1779813532.2241573, "step_id": 14715, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813532.2348666, "step_id": 14716, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813532.245923, "step_id": 14717, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813532.2576482, "step_id": 14718, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813532.2697852, "step_id": 14719, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813532.2815151, "step_id": 14720, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813532.2926886, "step_id": 14721, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813532.3047712, "step_id": 14722, "start_load_kv_us": 4, "get_finished_us": 149} +{"t_unix": 1779813532.315431, "step_id": 14723, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813532.32739, "step_id": 14724, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813532.3395982, "step_id": 14725, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813532.35175, "step_id": 14726, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813532.3643522, "step_id": 14727, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813532.375819, "step_id": 14728, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813532.3886564, "step_id": 14729, "start_load_kv_us": 4, "get_finished_us": 234} +{"t_unix": 1779813532.4009006, "step_id": 14730, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813532.4131002, "step_id": 14731, "start_load_kv_us": 5, "get_finished_us": 196} +{"t_unix": 1779813532.4243853, "step_id": 14732, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813532.4363074, "step_id": 14733, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813532.4478686, "step_id": 14734, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813532.460242, "step_id": 14735, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813532.4716165, "step_id": 14736, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813532.4820561, "step_id": 14737, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813532.5317132, "step_id": 14738, "start_load_kv_us": 171, "get_finished_us": 215} +{"t_unix": 1779813532.5354898, "step_id": 14739, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813532.7836058, "step_id": 14740, "start_load_kv_us": 288, "get_finished_us": 326} +{"t_unix": 1779813532.7877078, "step_id": 14741, "start_load_kv_us": 3, "get_finished_us": 220} +{"t_unix": 1779813533.2043502, "step_id": 14742, "start_load_kv_us": 2, "get_finished_us": 335} +{"t_unix": 1779813533.21716, "step_id": 14743, "start_load_kv_us": 5, "get_finished_us": 297} +{"t_unix": 1779813533.2293022, "step_id": 14744, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813533.243184, "step_id": 14745, "start_load_kv_us": 16, "get_finished_us": 171} +{"t_unix": 1779813533.2561588, "step_id": 14746, "start_load_kv_us": 5, "get_finished_us": 185} +{"t_unix": 1779813533.2691796, "step_id": 14747, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813533.281764, "step_id": 14748, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813533.295349, "step_id": 14749, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813533.309587, "step_id": 14750, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813533.3228183, "step_id": 14751, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813533.3364577, "step_id": 14752, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813533.3889332, "step_id": 14753, "start_load_kv_us": 304, "get_finished_us": 308} +{"t_unix": 1779813533.3935208, "step_id": 14754, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813533.8508449, "step_id": 14755, "start_load_kv_us": 144, "get_finished_us": 306} +{"t_unix": 1779813533.8551278, "step_id": 14756, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813534.0656767, "step_id": 14757, "start_load_kv_us": 6, "get_finished_us": 354} +{"t_unix": 1779813534.0842698, "step_id": 14758, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813534.0925808, "step_id": 14759, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813534.1073039, "step_id": 14760, "start_load_kv_us": 5, "get_finished_us": 254} +{"t_unix": 1779813534.1218636, "step_id": 14761, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813534.1365833, "step_id": 14762, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813534.1514997, "step_id": 14763, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813534.1654656, "step_id": 14764, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813534.180455, "step_id": 14765, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813534.1964228, "step_id": 14766, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813534.2123013, "step_id": 14767, "start_load_kv_us": 5, "get_finished_us": 183} +{"t_unix": 1779813534.264065, "step_id": 14768, "start_load_kv_us": 167, "get_finished_us": 216} +{"t_unix": 1779813534.2679315, "step_id": 14769, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813534.4763405, "step_id": 14770, "start_load_kv_us": 5, "get_finished_us": 274} +{"t_unix": 1779813534.491752, "step_id": 14771, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813534.5050619, "step_id": 14772, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813534.5201502, "step_id": 14773, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813534.533974, "step_id": 14774, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813534.5488193, "step_id": 14775, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813534.5631166, "step_id": 14776, "start_load_kv_us": 4, "get_finished_us": 196} +{"t_unix": 1779813534.5775397, "step_id": 14777, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813534.5921967, "step_id": 14778, "start_load_kv_us": 19, "get_finished_us": 201} +{"t_unix": 1779813534.606539, "step_id": 14779, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813534.620586, "step_id": 14780, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813534.6351833, "step_id": 14781, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813534.6502402, "step_id": 14782, "start_load_kv_us": 5, "get_finished_us": 217} +{"t_unix": 1779813534.6647701, "step_id": 14783, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813534.6793442, "step_id": 14784, "start_load_kv_us": 5, "get_finished_us": 171} +{"t_unix": 1779813534.6936297, "step_id": 14785, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813534.709359, "step_id": 14786, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813534.7237206, "step_id": 14787, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813534.7392745, "step_id": 14788, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813534.7555032, "step_id": 14789, "start_load_kv_us": 5, "get_finished_us": 259} +{"t_unix": 1779813534.769803, "step_id": 14790, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813534.7857232, "step_id": 14791, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813534.8008983, "step_id": 14792, "start_load_kv_us": 4, "get_finished_us": 163} +{"t_unix": 1779813534.8165371, "step_id": 14793, "start_load_kv_us": 5, "get_finished_us": 222} +{"t_unix": 1779813534.831343, "step_id": 14794, "start_load_kv_us": 6, "get_finished_us": 221} +{"t_unix": 1779813534.8462512, "step_id": 14795, "start_load_kv_us": 5, "get_finished_us": 262} +{"t_unix": 1779813534.8604553, "step_id": 14796, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813534.8756833, "step_id": 14797, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813534.8914123, "step_id": 14798, "start_load_kv_us": 5, "get_finished_us": 172} +{"t_unix": 1779813534.905465, "step_id": 14799, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813534.9637716, "step_id": 14800, "start_load_kv_us": 141, "get_finished_us": 243} +{"t_unix": 1779813534.9678206, "step_id": 14801, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813535.17612, "step_id": 14802, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813535.189528, "step_id": 14803, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813535.2034683, "step_id": 14804, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813535.2182844, "step_id": 14805, "start_load_kv_us": 5, "get_finished_us": 175} +{"t_unix": 1779813535.231739, "step_id": 14806, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813535.2457771, "step_id": 14807, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813535.2598758, "step_id": 14808, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813535.2738311, "step_id": 14809, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813535.2881827, "step_id": 14810, "start_load_kv_us": 18, "get_finished_us": 187} +{"t_unix": 1779813535.3023577, "step_id": 14811, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813535.315678, "step_id": 14812, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813535.3296654, "step_id": 14813, "start_load_kv_us": 3, "get_finished_us": 180} +{"t_unix": 1779813535.3441715, "step_id": 14814, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813535.3570218, "step_id": 14815, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813535.371193, "step_id": 14816, "start_load_kv_us": 5, "get_finished_us": 159} +{"t_unix": 1779813535.384326, "step_id": 14817, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813535.3983133, "step_id": 14818, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813535.4120586, "step_id": 14819, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813535.4257407, "step_id": 14820, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813535.4402885, "step_id": 14821, "start_load_kv_us": 5, "get_finished_us": 165} +{"t_unix": 1779813535.453418, "step_id": 14822, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813535.467526, "step_id": 14823, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813535.4818966, "step_id": 14824, "start_load_kv_us": 6, "get_finished_us": 217} +{"t_unix": 1779813535.4956722, "step_id": 14825, "start_load_kv_us": 5, "get_finished_us": 266} +{"t_unix": 1779813535.50986, "step_id": 14826, "start_load_kv_us": 446, "get_finished_us": 277} +{"t_unix": 1779813535.5218253, "step_id": 14827, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813535.535514, "step_id": 14828, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813535.5492377, "step_id": 14829, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813535.601011, "step_id": 14830, "start_load_kv_us": 116, "get_finished_us": 318} +{"t_unix": 1779813535.6048262, "step_id": 14831, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813535.8165574, "step_id": 14832, "start_load_kv_us": 6, "get_finished_us": 288} +{"t_unix": 1779813535.8292305, "step_id": 14833, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813535.8429325, "step_id": 14834, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813535.856456, "step_id": 14835, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813535.8700979, "step_id": 14836, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813535.8847742, "step_id": 14837, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813535.8979666, "step_id": 14838, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813535.9122317, "step_id": 14839, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813535.92701, "step_id": 14840, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813535.941165, "step_id": 14841, "start_load_kv_us": 4, "get_finished_us": 292} +{"t_unix": 1779813535.9551356, "step_id": 14842, "start_load_kv_us": 5, "get_finished_us": 232} +{"t_unix": 1779813535.9687157, "step_id": 14843, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813535.9830036, "step_id": 14844, "start_load_kv_us": 4, "get_finished_us": 248} +{"t_unix": 1779813535.9965913, "step_id": 14845, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813536.0113316, "step_id": 14846, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813536.0249107, "step_id": 14847, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813536.039885, "step_id": 14848, "start_load_kv_us": 5, "get_finished_us": 251} +{"t_unix": 1779813536.0536718, "step_id": 14849, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813536.0682366, "step_id": 14850, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813536.0822902, "step_id": 14851, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813536.0969396, "step_id": 14852, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813536.1119697, "step_id": 14853, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813536.1256862, "step_id": 14854, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813536.1398528, "step_id": 14855, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813536.154729, "step_id": 14856, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813536.1687715, "step_id": 14857, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813536.1827776, "step_id": 14858, "start_load_kv_us": 5, "get_finished_us": 208} +{"t_unix": 1779813536.196174, "step_id": 14859, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813536.2106946, "step_id": 14860, "start_load_kv_us": 16, "get_finished_us": 211} +{"t_unix": 1779813536.2241302, "step_id": 14861, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813536.2390678, "step_id": 14862, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813536.2520561, "step_id": 14863, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813536.2663794, "step_id": 14864, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813536.2796915, "step_id": 14865, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813536.2935624, "step_id": 14866, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813536.3073802, "step_id": 14867, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813536.3210776, "step_id": 14868, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813536.3356051, "step_id": 14869, "start_load_kv_us": 5, "get_finished_us": 216} +{"t_unix": 1779813536.3485017, "step_id": 14870, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813536.361869, "step_id": 14871, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813536.376408, "step_id": 14872, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813536.389832, "step_id": 14873, "start_load_kv_us": 4, "get_finished_us": 191} +{"t_unix": 1779813536.4035408, "step_id": 14874, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813536.4157822, "step_id": 14875, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813536.4299133, "step_id": 14876, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813536.4425812, "step_id": 14877, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813536.4568353, "step_id": 14878, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813536.4697955, "step_id": 14879, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813536.4840796, "step_id": 14880, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813536.496679, "step_id": 14881, "start_load_kv_us": 14, "get_finished_us": 196} +{"t_unix": 1779813536.509955, "step_id": 14882, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813536.5237887, "step_id": 14883, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813536.537229, "step_id": 14884, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813536.5518343, "step_id": 14885, "start_load_kv_us": 5, "get_finished_us": 335} +{"t_unix": 1779813536.5646665, "step_id": 14886, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813536.5784776, "step_id": 14887, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813536.592829, "step_id": 14888, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813536.6061296, "step_id": 14889, "start_load_kv_us": 5, "get_finished_us": 226} +{"t_unix": 1779813536.619182, "step_id": 14890, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813536.6321955, "step_id": 14891, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813536.6458378, "step_id": 14892, "start_load_kv_us": 4, "get_finished_us": 189} +{"t_unix": 1779813536.6585803, "step_id": 14893, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813536.6722045, "step_id": 14894, "start_load_kv_us": 5, "get_finished_us": 188} +{"t_unix": 1779813536.684921, "step_id": 14895, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813536.6991203, "step_id": 14896, "start_load_kv_us": 4, "get_finished_us": 238} +{"t_unix": 1779813536.7118533, "step_id": 14897, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813536.7253928, "step_id": 14898, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813536.7391477, "step_id": 14899, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813536.7525854, "step_id": 14900, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813536.7669563, "step_id": 14901, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813536.7793136, "step_id": 14902, "start_load_kv_us": 1, "get_finished_us": 204} +{"t_unix": 1779813536.7926998, "step_id": 14903, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813536.8060887, "step_id": 14904, "start_load_kv_us": 5, "get_finished_us": 203} +{"t_unix": 1779813536.8200803, "step_id": 14905, "start_load_kv_us": 4, "get_finished_us": 266} +{"t_unix": 1779813536.8340786, "step_id": 14906, "start_load_kv_us": 5, "get_finished_us": 212} +{"t_unix": 1779813536.8471541, "step_id": 14907, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813536.8615205, "step_id": 14908, "start_load_kv_us": 4, "get_finished_us": 265} +{"t_unix": 1779813536.8744588, "step_id": 14909, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813536.8887703, "step_id": 14910, "start_load_kv_us": 15, "get_finished_us": 289} +{"t_unix": 1779813536.9012685, "step_id": 14911, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813536.9154942, "step_id": 14912, "start_load_kv_us": 4, "get_finished_us": 257} +{"t_unix": 1779813536.9281862, "step_id": 14913, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813536.9419045, "step_id": 14914, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813536.9557838, "step_id": 14915, "start_load_kv_us": 2, "get_finished_us": 499} +{"t_unix": 1779813536.9694238, "step_id": 14916, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813536.9841018, "step_id": 14917, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813536.9974625, "step_id": 14918, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813537.0109162, "step_id": 14919, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813537.0246987, "step_id": 14920, "start_load_kv_us": 5, "get_finished_us": 311} +{"t_unix": 1779813537.0382164, "step_id": 14921, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813537.0520594, "step_id": 14922, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813537.0650904, "step_id": 14923, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813537.0802453, "step_id": 14924, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813537.0937068, "step_id": 14925, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813537.1065001, "step_id": 14926, "start_load_kv_us": 4, "get_finished_us": 200} +{"t_unix": 1779813537.1180084, "step_id": 14927, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813537.1298132, "step_id": 14928, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813537.1409307, "step_id": 14929, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813537.1522508, "step_id": 14930, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813537.1636777, "step_id": 14931, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813537.1749399, "step_id": 14932, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813537.1876905, "step_id": 14933, "start_load_kv_us": 5, "get_finished_us": 254} +{"t_unix": 1779813537.198966, "step_id": 14934, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813537.2110295, "step_id": 14935, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813537.2236445, "step_id": 14936, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813537.2353132, "step_id": 14937, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813537.2472572, "step_id": 14938, "start_load_kv_us": 4, "get_finished_us": 187} +{"t_unix": 1779813537.2585971, "step_id": 14939, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813537.2710166, "step_id": 14940, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813537.2820399, "step_id": 14941, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813537.2944274, "step_id": 14942, "start_load_kv_us": 4, "get_finished_us": 251} +{"t_unix": 1779813537.3072577, "step_id": 14943, "start_load_kv_us": 3, "get_finished_us": 263} +{"t_unix": 1779813537.3182712, "step_id": 14944, "start_load_kv_us": 4, "get_finished_us": 221} +{"t_unix": 1779813537.3293052, "step_id": 14945, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813537.3413363, "step_id": 14946, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813537.3531163, "step_id": 14947, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813537.3648646, "step_id": 14948, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813537.3773143, "step_id": 14949, "start_load_kv_us": 5, "get_finished_us": 199} +{"t_unix": 1779813537.3888707, "step_id": 14950, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813537.4011033, "step_id": 14951, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813537.4138675, "step_id": 14952, "start_load_kv_us": 5, "get_finished_us": 205} +{"t_unix": 1779813537.4260104, "step_id": 14953, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813537.4381945, "step_id": 14954, "start_load_kv_us": 5, "get_finished_us": 192} +{"t_unix": 1779813537.4495375, "step_id": 14955, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813537.4626215, "step_id": 14956, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813537.4742959, "step_id": 14957, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813537.4873364, "step_id": 14958, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813537.4991314, "step_id": 14959, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813537.5118659, "step_id": 14960, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813537.5231645, "step_id": 14961, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813537.5355804, "step_id": 14962, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813537.5876417, "step_id": 14963, "start_load_kv_us": 125, "get_finished_us": 319} +{"t_unix": 1779813537.5916674, "step_id": 14964, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813537.7999604, "step_id": 14965, "start_load_kv_us": 7, "get_finished_us": 325} +{"t_unix": 1779813537.812954, "step_id": 14966, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813537.8268223, "step_id": 14967, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813537.8418097, "step_id": 14968, "start_load_kv_us": 6, "get_finished_us": 205} +{"t_unix": 1779813537.8560889, "step_id": 14969, "start_load_kv_us": 5, "get_finished_us": 288} +{"t_unix": 1779813537.8702297, "step_id": 14970, "start_load_kv_us": 5, "get_finished_us": 242} +{"t_unix": 1779813537.8839364, "step_id": 14971, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813537.8990204, "step_id": 14972, "start_load_kv_us": 4, "get_finished_us": 251} +{"t_unix": 1779813537.9128518, "step_id": 14973, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813537.928069, "step_id": 14974, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813537.9420261, "step_id": 14975, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813537.9569252, "step_id": 14976, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813537.9705062, "step_id": 14977, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813537.984996, "step_id": 14978, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813537.999215, "step_id": 14979, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813538.0135233, "step_id": 14980, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813538.0287056, "step_id": 14981, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813538.042338, "step_id": 14982, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813538.056715, "step_id": 14983, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813538.0718324, "step_id": 14984, "start_load_kv_us": 5, "get_finished_us": 204} +{"t_unix": 1779813538.0864007, "step_id": 14985, "start_load_kv_us": 4, "get_finished_us": 197} +{"t_unix": 1779813538.1008031, "step_id": 14986, "start_load_kv_us": 4, "get_finished_us": 192} +{"t_unix": 1779813538.114465, "step_id": 14987, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813538.1293623, "step_id": 14988, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813538.1431308, "step_id": 14989, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813538.1582778, "step_id": 14990, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813538.1721358, "step_id": 14991, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813538.1873453, "step_id": 14992, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813538.2011616, "step_id": 14993, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813538.2161152, "step_id": 14994, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813538.2300081, "step_id": 14995, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813538.2421722, "step_id": 14996, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813538.2548692, "step_id": 14997, "start_load_kv_us": 5, "get_finished_us": 191} +{"t_unix": 1779813538.2655325, "step_id": 14998, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813538.277416, "step_id": 14999, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813538.2898273, "step_id": 15000, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813538.3011394, "step_id": 15001, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813538.311427, "step_id": 15002, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813538.3222206, "step_id": 15003, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813538.3336802, "step_id": 15004, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813538.344415, "step_id": 15005, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813538.3558202, "step_id": 15006, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813538.367616, "step_id": 15007, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813538.3794162, "step_id": 15008, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813538.3904855, "step_id": 15009, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813538.4018686, "step_id": 15010, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813538.4120011, "step_id": 15011, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813538.422069, "step_id": 15012, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813538.4305794, "step_id": 15013, "start_load_kv_us": 5, "get_finished_us": 189} +{"t_unix": 1779813538.437873, "step_id": 15014, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813538.4451826, "step_id": 15015, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813538.4528656, "step_id": 15016, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813538.4602275, "step_id": 15017, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813538.46686, "step_id": 15018, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813538.4743743, "step_id": 15019, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813538.4824796, "step_id": 15020, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813538.4895895, "step_id": 15021, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813538.4972086, "step_id": 15022, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813538.504956, "step_id": 15023, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813538.5131056, "step_id": 15024, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813538.5206294, "step_id": 15025, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813538.527787, "step_id": 15026, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813538.5350935, "step_id": 15027, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813538.5424073, "step_id": 15028, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813538.549721, "step_id": 15029, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813538.5571628, "step_id": 15030, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813538.5644658, "step_id": 15031, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813538.5721169, "step_id": 15032, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813538.5789578, "step_id": 15033, "start_load_kv_us": 4, "get_finished_us": 213} +{"t_unix": 1779813538.5853343, "step_id": 15034, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813538.5924249, "step_id": 15035, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813538.5999682, "step_id": 15036, "start_load_kv_us": 4, "get_finished_us": 229} +{"t_unix": 1779813538.6066318, "step_id": 15037, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813538.6136708, "step_id": 15038, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813538.6210086, "step_id": 15039, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813538.6281822, "step_id": 15040, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813538.6357832, "step_id": 15041, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813538.642934, "step_id": 15042, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813538.6504285, "step_id": 15043, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813538.6579325, "step_id": 15044, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813538.665405, "step_id": 15045, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813538.673208, "step_id": 15046, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813538.6808302, "step_id": 15047, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813538.6892586, "step_id": 15048, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813538.6971047, "step_id": 15049, "start_load_kv_us": 4, "get_finished_us": 242} +{"t_unix": 1779813538.7040136, "step_id": 15050, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813538.7116106, "step_id": 15051, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813538.7198403, "step_id": 15052, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813538.7267044, "step_id": 15053, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813538.7342007, "step_id": 15054, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813538.7422485, "step_id": 15055, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813538.7497125, "step_id": 15056, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813538.7573426, "step_id": 15057, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813538.763193, "step_id": 15058, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813538.7693243, "step_id": 15059, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813538.7755632, "step_id": 15060, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813538.781375, "step_id": 15061, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813538.7870135, "step_id": 15062, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813538.7927532, "step_id": 15063, "start_load_kv_us": 13, "get_finished_us": 161} +{"t_unix": 1779813538.798423, "step_id": 15064, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813538.804976, "step_id": 15065, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813538.8102934, "step_id": 15066, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813538.8163097, "step_id": 15067, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813538.8227103, "step_id": 15068, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813538.8278754, "step_id": 15069, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813538.833908, "step_id": 15070, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813538.8399324, "step_id": 15071, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813538.8458428, "step_id": 15072, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813538.8515031, "step_id": 15073, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813538.8571389, "step_id": 15074, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813538.8632383, "step_id": 15075, "start_load_kv_us": 15, "get_finished_us": 249} +{"t_unix": 1779813538.8692222, "step_id": 15076, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813538.875174, "step_id": 15077, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813538.8810601, "step_id": 15078, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813538.8871596, "step_id": 15079, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813538.892901, "step_id": 15080, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813538.8993995, "step_id": 15081, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813538.9043221, "step_id": 15082, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813538.9101567, "step_id": 15083, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813538.9167156, "step_id": 15084, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813538.9218466, "step_id": 15085, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813538.9281209, "step_id": 15086, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813538.9340813, "step_id": 15087, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813538.9386814, "step_id": 15088, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813538.9434545, "step_id": 15089, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813538.9482603, "step_id": 15090, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813538.9529927, "step_id": 15091, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813538.957762, "step_id": 15092, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813538.9625306, "step_id": 15093, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813538.967464, "step_id": 15094, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813538.972129, "step_id": 15095, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813538.9770646, "step_id": 15096, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813538.9825978, "step_id": 15097, "start_load_kv_us": 4, "get_finished_us": 276} +{"t_unix": 1779813538.986575, "step_id": 15098, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813538.9913347, "step_id": 15099, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813538.996111, "step_id": 15100, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813539.0008647, "step_id": 15101, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813539.0057967, "step_id": 15102, "start_load_kv_us": 1, "get_finished_us": 250} +{"t_unix": 1779813539.0105972, "step_id": 15103, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813539.0153923, "step_id": 15104, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813539.020112, "step_id": 15105, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813539.024933, "step_id": 15106, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813539.0296867, "step_id": 15107, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813539.034628, "step_id": 15108, "start_load_kv_us": 1, "get_finished_us": 253} +{"t_unix": 1779813539.0393786, "step_id": 15109, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813539.0441415, "step_id": 15110, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813539.048924, "step_id": 15111, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813539.0574546, "step_id": 15112, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813539.0617127, "step_id": 15113, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813539.065265, "step_id": 15114, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813539.0699801, "step_id": 15115, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813539.0747619, "step_id": 15116, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813539.0795004, "step_id": 15117, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813539.084248, "step_id": 15118, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813539.0890174, "step_id": 15119, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813539.0938268, "step_id": 15120, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.0985851, "step_id": 15121, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813539.1034632, "step_id": 15122, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813539.1081665, "step_id": 15123, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813539.1129818, "step_id": 15124, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813539.117683, "step_id": 15125, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813539.1225085, "step_id": 15126, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813539.127356, "step_id": 15127, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813539.1320808, "step_id": 15128, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813539.1376107, "step_id": 15129, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813539.1417596, "step_id": 15130, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813539.1466272, "step_id": 15131, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813539.1513255, "step_id": 15132, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813539.1560585, "step_id": 15133, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813539.1608634, "step_id": 15134, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.1656508, "step_id": 15135, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813539.1704948, "step_id": 15136, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813539.1754127, "step_id": 15137, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813539.180015, "step_id": 15138, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813539.1848743, "step_id": 15139, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813539.1895313, "step_id": 15140, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813539.194356, "step_id": 15141, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813539.1991274, "step_id": 15142, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813539.2039888, "step_id": 15143, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813539.2088113, "step_id": 15144, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813539.214286, "step_id": 15145, "start_load_kv_us": 4, "get_finished_us": 147} +{"t_unix": 1779813539.2182994, "step_id": 15146, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813539.2231174, "step_id": 15147, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813539.2279148, "step_id": 15148, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813539.2326205, "step_id": 15149, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.2374902, "step_id": 15150, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.2422426, "step_id": 15151, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813539.2471066, "step_id": 15152, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813539.25186, "step_id": 15153, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813539.2566283, "step_id": 15154, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813539.2613862, "step_id": 15155, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813539.2663069, "step_id": 15156, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813539.2710662, "step_id": 15157, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813539.2758784, "step_id": 15158, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813539.2806103, "step_id": 15159, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813539.2853692, "step_id": 15160, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813539.290819, "step_id": 15161, "start_load_kv_us": 4, "get_finished_us": 144} +{"t_unix": 1779813539.2949069, "step_id": 15162, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813539.299723, "step_id": 15163, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813539.3045409, "step_id": 15164, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813539.3092833, "step_id": 15165, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813539.31408, "step_id": 15166, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813539.318848, "step_id": 15167, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813539.3236759, "step_id": 15168, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813539.328391, "step_id": 15169, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.3331854, "step_id": 15170, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813539.3379602, "step_id": 15171, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813539.3428144, "step_id": 15172, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813539.3476384, "step_id": 15173, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813539.3522942, "step_id": 15174, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813539.3571048, "step_id": 15175, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813539.3638797, "step_id": 15176, "start_load_kv_us": 12, "get_finished_us": 813} +{"t_unix": 1779813539.3684506, "step_id": 15177, "start_load_kv_us": 4, "get_finished_us": 271} +{"t_unix": 1779813539.3719149, "step_id": 15178, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813539.3763683, "step_id": 15179, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813539.3810391, "step_id": 15180, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813539.3858116, "step_id": 15181, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813539.3906016, "step_id": 15182, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813539.3953567, "step_id": 15183, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813539.4001188, "step_id": 15184, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813539.404983, "step_id": 15185, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813539.4098418, "step_id": 15186, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813539.4145553, "step_id": 15187, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813539.4194667, "step_id": 15188, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813539.4242158, "step_id": 15189, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813539.4289746, "step_id": 15190, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813539.4337811, "step_id": 15191, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813539.4384763, "step_id": 15192, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.4439404, "step_id": 15193, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813539.4481812, "step_id": 15194, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813539.4529505, "step_id": 15195, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813539.457628, "step_id": 15196, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813539.462499, "step_id": 15197, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813539.4672842, "step_id": 15198, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813539.4720857, "step_id": 15199, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813539.476957, "step_id": 15200, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813539.4816601, "step_id": 15201, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813539.4864297, "step_id": 15202, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813539.491212, "step_id": 15203, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813539.4959838, "step_id": 15204, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813539.5008125, "step_id": 15205, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813539.505699, "step_id": 15206, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813539.5103827, "step_id": 15207, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813539.5151992, "step_id": 15208, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813539.520533, "step_id": 15209, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813539.5246933, "step_id": 15210, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813539.5294735, "step_id": 15211, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813539.5343676, "step_id": 15212, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813539.539122, "step_id": 15213, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813539.5438676, "step_id": 15214, "start_load_kv_us": 1, "get_finished_us": 211} +{"t_unix": 1779813539.5487769, "step_id": 15215, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813539.5534174, "step_id": 15216, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813539.558235, "step_id": 15217, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813539.5630112, "step_id": 15218, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813539.5673459, "step_id": 15219, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813539.571429, "step_id": 15220, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813540.0410585, "step_id": 15221, "start_load_kv_us": 138, "get_finished_us": 393} +{"t_unix": 1779813540.0538032, "step_id": 15222, "start_load_kv_us": 3, "get_finished_us": 351} +{"t_unix": 1779813540.2316558, "step_id": 15223, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813540.2358859, "step_id": 15224, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813540.2411282, "step_id": 15225, "start_load_kv_us": 4, "get_finished_us": 193} +{"t_unix": 1779813540.245997, "step_id": 15226, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813540.2884579, "step_id": 15227, "start_load_kv_us": 113, "get_finished_us": 253} +{"t_unix": 1779813540.2921324, "step_id": 15228, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813540.4904466, "step_id": 15229, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813540.4963958, "step_id": 15230, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813540.5396974, "step_id": 15231, "start_load_kv_us": 111, "get_finished_us": 333} +{"t_unix": 1779813540.7314634, "step_id": 15232, "start_load_kv_us": 136, "get_finished_us": 317} +{"t_unix": 1779813540.968014, "step_id": 15233, "start_load_kv_us": 114, "get_finished_us": 324} +{"t_unix": 1779813540.9802165, "step_id": 15234, "start_load_kv_us": 5, "get_finished_us": 218} +{"t_unix": 1779813541.2556038, "step_id": 15235, "start_load_kv_us": 110, "get_finished_us": 442} +{"t_unix": 1779813541.2594671, "step_id": 15236, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813541.4621317, "step_id": 15237, "start_load_kv_us": 4, "get_finished_us": 308} +{"t_unix": 1779813541.469512, "step_id": 15238, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813541.4782562, "step_id": 15239, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813541.4875114, "step_id": 15240, "start_load_kv_us": 4, "get_finished_us": 261} +{"t_unix": 1779813541.4962506, "step_id": 15241, "start_load_kv_us": 4, "get_finished_us": 232} +{"t_unix": 1779813541.5051022, "step_id": 15242, "start_load_kv_us": 4, "get_finished_us": 247} +{"t_unix": 1779813541.5131369, "step_id": 15243, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813541.5219986, "step_id": 15244, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813541.5306964, "step_id": 15245, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813541.539399, "step_id": 15246, "start_load_kv_us": 1, "get_finished_us": 209} +{"t_unix": 1779813541.5484812, "step_id": 15247, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813541.5574117, "step_id": 15248, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813541.5663764, "step_id": 15249, "start_load_kv_us": 1, "get_finished_us": 261} +{"t_unix": 1779813541.5758295, "step_id": 15250, "start_load_kv_us": 15, "get_finished_us": 230} +{"t_unix": 1779813541.583969, "step_id": 15251, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813541.5927784, "step_id": 15252, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813541.6020167, "step_id": 15253, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813541.610138, "step_id": 15254, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813541.618975, "step_id": 15255, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813541.6290932, "step_id": 15256, "start_load_kv_us": 4, "get_finished_us": 186} +{"t_unix": 1779813541.6369333, "step_id": 15257, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813541.646031, "step_id": 15258, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813541.654147, "step_id": 15259, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813541.6632218, "step_id": 15260, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813541.7101023, "step_id": 15261, "start_load_kv_us": 112, "get_finished_us": 279} +{"t_unix": 1779813541.7144122, "step_id": 15262, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813541.9558759, "step_id": 15263, "start_load_kv_us": 117, "get_finished_us": 327} +{"t_unix": 1779813542.1536913, "step_id": 15264, "start_load_kv_us": 123, "get_finished_us": 341} +{"t_unix": 1779813542.165174, "step_id": 15265, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813542.4032695, "step_id": 15266, "start_load_kv_us": 6, "get_finished_us": 298} +{"t_unix": 1779813542.4134128, "step_id": 15267, "start_load_kv_us": 4, "get_finished_us": 225} +{"t_unix": 1779813542.4233136, "step_id": 15268, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813542.4346015, "step_id": 15269, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813542.4446874, "step_id": 15270, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813542.4553998, "step_id": 15271, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813542.4669607, "step_id": 15272, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813542.47829, "step_id": 15273, "start_load_kv_us": 4, "get_finished_us": 152} +{"t_unix": 1779813542.4889848, "step_id": 15274, "start_load_kv_us": 4, "get_finished_us": 155} +{"t_unix": 1779813542.5003307, "step_id": 15275, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813542.5110452, "step_id": 15276, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813542.5223234, "step_id": 15277, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813542.5343819, "step_id": 15278, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813542.5451837, "step_id": 15279, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813542.5562284, "step_id": 15280, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813542.5668814, "step_id": 15281, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813542.5786011, "step_id": 15282, "start_load_kv_us": 6, "get_finished_us": 196} +{"t_unix": 1779813542.5896208, "step_id": 15283, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813542.5997336, "step_id": 15284, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813542.6114542, "step_id": 15285, "start_load_kv_us": 5, "get_finished_us": 166} +{"t_unix": 1779813542.6220355, "step_id": 15286, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813542.6330783, "step_id": 15287, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813542.6447313, "step_id": 15288, "start_load_kv_us": 5, "get_finished_us": 150} +{"t_unix": 1779813542.6556826, "step_id": 15289, "start_load_kv_us": 4, "get_finished_us": 251} +{"t_unix": 1779813542.6669002, "step_id": 15290, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813542.6780457, "step_id": 15291, "start_load_kv_us": 4, "get_finished_us": 219} +{"t_unix": 1779813542.6883144, "step_id": 15292, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813542.6993132, "step_id": 15293, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813542.7108574, "step_id": 15294, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813542.7205422, "step_id": 15295, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813542.731643, "step_id": 15296, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813542.7429829, "step_id": 15297, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813542.7546606, "step_id": 15298, "start_load_kv_us": 5, "get_finished_us": 158} +{"t_unix": 1779813542.7654266, "step_id": 15299, "start_load_kv_us": 4, "get_finished_us": 162} +{"t_unix": 1779813542.7761555, "step_id": 15300, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813542.7880886, "step_id": 15301, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813542.7986314, "step_id": 15302, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813542.8100877, "step_id": 15303, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813542.8217447, "step_id": 15304, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813542.8323014, "step_id": 15305, "start_load_kv_us": 4, "get_finished_us": 179} +{"t_unix": 1779813542.8437734, "step_id": 15306, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813542.8553262, "step_id": 15307, "start_load_kv_us": 5, "get_finished_us": 264} +{"t_unix": 1779813542.8663685, "step_id": 15308, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813542.8780065, "step_id": 15309, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813542.89025, "step_id": 15310, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813542.901129, "step_id": 15311, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813542.9128497, "step_id": 15312, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813542.9245167, "step_id": 15313, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813542.936677, "step_id": 15314, "start_load_kv_us": 5, "get_finished_us": 268} +{"t_unix": 1779813542.9480503, "step_id": 15315, "start_load_kv_us": 4, "get_finished_us": 299} +{"t_unix": 1779813542.9590132, "step_id": 15316, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813542.9708476, "step_id": 15317, "start_load_kv_us": 4, "get_finished_us": 188} +{"t_unix": 1779813542.9817595, "step_id": 15318, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813542.9928482, "step_id": 15319, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813543.004523, "step_id": 15320, "start_load_kv_us": 4, "get_finished_us": 202} +{"t_unix": 1779813543.0154865, "step_id": 15321, "start_load_kv_us": 4, "get_finished_us": 214} +{"t_unix": 1779813543.026605, "step_id": 15322, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813543.0383995, "step_id": 15323, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813543.0492601, "step_id": 15324, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813543.0609014, "step_id": 15325, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813543.0732255, "step_id": 15326, "start_load_kv_us": 4, "get_finished_us": 245} +{"t_unix": 1779813543.0843687, "step_id": 15327, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813543.0959659, "step_id": 15328, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813543.1079202, "step_id": 15329, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813543.1203644, "step_id": 15330, "start_load_kv_us": 5, "get_finished_us": 217} +{"t_unix": 1779813543.1323547, "step_id": 15331, "start_load_kv_us": 5, "get_finished_us": 206} +{"t_unix": 1779813543.143391, "step_id": 15332, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813543.1558964, "step_id": 15333, "start_load_kv_us": 4, "get_finished_us": 194} +{"t_unix": 1779813543.1668582, "step_id": 15334, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813543.1780088, "step_id": 15335, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813543.1898987, "step_id": 15336, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813543.2012672, "step_id": 15337, "start_load_kv_us": 4, "get_finished_us": 220} +{"t_unix": 1779813543.2127216, "step_id": 15338, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813543.224079, "step_id": 15339, "start_load_kv_us": 4, "get_finished_us": 299} +{"t_unix": 1779813543.2350223, "step_id": 15340, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813543.246306, "step_id": 15341, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813543.2585025, "step_id": 15342, "start_load_kv_us": 4, "get_finished_us": 205} +{"t_unix": 1779813543.2693963, "step_id": 15343, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813543.2807784, "step_id": 15344, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813543.2921495, "step_id": 15345, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813543.3039293, "step_id": 15346, "start_load_kv_us": 5, "get_finished_us": 193} +{"t_unix": 1779813543.3153617, "step_id": 15347, "start_load_kv_us": 5, "get_finished_us": 197} +{"t_unix": 1779813543.3264716, "step_id": 15348, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813543.3383703, "step_id": 15349, "start_load_kv_us": 4, "get_finished_us": 172} +{"t_unix": 1779813543.3493664, "step_id": 15350, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813543.361196, "step_id": 15351, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813543.373697, "step_id": 15352, "start_load_kv_us": 4, "get_finished_us": 184} +{"t_unix": 1779813543.3858156, "step_id": 15353, "start_load_kv_us": 4, "get_finished_us": 216} +{"t_unix": 1779813543.397782, "step_id": 15354, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813543.409834, "step_id": 15355, "start_load_kv_us": 5, "get_finished_us": 200} +{"t_unix": 1779813543.4212494, "step_id": 15356, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813543.4332464, "step_id": 15357, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813543.445674, "step_id": 15358, "start_load_kv_us": 18, "get_finished_us": 188} +{"t_unix": 1779813543.4563284, "step_id": 15359, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813543.4679265, "step_id": 15360, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813543.4795706, "step_id": 15361, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813543.4919388, "step_id": 15362, "start_load_kv_us": 6, "get_finished_us": 162} +{"t_unix": 1779813543.5034683, "step_id": 15363, "start_load_kv_us": 4, "get_finished_us": 170} +{"t_unix": 1779813543.5144603, "step_id": 15364, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813543.5267787, "step_id": 15365, "start_load_kv_us": 4, "get_finished_us": 199} +{"t_unix": 1779813543.5377662, "step_id": 15366, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813543.5495706, "step_id": 15367, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813543.5620365, "step_id": 15368, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813543.5731983, "step_id": 15369, "start_load_kv_us": 5, "get_finished_us": 176} +{"t_unix": 1779813543.5858958, "step_id": 15370, "start_load_kv_us": 5, "get_finished_us": 187} +{"t_unix": 1779813543.5975795, "step_id": 15371, "start_load_kv_us": 4, "get_finished_us": 272} +{"t_unix": 1779813543.6089385, "step_id": 15372, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813543.6210365, "step_id": 15373, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813543.6342213, "step_id": 15374, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813543.645057, "step_id": 15375, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813543.6572044, "step_id": 15376, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813543.6691077, "step_id": 15377, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813543.6813972, "step_id": 15378, "start_load_kv_us": 4, "get_finished_us": 178} +{"t_unix": 1779813543.6936247, "step_id": 15379, "start_load_kv_us": 4, "get_finished_us": 241} +{"t_unix": 1779813543.7048678, "step_id": 15380, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813543.717461, "step_id": 15381, "start_load_kv_us": 4, "get_finished_us": 237} +{"t_unix": 1779813543.7284703, "step_id": 15382, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813543.740407, "step_id": 15383, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813543.752985, "step_id": 15384, "start_load_kv_us": 4, "get_finished_us": 195} +{"t_unix": 1779813543.7652175, "step_id": 15385, "start_load_kv_us": 4, "get_finished_us": 212} +{"t_unix": 1779813543.7772455, "step_id": 15386, "start_load_kv_us": 4, "get_finished_us": 261} +{"t_unix": 1779813543.7890267, "step_id": 15387, "start_load_kv_us": 4, "get_finished_us": 243} +{"t_unix": 1779813543.8005598, "step_id": 15388, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813543.8126905, "step_id": 15389, "start_load_kv_us": 15, "get_finished_us": 206} +{"t_unix": 1779813543.824853, "step_id": 15390, "start_load_kv_us": 6, "get_finished_us": 265} +{"t_unix": 1779813543.835711, "step_id": 15391, "start_load_kv_us": 1, "get_finished_us": 233} +{"t_unix": 1779813543.847373, "step_id": 15392, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813543.8592544, "step_id": 15393, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813543.8717508, "step_id": 15394, "start_load_kv_us": 5, "get_finished_us": 184} +{"t_unix": 1779813543.8832788, "step_id": 15395, "start_load_kv_us": 5, "get_finished_us": 217} +{"t_unix": 1779813543.8942976, "step_id": 15396, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813543.9066925, "step_id": 15397, "start_load_kv_us": 4, "get_finished_us": 279} +{"t_unix": 1779813543.9179044, "step_id": 15398, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813543.9297738, "step_id": 15399, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813543.942373, "step_id": 15400, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813543.954043, "step_id": 15401, "start_load_kv_us": 4, "get_finished_us": 174} +{"t_unix": 1779813543.9659271, "step_id": 15402, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813543.9775374, "step_id": 15403, "start_load_kv_us": 4, "get_finished_us": 157} +{"t_unix": 1779813543.9886897, "step_id": 15404, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813544.0002635, "step_id": 15405, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813544.0123165, "step_id": 15406, "start_load_kv_us": 4, "get_finished_us": 175} +{"t_unix": 1779813544.0232332, "step_id": 15407, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813544.0346673, "step_id": 15408, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813544.046315, "step_id": 15409, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813544.0585027, "step_id": 15410, "start_load_kv_us": 6, "get_finished_us": 234} +{"t_unix": 1779813544.0697587, "step_id": 15411, "start_load_kv_us": 5, "get_finished_us": 223} +{"t_unix": 1779813544.080566, "step_id": 15412, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813544.092393, "step_id": 15413, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813544.102491, "step_id": 15414, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813544.1132913, "step_id": 15415, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813544.1249075, "step_id": 15416, "start_load_kv_us": 4, "get_finished_us": 262} +{"t_unix": 1779813544.1360207, "step_id": 15417, "start_load_kv_us": 4, "get_finished_us": 233} +{"t_unix": 1779813544.147345, "step_id": 15418, "start_load_kv_us": 4, "get_finished_us": 223} +{"t_unix": 1779813544.1584024, "step_id": 15419, "start_load_kv_us": 5, "get_finished_us": 211} +{"t_unix": 1779813544.1688385, "step_id": 15420, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813544.1795745, "step_id": 15421, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813544.191075, "step_id": 15422, "start_load_kv_us": 4, "get_finished_us": 190} +{"t_unix": 1779813544.2015672, "step_id": 15423, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813544.2123778, "step_id": 15424, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813544.2237928, "step_id": 15425, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813544.2360115, "step_id": 15426, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813544.247337, "step_id": 15427, "start_load_kv_us": 4, "get_finished_us": 203} +{"t_unix": 1779813544.2584295, "step_id": 15428, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813544.2697506, "step_id": 15429, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813544.2801902, "step_id": 15430, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813544.293591, "step_id": 15431, "start_load_kv_us": 1, "get_finished_us": 244} +{"t_unix": 1779813544.3044105, "step_id": 15432, "start_load_kv_us": 4, "get_finished_us": 227} +{"t_unix": 1779813544.3161829, "step_id": 15433, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813544.3275096, "step_id": 15434, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813544.3392534, "step_id": 15435, "start_load_kv_us": 4, "get_finished_us": 204} +{"t_unix": 1779813544.3505137, "step_id": 15436, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813544.3626761, "step_id": 15437, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813544.3751376, "step_id": 15438, "start_load_kv_us": 5, "get_finished_us": 241} +{"t_unix": 1779813544.3865635, "step_id": 15439, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813544.3982835, "step_id": 15440, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813544.4101894, "step_id": 15441, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813544.4223993, "step_id": 15442, "start_load_kv_us": 5, "get_finished_us": 154} +{"t_unix": 1779813544.4339921, "step_id": 15443, "start_load_kv_us": 4, "get_finished_us": 166} +{"t_unix": 1779813544.4449887, "step_id": 15444, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813544.4571373, "step_id": 15445, "start_load_kv_us": 4, "get_finished_us": 148} +{"t_unix": 1779813544.4688187, "step_id": 15446, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813544.4804041, "step_id": 15447, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813544.4927466, "step_id": 15448, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813544.5047812, "step_id": 15449, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813544.5167317, "step_id": 15450, "start_load_kv_us": 18, "get_finished_us": 243} +{"t_unix": 1779813544.5285952, "step_id": 15451, "start_load_kv_us": 4, "get_finished_us": 201} +{"t_unix": 1779813544.5397515, "step_id": 15452, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813544.5514975, "step_id": 15453, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813544.5636907, "step_id": 15454, "start_load_kv_us": 5, "get_finished_us": 202} +{"t_unix": 1779813544.5746808, "step_id": 15455, "start_load_kv_us": 16, "get_finished_us": 199} +{"t_unix": 1779813544.5861979, "step_id": 15456, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813544.5977252, "step_id": 15457, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813544.609736, "step_id": 15458, "start_load_kv_us": 5, "get_finished_us": 209} +{"t_unix": 1779813544.6214266, "step_id": 15459, "start_load_kv_us": 4, "get_finished_us": 168} +{"t_unix": 1779813544.632196, "step_id": 15460, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813544.6443284, "step_id": 15461, "start_load_kv_us": 3, "get_finished_us": 148} +{"t_unix": 1779813544.6553135, "step_id": 15462, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813544.666661, "step_id": 15463, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813544.6777625, "step_id": 15464, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813544.6885138, "step_id": 15465, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813544.700329, "step_id": 15466, "start_load_kv_us": 5, "get_finished_us": 302} +{"t_unix": 1779813544.7122061, "step_id": 15467, "start_load_kv_us": 22, "get_finished_us": 199} +{"t_unix": 1779813544.720895, "step_id": 15468, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813544.7319343, "step_id": 15469, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813544.744075, "step_id": 15470, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813544.7550821, "step_id": 15471, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813544.7664003, "step_id": 15472, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813544.7773, "step_id": 15473, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813544.789417, "step_id": 15474, "start_load_kv_us": 5, "get_finished_us": 149} +{"t_unix": 1779813544.800825, "step_id": 15475, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813544.8117714, "step_id": 15476, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813544.8240473, "step_id": 15477, "start_load_kv_us": 4, "get_finished_us": 171} +{"t_unix": 1779813544.8341985, "step_id": 15478, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813544.844494, "step_id": 15479, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813544.8556738, "step_id": 15480, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813544.8656166, "step_id": 15481, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813544.876846, "step_id": 15482, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813544.8879716, "step_id": 15483, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813544.8980708, "step_id": 15484, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813544.909531, "step_id": 15485, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813544.9219797, "step_id": 15486, "start_load_kv_us": 4, "get_finished_us": 177} +{"t_unix": 1779813544.9334826, "step_id": 15487, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813544.9447758, "step_id": 15488, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813544.9537828, "step_id": 15489, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813544.9631553, "step_id": 15490, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813544.9723134, "step_id": 15491, "start_load_kv_us": 4, "get_finished_us": 140} +{"t_unix": 1779813544.9797983, "step_id": 15492, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813544.9869092, "step_id": 15493, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813544.9937918, "step_id": 15494, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813545.001166, "step_id": 15495, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813545.0087717, "step_id": 15496, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813545.0156581, "step_id": 15497, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813545.022629, "step_id": 15498, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813545.0302827, "step_id": 15499, "start_load_kv_us": 4, "get_finished_us": 198} +{"t_unix": 1779813545.0367973, "step_id": 15500, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813545.0440795, "step_id": 15501, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813545.051798, "step_id": 15502, "start_load_kv_us": 4, "get_finished_us": 181} +{"t_unix": 1779813545.0584147, "step_id": 15503, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813545.0653572, "step_id": 15504, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813545.0719657, "step_id": 15505, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813545.0789657, "step_id": 15506, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813545.0866404, "step_id": 15507, "start_load_kv_us": 4, "get_finished_us": 173} +{"t_unix": 1779813545.0934708, "step_id": 15508, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813545.100773, "step_id": 15509, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813545.1083758, "step_id": 15510, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813545.1154659, "step_id": 15511, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813545.122914, "step_id": 15512, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813545.1303723, "step_id": 15513, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813545.1379395, "step_id": 15514, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813545.1455054, "step_id": 15515, "start_load_kv_us": 4, "get_finished_us": 154} +{"t_unix": 1779813545.1518953, "step_id": 15516, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813545.1592333, "step_id": 15517, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813545.1664484, "step_id": 15518, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813545.1722074, "step_id": 15519, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813545.1776414, "step_id": 15520, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813545.1816523, "step_id": 15521, "start_load_kv_us": 2, "get_finished_us": 175} diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/metrics_final.txt b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/metrics_final.txt new file mode 100644 index 0000000..7c99163 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/metrics_final.txt @@ -0,0 +1,624 @@ +# HELP python_gc_objects_collected_total Objects collected during gc +# TYPE python_gc_objects_collected_total counter +python_gc_objects_collected_total{generation="0"} 11970.0 +python_gc_objects_collected_total{generation="1"} 1549.0 +python_gc_objects_collected_total{generation="2"} 855.0 +# HELP python_gc_objects_uncollectable_total Uncollectable objects found during GC +# TYPE python_gc_objects_uncollectable_total counter +python_gc_objects_uncollectable_total{generation="0"} 0.0 +python_gc_objects_uncollectable_total{generation="1"} 0.0 +python_gc_objects_uncollectable_total{generation="2"} 0.0 +# HELP python_gc_collections_total Number of times this generation was collected +# TYPE python_gc_collections_total counter +python_gc_collections_total{generation="0"} 1349.0 +python_gc_collections_total{generation="1"} 123.0 +python_gc_collections_total{generation="2"} 9.0 +# HELP python_info Python platform information +# TYPE python_info gauge +python_info{implementation="CPython",major="3",minor="12",patchlevel="3",version="3.12.3"} 1.0 +# HELP process_virtual_memory_bytes Virtual memory size in bytes. +# TYPE process_virtual_memory_bytes gauge +process_virtual_memory_bytes 4.099221504e+010 +# HELP process_resident_memory_bytes Resident memory size in bytes. +# TYPE process_resident_memory_bytes gauge +process_resident_memory_bytes 1.380847616e+09 +# HELP process_start_time_seconds Start time of the process since unix epoch in seconds. +# TYPE process_start_time_seconds gauge +process_start_time_seconds 1.77981354873e+09 +# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. +# TYPE process_cpu_seconds_total counter +process_cpu_seconds_total 41.89 +# HELP process_open_fds Number of open file descriptors. +# TYPE process_open_fds gauge +process_open_fds 67.0 +# HELP process_max_fds Maximum number of open file descriptors. +# TYPE process_max_fds gauge +process_max_fds 1.048575e+06 +# HELP vllm:estimated_flops_per_gpu_total Estimated number of floating point operations per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_flops_per_gpu_total counter +vllm:estimated_flops_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_flops_per_gpu_created Estimated number of floating point operations per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_flops_per_gpu_created gauge +vllm:estimated_flops_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516264124e+09 +# HELP vllm:estimated_read_bytes_per_gpu_total Estimated number of bytes read from memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_read_bytes_per_gpu_total counter +vllm:estimated_read_bytes_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_read_bytes_per_gpu_created Estimated number of bytes read from memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_read_bytes_per_gpu_created gauge +vllm:estimated_read_bytes_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516264498e+09 +# HELP vllm:estimated_write_bytes_per_gpu_total Estimated number of bytes written to memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_write_bytes_per_gpu_total counter +vllm:estimated_write_bytes_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_write_bytes_per_gpu_created Estimated number of bytes written to memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_write_bytes_per_gpu_created gauge +vllm:estimated_write_bytes_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.77981365162647e+09 +# HELP vllm:num_requests_running Number of requests in model execution batches. +# TYPE vllm:num_requests_running gauge +vllm:num_requests_running{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:num_requests_waiting Number of requests waiting to be processed. +# TYPE vllm:num_requests_waiting gauge +vllm:num_requests_waiting{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:engine_sleep_state Engine sleep state; awake = 0 means engine is sleeping; awake = 1 means engine is awake; weights_offloaded = 1 means sleep level 1; discard_all = 1 means sleep level 2. +# TYPE vllm:engine_sleep_state gauge +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="awake"} 1.0 +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="weights_offloaded"} 0.0 +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="discard_all"} 0.0 +# HELP vllm:kv_cache_usage_perc KV-cache usage. 1 means 100 percent usage. +# TYPE vllm:kv_cache_usage_perc gauge +vllm:kv_cache_usage_perc{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prefix_cache_queries_total Prefix cache queries, in terms of number of queried tokens. +# TYPE vllm:prefix_cache_queries_total counter +vllm:prefix_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:prefix_cache_queries_created Prefix cache queries, in terms of number of queried tokens. +# TYPE vllm:prefix_cache_queries_created gauge +vllm:prefix_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516266289e+09 +# HELP vllm:prefix_cache_hits_total Prefix cache hits, in terms of number of cached tokens. +# TYPE vllm:prefix_cache_hits_total counter +vllm:prefix_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prefix_cache_hits_created Prefix cache hits, in terms of number of cached tokens. +# TYPE vllm:prefix_cache_hits_created gauge +vllm:prefix_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516266432e+09 +# HELP vllm:external_prefix_cache_queries_total External prefix cache queries from KV connector cross-instance cache sharing, in terms of number of queried tokens. +# TYPE vllm:external_prefix_cache_queries_total counter +vllm:external_prefix_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:external_prefix_cache_queries_created External prefix cache queries from KV connector cross-instance cache sharing, in terms of number of queried tokens. +# TYPE vllm:external_prefix_cache_queries_created gauge +vllm:external_prefix_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516266596e+09 +# HELP vllm:external_prefix_cache_hits_total External prefix cache hits from KV connector cross-instance cache sharing, in terms of number of cached tokens. +# TYPE vllm:external_prefix_cache_hits_total counter +vllm:external_prefix_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:external_prefix_cache_hits_created External prefix cache hits from KV connector cross-instance cache sharing, in terms of number of cached tokens. +# TYPE vllm:external_prefix_cache_hits_created gauge +vllm:external_prefix_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516266723e+09 +# HELP vllm:mm_cache_queries_total Multi-modal cache queries, in terms of number of queried items. +# TYPE vllm:mm_cache_queries_total counter +vllm:mm_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:mm_cache_queries_created Multi-modal cache queries, in terms of number of queried items. +# TYPE vllm:mm_cache_queries_created gauge +vllm:mm_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516266844e+09 +# HELP vllm:mm_cache_hits_total Multi-modal cache hits, in terms of number of cached items. +# TYPE vllm:mm_cache_hits_total counter +vllm:mm_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:mm_cache_hits_created Multi-modal cache hits, in terms of number of cached items. +# TYPE vllm:mm_cache_hits_created gauge +vllm:mm_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516266956e+09 +# HELP vllm:num_preemptions_total Cumulative number of preemption from the engine. +# TYPE vllm:num_preemptions_total counter +vllm:num_preemptions_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:num_preemptions_created Cumulative number of preemption from the engine. +# TYPE vllm:num_preemptions_created gauge +vllm:num_preemptions_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516267076e+09 +# HELP vllm:prompt_tokens_total Number of prefill tokens processed. +# TYPE vllm:prompt_tokens_total counter +vllm:prompt_tokens_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:prompt_tokens_created Number of prefill tokens processed. +# TYPE vllm:prompt_tokens_created gauge +vllm:prompt_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651626718e+09 +# HELP vllm:prompt_tokens_by_source_total Number of prompt tokens by source. +# TYPE vllm:prompt_tokens_by_source_total counter +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_compute"} 1.563446e+06 +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_cache_hit"} 0.0 +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="external_kv_transfer"} 0.0 +# HELP vllm:prompt_tokens_by_source_created Number of prompt tokens by source. +# TYPE vllm:prompt_tokens_by_source_created gauge +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_compute"} 1.7798136516267326e+09 +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_cache_hit"} 1.7798136516267376e+09 +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="external_kv_transfer"} 1.7798136516267424e+09 +# HELP vllm:prompt_tokens_cached_total Number of cached prompt tokens (local + external). +# TYPE vllm:prompt_tokens_cached_total counter +vllm:prompt_tokens_cached_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prompt_tokens_cached_created Number of cached prompt tokens (local + external). +# TYPE vllm:prompt_tokens_cached_created gauge +vllm:prompt_tokens_cached_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651626754e+09 +# HELP vllm:prompt_tokens_recomputed_total Number of cached tokens recomputed for forward pass. +# TYPE vllm:prompt_tokens_recomputed_total counter +vllm:prompt_tokens_recomputed_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prompt_tokens_recomputed_created Number of cached tokens recomputed for forward pass. +# TYPE vllm:prompt_tokens_recomputed_created gauge +vllm:prompt_tokens_recomputed_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651626765e+09 +# HELP vllm:generation_tokens_total Number of generation tokens processed. +# TYPE vllm:generation_tokens_total counter +vllm:generation_tokens_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:generation_tokens_created Number of generation tokens processed. +# TYPE vllm:generation_tokens_created gauge +vllm:generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516267776e+09 +# HELP vllm:request_success_total Count of successfully processed requests. +# TYPE vllm:request_success_total counter +vllm:request_success_total{engine="0",finished_reason="stop",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="length",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_success_total{engine="0",finished_reason="abort",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="error",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="repetition",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:request_success_created Count of successfully processed requests. +# TYPE vllm:request_success_created gauge +vllm:request_success_created{engine="0",finished_reason="stop",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516268065e+09 +vllm:request_success_created{engine="0",finished_reason="length",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516268144e+09 +vllm:request_success_created{engine="0",finished_reason="abort",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516268213e+09 +vllm:request_success_created{engine="0",finished_reason="error",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516268265e+09 +vllm:request_success_created{engine="0",finished_reason="repetition",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516268313e+09 +# HELP vllm:request_prompt_tokens Number of prefill tokens processed. +# TYPE vllm:request_prompt_tokens histogram +vllm:request_prompt_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:request_prompt_tokens_created Number of prefill tokens processed. +# TYPE vllm:request_prompt_tokens_created gauge +vllm:request_prompt_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651626876e+09 +# HELP vllm:request_generation_tokens Number of generation tokens processed. +# TYPE vllm:request_generation_tokens histogram +vllm:request_generation_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_generation_tokens_created Number of generation tokens processed. +# TYPE vllm:request_generation_tokens_created gauge +vllm:request_generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516269345e+09 +# HELP vllm:iteration_tokens_total Histogram of number of tokens per engine_step. +# TYPE vllm:iteration_tokens_total histogram +vllm:iteration_tokens_total_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3027.0 +vllm:iteration_tokens_total_bucket{engine="0",le="8.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 10335.0 +vllm:iteration_tokens_total_bucket{engine="0",le="16.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 14359.0 +vllm:iteration_tokens_total_bucket{engine="0",le="32.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="64.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="128.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="256.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="512.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="1024.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="2048.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15043.0 +vllm:iteration_tokens_total_bucket{engine="0",le="4096.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15389.0 +vllm:iteration_tokens_total_bucket{engine="0",le="8192.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15412.0 +vllm:iteration_tokens_total_bucket{engine="0",le="16384.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15412.0 +vllm:iteration_tokens_total_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15412.0 +vllm:iteration_tokens_total_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15412.0 +vllm:iteration_tokens_total_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.663798e+06 +# HELP vllm:iteration_tokens_total_created Histogram of number of tokens per engine_step. +# TYPE vllm:iteration_tokens_total_created gauge +vllm:iteration_tokens_total_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516270025e+09 +# HELP vllm:request_max_num_generation_tokens Histogram of maximum number of requested generation tokens. +# TYPE vllm:request_max_num_generation_tokens histogram +vllm:request_max_num_generation_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_max_num_generation_tokens_created Histogram of maximum number of requested generation tokens. +# TYPE vllm:request_max_num_generation_tokens_created gauge +vllm:request_max_num_generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516270401e+09 +# HELP vllm:request_params_n Histogram of the n request parameter. +# TYPE vllm:request_params_n histogram +vllm:request_params_n_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +# HELP vllm:request_params_n_created Histogram of the n request parameter. +# TYPE vllm:request_params_n_created gauge +vllm:request_params_n_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651627073e+09 +# HELP vllm:request_params_max_tokens Histogram of the max_tokens request parameter. +# TYPE vllm:request_params_max_tokens histogram +vllm:request_params_max_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_params_max_tokens_created Histogram of the max_tokens request parameter. +# TYPE vllm:request_params_max_tokens_created gauge +vllm:request_params_max_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651627101e+09 +# HELP vllm:time_to_first_token_seconds Histogram of time to first token in seconds. +# TYPE vllm:time_to_first_token_seconds histogram +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.001",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.005",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.02",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.04",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.06",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.08",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.25",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 13.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 335.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 385.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 391.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="160.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="640.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="2560.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 139.64915657043457 +# HELP vllm:time_to_first_token_seconds_created Histogram of time to first token in seconds. +# TYPE vllm:time_to_first_token_seconds_created gauge +vllm:time_to_first_token_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516271358e+09 +# HELP vllm:inter_token_latency_seconds Histogram of inter-token latency in seconds. +# TYPE vllm:inter_token_latency_seconds histogram +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 23661.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.025",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 93949.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.05",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96702.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.075",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96748.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96748.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.15",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96748.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.2",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96904.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99760.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.4",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99760.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2037.7261010148213 +# HELP vllm:inter_token_latency_seconds_created Histogram of inter-token latency in seconds. +# TYPE vllm:inter_token_latency_seconds_created gauge +vllm:inter_token_latency_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516271784e+09 +# HELP vllm:request_time_per_output_token_seconds Histogram of time_per_output_token_seconds per request. +# TYPE vllm:request_time_per_output_token_seconds histogram +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 32.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.025",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 277.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.05",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.075",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.15",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.2",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.4",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 7.991082749077725 +# HELP vllm:request_time_per_output_token_seconds_created Histogram of time_per_output_token_seconds per request. +# TYPE vllm:request_time_per_output_token_seconds_created gauge +vllm:request_time_per_output_token_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516272125e+09 +# HELP vllm:e2e_request_latency_seconds Histogram of e2e request latency in seconds. +# TYPE vllm:e2e_request_latency_seconds histogram +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 11.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 17.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 165.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2177.253833055496 +# HELP vllm:e2e_request_latency_seconds_created Histogram of e2e request latency in seconds. +# TYPE vllm:e2e_request_latency_seconds_created gauge +vllm:e2e_request_latency_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779813651627295e+09 +# HELP vllm:request_queue_time_seconds Histogram of time spent in WAITING phase for request. +# TYPE vllm:request_queue_time_seconds histogram +vllm:request_queue_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0029381027561612427 +# HELP vllm:request_queue_time_seconds_created Histogram of time spent in WAITING phase for request. +# TYPE vllm:request_queue_time_seconds_created gauge +vllm:request_queue_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516273322e+09 +# HELP vllm:request_inference_time_seconds Histogram of time spent in RUNNING phase for request. +# TYPE vllm:request_inference_time_seconds histogram +vllm:request_inference_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 12.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 18.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 168.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2156.0547709063394 +# HELP vllm:request_inference_time_seconds_created Histogram of time spent in RUNNING phase for request. +# TYPE vllm:request_inference_time_seconds_created gauge +vllm:request_inference_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516273665e+09 +# HELP vllm:request_prefill_time_seconds Histogram of time spent in PREFILL phase for request. +# TYPE vllm:request_prefill_time_seconds histogram +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 305.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 379.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 118.32866989151808 +# HELP vllm:request_prefill_time_seconds_created Histogram of time spent in PREFILL phase for request. +# TYPE vllm:request_prefill_time_seconds_created gauge +vllm:request_prefill_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516274056e+09 +# HELP vllm:request_decode_time_seconds Histogram of time spent in DECODE phase for request. +# TYPE vllm:request_decode_time_seconds histogram +vllm:request_decode_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 6.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 14.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 31.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 189.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2037.7261010148213 +# HELP vllm:request_decode_time_seconds_created Histogram of time spent in DECODE phase for request. +# TYPE vllm:request_decode_time_seconds_created gauge +vllm:request_decode_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516274517e+09 +# HELP vllm:request_prefill_kv_computed_tokens Histogram of new KV tokens computed during prefill (excluding cached tokens). +# TYPE vllm:request_prefill_kv_computed_tokens histogram +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:request_prefill_kv_computed_tokens_created Histogram of new KV tokens computed during prefill (excluding cached tokens). +# TYPE vllm:request_prefill_kv_computed_tokens_created gauge +vllm:request_prefill_kv_computed_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798136516274922e+09 +# HELP vllm:cache_config_info Information of the LLMEngine CacheConfig +# TYPE vllm:cache_config_info gauge +vllm:cache_config_info{_block_size_resolved="True",block_size="16",cache_dtype="auto",calculate_kv_scales="False",cpu_kvcache_space_bytes="None",enable_prefix_caching="True",engine="0",gpu_memory_utilization="0.9",is_attention_free="False",kv_cache_memory_bytes="None",kv_offloading_backend="native",kv_offloading_size="None",kv_sharing_fast_prefill="False",mamba_block_size="None",mamba_cache_dtype="auto",mamba_cache_mode="none",mamba_page_size_padded="None",mamba_ssm_cache_dtype="auto",num_cpu_blocks="None",num_gpu_blocks="17590",num_gpu_blocks_override="None",prefix_caching_hash_algo="sha256",sliding_window="None",user_specified_block_size="False"} 1.0 +# HELP http_requests_total Total number of requests by method, status and handler. +# TYPE http_requests_total counter +http_requests_total{handler="/v1/models",method="GET",status="2xx"} 1.0 +http_requests_total{handler="/v1/chat/completions",method="POST",status="2xx"} 392.0 +# HELP http_requests_created Total number of requests by method, status and handler. +# TYPE http_requests_created gauge +http_requests_created{handler="/v1/models",method="GET",status="2xx"} 1.7798136534283202e+09 +http_requests_created{handler="/v1/chat/completions",method="POST",status="2xx"} 1.7798136621262043e+09 +# HELP http_request_size_bytes Content length of incoming requests by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_request_size_bytes summary +http_request_size_bytes_count{handler="/v1/models"} 1.0 +http_request_size_bytes_sum{handler="/v1/models"} 0.0 +http_request_size_bytes_count{handler="/v1/chat/completions"} 392.0 +http_request_size_bytes_sum{handler="/v1/chat/completions"} 2.067408e+06 +# HELP http_request_size_bytes_created Content length of incoming requests by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_request_size_bytes_created gauge +http_request_size_bytes_created{handler="/v1/models"} 1.779813653428346e+09 +http_request_size_bytes_created{handler="/v1/chat/completions"} 1.7798136621262243e+09 +# HELP http_response_size_bytes Content length of outgoing responses by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_response_size_bytes summary +http_response_size_bytes_count{handler="/v1/models"} 1.0 +http_response_size_bytes_sum{handler="/v1/models"} 558.0 +http_response_size_bytes_count{handler="/v1/chat/completions"} 392.0 +http_response_size_bytes_sum{handler="/v1/chat/completions"} 0.0 +# HELP http_response_size_bytes_created Content length of outgoing responses by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_response_size_bytes_created gauge +http_response_size_bytes_created{handler="/v1/models"} 1.7798136534283705e+09 +http_response_size_bytes_created{handler="/v1/chat/completions"} 1.7798136621262496e+09 +# HELP http_request_duration_highr_seconds Latency with many buckets but no API specific labels. Made for more accurate percentile calculations. +# TYPE http_request_duration_highr_seconds histogram +http_request_duration_highr_seconds_bucket{le="0.01"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.025"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.05"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.075"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.1"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.25"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.5"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.75"} 1.0 +http_request_duration_highr_seconds_bucket{le="1.0"} 1.0 +http_request_duration_highr_seconds_bucket{le="1.5"} 3.0 +http_request_duration_highr_seconds_bucket{le="2.0"} 12.0 +http_request_duration_highr_seconds_bucket{le="2.5"} 18.0 +http_request_duration_highr_seconds_bucket{le="3.0"} 38.0 +http_request_duration_highr_seconds_bucket{le="3.5"} 59.0 +http_request_duration_highr_seconds_bucket{le="4.0"} 92.0 +http_request_duration_highr_seconds_bucket{le="4.5"} 134.0 +http_request_duration_highr_seconds_bucket{le="5.0"} 166.0 +http_request_duration_highr_seconds_bucket{le="7.5"} 317.0 +http_request_duration_highr_seconds_bucket{le="10.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="30.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="60.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="+Inf"} 393.0 +http_request_duration_highr_seconds_count 393.0 +http_request_duration_highr_seconds_sum 2177.854818835389 +# HELP http_request_duration_highr_seconds_created Latency with many buckets but no API specific labels. Made for more accurate percentile calculations. +# TYPE http_request_duration_highr_seconds_created gauge +http_request_duration_highr_seconds_created 1.779813652123545e+09 +# HELP http_request_duration_seconds Latency with only few buckets by handler. Made to be only used if aggregation by handler is important. +# TYPE http_request_duration_seconds histogram +http_request_duration_seconds_bucket{handler="/v1/models",le="0.1",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="0.5",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="1.0",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="+Inf",method="GET"} 1.0 +http_request_duration_seconds_count{handler="/v1/models",method="GET"} 1.0 +http_request_duration_seconds_sum{handler="/v1/models",method="GET"} 0.0021718639764003456 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="0.1",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="0.5",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="1.0",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="+Inf",method="POST"} 392.0 +http_request_duration_seconds_count{handler="/v1/chat/completions",method="POST"} 392.0 +http_request_duration_seconds_sum{handler="/v1/chat/completions",method="POST"} 2177.8526469714125 +# HELP http_request_duration_seconds_created Latency with only few buckets by handler. Made to be only used if aggregation by handler is important. +# TYPE http_request_duration_seconds_created gauge +http_request_duration_seconds_created{handler="/v1/models",method="GET"} 1.7798136534284024e+09 +http_request_duration_seconds_created{handler="/v1/chat/completions",method="POST"} 1.7798136621262796e+09 diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/requests.jsonl b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/requests.jsonl new file mode 100644 index 0000000..75ac18b --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/requests.jsonl @@ -0,0 +1,392 @@ +{"req_id": "f9f8f44fd4964565", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382789290926849, "t_first_token_ns": 382790558826455, "t_last_token_ns": 382797113514317, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "36bbb6c17a024be2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382789659901922, "t_first_token_ns": 382790562489439, "t_last_token_ns": 382797128313029, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "accbc730595b4e03", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382789652047816, "t_first_token_ns": 382790562628888, "t_last_token_ns": 382797128921692, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "95ac8f889eb69b61", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382790823166204, "t_first_token_ns": 382791088097622, "t_last_token_ns": 382797769087654, "prompt_tokens": 4026, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "70cae603829190e5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382791061474334, "t_first_token_ns": 382791331557838, "t_last_token_ns": 382797799038906, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "2769a82161526fa2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382791368904865, "t_first_token_ns": 382791639708760, "t_last_token_ns": 382797915973240, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "7a3ae284fd025e54", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382791513603042, "t_first_token_ns": 382791884362823, "t_last_token_ns": 382797945325656, "prompt_tokens": 3951, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8c7ebece6fc8ef96", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382792070360683, "t_first_token_ns": 382792333281514, "t_last_token_ns": 382798220523639, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8a6e9ed8388bab88", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382792188423536, "t_first_token_ns": 382792837925726, "t_last_token_ns": 382798245247200, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "291192528bfcd0d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382792278152712, "t_first_token_ns": 382792838878037, "t_last_token_ns": 382798245386265, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "29aa5369f15ef8ed", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382792657735480, "t_first_token_ns": 382793036280094, "t_last_token_ns": 382798257351743, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "7d168f7f34914df8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382793209071934, "t_first_token_ns": 382793475213444, "t_last_token_ns": 382798419759324, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "5949b30b5660db44", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382793337546159, "t_first_token_ns": 382793727514866, "t_last_token_ns": 382798439961212, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "dee2814e53c1133c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382793875482551, "t_first_token_ns": 382794149403210, "t_last_token_ns": 382798557234662, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "d3d6d687b1270d0c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382794168792434, "t_first_token_ns": 382794449869425, "t_last_token_ns": 382798593462406, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "0114c7c017f510dc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382796283672313, "t_first_token_ns": 382796567992768, "t_last_token_ns": 382800456325397, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "6b23ad60e8365056", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382796348717041, "t_first_token_ns": 382796826715112, "t_last_token_ns": 382800476852194, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "c147b43b07e42731", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382798913190946, "t_first_token_ns": 382799167265892, "t_last_token_ns": 382803660590230, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "d6e4d018b0cbaea9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382799268533212, "t_first_token_ns": 382799527223812, "t_last_token_ns": 382804095615169, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "6a3c0ae558f764fa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382799736444187, "t_first_token_ns": 382799996528165, "t_last_token_ns": 382804458206793, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "6f4afc5b3b7d8068", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382799843744360, "t_first_token_ns": 382800241058383, "t_last_token_ns": 382804483541758, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "e2a3bc5ca5dd8e06", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382800690287000, "t_first_token_ns": 382800949330830, "t_last_token_ns": 382805021322275, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "750b6e6f651a9619", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382800831527654, "t_first_token_ns": 382801196613852, "t_last_token_ns": 382805042270103, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "088884483a9971d8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382801111099661, "t_first_token_ns": 382801659580614, "t_last_token_ns": 382805058217742, "prompt_tokens": 4025, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "318a0f6dc8a5806d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382801128030199, "t_first_token_ns": 382801659764792, "t_last_token_ns": 382805058354556, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "60fa44dd296e868f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382801405238455, "t_first_token_ns": 382801906540087, "t_last_token_ns": 382805069893089, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "be5160126f3a14e8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382803689801416, "t_first_token_ns": 382803961955550, "t_last_token_ns": 382805850433970, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "31994709d9d43ecc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382806259759968, "t_first_token_ns": 382806513529094, "t_last_token_ns": 382808568722584, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "ebb3f3698c984adb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382807170612926, "t_first_token_ns": 382807425733023, "t_last_token_ns": 382809699885930, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "a0f7008353f8beb2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382807174114959, "t_first_token_ns": 382807660007935, "t_last_token_ns": 382809705901083, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "7eac0cde0fd34276", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382809053268435, "t_first_token_ns": 382809309839001, "t_last_token_ns": 382811034295669, "prompt_tokens": 4019, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "95601ae65eae9166", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382810418224589, "t_first_token_ns": 382810671017246, "t_last_token_ns": 382813683360459, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "189d08c7b9ae2624", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382811401411411, "t_first_token_ns": 382811657826254, "t_last_token_ns": 382815978585583, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "607beffbb7acca39", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382811533980256, "t_first_token_ns": 382812116764826, "t_last_token_ns": 382816003041668, "prompt_tokens": 3953, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "93918e85acdf8b5d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382811604869353, "t_first_token_ns": 382812116876489, "t_last_token_ns": 382816003440515, "prompt_tokens": 4052, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "de6c910bd8be862f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382811962671979, "t_first_token_ns": 382812360247384, "t_last_token_ns": 382816021579516, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "776a9724799617aa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382813408348118, "t_first_token_ns": 382813675025705, "t_last_token_ns": 382817366613815, "prompt_tokens": 3955, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "b6357510a726d24b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382813984655364, "t_first_token_ns": 382814246694913, "t_last_token_ns": 382817935981686, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "7814350e435d2264", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382814874412902, "t_first_token_ns": 382815141842094, "t_last_token_ns": 382818624922719, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "c354ffa98aea604a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382815052261057, "t_first_token_ns": 382815392116621, "t_last_token_ns": 382818641708933, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "b95654a80317948f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382815547784624, "t_first_token_ns": 382815822622438, "t_last_token_ns": 382819270756340, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "d3983c9d6e42e3df", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382816371960659, "t_first_token_ns": 382816637192064, "t_last_token_ns": 382819734625647, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f12e1b2630a2dfcc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382817535729606, "t_first_token_ns": 382817804214925, "t_last_token_ns": 382821032681629, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "26aa2698c0cddf5a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382818633148946, "t_first_token_ns": 382818894811465, "t_last_token_ns": 382822484649758, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1dd5dcf6889436bf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382818810752574, "t_first_token_ns": 382819139973477, "t_last_token_ns": 382822501695039, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "55f20a37c1e89743", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382820188413880, "t_first_token_ns": 382820443229664, "t_last_token_ns": 382824384135386, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "e013af03a51488e2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382820351769226, "t_first_token_ns": 382820686629031, "t_last_token_ns": 382824402041904, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4fefe92b23621583", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382821431689779, "t_first_token_ns": 382821690537145, "t_last_token_ns": 382825296434094, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "5af9d220c4dd9318", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382821972204625, "t_first_token_ns": 382822242915938, "t_last_token_ns": 382826325701865, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "a3ff67ad251967cf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382822111239665, "t_first_token_ns": 382822485582985, "t_last_token_ns": 382826345015943, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "c9258f74cc827511", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382822704557309, "t_first_token_ns": 382822968803272, "t_last_token_ns": 382826603860618, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "140eb88bb615ba37", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382823192398108, "t_first_token_ns": 382823466335994, "t_last_token_ns": 382826833236104, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "d4a164b2ff3b3509", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382825316782113, "t_first_token_ns": 382825585321098, "t_last_token_ns": 382828175467784, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "9f1266f29a9e8b28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382825345530509, "t_first_token_ns": 382825822792095, "t_last_token_ns": 382828181950839, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "57c78bedb1e5433a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382825466019551, "t_first_token_ns": 382826057756975, "t_last_token_ns": 382828185947405, "prompt_tokens": 3957, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "08ff3938b9e3ae71", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382828194709571, "t_first_token_ns": 382828446723843, "t_last_token_ns": 382832162465529, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "fc976d1e97a41cca", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382829385684628, "t_first_token_ns": 382829646522416, "t_last_token_ns": 382834471686551, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "6c45ae3b99de1e62", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382829495127172, "t_first_token_ns": 382829927358868, "t_last_token_ns": 382834495333020, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "417d200da6fc7d82", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382829669860793, "t_first_token_ns": 382830127234785, "t_last_token_ns": 382834509541573, "prompt_tokens": 4042, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "2b45e140974d73b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382830186691755, "t_first_token_ns": 382830445762600, "t_last_token_ns": 382834622035412, "prompt_tokens": 3948, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4809e923113cfa22", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382830302831191, "t_first_token_ns": 382830694144423, "t_last_token_ns": 382834642051937, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "1baef27c84916aa0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382830564505214, "t_first_token_ns": 382831154694683, "t_last_token_ns": 382834659162390, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "b80243b2ea980e07", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382830599299279, "t_first_token_ns": 382831155127199, "t_last_token_ns": 382834659294973, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "efd5183f824026cc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382831429833827, "t_first_token_ns": 382831745920808, "t_last_token_ns": 382834842531079, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "df3338f95a55a940", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382831484728095, "t_first_token_ns": 382831939656083, "t_last_token_ns": 382834846800173, "prompt_tokens": 3921, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "973d64287adcd8a7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382834967519234, "t_first_token_ns": 382835214621912, "t_last_token_ns": 382836480235337, "prompt_tokens": 3934, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "19674684ced3de91", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382836657139633, "t_first_token_ns": 382836908283705, "t_last_token_ns": 382838455104068, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "e6fa68dd3de56239", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382837694960949, "t_first_token_ns": 382837953336634, "t_last_token_ns": 382840239626082, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "ec06f5beb70436d9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382838682780619, "t_first_token_ns": 382838942724095, "t_last_token_ns": 382842521760568, "prompt_tokens": 4040, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "034f1151aa2d2bdd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382838989121879, "t_first_token_ns": 382839249141767, "t_last_token_ns": 382842673043655, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "d156973f3cae174d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382839746547888, "t_first_token_ns": 382840006204111, "t_last_token_ns": 382843960946040, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "c2a0107acab59bd0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382840701983439, "t_first_token_ns": 382840962872878, "t_last_token_ns": 382845132955301, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "25faaab088637291", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382841139347213, "t_first_token_ns": 382841400700080, "t_last_token_ns": 382845897226650, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4a6ff2135636c100", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382841182667230, "t_first_token_ns": 382841638190389, "t_last_token_ns": 382845909872365, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "70f1b6f6bad6005a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382841838766456, "t_first_token_ns": 382842109544859, "t_last_token_ns": 382846163150469, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "485e723c2b84eb6b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382842102247520, "t_first_token_ns": 382842370068440, "t_last_token_ns": 382846190836304, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "6be120b83e225aa3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382842731351181, "t_first_token_ns": 382843002689497, "t_last_token_ns": 382846744717830, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "291a0df34911423c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382843095908125, "t_first_token_ns": 382843368685031, "t_last_token_ns": 382846834854612, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "9a771254d6418297", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382845128062915, "t_first_token_ns": 382845391475443, "t_last_token_ns": 382849185873329, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "3d63e1d817747a07", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382845278716614, "t_first_token_ns": 382845640933297, "t_last_token_ns": 382849204892880, "prompt_tokens": 4011, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "a85143fddaf4a5d9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382846256383535, "t_first_token_ns": 382846514122606, "t_last_token_ns": 382849833534887, "prompt_tokens": 3953, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "ed998b60c04d0117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382847056406245, "t_first_token_ns": 382847317163260, "t_last_token_ns": 382852798088504, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "10c050e2cad99a17", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382847598877988, "t_first_token_ns": 382847855290527, "t_last_token_ns": 382853622632361, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "03bc3ccba18fc900", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382847655097289, "t_first_token_ns": 382848319845905, "t_last_token_ns": 382853650665548, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "6ca800f53f978a58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382847776227657, "t_first_token_ns": 382848320038841, "t_last_token_ns": 382853651094626, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "0d6ebbadc6b6f44a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382850056584059, "t_first_token_ns": 382850323034071, "t_last_token_ns": 382857353686173, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "2225316b65c25005", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382850232294933, "t_first_token_ns": 382850571523701, "t_last_token_ns": 382857383430636, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "48f171c96419c86f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382850351711103, "t_first_token_ns": 382850817436479, "t_last_token_ns": 382857412103847, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "53e2a3f9153c46d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382850579065344, "t_first_token_ns": 382851053333340, "t_last_token_ns": 382857426155741, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8f000c5b2b8ac58e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382851094382993, "t_first_token_ns": 382851369785577, "t_last_token_ns": 382857537754515, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "601066832f30b428", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382851584319567, "t_first_token_ns": 382852126037728, "t_last_token_ns": 382857864315096, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "d417d380a4f40330", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382851587673332, "t_first_token_ns": 382852126146415, "t_last_token_ns": 382857864450989, "prompt_tokens": 3970, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "bf6ab969a046d65b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382851590294191, "t_first_token_ns": 382852315781915, "t_last_token_ns": 382857875415449, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "d23fe5d3ae909682", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382852048384761, "t_first_token_ns": 382852556150704, "t_last_token_ns": 382857887345708, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "08d7416f17740d2e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382852186903555, "t_first_token_ns": 382852797844212, "t_last_token_ns": 382857898692126, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "f63c4d00aca7e8d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382852810963301, "t_first_token_ns": 382853090070347, "t_last_token_ns": 382858179268374, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "72e028e252e47e71", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382853879518176, "t_first_token_ns": 382854153977313, "t_last_token_ns": 382859251336870, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "90e18fcccb2043f7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382853947436690, "t_first_token_ns": 382854404877233, "t_last_token_ns": 382859274451727, "prompt_tokens": 3956, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "7e9fdd59228f0876", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382854417145965, "t_first_token_ns": 382854689344913, "t_last_token_ns": 382859311898867, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "245bf7e5865d03d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382854765184032, "t_first_token_ns": 382855038787458, "t_last_token_ns": 382859389368721, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "2033b1bb6c32c79a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382855809036268, "t_first_token_ns": 382856084747979, "t_last_token_ns": 382859808046805, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "0f0a89285f54e2c1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382857873857979, "t_first_token_ns": 382858146228833, "t_last_token_ns": 382864462319266, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "da6f35b293578e17", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382858233532283, "t_first_token_ns": 382858500337935, "t_last_token_ns": 382864641646276, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "6c160ab03b66d81b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382858420458286, "t_first_token_ns": 382858748307913, "t_last_token_ns": 382864670257950, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "acad4eb8b9a0e9f6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382859826767372, "t_first_token_ns": 382860085724367, "t_last_token_ns": 382868681541925, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "502a12aa8ba51234", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382859846364510, "t_first_token_ns": 382860321203574, "t_last_token_ns": 382868703310069, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "c0e0a7d3c8cf4b95", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382860114160506, "t_first_token_ns": 382860565320975, "t_last_token_ns": 382868745107387, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "541738310001dd1c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382860450336588, "t_first_token_ns": 382860809247681, "t_last_token_ns": 382868779420476, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "525463c05dc42958", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382860582042794, "t_first_token_ns": 382861044115067, "t_last_token_ns": 382868797192942, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "3926bdb966d6e395", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382861341888226, "t_first_token_ns": 382861603737627, "t_last_token_ns": 382869576571637, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "586a0d3540151470", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382861830424897, "t_first_token_ns": 382862101157718, "t_last_token_ns": 382869981021959, "prompt_tokens": 3929, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "37c5cdb56477a163", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382862022501733, "t_first_token_ns": 382862351891878, "t_last_token_ns": 382870009359321, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "5947be4f56ddbab5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382862378986939, "t_first_token_ns": 382862658213482, "t_last_token_ns": 382870329157278, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "2fe62cb82ee987a4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382863164667762, "t_first_token_ns": 382863444443567, "t_last_token_ns": 382871912625813, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "8c278419850c8b5e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382863427535361, "t_first_token_ns": 382863699218992, "t_last_token_ns": 382871946695232, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "021ff28eaacd14c5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382863475128757, "t_first_token_ns": 382863951960108, "t_last_token_ns": 382871981995583, "prompt_tokens": 3959, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "faaf800e58c8f85f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382863887390103, "t_first_token_ns": 382864207729489, "t_last_token_ns": 382872042538759, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "744f358ad7f63e97", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382864032910246, "t_first_token_ns": 382864462787591, "t_last_token_ns": 382872267709139, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "927918347bcc40c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382864681727723, "t_first_token_ns": 382864958793520, "t_last_token_ns": 382872558081539, "prompt_tokens": 4032, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "2fcef28ebf707351", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382864833150572, "t_first_token_ns": 382865425357745, "t_last_token_ns": 382872589580641, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "fe233f2c57e680fd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382864930557673, "t_first_token_ns": 382865425535074, "t_last_token_ns": 382872589739215, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "b95acf9eb3705d28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382866427825604, "t_first_token_ns": 382866709270487, "t_last_token_ns": 382874684576669, "prompt_tokens": 4011, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "96b58f314a838835", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382866696755497, "t_first_token_ns": 382866986395403, "t_last_token_ns": 382874726808228, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "08456882f8d362d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382866928601737, "t_first_token_ns": 382867245428560, "t_last_token_ns": 382874757221468, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "4c8bd15a715f7720", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382867444993419, "t_first_token_ns": 382867733050775, "t_last_token_ns": 382875177832988, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "6949ec56d00ce8b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382868234126538, "t_first_token_ns": 382868517342679, "t_last_token_ns": 382875833519236, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "0fce2da54ec51dfd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382868976012250, "t_first_token_ns": 382869250331927, "t_last_token_ns": 382876950728798, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "4238f6957ae36e57", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382870044017810, "t_first_token_ns": 382870328568643, "t_last_token_ns": 382878891622425, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "943ff34258d40d28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382870245262995, "t_first_token_ns": 382870582273142, "t_last_token_ns": 382878932090192, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "dfca62202759aa8a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382870618200019, "t_first_token_ns": 382870893342036, "t_last_token_ns": 382879030975977, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "4397f621098474f5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382870920664483, "t_first_token_ns": 382871209958417, "t_last_token_ns": 382879111894670, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "beebd08c7cc682ce", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382871407256036, "t_first_token_ns": 382871692238206, "t_last_token_ns": 382879382380843, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "7c168a9454ca5620", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382871976699659, "t_first_token_ns": 382872254268322, "t_last_token_ns": 382879676817984, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "affa6c57b9777216", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382872638803711, "t_first_token_ns": 382872919300104, "t_last_token_ns": 382880330872448, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "e5ffcb3c7f664dc7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382872686892734, "t_first_token_ns": 382873160637446, "t_last_token_ns": 382880344519928, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "a024c6b1441ebbd3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382872996907515, "t_first_token_ns": 382873414089019, "t_last_token_ns": 382880373013069, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "17af21e67df524a9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382873819669867, "t_first_token_ns": 382874099082834, "t_last_token_ns": 382880831950343, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "80ff547317c08b98", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382873844863211, "t_first_token_ns": 382874340211893, "t_last_token_ns": 382881051582722, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "70a5b87cfadecff6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382874759726277, "t_first_token_ns": 382875042630169, "t_last_token_ns": 382881481649108, "prompt_tokens": 3945, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "843c0165f72929a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382875532937845, "t_first_token_ns": 382875819586615, "t_last_token_ns": 382882184894285, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "73b4128afce8e243", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382875876473994, "t_first_token_ns": 382876155872298, "t_last_token_ns": 382882285464114, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "205e89d222fdda00", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382876274302126, "t_first_token_ns": 382876549749715, "t_last_token_ns": 382882445452734, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "7117082172557ca5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382876479204118, "t_first_token_ns": 382876805513213, "t_last_token_ns": 382882470129563, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "7cc19a30a453f5f4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382877371598529, "t_first_token_ns": 382877647353373, "t_last_token_ns": 382882945802699, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "8ba8086b8eec10d6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382877808717969, "t_first_token_ns": 382878099388879, "t_last_token_ns": 382883089311819, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "6b0f100f2f9945ac", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382878014780380, "t_first_token_ns": 382878570885120, "t_last_token_ns": 382883109319860, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "ec1a4c4a2ea7ed12", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382878036339967, "t_first_token_ns": 382878570459954, "t_last_token_ns": 382883109598159, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "768828307182d0ad", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382878319282993, "t_first_token_ns": 382878832080274, "t_last_token_ns": 382883126279116, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "034e749c721e456f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382880011988799, "t_first_token_ns": 382880291437318, "t_last_token_ns": 382885530837368, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "73a8827fa8847e13", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382880764408758, "t_first_token_ns": 382881051926191, "t_last_token_ns": 382885967259409, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "bbcdf2009f998102", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382881419700884, "t_first_token_ns": 382881700250856, "t_last_token_ns": 382886291410058, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "9fa8ae1957c0f1d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382883231057982, "t_first_token_ns": 382883485881853, "t_last_token_ns": 382888255739473, "prompt_tokens": 3937, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "b11891ac95fc3b64", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382883252874937, "t_first_token_ns": 382883719648085, "t_last_token_ns": 382888267939834, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "59a9a00a0d3a1563", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382883868184332, "t_first_token_ns": 382884139144747, "t_last_token_ns": 382889186590779, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "d8bfc0767d724848", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382884007352515, "t_first_token_ns": 382884379224633, "t_last_token_ns": 382889207548184, "prompt_tokens": 3937, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "345d39ae3777d415", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382884345576010, "t_first_token_ns": 382884627512514, "t_last_token_ns": 382889227382063, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "9866cbc828a4fca8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382884480501887, "t_first_token_ns": 382884876230583, "t_last_token_ns": 382889249997835, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "af397ebf951c7719", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382884767739861, "t_first_token_ns": 382885124472338, "t_last_token_ns": 382889268536602, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "65c0b4265eb5dd19", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382886313573221, "t_first_token_ns": 382886588229127, "t_last_token_ns": 382891715820424, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "89dffa88c862c5b0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382887176437803, "t_first_token_ns": 382887448513348, "t_last_token_ns": 382894077900115, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "dc476408b33fbf5a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382888425178525, "t_first_token_ns": 382888699968102, "t_last_token_ns": 382897116774074, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "319a82c9b4681316", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382888478107074, "t_first_token_ns": 382888948423442, "t_last_token_ns": 382897157363767, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "71d7c157bf1ea669", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382888717688914, "t_first_token_ns": 382889186312932, "t_last_token_ns": 382897178943570, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "2cc13ac9d11806a5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382889740622932, "t_first_token_ns": 382890009976557, "t_last_token_ns": 382898796692701, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "129148915a429e01", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382889768950727, "t_first_token_ns": 382890245592340, "t_last_token_ns": 382898817573117, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "df7587e4a3d50532", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382889910351533, "t_first_token_ns": 382890693590475, "t_last_token_ns": 382898834124575, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8b0e7810ec937f82", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382889967753775, "t_first_token_ns": 382890694173331, "t_last_token_ns": 382898835455142, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "fb520fc29874b954", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382891102870746, "t_first_token_ns": 382891370429992, "t_last_token_ns": 382900485553370, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "dd803dc1b0f0a741", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382891279933439, "t_first_token_ns": 382891622900966, "t_last_token_ns": 382900527320519, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "93327e2e45a9ea52", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382891648864921, "t_first_token_ns": 382892142430809, "t_last_token_ns": 382900630552894, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "f37f16b87565dc53", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382891660188365, "t_first_token_ns": 382892142544191, "t_last_token_ns": 382900630704880, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "3bcfa41060f2dd80", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382891741142874, "t_first_token_ns": 382892392763773, "t_last_token_ns": 382900662051752, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "5badec87742c1dc2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382892222558392, "t_first_token_ns": 382892645617021, "t_last_token_ns": 382900691779223, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "d1e7b052e89f38f0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382893267995348, "t_first_token_ns": 382893537558856, "t_last_token_ns": 382902110448308, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "36a41522c4af841a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382893547106929, "t_first_token_ns": 382893825258694, "t_last_token_ns": 382902183264392, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "56afd7a006446ce0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382893804824704, "t_first_token_ns": 382894077626259, "t_last_token_ns": 382902210704832, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "1ec26802903d0510", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382893833029795, "t_first_token_ns": 382894315324961, "t_last_token_ns": 382902223880583, "prompt_tokens": 3947, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "16ab6647bde110e0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382894011275587, "t_first_token_ns": 382894769095241, "t_last_token_ns": 382902239042630, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "a642c8cc74bcd308", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382893903766030, "t_first_token_ns": 382894769530699, "t_last_token_ns": 382902239612941, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "ab5eaa452796e93b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382894166873960, "t_first_token_ns": 382895011250802, "t_last_token_ns": 382902253518626, "prompt_tokens": 4016, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "57388896a658fda9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382894731523174, "t_first_token_ns": 382895254177278, "t_last_token_ns": 382902267079113, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "74e18421d9a9571b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382895028786147, "t_first_token_ns": 382895517301218, "t_last_token_ns": 382902293613778, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "51627206c78da939", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382897566234197, "t_first_token_ns": 382897845937130, "t_last_token_ns": 382904615902188, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "ce0e4f081e4c436a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382897789698193, "t_first_token_ns": 382898109862459, "t_last_token_ns": 382904638830708, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "9826eaf60529d07a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382899083621647, "t_first_token_ns": 382899362237981, "t_last_token_ns": 382906518716106, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f06c8516cb43f569", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382899148196495, "t_first_token_ns": 382899618298353, "t_last_token_ns": 382906547147628, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "a2fcaaf1ad76b0b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382899648898358, "t_first_token_ns": 382899929480205, "t_last_token_ns": 382906624841086, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "0edc9b51f130a612", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382900181437516, "t_first_token_ns": 382900467327062, "t_last_token_ns": 382906842242453, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "ab79c0a9dc372db9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382900896447338, "t_first_token_ns": 382901179686925, "t_last_token_ns": 382907276990728, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "284610eaafd0e42a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382901249884695, "t_first_token_ns": 382901524108593, "t_last_token_ns": 382907394146001, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "89cb2a334a9f6238", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382901744929129, "t_first_token_ns": 382902028948698, "t_last_token_ns": 382907835343717, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "7ea2d46c75d8fe9a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382902748306721, "t_first_token_ns": 382903020739499, "t_last_token_ns": 382908923484811, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "024f2a25db9d388f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382902859154774, "t_first_token_ns": 382903271922131, "t_last_token_ns": 382908951483118, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "4bff469af089d526", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382903366339263, "t_first_token_ns": 382903647927291, "t_last_token_ns": 382909325335834, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "700bf9b5ddd3a040", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382903958595364, "t_first_token_ns": 382904231427622, "t_last_token_ns": 382909620458796, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "56c8618490819588", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382904974089091, "t_first_token_ns": 382905249433034, "t_last_token_ns": 382911499962745, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "897a93d4897b76cf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382905094226481, "t_first_token_ns": 382905504673637, "t_last_token_ns": 382911755923446, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fa28b6fdceb04b0a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382905469868594, "t_first_token_ns": 382905971649674, "t_last_token_ns": 382912009019036, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "9d6d324a99e130fb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382905452504359, "t_first_token_ns": 382905971887208, "t_last_token_ns": 382912009178825, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "2b3fcd354a2135a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382906194698977, "t_first_token_ns": 382906477072813, "t_last_token_ns": 382912947657660, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "e29b1c49a4e6562a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382907545906785, "t_first_token_ns": 382907820955644, "t_last_token_ns": 382914026466704, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "729dbd22ce5934ca", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382907837036083, "t_first_token_ns": 382908116674853, "t_last_token_ns": 382914097885017, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "150d24a23cc28808", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382908967063936, "t_first_token_ns": 382909238669145, "t_last_token_ns": 382915701561511, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "1247310989ae8f13", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382909682801396, "t_first_token_ns": 382909951690012, "t_last_token_ns": 382916280964212, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "e40763fc59ed0799", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382909694527096, "t_first_token_ns": 382910191468305, "t_last_token_ns": 382916294845999, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "7db7d42bc0b6e636", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382910151148111, "t_first_token_ns": 382910657880040, "t_last_token_ns": 382916321401849, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "a0ed26ee4cdfed05", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382910119282882, "t_first_token_ns": 382910658550738, "t_last_token_ns": 382916322077729, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "c81fd9769ec09a5f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382910403029863, "t_first_token_ns": 382910909076097, "t_last_token_ns": 382916344295038, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "8a5e9c377ef0f53c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382911478442216, "t_first_token_ns": 382911755585640, "t_last_token_ns": 382919215026487, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "3bb8df688946d953", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382911568804259, "t_first_token_ns": 382912008790824, "t_last_token_ns": 382919250705350, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "448dfb7bcf90f1f3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382912124789573, "t_first_token_ns": 382912401294524, "t_last_token_ns": 382919907040123, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "33ee8dfa5d511f36", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382912164228258, "t_first_token_ns": 382912636831634, "t_last_token_ns": 382919925491073, "prompt_tokens": 3947, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fe73928ec06f2ffd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382912242688487, "t_first_token_ns": 382912876922081, "t_last_token_ns": 382919939997218, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "b3b98aab260b94f5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382914270206701, "t_first_token_ns": 382914550808586, "t_last_token_ns": 382921483877194, "prompt_tokens": 3962, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "0616a2c3128fe7ad", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382914338908210, "t_first_token_ns": 382915022293033, "t_last_token_ns": 382921513419471, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "ea50a73400df1150", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382914468450089, "t_first_token_ns": 382915022466955, "t_last_token_ns": 382921513936829, "prompt_tokens": 4063, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "4608dc5a783e53a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382916345077232, "t_first_token_ns": 382916616746154, "t_last_token_ns": 382922794737760, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "d2629c04025d1ad2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382916592047127, "t_first_token_ns": 382916864680409, "t_last_token_ns": 382922821976994, "prompt_tokens": 3959, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "871a29b70510a5f2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382916755438932, "t_first_token_ns": 382917328602586, "t_last_token_ns": 382922848341325, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "78ec14117dc5c5e0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382916823513977, "t_first_token_ns": 382917328486984, "t_last_token_ns": 382922851100152, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "83b69b3a671f955d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382917285817908, "t_first_token_ns": 382917582322995, "t_last_token_ns": 382922869151641, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "7174a671812eb138", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382917326878953, "t_first_token_ns": 382917822985310, "t_last_token_ns": 382922881121014, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "51ff885b54684fc5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382917493106734, "t_first_token_ns": 382918063504101, "t_last_token_ns": 382922922360327, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "37f77dec01a5a091", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382917661010779, "t_first_token_ns": 382918304544283, "t_last_token_ns": 382923134568047, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "280e5ba3748db94d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382918573377556, "t_first_token_ns": 382918856446952, "t_last_token_ns": 382923351992551, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "e4a29ae517fc90cb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382918692723590, "t_first_token_ns": 382919115739195, "t_last_token_ns": 382923367141481, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "191f846cb9f66a8d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382919284856966, "t_first_token_ns": 382919568613062, "t_last_token_ns": 382923468811444, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "35f7d27c1cba45d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382919469966584, "t_first_token_ns": 382919830779037, "t_last_token_ns": 382923480301484, "prompt_tokens": 4008, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "7c00e83d6e1dd0e6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382922861791438, "t_first_token_ns": 382923135112680, "t_last_token_ns": 382924503091456, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3d4d2bb9bff4449a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382925977287833, "t_first_token_ns": 382926229416220, "t_last_token_ns": 382927443967980, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "7272725ee8fd0540", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382927694895232, "t_first_token_ns": 382927946535112, "t_last_token_ns": 382929162206031, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "a2fea85d23f1bda3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382929230966978, "t_first_token_ns": 382929482152853, "t_last_token_ns": 382931140875021, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "011158111ca19afe", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382929769173364, "t_first_token_ns": 382930026850438, "t_last_token_ns": 382931455191149, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "8da37110844555c6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382931550982739, "t_first_token_ns": 382931801970406, "t_last_token_ns": 382934132119325, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "d8b99c661f516313", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382932232434189, "t_first_token_ns": 382932489066674, "t_last_token_ns": 382935585922128, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "a02c08c718952117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382932349367111, "t_first_token_ns": 382932727628078, "t_last_token_ns": 382935604839933, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "85285854a309da38", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382933228632964, "t_first_token_ns": 382933490787602, "t_last_token_ns": 382936531459672, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "7ddc31684732a450", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382934490449945, "t_first_token_ns": 382934753109500, "t_last_token_ns": 382939062928021, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "536791c815121f58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382934500858259, "t_first_token_ns": 382934989960495, "t_last_token_ns": 382939074298946, "prompt_tokens": 4023, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "8576f22a0c427bbf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382934646693281, "t_first_token_ns": 382935226352486, "t_last_token_ns": 382939086472061, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "ca99a4a5056f40d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382935670031514, "t_first_token_ns": 382935935402524, "t_last_token_ns": 382939594939297, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "5838d0fe27e1457f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382936644778672, "t_first_token_ns": 382936909549530, "t_last_token_ns": 382941059923067, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "816823128084eebd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382937193484770, "t_first_token_ns": 382937455521041, "t_last_token_ns": 382941454793009, "prompt_tokens": 3932, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "bb0921b5e49295ee", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382937282173431, "t_first_token_ns": 382937699735468, "t_last_token_ns": 382941473320522, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "346cf978d3834bc0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382937488037072, "t_first_token_ns": 382938162347825, "t_last_token_ns": 382941493290404, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "c886d982435860b7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382937668517005, "t_first_token_ns": 382938161971656, "t_last_token_ns": 382941493409534, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "fdbc4ac00b838337", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382940296695249, "t_first_token_ns": 382940563089249, "t_last_token_ns": 382944361465993, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "fa46f37dea905ba5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382940467467112, "t_first_token_ns": 382940810371498, "t_last_token_ns": 382944381392626, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3e44df05b71a3966", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382940777907007, "t_first_token_ns": 382941059757008, "t_last_token_ns": 382944400476315, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8ee00ef0ad273d5c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382941557356645, "t_first_token_ns": 382941818708637, "t_last_token_ns": 382944806309436, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "abfce48fa7fd10f9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382942283276208, "t_first_token_ns": 382942540378736, "t_last_token_ns": 382945532923940, "prompt_tokens": 3927, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4f100560326929ab", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382942835097381, "t_first_token_ns": 382943102441575, "t_last_token_ns": 382945784097900, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f83672c4afe7b491", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382943536448721, "t_first_token_ns": 382943802381831, "t_last_token_ns": 382946091237617, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8683501cd7f36932", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382944871994870, "t_first_token_ns": 382945131767468, "t_last_token_ns": 382947371298281, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "3ce62a1f03d2a106", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382946507732925, "t_first_token_ns": 382946763114679, "t_last_token_ns": 382949315979358, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "0b7dbbfb7b402e80", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382946585180971, "t_first_token_ns": 382947214557439, "t_last_token_ns": 382949331098873, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "34360b76a6f05a1c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382946605794034, "t_first_token_ns": 382947214884676, "t_last_token_ns": 382949331303486, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "9ca5d6660027739d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382948238795534, "t_first_token_ns": 382948501134769, "t_last_token_ns": 382950783595795, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "1fe7cbb011f5427a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382949847086241, "t_first_token_ns": 382950101614251, "t_last_token_ns": 382954977935175, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "dffdc06a4b36683c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382950153271451, "t_first_token_ns": 382950410171573, "t_last_token_ns": 382955176679267, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "caced4db24115828", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382950494401040, "t_first_token_ns": 382950754222077, "t_last_token_ns": 382955368458696, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "9b16f710bda9505d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382951265486654, "t_first_token_ns": 382951525029268, "t_last_token_ns": 382956726759990, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "cb7c10754f5ce5fe", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382951630844552, "t_first_token_ns": 382951905781927, "t_last_token_ns": 382957192870722, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "88ffbcb6bc7f56b1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382951711172765, "t_first_token_ns": 382952154698248, "t_last_token_ns": 382957212311988, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "78e331e87c45a189", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382951903480165, "t_first_token_ns": 382952391676452, "t_last_token_ns": 382957223112182, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "456ef7ed125277b0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382952145673760, "t_first_token_ns": 382952638086504, "t_last_token_ns": 382957247136845, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "89f55bed6ffb548a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382952702824754, "t_first_token_ns": 382952972212278, "t_last_token_ns": 382957343461682, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3d3ab1fae05f0d2a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382952829129450, "t_first_token_ns": 382953218114548, "t_last_token_ns": 382957362654919, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "335bb26db7a2003b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382953699622150, "t_first_token_ns": 382953979913404, "t_last_token_ns": 382957912450915, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "dfbdddceda574c5e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382956033443839, "t_first_token_ns": 382956301270498, "t_last_token_ns": 382959751761247, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "59fcfa5724d8e7b3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382956359374462, "t_first_token_ns": 382956627140565, "t_last_token_ns": 382959834054727, "prompt_tokens": 4019, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "cfe7772de6d17d6b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382956923401831, "t_first_token_ns": 382957192541857, "t_last_token_ns": 382960328155901, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "59bba69a8d667e3e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382957597982614, "t_first_token_ns": 382957857550912, "t_last_token_ns": 382961183047739, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "108739472aeef7cd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382958664670752, "t_first_token_ns": 382958921507089, "t_last_token_ns": 382962218143327, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "7912548face9904f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382959327521659, "t_first_token_ns": 382959594099935, "t_last_token_ns": 382962818584039, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9ad61f308977eb83", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382959813253530, "t_first_token_ns": 382960078042536, "t_last_token_ns": 382963024336825, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "3491e86c0fd93ddb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382960664110723, "t_first_token_ns": 382960925346876, "t_last_token_ns": 382963557439280, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "48e9daddae7ddfde", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382960681318934, "t_first_token_ns": 382961155976039, "t_last_token_ns": 382963563540337, "prompt_tokens": 3921, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "30336ab3d8b85b24", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382962555824470, "t_first_token_ns": 382962819202906, "t_last_token_ns": 382964586083884, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "9a3fd26f54c1be0a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382964082411460, "t_first_token_ns": 382964337877173, "t_last_token_ns": 382969707970982, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "6b4b03f7f400b478", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382964871974999, "t_first_token_ns": 382965130747141, "t_last_token_ns": 382972253410118, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "79c09b32b572e89b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382965023250275, "t_first_token_ns": 382965368790616, "t_last_token_ns": 382972291095009, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "96d046514314461d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382965678768077, "t_first_token_ns": 382965935574188, "t_last_token_ns": 382974521550074, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "185f1dbdea6d23c0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382965698768537, "t_first_token_ns": 382966173182946, "t_last_token_ns": 382974565651702, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1d800c9aabc32617", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382966037273044, "t_first_token_ns": 382966419747219, "t_last_token_ns": 382974807676197, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "6c8d620872c9187d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382966200511162, "t_first_token_ns": 382966665211292, "t_last_token_ns": 382974847518918, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "48598702f53ca2f3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382966750193640, "t_first_token_ns": 382967014976664, "t_last_token_ns": 382975032643076, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "f2db9e461e72ad78", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382966942869618, "t_first_token_ns": 382967264954501, "t_last_token_ns": 382975067203317, "prompt_tokens": 4022, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "f80c2c460ec65e32", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382967008273755, "t_first_token_ns": 382967501210814, "t_last_token_ns": 382975086214056, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "ab3000c06ac776bf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382968061829510, "t_first_token_ns": 382968328879133, "t_last_token_ns": 382976345897697, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "0bf5905c1e8121bd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382968255828785, "t_first_token_ns": 382968579400257, "t_last_token_ns": 382976381189354, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "1098d56d526989cc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382968803557889, "t_first_token_ns": 382969081531405, "t_last_token_ns": 382976663356019, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "137d70d1f46c03a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382968815464531, "t_first_token_ns": 382969321217983, "t_last_token_ns": 382976677186139, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "cebd470b51f7fe4e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382969368811945, "t_first_token_ns": 382969649467716, "t_last_token_ns": 382976780104681, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "a151e7b5b68ad9ae", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382970408712279, "t_first_token_ns": 382970685708239, "t_last_token_ns": 382977789107764, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "4eca794d265710c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382971434060756, "t_first_token_ns": 382971706870064, "t_last_token_ns": 382978779282915, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "dff220b2b2e49d3a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382971701668076, "t_first_token_ns": 382971976563040, "t_last_token_ns": 382978821705535, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "82efcb8a8e11e6c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382971794787189, "t_first_token_ns": 382972236783995, "t_last_token_ns": 382978850142874, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "2b2b27c2bbba748c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382972422695171, "t_first_token_ns": 382972698778991, "t_last_token_ns": 382979059872449, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "22232cfe893b9166", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382972667902866, "t_first_token_ns": 382972958069954, "t_last_token_ns": 382979086547479, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "139fa79bf7516bed", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382972893271136, "t_first_token_ns": 382973216336359, "t_last_token_ns": 382979108832071, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "d725af190f423c10", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382973051402584, "t_first_token_ns": 382973475218977, "t_last_token_ns": 382979131748405, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "1d3e84737b4620da", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382973385519328, "t_first_token_ns": 382973738667735, "t_last_token_ns": 382979155563268, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "2375944c4224b637", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382974150825083, "t_first_token_ns": 382974442895888, "t_last_token_ns": 382979391080369, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "657154f7593762d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382974493886898, "t_first_token_ns": 382974788861859, "t_last_token_ns": 382979452712066, "prompt_tokens": 4032, "completion_tokens": 256, "inflight_at_send": 23, "error": null} +{"req_id": "4e50ce56d0618fec", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382975188421027, "t_first_token_ns": 382975461931858, "t_last_token_ns": 382979687741052, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "cea59338a3b0a9b3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382976056272032, "t_first_token_ns": 382976346263881, "t_last_token_ns": 382979936373009, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f4dd02509a77bddd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382977165528339, "t_first_token_ns": 382977439885179, "t_last_token_ns": 382980290529320, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "0e7beafea7584ff7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382977731207395, "t_first_token_ns": 382978006850893, "t_last_token_ns": 382980399529403, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "b97b84e328b625d3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382980823689281, "t_first_token_ns": 382981075688086, "t_last_token_ns": 382983476634454, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "651186d1dd6c15a6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382981289258632, "t_first_token_ns": 382981548939419, "t_last_token_ns": 382983853578046, "prompt_tokens": 4033, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "b6350e463220e4e6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382981803870265, "t_first_token_ns": 382982060697967, "t_last_token_ns": 382984141231232, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "358015cbb66d10de", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382982520271690, "t_first_token_ns": 382982782950860, "t_last_token_ns": 382984464938783, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "50705bd15064c6d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382984889117196, "t_first_token_ns": 382985142742040, "t_last_token_ns": 382986739578814, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "ecb80a17721044a3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382985696775295, "t_first_token_ns": 382985955904751, "t_last_token_ns": 382987321670092, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "41abb79477b47f91", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382987355349469, "t_first_token_ns": 382987605708598, "t_last_token_ns": 382990574895939, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "721ebf229a030a95", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382987472519494, "t_first_token_ns": 382987840997804, "t_last_token_ns": 382990590088544, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "3a340945700f2c58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382987839061395, "t_first_token_ns": 382988099169498, "t_last_token_ns": 382990627092689, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "2170390234b5ae2d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382988649987556, "t_first_token_ns": 382988909167022, "t_last_token_ns": 382993001662646, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "076476fea8382967", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382989530470958, "t_first_token_ns": 382989792217274, "t_last_token_ns": 382994679266784, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "ff52490f95172d67", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382990712791716, "t_first_token_ns": 382990971200319, "t_last_token_ns": 382997553642879, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "e924d3bcedd387fb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382990920043591, "t_first_token_ns": 382991212182096, "t_last_token_ns": 382997584314503, "prompt_tokens": 3970, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "b877892f91ecec34", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382991172767836, "t_first_token_ns": 382991454716177, "t_last_token_ns": 382997615249931, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1caf880a2fbf12e5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382991527941321, "t_first_token_ns": 382991792900555, "t_last_token_ns": 382997791893345, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9a1cf60f1b871ded", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382991861045452, "t_first_token_ns": 382992130204783, "t_last_token_ns": 382997961286607, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "a95165328c12522a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382991926192021, "t_first_token_ns": 382992377868985, "t_last_token_ns": 382997989217438, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "db3cb451a123fd7b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382992256767425, "t_first_token_ns": 382992625017685, "t_last_token_ns": 382998016828719, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "ec19d55d7bc56117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382992942558055, "t_first_token_ns": 382993215701630, "t_last_token_ns": 382999096964079, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "45f17bcf193b6eb1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382993840954274, "t_first_token_ns": 382994119861588, "t_last_token_ns": 383001306366832, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "0a1426ca17d726a2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382994015777751, "t_first_token_ns": 382994370980435, "t_last_token_ns": 383001544419881, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "85f92136d0577f5c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382994662842950, "t_first_token_ns": 382994932478193, "t_last_token_ns": 383002402402567, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "c68c8ac2cefadeda", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382995590949195, "t_first_token_ns": 382995872537866, "t_last_token_ns": 383003709060859, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "5c5ae6e010163893", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382995704859857, "t_first_token_ns": 382996348969634, "t_last_token_ns": 383003743273870, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "39ec2bfef2cc660c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382995716668906, "t_first_token_ns": 382996348634157, "t_last_token_ns": 383003744205858, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "bc830bbd57c31dfd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382995834115999, "t_first_token_ns": 382996576548299, "t_last_token_ns": 383003757992635, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "f8dfa76d3272924c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382996592526432, "t_first_token_ns": 382996875178131, "t_last_token_ns": 383004057626431, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "6a0616efb0ee2261", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382998223428771, "t_first_token_ns": 382998493950952, "t_last_token_ns": 383005754297147, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "9be8cd07b75dc5e7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382998551019335, "t_first_token_ns": 382998831807421, "t_last_token_ns": 383005901218597, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "213c753a2902d374", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382998801335860, "t_first_token_ns": 382999083678594, "t_last_token_ns": 383006136157518, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "4e27c91846d4e17d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382999459596869, "t_first_token_ns": 382999732143017, "t_last_token_ns": 383006598191889, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "1b02d1736bed2783", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382999713878673, "t_first_token_ns": 382999984232406, "t_last_token_ns": 383006629308877, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "044505f55ee8eb29", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382999740776549, "t_first_token_ns": 383000224556617, "t_last_token_ns": 383006643506063, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "9b6468d2f524b689", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382999929759433, "t_first_token_ns": 383000465788287, "t_last_token_ns": 383006657148086, "prompt_tokens": 4015, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "0576ac2b072d4f41", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383000541997745, "t_first_token_ns": 383000823717795, "t_last_token_ns": 383006783955862, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "1904f89e3ffa195e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383000950707836, "t_first_token_ns": 383001230172094, "t_last_token_ns": 383007165326410, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "278330e7e052f152", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383001235892397, "t_first_token_ns": 383001528424082, "t_last_token_ns": 383007663661606, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "783382169706baf2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383001569684788, "t_first_token_ns": 383001844968737, "t_last_token_ns": 383007973140501, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "fd3f7b073d883ae7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383001668536397, "t_first_token_ns": 383002102721237, "t_last_token_ns": 383008001539889, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "16236450faab7663", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383002641194606, "t_first_token_ns": 383002920644684, "t_last_token_ns": 383008878449759, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f702da4e623d7579", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383002953745602, "t_first_token_ns": 383003230034676, "t_last_token_ns": 383008945478826, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "d9555469adb82bd6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383003736685686, "t_first_token_ns": 383004014553614, "t_last_token_ns": 383009317951479, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "47bdac1c5663cca9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383004296174963, "t_first_token_ns": 383004580018304, "t_last_token_ns": 383009574570549, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "af1d9e8359f64baa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383005832742661, "t_first_token_ns": 383006121843023, "t_last_token_ns": 383010633961300, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "b27e960445b0e807", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383006894781834, "t_first_token_ns": 383007166179558, "t_last_token_ns": 383011665380526, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "3877cb03f6ea4711", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383006990199450, "t_first_token_ns": 383007410572047, "t_last_token_ns": 383011688780131, "prompt_tokens": 3955, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "cee027f56ae5f140", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383007391297659, "t_first_token_ns": 383007663836597, "t_last_token_ns": 383011938063080, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "336f49e040184b00", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383007399829640, "t_first_token_ns": 383007908118781, "t_last_token_ns": 383011945522376, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "9cc7dafc187ac5a5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383008338941323, "t_first_token_ns": 383008614078777, "t_last_token_ns": 383012554380367, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "8363103077032c09", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383008515161934, "t_first_token_ns": 383008866787486, "t_last_token_ns": 383012573414985, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "288e93bd46cfc9ea", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383011018721810, "t_first_token_ns": 383011285846608, "t_last_token_ns": 383014720127104, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "9e4a220b3cf1ed89", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383011189805105, "t_first_token_ns": 383011534697539, "t_last_token_ns": 383014740652197, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "d553f356441ca287", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383011664224303, "t_first_token_ns": 383011937969249, "t_last_token_ns": 383014870442913, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "5c8b375f370a610c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383012116055141, "t_first_token_ns": 383012385155666, "t_last_token_ns": 383015038599250, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "c8b0fc76cafef753", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383013287964256, "t_first_token_ns": 383013553953406, "t_last_token_ns": 383017392254557, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "72e7e5c0e7f2b84f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383013891713358, "t_first_token_ns": 383014160649590, "t_last_token_ns": 383018064955282, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9e7ed7f0ec538c3f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383015312019843, "t_first_token_ns": 383015567966387, "t_last_token_ns": 383021670625639, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "ff133c5d58ab656f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383015569465518, "t_first_token_ns": 383015834678890, "t_last_token_ns": 383021745660658, "prompt_tokens": 4023, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "a729629242e95560", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383015638483717, "t_first_token_ns": 383016300705127, "t_last_token_ns": 383021771689746, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "0b005fe06300469f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383015776199335, "t_first_token_ns": 383016301094614, "t_last_token_ns": 383021772295924, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f9fef77febb3a101", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383015808407003, "t_first_token_ns": 383016526380049, "t_last_token_ns": 383021785516174, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3a56a9b9fbaf16ef", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383016627925772, "t_first_token_ns": 383016895163818, "t_last_token_ns": 383022187453466, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "a4b8f1dd0a833ac0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383017400989473, "t_first_token_ns": 383017678828983, "t_last_token_ns": 383023098524275, "prompt_tokens": 4015, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "bc1ce14acfb8f5b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383018338656614, "t_first_token_ns": 383018611454998, "t_last_token_ns": 383023927274975, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "550870cf62cf7dc8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383019351419913, "t_first_token_ns": 383019619186256, "t_last_token_ns": 383025053466820, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3bed9c08ecc0735e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383019485675318, "t_first_token_ns": 383020079935171, "t_last_token_ns": 383025077063089, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "2affef463ea83fb5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383019440881820, "t_first_token_ns": 383020080727063, "t_last_token_ns": 383025077844451, "prompt_tokens": 3963, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "80bee31a1295953e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383020204829783, "t_first_token_ns": 383020694573197, "t_last_token_ns": 383025229719769, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "aebd728fac5eb7c9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383020203647292, "t_first_token_ns": 383020693948715, "t_last_token_ns": 383025230376503, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "fc6cfd2270ab2581", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383020480649855, "t_first_token_ns": 383020946529158, "t_last_token_ns": 383025249446040, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "f4a15b0e0da21586", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383021072114639, "t_first_token_ns": 383021342159212, "t_last_token_ns": 383025342329830, "prompt_tokens": 3916, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "1ff7c31e57e00bcb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383021777330011, "t_first_token_ns": 383022051410261, "t_last_token_ns": 383025595705672, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "c1fecd97b2361f3e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383022415020732, "t_first_token_ns": 383022690188916, "t_last_token_ns": 383025769684775, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "d167f8efb80215a9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383024405106159, "t_first_token_ns": 383024677982876, "t_last_token_ns": 383026413568615, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "c52bced31247e27d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383026855738000, "t_first_token_ns": 383027104245357, "t_last_token_ns": 383031698453402, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "431a39693928917a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383027104473723, "t_first_token_ns": 383027362663482, "t_last_token_ns": 383031762943886, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "bf8d7bba7096d325", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383027357693904, "t_first_token_ns": 383027615410216, "t_last_token_ns": 383031809521168, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "abfb5bfd5d68dc8d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383027373043855, "t_first_token_ns": 383027851510799, "t_last_token_ns": 383031819724401, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "5142ba1e759d7807", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383027459898148, "t_first_token_ns": 383028089105308, "t_last_token_ns": 383031829219652, "prompt_tokens": 4016, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "911dfbd9a5da2f3a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383027845178171, "t_first_token_ns": 383028335148320, "t_last_token_ns": 383031845592361, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "d4ec1ed768d3128b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383028529926037, "t_first_token_ns": 383028799403610, "t_last_token_ns": 383032037654779, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8ecca9914ec9afd1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383028710045870, "t_first_token_ns": 383029259886354, "t_last_token_ns": 383032048417024, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "94e98c79036fdaf0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 383028782077174, "t_first_token_ns": 383029259643712, "t_last_token_ns": 383032048584805, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 9, "error": null} diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/run_summary.json b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/run_summary.json new file mode 100644 index 0000000..dea8aac --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/run_summary.json @@ -0,0 +1,8 @@ +{ + "rate": 1.5, + "input_tokens": 4096, + "output_tokens": 256, + "duration_target_s": 240.0, + "duration_actual_s": 243.08491666900227, + "n_requests": 392 +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/worker_step.r0.jsonl b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/worker_step.r0.jsonl new file mode 100644 index 0000000..2597528 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/mooncake_both_drfix/worker_step.r0.jsonl @@ -0,0 +1,15438 @@ +{"t_unix": 1779813654.8782487, "step_id": 0, "start_load_kv_us": 19, "get_finished_us": 518} +{"t_unix": 1779813655.1313918, "step_id": 1, "start_load_kv_us": 6, "get_finished_us": 365} +{"t_unix": 1779813655.5719395, "step_id": 2, "start_load_kv_us": 4, "get_finished_us": 347} +{"t_unix": 1779813655.5746331, "step_id": 3, "start_load_kv_us": 3, "get_finished_us": 261} +{"t_unix": 1779813655.5801997, "step_id": 4, "start_load_kv_us": 3, "get_finished_us": 230} +{"t_unix": 1779813655.5871017, "step_id": 5, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813655.5937603, "step_id": 6, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813655.6005213, "step_id": 7, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813655.6075535, "step_id": 8, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813655.6143053, "step_id": 9, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813655.620888, "step_id": 10, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813655.627862, "step_id": 11, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813655.6350403, "step_id": 12, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813655.642195, "step_id": 13, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813655.6497803, "step_id": 14, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813655.6571987, "step_id": 15, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813655.6642199, "step_id": 16, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813655.6716087, "step_id": 17, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813655.678936, "step_id": 18, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813655.6860151, "step_id": 19, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813655.6933537, "step_id": 20, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813655.700377, "step_id": 21, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813655.7071288, "step_id": 22, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813655.7142618, "step_id": 23, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813655.7212994, "step_id": 24, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813655.7286768, "step_id": 25, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813655.7357647, "step_id": 26, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813655.743041, "step_id": 27, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813655.7502377, "step_id": 28, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813655.7574265, "step_id": 29, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813655.7649376, "step_id": 30, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813655.7722054, "step_id": 31, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813655.7795672, "step_id": 32, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813655.7871225, "step_id": 33, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813655.7945004, "step_id": 34, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813655.802324, "step_id": 35, "start_load_kv_us": 2, "get_finished_us": 334} +{"t_unix": 1779813655.810059, "step_id": 36, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813655.8175995, "step_id": 37, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813655.8249052, "step_id": 38, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813655.8324163, "step_id": 39, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813655.8401628, "step_id": 40, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813655.84783, "step_id": 41, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813655.896134, "step_id": 42, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813655.8985143, "step_id": 43, "start_load_kv_us": 3, "get_finished_us": 151} +{"t_unix": 1779813656.140307, "step_id": 44, "start_load_kv_us": 3, "get_finished_us": 282} +{"t_unix": 1779813656.1433654, "step_id": 45, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813656.343889, "step_id": 46, "start_load_kv_us": 13, "get_finished_us": 280} +{"t_unix": 1779813656.3539546, "step_id": 47, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813656.3638597, "step_id": 48, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813656.374145, "step_id": 49, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813656.3842974, "step_id": 50, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813656.3953602, "step_id": 51, "start_load_kv_us": 2, "get_finished_us": 986} +{"t_unix": 1779813656.445202, "step_id": 52, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813656.4476733, "step_id": 53, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813656.6978388, "step_id": 54, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813656.7002542, "step_id": 55, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813656.8966556, "step_id": 56, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813656.9062304, "step_id": 57, "start_load_kv_us": 3, "get_finished_us": 183} +{"t_unix": 1779813656.9182842, "step_id": 58, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813656.9301007, "step_id": 59, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813656.9422069, "step_id": 60, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813656.9542565, "step_id": 61, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813656.966008, "step_id": 62, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813656.9778755, "step_id": 63, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813656.9899147, "step_id": 64, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813657.0014174, "step_id": 65, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813657.013244, "step_id": 66, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813657.0259073, "step_id": 67, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813657.0376427, "step_id": 68, "start_load_kv_us": 6, "get_finished_us": 242} +{"t_unix": 1779813657.0487034, "step_id": 69, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813657.0605364, "step_id": 70, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813657.0718863, "step_id": 71, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813657.0836732, "step_id": 72, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813657.1405873, "step_id": 73, "start_load_kv_us": 3, "get_finished_us": 306} +{"t_unix": 1779813657.143208, "step_id": 74, "start_load_kv_us": 4, "get_finished_us": 185} +{"t_unix": 1779813657.3974848, "step_id": 75, "start_load_kv_us": 2, "get_finished_us": 452} +{"t_unix": 1779813657.8465755, "step_id": 76, "start_load_kv_us": 3, "get_finished_us": 397} +{"t_unix": 1779813657.8514256, "step_id": 77, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813658.0477664, "step_id": 78, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813658.0608263, "step_id": 79, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813658.0743835, "step_id": 80, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813658.0883243, "step_id": 81, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813658.1016958, "step_id": 82, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813658.1151555, "step_id": 83, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813658.128366, "step_id": 84, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813658.1416242, "step_id": 85, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813658.1542847, "step_id": 86, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813658.1679156, "step_id": 87, "start_load_kv_us": 2, "get_finished_us": 825} +{"t_unix": 1779813658.1804461, "step_id": 88, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813658.1939204, "step_id": 89, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813658.2074502, "step_id": 90, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813658.2209606, "step_id": 91, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813658.2776778, "step_id": 92, "start_load_kv_us": 2, "get_finished_us": 356} +{"t_unix": 1779813658.2808738, "step_id": 93, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813658.5301712, "step_id": 94, "start_load_kv_us": 9, "get_finished_us": 403} +{"t_unix": 1779813658.53346, "step_id": 95, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813658.7391565, "step_id": 96, "start_load_kv_us": 3, "get_finished_us": 385} +{"t_unix": 1779813658.7521124, "step_id": 97, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813658.7660177, "step_id": 98, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813658.7797241, "step_id": 99, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813658.793599, "step_id": 100, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813658.808325, "step_id": 101, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813658.8219075, "step_id": 102, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813658.836219, "step_id": 103, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813658.8501663, "step_id": 104, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813658.863847, "step_id": 105, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813658.8778079, "step_id": 106, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813658.891628, "step_id": 107, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813658.9484534, "step_id": 108, "start_load_kv_us": 3, "get_finished_us": 249} +{"t_unix": 1779813658.9511561, "step_id": 109, "start_load_kv_us": 17, "get_finished_us": 154} +{"t_unix": 1779813659.161309, "step_id": 110, "start_load_kv_us": 7, "get_finished_us": 375} +{"t_unix": 1779813659.1757352, "step_id": 111, "start_load_kv_us": 3, "get_finished_us": 310} +{"t_unix": 1779813659.1905055, "step_id": 112, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813659.2470434, "step_id": 113, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813659.2497408, "step_id": 114, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813659.461857, "step_id": 115, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813659.4754972, "step_id": 116, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813659.4902196, "step_id": 117, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813659.505041, "step_id": 118, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813659.5202234, "step_id": 119, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813659.5356023, "step_id": 120, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813659.5502038, "step_id": 121, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813659.5658278, "step_id": 122, "start_load_kv_us": 2, "get_finished_us": 456} +{"t_unix": 1779813659.5805993, "step_id": 123, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813659.5952864, "step_id": 124, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813659.610169, "step_id": 125, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813659.6252787, "step_id": 126, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813659.6402955, "step_id": 127, "start_load_kv_us": 17, "get_finished_us": 292} +{"t_unix": 1779813659.6549664, "step_id": 128, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813659.669913, "step_id": 129, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813659.6853342, "step_id": 130, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813659.7000244, "step_id": 131, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813659.715037, "step_id": 132, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813659.7300885, "step_id": 133, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813659.7451649, "step_id": 134, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813659.759796, "step_id": 135, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813659.7748141, "step_id": 136, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813659.7891057, "step_id": 137, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813659.803381, "step_id": 138, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813659.8177836, "step_id": 139, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813659.8328655, "step_id": 140, "start_load_kv_us": 8, "get_finished_us": 207} +{"t_unix": 1779813659.8472228, "step_id": 141, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813659.8621767, "step_id": 142, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813659.8773737, "step_id": 143, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813659.8923085, "step_id": 144, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813659.907211, "step_id": 145, "start_load_kv_us": 3, "get_finished_us": 207} +{"t_unix": 1779813659.9216595, "step_id": 146, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813659.9361968, "step_id": 147, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813659.951001, "step_id": 148, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813659.9657457, "step_id": 149, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813659.9805803, "step_id": 150, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813659.9955673, "step_id": 151, "start_load_kv_us": 3, "get_finished_us": 317} +{"t_unix": 1779813660.0107272, "step_id": 152, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813660.0272346, "step_id": 153, "start_load_kv_us": 10, "get_finished_us": 919} +{"t_unix": 1779813660.0399885, "step_id": 154, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813660.0578027, "step_id": 155, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813660.069318, "step_id": 156, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813660.084276, "step_id": 157, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813660.0993888, "step_id": 158, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813660.1142168, "step_id": 159, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813660.1300685, "step_id": 160, "start_load_kv_us": 2, "get_finished_us": 338} +{"t_unix": 1779813660.1443489, "step_id": 161, "start_load_kv_us": 2, "get_finished_us": 329} +{"t_unix": 1779813660.1590555, "step_id": 162, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813660.1737602, "step_id": 163, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813660.18878, "step_id": 164, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813660.203959, "step_id": 165, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813660.2191067, "step_id": 166, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813660.2338517, "step_id": 167, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813660.248169, "step_id": 168, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813660.2626321, "step_id": 169, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813660.2786386, "step_id": 170, "start_load_kv_us": 3, "get_finished_us": 376} +{"t_unix": 1779813660.292998, "step_id": 171, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813660.3077574, "step_id": 172, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813660.3226144, "step_id": 173, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813660.3374712, "step_id": 174, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813660.35779, "step_id": 175, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813660.3671594, "step_id": 176, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813660.3823044, "step_id": 177, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813660.3970718, "step_id": 178, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813660.4124327, "step_id": 179, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813660.427475, "step_id": 180, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813660.442821, "step_id": 181, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813660.4572167, "step_id": 182, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813660.4713712, "step_id": 183, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813660.4856832, "step_id": 184, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813660.5002365, "step_id": 185, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813660.5145633, "step_id": 186, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813660.529529, "step_id": 187, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813660.5447285, "step_id": 188, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813660.5599692, "step_id": 189, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813660.5752602, "step_id": 190, "start_load_kv_us": 17, "get_finished_us": 260} +{"t_unix": 1779813660.5901642, "step_id": 191, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813660.605514, "step_id": 192, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813660.6209278, "step_id": 193, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813660.6356168, "step_id": 194, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813660.6504018, "step_id": 195, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813660.6654098, "step_id": 196, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813660.6803844, "step_id": 197, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813660.6953719, "step_id": 198, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813660.7106874, "step_id": 199, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813660.726214, "step_id": 200, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813660.7416835, "step_id": 201, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813660.757249, "step_id": 202, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813660.7727244, "step_id": 203, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813660.7888236, "step_id": 204, "start_load_kv_us": 7, "get_finished_us": 182} +{"t_unix": 1779813660.8045068, "step_id": 205, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813660.8201988, "step_id": 206, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813660.8359084, "step_id": 207, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813660.85133, "step_id": 208, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813660.8670697, "step_id": 209, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813660.8831546, "step_id": 210, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813660.8988843, "step_id": 211, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813660.9150221, "step_id": 212, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813660.9309597, "step_id": 213, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813660.946853, "step_id": 214, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813660.9630566, "step_id": 215, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813660.9787195, "step_id": 216, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813660.9941697, "step_id": 217, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813661.009639, "step_id": 218, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813661.0247138, "step_id": 219, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813661.0402215, "step_id": 220, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813661.0552611, "step_id": 221, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813661.070564, "step_id": 222, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813661.0858045, "step_id": 223, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813661.100896, "step_id": 224, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813661.116979, "step_id": 225, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813661.1319952, "step_id": 226, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813661.147755, "step_id": 227, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813661.1637135, "step_id": 228, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813661.1793747, "step_id": 229, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813661.195047, "step_id": 230, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813661.2106094, "step_id": 231, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813661.2261772, "step_id": 232, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813661.2416737, "step_id": 233, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813661.257688, "step_id": 234, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813661.2732828, "step_id": 235, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813661.2889814, "step_id": 236, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813661.304394, "step_id": 237, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813661.3660562, "step_id": 238, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813661.3689854, "step_id": 239, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813661.623472, "step_id": 240, "start_load_kv_us": 2, "get_finished_us": 399} +{"t_unix": 1779813661.8361006, "step_id": 241, "start_load_kv_us": 5, "get_finished_us": 327} +{"t_unix": 1779813661.8388453, "step_id": 242, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813661.856916, "step_id": 243, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813661.875683, "step_id": 244, "start_load_kv_us": 3, "get_finished_us": 265} +{"t_unix": 1779813661.8947692, "step_id": 245, "start_load_kv_us": 3, "get_finished_us": 303} +{"t_unix": 1779813661.9140956, "step_id": 246, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813661.9338903, "step_id": 247, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813661.9522274, "step_id": 248, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813661.9709105, "step_id": 249, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813661.990142, "step_id": 250, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813662.0093503, "step_id": 251, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813662.0286906, "step_id": 252, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813662.0479674, "step_id": 253, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813662.067404, "step_id": 254, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813662.0865054, "step_id": 255, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813662.1077895, "step_id": 256, "start_load_kv_us": 3, "get_finished_us": 333} +{"t_unix": 1779813662.12556, "step_id": 257, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813662.1405997, "step_id": 258, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813662.155849, "step_id": 259, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813662.1716022, "step_id": 260, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813662.1873062, "step_id": 261, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813662.2027154, "step_id": 262, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813662.2184293, "step_id": 263, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813662.2340877, "step_id": 264, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813662.2498841, "step_id": 265, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813662.2658541, "step_id": 266, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813662.2814636, "step_id": 267, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813662.2975225, "step_id": 268, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813662.3129342, "step_id": 269, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813662.329052, "step_id": 270, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813662.34498, "step_id": 271, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813662.360985, "step_id": 272, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813662.3766108, "step_id": 273, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813662.392514, "step_id": 274, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813662.408752, "step_id": 275, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813662.424637, "step_id": 276, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813662.4402633, "step_id": 277, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813662.4557686, "step_id": 278, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813662.471266, "step_id": 279, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813662.486809, "step_id": 280, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813662.5021222, "step_id": 281, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813662.5177805, "step_id": 282, "start_load_kv_us": 13, "get_finished_us": 182} +{"t_unix": 1779813662.5334768, "step_id": 283, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813662.5491061, "step_id": 284, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813662.5647552, "step_id": 285, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813662.5802312, "step_id": 286, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813662.5955381, "step_id": 287, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813662.6107476, "step_id": 288, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813662.6266139, "step_id": 289, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813662.642474, "step_id": 290, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813662.658008, "step_id": 291, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813662.6735253, "step_id": 292, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813662.690934, "step_id": 293, "start_load_kv_us": 6, "get_finished_us": 166} +{"t_unix": 1779813662.7045956, "step_id": 294, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813662.720215, "step_id": 295, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813662.7356539, "step_id": 296, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813662.7509673, "step_id": 297, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813662.7670822, "step_id": 298, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813662.7820153, "step_id": 299, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813662.797141, "step_id": 300, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813662.8115354, "step_id": 301, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813662.825602, "step_id": 302, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813662.8400981, "step_id": 303, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813662.8548572, "step_id": 304, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813662.8698332, "step_id": 305, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813662.8845718, "step_id": 306, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813662.89939, "step_id": 307, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813662.914509, "step_id": 308, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813662.92878, "step_id": 309, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813662.943467, "step_id": 310, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813662.9578044, "step_id": 311, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813662.9717665, "step_id": 312, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813662.9860055, "step_id": 313, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813663.0003982, "step_id": 314, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813663.0149996, "step_id": 315, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813663.0298972, "step_id": 316, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813663.044695, "step_id": 317, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813663.0591917, "step_id": 318, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813663.0739658, "step_id": 319, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813663.088377, "step_id": 320, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813663.1028278, "step_id": 321, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813663.1174197, "step_id": 322, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813663.1317925, "step_id": 323, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813663.1459992, "step_id": 324, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813663.1600802, "step_id": 325, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813663.174524, "step_id": 326, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813663.188956, "step_id": 327, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813663.2035322, "step_id": 328, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813663.218825, "step_id": 329, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813663.2334056, "step_id": 330, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813663.246129, "step_id": 331, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813663.2584708, "step_id": 332, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813663.2701886, "step_id": 333, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813663.2805226, "step_id": 334, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813663.2912772, "step_id": 335, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813663.3012035, "step_id": 336, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813663.3114138, "step_id": 337, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813663.3221693, "step_id": 338, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813663.3325958, "step_id": 339, "start_load_kv_us": 3, "get_finished_us": 191} +{"t_unix": 1779813663.3430848, "step_id": 340, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813663.353111, "step_id": 341, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813663.3633199, "step_id": 342, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813663.3736084, "step_id": 343, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813663.3838348, "step_id": 344, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813663.3941648, "step_id": 345, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813663.4042113, "step_id": 346, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813663.4140477, "step_id": 347, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813663.423747, "step_id": 348, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813663.4332204, "step_id": 349, "start_load_kv_us": 3, "get_finished_us": 169} +{"t_unix": 1779813663.4434927, "step_id": 350, "start_load_kv_us": 3, "get_finished_us": 268} +{"t_unix": 1779813663.4533424, "step_id": 351, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813663.4615655, "step_id": 352, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813663.469002, "step_id": 353, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813663.4767418, "step_id": 354, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813663.4844797, "step_id": 355, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813663.4930227, "step_id": 356, "start_load_kv_us": 3, "get_finished_us": 170} +{"t_unix": 1779813663.5015233, "step_id": 357, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813663.5104902, "step_id": 358, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813663.5190568, "step_id": 359, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813663.5278113, "step_id": 360, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813663.5365374, "step_id": 361, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813663.5450027, "step_id": 362, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813663.553476, "step_id": 363, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813663.5624754, "step_id": 364, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813663.5709267, "step_id": 365, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813663.5779364, "step_id": 366, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813663.5850403, "step_id": 367, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813663.5923378, "step_id": 368, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813663.6018617, "step_id": 369, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813663.6070247, "step_id": 370, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813663.6127243, "step_id": 371, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813663.61864, "step_id": 372, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813663.624814, "step_id": 373, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813663.63125, "step_id": 374, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813663.6376395, "step_id": 375, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813663.6438189, "step_id": 376, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813663.6502113, "step_id": 377, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813663.6574216, "step_id": 378, "start_load_kv_us": 12, "get_finished_us": 228} +{"t_unix": 1779813663.6628385, "step_id": 379, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813663.6686294, "step_id": 380, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813663.6746953, "step_id": 381, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813663.6810172, "step_id": 382, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813663.686916, "step_id": 383, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813663.693056, "step_id": 384, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813663.6989727, "step_id": 385, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813663.7050886, "step_id": 386, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813663.7111664, "step_id": 387, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813663.7173557, "step_id": 388, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813663.7235944, "step_id": 389, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813663.72975, "step_id": 390, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813663.735884, "step_id": 391, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813663.7419562, "step_id": 392, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813663.7481818, "step_id": 393, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813663.7543795, "step_id": 394, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813663.7606213, "step_id": 395, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813663.7668526, "step_id": 396, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813663.7732089, "step_id": 397, "start_load_kv_us": 3, "get_finished_us": 193} +{"t_unix": 1779813663.7795043, "step_id": 398, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813663.7858863, "step_id": 399, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813663.7921774, "step_id": 400, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813663.7985399, "step_id": 401, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813663.8049839, "step_id": 402, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813663.8113742, "step_id": 403, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813663.8177967, "step_id": 404, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813663.8241427, "step_id": 405, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813663.8305259, "step_id": 406, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813663.8368948, "step_id": 407, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813663.8432646, "step_id": 408, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813663.8498085, "step_id": 409, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813663.8571148, "step_id": 410, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813663.8626363, "step_id": 411, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813663.8691292, "step_id": 412, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813663.8755152, "step_id": 413, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813663.881961, "step_id": 414, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813663.888388, "step_id": 415, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813663.894705, "step_id": 416, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813663.9010532, "step_id": 417, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813663.9076328, "step_id": 418, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813663.9141076, "step_id": 419, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813663.920544, "step_id": 420, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813663.926978, "step_id": 421, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813663.933395, "step_id": 422, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813663.987391, "step_id": 423, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813663.989668, "step_id": 424, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813664.1800585, "step_id": 425, "start_load_kv_us": 3, "get_finished_us": 423} +{"t_unix": 1779813664.186488, "step_id": 426, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813664.1944506, "step_id": 427, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813664.2024279, "step_id": 428, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813664.2104933, "step_id": 429, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813664.2184317, "step_id": 430, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813664.2263887, "step_id": 431, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813664.234262, "step_id": 432, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813664.242355, "step_id": 433, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813664.2503002, "step_id": 434, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813664.2582467, "step_id": 435, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813664.266393, "step_id": 436, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813664.2734656, "step_id": 437, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813664.2812176, "step_id": 438, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813664.2888222, "step_id": 439, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813664.3413496, "step_id": 440, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813664.3435845, "step_id": 441, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813664.5392528, "step_id": 442, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813664.547265, "step_id": 443, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813664.5554314, "step_id": 444, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813664.5632102, "step_id": 445, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813664.5714042, "step_id": 446, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813664.5796483, "step_id": 447, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813664.5875082, "step_id": 448, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813664.5950685, "step_id": 449, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813664.6030617, "step_id": 450, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813664.6107862, "step_id": 451, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813664.6187892, "step_id": 452, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813664.6266556, "step_id": 453, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813664.6344216, "step_id": 454, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813664.6423566, "step_id": 455, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813664.6504774, "step_id": 456, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813664.6584077, "step_id": 457, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813664.6665194, "step_id": 458, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813664.6742966, "step_id": 459, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813664.6823268, "step_id": 460, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813664.6902933, "step_id": 461, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813664.6979766, "step_id": 462, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813664.7062314, "step_id": 463, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813664.7144575, "step_id": 464, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813664.7227347, "step_id": 465, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813664.7311454, "step_id": 466, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813664.7394984, "step_id": 467, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813664.7479658, "step_id": 468, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813664.7559175, "step_id": 469, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813664.8103437, "step_id": 470, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813664.8127687, "step_id": 471, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813665.0496643, "step_id": 472, "start_load_kv_us": 3, "get_finished_us": 344} +{"t_unix": 1779813665.0520995, "step_id": 473, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813665.2529862, "step_id": 474, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813665.2632902, "step_id": 475, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813665.2732677, "step_id": 476, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813665.2832038, "step_id": 477, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813665.2934058, "step_id": 478, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813665.303541, "step_id": 479, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813665.3134074, "step_id": 480, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813665.323342, "step_id": 481, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813665.3331757, "step_id": 482, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813665.3428876, "step_id": 483, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813665.353251, "step_id": 484, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813665.363714, "step_id": 485, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813665.3742597, "step_id": 486, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813665.3850906, "step_id": 487, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813665.395542, "step_id": 488, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813665.4061668, "step_id": 489, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813665.4168131, "step_id": 490, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813665.4270017, "step_id": 491, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813665.4374177, "step_id": 492, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813665.4482305, "step_id": 493, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813665.4589775, "step_id": 494, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813665.469494, "step_id": 495, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813665.4799666, "step_id": 496, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813665.490473, "step_id": 497, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813665.4983678, "step_id": 498, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813665.5063572, "step_id": 499, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813665.5145943, "step_id": 500, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813665.5226567, "step_id": 501, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813665.5303848, "step_id": 502, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813665.538423, "step_id": 503, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813665.5463798, "step_id": 504, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813665.5540643, "step_id": 505, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813665.5620747, "step_id": 506, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813665.5702627, "step_id": 507, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813665.57825, "step_id": 508, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813665.5864618, "step_id": 509, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813665.5943305, "step_id": 510, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813665.6023428, "step_id": 511, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813665.6103163, "step_id": 512, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813665.618356, "step_id": 513, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813665.6263494, "step_id": 514, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813665.6344304, "step_id": 515, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813665.6426616, "step_id": 516, "start_load_kv_us": 18, "get_finished_us": 173} +{"t_unix": 1779813665.65058, "step_id": 517, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813665.658659, "step_id": 518, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813665.6666799, "step_id": 519, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813665.6749043, "step_id": 520, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813665.6833363, "step_id": 521, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813665.6915243, "step_id": 522, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813665.6998534, "step_id": 523, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813665.7081335, "step_id": 524, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813665.7602293, "step_id": 525, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813665.7628593, "step_id": 526, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813666.005316, "step_id": 527, "start_load_kv_us": 2, "get_finished_us": 405} +{"t_unix": 1779813666.007919, "step_id": 528, "start_load_kv_us": 5, "get_finished_us": 194} +{"t_unix": 1779813666.2545884, "step_id": 529, "start_load_kv_us": 3, "get_finished_us": 346} +{"t_unix": 1779813666.2570922, "step_id": 530, "start_load_kv_us": 3, "get_finished_us": 221} +{"t_unix": 1779813666.7149005, "step_id": 531, "start_load_kv_us": 6, "get_finished_us": 521} +{"t_unix": 1779813666.7180846, "step_id": 532, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813666.9182353, "step_id": 533, "start_load_kv_us": 3, "get_finished_us": 367} +{"t_unix": 1779813666.9289002, "step_id": 534, "start_load_kv_us": 3, "get_finished_us": 213} +{"t_unix": 1779813666.9404304, "step_id": 535, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813666.9513724, "step_id": 536, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813666.9630938, "step_id": 537, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813666.974518, "step_id": 538, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813666.9862452, "step_id": 539, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813666.997935, "step_id": 540, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813667.009708, "step_id": 541, "start_load_kv_us": 3, "get_finished_us": 219} +{"t_unix": 1779813667.0214937, "step_id": 542, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813667.0334551, "step_id": 543, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813667.045056, "step_id": 544, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813667.0567563, "step_id": 545, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813667.068411, "step_id": 546, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813667.0801198, "step_id": 547, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813667.0917132, "step_id": 548, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813667.103473, "step_id": 549, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813667.114568, "step_id": 550, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813667.1260986, "step_id": 551, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813667.1369624, "step_id": 552, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813667.1473246, "step_id": 553, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813667.1580572, "step_id": 554, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813667.169053, "step_id": 555, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813667.1800966, "step_id": 556, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813667.1910396, "step_id": 557, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813667.2018387, "step_id": 558, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813667.2128043, "step_id": 559, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813667.2247522, "step_id": 560, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813667.236303, "step_id": 561, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813667.2482836, "step_id": 562, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813667.2600064, "step_id": 563, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813667.2716994, "step_id": 564, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813667.2833686, "step_id": 565, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813667.2953262, "step_id": 566, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813667.3067937, "step_id": 567, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813667.3186548, "step_id": 568, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813667.3301492, "step_id": 569, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813667.342134, "step_id": 570, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813667.3542902, "step_id": 571, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813667.366488, "step_id": 572, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813667.378261, "step_id": 573, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813667.3896992, "step_id": 574, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813667.4014184, "step_id": 575, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813667.4134827, "step_id": 576, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813667.4258718, "step_id": 577, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813667.438365, "step_id": 578, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813667.4506607, "step_id": 579, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813667.463229, "step_id": 580, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813667.4758205, "step_id": 581, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813667.48843, "step_id": 582, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813667.500853, "step_id": 583, "start_load_kv_us": 3, "get_finished_us": 191} +{"t_unix": 1779813667.5135632, "step_id": 584, "start_load_kv_us": 7, "get_finished_us": 257} +{"t_unix": 1779813667.5259213, "step_id": 585, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813667.5382388, "step_id": 586, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813667.550135, "step_id": 587, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813667.5624037, "step_id": 588, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813667.5743673, "step_id": 589, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813667.586641, "step_id": 590, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813667.5990891, "step_id": 591, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813667.6112077, "step_id": 592, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813667.6231368, "step_id": 593, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813667.635486, "step_id": 594, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813667.6476827, "step_id": 595, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813667.6602378, "step_id": 596, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813667.6724606, "step_id": 597, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813667.684737, "step_id": 598, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813667.6972523, "step_id": 599, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813667.709573, "step_id": 600, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813667.7212527, "step_id": 601, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813667.7333527, "step_id": 602, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813667.7453842, "step_id": 603, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813667.757381, "step_id": 604, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813667.7690723, "step_id": 605, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813667.78056, "step_id": 606, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813667.7939787, "step_id": 607, "start_load_kv_us": 3, "get_finished_us": 344} +{"t_unix": 1779813667.8040712, "step_id": 608, "start_load_kv_us": 3, "get_finished_us": 291} +{"t_unix": 1779813667.8154247, "step_id": 609, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813667.8269875, "step_id": 610, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813667.838912, "step_id": 611, "start_load_kv_us": 3, "get_finished_us": 195} +{"t_unix": 1779813667.8508425, "step_id": 612, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813667.8622806, "step_id": 613, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813667.8738961, "step_id": 614, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813667.885895, "step_id": 615, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813667.8976426, "step_id": 616, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813667.9091291, "step_id": 617, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813667.9205418, "step_id": 618, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813667.9322762, "step_id": 619, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813667.9440942, "step_id": 620, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813667.956055, "step_id": 621, "start_load_kv_us": 3, "get_finished_us": 250} +{"t_unix": 1779813667.968043, "step_id": 622, "start_load_kv_us": 3, "get_finished_us": 190} +{"t_unix": 1779813667.9802296, "step_id": 623, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813667.9921708, "step_id": 624, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813668.004058, "step_id": 625, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813668.01593, "step_id": 626, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813668.0277462, "step_id": 627, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813668.0400102, "step_id": 628, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813668.0522828, "step_id": 629, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813668.0642526, "step_id": 630, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813668.0764737, "step_id": 631, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813668.0883353, "step_id": 632, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813668.1006885, "step_id": 633, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813668.1128583, "step_id": 634, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813668.1252103, "step_id": 635, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813668.1373208, "step_id": 636, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813668.1494625, "step_id": 637, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813668.1616638, "step_id": 638, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813668.1738937, "step_id": 639, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813668.1860163, "step_id": 640, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813668.1977372, "step_id": 641, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813668.2097569, "step_id": 642, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813668.2221105, "step_id": 643, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813668.2342203, "step_id": 644, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813668.2462783, "step_id": 645, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813668.2583857, "step_id": 646, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813668.2703397, "step_id": 647, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813668.2825892, "step_id": 648, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813668.2946663, "step_id": 649, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813668.306926, "step_id": 650, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813668.3193, "step_id": 651, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813668.3313155, "step_id": 652, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813668.3434334, "step_id": 653, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813668.3555255, "step_id": 654, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813668.3677797, "step_id": 655, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813668.3797064, "step_id": 656, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813668.3920178, "step_id": 657, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813668.4044223, "step_id": 658, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813668.4162955, "step_id": 659, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813668.428115, "step_id": 660, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813668.4400723, "step_id": 661, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813668.4521177, "step_id": 662, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813668.464009, "step_id": 663, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813668.4757602, "step_id": 664, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813668.4878395, "step_id": 665, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813668.499997, "step_id": 666, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813668.5119755, "step_id": 667, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813668.5242615, "step_id": 668, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813668.5369034, "step_id": 669, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813668.5494764, "step_id": 670, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813668.5616858, "step_id": 671, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813668.5740693, "step_id": 672, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813668.586465, "step_id": 673, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813668.5986843, "step_id": 674, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813668.611372, "step_id": 675, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813668.6238647, "step_id": 676, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813668.636342, "step_id": 677, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813668.6492937, "step_id": 678, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813668.6622381, "step_id": 679, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813668.674111, "step_id": 680, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813668.685532, "step_id": 681, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813668.6975782, "step_id": 682, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813668.7098222, "step_id": 683, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813668.7625618, "step_id": 684, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813668.7648892, "step_id": 685, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813668.9742336, "step_id": 686, "start_load_kv_us": 8, "get_finished_us": 375} +{"t_unix": 1779813668.9822347, "step_id": 687, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813668.9945054, "step_id": 688, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813669.0071938, "step_id": 689, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813669.0192769, "step_id": 690, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813669.0314803, "step_id": 691, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813669.0435066, "step_id": 692, "start_load_kv_us": 3, "get_finished_us": 198} +{"t_unix": 1779813669.0558085, "step_id": 693, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813669.068082, "step_id": 694, "start_load_kv_us": 3, "get_finished_us": 207} +{"t_unix": 1779813669.080527, "step_id": 695, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813669.092959, "step_id": 696, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813669.1051025, "step_id": 697, "start_load_kv_us": 3, "get_finished_us": 215} +{"t_unix": 1779813669.1171682, "step_id": 698, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813669.129638, "step_id": 699, "start_load_kv_us": 2, "get_finished_us": 345} +{"t_unix": 1779813669.1416786, "step_id": 700, "start_load_kv_us": 15, "get_finished_us": 190} +{"t_unix": 1779813669.1539538, "step_id": 701, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813669.1660414, "step_id": 702, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813669.178075, "step_id": 703, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813669.1902413, "step_id": 704, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813669.2022927, "step_id": 705, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813669.217472, "step_id": 706, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813669.2266557, "step_id": 707, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813669.238343, "step_id": 708, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813669.250452, "step_id": 709, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813669.26282, "step_id": 710, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813669.2748542, "step_id": 711, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813669.2869012, "step_id": 712, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813669.2990944, "step_id": 713, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813669.3114624, "step_id": 714, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813669.3236496, "step_id": 715, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813669.3359077, "step_id": 716, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813669.3483782, "step_id": 717, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813669.360725, "step_id": 718, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813669.3727727, "step_id": 719, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813669.38513, "step_id": 720, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813669.3974788, "step_id": 721, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813669.4099123, "step_id": 722, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813669.4221365, "step_id": 723, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813669.4347997, "step_id": 724, "start_load_kv_us": 15, "get_finished_us": 307} +{"t_unix": 1779813669.4500456, "step_id": 725, "start_load_kv_us": 3, "get_finished_us": 314} +{"t_unix": 1779813669.459407, "step_id": 726, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813669.4717228, "step_id": 727, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813669.4840798, "step_id": 728, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813669.4965255, "step_id": 729, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813669.5066857, "step_id": 730, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813669.5156786, "step_id": 731, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813669.5260174, "step_id": 732, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813669.5358038, "step_id": 733, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813669.5459814, "step_id": 734, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813669.5563035, "step_id": 735, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813669.5664737, "step_id": 736, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813669.5763109, "step_id": 737, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813669.586288, "step_id": 738, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813669.5960517, "step_id": 739, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813669.6062663, "step_id": 740, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813669.6165798, "step_id": 741, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813669.6272545, "step_id": 742, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813669.6377804, "step_id": 743, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813669.6477106, "step_id": 744, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813669.658156, "step_id": 745, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813669.668504, "step_id": 746, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813669.6787171, "step_id": 747, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813669.6892629, "step_id": 748, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813669.6988878, "step_id": 749, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813669.7091167, "step_id": 750, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813669.7192924, "step_id": 751, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813669.7291467, "step_id": 752, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813669.7387815, "step_id": 753, "start_load_kv_us": 13, "get_finished_us": 182} +{"t_unix": 1779813669.7490933, "step_id": 754, "start_load_kv_us": 3, "get_finished_us": 208} +{"t_unix": 1779813669.7592714, "step_id": 755, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813669.7694786, "step_id": 756, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813669.7795615, "step_id": 757, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813669.791958, "step_id": 758, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813669.803007, "step_id": 759, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813669.810627, "step_id": 760, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813669.8209362, "step_id": 761, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813669.8309095, "step_id": 762, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813669.8412561, "step_id": 763, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813669.8516638, "step_id": 764, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813669.8618443, "step_id": 765, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813669.8721597, "step_id": 766, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813669.8823292, "step_id": 767, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813669.8924854, "step_id": 768, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813669.9030175, "step_id": 769, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813669.913284, "step_id": 770, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813669.9237156, "step_id": 771, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813669.9338875, "step_id": 772, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813669.9441898, "step_id": 773, "start_load_kv_us": 14, "get_finished_us": 194} +{"t_unix": 1779813669.954294, "step_id": 774, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813669.9643593, "step_id": 775, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813669.9744225, "step_id": 776, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813669.9843056, "step_id": 777, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813669.9941995, "step_id": 778, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813670.004047, "step_id": 779, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813670.0143454, "step_id": 780, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813670.0249014, "step_id": 781, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813670.0349948, "step_id": 782, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813670.0452106, "step_id": 783, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813670.055379, "step_id": 784, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813670.0638697, "step_id": 785, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813670.0717676, "step_id": 786, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813670.0799692, "step_id": 787, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813670.083807, "step_id": 788, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813670.0887005, "step_id": 789, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813670.0941062, "step_id": 790, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813670.0987504, "step_id": 791, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813670.1038544, "step_id": 792, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813670.1089733, "step_id": 793, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813670.1140924, "step_id": 794, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813670.1192691, "step_id": 795, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813670.1242824, "step_id": 796, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813670.1293051, "step_id": 797, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813670.1343772, "step_id": 798, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813670.1394258, "step_id": 799, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813670.1445594, "step_id": 800, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813670.149595, "step_id": 801, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813670.1549063, "step_id": 802, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813670.1598043, "step_id": 803, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813670.1648629, "step_id": 804, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813670.1700218, "step_id": 805, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813670.1750655, "step_id": 806, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813670.1801116, "step_id": 807, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813670.1851938, "step_id": 808, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813670.190309, "step_id": 809, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813670.1953743, "step_id": 810, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813670.20048, "step_id": 811, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813670.2056513, "step_id": 812, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813670.2107224, "step_id": 813, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813670.2158186, "step_id": 814, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813670.220832, "step_id": 815, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813670.225982, "step_id": 816, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813670.2310033, "step_id": 817, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813670.236146, "step_id": 818, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813670.2411335, "step_id": 819, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813670.246305, "step_id": 820, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813670.2566288, "step_id": 821, "start_load_kv_us": 7, "get_finished_us": 735} +{"t_unix": 1779813670.258858, "step_id": 822, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813670.2625859, "step_id": 823, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813670.2677207, "step_id": 824, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813670.2727926, "step_id": 825, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813670.277873, "step_id": 826, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813670.282988, "step_id": 827, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813670.2881472, "step_id": 828, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813670.2931767, "step_id": 829, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813670.2984233, "step_id": 830, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813670.3034484, "step_id": 831, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813670.3085804, "step_id": 832, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813670.3135734, "step_id": 833, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813670.3186758, "step_id": 834, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813670.3238354, "step_id": 835, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813670.328962, "step_id": 836, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813670.333983, "step_id": 837, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813670.3391297, "step_id": 838, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813670.3441865, "step_id": 839, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813670.3493254, "step_id": 840, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813670.354401, "step_id": 841, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813670.359473, "step_id": 842, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813670.3645873, "step_id": 843, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813670.3697124, "step_id": 844, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813670.3748114, "step_id": 845, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813670.3799658, "step_id": 846, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813670.3850622, "step_id": 847, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813670.3902051, "step_id": 848, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813670.395225, "step_id": 849, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813670.4003057, "step_id": 850, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813670.405406, "step_id": 851, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813670.4105353, "step_id": 852, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813670.4156585, "step_id": 853, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813670.4207375, "step_id": 854, "start_load_kv_us": 3, "get_finished_us": 139} +{"t_unix": 1779813670.425858, "step_id": 855, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813670.4309704, "step_id": 856, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813670.4360476, "step_id": 857, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813670.4413247, "step_id": 858, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813670.4463258, "step_id": 859, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813670.4514544, "step_id": 860, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813670.4565148, "step_id": 861, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813670.4616044, "step_id": 862, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813670.4667258, "step_id": 863, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813670.4719138, "step_id": 864, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813670.476986, "step_id": 865, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813670.482039, "step_id": 866, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813670.487088, "step_id": 867, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813670.4922726, "step_id": 868, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813670.497373, "step_id": 869, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813670.502541, "step_id": 870, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813670.5076048, "step_id": 871, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813670.5132418, "step_id": 872, "start_load_kv_us": 3, "get_finished_us": 232} +{"t_unix": 1779813670.5178792, "step_id": 873, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813670.5229287, "step_id": 874, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813670.5281467, "step_id": 875, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813670.533237, "step_id": 876, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813670.538281, "step_id": 877, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813670.5433762, "step_id": 878, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813670.5485146, "step_id": 879, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813670.553635, "step_id": 880, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813670.5587902, "step_id": 881, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813670.5638213, "step_id": 882, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813670.5688756, "step_id": 883, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813670.5739827, "step_id": 884, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813670.5790546, "step_id": 885, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813670.5842338, "step_id": 886, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813670.5893586, "step_id": 887, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813670.5943618, "step_id": 888, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813670.5994654, "step_id": 889, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813670.6045277, "step_id": 890, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813670.609662, "step_id": 891, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813670.614798, "step_id": 892, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813670.6199532, "step_id": 893, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813670.6250901, "step_id": 894, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813670.630172, "step_id": 895, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813670.6353295, "step_id": 896, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813670.6404035, "step_id": 897, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813670.6454105, "step_id": 898, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813670.6506255, "step_id": 899, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813670.65567, "step_id": 900, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813670.660756, "step_id": 901, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813670.665856, "step_id": 902, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813670.6710532, "step_id": 903, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813670.676096, "step_id": 904, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813670.681205, "step_id": 905, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813670.6863961, "step_id": 906, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813670.6914968, "step_id": 907, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813670.6964953, "step_id": 908, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813670.7016137, "step_id": 909, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813670.7067451, "step_id": 910, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813670.71185, "step_id": 911, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813670.7170005, "step_id": 912, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813670.7220867, "step_id": 913, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813670.7271628, "step_id": 914, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813670.7322547, "step_id": 915, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813670.7373464, "step_id": 916, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813670.7424936, "step_id": 917, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813670.7475967, "step_id": 918, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813670.7527416, "step_id": 919, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813670.757842, "step_id": 920, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813670.7629213, "step_id": 921, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813670.7680717, "step_id": 922, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813670.7733164, "step_id": 923, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813670.778233, "step_id": 924, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813670.7832606, "step_id": 925, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813670.7884028, "step_id": 926, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813670.7934804, "step_id": 927, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813670.7987072, "step_id": 928, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813670.803709, "step_id": 929, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813670.808822, "step_id": 930, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813670.8139682, "step_id": 931, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813670.8190534, "step_id": 932, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813670.824089, "step_id": 933, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813670.8291798, "step_id": 934, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813670.8342986, "step_id": 935, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813670.8394163, "step_id": 936, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813670.8445177, "step_id": 937, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813670.8496041, "step_id": 938, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813670.8548005, "step_id": 939, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813670.8596816, "step_id": 940, "start_load_kv_us": 4, "get_finished_us": 167} +{"t_unix": 1779813670.8640153, "step_id": 941, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813671.331817, "step_id": 942, "start_load_kv_us": 2, "get_finished_us": 348} +{"t_unix": 1779813671.333922, "step_id": 943, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813671.5260715, "step_id": 944, "start_load_kv_us": 3, "get_finished_us": 309} +{"t_unix": 1779813671.5306132, "step_id": 945, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813671.535609, "step_id": 946, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813671.5406375, "step_id": 947, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813671.545972, "step_id": 948, "start_load_kv_us": 3, "get_finished_us": 196} +{"t_unix": 1779813671.5509894, "step_id": 949, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813671.5560703, "step_id": 950, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813671.561197, "step_id": 951, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813671.5661345, "step_id": 952, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813671.571295, "step_id": 953, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813671.5762873, "step_id": 954, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813671.5814695, "step_id": 955, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813671.5865088, "step_id": 956, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813671.591615, "step_id": 957, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813671.5966754, "step_id": 958, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813671.6017904, "step_id": 959, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813671.6068368, "step_id": 960, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813671.6120267, "step_id": 961, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813671.6170478, "step_id": 962, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813671.6221569, "step_id": 963, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813671.6272004, "step_id": 964, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813671.6322489, "step_id": 965, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813671.637357, "step_id": 966, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813671.6424696, "step_id": 967, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813671.6475925, "step_id": 968, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813671.6527066, "step_id": 969, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813671.6577654, "step_id": 970, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813671.6629357, "step_id": 971, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813671.6679554, "step_id": 972, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813671.6731803, "step_id": 973, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813671.6781437, "step_id": 974, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813671.683212, "step_id": 975, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813671.6884017, "step_id": 976, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813671.6935716, "step_id": 977, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813671.6986153, "step_id": 978, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813671.7037203, "step_id": 979, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813671.7087643, "step_id": 980, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813671.714088, "step_id": 981, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813671.71898, "step_id": 982, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813671.7240427, "step_id": 983, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813671.7291021, "step_id": 984, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813671.7341871, "step_id": 985, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813671.739333, "step_id": 986, "start_load_kv_us": 3, "get_finished_us": 152} +{"t_unix": 1779813671.7443936, "step_id": 987, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813671.7494717, "step_id": 988, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813671.7545912, "step_id": 989, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813671.7597082, "step_id": 990, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813671.764823, "step_id": 991, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813671.7698932, "step_id": 992, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813671.7751193, "step_id": 993, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813671.7801287, "step_id": 994, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813671.7852495, "step_id": 995, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813671.790353, "step_id": 996, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813671.7954578, "step_id": 997, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813671.8005133, "step_id": 998, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813671.8056662, "step_id": 999, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813671.8108273, "step_id": 1000, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813671.8159041, "step_id": 1001, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813671.8211029, "step_id": 1002, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813671.8266492, "step_id": 1003, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813671.8313553, "step_id": 1004, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813671.8364744, "step_id": 1005, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813671.841614, "step_id": 1006, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813671.8471856, "step_id": 1007, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813671.851755, "step_id": 1008, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813671.8568034, "step_id": 1009, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813671.8619854, "step_id": 1010, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813671.8670006, "step_id": 1011, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813671.872127, "step_id": 1012, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813671.877132, "step_id": 1013, "start_load_kv_us": 14, "get_finished_us": 141} +{"t_unix": 1779813671.8822925, "step_id": 1014, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813671.887356, "step_id": 1015, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813671.8925166, "step_id": 1016, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813671.897572, "step_id": 1017, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813671.9027038, "step_id": 1018, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813671.907836, "step_id": 1019, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813671.9129353, "step_id": 1020, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813671.918055, "step_id": 1021, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813671.9230917, "step_id": 1022, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813671.9281836, "step_id": 1023, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813671.9332867, "step_id": 1024, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813671.9383376, "step_id": 1025, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813671.9433928, "step_id": 1026, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813671.948651, "step_id": 1027, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813671.9536858, "step_id": 1028, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813671.9587686, "step_id": 1029, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813671.9639769, "step_id": 1030, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813671.969082, "step_id": 1031, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813671.9741302, "step_id": 1032, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813671.9792907, "step_id": 1033, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813671.9843514, "step_id": 1034, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813671.9894292, "step_id": 1035, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813671.9944851, "step_id": 1036, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813671.9996293, "step_id": 1037, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813672.004749, "step_id": 1038, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813672.0098667, "step_id": 1039, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813672.015118, "step_id": 1040, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813672.020063, "step_id": 1041, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813672.0251608, "step_id": 1042, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813672.0303416, "step_id": 1043, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813672.035406, "step_id": 1044, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813672.0405848, "step_id": 1045, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813672.045615, "step_id": 1046, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813672.0509343, "step_id": 1047, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813672.0559883, "step_id": 1048, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813672.0611186, "step_id": 1049, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813672.066179, "step_id": 1050, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813672.071283, "step_id": 1051, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813672.0763083, "step_id": 1052, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813672.081374, "step_id": 1053, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813672.086418, "step_id": 1054, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813672.0915694, "step_id": 1055, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813672.096698, "step_id": 1056, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813672.1017704, "step_id": 1057, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813672.1068897, "step_id": 1058, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813672.1120625, "step_id": 1059, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813672.1174104, "step_id": 1060, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813672.122258, "step_id": 1061, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813672.127364, "step_id": 1062, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813672.1324627, "step_id": 1063, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813672.1376057, "step_id": 1064, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813672.1426988, "step_id": 1065, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813672.14776, "step_id": 1066, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813672.1529148, "step_id": 1067, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813672.1579382, "step_id": 1068, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813672.1630409, "step_id": 1069, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813672.1681807, "step_id": 1070, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813672.1733005, "step_id": 1071, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813672.1783555, "step_id": 1072, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813672.1835117, "step_id": 1073, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813672.1885917, "step_id": 1074, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813672.1937275, "step_id": 1075, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813672.2411366, "step_id": 1076, "start_load_kv_us": 18, "get_finished_us": 223} +{"t_unix": 1779813672.4287968, "step_id": 1077, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813672.4381962, "step_id": 1078, "start_load_kv_us": 15, "get_finished_us": 180} +{"t_unix": 1779813672.6728568, "step_id": 1079, "start_load_kv_us": 2, "get_finished_us": 329} +{"t_unix": 1779813672.6794589, "step_id": 1080, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813672.686467, "step_id": 1081, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813672.6934721, "step_id": 1082, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813672.700699, "step_id": 1083, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813672.7079105, "step_id": 1084, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813672.7151442, "step_id": 1085, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813672.7220407, "step_id": 1086, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813672.7289143, "step_id": 1087, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813672.7363517, "step_id": 1088, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813672.7437925, "step_id": 1089, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813672.7511203, "step_id": 1090, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813672.758933, "step_id": 1091, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813672.766592, "step_id": 1092, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813672.7741024, "step_id": 1093, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813672.7814658, "step_id": 1094, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813672.7883892, "step_id": 1095, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813672.795779, "step_id": 1096, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813672.8032181, "step_id": 1097, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813672.8106763, "step_id": 1098, "start_load_kv_us": 3, "get_finished_us": 189} +{"t_unix": 1779813672.8183558, "step_id": 1099, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813672.8255308, "step_id": 1100, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813672.8325412, "step_id": 1101, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813672.8395038, "step_id": 1102, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813672.8468754, "step_id": 1103, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813672.8544543, "step_id": 1104, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813672.861842, "step_id": 1105, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813672.8689172, "step_id": 1106, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813672.876413, "step_id": 1107, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813672.8838837, "step_id": 1108, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813672.8909647, "step_id": 1109, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813672.8982997, "step_id": 1110, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813672.9061224, "step_id": 1111, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813672.913661, "step_id": 1112, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813672.9211793, "step_id": 1113, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813672.9285064, "step_id": 1114, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813672.9357738, "step_id": 1115, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813672.942604, "step_id": 1116, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813672.9493835, "step_id": 1117, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813672.956492, "step_id": 1118, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813672.9639592, "step_id": 1119, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813672.9711955, "step_id": 1120, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813672.9783382, "step_id": 1121, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813672.9857774, "step_id": 1122, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813672.9931068, "step_id": 1123, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813673.0000803, "step_id": 1124, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813673.0071666, "step_id": 1125, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813673.0146277, "step_id": 1126, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813673.0219991, "step_id": 1127, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813673.029377, "step_id": 1128, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813673.0366712, "step_id": 1129, "start_load_kv_us": 2, "get_finished_us": 393} +{"t_unix": 1779813673.0436172, "step_id": 1130, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813673.0507042, "step_id": 1131, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813673.057429, "step_id": 1132, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813673.0643077, "step_id": 1133, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813673.0712678, "step_id": 1134, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813673.0785906, "step_id": 1135, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813673.0867162, "step_id": 1136, "start_load_kv_us": 21, "get_finished_us": 227} +{"t_unix": 1779813673.0934649, "step_id": 1137, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813673.1007524, "step_id": 1138, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813673.1084828, "step_id": 1139, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813673.1163924, "step_id": 1140, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813673.124133, "step_id": 1141, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813673.1321056, "step_id": 1142, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813673.1400087, "step_id": 1143, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813673.1476831, "step_id": 1144, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813673.1551495, "step_id": 1145, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813673.1627052, "step_id": 1146, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813673.170424, "step_id": 1147, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813673.1780055, "step_id": 1148, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813673.1859093, "step_id": 1149, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813673.193629, "step_id": 1150, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813673.201525, "step_id": 1151, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813673.2093859, "step_id": 1152, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813673.217299, "step_id": 1153, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813673.2252665, "step_id": 1154, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813673.2330182, "step_id": 1155, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813673.2405834, "step_id": 1156, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813673.248481, "step_id": 1157, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813673.256174, "step_id": 1158, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813673.264194, "step_id": 1159, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813673.2722163, "step_id": 1160, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813673.2799919, "step_id": 1161, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813673.2877455, "step_id": 1162, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813673.2955346, "step_id": 1163, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813673.3033452, "step_id": 1164, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813673.3112214, "step_id": 1165, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813673.3192258, "step_id": 1166, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813673.3270953, "step_id": 1167, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813673.3350966, "step_id": 1168, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813673.343102, "step_id": 1169, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813673.3511465, "step_id": 1170, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813673.3592424, "step_id": 1171, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813673.367286, "step_id": 1172, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813673.3753965, "step_id": 1173, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813673.383355, "step_id": 1174, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813673.3913677, "step_id": 1175, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813673.3995163, "step_id": 1176, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813673.4073703, "step_id": 1177, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813673.415468, "step_id": 1178, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813673.4236352, "step_id": 1179, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813673.4315293, "step_id": 1180, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813673.4395688, "step_id": 1181, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813673.4478278, "step_id": 1182, "start_load_kv_us": 14, "get_finished_us": 228} +{"t_unix": 1779813673.455881, "step_id": 1183, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813673.4638896, "step_id": 1184, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813673.4719412, "step_id": 1185, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.4800315, "step_id": 1186, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813673.4879909, "step_id": 1187, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813673.4959328, "step_id": 1188, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813673.5046556, "step_id": 1189, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813673.511988, "step_id": 1190, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813673.5198193, "step_id": 1191, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813673.5277376, "step_id": 1192, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.5353968, "step_id": 1193, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813673.543493, "step_id": 1194, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813673.5513966, "step_id": 1195, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813673.5592499, "step_id": 1196, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813673.5671656, "step_id": 1197, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813673.5754607, "step_id": 1198, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813673.5825667, "step_id": 1199, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813673.5884137, "step_id": 1200, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813673.5942833, "step_id": 1201, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813673.6000912, "step_id": 1202, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.6064615, "step_id": 1203, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813673.6125703, "step_id": 1204, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813673.6186225, "step_id": 1205, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813673.6247365, "step_id": 1206, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813673.6306884, "step_id": 1207, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813673.6366925, "step_id": 1208, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.6426108, "step_id": 1209, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813673.6488047, "step_id": 1210, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813673.654802, "step_id": 1211, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813673.6607628, "step_id": 1212, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813673.6670485, "step_id": 1213, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813673.6733088, "step_id": 1214, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813673.679613, "step_id": 1215, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813673.685346, "step_id": 1216, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813673.691678, "step_id": 1217, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813673.6978264, "step_id": 1218, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813673.7041469, "step_id": 1219, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813673.710325, "step_id": 1220, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813673.7162642, "step_id": 1221, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813673.7224145, "step_id": 1222, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813673.7285175, "step_id": 1223, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813673.7350948, "step_id": 1224, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813673.741463, "step_id": 1225, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813673.7478316, "step_id": 1226, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813673.7539618, "step_id": 1227, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.7600472, "step_id": 1228, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813673.765936, "step_id": 1229, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813673.7718647, "step_id": 1230, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813673.7779016, "step_id": 1231, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.7842467, "step_id": 1232, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813673.790349, "step_id": 1233, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813673.7966778, "step_id": 1234, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813673.805745, "step_id": 1235, "start_load_kv_us": 2, "get_finished_us": 383} +{"t_unix": 1779813673.808831, "step_id": 1236, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813673.8149648, "step_id": 1237, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813673.8209252, "step_id": 1238, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813673.8269818, "step_id": 1239, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813673.8327918, "step_id": 1240, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813673.8391678, "step_id": 1241, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813673.8451838, "step_id": 1242, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813673.8515031, "step_id": 1243, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813673.8578496, "step_id": 1244, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813673.8642452, "step_id": 1245, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813673.8702612, "step_id": 1246, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813673.8762953, "step_id": 1247, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813673.882495, "step_id": 1248, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813673.8888762, "step_id": 1249, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813673.8953218, "step_id": 1250, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813673.9015043, "step_id": 1251, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813673.907935, "step_id": 1252, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813673.9141872, "step_id": 1253, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813673.9205673, "step_id": 1254, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813673.9275956, "step_id": 1255, "start_load_kv_us": 3, "get_finished_us": 292} +{"t_unix": 1779813673.9328601, "step_id": 1256, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813673.938995, "step_id": 1257, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813673.9448726, "step_id": 1258, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813673.9508135, "step_id": 1259, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813673.9569948, "step_id": 1260, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813673.9629521, "step_id": 1261, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813673.9688704, "step_id": 1262, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813673.9748585, "step_id": 1263, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813673.9808743, "step_id": 1264, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813673.98696, "step_id": 1265, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813673.9931366, "step_id": 1266, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813673.9993296, "step_id": 1267, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813674.0056772, "step_id": 1268, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813674.0120537, "step_id": 1269, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813674.018332, "step_id": 1270, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813674.0245986, "step_id": 1271, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813674.0308254, "step_id": 1272, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813674.0371132, "step_id": 1273, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813674.0432608, "step_id": 1274, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813674.0497637, "step_id": 1275, "start_load_kv_us": 16, "get_finished_us": 277} +{"t_unix": 1779813674.0557983, "step_id": 1276, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813674.0617652, "step_id": 1277, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813674.0677311, "step_id": 1278, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813674.0736887, "step_id": 1279, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813674.1287522, "step_id": 1280, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813674.13103, "step_id": 1281, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813674.3226638, "step_id": 1282, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813674.3298025, "step_id": 1283, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813674.3374274, "step_id": 1284, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813674.3450062, "step_id": 1285, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813674.3526657, "step_id": 1286, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813674.3605218, "step_id": 1287, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813674.3679764, "step_id": 1288, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813674.3756366, "step_id": 1289, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813674.383423, "step_id": 1290, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813674.3911686, "step_id": 1291, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813674.3990386, "step_id": 1292, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813674.4069066, "step_id": 1293, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813674.4148846, "step_id": 1294, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813674.4225328, "step_id": 1295, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813674.4302993, "step_id": 1296, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813674.437913, "step_id": 1297, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813674.4453278, "step_id": 1298, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813674.4532123, "step_id": 1299, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813674.4610345, "step_id": 1300, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813674.4688244, "step_id": 1301, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813674.4764798, "step_id": 1302, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813674.4844081, "step_id": 1303, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813674.4921968, "step_id": 1304, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813674.500015, "step_id": 1305, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813674.5080016, "step_id": 1306, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813674.5152044, "step_id": 1307, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813674.5224006, "step_id": 1308, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813674.5300932, "step_id": 1309, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813674.5379698, "step_id": 1310, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813674.5457513, "step_id": 1311, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813674.5533657, "step_id": 1312, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813674.5608993, "step_id": 1313, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813674.5688512, "step_id": 1314, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813674.5766551, "step_id": 1315, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813674.584669, "step_id": 1316, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813674.5923216, "step_id": 1317, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813674.6000307, "step_id": 1318, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813674.607479, "step_id": 1319, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813674.614847, "step_id": 1320, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813674.622018, "step_id": 1321, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813674.629736, "step_id": 1322, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813674.6373994, "step_id": 1323, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813674.6448276, "step_id": 1324, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813674.6521745, "step_id": 1325, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813674.659318, "step_id": 1326, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813674.6671345, "step_id": 1327, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813674.6748884, "step_id": 1328, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813674.6823244, "step_id": 1329, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813674.6900914, "step_id": 1330, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813674.6978748, "step_id": 1331, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813674.70583, "step_id": 1332, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813674.7140214, "step_id": 1333, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813674.7197654, "step_id": 1334, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813674.7246225, "step_id": 1335, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813674.729682, "step_id": 1336, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813674.7347693, "step_id": 1337, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813674.739864, "step_id": 1338, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813674.744958, "step_id": 1339, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813674.7500484, "step_id": 1340, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813674.755171, "step_id": 1341, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813674.7603393, "step_id": 1342, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813674.765384, "step_id": 1343, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813674.7704127, "step_id": 1344, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813674.775779, "step_id": 1345, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813674.7805893, "step_id": 1346, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813674.7857218, "step_id": 1347, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813674.7907774, "step_id": 1348, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813674.7959032, "step_id": 1349, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813674.8009658, "step_id": 1350, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813674.806076, "step_id": 1351, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813674.811202, "step_id": 1352, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813674.8162336, "step_id": 1353, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813674.82125, "step_id": 1354, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813674.826327, "step_id": 1355, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813674.8313794, "step_id": 1356, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813674.836497, "step_id": 1357, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813674.841732, "step_id": 1358, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813674.8467097, "step_id": 1359, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813674.8518865, "step_id": 1360, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813674.8569295, "step_id": 1361, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813674.8620968, "step_id": 1362, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813674.8672428, "step_id": 1363, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813674.8723085, "step_id": 1364, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813674.877449, "step_id": 1365, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813674.8825219, "step_id": 1366, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813674.887739, "step_id": 1367, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813674.8926835, "step_id": 1368, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813674.8979163, "step_id": 1369, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813674.9030352, "step_id": 1370, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813674.908182, "step_id": 1371, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813674.9131563, "step_id": 1372, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813674.9183004, "step_id": 1373, "start_load_kv_us": 3, "get_finished_us": 178} +{"t_unix": 1779813674.9234295, "step_id": 1374, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813674.9284585, "step_id": 1375, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813674.933602, "step_id": 1376, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813674.9387236, "step_id": 1377, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813674.9438136, "step_id": 1378, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813674.9489174, "step_id": 1379, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813674.9540079, "step_id": 1380, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813674.9591835, "step_id": 1381, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813674.9642258, "step_id": 1382, "start_load_kv_us": 12, "get_finished_us": 236} +{"t_unix": 1779813674.9692953, "step_id": 1383, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813674.9743845, "step_id": 1384, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813674.9794621, "step_id": 1385, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813674.9846091, "step_id": 1386, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813674.9896796, "step_id": 1387, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813674.994773, "step_id": 1388, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813674.9998736, "step_id": 1389, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813675.0050533, "step_id": 1390, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813675.0100963, "step_id": 1391, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813675.0151665, "step_id": 1392, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813675.0202773, "step_id": 1393, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813675.0253658, "step_id": 1394, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813675.030452, "step_id": 1395, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813675.0355618, "step_id": 1396, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813675.040693, "step_id": 1397, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813675.0457957, "step_id": 1398, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813675.0509152, "step_id": 1399, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813675.0560038, "step_id": 1400, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813675.0611715, "step_id": 1401, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813675.0662174, "step_id": 1402, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813675.071338, "step_id": 1403, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813675.07643, "step_id": 1404, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813675.081567, "step_id": 1405, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813675.086715, "step_id": 1406, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813675.0918958, "step_id": 1407, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813675.0969024, "step_id": 1408, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813675.1020415, "step_id": 1409, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813675.1070843, "step_id": 1410, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813675.1121895, "step_id": 1411, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813675.1173658, "step_id": 1412, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813675.1224623, "step_id": 1413, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813675.1275978, "step_id": 1414, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813675.1326585, "step_id": 1415, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813675.1377585, "step_id": 1416, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813675.1428485, "step_id": 1417, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813675.1479535, "step_id": 1418, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813675.1530457, "step_id": 1419, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813675.1581666, "step_id": 1420, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813675.1633034, "step_id": 1421, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813675.1684704, "step_id": 1422, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813675.1734972, "step_id": 1423, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813675.1786075, "step_id": 1424, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813675.1837163, "step_id": 1425, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813675.1888692, "step_id": 1426, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813675.194053, "step_id": 1427, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813675.1991942, "step_id": 1428, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813675.2043104, "step_id": 1429, "start_load_kv_us": 3, "get_finished_us": 232} +{"t_unix": 1779813675.2094114, "step_id": 1430, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813675.2145057, "step_id": 1431, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813675.2195601, "step_id": 1432, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813675.224677, "step_id": 1433, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813675.229884, "step_id": 1434, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813675.2349243, "step_id": 1435, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813675.2400706, "step_id": 1436, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813675.2450824, "step_id": 1437, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813675.2502599, "step_id": 1438, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813675.2553442, "step_id": 1439, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813675.2604284, "step_id": 1440, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813675.265471, "step_id": 1441, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813675.2705402, "step_id": 1442, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813675.2756417, "step_id": 1443, "start_load_kv_us": 13, "get_finished_us": 158} +{"t_unix": 1779813675.2807908, "step_id": 1444, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813675.2858813, "step_id": 1445, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813675.2909908, "step_id": 1446, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813675.296086, "step_id": 1447, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813675.301195, "step_id": 1448, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813675.306278, "step_id": 1449, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813675.3113637, "step_id": 1450, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813675.3165314, "step_id": 1451, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813675.3216612, "step_id": 1452, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813675.3267648, "step_id": 1453, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813675.3319244, "step_id": 1454, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813675.3370335, "step_id": 1455, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813675.3421612, "step_id": 1456, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813675.3471954, "step_id": 1457, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813675.352291, "step_id": 1458, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813675.3574233, "step_id": 1459, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813675.3625247, "step_id": 1460, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813675.3676805, "step_id": 1461, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813675.3727555, "step_id": 1462, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813675.3778443, "step_id": 1463, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813675.3829067, "step_id": 1464, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813675.3880205, "step_id": 1465, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813675.3931425, "step_id": 1466, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813675.3982725, "step_id": 1467, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813675.4033692, "step_id": 1468, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813675.4085133, "step_id": 1469, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813675.413736, "step_id": 1470, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813675.418719, "step_id": 1471, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813675.423849, "step_id": 1472, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813675.428987, "step_id": 1473, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813675.434106, "step_id": 1474, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813675.4391582, "step_id": 1475, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813675.484774, "step_id": 1476, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813675.486919, "step_id": 1477, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813675.6835737, "step_id": 1478, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813675.6892343, "step_id": 1479, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813675.6951637, "step_id": 1480, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813675.7010517, "step_id": 1481, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813675.7069967, "step_id": 1482, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813675.7128878, "step_id": 1483, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813675.718961, "step_id": 1484, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813675.725025, "step_id": 1485, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813675.7310228, "step_id": 1486, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813675.7369928, "step_id": 1487, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813675.743087, "step_id": 1488, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813675.7492788, "step_id": 1489, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813675.7554147, "step_id": 1490, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813675.761886, "step_id": 1491, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813675.7682228, "step_id": 1492, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813675.7743628, "step_id": 1493, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813675.7805233, "step_id": 1494, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813675.7869127, "step_id": 1495, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813675.7932775, "step_id": 1496, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813675.7996774, "step_id": 1497, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813675.805695, "step_id": 1498, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813675.812008, "step_id": 1499, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813675.8182285, "step_id": 1500, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813675.8244948, "step_id": 1501, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813675.8308234, "step_id": 1502, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813675.837184, "step_id": 1503, "start_load_kv_us": 3, "get_finished_us": 152} +{"t_unix": 1779813675.8431163, "step_id": 1504, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813675.8491414, "step_id": 1505, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813675.8550565, "step_id": 1506, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813675.8612351, "step_id": 1507, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813675.86733, "step_id": 1508, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813675.8735769, "step_id": 1509, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813675.8796105, "step_id": 1510, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813675.88557, "step_id": 1511, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813675.891517, "step_id": 1512, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813675.8978932, "step_id": 1513, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813675.9038932, "step_id": 1514, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813675.9097698, "step_id": 1515, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813675.915998, "step_id": 1516, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813675.922189, "step_id": 1517, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813675.9283724, "step_id": 1518, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813675.9344065, "step_id": 1519, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813675.9406023, "step_id": 1520, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813675.9470654, "step_id": 1521, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813675.953459, "step_id": 1522, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813675.959914, "step_id": 1523, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813675.9662445, "step_id": 1524, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813675.9725823, "step_id": 1525, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813675.978976, "step_id": 1526, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813675.9853158, "step_id": 1527, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813675.9918044, "step_id": 1528, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813675.9983196, "step_id": 1529, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813676.004432, "step_id": 1530, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813676.010702, "step_id": 1531, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813676.017129, "step_id": 1532, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813676.0232983, "step_id": 1533, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813676.0293353, "step_id": 1534, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813676.0355196, "step_id": 1535, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813676.0423164, "step_id": 1536, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813676.0483549, "step_id": 1537, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813676.05321, "step_id": 1538, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813676.0583384, "step_id": 1539, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813676.0634115, "step_id": 1540, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813676.0685155, "step_id": 1541, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813676.073662, "step_id": 1542, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813676.078748, "step_id": 1543, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813676.0838785, "step_id": 1544, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813676.089067, "step_id": 1545, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813676.0940526, "step_id": 1546, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813676.0991092, "step_id": 1547, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813676.1042674, "step_id": 1548, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813676.1093378, "step_id": 1549, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813676.1144052, "step_id": 1550, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813676.1195297, "step_id": 1551, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813676.1246407, "step_id": 1552, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813676.1297338, "step_id": 1553, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813676.134868, "step_id": 1554, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813676.1399293, "step_id": 1555, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813676.1449895, "step_id": 1556, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813676.1500688, "step_id": 1557, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813676.155168, "step_id": 1558, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813676.1602666, "step_id": 1559, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813676.165358, "step_id": 1560, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813676.1705694, "step_id": 1561, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813676.1755605, "step_id": 1562, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813676.1806448, "step_id": 1563, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813676.1857326, "step_id": 1564, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813676.1908207, "step_id": 1565, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813676.195895, "step_id": 1566, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813676.2010193, "step_id": 1567, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813676.2060583, "step_id": 1568, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813676.2111418, "step_id": 1569, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813676.2162166, "step_id": 1570, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813676.2213514, "step_id": 1571, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813676.226387, "step_id": 1572, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813676.2314684, "step_id": 1573, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813676.236516, "step_id": 1574, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813676.2416737, "step_id": 1575, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813676.2468376, "step_id": 1576, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813676.2519388, "step_id": 1577, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813676.2569807, "step_id": 1578, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813676.2621086, "step_id": 1579, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813676.267178, "step_id": 1580, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813676.2723196, "step_id": 1581, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813676.277401, "step_id": 1582, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813676.2825372, "step_id": 1583, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813676.2876513, "step_id": 1584, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813676.2927597, "step_id": 1585, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813676.2979233, "step_id": 1586, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813676.303102, "step_id": 1587, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813676.308075, "step_id": 1588, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813676.3131511, "step_id": 1589, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813676.3181992, "step_id": 1590, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813676.3233156, "step_id": 1591, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813676.3284109, "step_id": 1592, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813676.3335998, "step_id": 1593, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813676.338625, "step_id": 1594, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813676.3437238, "step_id": 1595, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813676.3488805, "step_id": 1596, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813676.3539095, "step_id": 1597, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813676.3590517, "step_id": 1598, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813676.3641267, "step_id": 1599, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813676.3692322, "step_id": 1600, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813676.374404, "step_id": 1601, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813676.3795092, "step_id": 1602, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813676.3845992, "step_id": 1603, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813676.389777, "step_id": 1604, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813676.3949487, "step_id": 1605, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813676.3999853, "step_id": 1606, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813676.4050362, "step_id": 1607, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813676.4101336, "step_id": 1608, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813676.4153032, "step_id": 1609, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813676.4203608, "step_id": 1610, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813676.4254723, "step_id": 1611, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813676.4715402, "step_id": 1612, "start_load_kv_us": 3, "get_finished_us": 264} +{"t_unix": 1779813676.4736378, "step_id": 1613, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813676.709687, "step_id": 1614, "start_load_kv_us": 2, "get_finished_us": 342} +{"t_unix": 1779813676.7118914, "step_id": 1615, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813677.1693788, "step_id": 1616, "start_load_kv_us": 4, "get_finished_us": 359} +{"t_unix": 1779813677.1721601, "step_id": 1617, "start_load_kv_us": 3, "get_finished_us": 199} +{"t_unix": 1779813677.372353, "step_id": 1618, "start_load_kv_us": 20, "get_finished_us": 335} +{"t_unix": 1779813677.3806238, "step_id": 1619, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813677.3899574, "step_id": 1620, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813677.3994074, "step_id": 1621, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813677.4087873, "step_id": 1622, "start_load_kv_us": 3, "get_finished_us": 164} +{"t_unix": 1779813677.4183323, "step_id": 1623, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813677.4280236, "step_id": 1624, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813677.4380524, "step_id": 1625, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813677.4470928, "step_id": 1626, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813677.4567485, "step_id": 1627, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813677.4663234, "step_id": 1628, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813677.4759955, "step_id": 1629, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813677.485618, "step_id": 1630, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813677.4951801, "step_id": 1631, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813677.5046499, "step_id": 1632, "start_load_kv_us": 16, "get_finished_us": 161} +{"t_unix": 1779813677.5136352, "step_id": 1633, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813677.5223846, "step_id": 1634, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813677.5319703, "step_id": 1635, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813677.5408072, "step_id": 1636, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813677.549875, "step_id": 1637, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813677.5588317, "step_id": 1638, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813677.5682304, "step_id": 1639, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813677.5778365, "step_id": 1640, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813677.5873947, "step_id": 1641, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813677.5968797, "step_id": 1642, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813677.6063018, "step_id": 1643, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813677.6158257, "step_id": 1644, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813677.6250377, "step_id": 1645, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813677.6340106, "step_id": 1646, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813677.642923, "step_id": 1647, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813677.6521244, "step_id": 1648, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813677.6619606, "step_id": 1649, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813677.670673, "step_id": 1650, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813677.67986, "step_id": 1651, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813677.6891806, "step_id": 1652, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813677.6983826, "step_id": 1653, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813677.7075863, "step_id": 1654, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813677.7170453, "step_id": 1655, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813677.7264323, "step_id": 1656, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813677.7361355, "step_id": 1657, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813677.7455015, "step_id": 1658, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813677.7553272, "step_id": 1659, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813677.7651963, "step_id": 1660, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813677.7750177, "step_id": 1661, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813677.7844973, "step_id": 1662, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813677.7941916, "step_id": 1663, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813677.803927, "step_id": 1664, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813677.8137512, "step_id": 1665, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813677.8235118, "step_id": 1666, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813677.8334088, "step_id": 1667, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813677.8431828, "step_id": 1668, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813677.8528025, "step_id": 1669, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813677.862583, "step_id": 1670, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813677.8722124, "step_id": 1671, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813677.8820157, "step_id": 1672, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813677.8916116, "step_id": 1673, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813677.901077, "step_id": 1674, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813677.9105678, "step_id": 1675, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813677.9198244, "step_id": 1676, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813677.9289281, "step_id": 1677, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813677.9380422, "step_id": 1678, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813677.9471474, "step_id": 1679, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813677.9565444, "step_id": 1680, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813677.9661121, "step_id": 1681, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813677.9759989, "step_id": 1682, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813677.98553, "step_id": 1683, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813677.9953806, "step_id": 1684, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813678.0051649, "step_id": 1685, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813678.0146294, "step_id": 1686, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813678.0242012, "step_id": 1687, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813678.0337758, "step_id": 1688, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813678.0433114, "step_id": 1689, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813678.052601, "step_id": 1690, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813678.0623724, "step_id": 1691, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813678.0747433, "step_id": 1692, "start_load_kv_us": 3, "get_finished_us": 425} +{"t_unix": 1779813678.0826545, "step_id": 1693, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813678.0930057, "step_id": 1694, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813678.106139, "step_id": 1695, "start_load_kv_us": 5, "get_finished_us": 1512} +{"t_unix": 1779813678.1129034, "step_id": 1696, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813678.122416, "step_id": 1697, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813678.1323156, "step_id": 1698, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813678.1420352, "step_id": 1699, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813678.151983, "step_id": 1700, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813678.161725, "step_id": 1701, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813678.1717114, "step_id": 1702, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813678.1814904, "step_id": 1703, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813678.1914883, "step_id": 1704, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813678.2014647, "step_id": 1705, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813678.211208, "step_id": 1706, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813678.2209675, "step_id": 1707, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813678.230681, "step_id": 1708, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813678.2406435, "step_id": 1709, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813678.2506003, "step_id": 1710, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813678.2602172, "step_id": 1711, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813678.2700956, "step_id": 1712, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813678.2795403, "step_id": 1713, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813678.2892087, "step_id": 1714, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813678.298584, "step_id": 1715, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813678.3076718, "step_id": 1716, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813678.3173432, "step_id": 1717, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813678.327082, "step_id": 1718, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813678.336831, "step_id": 1719, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813678.3465636, "step_id": 1720, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813678.356377, "step_id": 1721, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813678.3660204, "step_id": 1722, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813678.37609, "step_id": 1723, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813678.3856928, "step_id": 1724, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813678.3955092, "step_id": 1725, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813678.405342, "step_id": 1726, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813678.4148107, "step_id": 1727, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813678.424231, "step_id": 1728, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813678.4336245, "step_id": 1729, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813678.4894054, "step_id": 1730, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813678.491954, "step_id": 1731, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813678.6878142, "step_id": 1732, "start_load_kv_us": 3, "get_finished_us": 349} +{"t_unix": 1779813678.6967435, "step_id": 1733, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813678.706376, "step_id": 1734, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813678.7163699, "step_id": 1735, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813678.7262735, "step_id": 1736, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813678.736014, "step_id": 1737, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813678.7458687, "step_id": 1738, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813678.7557979, "step_id": 1739, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813678.7652617, "step_id": 1740, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813678.7746372, "step_id": 1741, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813678.7843788, "step_id": 1742, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813678.793541, "step_id": 1743, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813678.802523, "step_id": 1744, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813678.8121562, "step_id": 1745, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813678.821868, "step_id": 1746, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813678.8315802, "step_id": 1747, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813678.8414814, "step_id": 1748, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813678.8515825, "step_id": 1749, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813678.861425, "step_id": 1750, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813678.8709304, "step_id": 1751, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813678.8802438, "step_id": 1752, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813678.8901372, "step_id": 1753, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813678.8999195, "step_id": 1754, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813678.9100003, "step_id": 1755, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813678.92006, "step_id": 1756, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813678.9303248, "step_id": 1757, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813678.9404647, "step_id": 1758, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813678.9503624, "step_id": 1759, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813678.9602802, "step_id": 1760, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813678.9705017, "step_id": 1761, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813678.9809217, "step_id": 1762, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813678.9912338, "step_id": 1763, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813679.0013866, "step_id": 1764, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813679.0517085, "step_id": 1765, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813679.0539806, "step_id": 1766, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813679.2588987, "step_id": 1767, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813679.2681444, "step_id": 1768, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813679.278126, "step_id": 1769, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813679.2873533, "step_id": 1770, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813679.296844, "step_id": 1771, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813679.306079, "step_id": 1772, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813679.3160462, "step_id": 1773, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813679.3255715, "step_id": 1774, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813679.3353622, "step_id": 1775, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813679.3447905, "step_id": 1776, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813679.3542635, "step_id": 1777, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813679.3638415, "step_id": 1778, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813679.3738415, "step_id": 1779, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813679.3838563, "step_id": 1780, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813679.3937151, "step_id": 1781, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813679.4031513, "step_id": 1782, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813679.4124887, "step_id": 1783, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813679.422229, "step_id": 1784, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813679.4318788, "step_id": 1785, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813679.4413838, "step_id": 1786, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813679.4511385, "step_id": 1787, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813679.4609416, "step_id": 1788, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813679.4706872, "step_id": 1789, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813679.4806263, "step_id": 1790, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813679.4904304, "step_id": 1791, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813679.5002184, "step_id": 1792, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813679.5099049, "step_id": 1793, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813679.5194278, "step_id": 1794, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813679.5290008, "step_id": 1795, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813679.539717, "step_id": 1796, "start_load_kv_us": 2, "get_finished_us": 1040} +{"t_unix": 1779813679.5490084, "step_id": 1797, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813679.5591114, "step_id": 1798, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813679.5688808, "step_id": 1799, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813679.5786076, "step_id": 1800, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813679.5881515, "step_id": 1801, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813679.5976596, "step_id": 1802, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813679.6073487, "step_id": 1803, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813679.6169744, "step_id": 1804, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813679.6266456, "step_id": 1805, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813679.6362166, "step_id": 1806, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813679.6456742, "step_id": 1807, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813679.6553514, "step_id": 1808, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813679.6646986, "step_id": 1809, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813679.6739035, "step_id": 1810, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813679.683256, "step_id": 1811, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813679.6972933, "step_id": 1812, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813679.7028081, "step_id": 1813, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813679.7126107, "step_id": 1814, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813679.7221556, "step_id": 1815, "start_load_kv_us": 15, "get_finished_us": 162} +{"t_unix": 1779813679.7318277, "step_id": 1816, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813679.7414293, "step_id": 1817, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813679.7508764, "step_id": 1818, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813679.7601078, "step_id": 1819, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813679.769228, "step_id": 1820, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813679.7784796, "step_id": 1821, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813679.7876616, "step_id": 1822, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813679.7967982, "step_id": 1823, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813679.8063161, "step_id": 1824, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813679.8161469, "step_id": 1825, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813679.826032, "step_id": 1826, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813679.8359113, "step_id": 1827, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813679.8455346, "step_id": 1828, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813679.8550856, "step_id": 1829, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813679.8651464, "step_id": 1830, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813679.8753366, "step_id": 1831, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813679.8853145, "step_id": 1832, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813679.8947988, "step_id": 1833, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813679.9455616, "step_id": 1834, "start_load_kv_us": 3, "get_finished_us": 256} +{"t_unix": 1779813679.9479637, "step_id": 1835, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813680.1944804, "step_id": 1836, "start_load_kv_us": 3, "get_finished_us": 339} +{"t_unix": 1779813680.197103, "step_id": 1837, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813680.403522, "step_id": 1838, "start_load_kv_us": 3, "get_finished_us": 343} +{"t_unix": 1779813680.4136329, "step_id": 1839, "start_load_kv_us": 2, "get_finished_us": 340} +{"t_unix": 1779813680.4245243, "step_id": 1840, "start_load_kv_us": 3, "get_finished_us": 222} +{"t_unix": 1779813680.435817, "step_id": 1841, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813680.4476032, "step_id": 1842, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813680.4596055, "step_id": 1843, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813680.4703877, "step_id": 1844, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813680.481472, "step_id": 1845, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813680.4927201, "step_id": 1846, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813680.5039182, "step_id": 1847, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813680.5151877, "step_id": 1848, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813680.5263846, "step_id": 1849, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813680.537832, "step_id": 1850, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813680.5495193, "step_id": 1851, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813680.5611346, "step_id": 1852, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813680.5723097, "step_id": 1853, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813680.6231084, "step_id": 1854, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813680.625611, "step_id": 1855, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813680.8341746, "step_id": 1856, "start_load_kv_us": 3, "get_finished_us": 324} +{"t_unix": 1779813680.8458726, "step_id": 1857, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813680.8577049, "step_id": 1858, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813680.870114, "step_id": 1859, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813680.882205, "step_id": 1860, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813680.8942747, "step_id": 1861, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813680.9064925, "step_id": 1862, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813680.9187865, "step_id": 1863, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813680.9311168, "step_id": 1864, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813680.9433482, "step_id": 1865, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813680.9559708, "step_id": 1866, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813680.9679365, "step_id": 1867, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813680.9806316, "step_id": 1868, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813680.9924953, "step_id": 1869, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813681.0043037, "step_id": 1870, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813681.0161517, "step_id": 1871, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813681.0254204, "step_id": 1872, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813681.034473, "step_id": 1873, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813681.0440903, "step_id": 1874, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813681.0539389, "step_id": 1875, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813681.0636885, "step_id": 1876, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813681.074301, "step_id": 1877, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813681.0844138, "step_id": 1878, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813681.0944755, "step_id": 1879, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813681.1046033, "step_id": 1880, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813681.1147726, "step_id": 1881, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813681.1254694, "step_id": 1882, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813681.1359882, "step_id": 1883, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813681.1465802, "step_id": 1884, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813681.1569695, "step_id": 1885, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813681.1671114, "step_id": 1886, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813681.1771376, "step_id": 1887, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813681.1872594, "step_id": 1888, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813681.1974146, "step_id": 1889, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813681.2074273, "step_id": 1890, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813681.2177129, "step_id": 1891, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813681.2280033, "step_id": 1892, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813681.2384493, "step_id": 1893, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813681.248391, "step_id": 1894, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813681.2587621, "step_id": 1895, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813681.2689602, "step_id": 1896, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813681.2787318, "step_id": 1897, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813681.288689, "step_id": 1898, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813681.2989342, "step_id": 1899, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813681.3094816, "step_id": 1900, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813681.3200507, "step_id": 1901, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813681.3303144, "step_id": 1902, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813681.3407793, "step_id": 1903, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813681.3510282, "step_id": 1904, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813681.361311, "step_id": 1905, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813681.3718214, "step_id": 1906, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813681.3821743, "step_id": 1907, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813681.392655, "step_id": 1908, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813681.4428434, "step_id": 1909, "start_load_kv_us": 3, "get_finished_us": 331} +{"t_unix": 1779813681.4456503, "step_id": 1910, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813681.6494615, "step_id": 1911, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813681.6588743, "step_id": 1912, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813681.6681333, "step_id": 1913, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813681.6775732, "step_id": 1914, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813681.6865954, "step_id": 1915, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813681.6957338, "step_id": 1916, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813681.705286, "step_id": 1917, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813681.7146585, "step_id": 1918, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813681.7243097, "step_id": 1919, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813681.7339144, "step_id": 1920, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813681.743662, "step_id": 1921, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813681.752988, "step_id": 1922, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813681.7627215, "step_id": 1923, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813681.7729616, "step_id": 1924, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813681.7830372, "step_id": 1925, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813681.7924314, "step_id": 1926, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813681.8019595, "step_id": 1927, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813681.8116112, "step_id": 1928, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813681.820887, "step_id": 1929, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813681.8302574, "step_id": 1930, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813681.84015, "step_id": 1931, "start_load_kv_us": 3, "get_finished_us": 154} +{"t_unix": 1779813681.8502283, "step_id": 1932, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813681.8601015, "step_id": 1933, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813681.869524, "step_id": 1934, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813681.87894, "step_id": 1935, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813681.8887186, "step_id": 1936, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813681.898601, "step_id": 1937, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813681.908418, "step_id": 1938, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813681.9186158, "step_id": 1939, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813681.9288013, "step_id": 1940, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813681.9396906, "step_id": 1941, "start_load_kv_us": 7, "get_finished_us": 223} +{"t_unix": 1779813681.9487586, "step_id": 1942, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813681.9586222, "step_id": 1943, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813681.968297, "step_id": 1944, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813681.9779577, "step_id": 1945, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813681.9878888, "step_id": 1946, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813681.9979644, "step_id": 1947, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813682.0075417, "step_id": 1948, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813682.016753, "step_id": 1949, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813682.0263662, "step_id": 1950, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813682.0357978, "step_id": 1951, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813682.045235, "step_id": 1952, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813682.0548072, "step_id": 1953, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813682.0642147, "step_id": 1954, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813682.0735266, "step_id": 1955, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813682.0826595, "step_id": 1956, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813682.092082, "step_id": 1957, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813682.1012905, "step_id": 1958, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813682.1105425, "step_id": 1959, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813682.1201308, "step_id": 1960, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813682.1300848, "step_id": 1961, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813682.1393616, "step_id": 1962, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813682.148834, "step_id": 1963, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813682.1589558, "step_id": 1964, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813682.168876, "step_id": 1965, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813682.1788747, "step_id": 1966, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813682.18829, "step_id": 1967, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813682.1979861, "step_id": 1968, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813682.207525, "step_id": 1969, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813682.2174642, "step_id": 1970, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813682.2274594, "step_id": 1971, "start_load_kv_us": 3, "get_finished_us": 164} +{"t_unix": 1779813682.238045, "step_id": 1972, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813682.2477849, "step_id": 1973, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813682.2572582, "step_id": 1974, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813682.266591, "step_id": 1975, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813682.275594, "step_id": 1976, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813682.284726, "step_id": 1977, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813682.294098, "step_id": 1978, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813682.3033657, "step_id": 1979, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813682.3126626, "step_id": 1980, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813682.3222985, "step_id": 1981, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813682.3317666, "step_id": 1982, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813682.3415952, "step_id": 1983, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813682.3511646, "step_id": 1984, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813682.3606834, "step_id": 1985, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813682.370604, "step_id": 1986, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813682.3801663, "step_id": 1987, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813682.3899834, "step_id": 1988, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813682.400126, "step_id": 1989, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813682.409733, "step_id": 1990, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813682.4195807, "step_id": 1991, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813682.429627, "step_id": 1992, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813682.4395294, "step_id": 1993, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813682.4493842, "step_id": 1994, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813682.4595344, "step_id": 1995, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813682.469491, "step_id": 1996, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813682.4790432, "step_id": 1997, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813682.4887652, "step_id": 1998, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813682.4988556, "step_id": 1999, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813682.5089104, "step_id": 2000, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813682.5188093, "step_id": 2001, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813682.5288646, "step_id": 2002, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813682.5391183, "step_id": 2003, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813682.5491788, "step_id": 2004, "start_load_kv_us": 12, "get_finished_us": 147} +{"t_unix": 1779813682.5592358, "step_id": 2005, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813682.6124675, "step_id": 2006, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813682.6146805, "step_id": 2007, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813682.8165262, "step_id": 2008, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813682.8258815, "step_id": 2009, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813682.8351376, "step_id": 2010, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813682.844657, "step_id": 2011, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813682.8538463, "step_id": 2012, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813682.8631582, "step_id": 2013, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813682.872532, "step_id": 2014, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813682.8818967, "step_id": 2015, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813682.8911703, "step_id": 2016, "start_load_kv_us": 3, "get_finished_us": 174} +{"t_unix": 1779813682.900674, "step_id": 2017, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813682.9101727, "step_id": 2018, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813682.9208968, "step_id": 2019, "start_load_kv_us": 5, "get_finished_us": 210} +{"t_unix": 1779813682.929929, "step_id": 2020, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813682.9399147, "step_id": 2021, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813682.9495106, "step_id": 2022, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813682.959213, "step_id": 2023, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813682.9689612, "step_id": 2024, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813682.9788435, "step_id": 2025, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813682.9884653, "step_id": 2026, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813682.9986024, "step_id": 2027, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813683.0085201, "step_id": 2028, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813683.0184758, "step_id": 2029, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813683.0283065, "step_id": 2030, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813683.0380158, "step_id": 2031, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813683.047829, "step_id": 2032, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813683.0575366, "step_id": 2033, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813683.0672698, "step_id": 2034, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813683.0770953, "step_id": 2035, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813683.0868793, "step_id": 2036, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813683.096904, "step_id": 2037, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813683.1066885, "step_id": 2038, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813683.1165278, "step_id": 2039, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813683.1265085, "step_id": 2040, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813683.1362789, "step_id": 2041, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813683.1462011, "step_id": 2042, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813683.1560962, "step_id": 2043, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813683.1658778, "step_id": 2044, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813683.1755004, "step_id": 2045, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813683.1858127, "step_id": 2046, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813683.1956537, "step_id": 2047, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813683.2055306, "step_id": 2048, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813683.2153108, "step_id": 2049, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813683.2252862, "step_id": 2050, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813683.2350461, "step_id": 2051, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813683.2448907, "step_id": 2052, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813683.2548172, "step_id": 2053, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813683.2646642, "step_id": 2054, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813683.274343, "step_id": 2055, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813683.284284, "step_id": 2056, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813683.2944045, "step_id": 2057, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813683.304358, "step_id": 2058, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813683.3144908, "step_id": 2059, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813683.3246338, "step_id": 2060, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813683.334421, "step_id": 2061, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813683.3442717, "step_id": 2062, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813683.354214, "step_id": 2063, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813683.3640985, "step_id": 2064, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813683.373843, "step_id": 2065, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813683.383267, "step_id": 2066, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813683.3931167, "step_id": 2067, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813683.4032443, "step_id": 2068, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813683.4132197, "step_id": 2069, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813683.4240253, "step_id": 2070, "start_load_kv_us": 3, "get_finished_us": 331} +{"t_unix": 1779813683.4327385, "step_id": 2071, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813683.442655, "step_id": 2072, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813683.4524214, "step_id": 2073, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813683.4623146, "step_id": 2074, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813683.4726543, "step_id": 2075, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813683.4828482, "step_id": 2076, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813683.4931772, "step_id": 2077, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813683.5033405, "step_id": 2078, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813683.5136878, "step_id": 2079, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813683.5242233, "step_id": 2080, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813683.5347745, "step_id": 2081, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813683.5451586, "step_id": 2082, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813683.5560102, "step_id": 2083, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813683.566611, "step_id": 2084, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813683.5768442, "step_id": 2085, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813683.5868526, "step_id": 2086, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813683.596962, "step_id": 2087, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813683.6070554, "step_id": 2088, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813683.6176755, "step_id": 2089, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813683.6287973, "step_id": 2090, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813683.638702, "step_id": 2091, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813683.6470346, "step_id": 2092, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813683.6550624, "step_id": 2093, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813683.7046978, "step_id": 2094, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813683.7068877, "step_id": 2095, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813683.9479973, "step_id": 2096, "start_load_kv_us": 2, "get_finished_us": 381} +{"t_unix": 1779813683.9504752, "step_id": 2097, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813684.152264, "step_id": 2098, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813684.1620667, "step_id": 2099, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813684.172358, "step_id": 2100, "start_load_kv_us": 3, "get_finished_us": 205} +{"t_unix": 1779813684.1827102, "step_id": 2101, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813684.1926858, "step_id": 2102, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813684.202843, "step_id": 2103, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813684.2132092, "step_id": 2104, "start_load_kv_us": 14, "get_finished_us": 212} +{"t_unix": 1779813684.223051, "step_id": 2105, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813684.2331269, "step_id": 2106, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813684.2431872, "step_id": 2107, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813684.2532153, "step_id": 2108, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813684.2636037, "step_id": 2109, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813684.2743528, "step_id": 2110, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813684.284409, "step_id": 2111, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813684.2925894, "step_id": 2112, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813684.30079, "step_id": 2113, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813684.309295, "step_id": 2114, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813684.3176327, "step_id": 2115, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813684.3260872, "step_id": 2116, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813684.3346205, "step_id": 2117, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813684.3428137, "step_id": 2118, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813684.3512158, "step_id": 2119, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813684.3595362, "step_id": 2120, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813684.368004, "step_id": 2121, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813684.3764145, "step_id": 2122, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813684.384842, "step_id": 2123, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813684.3930295, "step_id": 2124, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813684.4017386, "step_id": 2125, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813684.4102342, "step_id": 2126, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813684.4188485, "step_id": 2127, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813684.4273272, "step_id": 2128, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813684.4358056, "step_id": 2129, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813684.444021, "step_id": 2130, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813684.4522924, "step_id": 2131, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813684.4604983, "step_id": 2132, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813684.468984, "step_id": 2133, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813684.477312, "step_id": 2134, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813684.4859605, "step_id": 2135, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813684.4943056, "step_id": 2136, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813684.5024621, "step_id": 2137, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813684.51091, "step_id": 2138, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813684.519397, "step_id": 2139, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813684.527825, "step_id": 2140, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813684.5362563, "step_id": 2141, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813684.5443738, "step_id": 2142, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813684.5526414, "step_id": 2143, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813684.5610347, "step_id": 2144, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813684.5692985, "step_id": 2145, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813684.5779777, "step_id": 2146, "start_load_kv_us": 3, "get_finished_us": 165} +{"t_unix": 1779813684.5865772, "step_id": 2147, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813684.595006, "step_id": 2148, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813684.6034741, "step_id": 2149, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813684.6120632, "step_id": 2150, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813684.6205919, "step_id": 2151, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813684.629094, "step_id": 2152, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813684.6377358, "step_id": 2153, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813684.6462643, "step_id": 2154, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813684.6548295, "step_id": 2155, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813684.663351, "step_id": 2156, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813684.6718214, "step_id": 2157, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813684.6803155, "step_id": 2158, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813684.688989, "step_id": 2159, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813684.697015, "step_id": 2160, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813684.70527, "step_id": 2161, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813684.7137332, "step_id": 2162, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813684.7222655, "step_id": 2163, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813684.7306874, "step_id": 2164, "start_load_kv_us": 17, "get_finished_us": 199} +{"t_unix": 1779813684.7394834, "step_id": 2165, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813684.7478304, "step_id": 2166, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813684.7554743, "step_id": 2167, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813684.7631142, "step_id": 2168, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813684.7711513, "step_id": 2169, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813684.7787066, "step_id": 2170, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813684.7867546, "step_id": 2171, "start_load_kv_us": 12, "get_finished_us": 159} +{"t_unix": 1779813684.7946682, "step_id": 2172, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813684.802661, "step_id": 2173, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813684.8107088, "step_id": 2174, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813684.8187973, "step_id": 2175, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813684.8267727, "step_id": 2176, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813684.8346236, "step_id": 2177, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813684.8426661, "step_id": 2178, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813684.850692, "step_id": 2179, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813684.8588138, "step_id": 2180, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813684.8668463, "step_id": 2181, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813684.8749235, "step_id": 2182, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813684.882959, "step_id": 2183, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813684.891031, "step_id": 2184, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813684.8989315, "step_id": 2185, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813684.9066403, "step_id": 2186, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813684.9143834, "step_id": 2187, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813684.9220695, "step_id": 2188, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813684.9300275, "step_id": 2189, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813684.937809, "step_id": 2190, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813684.945849, "step_id": 2191, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813684.9534924, "step_id": 2192, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813684.9614842, "step_id": 2193, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813684.9693232, "step_id": 2194, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813684.9773335, "step_id": 2195, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813684.9853625, "step_id": 2196, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813684.9932384, "step_id": 2197, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813685.0012577, "step_id": 2198, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813685.009291, "step_id": 2199, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813685.0171843, "step_id": 2200, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813685.0251203, "step_id": 2201, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813685.0330586, "step_id": 2202, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813685.040781, "step_id": 2203, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813685.048367, "step_id": 2204, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813685.0561466, "step_id": 2205, "start_load_kv_us": 13, "get_finished_us": 156} +{"t_unix": 1779813685.064189, "step_id": 2206, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813685.0719726, "step_id": 2207, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813685.0812335, "step_id": 2208, "start_load_kv_us": 2, "get_finished_us": 1907} +{"t_unix": 1779813685.0873885, "step_id": 2209, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813685.095393, "step_id": 2210, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813685.1033814, "step_id": 2211, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813685.1115134, "step_id": 2212, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813685.1195772, "step_id": 2213, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813685.1279624, "step_id": 2214, "start_load_kv_us": 7, "get_finished_us": 230} +{"t_unix": 1779813685.1356387, "step_id": 2215, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813685.1434557, "step_id": 2216, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813685.1514618, "step_id": 2217, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813685.159587, "step_id": 2218, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813685.1673334, "step_id": 2219, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813685.17501, "step_id": 2220, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813685.1827888, "step_id": 2221, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813685.1907606, "step_id": 2222, "start_load_kv_us": 3, "get_finished_us": 161} +{"t_unix": 1779813685.1987112, "step_id": 2223, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813685.2065868, "step_id": 2224, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813685.2566807, "step_id": 2225, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813685.2588546, "step_id": 2226, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813685.4938354, "step_id": 2227, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813685.4961758, "step_id": 2228, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813685.6987677, "step_id": 2229, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813685.7082028, "step_id": 2230, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813685.7180223, "step_id": 2231, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813685.7278087, "step_id": 2232, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813685.7379205, "step_id": 2233, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813685.7478833, "step_id": 2234, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813685.7578588, "step_id": 2235, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813685.7677093, "step_id": 2236, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813685.7781236, "step_id": 2237, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813685.7884078, "step_id": 2238, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813685.79906, "step_id": 2239, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813685.80976, "step_id": 2240, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813685.8205416, "step_id": 2241, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813685.8308547, "step_id": 2242, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813685.8415196, "step_id": 2243, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813685.8517895, "step_id": 2244, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813685.8623383, "step_id": 2245, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813685.8722968, "step_id": 2246, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813685.8828936, "step_id": 2247, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813685.8933973, "step_id": 2248, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813685.903524, "step_id": 2249, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813685.9139163, "step_id": 2250, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813685.9240074, "step_id": 2251, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813685.9342377, "step_id": 2252, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813685.9446855, "step_id": 2253, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813685.9552698, "step_id": 2254, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813685.9657347, "step_id": 2255, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813685.9763517, "step_id": 2256, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813685.9864118, "step_id": 2257, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813685.9965575, "step_id": 2258, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813686.0064921, "step_id": 2259, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813686.0165343, "step_id": 2260, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813686.0264018, "step_id": 2261, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813686.0366447, "step_id": 2262, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813686.0465121, "step_id": 2263, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813686.0540762, "step_id": 2264, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813686.0621958, "step_id": 2265, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813686.0701375, "step_id": 2266, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813686.0784967, "step_id": 2267, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813686.0867002, "step_id": 2268, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813686.094994, "step_id": 2269, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813686.1030295, "step_id": 2270, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813686.1111696, "step_id": 2271, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813686.119372, "step_id": 2272, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813686.1276243, "step_id": 2273, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813686.1357841, "step_id": 2274, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813686.1439095, "step_id": 2275, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813686.151644, "step_id": 2276, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813686.159669, "step_id": 2277, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813686.1676006, "step_id": 2278, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813686.1756964, "step_id": 2279, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813686.183822, "step_id": 2280, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813686.1917973, "step_id": 2281, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813686.199376, "step_id": 2282, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813686.206866, "step_id": 2283, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813686.2147331, "step_id": 2284, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813686.2223425, "step_id": 2285, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813686.23017, "step_id": 2286, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813686.2376041, "step_id": 2287, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813686.245128, "step_id": 2288, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813686.2527869, "step_id": 2289, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813686.26012, "step_id": 2290, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813686.2677205, "step_id": 2291, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813686.2753282, "step_id": 2292, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813686.2832372, "step_id": 2293, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813686.2910492, "step_id": 2294, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813686.298919, "step_id": 2295, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813686.3065743, "step_id": 2296, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813686.314655, "step_id": 2297, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813686.3219168, "step_id": 2298, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813686.329791, "step_id": 2299, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813686.3374896, "step_id": 2300, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813686.3451345, "step_id": 2301, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813686.352792, "step_id": 2302, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813686.3602781, "step_id": 2303, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813686.36821, "step_id": 2304, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813686.3761306, "step_id": 2305, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813686.3841121, "step_id": 2306, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813686.392224, "step_id": 2307, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813686.400382, "step_id": 2308, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813686.4086797, "step_id": 2309, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813686.4169257, "step_id": 2310, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813686.4249, "step_id": 2311, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813686.4332025, "step_id": 2312, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813686.441363, "step_id": 2313, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813686.4497814, "step_id": 2314, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813686.4995828, "step_id": 2315, "start_load_kv_us": 3, "get_finished_us": 279} +{"t_unix": 1779813686.5017645, "step_id": 2316, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813686.7030392, "step_id": 2317, "start_load_kv_us": 3, "get_finished_us": 295} +{"t_unix": 1779813686.7123857, "step_id": 2318, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813686.7224157, "step_id": 2319, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813686.7322125, "step_id": 2320, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813686.742432, "step_id": 2321, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813686.75229, "step_id": 2322, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813686.7622855, "step_id": 2323, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813686.7721584, "step_id": 2324, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813686.7814913, "step_id": 2325, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813686.791127, "step_id": 2326, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813686.8012564, "step_id": 2327, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813686.8114624, "step_id": 2328, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813686.821759, "step_id": 2329, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813686.8319612, "step_id": 2330, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813686.8420656, "step_id": 2331, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813686.851968, "step_id": 2332, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813686.861798, "step_id": 2333, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813686.8718424, "step_id": 2334, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813686.8820176, "step_id": 2335, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813686.892047, "step_id": 2336, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813686.9023888, "step_id": 2337, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813686.912746, "step_id": 2338, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813686.9226644, "step_id": 2339, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813686.9325764, "step_id": 2340, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813686.9426298, "step_id": 2341, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813686.952489, "step_id": 2342, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813686.9625847, "step_id": 2343, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813686.9728162, "step_id": 2344, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813686.9825907, "step_id": 2345, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813686.9924688, "step_id": 2346, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813687.0421853, "step_id": 2347, "start_load_kv_us": 2, "get_finished_us": 390} +{"t_unix": 1779813687.044841, "step_id": 2348, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813687.297502, "step_id": 2349, "start_load_kv_us": 4, "get_finished_us": 292} +{"t_unix": 1779813687.3003764, "step_id": 2350, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813687.497006, "step_id": 2351, "start_load_kv_us": 2, "get_finished_us": 364} +{"t_unix": 1779813687.5067027, "step_id": 2352, "start_load_kv_us": 3, "get_finished_us": 280} +{"t_unix": 1779813687.5153563, "step_id": 2353, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813687.5252657, "step_id": 2354, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813687.535291, "step_id": 2355, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813687.544966, "step_id": 2356, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813687.554752, "step_id": 2357, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813687.5647523, "step_id": 2358, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813687.5745142, "step_id": 2359, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813687.584562, "step_id": 2360, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813687.595031, "step_id": 2361, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813687.6049914, "step_id": 2362, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813687.614968, "step_id": 2363, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813687.6251638, "step_id": 2364, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813687.634919, "step_id": 2365, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813687.6447341, "step_id": 2366, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813687.654472, "step_id": 2367, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813687.664631, "step_id": 2368, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813687.6745243, "step_id": 2369, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813687.6844566, "step_id": 2370, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813687.6947103, "step_id": 2371, "start_load_kv_us": 2, "get_finished_us": 333} +{"t_unix": 1779813687.7044537, "step_id": 2372, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813687.7140114, "step_id": 2373, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813687.7236698, "step_id": 2374, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813687.774907, "step_id": 2375, "start_load_kv_us": 3, "get_finished_us": 242} +{"t_unix": 1779813687.777228, "step_id": 2376, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813687.9806318, "step_id": 2377, "start_load_kv_us": 3, "get_finished_us": 389} +{"t_unix": 1779813687.9892845, "step_id": 2378, "start_load_kv_us": 15, "get_finished_us": 268} +{"t_unix": 1779813687.9981022, "step_id": 2379, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813688.0072289, "step_id": 2380, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813688.0163298, "step_id": 2381, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813688.0256104, "step_id": 2382, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813688.0352707, "step_id": 2383, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813688.0450156, "step_id": 2384, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813688.0546987, "step_id": 2385, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813688.0642474, "step_id": 2386, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813688.0738757, "step_id": 2387, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813688.0836506, "step_id": 2388, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813688.0939531, "step_id": 2389, "start_load_kv_us": 7, "get_finished_us": 217} +{"t_unix": 1779813688.1026118, "step_id": 2390, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813688.1123722, "step_id": 2391, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813688.12203, "step_id": 2392, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813688.1318161, "step_id": 2393, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813688.1413345, "step_id": 2394, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813688.1507523, "step_id": 2395, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813688.1607864, "step_id": 2396, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813688.1705189, "step_id": 2397, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813688.1806405, "step_id": 2398, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813688.190333, "step_id": 2399, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813688.2002988, "step_id": 2400, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813688.21059, "step_id": 2401, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813688.2213516, "step_id": 2402, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813688.275307, "step_id": 2403, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813688.2776113, "step_id": 2404, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813688.4786153, "step_id": 2405, "start_load_kv_us": 3, "get_finished_us": 323} +{"t_unix": 1779813688.490248, "step_id": 2406, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813688.5020745, "step_id": 2407, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813688.5136719, "step_id": 2408, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813688.5257316, "step_id": 2409, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813688.537588, "step_id": 2410, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813688.5496836, "step_id": 2411, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813688.5615184, "step_id": 2412, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813688.573246, "step_id": 2413, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813688.5848248, "step_id": 2414, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813688.5967855, "step_id": 2415, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813688.608647, "step_id": 2416, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813688.6208012, "step_id": 2417, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813688.6328633, "step_id": 2418, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813688.6452303, "step_id": 2419, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813688.657362, "step_id": 2420, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813688.6694298, "step_id": 2421, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813688.6814928, "step_id": 2422, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813688.693503, "step_id": 2423, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813688.7059906, "step_id": 2424, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813688.718053, "step_id": 2425, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813688.7302873, "step_id": 2426, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813688.7418191, "step_id": 2427, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813688.7540355, "step_id": 2428, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813688.7661817, "step_id": 2429, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813688.7782283, "step_id": 2430, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813688.7896624, "step_id": 2431, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813688.8013847, "step_id": 2432, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813688.8131795, "step_id": 2433, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813688.8250492, "step_id": 2434, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813688.836566, "step_id": 2435, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813688.8478599, "step_id": 2436, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813688.8595994, "step_id": 2437, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813688.8713322, "step_id": 2438, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813688.8831818, "step_id": 2439, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813688.8951683, "step_id": 2440, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813688.9073985, "step_id": 2441, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813688.9197588, "step_id": 2442, "start_load_kv_us": 3, "get_finished_us": 247} +{"t_unix": 1779813688.9316993, "step_id": 2443, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813688.9436603, "step_id": 2444, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813688.9557695, "step_id": 2445, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813688.9676495, "step_id": 2446, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813688.9794953, "step_id": 2447, "start_load_kv_us": 3, "get_finished_us": 245} +{"t_unix": 1779813688.9913695, "step_id": 2448, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813689.0033174, "step_id": 2449, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813689.0156543, "step_id": 2450, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813689.0281234, "step_id": 2451, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813689.0403426, "step_id": 2452, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813689.052172, "step_id": 2453, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813689.0637276, "step_id": 2454, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813689.0748787, "step_id": 2455, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813689.0869284, "step_id": 2456, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813689.0988994, "step_id": 2457, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813689.1107953, "step_id": 2458, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813689.1225212, "step_id": 2459, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813689.1344526, "step_id": 2460, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813689.1464026, "step_id": 2461, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813689.1585808, "step_id": 2462, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813689.1705031, "step_id": 2463, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813689.182473, "step_id": 2464, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813689.1944888, "step_id": 2465, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813689.206185, "step_id": 2466, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813689.2182798, "step_id": 2467, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813689.2311487, "step_id": 2468, "start_load_kv_us": 3, "get_finished_us": 343} +{"t_unix": 1779813689.2423685, "step_id": 2469, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813689.2547586, "step_id": 2470, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813689.2670848, "step_id": 2471, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813689.2797067, "step_id": 2472, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813689.2907376, "step_id": 2473, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813689.3022873, "step_id": 2474, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813689.313983, "step_id": 2475, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813689.3255026, "step_id": 2476, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813689.3373137, "step_id": 2477, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813689.3494625, "step_id": 2478, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813689.361781, "step_id": 2479, "start_load_kv_us": 3, "get_finished_us": 193} +{"t_unix": 1779813689.37377, "step_id": 2480, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813689.3858178, "step_id": 2481, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813689.397276, "step_id": 2482, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813689.4065185, "step_id": 2483, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813689.4157097, "step_id": 2484, "start_load_kv_us": 3, "get_finished_us": 288} +{"t_unix": 1779813689.4246125, "step_id": 2485, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813689.4343152, "step_id": 2486, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813689.444264, "step_id": 2487, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813689.4541702, "step_id": 2488, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813689.4640286, "step_id": 2489, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813689.4739633, "step_id": 2490, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813689.4835901, "step_id": 2491, "start_load_kv_us": 3, "get_finished_us": 253} +{"t_unix": 1779813689.4934561, "step_id": 2492, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813689.5033193, "step_id": 2493, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813689.5138798, "step_id": 2494, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813689.523909, "step_id": 2495, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813689.534128, "step_id": 2496, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813689.5440495, "step_id": 2497, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813689.5540426, "step_id": 2498, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813689.5641282, "step_id": 2499, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813689.5744174, "step_id": 2500, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813689.5846667, "step_id": 2501, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813689.5948825, "step_id": 2502, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813689.605113, "step_id": 2503, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813689.6152952, "step_id": 2504, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813689.6256123, "step_id": 2505, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813689.6359076, "step_id": 2506, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813689.646093, "step_id": 2507, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813689.6562371, "step_id": 2508, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813689.6665425, "step_id": 2509, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813689.6769738, "step_id": 2510, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813689.6877077, "step_id": 2511, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813689.6986341, "step_id": 2512, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813689.7087932, "step_id": 2513, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813689.7189584, "step_id": 2514, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813689.729329, "step_id": 2515, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813689.7398038, "step_id": 2516, "start_load_kv_us": 14, "get_finished_us": 204} +{"t_unix": 1779813689.7502193, "step_id": 2517, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813689.7605958, "step_id": 2518, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813689.7711313, "step_id": 2519, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813689.7820961, "step_id": 2520, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813689.7929187, "step_id": 2521, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813689.8035653, "step_id": 2522, "start_load_kv_us": 3, "get_finished_us": 308} +{"t_unix": 1779813689.8136184, "step_id": 2523, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813689.8245015, "step_id": 2524, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813689.8353183, "step_id": 2525, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813689.8459723, "step_id": 2526, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813689.861139, "step_id": 2527, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813689.8670964, "step_id": 2528, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813689.8787775, "step_id": 2529, "start_load_kv_us": 3, "get_finished_us": 349} +{"t_unix": 1779813689.8884165, "step_id": 2530, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813689.8988848, "step_id": 2531, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813689.9094815, "step_id": 2532, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813689.9201353, "step_id": 2533, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813689.9304147, "step_id": 2534, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813689.9403818, "step_id": 2535, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813689.9505682, "step_id": 2536, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813689.9604094, "step_id": 2537, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813689.9702818, "step_id": 2538, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813689.9800532, "step_id": 2539, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813689.9899526, "step_id": 2540, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813689.9999723, "step_id": 2541, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813690.0107267, "step_id": 2542, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813690.0196548, "step_id": 2543, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813690.0296705, "step_id": 2544, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813690.0393074, "step_id": 2545, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813690.0490835, "step_id": 2546, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813690.0591857, "step_id": 2547, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813690.0700364, "step_id": 2548, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813690.079585, "step_id": 2549, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813690.0898752, "step_id": 2550, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813690.100154, "step_id": 2551, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813690.1103878, "step_id": 2552, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813690.1202612, "step_id": 2553, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813690.1307511, "step_id": 2554, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813690.1404045, "step_id": 2555, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813690.1503422, "step_id": 2556, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813690.160487, "step_id": 2557, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813690.1704128, "step_id": 2558, "start_load_kv_us": 3, "get_finished_us": 200} +{"t_unix": 1779813690.180605, "step_id": 2559, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813690.190846, "step_id": 2560, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813690.2007158, "step_id": 2561, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813690.2108865, "step_id": 2562, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813690.2206914, "step_id": 2563, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813690.2308486, "step_id": 2564, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813690.2411594, "step_id": 2565, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813690.2511384, "step_id": 2566, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813690.2612152, "step_id": 2567, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813690.2711658, "step_id": 2568, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813690.2811139, "step_id": 2569, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813690.2905998, "step_id": 2570, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813690.3006005, "step_id": 2571, "start_load_kv_us": 3, "get_finished_us": 197} +{"t_unix": 1779813690.3100932, "step_id": 2572, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813690.3186977, "step_id": 2573, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813690.3273497, "step_id": 2574, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813690.3384707, "step_id": 2575, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813690.343974, "step_id": 2576, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813690.39456, "step_id": 2577, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813690.5872636, "step_id": 2578, "start_load_kv_us": 2, "get_finished_us": 370} +{"t_unix": 1779813690.824433, "step_id": 2579, "start_load_kv_us": 3, "get_finished_us": 327} +{"t_unix": 1779813690.834424, "step_id": 2580, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813691.0697818, "step_id": 2581, "start_load_kv_us": 3, "get_finished_us": 311} +{"t_unix": 1779813691.081204, "step_id": 2582, "start_load_kv_us": 3, "get_finished_us": 189} +{"t_unix": 1779813691.0928717, "step_id": 2583, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813691.1041822, "step_id": 2584, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813691.115939, "step_id": 2585, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813691.1279647, "step_id": 2586, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813691.139658, "step_id": 2587, "start_load_kv_us": 3, "get_finished_us": 279} +{"t_unix": 1779813691.1522255, "step_id": 2588, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813691.1635592, "step_id": 2589, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813691.1756663, "step_id": 2590, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813691.1877863, "step_id": 2591, "start_load_kv_us": 14, "get_finished_us": 186} +{"t_unix": 1779813691.1997252, "step_id": 2592, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813691.2115982, "step_id": 2593, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813691.2233193, "step_id": 2594, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813691.2353425, "step_id": 2595, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813691.2469234, "step_id": 2596, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813691.2585115, "step_id": 2597, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813691.269823, "step_id": 2598, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813691.2813814, "step_id": 2599, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813691.292737, "step_id": 2600, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813691.3041494, "step_id": 2601, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813691.3155696, "step_id": 2602, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813691.3277757, "step_id": 2603, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813691.3391335, "step_id": 2604, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813691.3490207, "step_id": 2605, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813691.3585055, "step_id": 2606, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813691.3682864, "step_id": 2607, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813691.3781254, "step_id": 2608, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813691.387589, "step_id": 2609, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813691.3974557, "step_id": 2610, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813691.4074652, "step_id": 2611, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813691.4173043, "step_id": 2612, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813691.427351, "step_id": 2613, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813691.4373477, "step_id": 2614, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813691.4470203, "step_id": 2615, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813691.4568098, "step_id": 2616, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813691.4668007, "step_id": 2617, "start_load_kv_us": 3, "get_finished_us": 185} +{"t_unix": 1779813691.476762, "step_id": 2618, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813691.4864821, "step_id": 2619, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813691.496345, "step_id": 2620, "start_load_kv_us": 3, "get_finished_us": 150} +{"t_unix": 1779813691.5063956, "step_id": 2621, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813691.5164125, "step_id": 2622, "start_load_kv_us": 3, "get_finished_us": 168} +{"t_unix": 1779813691.5270028, "step_id": 2623, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813691.5372086, "step_id": 2624, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813691.5472827, "step_id": 2625, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813691.5570524, "step_id": 2626, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813691.567073, "step_id": 2627, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813691.5771203, "step_id": 2628, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813691.5866861, "step_id": 2629, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813691.5966985, "step_id": 2630, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813691.6072798, "step_id": 2631, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813691.6174679, "step_id": 2632, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813691.6254532, "step_id": 2633, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813691.6336532, "step_id": 2634, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813691.641773, "step_id": 2635, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813691.6498885, "step_id": 2636, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813691.6581023, "step_id": 2637, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813691.6665814, "step_id": 2638, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813691.6750376, "step_id": 2639, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813691.6833212, "step_id": 2640, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813691.6916559, "step_id": 2641, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813691.7000215, "step_id": 2642, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813691.708061, "step_id": 2643, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813691.7165642, "step_id": 2644, "start_load_kv_us": 3, "get_finished_us": 262} +{"t_unix": 1779813691.7249267, "step_id": 2645, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813691.7329917, "step_id": 2646, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813691.7413437, "step_id": 2647, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813691.7492557, "step_id": 2648, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813691.757316, "step_id": 2649, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813691.7649357, "step_id": 2650, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813691.7729628, "step_id": 2651, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813691.7809653, "step_id": 2652, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813691.7891421, "step_id": 2653, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813691.7974885, "step_id": 2654, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813691.806089, "step_id": 2655, "start_load_kv_us": 7, "get_finished_us": 194} +{"t_unix": 1779813691.814305, "step_id": 2656, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813691.8225875, "step_id": 2657, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813691.8306594, "step_id": 2658, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813691.8390868, "step_id": 2659, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813691.8471332, "step_id": 2660, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813691.8543122, "step_id": 2661, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813691.8615859, "step_id": 2662, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813691.8683927, "step_id": 2663, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813691.875756, "step_id": 2664, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813691.8834753, "step_id": 2665, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813691.891309, "step_id": 2666, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813691.8992114, "step_id": 2667, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813691.906975, "step_id": 2668, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813691.914669, "step_id": 2669, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813691.9226136, "step_id": 2670, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813691.9305644, "step_id": 2671, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813691.9383245, "step_id": 2672, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813691.9457786, "step_id": 2673, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813691.953152, "step_id": 2674, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813691.9612396, "step_id": 2675, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813691.96927, "step_id": 2676, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813691.9769294, "step_id": 2677, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813691.9846509, "step_id": 2678, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813691.9921608, "step_id": 2679, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813691.999905, "step_id": 2680, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813692.0074892, "step_id": 2681, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813692.0152516, "step_id": 2682, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813692.022606, "step_id": 2683, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813692.0301456, "step_id": 2684, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813692.0377052, "step_id": 2685, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813692.0455618, "step_id": 2686, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813692.0535326, "step_id": 2687, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813692.06125, "step_id": 2688, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813692.0690434, "step_id": 2689, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813692.0767782, "step_id": 2690, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813692.084049, "step_id": 2691, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813692.0914166, "step_id": 2692, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813692.0990772, "step_id": 2693, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813692.1070583, "step_id": 2694, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813692.1147876, "step_id": 2695, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813692.1227162, "step_id": 2696, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813692.130715, "step_id": 2697, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813692.1388733, "step_id": 2698, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813692.1465726, "step_id": 2699, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813692.1545243, "step_id": 2700, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813692.1622443, "step_id": 2701, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813692.1701274, "step_id": 2702, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813692.1781232, "step_id": 2703, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813692.1860838, "step_id": 2704, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813692.194105, "step_id": 2705, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813692.201699, "step_id": 2706, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813692.2093556, "step_id": 2707, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813692.2166266, "step_id": 2708, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813692.2238889, "step_id": 2709, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813692.231027, "step_id": 2710, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813692.2386198, "step_id": 2711, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813692.246207, "step_id": 2712, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813692.2533512, "step_id": 2713, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813692.260496, "step_id": 2714, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813692.2682374, "step_id": 2715, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813692.2753828, "step_id": 2716, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813692.2828267, "step_id": 2717, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813692.290273, "step_id": 2718, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813692.298146, "step_id": 2719, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813692.3056514, "step_id": 2720, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813692.313266, "step_id": 2721, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813692.3206923, "step_id": 2722, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813692.3283389, "step_id": 2723, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813692.3361912, "step_id": 2724, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813692.3441393, "step_id": 2725, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813692.3517947, "step_id": 2726, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813692.3599348, "step_id": 2727, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813692.3673816, "step_id": 2728, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813692.375293, "step_id": 2729, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813692.3830705, "step_id": 2730, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813692.390705, "step_id": 2731, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813692.3986404, "step_id": 2732, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813692.4066257, "step_id": 2733, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813692.4145951, "step_id": 2734, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813692.4226754, "step_id": 2735, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813692.4305413, "step_id": 2736, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813692.4386387, "step_id": 2737, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813692.4465659, "step_id": 2738, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813692.454476, "step_id": 2739, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813692.462505, "step_id": 2740, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813692.470262, "step_id": 2741, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813692.4781132, "step_id": 2742, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813692.4859643, "step_id": 2743, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813692.4937434, "step_id": 2744, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813692.5018206, "step_id": 2745, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813692.509626, "step_id": 2746, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813692.5175965, "step_id": 2747, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813692.5254683, "step_id": 2748, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813692.5339334, "step_id": 2749, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813692.541728, "step_id": 2750, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813692.549661, "step_id": 2751, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813692.557223, "step_id": 2752, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813692.5647144, "step_id": 2753, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813692.571972, "step_id": 2754, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813692.5789678, "step_id": 2755, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813692.5863497, "step_id": 2756, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813692.5938292, "step_id": 2757, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813692.6011066, "step_id": 2758, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813692.6083345, "step_id": 2759, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813692.6156402, "step_id": 2760, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813692.6231332, "step_id": 2761, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813692.6306317, "step_id": 2762, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813692.6378887, "step_id": 2763, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813692.644795, "step_id": 2764, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813692.6523802, "step_id": 2765, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813692.6599836, "step_id": 2766, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813692.6675448, "step_id": 2767, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813692.674965, "step_id": 2768, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813692.6823623, "step_id": 2769, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813692.6893327, "step_id": 2770, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813692.6965046, "step_id": 2771, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813692.703758, "step_id": 2772, "start_load_kv_us": 3, "get_finished_us": 161} +{"t_unix": 1779813692.71097, "step_id": 2773, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813692.7180586, "step_id": 2774, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813692.7254694, "step_id": 2775, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813692.7326436, "step_id": 2776, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813692.7403157, "step_id": 2777, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813692.7477963, "step_id": 2778, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813692.7548945, "step_id": 2779, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813692.762361, "step_id": 2780, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813692.7701886, "step_id": 2781, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813692.7779524, "step_id": 2782, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813692.7853954, "step_id": 2783, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813692.7929752, "step_id": 2784, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813692.8008904, "step_id": 2785, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813692.8086462, "step_id": 2786, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813692.8166065, "step_id": 2787, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813692.8246257, "step_id": 2788, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813692.8324745, "step_id": 2789, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813692.8404043, "step_id": 2790, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813692.8483708, "step_id": 2791, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813692.8561897, "step_id": 2792, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813692.8641374, "step_id": 2793, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813692.8718922, "step_id": 2794, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813692.8795679, "step_id": 2795, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813692.8874717, "step_id": 2796, "start_load_kv_us": 3, "get_finished_us": 241} +{"t_unix": 1779813692.8951964, "step_id": 2797, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813692.9029813, "step_id": 2798, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813692.9110043, "step_id": 2799, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813692.9187863, "step_id": 2800, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813692.9267159, "step_id": 2801, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813692.9346547, "step_id": 2802, "start_load_kv_us": 3, "get_finished_us": 166} +{"t_unix": 1779813692.9425824, "step_id": 2803, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813692.9504619, "step_id": 2804, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813692.9583778, "step_id": 2805, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813692.9662988, "step_id": 2806, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813692.9743686, "step_id": 2807, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813692.982288, "step_id": 2808, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813692.9902735, "step_id": 2809, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813692.998163, "step_id": 2810, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813693.0062044, "step_id": 2811, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813693.0142217, "step_id": 2812, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813693.0223088, "step_id": 2813, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813693.030225, "step_id": 2814, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813693.0386171, "step_id": 2815, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813693.0463223, "step_id": 2816, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813693.0542753, "step_id": 2817, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813693.0619938, "step_id": 2818, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813693.069821, "step_id": 2819, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813693.0779676, "step_id": 2820, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813693.0858734, "step_id": 2821, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.0939121, "step_id": 2822, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813693.1017237, "step_id": 2823, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813693.1093, "step_id": 2824, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813693.1171875, "step_id": 2825, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813693.125273, "step_id": 2826, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813693.1329725, "step_id": 2827, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813693.1412652, "step_id": 2828, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813693.1490247, "step_id": 2829, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813693.1571512, "step_id": 2830, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813693.1651664, "step_id": 2831, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813693.1731093, "step_id": 2832, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813693.181394, "step_id": 2833, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813693.1896336, "step_id": 2834, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813693.1951663, "step_id": 2835, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813693.199396, "step_id": 2836, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813693.2624774, "step_id": 2837, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813693.264397, "step_id": 2838, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813693.4593744, "step_id": 2839, "start_load_kv_us": 3, "get_finished_us": 343} +{"t_unix": 1779813693.4639108, "step_id": 2840, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813693.4688182, "step_id": 2841, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813693.4737551, "step_id": 2842, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813693.478915, "step_id": 2843, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813693.484164, "step_id": 2844, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813693.4891028, "step_id": 2845, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813693.4943428, "step_id": 2846, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813693.4993618, "step_id": 2847, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813693.504394, "step_id": 2848, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.509488, "step_id": 2849, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813693.5146255, "step_id": 2850, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813693.519607, "step_id": 2851, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813693.52474, "step_id": 2852, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813693.529808, "step_id": 2853, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813693.5349774, "step_id": 2854, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813693.5400095, "step_id": 2855, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813693.5451102, "step_id": 2856, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813693.5502396, "step_id": 2857, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813693.5560195, "step_id": 2858, "start_load_kv_us": 4, "get_finished_us": 183} +{"t_unix": 1779813693.560937, "step_id": 2859, "start_load_kv_us": 4, "get_finished_us": 206} +{"t_unix": 1779813693.5657947, "step_id": 2860, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813693.570718, "step_id": 2861, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813693.575783, "step_id": 2862, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813693.580964, "step_id": 2863, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813693.5859342, "step_id": 2864, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813693.5911245, "step_id": 2865, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813693.5961308, "step_id": 2866, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813693.6011631, "step_id": 2867, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.6064045, "step_id": 2868, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813693.6113503, "step_id": 2869, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813693.6164925, "step_id": 2870, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813693.6216092, "step_id": 2871, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813693.6266782, "step_id": 2872, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813693.6317322, "step_id": 2873, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813693.6368542, "step_id": 2874, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813693.641962, "step_id": 2875, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813693.647003, "step_id": 2876, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.6521037, "step_id": 2877, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813693.6572177, "step_id": 2878, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813693.6622984, "step_id": 2879, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813693.6674201, "step_id": 2880, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813693.672536, "step_id": 2881, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813693.6776338, "step_id": 2882, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813693.6827703, "step_id": 2883, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813693.688002, "step_id": 2884, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813693.693002, "step_id": 2885, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813693.6980982, "step_id": 2886, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813693.7031448, "step_id": 2887, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.7083213, "step_id": 2888, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813693.7133007, "step_id": 2889, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.7183988, "step_id": 2890, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.7235096, "step_id": 2891, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813693.72861, "step_id": 2892, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813693.7337263, "step_id": 2893, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813693.7388709, "step_id": 2894, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813693.7439394, "step_id": 2895, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813693.7490966, "step_id": 2896, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813693.754251, "step_id": 2897, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813693.7592962, "step_id": 2898, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813693.76435, "step_id": 2899, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813693.7695625, "step_id": 2900, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813693.7746642, "step_id": 2901, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813693.7797146, "step_id": 2902, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813693.7848222, "step_id": 2903, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813693.7898982, "step_id": 2904, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813693.794964, "step_id": 2905, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813693.8003147, "step_id": 2906, "start_load_kv_us": 2, "get_finished_us": 371} +{"t_unix": 1779813693.805187, "step_id": 2907, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.810216, "step_id": 2908, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813693.8152819, "step_id": 2909, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813693.8203943, "step_id": 2910, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813693.8255227, "step_id": 2911, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813693.83063, "step_id": 2912, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.8357327, "step_id": 2913, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813693.8408575, "step_id": 2914, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813693.84596, "step_id": 2915, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.851111, "step_id": 2916, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813693.8562226, "step_id": 2917, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813693.8612828, "step_id": 2918, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813693.867141, "step_id": 2919, "start_load_kv_us": 3, "get_finished_us": 246} +{"t_unix": 1779813693.8717148, "step_id": 2920, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813693.876737, "step_id": 2921, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813693.8819125, "step_id": 2922, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813693.8871136, "step_id": 2923, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813693.8922384, "step_id": 2924, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813693.8973563, "step_id": 2925, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813693.902259, "step_id": 2926, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813693.9075782, "step_id": 2927, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813693.9125202, "step_id": 2928, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813693.9176776, "step_id": 2929, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813693.9227183, "step_id": 2930, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813693.9277322, "step_id": 2931, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813693.9329057, "step_id": 2932, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813693.9380229, "step_id": 2933, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813693.9430802, "step_id": 2934, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813693.9481182, "step_id": 2935, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813693.9532306, "step_id": 2936, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813693.9583614, "step_id": 2937, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813693.9634237, "step_id": 2938, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813693.9685173, "step_id": 2939, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813693.9736326, "step_id": 2940, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813693.9787, "step_id": 2941, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813693.983804, "step_id": 2942, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813693.9889088, "step_id": 2943, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813693.9939575, "step_id": 2944, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813693.999097, "step_id": 2945, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813694.0041714, "step_id": 2946, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813694.0093148, "step_id": 2947, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813694.0144155, "step_id": 2948, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813694.0194209, "step_id": 2949, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813694.024581, "step_id": 2950, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813694.0296617, "step_id": 2951, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813694.034851, "step_id": 2952, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813694.0399277, "step_id": 2953, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813694.0451162, "step_id": 2954, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813694.0505052, "step_id": 2955, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813694.055289, "step_id": 2956, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813694.0603805, "step_id": 2957, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813694.0655682, "step_id": 2958, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813694.0706246, "step_id": 2959, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813694.0756671, "step_id": 2960, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813694.080771, "step_id": 2961, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813694.0858324, "step_id": 2962, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813694.090953, "step_id": 2963, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813694.0961199, "step_id": 2964, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813694.1011353, "step_id": 2965, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813694.106258, "step_id": 2966, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813694.1113458, "step_id": 2967, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813694.1164205, "step_id": 2968, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813694.1216006, "step_id": 2969, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813694.1267653, "step_id": 2970, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813694.1322055, "step_id": 2971, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813694.1373582, "step_id": 2972, "start_load_kv_us": 3, "get_finished_us": 275} +{"t_unix": 1779813694.142215, "step_id": 2973, "start_load_kv_us": 3, "get_finished_us": 201} +{"t_unix": 1779813694.147226, "step_id": 2974, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813694.1524556, "step_id": 2975, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813694.1574259, "step_id": 2976, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813694.16251, "step_id": 2977, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813694.1675568, "step_id": 2978, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813694.1726792, "step_id": 2979, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813694.1778247, "step_id": 2980, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813694.182891, "step_id": 2981, "start_load_kv_us": 1, "get_finished_us": 130} +{"t_unix": 1779813694.188003, "step_id": 2982, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813694.1931157, "step_id": 2983, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813694.1981678, "step_id": 2984, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813694.203376, "step_id": 2985, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813694.208563, "step_id": 2986, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813694.2136288, "step_id": 2987, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813694.2190192, "step_id": 2988, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813694.2240417, "step_id": 2989, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813694.2290292, "step_id": 2990, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813694.2341163, "step_id": 2991, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813694.2392094, "step_id": 2992, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813694.244311, "step_id": 2993, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813694.2493777, "step_id": 2994, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813694.2544835, "step_id": 2995, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813694.2597444, "step_id": 2996, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813694.2647977, "step_id": 2997, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813694.269896, "step_id": 2998, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813694.2750194, "step_id": 2999, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813694.2801685, "step_id": 3000, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813694.2852888, "step_id": 3001, "start_load_kv_us": 14, "get_finished_us": 294} +{"t_unix": 1779813694.2902977, "step_id": 3002, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813694.2953875, "step_id": 3003, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813694.3005157, "step_id": 3004, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813694.3055952, "step_id": 3005, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813694.3106816, "step_id": 3006, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813694.3157277, "step_id": 3007, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813694.3208325, "step_id": 3008, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813694.3260221, "step_id": 3009, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813694.3311226, "step_id": 3010, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813694.3362772, "step_id": 3011, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813694.3414505, "step_id": 3012, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813694.3464558, "step_id": 3013, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813694.3515115, "step_id": 3014, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813694.3565934, "step_id": 3015, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813694.361731, "step_id": 3016, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813694.3668284, "step_id": 3017, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813694.3719838, "step_id": 3018, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813694.3770323, "step_id": 3019, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813694.3822021, "step_id": 3020, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813694.3872733, "step_id": 3021, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813694.3923485, "step_id": 3022, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813694.3974297, "step_id": 3023, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813694.40264, "step_id": 3024, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813694.4076838, "step_id": 3025, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813694.413706, "step_id": 3026, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813694.4575746, "step_id": 3027, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813694.459772, "step_id": 3028, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813694.6984043, "step_id": 3029, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813694.9373567, "step_id": 3030, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813694.9399035, "step_id": 3031, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813695.1396232, "step_id": 3032, "start_load_kv_us": 10, "get_finished_us": 373} +{"t_unix": 1779813695.1459806, "step_id": 3033, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813695.153405, "step_id": 3034, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813695.1608095, "step_id": 3035, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813695.1686811, "step_id": 3036, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813695.1765597, "step_id": 3037, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813695.1842945, "step_id": 3038, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813695.1919222, "step_id": 3039, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813695.1993227, "step_id": 3040, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813695.2072704, "step_id": 3041, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813695.2663639, "step_id": 3042, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813695.268848, "step_id": 3043, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813695.4963403, "step_id": 3044, "start_load_kv_us": 3, "get_finished_us": 300} +{"t_unix": 1779813695.4986777, "step_id": 3045, "start_load_kv_us": 15, "get_finished_us": 179} +{"t_unix": 1779813695.7453258, "step_id": 3046, "start_load_kv_us": 3, "get_finished_us": 300} +{"t_unix": 1779813695.7477767, "step_id": 3047, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813696.1656973, "step_id": 3048, "start_load_kv_us": 4, "get_finished_us": 343} +{"t_unix": 1779813696.1754649, "step_id": 3049, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813696.1865225, "step_id": 3050, "start_load_kv_us": 3, "get_finished_us": 252} +{"t_unix": 1779813696.1968098, "step_id": 3051, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813696.2074747, "step_id": 3052, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813696.2185652, "step_id": 3053, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813696.2293026, "step_id": 3054, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813696.239912, "step_id": 3055, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813696.2512834, "step_id": 3056, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813696.2625237, "step_id": 3057, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813696.277262, "step_id": 3058, "start_load_kv_us": 3, "get_finished_us": 232} +{"t_unix": 1779813696.2851992, "step_id": 3059, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813696.2967687, "step_id": 3060, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813696.307912, "step_id": 3061, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813696.3188787, "step_id": 3062, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813696.3299234, "step_id": 3063, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813696.341141, "step_id": 3064, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813696.3521783, "step_id": 3065, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813696.3639035, "step_id": 3066, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813696.374478, "step_id": 3067, "start_load_kv_us": 3, "get_finished_us": 164} +{"t_unix": 1779813696.3857715, "step_id": 3068, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813696.3967984, "step_id": 3069, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813696.4091244, "step_id": 3070, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813696.4213455, "step_id": 3071, "start_load_kv_us": 5, "get_finished_us": 298} +{"t_unix": 1779813696.432407, "step_id": 3072, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813696.443984, "step_id": 3073, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813696.4563751, "step_id": 3074, "start_load_kv_us": 2, "get_finished_us": 1129} +{"t_unix": 1779813696.509887, "step_id": 3075, "start_load_kv_us": 2, "get_finished_us": 1119} +{"t_unix": 1779813696.7552612, "step_id": 3076, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813696.7578754, "step_id": 3077, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813696.951544, "step_id": 3078, "start_load_kv_us": 3, "get_finished_us": 246} +{"t_unix": 1779813696.9654582, "step_id": 3079, "start_load_kv_us": 3, "get_finished_us": 196} +{"t_unix": 1779813696.979844, "step_id": 3080, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813696.9940941, "step_id": 3081, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813697.008266, "step_id": 3082, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813697.0221832, "step_id": 3083, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813697.036516, "step_id": 3084, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813697.0506644, "step_id": 3085, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813697.06522, "step_id": 3086, "start_load_kv_us": 3, "get_finished_us": 290} +{"t_unix": 1779813697.0780737, "step_id": 3087, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813697.0916293, "step_id": 3088, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813697.1052797, "step_id": 3089, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813697.119258, "step_id": 3090, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813697.1329706, "step_id": 3091, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813697.147174, "step_id": 3092, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813697.161336, "step_id": 3093, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813697.1754315, "step_id": 3094, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813697.1878471, "step_id": 3095, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813697.2000256, "step_id": 3096, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813697.2121394, "step_id": 3097, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813697.2245827, "step_id": 3098, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813697.2367623, "step_id": 3099, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813697.2487807, "step_id": 3100, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813697.259889, "step_id": 3101, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813697.2711878, "step_id": 3102, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813697.282392, "step_id": 3103, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813697.2933707, "step_id": 3104, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813697.304976, "step_id": 3105, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813697.316663, "step_id": 3106, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813697.328403, "step_id": 3107, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813697.3409042, "step_id": 3108, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813697.3523254, "step_id": 3109, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813697.3640442, "step_id": 3110, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813697.375324, "step_id": 3111, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813697.3873608, "step_id": 3112, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813697.3992026, "step_id": 3113, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813697.4110963, "step_id": 3114, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813697.422781, "step_id": 3115, "start_load_kv_us": 3, "get_finished_us": 154} +{"t_unix": 1779813697.4345334, "step_id": 3116, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813697.4457269, "step_id": 3117, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813697.457134, "step_id": 3118, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813697.4686694, "step_id": 3119, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813697.4806316, "step_id": 3120, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813697.492677, "step_id": 3121, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813697.5045786, "step_id": 3122, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813697.516505, "step_id": 3123, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813697.5284872, "step_id": 3124, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813697.540047, "step_id": 3125, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813697.5516627, "step_id": 3126, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813697.5632322, "step_id": 3127, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813697.5747097, "step_id": 3128, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813697.586396, "step_id": 3129, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813697.59867, "step_id": 3130, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813697.610391, "step_id": 3131, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813697.6224515, "step_id": 3132, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813697.6346343, "step_id": 3133, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813697.6465938, "step_id": 3134, "start_load_kv_us": 3, "get_finished_us": 196} +{"t_unix": 1779813697.6583097, "step_id": 3135, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813697.6700692, "step_id": 3136, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813697.6815202, "step_id": 3137, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813697.6934783, "step_id": 3138, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813697.7054574, "step_id": 3139, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813697.7172875, "step_id": 3140, "start_load_kv_us": 3, "get_finished_us": 279} +{"t_unix": 1779813697.7294116, "step_id": 3141, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813697.741635, "step_id": 3142, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813697.754304, "step_id": 3143, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813697.7663448, "step_id": 3144, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813697.7782974, "step_id": 3145, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813697.7940905, "step_id": 3146, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813697.8027978, "step_id": 3147, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813697.8199928, "step_id": 3148, "start_load_kv_us": 81, "get_finished_us": 1608} +{"t_unix": 1779813697.826751, "step_id": 3149, "start_load_kv_us": 3, "get_finished_us": 211} +{"t_unix": 1779813697.8398845, "step_id": 3150, "start_load_kv_us": 3, "get_finished_us": 186} +{"t_unix": 1779813697.8518677, "step_id": 3151, "start_load_kv_us": 3, "get_finished_us": 271} +{"t_unix": 1779813697.864302, "step_id": 3152, "start_load_kv_us": 3, "get_finished_us": 272} +{"t_unix": 1779813697.8762307, "step_id": 3153, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813697.888086, "step_id": 3154, "start_load_kv_us": 3, "get_finished_us": 204} +{"t_unix": 1779813697.8998027, "step_id": 3155, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813697.9122672, "step_id": 3156, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813697.924201, "step_id": 3157, "start_load_kv_us": 15, "get_finished_us": 207} +{"t_unix": 1779813697.9360833, "step_id": 3158, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813697.948231, "step_id": 3159, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813697.9604125, "step_id": 3160, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813697.972463, "step_id": 3161, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813697.9847214, "step_id": 3162, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813697.9969928, "step_id": 3163, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813698.0096688, "step_id": 3164, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813698.0222554, "step_id": 3165, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813698.0345354, "step_id": 3166, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813698.0464318, "step_id": 3167, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813698.058304, "step_id": 3168, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813698.0704124, "step_id": 3169, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813698.0819583, "step_id": 3170, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813698.093932, "step_id": 3171, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813698.1058664, "step_id": 3172, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813698.1182323, "step_id": 3173, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813698.130122, "step_id": 3174, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813698.1422539, "step_id": 3175, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813698.1545742, "step_id": 3176, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813698.1668267, "step_id": 3177, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813698.179211, "step_id": 3178, "start_load_kv_us": 16, "get_finished_us": 216} +{"t_unix": 1779813698.1914287, "step_id": 3179, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813698.2034795, "step_id": 3180, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813698.215727, "step_id": 3181, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813698.228161, "step_id": 3182, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813698.2403717, "step_id": 3183, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813698.252376, "step_id": 3184, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813698.2645943, "step_id": 3185, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813698.2765894, "step_id": 3186, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813698.288886, "step_id": 3187, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813698.3008475, "step_id": 3188, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813698.3125417, "step_id": 3189, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813698.3244612, "step_id": 3190, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813698.3367648, "step_id": 3191, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813698.3489645, "step_id": 3192, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813698.3609414, "step_id": 3193, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813698.3730078, "step_id": 3194, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813698.3855884, "step_id": 3195, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813698.397806, "step_id": 3196, "start_load_kv_us": 14, "get_finished_us": 205} +{"t_unix": 1779813698.4103887, "step_id": 3197, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813698.422501, "step_id": 3198, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813698.434998, "step_id": 3199, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813698.4475098, "step_id": 3200, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813698.4597015, "step_id": 3201, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813698.4721534, "step_id": 3202, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813698.4846506, "step_id": 3203, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813698.4974482, "step_id": 3204, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813698.510077, "step_id": 3205, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813698.522755, "step_id": 3206, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813698.5352528, "step_id": 3207, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813698.5480049, "step_id": 3208, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813698.5606315, "step_id": 3209, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813698.5732477, "step_id": 3210, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813698.5855784, "step_id": 3211, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813698.5979981, "step_id": 3212, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813698.6106749, "step_id": 3213, "start_load_kv_us": 3, "get_finished_us": 256} +{"t_unix": 1779813698.6227124, "step_id": 3214, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813698.635135, "step_id": 3215, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813698.6471102, "step_id": 3216, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813698.6590188, "step_id": 3217, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813698.6708465, "step_id": 3218, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813698.6831794, "step_id": 3219, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813698.69553, "step_id": 3220, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813698.7076936, "step_id": 3221, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813698.7201054, "step_id": 3222, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813698.7326458, "step_id": 3223, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813698.744586, "step_id": 3224, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813698.7567182, "step_id": 3225, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813698.7687435, "step_id": 3226, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813698.7809303, "step_id": 3227, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813698.7929394, "step_id": 3228, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813698.8049817, "step_id": 3229, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813698.8171258, "step_id": 3230, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813698.8293252, "step_id": 3231, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813698.8412127, "step_id": 3232, "start_load_kv_us": 15, "get_finished_us": 216} +{"t_unix": 1779813698.8528888, "step_id": 3233, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813698.8646064, "step_id": 3234, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813698.8760402, "step_id": 3235, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813698.8880603, "step_id": 3236, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813698.900251, "step_id": 3237, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813698.9126513, "step_id": 3238, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813698.9250798, "step_id": 3239, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813698.9373834, "step_id": 3240, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813698.9495673, "step_id": 3241, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813698.9616144, "step_id": 3242, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813698.9741602, "step_id": 3243, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813698.9868007, "step_id": 3244, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813698.999192, "step_id": 3245, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813699.0114536, "step_id": 3246, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813699.0243273, "step_id": 3247, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813699.0369036, "step_id": 3248, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813699.0495625, "step_id": 3249, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813699.0621147, "step_id": 3250, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813699.0746899, "step_id": 3251, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813699.0873415, "step_id": 3252, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813699.099959, "step_id": 3253, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813699.1124058, "step_id": 3254, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813699.1251395, "step_id": 3255, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813699.1375818, "step_id": 3256, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813699.1503308, "step_id": 3257, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813699.162715, "step_id": 3258, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813699.1747487, "step_id": 3259, "start_load_kv_us": 3, "get_finished_us": 225} +{"t_unix": 1779813699.1871824, "step_id": 3260, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813699.199642, "step_id": 3261, "start_load_kv_us": 3, "get_finished_us": 229} +{"t_unix": 1779813699.211988, "step_id": 3262, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813699.2247896, "step_id": 3263, "start_load_kv_us": 3, "get_finished_us": 295} +{"t_unix": 1779813699.2370505, "step_id": 3264, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813699.2501829, "step_id": 3265, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813699.2629237, "step_id": 3266, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813699.2759106, "step_id": 3267, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813699.2888443, "step_id": 3268, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813699.3013573, "step_id": 3269, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813699.3136578, "step_id": 3270, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813699.3261056, "step_id": 3271, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813699.3382905, "step_id": 3272, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813699.350712, "step_id": 3273, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813699.3636045, "step_id": 3274, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813699.3763294, "step_id": 3275, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813699.388609, "step_id": 3276, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813699.4009871, "step_id": 3277, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813699.4130485, "step_id": 3278, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813699.4249647, "step_id": 3279, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813699.4368868, "step_id": 3280, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813699.4486609, "step_id": 3281, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813699.4601686, "step_id": 3282, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813699.4726331, "step_id": 3283, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813699.4848058, "step_id": 3284, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813699.4967873, "step_id": 3285, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813699.5092614, "step_id": 3286, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813699.522904, "step_id": 3287, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813699.5302699, "step_id": 3288, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813699.5394146, "step_id": 3289, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813699.5487394, "step_id": 3290, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813699.5581577, "step_id": 3291, "start_load_kv_us": 3, "get_finished_us": 161} +{"t_unix": 1779813699.5678277, "step_id": 3292, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813699.5778015, "step_id": 3293, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813699.587412, "step_id": 3294, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813699.5970855, "step_id": 3295, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813699.6064746, "step_id": 3296, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813699.6161714, "step_id": 3297, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813699.625935, "step_id": 3298, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813699.6353543, "step_id": 3299, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813699.64547, "step_id": 3300, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813699.655414, "step_id": 3301, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813699.6648653, "step_id": 3302, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813699.6729245, "step_id": 3303, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813699.6786053, "step_id": 3304, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813699.6845624, "step_id": 3305, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813699.6904633, "step_id": 3306, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813699.6964178, "step_id": 3307, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813699.7025893, "step_id": 3308, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813699.7089193, "step_id": 3309, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813699.715148, "step_id": 3310, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813699.7211344, "step_id": 3311, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813699.7273264, "step_id": 3312, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813699.7335646, "step_id": 3313, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813699.7401314, "step_id": 3314, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813699.746432, "step_id": 3315, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813699.7529366, "step_id": 3316, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813699.7593694, "step_id": 3317, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813699.7657454, "step_id": 3318, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813699.7722409, "step_id": 3319, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813699.7785985, "step_id": 3320, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813699.7855368, "step_id": 3321, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813699.7917633, "step_id": 3322, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813699.7982142, "step_id": 3323, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813699.8046792, "step_id": 3324, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813699.811066, "step_id": 3325, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813699.8174324, "step_id": 3326, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813699.8239844, "step_id": 3327, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813699.8303556, "step_id": 3328, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813699.8368838, "step_id": 3329, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813699.843329, "step_id": 3330, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813699.8501477, "step_id": 3331, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813699.856023, "step_id": 3332, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813699.8602524, "step_id": 3333, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813700.0362716, "step_id": 3334, "start_load_kv_us": 3, "get_finished_us": 331} +{"t_unix": 1779813700.0382938, "step_id": 3335, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813700.2274008, "step_id": 3336, "start_load_kv_us": 3, "get_finished_us": 328} +{"t_unix": 1779813700.2322505, "step_id": 3337, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813700.2371352, "step_id": 3338, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813700.2421894, "step_id": 3339, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813700.2473447, "step_id": 3340, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813700.2523823, "step_id": 3341, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813700.2573936, "step_id": 3342, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813700.2625704, "step_id": 3343, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813700.2676473, "step_id": 3344, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813700.272721, "step_id": 3345, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813700.277773, "step_id": 3346, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813700.282957, "step_id": 3347, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813700.2879822, "step_id": 3348, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813700.2930977, "step_id": 3349, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813700.2981493, "step_id": 3350, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813700.3032322, "step_id": 3351, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813700.3083198, "step_id": 3352, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813700.3134642, "step_id": 3353, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813700.318517, "step_id": 3354, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813700.3236082, "step_id": 3355, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813700.32875, "step_id": 3356, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813700.3337555, "step_id": 3357, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.338875, "step_id": 3358, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813700.3439593, "step_id": 3359, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813700.3490934, "step_id": 3360, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813700.354242, "step_id": 3361, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813700.3593392, "step_id": 3362, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813700.3643973, "step_id": 3363, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813700.3694701, "step_id": 3364, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813700.3746357, "step_id": 3365, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813700.3797271, "step_id": 3366, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813700.3848891, "step_id": 3367, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.3900023, "step_id": 3368, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813700.395164, "step_id": 3369, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813700.400155, "step_id": 3370, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813700.4052706, "step_id": 3371, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813700.4104805, "step_id": 3372, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813700.415428, "step_id": 3373, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813700.4206338, "step_id": 3374, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813700.4258075, "step_id": 3375, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813700.4308503, "step_id": 3376, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813700.4358387, "step_id": 3377, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813700.4409065, "step_id": 3378, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813700.4460342, "step_id": 3379, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813700.4511352, "step_id": 3380, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813700.4561813, "step_id": 3381, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813700.4612987, "step_id": 3382, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813700.466393, "step_id": 3383, "start_load_kv_us": 3, "get_finished_us": 144} +{"t_unix": 1779813700.471463, "step_id": 3384, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813700.4765975, "step_id": 3385, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813700.4816482, "step_id": 3386, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813700.4867897, "step_id": 3387, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813700.491877, "step_id": 3388, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813700.496988, "step_id": 3389, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813700.502073, "step_id": 3390, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813700.5072074, "step_id": 3391, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.5122871, "step_id": 3392, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813700.5173917, "step_id": 3393, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813700.52249, "step_id": 3394, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813700.5276124, "step_id": 3395, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813700.5327697, "step_id": 3396, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813700.537872, "step_id": 3397, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813700.5428767, "step_id": 3398, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813700.5480185, "step_id": 3399, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813700.553158, "step_id": 3400, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813700.5585737, "step_id": 3401, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813700.5633934, "step_id": 3402, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813700.5684907, "step_id": 3403, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813700.574095, "step_id": 3404, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813700.5787635, "step_id": 3405, "start_load_kv_us": 3, "get_finished_us": 161} +{"t_unix": 1779813700.5838177, "step_id": 3406, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813700.5888972, "step_id": 3407, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813700.594, "step_id": 3408, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813700.5990555, "step_id": 3409, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813700.6041582, "step_id": 3410, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813700.609267, "step_id": 3411, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813700.614348, "step_id": 3412, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813700.619487, "step_id": 3413, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.6245136, "step_id": 3414, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813700.6297183, "step_id": 3415, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813700.6348062, "step_id": 3416, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813700.6399875, "step_id": 3417, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813700.6450155, "step_id": 3418, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813700.6501164, "step_id": 3419, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813700.6551988, "step_id": 3420, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813700.6603172, "step_id": 3421, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813700.6654196, "step_id": 3422, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813700.6705306, "step_id": 3423, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813700.6756055, "step_id": 3424, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813700.6807435, "step_id": 3425, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813700.6858575, "step_id": 3426, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813700.6909082, "step_id": 3427, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813700.6960144, "step_id": 3428, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813700.7010708, "step_id": 3429, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813700.706167, "step_id": 3430, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813700.711241, "step_id": 3431, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813700.716375, "step_id": 3432, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813700.7216036, "step_id": 3433, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813700.7265298, "step_id": 3434, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813700.7317243, "step_id": 3435, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813700.7368124, "step_id": 3436, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813700.7419274, "step_id": 3437, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813700.7470274, "step_id": 3438, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813700.7521513, "step_id": 3439, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813700.7572355, "step_id": 3440, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813700.7628798, "step_id": 3441, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813700.767397, "step_id": 3442, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813700.772539, "step_id": 3443, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813700.777646, "step_id": 3444, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813700.7827535, "step_id": 3445, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813700.7878726, "step_id": 3446, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813700.792969, "step_id": 3447, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813700.7980459, "step_id": 3448, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813700.8031623, "step_id": 3449, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813700.8082283, "step_id": 3450, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813700.8133407, "step_id": 3451, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813700.8184597, "step_id": 3452, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.8235054, "step_id": 3453, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813700.8287032, "step_id": 3454, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813700.8337982, "step_id": 3455, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813700.838884, "step_id": 3456, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813700.8440678, "step_id": 3457, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813700.849116, "step_id": 3458, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813700.8541868, "step_id": 3459, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813700.859345, "step_id": 3460, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813700.8644679, "step_id": 3461, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813700.869522, "step_id": 3462, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813700.8745952, "step_id": 3463, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813700.8797657, "step_id": 3464, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813700.8856723, "step_id": 3465, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.8903508, "step_id": 3466, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813700.8951676, "step_id": 3467, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813700.9000769, "step_id": 3468, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813700.9048085, "step_id": 3469, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813700.9095368, "step_id": 3470, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813700.9143693, "step_id": 3471, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813700.919113, "step_id": 3472, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813700.923935, "step_id": 3473, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813700.9286878, "step_id": 3474, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813700.9334533, "step_id": 3475, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813700.9382608, "step_id": 3476, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813700.9429939, "step_id": 3477, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813700.9478369, "step_id": 3478, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813700.9526343, "step_id": 3479, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813700.9573662, "step_id": 3480, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813700.962521, "step_id": 3481, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813700.9670587, "step_id": 3482, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813700.9718792, "step_id": 3483, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813700.9766142, "step_id": 3484, "start_load_kv_us": 1, "get_finished_us": 244} +{"t_unix": 1779813700.981407, "step_id": 3485, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813700.9862072, "step_id": 3486, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813700.9910192, "step_id": 3487, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813700.9957774, "step_id": 3488, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813701.0005262, "step_id": 3489, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813701.0052426, "step_id": 3490, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813701.0101311, "step_id": 3491, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813701.0148368, "step_id": 3492, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813701.0196552, "step_id": 3493, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813701.0243938, "step_id": 3494, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813701.0291414, "step_id": 3495, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813701.033939, "step_id": 3496, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813701.0388272, "step_id": 3497, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813701.0435266, "step_id": 3498, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813701.0491087, "step_id": 3499, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813701.0539944, "step_id": 3500, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813701.0587153, "step_id": 3501, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.063533, "step_id": 3502, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813701.0683076, "step_id": 3503, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.073563, "step_id": 3504, "start_load_kv_us": 2, "get_finished_us": 582} +{"t_unix": 1779813701.0779219, "step_id": 3505, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813701.0826979, "step_id": 3506, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813701.087488, "step_id": 3507, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813701.0923262, "step_id": 3508, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.0971272, "step_id": 3509, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813701.1019266, "step_id": 3510, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813701.1067176, "step_id": 3511, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813701.1114216, "step_id": 3512, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813701.1163135, "step_id": 3513, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813701.1211503, "step_id": 3514, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813701.125882, "step_id": 3515, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813701.1307402, "step_id": 3516, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813701.1355705, "step_id": 3517, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813701.140371, "step_id": 3518, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813701.1451027, "step_id": 3519, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813701.149878, "step_id": 3520, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813701.1546378, "step_id": 3521, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813701.1594727, "step_id": 3522, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813701.1643047, "step_id": 3523, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813701.169117, "step_id": 3524, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813701.173909, "step_id": 3525, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813701.1786044, "step_id": 3526, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813701.183403, "step_id": 3527, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813701.1881702, "step_id": 3528, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813701.193001, "step_id": 3529, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813701.197688, "step_id": 3530, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813701.2024817, "step_id": 3531, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813701.2072704, "step_id": 3532, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813701.2120793, "step_id": 3533, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813701.2168844, "step_id": 3534, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813701.2217145, "step_id": 3535, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813701.226493, "step_id": 3536, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813701.23124, "step_id": 3537, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813701.2360253, "step_id": 3538, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813701.240824, "step_id": 3539, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813701.2456365, "step_id": 3540, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813701.2511756, "step_id": 3541, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813701.2559407, "step_id": 3542, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813701.260905, "step_id": 3543, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813701.2655253, "step_id": 3544, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813701.2703512, "step_id": 3545, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813701.275102, "step_id": 3546, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.286784, "step_id": 3547, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813701.2886472, "step_id": 3548, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813701.2928383, "step_id": 3549, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813701.2976282, "step_id": 3550, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813701.3024178, "step_id": 3551, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.3071873, "step_id": 3552, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.3120043, "step_id": 3553, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813701.31681, "step_id": 3554, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813701.3215241, "step_id": 3555, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813701.326318, "step_id": 3556, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813701.3311298, "step_id": 3557, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813701.336009, "step_id": 3558, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813701.3407438, "step_id": 3559, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813701.3454847, "step_id": 3560, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813701.3503351, "step_id": 3561, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.3550928, "step_id": 3562, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813701.3599408, "step_id": 3563, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813701.3647933, "step_id": 3564, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813701.369492, "step_id": 3565, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813701.3743088, "step_id": 3566, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813701.3790855, "step_id": 3567, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813701.3838713, "step_id": 3568, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813701.388681, "step_id": 3569, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813701.3934286, "step_id": 3570, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813701.3982399, "step_id": 3571, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813701.403071, "step_id": 3572, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813701.4078505, "step_id": 3573, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813701.4126272, "step_id": 3574, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813701.417482, "step_id": 3575, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813701.422338, "step_id": 3576, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813701.4271061, "step_id": 3577, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813701.4318604, "step_id": 3578, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.4366515, "step_id": 3579, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813701.4419847, "step_id": 3580, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813701.4463408, "step_id": 3581, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813701.45109, "step_id": 3582, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813701.4559655, "step_id": 3583, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813701.4606318, "step_id": 3584, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813701.4654012, "step_id": 3585, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813701.4710338, "step_id": 3586, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813701.475727, "step_id": 3587, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813701.4804645, "step_id": 3588, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813701.4852653, "step_id": 3589, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813701.4896462, "step_id": 3590, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813701.493808, "step_id": 3591, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813701.7239277, "step_id": 3592, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813701.7259564, "step_id": 3593, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813701.9210982, "step_id": 3594, "start_load_kv_us": 7, "get_finished_us": 339} +{"t_unix": 1779813701.9252388, "step_id": 3595, "start_load_kv_us": 3, "get_finished_us": 211} +{"t_unix": 1779813701.930013, "step_id": 3596, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813701.9347653, "step_id": 3597, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813701.9394844, "step_id": 3598, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813701.9442563, "step_id": 3599, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813701.949, "step_id": 3600, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813701.9537244, "step_id": 3601, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813701.9585903, "step_id": 3602, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813701.9633403, "step_id": 3603, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813701.9681392, "step_id": 3604, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813701.972897, "step_id": 3605, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813701.977575, "step_id": 3606, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813701.9823203, "step_id": 3607, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813701.987111, "step_id": 3608, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813701.991987, "step_id": 3609, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813701.9966402, "step_id": 3610, "start_load_kv_us": 17, "get_finished_us": 151} +{"t_unix": 1779813702.002102, "step_id": 3611, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813702.006925, "step_id": 3612, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813702.0116549, "step_id": 3613, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813702.016376, "step_id": 3614, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813702.0211647, "step_id": 3615, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813702.0260053, "step_id": 3616, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813702.030804, "step_id": 3617, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813702.0355184, "step_id": 3618, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813702.0403144, "step_id": 3619, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813702.045072, "step_id": 3620, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813702.0498796, "step_id": 3621, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813702.0546563, "step_id": 3622, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813702.0593677, "step_id": 3623, "start_load_kv_us": 1, "get_finished_us": 131} +{"t_unix": 1779813702.0642354, "step_id": 3624, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813702.069124, "step_id": 3625, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813702.0738938, "step_id": 3626, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813702.0786157, "step_id": 3627, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813702.0833783, "step_id": 3628, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813702.0881188, "step_id": 3629, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813702.0929654, "step_id": 3630, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813702.0977564, "step_id": 3631, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813702.102525, "step_id": 3632, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813702.1072924, "step_id": 3633, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813702.1121192, "step_id": 3634, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813702.1169097, "step_id": 3635, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813702.121697, "step_id": 3636, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813702.1264844, "step_id": 3637, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813702.131247, "step_id": 3638, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813702.1360219, "step_id": 3639, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813702.140805, "step_id": 3640, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813702.1456156, "step_id": 3641, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813702.1503015, "step_id": 3642, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813702.155048, "step_id": 3643, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813702.1598482, "step_id": 3644, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813702.164603, "step_id": 3645, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813702.1693742, "step_id": 3646, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813702.1741943, "step_id": 3647, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813702.178935, "step_id": 3648, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813702.1840394, "step_id": 3649, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813702.1886482, "step_id": 3650, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813702.1934564, "step_id": 3651, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813702.1981819, "step_id": 3652, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813702.203058, "step_id": 3653, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813702.207884, "step_id": 3654, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813702.21262, "step_id": 3655, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813702.217318, "step_id": 3656, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813702.2221806, "step_id": 3657, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813702.2268696, "step_id": 3658, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813702.2316003, "step_id": 3659, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813702.236473, "step_id": 3660, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813702.241195, "step_id": 3661, "start_load_kv_us": 3, "get_finished_us": 155} +{"t_unix": 1779813702.2461214, "step_id": 3662, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813702.2508094, "step_id": 3663, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813702.2555993, "step_id": 3664, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813702.260359, "step_id": 3665, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813702.265111, "step_id": 3666, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813702.2698412, "step_id": 3667, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813702.2745938, "step_id": 3668, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813702.2793777, "step_id": 3669, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813702.2841272, "step_id": 3670, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813702.2889361, "step_id": 3671, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813702.2937248, "step_id": 3672, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813702.2985213, "step_id": 3673, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813702.303271, "step_id": 3674, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813702.3089337, "step_id": 3675, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813702.3135738, "step_id": 3676, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813702.3183231, "step_id": 3677, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813702.323126, "step_id": 3678, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813702.3279004, "step_id": 3679, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813702.3326516, "step_id": 3680, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813702.3374286, "step_id": 3681, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813702.3423226, "step_id": 3682, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813702.3471434, "step_id": 3683, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813702.351859, "step_id": 3684, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813702.356654, "step_id": 3685, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813702.3616433, "step_id": 3686, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813702.3662424, "step_id": 3687, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813702.3710194, "step_id": 3688, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813702.3758624, "step_id": 3689, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813702.3805249, "step_id": 3690, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813702.385361, "step_id": 3691, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813702.3901012, "step_id": 3692, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813702.3949358, "step_id": 3693, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813702.3996818, "step_id": 3694, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813702.4048023, "step_id": 3695, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813702.4093351, "step_id": 3696, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813702.4141593, "step_id": 3697, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813702.418918, "step_id": 3698, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813702.4237351, "step_id": 3699, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813702.4284563, "step_id": 3700, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813702.4331856, "step_id": 3701, "start_load_kv_us": 3, "get_finished_us": 147} +{"t_unix": 1779813702.437962, "step_id": 3702, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813702.4427223, "step_id": 3703, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813702.44752, "step_id": 3704, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813702.4523766, "step_id": 3705, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813702.4571643, "step_id": 3706, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813702.4621298, "step_id": 3707, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813702.4666991, "step_id": 3708, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813702.471522, "step_id": 3709, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813702.4762938, "step_id": 3710, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813702.481073, "step_id": 3711, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813702.4858077, "step_id": 3712, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813702.4905975, "step_id": 3713, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813702.495387, "step_id": 3714, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813702.5001268, "step_id": 3715, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813702.504975, "step_id": 3716, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813702.5097952, "step_id": 3717, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813702.5145679, "step_id": 3718, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813702.5193624, "step_id": 3719, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813702.5241518, "step_id": 3720, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813702.528966, "step_id": 3721, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813702.533705, "step_id": 3722, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813702.5385072, "step_id": 3723, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813702.5434058, "step_id": 3724, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813702.5482192, "step_id": 3725, "start_load_kv_us": 5, "get_finished_us": 155} +{"t_unix": 1779813702.5529008, "step_id": 3726, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813702.557626, "step_id": 3727, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813702.5624282, "step_id": 3728, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813702.5671203, "step_id": 3729, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813702.571982, "step_id": 3730, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813702.5767207, "step_id": 3731, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813702.5814614, "step_id": 3732, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813702.586287, "step_id": 3733, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813702.5910733, "step_id": 3734, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813702.5958605, "step_id": 3735, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813702.600651, "step_id": 3736, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813702.6054878, "step_id": 3737, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813702.6101966, "step_id": 3738, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813702.6150455, "step_id": 3739, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813702.6197798, "step_id": 3740, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813702.6245928, "step_id": 3741, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813702.6293302, "step_id": 3742, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813702.6341686, "step_id": 3743, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813702.638983, "step_id": 3744, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813702.6437783, "step_id": 3745, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813702.648456, "step_id": 3746, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813702.6532955, "step_id": 3747, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813702.6580853, "step_id": 3748, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813702.6629562, "step_id": 3749, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813702.6677048, "step_id": 3750, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813702.672463, "step_id": 3751, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813702.6772866, "step_id": 3752, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813702.6821148, "step_id": 3753, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813702.6868773, "step_id": 3754, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813702.6916661, "step_id": 3755, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813702.6964617, "step_id": 3756, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813702.7012177, "step_id": 3757, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813702.7060509, "step_id": 3758, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813702.7131426, "step_id": 3759, "start_load_kv_us": 3, "get_finished_us": 148} +{"t_unix": 1779813702.715652, "step_id": 3760, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813702.7204504, "step_id": 3761, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813702.7673333, "step_id": 3762, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813702.7694135, "step_id": 3763, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813702.9656668, "step_id": 3764, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813702.9713027, "step_id": 3765, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813702.9772778, "step_id": 3766, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813702.983461, "step_id": 3767, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813702.9896812, "step_id": 3768, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813702.995872, "step_id": 3769, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813703.0019624, "step_id": 3770, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813703.0080893, "step_id": 3771, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813703.0142617, "step_id": 3772, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813703.0203505, "step_id": 3773, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813703.0262215, "step_id": 3774, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813703.0321593, "step_id": 3775, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813703.0379915, "step_id": 3776, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813703.043966, "step_id": 3777, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813703.049888, "step_id": 3778, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.0557442, "step_id": 3779, "start_load_kv_us": 13, "get_finished_us": 149} +{"t_unix": 1779813703.0616412, "step_id": 3780, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813703.0673485, "step_id": 3781, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813703.0729299, "step_id": 3782, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813703.078575, "step_id": 3783, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813703.0845373, "step_id": 3784, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813703.0900998, "step_id": 3785, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813703.0958834, "step_id": 3786, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.1017582, "step_id": 3787, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813703.1074047, "step_id": 3788, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.113494, "step_id": 3789, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813703.1193054, "step_id": 3790, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813703.1254172, "step_id": 3791, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813703.131143, "step_id": 3792, "start_load_kv_us": 3, "get_finished_us": 149} +{"t_unix": 1779813703.1369562, "step_id": 3793, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813703.142767, "step_id": 3794, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813703.1484902, "step_id": 3795, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813703.1543005, "step_id": 3796, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813703.160409, "step_id": 3797, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813703.166229, "step_id": 3798, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813703.171995, "step_id": 3799, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813703.1780405, "step_id": 3800, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813703.1837287, "step_id": 3801, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.1894813, "step_id": 3802, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813703.195507, "step_id": 3803, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813703.2013457, "step_id": 3804, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813703.2072732, "step_id": 3805, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813703.2132692, "step_id": 3806, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813703.2193904, "step_id": 3807, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813703.225624, "step_id": 3808, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813703.2317266, "step_id": 3809, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813703.2376292, "step_id": 3810, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813703.2436452, "step_id": 3811, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813703.2498276, "step_id": 3812, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.2558446, "step_id": 3813, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813703.2620955, "step_id": 3814, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813703.267727, "step_id": 3815, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813703.2737353, "step_id": 3816, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813703.2800093, "step_id": 3817, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813703.2860982, "step_id": 3818, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813703.2919931, "step_id": 3819, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813703.2975256, "step_id": 3820, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813703.3033695, "step_id": 3821, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813703.3092213, "step_id": 3822, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813703.315253, "step_id": 3823, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813703.3210664, "step_id": 3824, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813703.3270695, "step_id": 3825, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813703.3328326, "step_id": 3826, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813703.3385367, "step_id": 3827, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813703.3446803, "step_id": 3828, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813703.350581, "step_id": 3829, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813703.356676, "step_id": 3830, "start_load_kv_us": 15, "get_finished_us": 190} +{"t_unix": 1779813703.3626623, "step_id": 3831, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813703.368688, "step_id": 3832, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813703.3744104, "step_id": 3833, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813703.3799927, "step_id": 3834, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813703.3856986, "step_id": 3835, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813703.3919222, "step_id": 3836, "start_load_kv_us": 3, "get_finished_us": 215} +{"t_unix": 1779813703.3976622, "step_id": 3837, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813703.403306, "step_id": 3838, "start_load_kv_us": 5, "get_finished_us": 263} +{"t_unix": 1779813703.4090395, "step_id": 3839, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813703.4147863, "step_id": 3840, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813703.4206986, "step_id": 3841, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813703.4266243, "step_id": 3842, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813703.433048, "step_id": 3843, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813703.4389067, "step_id": 3844, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813703.4449084, "step_id": 3845, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813703.4507222, "step_id": 3846, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813703.4568348, "step_id": 3847, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813703.463191, "step_id": 3848, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813703.4689991, "step_id": 3849, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813703.4735823, "step_id": 3850, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813703.4783306, "step_id": 3851, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813703.483095, "step_id": 3852, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813703.4878793, "step_id": 3853, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813703.4925935, "step_id": 3854, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813703.4973629, "step_id": 3855, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813703.5021522, "step_id": 3856, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813703.5069847, "step_id": 3857, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813703.5117302, "step_id": 3858, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813703.5165098, "step_id": 3859, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.521316, "step_id": 3860, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813703.5260754, "step_id": 3861, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813703.5308707, "step_id": 3862, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813703.5356247, "step_id": 3863, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813703.540406, "step_id": 3864, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813703.5452082, "step_id": 3865, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813703.5499961, "step_id": 3866, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813703.554792, "step_id": 3867, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813703.559888, "step_id": 3868, "start_load_kv_us": 3, "get_finished_us": 153} +{"t_unix": 1779813703.5644603, "step_id": 3869, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813703.569112, "step_id": 3870, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813703.5739639, "step_id": 3871, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813703.5787292, "step_id": 3872, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813703.5834844, "step_id": 3873, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813703.588269, "step_id": 3874, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813703.5931177, "step_id": 3875, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813703.5978978, "step_id": 3876, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813703.602642, "step_id": 3877, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813703.6074276, "step_id": 3878, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813703.6121957, "step_id": 3879, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813703.6170404, "step_id": 3880, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813703.6218143, "step_id": 3881, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813703.6265934, "step_id": 3882, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813703.63131, "step_id": 3883, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813703.6361535, "step_id": 3884, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813703.6410136, "step_id": 3885, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813703.6457093, "step_id": 3886, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813703.6504903, "step_id": 3887, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813703.6552515, "step_id": 3888, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813703.6600947, "step_id": 3889, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813703.664874, "step_id": 3890, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813703.6696172, "step_id": 3891, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813703.6744072, "step_id": 3892, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813703.6791883, "step_id": 3893, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813703.6839752, "step_id": 3894, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813703.6888351, "step_id": 3895, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813703.6935792, "step_id": 3896, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813703.6983454, "step_id": 3897, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813703.7031097, "step_id": 3898, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813703.7093892, "step_id": 3899, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813703.753381, "step_id": 3900, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813703.7554708, "step_id": 3901, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813703.9553094, "step_id": 3902, "start_load_kv_us": 18, "get_finished_us": 307} +{"t_unix": 1779813703.9608793, "step_id": 3903, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813703.9666533, "step_id": 3904, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813703.9724128, "step_id": 3905, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813703.9780884, "step_id": 3906, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813703.983981, "step_id": 3907, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813703.9895089, "step_id": 3908, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813703.9951735, "step_id": 3909, "start_load_kv_us": 13, "get_finished_us": 183} +{"t_unix": 1779813704.0008297, "step_id": 3910, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813704.0066504, "step_id": 3911, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813704.0126128, "step_id": 3912, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813704.0595222, "step_id": 3913, "start_load_kv_us": 3, "get_finished_us": 316} +{"t_unix": 1779813704.061933, "step_id": 3914, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813704.2617834, "step_id": 3915, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813704.2683084, "step_id": 3916, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813704.2754304, "step_id": 3917, "start_load_kv_us": 3, "get_finished_us": 216} +{"t_unix": 1779813704.282629, "step_id": 3918, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813704.289677, "step_id": 3919, "start_load_kv_us": 3, "get_finished_us": 213} +{"t_unix": 1779813704.2983315, "step_id": 3920, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813704.3026402, "step_id": 3921, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813704.3094497, "step_id": 3922, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813704.316361, "step_id": 3923, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813704.3237085, "step_id": 3924, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813704.3308723, "step_id": 3925, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813704.3382373, "step_id": 3926, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813704.3452559, "step_id": 3927, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813704.3524826, "step_id": 3928, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813704.3599577, "step_id": 3929, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813704.3671737, "step_id": 3930, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813704.3745368, "step_id": 3931, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813704.381838, "step_id": 3932, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813704.3892376, "step_id": 3933, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813704.3963456, "step_id": 3934, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813704.403713, "step_id": 3935, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813704.4110193, "step_id": 3936, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813704.417933, "step_id": 3937, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813704.4251332, "step_id": 3938, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813704.4324324, "step_id": 3939, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813704.4400396, "step_id": 3940, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813704.4477742, "step_id": 3941, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813704.454701, "step_id": 3942, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813704.4622927, "step_id": 3943, "start_load_kv_us": 4, "get_finished_us": 211} +{"t_unix": 1779813704.4689646, "step_id": 3944, "start_load_kv_us": 3, "get_finished_us": 242} +{"t_unix": 1779813704.4757538, "step_id": 3945, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813704.4824278, "step_id": 3946, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813704.489477, "step_id": 3947, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813704.496413, "step_id": 3948, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813704.5038693, "step_id": 3949, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813704.5117555, "step_id": 3950, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813704.5192645, "step_id": 3951, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813704.526667, "step_id": 3952, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813704.5339959, "step_id": 3953, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813704.5413609, "step_id": 3954, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813704.54882, "step_id": 3955, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813704.5558684, "step_id": 3956, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813704.5631359, "step_id": 3957, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813704.570507, "step_id": 3958, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813704.577123, "step_id": 3959, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813704.584223, "step_id": 3960, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813704.5917633, "step_id": 3961, "start_load_kv_us": 7, "get_finished_us": 180} +{"t_unix": 1779813704.5990524, "step_id": 3962, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813704.606231, "step_id": 3963, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813704.6136024, "step_id": 3964, "start_load_kv_us": 3, "get_finished_us": 220} +{"t_unix": 1779813704.620995, "step_id": 3965, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813704.6282477, "step_id": 3966, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813704.635607, "step_id": 3967, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813704.6430864, "step_id": 3968, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813704.650873, "step_id": 3969, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813704.6579297, "step_id": 3970, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813704.6651473, "step_id": 3971, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813704.6724682, "step_id": 3972, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813704.6797903, "step_id": 3973, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813704.6870322, "step_id": 3974, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813704.6941586, "step_id": 3975, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813704.7016356, "step_id": 3976, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813704.7090998, "step_id": 3977, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813704.7167704, "step_id": 3978, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813704.7242458, "step_id": 3979, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813704.7318075, "step_id": 3980, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813704.7395048, "step_id": 3981, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813704.7469175, "step_id": 3982, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813704.7543564, "step_id": 3983, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813704.7616444, "step_id": 3984, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813704.768926, "step_id": 3985, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813704.817534, "step_id": 3986, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813704.8196518, "step_id": 3987, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813705.0184898, "step_id": 3988, "start_load_kv_us": 3, "get_finished_us": 347} +{"t_unix": 1779813705.024993, "step_id": 3989, "start_load_kv_us": 3, "get_finished_us": 203} +{"t_unix": 1779813705.0324872, "step_id": 3990, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813705.0400188, "step_id": 3991, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813705.0471556, "step_id": 3992, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813705.0543473, "step_id": 3993, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813705.0618079, "step_id": 3994, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813705.0693517, "step_id": 3995, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813705.0770204, "step_id": 3996, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813705.0844784, "step_id": 3997, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813705.09233, "step_id": 3998, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813705.1000988, "step_id": 3999, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813705.1078777, "step_id": 4000, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813705.1156695, "step_id": 4001, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813705.1233907, "step_id": 4002, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813705.1311316, "step_id": 4003, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813705.1387546, "step_id": 4004, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813705.1466827, "step_id": 4005, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813705.154232, "step_id": 4006, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813705.1619663, "step_id": 4007, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813705.1693552, "step_id": 4008, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813705.176983, "step_id": 4009, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813705.184895, "step_id": 4010, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813705.1925993, "step_id": 4011, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813705.2000968, "step_id": 4012, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813705.2082148, "step_id": 4013, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813705.2151756, "step_id": 4014, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813705.2222905, "step_id": 4015, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813705.2303488, "step_id": 4016, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813705.2372658, "step_id": 4017, "start_load_kv_us": 3, "get_finished_us": 222} +{"t_unix": 1779813705.2454693, "step_id": 4018, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813705.2531495, "step_id": 4019, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813705.2606673, "step_id": 4020, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813705.268146, "step_id": 4021, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813705.2756398, "step_id": 4022, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813705.2832096, "step_id": 4023, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813705.2904158, "step_id": 4024, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813705.2977958, "step_id": 4025, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813705.30492, "step_id": 4026, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813705.3120615, "step_id": 4027, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813705.3193777, "step_id": 4028, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813705.326957, "step_id": 4029, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813705.334411, "step_id": 4030, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813705.3418794, "step_id": 4031, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813705.34904, "step_id": 4032, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813705.3656874, "step_id": 4033, "start_load_kv_us": 2, "get_finished_us": 9214} +{"t_unix": 1779813705.3678405, "step_id": 4034, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813705.3717985, "step_id": 4035, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813705.3792136, "step_id": 4036, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813705.3864233, "step_id": 4037, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813705.3938954, "step_id": 4038, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813705.4014006, "step_id": 4039, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813705.408931, "step_id": 4040, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813705.4164803, "step_id": 4041, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813705.4240475, "step_id": 4042, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813705.4312859, "step_id": 4043, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813705.438597, "step_id": 4044, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813705.446099, "step_id": 4045, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813705.4534118, "step_id": 4046, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813705.4605563, "step_id": 4047, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813705.4680717, "step_id": 4048, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813705.4755938, "step_id": 4049, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813705.4828382, "step_id": 4050, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813705.4901319, "step_id": 4051, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813705.497679, "step_id": 4052, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813705.5054433, "step_id": 4053, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813705.5130448, "step_id": 4054, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813705.5206006, "step_id": 4055, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813705.527643, "step_id": 4056, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813705.5346913, "step_id": 4057, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813705.5416903, "step_id": 4058, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813705.5487227, "step_id": 4059, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813705.556053, "step_id": 4060, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813705.563421, "step_id": 4061, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813705.5708997, "step_id": 4062, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813705.578294, "step_id": 4063, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813705.5857685, "step_id": 4064, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813705.5930839, "step_id": 4065, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813705.6005912, "step_id": 4066, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813705.6080053, "step_id": 4067, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813705.6155381, "step_id": 4068, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813705.6237438, "step_id": 4069, "start_load_kv_us": 3, "get_finished_us": 153} +{"t_unix": 1779813705.630575, "step_id": 4070, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813705.6375144, "step_id": 4071, "start_load_kv_us": 3, "get_finished_us": 248} +{"t_unix": 1779813705.644509, "step_id": 4072, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813705.6519816, "step_id": 4073, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813705.6596262, "step_id": 4074, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813705.6669931, "step_id": 4075, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813705.6742632, "step_id": 4076, "start_load_kv_us": 3, "get_finished_us": 259} +{"t_unix": 1779813705.6814098, "step_id": 4077, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813705.6889083, "step_id": 4078, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813705.6969595, "step_id": 4079, "start_load_kv_us": 3, "get_finished_us": 235} +{"t_unix": 1779813705.7044814, "step_id": 4080, "start_load_kv_us": 6, "get_finished_us": 263} +{"t_unix": 1779813705.7114263, "step_id": 4081, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813705.718825, "step_id": 4082, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813705.7260518, "step_id": 4083, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813705.7915316, "step_id": 4084, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813705.7939558, "step_id": 4085, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813705.97506, "step_id": 4086, "start_load_kv_us": 3, "get_finished_us": 286} +{"t_unix": 1779813705.9823334, "step_id": 4087, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813705.9899073, "step_id": 4088, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813705.9971101, "step_id": 4089, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813706.004466, "step_id": 4090, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813706.0117385, "step_id": 4091, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813706.018807, "step_id": 4092, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813706.0257936, "step_id": 4093, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813706.0326123, "step_id": 4094, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813706.0398574, "step_id": 4095, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813706.0474286, "step_id": 4096, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813706.0551214, "step_id": 4097, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813706.0623212, "step_id": 4098, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813706.0700154, "step_id": 4099, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813706.0776103, "step_id": 4100, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813706.0851493, "step_id": 4101, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813706.0925026, "step_id": 4102, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813706.1001377, "step_id": 4103, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813706.1075673, "step_id": 4104, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813706.115247, "step_id": 4105, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813706.1230454, "step_id": 4106, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813706.130371, "step_id": 4107, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813706.1379046, "step_id": 4108, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813706.145282, "step_id": 4109, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813706.1529965, "step_id": 4110, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813706.1607249, "step_id": 4111, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813706.2095928, "step_id": 4112, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813706.4033215, "step_id": 4113, "start_load_kv_us": 3, "get_finished_us": 309} +{"t_unix": 1779813706.413029, "step_id": 4114, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813706.6503086, "step_id": 4115, "start_load_kv_us": 4, "get_finished_us": 399} +{"t_unix": 1779813706.659118, "step_id": 4116, "start_load_kv_us": 3, "get_finished_us": 206} +{"t_unix": 1779813706.670498, "step_id": 4117, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813706.6764948, "step_id": 4118, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813706.6854637, "step_id": 4119, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813706.6942294, "step_id": 4120, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813706.70352, "step_id": 4121, "start_load_kv_us": 2, "get_finished_us": 425} +{"t_unix": 1779813706.7123497, "step_id": 4122, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813706.721407, "step_id": 4123, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813706.7305226, "step_id": 4124, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813706.7400377, "step_id": 4125, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813706.7492156, "step_id": 4126, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813706.7587419, "step_id": 4127, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813706.7685223, "step_id": 4128, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813706.7782357, "step_id": 4129, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813706.7883244, "step_id": 4130, "start_load_kv_us": 3, "get_finished_us": 178} +{"t_unix": 1779813706.797414, "step_id": 4131, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813706.8071415, "step_id": 4132, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813706.8165078, "step_id": 4133, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813706.826002, "step_id": 4134, "start_load_kv_us": 2, "get_finished_us": 414} +{"t_unix": 1779813706.8354218, "step_id": 4135, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813706.8451385, "step_id": 4136, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813706.854868, "step_id": 4137, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813706.8713486, "step_id": 4138, "start_load_kv_us": 2, "get_finished_us": 7094} +{"t_unix": 1779813706.9352784, "step_id": 4139, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813706.9378219, "step_id": 4140, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813707.1215193, "step_id": 4141, "start_load_kv_us": 3, "get_finished_us": 310} +{"t_unix": 1779813707.1871903, "step_id": 4142, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813707.1897213, "step_id": 4143, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813707.3824444, "step_id": 4144, "start_load_kv_us": 3, "get_finished_us": 304} +{"t_unix": 1779813707.3917341, "step_id": 4145, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813707.421685, "step_id": 4146, "start_load_kv_us": 3, "get_finished_us": 283} +{"t_unix": 1779813707.4239016, "step_id": 4147, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813707.4332864, "step_id": 4148, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813707.4483957, "step_id": 4149, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813707.455931, "step_id": 4150, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813707.4668925, "step_id": 4151, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813707.4780123, "step_id": 4152, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813707.4889808, "step_id": 4153, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813707.5003195, "step_id": 4154, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813707.511846, "step_id": 4155, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813707.523349, "step_id": 4156, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813707.5346055, "step_id": 4157, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813707.5461948, "step_id": 4158, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813707.5582116, "step_id": 4159, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813707.56988, "step_id": 4160, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813707.5814068, "step_id": 4161, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813707.5931306, "step_id": 4162, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813707.6043456, "step_id": 4163, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813707.616064, "step_id": 4164, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813707.628232, "step_id": 4165, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813707.6401079, "step_id": 4166, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813707.651589, "step_id": 4167, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813707.6632295, "step_id": 4168, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813707.6752648, "step_id": 4169, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813707.6865733, "step_id": 4170, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813707.6960359, "step_id": 4171, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813707.7059593, "step_id": 4172, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813707.7158408, "step_id": 4173, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813707.7271602, "step_id": 4174, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813707.7364628, "step_id": 4175, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813707.7477663, "step_id": 4176, "start_load_kv_us": 2, "get_finished_us": 1232} +{"t_unix": 1779813707.7570608, "step_id": 4177, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813707.8074467, "step_id": 4178, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813707.8096845, "step_id": 4179, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813708.0150464, "step_id": 4180, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813708.0270858, "step_id": 4181, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813708.0391343, "step_id": 4182, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813708.055296, "step_id": 4183, "start_load_kv_us": 3, "get_finished_us": 292} +{"t_unix": 1779813708.0624645, "step_id": 4184, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813708.0738966, "step_id": 4185, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813708.0853622, "step_id": 4186, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813708.0967512, "step_id": 4187, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813708.1081476, "step_id": 4188, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813708.119832, "step_id": 4189, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813708.1730247, "step_id": 4190, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813708.175299, "step_id": 4191, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813708.3804903, "step_id": 4192, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813708.3914828, "step_id": 4193, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813708.4023135, "step_id": 4194, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813708.4129617, "step_id": 4195, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813708.4235952, "step_id": 4196, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813708.4343984, "step_id": 4197, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813708.4455104, "step_id": 4198, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813708.4568098, "step_id": 4199, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813708.4677155, "step_id": 4200, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813708.478744, "step_id": 4201, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813708.4898376, "step_id": 4202, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813708.500996, "step_id": 4203, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813708.5123491, "step_id": 4204, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813708.5238452, "step_id": 4205, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813708.5352004, "step_id": 4206, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813708.5463862, "step_id": 4207, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813708.5576386, "step_id": 4208, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813708.5688658, "step_id": 4209, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813708.5803216, "step_id": 4210, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813708.591895, "step_id": 4211, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813708.6036794, "step_id": 4212, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813708.6158195, "step_id": 4213, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813708.62742, "step_id": 4214, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813708.6391797, "step_id": 4215, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813708.650827, "step_id": 4216, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813708.6624484, "step_id": 4217, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813708.6738274, "step_id": 4218, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813708.6858764, "step_id": 4219, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813708.697573, "step_id": 4220, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813708.7096765, "step_id": 4221, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813708.7207398, "step_id": 4222, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813708.7320385, "step_id": 4223, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813708.7436223, "step_id": 4224, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813708.75556, "step_id": 4225, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813708.767479, "step_id": 4226, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813708.7796962, "step_id": 4227, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813708.791537, "step_id": 4228, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813708.804039, "step_id": 4229, "start_load_kv_us": 2, "get_finished_us": 426} +{"t_unix": 1779813708.8159974, "step_id": 4230, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813708.8280354, "step_id": 4231, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813708.8403006, "step_id": 4232, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813708.8521278, "step_id": 4233, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813708.8642678, "step_id": 4234, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813708.876782, "step_id": 4235, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813708.8888748, "step_id": 4236, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813708.9014027, "step_id": 4237, "start_load_kv_us": 2, "get_finished_us": 391} +{"t_unix": 1779813708.913595, "step_id": 4238, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813708.9257123, "step_id": 4239, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813708.9377713, "step_id": 4240, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813708.9498053, "step_id": 4241, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813708.9619634, "step_id": 4242, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813708.973937, "step_id": 4243, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813708.9856782, "step_id": 4244, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813708.997925, "step_id": 4245, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813709.0097635, "step_id": 4246, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813709.0214133, "step_id": 4247, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813709.0330567, "step_id": 4248, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813709.0456371, "step_id": 4249, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813709.056863, "step_id": 4250, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813709.0685148, "step_id": 4251, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813709.080485, "step_id": 4252, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813709.092338, "step_id": 4253, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813709.104559, "step_id": 4254, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813709.1167836, "step_id": 4255, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813709.1285884, "step_id": 4256, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813709.1407735, "step_id": 4257, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813709.152401, "step_id": 4258, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813709.164297, "step_id": 4259, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813709.1762044, "step_id": 4260, "start_load_kv_us": 3, "get_finished_us": 213} +{"t_unix": 1779813709.1879885, "step_id": 4261, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813709.1997879, "step_id": 4262, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813709.2117863, "step_id": 4263, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813709.2239337, "step_id": 4264, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813709.2359781, "step_id": 4265, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813709.248067, "step_id": 4266, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813709.2602623, "step_id": 4267, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813709.2724152, "step_id": 4268, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813709.2847238, "step_id": 4269, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813709.2969317, "step_id": 4270, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813709.3087862, "step_id": 4271, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813709.321124, "step_id": 4272, "start_load_kv_us": 3, "get_finished_us": 244} +{"t_unix": 1779813709.3329396, "step_id": 4273, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813709.3441727, "step_id": 4274, "start_load_kv_us": 3, "get_finished_us": 168} +{"t_unix": 1779813709.3557305, "step_id": 4275, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813709.367626, "step_id": 4276, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813709.3791423, "step_id": 4277, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813709.390974, "step_id": 4278, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813709.40272, "step_id": 4279, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813709.4147158, "step_id": 4280, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813709.4267778, "step_id": 4281, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813709.4386108, "step_id": 4282, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813709.4505823, "step_id": 4283, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813709.4623709, "step_id": 4284, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813709.4740536, "step_id": 4285, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813709.4862251, "step_id": 4286, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813709.4985032, "step_id": 4287, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813709.5107484, "step_id": 4288, "start_load_kv_us": 3, "get_finished_us": 154} +{"t_unix": 1779813709.5230627, "step_id": 4289, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813709.5352688, "step_id": 4290, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813709.5477343, "step_id": 4291, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813709.5599077, "step_id": 4292, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813709.5721335, "step_id": 4293, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813709.5843306, "step_id": 4294, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813709.5963466, "step_id": 4295, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813709.6087286, "step_id": 4296, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813709.620881, "step_id": 4297, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813709.6332104, "step_id": 4298, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813709.6453187, "step_id": 4299, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813709.6608837, "step_id": 4300, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813709.6698399, "step_id": 4301, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813709.6821632, "step_id": 4302, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813709.694255, "step_id": 4303, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813709.706412, "step_id": 4304, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813709.7184262, "step_id": 4305, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813709.7301788, "step_id": 4306, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813709.7422934, "step_id": 4307, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813709.754263, "step_id": 4308, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813709.7661965, "step_id": 4309, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813709.7781894, "step_id": 4310, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813709.7899985, "step_id": 4311, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813709.8021255, "step_id": 4312, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813709.8142908, "step_id": 4313, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813709.8264642, "step_id": 4314, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813709.8382254, "step_id": 4315, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813709.8501875, "step_id": 4316, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813709.86215, "step_id": 4317, "start_load_kv_us": 14, "get_finished_us": 162} +{"t_unix": 1779813709.8743477, "step_id": 4318, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813709.8866107, "step_id": 4319, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813709.8988805, "step_id": 4320, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813709.9107566, "step_id": 4321, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813709.9226441, "step_id": 4322, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813709.934656, "step_id": 4323, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813709.946229, "step_id": 4324, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813709.958024, "step_id": 4325, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813709.9697375, "step_id": 4326, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813709.981633, "step_id": 4327, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813709.9934993, "step_id": 4328, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813710.005213, "step_id": 4329, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813710.0171714, "step_id": 4330, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813710.028842, "step_id": 4331, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813710.0407732, "step_id": 4332, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813710.0522804, "step_id": 4333, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813710.0636759, "step_id": 4334, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813710.0752876, "step_id": 4335, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813710.0871255, "step_id": 4336, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813710.0983849, "step_id": 4337, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813710.1103141, "step_id": 4338, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813710.122327, "step_id": 4339, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813710.1343887, "step_id": 4340, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813710.146155, "step_id": 4341, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813710.1951444, "step_id": 4342, "start_load_kv_us": 2, "get_finished_us": 336} +{"t_unix": 1779813710.1974227, "step_id": 4343, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813710.441089, "step_id": 4344, "start_load_kv_us": 3, "get_finished_us": 365} +{"t_unix": 1779813710.44384, "step_id": 4345, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813710.6529202, "step_id": 4346, "start_load_kv_us": 3, "get_finished_us": 311} +{"t_unix": 1779813710.6632729, "step_id": 4347, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813710.6742332, "step_id": 4348, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813710.6852298, "step_id": 4349, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813710.696072, "step_id": 4350, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813710.706594, "step_id": 4351, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813710.717685, "step_id": 4352, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813710.7286131, "step_id": 4353, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813710.7394676, "step_id": 4354, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813710.7501392, "step_id": 4355, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813710.760997, "step_id": 4356, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813710.7722652, "step_id": 4357, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813710.783866, "step_id": 4358, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813710.7953007, "step_id": 4359, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813710.8066998, "step_id": 4360, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813710.8184276, "step_id": 4361, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813710.830232, "step_id": 4362, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813710.841686, "step_id": 4363, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813710.8532088, "step_id": 4364, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813710.8647, "step_id": 4365, "start_load_kv_us": 15, "get_finished_us": 218} +{"t_unix": 1779813710.8762374, "step_id": 4366, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813710.8875418, "step_id": 4367, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813710.899149, "step_id": 4368, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813710.9108913, "step_id": 4369, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813710.9226706, "step_id": 4370, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813710.9320383, "step_id": 4371, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813710.9420843, "step_id": 4372, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813710.9518118, "step_id": 4373, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813710.961366, "step_id": 4374, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813710.971029, "step_id": 4375, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813710.980265, "step_id": 4376, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813710.989518, "step_id": 4377, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813710.9994767, "step_id": 4378, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813711.0096686, "step_id": 4379, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813711.0195203, "step_id": 4380, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813711.0300436, "step_id": 4381, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813711.0395412, "step_id": 4382, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813711.049177, "step_id": 4383, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813711.0588815, "step_id": 4384, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813711.0686817, "step_id": 4385, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813711.0786407, "step_id": 4386, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813711.0889893, "step_id": 4387, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813711.0991037, "step_id": 4388, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813711.1091223, "step_id": 4389, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813711.1187987, "step_id": 4390, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813711.1281483, "step_id": 4391, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813711.1381607, "step_id": 4392, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813711.1479173, "step_id": 4393, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813711.1572769, "step_id": 4394, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813711.16703, "step_id": 4395, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813711.1763606, "step_id": 4396, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813711.185919, "step_id": 4397, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813711.1956701, "step_id": 4398, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813711.2046149, "step_id": 4399, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813711.2117908, "step_id": 4400, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813711.2191253, "step_id": 4401, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813711.2352402, "step_id": 4402, "start_load_kv_us": 9, "get_finished_us": 248} +{"t_unix": 1779813711.237224, "step_id": 4403, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813711.2447147, "step_id": 4404, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813711.2524724, "step_id": 4405, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813711.260496, "step_id": 4406, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813711.268433, "step_id": 4407, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813711.2761278, "step_id": 4408, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813711.3215325, "step_id": 4409, "start_load_kv_us": 3, "get_finished_us": 227} +{"t_unix": 1779813711.323652, "step_id": 4410, "start_load_kv_us": 17, "get_finished_us": 164} +{"t_unix": 1779813711.5265834, "step_id": 4411, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813711.536225, "step_id": 4412, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813711.546112, "step_id": 4413, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813711.5561342, "step_id": 4414, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813711.5661552, "step_id": 4415, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813711.5758634, "step_id": 4416, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813711.5852256, "step_id": 4417, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813711.594412, "step_id": 4418, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813711.603904, "step_id": 4419, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813711.613536, "step_id": 4420, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813711.623197, "step_id": 4421, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813711.632579, "step_id": 4422, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813711.6422033, "step_id": 4423, "start_load_kv_us": 1, "get_finished_us": 237} +{"t_unix": 1779813711.6517131, "step_id": 4424, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813711.6615322, "step_id": 4425, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813711.6710393, "step_id": 4426, "start_load_kv_us": 1, "get_finished_us": 182} +{"t_unix": 1779813711.6803205, "step_id": 4427, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813711.6900058, "step_id": 4428, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813711.6998355, "step_id": 4429, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813711.7096457, "step_id": 4430, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813711.719461, "step_id": 4431, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813711.729198, "step_id": 4432, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813711.7387977, "step_id": 4433, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813711.7487211, "step_id": 4434, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813711.7583263, "step_id": 4435, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813711.7657266, "step_id": 4436, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813711.7732382, "step_id": 4437, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813711.7807496, "step_id": 4438, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813711.7881877, "step_id": 4439, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813711.7957006, "step_id": 4440, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813711.8032284, "step_id": 4441, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813711.8105302, "step_id": 4442, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813711.8179848, "step_id": 4443, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813711.8253133, "step_id": 4444, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813711.832883, "step_id": 4445, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813711.8409588, "step_id": 4446, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813711.8485603, "step_id": 4447, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813711.8560688, "step_id": 4448, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813711.8637457, "step_id": 4449, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813711.871235, "step_id": 4450, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813711.878824, "step_id": 4451, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813711.8863099, "step_id": 4452, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813711.893375, "step_id": 4453, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813711.9006956, "step_id": 4454, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813711.9081423, "step_id": 4455, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813711.9154837, "step_id": 4456, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813711.922885, "step_id": 4457, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813711.9298701, "step_id": 4458, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813711.9372754, "step_id": 4459, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813711.9449215, "step_id": 4460, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813711.9522207, "step_id": 4461, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813711.9597554, "step_id": 4462, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813711.967239, "step_id": 4463, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813711.9748323, "step_id": 4464, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813711.9823203, "step_id": 4465, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813711.9895954, "step_id": 4466, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813711.9966118, "step_id": 4467, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813712.0041392, "step_id": 4468, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813712.0116537, "step_id": 4469, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813712.0192046, "step_id": 4470, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813712.026582, "step_id": 4471, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813712.033687, "step_id": 4472, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813712.0407774, "step_id": 4473, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813712.0482135, "step_id": 4474, "start_load_kv_us": 16, "get_finished_us": 223} +{"t_unix": 1779813712.056061, "step_id": 4475, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813712.0630982, "step_id": 4476, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813712.069795, "step_id": 4477, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813712.0771275, "step_id": 4478, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813712.1219733, "step_id": 4479, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813712.1240094, "step_id": 4480, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813712.3294237, "step_id": 4481, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813712.3369222, "step_id": 4482, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813712.3446543, "step_id": 4483, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813712.3525138, "step_id": 4484, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813712.3603673, "step_id": 4485, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813712.3681264, "step_id": 4486, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813712.3758187, "step_id": 4487, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813712.3833265, "step_id": 4488, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813712.3909862, "step_id": 4489, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813712.398565, "step_id": 4490, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813712.4063036, "step_id": 4491, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813712.4137287, "step_id": 4492, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813712.4211905, "step_id": 4493, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813712.4293256, "step_id": 4494, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813712.4369872, "step_id": 4495, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813712.4445062, "step_id": 4496, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813712.4522097, "step_id": 4497, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813712.4595153, "step_id": 4498, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813712.4668052, "step_id": 4499, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813712.4738429, "step_id": 4500, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813712.481088, "step_id": 4501, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813712.488593, "step_id": 4502, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813712.4962735, "step_id": 4503, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813712.5038784, "step_id": 4504, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813712.5115998, "step_id": 4505, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813712.5190563, "step_id": 4506, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813712.5267334, "step_id": 4507, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813712.533996, "step_id": 4508, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813712.5412123, "step_id": 4509, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813712.5490391, "step_id": 4510, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813712.5565436, "step_id": 4511, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813712.5640998, "step_id": 4512, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813712.5718725, "step_id": 4513, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813712.5796752, "step_id": 4514, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813712.5873156, "step_id": 4515, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813712.5946906, "step_id": 4516, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813712.6022508, "step_id": 4517, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813712.610121, "step_id": 4518, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813712.6181595, "step_id": 4519, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813712.6661317, "step_id": 4520, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813712.6683033, "step_id": 4521, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813712.9045732, "step_id": 4522, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813712.9068031, "step_id": 4523, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813713.3305616, "step_id": 4524, "start_load_kv_us": 3, "get_finished_us": 339} +{"t_unix": 1779813713.3411584, "step_id": 4525, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813713.3522997, "step_id": 4526, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813713.3634315, "step_id": 4527, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813713.3745384, "step_id": 4528, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813713.3853085, "step_id": 4529, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813713.3967614, "step_id": 4530, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813713.4082618, "step_id": 4531, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813713.4200525, "step_id": 4532, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813713.4316344, "step_id": 4533, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813713.443398, "step_id": 4534, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813713.455144, "step_id": 4535, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813713.466881, "step_id": 4536, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813713.4784575, "step_id": 4537, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813713.4897554, "step_id": 4538, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813713.5011299, "step_id": 4539, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813713.5120678, "step_id": 4540, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813713.5232594, "step_id": 4541, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813713.534399, "step_id": 4542, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813713.5450475, "step_id": 4543, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813713.5561216, "step_id": 4544, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813713.5676513, "step_id": 4545, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813713.5784874, "step_id": 4546, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813713.5896719, "step_id": 4547, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813713.6011033, "step_id": 4548, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813713.6124074, "step_id": 4549, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813713.624039, "step_id": 4550, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813713.6357381, "step_id": 4551, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813713.6473758, "step_id": 4552, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813713.6591036, "step_id": 4553, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813713.6709104, "step_id": 4554, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813713.682462, "step_id": 4555, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813713.694109, "step_id": 4556, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813713.7057939, "step_id": 4557, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813713.7173617, "step_id": 4558, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813713.7287855, "step_id": 4559, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813713.7406921, "step_id": 4560, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813713.7525682, "step_id": 4561, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813713.764305, "step_id": 4562, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813713.7757823, "step_id": 4563, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813713.7871478, "step_id": 4564, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813713.7986534, "step_id": 4565, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813713.8098502, "step_id": 4566, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813713.8212194, "step_id": 4567, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813713.8326335, "step_id": 4568, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813713.8446789, "step_id": 4569, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813713.8569252, "step_id": 4570, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813713.8687246, "step_id": 4571, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813713.8808792, "step_id": 4572, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813713.8931367, "step_id": 4573, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813713.9051976, "step_id": 4574, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813713.9174726, "step_id": 4575, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813713.9295957, "step_id": 4576, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813713.9417956, "step_id": 4577, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813713.9541283, "step_id": 4578, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813713.966179, "step_id": 4579, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813713.9777274, "step_id": 4580, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813713.9894702, "step_id": 4581, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813714.0012293, "step_id": 4582, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813714.013126, "step_id": 4583, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813714.0250745, "step_id": 4584, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813714.036462, "step_id": 4585, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813714.0478637, "step_id": 4586, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813714.059701, "step_id": 4587, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813714.0716105, "step_id": 4588, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813714.0831463, "step_id": 4589, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813714.094823, "step_id": 4590, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813714.1064694, "step_id": 4591, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813714.1180832, "step_id": 4592, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813714.1296706, "step_id": 4593, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813714.1414883, "step_id": 4594, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813714.1529143, "step_id": 4595, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813714.164262, "step_id": 4596, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813714.1760082, "step_id": 4597, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813714.1877975, "step_id": 4598, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813714.1993206, "step_id": 4599, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813714.2089045, "step_id": 4600, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813714.2182581, "step_id": 4601, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813714.2276926, "step_id": 4602, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813714.2373123, "step_id": 4603, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813714.247057, "step_id": 4604, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813714.2571902, "step_id": 4605, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813714.2667923, "step_id": 4606, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813714.276572, "step_id": 4607, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813714.2867281, "step_id": 4608, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813714.2965388, "step_id": 4609, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813714.306482, "step_id": 4610, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813714.316709, "step_id": 4611, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813714.3264637, "step_id": 4612, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813714.3363898, "step_id": 4613, "start_load_kv_us": 1, "get_finished_us": 219} +{"t_unix": 1779813714.3459823, "step_id": 4614, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813714.355577, "step_id": 4615, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813714.3652825, "step_id": 4616, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813714.3748717, "step_id": 4617, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813714.3843079, "step_id": 4618, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813714.3936677, "step_id": 4619, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813714.4032278, "step_id": 4620, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813714.4128075, "step_id": 4621, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813714.4222639, "step_id": 4622, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813714.4322374, "step_id": 4623, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813714.4419687, "step_id": 4624, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813714.4520097, "step_id": 4625, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813714.4619775, "step_id": 4626, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813714.4716477, "step_id": 4627, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813714.4814522, "step_id": 4628, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813714.4911091, "step_id": 4629, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813714.5003235, "step_id": 4630, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813714.5095735, "step_id": 4631, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813714.5186608, "step_id": 4632, "start_load_kv_us": 3, "get_finished_us": 170} +{"t_unix": 1779813714.5279, "step_id": 4633, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813714.5371242, "step_id": 4634, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813714.5464656, "step_id": 4635, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813714.5558589, "step_id": 4636, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813714.5652428, "step_id": 4637, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813714.574817, "step_id": 4638, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813714.5843275, "step_id": 4639, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813714.5938966, "step_id": 4640, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813714.603561, "step_id": 4641, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813714.6132238, "step_id": 4642, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813714.6229813, "step_id": 4643, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813714.6326118, "step_id": 4644, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813714.6421258, "step_id": 4645, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813714.6518354, "step_id": 4646, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813714.6615052, "step_id": 4647, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813714.6711278, "step_id": 4648, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813714.6809392, "step_id": 4649, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813714.6906018, "step_id": 4650, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813714.7004535, "step_id": 4651, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813714.7112277, "step_id": 4652, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813714.7192042, "step_id": 4653, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813714.7285576, "step_id": 4654, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813714.7379816, "step_id": 4655, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813714.7476702, "step_id": 4656, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813714.7576745, "step_id": 4657, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813714.7675962, "step_id": 4658, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813714.7775578, "step_id": 4659, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813714.7877169, "step_id": 4660, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813714.797495, "step_id": 4661, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813714.807087, "step_id": 4662, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813714.8170717, "step_id": 4663, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813714.827164, "step_id": 4664, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813714.8373384, "step_id": 4665, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813714.847229, "step_id": 4666, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813714.8552759, "step_id": 4667, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813714.8634539, "step_id": 4668, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813714.8714762, "step_id": 4669, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813714.8799288, "step_id": 4670, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813714.8882368, "step_id": 4671, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813714.896685, "step_id": 4672, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813714.9051867, "step_id": 4673, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813714.9137373, "step_id": 4674, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813714.9222333, "step_id": 4675, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813714.9302278, "step_id": 4676, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813714.9385767, "step_id": 4677, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813714.9467666, "step_id": 4678, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813714.954521, "step_id": 4679, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813714.9624026, "step_id": 4680, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813714.9705384, "step_id": 4681, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813714.9788435, "step_id": 4682, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813714.9871485, "step_id": 4683, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813714.9955149, "step_id": 4684, "start_load_kv_us": 1, "get_finished_us": 241} +{"t_unix": 1779813715.0040903, "step_id": 4685, "start_load_kv_us": 1, "get_finished_us": 213} +{"t_unix": 1779813715.0127292, "step_id": 4686, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813715.0223575, "step_id": 4687, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813715.029914, "step_id": 4688, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813715.038196, "step_id": 4689, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813715.0464082, "step_id": 4690, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813715.0547135, "step_id": 4691, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813715.0632253, "step_id": 4692, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813715.0714915, "step_id": 4693, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813715.0799334, "step_id": 4694, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813715.1283484, "step_id": 4695, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813715.1305978, "step_id": 4696, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813715.372343, "step_id": 4697, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813715.374646, "step_id": 4698, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813715.621769, "step_id": 4699, "start_load_kv_us": 2, "get_finished_us": 358} +{"t_unix": 1779813715.8197846, "step_id": 4700, "start_load_kv_us": 2, "get_finished_us": 334} +{"t_unix": 1779813715.8294563, "step_id": 4701, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813716.0655024, "step_id": 4702, "start_load_kv_us": 4, "get_finished_us": 412} +{"t_unix": 1779813716.0752187, "step_id": 4703, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813716.0862277, "step_id": 4704, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813716.0971348, "step_id": 4705, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813716.1085348, "step_id": 4706, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813716.1199174, "step_id": 4707, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813716.1687527, "step_id": 4708, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813716.1710382, "step_id": 4709, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813716.3815804, "step_id": 4710, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813716.3930435, "step_id": 4711, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813716.4050205, "step_id": 4712, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813716.4168067, "step_id": 4713, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813716.428784, "step_id": 4714, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813716.440684, "step_id": 4715, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813716.4522169, "step_id": 4716, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813716.4638112, "step_id": 4717, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813716.4757142, "step_id": 4718, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813716.487212, "step_id": 4719, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813716.4989848, "step_id": 4720, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813716.5103238, "step_id": 4721, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813716.5217075, "step_id": 4722, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813716.5331888, "step_id": 4723, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813716.5444155, "step_id": 4724, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813716.555259, "step_id": 4725, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813716.566495, "step_id": 4726, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813716.5776665, "step_id": 4727, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813716.5888257, "step_id": 4728, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813716.6000814, "step_id": 4729, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813716.612308, "step_id": 4730, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813716.6620748, "step_id": 4731, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813717.1334457, "step_id": 4732, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813717.3170998, "step_id": 4733, "start_load_kv_us": 3, "get_finished_us": 314} +{"t_unix": 1779813717.5572176, "step_id": 4734, "start_load_kv_us": 3, "get_finished_us": 354} +{"t_unix": 1779813717.567655, "step_id": 4735, "start_load_kv_us": 3, "get_finished_us": 265} +{"t_unix": 1779813717.8086276, "step_id": 4736, "start_load_kv_us": 3, "get_finished_us": 352} +{"t_unix": 1779813717.821222, "step_id": 4737, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813717.8343227, "step_id": 4738, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813717.8848937, "step_id": 4739, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813717.8873148, "step_id": 4740, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813718.1011608, "step_id": 4741, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813718.1150627, "step_id": 4742, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813718.1292305, "step_id": 4743, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813718.1437492, "step_id": 4744, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813718.1580684, "step_id": 4745, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813718.1725376, "step_id": 4746, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813718.1874232, "step_id": 4747, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813718.2021737, "step_id": 4748, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813718.2165198, "step_id": 4749, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813718.2309873, "step_id": 4750, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813718.2453835, "step_id": 4751, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813718.2599907, "step_id": 4752, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813718.2740493, "step_id": 4753, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813718.288758, "step_id": 4754, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813718.3033242, "step_id": 4755, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813718.3181708, "step_id": 4756, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813718.3331506, "step_id": 4757, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813718.3482144, "step_id": 4758, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813718.3630724, "step_id": 4759, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813718.378202, "step_id": 4760, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813718.3932173, "step_id": 4761, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813718.4084907, "step_id": 4762, "start_load_kv_us": 7, "get_finished_us": 165} +{"t_unix": 1779813718.4236808, "step_id": 4763, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813718.4390342, "step_id": 4764, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813718.45396, "step_id": 4765, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813718.4693887, "step_id": 4766, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813718.4844975, "step_id": 4767, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813718.49968, "step_id": 4768, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813718.514922, "step_id": 4769, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813718.529909, "step_id": 4770, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813718.5448766, "step_id": 4771, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813718.559856, "step_id": 4772, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813718.5748703, "step_id": 4773, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813718.590261, "step_id": 4774, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813718.6055336, "step_id": 4775, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813718.6211383, "step_id": 4776, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813718.6360543, "step_id": 4777, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813718.6496732, "step_id": 4778, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813718.6632912, "step_id": 4779, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813718.6763494, "step_id": 4780, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813718.6901004, "step_id": 4781, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813718.7036765, "step_id": 4782, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813718.7172058, "step_id": 4783, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813718.7311327, "step_id": 4784, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813718.7453647, "step_id": 4785, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813718.758722, "step_id": 4786, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813718.7726715, "step_id": 4787, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813718.7863967, "step_id": 4788, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813718.7998762, "step_id": 4789, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813718.8134496, "step_id": 4790, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813718.8270614, "step_id": 4791, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813718.8407488, "step_id": 4792, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813718.853927, "step_id": 4793, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813718.8676336, "step_id": 4794, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813718.8814166, "step_id": 4795, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813718.8960807, "step_id": 4796, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813718.9478574, "step_id": 4797, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813718.950156, "step_id": 4798, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813719.2022045, "step_id": 4799, "start_load_kv_us": 3, "get_finished_us": 294} +{"t_unix": 1779813719.204684, "step_id": 4800, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813719.4163432, "step_id": 4801, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813719.430325, "step_id": 4802, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813719.48416, "step_id": 4803, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813719.486617, "step_id": 4804, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813719.701299, "step_id": 4805, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813719.7161324, "step_id": 4806, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813719.7312794, "step_id": 4807, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813719.7462444, "step_id": 4808, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813719.7613838, "step_id": 4809, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813719.7766411, "step_id": 4810, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813719.8296754, "step_id": 4811, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813719.832107, "step_id": 4812, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813720.04937, "step_id": 4813, "start_load_kv_us": 3, "get_finished_us": 318} +{"t_unix": 1779813720.0640125, "step_id": 4814, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813720.0787575, "step_id": 4815, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813720.0939822, "step_id": 4816, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813720.109218, "step_id": 4817, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813720.1242807, "step_id": 4818, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813720.1390934, "step_id": 4819, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813720.1542184, "step_id": 4820, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813720.1693442, "step_id": 4821, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813720.1857328, "step_id": 4822, "start_load_kv_us": 2, "get_finished_us": 976} +{"t_unix": 1779813720.2003407, "step_id": 4823, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813720.2152154, "step_id": 4824, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813720.230162, "step_id": 4825, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813720.245626, "step_id": 4826, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813720.261172, "step_id": 4827, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813720.2756655, "step_id": 4828, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813720.290634, "step_id": 4829, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813720.3054838, "step_id": 4830, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813720.3202443, "step_id": 4831, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813720.3349903, "step_id": 4832, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813720.3494306, "step_id": 4833, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813720.364285, "step_id": 4834, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813720.3795784, "step_id": 4835, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813720.3944905, "step_id": 4836, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813720.4096859, "step_id": 4837, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813720.4248974, "step_id": 4838, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813720.4399617, "step_id": 4839, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813720.4547338, "step_id": 4840, "start_load_kv_us": 12, "get_finished_us": 142} +{"t_unix": 1779813720.4696994, "step_id": 4841, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813720.4848983, "step_id": 4842, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813720.499808, "step_id": 4843, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813720.5145633, "step_id": 4844, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813720.5299392, "step_id": 4845, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813720.5452807, "step_id": 4846, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813720.5610309, "step_id": 4847, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813720.576275, "step_id": 4848, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813720.5913086, "step_id": 4849, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813720.6068847, "step_id": 4850, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813720.6223476, "step_id": 4851, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813720.6378393, "step_id": 4852, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813720.6531572, "step_id": 4853, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813720.6688159, "step_id": 4854, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813720.6842818, "step_id": 4855, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813720.7000706, "step_id": 4856, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813720.715405, "step_id": 4857, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813720.7306828, "step_id": 4858, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813720.7459648, "step_id": 4859, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813720.7614672, "step_id": 4860, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813720.776597, "step_id": 4861, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813720.7917073, "step_id": 4862, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813720.806988, "step_id": 4863, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813720.822555, "step_id": 4864, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813720.8774116, "step_id": 4865, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813720.8800201, "step_id": 4866, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813721.0957909, "step_id": 4867, "start_load_kv_us": 3, "get_finished_us": 359} +{"t_unix": 1779813721.1100519, "step_id": 4868, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813721.1251094, "step_id": 4869, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813721.1402504, "step_id": 4870, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813721.1553624, "step_id": 4871, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813721.1706555, "step_id": 4872, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813721.1858823, "step_id": 4873, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813721.2011807, "step_id": 4874, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813721.21651, "step_id": 4875, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813721.2317908, "step_id": 4876, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813721.2469711, "step_id": 4877, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813721.2619383, "step_id": 4878, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813721.2771149, "step_id": 4879, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813721.292318, "step_id": 4880, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813721.307303, "step_id": 4881, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813721.3222876, "step_id": 4882, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813721.3369021, "step_id": 4883, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813721.3523088, "step_id": 4884, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813721.367323, "step_id": 4885, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813721.3822665, "step_id": 4886, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813721.3974762, "step_id": 4887, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813721.4129002, "step_id": 4888, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813721.428087, "step_id": 4889, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813721.4432766, "step_id": 4890, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813721.4583948, "step_id": 4891, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813721.4735732, "step_id": 4892, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813721.488564, "step_id": 4893, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813721.5037215, "step_id": 4894, "start_load_kv_us": 2, "get_finished_us": 362} +{"t_unix": 1779813721.518107, "step_id": 4895, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813721.5326426, "step_id": 4896, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813721.5475435, "step_id": 4897, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813721.5627382, "step_id": 4898, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813721.5848818, "step_id": 4899, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813721.5933776, "step_id": 4900, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813721.608032, "step_id": 4901, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813721.6229193, "step_id": 4902, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813721.6375635, "step_id": 4903, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813721.651774, "step_id": 4904, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813721.6664264, "step_id": 4905, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813721.681187, "step_id": 4906, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813721.6960201, "step_id": 4907, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813721.710607, "step_id": 4908, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813721.7255573, "step_id": 4909, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813721.7401314, "step_id": 4910, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813721.7544746, "step_id": 4911, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813721.7687824, "step_id": 4912, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813721.783084, "step_id": 4913, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813721.797674, "step_id": 4914, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813721.8129776, "step_id": 4915, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813721.8280106, "step_id": 4916, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813721.8429189, "step_id": 4917, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813721.8581903, "step_id": 4918, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813721.8730912, "step_id": 4919, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813721.8882751, "step_id": 4920, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813721.90315, "step_id": 4921, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813721.9185452, "step_id": 4922, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813721.9334538, "step_id": 4923, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813721.948589, "step_id": 4924, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813721.963874, "step_id": 4925, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813721.9791539, "step_id": 4926, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813721.9939744, "step_id": 4927, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813722.0094907, "step_id": 4928, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813722.0247266, "step_id": 4929, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813722.0399964, "step_id": 4930, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813722.0550473, "step_id": 4931, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813722.0700266, "step_id": 4932, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813722.0851283, "step_id": 4933, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813722.1005967, "step_id": 4934, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813722.1162295, "step_id": 4935, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813722.131094, "step_id": 4936, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813722.1461778, "step_id": 4937, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813722.1613233, "step_id": 4938, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813722.1761708, "step_id": 4939, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813722.191353, "step_id": 4940, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813722.2066312, "step_id": 4941, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813722.2218702, "step_id": 4942, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813722.236487, "step_id": 4943, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813722.2511156, "step_id": 4944, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813722.2650514, "step_id": 4945, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813722.279544, "step_id": 4946, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813722.2944062, "step_id": 4947, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813722.3093143, "step_id": 4948, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813722.323734, "step_id": 4949, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813722.3380082, "step_id": 4950, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813722.3527563, "step_id": 4951, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813722.366976, "step_id": 4952, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813722.3819072, "step_id": 4953, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813722.3965383, "step_id": 4954, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813722.411205, "step_id": 4955, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813722.425789, "step_id": 4956, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813722.439053, "step_id": 4957, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813722.4522817, "step_id": 4958, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813722.465997, "step_id": 4959, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813722.4801207, "step_id": 4960, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813722.4939258, "step_id": 4961, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813722.5079632, "step_id": 4962, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813722.5221667, "step_id": 4963, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813722.5366495, "step_id": 4964, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813722.5504253, "step_id": 4965, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813722.5642507, "step_id": 4966, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813722.5784285, "step_id": 4967, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813722.5926497, "step_id": 4968, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813722.6065412, "step_id": 4969, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813722.621006, "step_id": 4970, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813722.6351576, "step_id": 4971, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813722.6488688, "step_id": 4972, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813722.6631143, "step_id": 4973, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813722.6777644, "step_id": 4974, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813722.6922402, "step_id": 4975, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813722.7063637, "step_id": 4976, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813722.721001, "step_id": 4977, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813722.734812, "step_id": 4978, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813722.7487319, "step_id": 4979, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813722.7631083, "step_id": 4980, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813722.777361, "step_id": 4981, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813722.7917206, "step_id": 4982, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813722.8059704, "step_id": 4983, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813722.8202567, "step_id": 4984, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813722.834319, "step_id": 4985, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813722.8486195, "step_id": 4986, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813722.8629804, "step_id": 4987, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813722.8778713, "step_id": 4988, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813722.8889797, "step_id": 4989, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813722.9010093, "step_id": 4990, "start_load_kv_us": 2, "get_finished_us": 990} +{"t_unix": 1779813722.9513218, "step_id": 4991, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813722.9534693, "step_id": 4992, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813723.1583223, "step_id": 4993, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813723.1694758, "step_id": 4994, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813723.1811278, "step_id": 4995, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813723.1926017, "step_id": 4996, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813723.2017484, "step_id": 4997, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813723.2117152, "step_id": 4998, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813723.2211344, "step_id": 4999, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813723.2302458, "step_id": 5000, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813723.2395132, "step_id": 5001, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813723.2483888, "step_id": 5002, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813723.2574751, "step_id": 5003, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813723.305088, "step_id": 5004, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813723.3072066, "step_id": 5005, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813723.5489223, "step_id": 5006, "start_load_kv_us": 3, "get_finished_us": 326} +{"t_unix": 1779813723.5513453, "step_id": 5007, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813723.7602448, "step_id": 5008, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813723.7700167, "step_id": 5009, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813723.7799382, "step_id": 5010, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813723.790301, "step_id": 5011, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813723.8002594, "step_id": 5012, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813723.8103528, "step_id": 5013, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813723.8210802, "step_id": 5014, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813723.8354862, "step_id": 5015, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813723.8417401, "step_id": 5016, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813723.8524234, "step_id": 5017, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813723.8633232, "step_id": 5018, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813723.8743834, "step_id": 5019, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813723.8857589, "step_id": 5020, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813723.8968897, "step_id": 5021, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813723.9080808, "step_id": 5022, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813723.919356, "step_id": 5023, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813723.9308743, "step_id": 5024, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813723.9419165, "step_id": 5025, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813723.9530215, "step_id": 5026, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813723.964525, "step_id": 5027, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813723.976252, "step_id": 5028, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813723.9876928, "step_id": 5029, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813723.9994287, "step_id": 5030, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813724.0110416, "step_id": 5031, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813724.022178, "step_id": 5032, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813724.033225, "step_id": 5033, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813724.0437353, "step_id": 5034, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813724.054519, "step_id": 5035, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813724.06569, "step_id": 5036, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813724.0771039, "step_id": 5037, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813724.0884511, "step_id": 5038, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813724.0994184, "step_id": 5039, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813724.1102738, "step_id": 5040, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813724.121593, "step_id": 5041, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813724.1329236, "step_id": 5042, "start_load_kv_us": 1, "get_finished_us": 204} +{"t_unix": 1779813724.144613, "step_id": 5043, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813724.1559985, "step_id": 5044, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813724.1666138, "step_id": 5045, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813724.177408, "step_id": 5046, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813724.1887069, "step_id": 5047, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813724.1997383, "step_id": 5048, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813724.2106583, "step_id": 5049, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813724.2214231, "step_id": 5050, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813724.2317767, "step_id": 5051, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813724.24271, "step_id": 5052, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813724.2536812, "step_id": 5053, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813724.2643096, "step_id": 5054, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813724.2760775, "step_id": 5055, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813724.2875295, "step_id": 5056, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813724.2967508, "step_id": 5057, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813724.306221, "step_id": 5058, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813724.3160527, "step_id": 5059, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813724.325678, "step_id": 5060, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813724.3354497, "step_id": 5061, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813724.3453622, "step_id": 5062, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813724.3549895, "step_id": 5063, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813724.3646586, "step_id": 5064, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813724.3743348, "step_id": 5065, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813724.3836536, "step_id": 5066, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813724.3933303, "step_id": 5067, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813724.403137, "step_id": 5068, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813724.4105422, "step_id": 5069, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813724.418424, "step_id": 5070, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813724.4263313, "step_id": 5071, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813724.4349027, "step_id": 5072, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813724.4417543, "step_id": 5073, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813724.4492548, "step_id": 5074, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813724.4569075, "step_id": 5075, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813724.4646745, "step_id": 5076, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813724.4724278, "step_id": 5077, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813724.4802756, "step_id": 5078, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813724.4878457, "step_id": 5079, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813724.4955776, "step_id": 5080, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813724.503334, "step_id": 5081, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813724.5114925, "step_id": 5082, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813724.5194478, "step_id": 5083, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813724.5272171, "step_id": 5084, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813724.5351143, "step_id": 5085, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813724.5428157, "step_id": 5086, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813724.5503747, "step_id": 5087, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813724.5581372, "step_id": 5088, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813724.5657878, "step_id": 5089, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813724.5733447, "step_id": 5090, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813724.5811987, "step_id": 5091, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813724.58904, "step_id": 5092, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813724.5967374, "step_id": 5093, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813724.604627, "step_id": 5094, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813724.612334, "step_id": 5095, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813724.620336, "step_id": 5096, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813724.6281433, "step_id": 5097, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813724.635933, "step_id": 5098, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813724.6440423, "step_id": 5099, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813724.651627, "step_id": 5100, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813724.6594553, "step_id": 5101, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813724.6671019, "step_id": 5102, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813724.6749017, "step_id": 5103, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813724.6827593, "step_id": 5104, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813724.690592, "step_id": 5105, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813724.698368, "step_id": 5106, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813724.7063906, "step_id": 5107, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813724.7141201, "step_id": 5108, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813724.722047, "step_id": 5109, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813724.730086, "step_id": 5110, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813724.7377791, "step_id": 5111, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813724.745393, "step_id": 5112, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813724.7529554, "step_id": 5113, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813724.7603815, "step_id": 5114, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813724.7681081, "step_id": 5115, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813724.7757769, "step_id": 5116, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813724.7833023, "step_id": 5117, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813724.7908428, "step_id": 5118, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813724.7985349, "step_id": 5119, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813724.8060856, "step_id": 5120, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813724.8140552, "step_id": 5121, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813724.821777, "step_id": 5122, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813724.8291037, "step_id": 5123, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813724.8364093, "step_id": 5124, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813724.8434322, "step_id": 5125, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813724.8508332, "step_id": 5126, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813724.8976717, "step_id": 5127, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813725.0884738, "step_id": 5128, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813725.0978885, "step_id": 5129, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813725.372805, "step_id": 5130, "start_load_kv_us": 5, "get_finished_us": 408} +{"t_unix": 1779813725.3753438, "step_id": 5131, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813725.6166759, "step_id": 5132, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813725.812038, "step_id": 5133, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813725.8216827, "step_id": 5134, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813726.056083, "step_id": 5135, "start_load_kv_us": 3, "get_finished_us": 295} +{"t_unix": 1779813726.066414, "step_id": 5136, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813726.076809, "step_id": 5137, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813726.0866232, "step_id": 5138, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813726.0968962, "step_id": 5139, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813726.1070888, "step_id": 5140, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813726.1172526, "step_id": 5141, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813726.1278036, "step_id": 5142, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813726.1387682, "step_id": 5143, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813726.1492772, "step_id": 5144, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813726.159616, "step_id": 5145, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813726.1702566, "step_id": 5146, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813726.1808124, "step_id": 5147, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813726.191758, "step_id": 5148, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813726.202074, "step_id": 5149, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813726.2126968, "step_id": 5150, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813726.2231553, "step_id": 5151, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813726.2335021, "step_id": 5152, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813726.244062, "step_id": 5153, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813726.254134, "step_id": 5154, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813726.2645788, "step_id": 5155, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813726.2749276, "step_id": 5156, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813726.2852821, "step_id": 5157, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813726.2956681, "step_id": 5158, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813726.3061836, "step_id": 5159, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813726.3167841, "step_id": 5160, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813726.3273447, "step_id": 5161, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813726.3375967, "step_id": 5162, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813726.3480375, "step_id": 5163, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813726.3585224, "step_id": 5164, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813726.4082, "step_id": 5165, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813726.4105067, "step_id": 5166, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813726.6158197, "step_id": 5167, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813726.6266806, "step_id": 5168, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813726.6377275, "step_id": 5169, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813726.648495, "step_id": 5170, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813726.6592364, "step_id": 5171, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813726.670246, "step_id": 5172, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813726.6813595, "step_id": 5173, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813726.6925035, "step_id": 5174, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813726.7040544, "step_id": 5175, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813726.715932, "step_id": 5176, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813726.7277668, "step_id": 5177, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813726.7393901, "step_id": 5178, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813726.7507286, "step_id": 5179, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813726.7623677, "step_id": 5180, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813726.774096, "step_id": 5181, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813726.7856193, "step_id": 5182, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813726.7976878, "step_id": 5183, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813726.8094325, "step_id": 5184, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813726.8214226, "step_id": 5185, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813726.8332539, "step_id": 5186, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813726.845215, "step_id": 5187, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813726.8581173, "step_id": 5188, "start_load_kv_us": 2, "get_finished_us": 1450} +{"t_unix": 1779813726.9068813, "step_id": 5189, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813726.9092736, "step_id": 5190, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813727.149493, "step_id": 5191, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813727.1519203, "step_id": 5192, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813727.3634744, "step_id": 5193, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813727.3763554, "step_id": 5194, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813727.3897593, "step_id": 5195, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813727.4043405, "step_id": 5196, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813727.4540777, "step_id": 5197, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813727.4564126, "step_id": 5198, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813727.669661, "step_id": 5199, "start_load_kv_us": 3, "get_finished_us": 323} +{"t_unix": 1779813727.683078, "step_id": 5200, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813727.6965687, "step_id": 5201, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813727.7103872, "step_id": 5202, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813727.723976, "step_id": 5203, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813727.737851, "step_id": 5204, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813727.7516007, "step_id": 5205, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813727.7656038, "step_id": 5206, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813727.7789414, "step_id": 5207, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813727.792917, "step_id": 5208, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813727.8065338, "step_id": 5209, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813727.819534, "step_id": 5210, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813727.8337305, "step_id": 5211, "start_load_kv_us": 3, "get_finished_us": 270} +{"t_unix": 1779813727.8462093, "step_id": 5212, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813727.8595607, "step_id": 5213, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813727.873271, "step_id": 5214, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813727.8872101, "step_id": 5215, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813727.909634, "step_id": 5216, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813727.9141626, "step_id": 5217, "start_load_kv_us": 3, "get_finished_us": 170} +{"t_unix": 1779813727.9277372, "step_id": 5218, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813727.9411712, "step_id": 5219, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813727.954844, "step_id": 5220, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813727.9688025, "step_id": 5221, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813727.9826124, "step_id": 5222, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813727.996224, "step_id": 5223, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813728.0098805, "step_id": 5224, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813728.02343, "step_id": 5225, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813728.0372808, "step_id": 5226, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813728.0509202, "step_id": 5227, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813728.064392, "step_id": 5228, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813728.0781405, "step_id": 5229, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813728.0917823, "step_id": 5230, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813728.1049006, "step_id": 5231, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813728.1183908, "step_id": 5232, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813728.1319256, "step_id": 5233, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813728.1456475, "step_id": 5234, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813728.1593208, "step_id": 5235, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813728.1733694, "step_id": 5236, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813728.1876712, "step_id": 5237, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813728.2391853, "step_id": 5238, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813728.2415228, "step_id": 5239, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813728.4949665, "step_id": 5240, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813728.497357, "step_id": 5241, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813728.747454, "step_id": 5242, "start_load_kv_us": 7, "get_finished_us": 315} +{"t_unix": 1779813728.7500038, "step_id": 5243, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813729.001174, "step_id": 5244, "start_load_kv_us": 3, "get_finished_us": 327} +{"t_unix": 1779813729.003711, "step_id": 5245, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813729.2563343, "step_id": 5246, "start_load_kv_us": 3, "get_finished_us": 306} +{"t_unix": 1779813729.2593408, "step_id": 5247, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813729.4729793, "step_id": 5248, "start_load_kv_us": 3, "get_finished_us": 351} +{"t_unix": 1779813729.4860427, "step_id": 5249, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813729.4993885, "step_id": 5250, "start_load_kv_us": 3, "get_finished_us": 229} +{"t_unix": 1779813729.5131738, "step_id": 5251, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813729.5270586, "step_id": 5252, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813729.540808, "step_id": 5253, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813729.5550382, "step_id": 5254, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813729.569498, "step_id": 5255, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813729.5841885, "step_id": 5256, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813729.598682, "step_id": 5257, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813729.612742, "step_id": 5258, "start_load_kv_us": 3, "get_finished_us": 264} +{"t_unix": 1779813729.626794, "step_id": 5259, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813729.6406574, "step_id": 5260, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813729.6540687, "step_id": 5261, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813729.6686428, "step_id": 5262, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813729.6830916, "step_id": 5263, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813729.6976597, "step_id": 5264, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813729.7523782, "step_id": 5265, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813729.754876, "step_id": 5266, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813730.0105283, "step_id": 5267, "start_load_kv_us": 3, "get_finished_us": 317} +{"t_unix": 1779813730.0137842, "step_id": 5268, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813730.4356546, "step_id": 5269, "start_load_kv_us": 3, "get_finished_us": 330} +{"t_unix": 1779813730.4514196, "step_id": 5270, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813730.4673667, "step_id": 5271, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813730.483126, "step_id": 5272, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813730.4991002, "step_id": 5273, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813730.5150938, "step_id": 5274, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813730.5308194, "step_id": 5275, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813730.5467012, "step_id": 5276, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813730.5621016, "step_id": 5277, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813730.577867, "step_id": 5278, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813730.5936415, "step_id": 5279, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813730.6095092, "step_id": 5280, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813730.6255705, "step_id": 5281, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813730.6413548, "step_id": 5282, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813730.6570477, "step_id": 5283, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813730.6731699, "step_id": 5284, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813730.6892874, "step_id": 5285, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813730.7057555, "step_id": 5286, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813730.7217593, "step_id": 5287, "start_load_kv_us": 3, "get_finished_us": 263} +{"t_unix": 1779813730.7380588, "step_id": 5288, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813730.7543907, "step_id": 5289, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813730.7708766, "step_id": 5290, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813730.7874448, "step_id": 5291, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813730.804177, "step_id": 5292, "start_load_kv_us": 17, "get_finished_us": 185} +{"t_unix": 1779813730.8206666, "step_id": 5293, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813730.8371613, "step_id": 5294, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813730.8538036, "step_id": 5295, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813730.872772, "step_id": 5296, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813730.8911085, "step_id": 5297, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813730.9097178, "step_id": 5298, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813730.9283957, "step_id": 5299, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813730.9464858, "step_id": 5300, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813730.9649138, "step_id": 5301, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813730.9835691, "step_id": 5302, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813731.001799, "step_id": 5303, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813731.020178, "step_id": 5304, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813731.0382872, "step_id": 5305, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813731.056502, "step_id": 5306, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813731.0746315, "step_id": 5307, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813731.0929003, "step_id": 5308, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813731.111177, "step_id": 5309, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813731.1296947, "step_id": 5310, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813731.1484282, "step_id": 5311, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813731.1668105, "step_id": 5312, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813731.1852434, "step_id": 5313, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813731.203584, "step_id": 5314, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813731.2226233, "step_id": 5315, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813731.2410836, "step_id": 5316, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813731.2590396, "step_id": 5317, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813731.2772357, "step_id": 5318, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813731.2960103, "step_id": 5319, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813731.3139944, "step_id": 5320, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813731.3321853, "step_id": 5321, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813731.3499515, "step_id": 5322, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813731.3678849, "step_id": 5323, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813731.3862722, "step_id": 5324, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813731.4048185, "step_id": 5325, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813731.4225914, "step_id": 5326, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813731.4408092, "step_id": 5327, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813731.4993062, "step_id": 5328, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813731.502396, "step_id": 5329, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813731.7207775, "step_id": 5330, "start_load_kv_us": 3, "get_finished_us": 311} +{"t_unix": 1779813731.7765248, "step_id": 5331, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813731.7794275, "step_id": 5332, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813732.0364814, "step_id": 5333, "start_load_kv_us": 2, "get_finished_us": 355} +{"t_unix": 1779813732.0396934, "step_id": 5334, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813732.2562473, "step_id": 5335, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813732.2763236, "step_id": 5336, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813732.2966442, "step_id": 5337, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813732.3174295, "step_id": 5338, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813732.337894, "step_id": 5339, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813732.3581662, "step_id": 5340, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813732.3783147, "step_id": 5341, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813732.3988447, "step_id": 5342, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813732.4192731, "step_id": 5343, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813732.4397776, "step_id": 5344, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813732.4600065, "step_id": 5345, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813732.5200977, "step_id": 5346, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813732.5229678, "step_id": 5347, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813732.743775, "step_id": 5348, "start_load_kv_us": 3, "get_finished_us": 287} +{"t_unix": 1779813732.7635107, "step_id": 5349, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813732.7834284, "step_id": 5350, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813732.8030043, "step_id": 5351, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813732.8229957, "step_id": 5352, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813732.8429556, "step_id": 5353, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813732.862821, "step_id": 5354, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813732.8832133, "step_id": 5355, "start_load_kv_us": 15, "get_finished_us": 221} +{"t_unix": 1779813732.9031684, "step_id": 5356, "start_load_kv_us": 15, "get_finished_us": 177} +{"t_unix": 1779813732.923163, "step_id": 5357, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813732.942928, "step_id": 5358, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813732.9624836, "step_id": 5359, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813732.9822636, "step_id": 5360, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813733.0025663, "step_id": 5361, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813733.0227296, "step_id": 5362, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813733.0428874, "step_id": 5363, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813733.0631924, "step_id": 5364, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813733.0837579, "step_id": 5365, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813733.1041431, "step_id": 5366, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813733.123997, "step_id": 5367, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813733.1436422, "step_id": 5368, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813733.1637695, "step_id": 5369, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813733.183486, "step_id": 5370, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813733.2036495, "step_id": 5371, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813733.2239697, "step_id": 5372, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813733.2447534, "step_id": 5373, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813733.304274, "step_id": 5374, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813733.3071322, "step_id": 5375, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813733.5288403, "step_id": 5376, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813733.5491126, "step_id": 5377, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813733.5698724, "step_id": 5378, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813733.5904887, "step_id": 5379, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813733.6112854, "step_id": 5380, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813733.6325934, "step_id": 5381, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813733.6530163, "step_id": 5382, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813733.6742716, "step_id": 5383, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813733.6944547, "step_id": 5384, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813733.7152293, "step_id": 5385, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813733.7363372, "step_id": 5386, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813733.757171, "step_id": 5387, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813733.7744823, "step_id": 5388, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813733.7921383, "step_id": 5389, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813733.8093386, "step_id": 5390, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813733.8285842, "step_id": 5391, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813733.847228, "step_id": 5392, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813733.866042, "step_id": 5393, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813733.884663, "step_id": 5394, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813733.9008186, "step_id": 5395, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813733.9179652, "step_id": 5396, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813733.9351377, "step_id": 5397, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813733.9521105, "step_id": 5398, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813733.969377, "step_id": 5399, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813733.9862003, "step_id": 5400, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813734.0472074, "step_id": 5401, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813734.0498018, "step_id": 5402, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813734.262197, "step_id": 5403, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813734.2788026, "step_id": 5404, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813734.2960675, "step_id": 5405, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813734.313348, "step_id": 5406, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813734.3307838, "step_id": 5407, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813734.3478494, "step_id": 5408, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813734.3653271, "step_id": 5409, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813734.382639, "step_id": 5410, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813734.399824, "step_id": 5411, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813734.417121, "step_id": 5412, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813734.4342108, "step_id": 5413, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813734.45115, "step_id": 5414, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813734.4684026, "step_id": 5415, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813734.485958, "step_id": 5416, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813734.502931, "step_id": 5417, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813734.5202403, "step_id": 5418, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813734.53761, "step_id": 5419, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813734.5545568, "step_id": 5420, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813734.5724952, "step_id": 5421, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813734.589382, "step_id": 5422, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813734.605888, "step_id": 5423, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813734.622749, "step_id": 5424, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813734.6401834, "step_id": 5425, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813734.6574163, "step_id": 5426, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813734.6746955, "step_id": 5427, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813734.6921132, "step_id": 5428, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813734.7091467, "step_id": 5429, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813734.72614, "step_id": 5430, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813734.7423103, "step_id": 5431, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813734.7591193, "step_id": 5432, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813734.7762177, "step_id": 5433, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813734.792937, "step_id": 5434, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813734.8096886, "step_id": 5435, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813734.8263102, "step_id": 5436, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813734.8430533, "step_id": 5437, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813734.859625, "step_id": 5438, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813734.8762536, "step_id": 5439, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813734.8931112, "step_id": 5440, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813734.9096465, "step_id": 5441, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813734.926292, "step_id": 5442, "start_load_kv_us": 3, "get_finished_us": 279} +{"t_unix": 1779813734.9428544, "step_id": 5443, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813734.9593995, "step_id": 5444, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813734.97642, "step_id": 5445, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813734.9929626, "step_id": 5446, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813735.0075817, "step_id": 5447, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813735.0216312, "step_id": 5448, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813735.0364034, "step_id": 5449, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813735.05139, "step_id": 5450, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813735.0663884, "step_id": 5451, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813735.1213264, "step_id": 5452, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813735.1242695, "step_id": 5453, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813735.3782377, "step_id": 5454, "start_load_kv_us": 3, "get_finished_us": 340} +{"t_unix": 1779813735.3810139, "step_id": 5455, "start_load_kv_us": 3, "get_finished_us": 276} +{"t_unix": 1779813735.5933197, "step_id": 5456, "start_load_kv_us": 2, "get_finished_us": 334} +{"t_unix": 1779813735.6066294, "step_id": 5457, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813735.6203592, "step_id": 5458, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813735.6344955, "step_id": 5459, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813735.6906219, "step_id": 5460, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813735.6931784, "step_id": 5461, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813735.904144, "step_id": 5462, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813735.922482, "step_id": 5463, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813735.9412463, "step_id": 5464, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813735.9997709, "step_id": 5465, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813736.0023673, "step_id": 5466, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813736.220618, "step_id": 5467, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813736.2380497, "step_id": 5468, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813736.2556126, "step_id": 5469, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813736.2723927, "step_id": 5470, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813736.2894955, "step_id": 5471, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813736.3068638, "step_id": 5472, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813736.3241801, "step_id": 5473, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813736.3410337, "step_id": 5474, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813736.3580487, "step_id": 5475, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813736.37492, "step_id": 5476, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813736.391694, "step_id": 5477, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813736.4092147, "step_id": 5478, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813736.4262836, "step_id": 5479, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813736.4839, "step_id": 5480, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813736.4864025, "step_id": 5481, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813736.7026029, "step_id": 5482, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813736.7197456, "step_id": 5483, "start_load_kv_us": 3, "get_finished_us": 322} +{"t_unix": 1779813736.7365353, "step_id": 5484, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813736.7532923, "step_id": 5485, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813736.7702258, "step_id": 5486, "start_load_kv_us": 3, "get_finished_us": 206} +{"t_unix": 1779813736.7869682, "step_id": 5487, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813736.8040745, "step_id": 5488, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813736.8210351, "step_id": 5489, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813736.8387282, "step_id": 5490, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813736.855879, "step_id": 5491, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813736.8730674, "step_id": 5492, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813736.890476, "step_id": 5493, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813736.908001, "step_id": 5494, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813736.924835, "step_id": 5495, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813736.9417129, "step_id": 5496, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813736.958348, "step_id": 5497, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813736.9769993, "step_id": 5498, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813736.9951308, "step_id": 5499, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813737.0519714, "step_id": 5500, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813737.054833, "step_id": 5501, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813737.265888, "step_id": 5502, "start_load_kv_us": 3, "get_finished_us": 326} +{"t_unix": 1779813737.2802002, "step_id": 5503, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813737.2953577, "step_id": 5504, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813737.31036, "step_id": 5505, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813737.3257194, "step_id": 5506, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813737.3409674, "step_id": 5507, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813737.3562605, "step_id": 5508, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813737.3715677, "step_id": 5509, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813737.3868423, "step_id": 5510, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813737.4022844, "step_id": 5511, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813737.4176102, "step_id": 5512, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813737.4327881, "step_id": 5513, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813737.4483228, "step_id": 5514, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813737.4636052, "step_id": 5515, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813737.4788787, "step_id": 5516, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813737.4941454, "step_id": 5517, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813737.513856, "step_id": 5518, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813737.5252724, "step_id": 5519, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813737.5403113, "step_id": 5520, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813737.5557039, "step_id": 5521, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813737.570834, "step_id": 5522, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813737.5864956, "step_id": 5523, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813737.6023138, "step_id": 5524, "start_load_kv_us": 3, "get_finished_us": 279} +{"t_unix": 1779813737.6162853, "step_id": 5525, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813737.630884, "step_id": 5526, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813737.6456826, "step_id": 5527, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813737.6601174, "step_id": 5528, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813737.716828, "step_id": 5529, "start_load_kv_us": 3, "get_finished_us": 295} +{"t_unix": 1779813737.9200518, "step_id": 5530, "start_load_kv_us": 3, "get_finished_us": 339} +{"t_unix": 1779813737.930194, "step_id": 5531, "start_load_kv_us": 3, "get_finished_us": 195} +{"t_unix": 1779813738.2108316, "step_id": 5532, "start_load_kv_us": 3, "get_finished_us": 344} +{"t_unix": 1779813738.213671, "step_id": 5533, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813738.4261675, "step_id": 5534, "start_load_kv_us": 3, "get_finished_us": 318} +{"t_unix": 1779813738.4405644, "step_id": 5535, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813738.4557047, "step_id": 5536, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813738.4707277, "step_id": 5537, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813738.4857905, "step_id": 5538, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813738.5006776, "step_id": 5539, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813738.5151224, "step_id": 5540, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813738.5310771, "step_id": 5541, "start_load_kv_us": 3, "get_finished_us": 347} +{"t_unix": 1779813738.544927, "step_id": 5542, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813738.5595398, "step_id": 5543, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813738.5744653, "step_id": 5544, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813738.5895643, "step_id": 5545, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813738.6047676, "step_id": 5546, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813738.620074, "step_id": 5547, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813738.6351388, "step_id": 5548, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813738.6501381, "step_id": 5549, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813738.6650534, "step_id": 5550, "start_load_kv_us": 1, "get_finished_us": 221} +{"t_unix": 1779813738.6801407, "step_id": 5551, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813738.6947486, "step_id": 5552, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813738.7095904, "step_id": 5553, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813738.724124, "step_id": 5554, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813738.738778, "step_id": 5555, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813738.7531767, "step_id": 5556, "start_load_kv_us": 14, "get_finished_us": 184} +{"t_unix": 1779813738.7673154, "step_id": 5557, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813738.7816083, "step_id": 5558, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813738.795968, "step_id": 5559, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813738.810406, "step_id": 5560, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813738.8250315, "step_id": 5561, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813738.8397598, "step_id": 5562, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813738.8943572, "step_id": 5563, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813739.099763, "step_id": 5564, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813739.110151, "step_id": 5565, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813739.3513672, "step_id": 5566, "start_load_kv_us": 3, "get_finished_us": 341} +{"t_unix": 1779813739.3689356, "step_id": 5567, "start_load_kv_us": 3, "get_finished_us": 309} +{"t_unix": 1779813739.387033, "step_id": 5568, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813739.4048612, "step_id": 5569, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813739.422771, "step_id": 5570, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813739.440641, "step_id": 5571, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813739.4589317, "step_id": 5572, "start_load_kv_us": 31, "get_finished_us": 361} +{"t_unix": 1779813739.4765706, "step_id": 5573, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813739.494638, "step_id": 5574, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813739.5127568, "step_id": 5575, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813739.5307422, "step_id": 5576, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813739.5485818, "step_id": 5577, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813739.5663579, "step_id": 5578, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813739.5848968, "step_id": 5579, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813739.6037617, "step_id": 5580, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813739.6222825, "step_id": 5581, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813739.6407692, "step_id": 5582, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813739.6594086, "step_id": 5583, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813739.6784558, "step_id": 5584, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813739.696566, "step_id": 5585, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813739.7107515, "step_id": 5586, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813739.7257733, "step_id": 5587, "start_load_kv_us": 17, "get_finished_us": 286} +{"t_unix": 1779813739.73983, "step_id": 5588, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813739.7547815, "step_id": 5589, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813739.7700176, "step_id": 5590, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813739.7861881, "step_id": 5591, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813739.8410304, "step_id": 5592, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813739.843737, "step_id": 5593, "start_load_kv_us": 3, "get_finished_us": 226} +{"t_unix": 1779813740.054247, "step_id": 5594, "start_load_kv_us": 3, "get_finished_us": 339} +{"t_unix": 1779813740.069066, "step_id": 5595, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813740.0842302, "step_id": 5596, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813740.0992637, "step_id": 5597, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813740.1145916, "step_id": 5598, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813740.1297548, "step_id": 5599, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813740.144835, "step_id": 5600, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813740.159966, "step_id": 5601, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813740.1752436, "step_id": 5602, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813740.1903858, "step_id": 5603, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813740.2057, "step_id": 5604, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813740.221084, "step_id": 5605, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813740.2362468, "step_id": 5606, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813740.2512412, "step_id": 5607, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813740.26669, "step_id": 5608, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813740.2820466, "step_id": 5609, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813740.2975872, "step_id": 5610, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813740.3131285, "step_id": 5611, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813740.3288538, "step_id": 5612, "start_load_kv_us": 3, "get_finished_us": 245} +{"t_unix": 1779813740.344386, "step_id": 5613, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813740.3599906, "step_id": 5614, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813740.3755422, "step_id": 5615, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813740.391076, "step_id": 5616, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813740.4064503, "step_id": 5617, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813740.4217823, "step_id": 5618, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813740.4371033, "step_id": 5619, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813740.452019, "step_id": 5620, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813740.4671218, "step_id": 5621, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813740.4820101, "step_id": 5622, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813740.4970725, "step_id": 5623, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813740.512265, "step_id": 5624, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813740.5276644, "step_id": 5625, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813740.5430548, "step_id": 5626, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813740.5585349, "step_id": 5627, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813740.6128154, "step_id": 5628, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813740.6154494, "step_id": 5629, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813740.8318565, "step_id": 5630, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813740.8464608, "step_id": 5631, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813740.8620927, "step_id": 5632, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813740.8778634, "step_id": 5633, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813740.89352, "step_id": 5634, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813740.949227, "step_id": 5635, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813740.9518623, "step_id": 5636, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813741.1672845, "step_id": 5637, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813741.1821964, "step_id": 5638, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813741.1975706, "step_id": 5639, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813741.2128305, "step_id": 5640, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813741.2280602, "step_id": 5641, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813741.2434115, "step_id": 5642, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813741.2590213, "step_id": 5643, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813741.27472, "step_id": 5644, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813741.2899263, "step_id": 5645, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813741.3438742, "step_id": 5646, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813741.3462822, "step_id": 5647, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813741.5981328, "step_id": 5648, "start_load_kv_us": 3, "get_finished_us": 300} +{"t_unix": 1779813741.600685, "step_id": 5649, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813741.8171623, "step_id": 5650, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813741.8357677, "step_id": 5651, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813741.854145, "step_id": 5652, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813741.8726065, "step_id": 5653, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813741.8910716, "step_id": 5654, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813741.9091954, "step_id": 5655, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813741.9274557, "step_id": 5656, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813741.9460356, "step_id": 5657, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813741.9640312, "step_id": 5658, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813741.9782917, "step_id": 5659, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813741.9928274, "step_id": 5660, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813742.0076554, "step_id": 5661, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813742.0222645, "step_id": 5662, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813742.0372083, "step_id": 5663, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813742.0519273, "step_id": 5664, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813742.0673382, "step_id": 5665, "start_load_kv_us": 6, "get_finished_us": 159} +{"t_unix": 1779813742.0827463, "step_id": 5666, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813742.0978248, "step_id": 5667, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813742.1127455, "step_id": 5668, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813742.1275928, "step_id": 5669, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813742.142334, "step_id": 5670, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813742.1574874, "step_id": 5671, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813742.1722996, "step_id": 5672, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813742.1868126, "step_id": 5673, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813742.2012892, "step_id": 5674, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813742.2158945, "step_id": 5675, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813742.230571, "step_id": 5676, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813742.2451122, "step_id": 5677, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813742.2593715, "step_id": 5678, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813742.2732399, "step_id": 5679, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813742.287372, "step_id": 5680, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813742.3016653, "step_id": 5681, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813742.3161848, "step_id": 5682, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813742.3305733, "step_id": 5683, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813742.3448343, "step_id": 5684, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813742.359171, "step_id": 5685, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813742.3737757, "step_id": 5686, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813742.3882608, "step_id": 5687, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813742.4415948, "step_id": 5688, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813742.4440625, "step_id": 5689, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813742.6586273, "step_id": 5690, "start_load_kv_us": 2, "get_finished_us": 343} +{"t_unix": 1779813742.6770003, "step_id": 5691, "start_load_kv_us": 3, "get_finished_us": 332} +{"t_unix": 1779813742.695487, "step_id": 5692, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813742.7144914, "step_id": 5693, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813742.7337363, "step_id": 5694, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813742.7529693, "step_id": 5695, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813742.7721076, "step_id": 5696, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813742.79121, "step_id": 5697, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813742.809788, "step_id": 5698, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813742.8291454, "step_id": 5699, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813742.8867407, "step_id": 5700, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813742.8895242, "step_id": 5701, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813743.168449, "step_id": 5702, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813743.1713872, "step_id": 5703, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813743.6193547, "step_id": 5704, "start_load_kv_us": 3, "get_finished_us": 332} +{"t_unix": 1779813743.6222103, "step_id": 5705, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813743.8428414, "step_id": 5706, "start_load_kv_us": 3, "get_finished_us": 293} +{"t_unix": 1779813743.863113, "step_id": 5707, "start_load_kv_us": 3, "get_finished_us": 211} +{"t_unix": 1779813743.884112, "step_id": 5708, "start_load_kv_us": 3, "get_finished_us": 231} +{"t_unix": 1779813743.9046082, "step_id": 5709, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813743.9248989, "step_id": 5710, "start_load_kv_us": 3, "get_finished_us": 210} +{"t_unix": 1779813743.9447713, "step_id": 5711, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813743.9607644, "step_id": 5712, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813743.9767184, "step_id": 5713, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813743.9931076, "step_id": 5714, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813744.0094283, "step_id": 5715, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813744.02635, "step_id": 5716, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813744.042728, "step_id": 5717, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813744.0588405, "step_id": 5718, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813744.075024, "step_id": 5719, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813744.0914304, "step_id": 5720, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813744.1080806, "step_id": 5721, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813744.1241071, "step_id": 5722, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813744.1420684, "step_id": 5723, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813744.1598756, "step_id": 5724, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813744.1775913, "step_id": 5725, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813744.1955793, "step_id": 5726, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813744.2132533, "step_id": 5727, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813744.2312446, "step_id": 5728, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813744.2489095, "step_id": 5729, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813744.2671108, "step_id": 5730, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813744.285578, "step_id": 5731, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813744.303609, "step_id": 5732, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813744.3213434, "step_id": 5733, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813744.33924, "step_id": 5734, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813744.3575416, "step_id": 5735, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813744.376524, "step_id": 5736, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813744.3948255, "step_id": 5737, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813744.4089186, "step_id": 5738, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813744.4227927, "step_id": 5739, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813744.436827, "step_id": 5740, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813744.4510427, "step_id": 5741, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813744.4652407, "step_id": 5742, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813744.4801295, "step_id": 5743, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813744.4947271, "step_id": 5744, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813744.5089734, "step_id": 5745, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813744.5236213, "step_id": 5746, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813744.5385149, "step_id": 5747, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813744.553485, "step_id": 5748, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813744.5683029, "step_id": 5749, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813744.5833616, "step_id": 5750, "start_load_kv_us": 3, "get_finished_us": 207} +{"t_unix": 1779813744.59854, "step_id": 5751, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813744.6141403, "step_id": 5752, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813744.629222, "step_id": 5753, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813744.6437745, "step_id": 5754, "start_load_kv_us": 3, "get_finished_us": 227} +{"t_unix": 1779813744.6581361, "step_id": 5755, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813744.6735234, "step_id": 5756, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813744.6884646, "step_id": 5757, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813744.703534, "step_id": 5758, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813744.718624, "step_id": 5759, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813744.7331982, "step_id": 5760, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813744.7482445, "step_id": 5761, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813744.7635257, "step_id": 5762, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813744.7784984, "step_id": 5763, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813744.7935827, "step_id": 5764, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813744.808701, "step_id": 5765, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813744.8240516, "step_id": 5766, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813744.8395612, "step_id": 5767, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813744.8546755, "step_id": 5768, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813744.870011, "step_id": 5769, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813744.8854263, "step_id": 5770, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813744.900405, "step_id": 5771, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813744.9153175, "step_id": 5772, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813744.9300718, "step_id": 5773, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813744.944893, "step_id": 5774, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813744.958971, "step_id": 5775, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813744.9730508, "step_id": 5776, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813744.9874117, "step_id": 5777, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813745.0017564, "step_id": 5778, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813745.0170426, "step_id": 5779, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813745.0317566, "step_id": 5780, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813745.0858006, "step_id": 5781, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813745.0882454, "step_id": 5782, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813745.3022068, "step_id": 5783, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813745.31573, "step_id": 5784, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813745.3297253, "step_id": 5785, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813745.343616, "step_id": 5786, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813745.3571858, "step_id": 5787, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813745.3720024, "step_id": 5788, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813745.3862944, "step_id": 5789, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813745.3995745, "step_id": 5790, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813745.4130933, "step_id": 5791, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813745.42678, "step_id": 5792, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813745.441308, "step_id": 5793, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813745.4541996, "step_id": 5794, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813745.4681087, "step_id": 5795, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813745.4818652, "step_id": 5796, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813745.4953184, "step_id": 5797, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813745.5091367, "step_id": 5798, "start_load_kv_us": 15, "get_finished_us": 148} +{"t_unix": 1779813745.5228612, "step_id": 5799, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813745.5368145, "step_id": 5800, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813745.550333, "step_id": 5801, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813745.564133, "step_id": 5802, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813745.577752, "step_id": 5803, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813745.591235, "step_id": 5804, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813745.6048393, "step_id": 5805, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813745.6188447, "step_id": 5806, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813745.6327565, "step_id": 5807, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813745.6472685, "step_id": 5808, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813745.6612706, "step_id": 5809, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813745.6758122, "step_id": 5810, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813745.6904628, "step_id": 5811, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813745.7046852, "step_id": 5812, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813745.7181766, "step_id": 5813, "start_load_kv_us": 4, "get_finished_us": 210} +{"t_unix": 1779813745.73295, "step_id": 5814, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813745.7462418, "step_id": 5815, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813745.7605262, "step_id": 5816, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813745.7749097, "step_id": 5817, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813745.7893581, "step_id": 5818, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813745.8421588, "step_id": 5819, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813745.845065, "step_id": 5820, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813746.0630052, "step_id": 5821, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813746.0771873, "step_id": 5822, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813746.0917988, "step_id": 5823, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813746.1064665, "step_id": 5824, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813746.120849, "step_id": 5825, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813746.1357498, "step_id": 5826, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813746.1501741, "step_id": 5827, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813746.1646566, "step_id": 5828, "start_load_kv_us": 16, "get_finished_us": 173} +{"t_unix": 1779813746.1791775, "step_id": 5829, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813746.1937973, "step_id": 5830, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813746.2081933, "step_id": 5831, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813746.2227154, "step_id": 5832, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813746.2368865, "step_id": 5833, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813746.2515411, "step_id": 5834, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813746.2661734, "step_id": 5835, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813746.2807713, "step_id": 5836, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813746.2952383, "step_id": 5837, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813746.3099675, "step_id": 5838, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813746.324644, "step_id": 5839, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813746.3392973, "step_id": 5840, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813746.353666, "step_id": 5841, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813746.367774, "step_id": 5842, "start_load_kv_us": 14, "get_finished_us": 181} +{"t_unix": 1779813746.381786, "step_id": 5843, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813746.3959332, "step_id": 5844, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813746.4102979, "step_id": 5845, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813746.4252694, "step_id": 5846, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813746.4392967, "step_id": 5847, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813746.492112, "step_id": 5848, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813746.494657, "step_id": 5849, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813746.7118483, "step_id": 5850, "start_load_kv_us": 3, "get_finished_us": 328} +{"t_unix": 1779813746.725433, "step_id": 5851, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813746.739219, "step_id": 5852, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813746.7534108, "step_id": 5853, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813746.7674918, "step_id": 5854, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813746.781529, "step_id": 5855, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813746.7954807, "step_id": 5856, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813746.8098657, "step_id": 5857, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813746.8240998, "step_id": 5858, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813746.838305, "step_id": 5859, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813746.852355, "step_id": 5860, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813746.865611, "step_id": 5861, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813746.8790267, "step_id": 5862, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813746.8922698, "step_id": 5863, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813746.9057493, "step_id": 5864, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813746.9194882, "step_id": 5865, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813746.9330482, "step_id": 5866, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813746.9469867, "step_id": 5867, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813746.9610562, "step_id": 5868, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813746.9749827, "step_id": 5869, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813746.988671, "step_id": 5870, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813747.0025651, "step_id": 5871, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813747.0164332, "step_id": 5872, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813747.0301933, "step_id": 5873, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813747.0437672, "step_id": 5874, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813747.057045, "step_id": 5875, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813747.0713644, "step_id": 5876, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813747.0857072, "step_id": 5877, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813747.0997734, "step_id": 5878, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813747.1139843, "step_id": 5879, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813747.127901, "step_id": 5880, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813747.1416888, "step_id": 5881, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813747.1554637, "step_id": 5882, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813747.169855, "step_id": 5883, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813747.184364, "step_id": 5884, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813747.198597, "step_id": 5885, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813747.2127137, "step_id": 5886, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813747.2268913, "step_id": 5887, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813747.2414782, "step_id": 5888, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813747.25575, "step_id": 5889, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813747.269586, "step_id": 5890, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813747.284406, "step_id": 5891, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813747.2989366, "step_id": 5892, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813747.3136182, "step_id": 5893, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813747.3279042, "step_id": 5894, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813747.3420637, "step_id": 5895, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813747.356335, "step_id": 5896, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813747.3708172, "step_id": 5897, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813747.3853998, "step_id": 5898, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813747.4001205, "step_id": 5899, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813747.4147708, "step_id": 5900, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813747.428816, "step_id": 5901, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813747.4437973, "step_id": 5902, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813747.45856, "step_id": 5903, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813747.4710562, "step_id": 5904, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813747.4832864, "step_id": 5905, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813747.49517, "step_id": 5906, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813747.5074809, "step_id": 5907, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813747.5194063, "step_id": 5908, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813747.531449, "step_id": 5909, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813747.5432107, "step_id": 5910, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813747.5551813, "step_id": 5911, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813747.5674262, "step_id": 5912, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813747.5795305, "step_id": 5913, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813747.591784, "step_id": 5914, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813747.6040647, "step_id": 5915, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813747.6163044, "step_id": 5916, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813747.628814, "step_id": 5917, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813747.640689, "step_id": 5918, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813747.6526613, "step_id": 5919, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813747.6646316, "step_id": 5920, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813747.6765578, "step_id": 5921, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813747.6885138, "step_id": 5922, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813747.700675, "step_id": 5923, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813747.7125678, "step_id": 5924, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813747.7244623, "step_id": 5925, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813747.736537, "step_id": 5926, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813747.7484646, "step_id": 5927, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813747.7605896, "step_id": 5928, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813747.7728324, "step_id": 5929, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813747.784348, "step_id": 5930, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813747.7957397, "step_id": 5931, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813747.807325, "step_id": 5932, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813747.8193007, "step_id": 5933, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813747.830901, "step_id": 5934, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813747.8424962, "step_id": 5935, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813747.8538651, "step_id": 5936, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813747.8649614, "step_id": 5937, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813747.8762689, "step_id": 5938, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813747.8881872, "step_id": 5939, "start_load_kv_us": 3, "get_finished_us": 197} +{"t_unix": 1779813747.8998091, "step_id": 5940, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813747.9114232, "step_id": 5941, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813747.9232628, "step_id": 5942, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813747.935222, "step_id": 5943, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813747.9470587, "step_id": 5944, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813747.9590564, "step_id": 5945, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813747.970788, "step_id": 5946, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813747.9826982, "step_id": 5947, "start_load_kv_us": 16, "get_finished_us": 212} +{"t_unix": 1779813747.9947646, "step_id": 5948, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813748.0068028, "step_id": 5949, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813748.019037, "step_id": 5950, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813748.0311143, "step_id": 5951, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813748.0430853, "step_id": 5952, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813748.054835, "step_id": 5953, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813748.0668185, "step_id": 5954, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813748.0788586, "step_id": 5955, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813748.0911744, "step_id": 5956, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813748.1028998, "step_id": 5957, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813748.113205, "step_id": 5958, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813748.1229584, "step_id": 5959, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813748.1314766, "step_id": 5960, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813748.1398861, "step_id": 5961, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813748.1471038, "step_id": 5962, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813748.1547005, "step_id": 5963, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813748.162073, "step_id": 5964, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813748.169498, "step_id": 5965, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813748.1768947, "step_id": 5966, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813748.184403, "step_id": 5967, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813748.1920347, "step_id": 5968, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813748.19946, "step_id": 5969, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813748.2069182, "step_id": 5970, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813748.2146223, "step_id": 5971, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813748.2222612, "step_id": 5972, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813748.2299974, "step_id": 5973, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813748.2375429, "step_id": 5974, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813748.2451644, "step_id": 5975, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813748.252737, "step_id": 5976, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813748.301979, "step_id": 5977, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813748.4887416, "step_id": 5978, "start_load_kv_us": 2, "get_finished_us": 336} +{"t_unix": 1779813748.4982326, "step_id": 5979, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813748.7319033, "step_id": 5980, "start_load_kv_us": 4, "get_finished_us": 295} +{"t_unix": 1779813748.7417228, "step_id": 5981, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813748.751489, "step_id": 5982, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813748.7611117, "step_id": 5983, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813748.7707858, "step_id": 5984, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813748.7802265, "step_id": 5985, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813748.78974, "step_id": 5986, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813748.7993515, "step_id": 5987, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813748.8089902, "step_id": 5988, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813748.818426, "step_id": 5989, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813748.8280697, "step_id": 5990, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813748.837267, "step_id": 5991, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813748.846896, "step_id": 5992, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813748.8567812, "step_id": 5993, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813748.866353, "step_id": 5994, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813748.8756914, "step_id": 5995, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813748.8849516, "step_id": 5996, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813748.8953576, "step_id": 5997, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813748.9411333, "step_id": 5998, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813748.9433377, "step_id": 5999, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813749.1915796, "step_id": 6000, "start_load_kv_us": 3, "get_finished_us": 335} +{"t_unix": 1779813749.1939914, "step_id": 6001, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813749.4280932, "step_id": 6002, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813749.4304693, "step_id": 6003, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813749.6768885, "step_id": 6004, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813749.6792402, "step_id": 6005, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813749.9265032, "step_id": 6006, "start_load_kv_us": 3, "get_finished_us": 347} +{"t_unix": 1779813749.9289544, "step_id": 6007, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813750.136292, "step_id": 6008, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813750.1490982, "step_id": 6009, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813750.161995, "step_id": 6010, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813750.174856, "step_id": 6011, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813750.1884098, "step_id": 6012, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813750.2021632, "step_id": 6013, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813750.2158651, "step_id": 6014, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813750.2295651, "step_id": 6015, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813750.2434523, "step_id": 6016, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813750.2569005, "step_id": 6017, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813750.2708073, "step_id": 6018, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813750.2851832, "step_id": 6019, "start_load_kv_us": 2, "get_finished_us": 793} +{"t_unix": 1779813750.29857, "step_id": 6020, "start_load_kv_us": 2, "get_finished_us": 504} +{"t_unix": 1779813750.3123364, "step_id": 6021, "start_load_kv_us": 2, "get_finished_us": 523} +{"t_unix": 1779813750.3254273, "step_id": 6022, "start_load_kv_us": 2, "get_finished_us": 374} +{"t_unix": 1779813750.3394969, "step_id": 6023, "start_load_kv_us": 2, "get_finished_us": 564} +{"t_unix": 1779813750.3525758, "step_id": 6024, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813750.365886, "step_id": 6025, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813750.3794165, "step_id": 6026, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813750.3931282, "step_id": 6027, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813750.4065442, "step_id": 6028, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813750.4201581, "step_id": 6029, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813750.4338777, "step_id": 6030, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813750.4478583, "step_id": 6031, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813750.4619021, "step_id": 6032, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813750.4759192, "step_id": 6033, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813750.4897, "step_id": 6034, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813750.5036826, "step_id": 6035, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813750.5169353, "step_id": 6036, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813750.5307267, "step_id": 6037, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813750.5436666, "step_id": 6038, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813750.5545244, "step_id": 6039, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813750.5659306, "step_id": 6040, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813750.5769, "step_id": 6041, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813750.5881665, "step_id": 6042, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813750.5997612, "step_id": 6043, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813750.611125, "step_id": 6044, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813750.6225903, "step_id": 6045, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813750.6341639, "step_id": 6046, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813750.6455197, "step_id": 6047, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813750.656921, "step_id": 6048, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813750.6685112, "step_id": 6049, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813750.680073, "step_id": 6050, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813750.6915042, "step_id": 6051, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813750.7033136, "step_id": 6052, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813750.7151778, "step_id": 6053, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813750.7269225, "step_id": 6054, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813750.7393022, "step_id": 6055, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813750.7503977, "step_id": 6056, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813750.7618673, "step_id": 6057, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813750.772499, "step_id": 6058, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813750.7837455, "step_id": 6059, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813750.7953193, "step_id": 6060, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813750.8067563, "step_id": 6061, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813750.8177152, "step_id": 6062, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813750.8292766, "step_id": 6063, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813750.8409252, "step_id": 6064, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813750.8522875, "step_id": 6065, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813750.8636324, "step_id": 6066, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813750.8753045, "step_id": 6067, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813750.8868625, "step_id": 6068, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813750.8986146, "step_id": 6069, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813750.9102113, "step_id": 6070, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813750.9216597, "step_id": 6071, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813750.933258, "step_id": 6072, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813750.9445684, "step_id": 6073, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813750.955904, "step_id": 6074, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813750.968262, "step_id": 6075, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813750.9800673, "step_id": 6076, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813750.990817, "step_id": 6077, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813751.0020025, "step_id": 6078, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813751.013384, "step_id": 6079, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813751.0247614, "step_id": 6080, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813751.035852, "step_id": 6081, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813751.0469315, "step_id": 6082, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813751.0582893, "step_id": 6083, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813751.0694034, "step_id": 6084, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813751.0803432, "step_id": 6085, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813751.091542, "step_id": 6086, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813751.1026013, "step_id": 6087, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813751.1137369, "step_id": 6088, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813751.125384, "step_id": 6089, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813751.136537, "step_id": 6090, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813751.1478796, "step_id": 6091, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813751.1593895, "step_id": 6092, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813751.173854, "step_id": 6093, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813751.182001, "step_id": 6094, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813751.1933496, "step_id": 6095, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813751.2049584, "step_id": 6096, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813751.2162144, "step_id": 6097, "start_load_kv_us": 13, "get_finished_us": 226} +{"t_unix": 1779813751.227094, "step_id": 6098, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813751.2387998, "step_id": 6099, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813751.2502785, "step_id": 6100, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813751.2611096, "step_id": 6101, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813751.2716572, "step_id": 6102, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813751.2822235, "step_id": 6103, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813751.2936907, "step_id": 6104, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813751.3050308, "step_id": 6105, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813751.316518, "step_id": 6106, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813751.3284562, "step_id": 6107, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813751.3410778, "step_id": 6108, "start_load_kv_us": 2, "get_finished_us": 1002} +{"t_unix": 1779813751.390461, "step_id": 6109, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813751.3926384, "step_id": 6110, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813751.6003523, "step_id": 6111, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813751.6108022, "step_id": 6112, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813751.6220663, "step_id": 6113, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813751.6333854, "step_id": 6114, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813751.6446736, "step_id": 6115, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813751.655953, "step_id": 6116, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813751.667, "step_id": 6117, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813751.6780355, "step_id": 6118, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813751.6891909, "step_id": 6119, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813751.700535, "step_id": 6120, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813751.711599, "step_id": 6121, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813751.7229993, "step_id": 6122, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813751.7343478, "step_id": 6123, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813751.7453666, "step_id": 6124, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813751.7567143, "step_id": 6125, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813751.768181, "step_id": 6126, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813751.7791119, "step_id": 6127, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813751.7897065, "step_id": 6128, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813751.8002553, "step_id": 6129, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813751.810361, "step_id": 6130, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813751.8207996, "step_id": 6131, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813751.8313046, "step_id": 6132, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813751.8420603, "step_id": 6133, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813751.8527498, "step_id": 6134, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813751.8633356, "step_id": 6135, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813751.8738804, "step_id": 6136, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813751.8841922, "step_id": 6137, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813751.8952365, "step_id": 6138, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813751.9063818, "step_id": 6139, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813751.9176493, "step_id": 6140, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813751.9290886, "step_id": 6141, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813751.9402692, "step_id": 6142, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813751.951346, "step_id": 6143, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813751.9631655, "step_id": 6144, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813751.9761553, "step_id": 6145, "start_load_kv_us": 3, "get_finished_us": 292} +{"t_unix": 1779813751.9860456, "step_id": 6146, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813751.9979906, "step_id": 6147, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813752.0099375, "step_id": 6148, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813752.0215788, "step_id": 6149, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813752.0336087, "step_id": 6150, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813752.045625, "step_id": 6151, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813752.0577118, "step_id": 6152, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813752.0700994, "step_id": 6153, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813752.0818055, "step_id": 6154, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813752.0939353, "step_id": 6155, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813752.1061635, "step_id": 6156, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813752.1183236, "step_id": 6157, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813752.1301913, "step_id": 6158, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813752.1421266, "step_id": 6159, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813752.154304, "step_id": 6160, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813752.1661785, "step_id": 6161, "start_load_kv_us": 15, "get_finished_us": 187} +{"t_unix": 1779813752.1779742, "step_id": 6162, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813752.189707, "step_id": 6163, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813752.2013469, "step_id": 6164, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813752.2524514, "step_id": 6165, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813752.2547157, "step_id": 6166, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813752.4610515, "step_id": 6167, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813752.4731078, "step_id": 6168, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813752.4851322, "step_id": 6169, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813752.4968402, "step_id": 6170, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813752.5086057, "step_id": 6171, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813752.5204756, "step_id": 6172, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813752.5323687, "step_id": 6173, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813752.5442343, "step_id": 6174, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813752.5562956, "step_id": 6175, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813752.5686996, "step_id": 6176, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813752.581119, "step_id": 6177, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813752.5931501, "step_id": 6178, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813752.6050177, "step_id": 6179, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813752.617388, "step_id": 6180, "start_load_kv_us": 2, "get_finished_us": 588} +{"t_unix": 1779813752.6309671, "step_id": 6181, "start_load_kv_us": 2, "get_finished_us": 2180} +{"t_unix": 1779813752.641837, "step_id": 6182, "start_load_kv_us": 2, "get_finished_us": 1049} +{"t_unix": 1779813752.6531913, "step_id": 6183, "start_load_kv_us": 2, "get_finished_us": 363} +{"t_unix": 1779813752.6651926, "step_id": 6184, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813752.6774187, "step_id": 6185, "start_load_kv_us": 2, "get_finished_us": 491} +{"t_unix": 1779813752.689677, "step_id": 6186, "start_load_kv_us": 2, "get_finished_us": 736} +{"t_unix": 1779813752.7012155, "step_id": 6187, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813752.7128053, "step_id": 6188, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813752.7244031, "step_id": 6189, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813752.7357798, "step_id": 6190, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813752.7473474, "step_id": 6191, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813752.7591655, "step_id": 6192, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813752.7710752, "step_id": 6193, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813752.7827582, "step_id": 6194, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813752.7942092, "step_id": 6195, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813752.8061626, "step_id": 6196, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813752.8182197, "step_id": 6197, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813752.830635, "step_id": 6198, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813752.8421352, "step_id": 6199, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813752.8535073, "step_id": 6200, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813752.8655815, "step_id": 6201, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813752.877174, "step_id": 6202, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813752.8889585, "step_id": 6203, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813752.9011269, "step_id": 6204, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813752.9128919, "step_id": 6205, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813752.9247375, "step_id": 6206, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813752.9366927, "step_id": 6207, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813752.9486942, "step_id": 6208, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813752.9609268, "step_id": 6209, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813752.9734294, "step_id": 6210, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813752.9860463, "step_id": 6211, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813752.9984746, "step_id": 6212, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813753.0109222, "step_id": 6213, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813753.0231032, "step_id": 6214, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813753.0354905, "step_id": 6215, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813753.0475945, "step_id": 6216, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813753.0602956, "step_id": 6217, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813753.0725675, "step_id": 6218, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813753.085311, "step_id": 6219, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813753.097833, "step_id": 6220, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813753.1097586, "step_id": 6221, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813753.1217215, "step_id": 6222, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813753.1336539, "step_id": 6223, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813753.1458442, "step_id": 6224, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813753.1572614, "step_id": 6225, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813753.1695142, "step_id": 6226, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813753.1820583, "step_id": 6227, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813753.1943269, "step_id": 6228, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813753.206861, "step_id": 6229, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813753.219328, "step_id": 6230, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813753.2319326, "step_id": 6231, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813753.2441525, "step_id": 6232, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813753.2571807, "step_id": 6233, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813753.269349, "step_id": 6234, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813753.2809575, "step_id": 6235, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813753.2929783, "step_id": 6236, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813753.3049808, "step_id": 6237, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813753.3172972, "step_id": 6238, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813753.3295588, "step_id": 6239, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813753.341689, "step_id": 6240, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813753.3535972, "step_id": 6241, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813753.365392, "step_id": 6242, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813753.3769634, "step_id": 6243, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813753.388835, "step_id": 6244, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813753.4009206, "step_id": 6245, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813753.413167, "step_id": 6246, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813753.4253626, "step_id": 6247, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813753.4373858, "step_id": 6248, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813753.4493492, "step_id": 6249, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813753.498789, "step_id": 6250, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813753.5011737, "step_id": 6251, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813753.7505002, "step_id": 6252, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813753.9504497, "step_id": 6253, "start_load_kv_us": 3, "get_finished_us": 378} +{"t_unix": 1779813753.96088, "step_id": 6254, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813754.198097, "step_id": 6255, "start_load_kv_us": 3, "get_finished_us": 333} +{"t_unix": 1779813754.209593, "step_id": 6256, "start_load_kv_us": 3, "get_finished_us": 255} +{"t_unix": 1779813754.2207122, "step_id": 6257, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813754.2310655, "step_id": 6258, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813754.2411733, "step_id": 6259, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813754.252393, "step_id": 6260, "start_load_kv_us": 3, "get_finished_us": 174} +{"t_unix": 1779813754.2634025, "step_id": 6261, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813754.2727718, "step_id": 6262, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813754.2814822, "step_id": 6263, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813754.2907808, "step_id": 6264, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813754.3004968, "step_id": 6265, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813754.3101764, "step_id": 6266, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813754.3198714, "step_id": 6267, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813754.3298302, "step_id": 6268, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813754.3394196, "step_id": 6269, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813754.349048, "step_id": 6270, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813754.3583915, "step_id": 6271, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813754.3678257, "step_id": 6272, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813754.3772595, "step_id": 6273, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813754.3869112, "step_id": 6274, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813754.3963976, "step_id": 6275, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813754.405898, "step_id": 6276, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813754.4152644, "step_id": 6277, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813754.4248707, "step_id": 6278, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813754.4343946, "step_id": 6279, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813754.4438505, "step_id": 6280, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813754.4535239, "step_id": 6281, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813754.4631982, "step_id": 6282, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813754.4728312, "step_id": 6283, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813754.4824073, "step_id": 6284, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813754.4921136, "step_id": 6285, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813754.5020373, "step_id": 6286, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813754.517682, "step_id": 6287, "start_load_kv_us": 2, "get_finished_us": 6266} +{"t_unix": 1779813754.5214124, "step_id": 6288, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813754.5310075, "step_id": 6289, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813754.5403466, "step_id": 6290, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813754.5496762, "step_id": 6291, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813754.5590339, "step_id": 6292, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813754.5685973, "step_id": 6293, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813754.5782213, "step_id": 6294, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813754.5878904, "step_id": 6295, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813754.5975804, "step_id": 6296, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813754.6073773, "step_id": 6297, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813754.6172943, "step_id": 6298, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813754.6272593, "step_id": 6299, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813754.6371276, "step_id": 6300, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813754.646862, "step_id": 6301, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813754.6565194, "step_id": 6302, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813754.6661284, "step_id": 6303, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813754.6758595, "step_id": 6304, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813754.6855865, "step_id": 6305, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813754.69582, "step_id": 6306, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813754.7055886, "step_id": 6307, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813754.7158515, "step_id": 6308, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813754.725728, "step_id": 6309, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813754.7357686, "step_id": 6310, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813754.7459996, "step_id": 6311, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813754.755715, "step_id": 6312, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813754.7658403, "step_id": 6313, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813754.8136773, "step_id": 6314, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813755.0114691, "step_id": 6315, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813755.2478778, "step_id": 6316, "start_load_kv_us": 2, "get_finished_us": 338} +{"t_unix": 1779813755.2576933, "step_id": 6317, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813755.7052577, "step_id": 6318, "start_load_kv_us": 3, "get_finished_us": 348} +{"t_unix": 1779813755.715578, "step_id": 6319, "start_load_kv_us": 3, "get_finished_us": 260} +{"t_unix": 1779813755.7266538, "step_id": 6320, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813755.7377048, "step_id": 6321, "start_load_kv_us": 16, "get_finished_us": 219} +{"t_unix": 1779813755.748373, "step_id": 6322, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813755.7588925, "step_id": 6323, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813755.769581, "step_id": 6324, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813755.7801366, "step_id": 6325, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813755.7908232, "step_id": 6326, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813755.8017857, "step_id": 6327, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813755.8128898, "step_id": 6328, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813755.8241212, "step_id": 6329, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813755.8351872, "step_id": 6330, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813755.8463697, "step_id": 6331, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813755.8573866, "step_id": 6332, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813755.8680513, "step_id": 6333, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813755.8789036, "step_id": 6334, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813755.8893425, "step_id": 6335, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813755.9023032, "step_id": 6336, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813755.9105725, "step_id": 6337, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813755.921182, "step_id": 6338, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813755.932265, "step_id": 6339, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813755.9429216, "step_id": 6340, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813755.9541464, "step_id": 6341, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813755.9651983, "step_id": 6342, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813755.976307, "step_id": 6343, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813755.987218, "step_id": 6344, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813755.9982085, "step_id": 6345, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813756.0090876, "step_id": 6346, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813756.020117, "step_id": 6347, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813756.0310638, "step_id": 6348, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813756.0422387, "step_id": 6349, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813756.0536463, "step_id": 6350, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813756.064918, "step_id": 6351, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813756.0760555, "step_id": 6352, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813756.087473, "step_id": 6353, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813756.0985293, "step_id": 6354, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813756.1098783, "step_id": 6355, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813756.1209977, "step_id": 6356, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813756.1701074, "step_id": 6357, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813756.1723843, "step_id": 6358, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813756.4203398, "step_id": 6359, "start_load_kv_us": 18, "get_finished_us": 341} +{"t_unix": 1779813756.4228804, "step_id": 6360, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813756.634684, "step_id": 6361, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813756.6480618, "step_id": 6362, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813756.6617699, "step_id": 6363, "start_load_kv_us": 3, "get_finished_us": 171} +{"t_unix": 1779813756.675924, "step_id": 6364, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813756.7267258, "step_id": 6365, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813756.7291791, "step_id": 6366, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813757.1895845, "step_id": 6367, "start_load_kv_us": 3, "get_finished_us": 318} +{"t_unix": 1779813757.192076, "step_id": 6368, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813757.441827, "step_id": 6369, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813757.444175, "step_id": 6370, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813757.6580205, "step_id": 6371, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813757.6720207, "step_id": 6372, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813757.6858683, "step_id": 6373, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813757.700214, "step_id": 6374, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813757.7148716, "step_id": 6375, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813757.7292974, "step_id": 6376, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813757.7438645, "step_id": 6377, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813757.7581413, "step_id": 6378, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813757.7728562, "step_id": 6379, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813757.7876456, "step_id": 6380, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813757.802294, "step_id": 6381, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813757.8171475, "step_id": 6382, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813757.8320568, "step_id": 6383, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813757.8469074, "step_id": 6384, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813757.862072, "step_id": 6385, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813757.8768017, "step_id": 6386, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813757.891535, "step_id": 6387, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813757.9065418, "step_id": 6388, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813757.9211404, "step_id": 6389, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813757.935979, "step_id": 6390, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813757.9506447, "step_id": 6391, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813757.9657533, "step_id": 6392, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813757.980871, "step_id": 6393, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813757.9956882, "step_id": 6394, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813758.010356, "step_id": 6395, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813758.0247538, "step_id": 6396, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813758.0392292, "step_id": 6397, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813758.0535197, "step_id": 6398, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813758.0672684, "step_id": 6399, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813758.0822515, "step_id": 6400, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813758.09721, "step_id": 6401, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813758.1119702, "step_id": 6402, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813758.1266723, "step_id": 6403, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813758.141769, "step_id": 6404, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813758.1569557, "step_id": 6405, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813758.1725833, "step_id": 6406, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813758.187972, "step_id": 6407, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813758.2032661, "step_id": 6408, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813758.2185352, "step_id": 6409, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813758.2340717, "step_id": 6410, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813758.2492855, "step_id": 6411, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813758.2646685, "step_id": 6412, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813758.279401, "step_id": 6413, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813758.3326385, "step_id": 6414, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813758.335016, "step_id": 6415, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813758.549661, "step_id": 6416, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813758.5646567, "step_id": 6417, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813758.618393, "step_id": 6418, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813758.620792, "step_id": 6419, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813758.8745158, "step_id": 6420, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813759.076519, "step_id": 6421, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813759.3164682, "step_id": 6422, "start_load_kv_us": 3, "get_finished_us": 330} +{"t_unix": 1779813759.7623174, "step_id": 6423, "start_load_kv_us": 3, "get_finished_us": 343} +{"t_unix": 1779813760.0117729, "step_id": 6424, "start_load_kv_us": 3, "get_finished_us": 386} +{"t_unix": 1779813760.022406, "step_id": 6425, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813760.3032007, "step_id": 6426, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813760.3060267, "step_id": 6427, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813760.5277095, "step_id": 6428, "start_load_kv_us": 3, "get_finished_us": 300} +{"t_unix": 1779813760.5473375, "step_id": 6429, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813760.5671074, "step_id": 6430, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813760.5872679, "step_id": 6431, "start_load_kv_us": 3, "get_finished_us": 240} +{"t_unix": 1779813760.6066117, "step_id": 6432, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813760.6264522, "step_id": 6433, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813760.6461704, "step_id": 6434, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813760.6666944, "step_id": 6435, "start_load_kv_us": 4, "get_finished_us": 316} +{"t_unix": 1779813760.68525, "step_id": 6436, "start_load_kv_us": 3, "get_finished_us": 259} +{"t_unix": 1779813760.7043962, "step_id": 6437, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813760.7241902, "step_id": 6438, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813760.7438366, "step_id": 6439, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813760.763903, "step_id": 6440, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813760.783737, "step_id": 6441, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813760.803541, "step_id": 6442, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813760.823218, "step_id": 6443, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813760.8430266, "step_id": 6444, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813760.8627038, "step_id": 6445, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813760.8828168, "step_id": 6446, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813760.9028025, "step_id": 6447, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813760.9223034, "step_id": 6448, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813760.9421957, "step_id": 6449, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813760.9620616, "step_id": 6450, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813760.981646, "step_id": 6451, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813761.0017815, "step_id": 6452, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813761.022033, "step_id": 6453, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813761.0423703, "step_id": 6454, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813761.0623264, "step_id": 6455, "start_load_kv_us": 3, "get_finished_us": 182} +{"t_unix": 1779813761.0824614, "step_id": 6456, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813761.1021276, "step_id": 6457, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813761.121967, "step_id": 6458, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813761.1418805, "step_id": 6459, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813761.1616719, "step_id": 6460, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813761.1820593, "step_id": 6461, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813761.2024167, "step_id": 6462, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813761.2226386, "step_id": 6463, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813761.24285, "step_id": 6464, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813761.262686, "step_id": 6465, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813761.282383, "step_id": 6466, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813761.3025575, "step_id": 6467, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813761.3230977, "step_id": 6468, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813761.3438277, "step_id": 6469, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813761.364477, "step_id": 6470, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813761.3849235, "step_id": 6471, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813761.4056134, "step_id": 6472, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813761.4262912, "step_id": 6473, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813761.4467545, "step_id": 6474, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813761.467456, "step_id": 6475, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813761.487912, "step_id": 6476, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813761.5081575, "step_id": 6477, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813761.529345, "step_id": 6478, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813761.5499322, "step_id": 6479, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813761.5711489, "step_id": 6480, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813761.5919664, "step_id": 6481, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813761.6125367, "step_id": 6482, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813761.6331787, "step_id": 6483, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813761.6538327, "step_id": 6484, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813761.674407, "step_id": 6485, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813761.6952283, "step_id": 6486, "start_load_kv_us": 3, "get_finished_us": 236} +{"t_unix": 1779813761.7158706, "step_id": 6487, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813761.7370455, "step_id": 6488, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813761.7582872, "step_id": 6489, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813761.7788048, "step_id": 6490, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813761.7999408, "step_id": 6491, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813761.8210702, "step_id": 6492, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813761.8413808, "step_id": 6493, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813761.8620887, "step_id": 6494, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813761.8828275, "step_id": 6495, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813761.9033864, "step_id": 6496, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813761.9238608, "step_id": 6497, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813761.9443283, "step_id": 6498, "start_load_kv_us": 5, "get_finished_us": 301} +{"t_unix": 1779813761.964893, "step_id": 6499, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813761.9850552, "step_id": 6500, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813762.0053437, "step_id": 6501, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813762.0258913, "step_id": 6502, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813762.0461867, "step_id": 6503, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813762.0663333, "step_id": 6504, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813762.0864024, "step_id": 6505, "start_load_kv_us": 3, "get_finished_us": 271} +{"t_unix": 1779813762.10718, "step_id": 6506, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813762.1277354, "step_id": 6507, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813762.1487854, "step_id": 6508, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813762.1695898, "step_id": 6509, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813762.190342, "step_id": 6510, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813762.2073424, "step_id": 6511, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813762.223824, "step_id": 6512, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813762.240664, "step_id": 6513, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813762.257357, "step_id": 6514, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813762.2742243, "step_id": 6515, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813762.2911704, "step_id": 6516, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813762.3083746, "step_id": 6517, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813762.32564, "step_id": 6518, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813762.3431244, "step_id": 6519, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813762.3604832, "step_id": 6520, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813762.3776696, "step_id": 6521, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813762.3947434, "step_id": 6522, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813762.411594, "step_id": 6523, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813762.4285927, "step_id": 6524, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813762.4451463, "step_id": 6525, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813762.4618862, "step_id": 6526, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813762.4786773, "step_id": 6527, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813762.495463, "step_id": 6528, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813762.51253, "step_id": 6529, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813762.5293117, "step_id": 6530, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813762.5461366, "step_id": 6531, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813762.5630083, "step_id": 6532, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813762.579752, "step_id": 6533, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813762.6353934, "step_id": 6534, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813762.6379664, "step_id": 6535, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813762.8924994, "step_id": 6536, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813762.8951035, "step_id": 6537, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813763.1205583, "step_id": 6538, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813763.141112, "step_id": 6539, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813763.1615205, "step_id": 6540, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813763.1816945, "step_id": 6541, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813763.202192, "step_id": 6542, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813763.2231548, "step_id": 6543, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813763.2437973, "step_id": 6544, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813763.264934, "step_id": 6545, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813763.2859106, "step_id": 6546, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813763.3070288, "step_id": 6547, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813763.3279665, "step_id": 6548, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813763.3492653, "step_id": 6549, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813763.3702273, "step_id": 6550, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813763.391482, "step_id": 6551, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813763.4125721, "step_id": 6552, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813763.4341471, "step_id": 6553, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813763.4552457, "step_id": 6554, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813763.4765265, "step_id": 6555, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813763.4975035, "step_id": 6556, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813763.5184493, "step_id": 6557, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813763.5391095, "step_id": 6558, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813763.560329, "step_id": 6559, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813763.5812564, "step_id": 6560, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813763.6021857, "step_id": 6561, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813763.623068, "step_id": 6562, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813763.6438167, "step_id": 6563, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813763.6649737, "step_id": 6564, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813763.685298, "step_id": 6565, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813763.7061539, "step_id": 6566, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813763.7266445, "step_id": 6567, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813763.7468917, "step_id": 6568, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813763.7671857, "step_id": 6569, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813763.7883012, "step_id": 6570, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813763.8091471, "step_id": 6571, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813763.8300781, "step_id": 6572, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813763.8468385, "step_id": 6573, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813763.8634756, "step_id": 6574, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813763.8803544, "step_id": 6575, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813763.8969958, "step_id": 6576, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813763.9138155, "step_id": 6577, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813763.9302216, "step_id": 6578, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813763.9464173, "step_id": 6579, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813763.9626575, "step_id": 6580, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813763.9792364, "step_id": 6581, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813763.9957676, "step_id": 6582, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813764.012416, "step_id": 6583, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813764.0292897, "step_id": 6584, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813764.0458734, "step_id": 6585, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813764.0622041, "step_id": 6586, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813764.0789194, "step_id": 6587, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813764.0955262, "step_id": 6588, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813764.1502163, "step_id": 6589, "start_load_kv_us": 2, "get_finished_us": 369} +{"t_unix": 1779813764.1527526, "step_id": 6590, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813764.4097059, "step_id": 6591, "start_load_kv_us": 3, "get_finished_us": 334} +{"t_unix": 1779813764.4140463, "step_id": 6592, "start_load_kv_us": 3, "get_finished_us": 250} +{"t_unix": 1779813764.6300437, "step_id": 6593, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813764.6467526, "step_id": 6594, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813764.6636581, "step_id": 6595, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813764.7187402, "step_id": 6596, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813764.7213936, "step_id": 6597, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813764.9405208, "step_id": 6598, "start_load_kv_us": 3, "get_finished_us": 317} +{"t_unix": 1779813764.9614978, "step_id": 6599, "start_load_kv_us": 3, "get_finished_us": 279} +{"t_unix": 1779813764.9825442, "step_id": 6600, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813765.0038679, "step_id": 6601, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813765.0253499, "step_id": 6602, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813765.0469925, "step_id": 6603, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813765.068108, "step_id": 6604, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813765.0891771, "step_id": 6605, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813765.110037, "step_id": 6606, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813765.1306157, "step_id": 6607, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813765.151164, "step_id": 6608, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813765.1717849, "step_id": 6609, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813765.1922443, "step_id": 6610, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813765.252055, "step_id": 6611, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813765.2548888, "step_id": 6612, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813765.4782863, "step_id": 6613, "start_load_kv_us": 3, "get_finished_us": 310} +{"t_unix": 1779813765.497953, "step_id": 6614, "start_load_kv_us": 3, "get_finished_us": 209} +{"t_unix": 1779813765.5191402, "step_id": 6615, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813765.5400035, "step_id": 6616, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813765.5562978, "step_id": 6617, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813765.5732388, "step_id": 6618, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813765.590344, "step_id": 6619, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813765.6073456, "step_id": 6620, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813765.6253629, "step_id": 6621, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813765.6421056, "step_id": 6622, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813765.6589057, "step_id": 6623, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813765.6749244, "step_id": 6624, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813765.690122, "step_id": 6625, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813765.7049577, "step_id": 6626, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813765.719794, "step_id": 6627, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813765.734895, "step_id": 6628, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813765.7497003, "step_id": 6629, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813765.7647414, "step_id": 6630, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813765.779766, "step_id": 6631, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813765.7949772, "step_id": 6632, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813765.8094654, "step_id": 6633, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813765.8249335, "step_id": 6634, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813765.8400054, "step_id": 6635, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813765.85516, "step_id": 6636, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813765.8706086, "step_id": 6637, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813765.8860898, "step_id": 6638, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813765.9017923, "step_id": 6639, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813765.9172404, "step_id": 6640, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813765.9708376, "step_id": 6641, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813765.9734108, "step_id": 6642, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813766.190198, "step_id": 6643, "start_load_kv_us": 3, "get_finished_us": 317} +{"t_unix": 1779813766.2041554, "step_id": 6644, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813766.218517, "step_id": 6645, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813766.2329185, "step_id": 6646, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813766.2476976, "step_id": 6647, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813766.2631946, "step_id": 6648, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813766.3164012, "step_id": 6649, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813766.3188603, "step_id": 6650, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813766.535518, "step_id": 6651, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813766.5541418, "step_id": 6652, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813766.5732255, "step_id": 6653, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813766.5922055, "step_id": 6654, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813766.6111252, "step_id": 6655, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813766.6299632, "step_id": 6656, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813766.6487188, "step_id": 6657, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813766.6673937, "step_id": 6658, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813766.686241, "step_id": 6659, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813766.7051742, "step_id": 6660, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813766.7238917, "step_id": 6661, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813766.7425375, "step_id": 6662, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813766.7609582, "step_id": 6663, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813766.8172674, "step_id": 6664, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813766.8198261, "step_id": 6665, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813767.0396423, "step_id": 6666, "start_load_kv_us": 3, "get_finished_us": 296} +{"t_unix": 1779813767.0557263, "step_id": 6667, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813767.0723705, "step_id": 6668, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813767.0890508, "step_id": 6669, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813767.1060357, "step_id": 6670, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813767.1225064, "step_id": 6671, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813767.140612, "step_id": 6672, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813767.1590486, "step_id": 6673, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813767.1775353, "step_id": 6674, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813767.195837, "step_id": 6675, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813767.210225, "step_id": 6676, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813767.223614, "step_id": 6677, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813767.2377872, "step_id": 6678, "start_load_kv_us": 3, "get_finished_us": 208} +{"t_unix": 1779813767.2526877, "step_id": 6679, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813767.2665858, "step_id": 6680, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813767.280042, "step_id": 6681, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813767.2937648, "step_id": 6682, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813767.3073926, "step_id": 6683, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813767.318454, "step_id": 6684, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813767.3298924, "step_id": 6685, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813767.341379, "step_id": 6686, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813767.3536234, "step_id": 6687, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813767.365789, "step_id": 6688, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813767.3778493, "step_id": 6689, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813767.389713, "step_id": 6690, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813767.4014037, "step_id": 6691, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813767.4127467, "step_id": 6692, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813767.4242823, "step_id": 6693, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813767.4357753, "step_id": 6694, "start_load_kv_us": 3, "get_finished_us": 150} +{"t_unix": 1779813767.4467766, "step_id": 6695, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813767.4585288, "step_id": 6696, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813767.4702508, "step_id": 6697, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813767.4817276, "step_id": 6698, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813767.4934137, "step_id": 6699, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813767.505051, "step_id": 6700, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813767.516468, "step_id": 6701, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813767.5276744, "step_id": 6702, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813767.5385392, "step_id": 6703, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813767.5495362, "step_id": 6704, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813767.560882, "step_id": 6705, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813767.5722878, "step_id": 6706, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813767.5841043, "step_id": 6707, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813767.5956945, "step_id": 6708, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813767.607606, "step_id": 6709, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813767.6195998, "step_id": 6710, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813767.6311312, "step_id": 6711, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813767.6429834, "step_id": 6712, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813767.6548922, "step_id": 6713, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813767.6667752, "step_id": 6714, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813767.6782768, "step_id": 6715, "start_load_kv_us": 1, "get_finished_us": 224} +{"t_unix": 1779813767.6899505, "step_id": 6716, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813767.7012577, "step_id": 6717, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813767.7126095, "step_id": 6718, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813767.7242296, "step_id": 6719, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813767.7358532, "step_id": 6720, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813767.7474265, "step_id": 6721, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813767.7591655, "step_id": 6722, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813767.7710278, "step_id": 6723, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813767.8202896, "step_id": 6724, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813767.8225584, "step_id": 6725, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813768.0688498, "step_id": 6726, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813768.0712266, "step_id": 6727, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813768.2836719, "step_id": 6728, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813768.2978365, "step_id": 6729, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813768.311523, "step_id": 6730, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813768.3249662, "step_id": 6731, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813768.3387187, "step_id": 6732, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813768.352288, "step_id": 6733, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813768.3656282, "step_id": 6734, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813768.3792427, "step_id": 6735, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813768.3939004, "step_id": 6736, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813768.4437573, "step_id": 6737, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813768.446058, "step_id": 6738, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813768.6602404, "step_id": 6739, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813768.674293, "step_id": 6740, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813768.6884189, "step_id": 6741, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813768.7028196, "step_id": 6742, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813768.7171125, "step_id": 6743, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813768.7313344, "step_id": 6744, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813768.7454326, "step_id": 6745, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813768.7596352, "step_id": 6746, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813768.7742155, "step_id": 6747, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813768.7890186, "step_id": 6748, "start_load_kv_us": 3, "get_finished_us": 298} +{"t_unix": 1779813768.8033257, "step_id": 6749, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813768.817708, "step_id": 6750, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813768.83201, "step_id": 6751, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813768.8461754, "step_id": 6752, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813768.8605127, "step_id": 6753, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813768.874543, "step_id": 6754, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813768.8886974, "step_id": 6755, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813768.9027565, "step_id": 6756, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813768.917181, "step_id": 6757, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813768.9313176, "step_id": 6758, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813768.9455323, "step_id": 6759, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813768.9596777, "step_id": 6760, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813768.9742007, "step_id": 6761, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813769.0261507, "step_id": 6762, "start_load_kv_us": 2, "get_finished_us": 334} +{"t_unix": 1779813769.0286026, "step_id": 6763, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813769.2428403, "step_id": 6764, "start_load_kv_us": 3, "get_finished_us": 277} +{"t_unix": 1779813769.2573254, "step_id": 6765, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813769.2716806, "step_id": 6766, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813769.2864554, "step_id": 6767, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813769.3012974, "step_id": 6768, "start_load_kv_us": 3, "get_finished_us": 273} +{"t_unix": 1779813769.3160105, "step_id": 6769, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813769.3301902, "step_id": 6770, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813769.3445392, "step_id": 6771, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813769.3588817, "step_id": 6772, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813769.3728185, "step_id": 6773, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813769.3872824, "step_id": 6774, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813769.4018474, "step_id": 6775, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813769.416242, "step_id": 6776, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813769.4304233, "step_id": 6777, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813769.4443924, "step_id": 6778, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813769.4579704, "step_id": 6779, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813769.4716036, "step_id": 6780, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813769.4853837, "step_id": 6781, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813769.498742, "step_id": 6782, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813769.5127022, "step_id": 6783, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813769.5262134, "step_id": 6784, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813769.5400028, "step_id": 6785, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813769.5536604, "step_id": 6786, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813769.5677176, "step_id": 6787, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813769.5811272, "step_id": 6788, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813769.5950644, "step_id": 6789, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813769.609676, "step_id": 6790, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813769.6282315, "step_id": 6791, "start_load_kv_us": 3, "get_finished_us": 288} +{"t_unix": 1779813769.6378114, "step_id": 6792, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813769.6520078, "step_id": 6793, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813769.6655965, "step_id": 6794, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813769.6795225, "step_id": 6795, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813769.6933327, "step_id": 6796, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813769.7074082, "step_id": 6797, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813769.7216315, "step_id": 6798, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813769.7360098, "step_id": 6799, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813769.7503622, "step_id": 6800, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813769.7650845, "step_id": 6801, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813769.779654, "step_id": 6802, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813769.7936995, "step_id": 6803, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813769.8073134, "step_id": 6804, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813769.8213592, "step_id": 6805, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813769.835688, "step_id": 6806, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813769.8501449, "step_id": 6807, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813769.8644881, "step_id": 6808, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813769.8789217, "step_id": 6809, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813769.893327, "step_id": 6810, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813769.9076526, "step_id": 6811, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813769.9219935, "step_id": 6812, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813769.9364638, "step_id": 6813, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813769.950882, "step_id": 6814, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813769.9646728, "step_id": 6815, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813769.9787457, "step_id": 6816, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813769.9929264, "step_id": 6817, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813770.046046, "step_id": 6818, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813770.0483768, "step_id": 6819, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813770.2978172, "step_id": 6820, "start_load_kv_us": 17, "get_finished_us": 305} +{"t_unix": 1779813770.3002696, "step_id": 6821, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813770.5541487, "step_id": 6822, "start_load_kv_us": 3, "get_finished_us": 338} +{"t_unix": 1779813770.5567675, "step_id": 6823, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813770.9822476, "step_id": 6824, "start_load_kv_us": 3, "get_finished_us": 338} +{"t_unix": 1779813770.9962773, "step_id": 6825, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813771.010969, "step_id": 6826, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813771.025964, "step_id": 6827, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813771.0406675, "step_id": 6828, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813771.0557406, "step_id": 6829, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813771.070514, "step_id": 6830, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813771.0849905, "step_id": 6831, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813771.0996678, "step_id": 6832, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813771.114326, "step_id": 6833, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813771.12912, "step_id": 6834, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813771.143997, "step_id": 6835, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813771.1587505, "step_id": 6836, "start_load_kv_us": 15, "get_finished_us": 158} +{"t_unix": 1779813771.1740215, "step_id": 6837, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813771.1891994, "step_id": 6838, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813771.2036731, "step_id": 6839, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813771.2182617, "step_id": 6840, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813771.27073, "step_id": 6841, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813771.273066, "step_id": 6842, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813771.4890087, "step_id": 6843, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813771.501861, "step_id": 6844, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813771.5165648, "step_id": 6845, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813771.5311296, "step_id": 6846, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813771.5465004, "step_id": 6847, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813771.5608876, "step_id": 6848, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813771.5757225, "step_id": 6849, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813771.5910602, "step_id": 6850, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813771.6064212, "step_id": 6851, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813771.62245, "step_id": 6852, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813771.637658, "step_id": 6853, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813771.6518881, "step_id": 6854, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813771.665697, "step_id": 6855, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813771.6802087, "step_id": 6856, "start_load_kv_us": 1, "get_finished_us": 221} +{"t_unix": 1779813771.6950343, "step_id": 6857, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813771.7094262, "step_id": 6858, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813771.7238603, "step_id": 6859, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813771.7386885, "step_id": 6860, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813771.7532306, "step_id": 6861, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813771.7679663, "step_id": 6862, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813771.7822227, "step_id": 6863, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813771.7969263, "step_id": 6864, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813771.811387, "step_id": 6865, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813771.825684, "step_id": 6866, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813771.8407993, "step_id": 6867, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813771.854927, "step_id": 6868, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813771.8691983, "step_id": 6869, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813771.8839834, "step_id": 6870, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813771.8985991, "step_id": 6871, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813771.9133143, "step_id": 6872, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813771.92794, "step_id": 6873, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813771.9429064, "step_id": 6874, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813771.9571342, "step_id": 6875, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813771.9714096, "step_id": 6876, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813771.9858074, "step_id": 6877, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813771.9998124, "step_id": 6878, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813772.0135684, "step_id": 6879, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813772.0275693, "step_id": 6880, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813772.0413194, "step_id": 6881, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813772.0553782, "step_id": 6882, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813772.0697532, "step_id": 6883, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813772.0840933, "step_id": 6884, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813772.0986748, "step_id": 6885, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813772.113396, "step_id": 6886, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813772.127492, "step_id": 6887, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813772.1427279, "step_id": 6888, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813772.1578639, "step_id": 6889, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813772.1725202, "step_id": 6890, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813772.1868794, "step_id": 6891, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813772.2015061, "step_id": 6892, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813772.216013, "step_id": 6893, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813772.2307124, "step_id": 6894, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813772.2456174, "step_id": 6895, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813772.260702, "step_id": 6896, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813772.2754626, "step_id": 6897, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813772.290098, "step_id": 6898, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813772.3042514, "step_id": 6899, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813772.31847, "step_id": 6900, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813772.3330243, "step_id": 6901, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813772.3478103, "step_id": 6902, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813772.3622587, "step_id": 6903, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813772.3777914, "step_id": 6904, "start_load_kv_us": 2, "get_finished_us": 338} +{"t_unix": 1779813772.3928843, "step_id": 6905, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813772.4074693, "step_id": 6906, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813772.4215803, "step_id": 6907, "start_load_kv_us": 3, "get_finished_us": 267} +{"t_unix": 1779813772.435497, "step_id": 6908, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813772.4497936, "step_id": 6909, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813772.463912, "step_id": 6910, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813772.4787657, "step_id": 6911, "start_load_kv_us": 3, "get_finished_us": 265} +{"t_unix": 1779813772.4929953, "step_id": 6912, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813772.5075958, "step_id": 6913, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813772.5221834, "step_id": 6914, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813772.5372398, "step_id": 6915, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813772.5507383, "step_id": 6916, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813772.5647051, "step_id": 6917, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813772.6180499, "step_id": 6918, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813772.620703, "step_id": 6919, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813772.8333054, "step_id": 6920, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813772.8476787, "step_id": 6921, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813772.8629358, "step_id": 6922, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813772.913775, "step_id": 6923, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813772.9160347, "step_id": 6924, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813773.1284091, "step_id": 6925, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813773.1426892, "step_id": 6926, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813773.157158, "step_id": 6927, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813773.1715968, "step_id": 6928, "start_load_kv_us": 1, "get_finished_us": 182} +{"t_unix": 1779813773.186145, "step_id": 6929, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813773.2006645, "step_id": 6930, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813773.2150576, "step_id": 6931, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813773.2289758, "step_id": 6932, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813773.2438133, "step_id": 6933, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813773.2582684, "step_id": 6934, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813773.2726212, "step_id": 6935, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813773.2864625, "step_id": 6936, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813773.3005853, "step_id": 6937, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813773.315241, "step_id": 6938, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813773.3298037, "step_id": 6939, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813773.3443327, "step_id": 6940, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813773.3590674, "step_id": 6941, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813773.3734262, "step_id": 6942, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813773.3878846, "step_id": 6943, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813773.4022741, "step_id": 6944, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813773.4164505, "step_id": 6945, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813773.4314885, "step_id": 6946, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813773.445967, "step_id": 6947, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813773.460241, "step_id": 6948, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813773.4745686, "step_id": 6949, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813773.4888043, "step_id": 6950, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813773.5027723, "step_id": 6951, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813773.516566, "step_id": 6952, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813773.530407, "step_id": 6953, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813773.5447633, "step_id": 6954, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813773.5582054, "step_id": 6955, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813773.5725038, "step_id": 6956, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813773.5867767, "step_id": 6957, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813773.600958, "step_id": 6958, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813773.615328, "step_id": 6959, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813773.6295285, "step_id": 6960, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813773.6433978, "step_id": 6961, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813773.6575189, "step_id": 6962, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813773.6718736, "step_id": 6963, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813773.6864645, "step_id": 6964, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813773.7012346, "step_id": 6965, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813773.715698, "step_id": 6966, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813773.7303166, "step_id": 6967, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813773.7449622, "step_id": 6968, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813773.7596283, "step_id": 6969, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813773.7743485, "step_id": 6970, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813773.7887654, "step_id": 6971, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813773.8035645, "step_id": 6972, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813773.8183322, "step_id": 6973, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813773.8329718, "step_id": 6974, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813773.8478308, "step_id": 6975, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813773.8628268, "step_id": 6976, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813773.8776295, "step_id": 6977, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813773.892002, "step_id": 6978, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813773.9063997, "step_id": 6979, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813773.921705, "step_id": 6980, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813773.936097, "step_id": 6981, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813773.9504085, "step_id": 6982, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813773.9644537, "step_id": 6983, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813773.976389, "step_id": 6984, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813773.9885647, "step_id": 6985, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813774.0413861, "step_id": 6986, "start_load_kv_us": 2, "get_finished_us": 333} +{"t_unix": 1779813774.0443516, "step_id": 6987, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813774.2505774, "step_id": 6988, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813774.2651563, "step_id": 6989, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813774.2794316, "step_id": 6990, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813774.2943628, "step_id": 6991, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813774.3089848, "step_id": 6992, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813774.3235924, "step_id": 6993, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813774.3380575, "step_id": 6994, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813774.3501725, "step_id": 6995, "start_load_kv_us": 14, "get_finished_us": 183} +{"t_unix": 1779813774.3622997, "step_id": 6996, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813774.3745575, "step_id": 6997, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813774.3869133, "step_id": 6998, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813774.3990602, "step_id": 6999, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813774.4111352, "step_id": 7000, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813774.4232378, "step_id": 7001, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813774.435232, "step_id": 7002, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813774.447209, "step_id": 7003, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813774.4589531, "step_id": 7004, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813774.4707055, "step_id": 7005, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813774.4823582, "step_id": 7006, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813774.494053, "step_id": 7007, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813774.5052183, "step_id": 7008, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813774.5164297, "step_id": 7009, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813774.5282242, "step_id": 7010, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813774.5397022, "step_id": 7011, "start_load_kv_us": 16, "get_finished_us": 218} +{"t_unix": 1779813774.5514097, "step_id": 7012, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813774.5632575, "step_id": 7013, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813774.5754526, "step_id": 7014, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813774.5872488, "step_id": 7015, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813774.5989747, "step_id": 7016, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813774.6101365, "step_id": 7017, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813774.6216276, "step_id": 7018, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813774.6334033, "step_id": 7019, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813774.6450005, "step_id": 7020, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813774.6561782, "step_id": 7021, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813774.6679125, "step_id": 7022, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813774.679861, "step_id": 7023, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813774.691533, "step_id": 7024, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813774.7032042, "step_id": 7025, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813774.7533545, "step_id": 7026, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813774.9535022, "step_id": 7027, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813774.9634187, "step_id": 7028, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813775.2404058, "step_id": 7029, "start_load_kv_us": 3, "get_finished_us": 322} +{"t_unix": 1779813775.2431855, "step_id": 7030, "start_load_kv_us": 3, "get_finished_us": 222} +{"t_unix": 1779813775.705842, "step_id": 7031, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813775.708496, "step_id": 7032, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813775.9208307, "step_id": 7033, "start_load_kv_us": 3, "get_finished_us": 305} +{"t_unix": 1779813775.9346611, "step_id": 7034, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813775.9486165, "step_id": 7035, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813775.9627495, "step_id": 7036, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813775.976931, "step_id": 7037, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813775.991525, "step_id": 7038, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813776.006125, "step_id": 7039, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813776.0205314, "step_id": 7040, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813776.0354726, "step_id": 7041, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813776.0500312, "step_id": 7042, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813776.064496, "step_id": 7043, "start_load_kv_us": 1, "get_finished_us": 272} +{"t_unix": 1779813776.0789168, "step_id": 7044, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813776.0931158, "step_id": 7045, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813776.1075776, "step_id": 7046, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813776.1215773, "step_id": 7047, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813776.135348, "step_id": 7048, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813776.1493442, "step_id": 7049, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813776.1633923, "step_id": 7050, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813776.1774323, "step_id": 7051, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813776.191166, "step_id": 7052, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813776.204979, "step_id": 7053, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813776.2185626, "step_id": 7054, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813776.2321544, "step_id": 7055, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813776.245371, "step_id": 7056, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813776.258565, "step_id": 7057, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813776.2722073, "step_id": 7058, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813776.2862115, "step_id": 7059, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813776.3003926, "step_id": 7060, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813776.3141687, "step_id": 7061, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813776.3285654, "step_id": 7062, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813776.3426816, "step_id": 7063, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813776.3568814, "step_id": 7064, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813776.370866, "step_id": 7065, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813776.3844943, "step_id": 7066, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813776.398312, "step_id": 7067, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813776.4122908, "step_id": 7068, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813776.4266415, "step_id": 7069, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813776.4409394, "step_id": 7070, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813776.4553695, "step_id": 7071, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813776.4693673, "step_id": 7072, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813776.4885085, "step_id": 7073, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813776.4982438, "step_id": 7074, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813776.5498319, "step_id": 7075, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813776.5525227, "step_id": 7076, "start_load_kv_us": 3, "get_finished_us": 216} +{"t_unix": 1779813776.8029175, "step_id": 7077, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813776.805572, "step_id": 7078, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813777.0203454, "step_id": 7079, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813777.0340724, "step_id": 7080, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813777.0480435, "step_id": 7081, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813777.0619516, "step_id": 7082, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813777.075523, "step_id": 7083, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813777.0894446, "step_id": 7084, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813777.1034532, "step_id": 7085, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813777.1176238, "step_id": 7086, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813777.1317053, "step_id": 7087, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813777.145415, "step_id": 7088, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813777.1983128, "step_id": 7089, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813777.4023976, "step_id": 7090, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813777.6387963, "step_id": 7091, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813777.6485655, "step_id": 7092, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813777.8886971, "step_id": 7093, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813777.9025908, "step_id": 7094, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813777.9166555, "step_id": 7095, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813777.9313378, "step_id": 7096, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813777.9461331, "step_id": 7097, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813777.9601822, "step_id": 7098, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813777.9732232, "step_id": 7099, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813777.9870322, "step_id": 7100, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813778.0011978, "step_id": 7101, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813778.014973, "step_id": 7102, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813778.0290906, "step_id": 7103, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813778.042671, "step_id": 7104, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813778.0561562, "step_id": 7105, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813778.070077, "step_id": 7106, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813778.083501, "step_id": 7107, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813778.097215, "step_id": 7108, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813778.1104758, "step_id": 7109, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813778.1236386, "step_id": 7110, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813778.137412, "step_id": 7111, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813778.1514995, "step_id": 7112, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813778.1649904, "step_id": 7113, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813778.1785305, "step_id": 7114, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813778.1918116, "step_id": 7115, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813778.2052948, "step_id": 7116, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813778.2192519, "step_id": 7117, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813778.232988, "step_id": 7118, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813778.2469785, "step_id": 7119, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813778.2610357, "step_id": 7120, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813778.2749145, "step_id": 7121, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813778.2886937, "step_id": 7122, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813778.3024921, "step_id": 7123, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813778.3161154, "step_id": 7124, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813778.329357, "step_id": 7125, "start_load_kv_us": 3, "get_finished_us": 213} +{"t_unix": 1779813778.3430336, "step_id": 7126, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813778.3575075, "step_id": 7127, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813778.3715448, "step_id": 7128, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813778.3861413, "step_id": 7129, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813778.4003775, "step_id": 7130, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813778.4145296, "step_id": 7131, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813778.4288085, "step_id": 7132, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813778.4433746, "step_id": 7133, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813778.457565, "step_id": 7134, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813778.4716854, "step_id": 7135, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813778.485394, "step_id": 7136, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813778.4990582, "step_id": 7137, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813778.5133715, "step_id": 7138, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813778.5278087, "step_id": 7139, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813778.5427272, "step_id": 7140, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813778.5574448, "step_id": 7141, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813778.5717976, "step_id": 7142, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813778.5864918, "step_id": 7143, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813778.6014614, "step_id": 7144, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813778.6153102, "step_id": 7145, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813778.6293027, "step_id": 7146, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813778.6434107, "step_id": 7147, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813778.6577592, "step_id": 7148, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813778.672323, "step_id": 7149, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813778.6866636, "step_id": 7150, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813778.7008667, "step_id": 7151, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813778.7146966, "step_id": 7152, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813778.7284975, "step_id": 7153, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813778.7425435, "step_id": 7154, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813778.756501, "step_id": 7155, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813778.7708592, "step_id": 7156, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813778.7853413, "step_id": 7157, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813778.799983, "step_id": 7158, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813778.8146183, "step_id": 7159, "start_load_kv_us": 6, "get_finished_us": 226} +{"t_unix": 1779813778.8286898, "step_id": 7160, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813778.8421452, "step_id": 7161, "start_load_kv_us": 16, "get_finished_us": 153} +{"t_unix": 1779813778.8559966, "step_id": 7162, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813778.8698616, "step_id": 7163, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813778.8838656, "step_id": 7164, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813778.8974888, "step_id": 7165, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813778.9113078, "step_id": 7166, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813778.9253876, "step_id": 7167, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813778.939717, "step_id": 7168, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813778.954162, "step_id": 7169, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813778.9690113, "step_id": 7170, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813778.9862967, "step_id": 7171, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813778.9981585, "step_id": 7172, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813779.011244, "step_id": 7173, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813779.0255804, "step_id": 7174, "start_load_kv_us": 3, "get_finished_us": 212} +{"t_unix": 1779813779.039528, "step_id": 7175, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813779.054026, "step_id": 7176, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813779.0684972, "step_id": 7177, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813779.0829628, "step_id": 7178, "start_load_kv_us": 4, "get_finished_us": 226} +{"t_unix": 1779813779.0967007, "step_id": 7179, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813779.110749, "step_id": 7180, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813779.1249213, "step_id": 7181, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813779.1391313, "step_id": 7182, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813779.1533608, "step_id": 7183, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813779.1675029, "step_id": 7184, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813779.1815941, "step_id": 7185, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813779.195491, "step_id": 7186, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813779.2092423, "step_id": 7187, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813779.2230844, "step_id": 7188, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813779.2369585, "step_id": 7189, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813779.2510197, "step_id": 7190, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813779.26502, "step_id": 7191, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813779.2796862, "step_id": 7192, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813779.2938871, "step_id": 7193, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813779.3469927, "step_id": 7194, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813779.3493881, "step_id": 7195, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813779.6001081, "step_id": 7196, "start_load_kv_us": 3, "get_finished_us": 306} +{"t_unix": 1779813779.6026986, "step_id": 7197, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813780.0332968, "step_id": 7198, "start_load_kv_us": 4, "get_finished_us": 358} +{"t_unix": 1779813780.0451035, "step_id": 7199, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813780.0603971, "step_id": 7200, "start_load_kv_us": 4, "get_finished_us": 351} +{"t_unix": 1779813780.0747912, "step_id": 7201, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813780.0894186, "step_id": 7202, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813780.1042476, "step_id": 7203, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813780.1191728, "step_id": 7204, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813780.1342518, "step_id": 7205, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813780.1493897, "step_id": 7206, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813780.1647055, "step_id": 7207, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813780.1802568, "step_id": 7208, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813780.1956854, "step_id": 7209, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813780.211693, "step_id": 7210, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813780.2268708, "step_id": 7211, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813780.24226, "step_id": 7212, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813780.25765, "step_id": 7213, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813780.2730732, "step_id": 7214, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813780.2884607, "step_id": 7215, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813780.3036275, "step_id": 7216, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813780.3188505, "step_id": 7217, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813780.3341773, "step_id": 7218, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813780.3496394, "step_id": 7219, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813780.3649075, "step_id": 7220, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813780.379928, "step_id": 7221, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813780.394779, "step_id": 7222, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813780.4096494, "step_id": 7223, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813780.4246247, "step_id": 7224, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813780.4396975, "step_id": 7225, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813780.4549148, "step_id": 7226, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813780.4699893, "step_id": 7227, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813780.485258, "step_id": 7228, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813780.500301, "step_id": 7229, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813780.5154827, "step_id": 7230, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813780.530341, "step_id": 7231, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813780.545643, "step_id": 7232, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813780.5606863, "step_id": 7233, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813780.5761473, "step_id": 7234, "start_load_kv_us": 16, "get_finished_us": 154} +{"t_unix": 1779813780.591408, "step_id": 7235, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813780.6067624, "step_id": 7236, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813780.6218152, "step_id": 7237, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813780.6369693, "step_id": 7238, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813780.6520977, "step_id": 7239, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813780.6675906, "step_id": 7240, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813780.6829693, "step_id": 7241, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813780.6988559, "step_id": 7242, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813780.7141864, "step_id": 7243, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813780.7282445, "step_id": 7244, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813780.742676, "step_id": 7245, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813780.7575076, "step_id": 7246, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813780.7723148, "step_id": 7247, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813780.7872124, "step_id": 7248, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813780.8022625, "step_id": 7249, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813780.8174164, "step_id": 7250, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813780.8323822, "step_id": 7251, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813780.8469105, "step_id": 7252, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813780.8611083, "step_id": 7253, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813780.8757267, "step_id": 7254, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813780.889987, "step_id": 7255, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813780.9051425, "step_id": 7256, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813780.9196362, "step_id": 7257, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813780.9342194, "step_id": 7258, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813780.9491303, "step_id": 7259, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813780.964106, "step_id": 7260, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813780.9790635, "step_id": 7261, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813780.9943738, "step_id": 7262, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813781.0092204, "step_id": 7263, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813781.0238874, "step_id": 7264, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813781.0380657, "step_id": 7265, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813781.051995, "step_id": 7266, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813781.0660753, "step_id": 7267, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813781.0801272, "step_id": 7268, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813781.0941544, "step_id": 7269, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813781.1087508, "step_id": 7270, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813781.1234293, "step_id": 7271, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813781.137641, "step_id": 7272, "start_load_kv_us": 3, "get_finished_us": 188} +{"t_unix": 1779813781.1516898, "step_id": 7273, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813781.166097, "step_id": 7274, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813781.179908, "step_id": 7275, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813781.1939871, "step_id": 7276, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813781.2081025, "step_id": 7277, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813781.2221909, "step_id": 7278, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813781.2359293, "step_id": 7279, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813781.2501228, "step_id": 7280, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813781.2644982, "step_id": 7281, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813781.2793093, "step_id": 7282, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813781.2937858, "step_id": 7283, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813781.3074293, "step_id": 7284, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813781.321038, "step_id": 7285, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813781.3347125, "step_id": 7286, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813781.3463676, "step_id": 7287, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813781.357486, "step_id": 7288, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813781.3683467, "step_id": 7289, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813781.4165273, "step_id": 7290, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813781.4187338, "step_id": 7291, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813781.665563, "step_id": 7292, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813781.6678686, "step_id": 7293, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813781.9143035, "step_id": 7294, "start_load_kv_us": 3, "get_finished_us": 309} +{"t_unix": 1779813781.91678, "step_id": 7295, "start_load_kv_us": 15, "get_finished_us": 174} +{"t_unix": 1779813782.3774564, "step_id": 7296, "start_load_kv_us": 3, "get_finished_us": 308} +{"t_unix": 1779813782.5832562, "step_id": 7297, "start_load_kv_us": 2, "get_finished_us": 385} +{"t_unix": 1779813782.8231514, "step_id": 7298, "start_load_kv_us": 2, "get_finished_us": 334} +{"t_unix": 1779813783.0645163, "step_id": 7299, "start_load_kv_us": 3, "get_finished_us": 335} +{"t_unix": 1779813783.0747647, "step_id": 7300, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813783.3143542, "step_id": 7301, "start_load_kv_us": 3, "get_finished_us": 272} +{"t_unix": 1779813783.3276947, "step_id": 7302, "start_load_kv_us": 3, "get_finished_us": 316} +{"t_unix": 1779813783.3409605, "step_id": 7303, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813783.3544064, "step_id": 7304, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813783.368304, "step_id": 7305, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813783.382309, "step_id": 7306, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813783.3963873, "step_id": 7307, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813783.4103088, "step_id": 7308, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813783.42401, "step_id": 7309, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813783.43822, "step_id": 7310, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813783.4523442, "step_id": 7311, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813783.4665072, "step_id": 7312, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813783.4811773, "step_id": 7313, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813783.495857, "step_id": 7314, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813783.5102196, "step_id": 7315, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813783.524658, "step_id": 7316, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813783.539256, "step_id": 7317, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813783.553875, "step_id": 7318, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813783.5681334, "step_id": 7319, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813783.5825598, "step_id": 7320, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813783.597007, "step_id": 7321, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813783.648971, "step_id": 7322, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813783.6513681, "step_id": 7323, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813783.905154, "step_id": 7324, "start_load_kv_us": 2, "get_finished_us": 332} +{"t_unix": 1779813783.9078164, "step_id": 7325, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813784.1268456, "step_id": 7326, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813784.1432385, "step_id": 7327, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813784.1603215, "step_id": 7328, "start_load_kv_us": 3, "get_finished_us": 228} +{"t_unix": 1779813784.1771033, "step_id": 7329, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813784.1936646, "step_id": 7330, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813784.2107189, "step_id": 7331, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813784.2271152, "step_id": 7332, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813784.2458355, "step_id": 7333, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813784.263589, "step_id": 7334, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813784.2777598, "step_id": 7335, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813784.292198, "step_id": 7336, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813784.3067226, "step_id": 7337, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813784.359298, "step_id": 7338, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813784.3617077, "step_id": 7339, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813784.6175241, "step_id": 7340, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813784.6202111, "step_id": 7341, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813784.8415067, "step_id": 7342, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813784.860527, "step_id": 7343, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813784.880002, "step_id": 7344, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813784.90016, "step_id": 7345, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813784.9195228, "step_id": 7346, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813784.938314, "step_id": 7347, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813784.9528327, "step_id": 7348, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813784.9677553, "step_id": 7349, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813784.9826403, "step_id": 7350, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813784.9974809, "step_id": 7351, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813785.0128732, "step_id": 7352, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813785.0278623, "step_id": 7353, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813785.043039, "step_id": 7354, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813785.0576713, "step_id": 7355, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813785.0721903, "step_id": 7356, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813785.086185, "step_id": 7357, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813785.1004767, "step_id": 7358, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813785.1151824, "step_id": 7359, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813785.129994, "step_id": 7360, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813785.144578, "step_id": 7361, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813785.1589563, "step_id": 7362, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813785.1733835, "step_id": 7363, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813785.1875956, "step_id": 7364, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813785.201959, "step_id": 7365, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813785.2160728, "step_id": 7366, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813785.2303498, "step_id": 7367, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813785.2445416, "step_id": 7368, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813785.2586381, "step_id": 7369, "start_load_kv_us": 15, "get_finished_us": 155} +{"t_unix": 1779813785.273115, "step_id": 7370, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813785.2882698, "step_id": 7371, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813785.3032203, "step_id": 7372, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813785.3180823, "step_id": 7373, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813785.3332458, "step_id": 7374, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813785.3479772, "step_id": 7375, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813785.3628447, "step_id": 7376, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813785.3778183, "step_id": 7377, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813785.392275, "step_id": 7378, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813785.4070003, "step_id": 7379, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813785.4217668, "step_id": 7380, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813785.4369073, "step_id": 7381, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813785.4519944, "step_id": 7382, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813785.4670296, "step_id": 7383, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813785.4819038, "step_id": 7384, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813785.4968398, "step_id": 7385, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813785.511959, "step_id": 7386, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813785.5273626, "step_id": 7387, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813785.5427303, "step_id": 7388, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813785.5578024, "step_id": 7389, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813785.5730731, "step_id": 7390, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813785.5882185, "step_id": 7391, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813785.6032376, "step_id": 7392, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813785.6185207, "step_id": 7393, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813785.633516, "step_id": 7394, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813785.6491818, "step_id": 7395, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813785.6648238, "step_id": 7396, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813785.680191, "step_id": 7397, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813785.6959713, "step_id": 7398, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813785.7114754, "step_id": 7399, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813785.7270005, "step_id": 7400, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813785.7425413, "step_id": 7401, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813785.7582357, "step_id": 7402, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813785.7737305, "step_id": 7403, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813785.7892337, "step_id": 7404, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813785.8040433, "step_id": 7405, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813785.8191142, "step_id": 7406, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813785.8343217, "step_id": 7407, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813785.8488557, "step_id": 7408, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813785.8639135, "step_id": 7409, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813785.8791823, "step_id": 7410, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813785.894091, "step_id": 7411, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813785.909099, "step_id": 7412, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813785.9242496, "step_id": 7413, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813785.9393308, "step_id": 7414, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813785.9542305, "step_id": 7415, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813785.9691482, "step_id": 7416, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813785.984173, "step_id": 7417, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813785.9993117, "step_id": 7418, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813786.0141902, "step_id": 7419, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813786.029278, "step_id": 7420, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813786.044201, "step_id": 7421, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813786.059431, "step_id": 7422, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813786.0746365, "step_id": 7423, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813786.0894256, "step_id": 7424, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813786.1043456, "step_id": 7425, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813786.1200297, "step_id": 7426, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813786.1352746, "step_id": 7427, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813786.1506364, "step_id": 7428, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813786.1660295, "step_id": 7429, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813786.1815217, "step_id": 7430, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813786.1962986, "step_id": 7431, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813786.21137, "step_id": 7432, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813786.2260957, "step_id": 7433, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813786.2410405, "step_id": 7434, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813786.2558758, "step_id": 7435, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813786.2704954, "step_id": 7436, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813786.2854958, "step_id": 7437, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813786.3009412, "step_id": 7438, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813786.3166022, "step_id": 7439, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813786.3316238, "step_id": 7440, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813786.3469954, "step_id": 7441, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813786.3622859, "step_id": 7442, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813786.3772802, "step_id": 7443, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813786.3920534, "step_id": 7444, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813786.4072666, "step_id": 7445, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813786.4225597, "step_id": 7446, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813786.4372928, "step_id": 7447, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813786.4523156, "step_id": 7448, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813786.467116, "step_id": 7449, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813786.4820776, "step_id": 7450, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813786.496227, "step_id": 7451, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813786.5112987, "step_id": 7452, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813786.5261817, "step_id": 7453, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813786.5400941, "step_id": 7454, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813786.5538824, "step_id": 7455, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813786.567696, "step_id": 7456, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813786.5819798, "step_id": 7457, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813786.5960994, "step_id": 7458, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813786.609859, "step_id": 7459, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813786.62327, "step_id": 7460, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813786.636897, "step_id": 7461, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813786.6501708, "step_id": 7462, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813786.6634626, "step_id": 7463, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813786.6769142, "step_id": 7464, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813786.6904263, "step_id": 7465, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813786.704117, "step_id": 7466, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813786.717243, "step_id": 7467, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813786.731006, "step_id": 7468, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813786.7446032, "step_id": 7469, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813786.7585373, "step_id": 7470, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813786.7723098, "step_id": 7471, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813786.786076, "step_id": 7472, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813786.799916, "step_id": 7473, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813786.8135839, "step_id": 7474, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813786.8268526, "step_id": 7475, "start_load_kv_us": 14, "get_finished_us": 260} +{"t_unix": 1779813786.8403468, "step_id": 7476, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813786.8542802, "step_id": 7477, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813786.868132, "step_id": 7478, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813786.8820152, "step_id": 7479, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813786.895789, "step_id": 7480, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813786.9093912, "step_id": 7481, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813786.923241, "step_id": 7482, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813786.9372423, "step_id": 7483, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813786.9513595, "step_id": 7484, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813786.9657922, "step_id": 7485, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813786.9790637, "step_id": 7486, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813786.992998, "step_id": 7487, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813787.0063272, "step_id": 7488, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813787.0193906, "step_id": 7489, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813787.0321765, "step_id": 7490, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813787.0455065, "step_id": 7491, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813787.05907, "step_id": 7492, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813787.072925, "step_id": 7493, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813787.0869043, "step_id": 7494, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813787.1011925, "step_id": 7495, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813787.1154773, "step_id": 7496, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813787.1294754, "step_id": 7497, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813787.1436348, "step_id": 7498, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813787.1574488, "step_id": 7499, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813787.1708763, "step_id": 7500, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813787.1840632, "step_id": 7501, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813787.197743, "step_id": 7502, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813787.2115564, "step_id": 7503, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813787.224917, "step_id": 7504, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813787.2386136, "step_id": 7505, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813787.2519877, "step_id": 7506, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813787.265521, "step_id": 7507, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813787.2787495, "step_id": 7508, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813787.2926533, "step_id": 7509, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813787.306337, "step_id": 7510, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813787.3195682, "step_id": 7511, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813787.3329148, "step_id": 7512, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813787.3464148, "step_id": 7513, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813787.3597622, "step_id": 7514, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813787.3730564, "step_id": 7515, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813787.386743, "step_id": 7516, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813787.400301, "step_id": 7517, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813787.4140255, "step_id": 7518, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813787.427709, "step_id": 7519, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813787.441022, "step_id": 7520, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813787.4548237, "step_id": 7521, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813787.4683821, "step_id": 7522, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813787.481936, "step_id": 7523, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813787.4958174, "step_id": 7524, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813787.5095427, "step_id": 7525, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813787.5231574, "step_id": 7526, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813787.5365283, "step_id": 7527, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813787.549682, "step_id": 7528, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813787.5632875, "step_id": 7529, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813787.5771854, "step_id": 7530, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813787.590809, "step_id": 7531, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813787.60496, "step_id": 7532, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813787.618586, "step_id": 7533, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813787.6330895, "step_id": 7534, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813787.6471496, "step_id": 7535, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813787.6610422, "step_id": 7536, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813787.674645, "step_id": 7537, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813787.6879957, "step_id": 7538, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813787.7013998, "step_id": 7539, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813787.714698, "step_id": 7540, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813787.7278273, "step_id": 7541, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813787.7408235, "step_id": 7542, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813787.753802, "step_id": 7543, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813787.7670329, "step_id": 7544, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813787.780414, "step_id": 7545, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813787.796715, "step_id": 7546, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813787.8076332, "step_id": 7547, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813787.821407, "step_id": 7548, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813787.8348114, "step_id": 7549, "start_load_kv_us": 3, "get_finished_us": 211} +{"t_unix": 1779813787.8481119, "step_id": 7550, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813787.8617713, "step_id": 7551, "start_load_kv_us": 2, "get_finished_us": 353} +{"t_unix": 1779813787.871988, "step_id": 7552, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813787.8824604, "step_id": 7553, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813787.932868, "step_id": 7554, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813787.9355714, "step_id": 7555, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813788.1468728, "step_id": 7556, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813788.1555102, "step_id": 7557, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813788.1645288, "step_id": 7558, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813788.173833, "step_id": 7559, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.1832166, "step_id": 7560, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813788.1926522, "step_id": 7561, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813788.2023466, "step_id": 7562, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813788.2118886, "step_id": 7563, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.2214856, "step_id": 7564, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.2309375, "step_id": 7565, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813788.2404165, "step_id": 7566, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813788.2500088, "step_id": 7567, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813788.2593262, "step_id": 7568, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813788.2690666, "step_id": 7569, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813788.278778, "step_id": 7570, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.2881937, "step_id": 7571, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.2980103, "step_id": 7572, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813788.3072655, "step_id": 7573, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813788.3168068, "step_id": 7574, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.32642, "step_id": 7575, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813788.3360167, "step_id": 7576, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813788.3456225, "step_id": 7577, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813788.3559647, "step_id": 7578, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813788.3655767, "step_id": 7579, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813788.3732202, "step_id": 7580, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813788.3808503, "step_id": 7581, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813788.3876486, "step_id": 7582, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813788.394985, "step_id": 7583, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813788.4023702, "step_id": 7584, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813788.4093745, "step_id": 7585, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813788.4168606, "step_id": 7586, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813788.424345, "step_id": 7587, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813788.4314623, "step_id": 7588, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813788.4384902, "step_id": 7589, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813788.4454198, "step_id": 7590, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813788.4529295, "step_id": 7591, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813788.4599655, "step_id": 7592, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813788.4672115, "step_id": 7593, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813788.4748304, "step_id": 7594, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813788.4822507, "step_id": 7595, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813788.488343, "step_id": 7596, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813788.4942284, "step_id": 7597, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813788.4987044, "step_id": 7598, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.503477, "step_id": 7599, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813788.508244, "step_id": 7600, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813788.5129836, "step_id": 7601, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813788.51774, "step_id": 7602, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813788.522566, "step_id": 7603, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813788.5272067, "step_id": 7604, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813788.5320246, "step_id": 7605, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813788.5367863, "step_id": 7606, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813788.541579, "step_id": 7607, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813788.5463092, "step_id": 7608, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813788.5510633, "step_id": 7609, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813788.5559103, "step_id": 7610, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813788.5606391, "step_id": 7611, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813788.5658376, "step_id": 7612, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813788.5702758, "step_id": 7613, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813788.5749958, "step_id": 7614, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813788.5798168, "step_id": 7615, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813788.5844703, "step_id": 7616, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813788.5892503, "step_id": 7617, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813788.5940242, "step_id": 7618, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813788.5988176, "step_id": 7619, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813788.603563, "step_id": 7620, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813788.6083102, "step_id": 7621, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813788.61319, "step_id": 7622, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813788.617856, "step_id": 7623, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813788.6230297, "step_id": 7624, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813788.6273966, "step_id": 7625, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813788.6321323, "step_id": 7626, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813788.636973, "step_id": 7627, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813788.641666, "step_id": 7628, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813788.6464236, "step_id": 7629, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813788.6512125, "step_id": 7630, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813788.6560063, "step_id": 7631, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813788.66074, "step_id": 7632, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813788.665493, "step_id": 7633, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813788.6703236, "step_id": 7634, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813788.6750712, "step_id": 7635, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813788.6798825, "step_id": 7636, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813788.6846063, "step_id": 7637, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813788.6893606, "step_id": 7638, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813788.6941466, "step_id": 7639, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813788.698892, "step_id": 7640, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813788.7037096, "step_id": 7641, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813788.7085447, "step_id": 7642, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813788.713373, "step_id": 7643, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813788.7181556, "step_id": 7644, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813788.722997, "step_id": 7645, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813788.7277396, "step_id": 7646, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813788.7325943, "step_id": 7647, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813788.7373104, "step_id": 7648, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813788.7420027, "step_id": 7649, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.7468436, "step_id": 7650, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813788.7516465, "step_id": 7651, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813788.7563848, "step_id": 7652, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813788.7611756, "step_id": 7653, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813788.765994, "step_id": 7654, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813788.7707276, "step_id": 7655, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813788.7754295, "step_id": 7656, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.780255, "step_id": 7657, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813788.7850168, "step_id": 7658, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813788.7898529, "step_id": 7659, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813788.7945108, "step_id": 7660, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.7992508, "step_id": 7661, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813788.8040755, "step_id": 7662, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813788.8088622, "step_id": 7663, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813788.813575, "step_id": 7664, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813788.8184166, "step_id": 7665, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813788.823164, "step_id": 7666, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813788.8279085, "step_id": 7667, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813788.8326423, "step_id": 7668, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813788.8374717, "step_id": 7669, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813788.8422832, "step_id": 7670, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813788.8470902, "step_id": 7671, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813788.8518748, "step_id": 7672, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813788.85654, "step_id": 7673, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.8613703, "step_id": 7674, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813788.8660793, "step_id": 7675, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813788.8708873, "step_id": 7676, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813788.8757565, "step_id": 7677, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813788.880459, "step_id": 7678, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813788.8852477, "step_id": 7679, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813788.8900192, "step_id": 7680, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813788.8947868, "step_id": 7681, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813788.8995073, "step_id": 7682, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813788.904285, "step_id": 7683, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813788.9090521, "step_id": 7684, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813788.9138482, "step_id": 7685, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813788.9186318, "step_id": 7686, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813788.9233782, "step_id": 7687, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813788.9282072, "step_id": 7688, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813788.9329605, "step_id": 7689, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813788.9379938, "step_id": 7690, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813788.9425287, "step_id": 7691, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813788.9473634, "step_id": 7692, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813788.9521406, "step_id": 7693, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813788.9569235, "step_id": 7694, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813788.9617112, "step_id": 7695, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813788.9664302, "step_id": 7696, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813788.9711826, "step_id": 7697, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813788.9759855, "step_id": 7698, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813788.980773, "step_id": 7699, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813788.9854903, "step_id": 7700, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.9903667, "step_id": 7701, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813788.9950507, "step_id": 7702, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813788.9998538, "step_id": 7703, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813789.0047536, "step_id": 7704, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813789.0094912, "step_id": 7705, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813789.01429, "step_id": 7706, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813789.0190818, "step_id": 7707, "start_load_kv_us": 1, "get_finished_us": 214} +{"t_unix": 1779813789.0238392, "step_id": 7708, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813789.0285754, "step_id": 7709, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813789.0335033, "step_id": 7710, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813789.0382545, "step_id": 7711, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813789.0428877, "step_id": 7712, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813789.0477014, "step_id": 7713, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813789.0524685, "step_id": 7714, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813789.0572681, "step_id": 7715, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813789.0620315, "step_id": 7716, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813789.06685, "step_id": 7717, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813789.07152, "step_id": 7718, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813789.0763333, "step_id": 7719, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813789.0810947, "step_id": 7720, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813789.0858836, "step_id": 7721, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813789.090646, "step_id": 7722, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813789.0954933, "step_id": 7723, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813789.1002507, "step_id": 7724, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813789.105005, "step_id": 7725, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813789.1098258, "step_id": 7726, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813789.1146622, "step_id": 7727, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813789.119343, "step_id": 7728, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813789.124079, "step_id": 7729, "start_load_kv_us": 1, "get_finished_us": 205} +{"t_unix": 1779813789.1289403, "step_id": 7730, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813789.1336458, "step_id": 7731, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813789.1383803, "step_id": 7732, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813789.1431282, "step_id": 7733, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813789.14797, "step_id": 7734, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813789.1527324, "step_id": 7735, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813789.1574702, "step_id": 7736, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813789.1622322, "step_id": 7737, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813789.166992, "step_id": 7738, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813789.171957, "step_id": 7739, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813789.176556, "step_id": 7740, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813789.181343, "step_id": 7741, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813789.1862106, "step_id": 7742, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813789.1932797, "step_id": 7743, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813789.1957562, "step_id": 7744, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813789.2006686, "step_id": 7745, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813789.2052188, "step_id": 7746, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813789.2099853, "step_id": 7747, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813789.214802, "step_id": 7748, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813789.2195048, "step_id": 7749, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813789.224326, "step_id": 7750, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813789.2290983, "step_id": 7751, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813789.2415738, "step_id": 7752, "start_load_kv_us": 48, "get_finished_us": 2282} +{"t_unix": 1779813789.2435095, "step_id": 7753, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813789.2455814, "step_id": 7754, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813789.2503014, "step_id": 7755, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813789.2550507, "step_id": 7756, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813789.259852, "step_id": 7757, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813789.2646163, "step_id": 7758, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813789.2694764, "step_id": 7759, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813789.2741895, "step_id": 7760, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813789.2789829, "step_id": 7761, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813789.2837422, "step_id": 7762, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813789.2885404, "step_id": 7763, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813789.293266, "step_id": 7764, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813789.298066, "step_id": 7765, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813789.3028646, "step_id": 7766, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813789.307604, "step_id": 7767, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813789.3123536, "step_id": 7768, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813789.317113, "step_id": 7769, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813789.3219156, "step_id": 7770, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813789.326695, "step_id": 7771, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813789.331462, "step_id": 7772, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813789.3362124, "step_id": 7773, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813789.3410306, "step_id": 7774, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813789.3459122, "step_id": 7775, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813789.3506057, "step_id": 7776, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813789.3553817, "step_id": 7777, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813789.3601491, "step_id": 7778, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813789.3648732, "step_id": 7779, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813789.3696804, "step_id": 7780, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813789.3744636, "step_id": 7781, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813789.379248, "step_id": 7782, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813789.383996, "step_id": 7783, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813789.3887951, "step_id": 7784, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813789.3935127, "step_id": 7785, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813789.398321, "step_id": 7786, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813789.4031115, "step_id": 7787, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813789.4078536, "step_id": 7788, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813789.412696, "step_id": 7789, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813789.4173868, "step_id": 7790, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813789.4222755, "step_id": 7791, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813789.4270198, "step_id": 7792, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813789.4318066, "step_id": 7793, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813789.4365423, "step_id": 7794, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813789.4413362, "step_id": 7795, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813789.4461155, "step_id": 7796, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813789.4508767, "step_id": 7797, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813789.4556766, "step_id": 7798, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813789.4603932, "step_id": 7799, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813789.4652176, "step_id": 7800, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813789.470017, "step_id": 7801, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813789.4747682, "step_id": 7802, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813789.4794853, "step_id": 7803, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813789.4842288, "step_id": 7804, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813789.489033, "step_id": 7805, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813789.4938319, "step_id": 7806, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813789.498669, "step_id": 7807, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813789.5033283, "step_id": 7808, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813789.508117, "step_id": 7809, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813789.512531, "step_id": 7810, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813789.516654, "step_id": 7811, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813791.0448196, "step_id": 7812, "start_load_kv_us": 3, "get_finished_us": 357} +{"t_unix": 1779813791.0470617, "step_id": 7813, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813791.2421222, "step_id": 7814, "start_load_kv_us": 3, "get_finished_us": 321} +{"t_unix": 1779813791.2464724, "step_id": 7815, "start_load_kv_us": 3, "get_finished_us": 265} +{"t_unix": 1779813791.2511823, "step_id": 7816, "start_load_kv_us": 3, "get_finished_us": 295} +{"t_unix": 1779813791.2557182, "step_id": 7817, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813791.2605648, "step_id": 7818, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813791.2652168, "step_id": 7819, "start_load_kv_us": 3, "get_finished_us": 171} +{"t_unix": 1779813791.2701519, "step_id": 7820, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813791.274699, "step_id": 7821, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813791.2793667, "step_id": 7822, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813791.2840836, "step_id": 7823, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813791.2888217, "step_id": 7824, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813791.293578, "step_id": 7825, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813791.2983112, "step_id": 7826, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813791.3030994, "step_id": 7827, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813791.307939, "step_id": 7828, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813791.3126035, "step_id": 7829, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813791.3173745, "step_id": 7830, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813791.3221526, "step_id": 7831, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813791.32691, "step_id": 7832, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813791.3317196, "step_id": 7833, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813791.3364334, "step_id": 7834, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813791.3412194, "step_id": 7835, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813791.3460233, "step_id": 7836, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813791.3507597, "step_id": 7837, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813791.3554223, "step_id": 7838, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813791.3602664, "step_id": 7839, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813791.365037, "step_id": 7840, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813791.3698332, "step_id": 7841, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813791.3745415, "step_id": 7842, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813791.3793695, "step_id": 7843, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813791.384116, "step_id": 7844, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813791.3888843, "step_id": 7845, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813791.393715, "step_id": 7846, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813791.3984692, "step_id": 7847, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.4032059, "step_id": 7848, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813791.4079869, "step_id": 7849, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813791.412756, "step_id": 7850, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813791.417499, "step_id": 7851, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813791.42229, "step_id": 7852, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813791.427027, "step_id": 7853, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813791.431793, "step_id": 7854, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813791.4366126, "step_id": 7855, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813791.441417, "step_id": 7856, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813791.4461098, "step_id": 7857, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813791.45087, "step_id": 7858, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.4556603, "step_id": 7859, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813791.4603524, "step_id": 7860, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813791.465154, "step_id": 7861, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813791.4700403, "step_id": 7862, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813791.4747539, "step_id": 7863, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813791.4795434, "step_id": 7864, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813791.4842577, "step_id": 7865, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813791.4890873, "step_id": 7866, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813791.4937935, "step_id": 7867, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813791.4986105, "step_id": 7868, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813791.5032926, "step_id": 7869, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813791.5080602, "step_id": 7870, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813791.5128992, "step_id": 7871, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813791.5176172, "step_id": 7872, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813791.5224223, "step_id": 7873, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813791.5271885, "step_id": 7874, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813791.53193, "step_id": 7875, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813791.5366387, "step_id": 7876, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813791.54146, "step_id": 7877, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813791.5462828, "step_id": 7878, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813791.5510938, "step_id": 7879, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813791.5558162, "step_id": 7880, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813791.560535, "step_id": 7881, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813791.56533, "step_id": 7882, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813791.570137, "step_id": 7883, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813791.5749652, "step_id": 7884, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813791.5799947, "step_id": 7885, "start_load_kv_us": 3, "get_finished_us": 195} +{"t_unix": 1779813791.5847583, "step_id": 7886, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813791.5892441, "step_id": 7887, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813791.5940409, "step_id": 7888, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813791.5987802, "step_id": 7889, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813791.6035433, "step_id": 7890, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813791.6082742, "step_id": 7891, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813791.6130028, "step_id": 7892, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813791.6178217, "step_id": 7893, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813791.6225152, "step_id": 7894, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813791.6273046, "step_id": 7895, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813791.6320853, "step_id": 7896, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813791.63687, "step_id": 7897, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813791.6416347, "step_id": 7898, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813791.646363, "step_id": 7899, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813791.6511838, "step_id": 7900, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813791.655954, "step_id": 7901, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813791.6606512, "step_id": 7902, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.6654115, "step_id": 7903, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813791.6701891, "step_id": 7904, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.674953, "step_id": 7905, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813791.6797101, "step_id": 7906, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813791.6844535, "step_id": 7907, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813791.6892097, "step_id": 7908, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813791.6939735, "step_id": 7909, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813791.6987712, "step_id": 7910, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813791.7034693, "step_id": 7911, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813791.708249, "step_id": 7912, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813791.7130303, "step_id": 7913, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813791.7177992, "step_id": 7914, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813791.7225845, "step_id": 7915, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813791.7273438, "step_id": 7916, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813791.7320354, "step_id": 7917, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.7374084, "step_id": 7918, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813791.7416263, "step_id": 7919, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813791.7463655, "step_id": 7920, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813791.751158, "step_id": 7921, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813791.7560067, "step_id": 7922, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813791.7606962, "step_id": 7923, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813791.765478, "step_id": 7924, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813791.7709403, "step_id": 7925, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813791.7751105, "step_id": 7926, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813791.779864, "step_id": 7927, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813791.7846, "step_id": 7928, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813791.7893865, "step_id": 7929, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813791.794157, "step_id": 7930, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813791.7989638, "step_id": 7931, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813791.8038344, "step_id": 7932, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813791.8084843, "step_id": 7933, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813791.8133004, "step_id": 7934, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813791.818046, "step_id": 7935, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813791.8230329, "step_id": 7936, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813791.8277082, "step_id": 7937, "start_load_kv_us": 5, "get_finished_us": 140} +{"t_unix": 1779813791.832497, "step_id": 7938, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813791.837147, "step_id": 7939, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813791.841965, "step_id": 7940, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.8467293, "step_id": 7941, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813791.8514643, "step_id": 7942, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813791.8562586, "step_id": 7943, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813791.8610046, "step_id": 7944, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813791.865809, "step_id": 7945, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813791.870518, "step_id": 7946, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813791.875302, "step_id": 7947, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813791.8801777, "step_id": 7948, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813791.8848784, "step_id": 7949, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813791.8896523, "step_id": 7950, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813791.894606, "step_id": 7951, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813791.899214, "step_id": 7952, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813791.9040658, "step_id": 7953, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813791.9090645, "step_id": 7954, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813791.9135935, "step_id": 7955, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813791.9183762, "step_id": 7956, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813791.9230955, "step_id": 7957, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813791.9279296, "step_id": 7958, "start_load_kv_us": 2, "get_finished_us": 126} +{"t_unix": 1779813791.9327216, "step_id": 7959, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813791.9374776, "step_id": 7960, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813791.9422688, "step_id": 7961, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813791.9471226, "step_id": 7962, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813791.9518383, "step_id": 7963, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813791.956671, "step_id": 7964, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813791.9613323, "step_id": 7965, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813791.966128, "step_id": 7966, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813791.9709957, "step_id": 7967, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813791.9763453, "step_id": 7968, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813791.9807527, "step_id": 7969, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813791.9852343, "step_id": 7970, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813791.989958, "step_id": 7971, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813791.994772, "step_id": 7972, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813791.9995308, "step_id": 7973, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813792.004315, "step_id": 7974, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813792.0090866, "step_id": 7975, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813792.0139065, "step_id": 7976, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813792.0186508, "step_id": 7977, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813792.0234084, "step_id": 7978, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813792.0282173, "step_id": 7979, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813792.033046, "step_id": 7980, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813792.037775, "step_id": 7981, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813792.0425196, "step_id": 7982, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813792.0473204, "step_id": 7983, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813792.0520813, "step_id": 7984, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813792.0568907, "step_id": 7985, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813792.0616372, "step_id": 7986, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813792.0663912, "step_id": 7987, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813792.0712, "step_id": 7988, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813792.0760157, "step_id": 7989, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813792.0807545, "step_id": 7990, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813792.0855236, "step_id": 7991, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813792.0903277, "step_id": 7992, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813792.0950956, "step_id": 7993, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813792.0998805, "step_id": 7994, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813792.104646, "step_id": 7995, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813792.109411, "step_id": 7996, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813792.114197, "step_id": 7997, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813792.1189911, "step_id": 7998, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813792.1237335, "step_id": 7999, "start_load_kv_us": 3, "get_finished_us": 138} +{"t_unix": 1779813792.1284914, "step_id": 8000, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813792.1332977, "step_id": 8001, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813792.1380556, "step_id": 8002, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813792.142852, "step_id": 8003, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813792.1476204, "step_id": 8004, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813792.15238, "step_id": 8005, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813792.1572034, "step_id": 8006, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813792.1619995, "step_id": 8007, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813792.1667957, "step_id": 8008, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813792.171535, "step_id": 8009, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813792.176293, "step_id": 8010, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813792.1812587, "step_id": 8011, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813792.1860533, "step_id": 8012, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813792.1907723, "step_id": 8013, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813792.1954532, "step_id": 8014, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813792.2002652, "step_id": 8015, "start_load_kv_us": 2, "get_finished_us": 124} +{"t_unix": 1779813792.2049973, "step_id": 8016, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813792.2098064, "step_id": 8017, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813792.214581, "step_id": 8018, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813792.2193177, "step_id": 8019, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813792.2241936, "step_id": 8020, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813792.2289555, "step_id": 8021, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813792.2337449, "step_id": 8022, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813792.238764, "step_id": 8023, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813792.243359, "step_id": 8024, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813792.2481053, "step_id": 8025, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813792.2528694, "step_id": 8026, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813792.2576969, "step_id": 8027, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813792.262489, "step_id": 8028, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813792.2671885, "step_id": 8029, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813792.2719383, "step_id": 8030, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813792.2767146, "step_id": 8031, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813792.2814598, "step_id": 8032, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813792.2862356, "step_id": 8033, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813792.2910829, "step_id": 8034, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813792.2958791, "step_id": 8035, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813792.3006668, "step_id": 8036, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813792.3053858, "step_id": 8037, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813792.3102038, "step_id": 8038, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813792.314984, "step_id": 8039, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813792.3197405, "step_id": 8040, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813792.3244605, "step_id": 8041, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813792.3292565, "step_id": 8042, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813792.3340614, "step_id": 8043, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813792.3388865, "step_id": 8044, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813792.3436425, "step_id": 8045, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813792.3484192, "step_id": 8046, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813792.3531237, "step_id": 8047, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813792.3579695, "step_id": 8048, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813792.3627505, "step_id": 8049, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813792.3674643, "step_id": 8050, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813792.3723032, "step_id": 8051, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813792.3770692, "step_id": 8052, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813792.381854, "step_id": 8053, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813792.3866935, "step_id": 8054, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813792.391982, "step_id": 8055, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813792.3962874, "step_id": 8056, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813792.4010837, "step_id": 8057, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813792.4058697, "step_id": 8058, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813792.4105906, "step_id": 8059, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813792.415474, "step_id": 8060, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813792.4200847, "step_id": 8061, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813792.424901, "step_id": 8062, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813792.429708, "step_id": 8063, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813792.434454, "step_id": 8064, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813792.4392617, "step_id": 8065, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813792.4441075, "step_id": 8066, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813792.4488404, "step_id": 8067, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813792.453201, "step_id": 8068, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813792.4573298, "step_id": 8069, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813792.762922, "step_id": 8070, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813792.7648473, "step_id": 8071, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813792.959234, "step_id": 8072, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813792.9635298, "step_id": 8073, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813792.9682033, "step_id": 8074, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813792.972996, "step_id": 8075, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813792.9777825, "step_id": 8076, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813792.9824805, "step_id": 8077, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813792.9872737, "step_id": 8078, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813792.9920716, "step_id": 8079, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813792.9968486, "step_id": 8080, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.0018153, "step_id": 8081, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813793.0064983, "step_id": 8082, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813793.0113633, "step_id": 8083, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813793.0161145, "step_id": 8084, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813793.0207698, "step_id": 8085, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813793.0254612, "step_id": 8086, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813793.0302532, "step_id": 8087, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813793.0351286, "step_id": 8088, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813793.0398655, "step_id": 8089, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813793.0445955, "step_id": 8090, "start_load_kv_us": 1, "get_finished_us": 218} +{"t_unix": 1779813793.0494, "step_id": 8091, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813793.0541258, "step_id": 8092, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813793.058937, "step_id": 8093, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813793.0637717, "step_id": 8094, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813793.0684552, "step_id": 8095, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813793.0731933, "step_id": 8096, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813793.0780418, "step_id": 8097, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813793.0827477, "step_id": 8098, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813793.087481, "step_id": 8099, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813793.0923102, "step_id": 8100, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813793.0970092, "step_id": 8101, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813793.1017697, "step_id": 8102, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813793.1064942, "step_id": 8103, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813793.1113596, "step_id": 8104, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813793.116085, "step_id": 8105, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813793.1208289, "step_id": 8106, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.125575, "step_id": 8107, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813793.1303298, "step_id": 8108, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.1350808, "step_id": 8109, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813793.1399696, "step_id": 8110, "start_load_kv_us": 1, "get_finished_us": 178} +{"t_unix": 1779813793.144731, "step_id": 8111, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813793.149429, "step_id": 8112, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.1542587, "step_id": 8113, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813793.158987, "step_id": 8114, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.1638057, "step_id": 8115, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813793.1685114, "step_id": 8116, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813793.173302, "step_id": 8117, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813793.1780844, "step_id": 8118, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813793.1828384, "step_id": 8119, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.1876557, "step_id": 8120, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813793.1924014, "step_id": 8121, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813793.1971736, "step_id": 8122, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813793.201932, "step_id": 8123, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813793.2067306, "step_id": 8124, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.2114658, "step_id": 8125, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813793.2162826, "step_id": 8126, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813793.221052, "step_id": 8127, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813793.2258232, "step_id": 8128, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813793.2306175, "step_id": 8129, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813793.2353332, "step_id": 8130, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813793.24008, "step_id": 8131, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813793.2448719, "step_id": 8132, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.2496617, "step_id": 8133, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813793.254397, "step_id": 8134, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813793.2592003, "step_id": 8135, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.2639747, "step_id": 8136, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813793.2687442, "step_id": 8137, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813793.2735143, "step_id": 8138, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813793.2782922, "step_id": 8139, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813793.283056, "step_id": 8140, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813793.2878456, "step_id": 8141, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.2926376, "step_id": 8142, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813793.2973797, "step_id": 8143, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813793.3021393, "step_id": 8144, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813793.306998, "step_id": 8145, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813793.3117404, "step_id": 8146, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813793.3164666, "step_id": 8147, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813793.3212762, "step_id": 8148, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813793.3260424, "step_id": 8149, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813793.330872, "step_id": 8150, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813793.3356044, "step_id": 8151, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813793.3405018, "step_id": 8152, "start_load_kv_us": 1, "get_finished_us": 240} +{"t_unix": 1779813793.3451948, "step_id": 8153, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813793.3499706, "step_id": 8154, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813793.3547661, "step_id": 8155, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813793.3594909, "step_id": 8156, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813793.364257, "step_id": 8157, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813793.3690674, "step_id": 8158, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813793.3738494, "step_id": 8159, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813793.3787088, "step_id": 8160, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813793.383452, "step_id": 8161, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813793.3881557, "step_id": 8162, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813793.392937, "step_id": 8163, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813793.397749, "step_id": 8164, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813793.4024944, "step_id": 8165, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813793.407221, "step_id": 8166, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.412016, "step_id": 8167, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813793.416805, "step_id": 8168, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813793.4216108, "step_id": 8169, "start_load_kv_us": 1, "get_finished_us": 224} +{"t_unix": 1779813793.4263988, "step_id": 8170, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813793.4311166, "step_id": 8171, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813793.4359782, "step_id": 8172, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813793.440647, "step_id": 8173, "start_load_kv_us": 16, "get_finished_us": 165} +{"t_unix": 1779813793.445404, "step_id": 8174, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813793.4501865, "step_id": 8175, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813793.4549658, "step_id": 8176, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813793.4597535, "step_id": 8177, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813793.464458, "step_id": 8178, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813793.4692512, "step_id": 8179, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813793.4740403, "step_id": 8180, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813793.4788072, "step_id": 8181, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813793.4835598, "step_id": 8182, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813793.4883423, "step_id": 8183, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813793.4931173, "step_id": 8184, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.4979877, "step_id": 8185, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813793.5026977, "step_id": 8186, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813793.5074778, "step_id": 8187, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813793.5122292, "step_id": 8188, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.517003, "step_id": 8189, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813793.5217667, "step_id": 8190, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.526534, "step_id": 8191, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813793.5313184, "step_id": 8192, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813793.536154, "step_id": 8193, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813793.5409348, "step_id": 8194, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813793.5456924, "step_id": 8195, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813793.5504632, "step_id": 8196, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813793.5553026, "step_id": 8197, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813793.560065, "step_id": 8198, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813793.5654454, "step_id": 8199, "start_load_kv_us": 2, "get_finished_us": 339} +{"t_unix": 1779813793.5700517, "step_id": 8200, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813793.574756, "step_id": 8201, "start_load_kv_us": 3, "get_finished_us": 238} +{"t_unix": 1779813793.5793068, "step_id": 8202, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813793.584334, "step_id": 8203, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813793.5888991, "step_id": 8204, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813793.5937154, "step_id": 8205, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813793.5983403, "step_id": 8206, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813793.6030767, "step_id": 8207, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813793.607877, "step_id": 8208, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813793.612685, "step_id": 8209, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813793.6176474, "step_id": 8210, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813793.6222227, "step_id": 8211, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813793.6269615, "step_id": 8212, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813793.6317596, "step_id": 8213, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813793.6364868, "step_id": 8214, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813793.641273, "step_id": 8215, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.646061, "step_id": 8216, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813793.6508977, "step_id": 8217, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813793.6556633, "step_id": 8218, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813793.6604102, "step_id": 8219, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813793.6651816, "step_id": 8220, "start_load_kv_us": 2, "get_finished_us": 129} +{"t_unix": 1779813793.669999, "step_id": 8221, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813793.67482, "step_id": 8222, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.6795888, "step_id": 8223, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813793.6842945, "step_id": 8224, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813793.6891882, "step_id": 8225, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.6951847, "step_id": 8226, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813793.6986916, "step_id": 8227, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813793.70356, "step_id": 8228, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813793.7081816, "step_id": 8229, "start_load_kv_us": 1, "get_finished_us": 131} +{"t_unix": 1779813793.7130268, "step_id": 8230, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813793.7178094, "step_id": 8231, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.7227077, "step_id": 8232, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813793.7275052, "step_id": 8233, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813793.7322087, "step_id": 8234, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813793.7369936, "step_id": 8235, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813793.7417912, "step_id": 8236, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813793.7464976, "step_id": 8237, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813793.7513218, "step_id": 8238, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813793.7561383, "step_id": 8239, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813793.7608886, "step_id": 8240, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813793.7657838, "step_id": 8241, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813793.770467, "step_id": 8242, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813793.775279, "step_id": 8243, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813793.7801414, "step_id": 8244, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813793.7849302, "step_id": 8245, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813793.789723, "step_id": 8246, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813793.7944665, "step_id": 8247, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813793.7994032, "step_id": 8248, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813793.8041646, "step_id": 8249, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813793.8087847, "step_id": 8250, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.8135934, "step_id": 8251, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813793.8183422, "step_id": 8252, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813793.823107, "step_id": 8253, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813793.828177, "step_id": 8254, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813793.8329377, "step_id": 8255, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813793.8376646, "step_id": 8256, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813793.8423977, "step_id": 8257, "start_load_kv_us": 1, "get_finished_us": 203} +{"t_unix": 1779813793.8470907, "step_id": 8258, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813793.851874, "step_id": 8259, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813793.8566697, "step_id": 8260, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813793.8615236, "step_id": 8261, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813793.8662193, "step_id": 8262, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813793.871002, "step_id": 8263, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813793.8757718, "step_id": 8264, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813793.8804615, "step_id": 8265, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813793.8852413, "step_id": 8266, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813793.8900056, "step_id": 8267, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813793.8948436, "step_id": 8268, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813793.8996055, "step_id": 8269, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813793.9047434, "step_id": 8270, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813793.9091842, "step_id": 8271, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813793.9139214, "step_id": 8272, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813793.9188175, "step_id": 8273, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813793.9236805, "step_id": 8274, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813793.928399, "step_id": 8275, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813793.933103, "step_id": 8276, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813793.9379308, "step_id": 8277, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813793.9426484, "step_id": 8278, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813793.9473722, "step_id": 8279, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813793.9523954, "step_id": 8280, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813793.9569936, "step_id": 8281, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813793.9617941, "step_id": 8282, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813793.9666305, "step_id": 8283, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813793.9712832, "step_id": 8284, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813793.9760742, "step_id": 8285, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813793.9808645, "step_id": 8286, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813793.9856672, "step_id": 8287, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813793.9905303, "step_id": 8288, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813793.9952857, "step_id": 8289, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813794.0001988, "step_id": 8290, "start_load_kv_us": 1, "get_finished_us": 325} +{"t_unix": 1779813794.0049753, "step_id": 8291, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813794.00972, "step_id": 8292, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813794.0145993, "step_id": 8293, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813794.0191662, "step_id": 8294, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813794.0239837, "step_id": 8295, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813794.0286794, "step_id": 8296, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813794.0335646, "step_id": 8297, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813794.038428, "step_id": 8298, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813794.0431693, "step_id": 8299, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813794.0479743, "step_id": 8300, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813794.0526707, "step_id": 8301, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813794.057452, "step_id": 8302, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813794.0621505, "step_id": 8303, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813794.067036, "step_id": 8304, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813794.07191, "step_id": 8305, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813794.0766096, "step_id": 8306, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813794.081323, "step_id": 8307, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813794.0860853, "step_id": 8308, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813794.0908725, "step_id": 8309, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813794.0956335, "step_id": 8310, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813794.1010149, "step_id": 8311, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813794.1053524, "step_id": 8312, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813794.110034, "step_id": 8313, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813794.1147466, "step_id": 8314, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813794.1196156, "step_id": 8315, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813794.124374, "step_id": 8316, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813794.1292048, "step_id": 8317, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813794.1339536, "step_id": 8318, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813794.1385703, "step_id": 8319, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813794.1433873, "step_id": 8320, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813794.1481931, "step_id": 8321, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813794.1529162, "step_id": 8322, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813794.1577482, "step_id": 8323, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813794.1625123, "step_id": 8324, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813794.167239, "step_id": 8325, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813794.1716805, "step_id": 8326, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813794.1758358, "step_id": 8327, "start_load_kv_us": 1, "get_finished_us": 237} +{"t_unix": 1779813794.299373, "step_id": 8328, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813794.3011956, "step_id": 8329, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813794.4948552, "step_id": 8330, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813794.4993336, "step_id": 8331, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813794.5041003, "step_id": 8332, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813794.5088422, "step_id": 8333, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813794.5135214, "step_id": 8334, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813794.5182555, "step_id": 8335, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813794.523075, "step_id": 8336, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813794.5278914, "step_id": 8337, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813794.5326338, "step_id": 8338, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813794.537355, "step_id": 8339, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813794.5421324, "step_id": 8340, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813794.5469031, "step_id": 8341, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813794.5516646, "step_id": 8342, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813794.5563715, "step_id": 8343, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813794.5611837, "step_id": 8344, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813794.56594, "step_id": 8345, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813794.5707707, "step_id": 8346, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813794.57546, "step_id": 8347, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813794.5803487, "step_id": 8348, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813794.5850265, "step_id": 8349, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813794.5898848, "step_id": 8350, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813794.5945308, "step_id": 8351, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813794.599351, "step_id": 8352, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813794.6041749, "step_id": 8353, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813794.608985, "step_id": 8354, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813794.6137178, "step_id": 8355, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813794.6184497, "step_id": 8356, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813794.6232812, "step_id": 8357, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813794.628029, "step_id": 8358, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813794.6327915, "step_id": 8359, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813794.6374989, "step_id": 8360, "start_load_kv_us": 1, "get_finished_us": 189} +{"t_unix": 1779813794.6423192, "step_id": 8361, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813794.6470244, "step_id": 8362, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813794.6519105, "step_id": 8363, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813794.6566942, "step_id": 8364, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813794.6613667, "step_id": 8365, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813794.6660898, "step_id": 8366, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813794.6709535, "step_id": 8367, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813794.6757834, "step_id": 8368, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813794.6804316, "step_id": 8369, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813794.6852627, "step_id": 8370, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813794.690037, "step_id": 8371, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813794.694795, "step_id": 8372, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813794.6995595, "step_id": 8373, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813794.7043417, "step_id": 8374, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813794.7090712, "step_id": 8375, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813794.7138855, "step_id": 8376, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813794.7186313, "step_id": 8377, "start_load_kv_us": 1, "get_finished_us": 205} +{"t_unix": 1779813794.7233632, "step_id": 8378, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813794.7281575, "step_id": 8379, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813794.7330341, "step_id": 8380, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813794.7377472, "step_id": 8381, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813794.742577, "step_id": 8382, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813794.7472606, "step_id": 8383, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813794.7521062, "step_id": 8384, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813794.756812, "step_id": 8385, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813794.7616127, "step_id": 8386, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813794.766339, "step_id": 8387, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813794.7710593, "step_id": 8388, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813794.7760692, "step_id": 8389, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813794.7806659, "step_id": 8390, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813794.78538, "step_id": 8391, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813794.7901735, "step_id": 8392, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813794.7960005, "step_id": 8393, "start_load_kv_us": 2, "get_finished_us": 1149} +{"t_unix": 1779813794.846693, "step_id": 8394, "start_load_kv_us": 2, "get_finished_us": 350} +{"t_unix": 1779813794.8490944, "step_id": 8395, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813795.039211, "step_id": 8396, "start_load_kv_us": 3, "get_finished_us": 328} +{"t_unix": 1779813795.0444536, "step_id": 8397, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813795.0501153, "step_id": 8398, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813795.056257, "step_id": 8399, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813795.0621936, "step_id": 8400, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813795.0681927, "step_id": 8401, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813795.0741613, "step_id": 8402, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813795.0798664, "step_id": 8403, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813795.0855303, "step_id": 8404, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813795.0913942, "step_id": 8405, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813795.0973945, "step_id": 8406, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813795.1031866, "step_id": 8407, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813795.1091547, "step_id": 8408, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813795.1148722, "step_id": 8409, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813795.120776, "step_id": 8410, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813795.1266053, "step_id": 8411, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813795.1323133, "step_id": 8412, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813795.1380298, "step_id": 8413, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813795.1438973, "step_id": 8414, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813795.1495256, "step_id": 8415, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813795.1555548, "step_id": 8416, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813795.161155, "step_id": 8417, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813795.1669967, "step_id": 8418, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813795.1727788, "step_id": 8419, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813795.178463, "step_id": 8420, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813795.1843517, "step_id": 8421, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813795.190066, "step_id": 8422, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813795.1958485, "step_id": 8423, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813795.201895, "step_id": 8424, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813795.2075412, "step_id": 8425, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813795.213262, "step_id": 8426, "start_load_kv_us": 3, "get_finished_us": 233} +{"t_unix": 1779813795.2188275, "step_id": 8427, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813795.2245746, "step_id": 8428, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813795.2299802, "step_id": 8429, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813795.2357395, "step_id": 8430, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813795.2417364, "step_id": 8431, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813795.2476482, "step_id": 8432, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813795.253405, "step_id": 8433, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813795.264353, "step_id": 8434, "start_load_kv_us": 2, "get_finished_us": 394} +{"t_unix": 1779813795.266297, "step_id": 8435, "start_load_kv_us": 1, "get_finished_us": 212} +{"t_unix": 1779813795.271469, "step_id": 8436, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813795.2773776, "step_id": 8437, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813795.2834086, "step_id": 8438, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813795.28953, "step_id": 8439, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813795.2954597, "step_id": 8440, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813795.3013198, "step_id": 8441, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813795.3070562, "step_id": 8442, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813795.3131807, "step_id": 8443, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813795.3191123, "step_id": 8444, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813795.3249729, "step_id": 8445, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813795.3304718, "step_id": 8446, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813795.3361287, "step_id": 8447, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813795.3416803, "step_id": 8448, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813795.3470745, "step_id": 8449, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813795.3527756, "step_id": 8450, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813795.358675, "step_id": 8451, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813795.3645973, "step_id": 8452, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813795.3707187, "step_id": 8453, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813795.3764756, "step_id": 8454, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813795.3820422, "step_id": 8455, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813795.3877647, "step_id": 8456, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813795.393668, "step_id": 8457, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.3994637, "step_id": 8458, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.4055216, "step_id": 8459, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813795.4113617, "step_id": 8460, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813795.417136, "step_id": 8461, "start_load_kv_us": 14, "get_finished_us": 149} +{"t_unix": 1779813795.4230149, "step_id": 8462, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813795.4291465, "step_id": 8463, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813795.4352353, "step_id": 8464, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813795.4408903, "step_id": 8465, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813795.4466276, "step_id": 8466, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813795.4523375, "step_id": 8467, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.4584754, "step_id": 8468, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813795.4643323, "step_id": 8469, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813795.4707847, "step_id": 8470, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813795.47659, "step_id": 8471, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813795.482652, "step_id": 8472, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813795.4885225, "step_id": 8473, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813795.4944813, "step_id": 8474, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813795.5002372, "step_id": 8475, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813795.506119, "step_id": 8476, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813795.5118904, "step_id": 8477, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813795.518048, "step_id": 8478, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813795.524056, "step_id": 8479, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813795.5302067, "step_id": 8480, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813795.53626, "step_id": 8481, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813795.5423868, "step_id": 8482, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.5485187, "step_id": 8483, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813795.554493, "step_id": 8484, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813795.560321, "step_id": 8485, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813795.566186, "step_id": 8486, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813795.572198, "step_id": 8487, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813795.578216, "step_id": 8488, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813795.5840278, "step_id": 8489, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813795.589882, "step_id": 8490, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813795.5956857, "step_id": 8491, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813795.6016047, "step_id": 8492, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813795.6077962, "step_id": 8493, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813795.6138375, "step_id": 8494, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813795.6199121, "step_id": 8495, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813795.6260223, "step_id": 8496, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813795.632156, "step_id": 8497, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813795.6383054, "step_id": 8498, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813795.6442149, "step_id": 8499, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813795.6499808, "step_id": 8500, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813795.6558554, "step_id": 8501, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813795.6613688, "step_id": 8502, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813795.6670659, "step_id": 8503, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813795.67284, "step_id": 8504, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.6786594, "step_id": 8505, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.6844976, "step_id": 8506, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813795.6902695, "step_id": 8507, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813795.6963615, "step_id": 8508, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813795.7022383, "step_id": 8509, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813795.7083209, "step_id": 8510, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813795.7142546, "step_id": 8511, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813795.7202592, "step_id": 8512, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813795.7260146, "step_id": 8513, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813795.7318432, "step_id": 8514, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813795.7378705, "step_id": 8515, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813795.7438374, "step_id": 8516, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813795.749846, "step_id": 8517, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813795.7553906, "step_id": 8518, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813795.7610762, "step_id": 8519, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813795.767061, "step_id": 8520, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813795.7729843, "step_id": 8521, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813795.7790947, "step_id": 8522, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813795.785186, "step_id": 8523, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813795.7912252, "step_id": 8524, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813795.7973027, "step_id": 8525, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813795.8035195, "step_id": 8526, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813795.8097107, "step_id": 8527, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813795.8157294, "step_id": 8528, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813795.821849, "step_id": 8529, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813795.8279855, "step_id": 8530, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813795.8341303, "step_id": 8531, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813795.8401837, "step_id": 8532, "start_load_kv_us": 1, "get_finished_us": 210} +{"t_unix": 1779813795.8463438, "step_id": 8533, "start_load_kv_us": 1, "get_finished_us": 207} +{"t_unix": 1779813795.8524303, "step_id": 8534, "start_load_kv_us": 1, "get_finished_us": 215} +{"t_unix": 1779813795.858615, "step_id": 8535, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813795.864776, "step_id": 8536, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813795.8708415, "step_id": 8537, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813795.8769536, "step_id": 8538, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813795.8831325, "step_id": 8539, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813795.8892715, "step_id": 8540, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813795.8952582, "step_id": 8541, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813795.901402, "step_id": 8542, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813795.907662, "step_id": 8543, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813795.9136024, "step_id": 8544, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813795.9195347, "step_id": 8545, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813795.9253938, "step_id": 8546, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813795.9311213, "step_id": 8547, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813795.9369988, "step_id": 8548, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813795.943133, "step_id": 8549, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813795.9487388, "step_id": 8550, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813795.954566, "step_id": 8551, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813795.960263, "step_id": 8552, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813795.966242, "step_id": 8553, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813795.9717126, "step_id": 8554, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813795.9771595, "step_id": 8555, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813795.9827857, "step_id": 8556, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813795.9883022, "step_id": 8557, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813795.9943395, "step_id": 8558, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813796.0004735, "step_id": 8559, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813796.0064695, "step_id": 8560, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813796.0123816, "step_id": 8561, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813796.0184274, "step_id": 8562, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813796.0243883, "step_id": 8563, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813796.0303948, "step_id": 8564, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813796.0363612, "step_id": 8565, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813796.0422728, "step_id": 8566, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813796.048958, "step_id": 8567, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813796.0548272, "step_id": 8568, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813796.0604126, "step_id": 8569, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813796.0661395, "step_id": 8570, "start_load_kv_us": 1, "get_finished_us": 231} +{"t_unix": 1779813796.0720732, "step_id": 8571, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813796.0778399, "step_id": 8572, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813796.0834842, "step_id": 8573, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813796.0896084, "step_id": 8574, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813796.0954742, "step_id": 8575, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813796.101247, "step_id": 8576, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813796.1072924, "step_id": 8577, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813796.1130831, "step_id": 8578, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813796.1188133, "step_id": 8579, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813796.1245155, "step_id": 8580, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813796.130317, "step_id": 8581, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813796.1363857, "step_id": 8582, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813796.1424682, "step_id": 8583, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813796.1489005, "step_id": 8584, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813796.1546414, "step_id": 8585, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813796.15927, "step_id": 8586, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813796.164, "step_id": 8587, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813796.168779, "step_id": 8588, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813796.1734867, "step_id": 8589, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813796.1782722, "step_id": 8590, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813796.183099, "step_id": 8591, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813796.1878881, "step_id": 8592, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813796.1926541, "step_id": 8593, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813796.197418, "step_id": 8594, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813796.2021794, "step_id": 8595, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813796.206979, "step_id": 8596, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813796.211875, "step_id": 8597, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813796.2165961, "step_id": 8598, "start_load_kv_us": 1, "get_finished_us": 216} +{"t_unix": 1779813796.2213316, "step_id": 8599, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813796.2261448, "step_id": 8600, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.2308526, "step_id": 8601, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813796.2356396, "step_id": 8602, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813796.240377, "step_id": 8603, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813796.2451677, "step_id": 8604, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813796.249998, "step_id": 8605, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813796.2547538, "step_id": 8606, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.259483, "step_id": 8607, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813796.2643192, "step_id": 8608, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813796.2694623, "step_id": 8609, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813796.273929, "step_id": 8610, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813796.2786372, "step_id": 8611, "start_load_kv_us": 17, "get_finished_us": 155} +{"t_unix": 1779813796.2835069, "step_id": 8612, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813796.2885358, "step_id": 8613, "start_load_kv_us": 3, "get_finished_us": 229} +{"t_unix": 1779813796.2932427, "step_id": 8614, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813796.2978795, "step_id": 8615, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813796.3026688, "step_id": 8616, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813796.3073792, "step_id": 8617, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.3121836, "step_id": 8618, "start_load_kv_us": 3, "get_finished_us": 173} +{"t_unix": 1779813796.317032, "step_id": 8619, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813796.3217282, "step_id": 8620, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813796.3263938, "step_id": 8621, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813796.3312101, "step_id": 8622, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813796.336042, "step_id": 8623, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813796.3407786, "step_id": 8624, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813796.345599, "step_id": 8625, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813796.3503196, "step_id": 8626, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813796.3550956, "step_id": 8627, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813796.359921, "step_id": 8628, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813796.364723, "step_id": 8629, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813796.3694239, "step_id": 8630, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813796.3742375, "step_id": 8631, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813796.3791096, "step_id": 8632, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813796.383852, "step_id": 8633, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813796.3886006, "step_id": 8634, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813796.3939729, "step_id": 8635, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813796.3982263, "step_id": 8636, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813796.4030306, "step_id": 8637, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813796.4077652, "step_id": 8638, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813796.4125037, "step_id": 8639, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813796.4172544, "step_id": 8640, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813796.422027, "step_id": 8641, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813796.4268603, "step_id": 8642, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813796.431584, "step_id": 8643, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813796.4363308, "step_id": 8644, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813796.4411528, "step_id": 8645, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813796.4459193, "step_id": 8646, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813796.4507294, "step_id": 8647, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813796.4556048, "step_id": 8648, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813796.4602947, "step_id": 8649, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813796.4646816, "step_id": 8650, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813796.4688156, "step_id": 8651, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813796.6160672, "step_id": 8652, "start_load_kv_us": 2, "get_finished_us": 339} +{"t_unix": 1779813796.6179214, "step_id": 8653, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813796.8146691, "step_id": 8654, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813796.8191574, "step_id": 8655, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813796.8237736, "step_id": 8656, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813796.8285055, "step_id": 8657, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813796.8331983, "step_id": 8658, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813796.837978, "step_id": 8659, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813796.8427453, "step_id": 8660, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813796.847464, "step_id": 8661, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813796.8522427, "step_id": 8662, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813796.8570254, "step_id": 8663, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813796.861907, "step_id": 8664, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813796.8665736, "step_id": 8665, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813796.8713403, "step_id": 8666, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813796.8762171, "step_id": 8667, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.8809316, "step_id": 8668, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.885629, "step_id": 8669, "start_load_kv_us": 15, "get_finished_us": 149} +{"t_unix": 1779813796.890383, "step_id": 8670, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813796.895114, "step_id": 8671, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.8999538, "step_id": 8672, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813796.90475, "step_id": 8673, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813796.9095752, "step_id": 8674, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813796.9142451, "step_id": 8675, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813796.9191089, "step_id": 8676, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813796.9237778, "step_id": 8677, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813796.9285235, "step_id": 8678, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813796.9332635, "step_id": 8679, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813796.938159, "step_id": 8680, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813796.9428582, "step_id": 8681, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813796.9476166, "step_id": 8682, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813796.952428, "step_id": 8683, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813796.957153, "step_id": 8684, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813796.9619896, "step_id": 8685, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813796.9667149, "step_id": 8686, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813796.971714, "step_id": 8687, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813796.9763908, "step_id": 8688, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813796.9810853, "step_id": 8689, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813796.9857757, "step_id": 8690, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813796.9904847, "step_id": 8691, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813796.9953148, "step_id": 8692, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813797.000037, "step_id": 8693, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813797.004785, "step_id": 8694, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813797.0096717, "step_id": 8695, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813797.014355, "step_id": 8696, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813797.0190845, "step_id": 8697, "start_load_kv_us": 1, "get_finished_us": 189} +{"t_unix": 1779813797.0238235, "step_id": 8698, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813797.028664, "step_id": 8699, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813797.0334682, "step_id": 8700, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813797.0381725, "step_id": 8701, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813797.0429366, "step_id": 8702, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813797.0476544, "step_id": 8703, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813797.0524535, "step_id": 8704, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813797.057264, "step_id": 8705, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813797.0619524, "step_id": 8706, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813797.066798, "step_id": 8707, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813797.0718277, "step_id": 8708, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813797.076446, "step_id": 8709, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813797.081113, "step_id": 8710, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813797.0859053, "step_id": 8711, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813797.090736, "step_id": 8712, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813797.095452, "step_id": 8713, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813797.1001563, "step_id": 8714, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813797.1050084, "step_id": 8715, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813797.1098523, "step_id": 8716, "start_load_kv_us": 17, "get_finished_us": 257} +{"t_unix": 1779813797.1145022, "step_id": 8717, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813797.1191962, "step_id": 8718, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813797.1240392, "step_id": 8719, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813797.1287785, "step_id": 8720, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813797.133529, "step_id": 8721, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813797.13827, "step_id": 8722, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813797.1430423, "step_id": 8723, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813797.1477833, "step_id": 8724, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813797.1525064, "step_id": 8725, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813797.1573145, "step_id": 8726, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813797.1620965, "step_id": 8727, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813797.166913, "step_id": 8728, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813797.171705, "step_id": 8729, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813797.1764596, "step_id": 8730, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813797.1813068, "step_id": 8731, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813797.1861396, "step_id": 8732, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813797.1908813, "step_id": 8733, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813797.1956148, "step_id": 8734, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813797.2004063, "step_id": 8735, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813797.2051156, "step_id": 8736, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813797.2099307, "step_id": 8737, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813797.2147179, "step_id": 8738, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813797.219433, "step_id": 8739, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813797.2242322, "step_id": 8740, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813797.2289996, "step_id": 8741, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813797.2338605, "step_id": 8742, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813797.2385921, "step_id": 8743, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813797.2433078, "step_id": 8744, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813797.2481008, "step_id": 8745, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813797.2528934, "step_id": 8746, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813797.257704, "step_id": 8747, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813797.3010304, "step_id": 8748, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813797.303014, "step_id": 8749, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813797.539752, "step_id": 8750, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813797.5418532, "step_id": 8751, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813797.740271, "step_id": 8752, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813797.746765, "step_id": 8753, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813797.753465, "step_id": 8754, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813797.7601223, "step_id": 8755, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813797.7666936, "step_id": 8756, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813797.773593, "step_id": 8757, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813797.780397, "step_id": 8758, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813797.787533, "step_id": 8759, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813797.7949944, "step_id": 8760, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813797.8019922, "step_id": 8761, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813797.8093896, "step_id": 8762, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813797.8167944, "step_id": 8763, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813797.8242414, "step_id": 8764, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813797.83166, "step_id": 8765, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813797.8392587, "step_id": 8766, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813797.8467164, "step_id": 8767, "start_load_kv_us": 12, "get_finished_us": 233} +{"t_unix": 1779813797.853757, "step_id": 8768, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813797.860334, "step_id": 8769, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813797.8668976, "step_id": 8770, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813797.87354, "step_id": 8771, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813797.880086, "step_id": 8772, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813797.8871148, "step_id": 8773, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813797.894186, "step_id": 8774, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813797.901851, "step_id": 8775, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813797.9092534, "step_id": 8776, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813797.9163303, "step_id": 8777, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813797.923529, "step_id": 8778, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813797.930205, "step_id": 8779, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813797.936849, "step_id": 8780, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813797.9435592, "step_id": 8781, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813797.9509852, "step_id": 8782, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813797.9582775, "step_id": 8783, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813797.9657996, "step_id": 8784, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813797.9730606, "step_id": 8785, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813797.9805646, "step_id": 8786, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813797.9879944, "step_id": 8787, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813797.9951077, "step_id": 8788, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813798.0023973, "step_id": 8789, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813798.0096996, "step_id": 8790, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813798.0168488, "step_id": 8791, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813798.0240176, "step_id": 8792, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813798.0311272, "step_id": 8793, "start_load_kv_us": 13, "get_finished_us": 141} +{"t_unix": 1779813798.0384307, "step_id": 8794, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813798.04599, "step_id": 8795, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813798.05298, "step_id": 8796, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813798.0598762, "step_id": 8797, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813798.0672364, "step_id": 8798, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813798.0741165, "step_id": 8799, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813798.081156, "step_id": 8800, "start_load_kv_us": 20, "get_finished_us": 153} +{"t_unix": 1779813798.0881636, "step_id": 8801, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813798.0953107, "step_id": 8802, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813798.1023269, "step_id": 8803, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813798.1092725, "step_id": 8804, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813798.1165583, "step_id": 8805, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813798.1236925, "step_id": 8806, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813798.1308033, "step_id": 8807, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813798.137822, "step_id": 8808, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813798.1448228, "step_id": 8809, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813798.1519191, "step_id": 8810, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813798.1593325, "step_id": 8811, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813798.1664064, "step_id": 8812, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813798.1732924, "step_id": 8813, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813798.180432, "step_id": 8814, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813798.1871476, "step_id": 8815, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813798.19421, "step_id": 8816, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813798.2017841, "step_id": 8817, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813798.2091982, "step_id": 8818, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813798.2167037, "step_id": 8819, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813798.2238362, "step_id": 8820, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813798.230586, "step_id": 8821, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813798.238238, "step_id": 8822, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813798.2454183, "step_id": 8823, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813798.2530153, "step_id": 8824, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813798.3002915, "step_id": 8825, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813798.3023117, "step_id": 8826, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813798.503358, "step_id": 8827, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813798.5106254, "step_id": 8828, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813798.5185425, "step_id": 8829, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813798.5267289, "step_id": 8830, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813798.5346694, "step_id": 8831, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813798.5425448, "step_id": 8832, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813798.5499947, "step_id": 8833, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813798.5574849, "step_id": 8834, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813798.5651608, "step_id": 8835, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813798.5728881, "step_id": 8836, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813798.580573, "step_id": 8837, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813798.588083, "step_id": 8838, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813798.5959327, "step_id": 8839, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813798.6038878, "step_id": 8840, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813798.6117327, "step_id": 8841, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813798.6193645, "step_id": 8842, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813798.6277015, "step_id": 8843, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813798.6354666, "step_id": 8844, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813798.64324, "step_id": 8845, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813798.6512623, "step_id": 8846, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813798.6588051, "step_id": 8847, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813798.6664507, "step_id": 8848, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813798.6743486, "step_id": 8849, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813798.6956482, "step_id": 8850, "start_load_kv_us": 2, "get_finished_us": 13542} +{"t_unix": 1779813798.6976542, "step_id": 8851, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813798.6994576, "step_id": 8852, "start_load_kv_us": 1, "get_finished_us": 180} +{"t_unix": 1779813798.7070951, "step_id": 8853, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813798.7149816, "step_id": 8854, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813798.7226002, "step_id": 8855, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813798.7303295, "step_id": 8856, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813798.7383466, "step_id": 8857, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813798.7461245, "step_id": 8858, "start_load_kv_us": 1, "get_finished_us": 243} +{"t_unix": 1779813798.7538316, "step_id": 8859, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813798.761507, "step_id": 8860, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813798.769175, "step_id": 8861, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813798.7769406, "step_id": 8862, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813798.7847397, "step_id": 8863, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813798.7922843, "step_id": 8864, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813798.8000448, "step_id": 8865, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813798.8073149, "step_id": 8866, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813798.814423, "step_id": 8867, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813798.8221118, "step_id": 8868, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813798.829877, "step_id": 8869, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813798.837631, "step_id": 8870, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813798.8453963, "step_id": 8871, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813798.8533485, "step_id": 8872, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813798.8610663, "step_id": 8873, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813798.8687222, "step_id": 8874, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813798.8763914, "step_id": 8875, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813798.8843753, "step_id": 8876, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813798.892213, "step_id": 8877, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813798.9003372, "step_id": 8878, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813798.9084568, "step_id": 8879, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813798.9165955, "step_id": 8880, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813798.9245975, "step_id": 8881, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813798.9326892, "step_id": 8882, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813798.9404483, "step_id": 8883, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813798.9487143, "step_id": 8884, "start_load_kv_us": 1, "get_finished_us": 283} +{"t_unix": 1779813798.956759, "step_id": 8885, "start_load_kv_us": 1, "get_finished_us": 237} +{"t_unix": 1779813798.9643168, "step_id": 8886, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813798.9721348, "step_id": 8887, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813798.980154, "step_id": 8888, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813798.9881248, "step_id": 8889, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813798.9956496, "step_id": 8890, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813799.0030847, "step_id": 8891, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813799.0104513, "step_id": 8892, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813799.01822, "step_id": 8893, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813799.0263827, "step_id": 8894, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813799.034171, "step_id": 8895, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813799.0421436, "step_id": 8896, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813799.0501835, "step_id": 8897, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813799.0580997, "step_id": 8898, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813799.0691907, "step_id": 8899, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813799.0742486, "step_id": 8900, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813799.0821145, "step_id": 8901, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813799.0900772, "step_id": 8902, "start_load_kv_us": 1, "get_finished_us": 244} +{"t_unix": 1779813799.0980775, "step_id": 8903, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813799.1061327, "step_id": 8904, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813799.1142495, "step_id": 8905, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813799.1222994, "step_id": 8906, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813799.1300836, "step_id": 8907, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813799.1383042, "step_id": 8908, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813799.1459801, "step_id": 8909, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813799.152849, "step_id": 8910, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813799.1593869, "step_id": 8911, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813799.1662862, "step_id": 8912, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813799.173219, "step_id": 8913, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813799.1804566, "step_id": 8914, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813799.187622, "step_id": 8915, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813799.1946447, "step_id": 8916, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813799.2022464, "step_id": 8917, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813799.2096727, "step_id": 8918, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813799.217252, "step_id": 8919, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813799.2247558, "step_id": 8920, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813799.2323565, "step_id": 8921, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813799.2400098, "step_id": 8922, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813799.2475588, "step_id": 8923, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813799.254864, "step_id": 8924, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813799.2622194, "step_id": 8925, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813799.2697253, "step_id": 8926, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813799.277156, "step_id": 8927, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813799.2843742, "step_id": 8928, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813799.2920358, "step_id": 8929, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813799.2994335, "step_id": 8930, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813799.3067663, "step_id": 8931, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813799.3139668, "step_id": 8932, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813799.3212285, "step_id": 8933, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813799.3286326, "step_id": 8934, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813799.3358316, "step_id": 8935, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813799.3427496, "step_id": 8936, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813799.3494122, "step_id": 8937, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813799.3563488, "step_id": 8938, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813799.3634493, "step_id": 8939, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813799.370665, "step_id": 8940, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813799.3781283, "step_id": 8941, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813799.3851435, "step_id": 8942, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813799.392179, "step_id": 8943, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813799.3990912, "step_id": 8944, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813799.406135, "step_id": 8945, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813799.4160025, "step_id": 8946, "start_load_kv_us": 6, "get_finished_us": 848} +{"t_unix": 1779813799.420701, "step_id": 8947, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813799.4273167, "step_id": 8948, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813799.433995, "step_id": 8949, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813799.440702, "step_id": 8950, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813799.4480689, "step_id": 8951, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813799.455777, "step_id": 8952, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813799.4632814, "step_id": 8953, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813799.4705229, "step_id": 8954, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813799.4778697, "step_id": 8955, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813799.4850981, "step_id": 8956, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813799.4925451, "step_id": 8957, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813799.5002174, "step_id": 8958, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813799.5075235, "step_id": 8959, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813799.5145934, "step_id": 8960, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813799.5602992, "step_id": 8961, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813799.7556174, "step_id": 8962, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813799.992452, "step_id": 8963, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813800.0022607, "step_id": 8964, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813800.2377908, "step_id": 8965, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813800.2458332, "step_id": 8966, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813800.2544968, "step_id": 8967, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813800.263377, "step_id": 8968, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813800.2719836, "step_id": 8969, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813800.2804313, "step_id": 8970, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813800.2891786, "step_id": 8971, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813800.2975683, "step_id": 8972, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813800.3060477, "step_id": 8973, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813800.314824, "step_id": 8974, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813800.3235438, "step_id": 8975, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813800.332633, "step_id": 8976, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813800.3415992, "step_id": 8977, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813800.3505998, "step_id": 8978, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813800.3594818, "step_id": 8979, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813800.368724, "step_id": 8980, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813800.3775864, "step_id": 8981, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813800.3864136, "step_id": 8982, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813800.3954606, "step_id": 8983, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813800.404423, "step_id": 8984, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813800.4134636, "step_id": 8985, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813800.4226205, "step_id": 8986, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813800.431819, "step_id": 8987, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813800.4410014, "step_id": 8988, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813800.4500048, "step_id": 8989, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813800.459395, "step_id": 8990, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813800.4685743, "step_id": 8991, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813800.4779615, "step_id": 8992, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813800.487247, "step_id": 8993, "start_load_kv_us": 1, "get_finished_us": 183} +{"t_unix": 1779813800.4966576, "step_id": 8994, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813800.5059943, "step_id": 8995, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813800.5155149, "step_id": 8996, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813800.524306, "step_id": 8997, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813800.5335124, "step_id": 8998, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813800.542863, "step_id": 8999, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813800.5521278, "step_id": 9000, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813800.5614166, "step_id": 9001, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813800.5706084, "step_id": 9002, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813800.5803668, "step_id": 9003, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813800.590151, "step_id": 9004, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813800.5991724, "step_id": 9005, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813800.6090302, "step_id": 9006, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813800.6185849, "step_id": 9007, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813800.6260154, "step_id": 9008, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813800.6339011, "step_id": 9009, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813800.6413908, "step_id": 9010, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813800.6492991, "step_id": 9011, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813800.6570284, "step_id": 9012, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813800.6648793, "step_id": 9013, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813800.6727078, "step_id": 9014, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813800.6805675, "step_id": 9015, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813800.6881623, "step_id": 9016, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813800.6967747, "step_id": 9017, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813800.741421, "step_id": 9018, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813800.7434819, "step_id": 9019, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813800.9479585, "step_id": 9020, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813800.9571369, "step_id": 9021, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813800.9667463, "step_id": 9022, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813800.9762588, "step_id": 9023, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813800.9858336, "step_id": 9024, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813800.9957883, "step_id": 9025, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813801.005509, "step_id": 9026, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813801.015011, "step_id": 9027, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813801.0243552, "step_id": 9028, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813801.0339963, "step_id": 9029, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813801.0433838, "step_id": 9030, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813801.0531971, "step_id": 9031, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813801.0627618, "step_id": 9032, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813801.0725944, "step_id": 9033, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813801.0819857, "step_id": 9034, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813801.0917504, "step_id": 9035, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813801.1014907, "step_id": 9036, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813801.1114638, "step_id": 9037, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813801.1214647, "step_id": 9038, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813801.1310186, "step_id": 9039, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813801.1405694, "step_id": 9040, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813801.1500978, "step_id": 9041, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813801.1602376, "step_id": 9042, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813801.170032, "step_id": 9043, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813801.1800418, "step_id": 9044, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813801.189804, "step_id": 9045, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813801.1994138, "step_id": 9046, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813801.2092733, "step_id": 9047, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813801.219192, "step_id": 9048, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813801.2287488, "step_id": 9049, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813801.2379107, "step_id": 9050, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813801.2474704, "step_id": 9051, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813801.2624059, "step_id": 9052, "start_load_kv_us": 3, "get_finished_us": 3146} +{"t_unix": 1779813801.2671697, "step_id": 9053, "start_load_kv_us": 3, "get_finished_us": 203} +{"t_unix": 1779813801.2765703, "step_id": 9054, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813801.2859058, "step_id": 9055, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813801.2955573, "step_id": 9056, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813801.3052886, "step_id": 9057, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813801.3148832, "step_id": 9058, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813801.3248858, "step_id": 9059, "start_load_kv_us": 1, "get_finished_us": 221} +{"t_unix": 1779813801.3344717, "step_id": 9060, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813801.344154, "step_id": 9061, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813801.3539124, "step_id": 9062, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813801.3634644, "step_id": 9063, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813801.373209, "step_id": 9064, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813801.3825305, "step_id": 9065, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813801.3921506, "step_id": 9066, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813801.4014583, "step_id": 9067, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813801.4108026, "step_id": 9068, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813801.4200344, "step_id": 9069, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813801.4296162, "step_id": 9070, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813801.4387276, "step_id": 9071, "start_load_kv_us": 11, "get_finished_us": 138} +{"t_unix": 1779813801.4480128, "step_id": 9072, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813801.4577763, "step_id": 9073, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813801.4676104, "step_id": 9074, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813801.4774287, "step_id": 9075, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813801.4872725, "step_id": 9076, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813801.4968023, "step_id": 9077, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813801.506208, "step_id": 9078, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813801.5158207, "step_id": 9079, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813801.5256085, "step_id": 9080, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813801.5354717, "step_id": 9081, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813801.5450318, "step_id": 9082, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813801.5527472, "step_id": 9083, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813801.5607936, "step_id": 9084, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813801.568372, "step_id": 9085, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813801.5762575, "step_id": 9086, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813801.5840223, "step_id": 9087, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813801.5921228, "step_id": 9088, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813801.5997977, "step_id": 9089, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813801.6073618, "step_id": 9090, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813801.615114, "step_id": 9091, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813801.623058, "step_id": 9092, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813801.6309, "step_id": 9093, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813801.6391537, "step_id": 9094, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813801.647685, "step_id": 9095, "start_load_kv_us": 3, "get_finished_us": 217} +{"t_unix": 1779813801.655324, "step_id": 9096, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813801.6631958, "step_id": 9097, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813801.6718597, "step_id": 9098, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813801.7165089, "step_id": 9099, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813801.7187493, "step_id": 9100, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813801.921807, "step_id": 9101, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813801.9312942, "step_id": 9102, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813801.9411194, "step_id": 9103, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813801.950898, "step_id": 9104, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813801.9606304, "step_id": 9105, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813801.9702168, "step_id": 9106, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813801.9799392, "step_id": 9107, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813801.9894738, "step_id": 9108, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813801.9990551, "step_id": 9109, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813802.0085373, "step_id": 9110, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813802.0182285, "step_id": 9111, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813802.0279644, "step_id": 9112, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813802.0377758, "step_id": 9113, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813802.0472806, "step_id": 9114, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813802.0571198, "step_id": 9115, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813802.0668843, "step_id": 9116, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813802.0763679, "step_id": 9117, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813802.0860195, "step_id": 9118, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813802.0954852, "step_id": 9119, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813802.1047359, "step_id": 9120, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813802.1146379, "step_id": 9121, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813802.124192, "step_id": 9122, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813802.1338356, "step_id": 9123, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813802.1432903, "step_id": 9124, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813802.1523714, "step_id": 9125, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813802.161701, "step_id": 9126, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813802.1711977, "step_id": 9127, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813802.1805553, "step_id": 9128, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813802.1897311, "step_id": 9129, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813802.1989882, "step_id": 9130, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813802.2080178, "step_id": 9131, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813802.2173502, "step_id": 9132, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813802.2664075, "step_id": 9133, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813802.2686033, "step_id": 9134, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813802.5043929, "step_id": 9135, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813802.5065968, "step_id": 9136, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813802.7499743, "step_id": 9137, "start_load_kv_us": 2, "get_finished_us": 332} +{"t_unix": 1779813802.752312, "step_id": 9138, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813803.1732287, "step_id": 9139, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813803.1834636, "step_id": 9140, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813803.193782, "step_id": 9141, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813803.204226, "step_id": 9142, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813803.2147746, "step_id": 9143, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813803.2259161, "step_id": 9144, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813803.2370987, "step_id": 9145, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813803.2482352, "step_id": 9146, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813803.2594824, "step_id": 9147, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813803.2707417, "step_id": 9148, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813803.2816565, "step_id": 9149, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813803.2926085, "step_id": 9150, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813803.3032565, "step_id": 9151, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813803.313989, "step_id": 9152, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813803.3248153, "step_id": 9153, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813803.3355627, "step_id": 9154, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813803.3458796, "step_id": 9155, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813803.356359, "step_id": 9156, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813803.3669262, "step_id": 9157, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813803.3779037, "step_id": 9158, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813803.3889773, "step_id": 9159, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813803.3999777, "step_id": 9160, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813803.411157, "step_id": 9161, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813803.4225178, "step_id": 9162, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813803.4335191, "step_id": 9163, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813803.4443603, "step_id": 9164, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813803.4554946, "step_id": 9165, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813803.4664574, "step_id": 9166, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813803.4766228, "step_id": 9167, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813803.4871736, "step_id": 9168, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813803.4976223, "step_id": 9169, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813803.5086899, "step_id": 9170, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813803.519268, "step_id": 9171, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813803.5302844, "step_id": 9172, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813803.5410645, "step_id": 9173, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813803.5523052, "step_id": 9174, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813803.563545, "step_id": 9175, "start_load_kv_us": 1, "get_finished_us": 247} +{"t_unix": 1779813803.5751772, "step_id": 9176, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813803.5866072, "step_id": 9177, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813803.5977652, "step_id": 9178, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813803.6092744, "step_id": 9179, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813803.6207244, "step_id": 9180, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813803.632333, "step_id": 9181, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813803.6440556, "step_id": 9182, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813803.6559145, "step_id": 9183, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813803.6711826, "step_id": 9184, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813803.6795607, "step_id": 9185, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813803.6912086, "step_id": 9186, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813803.7029219, "step_id": 9187, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813803.7147956, "step_id": 9188, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813803.7268841, "step_id": 9189, "start_load_kv_us": 1, "get_finished_us": 211} +{"t_unix": 1779813803.7388802, "step_id": 9190, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813803.750977, "step_id": 9191, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813803.7628465, "step_id": 9192, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813803.7743626, "step_id": 9193, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813803.786245, "step_id": 9194, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813803.7979655, "step_id": 9195, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813803.8099322, "step_id": 9196, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813803.8220258, "step_id": 9197, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813803.8345969, "step_id": 9198, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813803.8468745, "step_id": 9199, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813803.859014, "step_id": 9200, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813803.8709977, "step_id": 9201, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813803.8829114, "step_id": 9202, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813803.8949754, "step_id": 9203, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813803.907307, "step_id": 9204, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813803.9198787, "step_id": 9205, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813803.932229, "step_id": 9206, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813803.9445846, "step_id": 9207, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813803.9567719, "step_id": 9208, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813803.9685369, "step_id": 9209, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813803.9806228, "step_id": 9210, "start_load_kv_us": 1, "get_finished_us": 304} +{"t_unix": 1779813803.99225, "step_id": 9211, "start_load_kv_us": 3, "get_finished_us": 257} +{"t_unix": 1779813804.0042074, "step_id": 9212, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813804.0161424, "step_id": 9213, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813804.028044, "step_id": 9214, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813804.0400424, "step_id": 9215, "start_load_kv_us": 4, "get_finished_us": 355} +{"t_unix": 1779813804.0514777, "step_id": 9216, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813804.0638661, "step_id": 9217, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813804.076356, "step_id": 9218, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813804.0879586, "step_id": 9219, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813804.099558, "step_id": 9220, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813804.108727, "step_id": 9221, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813804.1180532, "step_id": 9222, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813804.1272492, "step_id": 9223, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813804.1368945, "step_id": 9224, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813804.146142, "step_id": 9225, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813804.1556735, "step_id": 9226, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813804.1651149, "step_id": 9227, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813804.1742198, "step_id": 9228, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813804.1832738, "step_id": 9229, "start_load_kv_us": 1, "get_finished_us": 210} +{"t_unix": 1779813804.1923208, "step_id": 9230, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813804.2012455, "step_id": 9231, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813804.2109566, "step_id": 9232, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813804.2208612, "step_id": 9233, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813804.230982, "step_id": 9234, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813804.2404797, "step_id": 9235, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813804.249907, "step_id": 9236, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813804.259774, "step_id": 9237, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813804.2698417, "step_id": 9238, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813804.279288, "step_id": 9239, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813804.2886465, "step_id": 9240, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813804.2977743, "step_id": 9241, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813804.306905, "step_id": 9242, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813804.316258, "step_id": 9243, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813804.3259373, "step_id": 9244, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813804.3351336, "step_id": 9245, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813804.3442762, "step_id": 9246, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813804.3533165, "step_id": 9247, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813804.3622453, "step_id": 9248, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813804.3714504, "step_id": 9249, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813804.3807328, "step_id": 9250, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813804.389882, "step_id": 9251, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813804.3995342, "step_id": 9252, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813804.408984, "step_id": 9253, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813804.4182332, "step_id": 9254, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813804.4276865, "step_id": 9255, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813804.4367177, "step_id": 9256, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813804.4460266, "step_id": 9257, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813804.45521, "step_id": 9258, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813804.4650238, "step_id": 9259, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813804.4741495, "step_id": 9260, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813804.483754, "step_id": 9261, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813804.4927113, "step_id": 9262, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813804.5016935, "step_id": 9263, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813804.510897, "step_id": 9264, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813804.5199828, "step_id": 9265, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813804.5286212, "step_id": 9266, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813804.5375724, "step_id": 9267, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813804.5463517, "step_id": 9268, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813804.5554483, "step_id": 9269, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813804.5644026, "step_id": 9270, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813804.5731049, "step_id": 9271, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813804.5821896, "step_id": 9272, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813804.5907228, "step_id": 9273, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813804.5998077, "step_id": 9274, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813804.6086562, "step_id": 9275, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813804.6182148, "step_id": 9276, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813804.627411, "step_id": 9277, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813804.636726, "step_id": 9278, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813804.6461015, "step_id": 9279, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813804.6554792, "step_id": 9280, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813804.6646788, "step_id": 9281, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813804.6745155, "step_id": 9282, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813804.6840777, "step_id": 9283, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813804.6933322, "step_id": 9284, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813804.7027307, "step_id": 9285, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813804.7123256, "step_id": 9286, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813804.7216618, "step_id": 9287, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813804.7311926, "step_id": 9288, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813804.740358, "step_id": 9289, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813804.7496676, "step_id": 9290, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813804.7590947, "step_id": 9291, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813804.7684996, "step_id": 9292, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813804.7779207, "step_id": 9293, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813804.7872248, "step_id": 9294, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813804.7966557, "step_id": 9295, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813804.8062062, "step_id": 9296, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813804.8156812, "step_id": 9297, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813804.8252165, "step_id": 9298, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813804.8345757, "step_id": 9299, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813804.844513, "step_id": 9300, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813804.854083, "step_id": 9301, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813804.8638973, "step_id": 9302, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813804.8735886, "step_id": 9303, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813804.8831341, "step_id": 9304, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813804.8921902, "step_id": 9305, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813804.9016652, "step_id": 9306, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813804.91127, "step_id": 9307, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813804.9209206, "step_id": 9308, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813804.9304166, "step_id": 9309, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813804.9398582, "step_id": 9310, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813804.9495208, "step_id": 9311, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813804.959409, "step_id": 9312, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813804.969255, "step_id": 9313, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813804.9790497, "step_id": 9314, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813804.9884143, "step_id": 9315, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813804.9978445, "step_id": 9316, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813805.006868, "step_id": 9317, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813805.016244, "step_id": 9318, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813805.0260081, "step_id": 9319, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813805.0356696, "step_id": 9320, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813805.0452647, "step_id": 9321, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813805.0550554, "step_id": 9322, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813805.0648236, "step_id": 9323, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813805.0743368, "step_id": 9324, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813805.0839643, "step_id": 9325, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813805.0934072, "step_id": 9326, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813805.1029341, "step_id": 9327, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813805.1127932, "step_id": 9328, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813805.1224673, "step_id": 9329, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813805.1323938, "step_id": 9330, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813805.1421266, "step_id": 9331, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813805.1511705, "step_id": 9332, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813805.1604493, "step_id": 9333, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813805.1699264, "step_id": 9334, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813805.1797636, "step_id": 9335, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813805.189345, "step_id": 9336, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813805.1994069, "step_id": 9337, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813805.2095904, "step_id": 9338, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813805.219724, "step_id": 9339, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813805.2301404, "step_id": 9340, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813805.240011, "step_id": 9341, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813805.2497404, "step_id": 9342, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813805.2598088, "step_id": 9343, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813805.2698336, "step_id": 9344, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813805.2797253, "step_id": 9345, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813805.2892745, "step_id": 9346, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813805.299118, "step_id": 9347, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813805.309088, "step_id": 9348, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813805.3193054, "step_id": 9349, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813805.3686793, "step_id": 9350, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813805.3708541, "step_id": 9351, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813805.6132216, "step_id": 9352, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813805.6156638, "step_id": 9353, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813805.8605814, "step_id": 9354, "start_load_kv_us": 3, "get_finished_us": 347} +{"t_unix": 1779813805.8633146, "step_id": 9355, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813806.0720658, "step_id": 9356, "start_load_kv_us": 2, "get_finished_us": 348} +{"t_unix": 1779813806.0833113, "step_id": 9357, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813806.0948162, "step_id": 9358, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813806.1063266, "step_id": 9359, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813806.117883, "step_id": 9360, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813806.129654, "step_id": 9361, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813806.1412296, "step_id": 9362, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813806.1524146, "step_id": 9363, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813806.164088, "step_id": 9364, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813806.1756017, "step_id": 9365, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813806.1873193, "step_id": 9366, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813806.199317, "step_id": 9367, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813806.211356, "step_id": 9368, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813806.2234583, "step_id": 9369, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813806.2352793, "step_id": 9370, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813806.2470791, "step_id": 9371, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813806.2588494, "step_id": 9372, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813806.2707381, "step_id": 9373, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813806.2825198, "step_id": 9374, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813806.294565, "step_id": 9375, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813806.306133, "step_id": 9376, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813806.3178813, "step_id": 9377, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813806.329941, "step_id": 9378, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813806.3414538, "step_id": 9379, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813806.3530383, "step_id": 9380, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813806.3647656, "step_id": 9381, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813806.3760903, "step_id": 9382, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813806.3877132, "step_id": 9383, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813806.3990421, "step_id": 9384, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813806.4104702, "step_id": 9385, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813806.4220836, "step_id": 9386, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813806.4334254, "step_id": 9387, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813806.4449136, "step_id": 9388, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813806.456854, "step_id": 9389, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813806.4682987, "step_id": 9390, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813806.4777157, "step_id": 9391, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813806.486882, "step_id": 9392, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813806.496662, "step_id": 9393, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813806.5065725, "step_id": 9394, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813806.513835, "step_id": 9395, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813806.5212862, "step_id": 9396, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813806.5289836, "step_id": 9397, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813806.5363424, "step_id": 9398, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813806.543829, "step_id": 9399, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813806.5508947, "step_id": 9400, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813806.558583, "step_id": 9401, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813806.566182, "step_id": 9402, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813806.573266, "step_id": 9403, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813806.5807467, "step_id": 9404, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813806.6259873, "step_id": 9405, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813806.628143, "step_id": 9406, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813806.83068, "step_id": 9407, "start_load_kv_us": 3, "get_finished_us": 407} +{"t_unix": 1779813806.837638, "step_id": 9408, "start_load_kv_us": 3, "get_finished_us": 314} +{"t_unix": 1779813806.8448343, "step_id": 9409, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813806.852297, "step_id": 9410, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813806.8600898, "step_id": 9411, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813806.8673215, "step_id": 9412, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813806.874349, "step_id": 9413, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813806.8820095, "step_id": 9414, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813806.8891516, "step_id": 9415, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813806.8966813, "step_id": 9416, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813806.9043655, "step_id": 9417, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813806.912295, "step_id": 9418, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813806.9202063, "step_id": 9419, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813806.9280522, "step_id": 9420, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813806.9357612, "step_id": 9421, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813806.9433808, "step_id": 9422, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813806.951245, "step_id": 9423, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813806.9589663, "step_id": 9424, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813806.966705, "step_id": 9425, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813806.9741771, "step_id": 9426, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813806.9817858, "step_id": 9427, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813806.9896133, "step_id": 9428, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813806.9973001, "step_id": 9429, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813807.005252, "step_id": 9430, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813807.013184, "step_id": 9431, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813807.0210605, "step_id": 9432, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813807.0287032, "step_id": 9433, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813807.0363123, "step_id": 9434, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813807.044135, "step_id": 9435, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813807.051917, "step_id": 9436, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813807.059618, "step_id": 9437, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813807.0673337, "step_id": 9438, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813807.0752144, "step_id": 9439, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813807.0830033, "step_id": 9440, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813807.0909727, "step_id": 9441, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813807.098691, "step_id": 9442, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813807.1065652, "step_id": 9443, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813807.1141877, "step_id": 9444, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813807.1219738, "step_id": 9445, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813807.1298294, "step_id": 9446, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813807.1376612, "step_id": 9447, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813807.1451693, "step_id": 9448, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813807.1526701, "step_id": 9449, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813807.1601121, "step_id": 9450, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813807.1680472, "step_id": 9451, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813807.1759996, "step_id": 9452, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813807.183824, "step_id": 9453, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813807.1917908, "step_id": 9454, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813807.19985, "step_id": 9455, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813807.2075934, "step_id": 9456, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813807.21531, "step_id": 9457, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813807.2231047, "step_id": 9458, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813807.2304037, "step_id": 9459, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813807.2373376, "step_id": 9460, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813807.2447846, "step_id": 9461, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813807.2522817, "step_id": 9462, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813807.2601848, "step_id": 9463, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813807.2676196, "step_id": 9464, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813807.2751844, "step_id": 9465, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813807.2828429, "step_id": 9466, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813807.2908664, "step_id": 9467, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813807.299027, "step_id": 9468, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813807.3069851, "step_id": 9469, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813807.354353, "step_id": 9470, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813807.3565116, "step_id": 9471, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813807.552894, "step_id": 9472, "start_load_kv_us": 3, "get_finished_us": 384} +{"t_unix": 1779813807.561765, "step_id": 9473, "start_load_kv_us": 3, "get_finished_us": 248} +{"t_unix": 1779813807.5713348, "step_id": 9474, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813807.580984, "step_id": 9475, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813807.5908575, "step_id": 9476, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813807.6004605, "step_id": 9477, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813807.6102066, "step_id": 9478, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813807.6198103, "step_id": 9479, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813807.6298394, "step_id": 9480, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813807.6394763, "step_id": 9481, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813807.64918, "step_id": 9482, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813807.6596978, "step_id": 9483, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813807.669753, "step_id": 9484, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813807.6794775, "step_id": 9485, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813807.689652, "step_id": 9486, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813807.6993692, "step_id": 9487, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813807.708859, "step_id": 9488, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813807.7184067, "step_id": 9489, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813807.7276025, "step_id": 9490, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813807.737047, "step_id": 9491, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813807.746327, "step_id": 9492, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813807.7559178, "step_id": 9493, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813807.7653122, "step_id": 9494, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813807.7748907, "step_id": 9495, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813807.7843425, "step_id": 9496, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813807.7938101, "step_id": 9497, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813807.803155, "step_id": 9498, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813807.8127677, "step_id": 9499, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813807.8222883, "step_id": 9500, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813807.8321176, "step_id": 9501, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813807.8416696, "step_id": 9502, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813807.8512628, "step_id": 9503, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813807.8609195, "step_id": 9504, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813807.9086874, "step_id": 9505, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813807.9111106, "step_id": 9506, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813808.1146636, "step_id": 9507, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813808.123336, "step_id": 9508, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813808.1323285, "step_id": 9509, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813808.1406646, "step_id": 9510, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813808.1492984, "step_id": 9511, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813808.1582272, "step_id": 9512, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813808.1669927, "step_id": 9513, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813808.1758695, "step_id": 9514, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813808.184637, "step_id": 9515, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813808.1938086, "step_id": 9516, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813808.2027006, "step_id": 9517, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813808.2119057, "step_id": 9518, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813808.220916, "step_id": 9519, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813808.2300847, "step_id": 9520, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813808.239169, "step_id": 9521, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813808.2482297, "step_id": 9522, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813808.2575774, "step_id": 9523, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813808.2667341, "step_id": 9524, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813808.275904, "step_id": 9525, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813808.2849317, "step_id": 9526, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813808.29402, "step_id": 9527, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813808.3032293, "step_id": 9528, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813808.3122597, "step_id": 9529, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813808.3212614, "step_id": 9530, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813808.3302357, "step_id": 9531, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813808.339144, "step_id": 9532, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813808.3480256, "step_id": 9533, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813808.3571508, "step_id": 9534, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813808.3661995, "step_id": 9535, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813808.3752375, "step_id": 9536, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813808.3840952, "step_id": 9537, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813808.3931901, "step_id": 9538, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813808.4026275, "step_id": 9539, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813808.412081, "step_id": 9540, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813808.4211204, "step_id": 9541, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813808.4303176, "step_id": 9542, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813808.43943, "step_id": 9543, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813808.448638, "step_id": 9544, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813808.4580412, "step_id": 9545, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813808.4674044, "step_id": 9546, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813808.4769068, "step_id": 9547, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813808.4861314, "step_id": 9548, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813808.4952376, "step_id": 9549, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813808.5043588, "step_id": 9550, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813808.5132434, "step_id": 9551, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813808.5225573, "step_id": 9552, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813808.5314636, "step_id": 9553, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813808.540629, "step_id": 9554, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813808.5498483, "step_id": 9555, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813808.5592155, "step_id": 9556, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813808.6076722, "step_id": 9557, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813808.6099136, "step_id": 9558, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813808.8146057, "step_id": 9559, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813808.8254733, "step_id": 9560, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813808.836823, "step_id": 9561, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813808.8480349, "step_id": 9562, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813808.859037, "step_id": 9563, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813808.8705432, "step_id": 9564, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813808.881996, "step_id": 9565, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813808.8934536, "step_id": 9566, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813808.905042, "step_id": 9567, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813808.9158669, "step_id": 9568, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813808.9273462, "step_id": 9569, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813808.9383807, "step_id": 9570, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813808.950258, "step_id": 9571, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813808.962402, "step_id": 9572, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813808.9741833, "step_id": 9573, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813808.9855063, "step_id": 9574, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813808.9972155, "step_id": 9575, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813809.0091004, "step_id": 9576, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813809.0206788, "step_id": 9577, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813809.0326288, "step_id": 9578, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813809.0445566, "step_id": 9579, "start_load_kv_us": 2, "get_finished_us": 578} +{"t_unix": 1779813809.0562756, "step_id": 9580, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813809.0677722, "step_id": 9581, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813809.0792396, "step_id": 9582, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813809.0908694, "step_id": 9583, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813809.102613, "step_id": 9584, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813809.114247, "step_id": 9585, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813809.1255827, "step_id": 9586, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813809.1372015, "step_id": 9587, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813809.1487546, "step_id": 9588, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813809.1608713, "step_id": 9589, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813809.1728985, "step_id": 9590, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813809.1853416, "step_id": 9591, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813809.1973963, "step_id": 9592, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813809.2092762, "step_id": 9593, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813809.2247195, "step_id": 9594, "start_load_kv_us": 2, "get_finished_us": 319} +{"t_unix": 1779813809.233218, "step_id": 9595, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813809.2443225, "step_id": 9596, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813809.2560005, "step_id": 9597, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813809.2678828, "step_id": 9598, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813809.2793756, "step_id": 9599, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813809.2914948, "step_id": 9600, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813809.303301, "step_id": 9601, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813809.3149645, "step_id": 9602, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813809.327154, "step_id": 9603, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813809.339205, "step_id": 9604, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813809.3515334, "step_id": 9605, "start_load_kv_us": 3, "get_finished_us": 267} +{"t_unix": 1779813809.3637853, "step_id": 9606, "start_load_kv_us": 3, "get_finished_us": 269} +{"t_unix": 1779813809.3755996, "step_id": 9607, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813809.385908, "step_id": 9608, "start_load_kv_us": 3, "get_finished_us": 244} +{"t_unix": 1779813809.3950658, "step_id": 9609, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813809.4095757, "step_id": 9610, "start_load_kv_us": 3, "get_finished_us": 308} +{"t_unix": 1779813809.4142387, "step_id": 9611, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813809.4214647, "step_id": 9612, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813809.4292033, "step_id": 9613, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813809.4367511, "step_id": 9614, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813809.4443855, "step_id": 9615, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813809.45168, "step_id": 9616, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813809.4592576, "step_id": 9617, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813809.4671752, "step_id": 9618, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813809.475039, "step_id": 9619, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813809.4829142, "step_id": 9620, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813809.490565, "step_id": 9621, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813809.498482, "step_id": 9622, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813809.5063403, "step_id": 9623, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813809.5142817, "step_id": 9624, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813809.522023, "step_id": 9625, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813809.5301235, "step_id": 9626, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813809.5377567, "step_id": 9627, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813809.5456593, "step_id": 9628, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813809.5538688, "step_id": 9629, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813809.561725, "step_id": 9630, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813809.5697932, "step_id": 9631, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813809.5775824, "step_id": 9632, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813809.5854154, "step_id": 9633, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813809.5935, "step_id": 9634, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813809.6015623, "step_id": 9635, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813809.6095874, "step_id": 9636, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813809.6176493, "step_id": 9637, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813809.625986, "step_id": 9638, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813809.6340506, "step_id": 9639, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813809.643398, "step_id": 9640, "start_load_kv_us": 2, "get_finished_us": 346} +{"t_unix": 1779813809.650228, "step_id": 9641, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813809.6582613, "step_id": 9642, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813809.6662188, "step_id": 9643, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813809.6742363, "step_id": 9644, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813809.6823783, "step_id": 9645, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813809.6904325, "step_id": 9646, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813809.6986392, "step_id": 9647, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813809.7066383, "step_id": 9648, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813809.714807, "step_id": 9649, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813809.7229178, "step_id": 9650, "start_load_kv_us": 1, "get_finished_us": 259} +{"t_unix": 1779813809.731022, "step_id": 9651, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813809.7391372, "step_id": 9652, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813809.7470725, "step_id": 9653, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813809.7551286, "step_id": 9654, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813809.7632723, "step_id": 9655, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813809.7713864, "step_id": 9656, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813809.7792058, "step_id": 9657, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813809.7872593, "step_id": 9658, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813809.7953448, "step_id": 9659, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813809.8033273, "step_id": 9660, "start_load_kv_us": 1, "get_finished_us": 195} +{"t_unix": 1779813809.811763, "step_id": 9661, "start_load_kv_us": 2, "get_finished_us": 330} +{"t_unix": 1779813809.8196664, "step_id": 9662, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813809.8273113, "step_id": 9663, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813809.8348932, "step_id": 9664, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813809.8422112, "step_id": 9665, "start_load_kv_us": 3, "get_finished_us": 199} +{"t_unix": 1779813809.8496459, "step_id": 9666, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813809.8569853, "step_id": 9667, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813809.8644874, "step_id": 9668, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813809.872126, "step_id": 9669, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813809.8796933, "step_id": 9670, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813809.88711, "step_id": 9671, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813809.8947477, "step_id": 9672, "start_load_kv_us": 13, "get_finished_us": 154} +{"t_unix": 1779813809.9453201, "step_id": 9673, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813809.947681, "step_id": 9674, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813810.144129, "step_id": 9675, "start_load_kv_us": 2, "get_finished_us": 362} +{"t_unix": 1779813810.1511858, "step_id": 9676, "start_load_kv_us": 3, "get_finished_us": 176} +{"t_unix": 1779813810.1588945, "step_id": 9677, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813810.1671593, "step_id": 9678, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813810.1748226, "step_id": 9679, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813810.182533, "step_id": 9680, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813810.190266, "step_id": 9681, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813810.1982534, "step_id": 9682, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813810.2074308, "step_id": 9683, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813810.214677, "step_id": 9684, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813810.2226152, "step_id": 9685, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813810.2305, "step_id": 9686, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813810.238461, "step_id": 9687, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813810.246571, "step_id": 9688, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813810.2545395, "step_id": 9689, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813810.2626688, "step_id": 9690, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813810.270615, "step_id": 9691, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813810.2788227, "step_id": 9692, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813810.2868967, "step_id": 9693, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813810.2950337, "step_id": 9694, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813810.303066, "step_id": 9695, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813810.311605, "step_id": 9696, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813810.3191853, "step_id": 9697, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813810.3266547, "step_id": 9698, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813810.3346653, "step_id": 9699, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813810.3425992, "step_id": 9700, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813810.3502853, "step_id": 9701, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813810.3582036, "step_id": 9702, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813810.36606, "step_id": 9703, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813810.3737934, "step_id": 9704, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813810.3812807, "step_id": 9705, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813810.3888772, "step_id": 9706, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813810.396279, "step_id": 9707, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813810.4038363, "step_id": 9708, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813810.4112518, "step_id": 9709, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813810.419079, "step_id": 9710, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813810.4266462, "step_id": 9711, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813810.4335096, "step_id": 9712, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813810.4410617, "step_id": 9713, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813810.4484537, "step_id": 9714, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813810.456019, "step_id": 9715, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813810.4635856, "step_id": 9716, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813810.4710863, "step_id": 9717, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813810.4785373, "step_id": 9718, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813810.4857094, "step_id": 9719, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813810.493415, "step_id": 9720, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813810.5008485, "step_id": 9721, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813810.5083535, "step_id": 9722, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813810.5156188, "step_id": 9723, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813810.5232048, "step_id": 9724, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813810.5306122, "step_id": 9725, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813810.538652, "step_id": 9726, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813810.5461564, "step_id": 9727, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813810.553052, "step_id": 9728, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813810.5601957, "step_id": 9729, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813810.5675333, "step_id": 9730, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813810.5750077, "step_id": 9731, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813810.5824642, "step_id": 9732, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813810.5894141, "step_id": 9733, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813810.5964494, "step_id": 9734, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813810.6036625, "step_id": 9735, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813810.6107821, "step_id": 9736, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813810.618034, "step_id": 9737, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813810.6251462, "step_id": 9738, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813810.632762, "step_id": 9739, "start_load_kv_us": 3, "get_finished_us": 214} +{"t_unix": 1779813810.6395302, "step_id": 9740, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813810.646836, "step_id": 9741, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813810.6541944, "step_id": 9742, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813810.6613333, "step_id": 9743, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813810.6682, "step_id": 9744, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813810.6751552, "step_id": 9745, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813810.6822891, "step_id": 9746, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813810.689023, "step_id": 9747, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813810.696241, "step_id": 9748, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813810.7034929, "step_id": 9749, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813810.7108045, "step_id": 9750, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813810.7182772, "step_id": 9751, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813810.7257733, "step_id": 9752, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813810.7333665, "step_id": 9753, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813810.7404952, "step_id": 9754, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813810.7475, "step_id": 9755, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813810.7545831, "step_id": 9756, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813810.761558, "step_id": 9757, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813810.7683156, "step_id": 9758, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813810.7757323, "step_id": 9759, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813810.7830818, "step_id": 9760, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813810.7906637, "step_id": 9761, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813810.7980063, "step_id": 9762, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813810.803842, "step_id": 9763, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813810.8099918, "step_id": 9764, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813810.8160906, "step_id": 9765, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813810.822083, "step_id": 9766, "start_load_kv_us": 4, "get_finished_us": 165} +{"t_unix": 1779813810.8280623, "step_id": 9767, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813810.8339882, "step_id": 9768, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813810.8398604, "step_id": 9769, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813810.8457055, "step_id": 9770, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813810.8514762, "step_id": 9771, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813810.857237, "step_id": 9772, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813810.8631074, "step_id": 9773, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813810.869116, "step_id": 9774, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813810.8750348, "step_id": 9775, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813810.8810182, "step_id": 9776, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813810.8870893, "step_id": 9777, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813810.8931112, "step_id": 9778, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813810.8991008, "step_id": 9779, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813810.9052403, "step_id": 9780, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813810.9112082, "step_id": 9781, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813810.9171002, "step_id": 9782, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813810.9228923, "step_id": 9783, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813810.9287271, "step_id": 9784, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813810.9348133, "step_id": 9785, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813810.940739, "step_id": 9786, "start_load_kv_us": 1, "get_finished_us": 217} +{"t_unix": 1779813810.9467082, "step_id": 9787, "start_load_kv_us": 1, "get_finished_us": 208} +{"t_unix": 1779813810.9527164, "step_id": 9788, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813810.9585032, "step_id": 9789, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813810.964526, "step_id": 9790, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813810.970709, "step_id": 9791, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813810.9765885, "step_id": 9792, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813810.9824884, "step_id": 9793, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813810.9882376, "step_id": 9794, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813810.9941123, "step_id": 9795, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813810.9999957, "step_id": 9796, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813811.005982, "step_id": 9797, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813811.0119278, "step_id": 9798, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813811.0178246, "step_id": 9799, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.023402, "step_id": 9800, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813811.029275, "step_id": 9801, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813811.0350718, "step_id": 9802, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813811.0408216, "step_id": 9803, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813811.0465956, "step_id": 9804, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813811.0524788, "step_id": 9805, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813811.0582206, "step_id": 9806, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813811.064233, "step_id": 9807, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813811.070128, "step_id": 9808, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813811.0758169, "step_id": 9809, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813811.0817256, "step_id": 9810, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813811.0876794, "step_id": 9811, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813811.0933924, "step_id": 9812, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813811.0992007, "step_id": 9813, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813811.1050808, "step_id": 9814, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813811.1096034, "step_id": 9815, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813811.1143506, "step_id": 9816, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813811.1191142, "step_id": 9817, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813811.1239252, "step_id": 9818, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813811.1287043, "step_id": 9819, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813811.133481, "step_id": 9820, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813811.1382551, "step_id": 9821, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813811.1430497, "step_id": 9822, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813811.1478071, "step_id": 9823, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813811.1525238, "step_id": 9824, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813811.157366, "step_id": 9825, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.1621437, "step_id": 9826, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813811.166922, "step_id": 9827, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813811.171729, "step_id": 9828, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.1764643, "step_id": 9829, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813811.1812437, "step_id": 9830, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.185981, "step_id": 9831, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813811.190871, "step_id": 9832, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813811.1955965, "step_id": 9833, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813811.2003038, "step_id": 9834, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813811.2051132, "step_id": 9835, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813811.2099266, "step_id": 9836, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813811.2146556, "step_id": 9837, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813811.2194037, "step_id": 9838, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813811.224199, "step_id": 9839, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813811.2290332, "step_id": 9840, "start_load_kv_us": 3, "get_finished_us": 148} +{"t_unix": 1779813811.2337854, "step_id": 9841, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813811.2385156, "step_id": 9842, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813811.2432692, "step_id": 9843, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813811.2480838, "step_id": 9844, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813811.252859, "step_id": 9845, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813811.2576287, "step_id": 9846, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813811.2623937, "step_id": 9847, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813811.2672448, "step_id": 9848, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813811.272053, "step_id": 9849, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813811.2768095, "step_id": 9850, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813811.2815301, "step_id": 9851, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813811.2863402, "step_id": 9852, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813811.291118, "step_id": 9853, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813811.2958846, "step_id": 9854, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813811.3007095, "step_id": 9855, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813811.3054957, "step_id": 9856, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813811.3102894, "step_id": 9857, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813811.3150656, "step_id": 9858, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813811.3198373, "step_id": 9859, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813811.3246818, "step_id": 9860, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813811.3294256, "step_id": 9861, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.3341591, "step_id": 9862, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813811.339001, "step_id": 9863, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813811.343748, "step_id": 9864, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813811.348503, "step_id": 9865, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813811.3532577, "step_id": 9866, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813811.3580496, "step_id": 9867, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813811.3628476, "step_id": 9868, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813811.3675845, "step_id": 9869, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813811.3723342, "step_id": 9870, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813811.3771346, "step_id": 9871, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813811.3819394, "step_id": 9872, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813811.386734, "step_id": 9873, "start_load_kv_us": 2, "get_finished_us": 128} +{"t_unix": 1779813811.391482, "step_id": 9874, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813811.3962739, "step_id": 9875, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813811.4010808, "step_id": 9876, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813811.4058204, "step_id": 9877, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813811.4105742, "step_id": 9878, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813811.4153473, "step_id": 9879, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.420137, "step_id": 9880, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813811.4249222, "step_id": 9881, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813811.4297192, "step_id": 9882, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813811.4344814, "step_id": 9883, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813811.4392924, "step_id": 9884, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813811.4443603, "step_id": 9885, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813811.448877, "step_id": 9886, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813811.4536467, "step_id": 9887, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813811.4583857, "step_id": 9888, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813811.4631515, "step_id": 9889, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813811.4679706, "step_id": 9890, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813811.4727647, "step_id": 9891, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813811.4776027, "step_id": 9892, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813811.4823704, "step_id": 9893, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813811.487063, "step_id": 9894, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813811.4918556, "step_id": 9895, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813811.4966362, "step_id": 9896, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813811.501392, "step_id": 9897, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813811.5061436, "step_id": 9898, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813811.5109577, "step_id": 9899, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813811.5157225, "step_id": 9900, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813811.5204682, "step_id": 9901, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813811.5252566, "step_id": 9902, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813811.5301254, "step_id": 9903, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813811.573829, "step_id": 9904, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813811.575867, "step_id": 9905, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813811.8123686, "step_id": 9906, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813811.814563, "step_id": 9907, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813812.2261336, "step_id": 9908, "start_load_kv_us": 4, "get_finished_us": 328} +{"t_unix": 1779813812.2326849, "step_id": 9909, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813812.2400382, "step_id": 9910, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813812.2473986, "step_id": 9911, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813812.2546365, "step_id": 9912, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813812.2619083, "step_id": 9913, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813812.268607, "step_id": 9914, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813812.275335, "step_id": 9915, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813812.2824142, "step_id": 9916, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813812.2893667, "step_id": 9917, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813812.2966704, "step_id": 9918, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813812.3037994, "step_id": 9919, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813812.3113296, "step_id": 9920, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813812.3186698, "step_id": 9921, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813812.3257344, "step_id": 9922, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813812.3332736, "step_id": 9923, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813812.3409371, "step_id": 9924, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813812.34813, "step_id": 9925, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813812.3550143, "step_id": 9926, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813812.362593, "step_id": 9927, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813812.3701797, "step_id": 9928, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813812.3778698, "step_id": 9929, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813812.3849227, "step_id": 9930, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813812.3916047, "step_id": 9931, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813812.3987467, "step_id": 9932, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813812.4053884, "step_id": 9933, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813812.4120007, "step_id": 9934, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813812.4190762, "step_id": 9935, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813812.4265358, "step_id": 9936, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813812.4336126, "step_id": 9937, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813812.4405897, "step_id": 9938, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813812.4477925, "step_id": 9939, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813812.4548092, "step_id": 9940, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813812.4621146, "step_id": 9941, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813812.4692488, "step_id": 9942, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813812.476131, "step_id": 9943, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813812.4834836, "step_id": 9944, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813812.490393, "step_id": 9945, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813812.4975736, "step_id": 9946, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813812.505005, "step_id": 9947, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813812.5124757, "step_id": 9948, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813812.5198076, "step_id": 9949, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813812.5269673, "step_id": 9950, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813812.534307, "step_id": 9951, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813812.5412617, "step_id": 9952, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813812.5483952, "step_id": 9953, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813812.5558565, "step_id": 9954, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813812.5627966, "step_id": 9955, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813812.5703597, "step_id": 9956, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813812.577468, "step_id": 9957, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813812.5843952, "step_id": 9958, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813812.5916255, "step_id": 9959, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813812.5986688, "step_id": 9960, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813812.605288, "step_id": 9961, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813812.611801, "step_id": 9962, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813812.6184647, "step_id": 9963, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813812.625491, "step_id": 9964, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813812.6323833, "step_id": 9965, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813812.639487, "step_id": 9966, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813812.6464217, "step_id": 9967, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813812.6534195, "step_id": 9968, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813812.6607432, "step_id": 9969, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813812.6681106, "step_id": 9970, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813812.6748164, "step_id": 9971, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813812.6821592, "step_id": 9972, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813812.6896749, "step_id": 9973, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813812.6969686, "step_id": 9974, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813812.7044473, "step_id": 9975, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813812.711967, "step_id": 9976, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813812.719469, "step_id": 9977, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813812.7267177, "step_id": 9978, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813812.7339396, "step_id": 9979, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813812.7411478, "step_id": 9980, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813812.7491577, "step_id": 9981, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813812.7556841, "step_id": 9982, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813812.7632194, "step_id": 9983, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813812.7704957, "step_id": 9984, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813812.7777052, "step_id": 9985, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813812.78469, "step_id": 9986, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813812.7917802, "step_id": 9987, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813812.7990468, "step_id": 9988, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813812.8062525, "step_id": 9989, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813812.8135836, "step_id": 9990, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813812.8211646, "step_id": 9991, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813812.8284967, "step_id": 9992, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813812.8361356, "step_id": 9993, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813812.8436923, "step_id": 9994, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813812.8509524, "step_id": 9995, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813812.8581824, "step_id": 9996, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813812.8650382, "step_id": 9997, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813812.8724308, "step_id": 9998, "start_load_kv_us": 5, "get_finished_us": 163} +{"t_unix": 1779813812.8796606, "step_id": 9999, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813812.88697, "step_id": 10000, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813812.8941717, "step_id": 10001, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813812.9015276, "step_id": 10002, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813812.9089735, "step_id": 10003, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813812.916307, "step_id": 10004, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813812.9239857, "step_id": 10005, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813812.9313276, "step_id": 10006, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813812.9388473, "step_id": 10007, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813812.9461987, "step_id": 10008, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813812.9538443, "step_id": 10009, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813812.9614592, "step_id": 10010, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813812.9688678, "step_id": 10011, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813812.9762647, "step_id": 10012, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813812.9838479, "step_id": 10013, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813812.991469, "step_id": 10014, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813812.998998, "step_id": 10015, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813813.006232, "step_id": 10016, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813813.013667, "step_id": 10017, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813813.0208127, "step_id": 10018, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813813.0277672, "step_id": 10019, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813813.0345585, "step_id": 10020, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813813.0417674, "step_id": 10021, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813813.049007, "step_id": 10022, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813813.0561109, "step_id": 10023, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813813.0633526, "step_id": 10024, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813813.0706356, "step_id": 10025, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813813.078127, "step_id": 10026, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813813.0855305, "step_id": 10027, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813813.0926552, "step_id": 10028, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813813.0998204, "step_id": 10029, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813813.1072154, "step_id": 10030, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813813.1144125, "step_id": 10031, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813813.121721, "step_id": 10032, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813813.1288755, "step_id": 10033, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813813.1361177, "step_id": 10034, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813813.143422, "step_id": 10035, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813813.1506739, "step_id": 10036, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813813.1576877, "step_id": 10037, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813813.164903, "step_id": 10038, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813813.1722138, "step_id": 10039, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813813.1795747, "step_id": 10040, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813813.1864917, "step_id": 10041, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813813.1938891, "step_id": 10042, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813813.2005923, "step_id": 10043, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813813.2077725, "step_id": 10044, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813813.2150855, "step_id": 10045, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813813.2223792, "step_id": 10046, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813813.2295232, "step_id": 10047, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813813.2366385, "step_id": 10048, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813813.2434483, "step_id": 10049, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813813.2503686, "step_id": 10050, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813813.2572994, "step_id": 10051, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813813.2638774, "step_id": 10052, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813813.3083804, "step_id": 10053, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813813.3105063, "step_id": 10054, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813813.5136015, "step_id": 10055, "start_load_kv_us": 3, "get_finished_us": 359} +{"t_unix": 1779813813.5196593, "step_id": 10056, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813813.5270593, "step_id": 10057, "start_load_kv_us": 3, "get_finished_us": 225} +{"t_unix": 1779813813.534301, "step_id": 10058, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813813.5420787, "step_id": 10059, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813813.5496824, "step_id": 10060, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813813.5569923, "step_id": 10061, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813813.564804, "step_id": 10062, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813813.5718894, "step_id": 10063, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813813.5794504, "step_id": 10064, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813813.5868924, "step_id": 10065, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813813.594509, "step_id": 10066, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813813.602277, "step_id": 10067, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813813.6101308, "step_id": 10068, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813813.618183, "step_id": 10069, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813813.6260655, "step_id": 10070, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813813.6338224, "step_id": 10071, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813813.6415043, "step_id": 10072, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813813.6493735, "step_id": 10073, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813813.6597946, "step_id": 10074, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813813.6639287, "step_id": 10075, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813813.671717, "step_id": 10076, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813813.679232, "step_id": 10077, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813813.686858, "step_id": 10078, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813813.6944964, "step_id": 10079, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813813.7023745, "step_id": 10080, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813813.710098, "step_id": 10081, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813813.718018, "step_id": 10082, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813813.7258396, "step_id": 10083, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813813.7336206, "step_id": 10084, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813813.7416031, "step_id": 10085, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813813.7491019, "step_id": 10086, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813813.7565546, "step_id": 10087, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813813.7642815, "step_id": 10088, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813813.7719193, "step_id": 10089, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813813.7835417, "step_id": 10090, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813813.786671, "step_id": 10091, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813813.7944613, "step_id": 10092, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813813.8021944, "step_id": 10093, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813813.8096557, "step_id": 10094, "start_load_kv_us": 16, "get_finished_us": 170} +{"t_unix": 1779813813.8171182, "step_id": 10095, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813813.8250911, "step_id": 10096, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813813.833198, "step_id": 10097, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813813.8407562, "step_id": 10098, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813813.8483076, "step_id": 10099, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813813.8560977, "step_id": 10100, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813813.8636594, "step_id": 10101, "start_load_kv_us": 17, "get_finished_us": 174} +{"t_unix": 1779813813.8713486, "step_id": 10102, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813813.8786626, "step_id": 10103, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813813.8859906, "step_id": 10104, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813813.8935864, "step_id": 10105, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813813.9011679, "step_id": 10106, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813813.908694, "step_id": 10107, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813813.9163823, "step_id": 10108, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813813.9237707, "step_id": 10109, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813813.9312336, "step_id": 10110, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813813.938667, "step_id": 10111, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813813.9472163, "step_id": 10112, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813813.953919, "step_id": 10113, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813813.9613657, "step_id": 10114, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813813.9692128, "step_id": 10115, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813813.9771986, "step_id": 10116, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813813.984933, "step_id": 10117, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813813.9931085, "step_id": 10118, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813814.000645, "step_id": 10119, "start_load_kv_us": 1, "get_finished_us": 233} +{"t_unix": 1779813814.0082226, "step_id": 10120, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813814.01604, "step_id": 10121, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813814.0233319, "step_id": 10122, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813814.0308042, "step_id": 10123, "start_load_kv_us": 13, "get_finished_us": 209} +{"t_unix": 1779813814.038231, "step_id": 10124, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813814.0458844, "step_id": 10125, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813814.053365, "step_id": 10126, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813814.0610013, "step_id": 10127, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813814.0688078, "step_id": 10128, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813814.076526, "step_id": 10129, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813814.08407, "step_id": 10130, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813814.0918944, "step_id": 10131, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813814.0996993, "step_id": 10132, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813814.1077013, "step_id": 10133, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813814.1158597, "step_id": 10134, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813814.1238391, "step_id": 10135, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813814.131901, "step_id": 10136, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813814.140176, "step_id": 10137, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813814.1482422, "step_id": 10138, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813814.1561136, "step_id": 10139, "start_load_kv_us": 1, "get_finished_us": 218} +{"t_unix": 1779813814.1647072, "step_id": 10140, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813814.172145, "step_id": 10141, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813814.180029, "step_id": 10142, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813814.1879935, "step_id": 10143, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813814.1961396, "step_id": 10144, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813814.2040584, "step_id": 10145, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813814.212002, "step_id": 10146, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813814.2200897, "step_id": 10147, "start_load_kv_us": 3, "get_finished_us": 163} +{"t_unix": 1779813814.228051, "step_id": 10148, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813814.2358875, "step_id": 10149, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813814.2436092, "step_id": 10150, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813814.251416, "step_id": 10151, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813814.2593741, "step_id": 10152, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813814.267287, "step_id": 10153, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813814.274582, "step_id": 10154, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813814.2822053, "step_id": 10155, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813814.2900662, "step_id": 10156, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813814.2978141, "step_id": 10157, "start_load_kv_us": 3, "get_finished_us": 196} +{"t_unix": 1779813814.3054676, "step_id": 10158, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813814.3132813, "step_id": 10159, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813814.321575, "step_id": 10160, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813814.3293374, "step_id": 10161, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813814.3369334, "step_id": 10162, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813814.3447175, "step_id": 10163, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813814.3489609, "step_id": 10164, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813814.3536434, "step_id": 10165, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813814.3584235, "step_id": 10166, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813814.3631995, "step_id": 10167, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813814.3679352, "step_id": 10168, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813814.3727057, "step_id": 10169, "start_load_kv_us": 1, "get_finished_us": 179} +{"t_unix": 1779813814.3774734, "step_id": 10170, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813814.3822432, "step_id": 10171, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813814.3870566, "step_id": 10172, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813814.3918724, "step_id": 10173, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813814.396543, "step_id": 10174, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813814.401366, "step_id": 10175, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813814.4061759, "step_id": 10176, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813814.410938, "step_id": 10177, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813814.4156938, "step_id": 10178, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813814.4205058, "step_id": 10179, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813814.4252868, "step_id": 10180, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813814.430072, "step_id": 10181, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813814.4349203, "step_id": 10182, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813814.4396238, "step_id": 10183, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813814.4444604, "step_id": 10184, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813814.4491663, "step_id": 10185, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813814.4539723, "step_id": 10186, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813814.4587667, "step_id": 10187, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813814.463423, "step_id": 10188, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813814.4682434, "step_id": 10189, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813814.4730794, "step_id": 10190, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813814.4783168, "step_id": 10191, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813814.482604, "step_id": 10192, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813814.4873922, "step_id": 10193, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813814.4920847, "step_id": 10194, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813814.4969609, "step_id": 10195, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813814.501649, "step_id": 10196, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813814.5064218, "step_id": 10197, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813814.5112388, "step_id": 10198, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813814.5160189, "step_id": 10199, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813814.5207458, "step_id": 10200, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813814.5255203, "step_id": 10201, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813814.5302699, "step_id": 10202, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813814.5350118, "step_id": 10203, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813814.5398393, "step_id": 10204, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813814.5447, "step_id": 10205, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813814.5493746, "step_id": 10206, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813814.5542064, "step_id": 10207, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813814.5589552, "step_id": 10208, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813814.563691, "step_id": 10209, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813814.5684712, "step_id": 10210, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813814.573208, "step_id": 10211, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813814.5779853, "step_id": 10212, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813814.582784, "step_id": 10213, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813814.5876715, "step_id": 10214, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813814.5923226, "step_id": 10215, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.5971208, "step_id": 10216, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813814.6019661, "step_id": 10217, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813814.6067076, "step_id": 10218, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813814.6115408, "step_id": 10219, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813814.6163516, "step_id": 10220, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813814.621043, "step_id": 10221, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813814.6258283, "step_id": 10222, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813814.630629, "step_id": 10223, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813814.6353626, "step_id": 10224, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813814.6401865, "step_id": 10225, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813814.645108, "step_id": 10226, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813814.649748, "step_id": 10227, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813814.654485, "step_id": 10228, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.6592808, "step_id": 10229, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813814.664199, "step_id": 10230, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813814.6688583, "step_id": 10231, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813814.6736104, "step_id": 10232, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813814.6783748, "step_id": 10233, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813814.683233, "step_id": 10234, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813814.6879606, "step_id": 10235, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813814.6927836, "step_id": 10236, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813814.697564, "step_id": 10237, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813814.702323, "step_id": 10238, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813814.707053, "step_id": 10239, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813814.7120125, "step_id": 10240, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813814.7167711, "step_id": 10241, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813814.7215421, "step_id": 10242, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813814.7262096, "step_id": 10243, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813814.73103, "step_id": 10244, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813814.7358017, "step_id": 10245, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813814.7406344, "step_id": 10246, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813814.7453127, "step_id": 10247, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813814.7500653, "step_id": 10248, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.7549038, "step_id": 10249, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813814.7596676, "step_id": 10250, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.764425, "step_id": 10251, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813814.7692127, "step_id": 10252, "start_load_kv_us": 1, "get_finished_us": 142} +{"t_unix": 1779813814.7740138, "step_id": 10253, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813814.7787926, "step_id": 10254, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.783544, "step_id": 10255, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813814.788356, "step_id": 10256, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813814.793161, "step_id": 10257, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.797941, "step_id": 10258, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813814.802749, "step_id": 10259, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813814.807433, "step_id": 10260, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813814.8122215, "step_id": 10261, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813814.8174605, "step_id": 10262, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813814.8219273, "step_id": 10263, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813814.8266914, "step_id": 10264, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813814.8314972, "step_id": 10265, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813814.8362815, "step_id": 10266, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813814.84109, "step_id": 10267, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813814.8458269, "step_id": 10268, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813814.850567, "step_id": 10269, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813814.8552923, "step_id": 10270, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813814.8600307, "step_id": 10271, "start_load_kv_us": 1, "get_finished_us": 217} +{"t_unix": 1779813814.864828, "step_id": 10272, "start_load_kv_us": 1, "get_finished_us": 182} +{"t_unix": 1779813814.8695633, "step_id": 10273, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813814.913778, "step_id": 10274, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813814.915871, "step_id": 10275, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813815.1141386, "step_id": 10276, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813815.1198332, "step_id": 10277, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813815.12574, "step_id": 10278, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813815.1315253, "step_id": 10279, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813815.1375778, "step_id": 10280, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813815.143149, "step_id": 10281, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813815.1489868, "step_id": 10282, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813815.1548915, "step_id": 10283, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813815.160462, "step_id": 10284, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813815.1660845, "step_id": 10285, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813815.1719797, "step_id": 10286, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813815.1777692, "step_id": 10287, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813815.2227607, "step_id": 10288, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813815.2249904, "step_id": 10289, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813815.4231215, "step_id": 10290, "start_load_kv_us": 3, "get_finished_us": 404} +{"t_unix": 1779813815.4288745, "step_id": 10291, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813815.4363425, "step_id": 10292, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813815.4438703, "step_id": 10293, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813815.451138, "step_id": 10294, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813815.4582744, "step_id": 10295, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813815.4649894, "step_id": 10296, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813815.4725237, "step_id": 10297, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813815.479611, "step_id": 10298, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813815.4865797, "step_id": 10299, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813815.493861, "step_id": 10300, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813815.501124, "step_id": 10301, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813815.508369, "step_id": 10302, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813815.5157847, "step_id": 10303, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813815.5610762, "step_id": 10304, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813815.5632002, "step_id": 10305, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813815.7668877, "step_id": 10306, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813815.7739184, "step_id": 10307, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813815.781627, "step_id": 10308, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813815.7896075, "step_id": 10309, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813815.7972736, "step_id": 10310, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813815.8042855, "step_id": 10311, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813815.8113363, "step_id": 10312, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813815.818489, "step_id": 10313, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813815.8250453, "step_id": 10314, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813815.8317134, "step_id": 10315, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813815.8389404, "step_id": 10316, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813815.8465176, "step_id": 10317, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813815.8537004, "step_id": 10318, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813815.861162, "step_id": 10319, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813815.868251, "step_id": 10320, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813815.8753185, "step_id": 10321, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813815.882639, "step_id": 10322, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813815.8895564, "step_id": 10323, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813815.8967087, "step_id": 10324, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813815.904113, "step_id": 10325, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813815.9112496, "step_id": 10326, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813815.9188547, "step_id": 10327, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813815.9262385, "step_id": 10328, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813815.933583, "step_id": 10329, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813815.9407778, "step_id": 10330, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813815.948289, "step_id": 10331, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813815.9557855, "step_id": 10332, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813815.963086, "step_id": 10333, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813815.970624, "step_id": 10334, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813815.9779837, "step_id": 10335, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813815.984852, "step_id": 10336, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813815.9918907, "step_id": 10337, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813815.9992776, "step_id": 10338, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813816.0069332, "step_id": 10339, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813816.0143785, "step_id": 10340, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813816.021637, "step_id": 10341, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813816.0291705, "step_id": 10342, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813816.0368881, "step_id": 10343, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813816.0440383, "step_id": 10344, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813816.0512052, "step_id": 10345, "start_load_kv_us": 15, "get_finished_us": 216} +{"t_unix": 1779813816.0583537, "step_id": 10346, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813816.065483, "step_id": 10347, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813816.0729272, "step_id": 10348, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813816.0803473, "step_id": 10349, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813816.0873375, "step_id": 10350, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813816.0946448, "step_id": 10351, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813816.1013637, "step_id": 10352, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813816.1082256, "step_id": 10353, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813816.1154687, "step_id": 10354, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813816.1226573, "step_id": 10355, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813816.130036, "step_id": 10356, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813816.137239, "step_id": 10357, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813816.1444054, "step_id": 10358, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813816.1516118, "step_id": 10359, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813816.158954, "step_id": 10360, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813816.1664515, "step_id": 10361, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813816.1736665, "step_id": 10362, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813816.1809247, "step_id": 10363, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813816.1881697, "step_id": 10364, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813816.1955872, "step_id": 10365, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813816.2030663, "step_id": 10366, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813816.2102096, "step_id": 10367, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813816.2169323, "step_id": 10368, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813816.2232454, "step_id": 10369, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813816.2300909, "step_id": 10370, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813816.2367845, "step_id": 10371, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813816.2437077, "step_id": 10372, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813816.250424, "step_id": 10373, "start_load_kv_us": 1, "get_finished_us": 315} +{"t_unix": 1779813816.257324, "step_id": 10374, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813816.2647789, "step_id": 10375, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813816.2722507, "step_id": 10376, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813816.279636, "step_id": 10377, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813816.28704, "step_id": 10378, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813816.3320613, "step_id": 10379, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813816.3341274, "step_id": 10380, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813816.5365853, "step_id": 10381, "start_load_kv_us": 2, "get_finished_us": 348} +{"t_unix": 1779813816.5436645, "step_id": 10382, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813816.551284, "step_id": 10383, "start_load_kv_us": 17, "get_finished_us": 292} +{"t_unix": 1779813816.5589998, "step_id": 10384, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813816.56647, "step_id": 10385, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813816.5742276, "step_id": 10386, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813816.5820103, "step_id": 10387, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813816.5894291, "step_id": 10388, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813816.5969725, "step_id": 10389, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813816.6039844, "step_id": 10390, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813816.6118295, "step_id": 10391, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813816.6194525, "step_id": 10392, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813816.6273525, "step_id": 10393, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813816.6352243, "step_id": 10394, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813816.643138, "step_id": 10395, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813816.650796, "step_id": 10396, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813816.6585844, "step_id": 10397, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813816.6665657, "step_id": 10398, "start_load_kv_us": 1, "get_finished_us": 228} +{"t_unix": 1779813816.7121892, "step_id": 10399, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813816.7144692, "step_id": 10400, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813816.9564896, "step_id": 10401, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813817.1539865, "step_id": 10402, "start_load_kv_us": 2, "get_finished_us": 374} +{"t_unix": 1779813817.1638966, "step_id": 10403, "start_load_kv_us": 3, "get_finished_us": 209} +{"t_unix": 1779813817.4407012, "step_id": 10404, "start_load_kv_us": 3, "get_finished_us": 375} +{"t_unix": 1779813817.4433796, "step_id": 10405, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813817.6503227, "step_id": 10406, "start_load_kv_us": 3, "get_finished_us": 334} +{"t_unix": 1779813817.660125, "step_id": 10407, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813817.6707826, "step_id": 10408, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813817.68143, "step_id": 10409, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813817.692305, "step_id": 10410, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813817.7033556, "step_id": 10411, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813817.714115, "step_id": 10412, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813817.7245893, "step_id": 10413, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813817.7736425, "step_id": 10414, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813817.776002, "step_id": 10415, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813818.0244803, "step_id": 10416, "start_load_kv_us": 3, "get_finished_us": 354} +{"t_unix": 1779813818.0274713, "step_id": 10417, "start_load_kv_us": 3, "get_finished_us": 266} +{"t_unix": 1779813818.2306457, "step_id": 10418, "start_load_kv_us": 3, "get_finished_us": 308} +{"t_unix": 1779813818.2434783, "step_id": 10419, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813818.2566333, "step_id": 10420, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813818.2700455, "step_id": 10421, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813818.2831914, "step_id": 10422, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813818.2963147, "step_id": 10423, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813818.3094528, "step_id": 10424, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813818.3227456, "step_id": 10425, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813818.3355849, "step_id": 10426, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813818.3486726, "step_id": 10427, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813818.3618503, "step_id": 10428, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813818.3750005, "step_id": 10429, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813818.3884263, "step_id": 10430, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813818.4017985, "step_id": 10431, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813818.4156282, "step_id": 10432, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813818.4290447, "step_id": 10433, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813818.442302, "step_id": 10434, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813818.455856, "step_id": 10435, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813818.4692411, "step_id": 10436, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813818.4829574, "step_id": 10437, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813818.4965158, "step_id": 10438, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813818.509851, "step_id": 10439, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813818.5234668, "step_id": 10440, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813818.5370083, "step_id": 10441, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813818.5503619, "step_id": 10442, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813818.5637932, "step_id": 10443, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813818.5779011, "step_id": 10444, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813818.590697, "step_id": 10445, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813818.603975, "step_id": 10446, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813818.6169062, "step_id": 10447, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813818.6305385, "step_id": 10448, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813818.6442015, "step_id": 10449, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813818.6577442, "step_id": 10450, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813818.6714983, "step_id": 10451, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813818.6846883, "step_id": 10452, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813818.6980627, "step_id": 10453, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813818.7117202, "step_id": 10454, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813818.72611, "step_id": 10455, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813818.7769818, "step_id": 10456, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813818.7793937, "step_id": 10457, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813818.9920003, "step_id": 10458, "start_load_kv_us": 3, "get_finished_us": 303} +{"t_unix": 1779813819.0054622, "step_id": 10459, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813819.0186055, "step_id": 10460, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813819.0320702, "step_id": 10461, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813819.0451903, "step_id": 10462, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813819.0580828, "step_id": 10463, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813819.0709107, "step_id": 10464, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813819.0861452, "step_id": 10465, "start_load_kv_us": 21, "get_finished_us": 1406} +{"t_unix": 1779813819.0973449, "step_id": 10466, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813819.1103032, "step_id": 10467, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813819.1237993, "step_id": 10468, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813819.137759, "step_id": 10469, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813819.1516132, "step_id": 10470, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813819.1652732, "step_id": 10471, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813819.1790621, "step_id": 10472, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813819.1928415, "step_id": 10473, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813819.2064598, "step_id": 10474, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813819.219873, "step_id": 10475, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813819.232888, "step_id": 10476, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813819.2464213, "step_id": 10477, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813819.2598686, "step_id": 10478, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813819.2736895, "step_id": 10479, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813819.2873387, "step_id": 10480, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813819.3009062, "step_id": 10481, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813819.3145552, "step_id": 10482, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813819.328005, "step_id": 10483, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813819.3414958, "step_id": 10484, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813819.3544633, "step_id": 10485, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813819.367668, "step_id": 10486, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813819.3809376, "step_id": 10487, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813819.3941977, "step_id": 10488, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813819.4079125, "step_id": 10489, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813819.421264, "step_id": 10490, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813819.4347596, "step_id": 10491, "start_load_kv_us": 4, "get_finished_us": 156} +{"t_unix": 1779813819.4483995, "step_id": 10492, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813819.462702, "step_id": 10493, "start_load_kv_us": 3, "get_finished_us": 267} +{"t_unix": 1779813819.4758496, "step_id": 10494, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813819.489483, "step_id": 10495, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813819.5035622, "step_id": 10496, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813819.5179696, "step_id": 10497, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813819.5317225, "step_id": 10498, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813819.5453503, "step_id": 10499, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813819.5588782, "step_id": 10500, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813819.5727634, "step_id": 10501, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813819.5868769, "step_id": 10502, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813819.6006303, "step_id": 10503, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813819.6148987, "step_id": 10504, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813819.6288228, "step_id": 10505, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813819.6429727, "step_id": 10506, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813819.6576154, "step_id": 10507, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813819.6713073, "step_id": 10508, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813819.685181, "step_id": 10509, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813819.6991158, "step_id": 10510, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813819.712968, "step_id": 10511, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813819.7271295, "step_id": 10512, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813819.7411456, "step_id": 10513, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813819.7547233, "step_id": 10514, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813819.7682989, "step_id": 10515, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813819.7823887, "step_id": 10516, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813819.796259, "step_id": 10517, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813819.8102467, "step_id": 10518, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813819.82474, "step_id": 10519, "start_load_kv_us": 3, "get_finished_us": 357} +{"t_unix": 1779813819.8381379, "step_id": 10520, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813819.8538146, "step_id": 10521, "start_load_kv_us": 2, "get_finished_us": 441} +{"t_unix": 1779813819.865129, "step_id": 10522, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813819.878687, "step_id": 10523, "start_load_kv_us": 17, "get_finished_us": 202} +{"t_unix": 1779813819.8927693, "step_id": 10524, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813819.9067733, "step_id": 10525, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813819.9209902, "step_id": 10526, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813819.935106, "step_id": 10527, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813819.9486852, "step_id": 10528, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813819.9623373, "step_id": 10529, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813819.9766517, "step_id": 10530, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813819.9907594, "step_id": 10531, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813820.004697, "step_id": 10532, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813820.0187335, "step_id": 10533, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813820.0328944, "step_id": 10534, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813820.047172, "step_id": 10535, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813820.0610263, "step_id": 10536, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813820.074829, "step_id": 10537, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813820.0885742, "step_id": 10538, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813820.102319, "step_id": 10539, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813820.1161103, "step_id": 10540, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813820.1299686, "step_id": 10541, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813820.1443307, "step_id": 10542, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813820.1585362, "step_id": 10543, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813820.1730814, "step_id": 10544, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813820.187262, "step_id": 10545, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813820.1990542, "step_id": 10546, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813820.2107446, "step_id": 10547, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813820.223179, "step_id": 10548, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813820.2355075, "step_id": 10549, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813820.2475755, "step_id": 10550, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813820.259276, "step_id": 10551, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813820.2713528, "step_id": 10552, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813820.2833805, "step_id": 10553, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813820.2952309, "step_id": 10554, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813820.3071208, "step_id": 10555, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813820.319072, "step_id": 10556, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813820.3311253, "step_id": 10557, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813820.3474061, "step_id": 10558, "start_load_kv_us": 2, "get_finished_us": 1060} +{"t_unix": 1779813820.3555737, "step_id": 10559, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813820.367459, "step_id": 10560, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813820.3794072, "step_id": 10561, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813820.3909326, "step_id": 10562, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813820.4028254, "step_id": 10563, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813820.4149141, "step_id": 10564, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813820.426612, "step_id": 10565, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813820.4386268, "step_id": 10566, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813820.4499898, "step_id": 10567, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813820.4613845, "step_id": 10568, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813820.4729984, "step_id": 10569, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813820.4844708, "step_id": 10570, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813820.4965134, "step_id": 10571, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813820.5082173, "step_id": 10572, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813820.5199554, "step_id": 10573, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813820.5312343, "step_id": 10574, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813820.542517, "step_id": 10575, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813820.5533602, "step_id": 10576, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813820.5643733, "step_id": 10577, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813820.574817, "step_id": 10578, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813820.5859847, "step_id": 10579, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813820.597412, "step_id": 10580, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813820.608854, "step_id": 10581, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813820.6207037, "step_id": 10582, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813820.6320512, "step_id": 10583, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813820.6436746, "step_id": 10584, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813820.6556275, "step_id": 10585, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813820.667414, "step_id": 10586, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813820.6793404, "step_id": 10587, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813820.6911402, "step_id": 10588, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813820.702897, "step_id": 10589, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813820.7143688, "step_id": 10590, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813820.725999, "step_id": 10591, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813820.7373545, "step_id": 10592, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813820.7490795, "step_id": 10593, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813820.7610896, "step_id": 10594, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813820.773063, "step_id": 10595, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813820.7847414, "step_id": 10596, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813820.7966573, "step_id": 10597, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813820.8087163, "step_id": 10598, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813820.8206418, "step_id": 10599, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813820.832423, "step_id": 10600, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813820.844136, "step_id": 10601, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813820.8562086, "step_id": 10602, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813820.8680153, "step_id": 10603, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813820.8796816, "step_id": 10604, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813820.8917892, "step_id": 10605, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813820.9039335, "step_id": 10606, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813820.9161577, "step_id": 10607, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813820.9284518, "step_id": 10608, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813820.9403555, "step_id": 10609, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813820.9523044, "step_id": 10610, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813820.964259, "step_id": 10611, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813820.976191, "step_id": 10612, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813820.9884226, "step_id": 10613, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813821.0007298, "step_id": 10614, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813821.012567, "step_id": 10615, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813821.024377, "step_id": 10616, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813821.0363555, "step_id": 10617, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813821.0484645, "step_id": 10618, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813821.1006794, "step_id": 10619, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813821.103026, "step_id": 10620, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813821.3133404, "step_id": 10621, "start_load_kv_us": 3, "get_finished_us": 311} +{"t_unix": 1779813821.3253229, "step_id": 10622, "start_load_kv_us": 3, "get_finished_us": 203} +{"t_unix": 1779813821.3428776, "step_id": 10623, "start_load_kv_us": 13, "get_finished_us": 281} +{"t_unix": 1779813821.3499105, "step_id": 10624, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813821.3621671, "step_id": 10625, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813821.3742645, "step_id": 10626, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813821.4256148, "step_id": 10627, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813821.427968, "step_id": 10628, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813821.6389651, "step_id": 10629, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813821.6527286, "step_id": 10630, "start_load_kv_us": 3, "get_finished_us": 258} +{"t_unix": 1779813821.666785, "step_id": 10631, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813821.681193, "step_id": 10632, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813821.6959395, "step_id": 10633, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813821.7106612, "step_id": 10634, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813821.7252119, "step_id": 10635, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813821.7399113, "step_id": 10636, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813821.752228, "step_id": 10637, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813821.7647252, "step_id": 10638, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813821.7768488, "step_id": 10639, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813821.7890372, "step_id": 10640, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813821.8008368, "step_id": 10641, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813821.812461, "step_id": 10642, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813821.8241842, "step_id": 10643, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813821.835636, "step_id": 10644, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813821.847355, "step_id": 10645, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813821.859397, "step_id": 10646, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813821.871165, "step_id": 10647, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813821.883111, "step_id": 10648, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813821.8947885, "step_id": 10649, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813821.9060442, "step_id": 10650, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813821.9173205, "step_id": 10651, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813821.928304, "step_id": 10652, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813821.9400022, "step_id": 10653, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813821.9906185, "step_id": 10654, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813821.9933026, "step_id": 10655, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813822.2025099, "step_id": 10656, "start_load_kv_us": 3, "get_finished_us": 354} +{"t_unix": 1779813822.213886, "step_id": 10657, "start_load_kv_us": 3, "get_finished_us": 222} +{"t_unix": 1779813822.2253702, "step_id": 10658, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813822.2362401, "step_id": 10659, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813822.2488627, "step_id": 10660, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813822.2604234, "step_id": 10661, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813822.269398, "step_id": 10662, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813822.2788959, "step_id": 10663, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813822.288542, "step_id": 10664, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813822.2982059, "step_id": 10665, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813822.3081768, "step_id": 10666, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813822.3174024, "step_id": 10667, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813822.3269815, "step_id": 10668, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813822.337147, "step_id": 10669, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813822.347188, "step_id": 10670, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813822.356689, "step_id": 10671, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813822.3668053, "step_id": 10672, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813822.376365, "step_id": 10673, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813822.3837538, "step_id": 10674, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813822.39138, "step_id": 10675, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813822.3985953, "step_id": 10676, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813822.4065328, "step_id": 10677, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813822.4141717, "step_id": 10678, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813822.4216082, "step_id": 10679, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813822.4294994, "step_id": 10680, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813822.4373946, "step_id": 10681, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813822.445169, "step_id": 10682, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813822.452995, "step_id": 10683, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813822.460871, "step_id": 10684, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813822.468711, "step_id": 10685, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813822.4767573, "step_id": 10686, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813822.4846458, "step_id": 10687, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813822.4925876, "step_id": 10688, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813822.5004292, "step_id": 10689, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813822.508197, "step_id": 10690, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813822.5160186, "step_id": 10691, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813822.523817, "step_id": 10692, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813822.531797, "step_id": 10693, "start_load_kv_us": 1, "get_finished_us": 136} +{"t_unix": 1779813822.5396712, "step_id": 10694, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813822.5475793, "step_id": 10695, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813822.5554533, "step_id": 10696, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813822.5641458, "step_id": 10697, "start_load_kv_us": 3, "get_finished_us": 216} +{"t_unix": 1779813822.5714092, "step_id": 10698, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813822.579305, "step_id": 10699, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813822.586986, "step_id": 10700, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813822.594739, "step_id": 10701, "start_load_kv_us": 14, "get_finished_us": 146} +{"t_unix": 1779813822.6027455, "step_id": 10702, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813822.6106052, "step_id": 10703, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813822.6186318, "step_id": 10704, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813822.6643894, "step_id": 10705, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813822.6665275, "step_id": 10706, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813822.8697748, "step_id": 10707, "start_load_kv_us": 17, "get_finished_us": 288} +{"t_unix": 1779813822.8793857, "step_id": 10708, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813822.8886778, "step_id": 10709, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813822.8978865, "step_id": 10710, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813822.90716, "step_id": 10711, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813822.9169405, "step_id": 10712, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813822.926246, "step_id": 10713, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813822.9338148, "step_id": 10714, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813822.9414134, "step_id": 10715, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813822.948929, "step_id": 10716, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813822.9564605, "step_id": 10717, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813822.9641464, "step_id": 10718, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813822.9719214, "step_id": 10719, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813822.9798017, "step_id": 10720, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813822.9876661, "step_id": 10721, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813822.9953203, "step_id": 10722, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813823.0031633, "step_id": 10723, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813823.0106354, "step_id": 10724, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813823.0182486, "step_id": 10725, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813823.0253909, "step_id": 10726, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813823.03298, "step_id": 10727, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813823.040578, "step_id": 10728, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813823.0479863, "step_id": 10729, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813823.054989, "step_id": 10730, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813823.0624177, "step_id": 10731, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813823.069909, "step_id": 10732, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813823.0771518, "step_id": 10733, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813823.084799, "step_id": 10734, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813823.0926566, "step_id": 10735, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813823.1006994, "step_id": 10736, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813823.108242, "step_id": 10737, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813823.115242, "step_id": 10738, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813823.122579, "step_id": 10739, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813823.1301885, "step_id": 10740, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813823.1375098, "step_id": 10741, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813823.144739, "step_id": 10742, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813823.1525383, "step_id": 10743, "start_load_kv_us": 3, "get_finished_us": 182} +{"t_unix": 1779813823.160675, "step_id": 10744, "start_load_kv_us": 2, "get_finished_us": 444} +{"t_unix": 1779813823.168279, "step_id": 10745, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813823.1761756, "step_id": 10746, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813823.1839254, "step_id": 10747, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813823.1917627, "step_id": 10748, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813823.1999228, "step_id": 10749, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813823.2076979, "step_id": 10750, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813823.2154534, "step_id": 10751, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813823.2235563, "step_id": 10752, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813823.2316167, "step_id": 10753, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813823.2393672, "step_id": 10754, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813823.2472007, "step_id": 10755, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813823.2550385, "step_id": 10756, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813823.2629957, "step_id": 10757, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813823.2710156, "step_id": 10758, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813823.2790005, "step_id": 10759, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813823.2867992, "step_id": 10760, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813823.2942753, "step_id": 10761, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813823.3020868, "step_id": 10762, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813823.3097746, "step_id": 10763, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813823.317526, "step_id": 10764, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813823.3252175, "step_id": 10765, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813823.3330894, "step_id": 10766, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813823.3407056, "step_id": 10767, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813823.3482313, "step_id": 10768, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813823.3557165, "step_id": 10769, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813823.363231, "step_id": 10770, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813823.370642, "step_id": 10771, "start_load_kv_us": 14, "get_finished_us": 158} +{"t_unix": 1779813823.377831, "step_id": 10772, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813823.3854444, "step_id": 10773, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813823.3933198, "step_id": 10774, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813823.4010024, "step_id": 10775, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813823.4081314, "step_id": 10776, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813823.4154, "step_id": 10777, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813823.4229956, "step_id": 10778, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813823.4305797, "step_id": 10779, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813823.438261, "step_id": 10780, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813823.4460964, "step_id": 10781, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813823.4543018, "step_id": 10782, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813823.4621196, "step_id": 10783, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813823.4699914, "step_id": 10784, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813823.4779167, "step_id": 10785, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813823.4857712, "step_id": 10786, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813823.4935396, "step_id": 10787, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813823.5015585, "step_id": 10788, "start_load_kv_us": 2, "get_finished_us": 378} +{"t_unix": 1779813823.5089662, "step_id": 10789, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813823.5167303, "step_id": 10790, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813823.5246089, "step_id": 10791, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813823.5324135, "step_id": 10792, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813823.5400178, "step_id": 10793, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813823.547998, "step_id": 10794, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813823.555923, "step_id": 10795, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813823.5639186, "step_id": 10796, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813823.572131, "step_id": 10797, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813823.5796719, "step_id": 10798, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813823.587449, "step_id": 10799, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813823.5954263, "step_id": 10800, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813823.6035268, "step_id": 10801, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813823.6115794, "step_id": 10802, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813823.6196277, "step_id": 10803, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813823.627827, "step_id": 10804, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813823.6359115, "step_id": 10805, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813823.6441162, "step_id": 10806, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813823.6522837, "step_id": 10807, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813823.6601918, "step_id": 10808, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813823.6682262, "step_id": 10809, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813823.6761725, "step_id": 10810, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813823.684414, "step_id": 10811, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813823.7307782, "step_id": 10812, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813823.73289, "step_id": 10813, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813823.933834, "step_id": 10814, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813823.9438467, "step_id": 10815, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813823.9544504, "step_id": 10816, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813823.9646344, "step_id": 10817, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813823.9747162, "step_id": 10818, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813823.9846935, "step_id": 10819, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813823.9946327, "step_id": 10820, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813824.0043235, "step_id": 10821, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813824.014075, "step_id": 10822, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813824.0239317, "step_id": 10823, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813824.0345678, "step_id": 10824, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813824.0446315, "step_id": 10825, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813824.0547986, "step_id": 10826, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813824.0647492, "step_id": 10827, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813824.0745335, "step_id": 10828, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813824.0837467, "step_id": 10829, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813824.0930474, "step_id": 10830, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813824.1023731, "step_id": 10831, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813824.1116436, "step_id": 10832, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813824.1208134, "step_id": 10833, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813824.1300945, "step_id": 10834, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813824.1394615, "step_id": 10835, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813824.1490374, "step_id": 10836, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813824.1583881, "step_id": 10837, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813824.1679294, "step_id": 10838, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813824.1776648, "step_id": 10839, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813824.1867526, "step_id": 10840, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813824.1963522, "step_id": 10841, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813824.2059727, "step_id": 10842, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813824.2158282, "step_id": 10843, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813824.2254264, "step_id": 10844, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813824.2352226, "step_id": 10845, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813824.2446566, "step_id": 10846, "start_load_kv_us": 3, "get_finished_us": 155} +{"t_unix": 1779813824.2541192, "step_id": 10847, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813824.2636616, "step_id": 10848, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813824.2733192, "step_id": 10849, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813824.2826524, "step_id": 10850, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813824.292194, "step_id": 10851, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813824.3017714, "step_id": 10852, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813824.3114967, "step_id": 10853, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813824.3213365, "step_id": 10854, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813824.331241, "step_id": 10855, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813824.3410878, "step_id": 10856, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813824.3510337, "step_id": 10857, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813824.3986084, "step_id": 10858, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813824.400777, "step_id": 10859, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813824.6067183, "step_id": 10860, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813824.6164129, "step_id": 10861, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813824.6261306, "step_id": 10862, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813824.6358926, "step_id": 10863, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813824.6459107, "step_id": 10864, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813824.655956, "step_id": 10865, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813824.665387, "step_id": 10866, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813824.6750433, "step_id": 10867, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813824.6845694, "step_id": 10868, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813824.694774, "step_id": 10869, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813824.7050443, "step_id": 10870, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813824.7151968, "step_id": 10871, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813824.7248814, "step_id": 10872, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813824.7348301, "step_id": 10873, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813824.744841, "step_id": 10874, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813824.7551827, "step_id": 10875, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813824.765525, "step_id": 10876, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813824.7758155, "step_id": 10877, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813824.7860162, "step_id": 10878, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813824.796009, "step_id": 10879, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813824.8062234, "step_id": 10880, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813824.8168464, "step_id": 10881, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813824.8266928, "step_id": 10882, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813824.8368423, "step_id": 10883, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813824.8849893, "step_id": 10884, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813824.8871372, "step_id": 10885, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813825.090603, "step_id": 10886, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813825.1004815, "step_id": 10887, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813825.1105254, "step_id": 10888, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813825.1207294, "step_id": 10889, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813825.1306927, "step_id": 10890, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813825.140756, "step_id": 10891, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813825.1509376, "step_id": 10892, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813825.161258, "step_id": 10893, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813825.1711376, "step_id": 10894, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813825.1809542, "step_id": 10895, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813825.191175, "step_id": 10896, "start_load_kv_us": 15, "get_finished_us": 184} +{"t_unix": 1779813825.2013626, "step_id": 10897, "start_load_kv_us": 2, "get_finished_us": 333} +{"t_unix": 1779813825.211394, "step_id": 10898, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813825.2215364, "step_id": 10899, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813825.231564, "step_id": 10900, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813825.2413757, "step_id": 10901, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813825.2511165, "step_id": 10902, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813825.2613266, "step_id": 10903, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813825.2712317, "step_id": 10904, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813825.2808926, "step_id": 10905, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813825.2910113, "step_id": 10906, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813825.3011878, "step_id": 10907, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813825.3112202, "step_id": 10908, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813825.3212245, "step_id": 10909, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813825.3315356, "step_id": 10910, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813825.3417876, "step_id": 10911, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813825.3496802, "step_id": 10912, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813825.3578725, "step_id": 10913, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813825.3660245, "step_id": 10914, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813825.3741205, "step_id": 10915, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813825.3822596, "step_id": 10916, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813825.3902907, "step_id": 10917, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813825.3981867, "step_id": 10918, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813825.405987, "step_id": 10919, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813825.4136271, "step_id": 10920, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813825.4212785, "step_id": 10921, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813825.429127, "step_id": 10922, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813825.4369118, "step_id": 10923, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813825.4447072, "step_id": 10924, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813825.4524636, "step_id": 10925, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813825.4602423, "step_id": 10926, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813825.4681714, "step_id": 10927, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813825.4759634, "step_id": 10928, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813825.4835706, "step_id": 10929, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813825.4906726, "step_id": 10930, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813825.4977014, "step_id": 10931, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813825.5053349, "step_id": 10932, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813825.512685, "step_id": 10933, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813825.520534, "step_id": 10934, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813825.5284169, "step_id": 10935, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813825.5363288, "step_id": 10936, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813825.5443168, "step_id": 10937, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813825.5520916, "step_id": 10938, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813825.5599332, "step_id": 10939, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813825.567709, "step_id": 10940, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813825.575469, "step_id": 10941, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813825.582931, "step_id": 10942, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813825.5901773, "step_id": 10943, "start_load_kv_us": 1, "get_finished_us": 240} +{"t_unix": 1779813825.5977721, "step_id": 10944, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813825.6056914, "step_id": 10945, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813825.6134849, "step_id": 10946, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813825.621563, "step_id": 10947, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813825.6295106, "step_id": 10948, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813825.637487, "step_id": 10949, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813825.645652, "step_id": 10950, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813825.6534562, "step_id": 10951, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813825.6615903, "step_id": 10952, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813825.6696305, "step_id": 10953, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813825.6774971, "step_id": 10954, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813825.6851888, "step_id": 10955, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813825.732013, "step_id": 10956, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813825.928191, "step_id": 10957, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813825.937752, "step_id": 10958, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813826.1683304, "step_id": 10959, "start_load_kv_us": 2, "get_finished_us": 341} +{"t_unix": 1779813826.1774092, "step_id": 10960, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813826.1868525, "step_id": 10961, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813826.1961887, "step_id": 10962, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813826.205736, "step_id": 10963, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813826.215289, "step_id": 10964, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813826.2247972, "step_id": 10965, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813826.2340353, "step_id": 10966, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813826.2433944, "step_id": 10967, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813826.2535992, "step_id": 10968, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813826.263238, "step_id": 10969, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813826.2726579, "step_id": 10970, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813826.2822452, "step_id": 10971, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813826.2920458, "step_id": 10972, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813826.3011954, "step_id": 10973, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813826.3103423, "step_id": 10974, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813826.3198142, "step_id": 10975, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813826.329367, "step_id": 10976, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813826.3388464, "step_id": 10977, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813826.3481147, "step_id": 10978, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813826.357526, "step_id": 10979, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813826.3670976, "step_id": 10980, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813826.3762078, "step_id": 10981, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813826.3857992, "step_id": 10982, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813826.3953831, "step_id": 10983, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813826.4044855, "step_id": 10984, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813826.413833, "step_id": 10985, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813826.4233482, "step_id": 10986, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813826.43275, "step_id": 10987, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813826.442351, "step_id": 10988, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813826.4519897, "step_id": 10989, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813826.461703, "step_id": 10990, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813826.471674, "step_id": 10991, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813826.482456, "step_id": 10992, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813826.4919817, "step_id": 10993, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813826.5019612, "step_id": 10994, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813826.511662, "step_id": 10995, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813826.521233, "step_id": 10996, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813826.5306456, "step_id": 10997, "start_load_kv_us": 18, "get_finished_us": 160} +{"t_unix": 1779813826.540073, "step_id": 10998, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813826.5492327, "step_id": 10999, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813826.5588183, "step_id": 11000, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813826.5684466, "step_id": 11001, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813826.5781386, "step_id": 11002, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813826.5879405, "step_id": 11003, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813826.5979595, "step_id": 11004, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813826.607619, "step_id": 11005, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813826.6171215, "step_id": 11006, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813826.6263335, "step_id": 11007, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813826.6358504, "step_id": 11008, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813826.6455257, "step_id": 11009, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813826.6554582, "step_id": 11010, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813826.6650503, "step_id": 11011, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813826.6745844, "step_id": 11012, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813826.6839943, "step_id": 11013, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813826.6933913, "step_id": 11014, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813826.702459, "step_id": 11015, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813826.7121048, "step_id": 11016, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813826.7215, "step_id": 11017, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813826.732317, "step_id": 11018, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813826.742176, "step_id": 11019, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813826.7521365, "step_id": 11020, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813826.762267, "step_id": 11021, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813826.7722754, "step_id": 11022, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813826.7824101, "step_id": 11023, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813826.7925358, "step_id": 11024, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813826.8027756, "step_id": 11025, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813826.812854, "step_id": 11026, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813826.822496, "step_id": 11027, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813826.8322835, "step_id": 11028, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813826.841743, "step_id": 11029, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813826.8514898, "step_id": 11030, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813826.8610342, "step_id": 11031, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813826.870697, "step_id": 11032, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813826.8804603, "step_id": 11033, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813826.8899846, "step_id": 11034, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813826.8997097, "step_id": 11035, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813826.9097776, "step_id": 11036, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813826.919669, "step_id": 11037, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813826.9289982, "step_id": 11038, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813826.9385753, "step_id": 11039, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813826.948159, "step_id": 11040, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813826.9580626, "step_id": 11041, "start_load_kv_us": 1, "get_finished_us": 327} +{"t_unix": 1779813826.9677892, "step_id": 11042, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813826.9775794, "step_id": 11043, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813826.9872432, "step_id": 11044, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813826.9967337, "step_id": 11045, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813827.0070174, "step_id": 11046, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813827.0164027, "step_id": 11047, "start_load_kv_us": 1, "get_finished_us": 280} +{"t_unix": 1779813827.026325, "step_id": 11048, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813827.0365326, "step_id": 11049, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813827.046595, "step_id": 11050, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813827.0562823, "step_id": 11051, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813827.0662854, "step_id": 11052, "start_load_kv_us": 2, "get_finished_us": 346} +{"t_unix": 1779813827.0760312, "step_id": 11053, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813827.0855303, "step_id": 11054, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813827.095223, "step_id": 11055, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813827.105243, "step_id": 11056, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813827.1150095, "step_id": 11057, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813827.124695, "step_id": 11058, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813827.1341803, "step_id": 11059, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813827.143962, "step_id": 11060, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813827.153663, "step_id": 11061, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813827.1629093, "step_id": 11062, "start_load_kv_us": 1, "get_finished_us": 194} +{"t_unix": 1779813827.1726422, "step_id": 11063, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813827.1822884, "step_id": 11064, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813827.1922982, "step_id": 11065, "start_load_kv_us": 8, "get_finished_us": 167} +{"t_unix": 1779813827.2020745, "step_id": 11066, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813827.2120028, "step_id": 11067, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813827.2218893, "step_id": 11068, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813827.23163, "step_id": 11069, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813827.2391422, "step_id": 11070, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813827.246968, "step_id": 11071, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813827.254864, "step_id": 11072, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813827.2628229, "step_id": 11073, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813827.2708964, "step_id": 11074, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813827.279224, "step_id": 11075, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813827.2873216, "step_id": 11076, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813827.2954118, "step_id": 11077, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813827.3035583, "step_id": 11078, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813827.3116465, "step_id": 11079, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813827.3204918, "step_id": 11080, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813827.3283134, "step_id": 11081, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813827.3362463, "step_id": 11082, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813827.3443282, "step_id": 11083, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813827.352456, "step_id": 11084, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813827.3604035, "step_id": 11085, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813827.3682163, "step_id": 11086, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813827.3762703, "step_id": 11087, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813827.3843164, "step_id": 11088, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813827.3922906, "step_id": 11089, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813827.400303, "step_id": 11090, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813827.4081805, "step_id": 11091, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813827.4162614, "step_id": 11092, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813827.4244199, "step_id": 11093, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813827.432499, "step_id": 11094, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813827.4404178, "step_id": 11095, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813827.4484296, "step_id": 11096, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813827.4562986, "step_id": 11097, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813827.4641407, "step_id": 11098, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813827.4720962, "step_id": 11099, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813827.480192, "step_id": 11100, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813827.4884613, "step_id": 11101, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813827.497188, "step_id": 11102, "start_load_kv_us": 3, "get_finished_us": 167} +{"t_unix": 1779813827.505227, "step_id": 11103, "start_load_kv_us": 18, "get_finished_us": 226} +{"t_unix": 1779813827.5129929, "step_id": 11104, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813827.5208633, "step_id": 11105, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813827.5288906, "step_id": 11106, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813827.5369978, "step_id": 11107, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813827.5450532, "step_id": 11108, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813827.5531085, "step_id": 11109, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813827.561306, "step_id": 11110, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813827.5694456, "step_id": 11111, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813827.577305, "step_id": 11112, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813827.6231287, "step_id": 11113, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813827.625494, "step_id": 11114, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813827.8308697, "step_id": 11115, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813827.8385153, "step_id": 11116, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813827.8463902, "step_id": 11117, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813827.8541565, "step_id": 11118, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813827.8621469, "step_id": 11119, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813827.8700492, "step_id": 11120, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813827.8777618, "step_id": 11121, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813827.885838, "step_id": 11122, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813827.8937888, "step_id": 11123, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813827.9017131, "step_id": 11124, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813827.909615, "step_id": 11125, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813827.9173763, "step_id": 11126, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813827.9255636, "step_id": 11127, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813827.9335418, "step_id": 11128, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813827.9418058, "step_id": 11129, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813827.950184, "step_id": 11130, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813827.957894, "step_id": 11131, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813827.9658256, "step_id": 11132, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813827.9737804, "step_id": 11133, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813827.9816284, "step_id": 11134, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813827.9897335, "step_id": 11135, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813827.9976807, "step_id": 11136, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813828.0056205, "step_id": 11137, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813828.0137737, "step_id": 11138, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813828.0217187, "step_id": 11139, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813828.029952, "step_id": 11140, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813828.0381498, "step_id": 11141, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813828.0454264, "step_id": 11142, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813828.0530205, "step_id": 11143, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813828.0606732, "step_id": 11144, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813828.0685067, "step_id": 11145, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813828.0760891, "step_id": 11146, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813828.0838032, "step_id": 11147, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813828.0915775, "step_id": 11148, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813828.0993989, "step_id": 11149, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813828.1071856, "step_id": 11150, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813828.1147494, "step_id": 11151, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813828.122426, "step_id": 11152, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813828.1301148, "step_id": 11153, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813828.1376543, "step_id": 11154, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813828.1452239, "step_id": 11155, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813828.1529207, "step_id": 11156, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813828.160671, "step_id": 11157, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813828.1681805, "step_id": 11158, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813828.1758313, "step_id": 11159, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813828.1832192, "step_id": 11160, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813828.1902535, "step_id": 11161, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813828.197245, "step_id": 11162, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813828.2046242, "step_id": 11163, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813828.212156, "step_id": 11164, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813828.2193735, "step_id": 11165, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813828.2269716, "step_id": 11166, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813828.2343318, "step_id": 11167, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813828.241808, "step_id": 11168, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813828.2488296, "step_id": 11169, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813828.2563539, "step_id": 11170, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813828.2634125, "step_id": 11171, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813828.2707372, "step_id": 11172, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813828.2783563, "step_id": 11173, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813828.285816, "step_id": 11174, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813828.2927473, "step_id": 11175, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813828.3000093, "step_id": 11176, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813828.3074052, "step_id": 11177, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813828.314727, "step_id": 11178, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813828.3220649, "step_id": 11179, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813828.3294935, "step_id": 11180, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813828.3369842, "step_id": 11181, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813828.3444514, "step_id": 11182, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813828.3516364, "step_id": 11183, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813828.3587883, "step_id": 11184, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813828.3663685, "step_id": 11185, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813828.3740714, "step_id": 11186, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813828.3813124, "step_id": 11187, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813828.3887434, "step_id": 11188, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813828.3957403, "step_id": 11189, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813828.4027047, "step_id": 11190, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813828.4098492, "step_id": 11191, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813828.416968, "step_id": 11192, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813828.4243166, "step_id": 11193, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813828.4316342, "step_id": 11194, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813828.4392133, "step_id": 11195, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813828.446519, "step_id": 11196, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813828.4540384, "step_id": 11197, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813828.4615939, "step_id": 11198, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813828.4690616, "step_id": 11199, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813828.4762444, "step_id": 11200, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813828.483174, "step_id": 11201, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813828.4905155, "step_id": 11202, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813828.4976807, "step_id": 11203, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813828.5052283, "step_id": 11204, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813828.5125208, "step_id": 11205, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813828.5199938, "step_id": 11206, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813828.5272746, "step_id": 11207, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813828.534416, "step_id": 11208, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813828.5415137, "step_id": 11209, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813828.548795, "step_id": 11210, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813828.5562155, "step_id": 11211, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813828.5641172, "step_id": 11212, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813828.5714688, "step_id": 11213, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813828.5772617, "step_id": 11214, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813828.5818975, "step_id": 11215, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813828.586623, "step_id": 11216, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813828.5913746, "step_id": 11217, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813828.596205, "step_id": 11218, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813828.6009405, "step_id": 11219, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813828.6056414, "step_id": 11220, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813828.6105049, "step_id": 11221, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813828.6152134, "step_id": 11222, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813828.6200287, "step_id": 11223, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813828.6248133, "step_id": 11224, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813828.629586, "step_id": 11225, "start_load_kv_us": 1, "get_finished_us": 202} +{"t_unix": 1779813828.6343622, "step_id": 11226, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813828.639148, "step_id": 11227, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813828.6438994, "step_id": 11228, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813828.6486971, "step_id": 11229, "start_load_kv_us": 1, "get_finished_us": 187} +{"t_unix": 1779813828.6534767, "step_id": 11230, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813828.6582112, "step_id": 11231, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813828.663101, "step_id": 11232, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813828.6678138, "step_id": 11233, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813828.6726134, "step_id": 11234, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813828.6773293, "step_id": 11235, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813828.6820838, "step_id": 11236, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813828.68693, "step_id": 11237, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813828.6917996, "step_id": 11238, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813828.696453, "step_id": 11239, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813828.7011979, "step_id": 11240, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813828.7059765, "step_id": 11241, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813828.7107928, "step_id": 11242, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813828.715519, "step_id": 11243, "start_load_kv_us": 1, "get_finished_us": 168} +{"t_unix": 1779813828.720282, "step_id": 11244, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813828.7251909, "step_id": 11245, "start_load_kv_us": 1, "get_finished_us": 226} +{"t_unix": 1779813828.7299318, "step_id": 11246, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813828.734742, "step_id": 11247, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813828.7394478, "step_id": 11248, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813828.7443085, "step_id": 11249, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813828.74906, "step_id": 11250, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813828.7540367, "step_id": 11251, "start_load_kv_us": 2, "get_finished_us": 405} +{"t_unix": 1779813828.7585602, "step_id": 11252, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813828.763372, "step_id": 11253, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813828.768113, "step_id": 11254, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813828.772904, "step_id": 11255, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813828.7776716, "step_id": 11256, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813828.7825103, "step_id": 11257, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813828.787237, "step_id": 11258, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813828.7920659, "step_id": 11259, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813828.7968352, "step_id": 11260, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813828.8016102, "step_id": 11261, "start_load_kv_us": 1, "get_finished_us": 197} +{"t_unix": 1779813828.8063526, "step_id": 11262, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813828.8111362, "step_id": 11263, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813828.815934, "step_id": 11264, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813828.8206956, "step_id": 11265, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813828.8255615, "step_id": 11266, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813828.83032, "step_id": 11267, "start_load_kv_us": 1, "get_finished_us": 196} +{"t_unix": 1779813828.8351133, "step_id": 11268, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813828.8398924, "step_id": 11269, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813828.8446827, "step_id": 11270, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813828.8493903, "step_id": 11271, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813828.8541949, "step_id": 11272, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813828.8589604, "step_id": 11273, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813828.8637667, "step_id": 11274, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813828.8684976, "step_id": 11275, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813828.873319, "step_id": 11276, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813828.878079, "step_id": 11277, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813828.8830235, "step_id": 11278, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813828.887755, "step_id": 11279, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813828.892459, "step_id": 11280, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813828.8972895, "step_id": 11281, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813828.9021065, "step_id": 11282, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813828.9068432, "step_id": 11283, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813828.911532, "step_id": 11284, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813828.916384, "step_id": 11285, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813828.9211423, "step_id": 11286, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813828.9259074, "step_id": 11287, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813828.930631, "step_id": 11288, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813828.9354842, "step_id": 11289, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813828.9402354, "step_id": 11290, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813828.9449868, "step_id": 11291, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813828.949793, "step_id": 11292, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813828.9546604, "step_id": 11293, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813828.959361, "step_id": 11294, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813828.964175, "step_id": 11295, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813828.9689023, "step_id": 11296, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813828.9737792, "step_id": 11297, "start_load_kv_us": 12, "get_finished_us": 190} +{"t_unix": 1779813828.978585, "step_id": 11298, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813828.9833066, "step_id": 11299, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813828.9881425, "step_id": 11300, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813828.9928834, "step_id": 11301, "start_load_kv_us": 1, "get_finished_us": 235} +{"t_unix": 1779813828.9976406, "step_id": 11302, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813829.0023565, "step_id": 11303, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813829.0071437, "step_id": 11304, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813829.0120301, "step_id": 11305, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813829.0167818, "step_id": 11306, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813829.0214744, "step_id": 11307, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813829.0263052, "step_id": 11308, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813829.03107, "step_id": 11309, "start_load_kv_us": 1, "get_finished_us": 175} +{"t_unix": 1779813829.0359535, "step_id": 11310, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813829.0406895, "step_id": 11311, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813829.045429, "step_id": 11312, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813829.0501912, "step_id": 11313, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813829.0551252, "step_id": 11314, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813829.059819, "step_id": 11315, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813829.0646315, "step_id": 11316, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813829.0693378, "step_id": 11317, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813829.0771835, "step_id": 11318, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813829.0791643, "step_id": 11319, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813829.0837438, "step_id": 11320, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813829.088487, "step_id": 11321, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813829.0932906, "step_id": 11322, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813829.0980027, "step_id": 11323, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813829.1028547, "step_id": 11324, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813829.1075697, "step_id": 11325, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813829.151448, "step_id": 11326, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813829.153554, "step_id": 11327, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813829.3502707, "step_id": 11328, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813829.3555655, "step_id": 11329, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813829.3613777, "step_id": 11330, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813829.3672438, "step_id": 11331, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813829.3731217, "step_id": 11332, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813829.378917, "step_id": 11333, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813829.3846748, "step_id": 11334, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813829.390488, "step_id": 11335, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813829.3962727, "step_id": 11336, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813829.4023218, "step_id": 11337, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813829.408352, "step_id": 11338, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813829.4143333, "step_id": 11339, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813829.4203107, "step_id": 11340, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813829.426312, "step_id": 11341, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813829.4324467, "step_id": 11342, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813829.4382582, "step_id": 11343, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813829.4439616, "step_id": 11344, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813829.4571831, "step_id": 11345, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813829.4592707, "step_id": 11346, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813829.464291, "step_id": 11347, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813829.4721823, "step_id": 11348, "start_load_kv_us": 11, "get_finished_us": 547} +{"t_unix": 1779813829.477423, "step_id": 11349, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813829.4822443, "step_id": 11350, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813829.4884152, "step_id": 11351, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813829.4941242, "step_id": 11352, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813829.500025, "step_id": 11353, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813829.5060277, "step_id": 11354, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813829.5118878, "step_id": 11355, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813829.5176005, "step_id": 11356, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813829.523234, "step_id": 11357, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813829.5292578, "step_id": 11358, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813829.5349302, "step_id": 11359, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813829.5406284, "step_id": 11360, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813829.54654, "step_id": 11361, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813829.552364, "step_id": 11362, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813829.5583422, "step_id": 11363, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813829.5643656, "step_id": 11364, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813829.5703433, "step_id": 11365, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813829.576403, "step_id": 11366, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813829.5824795, "step_id": 11367, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813829.5883465, "step_id": 11368, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813829.5943282, "step_id": 11369, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813829.6000826, "step_id": 11370, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813829.604643, "step_id": 11371, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813829.6094513, "step_id": 11372, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813829.6141477, "step_id": 11373, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813829.6189623, "step_id": 11374, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813829.6237192, "step_id": 11375, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813829.6284044, "step_id": 11376, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813829.6332366, "step_id": 11377, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813829.6379623, "step_id": 11378, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813829.6427572, "step_id": 11379, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813829.6475027, "step_id": 11380, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813829.6522613, "step_id": 11381, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813829.65701, "step_id": 11382, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813829.6618114, "step_id": 11383, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813829.6665332, "step_id": 11384, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813829.6713347, "step_id": 11385, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813829.6760917, "step_id": 11386, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813829.6808968, "step_id": 11387, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813829.685674, "step_id": 11388, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813829.6903775, "step_id": 11389, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813829.695138, "step_id": 11390, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813829.699931, "step_id": 11391, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813829.7046554, "step_id": 11392, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813829.7093873, "step_id": 11393, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813829.7141829, "step_id": 11394, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813829.7190206, "step_id": 11395, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813829.72374, "step_id": 11396, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813829.7285113, "step_id": 11397, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813829.7332842, "step_id": 11398, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813829.7380486, "step_id": 11399, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813829.7427974, "step_id": 11400, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813829.7475002, "step_id": 11401, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813829.7522757, "step_id": 11402, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813829.7570808, "step_id": 11403, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813829.761935, "step_id": 11404, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813829.7666953, "step_id": 11405, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813829.7714083, "step_id": 11406, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813829.7761595, "step_id": 11407, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813829.7809303, "step_id": 11408, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813829.7857397, "step_id": 11409, "start_load_kv_us": 15, "get_finished_us": 149} +{"t_unix": 1779813829.7904274, "step_id": 11410, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813829.7952921, "step_id": 11411, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813829.8000486, "step_id": 11412, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813829.8048608, "step_id": 11413, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813829.80962, "step_id": 11414, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813829.8144534, "step_id": 11415, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813829.8192103, "step_id": 11416, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813829.8240523, "step_id": 11417, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813829.8287904, "step_id": 11418, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813829.8336055, "step_id": 11419, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813829.8383837, "step_id": 11420, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813829.8431299, "step_id": 11421, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813829.8478494, "step_id": 11422, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813829.8526418, "step_id": 11423, "start_load_kv_us": 1, "get_finished_us": 231} +{"t_unix": 1779813829.8573763, "step_id": 11424, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813829.8621962, "step_id": 11425, "start_load_kv_us": 12, "get_finished_us": 210} +{"t_unix": 1779813829.8668633, "step_id": 11426, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813829.8715863, "step_id": 11427, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813829.8763955, "step_id": 11428, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813829.8811555, "step_id": 11429, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813829.8859558, "step_id": 11430, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813829.8906884, "step_id": 11431, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813829.8955102, "step_id": 11432, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813829.9434023, "step_id": 11433, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813829.9455354, "step_id": 11434, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813830.1817133, "step_id": 11435, "start_load_kv_us": 3, "get_finished_us": 357} +{"t_unix": 1779813830.1841402, "step_id": 11436, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813830.3814607, "step_id": 11437, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813830.3882515, "step_id": 11438, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813830.3953533, "step_id": 11439, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813830.4045997, "step_id": 11440, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813830.409655, "step_id": 11441, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813830.4168365, "step_id": 11442, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813830.4238162, "step_id": 11443, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813830.4307768, "step_id": 11444, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813830.4382343, "step_id": 11445, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813830.4453053, "step_id": 11446, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813830.4527018, "step_id": 11447, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813830.4601583, "step_id": 11448, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813830.4673235, "step_id": 11449, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813830.4744983, "step_id": 11450, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813830.4818358, "step_id": 11451, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813830.4890106, "step_id": 11452, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813830.49625, "step_id": 11453, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813830.5030575, "step_id": 11454, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813830.5099158, "step_id": 11455, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813830.5169773, "step_id": 11456, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813830.5241516, "step_id": 11457, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813830.5308487, "step_id": 11458, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813830.537862, "step_id": 11459, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813830.5446339, "step_id": 11460, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813830.5510774, "step_id": 11461, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813830.5573778, "step_id": 11462, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813830.5637994, "step_id": 11463, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813830.5707994, "step_id": 11464, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813830.5773325, "step_id": 11465, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813830.5837588, "step_id": 11466, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813830.5904965, "step_id": 11467, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813830.5971134, "step_id": 11468, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813830.6037495, "step_id": 11469, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813830.6109707, "step_id": 11470, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813830.6181276, "step_id": 11471, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813830.625186, "step_id": 11472, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813830.6325102, "step_id": 11473, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813830.6399677, "step_id": 11474, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813830.6472974, "step_id": 11475, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813830.6545053, "step_id": 11476, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813830.6618564, "step_id": 11477, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813830.669461, "step_id": 11478, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813830.6766367, "step_id": 11479, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813830.6864138, "step_id": 11480, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813830.6916747, "step_id": 11481, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813830.6991942, "step_id": 11482, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813830.7452111, "step_id": 11483, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813830.9385884, "step_id": 11484, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813830.9479654, "step_id": 11485, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813831.221949, "step_id": 11486, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813831.2242615, "step_id": 11487, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813831.4685585, "step_id": 11488, "start_load_kv_us": 3, "get_finished_us": 314} +{"t_unix": 1779813831.4707828, "step_id": 11489, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813831.6777737, "step_id": 11490, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813831.6890643, "step_id": 11491, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813831.7003543, "step_id": 11492, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813831.711264, "step_id": 11493, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813831.7221117, "step_id": 11494, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813831.7330983, "step_id": 11495, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813831.7443256, "step_id": 11496, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813831.7554197, "step_id": 11497, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813831.7668042, "step_id": 11498, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813831.8154151, "step_id": 11499, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813831.8176634, "step_id": 11500, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813832.0664797, "step_id": 11501, "start_load_kv_us": 3, "get_finished_us": 301} +{"t_unix": 1779813832.266576, "step_id": 11502, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813832.2765758, "step_id": 11503, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813832.513414, "step_id": 11504, "start_load_kv_us": 3, "get_finished_us": 310} +{"t_unix": 1779813832.5265014, "step_id": 11505, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813832.5396447, "step_id": 11506, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813832.5524726, "step_id": 11507, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813832.565049, "step_id": 11508, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813832.5777326, "step_id": 11509, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813832.5901823, "step_id": 11510, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813832.6031723, "step_id": 11511, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813832.6158457, "step_id": 11512, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813832.62867, "step_id": 11513, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813832.6419973, "step_id": 11514, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813832.6551123, "step_id": 11515, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813832.668212, "step_id": 11516, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813832.6813414, "step_id": 11517, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813832.694494, "step_id": 11518, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813832.7074616, "step_id": 11519, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813832.7201426, "step_id": 11520, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813832.733135, "step_id": 11521, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813832.7462552, "step_id": 11522, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813832.7600975, "step_id": 11523, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813832.7739193, "step_id": 11524, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813832.7876682, "step_id": 11525, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813832.8015385, "step_id": 11526, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813832.8150408, "step_id": 11527, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813832.8283925, "step_id": 11528, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813832.8416064, "step_id": 11529, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813832.8553174, "step_id": 11530, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813832.8687835, "step_id": 11531, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813832.8826494, "step_id": 11532, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813832.8960829, "step_id": 11533, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813832.9098184, "step_id": 11534, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813832.923399, "step_id": 11535, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813832.9365382, "step_id": 11536, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813832.9502745, "step_id": 11537, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813832.964138, "step_id": 11538, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813832.978065, "step_id": 11539, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813832.9917843, "step_id": 11540, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813833.0056748, "step_id": 11541, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813833.0195541, "step_id": 11542, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813833.0332522, "step_id": 11543, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813833.0474827, "step_id": 11544, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813833.0614746, "step_id": 11545, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813833.0747664, "step_id": 11546, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813833.1269875, "step_id": 11547, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813833.1292715, "step_id": 11548, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813833.3878915, "step_id": 11549, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813833.390589, "step_id": 11550, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813833.591573, "step_id": 11551, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813833.6050832, "step_id": 11552, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813833.6183374, "step_id": 11553, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813833.631856, "step_id": 11554, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813833.64542, "step_id": 11555, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813833.6588244, "step_id": 11556, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813833.6723537, "step_id": 11557, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813833.687343, "step_id": 11558, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813833.7002254, "step_id": 11559, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813833.714231, "step_id": 11560, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813833.7282872, "step_id": 11561, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813833.7423728, "step_id": 11562, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813833.7564201, "step_id": 11563, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813833.7703772, "step_id": 11564, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813833.7841723, "step_id": 11565, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813833.7976463, "step_id": 11566, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813833.8113003, "step_id": 11567, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813833.8249319, "step_id": 11568, "start_load_kv_us": 1, "get_finished_us": 186} +{"t_unix": 1779813833.8775046, "step_id": 11569, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813834.0833602, "step_id": 11570, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813834.0932007, "step_id": 11571, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813834.3330774, "step_id": 11572, "start_load_kv_us": 3, "get_finished_us": 312} +{"t_unix": 1779813834.3477569, "step_id": 11573, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813834.3631723, "step_id": 11574, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813834.3781605, "step_id": 11575, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813834.392777, "step_id": 11576, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813834.4495041, "step_id": 11577, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813834.4520888, "step_id": 11578, "start_load_kv_us": 3, "get_finished_us": 184} +{"t_unix": 1779813834.6615777, "step_id": 11579, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813834.6754797, "step_id": 11580, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813834.6902878, "step_id": 11581, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813834.7055666, "step_id": 11582, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813834.7202375, "step_id": 11583, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813834.7353168, "step_id": 11584, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813834.7498739, "step_id": 11585, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813834.764586, "step_id": 11586, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813834.7791548, "step_id": 11587, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813834.793663, "step_id": 11588, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813834.8086114, "step_id": 11589, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813834.823585, "step_id": 11590, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813834.8392308, "step_id": 11591, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813834.854506, "step_id": 11592, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813834.869984, "step_id": 11593, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813834.8856196, "step_id": 11594, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813834.90114, "step_id": 11595, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813834.9168186, "step_id": 11596, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813834.932341, "step_id": 11597, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813834.9480433, "step_id": 11598, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813834.9633358, "step_id": 11599, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813834.979065, "step_id": 11600, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813834.9944308, "step_id": 11601, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813835.0101025, "step_id": 11602, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813835.0254874, "step_id": 11603, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813835.0405133, "step_id": 11604, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813835.0557792, "step_id": 11605, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813835.0710707, "step_id": 11606, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813835.0863996, "step_id": 11607, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813835.1015747, "step_id": 11608, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813835.1166422, "step_id": 11609, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813835.1316168, "step_id": 11610, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813835.1470907, "step_id": 11611, "start_load_kv_us": 3, "get_finished_us": 182} +{"t_unix": 1779813835.162413, "step_id": 11612, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813835.1776714, "step_id": 11613, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813835.1931973, "step_id": 11614, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813835.2088962, "step_id": 11615, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813835.224253, "step_id": 11616, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813835.2393239, "step_id": 11617, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813835.2549372, "step_id": 11618, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813835.2703013, "step_id": 11619, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813835.2856708, "step_id": 11620, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813835.3014946, "step_id": 11621, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813835.317061, "step_id": 11622, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813835.333121, "step_id": 11623, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813835.3491523, "step_id": 11624, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813835.364879, "step_id": 11625, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813835.3804142, "step_id": 11626, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813835.3960023, "step_id": 11627, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813835.4112353, "step_id": 11628, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813835.4266555, "step_id": 11629, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813835.4797733, "step_id": 11630, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813835.4822142, "step_id": 11631, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813835.697312, "step_id": 11632, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813835.7124224, "step_id": 11633, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813835.7272007, "step_id": 11634, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813835.7426422, "step_id": 11635, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813835.7579541, "step_id": 11636, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813835.7734756, "step_id": 11637, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813835.7884736, "step_id": 11638, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813835.8039067, "step_id": 11639, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813835.8194003, "step_id": 11640, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813835.834891, "step_id": 11641, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813835.8503067, "step_id": 11642, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813835.8660262, "step_id": 11643, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813835.8811266, "step_id": 11644, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813835.8969827, "step_id": 11645, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813835.9126806, "step_id": 11646, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813835.9277022, "step_id": 11647, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813835.9427028, "step_id": 11648, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813835.9576685, "step_id": 11649, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813835.973342, "step_id": 11650, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813835.9889824, "step_id": 11651, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813836.0043924, "step_id": 11652, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813836.019785, "step_id": 11653, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813836.0348377, "step_id": 11654, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813836.05002, "step_id": 11655, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813836.0655298, "step_id": 11656, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813836.080739, "step_id": 11657, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813836.0962543, "step_id": 11658, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813836.111816, "step_id": 11659, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813836.127406, "step_id": 11660, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813836.1431441, "step_id": 11661, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813836.1584463, "step_id": 11662, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813836.1740344, "step_id": 11663, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813836.1891458, "step_id": 11664, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813836.2040462, "step_id": 11665, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813836.2187114, "step_id": 11666, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813836.2338793, "step_id": 11667, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813836.2489884, "step_id": 11668, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813836.2642555, "step_id": 11669, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813836.279416, "step_id": 11670, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813836.2943382, "step_id": 11671, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813836.3088138, "step_id": 11672, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813836.323364, "step_id": 11673, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813836.3385155, "step_id": 11674, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813836.3539906, "step_id": 11675, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813836.3693187, "step_id": 11676, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813836.3847206, "step_id": 11677, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813836.3999681, "step_id": 11678, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813836.4152668, "step_id": 11679, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813836.430964, "step_id": 11680, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813836.4464495, "step_id": 11681, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813836.5018623, "step_id": 11682, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813836.5044706, "step_id": 11683, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813836.718258, "step_id": 11684, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813836.7770526, "step_id": 11685, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813836.7798448, "step_id": 11686, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813837.028637, "step_id": 11687, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813837.0312614, "step_id": 11688, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813837.248598, "step_id": 11689, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813837.2656786, "step_id": 11690, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813837.284791, "step_id": 11691, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813837.3036003, "step_id": 11692, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813837.318641, "step_id": 11693, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813837.3341098, "step_id": 11694, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813837.3496323, "step_id": 11695, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813837.3643816, "step_id": 11696, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813837.3789937, "step_id": 11697, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813837.393627, "step_id": 11698, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813837.4088326, "step_id": 11699, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813837.424157, "step_id": 11700, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813837.4395764, "step_id": 11701, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813837.4948058, "step_id": 11702, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813837.4975262, "step_id": 11703, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813837.7484653, "step_id": 11704, "start_load_kv_us": 3, "get_finished_us": 297} +{"t_unix": 1779813837.7509148, "step_id": 11705, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813838.0074253, "step_id": 11706, "start_load_kv_us": 3, "get_finished_us": 319} +{"t_unix": 1779813838.0102043, "step_id": 11707, "start_load_kv_us": 3, "get_finished_us": 175} +{"t_unix": 1779813838.2654479, "step_id": 11708, "start_load_kv_us": 3, "get_finished_us": 269} +{"t_unix": 1779813838.268082, "step_id": 11709, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813838.525792, "step_id": 11710, "start_load_kv_us": 3, "get_finished_us": 314} +{"t_unix": 1779813838.5285604, "step_id": 11711, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813838.7489913, "step_id": 11712, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813838.768882, "step_id": 11713, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813838.7885768, "step_id": 11714, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813838.8084826, "step_id": 11715, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813838.8283648, "step_id": 11716, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813838.8482943, "step_id": 11717, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813838.8681772, "step_id": 11718, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813838.8880057, "step_id": 11719, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813838.9080145, "step_id": 11720, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813838.9281054, "step_id": 11721, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813838.9485, "step_id": 11722, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813838.9686484, "step_id": 11723, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813838.9882734, "step_id": 11724, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813839.0093014, "step_id": 11725, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813839.029092, "step_id": 11726, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813839.0491343, "step_id": 11727, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813839.069267, "step_id": 11728, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813839.0899098, "step_id": 11729, "start_load_kv_us": 2, "get_finished_us": 376} +{"t_unix": 1779813839.1098585, "step_id": 11730, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813839.1298153, "step_id": 11731, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813839.1501083, "step_id": 11732, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813839.1702673, "step_id": 11733, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813839.233899, "step_id": 11734, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813839.2367232, "step_id": 11735, "start_load_kv_us": 3, "get_finished_us": 225} +{"t_unix": 1779813839.4528177, "step_id": 11736, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813839.4722128, "step_id": 11737, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813839.4923658, "step_id": 11738, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813839.512746, "step_id": 11739, "start_load_kv_us": 2, "get_finished_us": 335} +{"t_unix": 1779813839.5741315, "step_id": 11740, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813839.5770571, "step_id": 11741, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813839.799271, "step_id": 11742, "start_load_kv_us": 3, "get_finished_us": 361} +{"t_unix": 1779813839.8186328, "step_id": 11743, "start_load_kv_us": 3, "get_finished_us": 358} +{"t_unix": 1779813839.8387094, "step_id": 11744, "start_load_kv_us": 3, "get_finished_us": 246} +{"t_unix": 1779813839.8587809, "step_id": 11745, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813839.8752463, "step_id": 11746, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813839.8921082, "step_id": 11747, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813839.9087412, "step_id": 11748, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813839.9256039, "step_id": 11749, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813839.9423482, "step_id": 11750, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813839.9590693, "step_id": 11751, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813839.975992, "step_id": 11752, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813839.9927037, "step_id": 11753, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813840.0108764, "step_id": 11754, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813840.0272734, "step_id": 11755, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813840.0441332, "step_id": 11756, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813840.062182, "step_id": 11757, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813840.0795019, "step_id": 11758, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813840.0981774, "step_id": 11759, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813840.1125925, "step_id": 11760, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813840.1274676, "step_id": 11761, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813840.1419768, "step_id": 11762, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813840.1564107, "step_id": 11763, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813840.1705549, "step_id": 11764, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813840.1855748, "step_id": 11765, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813840.2005143, "step_id": 11766, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813840.2561815, "step_id": 11767, "start_load_kv_us": 2, "get_finished_us": 361} +{"t_unix": 1779813840.259021, "step_id": 11768, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813840.472425, "step_id": 11769, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813840.4916275, "step_id": 11770, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813840.5101793, "step_id": 11771, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813840.5293443, "step_id": 11772, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813840.5482473, "step_id": 11773, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813840.5673943, "step_id": 11774, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813840.5864549, "step_id": 11775, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813840.6054578, "step_id": 11776, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813840.6244245, "step_id": 11777, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813840.643362, "step_id": 11778, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813840.6620526, "step_id": 11779, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813840.6811907, "step_id": 11780, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813840.6999657, "step_id": 11781, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813840.71827, "step_id": 11782, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813840.7371597, "step_id": 11783, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813840.7560713, "step_id": 11784, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813840.7751703, "step_id": 11785, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813840.793838, "step_id": 11786, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813840.8125634, "step_id": 11787, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813840.8311741, "step_id": 11788, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813840.8504622, "step_id": 11789, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813840.8692706, "step_id": 11790, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813840.8884206, "step_id": 11791, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813840.9073062, "step_id": 11792, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813840.9262514, "step_id": 11793, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813840.9450562, "step_id": 11794, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813840.9646873, "step_id": 11795, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813840.9834619, "step_id": 11796, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813841.002211, "step_id": 11797, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813841.0202665, "step_id": 11798, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813841.0387785, "step_id": 11799, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813841.0574949, "step_id": 11800, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813841.076491, "step_id": 11801, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813841.1348088, "step_id": 11802, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813841.1376107, "step_id": 11803, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813841.3570225, "step_id": 11804, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813841.3758497, "step_id": 11805, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813841.3936296, "step_id": 11806, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813841.407458, "step_id": 11807, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813841.421825, "step_id": 11808, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813841.436749, "step_id": 11809, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813841.4511476, "step_id": 11810, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813841.4655435, "step_id": 11811, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813841.4792526, "step_id": 11812, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813841.4929333, "step_id": 11813, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813841.5062907, "step_id": 11814, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813841.520397, "step_id": 11815, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813841.53399, "step_id": 11816, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813841.548374, "step_id": 11817, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813841.5627866, "step_id": 11818, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813841.5767798, "step_id": 11819, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813841.5913165, "step_id": 11820, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813841.6059024, "step_id": 11821, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813841.6202703, "step_id": 11822, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813841.634079, "step_id": 11823, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813841.647509, "step_id": 11824, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813841.6618829, "step_id": 11825, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813841.675927, "step_id": 11826, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813841.6896756, "step_id": 11827, "start_load_kv_us": 16, "get_finished_us": 193} +{"t_unix": 1779813841.703959, "step_id": 11828, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813841.718288, "step_id": 11829, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813841.7329354, "step_id": 11830, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813841.747882, "step_id": 11831, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813841.762596, "step_id": 11832, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813841.7783098, "step_id": 11833, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813841.7934494, "step_id": 11834, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813841.807538, "step_id": 11835, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813841.8218603, "step_id": 11836, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813841.8357801, "step_id": 11837, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813841.8497608, "step_id": 11838, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813841.863959, "step_id": 11839, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813841.8780155, "step_id": 11840, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813841.8919697, "step_id": 11841, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813841.9054272, "step_id": 11842, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813841.9189382, "step_id": 11843, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813841.9325895, "step_id": 11844, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813841.9464695, "step_id": 11845, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813841.960407, "step_id": 11846, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813841.9742022, "step_id": 11847, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813841.9881618, "step_id": 11848, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813842.0022824, "step_id": 11849, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813842.0162706, "step_id": 11850, "start_load_kv_us": 16, "get_finished_us": 279} +{"t_unix": 1779813842.0303187, "step_id": 11851, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813842.0443127, "step_id": 11852, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813842.058592, "step_id": 11853, "start_load_kv_us": 2, "get_finished_us": 301} +{"t_unix": 1779813842.072131, "step_id": 11854, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813842.0858393, "step_id": 11855, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813842.100066, "step_id": 11856, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813842.1142237, "step_id": 11857, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813842.1281884, "step_id": 11858, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813842.142127, "step_id": 11859, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813842.1558013, "step_id": 11860, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813842.1699934, "step_id": 11861, "start_load_kv_us": 1, "get_finished_us": 274} +{"t_unix": 1779813842.1840165, "step_id": 11862, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813842.2367754, "step_id": 11863, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813842.2392244, "step_id": 11864, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813842.45127, "step_id": 11865, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813842.4655168, "step_id": 11866, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813842.480015, "step_id": 11867, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813842.4947917, "step_id": 11868, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813842.5093527, "step_id": 11869, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813842.524335, "step_id": 11870, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813842.5391624, "step_id": 11871, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813842.5536823, "step_id": 11872, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813842.5680425, "step_id": 11873, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813842.5822053, "step_id": 11874, "start_load_kv_us": 16, "get_finished_us": 215} +{"t_unix": 1779813842.597076, "step_id": 11875, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813842.6117442, "step_id": 11876, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813842.6264515, "step_id": 11877, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813842.6411235, "step_id": 11878, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813842.6554313, "step_id": 11879, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813842.6698892, "step_id": 11880, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813842.684332, "step_id": 11881, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813842.6995084, "step_id": 11882, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813842.7144613, "step_id": 11883, "start_load_kv_us": 1, "get_finished_us": 223} +{"t_unix": 1779813842.7296052, "step_id": 11884, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813842.745077, "step_id": 11885, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813842.7990687, "step_id": 11886, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813842.8018363, "step_id": 11887, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813843.0184734, "step_id": 11888, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813843.0333507, "step_id": 11889, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813843.0485728, "step_id": 11890, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813843.0638185, "step_id": 11891, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813843.079155, "step_id": 11892, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813843.094159, "step_id": 11893, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813843.1084871, "step_id": 11894, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813843.1232758, "step_id": 11895, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813843.1384141, "step_id": 11896, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813843.1534953, "step_id": 11897, "start_load_kv_us": 1, "get_finished_us": 190} +{"t_unix": 1779813843.1688817, "step_id": 11898, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813843.183778, "step_id": 11899, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813843.1988292, "step_id": 11900, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813843.2146204, "step_id": 11901, "start_load_kv_us": 2, "get_finished_us": 300} +{"t_unix": 1779813843.2302933, "step_id": 11902, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813843.2456553, "step_id": 11903, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813843.2605374, "step_id": 11904, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813843.2751353, "step_id": 11905, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813843.2896202, "step_id": 11906, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813843.3044453, "step_id": 11907, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813843.3187673, "step_id": 11908, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813843.3337421, "step_id": 11909, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813843.349423, "step_id": 11910, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813843.364501, "step_id": 11911, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813843.3794603, "step_id": 11912, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813843.3943682, "step_id": 11913, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813843.4097724, "step_id": 11914, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813843.425171, "step_id": 11915, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813843.439885, "step_id": 11916, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813843.4550688, "step_id": 11917, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813843.470602, "step_id": 11918, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813843.4856818, "step_id": 11919, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813843.5011036, "step_id": 11920, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813843.5165038, "step_id": 11921, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813843.5321145, "step_id": 11922, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813843.5473578, "step_id": 11923, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813843.5620575, "step_id": 11924, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813843.5769832, "step_id": 11925, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813843.5923438, "step_id": 11926, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813843.6074765, "step_id": 11927, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813843.6228127, "step_id": 11928, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813843.6381605, "step_id": 11929, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813843.653783, "step_id": 11930, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813843.6694603, "step_id": 11931, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813843.6868687, "step_id": 11932, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813843.699916, "step_id": 11933, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813843.715334, "step_id": 11934, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813843.7308905, "step_id": 11935, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813843.7459342, "step_id": 11936, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813843.7611682, "step_id": 11937, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813843.7767498, "step_id": 11938, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813843.7919524, "step_id": 11939, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813843.8059247, "step_id": 11940, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813843.8205245, "step_id": 11941, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813843.8348205, "step_id": 11942, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813843.8491495, "step_id": 11943, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813843.8631647, "step_id": 11944, "start_load_kv_us": 15, "get_finished_us": 173} +{"t_unix": 1779813843.8765295, "step_id": 11945, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813843.8906643, "step_id": 11946, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813843.9042962, "step_id": 11947, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813843.9174242, "step_id": 11948, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813843.931203, "step_id": 11949, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813843.9451153, "step_id": 11950, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813843.9592683, "step_id": 11951, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813843.9737616, "step_id": 11952, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813843.9881022, "step_id": 11953, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813844.002097, "step_id": 11954, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813844.0161839, "step_id": 11955, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813844.0299022, "step_id": 11956, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813844.0442655, "step_id": 11957, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813844.0588605, "step_id": 11958, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813844.072648, "step_id": 11959, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813844.086053, "step_id": 11960, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813844.0993838, "step_id": 11961, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813844.110558, "step_id": 11962, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813844.1219714, "step_id": 11963, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813844.133757, "step_id": 11964, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813844.1450632, "step_id": 11965, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813844.156981, "step_id": 11966, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813844.1689413, "step_id": 11967, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813844.1784313, "step_id": 11968, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813844.1885986, "step_id": 11969, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813844.198788, "step_id": 11970, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813844.2087798, "step_id": 11971, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813844.218334, "step_id": 11972, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813844.227938, "step_id": 11973, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813844.2378316, "step_id": 11974, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813844.247612, "step_id": 11975, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813844.2571197, "step_id": 11976, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813844.2668276, "step_id": 11977, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813844.2769077, "step_id": 11978, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813844.286416, "step_id": 11979, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813844.2963378, "step_id": 11980, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813844.3063254, "step_id": 11981, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813844.3158517, "step_id": 11982, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813844.3259137, "step_id": 11983, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813844.3359823, "step_id": 11984, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813844.3458946, "step_id": 11985, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813844.3555884, "step_id": 11986, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813844.3656216, "step_id": 11987, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813844.375271, "step_id": 11988, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813844.3849163, "step_id": 11989, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813844.394784, "step_id": 11990, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813844.4044645, "step_id": 11991, "start_load_kv_us": 4, "get_finished_us": 159} +{"t_unix": 1779813844.4149067, "step_id": 11992, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813844.424912, "step_id": 11993, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813844.4353604, "step_id": 11994, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813844.4455366, "step_id": 11995, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813844.456032, "step_id": 11996, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813844.4663832, "step_id": 11997, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813844.4751067, "step_id": 11998, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813844.4838223, "step_id": 11999, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813844.4925199, "step_id": 12000, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813844.501468, "step_id": 12001, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813844.510397, "step_id": 12002, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813844.5192382, "step_id": 12003, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813844.5276756, "step_id": 12004, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813844.5363739, "step_id": 12005, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813844.545159, "step_id": 12006, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813844.5536044, "step_id": 12007, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813844.5622752, "step_id": 12008, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813844.5707643, "step_id": 12009, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813844.5795403, "step_id": 12010, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813844.5882545, "step_id": 12011, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813844.5968993, "step_id": 12012, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813844.605391, "step_id": 12013, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813844.613933, "step_id": 12014, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813844.6225276, "step_id": 12015, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813844.6311693, "step_id": 12016, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813844.6398432, "step_id": 12017, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813844.648503, "step_id": 12018, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813844.6572182, "step_id": 12019, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813844.6658616, "step_id": 12020, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813844.6747985, "step_id": 12021, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813844.6835175, "step_id": 12022, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813844.692679, "step_id": 12023, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813844.7013683, "step_id": 12024, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813844.7085836, "step_id": 12025, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813844.7161322, "step_id": 12026, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813844.7233362, "step_id": 12027, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813844.730146, "step_id": 12028, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813844.7369003, "step_id": 12029, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813844.7439256, "step_id": 12030, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813844.7510133, "step_id": 12031, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813844.758111, "step_id": 12032, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813844.7655203, "step_id": 12033, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813844.772633, "step_id": 12034, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813844.7801213, "step_id": 12035, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813844.78706, "step_id": 12036, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813844.7942495, "step_id": 12037, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813844.8011985, "step_id": 12038, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813844.808182, "step_id": 12039, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813844.8149593, "step_id": 12040, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813844.8221095, "step_id": 12041, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813844.8289328, "step_id": 12042, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813844.8360598, "step_id": 12043, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813844.8434603, "step_id": 12044, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813844.850682, "step_id": 12045, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813844.8582463, "step_id": 12046, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813844.865096, "step_id": 12047, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813844.872172, "step_id": 12048, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813844.8791206, "step_id": 12049, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813844.8860185, "step_id": 12050, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813844.893265, "step_id": 12051, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813844.8999202, "step_id": 12052, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813844.9066823, "step_id": 12053, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813844.9139116, "step_id": 12054, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813844.920382, "step_id": 12055, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813844.927788, "step_id": 12056, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813844.9350665, "step_id": 12057, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813844.9429348, "step_id": 12058, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813844.9501379, "step_id": 12059, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813844.9559255, "step_id": 12060, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813844.9618058, "step_id": 12061, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813844.9673758, "step_id": 12062, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813844.9730701, "step_id": 12063, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813844.9789655, "step_id": 12064, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813844.9848971, "step_id": 12065, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813844.9906917, "step_id": 12066, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813844.9961789, "step_id": 12067, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813845.001822, "step_id": 12068, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813845.007245, "step_id": 12069, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813845.0127158, "step_id": 12070, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813845.01853, "step_id": 12071, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813845.0242634, "step_id": 12072, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813845.030102, "step_id": 12073, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813845.0360963, "step_id": 12074, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813845.041817, "step_id": 12075, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813845.0474782, "step_id": 12076, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813845.0534008, "step_id": 12077, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813845.059085, "step_id": 12078, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813845.0646138, "step_id": 12079, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813845.0704043, "step_id": 12080, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813845.0763507, "step_id": 12081, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813845.0822375, "step_id": 12082, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813845.0883043, "step_id": 12083, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813845.0943027, "step_id": 12084, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813845.1002972, "step_id": 12085, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813845.1061234, "step_id": 12086, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813845.112075, "step_id": 12087, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813845.1182027, "step_id": 12088, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813845.124283, "step_id": 12089, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813845.1303043, "step_id": 12090, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813845.1362398, "step_id": 12091, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813845.142097, "step_id": 12092, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813845.147914, "step_id": 12093, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813845.1535237, "step_id": 12094, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813845.1592994, "step_id": 12095, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813845.164885, "step_id": 12096, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813845.1706448, "step_id": 12097, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813845.1762507, "step_id": 12098, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813845.1820724, "step_id": 12099, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813845.1876915, "step_id": 12100, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813845.1933923, "step_id": 12101, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813845.1993964, "step_id": 12102, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813845.2052333, "step_id": 12103, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813845.2110252, "step_id": 12104, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813845.216686, "step_id": 12105, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813845.2227776, "step_id": 12106, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813845.2287202, "step_id": 12107, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813845.2351377, "step_id": 12108, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813845.240411, "step_id": 12109, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813845.2458842, "step_id": 12110, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813845.2514143, "step_id": 12111, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813845.2572196, "step_id": 12112, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813845.2629879, "step_id": 12113, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813845.2687573, "step_id": 12114, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813845.2747838, "step_id": 12115, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813845.2807996, "step_id": 12116, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813845.2866802, "step_id": 12117, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813845.2925034, "step_id": 12118, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813845.2984517, "step_id": 12119, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813845.3044024, "step_id": 12120, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813845.3090582, "step_id": 12121, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813845.3138235, "step_id": 12122, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813845.3185296, "step_id": 12123, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813845.3232946, "step_id": 12124, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813845.3280525, "step_id": 12125, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813845.3328617, "step_id": 12126, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813845.3377035, "step_id": 12127, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813845.3423793, "step_id": 12128, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813845.3471718, "step_id": 12129, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813845.351966, "step_id": 12130, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813845.356781, "step_id": 12131, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813845.3614805, "step_id": 12132, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813845.366331, "step_id": 12133, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813845.3710382, "step_id": 12134, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813845.3758273, "step_id": 12135, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813845.380782, "step_id": 12136, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813845.3853936, "step_id": 12137, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813845.390147, "step_id": 12138, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813845.394963, "step_id": 12139, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813845.3997662, "step_id": 12140, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813845.4044755, "step_id": 12141, "start_load_kv_us": 1, "get_finished_us": 156} +{"t_unix": 1779813845.4089348, "step_id": 12142, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813845.4130695, "step_id": 12143, "start_load_kv_us": 1, "get_finished_us": 216} +{"t_unix": 1779813845.890501, "step_id": 12144, "start_load_kv_us": 3, "get_finished_us": 333} +{"t_unix": 1779813845.8924844, "step_id": 12145, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813846.0868833, "step_id": 12146, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813846.0912793, "step_id": 12147, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813846.0960073, "step_id": 12148, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813846.1007245, "step_id": 12149, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813846.1054208, "step_id": 12150, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813846.110206, "step_id": 12151, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813846.1150315, "step_id": 12152, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813846.1197312, "step_id": 12153, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813846.1245275, "step_id": 12154, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813846.1293254, "step_id": 12155, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813846.1341095, "step_id": 12156, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813846.1388261, "step_id": 12157, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813846.143516, "step_id": 12158, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813846.1483326, "step_id": 12159, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813846.1531713, "step_id": 12160, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813846.15799, "step_id": 12161, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813846.16276, "step_id": 12162, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813846.1674256, "step_id": 12163, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813846.1722672, "step_id": 12164, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813846.1770284, "step_id": 12165, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813846.1818004, "step_id": 12166, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813846.1865957, "step_id": 12167, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813846.1913977, "step_id": 12168, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813846.1961439, "step_id": 12169, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813846.2009954, "step_id": 12170, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813846.2058315, "step_id": 12171, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813846.210506, "step_id": 12172, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813846.215275, "step_id": 12173, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813846.2201002, "step_id": 12174, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813846.2247877, "step_id": 12175, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813846.2295332, "step_id": 12176, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813846.2344546, "step_id": 12177, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813846.239123, "step_id": 12178, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813846.244002, "step_id": 12179, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813846.2486563, "step_id": 12180, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813846.253508, "step_id": 12181, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813846.258155, "step_id": 12182, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813846.2630124, "step_id": 12183, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813846.2676878, "step_id": 12184, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813846.272568, "step_id": 12185, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813846.2772267, "step_id": 12186, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813846.2820852, "step_id": 12187, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813846.2868097, "step_id": 12188, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813846.2915218, "step_id": 12189, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813846.2962918, "step_id": 12190, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813846.301179, "step_id": 12191, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813846.3059216, "step_id": 12192, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813846.310698, "step_id": 12193, "start_load_kv_us": 1, "get_finished_us": 189} +{"t_unix": 1779813846.3154678, "step_id": 12194, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813846.3591383, "step_id": 12195, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813846.3612032, "step_id": 12196, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813846.561689, "step_id": 12197, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813846.566221, "step_id": 12198, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813846.5720155, "step_id": 12199, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813846.5774238, "step_id": 12200, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813846.5828538, "step_id": 12201, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813846.58841, "step_id": 12202, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813846.5940506, "step_id": 12203, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813846.5994942, "step_id": 12204, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813846.6053104, "step_id": 12205, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813846.6108198, "step_id": 12206, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813846.6165328, "step_id": 12207, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813846.6223407, "step_id": 12208, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813846.6280935, "step_id": 12209, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813846.6343465, "step_id": 12210, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813846.6404424, "step_id": 12211, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813846.646462, "step_id": 12212, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813846.652301, "step_id": 12213, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813846.6581786, "step_id": 12214, "start_load_kv_us": 2, "get_finished_us": 129} +{"t_unix": 1779813846.6640189, "step_id": 12215, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813846.669587, "step_id": 12216, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813846.6753273, "step_id": 12217, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813846.6814127, "step_id": 12218, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813846.687741, "step_id": 12219, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813846.693366, "step_id": 12220, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813846.6989374, "step_id": 12221, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813846.7050033, "step_id": 12222, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813846.7108953, "step_id": 12223, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813846.7167964, "step_id": 12224, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813846.7227488, "step_id": 12225, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813846.7285063, "step_id": 12226, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813846.7341714, "step_id": 12227, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813846.7399962, "step_id": 12228, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813846.7457159, "step_id": 12229, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813846.7515938, "step_id": 12230, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813846.7575006, "step_id": 12231, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813846.7633328, "step_id": 12232, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813846.7693617, "step_id": 12233, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813846.7748442, "step_id": 12234, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813846.7805853, "step_id": 12235, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813846.786342, "step_id": 12236, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813846.7919807, "step_id": 12237, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813846.7978644, "step_id": 12238, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813846.803891, "step_id": 12239, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813846.8098254, "step_id": 12240, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813846.8157384, "step_id": 12241, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813846.8218207, "step_id": 12242, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813846.8279397, "step_id": 12243, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813846.8726518, "step_id": 12244, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813846.8747277, "step_id": 12245, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813847.073355, "step_id": 12246, "start_load_kv_us": 3, "get_finished_us": 260} +{"t_unix": 1779813847.080453, "step_id": 12247, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813847.0876641, "step_id": 12248, "start_load_kv_us": 3, "get_finished_us": 177} +{"t_unix": 1779813847.094952, "step_id": 12249, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813847.102023, "step_id": 12250, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813847.1090343, "step_id": 12251, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813847.1154463, "step_id": 12252, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813847.1221993, "step_id": 12253, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813847.1291275, "step_id": 12254, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813847.136355, "step_id": 12255, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813847.1437035, "step_id": 12256, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813847.1507366, "step_id": 12257, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813847.1580966, "step_id": 12258, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813847.165272, "step_id": 12259, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813847.172256, "step_id": 12260, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813847.1793332, "step_id": 12261, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813847.1866868, "step_id": 12262, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813847.1937914, "step_id": 12263, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813847.2011414, "step_id": 12264, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813847.208596, "step_id": 12265, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813847.2159312, "step_id": 12266, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813847.223197, "step_id": 12267, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813847.2299752, "step_id": 12268, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813847.2366579, "step_id": 12269, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813847.2436607, "step_id": 12270, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813847.2508018, "step_id": 12271, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813847.2579706, "step_id": 12272, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813847.2649155, "step_id": 12273, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813847.2721448, "step_id": 12274, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813847.279715, "step_id": 12275, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813847.2872968, "step_id": 12276, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813847.294754, "step_id": 12277, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813847.302225, "step_id": 12278, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813847.3097472, "step_id": 12279, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813847.3171275, "step_id": 12280, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813847.324554, "step_id": 12281, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813847.3320775, "step_id": 12282, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813847.33925, "step_id": 12283, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813847.346422, "step_id": 12284, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813847.3537307, "step_id": 12285, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813847.3615372, "step_id": 12286, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813847.3689244, "step_id": 12287, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813847.3763163, "step_id": 12288, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813847.3830562, "step_id": 12289, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813847.3903208, "step_id": 12290, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813847.39759, "step_id": 12291, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813847.405065, "step_id": 12292, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813847.412418, "step_id": 12293, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813847.4198823, "step_id": 12294, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813847.4273512, "step_id": 12295, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813847.4349053, "step_id": 12296, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813847.4421911, "step_id": 12297, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813847.4493988, "step_id": 12298, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813847.4569175, "step_id": 12299, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813847.464202, "step_id": 12300, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813847.4716315, "step_id": 12301, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813847.4791865, "step_id": 12302, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813847.486747, "step_id": 12303, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813847.494282, "step_id": 12304, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813847.501637, "step_id": 12305, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813847.5089884, "step_id": 12306, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813847.516455, "step_id": 12307, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813847.523706, "step_id": 12308, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813847.5309942, "step_id": 12309, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813847.5384166, "step_id": 12310, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813847.545877, "step_id": 12311, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813847.5915802, "step_id": 12312, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813847.593584, "step_id": 12313, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813847.7956073, "step_id": 12314, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813847.8030446, "step_id": 12315, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813847.8107412, "step_id": 12316, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813847.818818, "step_id": 12317, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813847.8268044, "step_id": 12318, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813847.8349228, "step_id": 12319, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813847.842867, "step_id": 12320, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813847.8508818, "step_id": 12321, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813847.8591056, "step_id": 12322, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813847.8673003, "step_id": 12323, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813847.875361, "step_id": 12324, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813847.8834455, "step_id": 12325, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813847.891233, "step_id": 12326, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813847.899475, "step_id": 12327, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813847.9077983, "step_id": 12328, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813847.9158316, "step_id": 12329, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813847.9241438, "step_id": 12330, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813847.9320881, "step_id": 12331, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813847.9401987, "step_id": 12332, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813847.9482186, "step_id": 12333, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813847.956199, "step_id": 12334, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813847.964394, "step_id": 12335, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813847.9725418, "step_id": 12336, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813847.9805896, "step_id": 12337, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813847.9889803, "step_id": 12338, "start_load_kv_us": 3, "get_finished_us": 303} +{"t_unix": 1779813847.9968987, "step_id": 12339, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813848.004962, "step_id": 12340, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813848.0134273, "step_id": 12341, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813848.021343, "step_id": 12342, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813848.0295208, "step_id": 12343, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813848.0376556, "step_id": 12344, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813848.0456378, "step_id": 12345, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813848.0538592, "step_id": 12346, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813848.0616572, "step_id": 12347, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813848.0695934, "step_id": 12348, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813848.0775752, "step_id": 12349, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813848.0858655, "step_id": 12350, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813848.093904, "step_id": 12351, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813848.1020963, "step_id": 12352, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813848.1102438, "step_id": 12353, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813848.1182477, "step_id": 12354, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813848.1266406, "step_id": 12355, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813848.1345537, "step_id": 12356, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813848.1426895, "step_id": 12357, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813848.1507142, "step_id": 12358, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813848.1585264, "step_id": 12359, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813848.1665862, "step_id": 12360, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813848.1746829, "step_id": 12361, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813848.1829114, "step_id": 12362, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813848.1911352, "step_id": 12363, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.1991289, "step_id": 12364, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813848.2071035, "step_id": 12365, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813848.215078, "step_id": 12366, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813848.223073, "step_id": 12367, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813848.2312596, "step_id": 12368, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813848.2391498, "step_id": 12369, "start_load_kv_us": 1, "get_finished_us": 215} +{"t_unix": 1779813848.2468698, "step_id": 12370, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813848.2550156, "step_id": 12371, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813848.2628362, "step_id": 12372, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.270981, "step_id": 12373, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813848.2790837, "step_id": 12374, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813848.2871783, "step_id": 12375, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813848.2952218, "step_id": 12376, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813848.3032486, "step_id": 12377, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813848.3112328, "step_id": 12378, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.3191342, "step_id": 12379, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813848.3268673, "step_id": 12380, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813848.3342109, "step_id": 12381, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813848.341844, "step_id": 12382, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813848.3494, "step_id": 12383, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813848.357195, "step_id": 12384, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813848.3646178, "step_id": 12385, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813848.3722944, "step_id": 12386, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813848.3799877, "step_id": 12387, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.387594, "step_id": 12388, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813848.3951726, "step_id": 12389, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813848.4031258, "step_id": 12390, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813848.4111161, "step_id": 12391, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813848.4190633, "step_id": 12392, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813848.4266531, "step_id": 12393, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813848.4340603, "step_id": 12394, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813848.441995, "step_id": 12395, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813848.449965, "step_id": 12396, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813848.457865, "step_id": 12397, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813848.4658368, "step_id": 12398, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813848.47393, "step_id": 12399, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813848.4823956, "step_id": 12400, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813848.4903011, "step_id": 12401, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813848.497571, "step_id": 12402, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813848.5050626, "step_id": 12403, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813848.5124004, "step_id": 12404, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813848.5201776, "step_id": 12405, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813848.5275996, "step_id": 12406, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813848.5353477, "step_id": 12407, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.542967, "step_id": 12408, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813848.5505073, "step_id": 12409, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813848.5578575, "step_id": 12410, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813848.565346, "step_id": 12411, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813848.5730584, "step_id": 12412, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813848.5807226, "step_id": 12413, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813848.5882134, "step_id": 12414, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813848.595708, "step_id": 12415, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813848.603457, "step_id": 12416, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813848.611097, "step_id": 12417, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813848.6186125, "step_id": 12418, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813848.6262531, "step_id": 12419, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813848.6337605, "step_id": 12420, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813848.6414726, "step_id": 12421, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813848.6490512, "step_id": 12422, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813848.656373, "step_id": 12423, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813848.6639633, "step_id": 12424, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813848.6716218, "step_id": 12425, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813848.6793253, "step_id": 12426, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.6867592, "step_id": 12427, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813848.694137, "step_id": 12428, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813848.701717, "step_id": 12429, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813848.7089734, "step_id": 12430, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813848.715964, "step_id": 12431, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813848.7231584, "step_id": 12432, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813848.7304296, "step_id": 12433, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813848.7378962, "step_id": 12434, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813848.7454932, "step_id": 12435, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813848.7526112, "step_id": 12436, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813848.75989, "step_id": 12437, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813848.7667491, "step_id": 12438, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813848.7740886, "step_id": 12439, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813848.780998, "step_id": 12440, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813848.7882836, "step_id": 12441, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813848.7955282, "step_id": 12442, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813848.8024774, "step_id": 12443, "start_load_kv_us": 1, "get_finished_us": 165} +{"t_unix": 1779813848.8098774, "step_id": 12444, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813848.816711, "step_id": 12445, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813848.8237174, "step_id": 12446, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813848.8312283, "step_id": 12447, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813848.8382213, "step_id": 12448, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813848.8453858, "step_id": 12449, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813848.8524477, "step_id": 12450, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813848.860013, "step_id": 12451, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813848.867121, "step_id": 12452, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813848.872941, "step_id": 12453, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.8786829, "step_id": 12454, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813848.8843236, "step_id": 12455, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813848.8898458, "step_id": 12456, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813848.895263, "step_id": 12457, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813848.900772, "step_id": 12458, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813848.9065375, "step_id": 12459, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813848.9123662, "step_id": 12460, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813848.9196258, "step_id": 12461, "start_load_kv_us": 3, "get_finished_us": 297} +{"t_unix": 1779813848.9236927, "step_id": 12462, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813848.929104, "step_id": 12463, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813848.9350882, "step_id": 12464, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813848.9409206, "step_id": 12465, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813848.9469233, "step_id": 12466, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813848.9529276, "step_id": 12467, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813848.9587827, "step_id": 12468, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813848.9644315, "step_id": 12469, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813848.9702148, "step_id": 12470, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813848.9760573, "step_id": 12471, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813848.9817982, "step_id": 12472, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813848.9876075, "step_id": 12473, "start_load_kv_us": 1, "get_finished_us": 209} +{"t_unix": 1779813848.993382, "step_id": 12474, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813848.999256, "step_id": 12475, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813849.0052798, "step_id": 12476, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813849.010918, "step_id": 12477, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813849.0166612, "step_id": 12478, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813849.0226977, "step_id": 12479, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813849.0289195, "step_id": 12480, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813849.03477, "step_id": 12481, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813849.0406425, "step_id": 12482, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813849.0466278, "step_id": 12483, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813849.0552266, "step_id": 12484, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813849.058737, "step_id": 12485, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813849.064747, "step_id": 12486, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813849.070817, "step_id": 12487, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813849.0767796, "step_id": 12488, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813849.0824468, "step_id": 12489, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813849.0884097, "step_id": 12490, "start_load_kv_us": 1, "get_finished_us": 176} +{"t_unix": 1779813849.0944946, "step_id": 12491, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813849.1004026, "step_id": 12492, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813849.1065133, "step_id": 12493, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813849.1126409, "step_id": 12494, "start_load_kv_us": 1, "get_finished_us": 169} +{"t_unix": 1779813849.1187115, "step_id": 12495, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813849.1252372, "step_id": 12496, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813849.1307607, "step_id": 12497, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813849.1368015, "step_id": 12498, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813849.1428106, "step_id": 12499, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813849.148931, "step_id": 12500, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813849.1550496, "step_id": 12501, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813849.1595755, "step_id": 12502, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813849.1643295, "step_id": 12503, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813849.1691766, "step_id": 12504, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813849.1739097, "step_id": 12505, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813849.1787014, "step_id": 12506, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813849.1834133, "step_id": 12507, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813849.1881711, "step_id": 12508, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813849.1930377, "step_id": 12509, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813849.1977518, "step_id": 12510, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813849.2025197, "step_id": 12511, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813849.2073338, "step_id": 12512, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813849.2121236, "step_id": 12513, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813849.216859, "step_id": 12514, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813849.221637, "step_id": 12515, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813849.2263122, "step_id": 12516, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813849.2311323, "step_id": 12517, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813849.235987, "step_id": 12518, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813849.2407253, "step_id": 12519, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813849.2454624, "step_id": 12520, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813849.2502372, "step_id": 12521, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813849.2550802, "step_id": 12522, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813849.2598128, "step_id": 12523, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813849.2645862, "step_id": 12524, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813849.269294, "step_id": 12525, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813849.2741141, "step_id": 12526, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813849.278988, "step_id": 12527, "start_load_kv_us": 3, "get_finished_us": 156} +{"t_unix": 1779813849.2837324, "step_id": 12528, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813849.2884238, "step_id": 12529, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813849.2932472, "step_id": 12530, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813849.2979903, "step_id": 12531, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813849.3027482, "step_id": 12532, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813849.3075335, "step_id": 12533, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813849.3122754, "step_id": 12534, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813849.3170636, "step_id": 12535, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813849.321981, "step_id": 12536, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813849.3292954, "step_id": 12537, "start_load_kv_us": 9, "get_finished_us": 816} +{"t_unix": 1779813849.3326108, "step_id": 12538, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813849.3364034, "step_id": 12539, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813849.341385, "step_id": 12540, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813849.346393, "step_id": 12541, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813849.3509896, "step_id": 12542, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813849.3554914, "step_id": 12543, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813849.3601153, "step_id": 12544, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813849.3649747, "step_id": 12545, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813849.3697042, "step_id": 12546, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813849.3744497, "step_id": 12547, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813849.3792229, "step_id": 12548, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813849.3841145, "step_id": 12549, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813849.388811, "step_id": 12550, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813849.3935199, "step_id": 12551, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813849.3982444, "step_id": 12552, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813849.403085, "step_id": 12553, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813849.4078927, "step_id": 12554, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813849.4128242, "step_id": 12555, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813849.4173512, "step_id": 12556, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813849.4221463, "step_id": 12557, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813849.4269242, "step_id": 12558, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813849.431703, "step_id": 12559, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813849.4364676, "step_id": 12560, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813849.441312, "step_id": 12561, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813849.4460206, "step_id": 12562, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813849.450796, "step_id": 12563, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813849.4555612, "step_id": 12564, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813849.460368, "step_id": 12565, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813849.4651508, "step_id": 12566, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813849.4702077, "step_id": 12567, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813849.4745264, "step_id": 12568, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813849.4785326, "step_id": 12569, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813849.9567204, "step_id": 12570, "start_load_kv_us": 3, "get_finished_us": 350} +{"t_unix": 1779813849.9588726, "step_id": 12571, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813850.155467, "step_id": 12572, "start_load_kv_us": 3, "get_finished_us": 344} +{"t_unix": 1779813850.1594868, "step_id": 12573, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813850.1642363, "step_id": 12574, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813850.1690361, "step_id": 12575, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813850.173709, "step_id": 12576, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813850.1784174, "step_id": 12577, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813850.1831675, "step_id": 12578, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813850.1879961, "step_id": 12579, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813850.1955602, "step_id": 12580, "start_load_kv_us": 7, "get_finished_us": 1815} +{"t_unix": 1779813850.1981795, "step_id": 12581, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813850.2023115, "step_id": 12582, "start_load_kv_us": 2, "get_finished_us": 302} +{"t_unix": 1779813850.2071493, "step_id": 12583, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813850.212072, "step_id": 12584, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813850.216615, "step_id": 12585, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813850.2213843, "step_id": 12586, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813850.2262623, "step_id": 12587, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813850.2310412, "step_id": 12588, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813850.2358844, "step_id": 12589, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813850.2403612, "step_id": 12590, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813850.245222, "step_id": 12591, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813850.2499893, "step_id": 12592, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813850.2545764, "step_id": 12593, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813850.2592955, "step_id": 12594, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813850.2641866, "step_id": 12595, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813850.2688434, "step_id": 12596, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813850.2736452, "step_id": 12597, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813850.2782972, "step_id": 12598, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813850.2830887, "step_id": 12599, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813850.2878692, "step_id": 12600, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813850.2926114, "step_id": 12601, "start_load_kv_us": 1, "get_finished_us": 198} +{"t_unix": 1779813850.297369, "step_id": 12602, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813850.302337, "step_id": 12603, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813850.3070009, "step_id": 12604, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813850.3118339, "step_id": 12605, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813850.3165283, "step_id": 12606, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813850.3211942, "step_id": 12607, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813850.3259525, "step_id": 12608, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813850.3308332, "step_id": 12609, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813850.335523, "step_id": 12610, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813850.3403301, "step_id": 12611, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813850.3450325, "step_id": 12612, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813850.3498383, "step_id": 12613, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813850.354532, "step_id": 12614, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813850.35929, "step_id": 12615, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813850.3640537, "step_id": 12616, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813850.3688483, "step_id": 12617, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813850.3736002, "step_id": 12618, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813850.3783808, "step_id": 12619, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813850.383153, "step_id": 12620, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813850.3879113, "step_id": 12621, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813850.3927083, "step_id": 12622, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813850.3974788, "step_id": 12623, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813850.4022303, "step_id": 12624, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813850.4070303, "step_id": 12625, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813850.4118938, "step_id": 12626, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813850.4165428, "step_id": 12627, "start_load_kv_us": 1, "get_finished_us": 149} +{"t_unix": 1779813850.4213703, "step_id": 12628, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813850.4261932, "step_id": 12629, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813850.431165, "step_id": 12630, "start_load_kv_us": 2, "get_finished_us": 339} +{"t_unix": 1779813850.4360442, "step_id": 12631, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813850.4405751, "step_id": 12632, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813850.4452672, "step_id": 12633, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813850.449986, "step_id": 12634, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813850.4547997, "step_id": 12635, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813850.4595363, "step_id": 12636, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813850.464298, "step_id": 12637, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813850.4690669, "step_id": 12638, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813850.473882, "step_id": 12639, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813850.4785957, "step_id": 12640, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813850.48338, "step_id": 12641, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813850.4881735, "step_id": 12642, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813850.4929872, "step_id": 12643, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813850.4977705, "step_id": 12644, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813850.5025856, "step_id": 12645, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813850.5072217, "step_id": 12646, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813850.5120971, "step_id": 12647, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813850.5167801, "step_id": 12648, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813850.5215387, "step_id": 12649, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813850.526274, "step_id": 12650, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813850.5310645, "step_id": 12651, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813850.5358648, "step_id": 12652, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813850.5406353, "step_id": 12653, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813850.5453522, "step_id": 12654, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813850.550134, "step_id": 12655, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813850.5548887, "step_id": 12656, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813850.5596633, "step_id": 12657, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813850.564407, "step_id": 12658, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813850.569202, "step_id": 12659, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813850.573964, "step_id": 12660, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813850.5788524, "step_id": 12661, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813850.5834649, "step_id": 12662, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813850.5882232, "step_id": 12663, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813850.593046, "step_id": 12664, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813850.5978177, "step_id": 12665, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813850.6025443, "step_id": 12666, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813850.6073503, "step_id": 12667, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813850.6121814, "step_id": 12668, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813850.6169083, "step_id": 12669, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813850.6217191, "step_id": 12670, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813850.6264472, "step_id": 12671, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813850.6312163, "step_id": 12672, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813850.6360314, "step_id": 12673, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813850.6408079, "step_id": 12674, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813850.6455052, "step_id": 12675, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813850.6503274, "step_id": 12676, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813850.65518, "step_id": 12677, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813850.6599386, "step_id": 12678, "start_load_kv_us": 1, "get_finished_us": 164} +{"t_unix": 1779813850.664683, "step_id": 12679, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813850.6694593, "step_id": 12680, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813850.6742349, "step_id": 12681, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813850.6790206, "step_id": 12682, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813850.6838243, "step_id": 12683, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813850.6885698, "step_id": 12684, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813850.6933398, "step_id": 12685, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813850.698157, "step_id": 12686, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813850.7029054, "step_id": 12687, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813850.7076879, "step_id": 12688, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813850.712583, "step_id": 12689, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813850.7172675, "step_id": 12690, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813850.7220602, "step_id": 12691, "start_load_kv_us": 1, "get_finished_us": 206} +{"t_unix": 1779813850.7643697, "step_id": 12692, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813850.7664785, "step_id": 12693, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813850.9681382, "step_id": 12694, "start_load_kv_us": 3, "get_finished_us": 354} +{"t_unix": 1779813850.9731593, "step_id": 12695, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813850.9787946, "step_id": 12696, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813850.9846787, "step_id": 12697, "start_load_kv_us": 1, "get_finished_us": 308} +{"t_unix": 1779813850.9907236, "step_id": 12698, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813850.9967244, "step_id": 12699, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813851.002832, "step_id": 12700, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813851.008869, "step_id": 12701, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.014935, "step_id": 12702, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813851.0207956, "step_id": 12703, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813851.0266917, "step_id": 12704, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813851.0326781, "step_id": 12705, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813851.0386348, "step_id": 12706, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813851.0444007, "step_id": 12707, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813851.0501995, "step_id": 12708, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813851.0556607, "step_id": 12709, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813851.0610385, "step_id": 12710, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813851.0667257, "step_id": 12711, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813851.072463, "step_id": 12712, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813851.078348, "step_id": 12713, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.084527, "step_id": 12714, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813851.090253, "step_id": 12715, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813851.0961418, "step_id": 12716, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813851.102081, "step_id": 12717, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813851.108029, "step_id": 12718, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813851.1140258, "step_id": 12719, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813851.1197228, "step_id": 12720, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813851.1256816, "step_id": 12721, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813851.1318758, "step_id": 12722, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813851.1379106, "step_id": 12723, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813851.1436265, "step_id": 12724, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813851.1494613, "step_id": 12725, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813851.1550965, "step_id": 12726, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813851.1611538, "step_id": 12727, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813851.167248, "step_id": 12728, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813851.173377, "step_id": 12729, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813851.1793423, "step_id": 12730, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813851.1850555, "step_id": 12731, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813851.1910298, "step_id": 12732, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813851.196954, "step_id": 12733, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813851.2027013, "step_id": 12734, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813851.2087588, "step_id": 12735, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813851.2147498, "step_id": 12736, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813851.220908, "step_id": 12737, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813851.226693, "step_id": 12738, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.232686, "step_id": 12739, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813851.2388246, "step_id": 12740, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813851.2450058, "step_id": 12741, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813851.2508407, "step_id": 12742, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813851.2566297, "step_id": 12743, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813851.2625961, "step_id": 12744, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813851.2686336, "step_id": 12745, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813851.2747645, "step_id": 12746, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813851.280855, "step_id": 12747, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813851.2867916, "step_id": 12748, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813851.2929108, "step_id": 12749, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813851.2989767, "step_id": 12750, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813851.304633, "step_id": 12751, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813851.3103487, "step_id": 12752, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813851.3163946, "step_id": 12753, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813851.3224635, "step_id": 12754, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813851.328361, "step_id": 12755, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813851.334277, "step_id": 12756, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813851.3402905, "step_id": 12757, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813851.3462996, "step_id": 12758, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813851.3522058, "step_id": 12759, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813851.3580658, "step_id": 12760, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813851.3638701, "step_id": 12761, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813851.3699043, "step_id": 12762, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813851.3756812, "step_id": 12763, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813851.3817072, "step_id": 12764, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813851.3877933, "step_id": 12765, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813851.3937829, "step_id": 12766, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813851.3996596, "step_id": 12767, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813851.4055154, "step_id": 12768, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813851.41141, "step_id": 12769, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813851.417141, "step_id": 12770, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813851.422704, "step_id": 12771, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813851.4284673, "step_id": 12772, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813851.43438, "step_id": 12773, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813851.440259, "step_id": 12774, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813851.4463124, "step_id": 12775, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813851.4523945, "step_id": 12776, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813851.4582765, "step_id": 12777, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813851.4644032, "step_id": 12778, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813851.470244, "step_id": 12779, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813851.4759595, "step_id": 12780, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813851.482044, "step_id": 12781, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813851.4881, "step_id": 12782, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813851.4942515, "step_id": 12783, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813851.500387, "step_id": 12784, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813851.5064197, "step_id": 12785, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813851.5123901, "step_id": 12786, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813851.518389, "step_id": 12787, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813851.5243113, "step_id": 12788, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813851.530233, "step_id": 12789, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813851.5360508, "step_id": 12790, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813851.5418384, "step_id": 12791, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813851.54753, "step_id": 12792, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813851.5534887, "step_id": 12793, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813851.559531, "step_id": 12794, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813851.5650723, "step_id": 12795, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.570756, "step_id": 12796, "start_load_kv_us": 14, "get_finished_us": 165} +{"t_unix": 1779813851.5766726, "step_id": 12797, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813851.5824325, "step_id": 12798, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813851.5880313, "step_id": 12799, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813851.5936337, "step_id": 12800, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813851.599364, "step_id": 12801, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813851.6053205, "step_id": 12802, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813851.6110716, "step_id": 12803, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813851.616914, "step_id": 12804, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813851.6228652, "step_id": 12805, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813851.628739, "step_id": 12806, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813851.6346588, "step_id": 12807, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.6406045, "step_id": 12808, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813851.6466503, "step_id": 12809, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813851.652717, "step_id": 12810, "start_load_kv_us": 1, "get_finished_us": 191} +{"t_unix": 1779813851.6583993, "step_id": 12811, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813851.664097, "step_id": 12812, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813851.6702178, "step_id": 12813, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813851.6761878, "step_id": 12814, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813851.6821992, "step_id": 12815, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813851.6883326, "step_id": 12816, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813851.6943667, "step_id": 12817, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813851.700303, "step_id": 12818, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813851.7060342, "step_id": 12819, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813851.7117863, "step_id": 12820, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813851.7175968, "step_id": 12821, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813851.7233748, "step_id": 12822, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813851.729215, "step_id": 12823, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813851.7352545, "step_id": 12824, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.741136, "step_id": 12825, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813851.7475982, "step_id": 12826, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813851.7535138, "step_id": 12827, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813851.758125, "step_id": 12828, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813851.7628803, "step_id": 12829, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813851.7676291, "step_id": 12830, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813851.772431, "step_id": 12831, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813851.7771826, "step_id": 12832, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813851.7824614, "step_id": 12833, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813851.7869, "step_id": 12834, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813851.7915657, "step_id": 12835, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813851.7963476, "step_id": 12836, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813851.8011205, "step_id": 12837, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813851.805937, "step_id": 12838, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813851.8107226, "step_id": 12839, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813851.8154721, "step_id": 12840, "start_load_kv_us": 1, "get_finished_us": 184} +{"t_unix": 1779813851.8202643, "step_id": 12841, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813851.8251097, "step_id": 12842, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.829818, "step_id": 12843, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813851.834594, "step_id": 12844, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813851.8393512, "step_id": 12845, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813851.8441522, "step_id": 12846, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813851.8489332, "step_id": 12847, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813851.8536384, "step_id": 12848, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813851.8583937, "step_id": 12849, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813851.8632271, "step_id": 12850, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813851.8679922, "step_id": 12851, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813851.872756, "step_id": 12852, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813851.877537, "step_id": 12853, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813851.8823125, "step_id": 12854, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813851.8871293, "step_id": 12855, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813851.8918786, "step_id": 12856, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813851.89663, "step_id": 12857, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813851.9014604, "step_id": 12858, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813851.9062543, "step_id": 12859, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813851.9110413, "step_id": 12860, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813851.915873, "step_id": 12861, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813851.920565, "step_id": 12862, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813851.9253182, "step_id": 12863, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813851.9302304, "step_id": 12864, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813851.9350083, "step_id": 12865, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813851.9396951, "step_id": 12866, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813851.9444213, "step_id": 12867, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813851.9491796, "step_id": 12868, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813851.9540026, "step_id": 12869, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813851.958737, "step_id": 12870, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813851.963465, "step_id": 12871, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813851.968259, "step_id": 12872, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813851.9730234, "step_id": 12873, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813851.977863, "step_id": 12874, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813851.982576, "step_id": 12875, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813851.9873586, "step_id": 12876, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813851.9921334, "step_id": 12877, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813851.9969354, "step_id": 12878, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813852.001725, "step_id": 12879, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813852.0065095, "step_id": 12880, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813852.011243, "step_id": 12881, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813852.0160573, "step_id": 12882, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813852.0208788, "step_id": 12883, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813852.025621, "step_id": 12884, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813852.0304046, "step_id": 12885, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813852.0351927, "step_id": 12886, "start_load_kv_us": 2, "get_finished_us": 129} +{"t_unix": 1779813852.0400026, "step_id": 12887, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813852.0447981, "step_id": 12888, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813852.0496144, "step_id": 12889, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813852.0543993, "step_id": 12890, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813852.0591445, "step_id": 12891, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813852.06398, "step_id": 12892, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813852.068738, "step_id": 12893, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813852.073497, "step_id": 12894, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813852.0782392, "step_id": 12895, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813852.0830789, "step_id": 12896, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813852.0878649, "step_id": 12897, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813852.0925825, "step_id": 12898, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813852.0973756, "step_id": 12899, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813852.1021507, "step_id": 12900, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813852.1069994, "step_id": 12901, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813852.111712, "step_id": 12902, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813852.116451, "step_id": 12903, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813852.1212254, "step_id": 12904, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813852.1260474, "step_id": 12905, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813852.1308475, "step_id": 12906, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813852.1355073, "step_id": 12907, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813852.1402783, "step_id": 12908, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813852.1450536, "step_id": 12909, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813852.1498437, "step_id": 12910, "start_load_kv_us": 1, "get_finished_us": 134} +{"t_unix": 1779813852.1546416, "step_id": 12911, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813852.1593866, "step_id": 12912, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813852.1642041, "step_id": 12913, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813852.1690338, "step_id": 12914, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813852.1737556, "step_id": 12915, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813852.178519, "step_id": 12916, "start_load_kv_us": 1, "get_finished_us": 148} +{"t_unix": 1779813852.1833525, "step_id": 12917, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813852.1881218, "step_id": 12918, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813852.19294, "step_id": 12919, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813852.1977262, "step_id": 12920, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813852.2024536, "step_id": 12921, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813852.207344, "step_id": 12922, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813852.212067, "step_id": 12923, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813852.216856, "step_id": 12924, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813852.2216263, "step_id": 12925, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813852.2264302, "step_id": 12926, "start_load_kv_us": 1, "get_finished_us": 146} +{"t_unix": 1779813852.2311502, "step_id": 12927, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813852.2360182, "step_id": 12928, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813852.2407932, "step_id": 12929, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813852.2455199, "step_id": 12930, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813852.2502449, "step_id": 12931, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813852.2550945, "step_id": 12932, "start_load_kv_us": 1, "get_finished_us": 151} +{"t_unix": 1779813852.259854, "step_id": 12933, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813852.264614, "step_id": 12934, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813852.2693698, "step_id": 12935, "start_load_kv_us": 1, "get_finished_us": 133} +{"t_unix": 1779813852.274196, "step_id": 12936, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813852.278919, "step_id": 12937, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813852.2838476, "step_id": 12938, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813852.2885365, "step_id": 12939, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813852.2933073, "step_id": 12940, "start_load_kv_us": 1, "get_finished_us": 137} +{"t_unix": 1779813852.298105, "step_id": 12941, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813852.3028743, "step_id": 12942, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813852.3076465, "step_id": 12943, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813852.312407, "step_id": 12944, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813852.3171804, "step_id": 12945, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813852.3219614, "step_id": 12946, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813852.326729, "step_id": 12947, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813852.3310986, "step_id": 12948, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813852.335223, "step_id": 12949, "start_load_kv_us": 1, "get_finished_us": 132} +{"t_unix": 1779813852.4203389, "step_id": 12950, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813852.4221845, "step_id": 12951, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813852.6565387, "step_id": 12952, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813852.65864, "step_id": 12953, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813852.8537958, "step_id": 12954, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813852.8591776, "step_id": 12955, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813852.8657267, "step_id": 12956, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813852.9068608, "step_id": 12957, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813852.9088748, "step_id": 12958, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813853.1116462, "step_id": 12959, "start_load_kv_us": 2, "get_finished_us": 349} +{"t_unix": 1779813853.1178102, "step_id": 12960, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813853.124506, "step_id": 12961, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813853.1316411, "step_id": 12962, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813853.1384523, "step_id": 12963, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813853.1456704, "step_id": 12964, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813853.1529706, "step_id": 12965, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813853.1602437, "step_id": 12966, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813853.1674852, "step_id": 12967, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813853.1746309, "step_id": 12968, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813853.1814272, "step_id": 12969, "start_load_kv_us": 1, "get_finished_us": 150} +{"t_unix": 1779813853.1883996, "step_id": 12970, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813853.1951544, "step_id": 12971, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813853.2020767, "step_id": 12972, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813853.2093863, "step_id": 12973, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813853.216775, "step_id": 12974, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813853.2235398, "step_id": 12975, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813853.2302265, "step_id": 12976, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813853.2369611, "step_id": 12977, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813853.2435973, "step_id": 12978, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813853.2503142, "step_id": 12979, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813853.2574317, "step_id": 12980, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813853.2640922, "step_id": 12981, "start_load_kv_us": 1, "get_finished_us": 172} +{"t_unix": 1779813853.2712638, "step_id": 12982, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813853.2783158, "step_id": 12983, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813853.2857773, "step_id": 12984, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813853.2931128, "step_id": 12985, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813853.300092, "step_id": 12986, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813853.3073618, "step_id": 12987, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813853.3149161, "step_id": 12988, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813853.3215966, "step_id": 12989, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813853.3287225, "step_id": 12990, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813853.335844, "step_id": 12991, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813853.3427422, "step_id": 12992, "start_load_kv_us": 13, "get_finished_us": 151} +{"t_unix": 1779813853.349579, "step_id": 12993, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813853.3561199, "step_id": 12994, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813853.363127, "step_id": 12995, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813853.3700266, "step_id": 12996, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813853.377154, "step_id": 12997, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813853.3840215, "step_id": 12998, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813853.3908572, "step_id": 12999, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813853.3981688, "step_id": 13000, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813853.4051037, "step_id": 13001, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813853.4123652, "step_id": 13002, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813853.4198902, "step_id": 13003, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813853.4275358, "step_id": 13004, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813853.434541, "step_id": 13005, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813853.4418373, "step_id": 13006, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813853.4492483, "step_id": 13007, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813853.4564312, "step_id": 13008, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813853.4638238, "step_id": 13009, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813853.4711215, "step_id": 13010, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813853.478609, "step_id": 13011, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813853.4860682, "step_id": 13012, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813853.4934828, "step_id": 13013, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813853.5008373, "step_id": 13014, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813853.5080607, "step_id": 13015, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813853.5153785, "step_id": 13016, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813853.5222743, "step_id": 13017, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813853.5297265, "step_id": 13018, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813853.5371716, "step_id": 13019, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813853.5444844, "step_id": 13020, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813853.5518005, "step_id": 13021, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813853.558737, "step_id": 13022, "start_load_kv_us": 3, "get_finished_us": 145} +{"t_unix": 1779813853.5661275, "step_id": 13023, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813853.5735068, "step_id": 13024, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813853.5805764, "step_id": 13025, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813853.5880861, "step_id": 13026, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813853.5953066, "step_id": 13027, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813853.6026802, "step_id": 13028, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813853.60973, "step_id": 13029, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813853.6161497, "step_id": 13030, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813853.6228135, "step_id": 13031, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813853.6297848, "step_id": 13032, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813853.6366966, "step_id": 13033, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813853.6438656, "step_id": 13034, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813853.6511645, "step_id": 13035, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813853.6585736, "step_id": 13036, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813853.6657925, "step_id": 13037, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813853.6730185, "step_id": 13038, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813853.7176216, "step_id": 13039, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813853.7197425, "step_id": 13040, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813853.9214935, "step_id": 13041, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813853.9292557, "step_id": 13042, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813853.9371946, "step_id": 13043, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813853.945147, "step_id": 13044, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813853.9530547, "step_id": 13045, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813853.9609573, "step_id": 13046, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813853.9686744, "step_id": 13047, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813853.9763532, "step_id": 13048, "start_load_kv_us": 1, "get_finished_us": 154} +{"t_unix": 1779813853.9839587, "step_id": 13049, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813853.9917405, "step_id": 13050, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813853.9992223, "step_id": 13051, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813854.0066173, "step_id": 13052, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813854.0136538, "step_id": 13053, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813854.0212657, "step_id": 13054, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813854.028754, "step_id": 13055, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813854.0364482, "step_id": 13056, "start_load_kv_us": 1, "get_finished_us": 138} +{"t_unix": 1779813854.044199, "step_id": 13057, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813854.0517795, "step_id": 13058, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813854.0595298, "step_id": 13059, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813854.0674617, "step_id": 13060, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813854.0751295, "step_id": 13061, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.0828931, "step_id": 13062, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813854.0906775, "step_id": 13063, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.0983603, "step_id": 13064, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813854.1058643, "step_id": 13065, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813854.113636, "step_id": 13066, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.1213977, "step_id": 13067, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813854.1290438, "step_id": 13068, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813854.1362317, "step_id": 13069, "start_load_kv_us": 1, "get_finished_us": 153} +{"t_unix": 1779813854.1439912, "step_id": 13070, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813854.151019, "step_id": 13071, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813854.1581342, "step_id": 13072, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813854.1653965, "step_id": 13073, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813854.1732059, "step_id": 13074, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813854.1807227, "step_id": 13075, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813854.18831, "step_id": 13076, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813854.1960952, "step_id": 13077, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813854.2036066, "step_id": 13078, "start_load_kv_us": 1, "get_finished_us": 173} +{"t_unix": 1779813854.2112384, "step_id": 13079, "start_load_kv_us": 1, "get_finished_us": 174} +{"t_unix": 1779813854.2192078, "step_id": 13080, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813854.2267737, "step_id": 13081, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813854.2345111, "step_id": 13082, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813854.2420552, "step_id": 13083, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.249298, "step_id": 13084, "start_load_kv_us": 1, "get_finished_us": 140} +{"t_unix": 1779813854.256707, "step_id": 13085, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813854.2646606, "step_id": 13086, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813854.2726593, "step_id": 13087, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813854.280412, "step_id": 13088, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.2881038, "step_id": 13089, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813854.2958188, "step_id": 13090, "start_load_kv_us": 1, "get_finished_us": 152} +{"t_unix": 1779813854.3036282, "step_id": 13091, "start_load_kv_us": 1, "get_finished_us": 160} +{"t_unix": 1779813854.3114803, "step_id": 13092, "start_load_kv_us": 1, "get_finished_us": 171} +{"t_unix": 1779813854.3192418, "step_id": 13093, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813854.3269835, "step_id": 13094, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813854.3349376, "step_id": 13095, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813854.3428454, "step_id": 13096, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813854.3505838, "step_id": 13097, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813854.3586082, "step_id": 13098, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813854.3664947, "step_id": 13099, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813854.374526, "step_id": 13100, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.3825316, "step_id": 13101, "start_load_kv_us": 1, "get_finished_us": 170} +{"t_unix": 1779813854.3907208, "step_id": 13102, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813854.3988712, "step_id": 13103, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813854.4068816, "step_id": 13104, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813854.4149601, "step_id": 13105, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813854.4230464, "step_id": 13106, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813854.4311202, "step_id": 13107, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813854.439369, "step_id": 13108, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813854.4474106, "step_id": 13109, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813854.4555182, "step_id": 13110, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813854.4638171, "step_id": 13111, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813854.4718409, "step_id": 13112, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813854.4798932, "step_id": 13113, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813854.4880822, "step_id": 13114, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813854.4961755, "step_id": 13115, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813854.5044103, "step_id": 13116, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813854.5125434, "step_id": 13117, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813854.520768, "step_id": 13118, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813854.5289874, "step_id": 13119, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813854.5369847, "step_id": 13120, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813854.5450997, "step_id": 13121, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813854.553136, "step_id": 13122, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813854.5988107, "step_id": 13123, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813854.6010652, "step_id": 13124, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813854.80476, "step_id": 13125, "start_load_kv_us": 3, "get_finished_us": 339} +{"t_unix": 1779813854.81351, "step_id": 13126, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813854.8227806, "step_id": 13127, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813854.8324, "step_id": 13128, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813854.8420346, "step_id": 13129, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813854.8516912, "step_id": 13130, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813854.8611894, "step_id": 13131, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813854.870792, "step_id": 13132, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813854.880605, "step_id": 13133, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813854.8901947, "step_id": 13134, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813854.8999014, "step_id": 13135, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813854.909843, "step_id": 13136, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813854.9194963, "step_id": 13137, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813854.9292977, "step_id": 13138, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813854.938993, "step_id": 13139, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813854.9486806, "step_id": 13140, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813854.9582164, "step_id": 13141, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813854.9682918, "step_id": 13142, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813854.9783645, "step_id": 13143, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813854.9886432, "step_id": 13144, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813854.99876, "step_id": 13145, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813855.0092216, "step_id": 13146, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813855.0188222, "step_id": 13147, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813855.028511, "step_id": 13148, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813855.0382578, "step_id": 13149, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813855.048101, "step_id": 13150, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813855.0576503, "step_id": 13151, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813855.0671554, "step_id": 13152, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813855.0766044, "step_id": 13153, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813855.085934, "step_id": 13154, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813855.0953565, "step_id": 13155, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813855.1049047, "step_id": 13156, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813855.1140192, "step_id": 13157, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813855.1234505, "step_id": 13158, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813855.1329691, "step_id": 13159, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813855.1424832, "step_id": 13160, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813855.1518972, "step_id": 13161, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813855.1613817, "step_id": 13162, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813855.170448, "step_id": 13163, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813855.1795087, "step_id": 13164, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813855.1887136, "step_id": 13165, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813855.1982176, "step_id": 13166, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813855.2080536, "step_id": 13167, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813855.2176394, "step_id": 13168, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813855.2267003, "step_id": 13169, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813855.238306, "step_id": 13170, "start_load_kv_us": 2, "get_finished_us": 332} +{"t_unix": 1779813855.2455134, "step_id": 13171, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813855.2550707, "step_id": 13172, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813855.2645352, "step_id": 13173, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813855.274003, "step_id": 13174, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813855.283339, "step_id": 13175, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813855.2923691, "step_id": 13176, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813855.3017495, "step_id": 13177, "start_load_kv_us": 15, "get_finished_us": 155} +{"t_unix": 1779813855.3111053, "step_id": 13178, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813855.3207605, "step_id": 13179, "start_load_kv_us": 13, "get_finished_us": 168} +{"t_unix": 1779813855.330297, "step_id": 13180, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813855.339994, "step_id": 13181, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813855.3493814, "step_id": 13182, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813855.3588216, "step_id": 13183, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813855.368179, "step_id": 13184, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813855.3775957, "step_id": 13185, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813855.3868449, "step_id": 13186, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813855.3961685, "step_id": 13187, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813855.4053671, "step_id": 13188, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813855.4150255, "step_id": 13189, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813855.4245071, "step_id": 13190, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813855.4344985, "step_id": 13191, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813855.4443104, "step_id": 13192, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813855.4537163, "step_id": 13193, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813855.4632418, "step_id": 13194, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813855.472634, "step_id": 13195, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813855.4821239, "step_id": 13196, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813855.4913979, "step_id": 13197, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813855.5010743, "step_id": 13198, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813855.5103693, "step_id": 13199, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813855.5202057, "step_id": 13200, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813855.5301752, "step_id": 13201, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813855.5400097, "step_id": 13202, "start_load_kv_us": 3, "get_finished_us": 159} +{"t_unix": 1779813855.5499225, "step_id": 13203, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813855.5595684, "step_id": 13204, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813855.569096, "step_id": 13205, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813855.5789578, "step_id": 13206, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813855.5885272, "step_id": 13207, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813855.5963182, "step_id": 13208, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813855.6039205, "step_id": 13209, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813855.6113477, "step_id": 13210, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813855.6184883, "step_id": 13211, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813855.6261096, "step_id": 13212, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813855.6337306, "step_id": 13213, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813855.6408026, "step_id": 13214, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813855.646124, "step_id": 13215, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813855.6520512, "step_id": 13216, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813855.6581, "step_id": 13217, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813855.6639667, "step_id": 13218, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813855.6698773, "step_id": 13219, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813855.6757212, "step_id": 13220, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813855.6813712, "step_id": 13221, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813855.6873791, "step_id": 13222, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813855.6935296, "step_id": 13223, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813855.6993034, "step_id": 13224, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813855.7052748, "step_id": 13225, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813855.7114499, "step_id": 13226, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813855.717449, "step_id": 13227, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813855.7236109, "step_id": 13228, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813855.729604, "step_id": 13229, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813855.7358153, "step_id": 13230, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813855.780413, "step_id": 13231, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813855.7824256, "step_id": 13232, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813856.0208337, "step_id": 13233, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813856.0230405, "step_id": 13234, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813856.2623456, "step_id": 13235, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813856.2645955, "step_id": 13236, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813856.4673996, "step_id": 13237, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813856.476246, "step_id": 13238, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813856.4854944, "step_id": 13239, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813856.494867, "step_id": 13240, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813856.5040886, "step_id": 13241, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813856.513522, "step_id": 13242, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813856.522833, "step_id": 13243, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813856.5321548, "step_id": 13244, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813856.541507, "step_id": 13245, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813856.5507917, "step_id": 13246, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813856.5972395, "step_id": 13247, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813856.5994952, "step_id": 13248, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813856.80522, "step_id": 13249, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813856.8142302, "step_id": 13250, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813856.8234563, "step_id": 13251, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813856.8323362, "step_id": 13252, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813856.8413494, "step_id": 13253, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813856.8500164, "step_id": 13254, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813856.8590844, "step_id": 13255, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813856.8681312, "step_id": 13256, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813856.8769925, "step_id": 13257, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813856.885911, "step_id": 13258, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813856.9322128, "step_id": 13259, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813856.9343815, "step_id": 13260, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813857.1792269, "step_id": 13261, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813857.181579, "step_id": 13262, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813857.4264493, "step_id": 13263, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813857.4287634, "step_id": 13264, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813857.637398, "step_id": 13265, "start_load_kv_us": 7, "get_finished_us": 275} +{"t_unix": 1779813857.6482048, "step_id": 13266, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813857.6590078, "step_id": 13267, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813857.6696754, "step_id": 13268, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813857.6804638, "step_id": 13269, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813857.6918278, "step_id": 13270, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813857.7029693, "step_id": 13271, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813857.7140422, "step_id": 13272, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813857.7253711, "step_id": 13273, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813857.7367542, "step_id": 13274, "start_load_kv_us": 3, "get_finished_us": 254} +{"t_unix": 1779813857.7475183, "step_id": 13275, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813857.7585428, "step_id": 13276, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813857.7700467, "step_id": 13277, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813857.78128, "step_id": 13278, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813857.792835, "step_id": 13279, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813857.8038929, "step_id": 13280, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813857.8149712, "step_id": 13281, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813857.8258638, "step_id": 13282, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813857.8368728, "step_id": 13283, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813857.8483865, "step_id": 13284, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813857.8602817, "step_id": 13285, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813857.8717623, "step_id": 13286, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813857.883292, "step_id": 13287, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813857.8944633, "step_id": 13288, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813857.9061868, "step_id": 13289, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813857.9178727, "step_id": 13290, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813857.9288232, "step_id": 13291, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813857.9400563, "step_id": 13292, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813857.9513564, "step_id": 13293, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813857.9623504, "step_id": 13294, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813858.0120938, "step_id": 13295, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813858.0145009, "step_id": 13296, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813858.2282083, "step_id": 13297, "start_load_kv_us": 3, "get_finished_us": 321} +{"t_unix": 1779813858.2390707, "step_id": 13298, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813858.2507083, "step_id": 13299, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813858.2627983, "step_id": 13300, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813858.2745802, "step_id": 13301, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813858.2859328, "step_id": 13302, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813858.2972047, "step_id": 13303, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813858.3085873, "step_id": 13304, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813858.3197868, "step_id": 13305, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813858.331188, "step_id": 13306, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813858.3426418, "step_id": 13307, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813858.354017, "step_id": 13308, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813858.3654544, "step_id": 13309, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813858.377006, "step_id": 13310, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813858.3886266, "step_id": 13311, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813858.4008033, "step_id": 13312, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813858.4127712, "step_id": 13313, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813858.4248748, "step_id": 13314, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813858.4369175, "step_id": 13315, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813858.4486802, "step_id": 13316, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813858.4597607, "step_id": 13317, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813858.470694, "step_id": 13318, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813858.4820545, "step_id": 13319, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813858.4937584, "step_id": 13320, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813858.5055788, "step_id": 13321, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813858.51741, "step_id": 13322, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813858.5288, "step_id": 13323, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813858.5407772, "step_id": 13324, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813858.552651, "step_id": 13325, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813858.5647027, "step_id": 13326, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813858.5760984, "step_id": 13327, "start_load_kv_us": 1, "get_finished_us": 185} +{"t_unix": 1779813858.587663, "step_id": 13328, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813858.599048, "step_id": 13329, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813858.610611, "step_id": 13330, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813858.6221957, "step_id": 13331, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813858.6338525, "step_id": 13332, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813858.6453514, "step_id": 13333, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813858.656773, "step_id": 13334, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813858.66848, "step_id": 13335, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813858.6800873, "step_id": 13336, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813858.6914787, "step_id": 13337, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813858.7030315, "step_id": 13338, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813858.7145362, "step_id": 13339, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813858.7262561, "step_id": 13340, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813858.7381127, "step_id": 13341, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813858.7495282, "step_id": 13342, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813858.7609193, "step_id": 13343, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813858.7727435, "step_id": 13344, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813858.784537, "step_id": 13345, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813858.7960923, "step_id": 13346, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813858.8075705, "step_id": 13347, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813858.8195205, "step_id": 13348, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813858.831647, "step_id": 13349, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813858.843684, "step_id": 13350, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813858.8556147, "step_id": 13351, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813858.8675187, "step_id": 13352, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813858.9183085, "step_id": 13353, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813858.9205332, "step_id": 13354, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813859.1681666, "step_id": 13355, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813859.1706522, "step_id": 13356, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813859.3830373, "step_id": 13357, "start_load_kv_us": 2, "get_finished_us": 318} +{"t_unix": 1779813859.3962908, "step_id": 13358, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813859.4097333, "step_id": 13359, "start_load_kv_us": 3, "get_finished_us": 246} +{"t_unix": 1779813859.4231324, "step_id": 13360, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813859.4362392, "step_id": 13361, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813859.449489, "step_id": 13362, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813859.4626036, "step_id": 13363, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813859.475633, "step_id": 13364, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813859.4889202, "step_id": 13365, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813859.5022795, "step_id": 13366, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813859.5157018, "step_id": 13367, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813859.5294309, "step_id": 13368, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813859.5432267, "step_id": 13369, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813859.5574229, "step_id": 13370, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813859.5716114, "step_id": 13371, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813859.585462, "step_id": 13372, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813859.598809, "step_id": 13373, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813859.6120262, "step_id": 13374, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813859.625109, "step_id": 13375, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813859.6382387, "step_id": 13376, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813859.6512818, "step_id": 13377, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813859.6645665, "step_id": 13378, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813859.678313, "step_id": 13379, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813859.730822, "step_id": 13380, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813859.733297, "step_id": 13381, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813859.9444022, "step_id": 13382, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813859.9571507, "step_id": 13383, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813859.9705632, "step_id": 13384, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813859.984682, "step_id": 13385, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813859.9980571, "step_id": 13386, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813860.0119696, "step_id": 13387, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813860.0259643, "step_id": 13388, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813860.0400827, "step_id": 13389, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813860.0536983, "step_id": 13390, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813860.0673914, "step_id": 13391, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813860.0816255, "step_id": 13392, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813860.0958443, "step_id": 13393, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813860.109865, "step_id": 13394, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813860.1240516, "step_id": 13395, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813860.1383035, "step_id": 13396, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813860.1526244, "step_id": 13397, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813860.167082, "step_id": 13398, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813860.1818068, "step_id": 13399, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813860.1962001, "step_id": 13400, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813860.2103453, "step_id": 13401, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813860.224737, "step_id": 13402, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813860.2392757, "step_id": 13403, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813860.2537653, "step_id": 13404, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813860.2678926, "step_id": 13405, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813860.2820117, "step_id": 13406, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813860.296299, "step_id": 13407, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813860.3104792, "step_id": 13408, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813860.3244102, "step_id": 13409, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813860.3380957, "step_id": 13410, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813860.3518589, "step_id": 13411, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813860.365751, "step_id": 13412, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813860.3797903, "step_id": 13413, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813860.393586, "step_id": 13414, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813860.4078894, "step_id": 13415, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813860.422113, "step_id": 13416, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813860.4355156, "step_id": 13417, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813860.4495149, "step_id": 13418, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813860.463617, "step_id": 13419, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813860.477596, "step_id": 13420, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813860.4917858, "step_id": 13421, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813860.5055962, "step_id": 13422, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813860.5197332, "step_id": 13423, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813860.5338373, "step_id": 13424, "start_load_kv_us": 3, "get_finished_us": 203} +{"t_unix": 1779813860.5475109, "step_id": 13425, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813860.5610647, "step_id": 13426, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813860.5750844, "step_id": 13427, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813860.5891192, "step_id": 13428, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813860.6028454, "step_id": 13429, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813860.617768, "step_id": 13430, "start_load_kv_us": 2, "get_finished_us": 1482} +{"t_unix": 1779813860.6754422, "step_id": 13431, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813860.6778948, "step_id": 13432, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813860.9225318, "step_id": 13433, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813861.3407526, "step_id": 13434, "start_load_kv_us": 2, "get_finished_us": 365} +{"t_unix": 1779813861.3590956, "step_id": 13435, "start_load_kv_us": 4, "get_finished_us": 283} +{"t_unix": 1779813861.5876296, "step_id": 13436, "start_load_kv_us": 3, "get_finished_us": 356} +{"t_unix": 1779813861.6018786, "step_id": 13437, "start_load_kv_us": 3, "get_finished_us": 229} +{"t_unix": 1779813861.616674, "step_id": 13438, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813861.6696382, "step_id": 13439, "start_load_kv_us": 2, "get_finished_us": 343} +{"t_unix": 1779813861.6723325, "step_id": 13440, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813861.8860688, "step_id": 13441, "start_load_kv_us": 3, "get_finished_us": 344} +{"t_unix": 1779813861.8999865, "step_id": 13442, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813861.914244, "step_id": 13443, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813861.9287143, "step_id": 13444, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813861.9433196, "step_id": 13445, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813861.9579227, "step_id": 13446, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813861.9723742, "step_id": 13447, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813861.9872704, "step_id": 13448, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813862.0014248, "step_id": 13449, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813862.0151496, "step_id": 13450, "start_load_kv_us": 20, "get_finished_us": 154} +{"t_unix": 1779813862.0288613, "step_id": 13451, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813862.042587, "step_id": 13452, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813862.0557897, "step_id": 13453, "start_load_kv_us": 5, "get_finished_us": 164} +{"t_unix": 1779813862.069941, "step_id": 13454, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813862.0840895, "step_id": 13455, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813862.0984063, "step_id": 13456, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813862.1127665, "step_id": 13457, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813862.1267457, "step_id": 13458, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813862.1409395, "step_id": 13459, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813862.1555736, "step_id": 13460, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813862.1697571, "step_id": 13461, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813862.1838093, "step_id": 13462, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813862.197856, "step_id": 13463, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813862.2121832, "step_id": 13464, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813862.2268043, "step_id": 13465, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813862.241497, "step_id": 13466, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813862.2562892, "step_id": 13467, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813862.2707558, "step_id": 13468, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813862.2854595, "step_id": 13469, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813862.300013, "step_id": 13470, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813862.314375, "step_id": 13471, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813862.3292012, "step_id": 13472, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813862.3435442, "step_id": 13473, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813862.3576872, "step_id": 13474, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813862.3719568, "step_id": 13475, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813862.3864844, "step_id": 13476, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813862.4008832, "step_id": 13477, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813862.4153345, "step_id": 13478, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813862.4303207, "step_id": 13479, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813862.4449697, "step_id": 13480, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813862.4599597, "step_id": 13481, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813862.475331, "step_id": 13482, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813862.4908597, "step_id": 13483, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813862.50624, "step_id": 13484, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813862.5214794, "step_id": 13485, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813862.5364265, "step_id": 13486, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813862.5514734, "step_id": 13487, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813862.566339, "step_id": 13488, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813862.5816686, "step_id": 13489, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813862.596769, "step_id": 13490, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813862.612401, "step_id": 13491, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813862.6278956, "step_id": 13492, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813862.6424816, "step_id": 13493, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813862.657418, "step_id": 13494, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813862.6717267, "step_id": 13495, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813862.6856687, "step_id": 13496, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813862.6999671, "step_id": 13497, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813862.7147639, "step_id": 13498, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813862.729656, "step_id": 13499, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813862.7446568, "step_id": 13500, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813862.7597914, "step_id": 13501, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813862.7748017, "step_id": 13502, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813862.7898777, "step_id": 13503, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813862.8048193, "step_id": 13504, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813862.8191006, "step_id": 13505, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813862.833395, "step_id": 13506, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813862.8478777, "step_id": 13507, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813862.8623254, "step_id": 13508, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813862.8767486, "step_id": 13509, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813862.8910298, "step_id": 13510, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813862.9054213, "step_id": 13511, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813862.9193568, "step_id": 13512, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813862.933001, "step_id": 13513, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813862.946544, "step_id": 13514, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813862.9606562, "step_id": 13515, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813862.9743319, "step_id": 13516, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813862.9882393, "step_id": 13517, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813863.002111, "step_id": 13518, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813863.0161328, "step_id": 13519, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813863.0303042, "step_id": 13520, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813863.0417867, "step_id": 13521, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813863.053689, "step_id": 13522, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813863.0651712, "step_id": 13523, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813863.0767736, "step_id": 13524, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813863.088861, "step_id": 13525, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813863.1009781, "step_id": 13526, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813863.1129317, "step_id": 13527, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813863.1248412, "step_id": 13528, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813863.136885, "step_id": 13529, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813863.1489124, "step_id": 13530, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813863.1604757, "step_id": 13531, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813863.171765, "step_id": 13532, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813863.1835225, "step_id": 13533, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813863.195319, "step_id": 13534, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813863.2072518, "step_id": 13535, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813863.2192197, "step_id": 13536, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813863.2313015, "step_id": 13537, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813863.2435737, "step_id": 13538, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813863.2936287, "step_id": 13539, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813863.2960205, "step_id": 13540, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813863.5057979, "step_id": 13541, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813863.519273, "step_id": 13542, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813863.5332189, "step_id": 13543, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813863.5473387, "step_id": 13544, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813863.561717, "step_id": 13545, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813863.5758722, "step_id": 13546, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813863.6283817, "step_id": 13547, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813863.630734, "step_id": 13548, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813863.880459, "step_id": 13549, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813863.8829396, "step_id": 13550, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813864.0955698, "step_id": 13551, "start_load_kv_us": 3, "get_finished_us": 320} +{"t_unix": 1779813864.1096807, "step_id": 13552, "start_load_kv_us": 2, "get_finished_us": 297} +{"t_unix": 1779813864.123368, "step_id": 13553, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813864.1376364, "step_id": 13554, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813864.1522195, "step_id": 13555, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813864.166477, "step_id": 13556, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813864.180688, "step_id": 13557, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813864.1944616, "step_id": 13558, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813864.2083042, "step_id": 13559, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813864.221734, "step_id": 13560, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813864.2352858, "step_id": 13561, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813864.2490046, "step_id": 13562, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813864.2629545, "step_id": 13563, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813864.2769713, "step_id": 13564, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813864.2912376, "step_id": 13565, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813864.305529, "step_id": 13566, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813864.319699, "step_id": 13567, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813864.3343186, "step_id": 13568, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813864.348896, "step_id": 13569, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813864.3633654, "step_id": 13570, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813864.377017, "step_id": 13571, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813864.390874, "step_id": 13572, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813864.4047415, "step_id": 13573, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813864.4191508, "step_id": 13574, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813864.4335723, "step_id": 13575, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813864.4479961, "step_id": 13576, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813864.462177, "step_id": 13577, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813864.4766424, "step_id": 13578, "start_load_kv_us": 3, "get_finished_us": 290} +{"t_unix": 1779813864.5295913, "step_id": 13579, "start_load_kv_us": 2, "get_finished_us": 303} +{"t_unix": 1779813864.5319738, "step_id": 13580, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813864.781786, "step_id": 13581, "start_load_kv_us": 2, "get_finished_us": 332} +{"t_unix": 1779813864.9853287, "step_id": 13582, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813865.225323, "step_id": 13583, "start_load_kv_us": 2, "get_finished_us": 315} +{"t_unix": 1779813865.2355068, "step_id": 13584, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813865.476873, "step_id": 13585, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813865.4914556, "step_id": 13586, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813865.5061958, "step_id": 13587, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813865.5208251, "step_id": 13588, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813865.535698, "step_id": 13589, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813865.5503988, "step_id": 13590, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813865.5647888, "step_id": 13591, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813865.6168299, "step_id": 13592, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813865.6191795, "step_id": 13593, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813865.834744, "step_id": 13594, "start_load_kv_us": 2, "get_finished_us": 311} +{"t_unix": 1779813865.848376, "step_id": 13595, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813865.8615572, "step_id": 13596, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813865.8753822, "step_id": 13597, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813865.8895411, "step_id": 13598, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813865.9033632, "step_id": 13599, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813865.9171362, "step_id": 13600, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813865.9309309, "step_id": 13601, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813865.9443035, "step_id": 13602, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813865.9580781, "step_id": 13603, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813865.9720578, "step_id": 13604, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813866.0246937, "step_id": 13605, "start_load_kv_us": 2, "get_finished_us": 317} +{"t_unix": 1779813866.0272, "step_id": 13606, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813866.2424238, "step_id": 13607, "start_load_kv_us": 3, "get_finished_us": 322} +{"t_unix": 1779813866.2598202, "step_id": 13608, "start_load_kv_us": 3, "get_finished_us": 250} +{"t_unix": 1779813866.3158698, "step_id": 13609, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813866.3186083, "step_id": 13610, "start_load_kv_us": 3, "get_finished_us": 180} +{"t_unix": 1779813866.540532, "step_id": 13611, "start_load_kv_us": 3, "get_finished_us": 289} +{"t_unix": 1779813866.5577137, "step_id": 13612, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813866.5715885, "step_id": 13613, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813866.5854225, "step_id": 13614, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813866.6382747, "step_id": 13615, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813866.6407478, "step_id": 13616, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813866.8940194, "step_id": 13617, "start_load_kv_us": 3, "get_finished_us": 359} +{"t_unix": 1779813866.8968575, "step_id": 13618, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813867.114189, "step_id": 13619, "start_load_kv_us": 3, "get_finished_us": 323} +{"t_unix": 1779813867.1300073, "step_id": 13620, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813867.1463954, "step_id": 13621, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813867.1627238, "step_id": 13622, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813867.179179, "step_id": 13623, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813867.1954975, "step_id": 13624, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813867.21213, "step_id": 13625, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813867.2287176, "step_id": 13626, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813867.2453947, "step_id": 13627, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813867.26224, "step_id": 13628, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813867.2792914, "step_id": 13629, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813867.296618, "step_id": 13630, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813867.3134687, "step_id": 13631, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813867.3303845, "step_id": 13632, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813867.3470125, "step_id": 13633, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813867.3634737, "step_id": 13634, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813867.38036, "step_id": 13635, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813867.3976243, "step_id": 13636, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813867.4144866, "step_id": 13637, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813867.4304483, "step_id": 13638, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813867.4461198, "step_id": 13639, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813867.4623353, "step_id": 13640, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813867.4783762, "step_id": 13641, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813867.4950058, "step_id": 13642, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813867.511703, "step_id": 13643, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813867.528002, "step_id": 13644, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813867.5439377, "step_id": 13645, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813867.5601826, "step_id": 13646, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813867.576314, "step_id": 13647, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813867.5923772, "step_id": 13648, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813867.6084008, "step_id": 13649, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813867.6250732, "step_id": 13650, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813867.6413665, "step_id": 13651, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813867.6576936, "step_id": 13652, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813867.7121882, "step_id": 13653, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813867.7145674, "step_id": 13654, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813867.9325354, "step_id": 13655, "start_load_kv_us": 3, "get_finished_us": 315} +{"t_unix": 1779813867.9486828, "step_id": 13656, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813867.9653838, "step_id": 13657, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813868.020407, "step_id": 13658, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813868.0230744, "step_id": 13659, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813868.240529, "step_id": 13660, "start_load_kv_us": 2, "get_finished_us": 323} +{"t_unix": 1779813868.257172, "step_id": 13661, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813868.27425, "step_id": 13662, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813868.2911842, "step_id": 13663, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813868.3083038, "step_id": 13664, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813868.3251176, "step_id": 13665, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813868.3422174, "step_id": 13666, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813868.3597267, "step_id": 13667, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813868.3769953, "step_id": 13668, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813868.3946679, "step_id": 13669, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813868.4115896, "step_id": 13670, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813868.4290504, "step_id": 13671, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813868.4462948, "step_id": 13672, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813868.4633667, "step_id": 13673, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813868.4804244, "step_id": 13674, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813868.497361, "step_id": 13675, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813868.5144627, "step_id": 13676, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813868.531251, "step_id": 13677, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813868.548227, "step_id": 13678, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813868.56504, "step_id": 13679, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813868.5847585, "step_id": 13680, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813868.599839, "step_id": 13681, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813868.6170845, "step_id": 13682, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813868.6341627, "step_id": 13683, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813868.6515722, "step_id": 13684, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813868.669093, "step_id": 13685, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813868.6864624, "step_id": 13686, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813868.7042074, "step_id": 13687, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813868.721349, "step_id": 13688, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813868.7388206, "step_id": 13689, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813868.7562525, "step_id": 13690, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813868.808015, "step_id": 13691, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813868.8105326, "step_id": 13692, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813869.026145, "step_id": 13693, "start_load_kv_us": 3, "get_finished_us": 323} +{"t_unix": 1779813869.039953, "step_id": 13694, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813869.0539982, "step_id": 13695, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813869.0694604, "step_id": 13696, "start_load_kv_us": 3, "get_finished_us": 260} +{"t_unix": 1779813869.082406, "step_id": 13697, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813869.0972033, "step_id": 13698, "start_load_kv_us": 3, "get_finished_us": 179} +{"t_unix": 1779813869.112103, "step_id": 13699, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813869.1263673, "step_id": 13700, "start_load_kv_us": 3, "get_finished_us": 218} +{"t_unix": 1779813869.140389, "step_id": 13701, "start_load_kv_us": 3, "get_finished_us": 200} +{"t_unix": 1779813869.1550407, "step_id": 13702, "start_load_kv_us": 3, "get_finished_us": 187} +{"t_unix": 1779813869.169792, "step_id": 13703, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813869.183796, "step_id": 13704, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813869.1984885, "step_id": 13705, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813869.2136881, "step_id": 13706, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813869.2286997, "step_id": 13707, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813869.244047, "step_id": 13708, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813869.2588549, "step_id": 13709, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813869.274405, "step_id": 13710, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813869.289918, "step_id": 13711, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813869.30467, "step_id": 13712, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813869.319898, "step_id": 13713, "start_load_kv_us": 1, "get_finished_us": 199} +{"t_unix": 1779813869.3727884, "step_id": 13714, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813869.375211, "step_id": 13715, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813869.5907092, "step_id": 13716, "start_load_kv_us": 3, "get_finished_us": 313} +{"t_unix": 1779813869.6041293, "step_id": 13717, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813869.6178956, "step_id": 13718, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813869.6324494, "step_id": 13719, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813869.6468446, "step_id": 13720, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813869.6614828, "step_id": 13721, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813869.6764803, "step_id": 13722, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813869.691047, "step_id": 13723, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813869.705462, "step_id": 13724, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813869.7216225, "step_id": 13725, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813869.7346153, "step_id": 13726, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813869.7497706, "step_id": 13727, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813869.7649329, "step_id": 13728, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813869.7801132, "step_id": 13729, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813869.794955, "step_id": 13730, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813869.8098278, "step_id": 13731, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813869.8249834, "step_id": 13732, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813869.8400123, "step_id": 13733, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813869.8545763, "step_id": 13734, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813869.869144, "step_id": 13735, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813869.8839579, "step_id": 13736, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813869.8992505, "step_id": 13737, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813869.9142203, "step_id": 13738, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813869.9293702, "step_id": 13739, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813869.944252, "step_id": 13740, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813869.9592645, "step_id": 13741, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813869.9739826, "step_id": 13742, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813869.988772, "step_id": 13743, "start_load_kv_us": 2, "get_finished_us": 308} +{"t_unix": 1779813870.0032418, "step_id": 13744, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813870.0171456, "step_id": 13745, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813870.0326042, "step_id": 13746, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813870.0464165, "step_id": 13747, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813870.0624814, "step_id": 13748, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813870.0759084, "step_id": 13749, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813870.0906198, "step_id": 13750, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813870.105074, "step_id": 13751, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813870.119428, "step_id": 13752, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813870.1338766, "step_id": 13753, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813870.148656, "step_id": 13754, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813870.1629803, "step_id": 13755, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813870.177962, "step_id": 13756, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813870.1933188, "step_id": 13757, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813870.2083373, "step_id": 13758, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813870.2237313, "step_id": 13759, "start_load_kv_us": 2, "get_finished_us": 449} +{"t_unix": 1779813870.2376063, "step_id": 13760, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813870.2522662, "step_id": 13761, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813870.266684, "step_id": 13762, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813870.2813294, "step_id": 13763, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813870.2965636, "step_id": 13764, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813870.3113997, "step_id": 13765, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813870.3260424, "step_id": 13766, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813870.3409815, "step_id": 13767, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813870.3553321, "step_id": 13768, "start_load_kv_us": 1, "get_finished_us": 228} +{"t_unix": 1779813870.369673, "step_id": 13769, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813870.3836048, "step_id": 13770, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813870.3983464, "step_id": 13771, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813870.41326, "step_id": 13772, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813870.4280274, "step_id": 13773, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813870.4428277, "step_id": 13774, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813870.457719, "step_id": 13775, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813870.4723754, "step_id": 13776, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813870.487056, "step_id": 13777, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813870.5015588, "step_id": 13778, "start_load_kv_us": 2, "get_finished_us": 266} +{"t_unix": 1779813870.5158687, "step_id": 13779, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813870.530563, "step_id": 13780, "start_load_kv_us": 2, "get_finished_us": 324} +{"t_unix": 1779813870.544861, "step_id": 13781, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813870.559482, "step_id": 13782, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813870.5742805, "step_id": 13783, "start_load_kv_us": 4, "get_finished_us": 215} +{"t_unix": 1779813870.589387, "step_id": 13784, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813870.6047328, "step_id": 13785, "start_load_kv_us": 2, "get_finished_us": 322} +{"t_unix": 1779813870.6191778, "step_id": 13786, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813870.6341648, "step_id": 13787, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813870.6491368, "step_id": 13788, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813870.6645954, "step_id": 13789, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813870.6793537, "step_id": 13790, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813870.6938052, "step_id": 13791, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813870.7083013, "step_id": 13792, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813870.72314, "step_id": 13793, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813870.738231, "step_id": 13794, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813870.7530825, "step_id": 13795, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813870.7669628, "step_id": 13796, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813870.781399, "step_id": 13797, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813870.7965646, "step_id": 13798, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813870.8121395, "step_id": 13799, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813870.8273172, "step_id": 13800, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813870.842278, "step_id": 13801, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813870.8577707, "step_id": 13802, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813870.9107432, "step_id": 13803, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813870.9134622, "step_id": 13804, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813871.1338913, "step_id": 13805, "start_load_kv_us": 3, "get_finished_us": 361} +{"t_unix": 1779813871.1484945, "step_id": 13806, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813871.1635914, "step_id": 13807, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813871.1791508, "step_id": 13808, "start_load_kv_us": 2, "get_finished_us": 332} +{"t_unix": 1779813871.1942081, "step_id": 13809, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813871.2092643, "step_id": 13810, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813871.2247121, "step_id": 13811, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813871.2401516, "step_id": 13812, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813871.2551663, "step_id": 13813, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813871.27023, "step_id": 13814, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813871.2855868, "step_id": 13815, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813871.3009644, "step_id": 13816, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813871.3162265, "step_id": 13817, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813871.331474, "step_id": 13818, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813871.3467336, "step_id": 13819, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813871.362246, "step_id": 13820, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813871.37752, "step_id": 13821, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813871.3926916, "step_id": 13822, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813871.4083872, "step_id": 13823, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813871.4237838, "step_id": 13824, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813871.4396462, "step_id": 13825, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813871.4550838, "step_id": 13826, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813871.4701655, "step_id": 13827, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813871.4855402, "step_id": 13828, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813871.501161, "step_id": 13829, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813871.5168657, "step_id": 13830, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813871.532094, "step_id": 13831, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813871.5476828, "step_id": 13832, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813871.5634663, "step_id": 13833, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813871.579485, "step_id": 13834, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813871.5955293, "step_id": 13835, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813871.6115127, "step_id": 13836, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813871.6268978, "step_id": 13837, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813871.6424036, "step_id": 13838, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813871.6564155, "step_id": 13839, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813871.6699333, "step_id": 13840, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813871.6831288, "step_id": 13841, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813871.6970563, "step_id": 13842, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813871.711277, "step_id": 13843, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813871.7257214, "step_id": 13844, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813871.7400873, "step_id": 13845, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813871.7543442, "step_id": 13846, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813871.7686043, "step_id": 13847, "start_load_kv_us": 1, "get_finished_us": 181} +{"t_unix": 1779813871.783073, "step_id": 13848, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813871.7970612, "step_id": 13849, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813871.8089998, "step_id": 13850, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813871.8210313, "step_id": 13851, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813871.8328254, "step_id": 13852, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813871.8451571, "step_id": 13853, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813871.8569574, "step_id": 13854, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813871.8691394, "step_id": 13855, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813871.8810153, "step_id": 13856, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813871.8925903, "step_id": 13857, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813871.903792, "step_id": 13858, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813871.915579, "step_id": 13859, "start_load_kv_us": 2, "get_finished_us": 640} +{"t_unix": 1779813871.9690073, "step_id": 13860, "start_load_kv_us": 2, "get_finished_us": 316} +{"t_unix": 1779813871.971815, "step_id": 13861, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813872.2145123, "step_id": 13862, "start_load_kv_us": 3, "get_finished_us": 345} +{"t_unix": 1779813872.217297, "step_id": 13863, "start_load_kv_us": 3, "get_finished_us": 210} +{"t_unix": 1779813872.4607944, "step_id": 13864, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813872.6645064, "step_id": 13865, "start_load_kv_us": 3, "get_finished_us": 332} +{"t_unix": 1779813872.6746879, "step_id": 13866, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813872.919828, "step_id": 13867, "start_load_kv_us": 2, "get_finished_us": 354} +{"t_unix": 1779813872.932704, "step_id": 13868, "start_load_kv_us": 3, "get_finished_us": 223} +{"t_unix": 1779813872.9459922, "step_id": 13869, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813872.9592476, "step_id": 13870, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813872.9739017, "step_id": 13871, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813872.9866173, "step_id": 13872, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813873.0004714, "step_id": 13873, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813873.0141363, "step_id": 13874, "start_load_kv_us": 2, "get_finished_us": 289} +{"t_unix": 1779813873.0258503, "step_id": 13875, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813873.0376318, "step_id": 13876, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813873.0495696, "step_id": 13877, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813873.0614722, "step_id": 13878, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813873.073521, "step_id": 13879, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813873.0855677, "step_id": 13880, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813873.0975418, "step_id": 13881, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813873.1097775, "step_id": 13882, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813873.1221182, "step_id": 13883, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813873.1349044, "step_id": 13884, "start_load_kv_us": 3, "get_finished_us": 202} +{"t_unix": 1779813873.1460745, "step_id": 13885, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813873.1578271, "step_id": 13886, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813873.169733, "step_id": 13887, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813873.1813216, "step_id": 13888, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813873.1935005, "step_id": 13889, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813873.2055068, "step_id": 13890, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813873.2170765, "step_id": 13891, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813873.2284923, "step_id": 13892, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813873.239971, "step_id": 13893, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813873.2510417, "step_id": 13894, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813873.2623808, "step_id": 13895, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813873.273521, "step_id": 13896, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813873.2848456, "step_id": 13897, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813873.296239, "step_id": 13898, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813873.3075578, "step_id": 13899, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813873.319146, "step_id": 13900, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813873.3303893, "step_id": 13901, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813873.341981, "step_id": 13902, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813873.3534029, "step_id": 13903, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813873.3648393, "step_id": 13904, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813873.4133198, "step_id": 13905, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813873.4157133, "step_id": 13906, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813873.6630363, "step_id": 13907, "start_load_kv_us": 3, "get_finished_us": 335} +{"t_unix": 1779813873.6657186, "step_id": 13908, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813873.8790612, "step_id": 13909, "start_load_kv_us": 3, "get_finished_us": 333} +{"t_unix": 1779813873.891862, "step_id": 13910, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813873.9055598, "step_id": 13911, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813873.9191942, "step_id": 13912, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813873.932406, "step_id": 13913, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813873.945765, "step_id": 13914, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813873.9589958, "step_id": 13915, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813873.9702237, "step_id": 13916, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813873.981324, "step_id": 13917, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813873.9924548, "step_id": 13918, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813874.0040162, "step_id": 13919, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813874.0155895, "step_id": 13920, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813874.02657, "step_id": 13921, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813874.0375395, "step_id": 13922, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813874.0487278, "step_id": 13923, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813874.059733, "step_id": 13924, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813874.0713005, "step_id": 13925, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813874.0826108, "step_id": 13926, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813874.0940852, "step_id": 13927, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813874.1053436, "step_id": 13928, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813874.1163507, "step_id": 13929, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813874.12789, "step_id": 13930, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813874.1395314, "step_id": 13931, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813874.151365, "step_id": 13932, "start_load_kv_us": 1, "get_finished_us": 192} +{"t_unix": 1779813874.1628034, "step_id": 13933, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813874.1741815, "step_id": 13934, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813874.186499, "step_id": 13935, "start_load_kv_us": 4, "get_finished_us": 275} +{"t_unix": 1779813874.1967034, "step_id": 13936, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813874.2077427, "step_id": 13937, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813874.2187536, "step_id": 13938, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813874.229827, "step_id": 13939, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813874.2409108, "step_id": 13940, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813874.2521877, "step_id": 13941, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813874.263122, "step_id": 13942, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813874.273963, "step_id": 13943, "start_load_kv_us": 1, "get_finished_us": 274} +{"t_unix": 1779813874.2850983, "step_id": 13944, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813874.2968252, "step_id": 13945, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813874.3082569, "step_id": 13946, "start_load_kv_us": 19, "get_finished_us": 250} +{"t_unix": 1779813874.3199885, "step_id": 13947, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813874.3315446, "step_id": 13948, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813874.342348, "step_id": 13949, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813874.3533158, "step_id": 13950, "start_load_kv_us": 1, "get_finished_us": 200} +{"t_unix": 1779813874.364403, "step_id": 13951, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813874.3752513, "step_id": 13952, "start_load_kv_us": 1, "get_finished_us": 182} +{"t_unix": 1779813874.3863297, "step_id": 13953, "start_load_kv_us": 1, "get_finished_us": 155} +{"t_unix": 1779813874.3976119, "step_id": 13954, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813874.4090831, "step_id": 13955, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813874.4206214, "step_id": 13956, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813874.4315143, "step_id": 13957, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813874.44289, "step_id": 13958, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813874.4537487, "step_id": 13959, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813874.4651515, "step_id": 13960, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813874.47635, "step_id": 13961, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813874.4875226, "step_id": 13962, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813874.4989588, "step_id": 13963, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813874.5098338, "step_id": 13964, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813874.5206172, "step_id": 13965, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813874.5319815, "step_id": 13966, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813874.5432549, "step_id": 13967, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813874.5548267, "step_id": 13968, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813874.5659902, "step_id": 13969, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813874.5773787, "step_id": 13970, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813874.5875962, "step_id": 13971, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813874.5992048, "step_id": 13972, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813874.6110024, "step_id": 13973, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813874.6225696, "step_id": 13974, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813874.6340013, "step_id": 13975, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813874.645306, "step_id": 13976, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813874.6568732, "step_id": 13977, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813874.6690998, "step_id": 13978, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813874.6809125, "step_id": 13979, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813874.6930048, "step_id": 13980, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813874.7046554, "step_id": 13981, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813874.7158709, "step_id": 13982, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813874.7276149, "step_id": 13983, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813874.741616, "step_id": 13984, "start_load_kv_us": 4, "get_finished_us": 1822} +{"t_unix": 1779813874.751655, "step_id": 13985, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813874.7634127, "step_id": 13986, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813874.775032, "step_id": 13987, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813874.7869956, "step_id": 13988, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813874.798899, "step_id": 13989, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813874.810612, "step_id": 13990, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813874.8227994, "step_id": 13991, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813874.8350937, "step_id": 13992, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813874.847047, "step_id": 13993, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813874.8589902, "step_id": 13994, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813874.8709772, "step_id": 13995, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813874.8830204, "step_id": 13996, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813874.8948815, "step_id": 13997, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813874.9067922, "step_id": 13998, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813874.91887, "step_id": 13999, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813874.930824, "step_id": 14000, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813874.942901, "step_id": 14001, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813874.9549851, "step_id": 14002, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813874.9671748, "step_id": 14003, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813874.97935, "step_id": 14004, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813874.991518, "step_id": 14005, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813875.0039341, "step_id": 14006, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813875.016297, "step_id": 14007, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813875.0286622, "step_id": 14008, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813875.0406668, "step_id": 14009, "start_load_kv_us": 2, "get_finished_us": 326} +{"t_unix": 1779813875.0524497, "step_id": 14010, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813875.064613, "step_id": 14011, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813875.0767133, "step_id": 14012, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813875.0889988, "step_id": 14013, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813875.1013107, "step_id": 14014, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813875.113511, "step_id": 14015, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813875.1256876, "step_id": 14016, "start_load_kv_us": 2, "get_finished_us": 281} +{"t_unix": 1779813875.1373785, "step_id": 14017, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813875.149052, "step_id": 14018, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813875.1608095, "step_id": 14019, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813875.17216, "step_id": 14020, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813875.1837156, "step_id": 14021, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813875.195007, "step_id": 14022, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813875.2061746, "step_id": 14023, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813875.219895, "step_id": 14024, "start_load_kv_us": 2, "get_finished_us": 313} +{"t_unix": 1779813875.2292597, "step_id": 14025, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813875.2408714, "step_id": 14026, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813875.2526338, "step_id": 14027, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813875.2645338, "step_id": 14028, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813875.2764828, "step_id": 14029, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813875.288153, "step_id": 14030, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813875.3000224, "step_id": 14031, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813875.3120272, "step_id": 14032, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813875.323371, "step_id": 14033, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813875.3346493, "step_id": 14034, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813875.3462124, "step_id": 14035, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813875.3581388, "step_id": 14036, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813875.3697922, "step_id": 14037, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813875.3812702, "step_id": 14038, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813875.3935635, "step_id": 14039, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813875.4055364, "step_id": 14040, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813875.4173675, "step_id": 14041, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813875.4294486, "step_id": 14042, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813875.4415874, "step_id": 14043, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813875.4538805, "step_id": 14044, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813875.467401, "step_id": 14045, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813875.4783373, "step_id": 14046, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813875.4904857, "step_id": 14047, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813875.502472, "step_id": 14048, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813875.5145075, "step_id": 14049, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813875.5264611, "step_id": 14050, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813875.538539, "step_id": 14051, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813875.5505664, "step_id": 14052, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813875.562885, "step_id": 14053, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813875.5748377, "step_id": 14054, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813875.5869687, "step_id": 14055, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813875.5990674, "step_id": 14056, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813875.6111383, "step_id": 14057, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813875.6233842, "step_id": 14058, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813875.6356645, "step_id": 14059, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813875.647596, "step_id": 14060, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813875.6573863, "step_id": 14061, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813875.6673927, "step_id": 14062, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813875.6772492, "step_id": 14063, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813875.6874642, "step_id": 14064, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813875.697535, "step_id": 14065, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813875.7081795, "step_id": 14066, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813875.7181754, "step_id": 14067, "start_load_kv_us": 3, "get_finished_us": 161} +{"t_unix": 1779813875.7279017, "step_id": 14068, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813875.7379637, "step_id": 14069, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813875.7476168, "step_id": 14070, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813875.7571473, "step_id": 14071, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813875.7667248, "step_id": 14072, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813875.7763317, "step_id": 14073, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813875.7861488, "step_id": 14074, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813875.795785, "step_id": 14075, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813875.8050346, "step_id": 14076, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813875.8147097, "step_id": 14077, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813875.8245773, "step_id": 14078, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813875.834341, "step_id": 14079, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813875.8443003, "step_id": 14080, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813875.8539395, "step_id": 14081, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813875.863838, "step_id": 14082, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813875.8733883, "step_id": 14083, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813875.8832872, "step_id": 14084, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813875.8934605, "step_id": 14085, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813875.9033818, "step_id": 14086, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813875.913462, "step_id": 14087, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813875.9235232, "step_id": 14088, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813875.9332905, "step_id": 14089, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813875.943218, "step_id": 14090, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813875.9531047, "step_id": 14091, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813875.9629924, "step_id": 14092, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813875.973068, "step_id": 14093, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813875.9831944, "step_id": 14094, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813875.993063, "step_id": 14095, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813876.0030837, "step_id": 14096, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813876.0131202, "step_id": 14097, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813876.0228522, "step_id": 14098, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813876.0320742, "step_id": 14099, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813876.0416133, "step_id": 14100, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813876.0903375, "step_id": 14101, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813876.0926042, "step_id": 14102, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813876.3359365, "step_id": 14103, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813876.3381739, "step_id": 14104, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813876.5467367, "step_id": 14105, "start_load_kv_us": 2, "get_finished_us": 309} +{"t_unix": 1779813876.5578535, "step_id": 14106, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813876.5687437, "step_id": 14107, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813876.5795844, "step_id": 14108, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813876.5901053, "step_id": 14109, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813876.600797, "step_id": 14110, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813876.6111555, "step_id": 14111, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813876.6220531, "step_id": 14112, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813876.6332989, "step_id": 14113, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813876.6443353, "step_id": 14114, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813876.6560233, "step_id": 14115, "start_load_kv_us": 15, "get_finished_us": 538} +{"t_unix": 1779813876.6673222, "step_id": 14116, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813876.6786225, "step_id": 14117, "start_load_kv_us": 2, "get_finished_us": 498} +{"t_unix": 1779813876.6901777, "step_id": 14118, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813876.739792, "step_id": 14119, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813876.7423067, "step_id": 14120, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813876.950089, "step_id": 14121, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813876.95889, "step_id": 14122, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813876.9683719, "step_id": 14123, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813876.9781835, "step_id": 14124, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813876.987962, "step_id": 14125, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813876.9977288, "step_id": 14126, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813877.0073957, "step_id": 14127, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813877.016537, "step_id": 14128, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813877.026136, "step_id": 14129, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813877.0357997, "step_id": 14130, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813877.045233, "step_id": 14131, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813877.0547285, "step_id": 14132, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813877.064544, "step_id": 14133, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813877.0742912, "step_id": 14134, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813877.083711, "step_id": 14135, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813877.0932887, "step_id": 14136, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813877.1026535, "step_id": 14137, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813877.1121447, "step_id": 14138, "start_load_kv_us": 15, "get_finished_us": 156} +{"t_unix": 1779813877.121594, "step_id": 14139, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813877.1312993, "step_id": 14140, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813877.141051, "step_id": 14141, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813877.187671, "step_id": 14142, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813877.189721, "step_id": 14143, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813877.3975296, "step_id": 14144, "start_load_kv_us": 2, "get_finished_us": 305} +{"t_unix": 1779813877.4058964, "step_id": 14145, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813877.4155388, "step_id": 14146, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813877.4251347, "step_id": 14147, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813877.434256, "step_id": 14148, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813877.443895, "step_id": 14149, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813877.453407, "step_id": 14150, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813877.4625049, "step_id": 14151, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813877.4724188, "step_id": 14152, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813877.4814658, "step_id": 14153, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813877.4907422, "step_id": 14154, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813877.5003476, "step_id": 14155, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813877.510043, "step_id": 14156, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813877.5199409, "step_id": 14157, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813877.5295074, "step_id": 14158, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813877.5392106, "step_id": 14159, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813877.5489013, "step_id": 14160, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813877.5584774, "step_id": 14161, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813877.5677195, "step_id": 14162, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813877.57726, "step_id": 14163, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813877.586665, "step_id": 14164, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813877.5942807, "step_id": 14165, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813877.6019216, "step_id": 14166, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813877.6097388, "step_id": 14167, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813877.6171288, "step_id": 14168, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813877.6249697, "step_id": 14169, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813877.6325364, "step_id": 14170, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813877.6404176, "step_id": 14171, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813877.6482003, "step_id": 14172, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813877.6564, "step_id": 14173, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813877.6642447, "step_id": 14174, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813877.671986, "step_id": 14175, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813877.6795785, "step_id": 14176, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813877.6874762, "step_id": 14177, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813877.6954298, "step_id": 14178, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813877.7025568, "step_id": 14179, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813877.7102046, "step_id": 14180, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813877.7181318, "step_id": 14181, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813877.7256212, "step_id": 14182, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813877.7330658, "step_id": 14183, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813877.7408078, "step_id": 14184, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813877.7487, "step_id": 14185, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813877.7561758, "step_id": 14186, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813877.763826, "step_id": 14187, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813877.771351, "step_id": 14188, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813877.7787917, "step_id": 14189, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813877.7866094, "step_id": 14190, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813877.794236, "step_id": 14191, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813877.8023188, "step_id": 14192, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813877.8102412, "step_id": 14193, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813877.8182945, "step_id": 14194, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813877.8263497, "step_id": 14195, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813877.8345232, "step_id": 14196, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813877.8423753, "step_id": 14197, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813877.8500752, "step_id": 14198, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813877.8574207, "step_id": 14199, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813877.8648913, "step_id": 14200, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813877.8725677, "step_id": 14201, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813877.8804817, "step_id": 14202, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813877.8884628, "step_id": 14203, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813877.8958485, "step_id": 14204, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813877.9035861, "step_id": 14205, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813877.9111917, "step_id": 14206, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813877.9192145, "step_id": 14207, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813877.9272065, "step_id": 14208, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813877.9350712, "step_id": 14209, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813877.9429927, "step_id": 14210, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813877.9502008, "step_id": 14211, "start_load_kv_us": 1, "get_finished_us": 144} +{"t_unix": 1779813877.958128, "step_id": 14212, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813877.965769, "step_id": 14213, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813877.9734488, "step_id": 14214, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813877.981018, "step_id": 14215, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813877.9886317, "step_id": 14216, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813877.9962466, "step_id": 14217, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813878.0037246, "step_id": 14218, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813878.0110037, "step_id": 14219, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813878.0184286, "step_id": 14220, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813878.026459, "step_id": 14221, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813878.0340002, "step_id": 14222, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813878.0416272, "step_id": 14223, "start_load_kv_us": 1, "get_finished_us": 162} +{"t_unix": 1779813878.0491998, "step_id": 14224, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813878.0563035, "step_id": 14225, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813878.063825, "step_id": 14226, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813878.0713649, "step_id": 14227, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813878.0790844, "step_id": 14228, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813878.0867922, "step_id": 14229, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813878.0943007, "step_id": 14230, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813878.1022515, "step_id": 14231, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813878.1102548, "step_id": 14232, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813878.1181438, "step_id": 14233, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813878.1260366, "step_id": 14234, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813878.1340928, "step_id": 14235, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813878.1420898, "step_id": 14236, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813878.149854, "step_id": 14237, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813878.1570168, "step_id": 14238, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813878.1642663, "step_id": 14239, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813878.1722326, "step_id": 14240, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813878.1801596, "step_id": 14241, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813878.187843, "step_id": 14242, "start_load_kv_us": 1, "get_finished_us": 147} +{"t_unix": 1779813878.1957316, "step_id": 14243, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813878.2035823, "step_id": 14244, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813878.2114742, "step_id": 14245, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813878.219185, "step_id": 14246, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813878.227205, "step_id": 14247, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813878.2349222, "step_id": 14248, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813878.242794, "step_id": 14249, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813878.25069, "step_id": 14250, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813878.2588162, "step_id": 14251, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813878.2671828, "step_id": 14252, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813878.2755873, "step_id": 14253, "start_load_kv_us": 1, "get_finished_us": 158} +{"t_unix": 1779813878.2832685, "step_id": 14254, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813878.290869, "step_id": 14255, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813878.2984545, "step_id": 14256, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813878.3062046, "step_id": 14257, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813878.314921, "step_id": 14258, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813878.3614707, "step_id": 14259, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813878.3635373, "step_id": 14260, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813878.5663645, "step_id": 14261, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813878.5756934, "step_id": 14262, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813878.5849771, "step_id": 14263, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813878.594828, "step_id": 14264, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813878.6041317, "step_id": 14265, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813878.6133468, "step_id": 14266, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813878.6224504, "step_id": 14267, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813878.631681, "step_id": 14268, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813878.6411057, "step_id": 14269, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813878.6504488, "step_id": 14270, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813878.6600459, "step_id": 14271, "start_load_kv_us": 1, "get_finished_us": 145} +{"t_unix": 1779813878.66983, "step_id": 14272, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813878.679073, "step_id": 14273, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813878.6886253, "step_id": 14274, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813878.6982265, "step_id": 14275, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813878.7074468, "step_id": 14276, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813878.7167375, "step_id": 14277, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813878.7264147, "step_id": 14278, "start_load_kv_us": 1, "get_finished_us": 139} +{"t_unix": 1779813878.7355878, "step_id": 14279, "start_load_kv_us": 1, "get_finished_us": 159} +{"t_unix": 1779813878.7452443, "step_id": 14280, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813878.7549896, "step_id": 14281, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813878.764832, "step_id": 14282, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813878.7747324, "step_id": 14283, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813878.7846122, "step_id": 14284, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813878.7945046, "step_id": 14285, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813878.8043332, "step_id": 14286, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813878.8142545, "step_id": 14287, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813878.8241472, "step_id": 14288, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813878.8342323, "step_id": 14289, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813878.8441641, "step_id": 14290, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813878.8540213, "step_id": 14291, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813878.864133, "step_id": 14292, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813878.8740804, "step_id": 14293, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813878.884075, "step_id": 14294, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813878.8941267, "step_id": 14295, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813878.9039369, "step_id": 14296, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813878.914089, "step_id": 14297, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813878.9606621, "step_id": 14298, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813878.9626827, "step_id": 14299, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813879.1724968, "step_id": 14300, "start_load_kv_us": 2, "get_finished_us": 321} +{"t_unix": 1779813879.1811655, "step_id": 14301, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813879.1907568, "step_id": 14302, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813879.2005157, "step_id": 14303, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813879.2106223, "step_id": 14304, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813879.2208757, "step_id": 14305, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813879.2306695, "step_id": 14306, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813879.2403145, "step_id": 14307, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813879.249931, "step_id": 14308, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813879.2600646, "step_id": 14309, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813879.270151, "step_id": 14310, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813879.2802498, "step_id": 14311, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813879.2902884, "step_id": 14312, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813879.3002458, "step_id": 14313, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813879.3104975, "step_id": 14314, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813879.3206205, "step_id": 14315, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813879.3304272, "step_id": 14316, "start_load_kv_us": 1, "get_finished_us": 188} +{"t_unix": 1779813879.3402424, "step_id": 14317, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813879.3500018, "step_id": 14318, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813879.3596652, "step_id": 14319, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813879.3695166, "step_id": 14320, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813879.3788235, "step_id": 14321, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813879.388015, "step_id": 14322, "start_load_kv_us": 1, "get_finished_us": 204} +{"t_unix": 1779813879.39707, "step_id": 14323, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813879.4060688, "step_id": 14324, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813879.4154174, "step_id": 14325, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813879.4250317, "step_id": 14326, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813879.4347804, "step_id": 14327, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813879.4445038, "step_id": 14328, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813879.4542005, "step_id": 14329, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813879.4639175, "step_id": 14330, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813879.4730783, "step_id": 14331, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813879.482379, "step_id": 14332, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813879.4919403, "step_id": 14333, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813879.5014548, "step_id": 14334, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813879.510931, "step_id": 14335, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813879.5203562, "step_id": 14336, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813879.5337954, "step_id": 14337, "start_load_kv_us": 16, "get_finished_us": 306} +{"t_unix": 1779813879.5394695, "step_id": 14338, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813879.548685, "step_id": 14339, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813879.558705, "step_id": 14340, "start_load_kv_us": 16, "get_finished_us": 222} +{"t_unix": 1779813879.5686374, "step_id": 14341, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813879.578447, "step_id": 14342, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813879.5880103, "step_id": 14343, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813879.5972955, "step_id": 14344, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813879.6065679, "step_id": 14345, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813879.6160297, "step_id": 14346, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813879.6254508, "step_id": 14347, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813879.6351633, "step_id": 14348, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813879.6443439, "step_id": 14349, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813879.6540325, "step_id": 14350, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813879.663771, "step_id": 14351, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813879.673882, "step_id": 14352, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813879.6842625, "step_id": 14353, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813879.694173, "step_id": 14354, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813879.7041917, "step_id": 14355, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813879.7138965, "step_id": 14356, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813879.7238681, "step_id": 14357, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813879.7336066, "step_id": 14358, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813879.7440958, "step_id": 14359, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813879.754033, "step_id": 14360, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813879.7617254, "step_id": 14361, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813879.7697015, "step_id": 14362, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813879.7777505, "step_id": 14363, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813879.7861624, "step_id": 14364, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813879.7941988, "step_id": 14365, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813879.802211, "step_id": 14366, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813879.8104668, "step_id": 14367, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813879.8187106, "step_id": 14368, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813879.8269606, "step_id": 14369, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813879.8351688, "step_id": 14370, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813879.8433526, "step_id": 14371, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813879.8514304, "step_id": 14372, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813879.8596013, "step_id": 14373, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813879.8678105, "step_id": 14374, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813879.87619, "step_id": 14375, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813879.884186, "step_id": 14376, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813879.8915887, "step_id": 14377, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813879.8991165, "step_id": 14378, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813879.906831, "step_id": 14379, "start_load_kv_us": 3, "get_finished_us": 239} +{"t_unix": 1779813879.9141917, "step_id": 14380, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813879.9218123, "step_id": 14381, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813879.9291213, "step_id": 14382, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813879.9362454, "step_id": 14383, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813879.9433484, "step_id": 14384, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813879.9516242, "step_id": 14385, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813879.9580662, "step_id": 14386, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813879.9651017, "step_id": 14387, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813879.9721744, "step_id": 14388, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813879.9813356, "step_id": 14389, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813879.9869914, "step_id": 14390, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813879.994301, "step_id": 14391, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813880.0020344, "step_id": 14392, "start_load_kv_us": 3, "get_finished_us": 271} +{"t_unix": 1779813880.0090325, "step_id": 14393, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813880.0162046, "step_id": 14394, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813880.0235708, "step_id": 14395, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813880.0306222, "step_id": 14396, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813880.0378537, "step_id": 14397, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813880.0451477, "step_id": 14398, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813880.0522394, "step_id": 14399, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813880.0578065, "step_id": 14400, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813880.0639994, "step_id": 14401, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813880.0697982, "step_id": 14402, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813880.0754478, "step_id": 14403, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813880.0809357, "step_id": 14404, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813880.0865178, "step_id": 14405, "start_load_kv_us": 1, "get_finished_us": 161} +{"t_unix": 1779813880.0921936, "step_id": 14406, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813880.0982525, "step_id": 14407, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813880.104256, "step_id": 14408, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813880.110114, "step_id": 14409, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813880.1160588, "step_id": 14410, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813880.1220524, "step_id": 14411, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813880.1279483, "step_id": 14412, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813880.1340826, "step_id": 14413, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813880.1400952, "step_id": 14414, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813880.1461568, "step_id": 14415, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813880.1531835, "step_id": 14416, "start_load_kv_us": 4, "get_finished_us": 397} +{"t_unix": 1779813880.1578772, "step_id": 14417, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813880.1632907, "step_id": 14418, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813880.1690912, "step_id": 14419, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813880.1746986, "step_id": 14420, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813880.1804447, "step_id": 14421, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813880.1860232, "step_id": 14422, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813880.1920168, "step_id": 14423, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813880.197951, "step_id": 14424, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813880.2038567, "step_id": 14425, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813880.2097845, "step_id": 14426, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813880.216005, "step_id": 14427, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813880.2216392, "step_id": 14428, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813880.2275064, "step_id": 14429, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813880.2336345, "step_id": 14430, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813880.2395766, "step_id": 14431, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813880.2455125, "step_id": 14432, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813880.251366, "step_id": 14433, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813880.257138, "step_id": 14434, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813880.2633946, "step_id": 14435, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813880.2688498, "step_id": 14436, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813880.275039, "step_id": 14437, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813880.2808263, "step_id": 14438, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813880.287004, "step_id": 14439, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813880.2931466, "step_id": 14440, "start_load_kv_us": 13, "get_finished_us": 159} +{"t_unix": 1779813880.2988997, "step_id": 14441, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813880.3046663, "step_id": 14442, "start_load_kv_us": 3, "get_finished_us": 183} +{"t_unix": 1779813880.3104906, "step_id": 14443, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813880.3164139, "step_id": 14444, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813880.3224885, "step_id": 14445, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813880.328398, "step_id": 14446, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813880.33435, "step_id": 14447, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813880.3793967, "step_id": 14448, "start_load_kv_us": 2, "get_finished_us": 279} +{"t_unix": 1779813880.381528, "step_id": 14449, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813880.5806675, "step_id": 14450, "start_load_kv_us": 3, "get_finished_us": 307} +{"t_unix": 1779813880.5872242, "step_id": 14451, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813880.5941877, "step_id": 14452, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813880.6397393, "step_id": 14453, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813880.641845, "step_id": 14454, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813880.8850358, "step_id": 14455, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813881.2950454, "step_id": 14456, "start_load_kv_us": 2, "get_finished_us": 362} +{"t_unix": 1779813881.3120031, "step_id": 14457, "start_load_kv_us": 3, "get_finished_us": 215} +{"t_unix": 1779813881.5384903, "step_id": 14458, "start_load_kv_us": 3, "get_finished_us": 310} +{"t_unix": 1779813881.548218, "step_id": 14459, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813881.558911, "step_id": 14460, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813881.5695682, "step_id": 14461, "start_load_kv_us": 2, "get_finished_us": 275} +{"t_unix": 1779813881.5802824, "step_id": 14462, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813881.5912232, "step_id": 14463, "start_load_kv_us": 2, "get_finished_us": 240} +{"t_unix": 1779813881.60205, "step_id": 14464, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813881.6130803, "step_id": 14465, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813881.6238184, "step_id": 14466, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813881.6351445, "step_id": 14467, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813881.6465807, "step_id": 14468, "start_load_kv_us": 2, "get_finished_us": 271} +{"t_unix": 1779813881.6947975, "step_id": 14469, "start_load_kv_us": 16, "get_finished_us": 286} +{"t_unix": 1779813881.6969166, "step_id": 14470, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813881.907222, "step_id": 14471, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813881.917819, "step_id": 14472, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813881.9286814, "step_id": 14473, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813881.9391878, "step_id": 14474, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813881.9498742, "step_id": 14475, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813881.9627774, "step_id": 14476, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813881.9704664, "step_id": 14477, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813881.9809222, "step_id": 14478, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813881.9921193, "step_id": 14479, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813882.002837, "step_id": 14480, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813882.013826, "step_id": 14481, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813882.024509, "step_id": 14482, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813882.0362546, "step_id": 14483, "start_load_kv_us": 2, "get_finished_us": 358} +{"t_unix": 1779813882.047289, "step_id": 14484, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813882.058288, "step_id": 14485, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813882.069087, "step_id": 14486, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813882.0797312, "step_id": 14487, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813882.0900512, "step_id": 14488, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813882.1007762, "step_id": 14489, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813882.111264, "step_id": 14490, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813882.1220515, "step_id": 14491, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813882.1331508, "step_id": 14492, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813882.144311, "step_id": 14493, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813882.1556923, "step_id": 14494, "start_load_kv_us": 17, "get_finished_us": 208} +{"t_unix": 1779813882.1668305, "step_id": 14495, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813882.17804, "step_id": 14496, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813882.1922174, "step_id": 14497, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813882.20129, "step_id": 14498, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813882.212608, "step_id": 14499, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813882.2240062, "step_id": 14500, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813882.2355907, "step_id": 14501, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813882.2467856, "step_id": 14502, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813882.2582955, "step_id": 14503, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813882.269257, "step_id": 14504, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813882.2806988, "step_id": 14505, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813882.292026, "step_id": 14506, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813882.3036816, "step_id": 14507, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813882.3159168, "step_id": 14508, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813882.3273091, "step_id": 14509, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813882.3381755, "step_id": 14510, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813882.3487837, "step_id": 14511, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813882.3597627, "step_id": 14512, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813882.37104, "step_id": 14513, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813882.382119, "step_id": 14514, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813882.394069, "step_id": 14515, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813882.4052901, "step_id": 14516, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813882.4171164, "step_id": 14517, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813882.4293642, "step_id": 14518, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813882.4773853, "step_id": 14519, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813882.4795663, "step_id": 14520, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813882.690719, "step_id": 14521, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813882.7018862, "step_id": 14522, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813882.7131758, "step_id": 14523, "start_load_kv_us": 3, "get_finished_us": 178} +{"t_unix": 1779813882.7246165, "step_id": 14524, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813882.7358143, "step_id": 14525, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813882.746301, "step_id": 14526, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813882.7573938, "step_id": 14527, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813882.7681649, "step_id": 14528, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813882.7791007, "step_id": 14529, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813882.789688, "step_id": 14530, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813882.8008, "step_id": 14531, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813882.8122146, "step_id": 14532, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813882.8239956, "step_id": 14533, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813882.835796, "step_id": 14534, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813882.8471913, "step_id": 14535, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813882.8585126, "step_id": 14536, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813882.870168, "step_id": 14537, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813882.8817499, "step_id": 14538, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813882.8930042, "step_id": 14539, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813882.904601, "step_id": 14540, "start_load_kv_us": 2, "get_finished_us": 299} +{"t_unix": 1779813882.9158766, "step_id": 14541, "start_load_kv_us": 1, "get_finished_us": 262} +{"t_unix": 1779813882.9272647, "step_id": 14542, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813882.938609, "step_id": 14543, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813882.9496403, "step_id": 14544, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813882.9614544, "step_id": 14545, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813882.9731257, "step_id": 14546, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813882.9845233, "step_id": 14547, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813882.995981, "step_id": 14548, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813883.0074675, "step_id": 14549, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813883.0196779, "step_id": 14550, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813883.0311449, "step_id": 14551, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813883.0426693, "step_id": 14552, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813883.0547283, "step_id": 14553, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813883.0666466, "step_id": 14554, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813883.0784254, "step_id": 14555, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813883.0900972, "step_id": 14556, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813883.101642, "step_id": 14557, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813883.1135938, "step_id": 14558, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813883.1256542, "step_id": 14559, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813883.137686, "step_id": 14560, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813883.1493738, "step_id": 14561, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813883.1608741, "step_id": 14562, "start_load_kv_us": 2, "get_finished_us": 298} +{"t_unix": 1779813883.171847, "step_id": 14563, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813883.1832192, "step_id": 14564, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813883.1947417, "step_id": 14565, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813883.2066553, "step_id": 14566, "start_load_kv_us": 2, "get_finished_us": 327} +{"t_unix": 1779813883.2184558, "step_id": 14567, "start_load_kv_us": 2, "get_finished_us": 277} +{"t_unix": 1779813883.2302084, "step_id": 14568, "start_load_kv_us": 12, "get_finished_us": 220} +{"t_unix": 1779813883.2422898, "step_id": 14569, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813883.2542088, "step_id": 14570, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813883.266114, "step_id": 14571, "start_load_kv_us": 2, "get_finished_us": 250} +{"t_unix": 1779813883.2778487, "step_id": 14572, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813883.2896605, "step_id": 14573, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813883.301689, "step_id": 14574, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813883.3137884, "step_id": 14575, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813883.3257987, "step_id": 14576, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813883.3378448, "step_id": 14577, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813883.3499358, "step_id": 14578, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813883.3622284, "step_id": 14579, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813883.4135818, "step_id": 14580, "start_load_kv_us": 2, "get_finished_us": 269} +{"t_unix": 1779813883.4158025, "step_id": 14581, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813883.6233516, "step_id": 14582, "start_load_kv_us": 2, "get_finished_us": 259} +{"t_unix": 1779813883.6345894, "step_id": 14583, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813883.64611, "step_id": 14584, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813883.6570034, "step_id": 14585, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813883.667996, "step_id": 14586, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813883.679175, "step_id": 14587, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813883.6902847, "step_id": 14588, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813883.701516, "step_id": 14589, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813883.7131073, "step_id": 14590, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813883.7247436, "step_id": 14591, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813883.7365952, "step_id": 14592, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813883.7486687, "step_id": 14593, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813883.7612016, "step_id": 14594, "start_load_kv_us": 3, "get_finished_us": 148} +{"t_unix": 1779813883.7722127, "step_id": 14595, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813883.7836587, "step_id": 14596, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813883.7951298, "step_id": 14597, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813883.8063295, "step_id": 14598, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813883.818053, "step_id": 14599, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813883.8295307, "step_id": 14600, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813883.8411772, "step_id": 14601, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813883.85314, "step_id": 14602, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813883.864747, "step_id": 14603, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813883.875322, "step_id": 14604, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813883.8862212, "step_id": 14605, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813883.8975449, "step_id": 14606, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813883.9092867, "step_id": 14607, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813883.9201725, "step_id": 14608, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813883.9309628, "step_id": 14609, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813883.9413664, "step_id": 14610, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813883.951933, "step_id": 14611, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813883.9623501, "step_id": 14612, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813883.9727662, "step_id": 14613, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813883.9836988, "step_id": 14614, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813883.9948149, "step_id": 14615, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813884.0058353, "step_id": 14616, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813884.0165124, "step_id": 14617, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813884.026714, "step_id": 14618, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813884.0368605, "step_id": 14619, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813884.0470996, "step_id": 14620, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813884.0577176, "step_id": 14621, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813884.0683272, "step_id": 14622, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813884.0796456, "step_id": 14623, "start_load_kv_us": 15, "get_finished_us": 163} +{"t_unix": 1779813884.0901132, "step_id": 14624, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813884.10023, "step_id": 14625, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813884.1109645, "step_id": 14626, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813884.122177, "step_id": 14627, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813884.1328824, "step_id": 14628, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813884.1433544, "step_id": 14629, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813884.15426, "step_id": 14630, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813884.1651406, "step_id": 14631, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813884.1758351, "step_id": 14632, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813884.1864748, "step_id": 14633, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813884.1969824, "step_id": 14634, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813884.2081442, "step_id": 14635, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813884.2185624, "step_id": 14636, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813884.2290792, "step_id": 14637, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813884.2400932, "step_id": 14638, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813884.2501948, "step_id": 14639, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813884.2605784, "step_id": 14640, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813884.2714784, "step_id": 14641, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813884.282427, "step_id": 14642, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813884.293479, "step_id": 14643, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813884.3041272, "step_id": 14644, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813884.3152256, "step_id": 14645, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813884.326226, "step_id": 14646, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813884.3370345, "step_id": 14647, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813884.3475776, "step_id": 14648, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813884.3586252, "step_id": 14649, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813884.3694694, "step_id": 14650, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813884.4177554, "step_id": 14651, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813884.4199753, "step_id": 14652, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813884.6684654, "step_id": 14653, "start_load_kv_us": 2, "get_finished_us": 336} +{"t_unix": 1779813884.6709716, "step_id": 14654, "start_load_kv_us": 3, "get_finished_us": 186} +{"t_unix": 1779813885.0911565, "step_id": 14655, "start_load_kv_us": 3, "get_finished_us": 348} +{"t_unix": 1779813885.1042259, "step_id": 14656, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813885.1179943, "step_id": 14657, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813885.1319976, "step_id": 14658, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813885.145965, "step_id": 14659, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813885.1596575, "step_id": 14660, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813885.1733747, "step_id": 14661, "start_load_kv_us": 2, "get_finished_us": 531} +{"t_unix": 1779813885.1864033, "step_id": 14662, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813885.2003086, "step_id": 14663, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813885.214202, "step_id": 14664, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813885.2283778, "step_id": 14665, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813885.2807877, "step_id": 14666, "start_load_kv_us": 2, "get_finished_us": 288} +{"t_unix": 1779813885.283245, "step_id": 14667, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813885.7421575, "step_id": 14668, "start_load_kv_us": 2, "get_finished_us": 331} +{"t_unix": 1779813885.744679, "step_id": 14669, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813885.9575682, "step_id": 14670, "start_load_kv_us": 3, "get_finished_us": 329} +{"t_unix": 1779813885.9720724, "step_id": 14671, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813885.9861083, "step_id": 14672, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813886.000794, "step_id": 14673, "start_load_kv_us": 2, "get_finished_us": 254} +{"t_unix": 1779813886.0153475, "step_id": 14674, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813886.0301957, "step_id": 14675, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813886.0445676, "step_id": 14676, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813886.0589356, "step_id": 14677, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813886.0734804, "step_id": 14678, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813886.0885916, "step_id": 14679, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813886.1410384, "step_id": 14680, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813886.143452, "step_id": 14681, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813886.3532927, "step_id": 14682, "start_load_kv_us": 3, "get_finished_us": 273} +{"t_unix": 1779813886.367407, "step_id": 14683, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813886.3820574, "step_id": 14684, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813886.3963192, "step_id": 14685, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813886.4113455, "step_id": 14686, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813886.4254873, "step_id": 14687, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813886.4395013, "step_id": 14688, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813886.454057, "step_id": 14689, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813886.467998, "step_id": 14690, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813886.4818997, "step_id": 14691, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813886.4958158, "step_id": 14692, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813886.5099375, "step_id": 14693, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813886.5240314, "step_id": 14694, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813886.5383797, "step_id": 14695, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813886.552533, "step_id": 14696, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813886.5666633, "step_id": 14697, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813886.5811307, "step_id": 14698, "start_load_kv_us": 2, "get_finished_us": 286} +{"t_unix": 1779813886.5959911, "step_id": 14699, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813886.6109328, "step_id": 14700, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813886.626092, "step_id": 14701, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813886.6405432, "step_id": 14702, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813886.65461, "step_id": 14703, "start_load_kv_us": 2, "get_finished_us": 226} +{"t_unix": 1779813886.6692955, "step_id": 14704, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813886.6833103, "step_id": 14705, "start_load_kv_us": 2, "get_finished_us": 231} +{"t_unix": 1779813886.6976686, "step_id": 14706, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813886.7118819, "step_id": 14707, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813886.7268639, "step_id": 14708, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813886.7422042, "step_id": 14709, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813886.756985, "step_id": 14710, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813886.7707093, "step_id": 14711, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813886.7849967, "step_id": 14712, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813886.798733, "step_id": 14713, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813886.8495977, "step_id": 14714, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813886.851778, "step_id": 14715, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813887.063367, "step_id": 14716, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813887.0776417, "step_id": 14717, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813887.0916543, "step_id": 14718, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813887.1050086, "step_id": 14719, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813887.1183898, "step_id": 14720, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813887.1322405, "step_id": 14721, "start_load_kv_us": 2, "get_finished_us": 245} +{"t_unix": 1779813887.1459806, "step_id": 14722, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813887.1598246, "step_id": 14723, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813887.1730478, "step_id": 14724, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813887.1873498, "step_id": 14725, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813887.2005188, "step_id": 14726, "start_load_kv_us": 2, "get_finished_us": 249} +{"t_unix": 1779813887.2139277, "step_id": 14727, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813887.2277498, "step_id": 14728, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813887.2417848, "step_id": 14729, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813887.2556956, "step_id": 14730, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813887.2697723, "step_id": 14731, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813887.2837029, "step_id": 14732, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813887.2978213, "step_id": 14733, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813887.3115902, "step_id": 14734, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813887.325588, "step_id": 14735, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813887.339314, "step_id": 14736, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813887.3531349, "step_id": 14737, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813887.3668172, "step_id": 14738, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813887.380192, "step_id": 14739, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813887.3938196, "step_id": 14740, "start_load_kv_us": 13, "get_finished_us": 225} +{"t_unix": 1779813887.4077132, "step_id": 14741, "start_load_kv_us": 3, "get_finished_us": 319} +{"t_unix": 1779813887.42134, "step_id": 14742, "start_load_kv_us": 2, "get_finished_us": 320} +{"t_unix": 1779813887.4349165, "step_id": 14743, "start_load_kv_us": 2, "get_finished_us": 278} +{"t_unix": 1779813887.4881213, "step_id": 14744, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813887.490561, "step_id": 14745, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813887.7018301, "step_id": 14746, "start_load_kv_us": 2, "get_finished_us": 285} +{"t_unix": 1779813887.7151992, "step_id": 14747, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813887.728671, "step_id": 14748, "start_load_kv_us": 2, "get_finished_us": 294} +{"t_unix": 1779813887.7421608, "step_id": 14749, "start_load_kv_us": 2, "get_finished_us": 268} +{"t_unix": 1779813887.7559605, "step_id": 14750, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813887.7697952, "step_id": 14751, "start_load_kv_us": 2, "get_finished_us": 263} +{"t_unix": 1779813887.783703, "step_id": 14752, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813887.797599, "step_id": 14753, "start_load_kv_us": 2, "get_finished_us": 307} +{"t_unix": 1779813887.8107705, "step_id": 14754, "start_load_kv_us": 2, "get_finished_us": 304} +{"t_unix": 1779813887.8239603, "step_id": 14755, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813887.8373845, "step_id": 14756, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813887.850838, "step_id": 14757, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813887.864579, "step_id": 14758, "start_load_kv_us": 2, "get_finished_us": 296} +{"t_unix": 1779813887.8781757, "step_id": 14759, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813887.891831, "step_id": 14760, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813887.905632, "step_id": 14761, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813887.9191442, "step_id": 14762, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813887.933249, "step_id": 14763, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813887.9471757, "step_id": 14764, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813887.9612682, "step_id": 14765, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813887.9751265, "step_id": 14766, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813887.9892921, "step_id": 14767, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813888.0030766, "step_id": 14768, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813888.0165093, "step_id": 14769, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813888.0300965, "step_id": 14770, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813888.043993, "step_id": 14771, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813888.0574818, "step_id": 14772, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813888.0706558, "step_id": 14773, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813888.0841165, "step_id": 14774, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813888.0978138, "step_id": 14775, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813888.1112163, "step_id": 14776, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813888.1245222, "step_id": 14777, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813888.1382089, "step_id": 14778, "start_load_kv_us": 2, "get_finished_us": 312} +{"t_unix": 1779813888.151472, "step_id": 14779, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813888.1648977, "step_id": 14780, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813888.178065, "step_id": 14781, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813888.1914608, "step_id": 14782, "start_load_kv_us": 2, "get_finished_us": 257} +{"t_unix": 1779813888.204721, "step_id": 14783, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813888.2183113, "step_id": 14784, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813888.231889, "step_id": 14785, "start_load_kv_us": 2, "get_finished_us": 247} +{"t_unix": 1779813888.245462, "step_id": 14786, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813888.258782, "step_id": 14787, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813888.272288, "step_id": 14788, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813888.2861521, "step_id": 14789, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813888.299911, "step_id": 14790, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813888.313785, "step_id": 14791, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813888.3275888, "step_id": 14792, "start_load_kv_us": 2, "get_finished_us": 229} +{"t_unix": 1779813888.3410106, "step_id": 14793, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813888.3544104, "step_id": 14794, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813888.3677394, "step_id": 14795, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813888.3819628, "step_id": 14796, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813888.3957253, "step_id": 14797, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813888.4095893, "step_id": 14798, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813888.4235907, "step_id": 14799, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813888.4370837, "step_id": 14800, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813888.4547658, "step_id": 14801, "start_load_kv_us": 21, "get_finished_us": 1395} +{"t_unix": 1779813888.46427, "step_id": 14802, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813888.4767785, "step_id": 14803, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813888.4900622, "step_id": 14804, "start_load_kv_us": 2, "get_finished_us": 262} +{"t_unix": 1779813888.5036175, "step_id": 14805, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813888.5167298, "step_id": 14806, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813888.530477, "step_id": 14807, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813888.5439165, "step_id": 14808, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813888.557316, "step_id": 14809, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813888.5700045, "step_id": 14810, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813888.5835855, "step_id": 14811, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813888.5973601, "step_id": 14812, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813888.6109362, "step_id": 14813, "start_load_kv_us": 2, "get_finished_us": 239} +{"t_unix": 1779813888.624448, "step_id": 14814, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813888.6379316, "step_id": 14815, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813888.6513224, "step_id": 14816, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813888.6644511, "step_id": 14817, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813888.6779814, "step_id": 14818, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813888.6911974, "step_id": 14819, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813888.7042334, "step_id": 14820, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813888.7176125, "step_id": 14821, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813888.7313976, "step_id": 14822, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813888.7450929, "step_id": 14823, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813888.758837, "step_id": 14824, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813888.7726488, "step_id": 14825, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813888.786356, "step_id": 14826, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813888.8002517, "step_id": 14827, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813888.8141975, "step_id": 14828, "start_load_kv_us": 12, "get_finished_us": 209} +{"t_unix": 1779813888.828073, "step_id": 14829, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813888.84227, "step_id": 14830, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813888.8564115, "step_id": 14831, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813888.87051, "step_id": 14832, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813888.8846676, "step_id": 14833, "start_load_kv_us": 2, "get_finished_us": 337} +{"t_unix": 1779813888.8984833, "step_id": 14834, "start_load_kv_us": 2, "get_finished_us": 236} +{"t_unix": 1779813888.9120145, "step_id": 14835, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813888.9263566, "step_id": 14836, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813888.9407122, "step_id": 14837, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813888.952543, "step_id": 14838, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813888.9645407, "step_id": 14839, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813888.9768462, "step_id": 14840, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813888.9893053, "step_id": 14841, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813889.0018818, "step_id": 14842, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813889.0144753, "step_id": 14843, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813889.02681, "step_id": 14844, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813889.0391192, "step_id": 14845, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813889.051316, "step_id": 14846, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813889.0636063, "step_id": 14847, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813889.076491, "step_id": 14848, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813889.088398, "step_id": 14849, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813889.1002533, "step_id": 14850, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813889.1119146, "step_id": 14851, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813889.1234503, "step_id": 14852, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813889.134389, "step_id": 14853, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813889.146054, "step_id": 14854, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813889.157694, "step_id": 14855, "start_load_kv_us": 2, "get_finished_us": 267} +{"t_unix": 1779813889.1687818, "step_id": 14856, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813889.1802197, "step_id": 14857, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813889.191873, "step_id": 14858, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813889.203688, "step_id": 14859, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813889.2152984, "step_id": 14860, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813889.2266104, "step_id": 14861, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813889.2386293, "step_id": 14862, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813889.2503493, "step_id": 14863, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813889.2618093, "step_id": 14864, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813889.2735412, "step_id": 14865, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813889.2853005, "step_id": 14866, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813889.2966583, "step_id": 14867, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813889.3083808, "step_id": 14868, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813889.3202734, "step_id": 14869, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813889.3320243, "step_id": 14870, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813889.3435407, "step_id": 14871, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813889.3554857, "step_id": 14872, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813889.367218, "step_id": 14873, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813889.3789039, "step_id": 14874, "start_load_kv_us": 2, "get_finished_us": 256} +{"t_unix": 1779813889.390516, "step_id": 14875, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813889.4029074, "step_id": 14876, "start_load_kv_us": 2, "get_finished_us": 280} +{"t_unix": 1779813889.4151564, "step_id": 14877, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813889.4274986, "step_id": 14878, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813889.4812763, "step_id": 14879, "start_load_kv_us": 2, "get_finished_us": 291} +{"t_unix": 1779813889.483699, "step_id": 14880, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813889.689993, "step_id": 14881, "start_load_kv_us": 2, "get_finished_us": 314} +{"t_unix": 1779813889.7034237, "step_id": 14882, "start_load_kv_us": 3, "get_finished_us": 235} +{"t_unix": 1779813889.7172554, "step_id": 14883, "start_load_kv_us": 2, "get_finished_us": 237} +{"t_unix": 1779813889.731144, "step_id": 14884, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813889.7450526, "step_id": 14885, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813889.758569, "step_id": 14886, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813889.7725089, "step_id": 14887, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813889.7862785, "step_id": 14888, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813889.8004982, "step_id": 14889, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813889.8142586, "step_id": 14890, "start_load_kv_us": 7, "get_finished_us": 198} +{"t_unix": 1779813889.828079, "step_id": 14891, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813889.842215, "step_id": 14892, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813889.8565164, "step_id": 14893, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813889.87082, "step_id": 14894, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813889.8847713, "step_id": 14895, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813889.8983855, "step_id": 14896, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813889.91217, "step_id": 14897, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813889.92624, "step_id": 14898, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813889.9400291, "step_id": 14899, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813889.953697, "step_id": 14900, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813889.967802, "step_id": 14901, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813889.9817123, "step_id": 14902, "start_load_kv_us": 2, "get_finished_us": 251} +{"t_unix": 1779813889.99608, "step_id": 14903, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813890.0104618, "step_id": 14904, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813890.0244982, "step_id": 14905, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813890.038461, "step_id": 14906, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813890.052761, "step_id": 14907, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813890.06647, "step_id": 14908, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813890.0786128, "step_id": 14909, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813890.0903826, "step_id": 14910, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813890.1018026, "step_id": 14911, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813890.1137898, "step_id": 14912, "start_load_kv_us": 2, "get_finished_us": 276} +{"t_unix": 1779813890.1257243, "step_id": 14913, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813890.1378372, "step_id": 14914, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813890.1499062, "step_id": 14915, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813890.1615233, "step_id": 14916, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813890.1733284, "step_id": 14917, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813890.1852257, "step_id": 14918, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813890.1968489, "step_id": 14919, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813890.2080457, "step_id": 14920, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813890.2190933, "step_id": 14921, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813890.2311273, "step_id": 14922, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813890.2430236, "step_id": 14923, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813890.2527392, "step_id": 14924, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813890.2629046, "step_id": 14925, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813890.2706301, "step_id": 14926, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813890.2787404, "step_id": 14927, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813890.2868378, "step_id": 14928, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813890.2949295, "step_id": 14929, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813890.3026698, "step_id": 14930, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813890.3099184, "step_id": 14931, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813890.3173666, "step_id": 14932, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813890.325383, "step_id": 14933, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813890.3329701, "step_id": 14934, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813890.3406587, "step_id": 14935, "start_load_kv_us": 2, "get_finished_us": 227} +{"t_unix": 1779813890.3485665, "step_id": 14936, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813890.356102, "step_id": 14937, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813890.3631418, "step_id": 14938, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813890.3750284, "step_id": 14939, "start_load_kv_us": 36, "get_finished_us": 1106} +{"t_unix": 1779813890.377663, "step_id": 14940, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813890.384798, "step_id": 14941, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813890.3922536, "step_id": 14942, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813890.3996534, "step_id": 14943, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813890.4073703, "step_id": 14944, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813890.4150302, "step_id": 14945, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813890.4227962, "step_id": 14946, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813890.4302118, "step_id": 14947, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813890.437799, "step_id": 14948, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813890.4454901, "step_id": 14949, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813890.4530773, "step_id": 14950, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813890.4604728, "step_id": 14951, "start_load_kv_us": 1, "get_finished_us": 166} +{"t_unix": 1779813890.4676247, "step_id": 14952, "start_load_kv_us": 1, "get_finished_us": 201} +{"t_unix": 1779813890.4748478, "step_id": 14953, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813890.4821048, "step_id": 14954, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813890.489772, "step_id": 14955, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813890.4972224, "step_id": 14956, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813890.5043051, "step_id": 14957, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813890.5115824, "step_id": 14958, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813890.5192413, "step_id": 14959, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813890.5266256, "step_id": 14960, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813890.534056, "step_id": 14961, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813890.5415437, "step_id": 14962, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813890.5489378, "step_id": 14963, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813890.5565343, "step_id": 14964, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813890.5642116, "step_id": 14965, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813890.5716279, "step_id": 14966, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813890.5791557, "step_id": 14967, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813890.5864236, "step_id": 14968, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813890.5939145, "step_id": 14969, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813890.6022856, "step_id": 14970, "start_load_kv_us": 3, "get_finished_us": 158} +{"t_unix": 1779813890.60938, "step_id": 14971, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813890.6149218, "step_id": 14972, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813890.6208453, "step_id": 14973, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813890.6264904, "step_id": 14974, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813890.6320448, "step_id": 14975, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813890.6374693, "step_id": 14976, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813890.6431928, "step_id": 14977, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813890.6491733, "step_id": 14978, "start_load_kv_us": 2, "get_finished_us": 128} +{"t_unix": 1779813890.6549718, "step_id": 14979, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813890.660608, "step_id": 14980, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813890.6665275, "step_id": 14981, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813890.6723385, "step_id": 14982, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813890.6781664, "step_id": 14983, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813890.6843278, "step_id": 14984, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813890.6903684, "step_id": 14985, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813890.6958778, "step_id": 14986, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813890.7016363, "step_id": 14987, "start_load_kv_us": 2, "get_finished_us": 169} +{"t_unix": 1779813890.7075694, "step_id": 14988, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813890.713267, "step_id": 14989, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813890.718746, "step_id": 14990, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813890.7244606, "step_id": 14991, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813890.7302504, "step_id": 14992, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813890.7359855, "step_id": 14993, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813890.7421227, "step_id": 14994, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813890.7480707, "step_id": 14995, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813890.7540133, "step_id": 14996, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813890.7601402, "step_id": 14997, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813890.7658515, "step_id": 14998, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813890.7715075, "step_id": 14999, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813890.7774303, "step_id": 15000, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813890.7834518, "step_id": 15001, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813890.7880726, "step_id": 15002, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813890.7929404, "step_id": 15003, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813890.7976377, "step_id": 15004, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813890.8023667, "step_id": 15005, "start_load_kv_us": 2, "get_finished_us": 130} +{"t_unix": 1779813890.8071744, "step_id": 15006, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813890.8118954, "step_id": 15007, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813890.8166816, "step_id": 15008, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813890.821463, "step_id": 15009, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813890.82621, "step_id": 15010, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813890.8309865, "step_id": 15011, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813890.835806, "step_id": 15012, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813890.8405433, "step_id": 15013, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813890.845307, "step_id": 15014, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813890.850125, "step_id": 15015, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813890.8549001, "step_id": 15016, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813890.8597152, "step_id": 15017, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813890.864477, "step_id": 15018, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813890.8692153, "step_id": 15019, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813890.874018, "step_id": 15020, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813890.8788607, "step_id": 15021, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813890.8835762, "step_id": 15022, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813890.8883758, "step_id": 15023, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813890.8932824, "step_id": 15024, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813890.89797, "step_id": 15025, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813890.9026556, "step_id": 15026, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813890.9074674, "step_id": 15027, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813890.9122112, "step_id": 15028, "start_load_kv_us": 2, "get_finished_us": 132} +{"t_unix": 1779813890.9170423, "step_id": 15029, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813890.92179, "step_id": 15030, "start_load_kv_us": 1, "get_finished_us": 135} +{"t_unix": 1779813890.9264896, "step_id": 15031, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813890.9313061, "step_id": 15032, "start_load_kv_us": 2, "get_finished_us": 134} +{"t_unix": 1779813890.9361715, "step_id": 15033, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813890.940904, "step_id": 15034, "start_load_kv_us": 2, "get_finished_us": 131} +{"t_unix": 1779813890.9456909, "step_id": 15035, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813890.95042, "step_id": 15036, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813890.9552267, "step_id": 15037, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813890.9601035, "step_id": 15038, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813890.9650342, "step_id": 15039, "start_load_kv_us": 3, "get_finished_us": 253} +{"t_unix": 1779813890.9699266, "step_id": 15040, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813890.9744494, "step_id": 15041, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813890.97924, "step_id": 15042, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813890.984008, "step_id": 15043, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813890.9887938, "step_id": 15044, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813890.9936328, "step_id": 15045, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813890.9982393, "step_id": 15046, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813891.0030363, "step_id": 15047, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813891.007752, "step_id": 15048, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813891.0125825, "step_id": 15049, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813891.0173311, "step_id": 15050, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813891.0220993, "step_id": 15051, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813891.0269248, "step_id": 15052, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813891.0317645, "step_id": 15053, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813891.0364296, "step_id": 15054, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813891.0413647, "step_id": 15055, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813891.0460432, "step_id": 15056, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813891.050847, "step_id": 15057, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813891.055656, "step_id": 15058, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813891.060404, "step_id": 15059, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813891.065098, "step_id": 15060, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813891.0700366, "step_id": 15061, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813891.074727, "step_id": 15062, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813891.079508, "step_id": 15063, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813891.084265, "step_id": 15064, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813891.0890903, "step_id": 15065, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813891.0939786, "step_id": 15066, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813891.098586, "step_id": 15067, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813891.1033802, "step_id": 15068, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813891.1081645, "step_id": 15069, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813891.112962, "step_id": 15070, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813891.1177406, "step_id": 15071, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813891.1225278, "step_id": 15072, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813891.1272547, "step_id": 15073, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813891.1320922, "step_id": 15074, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813891.136907, "step_id": 15075, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813891.141682, "step_id": 15076, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813891.1464927, "step_id": 15077, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813891.151243, "step_id": 15078, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813891.1560116, "step_id": 15079, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813891.1608238, "step_id": 15080, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813891.1654878, "step_id": 15081, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813891.1703122, "step_id": 15082, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813891.1750786, "step_id": 15083, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813891.179872, "step_id": 15084, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813891.1845872, "step_id": 15085, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813891.1893733, "step_id": 15086, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813891.1942718, "step_id": 15087, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813891.1989598, "step_id": 15088, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813891.2036748, "step_id": 15089, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813891.2084525, "step_id": 15090, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813891.213254, "step_id": 15091, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813891.2180257, "step_id": 15092, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813891.222864, "step_id": 15093, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813891.227515, "step_id": 15094, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813891.232372, "step_id": 15095, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813891.2371569, "step_id": 15096, "start_load_kv_us": 1, "get_finished_us": 193} +{"t_unix": 1779813891.241924, "step_id": 15097, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813891.2466397, "step_id": 15098, "start_load_kv_us": 16, "get_finished_us": 157} +{"t_unix": 1779813891.2514524, "step_id": 15099, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813891.256217, "step_id": 15100, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813891.2609997, "step_id": 15101, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813891.2658124, "step_id": 15102, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813891.2706099, "step_id": 15103, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813891.2754204, "step_id": 15104, "start_load_kv_us": 1, "get_finished_us": 167} +{"t_unix": 1779813891.2801669, "step_id": 15105, "start_load_kv_us": 16, "get_finished_us": 176} +{"t_unix": 1779813891.2849681, "step_id": 15106, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813891.2897048, "step_id": 15107, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813891.2946677, "step_id": 15108, "start_load_kv_us": 2, "get_finished_us": 264} +{"t_unix": 1779813891.2993362, "step_id": 15109, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813891.3040755, "step_id": 15110, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813891.308828, "step_id": 15111, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813891.3136, "step_id": 15112, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813891.3183286, "step_id": 15113, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813891.323105, "step_id": 15114, "start_load_kv_us": 1, "get_finished_us": 133} +{"t_unix": 1779813891.3279037, "step_id": 15115, "start_load_kv_us": 2, "get_finished_us": 136} +{"t_unix": 1779813891.3327343, "step_id": 15116, "start_load_kv_us": 1, "get_finished_us": 157} +{"t_unix": 1779813891.33783, "step_id": 15117, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813891.342595, "step_id": 15118, "start_load_kv_us": 2, "get_finished_us": 282} +{"t_unix": 1779813891.3471575, "step_id": 15119, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813891.3519275, "step_id": 15120, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813891.3566713, "step_id": 15121, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813891.361455, "step_id": 15122, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813891.366192, "step_id": 15123, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813891.3710148, "step_id": 15124, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813891.3758864, "step_id": 15125, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813891.3805358, "step_id": 15126, "start_load_kv_us": 2, "get_finished_us": 155} +{"t_unix": 1779813891.3852694, "step_id": 15127, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813891.3900428, "step_id": 15128, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813891.394916, "step_id": 15129, "start_load_kv_us": 1, "get_finished_us": 141} +{"t_unix": 1779813891.3995678, "step_id": 15130, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813891.4043117, "step_id": 15131, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813891.4090862, "step_id": 15132, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813891.413906, "step_id": 15133, "start_load_kv_us": 1, "get_finished_us": 143} +{"t_unix": 1779813891.4186852, "step_id": 15134, "start_load_kv_us": 1, "get_finished_us": 213} +{"t_unix": 1779813891.4231653, "step_id": 15135, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813891.427149, "step_id": 15136, "start_load_kv_us": 1, "get_finished_us": 177} +{"t_unix": 1779813891.924576, "step_id": 15137, "start_load_kv_us": 2, "get_finished_us": 338} +{"t_unix": 1779813891.9265358, "step_id": 15138, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813892.1167598, "step_id": 15139, "start_load_kv_us": 2, "get_finished_us": 328} +{"t_unix": 1779813892.121231, "step_id": 15140, "start_load_kv_us": 2, "get_finished_us": 292} +{"t_unix": 1779813892.126059, "step_id": 15141, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813892.131645, "step_id": 15142, "start_load_kv_us": 2, "get_finished_us": 235} +{"t_unix": 1779813892.1722238, "step_id": 15143, "start_load_kv_us": 4, "get_finished_us": 224} +{"t_unix": 1779813892.1741686, "step_id": 15144, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813892.3750985, "step_id": 15145, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813892.3804152, "step_id": 15146, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813892.423657, "step_id": 15147, "start_load_kv_us": 2, "get_finished_us": 272} +{"t_unix": 1779813892.6181211, "step_id": 15148, "start_load_kv_us": 2, "get_finished_us": 306} +{"t_unix": 1779813892.8543892, "step_id": 15149, "start_load_kv_us": 2, "get_finished_us": 290} +{"t_unix": 1779813892.8640394, "step_id": 15150, "start_load_kv_us": 2, "get_finished_us": 260} +{"t_unix": 1779813893.13839, "step_id": 15151, "start_load_kv_us": 3, "get_finished_us": 342} +{"t_unix": 1779813893.140909, "step_id": 15152, "start_load_kv_us": 3, "get_finished_us": 192} +{"t_unix": 1779813893.3471766, "step_id": 15153, "start_load_kv_us": 2, "get_finished_us": 325} +{"t_unix": 1779813893.354922, "step_id": 15154, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813893.3634002, "step_id": 15155, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813893.3720937, "step_id": 15156, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813893.3808444, "step_id": 15157, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813893.3896208, "step_id": 15158, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813893.398411, "step_id": 15159, "start_load_kv_us": 2, "get_finished_us": 219} +{"t_unix": 1779813893.407159, "step_id": 15160, "start_load_kv_us": 2, "get_finished_us": 223} +{"t_unix": 1779813893.4158728, "step_id": 15161, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813893.424676, "step_id": 15162, "start_load_kv_us": 2, "get_finished_us": 287} +{"t_unix": 1779813893.433763, "step_id": 15163, "start_load_kv_us": 2, "get_finished_us": 233} +{"t_unix": 1779813893.4425666, "step_id": 15164, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813893.4513083, "step_id": 15165, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813893.4602444, "step_id": 15166, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813893.4687867, "step_id": 15167, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813893.477571, "step_id": 15168, "start_load_kv_us": 2, "get_finished_us": 175} +{"t_unix": 1779813893.4861915, "step_id": 15169, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813893.4948363, "step_id": 15170, "start_load_kv_us": 2, "get_finished_us": 198} +{"t_unix": 1779813893.5033972, "step_id": 15171, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813893.5125365, "step_id": 15172, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813893.521506, "step_id": 15173, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813893.530362, "step_id": 15174, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813893.5392118, "step_id": 15175, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813893.5482957, "step_id": 15176, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813893.5580735, "step_id": 15177, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813893.6037154, "step_id": 15178, "start_load_kv_us": 3, "get_finished_us": 294} +{"t_unix": 1779813893.6059155, "step_id": 15179, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813893.849745, "step_id": 15180, "start_load_kv_us": 2, "get_finished_us": 344} +{"t_unix": 1779813893.8522053, "step_id": 15181, "start_load_kv_us": 3, "get_finished_us": 172} +{"t_unix": 1779813894.270574, "step_id": 15182, "start_load_kv_us": 3, "get_finished_us": 355} +{"t_unix": 1779813894.2806146, "step_id": 15183, "start_load_kv_us": 2, "get_finished_us": 273} +{"t_unix": 1779813894.2910073, "step_id": 15184, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813894.301595, "step_id": 15185, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813894.3120105, "step_id": 15186, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813894.3227248, "step_id": 15187, "start_load_kv_us": 2, "get_finished_us": 310} +{"t_unix": 1779813894.333544, "step_id": 15188, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813894.34471, "step_id": 15189, "start_load_kv_us": 3, "get_finished_us": 195} +{"t_unix": 1779813894.3555398, "step_id": 15190, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813894.3666186, "step_id": 15191, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813894.3778522, "step_id": 15192, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813894.3894277, "step_id": 15193, "start_load_kv_us": 2, "get_finished_us": 228} +{"t_unix": 1779813894.4009628, "step_id": 15194, "start_load_kv_us": 2, "get_finished_us": 244} +{"t_unix": 1779813894.4124763, "step_id": 15195, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813894.4232395, "step_id": 15196, "start_load_kv_us": 2, "get_finished_us": 265} +{"t_unix": 1779813894.4339697, "step_id": 15197, "start_load_kv_us": 2, "get_finished_us": 248} +{"t_unix": 1779813894.4448478, "step_id": 15198, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813894.4553502, "step_id": 15199, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813894.4663606, "step_id": 15200, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813894.4777422, "step_id": 15201, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813894.4887795, "step_id": 15202, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813894.500404, "step_id": 15203, "start_load_kv_us": 2, "get_finished_us": 187} +{"t_unix": 1779813894.5119007, "step_id": 15204, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813894.522828, "step_id": 15205, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813894.5340853, "step_id": 15206, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813894.5452628, "step_id": 15207, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813894.5563834, "step_id": 15208, "start_load_kv_us": 2, "get_finished_us": 222} +{"t_unix": 1779813894.567343, "step_id": 15209, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813894.5786862, "step_id": 15210, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813894.5895975, "step_id": 15211, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813894.6007268, "step_id": 15212, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813894.6120207, "step_id": 15213, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813894.623067, "step_id": 15214, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813894.6343544, "step_id": 15215, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813894.6454575, "step_id": 15216, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813894.6562517, "step_id": 15217, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813894.6673367, "step_id": 15218, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813894.6786041, "step_id": 15219, "start_load_kv_us": 2, "get_finished_us": 188} +{"t_unix": 1779813894.6897604, "step_id": 15220, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813894.700893, "step_id": 15221, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813894.7123845, "step_id": 15222, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813894.723635, "step_id": 15223, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813894.7350423, "step_id": 15224, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813894.746691, "step_id": 15225, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813894.7582865, "step_id": 15226, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813894.7697513, "step_id": 15227, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813894.7810626, "step_id": 15228, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813894.7926285, "step_id": 15229, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813894.8040588, "step_id": 15230, "start_load_kv_us": 2, "get_finished_us": 208} +{"t_unix": 1779813894.8154066, "step_id": 15231, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813894.8272536, "step_id": 15232, "start_load_kv_us": 2, "get_finished_us": 153} +{"t_unix": 1779813894.838707, "step_id": 15233, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813894.8507283, "step_id": 15234, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813894.8621647, "step_id": 15235, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813894.8734996, "step_id": 15236, "start_load_kv_us": 2, "get_finished_us": 199} +{"t_unix": 1779813894.8845296, "step_id": 15237, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813894.895626, "step_id": 15238, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813894.906873, "step_id": 15239, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813894.918233, "step_id": 15240, "start_load_kv_us": 2, "get_finished_us": 212} +{"t_unix": 1779813894.9293084, "step_id": 15241, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813894.9407122, "step_id": 15242, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813894.952606, "step_id": 15243, "start_load_kv_us": 2, "get_finished_us": 255} +{"t_unix": 1779813894.9640977, "step_id": 15244, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813894.975563, "step_id": 15245, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813894.9872274, "step_id": 15246, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813894.9995563, "step_id": 15247, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813895.0117145, "step_id": 15248, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813895.0232742, "step_id": 15249, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813895.0349092, "step_id": 15250, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813895.0462644, "step_id": 15251, "start_load_kv_us": 2, "get_finished_us": 196} +{"t_unix": 1779813895.0577888, "step_id": 15252, "start_load_kv_us": 2, "get_finished_us": 258} +{"t_unix": 1779813895.0692894, "step_id": 15253, "start_load_kv_us": 2, "get_finished_us": 270} +{"t_unix": 1779813895.080535, "step_id": 15254, "start_load_kv_us": 2, "get_finished_us": 217} +{"t_unix": 1779813895.0918174, "step_id": 15255, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813895.1029184, "step_id": 15256, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813895.1141994, "step_id": 15257, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813895.1252599, "step_id": 15258, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813895.1364558, "step_id": 15259, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813895.1480687, "step_id": 15260, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813895.1595407, "step_id": 15261, "start_load_kv_us": 2, "get_finished_us": 180} +{"t_unix": 1779813895.1709266, "step_id": 15262, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813895.182209, "step_id": 15263, "start_load_kv_us": 3, "get_finished_us": 181} +{"t_unix": 1779813895.1936767, "step_id": 15264, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813895.2049103, "step_id": 15265, "start_load_kv_us": 2, "get_finished_us": 242} +{"t_unix": 1779813895.2157056, "step_id": 15266, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813895.2267387, "step_id": 15267, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813895.2384531, "step_id": 15268, "start_load_kv_us": 2, "get_finished_us": 261} +{"t_unix": 1779813895.2500167, "step_id": 15269, "start_load_kv_us": 2, "get_finished_us": 238} +{"t_unix": 1779813895.2621145, "step_id": 15270, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813895.2739272, "step_id": 15271, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813895.2857625, "step_id": 15272, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813895.2974746, "step_id": 15273, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813895.3093948, "step_id": 15274, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813895.3208575, "step_id": 15275, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813895.3318975, "step_id": 15276, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813895.3435938, "step_id": 15277, "start_load_kv_us": 2, "get_finished_us": 283} +{"t_unix": 1779813895.355557, "step_id": 15278, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813895.3669019, "step_id": 15279, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813895.3783524, "step_id": 15280, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813895.3895037, "step_id": 15281, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813895.399913, "step_id": 15282, "start_load_kv_us": 2, "get_finished_us": 190} +{"t_unix": 1779813895.4108357, "step_id": 15283, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813895.422139, "step_id": 15284, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813895.43367, "step_id": 15285, "start_load_kv_us": 2, "get_finished_us": 203} +{"t_unix": 1779813895.445634, "step_id": 15286, "start_load_kv_us": 2, "get_finished_us": 161} +{"t_unix": 1779813895.4574914, "step_id": 15287, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813895.4691675, "step_id": 15288, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813895.4810321, "step_id": 15289, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813895.4928095, "step_id": 15290, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813895.5046253, "step_id": 15291, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813895.516906, "step_id": 15292, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813895.528829, "step_id": 15293, "start_load_kv_us": 2, "get_finished_us": 221} +{"t_unix": 1779813895.5409648, "step_id": 15294, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813895.5528445, "step_id": 15295, "start_load_kv_us": 2, "get_finished_us": 185} +{"t_unix": 1779813895.564873, "step_id": 15296, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813895.57706, "step_id": 15297, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813895.58903, "step_id": 15298, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813895.601186, "step_id": 15299, "start_load_kv_us": 2, "get_finished_us": 143} +{"t_unix": 1779813895.61359, "step_id": 15300, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813895.6255345, "step_id": 15301, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813895.637671, "step_id": 15302, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813895.6501212, "step_id": 15303, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813895.6620176, "step_id": 15304, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813895.673659, "step_id": 15305, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813895.6887648, "step_id": 15306, "start_load_kv_us": 2, "get_finished_us": 274} +{"t_unix": 1779813895.697528, "step_id": 15307, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813895.7094607, "step_id": 15308, "start_load_kv_us": 2, "get_finished_us": 176} +{"t_unix": 1779813895.7212198, "step_id": 15309, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813895.7332873, "step_id": 15310, "start_load_kv_us": 2, "get_finished_us": 158} +{"t_unix": 1779813895.7453415, "step_id": 15311, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813895.7573419, "step_id": 15312, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813895.769153, "step_id": 15313, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813895.7807155, "step_id": 15314, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813895.7923918, "step_id": 15315, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813895.804063, "step_id": 15316, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813895.8157113, "step_id": 15317, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813895.827393, "step_id": 15318, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813895.8394156, "step_id": 15319, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813895.8513558, "step_id": 15320, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813895.8635316, "step_id": 15321, "start_load_kv_us": 2, "get_finished_us": 214} +{"t_unix": 1779813895.8753927, "step_id": 15322, "start_load_kv_us": 2, "get_finished_us": 166} +{"t_unix": 1779813895.8874633, "step_id": 15323, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813895.8993132, "step_id": 15324, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813895.9105737, "step_id": 15325, "start_load_kv_us": 2, "get_finished_us": 253} +{"t_unix": 1779813895.9215913, "step_id": 15326, "start_load_kv_us": 2, "get_finished_us": 293} +{"t_unix": 1779813895.9323177, "step_id": 15327, "start_load_kv_us": 2, "get_finished_us": 178} +{"t_unix": 1779813895.9433992, "step_id": 15328, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813895.9546077, "step_id": 15329, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813895.96477, "step_id": 15330, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813895.97524, "step_id": 15331, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813895.9862914, "step_id": 15332, "start_load_kv_us": 2, "get_finished_us": 142} +{"t_unix": 1779813895.9975374, "step_id": 15333, "start_load_kv_us": 1, "get_finished_us": 163} +{"t_unix": 1779813896.0086923, "step_id": 15334, "start_load_kv_us": 2, "get_finished_us": 206} +{"t_unix": 1779813896.0196757, "step_id": 15335, "start_load_kv_us": 2, "get_finished_us": 252} +{"t_unix": 1779813896.0308092, "step_id": 15336, "start_load_kv_us": 2, "get_finished_us": 152} +{"t_unix": 1779813896.0416796, "step_id": 15337, "start_load_kv_us": 2, "get_finished_us": 162} +{"t_unix": 1779813896.0531502, "step_id": 15338, "start_load_kv_us": 2, "get_finished_us": 183} +{"t_unix": 1779813896.0648687, "step_id": 15339, "start_load_kv_us": 2, "get_finished_us": 160} +{"t_unix": 1779813896.0765598, "step_id": 15340, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813896.0878942, "step_id": 15341, "start_load_kv_us": 2, "get_finished_us": 164} +{"t_unix": 1779813896.099009, "step_id": 15342, "start_load_kv_us": 2, "get_finished_us": 225} +{"t_unix": 1779813896.1099973, "step_id": 15343, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813896.1216204, "step_id": 15344, "start_load_kv_us": 2, "get_finished_us": 195} +{"t_unix": 1779813896.1334846, "step_id": 15345, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813896.1450026, "step_id": 15346, "start_load_kv_us": 2, "get_finished_us": 168} +{"t_unix": 1779813896.1571178, "step_id": 15347, "start_load_kv_us": 2, "get_finished_us": 200} +{"t_unix": 1779813896.1691751, "step_id": 15348, "start_load_kv_us": 2, "get_finished_us": 197} +{"t_unix": 1779813896.1810412, "step_id": 15349, "start_load_kv_us": 2, "get_finished_us": 174} +{"t_unix": 1779813896.1923344, "step_id": 15350, "start_load_kv_us": 2, "get_finished_us": 173} +{"t_unix": 1779813896.2041514, "step_id": 15351, "start_load_kv_us": 2, "get_finished_us": 213} +{"t_unix": 1779813896.2157712, "step_id": 15352, "start_load_kv_us": 2, "get_finished_us": 232} +{"t_unix": 1779813896.2274804, "step_id": 15353, "start_load_kv_us": 2, "get_finished_us": 179} +{"t_unix": 1779813896.239585, "step_id": 15354, "start_load_kv_us": 2, "get_finished_us": 215} +{"t_unix": 1779813896.2516816, "step_id": 15355, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813896.262846, "step_id": 15356, "start_load_kv_us": 2, "get_finished_us": 149} +{"t_unix": 1779813896.2741485, "step_id": 15357, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813896.2859077, "step_id": 15358, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813896.297817, "step_id": 15359, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813896.310019, "step_id": 15360, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813896.3223982, "step_id": 15361, "start_load_kv_us": 2, "get_finished_us": 246} +{"t_unix": 1779813896.334607, "step_id": 15362, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813896.3468585, "step_id": 15363, "start_load_kv_us": 2, "get_finished_us": 211} +{"t_unix": 1779813896.3585782, "step_id": 15364, "start_load_kv_us": 2, "get_finished_us": 209} +{"t_unix": 1779813896.3703043, "step_id": 15365, "start_load_kv_us": 2, "get_finished_us": 148} +{"t_unix": 1779813896.3823402, "step_id": 15366, "start_load_kv_us": 2, "get_finished_us": 182} +{"t_unix": 1779813896.39412, "step_id": 15367, "start_load_kv_us": 2, "get_finished_us": 207} +{"t_unix": 1779813896.4059937, "step_id": 15368, "start_load_kv_us": 2, "get_finished_us": 205} +{"t_unix": 1779813896.4178462, "step_id": 15369, "start_load_kv_us": 2, "get_finished_us": 202} +{"t_unix": 1779813896.429402, "step_id": 15370, "start_load_kv_us": 2, "get_finished_us": 181} +{"t_unix": 1779813896.441463, "step_id": 15371, "start_load_kv_us": 2, "get_finished_us": 177} +{"t_unix": 1779813896.4537013, "step_id": 15372, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813896.465976, "step_id": 15373, "start_load_kv_us": 2, "get_finished_us": 218} +{"t_unix": 1779813896.4778123, "step_id": 15374, "start_load_kv_us": 2, "get_finished_us": 165} +{"t_unix": 1779813896.4896688, "step_id": 15375, "start_load_kv_us": 2, "get_finished_us": 156} +{"t_unix": 1779813896.5016248, "step_id": 15376, "start_load_kv_us": 2, "get_finished_us": 234} +{"t_unix": 1779813896.5131683, "step_id": 15377, "start_load_kv_us": 2, "get_finished_us": 189} +{"t_unix": 1779813896.52506, "step_id": 15378, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813896.5369887, "step_id": 15379, "start_load_kv_us": 2, "get_finished_us": 157} +{"t_unix": 1779813896.5488317, "step_id": 15380, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813896.560837, "step_id": 15381, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813896.572758, "step_id": 15382, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813896.584756, "step_id": 15383, "start_load_kv_us": 2, "get_finished_us": 194} +{"t_unix": 1779813896.5964646, "step_id": 15384, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813896.6085947, "step_id": 15385, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813896.6201982, "step_id": 15386, "start_load_kv_us": 2, "get_finished_us": 184} +{"t_unix": 1779813896.632039, "step_id": 15387, "start_load_kv_us": 2, "get_finished_us": 171} +{"t_unix": 1779813896.6433606, "step_id": 15388, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813896.6544664, "step_id": 15389, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813896.6658542, "step_id": 15390, "start_load_kv_us": 2, "get_finished_us": 137} +{"t_unix": 1779813896.6771564, "step_id": 15391, "start_load_kv_us": 2, "get_finished_us": 133} +{"t_unix": 1779813896.6887388, "step_id": 15392, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813896.7006369, "step_id": 15393, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813896.7118688, "step_id": 15394, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813896.7223947, "step_id": 15395, "start_load_kv_us": 2, "get_finished_us": 135} +{"t_unix": 1779813896.733126, "step_id": 15396, "start_load_kv_us": 2, "get_finished_us": 146} +{"t_unix": 1779813896.7438357, "step_id": 15397, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813896.7548704, "step_id": 15398, "start_load_kv_us": 2, "get_finished_us": 201} +{"t_unix": 1779813896.7661638, "step_id": 15399, "start_load_kv_us": 2, "get_finished_us": 230} +{"t_unix": 1779813896.7766876, "step_id": 15400, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813896.7883022, "step_id": 15401, "start_load_kv_us": 2, "get_finished_us": 220} +{"t_unix": 1779813896.800299, "step_id": 15402, "start_load_kv_us": 2, "get_finished_us": 284} +{"t_unix": 1779813896.8121147, "step_id": 15403, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813896.8234572, "step_id": 15404, "start_load_kv_us": 2, "get_finished_us": 191} +{"t_unix": 1779813896.8332026, "step_id": 15405, "start_load_kv_us": 2, "get_finished_us": 154} +{"t_unix": 1779813896.8428886, "step_id": 15406, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813896.851183, "step_id": 15407, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813896.8595002, "step_id": 15408, "start_load_kv_us": 2, "get_finished_us": 186} +{"t_unix": 1779813896.8661513, "step_id": 15409, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813896.8734674, "step_id": 15410, "start_load_kv_us": 2, "get_finished_us": 224} +{"t_unix": 1779813896.8809316, "step_id": 15411, "start_load_kv_us": 2, "get_finished_us": 192} +{"t_unix": 1779813896.8880322, "step_id": 15412, "start_load_kv_us": 2, "get_finished_us": 172} +{"t_unix": 1779813896.8948808, "step_id": 15413, "start_load_kv_us": 2, "get_finished_us": 150} +{"t_unix": 1779813896.9019732, "step_id": 15414, "start_load_kv_us": 2, "get_finished_us": 163} +{"t_unix": 1779813896.9087174, "step_id": 15415, "start_load_kv_us": 2, "get_finished_us": 147} +{"t_unix": 1779813896.9153855, "step_id": 15416, "start_load_kv_us": 2, "get_finished_us": 141} +{"t_unix": 1779813896.9221828, "step_id": 15417, "start_load_kv_us": 2, "get_finished_us": 139} +{"t_unix": 1779813896.929189, "step_id": 15418, "start_load_kv_us": 2, "get_finished_us": 140} +{"t_unix": 1779813896.936338, "step_id": 15419, "start_load_kv_us": 2, "get_finished_us": 210} +{"t_unix": 1779813896.9431298, "step_id": 15420, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813896.949842, "step_id": 15421, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813896.9571214, "step_id": 15422, "start_load_kv_us": 2, "get_finished_us": 138} +{"t_unix": 1779813896.9646223, "step_id": 15423, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813896.9722123, "step_id": 15424, "start_load_kv_us": 2, "get_finished_us": 159} +{"t_unix": 1779813896.979474, "step_id": 15425, "start_load_kv_us": 2, "get_finished_us": 145} +{"t_unix": 1779813896.9869008, "step_id": 15426, "start_load_kv_us": 2, "get_finished_us": 151} +{"t_unix": 1779813896.993953, "step_id": 15427, "start_load_kv_us": 2, "get_finished_us": 193} +{"t_unix": 1779813897.0008068, "step_id": 15428, "start_load_kv_us": 2, "get_finished_us": 204} +{"t_unix": 1779813897.008044, "step_id": 15429, "start_load_kv_us": 2, "get_finished_us": 216} +{"t_unix": 1779813897.0151362, "step_id": 15430, "start_load_kv_us": 2, "get_finished_us": 243} +{"t_unix": 1779813897.0222216, "step_id": 15431, "start_load_kv_us": 2, "get_finished_us": 295} +{"t_unix": 1779813897.0291572, "step_id": 15432, "start_load_kv_us": 2, "get_finished_us": 241} +{"t_unix": 1779813897.036218, "step_id": 15433, "start_load_kv_us": 2, "get_finished_us": 170} +{"t_unix": 1779813897.0437143, "step_id": 15434, "start_load_kv_us": 2, "get_finished_us": 167} +{"t_unix": 1779813897.0512514, "step_id": 15435, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813897.0565283, "step_id": 15436, "start_load_kv_us": 2, "get_finished_us": 144} +{"t_unix": 1779813897.0617268, "step_id": 15437, "start_load_kv_us": 1, "get_finished_us": 146} diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/per_config.json b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/per_config.json new file mode 100644 index 0000000..4b055e8 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/per_config.json @@ -0,0 +1,286 @@ +{ + "mooncake_both": { + "config": "mooncake_both", + "n_steps_total": 15522, + "n_steps_after_warmup": 15022, + "n_steps_decode_only": 14645, + "decode_share": 0.974903474903475, + "rows_used_for_fit": "decode_only", + "cache_size_max": 17533, + "per_bin": [ + { + "bin_id": 3, + "cache_size_mid": 6136.55, + "n": 183, + "cache_size_p50": 6794, + "step_duration_us_p50": 753, + "step_duration_us_p90": 1105, + "build_meta_us_p50": 639, + "build_meta_us_p90": 968 + }, + { + "bin_id": 4, + "cache_size_mid": 7889.849999999999, + "n": 921, + "cache_size_p50": 7916, + "step_duration_us_p50": 763, + "step_duration_us_p90": 1102, + "build_meta_us_p50": 694, + "build_meta_us_p90": 983 + }, + { + "bin_id": 5, + "cache_size_mid": 9643.15, + "n": 223, + "cache_size_p50": 9500, + "step_duration_us_p50": 933, + "step_duration_us_p90": 1336, + "build_meta_us_p50": 834, + "build_meta_us_p90": 1223 + }, + { + "bin_id": 6, + "cache_size_mid": 11396.449999999999, + "n": 404, + "cache_size_p50": 11355, + "step_duration_us_p50": 1039, + "step_duration_us_p90": 1488, + "build_meta_us_p50": 954, + "build_meta_us_p90": 1363 + }, + { + "bin_id": 7, + "cache_size_mid": 13149.75, + "n": 367, + "cache_size_p50": 13443, + "step_duration_us_p50": 1174, + "step_duration_us_p90": 1659, + "build_meta_us_p50": 1078, + "build_meta_us_p90": 1540 + }, + { + "bin_id": 8, + "cache_size_mid": 14903.05, + "n": 468, + "cache_size_p50": 14554, + "step_duration_us_p50": 1211, + "step_duration_us_p90": 1685, + "build_meta_us_p50": 1136, + "build_meta_us_p90": 1593 + }, + { + "bin_id": 9, + "cache_size_mid": 16656.35, + "n": 12079, + "cache_size_p50": 17528, + "step_duration_us_p50": 1555, + "step_duration_us_p90": 2204, + "build_meta_us_p50": 1450, + "build_meta_us_p90": 2051 + } + ], + "fit_step_duration": { + "slope_us_per_block": 0.0944873921263782, + "intercept_us": 85.69888970284087 + }, + "fit_build_meta": { + "slope_us_per_block": 0.09173081765176755, + "intercept_us": 24.232639769930234 + }, + "worker_summary": { + "n": 15522, + "get_finished_us_p50": 180, + "get_finished_us_p90": 255, + "get_finished_us_p99": 349, + "start_load_kv_us_p50": 2, + "start_load_kv_us_p90": 5 + } + }, + "mooncake_both_drfix": { + "config": "mooncake_both_drfix", + "n_steps_total": 15438, + "n_steps_after_warmup": 14938, + "n_steps_decode_only": 14562, + "decode_share": 0.9748292944169232, + "rows_used_for_fit": "decode_only", + "cache_size_max": 17533, + "per_bin": [ + { + "bin_id": 3, + "cache_size_mid": 6136.55, + "n": 180, + "cache_size_p50": 6793, + "step_duration_us_p50": 125, + "step_duration_us_p90": 144, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + }, + { + "bin_id": 4, + "cache_size_mid": 7889.849999999999, + "n": 921, + "cache_size_p50": 7916, + "step_duration_us_p50": 66, + "step_duration_us_p90": 99, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + }, + { + "bin_id": 5, + "cache_size_mid": 9643.15, + "n": 217, + "cache_size_p50": 9499, + "step_duration_us_p50": 102, + "step_duration_us_p90": 120, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + }, + { + "bin_id": 6, + "cache_size_mid": 11396.449999999999, + "n": 384, + "cache_size_p50": 11353, + "step_duration_us_p50": 91, + "step_duration_us_p90": 119, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + }, + { + "bin_id": 7, + "cache_size_mid": 13149.75, + "n": 344, + "cache_size_p50": 13690, + "step_duration_us_p50": 98, + "step_duration_us_p90": 124, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + }, + { + "bin_id": 8, + "cache_size_mid": 14903.05, + "n": 456, + "cache_size_p50": 14554, + "step_duration_us_p50": 73, + "step_duration_us_p90": 100, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + }, + { + "bin_id": 9, + "cache_size_mid": 16656.35, + "n": 12060, + "cache_size_p50": 17528, + "step_duration_us_p50": 97, + "step_duration_us_p90": 169, + "build_meta_us_p50": 6, + "build_meta_us_p90": 7 + } + ], + "fit_step_duration": { + "slope_us_per_block": 0.0023383689406900362, + "intercept_us": 66.43277951652531 + }, + "fit_build_meta": { + "slope_us_per_block": -2.126549423120513e-05, + "intercept_us": 6.582759051897582 + }, + "worker_summary": { + "n": 15438, + "get_finished_us_p50": 180, + "get_finished_us_p90": 256, + "get_finished_us_p99": 345, + "start_load_kv_us_p50": 2, + "start_load_kv_us_p90": 2 + } + }, + "plain": { + "config": "plain", + "n_steps_total": 15626, + "n_steps_after_warmup": 15126, + "n_steps_decode_only": 14751, + "decode_share": 0.9752082506941689, + "rows_used_for_fit": "decode_only", + "cache_size_max": 17533, + "per_bin": [ + { + "bin_id": 3, + "cache_size_mid": 6136.55, + "n": 215, + "cache_size_p50": 6791, + "step_duration_us_p50": 105, + "step_duration_us_p90": 135, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + }, + { + "bin_id": 4, + "cache_size_mid": 7889.849999999999, + "n": 979, + "cache_size_p50": 7920, + "step_duration_us_p50": 54, + "step_duration_us_p90": 81, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + }, + { + "bin_id": 5, + "cache_size_mid": 9643.15, + "n": 230, + "cache_size_p50": 9500, + "step_duration_us_p50": 83, + "step_duration_us_p90": 104, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + }, + { + "bin_id": 6, + "cache_size_mid": 11396.449999999999, + "n": 402, + "cache_size_p50": 11355, + "step_duration_us_p50": 78, + "step_duration_us_p90": 101, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + }, + { + "bin_id": 7, + "cache_size_mid": 13149.75, + "n": 371, + "cache_size_p50": 13693, + "step_duration_us_p50": 81, + "step_duration_us_p90": 103, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + }, + { + "bin_id": 8, + "cache_size_mid": 14903.05, + "n": 468, + "cache_size_p50": 14554, + "step_duration_us_p50": 61, + "step_duration_us_p90": 83, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + }, + { + "bin_id": 9, + "cache_size_mid": 16656.35, + "n": 12086, + "cache_size_p50": 17528, + "step_duration_us_p50": 87, + "step_duration_us_p90": 157, + "build_meta_us_p50": 0, + "build_meta_us_p90": 0 + } + ], + "fit_step_duration": { + "slope_us_per_block": 0.0026079754841429087, + "intercept_us": 51.12171169280091 + }, + "fit_build_meta": { + "slope_us_per_block": 0.0, + "intercept_us": 0.0 + }, + "worker_summary": null + } +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/metrics_final.txt b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/metrics_final.txt new file mode 100644 index 0000000..828058e --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/metrics_final.txt @@ -0,0 +1,624 @@ +# HELP python_gc_objects_collected_total Objects collected during gc +# TYPE python_gc_objects_collected_total counter +python_gc_objects_collected_total{generation="0"} 11967.0 +python_gc_objects_collected_total{generation="1"} 1552.0 +python_gc_objects_collected_total{generation="2"} 855.0 +# HELP python_gc_objects_uncollectable_total Uncollectable objects found during GC +# TYPE python_gc_objects_uncollectable_total counter +python_gc_objects_uncollectable_total{generation="0"} 0.0 +python_gc_objects_uncollectable_total{generation="1"} 0.0 +python_gc_objects_uncollectable_total{generation="2"} 0.0 +# HELP python_gc_collections_total Number of times this generation was collected +# TYPE python_gc_collections_total counter +python_gc_collections_total{generation="0"} 1340.0 +python_gc_collections_total{generation="1"} 121.0 +python_gc_collections_total{generation="2"} 9.0 +# HELP python_info Python platform information +# TYPE python_info gauge +python_info{implementation="CPython",major="3",minor="12",patchlevel="3",version="3.12.3"} 1.0 +# HELP process_virtual_memory_bytes Virtual memory size in bytes. +# TYPE process_virtual_memory_bytes gauge +process_virtual_memory_bytes 3.8945964032e+010 +# HELP process_resident_memory_bytes Resident memory size in bytes. +# TYPE process_resident_memory_bytes gauge +process_resident_memory_bytes 1.350537216e+09 +# HELP process_start_time_seconds Start time of the process since unix epoch in seconds. +# TYPE process_start_time_seconds gauge +process_start_time_seconds 1.77981284373e+09 +# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. +# TYPE process_cpu_seconds_total counter +process_cpu_seconds_total 41.480000000000004 +# HELP process_open_fds Number of open file descriptors. +# TYPE process_open_fds gauge +process_open_fds 64.0 +# HELP process_max_fds Maximum number of open file descriptors. +# TYPE process_max_fds gauge +process_max_fds 65535.0 +# HELP vllm:estimated_flops_per_gpu_total Estimated number of floating point operations per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_flops_per_gpu_total counter +vllm:estimated_flops_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_flops_per_gpu_created Estimated number of floating point operations per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_flops_per_gpu_created gauge +vllm:estimated_flops_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468888192e+09 +# HELP vllm:estimated_read_bytes_per_gpu_total Estimated number of bytes read from memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_read_bytes_per_gpu_total counter +vllm:estimated_read_bytes_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_read_bytes_per_gpu_created Estimated number of bytes read from memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_read_bytes_per_gpu_created gauge +vllm:estimated_read_bytes_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779812946888848e+09 +# HELP vllm:estimated_write_bytes_per_gpu_total Estimated number of bytes written to memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_write_bytes_per_gpu_total counter +vllm:estimated_write_bytes_per_gpu_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:estimated_write_bytes_per_gpu_created Estimated number of bytes written to memory per GPU (for Model Flops Utilization calculations). +# TYPE vllm:estimated_write_bytes_per_gpu_created gauge +vllm:estimated_write_bytes_per_gpu_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468888671e+09 +# HELP vllm:num_requests_running Number of requests in model execution batches. +# TYPE vllm:num_requests_running gauge +vllm:num_requests_running{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:num_requests_waiting Number of requests waiting to be processed. +# TYPE vllm:num_requests_waiting gauge +vllm:num_requests_waiting{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:engine_sleep_state Engine sleep state; awake = 0 means engine is sleeping; awake = 1 means engine is awake; weights_offloaded = 1 means sleep level 1; discard_all = 1 means sleep level 2. +# TYPE vllm:engine_sleep_state gauge +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="awake"} 1.0 +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="weights_offloaded"} 0.0 +vllm:engine_sleep_state{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",sleep_state="discard_all"} 0.0 +# HELP vllm:kv_cache_usage_perc KV-cache usage. 1 means 100 percent usage. +# TYPE vllm:kv_cache_usage_perc gauge +vllm:kv_cache_usage_perc{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prefix_cache_queries_total Prefix cache queries, in terms of number of queried tokens. +# TYPE vllm:prefix_cache_queries_total counter +vllm:prefix_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:prefix_cache_queries_created Prefix cache queries, in terms of number of queried tokens. +# TYPE vllm:prefix_cache_queries_created gauge +vllm:prefix_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468890276e+09 +# HELP vllm:prefix_cache_hits_total Prefix cache hits, in terms of number of cached tokens. +# TYPE vllm:prefix_cache_hits_total counter +vllm:prefix_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prefix_cache_hits_created Prefix cache hits, in terms of number of cached tokens. +# TYPE vllm:prefix_cache_hits_created gauge +vllm:prefix_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468890412e+09 +# HELP vllm:external_prefix_cache_queries_total External prefix cache queries from KV connector cross-instance cache sharing, in terms of number of queried tokens. +# TYPE vllm:external_prefix_cache_queries_total counter +vllm:external_prefix_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:external_prefix_cache_queries_created External prefix cache queries from KV connector cross-instance cache sharing, in terms of number of queried tokens. +# TYPE vllm:external_prefix_cache_queries_created gauge +vllm:external_prefix_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468890548e+09 +# HELP vllm:external_prefix_cache_hits_total External prefix cache hits from KV connector cross-instance cache sharing, in terms of number of cached tokens. +# TYPE vllm:external_prefix_cache_hits_total counter +vllm:external_prefix_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:external_prefix_cache_hits_created External prefix cache hits from KV connector cross-instance cache sharing, in terms of number of cached tokens. +# TYPE vllm:external_prefix_cache_hits_created gauge +vllm:external_prefix_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468890667e+09 +# HELP vllm:mm_cache_queries_total Multi-modal cache queries, in terms of number of queried items. +# TYPE vllm:mm_cache_queries_total counter +vllm:mm_cache_queries_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:mm_cache_queries_created Multi-modal cache queries, in terms of number of queried items. +# TYPE vllm:mm_cache_queries_created gauge +vllm:mm_cache_queries_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468890786e+09 +# HELP vllm:mm_cache_hits_total Multi-modal cache hits, in terms of number of cached items. +# TYPE vllm:mm_cache_hits_total counter +vllm:mm_cache_hits_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:mm_cache_hits_created Multi-modal cache hits, in terms of number of cached items. +# TYPE vllm:mm_cache_hits_created gauge +vllm:mm_cache_hits_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468890915e+09 +# HELP vllm:num_preemptions_total Cumulative number of preemption from the engine. +# TYPE vllm:num_preemptions_total counter +vllm:num_preemptions_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:num_preemptions_created Cumulative number of preemption from the engine. +# TYPE vllm:num_preemptions_created gauge +vllm:num_preemptions_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468891037e+09 +# HELP vllm:prompt_tokens_total Number of prefill tokens processed. +# TYPE vllm:prompt_tokens_total counter +vllm:prompt_tokens_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:prompt_tokens_created Number of prefill tokens processed. +# TYPE vllm:prompt_tokens_created gauge +vllm:prompt_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468891146e+09 +# HELP vllm:prompt_tokens_by_source_total Number of prompt tokens by source. +# TYPE vllm:prompt_tokens_by_source_total counter +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_compute"} 1.563446e+06 +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_cache_hit"} 0.0 +vllm:prompt_tokens_by_source_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="external_kv_transfer"} 0.0 +# HELP vllm:prompt_tokens_by_source_created Number of prompt tokens by source. +# TYPE vllm:prompt_tokens_by_source_created gauge +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_compute"} 1.7798129468891292e+09 +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="local_cache_hit"} 1.7798129468891344e+09 +vllm:prompt_tokens_by_source_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct",source="external_kv_transfer"} 1.779812946889139e+09 +# HELP vllm:prompt_tokens_cached_total Number of cached prompt tokens (local + external). +# TYPE vllm:prompt_tokens_cached_total counter +vllm:prompt_tokens_cached_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prompt_tokens_cached_created Number of cached prompt tokens (local + external). +# TYPE vllm:prompt_tokens_cached_created gauge +vllm:prompt_tokens_cached_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468891513e+09 +# HELP vllm:prompt_tokens_recomputed_total Number of cached tokens recomputed for forward pass. +# TYPE vllm:prompt_tokens_recomputed_total counter +vllm:prompt_tokens_recomputed_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:prompt_tokens_recomputed_created Number of cached tokens recomputed for forward pass. +# TYPE vllm:prompt_tokens_recomputed_created gauge +vllm:prompt_tokens_recomputed_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468891625e+09 +# HELP vllm:generation_tokens_total Number of generation tokens processed. +# TYPE vllm:generation_tokens_total counter +vllm:generation_tokens_total{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:generation_tokens_created Number of generation tokens processed. +# TYPE vllm:generation_tokens_created gauge +vllm:generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468891773e+09 +# HELP vllm:request_success_total Count of successfully processed requests. +# TYPE vllm:request_success_total counter +vllm:request_success_total{engine="0",finished_reason="stop",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="length",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_success_total{engine="0",finished_reason="abort",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="error",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_success_total{engine="0",finished_reason="repetition",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +# HELP vllm:request_success_created Count of successfully processed requests. +# TYPE vllm:request_success_created gauge +vllm:request_success_created{engine="0",finished_reason="stop",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779812946889204e+09 +vllm:request_success_created{engine="0",finished_reason="length",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468892212e+09 +vllm:request_success_created{engine="0",finished_reason="abort",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468892279e+09 +vllm:request_success_created{engine="0",finished_reason="error",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468892329e+09 +vllm:request_success_created{engine="0",finished_reason="repetition",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468892384e+09 +# HELP vllm:request_prompt_tokens Number of prefill tokens processed. +# TYPE vllm:request_prompt_tokens histogram +vllm:request_prompt_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prompt_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prompt_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:request_prompt_tokens_created Number of prefill tokens processed. +# TYPE vllm:request_prompt_tokens_created gauge +vllm:request_prompt_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468892868e+09 +# HELP vllm:request_generation_tokens Number of generation tokens processed. +# TYPE vllm:request_generation_tokens histogram +vllm:request_generation_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_generation_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_generation_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_generation_tokens_created Number of generation tokens processed. +# TYPE vllm:request_generation_tokens_created gauge +vllm:request_generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468893485e+09 +# HELP vllm:iteration_tokens_total Histogram of number of tokens per engine_step. +# TYPE vllm:iteration_tokens_total histogram +vllm:iteration_tokens_total_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3152.0 +vllm:iteration_tokens_total_bucket{engine="0",le="8.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 10567.0 +vllm:iteration_tokens_total_bucket{engine="0",le="16.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 14535.0 +vllm:iteration_tokens_total_bucket{engine="0",le="32.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="64.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="128.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="256.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="512.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="1024.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="2048.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15232.0 +vllm:iteration_tokens_total_bucket{engine="0",le="4096.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15576.0 +vllm:iteration_tokens_total_bucket{engine="0",le="8192.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15600.0 +vllm:iteration_tokens_total_bucket{engine="0",le="16384.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15600.0 +vllm:iteration_tokens_total_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15600.0 +vllm:iteration_tokens_total_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 15600.0 +vllm:iteration_tokens_total_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.663798e+06 +# HELP vllm:iteration_tokens_total_created Histogram of number of tokens per engine_step. +# TYPE vllm:iteration_tokens_total_created gauge +vllm:iteration_tokens_total_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468893907e+09 +# HELP vllm:request_max_num_generation_tokens Histogram of maximum number of requested generation tokens. +# TYPE vllm:request_max_num_generation_tokens histogram +vllm:request_max_num_generation_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_max_num_generation_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_max_num_generation_tokens_created Histogram of maximum number of requested generation tokens. +# TYPE vllm:request_max_num_generation_tokens_created gauge +vllm:request_max_num_generation_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779812946889425e+09 +# HELP vllm:request_params_n Histogram of the n request parameter. +# TYPE vllm:request_params_n histogram +vllm:request_params_n_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_n_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +# HELP vllm:request_params_n_created Histogram of the n request parameter. +# TYPE vllm:request_params_n_created gauge +vllm:request_params_n_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468894763e+09 +# HELP vllm:request_params_max_tokens Histogram of the max_tokens request parameter. +# TYPE vllm:request_params_max_tokens histogram +vllm:request_params_max_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_params_max_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_params_max_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 100352.0 +# HELP vllm:request_params_max_tokens_created Histogram of the max_tokens request parameter. +# TYPE vllm:request_params_max_tokens_created gauge +vllm:request_params_max_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468895009e+09 +# HELP vllm:time_to_first_token_seconds Histogram of time to first token in seconds. +# TYPE vllm:time_to_first_token_seconds histogram +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.001",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.005",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.02",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.04",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.06",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.08",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.25",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 14.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 342.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 385.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 391.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="160.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="640.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="2560.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:time_to_first_token_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 139.74462819099426 +# HELP vllm:time_to_first_token_seconds_created Histogram of time to first token in seconds. +# TYPE vllm:time_to_first_token_seconds_created gauge +vllm:time_to_first_token_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779812946889535e+09 +# HELP vllm:inter_token_latency_seconds Histogram of inter-token latency in seconds. +# TYPE vllm:inter_token_latency_seconds histogram +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 24975.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.025",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 93964.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.05",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96708.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.075",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96773.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96773.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.15",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96780.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.2",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 96903.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99743.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.4",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99743.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 99960.0 +vllm:inter_token_latency_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2025.8043659705436 +# HELP vllm:inter_token_latency_seconds_created Histogram of inter-token latency in seconds. +# TYPE vllm:inter_token_latency_seconds_created gauge +vllm:inter_token_latency_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468896053e+09 +# HELP vllm:request_time_per_output_token_seconds Histogram of time_per_output_token_seconds per request. +# TYPE vllm:request_time_per_output_token_seconds histogram +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.01",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 33.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.025",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 276.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.05",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.075",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.1",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.15",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.2",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.4",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="0.75",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="7.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="80.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_time_per_output_token_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 7.94433084694331 +# HELP vllm:request_time_per_output_token_seconds_created Histogram of time_per_output_token_seconds per request. +# TYPE vllm:request_time_per_output_token_seconds_created gauge +vllm:request_time_per_output_token_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468896456e+09 +# HELP vllm:e2e_request_latency_seconds Histogram of e2e request latency in seconds. +# TYPE vllm:e2e_request_latency_seconds histogram +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 12.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 19.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 167.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:e2e_request_latency_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2165.43790102005 +# HELP vllm:e2e_request_latency_seconds_created Histogram of e2e request latency in seconds. +# TYPE vllm:e2e_request_latency_seconds_created gauge +vllm:e2e_request_latency_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468908637e+09 +# HELP vllm:request_queue_time_seconds Histogram of time spent in WAITING phase for request. +# TYPE vllm:request_queue_time_seconds histogram +vllm:request_queue_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_queue_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0030762000242248178 +# HELP vllm:request_queue_time_seconds_created Histogram of time spent in WAITING phase for request. +# TYPE vllm:request_queue_time_seconds_created gauge +vllm:request_queue_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468909323e+09 +# HELP vllm:request_inference_time_seconds Histogram of time spent in RUNNING phase for request. +# TYPE vllm:request_inference_time_seconds histogram +vllm:request_inference_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 3.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 13.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 20.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 173.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_inference_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2143.7371602561325 +# HELP vllm:request_inference_time_seconds_created Histogram of time spent in RUNNING phase for request. +# TYPE vllm:request_inference_time_seconds_created gauge +vllm:request_inference_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468909864e+09 +# HELP vllm:request_prefill_time_seconds Histogram of time spent in PREFILL phase for request. +# TYPE vllm:request_prefill_time_seconds histogram +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 308.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 376.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 117.9327942855889 +# HELP vllm:request_prefill_time_seconds_created Histogram of time spent in PREFILL phase for request. +# TYPE vllm:request_prefill_time_seconds_created gauge +vllm:request_prefill_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468910336e+09 +# HELP vllm:request_decode_time_seconds Histogram of time spent in DECODE phase for request. +# TYPE vllm:request_decode_time_seconds histogram +vllm:request_decode_time_seconds_bucket{engine="0",le="0.3",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="0.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="0.8",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 6.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 17.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="2.5",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 32.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 189.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="15.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="30.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="40.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="60.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="120.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="240.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="480.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="960.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="1920.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="7680.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_decode_time_seconds_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 2025.8043659705436 +# HELP vllm:request_decode_time_seconds_created Histogram of time spent in DECODE phase for request. +# TYPE vllm:request_decode_time_seconds_created gauge +vllm:request_decode_time_seconds_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.779812946891072e+09 +# HELP vllm:request_prefill_kv_computed_tokens Histogram of new KV tokens computed during prefill (excluding cached tokens). +# TYPE vllm:request_prefill_kv_computed_tokens histogram +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="1.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="2.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="5.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="10.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="20.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="50.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="100.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="200.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="500.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="1000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="2000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 0.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="5000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="10000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="20000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="50000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="100000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="200000.0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_bucket{engine="0",le="+Inf",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_count{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 392.0 +vllm:request_prefill_kv_computed_tokens_sum{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.563446e+06 +# HELP vllm:request_prefill_kv_computed_tokens_created Histogram of new KV tokens computed during prefill (excluding cached tokens). +# TYPE vllm:request_prefill_kv_computed_tokens_created gauge +vllm:request_prefill_kv_computed_tokens_created{engine="0",model_name="/home/admin/cpfs/wjh/models/Qwen/Qwen3-Coder-30B-A3B-Instruct"} 1.7798129468911197e+09 +# HELP vllm:cache_config_info Information of the LLMEngine CacheConfig +# TYPE vllm:cache_config_info gauge +vllm:cache_config_info{_block_size_resolved="True",block_size="16",cache_dtype="auto",calculate_kv_scales="False",cpu_kvcache_space_bytes="None",enable_prefix_caching="True",engine="0",gpu_memory_utilization="0.9",is_attention_free="False",kv_cache_memory_bytes="None",kv_offloading_backend="native",kv_offloading_size="None",kv_sharing_fast_prefill="False",mamba_block_size="None",mamba_cache_dtype="auto",mamba_cache_mode="none",mamba_page_size_padded="None",mamba_ssm_cache_dtype="auto",num_cpu_blocks="None",num_gpu_blocks="17590",num_gpu_blocks_override="None",prefix_caching_hash_algo="sha256",sliding_window="None",user_specified_block_size="False"} 1.0 +# HELP http_requests_total Total number of requests by method, status and handler. +# TYPE http_requests_total counter +http_requests_total{handler="/v1/models",method="GET",status="2xx"} 1.0 +http_requests_total{handler="/v1/chat/completions",method="POST",status="2xx"} 392.0 +# HELP http_requests_created Total number of requests by method, status and handler. +# TYPE http_requests_created gauge +http_requests_created{handler="/v1/models",method="GET",status="2xx"} 1.7798129484643826e+09 +http_requests_created{handler="/v1/chat/completions",method="POST",status="2xx"} 1.779812957247958e+09 +# HELP http_request_size_bytes Content length of incoming requests by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_request_size_bytes summary +http_request_size_bytes_count{handler="/v1/models"} 1.0 +http_request_size_bytes_sum{handler="/v1/models"} 0.0 +http_request_size_bytes_count{handler="/v1/chat/completions"} 392.0 +http_request_size_bytes_sum{handler="/v1/chat/completions"} 2.067408e+06 +# HELP http_request_size_bytes_created Content length of incoming requests by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_request_size_bytes_created gauge +http_request_size_bytes_created{handler="/v1/models"} 1.779812948464408e+09 +http_request_size_bytes_created{handler="/v1/chat/completions"} 1.7798129572479794e+09 +# HELP http_response_size_bytes Content length of outgoing responses by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_response_size_bytes summary +http_response_size_bytes_count{handler="/v1/models"} 1.0 +http_response_size_bytes_sum{handler="/v1/models"} 558.0 +http_response_size_bytes_count{handler="/v1/chat/completions"} 392.0 +http_response_size_bytes_sum{handler="/v1/chat/completions"} 0.0 +# HELP http_response_size_bytes_created Content length of outgoing responses by handler. Only value of header is respected. Otherwise ignored. No percentile calculated. +# TYPE http_response_size_bytes_created gauge +http_response_size_bytes_created{handler="/v1/models"} 1.7798129484644337e+09 +http_response_size_bytes_created{handler="/v1/chat/completions"} 1.7798129572480056e+09 +# HELP http_request_duration_highr_seconds Latency with many buckets but no API specific labels. Made for more accurate percentile calculations. +# TYPE http_request_duration_highr_seconds histogram +http_request_duration_highr_seconds_bucket{le="0.01"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.025"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.05"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.075"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.1"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.25"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.5"} 1.0 +http_request_duration_highr_seconds_bucket{le="0.75"} 1.0 +http_request_duration_highr_seconds_bucket{le="1.0"} 1.0 +http_request_duration_highr_seconds_bucket{le="1.5"} 4.0 +http_request_duration_highr_seconds_bucket{le="2.0"} 13.0 +http_request_duration_highr_seconds_bucket{le="2.5"} 20.0 +http_request_duration_highr_seconds_bucket{le="3.0"} 39.0 +http_request_duration_highr_seconds_bucket{le="3.5"} 64.0 +http_request_duration_highr_seconds_bucket{le="4.0"} 98.0 +http_request_duration_highr_seconds_bucket{le="4.5"} 138.0 +http_request_duration_highr_seconds_bucket{le="5.0"} 168.0 +http_request_duration_highr_seconds_bucket{le="7.5"} 316.0 +http_request_duration_highr_seconds_bucket{le="10.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="30.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="60.0"} 393.0 +http_request_duration_highr_seconds_bucket{le="+Inf"} 393.0 +http_request_duration_highr_seconds_count 393.0 +http_request_duration_highr_seconds_sum 2166.043502608838 +# HELP http_request_duration_highr_seconds_created Latency with many buckets but no API specific labels. Made for more accurate percentile calculations. +# TYPE http_request_duration_highr_seconds_created gauge +http_request_duration_highr_seconds_created 1.7798129474325876e+09 +# HELP http_request_duration_seconds Latency with only few buckets by handler. Made to be only used if aggregation by handler is important. +# TYPE http_request_duration_seconds histogram +http_request_duration_seconds_bucket{handler="/v1/models",le="0.1",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="0.5",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="1.0",method="GET"} 1.0 +http_request_duration_seconds_bucket{handler="/v1/models",le="+Inf",method="GET"} 1.0 +http_request_duration_seconds_count{handler="/v1/models",method="GET"} 1.0 +http_request_duration_seconds_sum{handler="/v1/models",method="GET"} 0.002513296960387379 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="0.1",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="0.5",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="1.0",method="POST"} 0.0 +http_request_duration_seconds_bucket{handler="/v1/chat/completions",le="+Inf",method="POST"} 392.0 +http_request_duration_seconds_count{handler="/v1/chat/completions",method="POST"} 392.0 +http_request_duration_seconds_sum{handler="/v1/chat/completions",method="POST"} 2166.0409893118776 +# HELP http_request_duration_seconds_created Latency with only few buckets by handler. Made to be only used if aggregation by handler is important. +# TYPE http_request_duration_seconds_created gauge +http_request_duration_seconds_created{handler="/v1/models",method="GET"} 1.779812948464476e+09 +http_request_duration_seconds_created{handler="/v1/chat/completions",method="POST"} 1.7798129572480347e+09 diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/requests.jsonl b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/requests.jsonl new file mode 100644 index 0000000..df087ba --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/requests.jsonl @@ -0,0 +1,392 @@ +{"req_id": "f9f8f44fd4964565", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382084485315880, "t_first_token_ns": 382085751985740, "t_last_token_ns": 382092234447772, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "36bbb6c17a024be2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382084854634864, "t_first_token_ns": 382085756582157, "t_last_token_ns": 382092249407424, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "accbc730595b4e03", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382084846909405, "t_first_token_ns": 382085756468395, "t_last_token_ns": 382092249666342, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "95ac8f889eb69b61", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382086017811149, "t_first_token_ns": 382086278898625, "t_last_token_ns": 382092888697351, "prompt_tokens": 4026, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "70cae603829190e5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382086255135893, "t_first_token_ns": 382086524187375, "t_last_token_ns": 382092918848009, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "2769a82161526fa2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382086561686502, "t_first_token_ns": 382086831843459, "t_last_token_ns": 382093038356375, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "7a3ae284fd025e54", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382086706452936, "t_first_token_ns": 382087076121991, "t_last_token_ns": 382093067217516, "prompt_tokens": 3951, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8c7ebece6fc8ef96", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382087263620291, "t_first_token_ns": 382087535250568, "t_last_token_ns": 382093356817425, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "291192528bfcd0d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382087471206537, "t_first_token_ns": 382088039840023, "t_last_token_ns": 382093380530301, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "8a6e9ed8388bab88", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382087381525191, "t_first_token_ns": 382088040653266, "t_last_token_ns": 382093381150039, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "29aa5369f15ef8ed", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382087850098477, "t_first_token_ns": 382088237260581, "t_last_token_ns": 382093391828376, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "7d168f7f34914df8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382088401317115, "t_first_token_ns": 382088675156747, "t_last_token_ns": 382093553597941, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "5949b30b5660db44", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382088530166550, "t_first_token_ns": 382088927487832, "t_last_token_ns": 382093570191025, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "dee2814e53c1133c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382089067684210, "t_first_token_ns": 382089347288505, "t_last_token_ns": 382093680939389, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "d3d6d687b1270d0c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382089360858174, "t_first_token_ns": 382089632276646, "t_last_token_ns": 382093709089784, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "0114c7c017f510dc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382091475713376, "t_first_token_ns": 382091750427712, "t_last_token_ns": 382095470175502, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "6b23ad60e8365056", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382091540474798, "t_first_token_ns": 382092011849654, "t_last_token_ns": 382095487909354, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "c147b43b07e42731", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382094105745222, "t_first_token_ns": 382094360416437, "t_last_token_ns": 382098653227539, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "d6e4d018b0cbaea9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382094460514148, "t_first_token_ns": 382094722942114, "t_last_token_ns": 382098876304081, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "6a3c0ae558f764fa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382094928261563, "t_first_token_ns": 382095189710499, "t_last_token_ns": 382099498627857, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "6f4afc5b3b7d8068", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382095035839055, "t_first_token_ns": 382095433479107, "t_last_token_ns": 382099519308502, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "e2a3bc5ca5dd8e06", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382095882568896, "t_first_token_ns": 382096149618438, "t_last_token_ns": 382100119691456, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "750b6e6f651a9619", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382096023573828, "t_first_token_ns": 382096389932985, "t_last_token_ns": 382100140145528, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "088884483a9971d8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382096303429046, "t_first_token_ns": 382096850723713, "t_last_token_ns": 382100156576034, "prompt_tokens": 4025, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "318a0f6dc8a5806d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382096320117360, "t_first_token_ns": 382096850558433, "t_last_token_ns": 382100156738283, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "60fa44dd296e868f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382096597293605, "t_first_token_ns": 382097098413040, "t_last_token_ns": 382100167935492, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "be5160126f3a14e8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382098881665428, "t_first_token_ns": 382099182823989, "t_last_token_ns": 382100932027749, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "31994709d9d43ecc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382101452253340, "t_first_token_ns": 382101705031877, "t_last_token_ns": 382103653661298, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "ebb3f3698c984adb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382102362695450, "t_first_token_ns": 382102617993097, "t_last_token_ns": 382104765107223, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "a0f7008353f8beb2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382102366075418, "t_first_token_ns": 382102852445112, "t_last_token_ns": 382104771161161, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "7eac0cde0fd34276", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382104245078173, "t_first_token_ns": 382104503092731, "t_last_token_ns": 382106080452930, "prompt_tokens": 4019, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "95601ae65eae9166", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382105609930451, "t_first_token_ns": 382105865820742, "t_last_token_ns": 382108479137977, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "189d08c7b9ae2624", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382106592854963, "t_first_token_ns": 382106846927268, "t_last_token_ns": 382111011314112, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "607beffbb7acca39", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382106725242270, "t_first_token_ns": 382107302770531, "t_last_token_ns": 382111031111692, "prompt_tokens": 3953, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "93918e85acdf8b5d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382106795960784, "t_first_token_ns": 382107303167749, "t_last_token_ns": 382111031731486, "prompt_tokens": 4052, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "de6c910bd8be862f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382107155362079, "t_first_token_ns": 382107545253073, "t_last_token_ns": 382111049499791, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "776a9724799617aa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382108601027573, "t_first_token_ns": 382108863203989, "t_last_token_ns": 382112459442313, "prompt_tokens": 3955, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "b6357510a726d24b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382109178368627, "t_first_token_ns": 382109445074511, "t_last_token_ns": 382113049635333, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "7814350e435d2264", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382110068747851, "t_first_token_ns": 382110335361810, "t_last_token_ns": 382113760511997, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "c354ffa98aea604a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382110246872779, "t_first_token_ns": 382110582645427, "t_last_token_ns": 382113776093718, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "b95654a80317948f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382110741663414, "t_first_token_ns": 382111010987856, "t_last_token_ns": 382114375439940, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "d3983c9d6e42e3df", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382111566724910, "t_first_token_ns": 382111832273757, "t_last_token_ns": 382114862593646, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f12e1b2630a2dfcc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382112728721768, "t_first_token_ns": 382112997261704, "t_last_token_ns": 382116098452170, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "26aa2698c0cddf5a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382113826064659, "t_first_token_ns": 382114085296890, "t_last_token_ns": 382117051979504, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "1dd5dcf6889436bf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382114003523637, "t_first_token_ns": 382114329516196, "t_last_token_ns": 382117067193867, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "55f20a37c1e89743", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382115381130284, "t_first_token_ns": 382115639648893, "t_last_token_ns": 382119382645818, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "e013af03a51488e2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382115544317102, "t_first_token_ns": 382115881855274, "t_last_token_ns": 382119401842605, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4fefe92b23621583", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382116624370456, "t_first_token_ns": 382116887620494, "t_last_token_ns": 382120316201161, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "5af9d220c4dd9318", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382117164782628, "t_first_token_ns": 382117420646491, "t_last_token_ns": 382121312403234, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "a3ff67ad251967cf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382117302283549, "t_first_token_ns": 382117663368691, "t_last_token_ns": 382121329907934, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "c9258f74cc827511", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382117895621904, "t_first_token_ns": 382118163339413, "t_last_token_ns": 382121605409252, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "140eb88bb615ba37", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382118382848752, "t_first_token_ns": 382118646417347, "t_last_token_ns": 382121814874557, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "d4a164b2ff3b3509", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382120507346979, "t_first_token_ns": 382120765805217, "t_last_token_ns": 382123161869622, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "9f1266f29a9e8b28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382120536346207, "t_first_token_ns": 382121002154595, "t_last_token_ns": 382123167727494, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "57c78bedb1e5433a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382120656527505, "t_first_token_ns": 382121237067439, "t_last_token_ns": 382123171579404, "prompt_tokens": 3957, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "08ff3938b9e3ae71", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382123385556601, "t_first_token_ns": 382123637959122, "t_last_token_ns": 382127170763520, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "fc976d1e97a41cca", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382124575913113, "t_first_token_ns": 382124831128749, "t_last_token_ns": 382129509596960, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "6c45ae3b99de1e62", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382124685304696, "t_first_token_ns": 382125071733865, "t_last_token_ns": 382129532983141, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "417d200da6fc7d82", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382124859602337, "t_first_token_ns": 382125318069397, "t_last_token_ns": 382129555520868, "prompt_tokens": 4042, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "2b45e140974d73b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382125376483769, "t_first_token_ns": 382125633771501, "t_last_token_ns": 382129669787344, "prompt_tokens": 3948, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4809e923113cfa22", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382125490789770, "t_first_token_ns": 382125879482814, "t_last_token_ns": 382129689298424, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "b80243b2ea980e07", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382125786666385, "t_first_token_ns": 382126338815361, "t_last_token_ns": 382129706104856, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "1baef27c84916aa0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382125751949133, "t_first_token_ns": 382126339351486, "t_last_token_ns": 382129706277861, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "efd5183f824026cc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382126616017958, "t_first_token_ns": 382126885654669, "t_last_token_ns": 382129879944142, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "df3338f95a55a940", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382126671637574, "t_first_token_ns": 382127130961013, "t_last_token_ns": 382129888643028, "prompt_tokens": 3921, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "973d64287adcd8a7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382130154531040, "t_first_token_ns": 382130400867231, "t_last_token_ns": 382131621211341, "prompt_tokens": 3934, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "19674684ced3de91", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382131844141889, "t_first_token_ns": 382132095400336, "t_last_token_ns": 382133641527953, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "e6fa68dd3de56239", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382132881184723, "t_first_token_ns": 382133139468625, "t_last_token_ns": 382135430175003, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "ec06f5beb70436d9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382133868534695, "t_first_token_ns": 382134124890189, "t_last_token_ns": 382137703558917, "prompt_tokens": 4040, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "034f1151aa2d2bdd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382134174927085, "t_first_token_ns": 382134431228329, "t_last_token_ns": 382137856822810, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "d156973f3cae174d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382134932527817, "t_first_token_ns": 382135193457977, "t_last_token_ns": 382139144533899, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "c2a0107acab59bd0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382135888587433, "t_first_token_ns": 382136144211615, "t_last_token_ns": 382140297080035, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "25faaab088637291", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382136326035620, "t_first_token_ns": 382136587916047, "t_last_token_ns": 382141063089526, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4a6ff2135636c100", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382136368689957, "t_first_token_ns": 382136833523524, "t_last_token_ns": 382141087519173, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "70f1b6f6bad6005a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382137026103851, "t_first_token_ns": 382137294678583, "t_last_token_ns": 382141333527505, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "485e723c2b84eb6b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382137289910024, "t_first_token_ns": 382137554990236, "t_last_token_ns": 382141362746117, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "6be120b83e225aa3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382137918445148, "t_first_token_ns": 382138190076505, "t_last_token_ns": 382141924574841, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "291a0df34911423c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382138282808798, "t_first_token_ns": 382138556098766, "t_last_token_ns": 382142015329705, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "9a771254d6418297", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382140315586420, "t_first_token_ns": 382140584545283, "t_last_token_ns": 382144385358364, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3d63e1d817747a07", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382140466303138, "t_first_token_ns": 382140835388158, "t_last_token_ns": 382144405051264, "prompt_tokens": 4011, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "a85143fddaf4a5d9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382141443044504, "t_first_token_ns": 382141698075190, "t_last_token_ns": 382145026911126, "prompt_tokens": 3953, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "ed998b60c04d0117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382142243200480, "t_first_token_ns": 382142506026607, "t_last_token_ns": 382147980017354, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "10c050e2cad99a17", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382142786760294, "t_first_token_ns": 382143046239974, "t_last_token_ns": 382148808485648, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "03bc3ccba18fc900", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382142843582082, "t_first_token_ns": 382143510409309, "t_last_token_ns": 382148835792674, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "6ca800f53f978a58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382142965009435, "t_first_token_ns": 382143510700208, "t_last_token_ns": 382148836070146, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "0d6ebbadc6b6f44a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382145245720490, "t_first_token_ns": 382145510468100, "t_last_token_ns": 382152509489934, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "2225316b65c25005", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382145422737803, "t_first_token_ns": 382145758585647, "t_last_token_ns": 382152539934260, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "48f171c96419c86f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382145543044038, "t_first_token_ns": 382146005415056, "t_last_token_ns": 382152571890884, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "53e2a3f9153c46d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382145770431456, "t_first_token_ns": 382146240838887, "t_last_token_ns": 382152587726945, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8f000c5b2b8ac58e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382146284550460, "t_first_token_ns": 382146558571855, "t_last_token_ns": 382152703280461, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "601066832f30b428", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382146774467284, "t_first_token_ns": 382147047268204, "t_last_token_ns": 382153033798108, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "bf6ab969a046d65b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382146780852586, "t_first_token_ns": 382147499518858, "t_last_token_ns": 382153047446499, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "d417d380a4f40330", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382146777761158, "t_first_token_ns": 382147499719427, "t_last_token_ns": 382153047956971, "prompt_tokens": 3970, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "d23fe5d3ae909682", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382147238846239, "t_first_token_ns": 382147968347685, "t_last_token_ns": 382153070669400, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "08d7416f17740d2e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382147375689078, "t_first_token_ns": 382147968700737, "t_last_token_ns": 382153070806834, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "f63c4d00aca7e8d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382148000174672, "t_first_token_ns": 382148273597339, "t_last_token_ns": 382153360298420, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "72e028e252e47e71", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382149068456835, "t_first_token_ns": 382149348554144, "t_last_token_ns": 382154443030601, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "90e18fcccb2043f7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382149136513746, "t_first_token_ns": 382149600864577, "t_last_token_ns": 382154466234174, "prompt_tokens": 3956, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "7e9fdd59228f0876", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382149606281138, "t_first_token_ns": 382149886196466, "t_last_token_ns": 382154505159382, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "245bf7e5865d03d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382149954192620, "t_first_token_ns": 382150233950827, "t_last_token_ns": 382154585202689, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "2033b1bb6c32c79a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382150996777505, "t_first_token_ns": 382151279633180, "t_last_token_ns": 382155011561233, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "0f0a89285f54e2c1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382153062097748, "t_first_token_ns": 382153328237737, "t_last_token_ns": 382159693572019, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "da6f35b293578e17", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382153422066955, "t_first_token_ns": 382153692956220, "t_last_token_ns": 382159892850728, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "6c160ab03b66d81b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382153608576562, "t_first_token_ns": 382153942415850, "t_last_token_ns": 382160157467343, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "acad4eb8b9a0e9f6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382155014185856, "t_first_token_ns": 382155276645095, "t_last_token_ns": 382163987065268, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "502a12aa8ba51234", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382155033067481, "t_first_token_ns": 382155512278400, "t_last_token_ns": 382164008874723, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "c0e0a7d3c8cf4b95", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382155300992731, "t_first_token_ns": 382155758956878, "t_last_token_ns": 382164052573925, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "541738310001dd1c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382155636772096, "t_first_token_ns": 382156002850078, "t_last_token_ns": 382164086851692, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "525463c05dc42958", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382155769330470, "t_first_token_ns": 382156238617491, "t_last_token_ns": 382164103208348, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "3926bdb966d6e395", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382156529924106, "t_first_token_ns": 382156795118967, "t_last_token_ns": 382164859875757, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "586a0d3540151470", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382157017897104, "t_first_token_ns": 382157281724702, "t_last_token_ns": 382165249594661, "prompt_tokens": 3929, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "37c5cdb56477a163", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382157209281472, "t_first_token_ns": 382157533807262, "t_last_token_ns": 382165509376109, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "5947be4f56ddbab5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382157565789420, "t_first_token_ns": 382157841926331, "t_last_token_ns": 382165859469454, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "2fe62cb82ee987a4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382158351514622, "t_first_token_ns": 382158623425098, "t_last_token_ns": 382167223583208, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "8c278419850c8b5e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382158614234491, "t_first_token_ns": 382158892966968, "t_last_token_ns": 382167480594409, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "021ff28eaacd14c5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382158662162337, "t_first_token_ns": 382159133444765, "t_last_token_ns": 382167497314962, "prompt_tokens": 3959, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "faaf800e58c8f85f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382159074263310, "t_first_token_ns": 382159388624067, "t_last_token_ns": 382167535060392, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "744f358ad7f63e97", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382159219646231, "t_first_token_ns": 382159642125878, "t_last_token_ns": 382167563663637, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "927918347bcc40c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382159867767929, "t_first_token_ns": 382160155490922, "t_last_token_ns": 382167882727509, "prompt_tokens": 4032, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "2fcef28ebf707351", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382160018644036, "t_first_token_ns": 382160622703153, "t_last_token_ns": 382168139630832, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "fe233f2c57e680fd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382160117624464, "t_first_token_ns": 382160623811460, "t_last_token_ns": 382168140619284, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "b95acf9eb3705d28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382161614049847, "t_first_token_ns": 382161911634388, "t_last_token_ns": 382170238228998, "prompt_tokens": 4011, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "96b58f314a838835", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382161882357875, "t_first_token_ns": 382162173383565, "t_last_token_ns": 382170273284320, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "08456882f8d362d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382162114090871, "t_first_token_ns": 382162432411293, "t_last_token_ns": 382170301380722, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "4c8bd15a715f7720", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382162631449889, "t_first_token_ns": 382162928978333, "t_last_token_ns": 382170490281703, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "6949ec56d00ce8b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382163420315977, "t_first_token_ns": 382163714525969, "t_last_token_ns": 382171352639512, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "0fce2da54ec51dfd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382164162116760, "t_first_token_ns": 382164449957180, "t_last_token_ns": 382172239925040, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "4238f6957ae36e57", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382165230181175, "t_first_token_ns": 382165510156058, "t_last_token_ns": 382174169547343, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "943ff34258d40d28", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382165432201314, "t_first_token_ns": 382165764227907, "t_last_token_ns": 382174210119649, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "dfca62202759aa8a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382165803829344, "t_first_token_ns": 382166083320567, "t_last_token_ns": 382174292923771, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "4397f621098474f5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382166106375621, "t_first_token_ns": 382166400274028, "t_last_token_ns": 382174375244987, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "beebd08c7cc682ce", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382166591831129, "t_first_token_ns": 382166882526737, "t_last_token_ns": 382174647993158, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "7c168a9454ca5620", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382167161160421, "t_first_token_ns": 382167447364672, "t_last_token_ns": 382174942751314, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "affa6c57b9777216", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382167822972670, "t_first_token_ns": 382168102677870, "t_last_token_ns": 382175570182132, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "e5ffcb3c7f664dc7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382167870353217, "t_first_token_ns": 382168359531073, "t_last_token_ns": 382175599481749, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "a024c6b1441ebbd3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382168180794345, "t_first_token_ns": 382168615046947, "t_last_token_ns": 382175631200427, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "17af21e67df524a9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382169003040547, "t_first_token_ns": 382169290554765, "t_last_token_ns": 382176280489960, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "80ff547317c08b98", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382169028258376, "t_first_token_ns": 382169531758895, "t_last_token_ns": 382176294013489, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "70a5b87cfadecff6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382169943431963, "t_first_token_ns": 382170222748100, "t_last_token_ns": 382176877992402, "prompt_tokens": 3945, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "843c0165f72929a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382170717602609, "t_first_token_ns": 382170991417567, "t_last_token_ns": 382177388384436, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "73b4128afce8e243", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382171060540918, "t_first_token_ns": 382171339560239, "t_last_token_ns": 382177506575857, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "205e89d222fdda00", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382171458987421, "t_first_token_ns": 382171728840309, "t_last_token_ns": 382177666134634, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "7117082172557ca5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382171664441326, "t_first_token_ns": 382171984200978, "t_last_token_ns": 382177690516908, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "7cc19a30a453f5f4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382172556410858, "t_first_token_ns": 382172843986587, "t_last_token_ns": 382178155208995, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "8ba8086b8eec10d6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382172994104335, "t_first_token_ns": 382173271591898, "t_last_token_ns": 382178289834991, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "ec1a4c4a2ea7ed12", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382173221073726, "t_first_token_ns": 382173744591784, "t_last_token_ns": 382178309642689, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "6b0f100f2f9945ac", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382173199924494, "t_first_token_ns": 382173744158256, "t_last_token_ns": 382178309921433, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "768828307182d0ad", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382173504248810, "t_first_token_ns": 382174004761140, "t_last_token_ns": 382178326065050, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "034e749c721e456f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382175197041765, "t_first_token_ns": 382175471363162, "t_last_token_ns": 382180696818257, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "73a8827fa8847e13", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382175949308654, "t_first_token_ns": 382176225537422, "t_last_token_ns": 382181123225967, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "bbcdf2009f998102", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382176605208379, "t_first_token_ns": 382176877581484, "t_last_token_ns": 382181469659040, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "9fa8ae1957c0f1d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382178416433437, "t_first_token_ns": 382178669969435, "t_last_token_ns": 382183430963715, "prompt_tokens": 3937, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "b11891ac95fc3b64", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382178438073962, "t_first_token_ns": 382178904163248, "t_last_token_ns": 382183442473126, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "59a9a00a0d3a1563", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382179053970222, "t_first_token_ns": 382179321413429, "t_last_token_ns": 382184133136282, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "d8bfc0767d724848", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382179193547844, "t_first_token_ns": 382179562446906, "t_last_token_ns": 382184385847973, "prompt_tokens": 3937, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "345d39ae3777d415", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382179531917382, "t_first_token_ns": 382179810488747, "t_last_token_ns": 382184406996473, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "9866cbc828a4fca8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382179667191362, "t_first_token_ns": 382180058895485, "t_last_token_ns": 382184428709692, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "af397ebf951c7719", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382179954066160, "t_first_token_ns": 382180308317944, "t_last_token_ns": 382184446591780, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "65c0b4265eb5dd19", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382181499593078, "t_first_token_ns": 382181767061473, "t_last_token_ns": 382186889749065, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "89dffa88c862c5b0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382182361462319, "t_first_token_ns": 382182625455239, "t_last_token_ns": 382189019116200, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "dc476408b33fbf5a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382183610794544, "t_first_token_ns": 382183883955404, "t_last_token_ns": 382192272274136, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "319a82c9b4681316", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382183664074066, "t_first_token_ns": 382184133404454, "t_last_token_ns": 382192312585207, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "71d7c157bf1ea669", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382183903860832, "t_first_token_ns": 382184376240888, "t_last_token_ns": 382192334761008, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "2cc13ac9d11806a5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382184926866005, "t_first_token_ns": 382185201824699, "t_last_token_ns": 382193981317819, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "129148915a429e01", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382184955411982, "t_first_token_ns": 382185432923928, "t_last_token_ns": 382194002762124, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "df7587e4a3d50532", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382185096858110, "t_first_token_ns": 382185881088756, "t_last_token_ns": 382194019141847, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8b0e7810ec937f82", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382185154085449, "t_first_token_ns": 382185881181943, "t_last_token_ns": 382194019333715, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "fb520fc29874b954", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382186288931232, "t_first_token_ns": 382186557093785, "t_last_token_ns": 382195672501852, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "dd803dc1b0f0a741", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382186465630886, "t_first_token_ns": 382186809713643, "t_last_token_ns": 382195713983940, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "93327e2e45a9ea52", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382186834740379, "t_first_token_ns": 382187108739879, "t_last_token_ns": 382195799397624, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "f37f16b87565dc53", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382186845106124, "t_first_token_ns": 382187347272150, "t_last_token_ns": 382195815554352, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "3bcfa41060f2dd80", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382186926327941, "t_first_token_ns": 382187586073595, "t_last_token_ns": 382195831555122, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "5badec87742c1dc2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382187408177011, "t_first_token_ns": 382187840621135, "t_last_token_ns": 382195861307988, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "d1e7b052e89f38f0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382188453345563, "t_first_token_ns": 382188738586177, "t_last_token_ns": 382197289823823, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "36a41522c4af841a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382188733332937, "t_first_token_ns": 382189006922767, "t_last_token_ns": 382197344116266, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "56afd7a006446ce0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382188990746952, "t_first_token_ns": 382189273460023, "t_last_token_ns": 382197387052714, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "1ec26802903d0510", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382189020131877, "t_first_token_ns": 382189511203860, "t_last_token_ns": 382197400723372, "prompt_tokens": 3947, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "16ab6647bde110e0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382189199081819, "t_first_token_ns": 382189965760901, "t_last_token_ns": 382197415670374, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "a642c8cc74bcd308", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382189090754451, "t_first_token_ns": 382189964656055, "t_last_token_ns": 382197415797903, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "ab5eaa452796e93b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382189354201545, "t_first_token_ns": 382190205438099, "t_last_token_ns": 382197428708232, "prompt_tokens": 4016, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "57388896a658fda9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382189917526905, "t_first_token_ns": 382190450077996, "t_last_token_ns": 382197441930889, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "74e18421d9a9571b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382190215201021, "t_first_token_ns": 382190711418045, "t_last_token_ns": 382197469232700, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "51627206c78da939", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382192752654125, "t_first_token_ns": 382193045592207, "t_last_token_ns": 382199829188993, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "ce0e4f081e4c436a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382192976393814, "t_first_token_ns": 382193310053865, "t_last_token_ns": 382199857315482, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "9826eaf60529d07a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382194270660231, "t_first_token_ns": 382194547882750, "t_last_token_ns": 382201701909232, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f06c8516cb43f569", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382194335191820, "t_first_token_ns": 382194811176438, "t_last_token_ns": 382201730094284, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "a2fcaaf1ad76b0b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382194836282261, "t_first_token_ns": 382195116206158, "t_last_token_ns": 382201803203035, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "0edc9b51f130a612", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382195368740645, "t_first_token_ns": 382195653479024, "t_last_token_ns": 382202018525566, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "ab79c0a9dc372db9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382196083110703, "t_first_token_ns": 382196359652940, "t_last_token_ns": 382202449697183, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "284610eaafd0e42a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382196435574411, "t_first_token_ns": 382196722381601, "t_last_token_ns": 382202582104081, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "89cb2a334a9f6238", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382196931100841, "t_first_token_ns": 382197207709370, "t_last_token_ns": 382203010566186, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "7ea2d46c75d8fe9a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382197934695072, "t_first_token_ns": 382198207993298, "t_last_token_ns": 382204087960501, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "024f2a25db9d388f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382198044809734, "t_first_token_ns": 382198460255925, "t_last_token_ns": 382204115940149, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "4bff469af089d526", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382198551418465, "t_first_token_ns": 382198828331830, "t_last_token_ns": 382204470998169, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "700bf9b5ddd3a040", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382199143308149, "t_first_token_ns": 382199425761836, "t_last_token_ns": 382204776586852, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "56c8618490819588", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382200158437145, "t_first_token_ns": 382200429219426, "t_last_token_ns": 382206610744431, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "897a93d4897b76cf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382200278100137, "t_first_token_ns": 382200684269775, "t_last_token_ns": 382206638146108, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "9d6d324a99e130fb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382200636238899, "t_first_token_ns": 382201150640347, "t_last_token_ns": 382206666403827, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "fa28b6fdceb04b0a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382200653602709, "t_first_token_ns": 382201151055854, "t_last_token_ns": 382206666630685, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "2b3fcd354a2135a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382201378628999, "t_first_token_ns": 382201661105558, "t_last_token_ns": 382208056226905, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "e29b1c49a4e6562a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382202729634059, "t_first_token_ns": 382203010114269, "t_last_token_ns": 382209145628336, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "729dbd22ce5934ca", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382203021873189, "t_first_token_ns": 382203290339273, "t_last_token_ns": 382209201681417, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "150d24a23cc28808", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382204152434994, "t_first_token_ns": 382204428915616, "t_last_token_ns": 382210818961899, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "1247310989ae8f13", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382204868864561, "t_first_token_ns": 382205136220226, "t_last_token_ns": 382211428871526, "prompt_tokens": 3967, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "e40763fc59ed0799", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382204881170636, "t_first_token_ns": 382205374451179, "t_last_token_ns": 382211442251967, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "a0ed26ee4cdfed05", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382205305886748, "t_first_token_ns": 382205841941111, "t_last_token_ns": 382211470050233, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "7db7d42bc0b6e636", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382205337379117, "t_first_token_ns": 382205843033175, "t_last_token_ns": 382211470970408, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "c81fd9769ec09a5f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382205589339335, "t_first_token_ns": 382206093690937, "t_last_token_ns": 382211492058195, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "8a5e9c377ef0f53c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382206665758791, "t_first_token_ns": 382206941354350, "t_last_token_ns": 382214383505479, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "3bb8df688946d953", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382206755281174, "t_first_token_ns": 382207192472676, "t_last_token_ns": 382214420082876, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "448dfb7bcf90f1f3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382207311175673, "t_first_token_ns": 382207579731863, "t_last_token_ns": 382215073238782, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "33ee8dfa5d511f36", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382207350457148, "t_first_token_ns": 382207815485763, "t_last_token_ns": 382215091566276, "prompt_tokens": 3947, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fe73928ec06f2ffd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382207428695980, "t_first_token_ns": 382208056417117, "t_last_token_ns": 382215106284349, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "b3b98aab260b94f5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382209456038643, "t_first_token_ns": 382209735842187, "t_last_token_ns": 382216670868033, "prompt_tokens": 3962, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "0616a2c3128fe7ad", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382209524353675, "t_first_token_ns": 382210204453851, "t_last_token_ns": 382216700436726, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "ea50a73400df1150", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382209653218229, "t_first_token_ns": 382210204820040, "t_last_token_ns": 382216700686594, "prompt_tokens": 4063, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "4608dc5a783e53a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382211530198960, "t_first_token_ns": 382211798959182, "t_last_token_ns": 382217995483399, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "d2629c04025d1ad2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382211777756263, "t_first_token_ns": 382212047899603, "t_last_token_ns": 382218022826439, "prompt_tokens": 3959, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "871a29b70510a5f2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382211942268855, "t_first_token_ns": 382212512638118, "t_last_token_ns": 382218050169237, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "78ec14117dc5c5e0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382212010734151, "t_first_token_ns": 382212513442145, "t_last_token_ns": 382218050665050, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "83b69b3a671f955d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382212473143542, "t_first_token_ns": 382212766009828, "t_last_token_ns": 382218072846481, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "7174a671812eb138", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382212513915268, "t_first_token_ns": 382213007341635, "t_last_token_ns": 382218116461094, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "51ff885b54684fc5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382212680827271, "t_first_token_ns": 382213246437014, "t_last_token_ns": 382218333747392, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "37f77dec01a5a091", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382212849598239, "t_first_token_ns": 382213486182778, "t_last_token_ns": 382218337218911, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "280e5ba3748db94d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382213761471408, "t_first_token_ns": 382214039964989, "t_last_token_ns": 382218557306081, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "e4a29ae517fc90cb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382213881609836, "t_first_token_ns": 382214300688822, "t_last_token_ns": 382218572178840, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "191f846cb9f66a8d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382214474097639, "t_first_token_ns": 382214753987221, "t_last_token_ns": 382218673528080, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "35f7d27c1cba45d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382214659257602, "t_first_token_ns": 382215015590573, "t_last_token_ns": 382218685133468, "prompt_tokens": 4008, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "7c00e83d6e1dd0e6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382218051462410, "t_first_token_ns": 382218333647381, "t_last_token_ns": 382219702300725, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3d4d2bb9bff4449a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382221166680340, "t_first_token_ns": 382221418232551, "t_last_token_ns": 382222635150182, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "7272725ee8fd0540", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382222884018197, "t_first_token_ns": 382223136178690, "t_last_token_ns": 382224353706433, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "a2fea85d23f1bda3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382224420641376, "t_first_token_ns": 382224672337337, "t_last_token_ns": 382226325895727, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "011158111ca19afe", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382224959521340, "t_first_token_ns": 382225213382835, "t_last_token_ns": 382226635465143, "prompt_tokens": 3987, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "8da37110844555c6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382226741248835, "t_first_token_ns": 382226992920493, "t_last_token_ns": 382229323314112, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "d8b99c661f516313", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382227423181356, "t_first_token_ns": 382227679988954, "t_last_token_ns": 382230776778108, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "a02c08c718952117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382227539642691, "t_first_token_ns": 382227918674657, "t_last_token_ns": 382230795745437, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "85285854a309da38", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382228419136250, "t_first_token_ns": 382228682408216, "t_last_token_ns": 382231728912764, "prompt_tokens": 4001, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "7ddc31684732a450", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382229681891401, "t_first_token_ns": 382229944481851, "t_last_token_ns": 382234275268214, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "536791c815121f58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382229692195410, "t_first_token_ns": 382230180918053, "t_last_token_ns": 382234293959653, "prompt_tokens": 4023, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "8576f22a0c427bbf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382229837600895, "t_first_token_ns": 382230416855636, "t_last_token_ns": 382234298990114, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "ca99a4a5056f40d2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382230860534607, "t_first_token_ns": 382231118860753, "t_last_token_ns": 382234807481914, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "5838d0fe27e1457f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382231835313652, "t_first_token_ns": 382232094063147, "t_last_token_ns": 382236260213053, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "816823128084eebd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382232384537271, "t_first_token_ns": 382232642912715, "t_last_token_ns": 382236632788270, "prompt_tokens": 3932, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "bb0921b5e49295ee", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382232472077972, "t_first_token_ns": 382232888080797, "t_last_token_ns": 382236651960314, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "346cf978d3834bc0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382232678229522, "t_first_token_ns": 382233348913731, "t_last_token_ns": 382236671555061, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "c886d982435860b7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382232858052076, "t_first_token_ns": 382233349466266, "t_last_token_ns": 382236671992368, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "fdbc4ac00b838337", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382235486795830, "t_first_token_ns": 382235755469859, "t_last_token_ns": 382239539887610, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "fa46f37dea905ba5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382235657639879, "t_first_token_ns": 382236001757374, "t_last_token_ns": 382239557882032, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3e44df05b71a3966", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382235968214739, "t_first_token_ns": 382236251599184, "t_last_token_ns": 382239577233326, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "8ee00ef0ad273d5c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382236747690994, "t_first_token_ns": 382237010170939, "t_last_token_ns": 382239991166370, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "abfce48fa7fd10f9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382237473573203, "t_first_token_ns": 382237731677118, "t_last_token_ns": 382240710895573, "prompt_tokens": 3927, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "4f100560326929ab", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382238025183856, "t_first_token_ns": 382238287784436, "t_last_token_ns": 382240956308495, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "f83672c4afe7b491", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382238727193197, "t_first_token_ns": 382238989046663, "t_last_token_ns": 382241255073454, "prompt_tokens": 3975, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8683501cd7f36932", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382240062713183, "t_first_token_ns": 382240322846834, "t_last_token_ns": 382242542706069, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "3ce62a1f03d2a106", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382241698518116, "t_first_token_ns": 382241955883205, "t_last_token_ns": 382244507877645, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "34360b76a6f05a1c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382241796530824, "t_first_token_ns": 382242408126523, "t_last_token_ns": 382244524309960, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "0b7dbbfb7b402e80", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382241775725566, "t_first_token_ns": 382242408235306, "t_last_token_ns": 382244524593196, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "9ca5d6660027739d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382243429474904, "t_first_token_ns": 382243689797564, "t_last_token_ns": 382245973300327, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "1fe7cbb011f5427a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382245037514759, "t_first_token_ns": 382245294339964, "t_last_token_ns": 382250194843484, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "dffdc06a4b36683c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382245343924635, "t_first_token_ns": 382245602114914, "t_last_token_ns": 382250387049265, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "caced4db24115828", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382245684488912, "t_first_token_ns": 382245959670002, "t_last_token_ns": 382250595073071, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "9b16f710bda9505d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382246455155122, "t_first_token_ns": 382246713116464, "t_last_token_ns": 382251855458673, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "cb7c10754f5ce5fe", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382246820467361, "t_first_token_ns": 382247079292015, "t_last_token_ns": 382252064431004, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "88ffbcb6bc7f56b1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382246899219593, "t_first_token_ns": 382247324912941, "t_last_token_ns": 382252087727441, "prompt_tokens": 4007, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "78e331e87c45a189", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382247090656834, "t_first_token_ns": 382247563741168, "t_last_token_ns": 382252100025111, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "456ef7ed125277b0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382247332250810, "t_first_token_ns": 382247810341060, "t_last_token_ns": 382252119050670, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "89f55bed6ffb548a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382247890167221, "t_first_token_ns": 382248154181193, "t_last_token_ns": 382252447222493, "prompt_tokens": 3969, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3d3ab1fae05f0d2a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382248016358736, "t_first_token_ns": 382248404905181, "t_last_token_ns": 382252466210954, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "335bb26db7a2003b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382248886461930, "t_first_token_ns": 382249158934231, "t_last_token_ns": 382252778461417, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "dfbdddceda574c5e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382251220254559, "t_first_token_ns": 382251492349707, "t_last_token_ns": 382254858193212, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "59fcfa5724d8e7b3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382251545160317, "t_first_token_ns": 382251817740199, "t_last_token_ns": 382254943373623, "prompt_tokens": 4019, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "cfe7772de6d17d6b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382252108590582, "t_first_token_ns": 382252376840772, "t_last_token_ns": 382255427792897, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "59bba69a8d667e3e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382252783358215, "t_first_token_ns": 382253044197227, "t_last_token_ns": 382255861156576, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "108739472aeef7cd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382253850525340, "t_first_token_ns": 382254113938495, "t_last_token_ns": 382257348412417, "prompt_tokens": 3964, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "7912548face9904f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382254512630187, "t_first_token_ns": 382254777050148, "t_last_token_ns": 382257680083230, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9ad61f308977eb83", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382254998337939, "t_first_token_ns": 382255257111090, "t_last_token_ns": 382258124056760, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "3491e86c0fd93ddb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382255849278374, "t_first_token_ns": 382256113740914, "t_last_token_ns": 382258672159473, "prompt_tokens": 4013, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "48e9daddae7ddfde", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382255866071677, "t_first_token_ns": 382256343072316, "t_last_token_ns": 382258678062715, "prompt_tokens": 3921, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "30336ab3d8b85b24", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382257740405991, "t_first_token_ns": 382258003695552, "t_last_token_ns": 382259717870390, "prompt_tokens": 4024, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "9a3fd26f54c1be0a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382259267040309, "t_first_token_ns": 382259520113618, "t_last_token_ns": 382264610527785, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "6b4b03f7f400b478", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382260056629156, "t_first_token_ns": 382260314996180, "t_last_token_ns": 382266945327221, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "79c09b32b572e89b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382260207966744, "t_first_token_ns": 382260552535667, "t_last_token_ns": 382267201658830, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "96d046514314461d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382260863772430, "t_first_token_ns": 382261121517694, "t_last_token_ns": 382269616456818, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "185f1dbdea6d23c0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382260883864322, "t_first_token_ns": 382261358981122, "t_last_token_ns": 382269635133280, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1d800c9aabc32617", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382261223021937, "t_first_token_ns": 382261605036781, "t_last_token_ns": 382269675252671, "prompt_tokens": 4020, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "6c8d620872c9187d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382261386618982, "t_first_token_ns": 382261850355307, "t_last_token_ns": 382269733330878, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "48598702f53ca2f3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382261936113708, "t_first_token_ns": 382262207866977, "t_last_token_ns": 382270137410340, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "f2db9e461e72ad78", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382262129279460, "t_first_token_ns": 382262457281167, "t_last_token_ns": 382270170093876, "prompt_tokens": 4022, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "f80c2c460ec65e32", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382262194739319, "t_first_token_ns": 382262694545867, "t_last_token_ns": 382270188383183, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "ab3000c06ac776bf", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382263247959500, "t_first_token_ns": 382263527369075, "t_last_token_ns": 382271199385444, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "0bf5905c1e8121bd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382263441769801, "t_first_token_ns": 382263778485898, "t_last_token_ns": 382271229307297, "prompt_tokens": 3966, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "137d70d1f46c03a1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382264000930903, "t_first_token_ns": 382264483440102, "t_last_token_ns": 382271736094277, "prompt_tokens": 3988, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "1098d56d526989cc", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382263989145268, "t_first_token_ns": 382264483691940, "t_last_token_ns": 382271736277227, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "cebd470b51f7fe4e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382264554664854, "t_first_token_ns": 382264829425692, "t_last_token_ns": 382271857184862, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "a151e7b5b68ad9ae", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382265593367647, "t_first_token_ns": 382265878694985, "t_last_token_ns": 382272887094000, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "4eca794d265710c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382266619269328, "t_first_token_ns": 382266891337738, "t_last_token_ns": 382273890793576, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "dff220b2b2e49d3a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382266885962771, "t_first_token_ns": 382267165156399, "t_last_token_ns": 382273933294801, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "82efcb8a8e11e6c8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382266978474898, "t_first_token_ns": 382267421971357, "t_last_token_ns": 382273961573828, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "2b2b27c2bbba748c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382267606770870, "t_first_token_ns": 382267891744564, "t_last_token_ns": 382274201139814, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "22232cfe893b9166", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382267851804875, "t_first_token_ns": 382268151719835, "t_last_token_ns": 382274222764040, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "139fa79bf7516bed", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382268077307186, "t_first_token_ns": 382268410764409, "t_last_token_ns": 382274244527518, "prompt_tokens": 3980, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "d725af190f423c10", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382268235288591, "t_first_token_ns": 382268669529210, "t_last_token_ns": 382274266811916, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "1d3e84737b4620da", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382268568836316, "t_first_token_ns": 382268931323446, "t_last_token_ns": 382274290482621, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 21, "error": null} +{"req_id": "2375944c4224b637", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382269333588639, "t_first_token_ns": 382269616315075, "t_last_token_ns": 382274517324964, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 22, "error": null} +{"req_id": "657154f7593762d1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382269676971204, "t_first_token_ns": 382269955772343, "t_last_token_ns": 382274579582384, "prompt_tokens": 4032, "completion_tokens": 256, "inflight_at_send": 20, "error": null} +{"req_id": "4e50ce56d0618fec", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382270370930435, "t_first_token_ns": 382270646155427, "t_last_token_ns": 382274840321258, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "cea59338a3b0a9b3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382271240179357, "t_first_token_ns": 382271517760638, "t_last_token_ns": 382275102943935, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "f4dd02509a77bddd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382272348998420, "t_first_token_ns": 382272630061624, "t_last_token_ns": 382275456225311, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "0e7beafea7584ff7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382272913324164, "t_first_token_ns": 382273185025477, "t_last_token_ns": 382275560411765, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "b97b84e328b625d3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382276006639328, "t_first_token_ns": 382276256530418, "t_last_token_ns": 382278666436229, "prompt_tokens": 3974, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "651186d1dd6c15a6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382276471774276, "t_first_token_ns": 382276726335909, "t_last_token_ns": 382279030224506, "prompt_tokens": 4033, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "b6350e463220e4e6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382276985792776, "t_first_token_ns": 382277240696393, "t_last_token_ns": 382279322364134, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "358015cbb66d10de", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382277702966911, "t_first_token_ns": 382277962916964, "t_last_token_ns": 382279646475958, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "50705bd15064c6d4", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382280071652148, "t_first_token_ns": 382280324700297, "t_last_token_ns": 382281925876641, "prompt_tokens": 4006, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "ecb80a17721044a3", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382280878938876, "t_first_token_ns": 382281138710755, "t_last_token_ns": 382282509067958, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "41abb79477b47f91", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382282537804991, "t_first_token_ns": 382282788944025, "t_last_token_ns": 382285759281017, "prompt_tokens": 3983, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "721ebf229a030a95", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382282654081516, "t_first_token_ns": 382283024887566, "t_last_token_ns": 382285774665841, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "3a340945700f2c58", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382283020915717, "t_first_token_ns": 382283281575175, "t_last_token_ns": 382285814957053, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "2170390234b5ae2d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382283831925259, "t_first_token_ns": 382284092819349, "t_last_token_ns": 382288185747467, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "076476fea8382967", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382284712516382, "t_first_token_ns": 382284976692902, "t_last_token_ns": 382289902776001, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "ff52490f95172d67", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382285894483115, "t_first_token_ns": 382286155432594, "t_last_token_ns": 382292769390123, "prompt_tokens": 3996, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "e924d3bcedd387fb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382286101690378, "t_first_token_ns": 382286397210325, "t_last_token_ns": 382292801303990, "prompt_tokens": 3970, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "b877892f91ecec34", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382286354904928, "t_first_token_ns": 382286639601881, "t_last_token_ns": 382292831600255, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "1caf880a2fbf12e5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382286710224367, "t_first_token_ns": 382286977767075, "t_last_token_ns": 382293006976919, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9a1cf60f1b871ded", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382287042791479, "t_first_token_ns": 382287306643213, "t_last_token_ns": 382293163095604, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "a95165328c12522a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382287108257219, "t_first_token_ns": 382287553709196, "t_last_token_ns": 382293190316188, "prompt_tokens": 3986, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "db3cb451a123fd7b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382287438582330, "t_first_token_ns": 382287801748655, "t_last_token_ns": 382293217578256, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "ec19d55d7bc56117", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382288124599871, "t_first_token_ns": 382288403964586, "t_last_token_ns": 382294315926875, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "45f17bcf193b6eb1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382289022270243, "t_first_token_ns": 382289289950672, "t_last_token_ns": 382296722833350, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "0a1426ca17d726a2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382289197880272, "t_first_token_ns": 382289541891230, "t_last_token_ns": 382296758146324, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "85f92136d0577f5c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382289844640819, "t_first_token_ns": 382290119573263, "t_last_token_ns": 382297620747299, "prompt_tokens": 3982, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "c68c8ac2cefadeda", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382290772189791, "t_first_token_ns": 382291044190610, "t_last_token_ns": 382298884126891, "prompt_tokens": 3976, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "39ec2bfef2cc660c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382290896269825, "t_first_token_ns": 382291557937052, "t_last_token_ns": 382298918583030, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "5c5ae6e010163893", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382290885824379, "t_first_token_ns": 382291558128261, "t_last_token_ns": 382298919800304, "prompt_tokens": 3960, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "bc830bbd57c31dfd", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382291013313524, "t_first_token_ns": 382291747448050, "t_last_token_ns": 382298932740540, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "f8dfa76d3272924c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382291771801775, "t_first_token_ns": 382292046115735, "t_last_token_ns": 382299229923989, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "6a0616efb0ee2261", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382293403776801, "t_first_token_ns": 382293668924944, "t_last_token_ns": 382300919064688, "prompt_tokens": 3977, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "9be8cd07b75dc5e7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382293731199801, "t_first_token_ns": 382294006155407, "t_last_token_ns": 382301042218103, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "213c753a2902d374", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382293981769734, "t_first_token_ns": 382294258539915, "t_last_token_ns": 382301299021090, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "4e27c91846d4e17d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382294641425973, "t_first_token_ns": 382294925554912, "t_last_token_ns": 382301779950306, "prompt_tokens": 3995, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "1b02d1736bed2783", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382294895722126, "t_first_token_ns": 382295177886367, "t_last_token_ns": 382301807617569, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "044505f55ee8eb29", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382294923363657, "t_first_token_ns": 382295417962976, "t_last_token_ns": 382301822151120, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "9b6468d2f524b689", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382295112754799, "t_first_token_ns": 382295660622279, "t_last_token_ns": 382301837146717, "prompt_tokens": 4015, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "0576ac2b072d4f41", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382295725139653, "t_first_token_ns": 382296004582188, "t_last_token_ns": 382301950439627, "prompt_tokens": 3999, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "1904f89e3ffa195e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382296134260191, "t_first_token_ns": 382296413472717, "t_last_token_ns": 382302134773902, "prompt_tokens": 4002, "completion_tokens": 256, "inflight_at_send": 17, "error": null} +{"req_id": "278330e7e052f152", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382296419310614, "t_first_token_ns": 382296708528618, "t_last_token_ns": 382302640835174, "prompt_tokens": 3973, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "783382169706baf2", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382296752445880, "t_first_token_ns": 382297031024489, "t_last_token_ns": 382303135339820, "prompt_tokens": 4017, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "fd3f7b073d883ae7", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382296851397497, "t_first_token_ns": 382297289250588, "t_last_token_ns": 382303160499824, "prompt_tokens": 3981, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "16236450faab7663", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382297824640610, "t_first_token_ns": 382298107311304, "t_last_token_ns": 382304045809829, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 18, "error": null} +{"req_id": "f702da4e623d7579", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382298137321560, "t_first_token_ns": 382298416539465, "t_last_token_ns": 382304112896204, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "d9555469adb82bd6", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382298919125293, "t_first_token_ns": 382299203410033, "t_last_token_ns": 382304513657278, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 19, "error": null} +{"req_id": "47bdac1c5663cca9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382299479247967, "t_first_token_ns": 382299752385750, "t_last_token_ns": 382304758513211, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "af1d9e8359f64baa", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382301015398911, "t_first_token_ns": 382301299446540, "t_last_token_ns": 382305833963679, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 16, "error": null} +{"req_id": "b27e960445b0e807", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382302077132232, "t_first_token_ns": 382302353779344, "t_last_token_ns": 382306867355390, "prompt_tokens": 3993, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "3877cb03f6ea4711", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382302172810824, "t_first_token_ns": 382302601941942, "t_last_token_ns": 382307117973132, "prompt_tokens": 3955, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "cee027f56ae5f140", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382302573962987, "t_first_token_ns": 382303068443742, "t_last_token_ns": 382307138965145, "prompt_tokens": 4009, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "336f49e040184b00", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382302582340992, "t_first_token_ns": 382303068546107, "t_last_token_ns": 382307139098054, "prompt_tokens": 4005, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "9cc7dafc187ac5a5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382303521299090, "t_first_token_ns": 382303790669946, "t_last_token_ns": 382307775877186, "prompt_tokens": 3994, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "8363103077032c09", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382303698193977, "t_first_token_ns": 382304047062605, "t_last_token_ns": 382307795962936, "prompt_tokens": 4018, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "288e93bd46cfc9ea", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382306201788219, "t_first_token_ns": 382306465215344, "t_last_token_ns": 382309936320353, "prompt_tokens": 3984, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "9e4a220b3cf1ed89", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382306372622843, "t_first_token_ns": 382306713100234, "t_last_token_ns": 382309956502330, "prompt_tokens": 4000, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "d553f356441ca287", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382306846192108, "t_first_token_ns": 382307117674979, "t_last_token_ns": 382310085891182, "prompt_tokens": 4027, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "5c8b375f370a610c", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382307297425735, "t_first_token_ns": 382307565490133, "t_last_token_ns": 382310246006686, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "c8b0fc76cafef753", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382308469469585, "t_first_token_ns": 382308734862861, "t_last_token_ns": 382312592045093, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "72e7e5c0e7f2b84f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382309072995230, "t_first_token_ns": 382309336914139, "t_last_token_ns": 382313268295474, "prompt_tokens": 3998, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "9e7ed7f0ec538c3f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382310492993009, "t_first_token_ns": 382310754760768, "t_last_token_ns": 382316883485729, "prompt_tokens": 3992, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "ff133c5d58ab656f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382310750583486, "t_first_token_ns": 382311013283677, "t_last_token_ns": 382316943272594, "prompt_tokens": 4023, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "0b005fe06300469f", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382310957832201, "t_first_token_ns": 382311478864113, "t_last_token_ns": 382316971147033, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "a729629242e95560", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382310819773538, "t_first_token_ns": 382311479055787, "t_last_token_ns": 382316971417710, "prompt_tokens": 3985, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "f9fef77febb3a101", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382310989684571, "t_first_token_ns": 382311707712423, "t_last_token_ns": 382316984995843, "prompt_tokens": 3991, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "3a56a9b9fbaf16ef", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382311809639853, "t_first_token_ns": 382312083743110, "t_last_token_ns": 382317398693541, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "a4b8f1dd0a833ac0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382312582579356, "t_first_token_ns": 382312855284846, "t_last_token_ns": 382318293869707, "prompt_tokens": 4015, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "bc1ce14acfb8f5b9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382313520095902, "t_first_token_ns": 382313785296209, "t_last_token_ns": 382319122033699, "prompt_tokens": 3971, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "550870cf62cf7dc8", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382314533243277, "t_first_token_ns": 382314803619472, "t_last_token_ns": 382320237138835, "prompt_tokens": 3989, "completion_tokens": 256, "inflight_at_send": 9, "error": null} +{"req_id": "3bed9c08ecc0735e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382314667881087, "t_first_token_ns": 382315264386947, "t_last_token_ns": 382320261349546, "prompt_tokens": 4012, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "2affef463ea83fb5", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382314623370475, "t_first_token_ns": 382315264474829, "t_last_token_ns": 382320261630141, "prompt_tokens": 3963, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "aebd728fac5eb7c9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382315387126536, "t_first_token_ns": 382315882868801, "t_last_token_ns": 382320413305294, "prompt_tokens": 3978, "completion_tokens": 256, "inflight_at_send": 12, "error": null} +{"req_id": "80bee31a1295953e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382315388543059, "t_first_token_ns": 382315883264438, "t_last_token_ns": 382320413544809, "prompt_tokens": 3965, "completion_tokens": 256, "inflight_at_send": 13, "error": null} +{"req_id": "fc6cfd2270ab2581", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382315664880544, "t_first_token_ns": 382316134809886, "t_last_token_ns": 382320433041568, "prompt_tokens": 3972, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "f4a15b0e0da21586", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382316255760696, "t_first_token_ns": 382316529243729, "t_last_token_ns": 382320526288526, "prompt_tokens": 3916, "completion_tokens": 256, "inflight_at_send": 15, "error": null} +{"req_id": "1ff7c31e57e00bcb", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382316961175087, "t_first_token_ns": 382317236358633, "t_last_token_ns": 382320780111665, "prompt_tokens": 3961, "completion_tokens": 256, "inflight_at_send": 14, "error": null} +{"req_id": "c1fecd97b2361f3e", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382317599187050, "t_first_token_ns": 382317873144906, "t_last_token_ns": 382320954096140, "prompt_tokens": 4003, "completion_tokens": 256, "inflight_at_send": 11, "error": null} +{"req_id": "d167f8efb80215a9", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382319589439442, "t_first_token_ns": 382319862829834, "t_last_token_ns": 382321599275810, "prompt_tokens": 3979, "completion_tokens": 256, "inflight_at_send": 10, "error": null} +{"req_id": "c52bced31247e27d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382322039662170, "t_first_token_ns": 382322288052303, "t_last_token_ns": 382326895246382, "prompt_tokens": 3949, "completion_tokens": 256, "inflight_at_send": 1, "error": null} +{"req_id": "431a39693928917a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382322288301548, "t_first_token_ns": 382322546859249, "t_last_token_ns": 382326958466910, "prompt_tokens": 4004, "completion_tokens": 256, "inflight_at_send": 2, "error": null} +{"req_id": "bf8d7bba7096d325", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382322541678429, "t_first_token_ns": 382322799972050, "t_last_token_ns": 382327005049850, "prompt_tokens": 4014, "completion_tokens": 256, "inflight_at_send": 3, "error": null} +{"req_id": "abfb5bfd5d68dc8d", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382322557040682, "t_first_token_ns": 382323036117646, "t_last_token_ns": 382327014252080, "prompt_tokens": 4028, "completion_tokens": 256, "inflight_at_send": 4, "error": null} +{"req_id": "5142ba1e759d7807", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382322644006561, "t_first_token_ns": 382323272791904, "t_last_token_ns": 382327023929267, "prompt_tokens": 4016, "completion_tokens": 256, "inflight_at_send": 5, "error": null} +{"req_id": "911dfbd9a5da2f3a", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382323029542517, "t_first_token_ns": 382323518698810, "t_last_token_ns": 382327040019218, "prompt_tokens": 4010, "completion_tokens": 256, "inflight_at_send": 6, "error": null} +{"req_id": "d4ec1ed768d3128b", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382323714343260, "t_first_token_ns": 382323975638146, "t_last_token_ns": 382327226864239, "prompt_tokens": 3968, "completion_tokens": 256, "inflight_at_send": 7, "error": null} +{"req_id": "8ecca9914ec9afd1", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382323894640673, "t_first_token_ns": 382324222039019, "t_last_token_ns": 382327238167110, "prompt_tokens": 3997, "completion_tokens": 256, "inflight_at_send": 8, "error": null} +{"req_id": "94e98c79036fdaf0", "rate_target": 1.5, "input_tokens_target": 4096, "output_tokens_target": 256, "t_send_ns": 382323965866554, "t_first_token_ns": 382324463256352, "t_last_token_ns": 382327242314889, "prompt_tokens": 3990, "completion_tokens": 256, "inflight_at_send": 9, "error": null} diff --git a/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/run_summary.json b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/run_summary.json new file mode 100644 index 0000000..0714dde --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/20260526_1627_drfix/plain/run_summary.json @@ -0,0 +1,8 @@ +{ + "rate": 1.5, + "input_tokens": 4096, + "output_tokens": 256, + "duration_target_s": 240.0, + "duration_actual_s": 243.239731536014, + "n_requests": 392 +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/trace_replay_summary.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/trace_replay_summary.json new file mode 100644 index 0000000..a694bb3 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/trace_replay_summary.json @@ -0,0 +1,53 @@ +{ + "unified": { + "n_total": 1214, + "n_ok": 1214, + "n_err": 0, + "ttft_mean_ms": 4018.2049553304346, + "ttft_p50_ms": 499.80880302609876, + "ttft_p90_ms": 11971.00561100524, + "ttft_p99_ms": 46695.4637899762, + "tpot_mean_ms": 15.317457336748381, + "tpot_p50_ms": 8.4233505983844, + "tpot_p90_ms": 19.624556955096267, + "tpot_p99_ms": 151.59626177765062, + "e2e_mean_ms": 8179.940037778339, + "e2e_p50_ms": 1942.4257799983025, + "e2e_p90_ms": 23474.75191502599, + "e2e_p99_ms": 73709.20522802044 + }, + "unified_kv_both": { + "n_total": 1214, + "n_ok": 1214, + "n_err": 0, + "ttft_mean_ms": 3551.512749613402, + "ttft_p50_ms": 500.6749929743819, + "ttft_p90_ms": 9743.529893981759, + "ttft_p99_ms": 42432.15363100171, + "tpot_mean_ms": 14.382922003727078, + "tpot_p50_ms": 8.348213152272539, + "tpot_p90_ms": 21.58885370458434, + "tpot_p99_ms": 127.73682388598733, + "e2e_mean_ms": 7966.7458915099105, + "e2e_p50_ms": 1995.0270210392773, + "e2e_p90_ms": 21254.210047016386, + "e2e_p99_ms": 76629.94067498948 + }, + "unified_kv_both_drfix": { + "n_total": 1214, + "n_ok": 1214, + "n_err": 0, + "ttft_mean_ms": 3103.38564077023, + "ttft_p50_ms": 484.8736240528524, + "ttft_p90_ms": 7583.885677042417, + "ttft_p99_ms": 41882.84209399717, + "tpot_mean_ms": 14.182905529343138, + "tpot_p50_ms": 8.092588612325601, + "tpot_p90_ms": 17.727813587879535, + "tpot_p99_ms": 112.25943991111738, + "e2e_mean_ms": 7183.769712352909, + "e2e_p50_ms": 1805.8691520127468, + "e2e_p90_ms": 17930.795097956434, + "e2e_p99_ms": 71957.86093402421 + } +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/breakdown.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/breakdown.json new file mode 100644 index 0000000..9bed749 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/breakdown.json @@ -0,0 +1 @@ +[{"request_id":"1237198:1:1237198:0","session_id":"1237198","input_length":8228,"t_proxy_recv":383644.122658325,"t_decision_unix":1779814509.1365995,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383645.022616935,"t_first_token_unix":1779814510.0365622,"t_done":383645.117893655,"t_done_unix":1779814510.1318388},{"request_id":"1237337:1:1237337:1","session_id":"1237337","input_length":3976,"t_proxy_recv":383644.54105159,"t_decision_unix":1779814509.5549927,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3976,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8228,"ongoing_decode_tokens":0,"pending_prefill_tokens":8228,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":8228.0,"score_lmetric":12204},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383645.071847266,"t_first_token_unix":1779814510.0857913,"t_done":383645.457055362,"t_done_unix":1779814510.4709992},{"request_id":"1237198:2:1237773:2","session_id":"1237198","input_length":10237,"t_proxy_recv":383646.091240435,"t_decision_unix":1779814511.1051817,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8192,"affinity_cache_ratio":0.8002344436846732,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":2045,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":16,"cache_hit":8192,"new_prefill":2045,"score_linear":-8192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":7,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":383646.376378617,"t_first_token_unix":1779814511.3903222,"t_done":383646.509185331,"t_done_unix":1779814511.5231287},{"request_id":"1237877:1:1237877:3","session_id":"1237877","input_length":749,"t_proxy_recv":383646.549221877,"t_decision_unix":1779814511.5631633,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":7,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383646.665839945,"t_first_token_unix":1779814511.6797836,"t_done":383646.791882104,"t_done_unix":1779814511.8058255},{"request_id":"1239034:1:1239034:4","session_id":"1239034","input_length":13489,"t_proxy_recv":383650.328071648,"t_decision_unix":1779814515.342013,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13489,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383651.819702232,"t_first_token_unix":1779814516.833646,"t_done":383652.266954517,"t_done_unix":1779814517.2808983},{"request_id":"1237877:2:1239577:6","session_id":"1237877","input_length":1620,"t_proxy_recv":383652.211062693,"t_decision_unix":1779814517.225004,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":512,"affinity_cache_ratio":0.3160493827160494,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":512,"new_prefill":1108,"score_linear":-512.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13489,"ongoing_decode_tokens":13489,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":13489.0,"score_lmetric":1620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":37165.0,"score_lmetric":38785},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":383652.28958317,"t_first_token_unix":1779814517.3035264,"t_done":383652.733037849,"t_done_unix":1779814517.7469811},{"request_id":"1239704:1:1239704:7","session_id":"1239704","input_length":5194,"t_proxy_recv":383652.653241388,"t_decision_unix":1779814517.667183,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1620,"ongoing_decode_tokens":1620,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":5194,"score_linear":1620.0,"score_lmetric":5194},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":37165.0,"score_lmetric":42359},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383653.271881839,"t_first_token_unix":1779814518.2858255,"t_done":383653.538473095,"t_done_unix":1779814518.5524166},{"request_id":"1240924:1:1240924:11","session_id":"1240924","input_length":7429,"t_proxy_recv":383656.674821705,"t_decision_unix":1779814521.688763,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7429,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":66214.0,"score_lmetric":73643},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30040,"ongoing_decode_tokens":0,"pending_prefill_tokens":30040,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7429,"score_linear":30040.0,"score_lmetric":37469},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7429,"score_linear":18420.0,"score_lmetric":7429},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":37165,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":37165.0,"score_lmetric":7429},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383657.210396158,"t_first_token_unix":1779814522.2243402,"t_done":383657.385189133,"t_done_unix":1779814522.3991327},{"request_id":"1239100:1:1239100:5","session_id":"1239100","input_length":37165,"t_proxy_recv":383650.568139237,"t_decision_unix":1779814515.5820806,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":37165,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13489,"ongoing_decode_tokens":0,"pending_prefill_tokens":13489,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":13489.0,"score_lmetric":50654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383656.546498869,"t_first_token_unix":1779814521.560443,"t_done":383657.79109809,"t_done_unix":1779814522.8050416},{"request_id":"1240198:1:1240198:9","session_id":"1240198","input_length":30040,"t_proxy_recv":383654.18854723,"t_decision_unix":1779814519.2024884,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":30040,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":66214.0,"score_lmetric":96254},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":37165.0,"score_lmetric":67205},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383658.118786118,"t_first_token_unix":1779814523.13273,"t_done":383658.756735394,"t_done_unix":1779814523.770679},{"request_id":"1241953:1:1241953:13","session_id":"1241953","input_length":1093,"t_proxy_recv":383660.090934397,"t_decision_unix":1779814525.1048756,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1093,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":34,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":66214.0,"score_lmetric":67307},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1093,"score_linear":18420.0,"score_lmetric":1093},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7587,"ongoing_decode_tokens":0,"pending_prefill_tokens":7587,"num_requests":1,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":1093,"score_linear":7587.0,"score_lmetric":8680},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383660.205019368,"t_first_token_unix":1779814525.2189627,"t_done":383660.714875862,"t_done_unix":1779814525.7288206},{"request_id":"1241942:1:1241942:12","session_id":"1241942","input_length":7587,"t_proxy_recv":383660.0502421,"t_decision_unix":1779814525.0641828,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7587,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":34,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":66214.0,"score_lmetric":73801},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7587,"score_linear":18420.0,"score_lmetric":7587},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383660.582900636,"t_first_token_unix":1779814525.5968444,"t_done":383660.771511394,"t_done_unix":1779814525.7854545},{"request_id":"1237877:3:1242953:15","session_id":"1237877","input_length":2659,"t_proxy_recv":383663.477884983,"t_decision_unix":1779814528.491826,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.5776607747273411,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":1123,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17157,"ongoing_decode_tokens":0,"pending_prefill_tokens":17157,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":2659,"score_linear":17157.0,"score_lmetric":19816},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":66214.0,"score_lmetric":68873},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":1536,"new_prefill":1123,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":2659,"score_linear":18420.0,"score_lmetric":2659},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":383663.572022839,"t_first_token_unix":1779814528.5859666,"t_done":383663.634923395,"t_done_unix":1779814528.648867},{"request_id":"1242838:1:1242838:14","session_id":"1242838","input_length":17157,"t_proxy_recv":383663.09834265,"t_decision_unix":1779814528.112284,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":66214.0,"score_lmetric":83371},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17157,"score_linear":18420.0,"score_lmetric":17157},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383664.802070055,"t_first_token_unix":1779814529.8160133,"t_done":383665.692080642,"t_done_unix":1779814530.7060246},{"request_id":"1239704:2:1243943:17","session_id":"1239704","input_length":14812,"t_proxy_recv":383666.756306456,"t_decision_unix":1779814531.7702477,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":5120,"affinity_cache_ratio":0.3456656764785309,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":9692,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":43,"cache_hit":5120,"new_prefill":9692,"score_linear":-5120.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":11074,"ongoing_decode_tokens":0,"pending_prefill_tokens":11074,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14812,"score_linear":11074.0,"score_lmetric":25886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":66214.0,"score_lmetric":81026},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":14812,"score_linear":18420.0,"score_lmetric":14812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":383667.83703678,"t_first_token_unix":1779814532.8509805,"t_done":383667.95136961,"t_done_unix":1779814532.9653132},{"request_id":"1243831:1:1243831:16","session_id":"1243831","input_length":11074,"t_proxy_recv":383666.35382998,"t_decision_unix":1779814531.3677714,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":43,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":66214.0,"score_lmetric":77288},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":11074,"score_linear":18420.0,"score_lmetric":11074},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383667.287076766,"t_first_token_unix":1779814532.3010206,"t_done":383668.730192545,"t_done_unix":1779814533.744137},{"request_id":"1239034:2:1240558:10","session_id":"1239034","input_length":18420,"t_proxy_recv":383655.423984322,"t_decision_unix":1779814520.4379249,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":13312,"affinity_cache_ratio":0.7226927252985885,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":5108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":66214.0,"score_lmetric":84634},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30040,"ongoing_decode_tokens":0,"pending_prefill_tokens":30040,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":18420,"score_linear":30040.0,"score_lmetric":48460},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":13312,"new_prefill":5108,"score_linear":-13312.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":37165.0,"score_lmetric":55585},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13312.0,"chosen_score_lmetric":0,"t_first_token":383656.128038306,"t_first_token_unix":1779814521.1419818,"t_done":383669.388160036,"t_done_unix":1779814534.4021037},{"request_id":"1239755:1:1239755:8","session_id":"1239755","input_length":66214,"t_proxy_recv":383652.863929989,"t_decision_unix":1779814517.877871,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66214,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5194,"ongoing_decode_tokens":0,"pending_prefill_tokens":5194,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":5194.0,"score_lmetric":71408},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":37165.0,"score_lmetric":103379},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383668.738811383,"t_first_token_unix":1779814533.752755,"t_done":383669.422118606,"t_done_unix":1779814534.4360619},{"request_id":"1244640:1:1244640:18","session_id":"1244640","input_length":8274,"t_proxy_recv":383669.250515051,"t_decision_unix":1779814534.2644563,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8274,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":66214,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":66214.0,"score_lmetric":8274},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":8274,"score_linear":18420.0,"score_lmetric":8274},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383669.843824181,"t_first_token_unix":1779814534.8577678,"t_done":383670.044370168,"t_done_unix":1779814535.0583134},{"request_id":"1245572:1:1245572:19","session_id":"1245572","input_length":6109,"t_proxy_recv":383672.384386784,"t_decision_unix":1779814537.3983278,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6109,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383673.146177338,"t_first_token_unix":1779814538.160122,"t_done":383673.386448597,"t_done_unix":1779814538.4003923},{"request_id":"1241953:2:1245624:20","session_id":"1241953","input_length":10382,"t_proxy_recv":383672.47505693,"t_decision_unix":1779814537.4889982,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":1024,"affinity_cache_ratio":0.09863224812174919,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":9358,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":1024,"new_prefill":9358,"score_linear":-1024.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":6109,"ongoing_decode_tokens":0,"pending_prefill_tokens":6109,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10382,"score_linear":6109.0,"score_lmetric":16491}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":383673.245664008,"t_first_token_unix":1779814538.2596083,"t_done":383673.428314075,"t_done_unix":1779814538.4422576},{"request_id":"1245572:2:1246348:22","session_id":"1245572","input_length":6182,"t_proxy_recv":383674.980081409,"t_decision_unix":1779814539.9940226,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.9938531219670009,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":38,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":17447,"ongoing_decode_tokens":0,"pending_prefill_tokens":10279,"num_requests":1,"active_p_offloads":0,"cached_blocks":76,"cache_hit":0,"new_prefill":6182,"score_linear":17447.0,"score_lmetric":16461},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":6144,"new_prefill":38,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":383675.012327214,"t_first_token_unix":1779814540.0262713,"t_done":383675.189244965,"t_done_unix":1779814540.2031882},{"request_id":"1240924:2:1246244:21","session_id":"1240924","input_length":17447,"t_proxy_recv":383674.607874129,"t_decision_unix":1779814539.621815,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7168,"affinity_cache_ratio":0.4108442712214134,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":76,"cache_hit":7168,"new_prefill":10279,"score_linear":-7168.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":383675.821651511,"t_first_token_unix":1779814540.8355956,"t_done":383676.196595962,"t_done_unix":1779814541.2105393},{"request_id":"1241942:2:1247111:23","session_id":"1241942","input_length":17975,"t_proxy_recv":383677.653479246,"t_decision_unix":1779814542.6674204,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":7168,"affinity_cache_ratio":0.3987760778859527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10807,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":7168,"new_prefill":10807,"score_linear":-7168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":383678.937566518,"t_first_token_unix":1779814543.9515102,"t_done":383679.122300082,"t_done_unix":1779814544.136243},{"request_id":"1244640:2:1247941:24","session_id":"1244640","input_length":10696,"t_proxy_recv":383680.470015457,"t_decision_unix":1779814545.4839566,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8192,"affinity_cache_ratio":0.7658937920718025,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":2504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":8192,"new_prefill":2504,"score_linear":-8192.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":383680.793995604,"t_first_token_unix":1779814545.8079393,"t_done":383680.839026376,"t_done_unix":1779814545.8529694},{"request_id":"1248768:1:1248768:25","session_id":"1248768","input_length":11515,"t_proxy_recv":383683.249861089,"t_decision_unix":1779814548.263802,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11515,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383684.225410945,"t_first_token_unix":1779814549.239355,"t_done":383684.483842127,"t_done_unix":1779814549.4977853},{"request_id":"1249058:1:1249058:26","session_id":"1249058","input_length":4126,"t_proxy_recv":383684.269826526,"t_decision_unix":1779814549.2837677,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4126,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11515,"ongoing_decode_tokens":11515,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":4126,"score_linear":11515.0,"score_lmetric":4126},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383684.534703295,"t_first_token_unix":1779814549.548647,"t_done":383684.698825568,"t_done_unix":1779814549.7127693},{"request_id":"1248768:2:1249765:27","session_id":"1248768","input_length":12188,"t_proxy_recv":383686.532864787,"t_decision_unix":1779814551.5468059,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.924187725631769,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":924,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":83,"cache_hit":11264,"new_prefill":924,"score_linear":-11264.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":45,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":383686.673705393,"t_first_token_unix":1779814551.6876493,"t_done":383687.135535335,"t_done_unix":1779814552.1494787},{"request_id":"1249058:2:1249872:28","session_id":"1249058","input_length":7482,"t_proxy_recv":383686.924316245,"t_decision_unix":1779814551.9382577,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4096,"affinity_cache_ratio":0.5474472066292435,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":3386,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12188,"ongoing_decode_tokens":12188,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":83,"cache_hit":0,"new_prefill":7482,"score_linear":12188.0,"score_lmetric":7482},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":45,"cache_hit":4096,"new_prefill":3386,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":383687.242288007,"t_first_token_unix":1779814552.2562313,"t_done":383687.368933086,"t_done_unix":1779814552.3828764},{"request_id":"1242838:2:1250503:29","session_id":"1242838","input_length":21578,"t_proxy_recv":383689.199752888,"t_decision_unix":1779814554.2136939,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.783019742330151,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":4682,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":16896,"new_prefill":4682,"score_linear":-16896.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":383689.917573334,"t_first_token_unix":1779814554.931517,"t_done":383690.400875316,"t_done_unix":1779814555.4148202},{"request_id":"1250772:1:1250772:30","session_id":"1250772","input_length":6829,"t_proxy_recv":383690.060526231,"t_decision_unix":1779814555.0744672,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6829,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21578,"ongoing_decode_tokens":21578,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6829,"score_linear":21578.0,"score_lmetric":6829},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383690.860668014,"t_first_token_unix":1779814555.8746114,"t_done":383692.431507581,"t_done_unix":1779814557.445451},{"request_id":"1251059:1:1251059:32","session_id":"1251059","input_length":16512,"t_proxy_recv":383691.241919753,"t_decision_unix":1779814556.2558613,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":6829,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":16512,"score_linear":6829.0,"score_lmetric":16512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":0,"pending_prefill_tokens":20086,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":16512,"score_linear":20086.0,"score_lmetric":36598},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383692.801119302,"t_first_token_unix":1779814557.8150628,"t_done":383692.802803399,"t_done_unix":1779814557.8167465},{"request_id":"1248768:3:1251261:33","session_id":"1248768","input_length":16989,"t_proxy_recv":383691.815575994,"t_decision_unix":1779814556.8295176,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11776,"affinity_cache_ratio":0.6931543940196597,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":5213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":11776,"new_prefill":5213,"score_linear":-11776.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16512,"ongoing_decode_tokens":0,"pending_prefill_tokens":16512,"num_requests":1,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":16989,"score_linear":16512.0,"score_lmetric":33501},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":6829,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":16989,"score_linear":6829.0,"score_lmetric":16989},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":0,"pending_prefill_tokens":20086,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":16989,"score_linear":20086.0,"score_lmetric":37075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":383692.498753655,"t_first_token_unix":1779814557.512697,"t_done":383693.457125641,"t_done_unix":1779814558.4710686},{"request_id":"1251828:1:1251828:35","session_id":"1251828","input_length":1090,"t_proxy_recv":383693.745348161,"t_decision_unix":1779814558.7592897,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1090,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":20086,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":1090,"score_linear":20086.0,"score_lmetric":1090},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13780,"ongoing_decode_tokens":0,"pending_prefill_tokens":7636,"num_requests":1,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":1090,"score_linear":13780.0,"score_lmetric":8726}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383693.831743987,"t_first_token_unix":1779814558.8456879,"t_done":383693.938304286,"t_done_unix":1779814558.9522479},{"request_id":"1250935:1:1250935:31","session_id":"1250935","input_length":20086,"t_proxy_recv":383690.685647466,"t_decision_unix":1779814555.6995888,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":20086,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":0,"pending_prefill_tokens":6829,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":20086,"score_linear":6829.0,"score_lmetric":26915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383692.765063814,"t_first_token_unix":1779814557.7790072,"t_done":383694.006985557,"t_done_unix":1779814559.0209289},{"request_id":"1245572:3:1251662:34","session_id":"1245572","input_length":13780,"t_proxy_recv":383693.226942585,"t_decision_unix":1779814558.2408843,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.4458635703918723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":7636,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16989,"ongoing_decode_tokens":16989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":13780,"score_linear":16989.0,"score_lmetric":13780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":20086,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":13780,"score_linear":20086.0,"score_lmetric":13780},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":6144,"new_prefill":7636,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":383694.038590686,"t_first_token_unix":1779814559.0525339,"t_done":383694.26458323,"t_done_unix":1779814559.2785265},{"request_id":"1252010:1:1252010:36","session_id":"1252010","input_length":9855,"t_proxy_recv":383694.354484413,"t_decision_unix":1779814559.3684254,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9855,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":144,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383695.165449835,"t_first_token_unix":1779814560.1793942,"t_done":383695.335857205,"t_done_unix":1779814560.3498003},{"request_id":"1248768:4:1253385:37","session_id":"1248768","input_length":17309,"t_proxy_recv":383699.129549576,"t_decision_unix":1779814564.1434906,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.9761395805650239,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":413,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":16896,"new_prefill":413,"score_linear":-16896.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":383699.211120038,"t_first_token_unix":1779814564.2250633,"t_done":383702.134140606,"t_done_unix":1779814567.1480837},{"request_id":"1251828:2:1254272:41","session_id":"1251828","input_length":3934,"t_proxy_recv":383702.097923201,"t_decision_unix":1779814567.1118648,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":4,"affinity_cache_hit":1024,"affinity_cache_ratio":0.2602948652770717,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3934,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":3934,"score_linear":17309.0,"score_lmetric":3934},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":3934,"score_linear":35221.0,"score_lmetric":39155},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":1024,"new_prefill":2910,"score_linear":48600.0,"score_lmetric":52534},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":0,"pending_prefill_tokens":4108,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":3934,"score_linear":10764.0,"score_lmetric":8042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383702.345046828,"t_first_token_unix":1779814567.3589902,"t_done":383702.487714511,"t_done_unix":1779814567.501658},{"request_id":"1254584:1:1254584:42","session_id":"1254584","input_length":748,"t_proxy_recv":383703.234146542,"t_decision_unix":1779814568.2480881,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":748,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":748,"score_linear":35221.0,"score_lmetric":35969},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":748,"score_linear":49624.0,"score_lmetric":50372},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":10764,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":748,"score_linear":10764.0,"score_lmetric":748},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383703.299118698,"t_first_token_unix":1779814568.3130617,"t_done":383703.449763362,"t_done_unix":1779814568.463707},{"request_id":"1252010:2:1254691:43","session_id":"1252010","input_length":13092,"t_proxy_recv":383703.683702688,"t_decision_unix":1779814568.6976442,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.743049190345249,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":3364,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":13092,"score_linear":35221.0,"score_lmetric":48313},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":13092,"score_linear":49624.0,"score_lmetric":62716},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":10764,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":13092,"score_linear":10764.0,"score_lmetric":13092},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":9728,"new_prefill":3364,"score_linear":-9728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":383704.105873515,"t_first_token_unix":1779814569.1198168,"t_done":383704.274091523,"t_done_unix":1779814569.288035},{"request_id":"1250772:2:1254198:40","session_id":"1250772","input_length":10764,"t_proxy_recv":383701.82561459,"t_decision_unix":1779814566.8395557,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6656,"affinity_cache_ratio":0.6183574879227053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":4108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":10764,"score_linear":17309.0,"score_lmetric":10764},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":10764,"score_linear":35221.0,"score_lmetric":45985},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":10764,"score_linear":49624.0,"score_lmetric":60388},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":6656,"new_prefill":4108,"score_linear":-6656.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":383702.207936237,"t_first_token_unix":1779814567.2218792,"t_done":383704.445695477,"t_done_unix":1779814569.4596388},{"request_id":"1253804:1:1253804:39","session_id":"1253804","input_length":35221,"t_proxy_recv":383700.716905915,"t_decision_unix":1779814565.7308471,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":35221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":35221,"score_linear":17309.0,"score_lmetric":35221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":35221,"score_linear":49624.0,"score_lmetric":84845},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383705.87661917,"t_first_token_unix":1779814570.8905628,"t_done":383708.066299568,"t_done_unix":1779814573.0802429},{"request_id":"1256273:1:1256273:46","session_id":"1256273","input_length":1694,"t_proxy_recv":383708.914310646,"t_decision_unix":1779814573.9282525,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1694,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":1694,"score_linear":49624.0,"score_lmetric":51318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":0,"pending_prefill_tokens":10618,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":1694,"score_linear":17786.0,"score_lmetric":12312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383709.057704721,"t_first_token_unix":1779814574.0716484,"t_done":383709.337901971,"t_done_unix":1779814574.3518453},{"request_id":"1243831:2:1256324:47","session_id":"1243831","input_length":11448,"t_proxy_recv":383709.078257897,"t_decision_unix":1779814574.0921993,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":11264,"affinity_cache_ratio":0.983927323549965,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":11264,"new_prefill":184,"score_linear":-11264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":11448,"score_linear":49624.0,"score_lmetric":61072},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":0,"pending_prefill_tokens":10618,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":11448,"score_linear":17786.0,"score_lmetric":22066},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1694,"ongoing_decode_tokens":1694,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":11448,"score_linear":1694.0,"score_lmetric":11448},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":383709.13007106,"t_first_token_unix":1779814574.1440141,"t_done":383709.564325294,"t_done_unix":1779814574.578269},{"request_id":"1253743:1:1253743:38","session_id":"1253743","input_length":49624,"t_proxy_recv":383700.475924088,"t_decision_unix":1779814565.489865,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49624,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":49624,"score_linear":17309.0,"score_lmetric":49624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383709.719286719,"t_first_token_unix":1779814574.7332304,"t_done":383710.114185421,"t_done_unix":1779814575.1281288},{"request_id":"1249058:3:1256222:45","session_id":"1249058","input_length":17786,"t_proxy_recv":383708.766163881,"t_decision_unix":1779814573.780105,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7168,"affinity_cache_ratio":0.4030136062071292,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10618,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":17786,"score_linear":49624.0,"score_lmetric":67410},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":7168,"new_prefill":10618,"score_linear":-7168.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":383710.032422212,"t_first_token_unix":1779814575.0463657,"t_done":383710.147075685,"t_done_unix":1779814575.161021},{"request_id":"1253743:2:1256070:44","session_id":"1253743","input_length":49687,"t_proxy_recv":383710.123197268,"t_decision_unix":1779814575.1371388,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9995371022601486,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":23,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":3584,"new_prefill":46103,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":49664,"new_prefill":23,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":17786,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":49687,"score_linear":17786.0,"score_lmetric":49687},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":383710.198534428,"t_first_token_unix":1779814575.2124777,"t_done":383711.016719667,"t_done_unix":1779814576.0306633},{"request_id":"1256273:2:1257769:51","session_id":"1256273","input_length":6170,"t_proxy_recv":383713.897361957,"t_decision_unix":1779814578.9113035,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.24894651539708265,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":4634,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":4434,"ongoing_decode_tokens":4434,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":6170,"score_linear":4434.0,"score_lmetric":6170},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":6170,"score_linear":27387.0,"score_lmetric":33557},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6170,"score_linear":90488.0,"score_lmetric":96658},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":1536,"new_prefill":4634,"score_linear":-1536.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":383714.224023039,"t_first_token_unix":1779814579.2379665,"t_done":383714.518183176,"t_done_unix":1779814579.5321264},{"request_id":"1257572:1:1257572:50","session_id":"1257572","input_length":4434,"t_proxy_recv":383713.262959528,"t_decision_unix":1779814578.2769008,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":4434,"score_linear":27387.0,"score_lmetric":31821},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":4434,"score_linear":90488.0,"score_lmetric":94922},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383713.549085287,"t_first_token_unix":1779814578.5630288,"t_done":383714.768146274,"t_done_unix":1779814579.7820895},{"request_id":"1254584:2:1258039:52","session_id":"1254584","input_length":1257,"t_proxy_recv":383714.917016377,"t_decision_unix":1779814579.930958,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":512,"affinity_cache_ratio":0.40731901352426414,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":745,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":113,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":1257,"score_linear":27387.0,"score_lmetric":28644},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":512,"new_prefill":745,"score_linear":-512.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":1257,"score_linear":90488.0,"score_lmetric":91745},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":383714.97057621,"t_first_token_unix":1779814579.9845195,"t_done":383715.300250588,"t_done_unix":1779814580.314194},{"request_id":"1242838:3:1258161:53","session_id":"1242838","input_length":22262,"t_proxy_recv":383715.378961062,"t_decision_unix":1779814580.3929024,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9659509478034318,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":113,"cache_hit":21504,"new_prefill":758,"score_linear":-21504.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":22262,"score_linear":27387.0,"score_lmetric":49649},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22262,"score_linear":90488.0,"score_lmetric":112750},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":383715.542917529,"t_first_token_unix":1779814580.5568612,"t_done":383716.084993793,"t_done_unix":1779814581.0989368},{"request_id":"1256273:3:1258499:55","session_id":"1256273","input_length":7934,"t_proxy_recv":383716.540505914,"t_decision_unix":1779814581.5544472,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6144,"affinity_cache_ratio":0.7743887068313587,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":1790,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":0,"pending_prefill_tokens":45037,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":7934,"score_linear":80365.0,"score_lmetric":105942},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":7934,"score_linear":90488.0,"score_lmetric":98422},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":6144,"new_prefill":1790,"score_linear":-6144.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":383716.724920137,"t_first_token_unix":1779814581.7388635,"t_done":383717.332443657,"t_done_unix":1779814582.3463874},{"request_id":"1258908:1:1258908:58","session_id":"1258908","input_length":9250,"t_proxy_recv":383717.994588544,"t_decision_unix":1779814583.0085294,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9250,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":9250,"score_linear":80365.0,"score_lmetric":53800},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":9250,"score_linear":68131.0,"score_lmetric":77381},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":9250,"score_linear":90488.0,"score_lmetric":99738},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9250,"score_linear":112793.0,"score_lmetric":122043},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383718.691486831,"t_first_token_unix":1779814583.7054303,"t_done":383720.66007256,"t_done_unix":1779814585.6740162},{"request_id":"1259178:1:1259178:59","session_id":"1259178","input_length":14291,"t_proxy_recv":383718.956528172,"t_decision_unix":1779814583.9704695,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":14291,"score_linear":80365.0,"score_lmetric":63882},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":14291,"score_linear":68131.0,"score_lmetric":82422},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9250,"ongoing_decode_tokens":9250,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":14291,"score_linear":9250.0,"score_lmetric":14291},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":14291,"score_linear":90488.0,"score_lmetric":104779},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14291,"score_linear":112793.0,"score_lmetric":127084},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383720.205376274,"t_first_token_unix":1779814585.219324,"t_done":383722.132080833,"t_done_unix":1779814587.1460242},{"request_id":"1257525:1:1257525:49","session_id":"1257525","input_length":27387,"t_proxy_recv":383713.17695427,"t_decision_unix":1779814578.1908956,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":27387,"score_linear":90488.0,"score_lmetric":117875},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383716.631520283,"t_first_token_unix":1779814581.6454642,"t_done":383722.255362384,"t_done_unix":1779814587.2693057},{"request_id":"1253804:2:1258346:54","session_id":"1253804","input_length":52978,"t_proxy_recv":383716.08858001,"t_decision_unix":1779814581.1025217,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":35328,"affinity_cache_ratio":0.6668428404243271,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":17650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":35328,"new_prefill":17650,"score_linear":-7941.0,"score_lmetric":45037},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":3584,"new_prefill":49394,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":52978,"score_linear":90488.0,"score_lmetric":143466},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7941.0,"chosen_score_lmetric":45037,"t_first_token":383721.88328623,"t_first_token_unix":1779814586.89723,"t_done":383722.803413454,"t_done_unix":1779814587.8173568},{"request_id":"1260746:1:1260746:62","session_id":"1260746","input_length":9571,"t_proxy_recv":383724.498834317,"t_decision_unix":1779814589.5127757,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9571,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":9571,"score_linear":68131.0,"score_lmetric":77702},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":9571,"score_linear":90488.0,"score_lmetric":100059},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9571,"score_linear":125063.0,"score_lmetric":253908},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9571,"score_linear":30655.0,"score_lmetric":40226}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383725.250477106,"t_first_token_unix":1779814590.2644203,"t_done":383725.635708527,"t_done_unix":1779814590.649652},{"request_id":"1260792:1:1260792:63","session_id":"1260792","input_length":12522,"t_proxy_recv":383724.617244157,"t_decision_unix":1779814589.6311853,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12522,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9571,"ongoing_decode_tokens":0,"pending_prefill_tokens":9571,"num_requests":1,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":12522,"score_linear":9571.0,"score_lmetric":22093},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":12522,"score_linear":68131.0,"score_lmetric":80653},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":12522,"score_linear":90488.0,"score_lmetric":103010},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12522,"score_linear":125063.0,"score_lmetric":259810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":12522,"score_linear":30655.0,"score_lmetric":43177}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383725.646041869,"t_first_token_unix":1779814590.6599848,"t_done":383725.977722906,"t_done_unix":1779814590.991666},{"request_id":"1261126:1:1261126:65","session_id":"1261126","input_length":5640,"t_proxy_recv":383725.652524324,"t_decision_unix":1779814590.6664658,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5640,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":132,"cache_hit":0,"new_prefill":5640,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55138,"ongoing_decode_tokens":0,"pending_prefill_tokens":2402,"num_requests":1,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":5640,"score_linear":55138.0,"score_lmetric":8042},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":5640,"score_linear":68131.0,"score_lmetric":73771},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12522,"ongoing_decode_tokens":12522,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5640,"score_linear":12522.0,"score_lmetric":5640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5640,"score_linear":90488.0,"score_lmetric":96128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5640,"score_linear":125063.0,"score_lmetric":246046},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":5640,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":5640,"score_linear":30655.0,"score_lmetric":36295}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383726.021449639,"t_first_token_unix":1779814591.0353928,"t_done":383726.188166046,"t_done_unix":1779814591.2021098},{"request_id":"1253804:3:1260997:64","session_id":"1253804","input_length":55138,"t_proxy_recv":383725.354757968,"t_decision_unix":1779814590.368699,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9564365773151003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2402,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9571,"ongoing_decode_tokens":9571,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":55138,"score_linear":9571.0,"score_lmetric":55138},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":52736,"new_prefill":2402,"score_linear":-52736.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":55138,"score_linear":68131.0,"score_lmetric":123269},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12522,"ongoing_decode_tokens":0,"pending_prefill_tokens":12522,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":3584,"new_prefill":51554,"score_linear":8938.0,"score_lmetric":64076},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":55138,"score_linear":90488.0,"score_lmetric":145626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":55138,"score_linear":125063.0,"score_lmetric":345042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":55138,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":55138,"score_linear":30655.0,"score_lmetric":85793}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":383726.235438988,"t_first_token_unix":1779814591.2493825,"t_done":383726.817655246,"t_done_unix":1779814591.8315988},{"request_id":"1260327:1:1260327:61","session_id":"1260327","input_length":30655,"t_proxy_recv":383722.779633782,"t_decision_unix":1779814587.7935748,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":30655,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":52978,"ongoing_decode_tokens":52978,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":218,"cache_hit":0,"new_prefill":30655,"score_linear":52978.0,"score_lmetric":30655},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":30655,"score_linear":68131.0,"score_lmetric":98786},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":30655,"score_linear":90488.0,"score_lmetric":121143},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":30655,"score_linear":125063.0,"score_lmetric":296076},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383726.847309517,"t_first_token_unix":1779814591.8612525,"t_done":383727.485171861,"t_done_unix":1779814592.499115},{"request_id":"1257525:2:1262205:67","session_id":"1257525","input_length":29988,"t_proxy_recv":383729.468044818,"t_decision_unix":1779814594.4819863,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9048952914499133,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":2852,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":256,"cache_hit":27136,"new_prefill":2852,"score_linear":-27136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":29988,"score_linear":68131.0,"score_lmetric":98119},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":29988,"score_linear":90488.0,"score_lmetric":120476},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":29988,"score_linear":125063.0,"score_lmetric":294742},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":383730.107194919,"t_first_token_unix":1779814595.121138,"t_done":383730.129132793,"t_done_unix":1779814595.1430805},{"request_id":"1262757:1:1262757:73","session_id":"1262757","input_length":5465,"t_proxy_recv":383731.349334551,"t_decision_unix":1779814596.363276,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":5465,"score_linear":55989.0,"score_lmetric":6670},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":5465,"score_linear":68131.0,"score_lmetric":73596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5465,"score_linear":15283.0,"score_lmetric":20748},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5465,"score_linear":113053.0,"score_lmetric":196076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5465,"score_linear":125063.0,"score_lmetric":245696},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":5465,"score_linear":21510.0,"score_lmetric":26975}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383731.70473428,"t_first_token_unix":1779814596.7186778,"t_done":383731.834468966,"t_done_unix":1779814596.8484118},{"request_id":"1261126:2:1262820:74","session_id":"1261126","input_length":6953,"t_proxy_recv":383731.52019884,"t_decision_unix":1779814596.53414,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":5632,"affinity_cache_ratio":0.8100100675967209,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":1321,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":5632,"new_prefill":1321,"score_linear":-5632.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":6953,"score_linear":55989.0,"score_lmetric":8158},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":6953,"score_linear":68131.0,"score_lmetric":75084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":6953,"score_linear":15283.0,"score_lmetric":22236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6953,"score_linear":113053.0,"score_lmetric":199052},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":6953,"score_linear":125063.0,"score_lmetric":248672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":5465,"ongoing_decode_tokens":0,"pending_prefill_tokens":5465,"num_requests":1,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":6953,"score_linear":5465.0,"score_lmetric":12418},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6953,"score_linear":21510.0,"score_lmetric":28463}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":383731.680583542,"t_first_token_unix":1779814596.694527,"t_done":383731.912117563,"t_done_unix":1779814596.926061},{"request_id":"1262354:1:1262354:69","session_id":"1262354","input_length":21510,"t_proxy_recv":383730.064745191,"t_decision_unix":1779814595.078687,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":29988,"ongoing_decode_tokens":0,"pending_prefill_tokens":2852,"num_requests":1,"active_p_offloads":0,"cached_blocks":256,"cache_hit":0,"new_prefill":21510,"score_linear":29988.0,"score_lmetric":24362},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":21510,"score_linear":68131.0,"score_lmetric":89641},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":21510,"score_linear":113053.0,"score_lmetric":228166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":21510,"score_linear":125063.0,"score_lmetric":277786},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383732.386542519,"t_first_token_unix":1779814597.400486,"t_done":383732.980777296,"t_done_unix":1779814597.9947207},{"request_id":"1258611:1:1258611:56","session_id":"1258611","input_length":68131,"t_proxy_recv":383716.939014713,"t_decision_unix":1779814581.9529564,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":68131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":68131,"score_linear":80365.0,"score_lmetric":171562},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68131,"score_linear":90488.0,"score_lmetric":158619},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7934,"ongoing_decode_tokens":7934,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":68131,"score_linear":7934.0,"score_lmetric":68131},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383733.309564942,"t_first_token_unix":1779814598.3235087,"t_done":383734.471549657,"t_done_unix":1779814599.4854934},{"request_id":"1258611:2:1261594:66","session_id":"1258611","input_length":68320,"t_proxy_recv":383734.482554433,"t_decision_unix":1779814599.496496,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9967213114754099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":224,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":68320,"score_linear":55989.0,"score_lmetric":68320},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":68096,"new_prefill":224,"score_linear":-68096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":68320,"score_linear":15283.0,"score_lmetric":68320},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68320,"score_linear":113053.0,"score_lmetric":321786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":68320,"score_linear":125063.0,"score_lmetric":371406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":0,"pending_prefill_tokens":605,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":68320,"score_linear":22109.0,"score_lmetric":68925}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":383734.625293699,"t_first_token_unix":1779814599.639237,"t_done":383734.668632163,"t_done_unix":1779814599.6825774},{"request_id":"1258611:3:1262709:71","session_id":"1258611","input_length":68377,"t_proxy_recv":383734.681433534,"t_decision_unix":1779814599.695375,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9958904309928778,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":0,"pending_prefill_tokens":5990,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":68377,"score_linear":5990.0,"score_lmetric":74367},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":68377,"score_linear":55989.0,"score_lmetric":68377},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":68096,"new_prefill":281,"score_linear":-68096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":68377,"score_linear":15283.0,"score_lmetric":68377},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68377,"score_linear":113053.0,"score_lmetric":321900},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":68377,"score_linear":125063.0,"score_lmetric":371520},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":68377,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":68377,"score_linear":22109.0,"score_lmetric":68377}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":383734.819246686,"t_first_token_unix":1779814599.83319,"t_done":383735.252717592,"t_done_unix":1779814600.266661},{"request_id":"1263611:1:1263611:76","session_id":"1263611","input_length":5990,"t_proxy_recv":383734.552017317,"t_decision_unix":1779814599.565959,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5990,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":5990,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":5990,"score_linear":55989.0,"score_lmetric":5990},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68320,"ongoing_decode_tokens":0,"pending_prefill_tokens":224,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":5990,"score_linear":68320.0,"score_lmetric":6214},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5990,"score_linear":15283.0,"score_lmetric":5990},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5990,"score_linear":113053.0,"score_lmetric":197126},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5990,"score_linear":125063.0,"score_lmetric":246746},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5990,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":0,"pending_prefill_tokens":605,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":5990,"score_linear":22109.0,"score_lmetric":6595}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383734.950694486,"t_first_token_unix":1779814599.9646378,"t_done":383735.334534737,"t_done_unix":1779814600.3484783},{"request_id":"1262354:2:1263593:75","session_id":"1262354","input_length":22109,"t_proxy_recv":383734.432647868,"t_decision_unix":1779814599.4465885,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9726355782712922,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":605,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":22109,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":22109,"score_linear":55989.0,"score_lmetric":22109},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":68131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22109,"score_linear":68131.0,"score_lmetric":22109},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22109,"score_linear":15283.0,"score_lmetric":22109},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22109,"score_linear":113053.0,"score_lmetric":229364},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22109,"score_linear":125063.0,"score_lmetric":278984},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":22109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":128,"cache_hit":21504,"new_prefill":605,"score_linear":-21504.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":383734.597087096,"t_first_token_unix":1779814599.6110306,"t_done":383735.811317171,"t_done_unix":1779814600.8252604},{"request_id":"1263971:1:1263971:80","session_id":"1263971","input_length":6336,"t_proxy_recv":383735.850948961,"t_decision_unix":1779814600.8648903,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":6336,"score_linear":55989.0,"score_lmetric":6336},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":6336,"score_linear":71575.0,"score_lmetric":125256},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6336,"score_linear":113053.0,"score_lmetric":197818},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":6336,"score_linear":125063.0,"score_lmetric":247438},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":6336,"score_linear":50783.0,"score_lmetric":57119},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383736.266846799,"t_first_token_unix":1779814601.2807903,"t_done":383736.62590844,"t_done_unix":1779814601.6398518},{"request_id":"1257323:1:1257323:48","session_id":"1257323","input_length":90488,"t_proxy_recv":383712.578475924,"t_decision_unix":1779814577.5924172,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":90488,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383740.148535346,"t_first_token_unix":1779814605.1624794,"t_done":383740.561221166,"t_done_unix":1779814605.5751703},{"request_id":"1239034:3:1262346:68","session_id":"1239034","input_length":22565,"t_proxy_recv":383730.034226255,"t_decision_unix":1779814595.0481677,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":20480,"affinity_cache_ratio":0.9076002658985154,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":2085,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":29988,"ongoing_decode_tokens":0,"pending_prefill_tokens":2852,"num_requests":1,"active_p_offloads":0,"cached_blocks":256,"cache_hit":0,"new_prefill":22565,"score_linear":29988.0,"score_lmetric":25417},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22565,"score_linear":68131.0,"score_lmetric":90696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":20480,"new_prefill":2085,"score_linear":70008.0,"score_lmetric":92573},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22565,"score_linear":125063.0,"score_lmetric":279896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":70008.0,"chosen_score_lmetric":92573,"t_first_token":383740.149787794,"t_first_token_unix":1779814605.1637309,"t_done":383740.683230774,"t_done_unix":1779814605.6971748},{"request_id":"1265000:1:1265000:83","session_id":"1265000","input_length":301,"t_proxy_recv":383739.477102777,"t_decision_unix":1779814604.491044,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":301,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":301,"score_linear":110048.0,"score_lmetric":110349},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":301,"score_linear":55989.0,"score_lmetric":301},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":301,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":301,"score_linear":71575.0,"score_lmetric":113186},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":301,"score_linear":113053.0,"score_lmetric":185748},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":301,"score_linear":125063.0,"score_lmetric":235368},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":301,"score_linear":50783.0,"score_lmetric":51084},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":301,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383739.514950574,"t_first_token_unix":1779814604.5288937,"t_done":383741.026898287,"t_done_unix":1779814606.040841},{"request_id":"1265128:1:1265128:85","session_id":"1265128","input_length":14028,"t_proxy_recv":383739.805416871,"t_decision_unix":1779814604.8193579,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":14028,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14028,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":14028,"score_linear":110048.0,"score_lmetric":124076},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":14028,"score_linear":55989.0,"score_lmetric":14028},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":301,"ongoing_decode_tokens":301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":14028,"score_linear":301.0,"score_lmetric":14028},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":14028,"score_linear":71575.0,"score_lmetric":140640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":14028,"score_linear":113053.0,"score_lmetric":213202},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14028,"score_linear":125063.0,"score_lmetric":262822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":14028,"score_linear":50783.0,"score_lmetric":64811},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":23540,"ongoing_decode_tokens":0,"pending_prefill_tokens":23540,"num_requests":1,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":14028,"score_linear":23540.0,"score_lmetric":37568}],"chosen_score_linear":301.0,"chosen_score_lmetric":14028,"t_first_token":383741.023548271,"t_first_token_unix":1779814606.037492,"t_done":383741.450891166,"t_done_unix":1779814606.464835},{"request_id":"1266067:1:1266067:91","session_id":"1266067","input_length":579,"t_proxy_recv":383743.027828619,"t_decision_unix":1779814608.0417702,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":579,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":579,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":579,"score_linear":135235.0,"score_lmetric":227596},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":60059,"ongoing_decode_tokens":55989,"pending_prefill_tokens":4070,"num_requests":2,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":579,"score_linear":60059.0,"score_lmetric":9298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":579,"score_linear":13178.0,"score_lmetric":13757},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":579,"score_linear":92560.0,"score_lmetric":196704},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":579,"score_linear":27639.0,"score_lmetric":579},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":579,"score_linear":125063.0,"score_lmetric":235924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":579,"score_linear":50783.0,"score_lmetric":51362},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":579,"score_linear":45884.0,"score_lmetric":1158}],"chosen_score_linear":27639.0,"chosen_score_lmetric":579,"t_first_token":383743.142540756,"t_first_token_unix":1779814608.156484,"t_done":383743.307569497,"t_done_unix":1779814608.3215127},{"request_id":"1263611:2:1265770:88","session_id":"1263611","input_length":13178,"t_proxy_recv":383742.124702117,"t_decision_unix":1779814607.1386435,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":2,"affinity_cache_hit":5632,"affinity_cache_ratio":0.4273789649415693,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":5632,"new_prefill":7546,"score_linear":129603.0,"score_lmetric":241530},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":13178,"score_linear":55989.0,"score_lmetric":13178},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":13178,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":13178,"score_linear":71575.0,"score_lmetric":138940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":13178,"score_linear":27639.0,"score_lmetric":13178},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":13178,"score_linear":125063.0,"score_lmetric":261122},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":13178,"score_linear":50783.0,"score_lmetric":63961},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":13178,"score_linear":45884.0,"score_lmetric":74092}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383743.232768731,"t_first_token_unix":1779814608.246712,"t_done":383743.483522734,"t_done_unix":1779814608.497466},{"request_id":"1250772:3:1265019:84","session_id":"1250772","input_length":23540,"t_proxy_recv":383739.548574347,"t_decision_unix":1779814604.5625157,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.45675446049277824,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":23540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":23540,"score_linear":110048.0,"score_lmetric":133588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":23540,"score_linear":55989.0,"score_lmetric":23540},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":301,"ongoing_decode_tokens":301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":23540,"score_linear":301.0,"score_lmetric":23540},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":23540,"score_linear":71575.0,"score_lmetric":159664},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":23540,"score_linear":113053.0,"score_lmetric":232226},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":10752,"new_prefill":12788,"score_linear":114311.0,"score_lmetric":260342},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":23540,"score_linear":50783.0,"score_lmetric":74323},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":23540,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383742.234881118,"t_first_token_unix":1779814607.2488248,"t_done":383743.83854003,"t_done_unix":1779814608.852485},{"request_id":"1265942:1:1265942:89","session_id":"1265942","input_length":4070,"t_proxy_recv":383742.754462029,"t_decision_unix":1779814607.7684035,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":4070,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4070,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":4070,"score_linear":135235.0,"score_lmetric":234578},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":4070,"score_linear":55989.0,"score_lmetric":4070},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":4070,"score_linear":13178.0,"score_lmetric":17248},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":4070,"score_linear":71575.0,"score_lmetric":120724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":4070,"score_linear":27639.0,"score_lmetric":4070},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":4070,"score_linear":125063.0,"score_lmetric":242906},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":4070,"score_linear":50783.0,"score_lmetric":54853},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":4070,"score_linear":45884.0,"score_lmetric":8140}],"chosen_score_linear":55989.0,"chosen_score_lmetric":4070,"t_first_token":383743.065906949,"t_first_token_unix":1779814608.07985,"t_done":383743.905258868,"t_done_unix":1779814608.9192019},{"request_id":"1262354:3:1265178:86","session_id":"1262354","input_length":22344,"t_proxy_recv":383739.913567662,"t_decision_unix":1779814604.927509,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9853204439670605,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":22344,"score_linear":110048.0,"score_lmetric":132392},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":22344,"score_linear":55989.0,"score_lmetric":22344},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14329,"ongoing_decode_tokens":301,"pending_prefill_tokens":14028,"num_requests":2,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":22344,"score_linear":14329.0,"score_lmetric":72744},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22344,"score_linear":71575.0,"score_lmetric":157272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22344,"score_linear":113053.0,"score_lmetric":229834},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22344,"score_linear":125063.0,"score_lmetric":279454},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":22344,"score_linear":50783.0,"score_lmetric":73127},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":23540,"ongoing_decode_tokens":0,"pending_prefill_tokens":23540,"num_requests":1,"active_p_offloads":0,"cached_blocks":141,"cache_hit":22016,"new_prefill":328,"score_linear":1524.0,"score_lmetric":23868}],"chosen_score_linear":1524.0,"chosen_score_lmetric":23868,"t_first_token":383742.236932471,"t_first_token_unix":1779814607.2508757,"t_done":383744.632910834,"t_done_unix":1779814609.6468542},{"request_id":"1266440:1:1266440:92","session_id":"1266440","input_length":5381,"t_proxy_recv":383744.099807825,"t_decision_unix":1779814609.1137493,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":5381,"score_linear":135235.0,"score_lmetric":237200},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":269,"cache_hit":0,"new_prefill":5381,"score_linear":55989.0,"score_lmetric":5381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":5381,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5381,"score_linear":92560.0,"score_lmetric":211110},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":5381,"score_linear":27639.0,"score_lmetric":5381},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5381,"score_linear":125063.0,"score_lmetric":245528},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5381,"score_linear":50783.0,"score_lmetric":56164},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22344,"ongoing_decode_tokens":22344,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":187,"cache_hit":0,"new_prefill":5381,"score_linear":22344.0,"score_lmetric":5381}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383744.476914879,"t_first_token_unix":1779814609.4908583,"t_done":383744.77436374,"t_done_unix":1779814609.788307},{"request_id":"1263727:1:1263727:77","session_id":"1263727","input_length":50783,"t_proxy_recv":383735.011235264,"t_decision_unix":1779814600.0251768,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":50783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":5990,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":50783,"score_linear":5990.0,"score_lmetric":50783},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":50783,"score_linear":55989.0,"score_lmetric":50783},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68377,"ongoing_decode_tokens":68377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":50783,"score_linear":68377.0,"score_lmetric":50783},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":50783,"score_linear":15283.0,"score_lmetric":50783},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":50783,"score_linear":113053.0,"score_lmetric":286712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":50783,"score_linear":125063.0,"score_lmetric":336332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":50783,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":50783,"score_linear":22109.0,"score_lmetric":50783}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383744.729965781,"t_first_token_unix":1779814609.7439091,"t_done":383744.911475237,"t_done_unix":1779814609.9254189},{"request_id":"1253804:4:1262690:70","session_id":"1253804","input_length":55989,"t_proxy_recv":383731.165187927,"t_decision_unix":1779814596.1791291,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":54784,"affinity_cache_ratio":0.978477915304792,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":1205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":55989,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":261,"cache_hit":54784,"new_prefill":1205,"score_linear":-54784.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":55989,"score_linear":68131.0,"score_lmetric":124120},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":3584,"new_prefill":52405,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":55989,"score_linear":113053.0,"score_lmetric":297124},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":55989,"score_linear":125063.0,"score_lmetric":346744},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":55989,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":55989,"score_linear":21510.0,"score_lmetric":77499}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":383731.600382981,"t_first_token_unix":1779814596.6143265,"t_done":383745.265837014,"t_done_unix":1779814610.2797806},{"request_id":"1263971:2:1266797:94","session_id":"1263971","input_length":9504,"t_proxy_recv":383745.449282218,"t_decision_unix":1779814610.4632232,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.6464646464646465,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":3360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":9504,"score_linear":135235.0,"score_lmetric":245446},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":0,"new_prefill":9504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":9504,"score_linear":92560.0,"score_lmetric":223479},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":9504,"score_linear":27639.0,"score_lmetric":9504},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9504,"score_linear":125063.0,"score_lmetric":253774},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":0,"pending_prefill_tokens":17466,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":9504,"score_linear":17466.0,"score_lmetric":26970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":188,"cache_hit":6144,"new_prefill":3360,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":383745.811111774,"t_first_token_unix":1779814610.825055,"t_done":383745.961397821,"t_done_unix":1779814610.9753408},{"request_id":"1260792:2:1265951:90","session_id":"1260792","input_length":20985,"t_proxy_recv":383742.782159053,"t_decision_unix":1779814607.796093,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":12288,"affinity_cache_ratio":0.5855611150822015,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":8697,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":20985,"score_linear":135235.0,"score_lmetric":268408},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":60059,"ongoing_decode_tokens":55989,"pending_prefill_tokens":4070,"num_requests":2,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":20985,"score_linear":60059.0,"score_lmetric":50110},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":20985,"score_linear":13178.0,"score_lmetric":34163},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":12288,"new_prefill":8697,"score_linear":59287.0,"score_lmetric":129978},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":20985,"score_linear":27639.0,"score_lmetric":20985},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":20985,"score_linear":125063.0,"score_lmetric":276736},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":20985,"score_linear":50783.0,"score_lmetric":71768},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":20985,"score_linear":45884.0,"score_lmetric":41970}],"chosen_score_linear":59287.0,"chosen_score_lmetric":129978,"t_first_token":383747.712744926,"t_first_token_unix":1779814612.7266889,"t_done":383748.226033157,"t_done_unix":1779814613.2399788},{"request_id":"1263749:1:1263749:79","session_id":"1263749","input_length":56292,"t_proxy_recv":383735.084691344,"t_decision_unix":1779814600.0986328,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":56292,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":56292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":5990,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":56292,"score_linear":5990.0,"score_lmetric":56292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":56292,"score_linear":55989.0,"score_lmetric":56292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68377,"ongoing_decode_tokens":68377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":56292,"score_linear":68377.0,"score_lmetric":56292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":56292,"score_linear":15283.0,"score_lmetric":56292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":56292,"score_linear":113053.0,"score_lmetric":297730},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":56292,"score_linear":125063.0,"score_lmetric":347350},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":56292,"score_linear":50783.0,"score_lmetric":107075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":56292,"score_linear":22109.0,"score_lmetric":56292}],"chosen_score_linear":15283.0,"chosen_score_lmetric":56292,"t_first_token":383746.541626689,"t_first_token_unix":1779814611.5555716,"t_done":383749.161527541,"t_done_unix":1779814614.175471},{"request_id":"1266668:1:1266668:93","session_id":"1266668","input_length":17466,"t_proxy_recv":383745.00567741,"t_decision_unix":1779814610.0196185,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17466,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":13370,"score_linear":131139.0,"score_lmetric":253178},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":269,"cache_hit":0,"new_prefill":17466,"score_linear":55989.0,"score_lmetric":17466},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":17466,"score_linear":92560.0,"score_lmetric":247365},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":17466,"score_linear":27639.0,"score_lmetric":17466},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":17466,"score_linear":125063.0,"score_lmetric":269698},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":188,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383746.703568339,"t_first_token_unix":1779814611.7175117,"t_done":383750.556554086,"t_done_unix":1779814615.5704975},{"request_id":"1265942:2:1268069:97","session_id":"1265942","input_length":10457,"t_proxy_recv":383749.757684302,"t_decision_unix":1779814614.7716258,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":4096,"affinity_cache_ratio":0.39169934015492014,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":6361,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":10457,"score_linear":135235.0,"score_lmetric":247352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":4096,"new_prefill":6361,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10457,"score_linear":126924.0,"score_lmetric":118437},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10457,"score_linear":15283.0,"score_lmetric":10457},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":10457,"score_linear":27639.0,"score_lmetric":10457},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":10457,"score_linear":125063.0,"score_lmetric":255680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":10457,"score_linear":17466.0,"score_lmetric":10457},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28671,"ongoing_decode_tokens":0,"pending_prefill_tokens":6143,"num_requests":1,"active_p_offloads":0,"cached_blocks":194,"cache_hit":0,"new_prefill":10457,"score_linear":28671.0,"score_lmetric":16600}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":383750.332574853,"t_first_token_unix":1779814615.3465188,"t_done":383750.685924764,"t_done_unix":1779814615.6998684},{"request_id":"1262354:4:1267821:95","session_id":"1262354","input_length":28671,"t_proxy_recv":383749.058569022,"t_decision_unix":1779814614.0725105,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22528,"affinity_cache_ratio":0.7857416902096195,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":6143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28671,"score_linear":135235.0,"score_lmetric":283780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":0,"new_prefill":28671,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28671,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":71575,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":248,"cache_hit":0,"new_prefill":28671,"score_linear":71575.0,"score_lmetric":57342},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":28671,"score_linear":27639.0,"score_lmetric":28671},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28671,"score_linear":125063.0,"score_lmetric":292108},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":28671,"score_linear":17466.0,"score_lmetric":28671},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":194,"cache_hit":22528,"new_prefill":6143,"score_linear":-22528.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":383750.246423075,"t_first_token_unix":1779814615.260367,"t_done":383751.536787442,"t_done_unix":1779814616.5507307},{"request_id":"1268634:1:1268634:99","session_id":"1268634","input_length":2298,"t_proxy_recv":383752.005721969,"t_decision_unix":1779814617.0196633,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2298,"score_linear":135235.0,"score_lmetric":231034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2298,"score_linear":126924.0,"score_lmetric":110278},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2298,"score_linear":15283.0,"score_lmetric":2298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":2298,"score_linear":27639.0,"score_lmetric":2298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":2298,"score_linear":125063.0,"score_lmetric":239362},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383752.242862753,"t_first_token_unix":1779814617.2568061,"t_done":383752.355674256,"t_done_unix":1779814617.3696177},{"request_id":"1268649:1:1268649:100","session_id":"1268649","input_length":18638,"t_proxy_recv":383752.01637102,"t_decision_unix":1779814617.0303128,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18638,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":18638,"score_linear":135235.0,"score_lmetric":263714},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":18638,"score_linear":102074.0,"score_lmetric":117128},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18638,"score_linear":126924.0,"score_lmetric":126618},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18638,"score_linear":15283.0,"score_lmetric":18638},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":18638,"score_linear":27639.0,"score_lmetric":18638},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":18638,"score_linear":125063.0,"score_lmetric":272042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":18638,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2298,"ongoing_decode_tokens":0,"pending_prefill_tokens":2298,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":18638,"score_linear":2298.0,"score_lmetric":20936}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383753.914822912,"t_first_token_unix":1779814618.9287665,"t_done":383754.05499631,"t_done_unix":1779814619.0689409},{"request_id":"1263971:3:1269088:104","session_id":"1263971","input_length":13955,"t_proxy_recv":383753.39173522,"t_decision_unix":1779814618.4056766,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.660408455750627,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":4739,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":13955,"score_linear":135235.0,"score_lmetric":254348},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":13955,"score_linear":102074.0,"score_lmetric":112445},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13955,"score_linear":126924.0,"score_lmetric":121935},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13955,"score_linear":15283.0,"score_lmetric":13955},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":27639,"pending_prefill_tokens":12320,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":13955,"score_linear":39959.0,"score_lmetric":52550},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":13955,"score_linear":125063.0,"score_lmetric":262676},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":13955,"score_linear":18638.0,"score_lmetric":32593},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":36224,"ongoing_decode_tokens":0,"pending_prefill_tokens":12672,"num_requests":2,"active_p_offloads":0,"cached_blocks":210,"cache_hit":9216,"new_prefill":4739,"score_linear":27008.0,"score_lmetric":34822}],"chosen_score_linear":27008.0,"chosen_score_lmetric":34822,"t_first_token":383754.090351668,"t_first_token_unix":1779814619.1042953,"t_done":383754.366184713,"t_done_unix":1779814619.380128},{"request_id":"1250772:4:1268869:103","session_id":"1250772","input_length":24029,"t_proxy_recv":383752.650343785,"t_decision_unix":1779814617.6642852,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9801489866411419,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":24029,"score_linear":135235.0,"score_lmetric":274496},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":24029,"score_linear":102074.0,"score_lmetric":122519},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24029,"score_linear":126924.0,"score_lmetric":132009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24029,"score_linear":15283.0,"score_lmetric":24029},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":27639,"pending_prefill_tokens":12320,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":24029,"score_linear":39959.0,"score_lmetric":72698},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":10752,"new_prefill":13277,"score_linear":114311.0,"score_lmetric":261320},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":24029,"score_linear":18638.0,"score_lmetric":42667},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":210,"cache_hit":23552,"new_prefill":477,"score_linear":-11357.0,"score_lmetric":12672}],"chosen_score_linear":-11357.0,"chosen_score_lmetric":12672,"t_first_token":383753.630214932,"t_first_token_unix":1779814618.6441584,"t_done":383755.298682626,"t_done_unix":1779814620.312626},{"request_id":"1262354:5:1269336:105","session_id":"1262354","input_length":28906,"t_proxy_recv":383754.345765172,"t_decision_unix":1779814619.3597064,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9919047948522798,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":234,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28906,"score_linear":135235.0,"score_lmetric":284250},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":28906,"score_linear":102074.0,"score_lmetric":127396},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28906,"score_linear":126924.0,"score_lmetric":136886},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28906,"score_linear":15283.0,"score_lmetric":28906},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":28906,"score_linear":39959.0,"score_lmetric":57812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28906,"score_linear":125063.0,"score_lmetric":292578},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":377,"cache_hit":0,"new_prefill":28906,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":50179,"ongoing_decode_tokens":50179,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":210,"cache_hit":28672,"new_prefill":234,"score_linear":21507.0,"score_lmetric":702}],"chosen_score_linear":21507.0,"chosen_score_lmetric":702,"t_first_token":383754.420345216,"t_first_token_unix":1779814619.4342887,"t_done":383755.352111521,"t_done_unix":1779814620.366055},{"request_id":"1268831:1:1268831:101","session_id":"1268831","input_length":12195,"t_proxy_recv":383752.493314647,"t_decision_unix":1779814617.5072558,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":12195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":12195,"score_linear":135235.0,"score_lmetric":250828},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":12195,"score_linear":102074.0,"score_lmetric":110685},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12195,"score_linear":126924.0,"score_lmetric":120175},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12195,"score_linear":15283.0,"score_lmetric":12195},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":12195,"score_linear":27639.0,"score_lmetric":12195},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12195,"score_linear":125063.0,"score_lmetric":259156},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":12195,"score_linear":18638.0,"score_lmetric":30833},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":210,"cache_hit":0,"new_prefill":12195,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383753.489892632,"t_first_token_unix":1779814618.5038364,"t_done":383755.979072563,"t_done_unix":1779814620.9930162},{"request_id":"1269373:1:1269373:106","session_id":"1269373","input_length":14104,"t_proxy_recv":383754.470781049,"t_decision_unix":1779814619.4847221,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6424,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":10008,"score_linear":131139.0,"score_lmetric":246454},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":14104,"score_linear":102074.0,"score_lmetric":112594},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14104,"score_linear":126924.0,"score_lmetric":122084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14104,"score_linear":15283.0,"score_lmetric":14104},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":14104,"score_linear":39959.0,"score_lmetric":28208},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14104,"score_linear":125063.0,"score_lmetric":262974},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":377,"cache_hit":7680,"new_prefill":6424,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":65130,"ongoing_decode_tokens":65130,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":219,"cache_hit":0,"new_prefill":14104,"score_linear":65130.0,"score_lmetric":42312}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":383755.19171065,"t_first_token_unix":1779814620.205655,"t_done":383756.505516468,"t_done_unix":1779814621.5194597},{"request_id":"1268861:1:1268861:102","session_id":"1268861","input_length":12320,"t_proxy_recv":383752.612250864,"t_decision_unix":1779814617.6261923,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":12320,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":12320,"score_linear":135235.0,"score_lmetric":251078},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":12320,"score_linear":102074.0,"score_lmetric":110810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12320,"score_linear":126924.0,"score_lmetric":120300},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12320,"score_linear":15283.0,"score_lmetric":12320},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":12320,"score_linear":27639.0,"score_lmetric":12320},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12320,"score_linear":125063.0,"score_lmetric":259406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":12320,"score_linear":18638.0,"score_lmetric":30958},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":210,"cache_hit":0,"new_prefill":12320,"score_linear":12195.0,"score_lmetric":24515}],"chosen_score_linear":27639.0,"chosen_score_lmetric":12320,"t_first_token":383753.641458034,"t_first_token_unix":1779814618.6554017,"t_done":383756.60463646,"t_done_unix":1779814621.6185849},{"request_id":"1269901:1:1269901:107","session_id":"1269901","input_length":1323,"t_proxy_recv":383756.029429118,"t_decision_unix":1779814621.0433707,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1323,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":1323,"score_linear":135235.0,"score_lmetric":229084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":1323,"score_linear":102074.0,"score_lmetric":99813},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":1323,"score_linear":126924.0,"score_lmetric":109303},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":1323,"score_linear":15283.0,"score_lmetric":1323},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":1323,"score_linear":39959.0,"score_lmetric":2646},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":1323,"score_linear":125063.0,"score_lmetric":237412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14104,"ongoing_decode_tokens":14104,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":377,"cache_hit":0,"new_prefill":1323,"score_linear":14104.0,"score_lmetric":1323},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":244,"cache_hit":0,"new_prefill":1323,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383756.175031346,"t_first_token_unix":1779814621.1889749,"t_done":383756.765651889,"t_done_unix":1779814621.779596},{"request_id":"1260327:2:1270005:108","session_id":"1260327","input_length":30828,"t_proxy_recv":383756.455402177,"t_decision_unix":1779814621.4693432,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9964966913195796,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":30828,"score_linear":135235.0,"score_lmetric":288094},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":30828,"score_linear":102074.0,"score_lmetric":129318},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30828,"score_linear":126924.0,"score_lmetric":138808},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30828,"score_linear":15283.0,"score_lmetric":30828},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":30828,"score_linear":39959.0,"score_lmetric":61656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":30828,"score_linear":125063.0,"score_lmetric":296422},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14104,"ongoing_decode_tokens":14104,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":377,"cache_hit":0,"new_prefill":30828,"score_linear":14104.0,"score_lmetric":30828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":1323,"ongoing_decode_tokens":1323,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":244,"cache_hit":30720,"new_prefill":108,"score_linear":-29397.0,"score_lmetric":108}],"chosen_score_linear":-29397.0,"chosen_score_lmetric":108,"t_first_token":383756.540651914,"t_first_token_unix":1779814621.5545952,"t_done":383756.918582632,"t_done_unix":1779814621.932526},{"request_id":"1266440:2:1270501:112","session_id":"1266440","input_length":11128,"t_proxy_recv":383758.223096927,"t_decision_unix":1779814623.2370381,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.46010064701653486,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":11128,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11128,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":11128,"score_linear":135235.0,"score_lmetric":248694},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":11128,"score_linear":102074.0,"score_lmetric":109618},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":5120,"new_prefill":6008,"score_linear":121804.0,"score_lmetric":113988},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11128,"score_linear":15283.0,"score_lmetric":11128},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":11128,"score_linear":27639.0,"score_lmetric":11128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":11128,"score_linear":125063.0,"score_lmetric":257022},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":11128,"score_linear":57803.0,"score_lmetric":18243},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":11128,"score_linear":27927.0,"score_lmetric":39055}],"chosen_score_linear":15283.0,"chosen_score_lmetric":11128,"t_first_token":383759.124184733,"t_first_token_unix":1779814624.138128,"t_done":383759.338600307,"t_done_unix":1779814624.3525453},{"request_id":"1256273:4:1259632:60","session_id":"1256273","input_length":12270,"t_proxy_recv":383720.497939375,"t_decision_unix":1779814585.5118806,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":7680,"affinity_cache_ratio":0.6259168704156479,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":4590,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":12270,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":12270,"score_linear":80365.0,"score_lmetric":59840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":12270,"score_linear":68131.0,"score_lmetric":80401},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9250,"ongoing_decode_tokens":9250,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":12270,"score_linear":9250.0,"score_lmetric":12270},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":12270,"score_linear":90488.0,"score_lmetric":102758},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":7680,"new_prefill":4590,"score_linear":105113.0,"score_lmetric":117383},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14291,"ongoing_decode_tokens":14291,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":12270,"score_linear":14291.0,"score_lmetric":12270},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":12270,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":105113.0,"chosen_score_lmetric":117383,"t_first_token":383759.255821551,"t_first_token_unix":1779814624.2697647,"t_done":383760.297922015,"t_done_unix":1779814625.3118653},{"request_id":"1258859:1:1258859:57","session_id":"1258859","input_length":112793,"t_proxy_recv":383717.911443004,"t_decision_unix":1779814582.9253843,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":112793,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":112793,"score_linear":80365.0,"score_lmetric":260886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":112793,"score_linear":68131.0,"score_lmetric":180924},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":112793,"score_linear":90488.0,"score_lmetric":203281},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383759.018956329,"t_first_token_unix":1779814624.0329006,"t_done":383760.412148172,"t_done_unix":1779814625.4260921},{"request_id":"1263727:2:1270052:109","session_id":"1263727","input_length":57803,"t_proxy_recv":383756.650434512,"t_decision_unix":1779814621.6643758,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":50688,"affinity_cache_ratio":0.876909502966974,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":7115,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":57803,"score_linear":135235.0,"score_lmetric":342044},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":57803,"score_linear":102074.0,"score_lmetric":156293},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":57803,"score_linear":126924.0,"score_lmetric":165783},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":57803,"score_linear":15283.0,"score_lmetric":57803},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":57803,"score_linear":27639.0,"score_lmetric":57803},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":57803,"score_linear":125063.0,"score_lmetric":350372},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":390,"cache_hit":50688,"new_prefill":7115,"score_linear":-50688.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32151,"ongoing_decode_tokens":32151,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":244,"cache_hit":0,"new_prefill":57803,"score_linear":32151.0,"score_lmetric":115606}],"chosen_score_linear":-50688.0,"chosen_score_lmetric":0,"t_first_token":383759.187113487,"t_first_token_unix":1779814624.2010567,"t_done":383761.243848481,"t_done_unix":1779814626.2577918},{"request_id":"1271459:1:1271459:118","session_id":"1271459","input_length":751,"t_proxy_recv":383761.620583194,"t_decision_unix":1779814626.634524,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":751,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":751,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":751,"score_linear":135235.0,"score_lmetric":227940},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":751,"score_linear":102074.0,"score_lmetric":99241},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":751,"score_linear":126924.0,"score_lmetric":108731},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":751,"score_linear":15283.0,"score_lmetric":751},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":751,"score_linear":121069.0,"score_lmetric":188362},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":751,"score_linear":130878.0,"score_lmetric":36914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28385,"ongoing_decode_tokens":28385,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":751,"score_linear":28385.0,"score_lmetric":751},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":0,"pending_prefill_tokens":39189,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":751,"score_linear":80149.0,"score_lmetric":119820}],"chosen_score_linear":15283.0,"chosen_score_lmetric":751,"t_first_token":383761.715830607,"t_first_token_unix":1779814626.7297738,"t_done":383762.669060218,"t_done_unix":1779814627.6830044},{"request_id":"1271847:1:1271847:123","session_id":"1271847","input_length":2524,"t_proxy_recv":383762.912265936,"t_decision_unix":1779814627.9262073,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":2524,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2524,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2524,"score_linear":135235.0,"score_lmetric":231486},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":2524,"score_linear":102074.0,"score_lmetric":101014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2524,"score_linear":150574.0,"score_lmetric":240660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":380,"cache_hit":0,"new_prefill":2524,"score_linear":15283.0,"score_lmetric":2524},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":2524,"score_linear":121069.0,"score_lmetric":191908},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":2524,"score_linear":130878.0,"score_lmetric":40460},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64508,"ongoing_decode_tokens":28385,"pending_prefill_tokens":21787,"num_requests":3,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":2524,"score_linear":64508.0,"score_lmetric":72933},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":80149,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":2524,"score_linear":80149.0,"score_lmetric":7572}],"chosen_score_linear":15283.0,"chosen_score_lmetric":2524,"t_first_token":383763.112941456,"t_first_token_unix":1779814628.126885,"t_done":383763.288774311,"t_done_unix":1779814628.3027182},{"request_id":"1270340:1:1270340:111","session_id":"1270340","input_length":27927,"t_proxy_recv":383757.656267635,"t_decision_unix":1779814622.670209,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":27927,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":27927,"score_linear":135235.0,"score_lmetric":282292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":27927,"score_linear":102074.0,"score_lmetric":126417},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27927,"score_linear":126924.0,"score_lmetric":135907},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27927,"score_linear":15283.0,"score_lmetric":27927},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":27927,"score_linear":27639.0,"score_lmetric":27927},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":27927,"score_linear":125063.0,"score_lmetric":290620},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":27927,"score_linear":57803.0,"score_lmetric":35042},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":27927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383762.012881212,"t_first_token_unix":1779814627.0268245,"t_done":383763.534781941,"t_done_unix":1779814628.5487258},{"request_id":"1271991:1:1271991:124","session_id":"1271991","input_length":2851,"t_proxy_recv":383763.443014616,"t_decision_unix":1779814628.456956,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":2851,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2851,"score_linear":135235.0,"score_lmetric":232140},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":2851,"score_linear":102074.0,"score_lmetric":101341},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2851,"score_linear":150574.0,"score_lmetric":241314},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":384,"cache_hit":0,"new_prefill":2851,"score_linear":15283.0,"score_lmetric":2851},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":2851,"score_linear":121069.0,"score_lmetric":192562},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":130878,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":2851,"score_linear":130878.0,"score_lmetric":5702},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64508,"ongoing_decode_tokens":28385,"pending_prefill_tokens":21787,"num_requests":3,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":2851,"score_linear":64508.0,"score_lmetric":73914},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":80149,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":2851,"score_linear":80149.0,"score_lmetric":8553}],"chosen_score_linear":15283.0,"chosen_score_lmetric":2851,"t_first_token":383763.627832426,"t_first_token_unix":1779814628.6417756,"t_done":383763.823868362,"t_done_unix":1779814628.8378115},{"request_id":"1271328:1:1271328:117","session_id":"1271328","input_length":17706,"t_proxy_recv":383761.198442713,"t_decision_unix":1779814626.212384,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":17706,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":17706,"score_linear":135235.0,"score_lmetric":261850},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":17706,"score_linear":102074.0,"score_lmetric":116196},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17706,"score_linear":126924.0,"score_lmetric":125686},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":17706,"score_linear":15283.0,"score_lmetric":17706},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":17706,"score_linear":121069.0,"score_lmetric":222272},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":17706,"score_linear":113172.0,"score_lmetric":17706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":86188,"ongoing_decode_tokens":86188,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":17706,"score_linear":86188.0,"score_lmetric":35412},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":0,"pending_prefill_tokens":39189,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":17706,"score_linear":80149.0,"score_lmetric":170685}],"chosen_score_linear":113172.0,"chosen_score_lmetric":17706,"t_first_token":383763.037446442,"t_first_token_unix":1779814628.05139,"t_done":383764.515340691,"t_done_unix":1779814629.5292852},{"request_id":"1272085:1:1272085:125","session_id":"1272085","input_length":5302,"t_proxy_recv":383763.779266533,"t_decision_unix":1779814628.7932081,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":10604,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":5302,"score_linear":135235.0,"score_lmetric":237042},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":5302,"score_linear":102074.0,"score_lmetric":103792},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":5302,"score_linear":150574.0,"score_lmetric":246216},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18134,"ongoing_decode_tokens":18134,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":384,"cache_hit":0,"new_prefill":5302,"score_linear":18134.0,"score_lmetric":10604},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":5302,"score_linear":121069.0,"score_lmetric":197464},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":130878,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":5302,"score_linear":130878.0,"score_lmetric":10604},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64508,"ongoing_decode_tokens":28385,"pending_prefill_tokens":21787,"num_requests":3,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":5302,"score_linear":64508.0,"score_lmetric":81267},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80545,"ongoing_decode_tokens":80545,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":5302,"score_linear":80545.0,"score_lmetric":15906}],"chosen_score_linear":130878.0,"chosen_score_lmetric":10604,"t_first_token":383764.244042427,"t_first_token_unix":1779814629.257986,"t_done":383765.164639647,"t_done_unix":1779814630.1785834},{"request_id":"1268831:2:1271087:116","session_id":"1268831","input_length":19448,"t_proxy_recv":383760.470300934,"t_decision_unix":1779814625.4842424,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":12288,"affinity_cache_ratio":0.6318387494858083,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":7160,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":19448,"score_linear":135235.0,"score_lmetric":265334},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":19448,"score_linear":102074.0,"score_lmetric":117938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":19448,"score_linear":126924.0,"score_lmetric":127428},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":19448,"score_linear":15283.0,"score_lmetric":19448},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":19448,"score_linear":121069.0,"score_lmetric":225756},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":0,"pending_prefill_tokens":532,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":19448,"score_linear":113172.0,"score_lmetric":19980},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":86188,"ongoing_decode_tokens":57803,"pending_prefill_tokens":10465,"num_requests":2,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":19448,"score_linear":86188.0,"score_lmetric":59826},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":12288,"new_prefill":7160,"score_linear":48413.0,"score_lmetric":78378}],"chosen_score_linear":48413.0,"chosen_score_lmetric":78378,"t_first_token":383762.904020058,"t_first_token_unix":1779814627.9179635,"t_done":383765.771481782,"t_done_unix":1779814630.7854269},{"request_id":"1270340:2:1271641:121","session_id":"1270340","input_length":28323,"t_proxy_recv":383763.54068168,"t_decision_unix":1779814628.5546231,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9761677788369876,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28323,"score_linear":135235.0,"score_lmetric":283084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":28323,"score_linear":102074.0,"score_lmetric":126813},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28323,"score_linear":150574.0,"score_lmetric":292258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18134,"ongoing_decode_tokens":15283,"pending_prefill_tokens":2851,"num_requests":2,"active_p_offloads":0,"cached_blocks":384,"cache_hit":0,"new_prefill":28323,"score_linear":18134.0,"score_lmetric":62348},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":28323,"score_linear":121069.0,"score_lmetric":243506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":130878,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":28323,"score_linear":130878.0,"score_lmetric":56646},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64508,"ongoing_decode_tokens":28385,"pending_prefill_tokens":21787,"num_requests":3,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":28323,"score_linear":64508.0,"score_lmetric":150330},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":52222,"ongoing_decode_tokens":52222,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":300,"cache_hit":27648,"new_prefill":675,"score_linear":24574.0,"score_lmetric":1350}],"chosen_score_linear":24574.0,"chosen_score_lmetric":1350,"t_first_token":383763.713679147,"t_first_token_unix":1779814628.727623,"t_done":383766.583752152,"t_done_unix":1779814631.5976958},{"request_id":"1271486:1:1271486:119","session_id":"1271486","input_length":21719,"t_proxy_recv":383761.713457697,"t_decision_unix":1779814626.7273989,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":21719,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21719,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21719,"score_linear":135235.0,"score_lmetric":269876},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":21719,"score_linear":102074.0,"score_lmetric":120209},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21719,"score_linear":126924.0,"score_lmetric":129699},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16034,"ongoing_decode_tokens":15283,"pending_prefill_tokens":751,"num_requests":2,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":21719,"score_linear":16034.0,"score_lmetric":44940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":21719,"score_linear":121069.0,"score_lmetric":230298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":21719,"score_linear":130878.0,"score_lmetric":78850},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28385,"ongoing_decode_tokens":28385,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":21719,"score_linear":28385.0,"score_lmetric":21719},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":0,"pending_prefill_tokens":39189,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":21719,"score_linear":80149.0,"score_lmetric":182724}],"chosen_score_linear":28385.0,"chosen_score_lmetric":21719,"t_first_token":383764.078728008,"t_first_token_unix":1779814629.0926712,"t_done":383767.179459709,"t_done_unix":1779814632.1934032},{"request_id":"1266668:2:1270661:115","session_id":"1266668","input_length":28385,"t_proxy_recv":383758.840896566,"t_decision_unix":1779814623.8548374,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":17920,"affinity_cache_ratio":0.6313193588162762,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":10465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":24289,"score_linear":131139.0,"score_lmetric":275016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":28385,"score_linear":102074.0,"score_lmetric":126875},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28385,"score_linear":126924.0,"score_lmetric":136365},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26411,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11128,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28385,"score_linear":26411.0,"score_lmetric":79026},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":28385,"score_linear":121069.0,"score_lmetric":243630},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28385,"score_linear":125063.0,"score_lmetric":291536},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":390,"cache_hit":17920,"new_prefill":10465,"score_linear":39883.0,"score_lmetric":17580},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":28385,"score_linear":60701.0,"score_lmetric":120828}],"chosen_score_linear":39883.0,"chosen_score_lmetric":17580,"t_first_token":383761.006906602,"t_first_token_unix":1779814626.0208504,"t_done":383767.475238887,"t_done_unix":1779814632.4891822},{"request_id":"1262727:1:1262727:72","session_id":"1262727","input_length":15283,"t_proxy_recv":383731.269924403,"t_decision_unix":1779814596.283866,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":15283,"score_linear":55989.0,"score_lmetric":16488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":15283,"score_linear":68131.0,"score_lmetric":83414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":15283,"score_linear":113053.0,"score_lmetric":215712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":15283,"score_linear":125063.0,"score_lmetric":265332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":15283,"score_linear":21510.0,"score_lmetric":36793}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383732.67734115,"t_first_token_unix":1779814597.691285,"t_done":383768.026544315,"t_done_unix":1779814633.0404878},{"request_id":"1272313:1:1272313:126","session_id":"1272313","input_length":9718,"t_proxy_recv":383764.691186623,"t_decision_unix":1779814629.705128,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":6114,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2038,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":5622,"score_linear":131139.0,"score_lmetric":237682},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":9718,"score_linear":102074.0,"score_lmetric":108208},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9718,"score_linear":150574.0,"score_lmetric":255048},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":9718,"score_linear":15283.0,"score_lmetric":9718},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":9718,"score_linear":121069.0,"score_lmetric":206296},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":118474,"ongoing_decode_tokens":118474,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":299,"cache_hit":0,"new_prefill":9718,"score_linear":118474.0,"score_lmetric":19436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64508,"ongoing_decode_tokens":64508,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":403,"cache_hit":7680,"new_prefill":2038,"score_linear":56828.0,"score_lmetric":6114},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80545,"ongoing_decode_tokens":80545,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":9718,"score_linear":80545.0,"score_lmetric":29154}],"chosen_score_linear":56828.0,"chosen_score_lmetric":6114,"t_first_token":383764.938210758,"t_first_token_unix":1779814629.9521544,"t_done":383770.72206451,"t_done_unix":1779814635.7360082},{"request_id":"1269373:2:1271580:120","session_id":"1269373","input_length":14404,"t_proxy_recv":383762.027681084,"t_decision_unix":1779814627.0416222,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.995279089141905,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":68,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":10308,"score_linear":131139.0,"score_lmetric":247054},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":14404,"score_linear":102074.0,"score_lmetric":112894},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14404,"score_linear":126924.0,"score_lmetric":122384},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16034,"ongoing_decode_tokens":16034,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":14404,"score_linear":16034.0,"score_lmetric":28808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":14404,"score_linear":121069.0,"score_lmetric":215668},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":14404,"score_linear":130878.0,"score_lmetric":64220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50104,"ongoing_decode_tokens":28385,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":403,"cache_hit":14336,"new_prefill":68,"score_linear":35768.0,"score_lmetric":43574},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":60701,"pending_prefill_tokens":7160,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":14404,"score_linear":80149.0,"score_lmetric":64692}],"chosen_score_linear":35768.0,"chosen_score_lmetric":43574,"t_first_token":383764.080647786,"t_first_token_unix":1779814629.0945911,"t_done":383770.861305414,"t_done_unix":1779814635.875249},{"request_id":"1260327:3:1273741:132","session_id":"1260327","input_length":31283,"t_proxy_recv":383769.813234888,"t_decision_unix":1779814634.827176,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9820030048269028,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":563,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":31283,"score_linear":135235.0,"score_lmetric":289004},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":31283,"score_linear":120167.0,"score_lmetric":275252},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31283,"score_linear":150574.0,"score_lmetric":298178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":31283,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":31283,"score_linear":121069.0,"score_lmetric":249426},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":146297,"ongoing_decode_tokens":121189,"pending_prefill_tokens":7700,"num_requests":3,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":31283,"score_linear":146297.0,"score_lmetric":116949},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57833,"ongoing_decode_tokens":57833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":31283,"score_linear":57833.0,"score_lmetric":93849},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54737,"ongoing_decode_tokens":32774,"pending_prefill_tokens":21963,"num_requests":2,"active_p_offloads":0,"cached_blocks":315,"cache_hit":30720,"new_prefill":563,"score_linear":24017.0,"score_lmetric":45052}],"chosen_score_linear":24017.0,"chosen_score_lmetric":45052,"t_first_token":383770.295177287,"t_first_token_unix":1779814635.3091216,"t_done":383771.417710489,"t_done_unix":1779814636.4316547},{"request_id":"1272085:2:1273645:130","session_id":"1272085","input_length":8017,"t_proxy_recv":383769.41253822,"t_decision_unix":1779814634.4264793,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.6386428838717725,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":2897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":8017,"score_linear":135235.0,"score_lmetric":242472},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":8017,"score_linear":120167.0,"score_lmetric":228720},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8017,"score_linear":150574.0,"score_lmetric":251646},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":8017,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":8017,"score_linear":121069.0,"score_lmetric":202894},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":309,"cache_hit":5120,"new_prefill":2897,"score_linear":108052.0,"score_lmetric":2897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57833,"ongoing_decode_tokens":57833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":8017,"score_linear":57833.0,"score_lmetric":24051},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54737,"ongoing_decode_tokens":32774,"pending_prefill_tokens":21963,"num_requests":2,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":8017,"score_linear":54737.0,"score_lmetric":59960}],"chosen_score_linear":108052.0,"chosen_score_lmetric":2897,"t_first_token":383769.790762118,"t_first_token_unix":1779814634.8047059,"t_done":383771.962275641,"t_done_unix":1779814636.976219},{"request_id":"1266668:3:1273119:128","session_id":"1266668","input_length":33711,"t_proxy_recv":383767.484333759,"t_decision_unix":1779814632.498275,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28672,"affinity_cache_ratio":0.850523567974845,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":5039,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":29615,"score_linear":131139.0,"score_lmetric":285668},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":33711,"score_linear":120167.0,"score_lmetric":280108},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33711,"score_linear":150574.0,"score_lmetric":303034},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":33711,"score_linear":15283.0,"score_lmetric":33711},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":33711,"score_linear":121069.0,"score_lmetric":254282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":33711,"score_linear":113172.0,"score_lmetric":33711},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24122,"ongoing_decode_tokens":24122,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":466,"cache_hit":28672,"new_prefill":5039,"score_linear":-4550.0,"score_lmetric":10078},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32774,"ongoing_decode_tokens":32774,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":33711,"score_linear":32774.0,"score_lmetric":33711}],"chosen_score_linear":-4550.0,"chosen_score_lmetric":10078,"t_first_token":383768.627063075,"t_first_token_unix":1779814633.641007,"t_done":383771.99646601,"t_done_unix":1779814637.0104094},{"request_id":"1258859:2:1264639:81","session_id":"1258859","input_length":113172,"t_proxy_recv":383760.430370927,"t_decision_unix":1779814625.4443126,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":112640,"affinity_cache_ratio":0.995299190612519,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":113172,"score_linear":135235.0,"score_lmetric":452782},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":113172,"score_linear":102074.0,"score_lmetric":211662},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":113172,"score_linear":126924.0,"score_lmetric":221152},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":113172,"score_linear":15283.0,"score_lmetric":113172},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":113172,"score_linear":121069.0,"score_lmetric":413204},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":265,"cache_hit":112640,"new_prefill":532,"score_linear":-112640.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":86188,"ongoing_decode_tokens":57803,"pending_prefill_tokens":10465,"num_requests":2,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":113172,"score_linear":86188.0,"score_lmetric":247274},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":113172,"score_linear":60701.0,"score_lmetric":290402}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":383760.779216493,"t_first_token_unix":1779814625.79316,"t_done":383772.520635113,"t_done_unix":1779814637.5345795},{"request_id":"1262354:6:1270643:114","session_id":"1262354","input_length":32774,"t_proxy_recv":383758.763259877,"t_decision_unix":1779814623.7772012,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28672,"affinity_cache_ratio":0.8748398120461341,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":4102,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":32774,"score_linear":135235.0,"score_lmetric":291986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":32774,"score_linear":102074.0,"score_lmetric":131264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32774,"score_linear":126924.0,"score_lmetric":140754},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26411,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11128,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32774,"score_linear":26411.0,"score_lmetric":87804},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":32774,"score_linear":121069.0,"score_lmetric":252408},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":32774,"score_linear":125063.0,"score_lmetric":300314},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":32774,"score_linear":57803.0,"score_lmetric":39889},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":28672,"new_prefill":4102,"score_linear":-745.0,"score_lmetric":32029}],"chosen_score_linear":-745.0,"chosen_score_lmetric":32029,"t_first_token":383762.015340471,"t_first_token_unix":1779814627.0292838,"t_done":383772.648897885,"t_done_unix":1779814637.6628413},{"request_id":"1274405:1:1274405:134","session_id":"1274405","input_length":6208,"t_proxy_recv":383772.209861524,"t_decision_unix":1779814637.2238028,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6208,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":6208,"score_linear":135235.0,"score_lmetric":238854},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":6208,"score_linear":120167.0,"score_lmetric":225102},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":6208,"score_linear":150574.0,"score_lmetric":248028},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":6208,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":6208,"score_linear":121069.0,"score_lmetric":199276},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138280,"ongoing_decode_tokens":138280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":314,"cache_hit":0,"new_prefill":6208,"score_linear":138280.0,"score_lmetric":12416},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":6208,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54737,"ongoing_decode_tokens":54737,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":316,"cache_hit":0,"new_prefill":6208,"score_linear":54737.0,"score_lmetric":12416}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383772.617401802,"t_first_token_unix":1779814637.6313455,"t_done":383773.08407434,"t_done_unix":1779814638.09802},{"request_id":"1273203:1:1273203:129","session_id":"1273203","input_length":21963,"t_proxy_recv":383767.770025801,"t_decision_unix":1779814632.7839668,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":21963,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21963,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21963,"score_linear":135235.0,"score_lmetric":270364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":21963,"score_linear":120167.0,"score_lmetric":256612},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21963,"score_linear":150574.0,"score_lmetric":279538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":21963,"score_linear":15283.0,"score_lmetric":21963},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":21963,"score_linear":121069.0,"score_lmetric":230786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":21963,"score_linear":113172.0,"score_lmetric":21963},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57833,"ongoing_decode_tokens":24122,"pending_prefill_tokens":5039,"num_requests":3,"active_p_offloads":0,"cached_blocks":466,"cache_hit":12800,"new_prefill":9163,"score_linear":45033.0,"score_lmetric":42606},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32774,"ongoing_decode_tokens":32774,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":21963,"score_linear":32774.0,"score_lmetric":21963}],"chosen_score_linear":32774.0,"chosen_score_lmetric":21963,"t_first_token":383770.140956555,"t_first_token_unix":1779814635.1549008,"t_done":383774.539982271,"t_done_unix":1779814639.5539274},{"request_id":"1271328:2:1273711:131","session_id":"1271328","input_length":25108,"t_proxy_recv":383769.67532509,"t_decision_unix":1779814634.6892664,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":17408,"affinity_cache_ratio":0.6933248367054325,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":7700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":25108,"score_linear":135235.0,"score_lmetric":276654},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":25108,"score_linear":120167.0,"score_lmetric":262902},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":25108,"score_linear":150574.0,"score_lmetric":285828},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":25108,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":25108,"score_linear":121069.0,"score_lmetric":237076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":121189,"ongoing_decode_tokens":113172,"pending_prefill_tokens":2897,"num_requests":2,"active_p_offloads":0,"cached_blocks":309,"cache_hit":17408,"new_prefill":7700,"score_linear":103781.0,"score_lmetric":21194},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57833,"ongoing_decode_tokens":57833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":25108,"score_linear":57833.0,"score_lmetric":75324},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54737,"ongoing_decode_tokens":32774,"pending_prefill_tokens":21963,"num_requests":2,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":25108,"score_linear":54737.0,"score_lmetric":94142}],"chosen_score_linear":103781.0,"chosen_score_lmetric":21194,"t_first_token":383771.022515681,"t_first_token_unix":1779814636.0364592,"t_done":383774.637220072,"t_done_unix":1779814639.6511633},{"request_id":"1274890:1:1274890:135","session_id":"1274890","input_length":10506,"t_proxy_recv":383773.736718118,"t_decision_unix":1779814638.7506592,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10506,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":10506,"score_linear":135235.0,"score_lmetric":247450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":10506,"score_linear":120167.0,"score_lmetric":233698},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10506,"score_linear":150574.0,"score_lmetric":256624},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":10506,"score_linear":121069.0,"score_lmetric":207872},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":25108,"ongoing_decode_tokens":25108,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":316,"cache_hit":0,"new_prefill":10506,"score_linear":25108.0,"score_lmetric":10506},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":21963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":325,"cache_hit":0,"new_prefill":10506,"score_linear":21963.0,"score_lmetric":10506}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383774.557399092,"t_first_token_unix":1779814639.5713427,"t_done":383774.805764316,"t_done_unix":1779814639.8197079},{"request_id":"1275433:1:1275433:137","session_id":"1275433","input_length":7794,"t_proxy_recv":383775.486187843,"t_decision_unix":1779814640.5001292,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7794,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":7794,"score_linear":135235.0,"score_lmetric":242026},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":7794,"score_linear":120167.0,"score_lmetric":228274},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":7794,"score_linear":150574.0,"score_lmetric":251200},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":444,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":7794,"score_linear":121069.0,"score_lmetric":202448},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":7794,"score_linear":114612.0,"score_lmetric":122406}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383776.024408524,"t_first_token_unix":1779814641.0383518,"t_done":383776.075622522,"t_done_unix":1779814641.0895662},{"request_id":"1275433:2:1276027:139","session_id":"1275433","input_length":7463,"t_proxy_recv":383777.757584947,"t_decision_unix":1779814642.7715263,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7168,"affinity_cache_ratio":0.960471660190272,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":295,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":7463,"score_linear":135235.0,"score_lmetric":241364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":7463,"score_linear":120167.0,"score_lmetric":227612},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":7463,"score_linear":150574.0,"score_lmetric":250538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":459,"cache_hit":7168,"new_prefill":295,"score_linear":-7168.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":7463,"score_linear":121069.0,"score_lmetric":201786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":7463,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":7463,"score_linear":10639.0,"score_lmetric":7463},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":7463,"score_linear":114612.0,"score_lmetric":122075}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":383777.783469143,"t_first_token_unix":1779814642.7974129,"t_done":383777.7926725,"t_done_unix":1779814642.8066156},{"request_id":"1272313:2:1275926:138","session_id":"1272313","input_length":10639,"t_proxy_recv":383777.427350155,"t_decision_unix":1779814642.4412913,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.914371651471003,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":6543,"score_linear":131139.0,"score_lmetric":239524},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":10639,"score_linear":120167.0,"score_lmetric":233964},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10639,"score_linear":150574.0,"score_lmetric":256890},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":459,"cache_hit":0,"new_prefill":10639,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":10639,"score_linear":121069.0,"score_lmetric":208138},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":10639,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":9728,"new_prefill":911,"score_linear":-9728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":10639,"score_linear":114612.0,"score_lmetric":125251}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":383777.579087498,"t_first_token_unix":1779814642.5930314,"t_done":383778.844642068,"t_done_unix":1779814643.8585863},{"request_id":"1264679:1:1264679:82","session_id":"1264679","input_length":110048,"t_proxy_recv":383738.39289295,"t_decision_unix":1779814603.4068341,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":110048,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":110048,"score_linear":55989.0,"score_lmetric":110048},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":110048,"score_linear":71575.0,"score_lmetric":332680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":110048,"score_linear":113053.0,"score_lmetric":405242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":110048,"score_linear":125063.0,"score_lmetric":454862},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":110048,"score_linear":50783.0,"score_lmetric":160831},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383778.143826031,"t_first_token_unix":1779814643.15777,"t_done":383779.156843203,"t_done_unix":1779814644.1707876},{"request_id":"1276111:1:1276111:140","session_id":"1276111","input_length":15783,"t_proxy_recv":383778.112285345,"t_decision_unix":1779814643.1262264,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":15783,"score_linear":135235.0,"score_lmetric":258004},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":15783,"score_linear":120167.0,"score_lmetric":244252},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":15783,"score_linear":150574.0,"score_lmetric":267178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":459,"cache_hit":0,"new_prefill":15783,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":15783,"score_linear":121069.0,"score_lmetric":218426},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":15783,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":15783,"score_linear":10639.0,"score_lmetric":15783},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":15783,"score_linear":114612.0,"score_lmetric":130395}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383779.544362375,"t_first_token_unix":1779814644.558306,"t_done":383779.728154448,"t_done_unix":1779814644.7420976},{"request_id":"1276136:1:1276136:141","session_id":"1276136","input_length":17280,"t_proxy_recv":383778.190043914,"t_decision_unix":1779814643.2039855,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":17280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":135235,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":17280,"score_linear":135235.0,"score_lmetric":34560},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":17280,"score_linear":120167.0,"score_lmetric":247246},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17280,"score_linear":150574.0,"score_lmetric":270172},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":459,"cache_hit":0,"new_prefill":17280,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":17280,"score_linear":121069.0,"score_lmetric":221420},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":17280,"score_linear":15783.0,"score_lmetric":33063},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":17280,"score_linear":10639.0,"score_lmetric":17280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":17280,"score_linear":114612.0,"score_lmetric":131892}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383779.840666261,"t_first_token_unix":1779814644.85461,"t_done":383780.214914544,"t_done_unix":1779814645.2288578},{"request_id":"1271991:2:1276999:145","session_id":"1271991","input_length":11292,"t_proxy_recv":383781.207997873,"t_decision_unix":1779814646.2219388,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":2560,"affinity_cache_ratio":0.2267091746369111,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":8732,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":11292,"score_linear":25187.0,"score_lmetric":11292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":11292,"score_linear":120167.0,"score_lmetric":235270},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11292,"score_linear":150574.0,"score_lmetric":258196},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":492,"cache_hit":2560,"new_prefill":8732,"score_linear":-2560.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":11292,"score_linear":121069.0,"score_lmetric":209444},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":11292,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64444,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15804,"num_requests":3,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":11292,"score_linear":64444.0,"score_lmetric":81288},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":11292,"score_linear":114612.0,"score_lmetric":125904}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":383781.957139452,"t_first_token_unix":1779814646.971083,"t_done":383782.115180357,"t_done_unix":1779814647.1291242},{"request_id":"1277533:1:1277533:150","session_id":"1277533","input_length":4729,"t_proxy_recv":383783.239115614,"t_decision_unix":1779814648.2530568,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":4729,"score_linear":25187.0,"score_lmetric":4729},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":4729,"score_linear":120167.0,"score_lmetric":222144},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":4729,"score_linear":150574.0,"score_lmetric":245070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":0,"pending_prefill_tokens":9813,"num_requests":1,"active_p_offloads":0,"cached_blocks":509,"cache_hit":0,"new_prefill":4729,"score_linear":27221.0,"score_lmetric":14542},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":4729,"score_linear":121069.0,"score_lmetric":196318},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":4729,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":81344,"ongoing_decode_tokens":8704,"pending_prefill_tokens":17856,"num_requests":4,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":4729,"score_linear":81344.0,"score_lmetric":90340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179981,"ongoing_decode_tokens":0,"pending_prefill_tokens":127245,"num_requests":3,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":4729,"score_linear":179981.0,"score_lmetric":395922}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383783.538358438,"t_first_token_unix":1779814648.552302,"t_done":383783.678835789,"t_done_unix":1779814648.6927793},{"request_id":"1274405:2:1276717:144","session_id":"1274405","input_length":6360,"t_proxy_recv":383780.221413501,"t_decision_unix":1779814645.235355,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":6144,"affinity_cache_ratio":0.9660377358490566,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":6360,"score_linear":25187.0,"score_lmetric":6360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":6360,"score_linear":120167.0,"score_lmetric":225406},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":6360,"score_linear":150574.0,"score_lmetric":248332},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":492,"cache_hit":0,"new_prefill":6360,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":6360,"score_linear":121069.0,"score_lmetric":199580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":6360,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58084,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15588,"num_requests":2,"active_p_offloads":0,"cached_blocks":495,"cache_hit":6144,"new_prefill":216,"score_linear":51940.0,"score_lmetric":31608},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":6360,"score_linear":114612.0,"score_lmetric":120972}],"chosen_score_linear":51940.0,"chosen_score_lmetric":31608,"t_first_token":383784.424675642,"t_first_token_unix":1779814649.4386191,"t_done":383785.019138803,"t_done_unix":1779814650.0330837},{"request_id":"1276498:1:1276498:142","session_id":"1276498","input_length":8704,"t_proxy_recv":383779.439046814,"t_decision_unix":1779814644.4529877,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8704,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":8704,"score_linear":25187.0,"score_lmetric":8704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":8704,"score_linear":120167.0,"score_lmetric":230094},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8704,"score_linear":150574.0,"score_lmetric":253020},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":17280,"ongoing_decode_tokens":0,"pending_prefill_tokens":17280,"num_requests":1,"active_p_offloads":0,"cached_blocks":459,"cache_hit":0,"new_prefill":8704,"score_linear":17280.0,"score_lmetric":25984},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":8704,"score_linear":121069.0,"score_lmetric":204268},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":8704,"score_linear":15783.0,"score_lmetric":24487},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":8704,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":8704,"score_linear":114612.0,"score_lmetric":123316}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383780.079414769,"t_first_token_unix":1779814645.0933583,"t_done":383785.160920369,"t_done_unix":1779814650.1748638},{"request_id":"1277428:1:1277428:149","session_id":"1277428","input_length":27221,"t_proxy_recv":383782.810856691,"t_decision_unix":1779814647.8247974,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":9813,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":27221,"score_linear":25187.0,"score_lmetric":27221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":3584,"new_prefill":23637,"score_linear":116583.0,"score_lmetric":259960},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27221,"score_linear":150574.0,"score_lmetric":290054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":509,"cache_hit":17408,"new_prefill":9813,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":27221,"score_linear":121069.0,"score_lmetric":241302},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":27221,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":81344,"ongoing_decode_tokens":8704,"pending_prefill_tokens":17856,"num_requests":4,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":27221,"score_linear":81344.0,"score_lmetric":180308},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179981,"ongoing_decode_tokens":0,"pending_prefill_tokens":127245,"num_requests":3,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":27221,"score_linear":179981.0,"score_lmetric":463398}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":383784.596158763,"t_first_token_unix":1779814649.610102,"t_done":383785.200832531,"t_done_unix":1779814650.2147768},{"request_id":"1271459:2:1277544:151","session_id":"1271459","input_length":8884,"t_proxy_recv":383783.275926848,"t_decision_unix":1779814648.2898684,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":0,"affinity_cache_hit":512,"affinity_cache_ratio":0.05763169743358847,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":8884,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8884,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":8884,"score_linear":25187.0,"score_lmetric":8884},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":8884,"score_linear":120167.0,"score_lmetric":230454},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8884,"score_linear":150574.0,"score_lmetric":253380},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":0,"pending_prefill_tokens":9813,"num_requests":1,"active_p_offloads":0,"cached_blocks":509,"cache_hit":512,"new_prefill":8372,"score_linear":26709.0,"score_lmetric":18185},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":8884,"score_linear":121069.0,"score_lmetric":204628},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4729,"ongoing_decode_tokens":0,"pending_prefill_tokens":4729,"num_requests":1,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":8884,"score_linear":4729.0,"score_lmetric":13613},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":81344,"ongoing_decode_tokens":8704,"pending_prefill_tokens":17856,"num_requests":4,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":8884,"score_linear":81344.0,"score_lmetric":106960},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179981,"ongoing_decode_tokens":0,"pending_prefill_tokens":127245,"num_requests":3,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":8884,"score_linear":179981.0,"score_lmetric":408387}],"chosen_score_linear":25187.0,"chosen_score_lmetric":8884,"t_first_token":383783.959029725,"t_first_token_unix":1779814648.972973,"t_done":383787.320178962,"t_done_unix":1779814652.3341227},{"request_id":"1265942:3:1272453:127","session_id":"1265942","input_length":18093,"t_proxy_recv":383765.243323383,"t_decision_unix":1779814630.2572644,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10240,"affinity_cache_ratio":0.5659647377438789,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":7853,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":18093,"score_linear":135235.0,"score_lmetric":262624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":10240,"new_prefill":7853,"score_linear":91834.0,"score_lmetric":106343},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18093,"score_linear":150574.0,"score_lmetric":271798},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":18093,"score_linear":15283.0,"score_lmetric":18093},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":18093,"score_linear":121069.0,"score_lmetric":223046},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":18093,"score_linear":113172.0,"score_lmetric":18093},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":74226,"ongoing_decode_tokens":74226,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":18093,"score_linear":74226.0,"score_lmetric":72372},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80545,"ongoing_decode_tokens":80545,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":18093,"score_linear":80545.0,"score_lmetric":54279}],"chosen_score_linear":91834.0,"chosen_score_lmetric":106343,"t_first_token":383786.845051437,"t_first_token_unix":1779814651.8589947,"t_done":383787.926187035,"t_done_unix":1779814652.9401305},{"request_id":"1265942:4:1274182:133","session_id":"1265942","input_length":21229,"t_proxy_recv":383787.939683975,"t_decision_unix":1779814652.9536254,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":17920,"affinity_cache_ratio":0.8441283150407461,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":3309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":21229,"score_linear":25187.0,"score_lmetric":21229},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":160826,"ongoing_decode_tokens":160826,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":300,"cache_hit":17920,"new_prefill":3309,"score_linear":142906.0,"score_lmetric":6618},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21229,"score_linear":150574.0,"score_lmetric":278070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":21229,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":121069,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":21229,"score_linear":121069.0,"score_lmetric":42458},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":24222,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":21229,"score_linear":142319.0,"score_lmetric":51324},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":512,"cache_hit":0,"new_prefill":21229,"score_linear":66280.0,"score_lmetric":42458},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":21229,"score_linear":233984.0,"score_lmetric":746145}],"chosen_score_linear":142906.0,"chosen_score_lmetric":6618,"t_first_token":383788.502140917,"t_first_token_unix":1779814653.5160844,"t_done":383789.75478019,"t_done_unix":1779814654.768724},{"request_id":"1270606:1:1270606:113","session_id":"1270606","input_length":93430,"t_proxy_recv":383758.666038014,"t_decision_unix":1779814623.679979,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":93430,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":93430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":93430,"score_linear":135235.0,"score_lmetric":413298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":93430,"score_linear":102074.0,"score_lmetric":191920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":93430,"score_linear":126924.0,"score_lmetric":201410},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26411,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11128,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":93430,"score_linear":26411.0,"score_lmetric":209116},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":93430,"score_linear":27639.0,"score_lmetric":93430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":93430,"score_linear":125063.0,"score_lmetric":421626},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":390,"cache_hit":0,"new_prefill":93430,"score_linear":57803.0,"score_lmetric":100545},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":93430,"score_linear":27927.0,"score_lmetric":121357}],"chosen_score_linear":27639.0,"chosen_score_lmetric":93430,"t_first_token":383787.734799802,"t_first_token_unix":1779814652.7487493,"t_done":383789.773324403,"t_done_unix":1779814654.7872682},{"request_id":"1276498:2:1278996:157","session_id":"1276498","input_length":16650,"t_proxy_recv":383788.392581222,"t_decision_unix":1779814653.4065223,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":8704,"affinity_cache_ratio":0.5227627627627628,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":7946,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":16650,"score_linear":25187.0,"score_lmetric":16650},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":182055,"ongoing_decode_tokens":160826,"pending_prefill_tokens":3309,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":16650,"score_linear":182055.0,"score_lmetric":59877},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":16650,"score_linear":150574.0,"score_lmetric":268912},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":16650,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":121069,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":16650,"score_linear":121069.0,"score_lmetric":33300},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":24222,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":16650,"score_linear":142319.0,"score_lmetric":42166},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":512,"cache_hit":8704,"new_prefill":7946,"score_linear":57576.0,"score_lmetric":15892},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":16650,"score_linear":233984.0,"score_lmetric":723250}],"chosen_score_linear":57576.0,"chosen_score_lmetric":15892,"t_first_token":383789.353468111,"t_first_token_unix":1779814654.3674119,"t_done":383789.937964074,"t_done_unix":1779814654.9519098},{"request_id":"1268630:1:1268630:98","session_id":"1268630","input_length":102074,"t_proxy_recv":383752.014820532,"t_decision_unix":1779814617.028762,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":98490,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":102074,"score_linear":135235.0,"score_lmetric":430586},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":285,"cache_hit":3584,"new_prefill":98490,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":102074,"score_linear":126924.0,"score_lmetric":210054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":4608,"new_prefill":97466,"score_linear":10675.0,"score_lmetric":97466},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":102074,"score_linear":27639.0,"score_lmetric":102074},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":102074,"score_linear":125063.0,"score_lmetric":438914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":102074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2298,"ongoing_decode_tokens":0,"pending_prefill_tokens":2298,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":102074,"score_linear":2298.0,"score_lmetric":104372}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":383786.844253638,"t_first_token_unix":1779814651.858198,"t_done":383790.087742665,"t_done_unix":1779814655.1016862},{"request_id":"1266668:4:1276519:143","session_id":"1266668","input_length":49380,"t_proxy_recv":383779.499015544,"t_decision_unix":1779814644.5129566,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":33792,"affinity_cache_ratio":0.684325637910085,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":15588,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":45284,"score_linear":21091.0,"score_lmetric":45284},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":49380,"score_linear":120167.0,"score_lmetric":311446},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":49380,"score_linear":150574.0,"score_lmetric":334372},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":17280,"ongoing_decode_tokens":0,"pending_prefill_tokens":17280,"num_requests":1,"active_p_offloads":0,"cached_blocks":459,"cache_hit":0,"new_prefill":49380,"score_linear":17280.0,"score_lmetric":66660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":49380,"score_linear":121069.0,"score_lmetric":285620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":49380,"score_linear":15783.0,"score_lmetric":65163},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":8704,"ongoing_decode_tokens":0,"pending_prefill_tokens":8704,"num_requests":1,"active_p_offloads":0,"cached_blocks":495,"cache_hit":33792,"new_prefill":15588,"score_linear":-25088.0,"score_lmetric":24292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":49380,"score_linear":114612.0,"score_lmetric":163992}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":24292,"t_first_token":383784.383523521,"t_first_token_unix":1779814649.397467,"t_done":383791.004054839,"t_done_unix":1779814656.018004},{"request_id":"1269373:3:1277365:148","session_id":"1269373","input_length":16900,"t_proxy_recv":383782.529870663,"t_decision_unix":1779814647.5438116,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14848,"affinity_cache_ratio":0.8785798816568048,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":2052,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":12804,"score_linear":21091.0,"score_lmetric":12804},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":16900,"score_linear":120167.0,"score_lmetric":246486},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":16900,"score_linear":150574.0,"score_lmetric":269412},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":509,"cache_hit":0,"new_prefill":16900,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":16900,"score_linear":121069.0,"score_lmetric":220660},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":16900,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64444,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15804,"num_requests":3,"active_p_offloads":0,"cached_blocks":495,"cache_hit":14848,"new_prefill":2052,"score_linear":49596.0,"score_lmetric":53568},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179981,"ongoing_decode_tokens":0,"pending_prefill_tokens":127245,"num_requests":3,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":16900,"score_linear":179981.0,"score_lmetric":432435}],"chosen_score_linear":49596.0,"chosen_score_lmetric":53568,"t_first_token":383784.69774868,"t_first_token_unix":1779814649.711692,"t_done":383791.549262312,"t_done_unix":1779814656.5632064},{"request_id":"1272313:3:1279208:159","session_id":"1272313","input_length":11549,"t_proxy_recv":383789.06091924,"t_decision_unix":1779814654.0748606,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9309896960775825,"affinity_num_requests":3,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":797,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":7453,"score_linear":21091.0,"score_lmetric":7453},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":182055,"ongoing_decode_tokens":182055,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":11549,"score_linear":182055.0,"score_lmetric":34647},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11549,"score_linear":150574.0,"score_lmetric":258710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":11549,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":121069,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":11549,"score_linear":121069.0,"score_lmetric":23098},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":24222,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":11549,"score_linear":142319.0,"score_lmetric":31964},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82930,"ongoing_decode_tokens":66280,"pending_prefill_tokens":7946,"num_requests":3,"active_p_offloads":0,"cached_blocks":512,"cache_hit":10752,"new_prefill":797,"score_linear":72178.0,"score_lmetric":26229},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":11549,"score_linear":233984.0,"score_lmetric":697745}],"chosen_score_linear":72178.0,"chosen_score_lmetric":26229,"t_first_token":383789.497326449,"t_first_token_unix":1779814654.51127,"t_done":383791.55368055,"t_done_unix":1779814656.5676239},{"request_id":"1253804:5:1278488:156","session_id":"1253804","input_length":58752,"t_proxy_recv":383786.543867972,"t_decision_unix":1779814651.5578086,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9760348583877996,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":1408,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":58752,"score_linear":34071.0,"score_lmetric":117504},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":57344,"new_prefill":1408,"score_linear":62823.0,"score_lmetric":215502},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":58752,"score_linear":150574.0,"score_lmetric":353116},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":528,"cache_hit":3584,"new_prefill":55168,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":58752,"score_linear":121069.0,"score_lmetric":304364},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":0,"pending_prefill_tokens":28655,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":58752,"score_linear":142319.0,"score_lmetric":174814},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":512,"cache_hit":0,"new_prefill":58752,"score_linear":66280.0,"score_lmetric":117504},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":58752,"score_linear":233984.0,"score_lmetric":933760}],"chosen_score_linear":62823.0,"chosen_score_lmetric":215502,"t_first_token":383787.309143449,"t_first_token_unix":1779814652.3230875,"t_done":383793.020651211,"t_done_unix":1779814658.034595},{"request_id":"1276136:2:1280145:162","session_id":"1276136","input_length":24519,"t_proxy_recv":383792.170406192,"t_decision_unix":1779814657.1843472,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":16896,"affinity_cache_ratio":0.6890982503364738,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":7623,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":24519,"score_linear":25187.0,"score_lmetric":24519},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":498,"cache_hit":0,"new_prefill":24519,"score_linear":58752.0,"score_lmetric":24519},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24519,"score_linear":150574.0,"score_lmetric":284650},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20136,"ongoing_decode_tokens":20136,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":528,"cache_hit":16896,"new_prefill":7623,"score_linear":3240.0,"score_lmetric":7623},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":24519,"score_linear":27639.0,"score_lmetric":24519},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":24519,"score_linear":142319.0,"score_lmetric":49038},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":24519,"score_linear":88317.0,"score_lmetric":112836},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":24519,"score_linear":233984.0,"score_lmetric":762595}],"chosen_score_linear":3240.0,"chosen_score_lmetric":7623,"t_first_token":383793.378546849,"t_first_token_unix":1779814658.3924904,"t_done":383793.649520742,"t_done_unix":1779814658.6634648},{"request_id":"1279412:1:1279412:160","session_id":"1279412","input_length":20136,"t_proxy_recv":383789.859754701,"t_decision_unix":1779814654.8736963,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":20136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":20136,"score_linear":25187.0,"score_lmetric":20136},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":160826,"ongoing_decode_tokens":160826,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":20136,"score_linear":160826.0,"score_lmetric":40272},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":20136,"score_linear":150574.0,"score_lmetric":275884},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":20136,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":20136,"score_linear":27639.0,"score_lmetric":20136},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":24222,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":20136,"score_linear":142319.0,"score_lmetric":49138},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94479,"ongoing_decode_tokens":94479,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":512,"cache_hit":0,"new_prefill":20136,"score_linear":94479.0,"score_lmetric":80544},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":12800,"new_prefill":7336,"score_linear":221184.0,"score_lmetric":676680}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383791.954429285,"t_first_token_unix":1779814656.968373,"t_done":383794.5994659,"t_done_unix":1779814659.6134098},{"request_id":"1268861:2:1280530:164","session_id":"1268861","input_length":12765,"t_proxy_recv":383793.389619198,"t_decision_unix":1779814658.4035604,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":12288,"affinity_cache_ratio":0.9626321974148061,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":12765,"score_linear":25187.0,"score_lmetric":12765},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":12765,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12765,"score_linear":150574.0,"score_lmetric":261142},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":44655,"ongoing_decode_tokens":44655,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":12765,"score_linear":44655.0,"score_lmetric":25530},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":12288,"new_prefill":477,"score_linear":15351.0,"score_lmetric":477},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":12765,"score_linear":142319.0,"score_lmetric":25530},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":12765,"score_linear":88317.0,"score_lmetric":101082},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":12765,"score_linear":233984.0,"score_lmetric":703825}],"chosen_score_linear":15351.0,"chosen_score_lmetric":477,"t_first_token":383793.446114764,"t_first_token_unix":1779814658.4600585,"t_done":383796.657132012,"t_done_unix":1779814661.6710794},{"request_id":"1276136:3:1280987:166","session_id":"1276136","input_length":25923,"t_proxy_recv":383795.115931843,"t_decision_unix":1779814660.129873,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9282876210315164,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":1859,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":25923,"score_linear":25187.0,"score_lmetric":25923},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":25923,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":25923,"score_linear":150574.0,"score_lmetric":287458},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":581,"cache_hit":24064,"new_prefill":1859,"score_linear":-24064.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":25923,"score_linear":40404.0,"score_lmetric":51846},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":25923,"score_linear":142319.0,"score_lmetric":51846},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118579,"ongoing_decode_tokens":0,"pending_prefill_tokens":101171,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":25923,"score_linear":118579.0,"score_lmetric":254188},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":25923,"score_linear":233984.0,"score_lmetric":769615}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":383795.454730447,"t_first_token_unix":1779814660.4686737,"t_done":383797.100509813,"t_done_unix":1779814662.1144545},{"request_id":"1258859:3:1278118:155","session_id":"1258859","input_length":118097,"t_proxy_recv":383785.383035735,"t_decision_unix":1779814650.3969772,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":113664,"affinity_cache_ratio":0.962463060026927,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":113664,"estimated_new_tokens":4433,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":118097,"score_linear":34071.0,"score_lmetric":236194},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":118097,"score_linear":120167.0,"score_lmetric":448880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":118097,"score_linear":150574.0,"score_lmetric":471806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":118097,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":118097,"score_linear":121069.0,"score_lmetric":423054},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":24222,"ongoing_decode_tokens":0,"pending_prefill_tokens":24222,"num_requests":1,"active_p_offloads":0,"cached_blocks":370,"cache_hit":113664,"new_prefill":4433,"score_linear":-89442.0,"score_lmetric":28655},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":512,"cache_hit":0,"new_prefill":118097,"score_linear":66280.0,"score_lmetric":236194},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":118097,"score_linear":233984.0,"score_lmetric":1230485}],"chosen_score_linear":-89442.0,"chosen_score_lmetric":28655,"t_first_token":383790.458417613,"t_first_token_unix":1779814655.4723618,"t_done":383798.716308381,"t_done_unix":1779814663.730252},{"request_id":"1281887:1:1281887:171","session_id":"1281887","input_length":9370,"t_proxy_recv":383798.032422917,"t_decision_unix":1779814663.046364,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9370,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":9370,"score_linear":25187.0,"score_lmetric":9370},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":9370,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9370,"score_linear":150574.0,"score_lmetric":254352},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":584,"cache_hit":0,"new_prefill":9370,"score_linear":26426.0,"score_lmetric":9370},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":9370,"score_linear":27639.0,"score_lmetric":9370},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":9370,"score_linear":142319.0,"score_lmetric":18740},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":9370,"score_linear":190512.0,"score_lmetric":486184},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":9370,"score_linear":233984.0,"score_lmetric":686850}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383798.737841619,"t_first_token_unix":1779814663.751786,"t_done":383798.904715343,"t_done_unix":1779814663.9186592},{"request_id":"1277909:1:1277909:153","session_id":"1277909","input_length":24222,"t_proxy_recv":383784.663879106,"t_decision_unix":1779814649.6778204,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":24222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":20126,"score_linear":29975.0,"score_lmetric":40252},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":24222,"score_linear":120167.0,"score_lmetric":261130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24222,"score_linear":150574.0,"score_lmetric":284056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":27221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":509,"cache_hit":0,"new_prefill":24222,"score_linear":27221.0,"score_lmetric":24222},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":24222,"score_linear":121069.0,"score_lmetric":235304},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":24222,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":81344,"ongoing_decode_tokens":64444,"pending_prefill_tokens":2052,"num_requests":4,"active_p_offloads":0,"cached_blocks":495,"cache_hit":7680,"new_prefill":16542,"score_linear":73664.0,"score_lmetric":74376},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202554,"ongoing_decode_tokens":0,"pending_prefill_tokens":127802,"num_requests":4,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":24222,"score_linear":202554.0,"score_lmetric":608096}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383787.519200593,"t_first_token_unix":1779814652.533153,"t_done":383799.028997091,"t_done_unix":1779814664.0429406},{"request_id":"1282082:1:1282082:173","session_id":"1282082","input_length":4972,"t_proxy_recv":383798.704868093,"t_decision_unix":1779814663.7188094,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":4972,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4972,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":4972,"score_linear":25187.0,"score_lmetric":4972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":9370,"ongoing_decode_tokens":0,"pending_prefill_tokens":9370,"num_requests":1,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":4972,"score_linear":9370.0,"score_lmetric":14342},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":4972,"score_linear":150574.0,"score_lmetric":245556},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":584,"cache_hit":0,"new_prefill":4972,"score_linear":26426.0,"score_lmetric":4972},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":4972,"score_linear":27639.0,"score_lmetric":4972},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":4972,"score_linear":142319.0,"score_lmetric":9944},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":4972,"score_linear":190512.0,"score_lmetric":468592},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":4972,"score_linear":233984.0,"score_lmetric":664860}],"chosen_score_linear":27639.0,"chosen_score_lmetric":4972,"t_first_token":383799.026700098,"t_first_token_unix":1779814664.0406432,"t_done":383799.278197245,"t_done_unix":1779814664.2921417},{"request_id":"1279412:2:1281113:167","session_id":"1279412","input_length":26426,"t_proxy_recv":383795.650264256,"t_decision_unix":1779814660.6642056,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19968,"affinity_cache_ratio":0.7556194656777416,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":6458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":26426,"score_linear":25187.0,"score_lmetric":26426},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":26426,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":26426,"score_linear":150574.0,"score_lmetric":288464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":25923,"ongoing_decode_tokens":25923,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":581,"cache_hit":19968,"new_prefill":6458,"score_linear":5955.0,"score_lmetric":6458},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":26426,"score_linear":40404.0,"score_lmetric":52852},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":26426,"score_linear":142319.0,"score_lmetric":52852},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118579,"ongoing_decode_tokens":0,"pending_prefill_tokens":101171,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":26426,"score_linear":118579.0,"score_lmetric":255194},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":12800,"new_prefill":13626,"score_linear":221184.0,"score_lmetric":708130}],"chosen_score_linear":5955.0,"chosen_score_lmetric":6458,"t_first_token":383796.768662223,"t_first_token_unix":1779814661.7826064,"t_done":383800.772112001,"t_done_unix":1779814665.786058},{"request_id":"1267915:1:1267915:96","session_id":"1267915","input_length":126924,"t_proxy_recv":383749.38306468,"t_decision_unix":1779814614.397006,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":107980,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":126924,"score_linear":135235.0,"score_lmetric":480286},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":0,"new_prefill":126924,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":18944,"new_prefill":107980,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":126924,"score_linear":15283.0,"score_lmetric":126924},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":126924,"score_linear":27639.0,"score_lmetric":126924},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":126924,"score_linear":125063.0,"score_lmetric":488614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":126924,"score_linear":17466.0,"score_lmetric":126924},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28671,"ongoing_decode_tokens":0,"pending_prefill_tokens":6143,"num_requests":1,"active_p_offloads":0,"cached_blocks":194,"cache_hit":0,"new_prefill":126924,"score_linear":28671.0,"score_lmetric":133067}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":383799.770230561,"t_first_token_unix":1779814664.784174,"t_done":383801.077870829,"t_done_unix":1779814666.091815},{"request_id":"1265128:2:1271655:122","session_id":"1265128","input_length":23650,"t_proxy_recv":383762.224043351,"t_decision_unix":1779814627.2379847,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13824,"affinity_cache_ratio":0.5845243128964059,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":9826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":23650,"score_linear":135235.0,"score_lmetric":273738},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":23650,"score_linear":102074.0,"score_lmetric":122140},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":13824,"new_prefill":9826,"score_linear":113100.0,"score_lmetric":117806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16034,"ongoing_decode_tokens":16034,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":23650,"score_linear":16034.0,"score_lmetric":47300},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":23650,"score_linear":121069.0,"score_lmetric":234160},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":23650,"score_linear":130878.0,"score_lmetric":82712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64508,"ongoing_decode_tokens":28385,"pending_prefill_tokens":21787,"num_requests":3,"active_p_offloads":0,"cached_blocks":403,"cache_hit":0,"new_prefill":23650,"score_linear":64508.0,"score_lmetric":136311},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80149,"ongoing_decode_tokens":60701,"pending_prefill_tokens":7160,"num_requests":3,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":23650,"score_linear":80149.0,"score_lmetric":92430}],"chosen_score_linear":113100.0,"chosen_score_lmetric":117806,"t_first_token":383800.267783765,"t_first_token_unix":1779814665.2817278,"t_done":383801.433584611,"t_done_unix":1779814666.4475281},{"request_id":"1277533:2:1282872:175","session_id":"1277533","input_length":16299,"t_proxy_recv":383801.449849912,"t_decision_unix":1779814666.4637914,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.2827167310877968,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":11691,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":16299,"score_linear":25187.0,"score_lmetric":16299},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":16299,"score_linear":27639.0,"score_lmetric":16299},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":427,"cache_hit":4608,"new_prefill":11691,"score_linear":-4608.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":16299,"score_linear":190512.0,"score_lmetric":513900},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":16299,"score_linear":233984.0,"score_lmetric":721495}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":383802.731308499,"t_first_token_unix":1779814667.7452521,"t_done":383802.916750245,"t_done_unix":1779814667.9306934},{"request_id":"1242838:4:1265709:87","session_id":"1242838","input_length":25187,"t_proxy_recv":383741.854076138,"t_decision_unix":1779814606.8680177,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":22016,"affinity_cache_ratio":0.8741017191408266,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":3171,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":22016,"new_prefill":3171,"score_linear":88032.0,"score_lmetric":113219},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":25187,"score_linear":55989.0,"score_lmetric":25187},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":25187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":25187,"score_linear":71575.0,"score_lmetric":162958},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":25187,"score_linear":27639.0,"score_lmetric":25187},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":25187,"score_linear":125063.0,"score_lmetric":285140},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":25187,"score_linear":50783.0,"score_lmetric":75970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":25187,"score_linear":45884.0,"score_lmetric":98110}],"chosen_score_linear":88032.0,"chosen_score_lmetric":113219,"t_first_token":383778.145695711,"t_first_token_unix":1779814643.1596391,"t_done":383803.942662416,"t_done_unix":1779814668.956606},{"request_id":"1283642:1:1283642:178","session_id":"1283642","input_length":8510,"t_proxy_recv":383803.889376579,"t_decision_unix":1779814668.9033177,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":8510,"score_linear":25187.0,"score_lmetric":8510},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":8510,"score_linear":27639.0,"score_lmetric":8510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":118736,"ongoing_decode_tokens":118736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":449,"cache_hit":0,"new_prefill":8510,"score_linear":118736.0,"score_lmetric":8510},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":8510,"score_linear":190512.0,"score_lmetric":482744},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":8510,"score_linear":233984.0,"score_lmetric":682550}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383804.519160044,"t_first_token_unix":1779814669.5331037,"t_done":383804.827094357,"t_done_unix":1779814669.8410375},{"request_id":"1258859:4:1282900:176","session_id":"1258859","input_length":118736,"t_proxy_recv":383801.52365329,"t_decision_unix":1779814666.5375948,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":118272,"affinity_cache_ratio":0.9960921708664601,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":118272,"estimated_new_tokens":464,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":118736,"score_linear":25187.0,"score_lmetric":118736},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":118736,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":118736,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":118736,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":118736,"score_linear":27639.0,"score_lmetric":118736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16299,"ongoing_decode_tokens":0,"pending_prefill_tokens":11691,"num_requests":1,"active_p_offloads":0,"cached_blocks":427,"cache_hit":118272,"new_prefill":464,"score_linear":-101973.0,"score_lmetric":12155},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":118736,"score_linear":190512.0,"score_lmetric":923648},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":118736,"score_linear":233984.0,"score_lmetric":1233680}],"chosen_score_linear":-101973.0,"chosen_score_lmetric":12155,"t_first_token":383802.84173732,"t_first_token_unix":1779814667.8556807,"t_done":383808.596553347,"t_done_unix":1779814673.6104972},{"request_id":"1279412:3:1285475:187","session_id":"1279412","input_length":27077,"t_proxy_recv":383810.349741299,"t_decision_unix":1779814675.3636825,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9832699338922333,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":453,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":27077,"score_linear":49619.0,"score_lmetric":76696},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":27077,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":27077,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":26624,"new_prefill":453,"score_linear":-26624.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":27077,"score_linear":27639.0,"score_lmetric":27077},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":27077,"score_linear":30965.0,"score_lmetric":27077},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":27077,"score_linear":190512.0,"score_lmetric":557012},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":12800,"new_prefill":14277,"score_linear":221184.0,"score_lmetric":711385}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":383810.41071472,"t_first_token_unix":1779814675.4246578,"t_done":383810.475144883,"t_done_unix":1779814675.4890912},{"request_id":"1277909:2:1283679:179","session_id":"1277909","input_length":30965,"t_proxy_recv":383803.997438303,"t_decision_unix":1779814669.0113795,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24576,"affinity_cache_ratio":0.7936702728887454,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":6389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":399,"cache_hit":4096,"new_prefill":26869,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8510,"ongoing_decode_tokens":0,"pending_prefill_tokens":8510,"num_requests":1,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":30965,"score_linear":8510.0,"score_lmetric":39475},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":30965,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":30965,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":30965,"score_linear":27639.0,"score_lmetric":30965},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":118736,"ongoing_decode_tokens":118736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":449,"cache_hit":24576,"new_prefill":6389,"score_linear":94160.0,"score_lmetric":6389},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":7680,"new_prefill":23285,"score_linear":182832.0,"score_lmetric":541844},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":30965,"score_linear":233984.0,"score_lmetric":794825}],"chosen_score_linear":94160.0,"chosen_score_lmetric":6389,"t_first_token":383805.281656592,"t_first_token_unix":1779814670.2956002,"t_done":383811.539023378,"t_done_unix":1779814676.5529668},{"request_id":"1285800:1:1285800:191","session_id":"1285800","input_length":4510,"t_proxy_recv":383811.461216634,"t_decision_unix":1779814676.4751582,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":4510,"score_linear":49619.0,"score_lmetric":54129},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":14192,"ongoing_decode_tokens":0,"pending_prefill_tokens":6000,"num_requests":1,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":4510,"score_linear":14192.0,"score_lmetric":10510},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":4510,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11,"ongoing_decode_tokens":11,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":4510,"score_linear":11.0,"score_lmetric":4510},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":4510,"score_linear":27639.0,"score_lmetric":4510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":4510,"score_linear":30965.0,"score_lmetric":4510},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":4510,"score_linear":190512.0,"score_lmetric":466744},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":4510,"score_linear":233984.0,"score_lmetric":662550}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383811.74820113,"t_first_token_unix":1779814676.762145,"t_done":383812.025280986,"t_done_unix":1779814677.0392249},{"request_id":"1239034:4:1263738:78","session_id":"1239034","input_length":27639,"t_proxy_recv":383740.690450124,"t_decision_unix":1779814605.7043915,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":22528,"affinity_cache_ratio":0.8150801403813452,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":5111,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":27639,"score_linear":110048.0,"score_lmetric":137687},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":27639,"score_linear":55989.0,"score_lmetric":27639},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14329,"ongoing_decode_tokens":301,"pending_prefill_tokens":14028,"num_requests":2,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":27639,"score_linear":14329.0,"score_lmetric":83334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":27639,"score_linear":71575.0,"score_lmetric":167862},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":258,"cache_hit":22528,"new_prefill":5111,"score_linear":-22528.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":27639,"score_linear":125063.0,"score_lmetric":290044},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":27639,"score_linear":50783.0,"score_lmetric":78422},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":27639,"score_linear":45884.0,"score_lmetric":103014}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":383741.697394172,"t_first_token_unix":1779814606.7113378,"t_done":383812.190632895,"t_done_unix":1779814677.2045763},{"request_id":"1283642:2:1285731:190","session_id":"1283642","input_length":14192,"t_proxy_recv":383811.208346736,"t_decision_unix":1779814676.2222884,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8192,"affinity_cache_ratio":0.5772266065388951,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":6000,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":14192,"score_linear":49619.0,"score_lmetric":63811},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":8192,"new_prefill":6000,"score_linear":-8192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":14192,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11,"ongoing_decode_tokens":11,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":14192,"score_linear":11.0,"score_lmetric":14192},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":14192,"score_linear":27639.0,"score_lmetric":14192},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":14192,"score_linear":30965.0,"score_lmetric":14192},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":14192,"score_linear":190512.0,"score_lmetric":505472},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":14192,"score_linear":233984.0,"score_lmetric":710960}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":383811.860474282,"t_first_token_unix":1779814676.8744173,"t_done":383812.244564918,"t_done_unix":1779814677.2585082},{"request_id":"1285558:1:1285558:188","session_id":"1285558","input_length":11,"t_proxy_recv":383810.552938713,"t_decision_unix":1779814675.5668802,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":11,"score_linear":49619.0,"score_lmetric":49630},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":11,"score_linear":27639.0,"score_lmetric":11},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":11,"score_linear":30965.0,"score_lmetric":11},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":11,"score_linear":190512.0,"score_lmetric":448748},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":11,"score_linear":233984.0,"score_lmetric":640055}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383810.568972829,"t_first_token_unix":1779814675.582916,"t_done":383812.246754948,"t_done_unix":1779814677.2606986},{"request_id":"1286551:1:1286551:194","session_id":"1286551","input_length":1700,"t_proxy_recv":383814.423776258,"t_decision_unix":1779814679.4377177,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":1700,"score_linear":49619.0,"score_lmetric":51319},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":574,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31898,"ongoing_decode_tokens":0,"pending_prefill_tokens":5274,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":1700,"score_linear":31898.0,"score_lmetric":6974},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":486,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":463,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":1700,"score_linear":190512.0,"score_lmetric":455504},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":1700,"score_linear":233984.0,"score_lmetric":648500}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383814.591378477,"t_first_token_unix":1779814679.605322,"t_done":383814.781742888,"t_done_unix":1779814679.7956865},{"request_id":"1279412:4:1286447:193","session_id":"1279412","input_length":31898,"t_proxy_recv":383814.02725734,"t_decision_unix":1779814679.0411985,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8346604802808953,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":5274,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":31898,"score_linear":49619.0,"score_lmetric":81517},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":574,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":26624,"new_prefill":5274,"score_linear":-26624.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":486,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":463,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":31898,"score_linear":190512.0,"score_lmetric":576296},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":12800,"new_prefill":19098,"score_linear":221184.0,"score_lmetric":735490}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":383815.098430433,"t_first_token_unix":1779814680.112374,"t_done":383816.704952911,"t_done_unix":1779814681.7188962},{"request_id":"1286804:1:1286804:195","session_id":"1286804","input_length":13962,"t_proxy_recv":383815.15757953,"t_decision_unix":1779814680.1715207,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13962,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":13962,"score_linear":49619.0,"score_lmetric":13962},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":574,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31898,"ongoing_decode_tokens":31898,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":13962,"score_linear":31898.0,"score_lmetric":13962},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":463,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":13962,"score_linear":190512.0,"score_lmetric":504552},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":13962,"score_linear":233984.0,"score_lmetric":709810}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383816.357865256,"t_first_token_unix":1779814681.3718088,"t_done":383817.050844555,"t_done_unix":1779814682.0647883},{"request_id":"1287588:1:1287588:198","session_id":"1287588","input_length":9925,"t_proxy_recv":383817.706935854,"t_decision_unix":1779814682.7208772,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9925,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":9925,"score_linear":49619.0,"score_lmetric":9925},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":574,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":607,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":9925,"score_linear":77805.0,"score_lmetric":87730},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":9925,"score_linear":190512.0,"score_lmetric":488404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":148136,"pending_prefill_tokens":13144,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":9925,"score_linear":233984.0,"score_lmetric":115345}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383818.517420758,"t_first_token_unix":1779814683.5313647,"t_done":383819.822662532,"t_done_unix":1779814684.8366067},{"request_id":"1288143:1:1288143:200","session_id":"1288143","input_length":448,"t_proxy_recv":383819.671694865,"t_decision_unix":1779814684.6856363,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":448,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":448,"score_linear":49619.0,"score_lmetric":448},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":9925,"ongoing_decode_tokens":9925,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":574,"cache_hit":0,"new_prefill":448,"score_linear":9925.0,"score_lmetric":448},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":607,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":448,"score_linear":77805.0,"score_lmetric":78253},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":88317,"pending_prefill_tokens":23859,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":448,"score_linear":190512.0,"score_lmetric":97228},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":233984,"pending_prefill_tokens":0,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":448,"score_linear":233984.0,"score_lmetric":2240}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383819.718456605,"t_first_token_unix":1779814684.7324004,"t_done":383820.22937643,"t_done_unix":1779814685.2433212},{"request_id":"1260327:4:1277974:154","session_id":"1260327","input_length":31430,"t_proxy_recv":383784.863402477,"t_decision_unix":1779814649.8773444,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9937002863506205,"affinity_num_requests":4,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":198,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":31430,"score_linear":34071.0,"score_lmetric":62860},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":31430,"score_linear":120167.0,"score_lmetric":275546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31430,"score_linear":150574.0,"score_lmetric":298472},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":27221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":509,"cache_hit":0,"new_prefill":31430,"score_linear":27221.0,"score_lmetric":31430},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":31430,"score_linear":121069.0,"score_lmetric":249720},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":24222,"ongoing_decode_tokens":0,"pending_prefill_tokens":24222,"num_requests":1,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":31430,"score_linear":24222.0,"score_lmetric":55652},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":81344,"ongoing_decode_tokens":81344,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":31430,"score_linear":81344.0,"score_lmetric":125720},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202554,"ongoing_decode_tokens":0,"pending_prefill_tokens":127802,"num_requests":4,"active_p_offloads":0,"cached_blocks":368,"cache_hit":31232,"new_prefill":198,"score_linear":171322.0,"score_lmetric":512000}],"chosen_score_linear":171322.0,"chosen_score_lmetric":512000,"t_first_token":383819.566338868,"t_first_token_unix":1779814684.5802824,"t_done":383821.319407356,"t_done_unix":1779814686.3333507},{"request_id":"1284132:1:1284132:182","session_id":"1284132","input_length":49619,"t_proxy_recv":383805.736123863,"t_decision_unix":1779814670.750065,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49619,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":49619,"score_linear":27639.0,"score_lmetric":49619},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":149701,"ongoing_decode_tokens":149701,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":449,"cache_hit":0,"new_prefill":49619,"score_linear":149701.0,"score_lmetric":99238},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":49619,"score_linear":190512.0,"score_lmetric":647180},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":49619,"score_linear":233984.0,"score_lmetric":888095}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383815.0541958,"t_first_token_unix":1779814680.0681412,"t_done":383821.68891055,"t_done_unix":1779814686.7028537},{"request_id":"1268831:3:1277112:147","session_id":"1268831","input_length":31845,"t_proxy_recv":383781.656743136,"t_decision_unix":1779814646.6706843,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19456,"affinity_cache_ratio":0.6109593342753965,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":12389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":31845,"score_linear":25187.0,"score_lmetric":31845},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":31845,"score_linear":120167.0,"score_lmetric":276376},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31845,"score_linear":150574.0,"score_lmetric":299302},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11292,"ongoing_decode_tokens":0,"pending_prefill_tokens":8732,"num_requests":1,"active_p_offloads":0,"cached_blocks":492,"cache_hit":0,"new_prefill":31845,"score_linear":11292.0,"score_lmetric":40577},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":31845,"score_linear":121069.0,"score_lmetric":250550},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":31845,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64444,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15804,"num_requests":3,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":31845,"score_linear":64444.0,"score_lmetric":142947},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148136,"ongoing_decode_tokens":0,"pending_prefill_tokens":114856,"num_requests":2,"active_p_offloads":0,"cached_blocks":368,"cache_hit":19456,"new_prefill":12389,"score_linear":128680.0,"score_lmetric":254490}],"chosen_score_linear":128680.0,"chosen_score_lmetric":254490,"t_first_token":383819.561731068,"t_first_token_unix":1779814684.5756745,"t_done":383824.3458796,"t_done_unix":1779814689.3598235},{"request_id":"1279994:1:1279994:161","session_id":"1279994","input_length":88317,"t_proxy_recv":383791.782635572,"t_decision_unix":1779814656.796577,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":88317,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":88317,"score_linear":25187.0,"score_lmetric":88317},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":498,"cache_hit":0,"new_prefill":88317,"score_linear":58752.0,"score_lmetric":88317},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":88317,"score_linear":150574.0,"score_lmetric":412246},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20136,"ongoing_decode_tokens":0,"pending_prefill_tokens":20136,"num_requests":1,"active_p_offloads":0,"cached_blocks":528,"cache_hit":0,"new_prefill":88317,"score_linear":20136.0,"score_lmetric":108453},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":88317,"score_linear":27639.0,"score_lmetric":88317},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":88317,"score_linear":142319.0,"score_lmetric":176634},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":88317,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":88317,"score_linear":233984.0,"score_lmetric":1081585}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383818.002478377,"t_first_token_unix":1779814683.016422,"t_done":383824.919594917,"t_done_unix":1779814689.9335392},{"request_id":"1273203:2:1277744:152","session_id":"1273203","input_length":22573,"t_proxy_recv":383783.962982245,"t_decision_unix":1779814648.976924,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9753245027244939,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":557,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":22573,"score_linear":34071.0,"score_lmetric":45146},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":22573,"score_linear":120167.0,"score_lmetric":257832},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":22573,"score_linear":150574.0,"score_lmetric":280758},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":0,"pending_prefill_tokens":9813,"num_requests":1,"active_p_offloads":0,"cached_blocks":509,"cache_hit":0,"new_prefill":22573,"score_linear":27221.0,"score_lmetric":32386},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":22573,"score_linear":121069.0,"score_lmetric":232006},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":22573,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":81344,"ongoing_decode_tokens":8704,"pending_prefill_tokens":17856,"num_requests":4,"active_p_offloads":0,"cached_blocks":495,"cache_hit":12800,"new_prefill":9773,"score_linear":68544.0,"score_lmetric":110516},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179981,"ongoing_decode_tokens":0,"pending_prefill_tokens":127245,"num_requests":3,"active_p_offloads":0,"cached_blocks":368,"cache_hit":22016,"new_prefill":557,"score_linear":157965.0,"score_lmetric":383406}],"chosen_score_linear":157965.0,"chosen_score_lmetric":383406,"t_first_token":383819.565017302,"t_first_token_unix":1779814684.578961,"t_done":383825.077449475,"t_done_unix":1779814690.0913928},{"request_id":"1286551:2:1289450:202","session_id":"1286551","input_length":9610,"t_proxy_recv":383824.019342014,"t_decision_unix":1779814689.0332832,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":0,"affinity_cache_hit":1536,"affinity_cache_ratio":0.1598335067637877,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9610,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":497,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":1536,"new_prefill":8074,"score_linear":76269.0,"score_lmetric":85879},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":9610,"score_linear":86943.0,"score_lmetric":130642},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":190512,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":9610,"score_linear":190512.0,"score_lmetric":38440},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202554,"ongoing_decode_tokens":202554,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":9610,"score_linear":202554.0,"score_lmetric":38440}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383824.762204743,"t_first_token_unix":1779814689.7761486,"t_done":383825.123226216,"t_done_unix":1779814690.1371694},{"request_id":"1279412:4:1289482:203","session_id":"1279412","input_length":32191,"t_proxy_recv":383824.098309585,"t_decision_unix":1779814689.1122508,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9861141312789289,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":447,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":9610,"num_requests":1,"active_p_offloads":0,"cached_blocks":497,"cache_hit":0,"new_prefill":32191,"score_linear":9610.0,"score_lmetric":41801},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":32191,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":32191,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":608,"cache_hit":31744,"new_prefill":447,"score_linear":-31744.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":32191,"score_linear":77805.0,"score_lmetric":109996},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":32191,"score_linear":86943.0,"score_lmetric":175804},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":190512,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":32191,"score_linear":190512.0,"score_lmetric":128764},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202554,"ongoing_decode_tokens":202554,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":368,"cache_hit":12800,"new_prefill":19391,"score_linear":189754.0,"score_lmetric":77564}],"chosen_score_linear":-31744.0,"chosen_score_lmetric":0,"t_first_token":383824.177009334,"t_first_token_unix":1779814689.1909537,"t_done":383825.195164956,"t_done_unix":1779814690.2091079},{"request_id":"1262354:7:1277104:146","session_id":"1262354","input_length":33524,"t_proxy_recv":383781.6218971,"t_decision_unix":1779814646.635838,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33280,"affinity_cache_ratio":0.992721632263453,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":33524,"score_linear":25187.0,"score_lmetric":33524},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":33524,"score_linear":120167.0,"score_lmetric":279734},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33524,"score_linear":150574.0,"score_lmetric":302660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11292,"ongoing_decode_tokens":0,"pending_prefill_tokens":8732,"num_requests":1,"active_p_offloads":0,"cached_blocks":492,"cache_hit":0,"new_prefill":33524,"score_linear":11292.0,"score_lmetric":42256},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":33524,"score_linear":121069.0,"score_lmetric":253908},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":361,"cache_hit":0,"new_prefill":33524,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64444,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15804,"num_requests":3,"active_p_offloads":0,"cached_blocks":495,"cache_hit":0,"new_prefill":33524,"score_linear":64444.0,"score_lmetric":147984},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":368,"cache_hit":33280,"new_prefill":244,"score_linear":81332.0,"score_lmetric":114856}],"chosen_score_linear":81332.0,"chosen_score_lmetric":114856,"t_first_token":383817.191474982,"t_first_token_unix":1779814682.2054186,"t_done":383827.249537224,"t_done_unix":1779814692.263481},{"request_id":"1279994:2:1283011:177","session_id":"1279994","input_length":88940,"t_proxy_recv":383824.942218487,"t_decision_unix":1779814689.95616,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":88064,"affinity_cache_ratio":0.990150663368563,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":876,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":9610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":497,"cache_hit":0,"new_prefill":88940,"score_linear":9610.0,"score_lmetric":88940},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":88940,"score_linear":92209.0,"score_lmetric":342842},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32191,"ongoing_decode_tokens":32191,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":88940,"score_linear":32191.0,"score_lmetric":88940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":88940,"score_linear":77805.0,"score_lmetric":166745},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":88940,"score_linear":86943.0,"score_lmetric":289302},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":102195,"ongoing_decode_tokens":102195,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":736,"cache_hit":88064,"new_prefill":876,"score_linear":14131.0,"score_lmetric":2628},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":203055,"ongoing_decode_tokens":203055,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":392,"cache_hit":0,"new_prefill":88940,"score_linear":203055.0,"score_lmetric":355760}],"chosen_score_linear":14131.0,"chosen_score_lmetric":2628,"t_first_token":383825.408134342,"t_first_token_unix":1779814690.4220777,"t_done":383827.377954254,"t_done_unix":1779814692.3918986},{"request_id":"1290442:1:1290442:210","session_id":"1290442","input_length":7261,"t_proxy_recv":383827.286967382,"t_decision_unix":1779814692.300909,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13552,"ongoing_decode_tokens":0,"pending_prefill_tokens":12016,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":7261,"score_linear":13552.0,"score_lmetric":19277},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":7261,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":7261,"score_linear":92209.0,"score_lmetric":179484},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":7261,"score_linear":23228.0,"score_lmetric":30489},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":7261,"score_linear":77805.0,"score_lmetric":85066},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":7261,"score_linear":86943.0,"score_lmetric":125944},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191135,"ongoing_decode_tokens":191135,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":7261,"score_linear":191135.0,"score_lmetric":29044},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180886,"ongoing_decode_tokens":146958,"pending_prefill_tokens":136,"num_requests":3,"active_p_offloads":0,"cached_blocks":394,"cache_hit":0,"new_prefill":7261,"score_linear":180886.0,"score_lmetric":22191}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383827.777648683,"t_first_token_unix":1779814692.791592,"t_done":383827.920254824,"t_done_unix":1779814692.934199},{"request_id":"1268831:4:1279168:158","session_id":"1268831","input_length":32346,"t_proxy_recv":383824.352667111,"t_decision_unix":1779814689.3666084,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9813887343102702,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":602,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":9610,"num_requests":1,"active_p_offloads":0,"cached_blocks":497,"cache_hit":0,"new_prefill":32346,"score_linear":9610.0,"score_lmetric":41956},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":32346,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":32346,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32191,"ongoing_decode_tokens":32191,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":32346,"score_linear":32191.0,"score_lmetric":32346},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":32346,"score_linear":77805.0,"score_lmetric":110151},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":32346,"score_linear":86943.0,"score_lmetric":176114},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":190512,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":32346,"score_linear":190512.0,"score_lmetric":129384},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170709,"ongoing_decode_tokens":170709,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":392,"cache_hit":31744,"new_prefill":602,"score_linear":138965.0,"score_lmetric":1806}],"chosen_score_linear":138965.0,"chosen_score_lmetric":1806,"t_first_token":383824.54967186,"t_first_token_unix":1779814689.5636156,"t_done":383828.337310143,"t_done_unix":1779814693.3512535},{"request_id":"1290426:1:1290426:209","session_id":"1290426","input_length":13552,"t_proxy_recv":383827.262934028,"t_decision_unix":1779814692.2768755,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":12016,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":515,"cache_hit":1536,"new_prefill":12016,"score_linear":-1536.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":13552,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":13552,"score_linear":92209.0,"score_lmetric":192066},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":13552,"score_linear":23228.0,"score_lmetric":36780},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":1536,"new_prefill":12016,"score_linear":76269.0,"score_lmetric":89821},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":13552,"score_linear":86943.0,"score_lmetric":138526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191135,"ongoing_decode_tokens":191135,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":13552,"score_linear":191135.0,"score_lmetric":54208},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180886,"ongoing_decode_tokens":146958,"pending_prefill_tokens":136,"num_requests":3,"active_p_offloads":0,"cached_blocks":394,"cache_hit":0,"new_prefill":13552,"score_linear":180886.0,"score_lmetric":41064}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":383828.357803266,"t_first_token_unix":1779814693.3717465,"t_done":383828.720905601,"t_done_unix":1779814693.7348492},{"request_id":"1269373:4:1280765:165","session_id":"1269373","input_length":30262,"t_proxy_recv":383794.276238344,"t_decision_unix":1779814659.2901795,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":17408,"affinity_cache_ratio":0.5752428788579736,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":12854,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":26166,"score_linear":21091.0,"score_lmetric":26166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":30262,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30262,"score_linear":150574.0,"score_lmetric":296136},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20136,"ongoing_decode_tokens":20136,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":542,"cache_hit":0,"new_prefill":30262,"score_linear":20136.0,"score_lmetric":30262},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":30262,"score_linear":40404.0,"score_lmetric":60524},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":30262,"score_linear":142319.0,"score_lmetric":60524},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":17408,"new_prefill":12854,"score_linear":70909.0,"score_lmetric":101171},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":30262,"score_linear":233984.0,"score_lmetric":791310}],"chosen_score_linear":70909.0,"chosen_score_lmetric":101171,"t_first_token":383821.871479795,"t_first_token_unix":1779814686.8854234,"t_done":383829.403448398,"t_done_unix":1779814694.4173918},{"request_id":"1272313:4:1281720:170","session_id":"1272313","input_length":13901,"t_proxy_recv":383797.465016915,"t_decision_unix":1779814662.4789581,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":11264,"affinity_cache_ratio":0.8103014171642328,"affinity_num_requests":3,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":2637,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":9805,"score_linear":21091.0,"score_lmetric":9805},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":13901,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13901,"score_linear":150574.0,"score_lmetric":263414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":584,"cache_hit":0,"new_prefill":13901,"score_linear":26426.0,"score_lmetric":13901},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":13901,"score_linear":27639.0,"score_lmetric":13901},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":13901,"score_linear":142319.0,"score_lmetric":27802},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176611,"ongoing_decode_tokens":0,"pending_prefill_tokens":109539,"num_requests":3,"active_p_offloads":0,"cached_blocks":564,"cache_hit":11264,"new_prefill":2637,"score_linear":165347.0,"score_lmetric":336528},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":13901,"score_linear":233984.0,"score_lmetric":709505}],"chosen_score_linear":165347.0,"chosen_score_lmetric":336528,"t_first_token":383823.120846754,"t_first_token_unix":1779814688.13479,"t_done":383829.609146315,"t_done_unix":1779814694.6230896},{"request_id":"1291100:1:1291100:212","session_id":"1291100","input_length":1744,"t_proxy_recv":383829.502466552,"t_decision_unix":1779814694.516408,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1744,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":1744,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":1744,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":1744,"score_linear":92209.0,"score_lmetric":168450},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":1744,"score_linear":23228.0,"score_lmetric":24972},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":1744,"score_linear":77805.0,"score_lmetric":79549},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":1744,"score_linear":86943.0,"score_lmetric":114910},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191753,"ongoing_decode_tokens":161159,"pending_prefill_tokens":386,"num_requests":4,"active_p_offloads":0,"cached_blocks":762,"cache_hit":0,"new_prefill":1744,"score_linear":191753.0,"score_lmetric":8520},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190804,"ongoing_decode_tokens":148540,"pending_prefill_tokens":10008,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":1744,"score_linear":190804.0,"score_lmetric":35256}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383829.64459917,"t_first_token_unix":1779814694.6585422,"t_done":383830.033731237,"t_done_unix":1779814695.0476744},{"request_id":"1290365:1:1290365:208","session_id":"1290365","input_length":23228,"t_proxy_recv":383827.080594703,"t_decision_unix":1779814692.0945358,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":23228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":23228,"score_linear":92209.0,"score_lmetric":211418},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":23228,"score_linear":77805.0,"score_lmetric":101033},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":23228,"score_linear":86943.0,"score_lmetric":157878},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191135,"ongoing_decode_tokens":191135,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":23228,"score_linear":191135.0,"score_lmetric":92912},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180482,"ongoing_decode_tokens":180482,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":393,"cache_hit":0,"new_prefill":23228,"score_linear":180482.0,"score_lmetric":69684}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383829.656718642,"t_first_token_unix":1779814694.6706624,"t_done":383830.370634191,"t_done_unix":1779814695.3845775},{"request_id":"1262354:8:1280463:163","session_id":"1262354","input_length":33928,"t_proxy_recv":383827.255472744,"t_decision_unix":1779814692.2694142,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9959915114359821,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":33928,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":33928,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":33928,"score_linear":92209.0,"score_lmetric":232818},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":12800,"new_prefill":21128,"score_linear":10428.0,"score_lmetric":44356},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":33928,"score_linear":77805.0,"score_lmetric":111733},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":33928,"score_linear":86943.0,"score_lmetric":179278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191135,"ongoing_decode_tokens":191135,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":33928,"score_linear":191135.0,"score_lmetric":135712},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146958,"ongoing_decode_tokens":146958,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":394,"cache_hit":33792,"new_prefill":136,"score_linear":113166.0,"score_lmetric":272}],"chosen_score_linear":113166.0,"chosen_score_lmetric":272,"t_first_token":383827.360528508,"t_first_token_unix":1779814692.3744717,"t_done":383831.125784994,"t_done_unix":1779814696.1397283},{"request_id":"1279412:5:1291651:214","session_id":"1279412","input_length":32359,"t_proxy_recv":383831.428124241,"t_decision_unix":1779814696.4420652,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":32256,"affinity_cache_ratio":0.9968169597329954,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":32359,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":563,"cache_hit":0,"new_prefill":32359,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":32359,"score_linear":92209.0,"score_lmetric":229680},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":32256,"new_prefill":103,"score_linear":-32256.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":32359,"score_linear":77805.0,"score_lmetric":110164},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":42023,"pending_prefill_tokens":13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":32359,"score_linear":86943.0,"score_lmetric":92094},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":192737,"ongoing_decode_tokens":192737,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":32359,"score_linear":192737.0,"score_lmetric":129436},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190904,"ongoing_decode_tokens":190904,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":12800,"new_prefill":19559,"score_linear":178104.0,"score_lmetric":58677}],"chosen_score_linear":-32256.0,"chosen_score_lmetric":0,"t_first_token":383831.492869056,"t_first_token_unix":1779814696.5068123,"t_done":383832.063915384,"t_done_unix":1779814697.0778592},{"request_id":"1266668:5:1281133:168","session_id":"1266668","input_length":58032,"t_proxy_recv":383795.73195029,"t_decision_unix":1779814660.7458918,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49664,"affinity_cache_ratio":0.8558036945133719,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":8368,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":53936,"score_linear":21091.0,"score_lmetric":53936},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":58032,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":58032,"score_linear":150574.0,"score_lmetric":351676},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":52349,"ongoing_decode_tokens":25923,"pending_prefill_tokens":6458,"num_requests":2,"active_p_offloads":0,"cached_blocks":581,"cache_hit":0,"new_prefill":58032,"score_linear":52349.0,"score_lmetric":128980},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":58032,"score_linear":40404.0,"score_lmetric":116064},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":58032,"score_linear":142319.0,"score_lmetric":116064},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118579,"ongoing_decode_tokens":0,"pending_prefill_tokens":101171,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":49664,"new_prefill":8368,"score_linear":68915.0,"score_lmetric":219078},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":58032,"score_linear":233984.0,"score_lmetric":930160}],"chosen_score_linear":68915.0,"chosen_score_lmetric":219078,"t_first_token":383823.119951709,"t_first_token_unix":1779814688.133895,"t_done":383832.105952719,"t_done_unix":1779814697.1198967},{"request_id":"1260327:5:1281915:172","session_id":"1260327","input_length":42023,"t_proxy_recv":383821.331256544,"t_decision_unix":1779814686.3451977,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":5,"affinity_cache_hit":31232,"affinity_cache_ratio":0.7432120505437498,"affinity_num_requests":4,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":42023,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":42023,"score_linear":49619.0,"score_lmetric":42023},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":42023,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":42023,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":42023,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":42023,"score_linear":77805.0,"score_lmetric":119828},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":42023,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":88317,"pending_prefill_tokens":23859,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":42023,"score_linear":190512.0,"score_lmetric":263528},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202554,"ongoing_decode_tokens":202554,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":368,"cache_hit":31232,"new_prefill":10791,"score_linear":171322.0,"score_lmetric":43164}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383829.937352652,"t_first_token_unix":1779814694.9512963,"t_done":383832.540334369,"t_done_unix":1779814697.554278},{"request_id":"1290365:2:1292000:217","session_id":"1290365","input_length":23414,"t_proxy_recv":383832.67848871,"t_decision_unix":1779814697.69243,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9840266507217904,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":374,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":0,"pending_prefill_tokens":75959,"num_requests":1,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":23414,"score_linear":80055.0,"score_lmetric":99373},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8144,"ongoing_decode_tokens":0,"pending_prefill_tokens":8144,"num_requests":1,"active_p_offloads":0,"cached_blocks":563,"cache_hit":0,"new_prefill":23414,"score_linear":8144.0,"score_lmetric":31558},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":23414,"score_linear":92209.0,"score_lmetric":211790},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":23040,"new_prefill":374,"score_linear":-23040.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":23414,"score_linear":77805.0,"score_lmetric":101219},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87073,"ongoing_decode_tokens":87073,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":23414,"score_linear":87073.0,"score_lmetric":46828},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":23414,"score_linear":134705.0,"score_lmetric":70242},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190904,"ongoing_decode_tokens":190904,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":23414,"score_linear":190904.0,"score_lmetric":70242}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":383832.76077859,"t_first_token_unix":1779814697.774722,"t_done":383833.070328011,"t_done_unix":1779814698.0842717},{"request_id":"1291944:1:1291944:216","session_id":"1291944","input_length":8144,"t_proxy_recv":383832.48226996,"t_decision_unix":1779814697.4962115,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":0,"pending_prefill_tokens":75959,"num_requests":1,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":8144,"score_linear":80055.0,"score_lmetric":84103},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":563,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":8144,"score_linear":92209.0,"score_lmetric":181250},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":8144,"score_linear":77805.0,"score_lmetric":85949},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":86943,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":8144,"score_linear":86943.0,"score_lmetric":16288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":8144,"score_linear":134705.0,"score_lmetric":24432},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190904,"ongoing_decode_tokens":190904,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":8144,"score_linear":190904.0,"score_lmetric":24432}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383833.047340739,"t_first_token_unix":1779814698.061285,"t_done":383833.18930261,"t_done_unix":1779814698.2032464},{"request_id":"1260327:6:1291827:215","session_id":"1260327","input_length":42153,"t_proxy_recv":383832.548242354,"t_decision_unix":1779814697.5621839,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9959907954356748,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":169,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":0,"pending_prefill_tokens":75959,"num_requests":1,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":42153,"score_linear":80055.0,"score_lmetric":118112},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8144,"ongoing_decode_tokens":0,"pending_prefill_tokens":8144,"num_requests":1,"active_p_offloads":0,"cached_blocks":563,"cache_hit":0,"new_prefill":42153,"score_linear":8144.0,"score_lmetric":50297},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":42153,"score_linear":92209.0,"score_lmetric":249268},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":0,"new_prefill":42153,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":42153,"score_linear":77805.0,"score_lmetric":119958},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":41984,"new_prefill":169,"score_linear":2936.0,"score_lmetric":169},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":42153,"score_linear":134705.0,"score_lmetric":126459},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190904,"ongoing_decode_tokens":190904,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":31232,"new_prefill":10921,"score_linear":159672.0,"score_lmetric":32763}],"chosen_score_linear":2936.0,"chosen_score_lmetric":169,"t_first_token":383832.64458201,"t_first_token_unix":1779814697.6585252,"t_done":383833.295377374,"t_done_unix":1779814698.309321},{"request_id":"1268831:5:1284640:184","session_id":"1268831","input_length":42264,"t_proxy_recv":383828.349010449,"t_decision_unix":1779814693.362952,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":32256,"affinity_cache_ratio":0.7632027257240205,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":10008,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13552,"ongoing_decode_tokens":0,"pending_prefill_tokens":12016,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":42264,"score_linear":13552.0,"score_lmetric":54280},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":42264,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":42264,"score_linear":92209.0,"score_lmetric":249490},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":42264,"score_linear":23228.0,"score_lmetric":65492},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":42264,"score_linear":77805.0,"score_lmetric":120069},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":42264,"score_linear":86943.0,"score_lmetric":195950},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191421,"ongoing_decode_tokens":191421,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":737,"cache_hit":0,"new_prefill":42264,"score_linear":191421.0,"score_lmetric":169056},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148540,"ongoing_decode_tokens":148540,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":395,"cache_hit":32256,"new_prefill":10008,"score_linear":116284.0,"score_lmetric":20016}],"chosen_score_linear":116284.0,"chosen_score_lmetric":20016,"t_first_token":383830.999859481,"t_first_token_unix":1779814696.0138035,"t_done":383834.091707,"t_done_unix":1779814699.1056507},{"request_id":"1262354:9:1281632:169","session_id":"1262354","input_length":34028,"t_proxy_recv":383831.132356155,"t_decision_unix":1779814696.1462977,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9930645350887505,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":236,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":34028,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":563,"cache_hit":0,"new_prefill":34028,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":34028,"score_linear":92209.0,"score_lmetric":233018},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":12800,"new_prefill":21228,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":34028,"score_linear":77805.0,"score_lmetric":111833},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":42023,"pending_prefill_tokens":13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":34028,"score_linear":86943.0,"score_lmetric":95432},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":192737,"ongoing_decode_tokens":192737,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":34028,"score_linear":192737.0,"score_lmetric":136112},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":156876,"ongoing_decode_tokens":156876,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":395,"cache_hit":33792,"new_prefill":236,"score_linear":123084.0,"score_lmetric":472}],"chosen_score_linear":123084.0,"chosen_score_lmetric":472,"t_first_token":383831.238678108,"t_first_token_unix":1779814696.252622,"t_done":383834.75284467,"t_done_unix":1779814699.76679},{"request_id":"1262354:10:1283773:180","session_id":"1262354","input_length":34282,"t_proxy_recv":383834.762519557,"t_decision_unix":1779814699.7764611,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9857067849016977,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":490,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":34282,"score_linear":96969.0,"score_lmetric":235878},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":34282,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":34282,"score_linear":92209.0,"score_lmetric":233526},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":12800,"new_prefill":21482,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":34282,"score_linear":77805.0,"score_lmetric":112087},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":34282,"score_linear":44920.0,"score_lmetric":34282},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":34282,"score_linear":134705.0,"score_lmetric":102846},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":414,"cache_hit":33792,"new_prefill":490,"score_linear":80820.0,"score_lmetric":490}],"chosen_score_linear":80820.0,"chosen_score_lmetric":490,"t_first_token":383834.848205802,"t_first_token_unix":1779814699.8621495,"t_done":383835.711482201,"t_done_unix":1779814700.7254257},{"request_id":"1292750:1:1292750:220","session_id":"1292750","input_length":4684,"t_proxy_recv":383834.983406359,"t_decision_unix":1779814699.9973478,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":4684,"score_linear":96969.0,"score_lmetric":176682},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":4684,"score_linear":92209.0,"score_lmetric":174330},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":4684,"score_linear":77805.0,"score_lmetric":82489},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":4684,"score_linear":44920.0,"score_lmetric":4684},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":4684,"score_linear":134705.0,"score_lmetric":14052},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148894,"ongoing_decode_tokens":148894,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":414,"cache_hit":0,"new_prefill":4684,"score_linear":148894.0,"score_lmetric":9368}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383835.277256048,"t_first_token_unix":1779814700.2911994,"t_done":383835.712690183,"t_done_unix":1779814700.7266335},{"request_id":"1279994:3:1286181:192","session_id":"1279994","input_length":89226,"t_proxy_recv":383827.405403836,"t_decision_unix":1779814692.4193451,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":88576,"affinity_cache_ratio":0.9927151278775245,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":88576,"estimated_new_tokens":650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13552,"ongoing_decode_tokens":0,"pending_prefill_tokens":12016,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":89226,"score_linear":13552.0,"score_lmetric":101242},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":7261,"ongoing_decode_tokens":0,"pending_prefill_tokens":7261,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":89226,"score_linear":7261.0,"score_lmetric":96487},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":89226,"score_linear":92209.0,"score_lmetric":343414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":89226,"score_linear":23228.0,"score_lmetric":112454},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":89226,"score_linear":77805.0,"score_lmetric":167031},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":89226,"score_linear":86943.0,"score_lmetric":289874},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":102195,"ongoing_decode_tokens":102195,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":737,"cache_hit":88576,"new_prefill":650,"score_linear":13619.0,"score_lmetric":1950},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180886,"ongoing_decode_tokens":180886,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":394,"cache_hit":0,"new_prefill":89226,"score_linear":180886.0,"score_lmetric":267678}],"chosen_score_linear":13619.0,"chosen_score_lmetric":1950,"t_first_token":383827.689600137,"t_first_token_unix":1779814692.7035437,"t_done":383836.199432165,"t_done_unix":1779814701.213376},{"request_id":"1287100:1:1287100:196","session_id":"1287100","input_length":77805,"t_proxy_recv":383816.128270553,"t_decision_unix":1779814681.1422117,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":77805,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":399,"cache_hit":0,"new_prefill":77805,"score_linear":49619.0,"score_lmetric":77805},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":574,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31898,"ongoing_decode_tokens":31898,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":77805,"score_linear":31898.0,"score_lmetric":77805},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13962,"ongoing_decode_tokens":0,"pending_prefill_tokens":13962,"num_requests":1,"active_p_offloads":0,"cached_blocks":463,"cache_hit":0,"new_prefill":77805,"score_linear":13962.0,"score_lmetric":91767},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":0,"pending_prefill_tokens":112176,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":77805,"score_linear":190512.0,"score_lmetric":759924},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233984,"ongoing_decode_tokens":0,"pending_prefill_tokens":128000,"num_requests":5,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":77805,"score_linear":233984.0,"score_lmetric":1029025}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383836.935965986,"t_first_token_unix":1779814701.9499094,"t_done":383837.463852934,"t_done_unix":1779814702.4777968},{"request_id":"1272313:5:1284744:185","session_id":"1272313","input_length":14885,"t_proxy_recv":383829.614485355,"t_decision_unix":1779814694.6284268,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":13824,"affinity_cache_ratio":0.9287201881088344,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1061,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":10789,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":1744,"ongoing_decode_tokens":0,"pending_prefill_tokens":1744,"num_requests":1,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":14885,"score_linear":1744.0,"score_lmetric":16629},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":14885,"score_linear":92209.0,"score_lmetric":194732},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":14885,"score_linear":23228.0,"score_lmetric":38113},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":14885,"score_linear":77805.0,"score_lmetric":92690},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":7680,"new_prefill":7205,"score_linear":79263.0,"score_lmetric":125832},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":177852,"ongoing_decode_tokens":177852,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":767,"cache_hit":13824,"new_prefill":1061,"score_linear":164028.0,"score_lmetric":3183},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190804,"ongoing_decode_tokens":148540,"pending_prefill_tokens":10008,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":14885,"score_linear":190804.0,"score_lmetric":74679}],"chosen_score_linear":164028.0,"chosen_score_lmetric":3183,"t_first_token":383829.856944595,"t_first_token_unix":1779814694.8708885,"t_done":383837.506309025,"t_done_unix":1779814702.5202525},{"request_id":"1291100:2:1293458:223","session_id":"1291100","input_length":2572,"t_proxy_recv":383837.472802062,"t_decision_unix":1779814702.4867435,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":1536,"affinity_cache_ratio":0.5972006220839814,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":1036,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":2572,"score_linear":96969.0,"score_lmetric":172458},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":1536,"new_prefill":1036,"score_linear":-1536.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":2572,"score_linear":92209.0,"score_lmetric":170106},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":659,"cache_hit":0,"new_prefill":2572,"score_linear":24482.0,"score_lmetric":2572},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":641,"cache_hit":0,"new_prefill":2572,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":2572,"score_linear":44920.0,"score_lmetric":2572},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135228,"ongoing_decode_tokens":135228,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":786,"cache_hit":0,"new_prefill":2572,"score_linear":135228.0,"score_lmetric":7716},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":2572,"score_linear":148965.0,"score_lmetric":5144}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":383837.550442855,"t_first_token_unix":1779814702.564386,"t_done":383837.699941584,"t_done_unix":1779814702.7138844},{"request_id":"1269373:5:1282812:174","session_id":"1269373","input_length":30594,"t_proxy_recv":383829.410545211,"t_decision_unix":1779814694.4244862,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":30208,"affinity_cache_ratio":0.9873831470222919,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":30208,"estimated_new_tokens":386,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":26498,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":30594,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":30594,"score_linear":92209.0,"score_lmetric":226150},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":30594,"score_linear":23228.0,"score_lmetric":53822},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":30594,"score_linear":77805.0,"score_lmetric":108399},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":7680,"new_prefill":22914,"score_linear":79263.0,"score_lmetric":157250},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":161159,"ongoing_decode_tokens":161159,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":762,"cache_hit":30208,"new_prefill":386,"score_linear":130951.0,"score_lmetric":1158},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190804,"ongoing_decode_tokens":148540,"pending_prefill_tokens":10008,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":30594,"score_linear":190804.0,"score_lmetric":121806}],"chosen_score_linear":130951.0,"chosen_score_lmetric":1158,"t_first_token":383829.534684398,"t_first_token_unix":1779814694.5486283,"t_done":383837.980146655,"t_done_unix":1779814702.9940903},{"request_id":"1293507:1:1293507:224","session_id":"1293507","input_length":6460,"t_proxy_recv":383837.659266716,"t_decision_unix":1779814702.6732082,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":6460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":6460,"score_linear":96969.0,"score_lmetric":180234},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":2572,"ongoing_decode_tokens":2572,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":6460,"score_linear":2572.0,"score_lmetric":6460},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":6460,"score_linear":92209.0,"score_lmetric":177882},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":659,"cache_hit":0,"new_prefill":6460,"score_linear":24482.0,"score_lmetric":6460},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":641,"cache_hit":0,"new_prefill":6460,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":6460,"score_linear":44920.0,"score_lmetric":6460},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135890,"ongoing_decode_tokens":135890,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":6460,"score_linear":135890.0,"score_lmetric":19380},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":6460,"score_linear":148965.0,"score_lmetric":12920}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383838.094505189,"t_first_token_unix":1779814703.1084485,"t_done":383838.213656257,"t_done_unix":1779814703.2275996},{"request_id":"1291944:2:1293798:227","session_id":"1291944","input_length":12388,"t_proxy_recv":383838.745627241,"t_decision_unix":1779814703.7595682,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7680,"affinity_cache_ratio":0.6199547949628673,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":4708,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":12388,"score_linear":96969.0,"score_lmetric":192090},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":7680,"new_prefill":4708,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":12388,"score_linear":92209.0,"score_lmetric":189738},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":64760,"ongoing_decode_tokens":24482,"pending_prefill_tokens":8022,"num_requests":2,"active_p_offloads":0,"cached_blocks":659,"cache_hit":0,"new_prefill":12388,"score_linear":64760.0,"score_lmetric":40820},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":12388,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":12388,"score_linear":44920.0,"score_lmetric":12388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":144084,"ongoing_decode_tokens":105296,"pending_prefill_tokens":8068,"num_requests":3,"active_p_offloads":0,"cached_blocks":790,"cache_hit":0,"new_prefill":12388,"score_linear":144084.0,"score_lmetric":61368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":12388,"score_linear":148965.0,"score_lmetric":24776}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":383839.214746397,"t_first_token_unix":1779814704.2286897,"t_done":383839.55194287,"t_done_unix":1779814704.5658863},{"request_id":"1279994:4:1290711:211","session_id":"1279994","input_length":89749,"t_proxy_recv":383836.217074681,"t_decision_unix":1779814701.2310162,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9983398143711908,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":149,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":89749,"score_linear":96969.0,"score_lmetric":346812},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":89749,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":89749,"score_linear":92209.0,"score_lmetric":344460},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":659,"cache_hit":0,"new_prefill":89749,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":89749,"score_linear":77805.0,"score_lmetric":167554},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":89749,"score_linear":44920.0,"score_lmetric":89749},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":45479,"ongoing_decode_tokens":45479,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":786,"cache_hit":89600,"new_prefill":149,"score_linear":-44121.0,"score_lmetric":298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":89749,"score_linear":148965.0,"score_lmetric":179498}],"chosen_score_linear":-44121.0,"chosen_score_lmetric":298,"t_first_token":383836.375863574,"t_first_token_unix":1779814701.389807,"t_done":383841.145303523,"t_done_unix":1779814706.1592503},{"request_id":"1290365:3:1293216:222","session_id":"1290365","input_length":24482,"t_proxy_recv":383836.613440342,"t_decision_unix":1779814701.6273818,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":23040,"affinity_cache_ratio":0.941099583367372,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1442,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":24482,"score_linear":96969.0,"score_lmetric":216278},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":24482,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":24482,"score_linear":92209.0,"score_lmetric":213926},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":659,"cache_hit":23040,"new_prefill":1442,"score_linear":-23040.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":24482,"score_linear":77805.0,"score_lmetric":102287},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":24482,"score_linear":44920.0,"score_lmetric":24482},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135228,"ongoing_decode_tokens":135228,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":786,"cache_hit":0,"new_prefill":24482,"score_linear":135228.0,"score_lmetric":73446},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":24482,"score_linear":148965.0,"score_lmetric":48964}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":383836.88068033,"t_first_token_unix":1779814701.8946238,"t_done":383841.191460907,"t_done_unix":1779814706.2054045},{"request_id":"1272313:6:1287745:199","session_id":"1272313","input_length":15547,"t_proxy_recv":383837.510834856,"t_decision_unix":1779814702.5247765,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":15360,"affinity_cache_ratio":0.9879719560043738,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":11451,"score_linear":92873.0,"score_lmetric":190216},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":2572,"ongoing_decode_tokens":0,"pending_prefill_tokens":1036,"num_requests":1,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":15547,"score_linear":2572.0,"score_lmetric":16583},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":15547,"score_linear":92209.0,"score_lmetric":196056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":659,"cache_hit":0,"new_prefill":15547,"score_linear":24482.0,"score_lmetric":15547},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":641,"cache_hit":0,"new_prefill":15547,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":7867,"score_linear":37240.0,"score_lmetric":7867},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120343,"ongoing_decode_tokens":120343,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":789,"cache_hit":15360,"new_prefill":187,"score_linear":104983.0,"score_lmetric":374},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":15547,"score_linear":148965.0,"score_lmetric":31094}],"chosen_score_linear":104983.0,"chosen_score_lmetric":374,"t_first_token":383837.632734306,"t_first_token_unix":1779814702.6466775,"t_done":383842.447253674,"t_done_unix":1779814707.4611971},{"request_id":"1279412:6:1293655:225","session_id":"1279412","input_length":40278,"t_proxy_recv":383838.239530432,"t_decision_unix":1779814703.2534714,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":32256,"affinity_cache_ratio":0.8008342022940563,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":8022,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":40278,"score_linear":96969.0,"score_lmetric":247870},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":40278,"score_linear":92209.0,"score_lmetric":245518},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":659,"cache_hit":32256,"new_prefill":8022,"score_linear":-7774.0,"score_lmetric":8022},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":40278,"score_linear":44920.0,"score_lmetric":40278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":144084,"ongoing_decode_tokens":105296,"pending_prefill_tokens":8068,"num_requests":3,"active_p_offloads":0,"cached_blocks":790,"cache_hit":0,"new_prefill":40278,"score_linear":144084.0,"score_lmetric":145038},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":12800,"new_prefill":27478,"score_linear":136165.0,"score_lmetric":54956}],"chosen_score_linear":-7774.0,"chosen_score_lmetric":8022,"t_first_token":383840.264961535,"t_first_token_unix":1779814705.2789075,"t_done":383843.968074521,"t_done_unix":1779814708.9820178},{"request_id":"1294611:1:1294611:229","session_id":"1294611","input_length":21947,"t_proxy_recv":383841.20645951,"t_decision_unix":1779814706.2204008,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21947,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":21947,"score_linear":96969.0,"score_lmetric":211208},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":589,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":21947,"score_linear":92209.0,"score_lmetric":208856},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40278,"ongoing_decode_tokens":40278,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":662,"cache_hit":0,"new_prefill":21947,"score_linear":40278.0,"score_lmetric":21947},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":21947,"score_linear":44920.0,"score_lmetric":21947},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54335,"ongoing_decode_tokens":54335,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":790,"cache_hit":12800,"new_prefill":9147,"score_linear":41535.0,"score_lmetric":18294},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":12800,"new_prefill":9147,"score_linear":136165.0,"score_lmetric":18294}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383843.571786658,"t_first_token_unix":1779814708.58573,"t_done":383844.229742199,"t_done_unix":1779814709.2436855},{"request_id":"1269373:6:1285668:189","session_id":"1269373","input_length":38788,"t_proxy_recv":383837.990505401,"t_decision_unix":1779814703.0044467,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":30720,"affinity_cache_ratio":0.7919975250077343,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":8068,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":34692,"score_linear":92873.0,"score_lmetric":236698},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":38788,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":38788,"score_linear":92209.0,"score_lmetric":242538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":659,"cache_hit":0,"new_prefill":38788,"score_linear":24482.0,"score_lmetric":38788},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":6460,"ongoing_decode_tokens":0,"pending_prefill_tokens":6460,"num_requests":1,"active_p_offloads":0,"cached_blocks":641,"cache_hit":0,"new_prefill":38788,"score_linear":6460.0,"score_lmetric":45248},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":31108,"score_linear":37240.0,"score_lmetric":31108},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":105296,"ongoing_decode_tokens":105296,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":790,"cache_hit":30720,"new_prefill":8068,"score_linear":74576.0,"score_lmetric":16136},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":38788,"score_linear":148965.0,"score_lmetric":77576}],"chosen_score_linear":74576.0,"chosen_score_lmetric":16136,"t_first_token":383839.905288115,"t_first_token_unix":1779814704.9192314,"t_done":383844.267311214,"t_done_unix":1779814709.2812548},{"request_id":"1262354:11:1284987:186","session_id":"1262354","input_length":34353,"t_proxy_recv":383835.718782241,"t_decision_unix":1779814700.732724,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9985736325793962,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":49,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":34353,"score_linear":96969.0,"score_lmetric":236020},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":34353,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":34353,"score_linear":92209.0,"score_lmetric":233668},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":659,"cache_hit":12800,"new_prefill":21553,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":34353,"score_linear":77805.0,"score_lmetric":112158},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":34353,"score_linear":44920.0,"score_lmetric":34353},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":34353,"score_linear":134705.0,"score_lmetric":103059},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":415,"cache_hit":34304,"new_prefill":49,"score_linear":80308.0,"score_lmetric":49}],"chosen_score_linear":80308.0,"chosen_score_lmetric":49,"t_first_token":383835.794914657,"t_first_token_unix":1779814700.8088582,"t_done":383845.182633137,"t_done_unix":1779814710.1965766},{"request_id":"1262354:12:1291548:213","session_id":"1262354","input_length":35099,"t_proxy_recv":383845.190077339,"t_decision_unix":1779814710.2040188,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9919370922248497,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":35099,"score_linear":96969.0,"score_lmetric":237512},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":35099,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":35099,"score_linear":92209.0,"score_lmetric":235160},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10857,"ongoing_decode_tokens":0,"pending_prefill_tokens":10857,"num_requests":1,"active_p_offloads":0,"cached_blocks":678,"cache_hit":12800,"new_prefill":22299,"score_linear":-1943.0,"score_lmetric":33156},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":35099,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":35099,"score_linear":44920.0,"score_lmetric":35099},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58714,"ongoing_decode_tokens":15969,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":35099,"score_linear":58714.0,"score_lmetric":77864},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":416,"cache_hit":34816,"new_prefill":283,"score_linear":79796.0,"score_lmetric":283}],"chosen_score_linear":79796.0,"chosen_score_lmetric":283,"t_first_token":383845.292505022,"t_first_token_unix":1779814710.3064485,"t_done":383846.362992248,"t_done_unix":1779814711.3769376},{"request_id":"1295690:1:1295690:232","session_id":"1295690","input_length":10857,"t_proxy_recv":383845.109381131,"t_decision_unix":1779814710.123322,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10857,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":10857,"score_linear":96969.0,"score_lmetric":189028},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":10857,"score_linear":92209.0,"score_lmetric":186676},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":678,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":10857,"score_linear":44920.0,"score_lmetric":10857},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58714,"ongoing_decode_tokens":15969,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":10857,"score_linear":58714.0,"score_lmetric":29380},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":10857,"score_linear":148965.0,"score_lmetric":21714}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383845.983692178,"t_first_token_unix":1779814710.9976356,"t_done":383846.416370799,"t_done_unix":1779814711.430314},{"request_id":"1272313:7:1290281:206","session_id":"1272313","input_length":15969,"t_proxy_recv":383842.452558877,"t_decision_unix":1779814707.4665,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":15360,"affinity_cache_ratio":0.96186361074582,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":11873,"score_linear":92873.0,"score_lmetric":191060},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":21947,"ongoing_decode_tokens":0,"pending_prefill_tokens":21947,"num_requests":1,"active_p_offloads":0,"cached_blocks":589,"cache_hit":0,"new_prefill":15969,"score_linear":21947.0,"score_lmetric":37916},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":15969,"score_linear":92209.0,"score_lmetric":196900},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40278,"ongoing_decode_tokens":40278,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":662,"cache_hit":0,"new_prefill":15969,"score_linear":40278.0,"score_lmetric":15969},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":15969,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":8289,"score_linear":37240.0,"score_lmetric":8289},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38788,"ongoing_decode_tokens":38788,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":790,"cache_hit":15360,"new_prefill":609,"score_linear":23428.0,"score_lmetric":609},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":15969,"score_linear":148965.0,"score_lmetric":31938}],"chosen_score_linear":23428.0,"chosen_score_lmetric":609,"t_first_token":383842.539345894,"t_first_token_unix":1779814707.5532892,"t_done":383846.551257593,"t_done_unix":1779814711.5652006},{"request_id":"1287588:2:1289701:205","session_id":"1287588","input_length":10195,"t_proxy_recv":383824.933034769,"t_decision_unix":1779814689.9469757,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":9728,"affinity_cache_ratio":0.954193231976459,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":9610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":497,"cache_hit":0,"new_prefill":10195,"score_linear":9610.0,"score_lmetric":10195},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":10195,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":593,"cache_hit":9728,"new_prefill":467,"score_linear":72286.0,"score_lmetric":82481},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32191,"ongoing_decode_tokens":32191,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":10195,"score_linear":32191.0,"score_lmetric":10195},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":10195,"score_linear":77805.0,"score_lmetric":88000},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":10195,"score_linear":86943.0,"score_lmetric":131812},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":102195,"ongoing_decode_tokens":102195,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":10195,"score_linear":102195.0,"score_lmetric":30585},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":203055,"ongoing_decode_tokens":203055,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":392,"cache_hit":0,"new_prefill":10195,"score_linear":203055.0,"score_lmetric":40780}],"chosen_score_linear":72286.0,"chosen_score_lmetric":82481,"t_first_token":383847.174031697,"t_first_token_unix":1779814712.1879747,"t_done":383847.24429593,"t_done_unix":1779814712.258239},{"request_id":"1294611:2:1295852:233","session_id":"1294611","input_length":23610,"t_proxy_recv":383845.613534831,"t_decision_unix":1779814710.6274762,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9324862346463363,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":1594,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":23610,"score_linear":96969.0,"score_lmetric":214534},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":22016,"new_prefill":1594,"score_linear":-22016.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":23610,"score_linear":92209.0,"score_lmetric":212182},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10857,"ongoing_decode_tokens":0,"pending_prefill_tokens":10857,"num_requests":1,"active_p_offloads":0,"cached_blocks":678,"cache_hit":0,"new_prefill":23610,"score_linear":10857.0,"score_lmetric":34467},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":23610,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":23610,"score_linear":44920.0,"score_lmetric":23610},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58714,"ongoing_decode_tokens":58714,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":806,"cache_hit":12800,"new_prefill":10810,"score_linear":45914.0,"score_lmetric":21620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":149711,"ongoing_decode_tokens":149711,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":416,"cache_hit":12800,"new_prefill":10810,"score_linear":136911.0,"score_lmetric":21620}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":383845.971988565,"t_first_token_unix":1779814710.9859335,"t_done":383847.323351318,"t_done_unix":1779814712.3372948},{"request_id":"1262354:13:1293000:221","session_id":"1262354","input_length":35210,"t_proxy_recv":383846.37126349,"t_decision_unix":1779814711.385205,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9888099971598977,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":394,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":35210,"score_linear":96969.0,"score_lmetric":237734},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23610,"ongoing_decode_tokens":23610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":35210,"score_linear":23610.0,"score_lmetric":35210},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":35210,"score_linear":92209.0,"score_lmetric":235382},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10857,"ongoing_decode_tokens":10857,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":678,"cache_hit":12800,"new_prefill":22410,"score_linear":-1943.0,"score_lmetric":22410},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":35210,"score_linear":44920.0,"score_lmetric":35210},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58714,"ongoing_decode_tokens":58714,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":35210,"score_linear":58714.0,"score_lmetric":70420},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":416,"cache_hit":34816,"new_prefill":394,"score_linear":79796.0,"score_lmetric":394}],"chosen_score_linear":79796.0,"chosen_score_lmetric":394,"t_first_token":383846.450327787,"t_first_token_unix":1779814711.464271,"t_done":383847.664377983,"t_done_unix":1779814712.6783211},{"request_id":"1289570:1:1289570:204","session_id":"1289570","input_length":82014,"t_proxy_recv":383824.455184317,"t_decision_unix":1779814689.469126,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":82014,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":9610,"num_requests":1,"active_p_offloads":0,"cached_blocks":497,"cache_hit":0,"new_prefill":82014,"score_linear":9610.0,"score_lmetric":91624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":82014,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":82014,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32191,"ongoing_decode_tokens":32191,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":82014,"score_linear":32191.0,"score_lmetric":82014},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":82014,"score_linear":77805.0,"score_lmetric":159819},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":0,"pending_prefill_tokens":55711,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":82014,"score_linear":86943.0,"score_lmetric":275450},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":190512,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":82014,"score_linear":190512.0,"score_lmetric":328056},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":203055,"ongoing_decode_tokens":170709,"pending_prefill_tokens":602,"num_requests":4,"active_p_offloads":0,"cached_blocks":392,"cache_hit":0,"new_prefill":82014,"score_linear":203055.0,"score_lmetric":330464}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383847.17176327,"t_first_token_unix":1779814712.1857069,"t_done":383847.700699668,"t_done_unix":1779814712.7146432},{"request_id":"1296872:1:1296872:235","session_id":"1296872","input_length":624,"t_proxy_recv":383849.173224076,"t_decision_unix":1779814714.1871655,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":624,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":624,"score_linear":96969.0,"score_lmetric":168562},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":753,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":624,"score_linear":44920.0,"score_lmetric":624},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":624,"score_linear":71541.0,"score_lmetric":1248},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150047,"ongoing_decode_tokens":150047,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":416,"cache_hit":0,"new_prefill":624,"score_linear":150047.0,"score_lmetric":1248}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383849.237446232,"t_first_token_unix":1779814714.2513897,"t_done":383849.339093989,"t_done_unix":1779814714.3530374},{"request_id":"1296983:1:1296983:236","session_id":"1296983","input_length":1791,"t_proxy_recv":383849.606365759,"t_decision_unix":1779814714.6203072,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1791,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":1791,"score_linear":96969.0,"score_lmetric":170896},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":753,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":1791,"score_linear":44920.0,"score_lmetric":1791},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":1791,"score_linear":71541.0,"score_lmetric":3582},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150047,"ongoing_decode_tokens":150047,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":416,"cache_hit":0,"new_prefill":1791,"score_linear":150047.0,"score_lmetric":3582}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383849.725012345,"t_first_token_unix":1779814714.7389576,"t_done":383849.945877147,"t_done_unix":1779814714.9598205},{"request_id":"1262354:14:1294243:228","session_id":"1262354","input_length":35435,"t_proxy_recv":383847.672434696,"t_decision_unix":1779814712.6863759,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9825313955129109,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":619,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":35435,"score_linear":96969.0,"score_lmetric":238184},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":82014,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":35435,"score_linear":82014.0,"score_lmetric":35435},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":699,"cache_hit":12800,"new_prefill":22635,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":35435,"score_linear":44920.0,"score_lmetric":35435},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":42745,"pending_prefill_tokens":12924,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":35435,"score_linear":71541.0,"score_lmetric":96718},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":416,"cache_hit":34816,"new_prefill":619,"score_linear":79796.0,"score_lmetric":619}],"chosen_score_linear":79796.0,"chosen_score_lmetric":619,"t_first_token":383847.800440674,"t_first_token_unix":1779814712.8143842,"t_done":383850.521058529,"t_done_unix":1779814715.535004},{"request_id":"1272313:8:1293738:226","session_id":"1272313","input_length":28796,"t_proxy_recv":383846.562734369,"t_decision_unix":1779814711.5766761,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":15872,"affinity_cache_ratio":0.5511876649534657,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":12924,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":24700,"score_linear":92873.0,"score_lmetric":216714},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23610,"ongoing_decode_tokens":23610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":28796,"score_linear":23610.0,"score_lmetric":28796},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":28796,"score_linear":92209.0,"score_lmetric":222554},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":28796,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":28796,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":21116,"score_linear":37240.0,"score_lmetric":21116},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42745,"ongoing_decode_tokens":42745,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":807,"cache_hit":15872,"new_prefill":12924,"score_linear":26873.0,"score_lmetric":12924},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":149822,"ongoing_decode_tokens":149822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":416,"cache_hit":0,"new_prefill":28796,"score_linear":149822.0,"score_lmetric":57592}],"chosen_score_linear":26873.0,"chosen_score_lmetric":12924,"t_first_token":383848.757700925,"t_first_token_unix":1779814713.7716444,"t_done":383851.480765989,"t_done_unix":1779814716.4947095},{"request_id":"1275274:1:1275274:136","session_id":"1275274","input_length":114612,"t_proxy_recv":383774.987563865,"t_decision_unix":1779814640.0015051,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":114612,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":114612,"score_linear":135235.0,"score_lmetric":455662},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":114612,"score_linear":120167.0,"score_lmetric":441910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":114612,"score_linear":150574.0,"score_lmetric":464836},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":444,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":114612,"score_linear":121069.0,"score_lmetric":416084},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383817.18990314,"t_first_token_unix":1779814682.2038467,"t_done":383851.830047095,"t_done_unix":1779814716.843991},{"request_id":"1260327:7:1297673:242","session_id":"1260327","input_length":42363,"t_proxy_recv":383851.795203715,"t_decision_unix":1779814716.809145,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41984,"affinity_cache_ratio":0.99105351367939,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":379,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":42363,"score_linear":96969.0,"score_lmetric":252040},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":42363,"score_linear":23863.0,"score_lmetric":42363},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":42363,"score_linear":62414.0,"score_lmetric":85833},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":42363,"score_linear":119700.0,"score_lmetric":243230},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":42363,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":41984,"new_prefill":379,"score_linear":2936.0,"score_lmetric":379},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42745,"ongoing_decode_tokens":42745,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":42363,"score_linear":42745.0,"score_lmetric":42363},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150281,"ongoing_decode_tokens":150281,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":417,"cache_hit":31232,"new_prefill":11131,"score_linear":119049.0,"score_lmetric":22262}],"chosen_score_linear":2936.0,"chosen_score_lmetric":379,"t_first_token":383851.948466596,"t_first_token_unix":1779814716.96241,"t_done":383852.283481896,"t_done_unix":1779814717.2974274},{"request_id":"1277909:3:1289205:201","session_id":"1277909","input_length":44920,"t_proxy_recv":383823.151310724,"t_decision_unix":1779814688.1652524,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":31232,"affinity_cache_ratio":0.6952804986642921,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":13688,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":497,"cache_hit":4096,"new_prefill":40824,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":608,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":44920,"score_linear":77805.0,"score_lmetric":122725},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42023,"ongoing_decode_tokens":0,"pending_prefill_tokens":42023,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":31232,"new_prefill":13688,"score_linear":10791.0,"score_lmetric":55711},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":190512,"ongoing_decode_tokens":190512,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":564,"cache_hit":7680,"new_prefill":37240,"score_linear":182832.0,"score_lmetric":148960},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202554,"ongoing_decode_tokens":202554,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":368,"cache_hit":0,"new_prefill":44920,"score_linear":202554.0,"score_lmetric":179680}],"chosen_score_linear":10791.0,"chosen_score_lmetric":55711,"t_first_token":383831.656349952,"t_first_token_unix":1779814696.6702938,"t_done":383852.426658461,"t_done_unix":1779814717.4406018},{"request_id":"1269373:7:1290314:207","session_id":"1269373","input_length":42745,"t_proxy_recv":383844.277112598,"t_decision_unix":1779814709.291054,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":38912,"affinity_cache_ratio":0.9103286934144345,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38912,"estimated_new_tokens":3833,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":38649,"score_linear":92873.0,"score_lmetric":244612},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":42745,"score_linear":92209.0,"score_lmetric":250452},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":678,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":35065,"score_linear":37240.0,"score_lmetric":35065},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":38912,"new_prefill":3833,"score_linear":-22943.0,"score_lmetric":3833},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148965,"ongoing_decode_tokens":148965,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":415,"cache_hit":0,"new_prefill":42745,"score_linear":148965.0,"score_lmetric":85490}],"chosen_score_linear":-22943.0,"chosen_score_lmetric":3833,"t_first_token":383845.343652145,"t_first_token_unix":1779814710.3575957,"t_done":383852.486775049,"t_done_unix":1779814717.5007184},{"request_id":"1262354:15:1296106:234","session_id":"1262354","input_length":35669,"t_proxy_recv":383850.529074896,"t_decision_unix":1779814715.5430164,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9904398777650061,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":341,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":35669,"score_linear":96969.0,"score_lmetric":238652},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":12800,"new_prefill":22869,"score_linear":46707.0,"score_lmetric":82376},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":35669,"score_linear":44920.0,"score_lmetric":35669},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":35669,"score_linear":71541.0,"score_lmetric":71338},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":417,"cache_hit":35328,"new_prefill":341,"score_linear":79284.0,"score_lmetric":341}],"chosen_score_linear":79284.0,"chosen_score_lmetric":341,"t_first_token":383850.609094774,"t_first_token_unix":1779814715.6230392,"t_done":383853.641676615,"t_done_unix":1779814718.655625},{"request_id":"1290442:2:1298058:246","session_id":"1290442","input_length":11994,"t_proxy_recv":383853.144116782,"t_decision_unix":1779814718.1580582,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7168,"affinity_cache_ratio":0.5976321494080373,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":4826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":11994,"score_linear":96969.0,"score_lmetric":191302},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":7168,"new_prefill":4826,"score_linear":16695.0,"score_lmetric":4826},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":11994,"score_linear":62414.0,"score_lmetric":55464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":11994,"score_linear":119700.0,"score_lmetric":182492},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35622,"ongoing_decode_tokens":0,"pending_prefill_tokens":22822,"num_requests":2,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":11994,"score_linear":35622.0,"score_lmetric":69632},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":11994,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79829,"ongoing_decode_tokens":29149,"pending_prefill_tokens":7672,"num_requests":2,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":11994,"score_linear":79829.0,"score_lmetric":39332},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":35669,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":642,"cache_hit":0,"new_prefill":11994,"score_linear":35669.0,"score_lmetric":11994}],"chosen_score_linear":16695.0,"chosen_score_lmetric":4826,"t_first_token":383853.650338464,"t_first_token_unix":1779814718.6642818,"t_done":383853.76910249,"t_done_unix":1779814718.7830455},{"request_id":"1286551:3:1292589:219","session_id":"1286551","input_length":16914,"t_proxy_recv":383834.350338051,"t_decision_unix":1779814699.3642793,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.54487406881873,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":7698,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":0,"pending_prefill_tokens":75959,"num_requests":1,"active_p_offloads":0,"cached_blocks":524,"cache_hit":9216,"new_prefill":7698,"score_linear":70839.0,"score_lmetric":83657},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":578,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":16914,"score_linear":92209.0,"score_lmetric":198790},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":1536,"new_prefill":15378,"score_linear":76269.0,"score_lmetric":93183},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":16914,"score_linear":44920.0,"score_lmetric":16914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":16914,"score_linear":134705.0,"score_lmetric":50742},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":148640,"ongoing_decode_tokens":148640,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":414,"cache_hit":0,"new_prefill":16914,"score_linear":148640.0,"score_lmetric":33828}],"chosen_score_linear":70839.0,"chosen_score_lmetric":83657,"t_first_token":383854.549392951,"t_first_token_unix":1779814719.5633364,"t_done":383854.895172055,"t_done_unix":1779814719.9091153},{"request_id":"1294611:3:1297534:240","session_id":"1294611","input_length":23863,"t_proxy_recv":383851.451981775,"t_decision_unix":1779814716.465923,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9869672715081926,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":23863,"score_linear":96969.0,"score_lmetric":215040},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":23552,"new_prefill":311,"score_linear":-23552.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":23863,"score_linear":62414.0,"score_lmetric":67333},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":23863,"score_linear":119700.0,"score_lmetric":206230},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":23863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":23863,"score_linear":44920.0,"score_lmetric":23863},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":12800,"new_prefill":11063,"score_linear":58741.0,"score_lmetric":22126},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150281,"ongoing_decode_tokens":150281,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":417,"cache_hit":12800,"new_prefill":11063,"score_linear":137481.0,"score_lmetric":22126}],"chosen_score_linear":-23552.0,"chosen_score_lmetric":0,"t_first_token":383851.505789752,"t_first_token_unix":1779814716.5197332,"t_done":383855.03146395,"t_done_unix":1779814720.045407},{"request_id":"1272313:9:1297810:243","session_id":"1272313","input_length":29149,"t_proxy_recv":383852.291635585,"t_decision_unix":1779814717.3055773,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9836358022573674,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":25053,"score_linear":92873.0,"score_lmetric":217420},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":29149,"score_linear":23863.0,"score_lmetric":29149},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":29149,"score_linear":62414.0,"score_lmetric":72619},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":29149,"score_linear":119700.0,"score_lmetric":216802},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":29149,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":21469,"score_linear":37240.0,"score_lmetric":21469},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42745,"ongoing_decode_tokens":42745,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":832,"cache_hit":28672,"new_prefill":477,"score_linear":14073.0,"score_lmetric":477},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":35669,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":642,"cache_hit":0,"new_prefill":29149,"score_linear":35669.0,"score_lmetric":29149}],"chosen_score_linear":14073.0,"chosen_score_lmetric":477,"t_first_token":383852.395977841,"t_first_token_unix":1779814717.4099212,"t_done":383856.036351011,"t_done_unix":1779814721.0502946},{"request_id":"1297811:1:1297811:244","session_id":"1297811","input_length":13992,"t_proxy_recv":383852.296046122,"t_decision_unix":1779814717.3099878,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13992,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":13992,"score_linear":96969.0,"score_lmetric":195298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":13992,"score_linear":23863.0,"score_lmetric":13992},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":13992,"score_linear":62414.0,"score_lmetric":57462},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":13992,"score_linear":119700.0,"score_lmetric":186488},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":13992,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":1536,"new_prefill":12456,"score_linear":43384.0,"score_lmetric":12456},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71894,"ongoing_decode_tokens":42745,"pending_prefill_tokens":477,"num_requests":2,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":13992,"score_linear":71894.0,"score_lmetric":28938},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":35669,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":642,"cache_hit":0,"new_prefill":13992,"score_linear":35669.0,"score_lmetric":13992}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383853.512968585,"t_first_token_unix":1779814718.526912,"t_done":383856.45807752,"t_done_unix":1779814721.4720204},{"request_id":"1268861:3:1298057:245","session_id":"1268861","input_length":21630,"t_proxy_recv":383853.130415431,"t_decision_unix":1779814718.144357,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":12800,"affinity_cache_ratio":0.5917706888580675,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":8830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":21630,"score_linear":96969.0,"score_lmetric":210574},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":21630,"score_linear":23863.0,"score_lmetric":21630},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":21630,"score_linear":62414.0,"score_lmetric":65100},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":21630,"score_linear":119700.0,"score_lmetric":201764},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":13992,"num_requests":1,"active_p_offloads":0,"cached_blocks":653,"cache_hit":12800,"new_prefill":8830,"score_linear":1192.0,"score_lmetric":22822},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":21630,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79829,"ongoing_decode_tokens":29149,"pending_prefill_tokens":7672,"num_requests":2,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":21630,"score_linear":79829.0,"score_lmetric":58604},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":35669,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":642,"cache_hit":0,"new_prefill":21630,"score_linear":35669.0,"score_lmetric":21630}],"chosen_score_linear":1192.0,"chosen_score_lmetric":22822,"t_first_token":383854.751871348,"t_first_token_unix":1779814719.7658148,"t_done":383857.255717766,"t_done_unix":1779814722.2696614},{"request_id":"1298970:1:1298970:248","session_id":"1298970","input_length":9530,"t_proxy_recv":383856.412290074,"t_decision_unix":1779814721.4262314,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":0,"new_prefill":9530,"score_linear":80055.0,"score_lmetric":9530},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":9530,"score_linear":62414.0,"score_lmetric":53000},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":9530,"score_linear":144803.0,"score_lmetric":267927},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35622,"ongoing_decode_tokens":35622,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":9530,"score_linear":35622.0,"score_lmetric":19060},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":9530,"score_linear":50680.0,"score_lmetric":9530},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":643,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383857.136066971,"t_first_token_unix":1779814722.1500113,"t_done":383857.318959361,"t_done_unix":1779814722.3329027},{"request_id":"1299073:1:1299073:249","session_id":"1299073","input_length":881,"t_proxy_recv":383856.772105386,"t_decision_unix":1779814721.7860463,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":881,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":0,"new_prefill":881,"score_linear":80055.0,"score_lmetric":881},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":881,"score_linear":62414.0,"score_lmetric":44351},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":881,"score_linear":144803.0,"score_lmetric":241980},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21630,"ongoing_decode_tokens":21630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":680,"cache_hit":0,"new_prefill":881,"score_linear":21630.0,"score_lmetric":881},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":881,"score_linear":50680.0,"score_lmetric":881},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9530,"ongoing_decode_tokens":0,"pending_prefill_tokens":9530,"num_requests":1,"active_p_offloads":0,"cached_blocks":643,"cache_hit":0,"new_prefill":881,"score_linear":9530.0,"score_lmetric":10411}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383856.849195498,"t_first_token_unix":1779814721.863139,"t_done":383857.954386839,"t_done_unix":1779814722.96833},{"request_id":"1296983:2:1299368:250","session_id":"1296983","input_length":7963,"t_proxy_recv":383857.597333945,"t_decision_unix":1779814722.6112752,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.1928921260831345,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7963,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":0,"new_prefill":7963,"score_linear":80055.0,"score_lmetric":7963},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":7963,"score_linear":881.0,"score_lmetric":7963},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":1536,"new_prefill":6427,"score_linear":60878.0,"score_lmetric":49897},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":7963,"score_linear":144803.0,"score_lmetric":263226},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":7963,"score_linear":50680.0,"score_lmetric":7963},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383858.147232955,"t_first_token_unix":1779814723.1611762,"t_done":383858.337361003,"t_done_unix":1779814723.3513045},{"request_id":"1296872:2:1299394:251","session_id":"1296872","input_length":8352,"t_proxy_recv":383857.710368691,"t_decision_unix":1779814722.72431,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":4,"affinity_cache_hit":512,"affinity_cache_ratio":0.06130268199233716,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8352,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":0,"new_prefill":8352,"score_linear":80055.0,"score_lmetric":8352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":646,"cache_hit":512,"new_prefill":7840,"score_linear":369.0,"score_lmetric":7840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":8352,"score_linear":62414.0,"score_lmetric":51822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":8352,"score_linear":144803.0,"score_lmetric":264393},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":8352,"score_linear":7963.0,"score_lmetric":16315},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":8352,"score_linear":50680.0,"score_lmetric":8352},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383858.321351648,"t_first_token_unix":1779814723.3352952,"t_done":383858.451915695,"t_done_unix":1779814723.4658587},{"request_id":"1269373:8:1295332:230","session_id":"1269373","input_length":50680,"t_proxy_recv":383852.49864004,"t_decision_unix":1779814717.5125816,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":43008,"affinity_cache_ratio":0.8486187845303867,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":43008,"estimated_new_tokens":7672,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":46584,"score_linear":92873.0,"score_lmetric":260482},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":50680,"score_linear":23863.0,"score_lmetric":50680},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":50680,"score_linear":62414.0,"score_lmetric":94150},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":50680,"score_linear":119700.0,"score_lmetric":259864},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":13992,"num_requests":1,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":50680,"score_linear":13992.0,"score_lmetric":64672},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":7680,"new_prefill":43000,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29149,"ongoing_decode_tokens":29149,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":43008,"new_prefill":7672,"score_linear":-13859.0,"score_lmetric":7672},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":35669,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":642,"cache_hit":0,"new_prefill":50680,"score_linear":35669.0,"score_lmetric":50680}],"chosen_score_linear":-13859.0,"chosen_score_lmetric":7672,"t_first_token":383854.846288434,"t_first_token_unix":1779814719.8602316,"t_done":383859.057535996,"t_done_unix":1779814724.0714798},{"request_id":"1266668:6:1284003:181","session_id":"1266668","input_length":80055,"t_proxy_recv":383832.12801044,"t_decision_unix":1779814697.1419518,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":0,"affinity_cache_hit":58368,"affinity_cache_ratio":0.7290987446130786,"affinity_num_requests":3,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":75959,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":524,"cache_hit":4096,"new_prefill":75959,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":563,"cache_hit":0,"new_prefill":80055,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92209,"ongoing_decode_tokens":0,"pending_prefill_tokens":82481,"num_requests":2,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":80055,"score_linear":92209.0,"score_lmetric":325072},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":650,"cache_hit":0,"new_prefill":80055,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":489,"cache_hit":0,"new_prefill":80055,"score_linear":77805.0,"score_lmetric":157860},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":86943,"ongoing_decode_tokens":86943,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":490,"cache_hit":7680,"new_prefill":72375,"score_linear":79263.0,"score_lmetric":144750},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":134705,"ongoing_decode_tokens":134705,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":784,"cache_hit":58368,"new_prefill":21687,"score_linear":76337.0,"score_lmetric":65061},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190904,"ongoing_decode_tokens":190904,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":80055,"score_linear":190904.0,"score_lmetric":240165}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":383854.378879338,"t_first_token_unix":1779814719.3928227,"t_done":383859.174445612,"t_done_unix":1779814724.1883898},{"request_id":"1292750:2:1299406:252","session_id":"1292750","input_length":19157,"t_proxy_recv":383857.755361958,"t_decision_unix":1779814722.7693036,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.24053870647804979,"affinity_num_requests":3,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":19157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":0,"new_prefill":19157,"score_linear":80055.0,"score_lmetric":19157},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":19157,"score_linear":881.0,"score_lmetric":19157},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":19157,"score_linear":62414.0,"score_lmetric":62627},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":4608,"new_prefill":14549,"score_linear":140195.0,"score_lmetric":282984},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":8352,"num_requests":1,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":19157,"score_linear":8352.0,"score_lmetric":27509},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":19157,"score_linear":7963.0,"score_lmetric":27120},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":19157,"score_linear":50680.0,"score_lmetric":19157},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":19157,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383859.693423763,"t_first_token_unix":1779814724.7073677,"t_done":383859.781042612,"t_done_unix":1779814724.7949886},{"request_id":"1272313:10:1299814:254","session_id":"1272313","input_length":29486,"t_proxy_recv":383859.129523671,"t_decision_unix":1779814724.1434653,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9897578511836126,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":4096,"new_prefill":25390,"score_linear":75959.0,"score_lmetric":25390},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":0,"pending_prefill_tokens":18893,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":29486,"score_linear":18893.0,"score_lmetric":48379},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":29486,"score_linear":62414.0,"score_lmetric":72956},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":29486,"score_linear":144803.0,"score_lmetric":327795},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":29486,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":21806,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":29184,"new_prefill":302,"score_linear":-29184.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":29486,"score_linear":19157.0,"score_lmetric":48643}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":383859.24682196,"t_first_token_unix":1779814724.260765,"t_done":383860.684851675,"t_done_unix":1779814725.698795},{"request_id":"1286804:2:1300234:256","session_id":"1286804","input_length":14213,"t_proxy_recv":383860.5777662,"t_decision_unix":1779814725.5917077,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.9726306902131852,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":0,"pending_prefill_tokens":7357,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":0,"new_prefill":14213,"score_linear":87741.0,"score_lmetric":21570},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":14213,"score_linear":18893.0,"score_lmetric":14213},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":14213,"score_linear":62414.0,"score_lmetric":57683},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":14213,"score_linear":144803.0,"score_lmetric":281976},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":713,"cache_hit":1536,"new_prefill":12677,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":13824,"new_prefill":389,"score_linear":-13824.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29486,"ongoing_decode_tokens":29486,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":14213,"score_linear":29486.0,"score_lmetric":14213},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":14213,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":383860.633578899,"t_first_token_unix":1779814725.647522,"t_done":383861.267706742,"t_done_unix":1779814726.2816498},{"request_id":"1294611:4:1300505:257","session_id":"1294611","input_length":24384,"t_proxy_recv":383861.595857358,"t_decision_unix":1779814726.6097987,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9868766404199475,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":0,"pending_prefill_tokens":7357,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":0,"new_prefill":24384,"score_linear":87741.0,"score_lmetric":31741},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":24064,"new_prefill":320,"score_linear":-5171.0,"score_lmetric":320},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":24384,"score_linear":62414.0,"score_lmetric":67854},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":24384,"score_linear":144803.0,"score_lmetric":312489},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":24384,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":24384,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":12800,"new_prefill":11584,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":12800,"new_prefill":11584,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-5171.0,"chosen_score_lmetric":320,"t_first_token":383861.654086723,"t_first_token_unix":1779814726.6680303,"t_done":383862.120786098,"t_done_unix":1779814727.1347296},{"request_id":"1297473:1:1297473:239","session_id":"1297473","input_length":62414,"t_proxy_recv":383851.351862619,"t_decision_unix":1779814716.365804,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":43470,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":62414,"score_linear":96969.0,"score_lmetric":292142},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":756,"cache_hit":18944,"new_prefill":43470,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":62414,"score_linear":119700.0,"score_lmetric":283332},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":62414,"score_linear":44920.0,"score_lmetric":62414},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":62414,"score_linear":71541.0,"score_lmetric":124828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150281,"ongoing_decode_tokens":150281,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":417,"cache_hit":0,"new_prefill":62414,"score_linear":150281.0,"score_lmetric":124828}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":383863.425965292,"t_first_token_unix":1779814728.4399085,"t_done":383863.749706549,"t_done_unix":1779814728.7636542},{"request_id":"1294611:5:1301356:262","session_id":"1294611","input_length":25650,"t_proxy_recv":383864.418396185,"t_decision_unix":1779814729.4323378,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9381676413255361,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":1586,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":87741,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":0,"new_prefill":25650,"score_linear":87741.0,"score_lmetric":25650},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":24064,"new_prefill":1586,"score_linear":-5171.0,"score_lmetric":1586},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":25650,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":25650,"score_linear":144803.0,"score_lmetric":316287},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":25650,"score_linear":43607.0,"score_lmetric":55433},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":25650,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":0,"pending_prefill_tokens":3763,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":12800,"new_prefill":12850,"score_linear":41651.0,"score_lmetric":16613},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":12800,"new_prefill":12850,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-5171.0,"chosen_score_lmetric":1586,"t_first_token":383864.699808979,"t_first_token_unix":1779814729.7137523,"t_done":383865.093203389,"t_done_unix":1779814730.1071467},{"request_id":"1299507:1:1299507:253","session_id":"1299507","input_length":18893,"t_proxy_recv":383858.012215303,"t_decision_unix":1779814723.0261564,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18893,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":80055,"ongoing_decode_tokens":80055,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":532,"cache_hit":0,"new_prefill":18893,"score_linear":80055.0,"score_lmetric":18893},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":18893,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":18893,"score_linear":62414.0,"score_lmetric":62363},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":18893,"score_linear":144803.0,"score_lmetric":296016},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":8352,"num_requests":1,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":18893,"score_linear":8352.0,"score_lmetric":27245},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":18893,"score_linear":7963.0,"score_lmetric":26856},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":841,"cache_hit":11776,"new_prefill":7117,"score_linear":38904.0,"score_lmetric":7117},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":18893,"score_linear":19157.0,"score_lmetric":38050}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383859.920234001,"t_first_token_unix":1779814724.9341776,"t_done":383865.994485739,"t_done_unix":1779814731.0084288},{"request_id":"1266668:7:1287468:197","session_id":"1266668","input_length":87741,"t_proxy_recv":383859.193203224,"t_decision_unix":1779814724.2071447,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":80384,"affinity_cache_ratio":0.916150944256391,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":80384,"estimated_new_tokens":7357,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":681,"cache_hit":80384,"new_prefill":7357,"score_linear":-80384.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":0,"pending_prefill_tokens":18893,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":87741,"score_linear":18893.0,"score_lmetric":106634},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":87741,"score_linear":62414.0,"score_lmetric":131211},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":87741,"score_linear":144803.0,"score_lmetric":502560},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":87741,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":80061,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29486,"ongoing_decode_tokens":0,"pending_prefill_tokens":302,"num_requests":1,"active_p_offloads":0,"cached_blocks":856,"cache_hit":58368,"new_prefill":29373,"score_linear":-28882.0,"score_lmetric":29675},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":87741,"score_linear":19157.0,"score_lmetric":106898}],"chosen_score_linear":-80384.0,"chosen_score_lmetric":0,"t_first_token":383863.100176497,"t_first_token_unix":1779814728.1141202,"t_done":383867.039305557,"t_done_unix":1779814732.0532494},{"request_id":"1302071:1:1302071:267","session_id":"1302071","input_length":6527,"t_proxy_recv":383867.13918723,"t_decision_unix":1779814732.1531289,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":6527,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6527,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":6527,"score_linear":96105.0,"score_lmetric":14568},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":6527,"score_linear":34706.0,"score_lmetric":41233},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":6527,"score_linear":26441.0,"score_lmetric":32968},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":6527,"score_linear":144803.0,"score_lmetric":80397},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":6527,"score_linear":43607.0,"score_lmetric":36310},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":6527,"score_linear":43181.0,"score_lmetric":6527},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":6527,"score_linear":54451.0,"score_lmetric":6527},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":6527,"score_linear":28972.0,"score_lmetric":35499}],"chosen_score_linear":54451.0,"chosen_score_lmetric":6527,"t_first_token":383867.586213099,"t_first_token_unix":1779814732.6001563,"t_done":383868.022769062,"t_done_unix":1779814733.0367138},{"request_id":"1269373:9:1300958:261","session_id":"1269373","input_length":54451,"t_proxy_recv":383863.264036825,"t_decision_unix":1779814728.2779784,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":50688,"affinity_cache_ratio":0.9308919946373804,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":3763,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":87741,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":7680,"new_prefill":46771,"score_linear":80061.0,"score_lmetric":46771},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":54451,"score_linear":18893.0,"score_lmetric":54451},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":54451,"score_linear":62414.0,"score_lmetric":97921},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":54451,"score_linear":144803.0,"score_lmetric":402690},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":54451,"score_linear":43607.0,"score_lmetric":84234},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":46771,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":50688,"new_prefill":3763,"score_linear":-50688.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":54451,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-50688.0,"chosen_score_lmetric":0,"t_first_token":383864.531014294,"t_first_token_unix":1779814729.5449576,"t_done":383868.982016892,"t_done_unix":1779814733.9959605},{"request_id":"1302449:1:1302449:269","session_id":"1302449","input_length":1105,"t_proxy_recv":383868.671522601,"t_decision_unix":1779814733.6854641,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":1105,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1105,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":1105,"score_linear":96105.0,"score_lmetric":9146},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":1105,"score_linear":34706.0,"score_lmetric":35811},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":1105,"score_linear":26441.0,"score_lmetric":27546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":1105,"score_linear":144803.0,"score_lmetric":64131},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":1105,"score_linear":43607.0,"score_lmetric":1105},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":1105,"score_linear":93036.0,"score_lmetric":101920},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":869,"cache_hit":0,"new_prefill":1105,"score_linear":54451.0,"score_lmetric":1105},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":1105,"score_linear":28972.0,"score_lmetric":30077}],"chosen_score_linear":54451.0,"chosen_score_lmetric":1105,"t_first_token":383868.846739884,"t_first_token_unix":1779814733.8606832,"t_done":383869.596213813,"t_done_unix":1779814734.610157},{"request_id":"1295690:2:1301706:264","session_id":"1295690","input_length":28972,"t_proxy_recv":383865.705929015,"t_decision_unix":1779814730.7198706,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.37111694049427035,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":28972,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":87741,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":0,"new_prefill":28972,"score_linear":87741.0,"score_lmetric":28972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":651,"cache_hit":0,"new_prefill":28972,"score_linear":18893.0,"score_lmetric":28972},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":10752,"new_prefill":18220,"score_linear":134051.0,"score_lmetric":115476},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":28972,"score_linear":43607.0,"score_lmetric":58755},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":0,"pending_prefill_tokens":1197,"num_requests":1,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":28972,"score_linear":43181.0,"score_lmetric":30169},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":28972,"score_linear":54451.0,"score_lmetric":28972},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383869.431980694,"t_first_token_unix":1779814734.4459238,"t_done":383869.688556388,"t_done_unix":1779814734.7025},{"request_id":"1302063:1:1302063:266","session_id":"1302063","input_length":26441,"t_proxy_recv":383867.135108201,"t_decision_unix":1779814732.1490498,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":26441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":26441,"score_linear":96105.0,"score_lmetric":34482},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":26441,"score_linear":34706.0,"score_lmetric":61147},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":26441,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":26441,"score_linear":144803.0,"score_lmetric":140139},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":26441,"score_linear":43607.0,"score_lmetric":56224},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":26441,"score_linear":43181.0,"score_lmetric":26441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":26441,"score_linear":54451.0,"score_lmetric":26441},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":26441,"score_linear":28972.0,"score_lmetric":55413}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383870.371636142,"t_first_token_unix":1779814735.3855796,"t_done":383870.621854219,"t_done_unix":1779814735.6357985},{"request_id":"1302907:1:1302907:272","session_id":"1302907","input_length":15958,"t_proxy_recv":383870.039016581,"t_decision_unix":1779814735.052958,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":15958,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":15958,"score_linear":96105.0,"score_lmetric":23999},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":15958,"score_linear":65351.0,"score_lmetric":111418},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":15958,"score_linear":26441.0,"score_lmetric":42399},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":144803,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":15958,"score_linear":144803.0,"score_lmetric":47874},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":15958,"score_linear":43607.0,"score_lmetric":15958},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":15958,"score_linear":93036.0,"score_lmetric":131626},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":879,"cache_hit":0,"new_prefill":15958,"score_linear":29948.0,"score_lmetric":15958},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":754,"cache_hit":0,"new_prefill":15958,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383871.491181084,"t_first_token_unix":1779814736.5051248,"t_done":383871.689459316,"t_done_unix":1779814736.7034025},{"request_id":"1290365:4:1298540:247","session_id":"1290365","input_length":25103,"t_proxy_recv":383854.852792618,"t_decision_unix":1779814719.866734,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24576,"affinity_cache_ratio":0.979006493247819,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":527,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":96969,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":25103,"score_linear":96969.0,"score_lmetric":50206},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":645,"cache_hit":0,"new_prefill":25103,"score_linear":23863.0,"score_lmetric":25103},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":25103,"score_linear":62414.0,"score_lmetric":68573},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":0,"pending_prefill_tokens":79252,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":24576,"new_prefill":527,"score_linear":95124.0,"score_lmetric":159558},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35622,"ongoing_decode_tokens":35622,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":25103,"score_linear":35622.0,"score_lmetric":50206},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79829,"ongoing_decode_tokens":79829,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":25103,"score_linear":79829.0,"score_lmetric":50206},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":643,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":95124.0,"chosen_score_lmetric":159558,"t_first_token":383869.192159974,"t_first_token_unix":1779814734.206103,"t_done":383872.365671845,"t_done_unix":1779814737.3796153},{"request_id":"1266668:8:1292408:218","session_id":"1266668","input_length":96105,"t_proxy_recv":383867.059309903,"t_decision_unix":1779814732.0732512,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":88064,"affinity_cache_ratio":0.916331096196868,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":8041,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":696,"cache_hit":88064,"new_prefill":8041,"score_linear":-88064.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":96105,"score_linear":34706.0,"score_lmetric":130811},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":96105,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":96105,"score_linear":144803.0,"score_lmetric":349131},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":96105,"score_linear":43607.0,"score_lmetric":125888},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":88425,"score_linear":35501.0,"score_lmetric":88425},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":58368,"new_prefill":37737,"score_linear":-3917.0,"score_lmetric":37737},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":96105,"score_linear":28972.0,"score_lmetric":125077}],"chosen_score_linear":-88064.0,"chosen_score_lmetric":0,"t_first_token":383871.695498876,"t_first_token_unix":1779814736.709442,"t_done":383872.5711776,"t_done_unix":1779814737.5851214},{"request_id":"1302449:2:1303563:277","session_id":"1302449","input_length":3709,"t_proxy_recv":383872.363118996,"t_decision_unix":1779814737.3770604,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":1024,"affinity_cache_ratio":0.27608519816662175,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":2685,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":2685,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":96105,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":3709,"score_linear":96105.0,"score_lmetric":3709},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":3709,"score_linear":65351.0,"score_lmetric":86920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":3709,"score_linear":14944.0,"score_lmetric":18653},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":144803,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":3709,"score_linear":144803.0,"score_lmetric":11127},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":3709,"score_linear":43607.0,"score_lmetric":3709},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":3709,"score_linear":93036.0,"score_lmetric":107128},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":879,"cache_hit":1024,"new_prefill":2685,"score_linear":28924.0,"score_lmetric":2685},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":3709,"score_linear":15081.0,"score_lmetric":18790}],"chosen_score_linear":28924.0,"chosen_score_lmetric":2685,"t_first_token":383872.56302154,"t_first_token_unix":1779814737.576965,"t_done":383872.892166835,"t_done_unix":1779814737.9061103},{"request_id":"1303651:1:1303651:278","session_id":"1303651","input_length":3065,"t_proxy_recv":383872.669261879,"t_decision_unix":1779814737.6832032,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":3065,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3065,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96717,"ongoing_decode_tokens":0,"pending_prefill_tokens":973,"num_requests":1,"active_p_offloads":0,"cached_blocks":711,"cache_hit":0,"new_prefill":3065,"score_linear":96717.0,"score_lmetric":4038},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":65351,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":3065,"score_linear":65351.0,"score_lmetric":6130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":3065,"score_linear":14944.0,"score_lmetric":18009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145648,"ongoing_decode_tokens":145648,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":700,"cache_hit":0,"new_prefill":3065,"score_linear":145648.0,"score_lmetric":9195},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":3065,"score_linear":43607.0,"score_lmetric":3065},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":3065,"score_linear":93036.0,"score_lmetric":105840},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33657,"ongoing_decode_tokens":33657,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":879,"cache_hit":0,"new_prefill":3065,"score_linear":33657.0,"score_lmetric":6130},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":3065,"score_linear":15081.0,"score_lmetric":18146}],"chosen_score_linear":43607.0,"chosen_score_lmetric":3065,"t_first_token":383872.915212456,"t_first_token_unix":1779814737.9291556,"t_done":383873.29609665,"t_done_unix":1779814738.3100417},{"request_id":"1266668:9:1295576:231","session_id":"1266668","input_length":96717,"t_proxy_recv":383872.588154028,"t_decision_unix":1779814737.6020954,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9899397210418024,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":973,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":711,"cache_hit":95744,"new_prefill":973,"score_linear":-95744.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":96717,"score_linear":65351.0,"score_lmetric":272936},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":96717,"score_linear":14944.0,"score_lmetric":111661},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145648,"ongoing_decode_tokens":119700,"pending_prefill_tokens":860,"num_requests":3,"active_p_offloads":0,"cached_blocks":700,"cache_hit":0,"new_prefill":96717,"score_linear":145648.0,"score_lmetric":292731},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":96717,"score_linear":43607.0,"score_lmetric":96717},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":89037,"score_linear":85356.0,"score_lmetric":277784},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33657,"ongoing_decode_tokens":33657,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":879,"cache_hit":58368,"new_prefill":38349,"score_linear":-24711.0,"score_lmetric":76698},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":96717,"score_linear":15081.0,"score_lmetric":111798}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":383873.090370971,"t_first_token_unix":1779814738.1043146,"t_done":383873.375503948,"t_done_unix":1779814738.3894475},{"request_id":"1297117:1:1297117:237","session_id":"1297117","input_length":59507,"t_proxy_recv":383850.087503794,"t_decision_unix":1779814715.1014452,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":59507,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":59507,"score_linear":96969.0,"score_lmetric":286328},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":59507,"score_linear":44920.0,"score_lmetric":59507},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":59507,"score_linear":71541.0,"score_lmetric":119014},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150047,"ongoing_decode_tokens":150047,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":416,"cache_hit":0,"new_prefill":59507,"score_linear":150047.0,"score_lmetric":119014}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383864.499061402,"t_first_token_unix":1779814729.5130048,"t_done":383873.553315906,"t_done_unix":1779814738.5672593},{"request_id":"1279412:7:1297236:238","session_id":"1279412","input_length":60193,"t_proxy_recv":383850.616911455,"t_decision_unix":1779814715.6308527,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":40448,"affinity_cache_ratio":0.6719718239662419,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":19745,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96969,"ongoing_decode_tokens":0,"pending_prefill_tokens":83657,"num_requests":2,"active_p_offloads":0,"cached_blocks":524,"cache_hit":0,"new_prefill":60193,"score_linear":96969.0,"score_lmetric":287700},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":40448,"new_prefill":19745,"score_linear":19059.0,"score_lmetric":79252},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":653,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":60193,"score_linear":44920.0,"score_lmetric":60193},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71541,"ongoing_decode_tokens":71541,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":807,"cache_hit":0,"new_prefill":60193,"score_linear":71541.0,"score_lmetric":120386},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":150281,"ongoing_decode_tokens":150281,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":417,"cache_hit":12800,"new_prefill":47393,"score_linear":137481.0,"score_lmetric":94786}],"chosen_score_linear":19059.0,"chosen_score_lmetric":79252,"t_first_token":383869.187206746,"t_first_token_unix":1779814734.2011502,"t_done":383873.573266739,"t_done_unix":1779814738.58721},{"request_id":"1303517:1:1303517:275","session_id":"1303517","input_length":15081,"t_proxy_recv":383872.235348378,"t_decision_unix":1779814737.2492898,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":15081,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":96105,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":15081,"score_linear":96105.0,"score_lmetric":15081},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":15081,"score_linear":65351.0,"score_lmetric":109664},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":15081,"score_linear":14944.0,"score_lmetric":30025},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":144803,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":15081,"score_linear":144803.0,"score_lmetric":45243},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":15081,"score_linear":43607.0,"score_lmetric":15081},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":15081,"score_linear":93036.0,"score_lmetric":129872},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":879,"cache_hit":0,"new_prefill":15081,"score_linear":29948.0,"score_lmetric":15081},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":15081,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383873.577744734,"t_first_token_unix":1779814738.591688,"t_done":383873.905034931,"t_done_unix":1779814738.9189782},{"request_id":"1303462:1:1303462:274","session_id":"1303462","input_length":14944,"t_proxy_recv":383872.069828094,"t_decision_unix":1779814737.0837696,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":96105,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":14944,"score_linear":96105.0,"score_lmetric":14944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":14944,"score_linear":65351.0,"score_lmetric":109390},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":144803,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":14944,"score_linear":144803.0,"score_lmetric":44832},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":14944,"score_linear":43607.0,"score_lmetric":14944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":14944,"score_linear":93036.0,"score_lmetric":129598},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":879,"cache_hit":0,"new_prefill":14944,"score_linear":29948.0,"score_lmetric":14944},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383873.40138511,"t_first_token_unix":1779814738.415328,"t_done":383874.590986304,"t_done_unix":1779814739.6049297},{"request_id":"1302063:2:1303816:279","session_id":"1302063","input_length":30248,"t_proxy_recv":383873.344127564,"t_decision_unix":1779814738.3580687,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26112,"affinity_cache_ratio":0.8632636868553293,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":4136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96717,"ongoing_decode_tokens":96717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":711,"cache_hit":0,"new_prefill":30248,"score_linear":96717.0,"score_lmetric":30248},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":65351,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":30248,"score_linear":65351.0,"score_lmetric":60496},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":891,"cache_hit":26112,"new_prefill":4136,"score_linear":-11168.0,"score_lmetric":19080},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145648,"ongoing_decode_tokens":145648,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":700,"cache_hit":0,"new_prefill":30248,"score_linear":145648.0,"score_lmetric":90744},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":30248,"score_linear":43607.0,"score_lmetric":30248},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":30248,"score_linear":93036.0,"score_lmetric":160206},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":30248,"score_linear":29948.0,"score_lmetric":30248},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":30248,"score_linear":15081.0,"score_lmetric":45329}],"chosen_score_linear":-11168.0,"chosen_score_lmetric":19080,"t_first_token":383874.226645531,"t_first_token_unix":1779814739.240589,"t_done":383874.591567113,"t_done_unix":1779814739.6055102},{"request_id":"1304239:1:1304239:280","session_id":"1304239","input_length":1300,"t_proxy_recv":383874.868651757,"t_decision_unix":1779814739.882593,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1300,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":1300,"score_linear":97145.0,"score_lmetric":1300},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":65351,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":1300,"score_linear":65351.0,"score_lmetric":2600},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":928,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":86626,"ongoing_decode_tokens":86626,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":1300,"score_linear":86626.0,"score_lmetric":2600},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":1300,"score_linear":43607.0,"score_lmetric":1300},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":1300,"score_linear":93036.0,"score_lmetric":102310},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":1300,"score_linear":29948.0,"score_lmetric":1300},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":814,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383874.963201399,"t_first_token_unix":1779814739.977147,"t_done":383875.104329038,"t_done_unix":1779814740.1182723},{"request_id":"1294611:6:1302460:270","session_id":"1294611","input_length":30645,"t_proxy_recv":383868.692829191,"t_decision_unix":1779814733.7067704,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":25600,"affinity_cache_ratio":0.8353728177516724,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":25600,"estimated_new_tokens":5045,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":30645,"score_linear":96105.0,"score_lmetric":38686},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":25600,"new_prefill":5045,"score_linear":9106.0,"score_lmetric":39751},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":30645,"score_linear":26441.0,"score_lmetric":57086},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":30645,"score_linear":144803.0,"score_lmetric":152751},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":30645,"score_linear":43607.0,"score_lmetric":30645},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":30645,"score_linear":93036.0,"score_lmetric":161000},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":55556,"ongoing_decode_tokens":54451,"pending_prefill_tokens":1105,"num_requests":2,"active_p_offloads":0,"cached_blocks":869,"cache_hit":12800,"new_prefill":17845,"score_linear":42756.0,"score_lmetric":37900},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":12800,"new_prefill":17845,"score_linear":16172.0,"score_lmetric":46817}],"chosen_score_linear":9106.0,"chosen_score_lmetric":39751,"t_first_token":383872.604099701,"t_first_token_unix":1779814737.6180432,"t_done":383875.46936711,"t_done_unix":1779814740.4833102},{"request_id":"1279412:8:1300001:255","session_id":"1279412","input_length":60678,"t_proxy_recv":383873.585834257,"t_decision_unix":1779814738.5997758,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":60416,"affinity_cache_ratio":0.9956821253172484,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":262,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97145,"ongoing_decode_tokens":0,"pending_prefill_tokens":889,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":60678,"score_linear":97145.0,"score_lmetric":61567},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":65351,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":60678,"score_linear":65351.0,"score_lmetric":121356},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45192,"ongoing_decode_tokens":14944,"pending_prefill_tokens":4136,"num_requests":2,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":60678,"score_linear":45192.0,"score_lmetric":129628},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":25948,"ongoing_decode_tokens":25948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":60416,"new_prefill":262,"score_linear":-34468.0,"score_lmetric":262},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":60678,"score_linear":43607.0,"score_lmetric":60678},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":60678,"score_linear":93036.0,"score_lmetric":221066},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":60678,"score_linear":29948.0,"score_lmetric":60678},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":15081,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":12800,"new_prefill":47878,"score_linear":2281.0,"score_lmetric":47878}],"chosen_score_linear":-34468.0,"chosen_score_lmetric":262,"t_first_token":383873.806223833,"t_first_token_unix":1779814738.8201678,"t_done":383875.951120803,"t_done_unix":1779814740.9650645},{"request_id":"1290365:5:1300807:259","session_id":"1290365","input_length":25948,"t_proxy_recv":383872.374156055,"t_decision_unix":1779814737.3880975,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9668567905040851,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":860,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":96105,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":25948,"score_linear":96105.0,"score_lmetric":25948},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":25948,"score_linear":65351.0,"score_lmetric":131398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":25948,"score_linear":14944.0,"score_lmetric":40892},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119700,"ongoing_decode_tokens":119700,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":700,"cache_hit":25088,"new_prefill":860,"score_linear":94612.0,"score_lmetric":1720},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":25948,"score_linear":43607.0,"score_lmetric":25948},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":25948,"score_linear":93036.0,"score_lmetric":151606},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33657,"ongoing_decode_tokens":29948,"pending_prefill_tokens":2685,"num_requests":2,"active_p_offloads":0,"cached_blocks":879,"cache_hit":0,"new_prefill":25948,"score_linear":33657.0,"score_lmetric":57266},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":25948,"score_linear":15081.0,"score_lmetric":41029}],"chosen_score_linear":94612.0,"chosen_score_lmetric":1720,"t_first_token":383872.606677025,"t_first_token_unix":1779814737.6206203,"t_done":383876.332582705,"t_done_unix":1779814741.3465261},{"request_id":"1266668:10:1297641:241","session_id":"1266668","input_length":97145,"t_proxy_recv":383873.392203893,"t_decision_unix":1779814738.4061456,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":96256,"affinity_cache_ratio":0.9908487312779866,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":96256,"estimated_new_tokens":889,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":712,"cache_hit":96256,"new_prefill":889,"score_linear":-96256.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":65351,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":97145,"score_linear":65351.0,"score_lmetric":194290},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45192,"ongoing_decode_tokens":0,"pending_prefill_tokens":19080,"num_requests":2,"active_p_offloads":0,"cached_blocks":891,"cache_hit":0,"new_prefill":97145,"score_linear":45192.0,"score_lmetric":232450},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145648,"ongoing_decode_tokens":145648,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":700,"cache_hit":0,"new_prefill":97145,"score_linear":145648.0,"score_lmetric":291435},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":97145,"score_linear":43607.0,"score_lmetric":97145},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":89465,"score_linear":85356.0,"score_lmetric":278640},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":58368,"new_prefill":38777,"score_linear":-28420.0,"score_lmetric":38777},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":785,"cache_hit":0,"new_prefill":97145,"score_linear":15081.0,"score_lmetric":112226}],"chosen_score_linear":-96256.0,"chosen_score_lmetric":0,"t_first_token":383873.878534601,"t_first_token_unix":1779814738.8924787,"t_done":383876.614489974,"t_done_unix":1779814741.6284428},{"request_id":"1304239:2:1304866:281","session_id":"1304239","input_length":7798,"t_proxy_recv":383877.021900132,"t_decision_unix":1779814742.0358412,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":1024,"affinity_cache_ratio":0.13131572197999486,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":6774,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":0,"pending_prefill_tokens":531,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":7798,"score_linear":97811.0,"score_lmetric":8329},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":7798,"score_linear":34706.0,"score_lmetric":7798},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":928,"cache_hit":0,"new_prefill":7798,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":7798,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":7798,"score_linear":43607.0,"score_lmetric":7798},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":7798,"score_linear":93036.0,"score_lmetric":115306},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":7798,"score_linear":29948.0,"score_lmetric":7798},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":1024,"new_prefill":6774,"score_linear":-1024.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":383877.497521576,"t_first_token_unix":1779814742.5114646,"t_done":383877.645536558,"t_done_unix":1779814742.659481},{"request_id":"1304943:1:1304943:283","session_id":"1304943","input_length":2772,"t_proxy_recv":383877.272049017,"t_decision_unix":1779814742.2859907,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2772,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":2772,"score_linear":97811.0,"score_lmetric":2772},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":2772,"score_linear":34706.0,"score_lmetric":2772},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":928,"cache_hit":0,"new_prefill":2772,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":2772,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":2772,"score_linear":43607.0,"score_lmetric":2772},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":2772,"score_linear":93036.0,"score_lmetric":105254},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":29948,"pending_prefill_tokens":4362,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":2772,"score_linear":89094.0,"score_lmetric":14268},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":7798,"ongoing_decode_tokens":0,"pending_prefill_tokens":6774,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":2772,"score_linear":7798.0,"score_lmetric":9546}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383877.486453637,"t_first_token_unix":1779814742.5003972,"t_done":383877.784332828,"t_done_unix":1779814742.798276},{"request_id":"1253743:3:1302294:268","session_id":"1253743","input_length":49855,"t_proxy_recv":383868.057390178,"t_decision_unix":1779814733.0713317,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.996168889780363,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":49855,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49855,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":0,"new_prefill":49855,"score_linear":96105.0,"score_lmetric":57896},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":4608,"new_prefill":45247,"score_linear":30098.0,"score_lmetric":79953},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":49855,"score_linear":26441.0,"score_lmetric":76296},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":49664,"new_prefill":191,"score_linear":95139.0,"score_lmetric":61389},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":49855,"score_linear":43607.0,"score_lmetric":79638},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":49855,"score_linear":43181.0,"score_lmetric":49855},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":869,"cache_hit":0,"new_prefill":49855,"score_linear":54451.0,"score_lmetric":49855},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":49855,"score_linear":28972.0,"score_lmetric":78827}],"chosen_score_linear":43181.0,"chosen_score_lmetric":49855,"t_first_token":383877.405057022,"t_first_token_unix":1779814742.4190004,"t_done":383878.204207473,"t_done_unix":1779814743.2181509},{"request_id":"1294611:6:1305080:284","session_id":"1294611","input_length":30995,"t_proxy_recv":383877.780237492,"t_decision_unix":1779814742.794179,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9911276012260042,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":275,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":30995,"score_linear":97811.0,"score_lmetric":30995},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":30720,"new_prefill":275,"score_linear":3986.0,"score_lmetric":275},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":2772,"ongoing_decode_tokens":2772,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":928,"cache_hit":0,"new_prefill":30995,"score_linear":2772.0,"score_lmetric":30995},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":30995,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":30995,"score_linear":43607.0,"score_lmetric":30995},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":93036,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":30995,"score_linear":93036.0,"score_lmetric":61990},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":29948,"pending_prefill_tokens":4362,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":12800,"new_prefill":18195,"score_linear":76294.0,"score_lmetric":45114},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":12800,"new_prefill":18195,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":3986.0,"chosen_score_lmetric":275,"t_first_token":383877.856838301,"t_first_token_unix":1779814742.8707814,"t_done":383879.687960445,"t_done_unix":1779814744.7019057},{"request_id":"1266668:11:1300918:260","session_id":"1266668","input_length":97811,"t_proxy_recv":383876.634218585,"t_decision_unix":1779814741.64816,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9945711627526557,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":714,"cache_hit":97280,"new_prefill":531,"score_linear":-97280.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":97811,"score_linear":34706.0,"score_lmetric":97811},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":928,"cache_hit":0,"new_prefill":97811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":97811,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":97811,"score_linear":43607.0,"score_lmetric":97811},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":90131,"score_linear":85356.0,"score_lmetric":279972},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":58368,"new_prefill":39443,"score_linear":-28420.0,"score_lmetric":39443},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":97811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-97280.0,"chosen_score_lmetric":0,"t_first_token":383877.13551235,"t_first_token_unix":1779814742.1494555,"t_done":383880.254899067,"t_done_unix":1779814745.2688432},{"request_id":"1260327:8:1301686:263","session_id":"1260327","input_length":43181,"t_proxy_recv":383865.619512118,"t_decision_unix":1779814730.6334534,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9722794747689957,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":1197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":87741,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":0,"new_prefill":43181,"score_linear":87741.0,"score_lmetric":43181},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":651,"cache_hit":0,"new_prefill":43181,"score_linear":18893.0,"score_lmetric":43181},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":43181,"score_linear":144803.0,"score_lmetric":190359},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":43181,"score_linear":43607.0,"score_lmetric":72964},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":41984,"new_prefill":1197,"score_linear":-41984.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":43181,"score_linear":54451.0,"score_lmetric":43181},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":31232,"new_prefill":11949,"score_linear":-31232.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":383865.990257405,"t_first_token_unix":1779814731.0042005,"t_done":383880.29777524,"t_done_unix":1779814745.311719},{"request_id":"1279412:9:1305633:286","session_id":"1279412","input_length":61291,"t_proxy_recv":383879.948245646,"t_decision_unix":1779814744.9621868,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":60416,"affinity_cache_ratio":0.985723841999641,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":875,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":61291,"score_linear":97811.0,"score_lmetric":61291},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":61291,"score_linear":34706.0,"score_lmetric":61291},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":61291,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":60416,"new_prefill":875,"score_linear":-60416.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":61291,"score_linear":43607.0,"score_lmetric":61291},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":61291,"score_linear":43181.0,"score_lmetric":61291},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":89094,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":61291,"score_linear":89094.0,"score_lmetric":122582},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":12800,"new_prefill":48491,"score_linear":63026.0,"score_lmetric":124317}],"chosen_score_linear":-60416.0,"chosen_score_lmetric":0,"t_first_token":383880.295576012,"t_first_token_unix":1779814745.3095193,"t_done":383881.132584502,"t_done_unix":1779814746.1465287},{"request_id":"1269373:10:1304899:282","session_id":"1269373","input_length":59146,"t_proxy_recv":383877.148696837,"t_decision_unix":1779814742.1626382,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9262502958779968,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":4362,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":7680,"new_prefill":51466,"score_linear":90131.0,"score_lmetric":51466},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":59146,"score_linear":34706.0,"score_lmetric":59146},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":928,"cache_hit":0,"new_prefill":59146,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":59146,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":59146,"score_linear":43607.0,"score_lmetric":59146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":51466,"score_linear":85356.0,"score_lmetric":202642},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":884,"cache_hit":54784,"new_prefill":4362,"score_linear":-24836.0,"score_lmetric":4362},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":7798,"ongoing_decode_tokens":0,"pending_prefill_tokens":6774,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":59146,"score_linear":7798.0,"score_lmetric":65920}],"chosen_score_linear":-24836.0,"chosen_score_lmetric":4362,"t_first_token":383878.792064312,"t_first_token_unix":1779814743.8060079,"t_done":383881.292300318,"t_done_unix":1779814746.3062441},{"request_id":"1303651:2:1305707:287","session_id":"1303651","input_length":12795,"t_proxy_recv":383880.212314831,"t_decision_unix":1779814745.2262561,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":3072,"affinity_cache_ratio":0.24009378663540445,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":12795,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":12795,"score_linear":97811.0,"score_lmetric":12795},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":12795,"score_linear":34706.0,"score_lmetric":12795},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":12795,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61291,"ongoing_decode_tokens":0,"pending_prefill_tokens":875,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":12795,"score_linear":61291.0,"score_lmetric":13670},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":3072,"new_prefill":9723,"score_linear":40535.0,"score_lmetric":9723},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":12795,"score_linear":43181.0,"score_lmetric":12795},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":89094,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":12795,"score_linear":89094.0,"score_lmetric":25590},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":12795,"score_linear":75826.0,"score_lmetric":88621}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383881.272569975,"t_first_token_unix":1779814746.2865136,"t_done":383881.391468697,"t_done_unix":1779814746.4054122},{"request_id":"1303462:2:1306126:290","session_id":"1303462","input_length":18631,"t_proxy_recv":383881.440064459,"t_decision_unix":1779814746.4540062,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.7969513176963126,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":3783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":18631,"score_linear":121968.0,"score_lmetric":42807},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53621,"ongoing_decode_tokens":53621,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":18631,"score_linear":53621.0,"score_lmetric":37262},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":958,"cache_hit":14848,"new_prefill":3783,"score_linear":-14848.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":858,"cache_hit":0,"new_prefill":18631,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":18631,"score_linear":43607.0,"score_lmetric":18631},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":0,"pending_prefill_tokens":14027,"num_requests":1,"active_p_offloads":0,"cached_blocks":717,"cache_hit":0,"new_prefill":18631,"score_linear":14027.0,"score_lmetric":32658},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":18631,"score_linear":29948.0,"score_lmetric":18631},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":18631,"score_linear":75826.0,"score_lmetric":94457}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":383881.983806214,"t_first_token_unix":1779814746.9977515,"t_done":383882.019686909,"t_done_unix":1779814747.033633},{"request_id":"1299507:2:1305770:288","session_id":"1299507","input_length":18915,"t_proxy_recv":383880.405716717,"t_decision_unix":1779814745.419658,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9744647105471848,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":18915,"score_linear":121968.0,"score_lmetric":43091},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":18432,"new_prefill":483,"score_linear":16274.0,"score_lmetric":483},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":12795,"ongoing_decode_tokens":0,"pending_prefill_tokens":12795,"num_requests":1,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":18915,"score_linear":12795.0,"score_lmetric":31710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61291,"ongoing_decode_tokens":61291,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":18915,"score_linear":61291.0,"score_lmetric":18915},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":18915,"score_linear":43607.0,"score_lmetric":18915},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":717,"cache_hit":0,"new_prefill":18915,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":89094,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":11776,"new_prefill":7139,"score_linear":77318.0,"score_lmetric":14278},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":18915,"score_linear":75826.0,"score_lmetric":94741}],"chosen_score_linear":16274.0,"chosen_score_lmetric":483,"t_first_token":383880.454085254,"t_first_token_unix":1779814745.4680288,"t_done":383882.375739479,"t_done_unix":1779814747.389683},{"request_id":"1306347:1:1306347:291","session_id":"1306347","input_length":897,"t_proxy_recv":383882.228027526,"t_decision_unix":1779814747.241969,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":897,"score_linear":121968.0,"score_lmetric":25073},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53621,"ongoing_decode_tokens":53621,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":897,"score_linear":53621.0,"score_lmetric":1794},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":965,"cache_hit":0,"new_prefill":897,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":858,"cache_hit":0,"new_prefill":897,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":897,"score_linear":43607.0,"score_lmetric":897},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":717,"cache_hit":0,"new_prefill":897,"score_linear":14027.0,"score_lmetric":897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":897,"score_linear":29948.0,"score_lmetric":897},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":897,"score_linear":75826.0,"score_lmetric":76723}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383882.329539374,"t_first_token_unix":1779814747.3434832,"t_done":383882.691971084,"t_done_unix":1779814747.7059147},{"request_id":"1305906:1:1305906:289","session_id":"1305906","input_length":14027,"t_proxy_recv":383880.82889372,"t_decision_unix":1779814745.8428352,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":14027,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":14027,"score_linear":121968.0,"score_lmetric":38203},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53621,"ongoing_decode_tokens":53621,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":14027,"score_linear":53621.0,"score_lmetric":28054},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":12795,"ongoing_decode_tokens":0,"pending_prefill_tokens":12795,"num_requests":1,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":14027,"score_linear":12795.0,"score_lmetric":26822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61291,"ongoing_decode_tokens":61291,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":14027,"score_linear":61291.0,"score_lmetric":14027},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":14027,"score_linear":43607.0,"score_lmetric":14027},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":717,"cache_hit":0,"new_prefill":14027,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":89094,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":14027,"score_linear":89094.0,"score_lmetric":28054},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":14027,"score_linear":75826.0,"score_lmetric":89853}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383882.036710317,"t_first_token_unix":1779814747.050654,"t_done":383883.068093355,"t_done_unix":1779814748.0820367},{"request_id":"1272313:11:1302571:271","session_id":"1272313","input_length":29948,"t_proxy_recv":383868.997410293,"t_decision_unix":1779814734.011352,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":29696,"affinity_cache_ratio":0.991585414718846,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":96105,"ongoing_decode_tokens":0,"pending_prefill_tokens":8041,"num_requests":1,"active_p_offloads":0,"cached_blocks":696,"cache_hit":7680,"new_prefill":22268,"score_linear":88425.0,"score_lmetric":30309},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65351,"ongoing_decode_tokens":0,"pending_prefill_tokens":39751,"num_requests":2,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":29948,"score_linear":65351.0,"score_lmetric":139398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":29948,"score_linear":26441.0,"score_lmetric":56389},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":29948,"score_linear":144803.0,"score_lmetric":150660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":29948,"score_linear":43607.0,"score_lmetric":29948},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93036,"ongoing_decode_tokens":43181,"pending_prefill_tokens":49855,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":22268,"score_linear":85356.0,"score_lmetric":144246},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":1105,"ongoing_decode_tokens":1105,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":29696,"new_prefill":252,"score_linear":-28591.0,"score_lmetric":252},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":29948,"score_linear":28972.0,"score_lmetric":58920}],"chosen_score_linear":-28591.0,"chosen_score_lmetric":252,"t_first_token":383869.123240096,"t_first_token_unix":1779814734.1371832,"t_done":383884.092435187,"t_done_unix":1779814749.1063788},{"request_id":"1253743:4:1307058:295","session_id":"1253743","input_length":49975,"t_proxy_recv":383884.782633604,"t_decision_unix":1779814749.7965748,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9937768884442221,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":49975,"score_linear":121968.0,"score_lmetric":74151},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78084,"ongoing_decode_tokens":34706,"pending_prefill_tokens":12658,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":4608,"new_prefill":45367,"score_linear":73476.0,"score_lmetric":116050},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":49975,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":858,"cache_hit":49664,"new_prefill":311,"score_linear":-18606.0,"score_lmetric":311},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":49975,"score_linear":43607.0,"score_lmetric":49975},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":49664,"new_prefill":311,"score_linear":-49664.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":49975,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":89666,"ongoing_decode_tokens":0,"pending_prefill_tokens":81986,"num_requests":2,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":49975,"score_linear":89666.0,"score_lmetric":263922}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":383884.892283839,"t_first_token_unix":1779814749.906227,"t_done":383885.350834627,"t_done_unix":1779814750.3647823},{"request_id":"1277428:2:1306373:292","session_id":"1277428","input_length":31058,"t_proxy_recv":383882.338666462,"t_decision_unix":1779814747.352608,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":27136,"affinity_cache_ratio":0.8737201365187713,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":3922,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":31058,"score_linear":121968.0,"score_lmetric":55234},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53621,"ongoing_decode_tokens":53621,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":4608,"new_prefill":26450,"score_linear":49013.0,"score_lmetric":52900},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":897,"ongoing_decode_tokens":897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":965,"cache_hit":0,"new_prefill":31058,"score_linear":897.0,"score_lmetric":31058},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":858,"cache_hit":27136,"new_prefill":3922,"score_linear":-27136.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":31058,"score_linear":43607.0,"score_lmetric":31058},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":717,"cache_hit":17408,"new_prefill":13650,"score_linear":-3381.0,"score_lmetric":13650},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":31058,"score_linear":29948.0,"score_lmetric":31058},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":31058,"score_linear":75826.0,"score_lmetric":106884}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":383883.210918585,"t_first_token_unix":1779814748.224862,"t_done":383886.663402984,"t_done_unix":1779814751.6773462},{"request_id":"1294611:7:1306822:293","session_id":"1294611","input_length":43378,"t_proxy_recv":383884.0503924,"t_decision_unix":1779814749.0643337,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":30720,"affinity_cache_ratio":0.7081930932730878,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":12658,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":43378,"score_linear":121968.0,"score_lmetric":67554},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":30720,"new_prefill":12658,"score_linear":3986.0,"score_lmetric":12658},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":43378,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":858,"cache_hit":0,"new_prefill":43378,"score_linear":31058.0,"score_lmetric":43378},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":43378,"score_linear":43607.0,"score_lmetric":43378},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":43378,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":12800,"new_prefill":30578,"score_linear":17148.0,"score_lmetric":30578},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":12800,"new_prefill":30578,"score_linear":63026.0,"score_lmetric":106404}],"chosen_score_linear":3986.0,"chosen_score_lmetric":12658,"t_first_token":383887.2199888,"t_first_token_unix":1779814752.2339323,"t_done":383888.738962888,"t_done_unix":1779814753.7529087},{"request_id":"1302449:3:1308121:299","session_id":"1302449","input_length":8729,"t_proxy_recv":383888.516102399,"t_decision_unix":1779814753.5300438,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":5,"affinity_cache_hit":3584,"affinity_cache_ratio":0.41058540497193263,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":8729,"score_linear":121968.0,"score_lmetric":32905},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78084,"ongoing_decode_tokens":78084,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":8729,"score_linear":78084.0,"score_lmetric":17458},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":8729,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61505,"ongoing_decode_tokens":0,"pending_prefill_tokens":577,"num_requests":1,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":8729,"score_linear":61505.0,"score_lmetric":9306},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":8729,"score_linear":43607.0,"score_lmetric":8729},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":8729,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":894,"cache_hit":3584,"new_prefill":5145,"score_linear":55862.0,"score_lmetric":5145},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":8729,"score_linear":112797.0,"score_lmetric":296994}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383889.165471118,"t_first_token_unix":1779814754.1794145,"t_done":383889.24892989,"t_done_unix":1779814754.2628734},{"request_id":"1279412:10:1308091:298","session_id":"1279412","input_length":61505,"t_proxy_recv":383888.426337116,"t_decision_unix":1779814753.4402785,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9906186488903341,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":577,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":61505,"score_linear":121968.0,"score_lmetric":85681},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78084,"ongoing_decode_tokens":78084,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":61505,"score_linear":78084.0,"score_lmetric":123010},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":61505,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":60928,"new_prefill":577,"score_linear":-60928.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":61505,"score_linear":43607.0,"score_lmetric":61505},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":61505,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":61505,"score_linear":59446.0,"score_lmetric":61505},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":12800,"new_prefill":48705,"score_linear":99997.0,"score_lmetric":416922}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":383888.588827244,"t_first_token_unix":1779814753.6027708,"t_done":383889.358802263,"t_done_unix":1779814754.3727462},{"request_id":"1269373:11:1307381:296","session_id":"1269373","input_length":59446,"t_proxy_recv":383885.953500638,"t_decision_unix":1779814750.9674416,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9904787538270027,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":51766,"score_linear":114288.0,"score_lmetric":75942},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78084,"ongoing_decode_tokens":34706,"pending_prefill_tokens":12658,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":59446,"score_linear":78084.0,"score_lmetric":144208},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":59446,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":858,"cache_hit":0,"new_prefill":59446,"score_linear":31058.0,"score_lmetric":59446},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":59446,"score_linear":43607.0,"score_lmetric":59446},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":7680,"new_prefill":51766,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":58880,"new_prefill":566,"score_linear":-58880.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":89666,"ongoing_decode_tokens":0,"pending_prefill_tokens":81986,"num_requests":2,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":59446,"score_linear":89666.0,"score_lmetric":282864}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":383886.097144225,"t_first_token_unix":1779814751.1110878,"t_done":383890.165307884,"t_done_unix":1779814755.1792514},{"request_id":"1303651:3:1308202:300","session_id":"1303651","input_length":22896,"t_proxy_recv":383888.771324564,"t_decision_unix":1779814753.7852662,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":12800,"affinity_cache_ratio":0.5590496156533893,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":10096,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":22896,"score_linear":121968.0,"score_lmetric":47072},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":22896,"score_linear":34706.0,"score_lmetric":22896},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":12800,"new_prefill":10096,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61505,"ongoing_decode_tokens":61505,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":22896,"score_linear":61505.0,"score_lmetric":22896},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":3072,"new_prefill":19824,"score_linear":40535.0,"score_lmetric":19824},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":8729,"ongoing_decode_tokens":0,"pending_prefill_tokens":8729,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":22896,"score_linear":8729.0,"score_lmetric":31625},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":22896,"score_linear":59446.0,"score_lmetric":22896},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":22896,"score_linear":112797.0,"score_lmetric":339495}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":383890.321652546,"t_first_token_unix":1779814755.3355966,"t_done":383890.400075662,"t_done_unix":1779814755.414019},{"request_id":"1309040:1:1309040:302","session_id":"1309040","input_length":4679,"t_proxy_recv":383891.887211729,"t_decision_unix":1779814756.9011533,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4679,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":4679,"score_linear":121968.0,"score_lmetric":28855},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78416,"ongoing_decode_tokens":78416,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":4679,"score_linear":78416.0,"score_lmetric":9358},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":867,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":4679,"score_linear":43607.0,"score_lmetric":4679},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":761,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":4679,"score_linear":112797.0,"score_lmetric":284844}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383892.178322174,"t_first_token_unix":1779814757.1922655,"t_done":383892.667962813,"t_done_unix":1779814757.6819062},{"request_id":"1294611:8:1308970:301","session_id":"1294611","input_length":43710,"t_proxy_recv":383891.557561671,"t_decision_unix":1779814756.5715032,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9956531686113017,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":43710,"score_linear":121968.0,"score_lmetric":67886},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":724,"cache_hit":43520,"new_prefill":190,"score_linear":-8814.0,"score_lmetric":190},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":867,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":43710,"score_linear":43607.0,"score_lmetric":43710},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":761,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":12800,"new_prefill":30910,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":12800,"new_prefill":30910,"score_linear":99997.0,"score_lmetric":363537}],"chosen_score_linear":-8814.0,"chosen_score_lmetric":190,"t_first_token":383891.713184206,"t_first_token_unix":1779814756.7271278,"t_done":383893.423651028,"t_done_unix":1779814758.4375947},{"request_id":"1301929:1:1301929:265","session_id":"1301929","input_length":34706,"t_proxy_recv":383866.573267254,"t_decision_unix":1779814731.587209,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":34706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":87741,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":3584,"new_prefill":31122,"score_linear":84157.0,"score_lmetric":31122},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":840,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":59507,"pending_prefill_tokens":20272,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":34706,"score_linear":144803.0,"score_lmetric":164934},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":713,"cache_hit":0,"new_prefill":34706,"score_linear":43607.0,"score_lmetric":64489},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":34706,"score_linear":43181.0,"score_lmetric":34706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":34706,"score_linear":54451.0,"score_lmetric":34706},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":34706,"score_linear":28972.0,"score_lmetric":63678}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383872.601145099,"t_first_token_unix":1779814737.6150887,"t_done":383896.940907214,"t_done_unix":1779814761.954851},{"request_id":"1309252:1:1309252:304","session_id":"1309252","input_length":24545,"t_proxy_recv":383892.717788942,"t_decision_unix":1779814757.7317307,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24545,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":24545,"score_linear":121968.0,"score_lmetric":48721},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78416,"ongoing_decode_tokens":78416,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":24545,"score_linear":78416.0,"score_lmetric":49090},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":867,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":24545,"score_linear":43607.0,"score_lmetric":24545},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":24545,"score_linear":112797.0,"score_lmetric":344442}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383895.552513985,"t_first_token_unix":1779814760.5664632,"t_done":383897.388160786,"t_done_unix":1779814762.4021041},{"request_id":"1279412:11:1310014:305","session_id":"1279412","input_length":64558,"t_proxy_recv":383895.356063663,"t_decision_unix":1779814760.3700047,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9517023451779795,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":3118,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":64558,"score_linear":121968.0,"score_lmetric":88734},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":64558,"score_linear":34706.0,"score_lmetric":64558},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":867,"cache_hit":61440,"new_prefill":3118,"score_linear":-61440.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":64558,"score_linear":43607.0,"score_lmetric":64558},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24545,"ongoing_decode_tokens":0,"pending_prefill_tokens":24545,"num_requests":1,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":64558,"score_linear":24545.0,"score_lmetric":89103},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":12800,"new_prefill":51758,"score_linear":99997.0,"score_lmetric":426081}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":383896.669897114,"t_first_token_unix":1779814761.6838408,"t_done":383898.043323597,"t_done_unix":1779814763.0572672},{"request_id":"1310590:1:1310590:306","session_id":"1310590","input_length":18089,"t_proxy_recv":383897.301157231,"t_decision_unix":1779814762.3150985,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18089,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":18089,"score_linear":121968.0,"score_lmetric":18089},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":64558,"ongoing_decode_tokens":64558,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":867,"cache_hit":0,"new_prefill":18089,"score_linear":64558.0,"score_lmetric":18089},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":18089,"score_linear":43607.0,"score_lmetric":18089},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24545,"ongoing_decode_tokens":24545,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":18089,"score_linear":24545.0,"score_lmetric":18089},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":0,"pending_prefill_tokens":90269,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":18089,"score_linear":112797.0,"score_lmetric":325074}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383899.092216649,"t_first_token_unix":1779814764.106164,"t_done":383899.583306541,"t_done_unix":1779814764.5972521},{"request_id":"1297811:2:1300578:258","session_id":"1297811","input_length":43607,"t_proxy_recv":383861.917506648,"t_decision_unix":1779814726.931448,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":13824,"affinity_cache_ratio":0.3170133235489715,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":29783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":87741,"ongoing_decode_tokens":0,"pending_prefill_tokens":7357,"num_requests":1,"active_p_offloads":0,"cached_blocks":681,"cache_hit":0,"new_prefill":43607,"score_linear":87741.0,"score_lmetric":50964},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43277,"ongoing_decode_tokens":43277,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":43607,"score_linear":43277.0,"score_lmetric":87214},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":43607,"score_linear":62414.0,"score_lmetric":87077},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":144803,"ongoing_decode_tokens":0,"pending_prefill_tokens":79779,"num_requests":3,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":43607,"score_linear":144803.0,"score_lmetric":370158},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":713,"cache_hit":13824,"new_prefill":29783,"score_linear":-13824.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":617,"cache_hit":1536,"new_prefill":42071,"score_linear":-1536.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":383868.117769578,"t_first_token_unix":1779814733.1317139,"t_done":383899.797517427,"t_done_unix":1779814764.8114614},{"request_id":"1304943:2:1311189:307","session_id":"1304943","input_length":13164,"t_proxy_recv":383899.432575826,"t_decision_unix":1779814764.446517,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":3,"affinity_cache_hit":2560,"affinity_cache_ratio":0.19446976602856275,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":13164,"score_linear":121968.0,"score_lmetric":13164},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":18089,"ongoing_decode_tokens":18089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":2560,"new_prefill":10604,"score_linear":15529.0,"score_lmetric":10604},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":873,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":13164,"score_linear":43607.0,"score_lmetric":13164},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":89666,"pending_prefill_tokens":8283,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":13164,"score_linear":112797.0,"score_lmetric":64341}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383900.531531187,"t_first_token_unix":1779814765.5454745,"t_done":383900.583569195,"t_done_unix":1779814765.5975125},{"request_id":"1304239:3:1307007:294","session_id":"1304239","input_length":13840,"t_proxy_recv":383884.58285506,"t_decision_unix":1779814749.5967963,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":7680,"affinity_cache_ratio":0.5549132947976878,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6160,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":13840,"score_linear":121968.0,"score_lmetric":38016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78084,"ongoing_decode_tokens":34706,"pending_prefill_tokens":12658,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":13840,"score_linear":78084.0,"score_lmetric":52996},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":13840,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":858,"cache_hit":0,"new_prefill":13840,"score_linear":31058.0,"score_lmetric":13840},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":13840,"score_linear":43607.0,"score_lmetric":13840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":13840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":13840,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":7680,"new_prefill":6160,"score_linear":68146.0,"score_lmetric":81986}],"chosen_score_linear":68146.0,"chosen_score_lmetric":81986,"t_first_token":383899.367967302,"t_first_token_unix":1779814764.3819106,"t_done":383900.836049403,"t_done_unix":1779814765.8499925},{"request_id":"1303517:2:1307703:297","session_id":"1303517","input_length":23131,"t_proxy_recv":383887.108226761,"t_decision_unix":1779814752.1221678,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14848,"affinity_cache_ratio":0.6419091262807488,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":8283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":23131,"score_linear":121968.0,"score_lmetric":47307},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78084,"ongoing_decode_tokens":34706,"pending_prefill_tokens":12658,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":23131,"score_linear":78084.0,"score_lmetric":71578},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":966,"cache_hit":0,"new_prefill":23131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":23131,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":23131,"score_linear":43607.0,"score_lmetric":23131},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":23131,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":23131,"score_linear":59446.0,"score_lmetric":23131},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":89666,"ongoing_decode_tokens":0,"pending_prefill_tokens":81986,"num_requests":2,"active_p_offloads":0,"cached_blocks":829,"cache_hit":14848,"new_prefill":8283,"score_linear":74818.0,"score_lmetric":180538}],"chosen_score_linear":74818.0,"chosen_score_lmetric":180538,"t_first_token":383900.505957458,"t_first_token_unix":1779814765.519901,"t_done":383901.229116481,"t_done_unix":1779814766.2430596},{"request_id":"1305420:1:1305420:285","session_id":"1305420","input_length":75826,"t_proxy_recv":383879.046680751,"t_decision_unix":1779814744.060622,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":75826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":75826,"score_linear":97811.0,"score_lmetric":75826},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65701,"ongoing_decode_tokens":65701,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":75826,"score_linear":65701.0,"score_lmetric":151652},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":75826,"score_linear":43607.0,"score_lmetric":75826},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":75826,"score_linear":43181.0,"score_lmetric":75826},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":89094,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":0,"new_prefill":75826,"score_linear":89094.0,"score_lmetric":151652},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383899.366963603,"t_first_token_unix":1779814764.380907,"t_done":383901.357242213,"t_done_unix":1779814766.3711863},{"request_id":"1303517:3:1309213:303","session_id":"1303517","input_length":23259,"t_proxy_recv":383901.234247705,"t_decision_unix":1779814766.2481894,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9905842899522765,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":23259,"score_linear":121968.0,"score_lmetric":23259},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40607,"ongoing_decode_tokens":0,"pending_prefill_tokens":671,"num_requests":2,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":23259,"score_linear":40607.0,"score_lmetric":47860},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":23259,"score_linear":44792.0,"score_lmetric":43475},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":75826,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":23040,"new_prefill":219,"score_linear":52786.0,"score_lmetric":219}],"chosen_score_linear":52786.0,"chosen_score_lmetric":219,"t_first_token":383901.313181002,"t_first_token_unix":1779814766.3271246,"t_done":383901.390140646,"t_done_unix":1779814766.4040837},{"request_id":"1303517:4:1311293:308","session_id":"1303517","input_length":24638,"t_proxy_recv":383901.395766651,"t_decision_unix":1779814766.4097083,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9351408393538436,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1598,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":24638,"score_linear":121968.0,"score_lmetric":24638},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40607,"ongoing_decode_tokens":0,"pending_prefill_tokens":671,"num_requests":2,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":24638,"score_linear":40607.0,"score_lmetric":50618},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":24638,"score_linear":44792.0,"score_lmetric":44854},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1005,"cache_hit":23040,"new_prefill":1598,"score_linear":-23040.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":383901.715671109,"t_first_token_unix":1779814766.7296145,"t_done":383901.885679671,"t_done_unix":1779814766.8996234},{"request_id":"1277428:3:1311644:311","session_id":"1277428","input_length":31611,"t_proxy_recv":383901.05639957,"t_decision_unix":1779814766.0703409,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9880105026731201,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":379,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":31611,"score_linear":121968.0,"score_lmetric":31611},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":4608,"new_prefill":27003,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8996,"ongoing_decode_tokens":0,"pending_prefill_tokens":292,"num_requests":1,"active_p_offloads":0,"cached_blocks":898,"cache_hit":31232,"new_prefill":379,"score_linear":-22236.0,"score_lmetric":671},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":17408,"new_prefill":14203,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":31611,"score_linear":44792.0,"score_lmetric":51827},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":98957,"ongoing_decode_tokens":98957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":31611,"score_linear":98957.0,"score_lmetric":63222}],"chosen_score_linear":-22236.0,"chosen_score_lmetric":671,"t_first_token":383901.591637195,"t_first_token_unix":1779814766.6055803,"t_done":383901.990389134,"t_done_unix":1779814767.0043325},{"request_id":"1258908:2:1311606:310","session_id":"1258908","input_length":8996,"t_proxy_recv":383900.875396488,"t_decision_unix":1779814765.889338,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9675411293908404,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":8996,"score_linear":121968.0,"score_lmetric":8996},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":898,"cache_hit":8704,"new_prefill":292,"score_linear":-8704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":8996,"score_linear":44792.0,"score_lmetric":29212},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":98957,"ongoing_decode_tokens":98957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":8996,"score_linear":98957.0,"score_lmetric":17992}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":383901.547667686,"t_first_token_unix":1779814766.561611,"t_done":383903.577090212,"t_done_unix":1779814768.5910347},{"request_id":"1311753:1:1311753:312","session_id":"1311753","input_length":20175,"t_proxy_recv":383901.451673187,"t_decision_unix":1779814766.4656146,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":20175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":20175,"score_linear":121968.0,"score_lmetric":20175},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40607,"ongoing_decode_tokens":0,"pending_prefill_tokens":671,"num_requests":2,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":20175,"score_linear":40607.0,"score_lmetric":41692},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":20175,"score_linear":44792.0,"score_lmetric":40391},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24638,"ongoing_decode_tokens":0,"pending_prefill_tokens":1598,"num_requests":1,"active_p_offloads":0,"cached_blocks":1005,"cache_hit":0,"new_prefill":20175,"score_linear":24638.0,"score_lmetric":21773}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383903.581768549,"t_first_token_unix":1779814768.5957124,"t_done":383903.754479431,"t_done_unix":1779814768.7684226},{"request_id":"1294611:9:1312398:313","session_id":"1294611","input_length":44335,"t_proxy_recv":383903.732910063,"t_decision_unix":1779814768.746851,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9816172324348709,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":815,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":44335,"score_linear":121968.0,"score_lmetric":44335},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":43520,"new_prefill":815,"score_linear":-43520.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20175,"ongoing_decode_tokens":20175,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":44335,"score_linear":20175.0,"score_lmetric":44335},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":12800,"new_prefill":31535,"score_linear":31992.0,"score_lmetric":51751},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1008,"cache_hit":12800,"new_prefill":31535,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":383903.979747293,"t_first_token_unix":1779814768.993691,"t_done":383905.263744134,"t_done_unix":1779814770.2776875},{"request_id":"1303517:5:1313040:317","session_id":"1303517","input_length":25637,"t_proxy_recv":383905.799696482,"t_decision_unix":1779814770.8136375,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9586145024768888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":1061,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":25637,"score_linear":121968.0,"score_lmetric":25637},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":794,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13360,"ongoing_decode_tokens":13360,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":25637,"score_linear":13360.0,"score_lmetric":25637},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":26885,"ongoing_decode_tokens":26885,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":25637,"score_linear":26885.0,"score_lmetric":25637},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":107632,"ongoing_decode_tokens":44792,"pending_prefill_tokens":2936,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":25637,"score_linear":107632.0,"score_lmetric":57146},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1008,"cache_hit":24576,"new_prefill":1061,"score_linear":-24576.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":383906.099046739,"t_first_token_unix":1779814771.1129901,"t_done":383906.131814072,"t_done_unix":1779814771.1457577},{"request_id":"1306347:2:1312642:314","session_id":"1306347","input_length":13360,"t_proxy_recv":383904.623670366,"t_decision_unix":1779814769.6376116,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":512,"affinity_cache_ratio":0.03832335329341317,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":12848,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":13360,"score_linear":121968.0,"score_lmetric":13360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":13360,"score_linear":44335.0,"score_lmetric":13360},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":512,"new_prefill":12848,"score_linear":-512.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":13360,"score_linear":44792.0,"score_lmetric":33576},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1008,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":383905.719136631,"t_first_token_unix":1779814770.7330806,"t_done":383906.260135072,"t_done_unix":1779814771.2740784},{"request_id":"1268861:4:1312689:315","session_id":"1268861","input_length":26885,"t_proxy_recv":383904.812765856,"t_decision_unix":1779814769.826707,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":21504,"affinity_cache_ratio":0.7998512181513855,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":5381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":26885,"score_linear":121968.0,"score_lmetric":26885},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":26885,"score_linear":44335.0,"score_lmetric":26885},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13360,"ongoing_decode_tokens":0,"pending_prefill_tokens":12848,"num_requests":1,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":26885,"score_linear":13360.0,"score_lmetric":39733},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":819,"cache_hit":21504,"new_prefill":5381,"score_linear":-21504.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":26885,"score_linear":44792.0,"score_lmetric":47101},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1008,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":383905.758278874,"t_first_token_unix":1779814770.7722225,"t_done":383906.996434889,"t_done_unix":1779814772.0103788},{"request_id":"1309252:2:1311531:309","session_id":"1309252","input_length":44792,"t_proxy_recv":383900.647015057,"t_decision_unix":1779814765.6609566,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":24576,"affinity_cache_ratio":0.5486694052509377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":20216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":44792,"score_linear":121968.0,"score_lmetric":44792},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":944,"cache_hit":24576,"new_prefill":20216,"score_linear":-24576.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112797,"ongoing_decode_tokens":112797,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":44792,"score_linear":112797.0,"score_lmetric":134376}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":383905.542127227,"t_first_token_unix":1779814770.5560706,"t_done":383907.747110941,"t_done_unix":1779814772.7610574},{"request_id":"1313181:1:1313181:318","session_id":"1313181","input_length":22686,"t_proxy_recv":383906.411542212,"t_decision_unix":1779814771.4254837,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":12800,"estimated_new_tokens":9886,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":22686,"score_linear":121968.0,"score_lmetric":22686},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":794,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":12800,"new_prefill":9886,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":26885,"ongoing_decode_tokens":26885,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":22686,"score_linear":26885.0,"score_lmetric":22686},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":107632,"ongoing_decode_tokens":44792,"pending_prefill_tokens":2936,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":22686,"score_linear":107632.0,"score_lmetric":51244},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1010,"cache_hit":12800,"new_prefill":9886,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":383907.90196259,"t_first_token_unix":1779814772.915906,"t_done":383908.560119869,"t_done_unix":1779814773.574063},{"request_id":"1279412:12:1313518:319","session_id":"1279412","input_length":64755,"t_proxy_recv":383907.533544116,"t_decision_unix":1779814772.5474854,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9962473940236275,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":243,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":64755,"score_linear":121968.0,"score_lmetric":64755},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":794,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":64512,"new_prefill":243,"score_linear":-64512.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":107632,"ongoing_decode_tokens":107632,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":64755,"score_linear":107632.0,"score_lmetric":129510},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22686,"ongoing_decode_tokens":0,"pending_prefill_tokens":9886,"num_requests":1,"active_p_offloads":0,"cached_blocks":1010,"cache_hit":12800,"new_prefill":51955,"score_linear":9886.0,"score_lmetric":61841}],"chosen_score_linear":-64512.0,"chosen_score_lmetric":0,"t_first_token":383907.658843562,"t_first_token_unix":1779814772.672788,"t_done":383908.940660361,"t_done_unix":1779814773.9546037},{"request_id":"1269373:12:1312836:316","session_id":"1269373","input_length":62840,"t_proxy_recv":383905.171497477,"t_decision_unix":1779814770.1854334,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":59904,"affinity_cache_ratio":0.9532781667727562,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59904,"estimated_new_tokens":2936,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":55160,"score_linear":114288.0,"score_lmetric":55160},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":62840,"score_linear":44335.0,"score_lmetric":62840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13360,"ongoing_decode_tokens":0,"pending_prefill_tokens":12848,"num_requests":1,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":62840,"score_linear":13360.0,"score_lmetric":75688},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":62840,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":26885,"ongoing_decode_tokens":0,"pending_prefill_tokens":5381,"num_requests":1,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":62840,"score_linear":26885.0,"score_lmetric":68221},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":7680,"new_prefill":55160,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":59904,"new_prefill":2936,"score_linear":-15112.0,"score_lmetric":23152},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1008,"cache_hit":0,"new_prefill":62840,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-15112.0,"chosen_score_lmetric":23152,"t_first_token":383906.761255547,"t_first_token_unix":1779814771.775199,"t_done":383910.08217661,"t_done_unix":1779814775.0961204},{"request_id":"1294611:10:1314495:322","session_id":"1294611","input_length":45362,"t_proxy_recv":383911.189502035,"t_decision_unix":1779814776.203443,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":44032,"affinity_cache_ratio":0.970680305101186,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":45362,"score_linear":121968.0,"score_lmetric":45362},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":794,"cache_hit":44032,"new_prefill":1330,"score_linear":-44032.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":45362,"score_linear":57051.0,"score_lmetric":98829},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":12800,"new_prefill":32562,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":12800,"new_prefill":32562,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":383911.534746814,"t_first_token_unix":1779814776.54869,"t_done":383912.989013618,"t_done_unix":1779814778.002957},{"request_id":"1313181:2:1314940:323","session_id":"1313181","input_length":24306,"t_proxy_recv":383912.601245257,"t_decision_unix":1779814777.6151865,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22528,"affinity_cache_ratio":0.9268493376121122,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":1778,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":24306,"score_linear":121968.0,"score_lmetric":24306},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":45362,"ongoing_decode_tokens":45362,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":794,"cache_hit":0,"new_prefill":24306,"score_linear":45362.0,"score_lmetric":24306},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":12800,"new_prefill":11506,"score_linear":44251.0,"score_lmetric":64973},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":22528,"new_prefill":1778,"score_linear":-22528.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":383912.930659364,"t_first_token_unix":1779814777.9446032,"t_done":383913.51928822,"t_done_unix":1779814778.5332315},{"request_id":"1315313:1:1315313:325","session_id":"1315313","input_length":7,"t_proxy_recv":383913.832559257,"t_decision_unix":1779814778.8465006,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":7,"score_linear":121968.0,"score_lmetric":7},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":7,"score_linear":32440.0,"score_lmetric":14527},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":7,"score_linear":57051.0,"score_lmetric":53474},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383913.847343606,"t_first_token_unix":1779814778.8612864,"t_done":383913.851906836,"t_done_unix":1779814778.8658495},{"request_id":"1310590:2:1315212:324","session_id":"1310590","input_length":32440,"t_proxy_recv":383913.481408252,"t_decision_unix":1779814778.4953494,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":17920,"affinity_cache_ratio":0.5524044389642416,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":14520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":32440,"score_linear":121968.0,"score_lmetric":32440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":17920,"new_prefill":14520,"score_linear":-17920.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":32440,"score_linear":57051.0,"score_lmetric":85907},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24306,"ongoing_decode_tokens":24306,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":0,"new_prefill":32440,"score_linear":24306.0,"score_lmetric":32440}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":383916.211314453,"t_first_token_unix":1779814781.2252588,"t_done":383916.358923456,"t_done_unix":1779814781.372867},{"request_id":"1309040:2:1315488:326","session_id":"1309040","input_length":23097,"t_proxy_recv":383914.553576379,"t_decision_unix":1779814779.5675175,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.1995064294064164,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":18489,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":23097,"score_linear":121968.0,"score_lmetric":23097},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":23097,"score_linear":32440.0,"score_lmetric":37617},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":23097,"score_linear":57051.0,"score_lmetric":76564},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":4608,"new_prefill":18489,"score_linear":-4608.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":383916.894631977,"t_first_token_unix":1779814781.9085758,"t_done":383917.252930645,"t_done_unix":1779814782.2668738},{"request_id":"1315567:1:1315567:327","session_id":"1315567","input_length":16960,"t_proxy_recv":383914.822134983,"t_decision_unix":1779814779.8360765,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":9280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":9280,"score_linear":114288.0,"score_lmetric":9280},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":16960,"score_linear":32440.0,"score_lmetric":31480},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":16960,"score_linear":57051.0,"score_lmetric":70427},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":18489,"num_requests":1,"active_p_offloads":0,"cached_blocks":770,"cache_hit":7680,"new_prefill":9280,"score_linear":15417.0,"score_lmetric":27769},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":7680,"new_prefill":9280,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":383915.939009236,"t_first_token_unix":1779814780.9529538,"t_done":383918.999210674,"t_done_unix":1779814784.0131562},{"request_id":"1316848:1:1316848:331","session_id":"1316848","input_length":5985,"t_proxy_recv":383919.175223648,"t_decision_unix":1779814784.1891649,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":4961,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":5985,"score_linear":121968.0,"score_lmetric":5985},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24487,"ongoing_decode_tokens":0,"pending_prefill_tokens":24487,"num_requests":1,"active_p_offloads":0,"cached_blocks":1073,"cache_hit":0,"new_prefill":5985,"score_linear":24487.0,"score_lmetric":30472},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":0,"pending_prefill_tokens":53904,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":5985,"score_linear":122000.0,"score_lmetric":119778},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1008,"cache_hit":1024,"new_prefill":4961,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":383919.518070966,"t_first_token_unix":1779814784.5320146,"t_done":383919.697026497,"t_done_unix":1779814784.7109702},{"request_id":"1316201:1:1316201:329","session_id":"1316201","input_length":24487,"t_proxy_recv":383917.086295824,"t_decision_unix":1779814782.1002374,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24487,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":24487,"score_linear":121968.0,"score_lmetric":24487},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1073,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":0,"pending_prefill_tokens":53904,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":24487,"score_linear":122000.0,"score_lmetric":156782},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":23097,"ongoing_decode_tokens":23097,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":24487,"score_linear":23097.0,"score_lmetric":24487},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":16960,"ongoing_decode_tokens":16960,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":24487,"score_linear":16960.0,"score_lmetric":24487},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383919.901057736,"t_first_token_unix":1779814784.9150014,"t_done":383920.190935045,"t_done_unix":1779814785.2048783},{"request_id":"1317160:1:1317160:332","session_id":"1317160","input_length":3441,"t_proxy_recv":383920.328298374,"t_decision_unix":1779814785.3422399,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":3441,"score_linear":121968.0,"score_lmetric":3441},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":0,"pending_prefill_tokens":53904,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":3441,"score_linear":122000.0,"score_lmetric":114690},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1017,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383920.540066862,"t_first_token_unix":1779814785.5540104,"t_done":383920.692088349,"t_done_unix":1779814785.706032},{"request_id":"1316848:2:1317438:333","session_id":"1316848","input_length":6040,"t_proxy_recv":383921.408975191,"t_decision_unix":1779814786.4229167,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":5632,"affinity_cache_ratio":0.9324503311258279,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":408,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":6040,"score_linear":121968.0,"score_lmetric":6040},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":0,"pending_prefill_tokens":53904,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":6040,"score_linear":122000.0,"score_lmetric":119888},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":5632,"new_prefill":408,"score_linear":-5632.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":383921.435338972,"t_first_token_unix":1779814786.4492824,"t_done":383923.21823553,"t_done_unix":1779814788.2321792},{"request_id":"1317160:2:1317773:336","session_id":"1317160","input_length":7440,"t_proxy_recv":383922.727157118,"t_decision_unix":1779814787.7410984,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":7,"affinity_cache_hit":3072,"affinity_cache_ratio":0.4129032258064516,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":7440,"score_linear":121968.0,"score_lmetric":7440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":122000,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":7440,"score_linear":122000.0,"score_lmetric":14880},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":7440,"score_linear":79663.0,"score_lmetric":86591},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72175,"ongoing_decode_tokens":6040,"pending_prefill_tokens":3159,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":3072,"new_prefill":4368,"score_linear":69103.0,"score_lmetric":15054},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383923.233732458,"t_first_token_unix":1779814788.2476761,"t_done":383923.35801159,"t_done_unix":1779814788.3719552},{"request_id":"1316201:2:1317776:337","session_id":"1316201","input_length":24768,"t_proxy_recv":383922.748061378,"t_decision_unix":1779814787.762003,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9715762273901809,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":704,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":24768,"score_linear":121968.0,"score_lmetric":24768},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":24064,"new_prefill":704,"score_linear":-24064.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":122000,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":24768,"score_linear":122000.0,"score_lmetric":49536},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":24768,"score_linear":79663.0,"score_lmetric":103919},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72175,"ongoing_decode_tokens":6040,"pending_prefill_tokens":3159,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":24768,"score_linear":72175.0,"score_lmetric":55854},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":7440,"ongoing_decode_tokens":0,"pending_prefill_tokens":7440,"num_requests":1,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":24768,"score_linear":7440.0,"score_lmetric":32208}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":383922.854592401,"t_first_token_unix":1779814787.8685365,"t_done":383923.395915209,"t_done_unix":1779814788.4098585},{"request_id":"1318031:1:1318031:338","session_id":"1318031","input_length":5219,"t_proxy_recv":383923.390119287,"t_decision_unix":1779814788.4040608,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":5219,"score_linear":121968.0,"score_lmetric":5219},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24768,"ongoing_decode_tokens":24768,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":5219,"score_linear":24768.0,"score_lmetric":5219},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":122000,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":5219,"score_linear":122000.0,"score_lmetric":10438},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":5219,"score_linear":79663.0,"score_lmetric":84370},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":5219,"score_linear":66135.0,"score_lmetric":5219},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1046,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383923.722896073,"t_first_token_unix":1779814788.736839,"t_done":383923.942256112,"t_done_unix":1779814788.9562},{"request_id":"1318036:1:1318036:339","session_id":"1318036","input_length":2696,"t_proxy_recv":383923.393813815,"t_decision_unix":1779814788.4077556,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2696,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":2696,"score_linear":121968.0,"score_lmetric":2696},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5219,"ongoing_decode_tokens":0,"pending_prefill_tokens":5219,"num_requests":1,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":2696,"score_linear":5219.0,"score_lmetric":7915},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24768,"ongoing_decode_tokens":24768,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":2696,"score_linear":24768.0,"score_lmetric":2696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":122000,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":2696,"score_linear":122000.0,"score_lmetric":5392},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":2696,"score_linear":79663.0,"score_lmetric":81847},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":2696,"score_linear":66135.0,"score_lmetric":2696},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1046,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383923.560741316,"t_first_token_unix":1779814788.5746844,"t_done":383924.043968543,"t_done_unix":1779814789.0579126},{"request_id":"1314357:1:1314357:321","session_id":"1314357","input_length":57051,"t_proxy_recv":383910.728976668,"t_decision_unix":1779814775.7429175,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":53467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":57051,"score_linear":121968.0,"score_lmetric":57051},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":794,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":899,"cache_hit":3584,"new_prefill":53467,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":383922.450966339,"t_first_token_unix":1779814787.46491,"t_done":383925.224166358,"t_done_unix":1779814790.2381096},{"request_id":"1279412:13:1315780:328","session_id":"1279412","input_length":64949,"t_proxy_recv":383915.619486951,"t_decision_unix":1779814780.6334283,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9932716439052179,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":64949,"score_linear":121968.0,"score_lmetric":64949},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1045,"cache_hit":0,"new_prefill":64949,"score_linear":32440.0,"score_lmetric":79469},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":53467,"num_requests":1,"active_p_offloads":0,"cached_blocks":899,"cache_hit":64512,"new_prefill":437,"score_linear":-7461.0,"score_lmetric":53904},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":18489,"num_requests":1,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":64949,"score_linear":23097.0,"score_lmetric":83438},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":16960,"ongoing_decode_tokens":0,"pending_prefill_tokens":9280,"num_requests":1,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":64949,"score_linear":16960.0,"score_lmetric":74229},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":12800,"new_prefill":52149,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-7461.0,"chosen_score_lmetric":53904,"t_first_token":383922.456693928,"t_first_token_unix":1779814787.4706373,"t_done":383925.782266223,"t_done_unix":1779814790.7962103},{"request_id":"1318604:1:1318604:341","session_id":"1318604","input_length":14412,"t_proxy_recv":383925.437210783,"t_decision_unix":1779814790.451152,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":14412,"score_linear":121968.0,"score_lmetric":14412},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":0,"pending_prefill_tokens":3738,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14412,"score_linear":62618.0,"score_lmetric":18150},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":64949,"ongoing_decode_tokens":64949,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1002,"cache_hit":0,"new_prefill":14412,"score_linear":64949.0,"score_lmetric":14412},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":14412,"score_linear":79663.0,"score_lmetric":93563},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":14412,"score_linear":66135.0,"score_lmetric":14412},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383926.680183288,"t_first_token_unix":1779814791.6941268,"t_done":383926.863835298,"t_done_unix":1779814791.8777785},{"request_id":"1269373:13:1317516:334","session_id":"1269373","input_length":66135,"t_proxy_recv":383921.671397718,"t_decision_unix":1779814786.6853392,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9522340666817872,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":3159,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":58455,"score_linear":114288.0,"score_lmetric":58455},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":0,"pending_prefill_tokens":53904,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":66135,"score_linear":122000.0,"score_lmetric":240078},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":7680,"new_prefill":58455,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6040,"ongoing_decode_tokens":6040,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":62976,"new_prefill":3159,"score_linear":-56936.0,"score_lmetric":3159},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56936.0,"chosen_score_lmetric":3159,"t_first_token":383923.007728703,"t_first_token_unix":1779814788.0216727,"t_done":383927.061378349,"t_done_unix":1779814792.075322},{"request_id":"1316848:3:1318975:343","session_id":"1316848","input_length":6298,"t_proxy_recv":383926.808914052,"t_decision_unix":1779814791.8228552,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":5632,"affinity_cache_ratio":0.8942521435376309,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":666,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":6298,"score_linear":121968.0,"score_lmetric":6298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":6298,"score_linear":62618.0,"score_lmetric":6298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":6298,"score_linear":79663.0,"score_lmetric":85449},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":5632,"new_prefill":666,"score_linear":60503.0,"score_lmetric":666},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":14412,"ongoing_decode_tokens":14412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":6298,"score_linear":14412.0,"score_lmetric":6298}],"chosen_score_linear":60503.0,"chosen_score_lmetric":666,"t_first_token":383926.87613483,"t_first_token_unix":1779814791.8900783,"t_done":383927.233917297,"t_done_unix":1779814792.247862},{"request_id":"1318604:2:1319895:347","session_id":"1318604","input_length":15745,"t_proxy_recv":383929.955914967,"t_decision_unix":1779814794.9698567,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9105112734201334,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":1409,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":15745,"score_linear":121968.0,"score_lmetric":15745},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":15745,"score_linear":62618.0,"score_lmetric":15745},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":15745,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71854,"ongoing_decode_tokens":0,"pending_prefill_tokens":6830,"num_requests":1,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":15745,"score_linear":71854.0,"score_lmetric":22575},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":15745,"score_linear":79663.0,"score_lmetric":94896},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":15745,"score_linear":54546.0,"score_lmetric":62611},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21140,"ongoing_decode_tokens":0,"pending_prefill_tokens":14996,"num_requests":1,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":15745,"score_linear":21140.0,"score_lmetric":30741},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1079,"cache_hit":14336,"new_prefill":1409,"score_linear":-14336.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":383930.188455772,"t_first_token_unix":1779814795.202399,"t_done":383930.371408583,"t_done_unix":1779814795.385352},{"request_id":"1279412:14:1319059:344","session_id":"1279412","input_length":71854,"t_proxy_recv":383927.169157264,"t_decision_unix":1779814792.1830986,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9049461407854816,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":6830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":71854,"score_linear":121968.0,"score_lmetric":71854},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":71854,"score_linear":62618.0,"score_lmetric":71854},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":65024,"new_prefill":6830,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":71854,"score_linear":79663.0,"score_lmetric":151005},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6298,"ongoing_decode_tokens":6298,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1030,"cache_hit":0,"new_prefill":71854,"score_linear":6298.0,"score_lmetric":71854},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1079,"cache_hit":12800,"new_prefill":59054,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":383930.130418251,"t_first_token_unix":1779814795.1443617,"t_done":383932.998367912,"t_done_unix":1779814798.0123117},{"request_id":"1320630:1:1320630:348","session_id":"1320630","input_length":3099,"t_proxy_recv":383932.72862461,"t_decision_unix":1779814797.7425659,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3099,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":3099,"score_linear":121968.0,"score_lmetric":3099},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":3099,"score_linear":62618.0,"score_lmetric":3099},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71854,"ongoing_decode_tokens":71854,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":3099,"score_linear":71854.0,"score_lmetric":3099},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":3099,"score_linear":79663.0,"score_lmetric":82250},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":3099,"score_linear":54546.0,"score_lmetric":49965},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21140,"ongoing_decode_tokens":21140,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":3099,"score_linear":21140.0,"score_lmetric":3099},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383932.922037695,"t_first_token_unix":1779814797.9359815,"t_done":383933.117162691,"t_done_unix":1779814798.1311061},{"request_id":"1316848:4:1319820:345","session_id":"1316848","input_length":21140,"t_proxy_recv":383929.723733811,"t_decision_unix":1779814794.7376752,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":6144,"affinity_cache_ratio":0.29063386944181646,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":14996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":21140,"score_linear":121968.0,"score_lmetric":21140},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21140,"score_linear":62618.0,"score_lmetric":21140},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71854,"ongoing_decode_tokens":0,"pending_prefill_tokens":6830,"num_requests":1,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":21140,"score_linear":71854.0,"score_lmetric":27970},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":21140,"score_linear":79663.0,"score_lmetric":100291},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":6144,"new_prefill":14996,"score_linear":-6144.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1079,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":383931.567964969,"t_first_token_unix":1779814796.5819082,"t_done":383933.384368544,"t_done_unix":1779814798.398313},{"request_id":"1318604:3:1320865:350","session_id":"1318604","input_length":17883,"t_proxy_recv":383933.57304372,"t_decision_unix":1779814798.586985,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":15360,"affinity_cache_ratio":0.8589162892132193,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":2523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":17883,"score_linear":121968.0,"score_lmetric":17883},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":17883,"score_linear":62618.0,"score_lmetric":17883},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1016,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":17883,"score_linear":79663.0,"score_lmetric":97034},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":17883,"score_linear":54546.0,"score_lmetric":64749},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":15360,"new_prefill":2523,"score_linear":-15360.0,"score_lmetric":0}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":383933.95986161,"t_first_token_unix":1779814798.9738047,"t_done":383934.181350412,"t_done_unix":1779814799.195294},{"request_id":"1318036:2:1321282:353","session_id":"1318036","input_length":2677,"t_proxy_recv":383935.037524266,"t_decision_unix":1779814800.0514657,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":2560,"affinity_cache_ratio":0.9562943593574897,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":117,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":2677,"score_linear":121968.0,"score_lmetric":2677},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":2677,"score_linear":62618.0,"score_lmetric":2677},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8095,"ongoing_decode_tokens":8095,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":2677,"score_linear":8095.0,"score_lmetric":2677},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":33906,"ongoing_decode_tokens":0,"pending_prefill_tokens":2674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1016,"cache_hit":0,"new_prefill":2677,"score_linear":33906.0,"score_lmetric":5351},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":2677,"score_linear":79663.0,"score_lmetric":81828},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":2677,"score_linear":54546.0,"score_lmetric":49543},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":2677,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1092,"cache_hit":2560,"new_prefill":117,"score_linear":-2560.0,"score_lmetric":0}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":383935.059447955,"t_first_token_unix":1779814800.0733912,"t_done":383935.065919662,"t_done_unix":1779814800.0798628},{"request_id":"1321042:1:1321042:351","session_id":"1321042","input_length":8095,"t_proxy_recv":383934.223140625,"t_decision_unix":1779814799.237082,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8095,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":8095,"score_linear":121968.0,"score_lmetric":8095},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":8095,"score_linear":62618.0,"score_lmetric":8095},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1016,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":8095,"score_linear":79663.0,"score_lmetric":87246},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":8095,"score_linear":54546.0,"score_lmetric":54961},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1092,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383934.789080244,"t_first_token_unix":1779814799.8030243,"t_done":383935.096271596,"t_done_unix":1779814800.1102147},{"request_id":"1277428:4:1321259:352","session_id":"1277428","input_length":33906,"t_proxy_recv":383934.982241782,"t_decision_unix":1779814799.9961832,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9211349023771603,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":2674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":33906,"score_linear":121968.0,"score_lmetric":33906},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":4608,"new_prefill":29298,"score_linear":58010.0,"score_lmetric":29298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8095,"ongoing_decode_tokens":8095,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":33906,"score_linear":8095.0,"score_lmetric":33906},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1016,"cache_hit":31232,"new_prefill":2674,"score_linear":-31232.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":33906,"score_linear":79663.0,"score_lmetric":113057},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":17408,"new_prefill":16498,"score_linear":37138.0,"score_lmetric":63364},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1092,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":383935.592466023,"t_first_token_unix":1779814800.6064103,"t_done":383936.403219015,"t_done_unix":1779814801.4171643},{"request_id":"1318604:4:1321889:356","session_id":"1318604","input_length":21033,"t_proxy_recv":383937.165322616,"t_decision_unix":1779814802.1792638,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":17920,"affinity_cache_ratio":0.8519944848571293,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":3113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":21033,"score_linear":121968.0,"score_lmetric":21033},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21033,"score_linear":62618.0,"score_lmetric":21033},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":21033,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72402,"ongoing_decode_tokens":72402,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":21033,"score_linear":72402.0,"score_lmetric":21033},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":21033,"score_linear":79663.0,"score_lmetric":100184},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21033,"score_linear":54546.0,"score_lmetric":67899},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66840,"ongoing_decode_tokens":66840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":21033,"score_linear":66840.0,"score_lmetric":21033},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1092,"cache_hit":17920,"new_prefill":3113,"score_linear":-17920.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":383937.683087619,"t_first_token_unix":1779814802.6970313,"t_done":383937.917897614,"t_done_unix":1779814802.9318411},{"request_id":"1269373:14:1321512:354","session_id":"1269373","input_length":66840,"t_proxy_recv":383935.819582558,"t_decision_unix":1779814800.8335238,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":66560,"affinity_cache_ratio":0.9958108916816277,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66560,"estimated_new_tokens":280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":59160,"score_linear":114288.0,"score_lmetric":59160},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":66840,"score_linear":62618.0,"score_lmetric":66840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":66840,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":33906,"ongoing_decode_tokens":33906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1016,"cache_hit":0,"new_prefill":66840,"score_linear":33906.0,"score_lmetric":66840},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":66840,"score_linear":79663.0,"score_lmetric":145991},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":7680,"new_prefill":59160,"score_linear":46866.0,"score_lmetric":106026},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":66560,"new_prefill":280,"score_linear":-66560.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1092,"cache_hit":0,"new_prefill":66840,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-66560.0,"chosen_score_lmetric":0,"t_first_token":383936.037297836,"t_first_token_unix":1779814801.0512416,"t_done":383938.207248371,"t_done_unix":1779814803.221192},{"request_id":"1279412:15:1321613:355","session_id":"1279412","input_length":72402,"t_proxy_recv":383936.153245881,"t_decision_unix":1779814801.1671872,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":71680,"affinity_cache_ratio":0.990027899781774,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":722,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":72402,"score_linear":121968.0,"score_lmetric":72402},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":72402,"score_linear":62618.0,"score_lmetric":72402},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":72402,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":33906,"ongoing_decode_tokens":33906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1016,"cache_hit":71680,"new_prefill":722,"score_linear":-37774.0,"score_lmetric":722},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":72402,"score_linear":79663.0,"score_lmetric":151553},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":72402,"score_linear":54546.0,"score_lmetric":119268},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66840,"ongoing_decode_tokens":66840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":72402,"score_linear":66840.0,"score_lmetric":72402},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1092,"cache_hit":12800,"new_prefill":59602,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-37774.0,"chosen_score_lmetric":722,"t_first_token":383936.387445531,"t_first_token_unix":1779814801.4013922,"t_done":383938.633315842,"t_done_unix":1779814803.6472595},{"request_id":"1316848:5:1322192:357","session_id":"1316848","input_length":21471,"t_proxy_recv":383938.341774751,"t_decision_unix":1779814803.3557165,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9776908388058311,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":479,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":21471,"score_linear":121968.0,"score_lmetric":21471},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21471,"score_linear":62618.0,"score_lmetric":21471},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72402,"ongoing_decode_tokens":72402,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":21471,"score_linear":72402.0,"score_lmetric":21471},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":21471,"score_linear":79663.0,"score_lmetric":100622},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21471,"score_linear":54546.0,"score_lmetric":68337},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1061,"cache_hit":20992,"new_prefill":479,"score_linear":-20992.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-20992.0,"chosen_score_lmetric":0,"t_first_token":383938.399666339,"t_first_token_unix":1779814803.4136105,"t_done":383938.918037911,"t_done_unix":1779814803.931981},{"request_id":"1322540:1:1322540:359","session_id":"1322540","input_length":8939,"t_proxy_recv":383939.624731354,"t_decision_unix":1779814804.638672,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8939,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":8939,"score_linear":121968.0,"score_lmetric":8939},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":8939,"score_linear":62618.0,"score_lmetric":8939},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":8939,"score_linear":79663.0,"score_lmetric":88090},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":8939,"score_linear":54546.0,"score_lmetric":55805},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1062,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":8939,"score_linear":33182.0,"score_lmetric":42121}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383940.29368124,"t_first_token_unix":1779814805.307625,"t_done":383940.553237848,"t_done_unix":1779814805.5671813},{"request_id":"1318031:2:1322552:360","session_id":"1318031","input_length":11145,"t_proxy_recv":383939.684134283,"t_decision_unix":1779814804.6980753,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":6,"affinity_cache_hit":5120,"affinity_cache_ratio":0.45939883355764916,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11145,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":11145,"score_linear":121968.0,"score_lmetric":11145},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":5120,"new_prefill":6025,"score_linear":57498.0,"score_lmetric":6025},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8939,"ongoing_decode_tokens":0,"pending_prefill_tokens":8939,"num_requests":1,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":11145,"score_linear":8939.0,"score_lmetric":20084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":11145,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":11145,"score_linear":79663.0,"score_lmetric":90296},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":11145,"score_linear":54546.0,"score_lmetric":58011},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1062,"cache_hit":0,"new_prefill":11145,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":11145,"score_linear":33182.0,"score_lmetric":44327}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383940.569527622,"t_first_token_unix":1779814805.5834715,"t_done":383940.620704056,"t_done_unix":1779814805.6346476},{"request_id":"1315567:2:1319894:346","session_id":"1315567","input_length":54546,"t_proxy_recv":383929.949965386,"t_decision_unix":1779814794.963907,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":5,"affinity_cache_hit":17408,"affinity_cache_ratio":0.31914347523191433,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":46866,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":46866,"score_linear":114288.0,"score_lmetric":46866},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":54546,"score_linear":62618.0,"score_lmetric":54546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":54546,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71854,"ongoing_decode_tokens":0,"pending_prefill_tokens":6830,"num_requests":1,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":54546,"score_linear":71854.0,"score_lmetric":61376},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":54546,"score_linear":79663.0,"score_lmetric":133697},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":7680,"new_prefill":46866,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21140,"ongoing_decode_tokens":0,"pending_prefill_tokens":14996,"num_requests":1,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":17408,"new_prefill":37138,"score_linear":3732.0,"score_lmetric":52134},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1079,"cache_hit":0,"new_prefill":54546,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":383940.264546826,"t_first_token_unix":1779814805.2784915,"t_done":383943.036813054,"t_done_unix":1779814808.050757},{"request_id":"1322540:2:1323519:362","session_id":"1322540","input_length":9016,"t_proxy_recv":383942.919416673,"t_decision_unix":1779814807.9333577,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9653948535936113,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":312,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":9016,"score_linear":121968.0,"score_lmetric":9016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9016,"score_linear":62618.0,"score_lmetric":9016},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13008,"ongoing_decode_tokens":0,"pending_prefill_tokens":5328,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":8704,"new_prefill":312,"score_linear":4304.0,"score_lmetric":5640},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":9016,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":9016,"score_linear":79663.0,"score_lmetric":88167},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":54546,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9016,"score_linear":54546.0,"score_lmetric":9016},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":9016,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":9016,"score_linear":33182.0,"score_lmetric":42198}],"chosen_score_linear":4304.0,"chosen_score_lmetric":5640,"t_first_token":383943.407767351,"t_first_token_unix":1779814808.4217112,"t_done":383943.563113042,"t_done_unix":1779814808.5770564},{"request_id":"1321042:2:1323492:361","session_id":"1321042","input_length":13008,"t_proxy_recv":383942.851227005,"t_decision_unix":1779814807.865168,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":7680,"affinity_cache_ratio":0.5904059040590406,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":5328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":13008,"score_linear":121968.0,"score_lmetric":13008},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":13008,"score_linear":62618.0,"score_lmetric":13008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":7680,"new_prefill":5328,"score_linear":-7680.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":13008,"score_linear":79663.0,"score_lmetric":92159},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":54546,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":13008,"score_linear":54546.0,"score_lmetric":13008},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":13008,"score_linear":33182.0,"score_lmetric":46190}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":383943.3901738,"t_first_token_unix":1779814808.4041173,"t_done":383943.815799296,"t_done_unix":1779814808.8297446},{"request_id":"1316848:6:1323535:363","session_id":"1316848","input_length":24395,"t_proxy_recv":383942.969776451,"t_decision_unix":1779814807.983718,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":21504,"affinity_cache_ratio":0.8814921090387374,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":2891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":24395,"score_linear":121968.0,"score_lmetric":24395},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":24395,"score_linear":62618.0,"score_lmetric":24395},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":22024,"ongoing_decode_tokens":0,"pending_prefill_tokens":5640,"num_requests":2,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":24395,"score_linear":22024.0,"score_lmetric":60070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":24395,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":24395,"score_linear":79663.0,"score_lmetric":103546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":54546,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":24395,"score_linear":54546.0,"score_lmetric":24395},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":21504,"new_prefill":2891,"score_linear":-21504.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":24395,"score_linear":33182.0,"score_lmetric":57577}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":383943.536942517,"t_first_token_unix":1779814808.5508864,"t_done":383944.123879985,"t_done_unix":1779814809.1378238},{"request_id":"1320630:2:1323748:364","session_id":"1320630","input_length":11298,"t_proxy_recv":383943.692623555,"t_decision_unix":1779814808.706565,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":3,"affinity_cache_hit":3072,"affinity_cache_ratio":0.27190653212958044,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":11298,"score_linear":121968.0,"score_lmetric":11298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":11298,"score_linear":62618.0,"score_lmetric":11298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13008,"ongoing_decode_tokens":13008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":11298,"score_linear":13008.0,"score_lmetric":11298},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":11298,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":11298,"score_linear":79663.0,"score_lmetric":90449},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":11298,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24395,"ongoing_decode_tokens":24395,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":11298,"score_linear":24395.0,"score_lmetric":11298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":3072,"new_prefill":8226,"score_linear":30110.0,"score_lmetric":8226}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383944.588970061,"t_first_token_unix":1779814809.6029146,"t_done":383946.522740199,"t_done_unix":1779814811.5366838},{"request_id":"1324227:1:1324227:367","session_id":"1324227","input_length":14863,"t_proxy_recv":383945.482457519,"t_decision_unix":1779814810.4963984,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14863,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":14863,"score_linear":121968.0,"score_lmetric":14863},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14863,"score_linear":62618.0,"score_lmetric":14863},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":86922,"ongoing_decode_tokens":11298,"pending_prefill_tokens":3432,"num_requests":2,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":0,"new_prefill":14863,"score_linear":86922.0,"score_lmetric":36590},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":14863,"score_linear":79663.0,"score_lmetric":14863},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1088,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":14863,"score_linear":33182.0,"score_lmetric":14863}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383946.812830369,"t_first_token_unix":1779814811.82679,"t_done":383947.05046878,"t_done_unix":1779814812.0644128},{"request_id":"1279412:16:1323780:365","session_id":"1279412","input_length":75624,"t_proxy_recv":383943.791900628,"t_decision_unix":1779814808.8058417,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9546175817200888,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":3432,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":75624,"score_linear":121968.0,"score_lmetric":75624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":75624,"score_linear":62618.0,"score_lmetric":75624},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13008,"ongoing_decode_tokens":13008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":75624,"score_linear":13008.0,"score_lmetric":75624},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11298,"ongoing_decode_tokens":0,"pending_prefill_tokens":11298,"num_requests":1,"active_p_offloads":0,"cached_blocks":1022,"cache_hit":72192,"new_prefill":3432,"score_linear":-60894.0,"score_lmetric":14730},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":75624,"score_linear":79663.0,"score_lmetric":75624},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":75624,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24395,"ongoing_decode_tokens":24395,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":75624,"score_linear":24395.0,"score_lmetric":75624},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":12800,"new_prefill":62824,"score_linear":20382.0,"score_lmetric":62824}],"chosen_score_linear":-60894.0,"chosen_score_lmetric":14730,"t_first_token":383946.038968237,"t_first_token_unix":1779814811.0529125,"t_done":383948.621452119,"t_done_unix":1779814813.6353958},{"request_id":"1316848:7:1325031:371","session_id":"1316848","input_length":26994,"t_proxy_recv":383948.145065766,"t_decision_unix":1779814813.159007,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":24064,"affinity_cache_ratio":0.8914573608950137,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":2930,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":26994,"score_linear":121968.0,"score_lmetric":26994},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":26994,"score_linear":62618.0,"score_lmetric":26994},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":26994,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75624,"ongoing_decode_tokens":75624,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1044,"cache_hit":0,"new_prefill":26994,"score_linear":75624.0,"score_lmetric":26994},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":26994,"score_linear":79663.0,"score_lmetric":26994},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4312,"ongoing_decode_tokens":0,"pending_prefill_tokens":4312,"num_requests":1,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":26994,"score_linear":4312.0,"score_lmetric":31306},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1088,"cache_hit":24064,"new_prefill":2930,"score_linear":-24064.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":26994,"score_linear":33182.0,"score_lmetric":26994}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":383948.706533328,"t_first_token_unix":1779814813.7204773,"t_done":383949.335261438,"t_done_unix":1779814814.3492117},{"request_id":"1322540:3:1325410:373","session_id":"1322540","input_length":12118,"t_proxy_recv":383949.518812411,"t_decision_unix":1779814814.5327537,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8704,"affinity_cache_ratio":0.7182703416405347,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":3414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":12118,"score_linear":121968.0,"score_lmetric":12118},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":12118,"score_linear":62618.0,"score_lmetric":12118},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":8704,"new_prefill":3414,"score_linear":-8704.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":12118,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":12118,"score_linear":79663.0,"score_lmetric":12118},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59442,"ongoing_decode_tokens":59442,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":12118,"score_linear":59442.0,"score_lmetric":24236},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":12118,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":12118,"score_linear":33182.0,"score_lmetric":12118}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":383949.875444812,"t_first_token_unix":1779814814.889388,"t_done":383950.001395756,"t_done_unix":1779814815.015339},{"request_id":"1324964:1:1324964:370","session_id":"1324964","input_length":4312,"t_proxy_recv":383947.900485045,"t_decision_unix":1779814812.9144258,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4312,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":4312,"score_linear":121968.0,"score_lmetric":4312},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":4312,"score_linear":62618.0,"score_lmetric":4312},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75624,"ongoing_decode_tokens":75624,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1044,"cache_hit":0,"new_prefill":4312,"score_linear":75624.0,"score_lmetric":4312},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":4312,"score_linear":79663.0,"score_lmetric":4312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1088,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":4312,"score_linear":33182.0,"score_lmetric":4312}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383948.167904308,"t_first_token_unix":1779814813.1818476,"t_done":383950.219165663,"t_done_unix":1779814815.2331092},{"request_id":"1317598:1:1317598:335","session_id":"1317598","input_length":79663,"t_proxy_recv":383921.976764952,"t_decision_unix":1779814786.9907064,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":79151,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":79663,"score_linear":121968.0,"score_lmetric":79663},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1120,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122000,"ongoing_decode_tokens":0,"pending_prefill_tokens":53904,"num_requests":2,"active_p_offloads":0,"cached_blocks":899,"cache_hit":0,"new_prefill":79663,"score_linear":122000.0,"score_lmetric":267134},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":829,"cache_hit":512,"new_prefill":79151,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72175,"ongoing_decode_tokens":6040,"pending_prefill_tokens":3159,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":79663,"score_linear":72175.0,"score_lmetric":165644},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1032,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":383943.698033149,"t_first_token_unix":1779814808.7119765,"t_done":383950.86011999,"t_done_unix":1779814815.874064},{"request_id":"1266668:12:1303535:276","session_id":"1266668","input_length":121968,"t_proxy_recv":383880.28478471,"t_decision_unix":1779814745.2987258,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":97792,"affinity_cache_ratio":0.8017840745113473,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":24176,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":715,"cache_hit":97792,"new_prefill":24176,"score_linear":-97792.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":699,"cache_hit":0,"new_prefill":121968,"score_linear":34706.0,"score_lmetric":121968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":12795,"ongoing_decode_tokens":0,"pending_prefill_tokens":12795,"num_requests":1,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":121968,"score_linear":12795.0,"score_lmetric":134763},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61291,"ongoing_decode_tokens":0,"pending_prefill_tokens":875,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":121968,"score_linear":61291.0,"score_lmetric":122843},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":719,"cache_hit":0,"new_prefill":121968,"score_linear":43607.0,"score_lmetric":121968},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":7680,"new_prefill":114288,"score_linear":35501.0,"score_lmetric":114288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89094,"ongoing_decode_tokens":89094,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":884,"cache_hit":58368,"new_prefill":63600,"score_linear":30726.0,"score_lmetric":127200},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":121968,"score_linear":75826.0,"score_lmetric":197794}],"chosen_score_linear":-97792.0,"chosen_score_lmetric":0,"t_first_token":383896.260471123,"t_first_token_unix":1779814761.2744143,"t_done":383951.772815983,"t_done_unix":1779814816.7867599},{"request_id":"1325987:1:1325987:376","session_id":"1325987","input_length":1823,"t_proxy_recv":383951.619473167,"t_decision_unix":1779814816.6334147,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1823,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":1823,"score_linear":121968.0,"score_lmetric":1823},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":1823,"score_linear":62618.0,"score_lmetric":1823},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":0,"new_prefill":1823,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":1823,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":1823,"score_linear":81220.0,"score_lmetric":1823},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":1823,"score_linear":55130.0,"score_lmetric":1823},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135744,"ongoing_decode_tokens":0,"pending_prefill_tokens":68672,"num_requests":2,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":1823,"score_linear":135744.0,"score_lmetric":140990},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":1823,"score_linear":33182.0,"score_lmetric":1823}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383951.738614813,"t_first_token_unix":1779814816.752559,"t_done":383951.920447178,"t_done_unix":1779814816.9343905},{"request_id":"1326192:1:1326192:378","session_id":"1326192","input_length":9513,"t_proxy_recv":383952.490734071,"t_decision_unix":1779814817.5046751,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9513,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":9513,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9513,"score_linear":62618.0,"score_lmetric":9513},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1201,"cache_hit":0,"new_prefill":9513,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":0,"pending_prefill_tokens":5232,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":9513,"score_linear":81008.0,"score_lmetric":14745},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":9513,"score_linear":81220.0,"score_lmetric":9513},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":9513,"score_linear":55130.0,"score_lmetric":9513},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135744,"ongoing_decode_tokens":0,"pending_prefill_tokens":68672,"num_requests":2,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":9513,"score_linear":135744.0,"score_lmetric":156370},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":9513,"score_linear":33182.0,"score_lmetric":9513}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383953.223378064,"t_first_token_unix":1779814818.2373216,"t_done":383953.758126447,"t_done_unix":1779814818.7720706},{"request_id":"1317598:2:1324364:368","session_id":"1317598","input_length":81220,"t_proxy_recv":383950.875174357,"t_decision_unix":1779814815.8891158,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":80384,"affinity_cache_ratio":0.9897069687269145,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":80384,"estimated_new_tokens":836,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":81220,"score_linear":121968.0,"score_lmetric":81220},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":81220,"score_linear":62618.0,"score_lmetric":81220},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":80384,"new_prefill":836,"score_linear":-80384.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":81220,"score_linear":55130.0,"score_lmetric":81220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135744,"ongoing_decode_tokens":0,"pending_prefill_tokens":68672,"num_requests":2,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":81220,"score_linear":135744.0,"score_lmetric":299784},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":81220,"score_linear":33182.0,"score_lmetric":81220}],"chosen_score_linear":-80384.0,"chosen_score_lmetric":0,"t_first_token":383951.454852694,"t_first_token_unix":1779814816.4687967,"t_done":383954.294364411,"t_done_unix":1779814819.3083112},{"request_id":"1322540:4:1326861:380","session_id":"1322540","input_length":13249,"t_proxy_recv":383954.767396908,"t_decision_unix":1779814819.7813385,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.8888217978715375,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":1473,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":13249,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":13249,"score_linear":62618.0,"score_lmetric":13249},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1219,"cache_hit":11776,"new_prefill":1473,"score_linear":-11776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":0,"pending_prefill_tokens":5232,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":13249,"score_linear":81008.0,"score_lmetric":18481},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":13249,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":13249,"score_linear":55130.0,"score_lmetric":13249},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":13249,"score_linear":163864.0,"score_lmetric":250251},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":13249,"score_linear":33182.0,"score_lmetric":13249}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":383954.948151982,"t_first_token_unix":1779814819.962096,"t_done":383955.078790425,"t_done_unix":1779814820.0927346},{"request_id":"1326192:2:1327234:381","session_id":"1326192","input_length":15253,"t_proxy_recv":383956.051087967,"t_decision_unix":1779814821.0650291,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":9216,"affinity_cache_ratio":0.6042090080639874,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":6037,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":15253,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":15253,"score_linear":62618.0,"score_lmetric":15253},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1221,"cache_hit":9216,"new_prefill":6037,"score_linear":-9216.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":15253,"score_linear":81008.0,"score_lmetric":15253},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":15253,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":15253,"score_linear":55130.0,"score_lmetric":15253},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":15253,"score_linear":163864.0,"score_lmetric":256263},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":15253,"score_linear":33182.0,"score_lmetric":15253}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":383956.739928451,"t_first_token_unix":1779814821.7538722,"t_done":383957.120334202,"t_done_unix":1779814822.1342788},{"request_id":"1324964:2:1327382:382","session_id":"1324964","input_length":5146,"t_proxy_recv":383956.653784827,"t_decision_unix":1779814821.6677256,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.895452778857365,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":538,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5146,"score_linear":62618.0,"score_lmetric":5146},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":15253,"ongoing_decode_tokens":0,"pending_prefill_tokens":6037,"num_requests":1,"active_p_offloads":0,"cached_blocks":1221,"cache_hit":0,"new_prefill":5146,"score_linear":15253.0,"score_lmetric":11183},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":5146,"score_linear":81008.0,"score_lmetric":5146},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":4608,"new_prefill":538,"score_linear":50522.0,"score_lmetric":538},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":5146,"score_linear":163864.0,"score_lmetric":225942},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":5146,"score_linear":33182.0,"score_lmetric":5146}],"chosen_score_linear":50522.0,"chosen_score_lmetric":538,"t_first_token":383956.814380668,"t_first_token_unix":1779814821.8283243,"t_done":383957.587852642,"t_done_unix":1779814822.6017962},{"request_id":"1324964:3:1328499:384","session_id":"1324964","input_length":5234,"t_proxy_recv":383960.669847835,"t_decision_unix":1779814825.683789,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.9782193351165457,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":114,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5234,"score_linear":62618.0,"score_lmetric":5234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":5234,"score_linear":81008.0,"score_lmetric":5234},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":5120,"new_prefill":114,"score_linear":50010.0,"score_lmetric":114},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":5234,"score_linear":163864.0,"score_lmetric":226206},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":5234,"score_linear":33182.0,"score_lmetric":5234}],"chosen_score_linear":50010.0,"chosen_score_lmetric":114,"t_first_token":383960.703035702,"t_first_token_unix":1779814825.7169795,"t_done":383961.071330046,"t_done_unix":1779814826.0852757},{"request_id":"1322225:1:1322225:358","session_id":"1322225","input_length":33182,"t_proxy_recv":383938.447190482,"t_decision_unix":1779814803.4611318,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":33182,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":33182,"score_linear":121968.0,"score_lmetric":33182},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":33182,"score_linear":62618.0,"score_lmetric":33182},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72402,"ongoing_decode_tokens":72402,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":33182,"score_linear":72402.0,"score_lmetric":33182},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":33182,"score_linear":79663.0,"score_lmetric":112333},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":46866,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":33182,"score_linear":54546.0,"score_lmetric":80048},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21471,"ongoing_decode_tokens":21471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1061,"cache_hit":0,"new_prefill":33182,"score_linear":21471.0,"score_lmetric":33182},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383943.105069797,"t_first_token_unix":1779814808.1190133,"t_done":383962.868315975,"t_done_unix":1779814827.8822596},{"request_id":"1279412:17:1326166:377","session_id":"1279412","input_length":81008,"t_proxy_recv":383952.336755513,"t_decision_unix":1779814817.3506966,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9354137862927119,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":5232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":81008,"score_linear":62618.0,"score_lmetric":81008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1201,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":75776,"new_prefill":5232,"score_linear":-75776.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":81008,"score_linear":81220.0,"score_lmetric":81008},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":81008,"score_linear":55130.0,"score_lmetric":81008},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135744,"ongoing_decode_tokens":0,"pending_prefill_tokens":68672,"num_requests":2,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":81008,"score_linear":135744.0,"score_lmetric":299360},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":12800,"new_prefill":68208,"score_linear":20382.0,"score_lmetric":68208}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":383954.981136113,"t_first_token_unix":1779814819.99508,"t_done":383963.476178294,"t_done_unix":1779814828.490122},{"request_id":"1329110:1:1329110:389","session_id":"1329110","input_length":9292,"t_proxy_recv":383962.882167151,"t_decision_unix":1779814827.8961086,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":9292,"score_linear":36880.0,"score_lmetric":46172},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9292,"score_linear":62618.0,"score_lmetric":9292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":9292,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":9292,"score_linear":81008.0,"score_lmetric":9292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":9292,"score_linear":116091.0,"score_lmetric":33864},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":9292,"score_linear":55130.0,"score_lmetric":9292},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":9292,"score_linear":163864.0,"score_lmetric":238380},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1164,"cache_hit":0,"new_prefill":9292,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383963.582976297,"t_first_token_unix":1779814828.5969195,"t_done":383963.892094286,"t_done_unix":1779814828.9060378},{"request_id":"1324964:4:1329201:390","session_id":"1324964","input_length":5414,"t_proxy_recv":383963.19217413,"t_decision_unix":1779814828.2061155,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.9456963428149243,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":294,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":5414,"score_linear":36880.0,"score_lmetric":42294},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5414,"score_linear":62618.0,"score_lmetric":5414},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":5414,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":5414,"score_linear":81008.0,"score_lmetric":5414},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":5414,"score_linear":116091.0,"score_lmetric":26108},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":5120,"new_prefill":294,"score_linear":50010.0,"score_lmetric":294},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":5414,"score_linear":163864.0,"score_lmetric":226746},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9292,"ongoing_decode_tokens":0,"pending_prefill_tokens":9292,"num_requests":1,"active_p_offloads":0,"cached_blocks":1164,"cache_hit":0,"new_prefill":5414,"score_linear":9292.0,"score_lmetric":14706}],"chosen_score_linear":50010.0,"chosen_score_lmetric":294,"t_first_token":383963.249311898,"t_first_token_unix":1779814828.2632556,"t_done":383963.948167464,"t_done_unix":1779814828.9621105},{"request_id":"1325987:2:1329336:391","session_id":"1325987","input_length":7423,"t_proxy_recv":383963.730247757,"t_decision_unix":1779814828.744189,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":1536,"affinity_cache_ratio":0.20692442408729625,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":5887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":7423,"score_linear":36880.0,"score_lmetric":44303},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":7423,"score_linear":62618.0,"score_lmetric":7423},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":1536,"new_prefill":5887,"score_linear":-1536.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1062,"cache_hit":0,"new_prefill":7423,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":7423,"score_linear":116091.0,"score_lmetric":30126},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":60544,"ongoing_decode_tokens":60544,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":7423,"score_linear":60544.0,"score_lmetric":14846},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":7423,"score_linear":163864.0,"score_lmetric":232773},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9292,"ongoing_decode_tokens":9292,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1164,"cache_hit":0,"new_prefill":7423,"score_linear":9292.0,"score_lmetric":7423}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":383964.150791312,"t_first_token_unix":1779814829.1647346,"t_done":383964.353026804,"t_done_unix":1779814829.3669703},{"request_id":"1329470:1:1329470:392","session_id":"1329470","input_length":10847,"t_proxy_recv":383964.216366191,"t_decision_unix":1779814829.2303076,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10847,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":10847,"score_linear":36880.0,"score_lmetric":47727},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":10847,"score_linear":62618.0,"score_lmetric":10847},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7423,"ongoing_decode_tokens":7423,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":10847,"score_linear":7423.0,"score_lmetric":10847},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1062,"cache_hit":0,"new_prefill":10847,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":10847,"score_linear":116091.0,"score_lmetric":36974},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":10847,"score_linear":55130.0,"score_lmetric":10847},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":10847,"score_linear":163864.0,"score_lmetric":243045},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":10847,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383965.07333598,"t_first_token_unix":1779814830.0872803,"t_done":383966.562768475,"t_done_unix":1779814831.5767121},{"request_id":"1324964:5:1330169:397","session_id":"1324964","input_length":6691,"t_proxy_recv":383966.586846031,"t_decision_unix":1779814831.6007874,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.7652069944701838,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":1571,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":6691,"score_linear":36880.0,"score_lmetric":43571},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":6691,"score_linear":62618.0,"score_lmetric":6691},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":6691,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":6691,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":6691,"score_linear":206696.0,"score_lmetric":21552},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":5120,"new_prefill":1571,"score_linear":50010.0,"score_lmetric":1571},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":6691,"score_linear":163864.0,"score_lmetric":230577},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":11725,"ongoing_decode_tokens":0,"pending_prefill_tokens":11725,"num_requests":1,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":6691,"score_linear":11725.0,"score_lmetric":18416}],"chosen_score_linear":50010.0,"chosen_score_lmetric":1571,"t_first_token":383966.779968652,"t_first_token_unix":1779814831.7939126,"t_done":383967.138989285,"t_done_unix":1779814832.152933},{"request_id":"1325541:1:1325541:374","session_id":"1325541","input_length":66703,"t_proxy_recv":383950.102867491,"t_decision_unix":1779814815.1168087,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66703,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":66703,"score_linear":121968.0,"score_lmetric":66703},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":66703,"score_linear":62618.0,"score_lmetric":66703},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":66703,"score_linear":79663.0,"score_lmetric":66703},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59442,"ongoing_decode_tokens":59442,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":898,"cache_hit":0,"new_prefill":66703,"score_linear":59442.0,"score_lmetric":133406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":66703,"score_linear":33182.0,"score_lmetric":66703}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383966.788909865,"t_first_token_unix":1779814831.8028536,"t_done":383967.436743517,"t_done_unix":1779814832.4506917},{"request_id":"1328753:1:1328753:387","session_id":"1328753","input_length":36880,"t_proxy_recv":383961.640380486,"t_decision_unix":1779814826.6543217,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":36880,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":36880,"score_linear":62618.0,"score_lmetric":36880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":36880,"score_linear":81008.0,"score_lmetric":36880},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81827,"ongoing_decode_tokens":0,"pending_prefill_tokens":419,"num_requests":1,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":36880,"score_linear":81827.0,"score_lmetric":37299},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":36880,"score_linear":55130.0,"score_lmetric":36880},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":36880,"score_linear":163864.0,"score_lmetric":321144},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":36880,"score_linear":33182.0,"score_lmetric":36880}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383967.224880178,"t_first_token_unix":1779814832.2388237,"t_done":383967.607202452,"t_done_unix":1779814832.6211464},{"request_id":"1330130:1:1330130:396","session_id":"1330130","input_length":11725,"t_proxy_recv":383966.485189074,"t_decision_unix":1779814831.4991302,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11725,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":11725,"score_linear":36880.0,"score_lmetric":48605},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":11725,"score_linear":62618.0,"score_lmetric":11725},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":11725,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10847,"ongoing_decode_tokens":10847,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1062,"cache_hit":0,"new_prefill":11725,"score_linear":10847.0,"score_lmetric":11725},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":11725,"score_linear":206696.0,"score_lmetric":36654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":11725,"score_linear":55130.0,"score_lmetric":11725},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":11725,"score_linear":163864.0,"score_lmetric":245679},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":11725,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383967.430468847,"t_first_token_unix":1779814832.4444125,"t_done":383967.880387281,"t_done_unix":1779814832.8943307},{"request_id":"1328753:2:1330033:395","session_id":"1328753","input_length":37007,"t_proxy_recv":383967.614170678,"t_decision_unix":1779814832.628112,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9961358661874781,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":836,"cache_hit":36864,"new_prefill":143,"score_linear":-36864.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":37007,"score_linear":62618.0,"score_lmetric":37007},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":37007,"score_linear":206696.0,"score_lmetric":112500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":37007,"score_linear":55130.0,"score_lmetric":37007},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97161,"ongoing_decode_tokens":97161,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":0,"new_prefill":37007,"score_linear":97161.0,"score_lmetric":74014},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":11725,"ongoing_decode_tokens":11725,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":37007,"score_linear":11725.0,"score_lmetric":37007}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":383967.709117697,"t_first_token_unix":1779814832.723061,"t_done":383968.163845584,"t_done_unix":1779814833.1777897},{"request_id":"1330881:1:1330881:400","session_id":"1330881","input_length":3866,"t_proxy_recv":383969.245030062,"t_decision_unix":1779814834.2589715,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3866,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":836,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":3866,"score_linear":62618.0,"score_lmetric":3866},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":25688,"ongoing_decode_tokens":0,"pending_prefill_tokens":10840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":3866,"score_linear":25688.0,"score_lmetric":14706},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":3866,"score_linear":206696.0,"score_lmetric":13077},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":3866,"score_linear":55130.0,"score_lmetric":3866},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97161,"ongoing_decode_tokens":97161,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":0,"new_prefill":3866,"score_linear":97161.0,"score_lmetric":7732},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1205,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383969.484483906,"t_first_token_unix":1779814834.4984276,"t_done":383969.842804992,"t_done_unix":1779814834.8567488},{"request_id":"1316848:8:1326380:379","session_id":"1316848","input_length":28120,"t_proxy_recv":383953.10208326,"t_decision_unix":1779814818.1160245,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9467994310099573,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":1496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":28120,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":28120,"score_linear":62618.0,"score_lmetric":28120},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":9513,"ongoing_decode_tokens":0,"pending_prefill_tokens":9513,"num_requests":1,"active_p_offloads":0,"cached_blocks":1201,"cache_hit":0,"new_prefill":28120,"score_linear":9513.0,"score_lmetric":37633},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":0,"pending_prefill_tokens":5232,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":28120,"score_linear":81008.0,"score_lmetric":33352},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":28120,"score_linear":81220.0,"score_lmetric":28120},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":28120,"score_linear":55130.0,"score_lmetric":28120},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135744,"ongoing_decode_tokens":0,"pending_prefill_tokens":68672,"num_requests":2,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":26624,"new_prefill":1496,"score_linear":109120.0,"score_lmetric":140336},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":28120,"score_linear":33182.0,"score_lmetric":28120}],"chosen_score_linear":109120.0,"chosen_score_lmetric":140336,"t_first_token":383966.796034256,"t_first_token_unix":1779814831.8099768,"t_done":383970.235363015,"t_done_unix":1779814835.2493067},{"request_id":"1326192:3:1330643:399","session_id":"1326192","input_length":25688,"t_proxy_recv":383968.387284297,"t_decision_unix":1779814833.4012256,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.5780130800373715,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":10840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":836,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":25688,"score_linear":62618.0,"score_lmetric":25688},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":14848,"new_prefill":10840,"score_linear":-14848.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":25688,"score_linear":206696.0,"score_lmetric":78543},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":25688,"score_linear":55130.0,"score_lmetric":25688},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97161,"ongoing_decode_tokens":97161,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":0,"new_prefill":25688,"score_linear":97161.0,"score_lmetric":51376},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1205,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":383970.150058737,"t_first_token_unix":1779814835.1640027,"t_done":383970.425179043,"t_done_unix":1779814835.4391222},{"request_id":"1326192:4:1331370:401","session_id":"1326192","input_length":27049,"t_proxy_recv":383971.020683867,"t_decision_unix":1779814836.034625,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":25600,"affinity_cache_ratio":0.9464305519612555,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25600,"estimated_new_tokens":1449,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":27049,"score_linear":62618.0,"score_lmetric":27049},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1264,"cache_hit":25600,"new_prefill":1449,"score_linear":-25600.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":27049,"score_linear":206696.0,"score_lmetric":82626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":27049,"score_linear":55130.0,"score_lmetric":27049},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97656,"ongoing_decode_tokens":97656,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":27049,"score_linear":97656.0,"score_lmetric":54098},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1205,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-25600.0,"chosen_score_lmetric":0,"t_first_token":383971.373647491,"t_first_token_unix":1779814836.387591,"t_done":383971.70596808,"t_done_unix":1779814836.7199113},{"request_id":"1329110:2:1331399:402","session_id":"1329110","input_length":12781,"t_proxy_recv":383971.096457263,"t_decision_unix":1779814836.1103988,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.7210703387841327,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":3565,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":12781,"score_linear":62618.0,"score_lmetric":12781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":27049,"ongoing_decode_tokens":0,"pending_prefill_tokens":1449,"num_requests":1,"active_p_offloads":0,"cached_blocks":1264,"cache_hit":0,"new_prefill":12781,"score_linear":27049.0,"score_lmetric":14230},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":12781,"score_linear":206696.0,"score_lmetric":39822},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":12781,"score_linear":55130.0,"score_lmetric":12781},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97656,"ongoing_decode_tokens":97656,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":12781,"score_linear":97656.0,"score_lmetric":25562},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1205,"cache_hit":9216,"new_prefill":3565,"score_linear":-9216.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":383971.503122008,"t_first_token_unix":1779814836.5170655,"t_done":383971.868354964,"t_done_unix":1779814836.8822985},{"request_id":"1330130:2:1331784:403","session_id":"1330130","input_length":14067,"t_proxy_recv":383972.290819495,"t_decision_unix":1779814837.304761,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":11776,"affinity_cache_ratio":0.8371365607450061,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":2291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14067,"score_linear":62618.0,"score_lmetric":14067},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1266,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":14067,"score_linear":206696.0,"score_lmetric":43680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":14067,"score_linear":55130.0,"score_lmetric":14067},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97656,"ongoing_decode_tokens":97656,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":14067,"score_linear":97656.0,"score_lmetric":28134},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1212,"cache_hit":11776,"new_prefill":2291,"score_linear":-11776.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":383972.60323479,"t_first_token_unix":1779814837.617178,"t_done":383972.741801867,"t_done_unix":1779814837.7557452},{"request_id":"1329470:2:1332133:409","session_id":"1329470","input_length":11766,"t_proxy_recv":383973.448574066,"t_decision_unix":1779814838.4625154,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9138194798572157,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":1014,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":11766,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":11766,"score_linear":62618.0,"score_lmetric":11766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1266,"cache_hit":0,"new_prefill":11766,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":10752,"new_prefill":1014,"score_linear":-10752.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":11766,"score_linear":206696.0,"score_lmetric":36777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":11766,"score_linear":55130.0,"score_lmetric":11766},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170890,"ongoing_decode_tokens":97656,"pending_prefill_tokens":6674,"num_requests":3,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":11766,"score_linear":170890.0,"score_lmetric":55320},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":8880,"num_requests":1,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":0,"new_prefill":11766,"score_linear":21680.0,"score_lmetric":20646}],"chosen_score_linear":-10752.0,"chosen_score_lmetric":0,"t_first_token":383973.583789259,"t_first_token_unix":1779814838.5977325,"t_done":383973.647291336,"t_done_unix":1779814838.661238},{"request_id":"1332021:1:1332021:407","session_id":"1332021","input_length":12421,"t_proxy_recv":383973.091008694,"t_decision_unix":1779814838.1049497,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12421,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":12421,"score_linear":62618.0,"score_lmetric":12421},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1266,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":12421,"score_linear":206696.0,"score_lmetric":38742},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":12421,"score_linear":55130.0,"score_lmetric":12421},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170890,"ongoing_decode_tokens":97656,"pending_prefill_tokens":6674,"num_requests":3,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":12421,"score_linear":170890.0,"score_lmetric":57285},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":8880,"num_requests":1,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":0,"new_prefill":12421,"score_linear":21680.0,"score_lmetric":21301}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383974.117542844,"t_first_token_unix":1779814839.131487,"t_done":383974.371725465,"t_done_unix":1779814839.3856692},{"request_id":"1325541:2:1331846:404","session_id":"1325541","input_length":73234,"t_proxy_recv":383972.496596373,"t_decision_unix":1779814837.510538,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":66560,"affinity_cache_ratio":0.9088674659311249,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66560,"estimated_new_tokens":6674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":73234,"score_linear":62618.0,"score_lmetric":73234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1266,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":73234,"score_linear":206696.0,"score_lmetric":221181},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":73234,"score_linear":55130.0,"score_lmetric":73234},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97656,"ongoing_decode_tokens":97656,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":66560,"new_prefill":6674,"score_linear":31096.0,"score_lmetric":13348},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":14067,"ongoing_decode_tokens":0,"pending_prefill_tokens":2291,"num_requests":1,"active_p_offloads":0,"cached_blocks":1212,"cache_hit":0,"new_prefill":73234,"score_linear":14067.0,"score_lmetric":75525}],"chosen_score_linear":31096.0,"chosen_score_lmetric":13348,"t_first_token":383975.410147819,"t_first_token_unix":1779814840.4240909,"t_done":383975.558181995,"t_done_unix":1779814840.5721252},{"request_id":"1332472:1:1332472:410","session_id":"1332472","input_length":1810,"t_proxy_recv":383974.746060254,"t_decision_unix":1779814839.760002,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1810,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":1810,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":1810,"score_linear":62618.0,"score_lmetric":1810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1290,"cache_hit":0,"new_prefill":1810,"score_linear":-12421.0,"score_lmetric":10611},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":0,"new_prefill":1810,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":1810,"score_linear":206696.0,"score_lmetric":6909},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":1810,"score_linear":55130.0,"score_lmetric":1810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170890,"ongoing_decode_tokens":97656,"pending_prefill_tokens":6674,"num_requests":3,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":1810,"score_linear":170890.0,"score_lmetric":25452},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":8880,"num_requests":1,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":0,"new_prefill":1810,"score_linear":21680.0,"score_lmetric":10690}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383974.916578415,"t_first_token_unix":1779814839.930522,"t_done":383975.603742132,"t_done_unix":1779814840.6176853},{"request_id":"1269373:15:1325630:375","session_id":"1269373","input_length":69041,"t_proxy_recv":383950.362220626,"t_decision_unix":1779814815.376162,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":67072,"affinity_cache_ratio":0.971480714358135,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":67072,"estimated_new_tokens":1969,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":61361,"score_linear":114288.0,"score_lmetric":61361},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":69041,"score_linear":62618.0,"score_lmetric":69041},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":0,"new_prefill":69041,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":69041,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":69041,"score_linear":79663.0,"score_lmetric":69041},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":7680,"new_prefill":61361,"score_linear":47450.0,"score_lmetric":61361},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":67072,"new_prefill":1969,"score_linear":-369.0,"score_lmetric":68672},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":69041,"score_linear":33182.0,"score_lmetric":69041}],"chosen_score_linear":-369.0,"chosen_score_lmetric":68672,"t_first_token":383966.795864324,"t_first_token_unix":1779814831.8098075,"t_done":383975.913026148,"t_done_unix":1779814840.9269698},{"request_id":"1316848:9:1328693:386","session_id":"1316848","input_length":28615,"t_proxy_recv":383970.241743164,"t_decision_unix":1779814835.2556846,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9840992486458151,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":455,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":28615,"score_linear":62618.0,"score_lmetric":28615},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":25688,"ongoing_decode_tokens":25688,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":28615,"score_linear":25688.0,"score_lmetric":28615},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":28615,"score_linear":206696.0,"score_lmetric":87324},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":28615,"score_linear":55130.0,"score_lmetric":28615},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":28160,"new_prefill":455,"score_linear":40881.0,"score_lmetric":455},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1205,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":40881.0,"chosen_score_lmetric":455,"t_first_token":383970.359984687,"t_first_token_unix":1779814835.3739293,"t_done":383975.974626831,"t_done_unix":1779814840.9885705},{"request_id":"1329110:3:1332476:411","session_id":"1329110","input_length":13479,"t_proxy_recv":383974.77152812,"t_decision_unix":1779814839.7854698,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":12800,"affinity_cache_ratio":0.9496253431263447,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":679,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":1810,"ongoing_decode_tokens":0,"pending_prefill_tokens":1810,"num_requests":1,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":13479,"score_linear":1810.0,"score_lmetric":15289},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":13479,"score_linear":62618.0,"score_lmetric":13479},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1290,"cache_hit":0,"new_prefill":13479,"score_linear":-12421.0,"score_lmetric":-1058},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":0,"new_prefill":13479,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":13479,"score_linear":206696.0,"score_lmetric":41916},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":13479,"score_linear":55130.0,"score_lmetric":13479},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170890,"ongoing_decode_tokens":97656,"pending_prefill_tokens":6674,"num_requests":3,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":13479,"score_linear":170890.0,"score_lmetric":60459},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":8880,"num_requests":1,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":12800,"new_prefill":679,"score_linear":8880.0,"score_lmetric":9559}],"chosen_score_linear":8880.0,"chosen_score_lmetric":9559,"t_first_token":383975.509909536,"t_first_token_unix":1779814840.5238526,"t_done":383976.003399837,"t_done_unix":1779814841.0173435},{"request_id":"1332013:1:1332013:406","session_id":"1332013","input_length":21680,"t_proxy_recv":383973.074180532,"t_decision_unix":1779814838.0881217,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":8880,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":843,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":12800,"new_prefill":8880,"score_linear":49818.0,"score_lmetric":8880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1266,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":21680,"score_linear":206696.0,"score_lmetric":66519},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":21680,"score_linear":55130.0,"score_lmetric":21680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170890,"ongoing_decode_tokens":97656,"pending_prefill_tokens":6674,"num_requests":3,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":12800,"new_prefill":8880,"score_linear":158090.0,"score_lmetric":46662},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":12800,"new_prefill":8880,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":383975.391994785,"t_first_token_unix":1779814840.4059613,"t_done":383976.731584902,"t_done_unix":1779814841.745529},{"request_id":"1332754:1:1332754:412","session_id":"1332754","input_length":19766,"t_proxy_recv":383975.77374739,"t_decision_unix":1779814840.787689,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-7345,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":19766,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":19766,"score_linear":62618.0,"score_lmetric":19766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1290,"cache_hit":0,"new_prefill":19766,"score_linear":-12421.0,"score_lmetric":-7345},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":19766,"score_linear":206696.0,"score_lmetric":60777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":19766,"score_linear":55130.0,"score_lmetric":19766},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97656,"ongoing_decode_tokens":97656,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1239,"cache_hit":0,"new_prefill":19766,"score_linear":97656.0,"score_lmetric":39532},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35159,"ongoing_decode_tokens":35159,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":0,"new_prefill":19766,"score_linear":35159.0,"score_lmetric":39532}],"chosen_score_linear":-12421.0,"chosen_score_lmetric":-7345,"t_first_token":383977.807152586,"t_first_token_unix":1779814842.821096,"t_done":383978.286854546,"t_done_unix":1779814843.3007984},{"request_id":"1279412:18:1332945:413","session_id":"1279412","input_length":82488,"t_proxy_recv":383976.619065339,"t_decision_unix":1779814841.6330063,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9869071864998545,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":1080,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":82488,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":82488,"score_linear":62618.0,"score_lmetric":82488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7345,"ongoing_decode_tokens":0,"pending_prefill_tokens":7345,"num_requests":0,"active_p_offloads":0,"cached_blocks":1290,"cache_hit":0,"new_prefill":82488,"score_linear":7345.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":81408,"new_prefill":1080,"score_linear":-81408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":82488,"score_linear":206696.0,"score_lmetric":248943},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":82488,"score_linear":55130.0,"score_lmetric":82488},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":100754,"ongoing_decode_tokens":0,"pending_prefill_tokens":2962,"num_requests":2,"active_p_offloads":0,"cached_blocks":1244,"cache_hit":0,"new_prefill":82488,"score_linear":100754.0,"score_lmetric":170900},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21680,"ongoing_decode_tokens":21680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1217,"cache_hit":12800,"new_prefill":69688,"score_linear":8880.0,"score_lmetric":69688}],"chosen_score_linear":-81408.0,"chosen_score_lmetric":0,"t_first_token":383977.056203114,"t_first_token_unix":1779814842.070147,"t_done":383979.798407008,"t_done_unix":1779814844.812351},{"request_id":"1269373:16:1331896:405","session_id":"1269373","input_length":71777,"t_proxy_recv":383975.935256038,"t_decision_unix":1779814840.9491973,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9629825710185714,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":2657,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":7680,"new_prefill":64097,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":71777,"score_linear":62618.0,"score_lmetric":71777},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7345,"ongoing_decode_tokens":0,"pending_prefill_tokens":7345,"num_requests":0,"active_p_offloads":0,"cached_blocks":1290,"cache_hit":0,"new_prefill":71777,"score_linear":7345.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":0,"new_prefill":71777,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":71777,"score_linear":206696.0,"score_lmetric":216810},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":7680,"new_prefill":64097,"score_linear":47450.0,"score_lmetric":64097},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28615,"ongoing_decode_tokens":28615,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":69120,"new_prefill":2657,"score_linear":-40505.0,"score_lmetric":2657},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35159,"ongoing_decode_tokens":35159,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1216,"cache_hit":0,"new_prefill":71777,"score_linear":35159.0,"score_lmetric":143554}],"chosen_score_linear":-40505.0,"chosen_score_lmetric":2657,"t_first_token":383977.10357424,"t_first_token_unix":1779814842.1175184,"t_done":383980.507217753,"t_done_unix":1779814845.521165},{"request_id":"1316848:10:1330509:398","session_id":"1316848","input_length":28977,"t_proxy_recv":383976.012542923,"t_decision_unix":1779814841.0264845,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9894744107395521,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":305,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":28977,"score_linear":62618.0,"score_lmetric":28977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7345,"ongoing_decode_tokens":0,"pending_prefill_tokens":7345,"num_requests":0,"active_p_offloads":0,"cached_blocks":1290,"cache_hit":0,"new_prefill":28977,"score_linear":7345.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":28977,"score_linear":206696.0,"score_lmetric":88410},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":28977,"score_linear":55130.0,"score_lmetric":28977},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":0,"pending_prefill_tokens":2657,"num_requests":1,"active_p_offloads":0,"cached_blocks":1244,"cache_hit":28672,"new_prefill":305,"score_linear":43105.0,"score_lmetric":2962},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21680,"ongoing_decode_tokens":21680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1217,"cache_hit":0,"new_prefill":28977,"score_linear":21680.0,"score_lmetric":28977}],"chosen_score_linear":43105.0,"chosen_score_lmetric":2962,"t_first_token":383977.146118865,"t_first_token_unix":1779814842.1600623,"t_done":383981.606830913,"t_done_unix":1779814846.620774},{"request_id":"1316848:11:1333994:416","session_id":"1316848","input_length":29656,"t_proxy_recv":383981.613097383,"t_decision_unix":1779814846.627039,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9840841650930672,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":472,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":29656,"score_linear":62618.0,"score_lmetric":29656},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":11268,"ongoing_decode_tokens":0,"pending_prefill_tokens":11268,"num_requests":0,"active_p_offloads":0,"cached_blocks":1328,"cache_hit":0,"new_prefill":29656,"score_linear":11268.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":29656,"score_linear":206696.0,"score_lmetric":90447},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":29656,"score_linear":55130.0,"score_lmetric":29656},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1250,"cache_hit":29184,"new_prefill":472,"score_linear":-29184.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":383981.727154635,"t_first_token_unix":1779814846.7410982,"t_done":383982.011369534,"t_done_unix":1779814847.0253131},{"request_id":"1334223:1:1334223:417","session_id":"1334223","input_length":23689,"t_proxy_recv":383981.020614196,"t_decision_unix":1779814846.0345547,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-11268,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":23689,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":23689,"score_linear":62618.0,"score_lmetric":23689},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1328,"cache_hit":0,"new_prefill":23689,"score_linear":-12421.0,"score_lmetric":-11268},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":23689,"score_linear":206696.0,"score_lmetric":72546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":23689,"score_linear":55130.0,"score_lmetric":23689},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1249,"cache_hit":0,"new_prefill":23689,"score_linear":28977.0,"score_lmetric":23689},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12421.0,"chosen_score_lmetric":-11268,"t_first_token":383983.699224661,"t_first_token_unix":1779814848.7131681,"t_done":383984.29513667,"t_done_unix":1779814849.3090806},{"request_id":"1316848:12:1334743:418","session_id":"1316848","input_length":44664,"t_proxy_recv":383982.997208196,"t_decision_unix":1779814848.01115,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":29696,"affinity_cache_ratio":0.6648755149561167,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":14968,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":44664,"score_linear":62618.0,"score_lmetric":44664},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":11268,"ongoing_decode_tokens":0,"pending_prefill_tokens":11268,"num_requests":0,"active_p_offloads":0,"cached_blocks":1328,"cache_hit":0,"new_prefill":44664,"score_linear":11268.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":44664,"score_linear":206696.0,"score_lmetric":135471},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":44664,"score_linear":55130.0,"score_lmetric":44664},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":45601,"ongoing_decode_tokens":0,"pending_prefill_tokens":1057,"num_requests":1,"active_p_offloads":0,"cached_blocks":1251,"cache_hit":29696,"new_prefill":14968,"score_linear":15905.0,"score_lmetric":16025},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":15905.0,"chosen_score_lmetric":16025,"t_first_token":383987.140361997,"t_first_token_unix":1779814852.1543057,"t_done":383988.442277753,"t_done_unix":1779814853.456224},{"request_id":"1330881:2:1336222:422","session_id":"1330881","input_length":11989,"t_proxy_recv":383988.104116605,"t_decision_unix":1779814853.118058,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":3584,"affinity_cache_ratio":0.29894069563766784,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":8405,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":3584,"new_prefill":8405,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":11989,"score_linear":62618.0,"score_lmetric":11989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1374,"cache_hit":0,"new_prefill":11989,"score_linear":-12421.0,"score_lmetric":432},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":148493,"ongoing_decode_tokens":61229,"pending_prefill_tokens":4832,"num_requests":2,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":11989,"score_linear":148493.0,"score_lmetric":33642},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":11989,"score_linear":206696.0,"score_lmetric":37446},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":11989,"score_linear":55130.0,"score_lmetric":11989},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":90265,"ongoing_decode_tokens":90265,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1251,"cache_hit":0,"new_prefill":11989,"score_linear":90265.0,"score_lmetric":23978},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":383988.848115651,"t_first_token_unix":1779814853.8620594,"t_done":383989.004591441,"t_done_unix":1779814854.018535},{"request_id":"1309252:2:1334746:419","session_id":"1309252","input_length":45601,"t_proxy_recv":383982.990472043,"t_decision_unix":1779814848.0044131,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":44544,"affinity_cache_ratio":0.9768206837569352,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":1057,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":45601,"score_linear":62618.0,"score_lmetric":45601},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":11268,"ongoing_decode_tokens":0,"pending_prefill_tokens":11268,"num_requests":0,"active_p_offloads":0,"cached_blocks":1328,"cache_hit":0,"new_prefill":45601,"score_linear":11268.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":45601,"score_linear":206696.0,"score_lmetric":138282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":45601,"score_linear":55130.0,"score_lmetric":45601},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1251,"cache_hit":44544,"new_prefill":1057,"score_linear":-44544.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44544.0,"chosen_score_lmetric":0,"t_first_token":383983.349047685,"t_first_token_unix":1779814848.3629916,"t_done":383989.08318847,"t_done_unix":1779814854.0971317},{"request_id":"1279412:19:1335444:421","session_id":"1279412","input_length":87264,"t_proxy_recv":383985.292950975,"t_decision_unix":1779814850.3068924,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":82432,"affinity_cache_ratio":0.9446277961129447,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82432,"estimated_new_tokens":4832,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":87264,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":87264,"score_linear":62618.0,"score_lmetric":87264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1374,"cache_hit":0,"new_prefill":87264,"score_linear":-12421.0,"score_lmetric":-74843},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61229,"ongoing_decode_tokens":0,"pending_prefill_tokens":4397,"num_requests":1,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":82432,"new_prefill":4832,"score_linear":-21203.0,"score_lmetric":9229},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":87264,"score_linear":206696.0,"score_lmetric":263271},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":87264,"score_linear":55130.0,"score_lmetric":87264},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":90265,"ongoing_decode_tokens":45601,"pending_prefill_tokens":14968,"num_requests":2,"active_p_offloads":0,"cached_blocks":1251,"cache_hit":0,"new_prefill":87264,"score_linear":90265.0,"score_lmetric":204464},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":12800,"new_prefill":74464,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-21203.0,"chosen_score_lmetric":9229,"t_first_token":383988.374625672,"t_first_token_unix":1779814853.3885689,"t_done":383991.166219519,"t_done_unix":1779814856.1801639},{"request_id":"1314357:2:1335184:420","session_id":"1314357","input_length":61229,"t_proxy_recv":383984.358101934,"t_decision_unix":1779814849.3720398,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9281876235117347,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":4397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":846,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":61229,"score_linear":62618.0,"score_lmetric":61229},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1374,"cache_hit":0,"new_prefill":61229,"score_linear":-12421.0,"score_lmetric":-48808},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":56832,"new_prefill":4397,"score_linear":-56832.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":61229,"score_linear":206696.0,"score_lmetric":185166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":61229,"score_linear":55130.0,"score_lmetric":61229},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":90265,"ongoing_decode_tokens":45601,"pending_prefill_tokens":14968,"num_requests":2,"active_p_offloads":0,"cached_blocks":1251,"cache_hit":0,"new_prefill":61229,"score_linear":90265.0,"score_lmetric":152394},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56832.0,"chosen_score_lmetric":0,"t_first_token":383985.943615949,"t_first_token_unix":1779814850.95756,"t_done":383991.412389099,"t_done_unix":1779814856.4263334},{"request_id":"1336620:1:1336620:423","session_id":"1336620","input_length":14666,"t_proxy_recv":383989.406862682,"t_decision_unix":1779814854.4208038,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-2245,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":14666,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":862,"cache_hit":7680,"new_prefill":6986,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14666,"score_linear":62618.0,"score_lmetric":14666},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1374,"cache_hit":0,"new_prefill":14666,"score_linear":-12421.0,"score_lmetric":-2245},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":148493,"ongoing_decode_tokens":148493,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":14666,"score_linear":148493.0,"score_lmetric":29332},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":14666,"score_linear":206696.0,"score_lmetric":45477},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":7680,"new_prefill":6986,"score_linear":47450.0,"score_lmetric":6986},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":7680,"new_prefill":6986,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":14666,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12421.0,"chosen_score_lmetric":-2245,"t_first_token":383990.702576214,"t_first_token_unix":1779814855.7165203,"t_done":383991.657773247,"t_done_unix":1779814856.6717167},{"request_id":"1337035:1:1337035:425","session_id":"1337035","input_length":12644,"t_proxy_recv":383990.904113618,"t_decision_unix":1779814855.9180548,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":862,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":12644,"score_linear":62618.0,"score_lmetric":12644},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":2245,"ongoing_decode_tokens":14666,"pending_prefill_tokens":-12421,"num_requests":0,"active_p_offloads":0,"cached_blocks":1374,"cache_hit":0,"new_prefill":12644,"score_linear":2245.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":148493,"ongoing_decode_tokens":148493,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":12644,"score_linear":148493.0,"score_lmetric":25288},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":12644,"score_linear":206696.0,"score_lmetric":39411},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":12644,"score_linear":55130.0,"score_lmetric":12644},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":0,"pending_prefill_tokens":5673,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":12644,"score_linear":20009.0,"score_lmetric":18317},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":383991.954209683,"t_first_token_unix":1779814856.9681542,"t_done":383992.128065422,"t_done_unix":1779814857.1420085},{"request_id":"1317598:3:1328678:385","session_id":"1317598","input_length":81827,"t_proxy_recv":383961.347233842,"t_decision_unix":1779814826.361175,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9948794407713836,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":419,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":81827,"score_linear":62618.0,"score_lmetric":81827},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":81827,"score_linear":81008.0,"score_lmetric":81827},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":987,"cache_hit":81408,"new_prefill":419,"score_linear":-81408.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":81827,"score_linear":55130.0,"score_lmetric":81827},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":81827,"score_linear":163864.0,"score_lmetric":455985},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":81827,"score_linear":33182.0,"score_lmetric":81827}],"chosen_score_linear":-81408.0,"chosen_score_lmetric":0,"t_first_token":383961.761125543,"t_first_token_unix":1779814826.7750697,"t_done":383992.236198706,"t_done_unix":1779814857.2501426},{"request_id":"1259178:2:1336768:424","session_id":"1259178","input_length":20009,"t_proxy_recv":383989.871763508,"t_decision_unix":1779814854.8857045,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.716477585086711,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":5673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":862,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":20009,"score_linear":62618.0,"score_lmetric":20009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":2245,"ongoing_decode_tokens":0,"pending_prefill_tokens":2245,"num_requests":0,"active_p_offloads":0,"cached_blocks":1374,"cache_hit":0,"new_prefill":20009,"score_linear":2245.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":148493,"ongoing_decode_tokens":148493,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1087,"cache_hit":0,"new_prefill":20009,"score_linear":148493.0,"score_lmetric":40018},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":0,"new_prefill":20009,"score_linear":206696.0,"score_lmetric":61506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":20009,"score_linear":55130.0,"score_lmetric":20009},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":14336,"new_prefill":5673,"score_linear":-14336.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":383991.931527525,"t_first_token_unix":1779814856.945471,"t_done":383992.727921477,"t_done_unix":1779814857.741865},{"request_id":"1257323:2:1329541:393","session_id":"1257323","input_length":90605,"t_proxy_recv":383964.664491121,"t_decision_unix":1779814829.6784325,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":90112,"affinity_cache_ratio":0.9945587991832681,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":90112,"estimated_new_tokens":493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":90605,"score_linear":36880.0,"score_lmetric":127485},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":90605,"score_linear":62618.0,"score_lmetric":90605},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":90605,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10847,"ongoing_decode_tokens":0,"pending_prefill_tokens":10847,"num_requests":1,"active_p_offloads":0,"cached_blocks":1062,"cache_hit":0,"new_prefill":90605,"score_linear":10847.0,"score_lmetric":101452},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":116091,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":987,"cache_hit":90112,"new_prefill":493,"score_linear":25979.0,"score_lmetric":986},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":90605,"score_linear":55130.0,"score_lmetric":90605},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":90605,"score_linear":163864.0,"score_lmetric":482319},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":90605,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":25979.0,"chosen_score_lmetric":986,"t_first_token":383992.141639253,"t_first_token_unix":1779814857.1555874,"t_done":383992.931244856,"t_done_unix":1779814857.9451883},{"request_id":"1316848:13:1337519:427","session_id":"1316848","input_length":45005,"t_proxy_recv":383992.739101275,"t_decision_unix":1779814857.7530425,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":44544,"affinity_cache_ratio":0.9897566937007,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":461,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":45005,"score_linear":62618.0,"score_lmetric":45005},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24097,"ongoing_decode_tokens":0,"pending_prefill_tokens":24097,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":45005,"score_linear":24097.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":207011,"ongoing_decode_tokens":207011,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":988,"cache_hit":0,"new_prefill":45005,"score_linear":207011.0,"score_lmetric":135015},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":45005,"score_linear":55130.0,"score_lmetric":45005},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":44544,"new_prefill":461,"score_linear":-44544.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44544.0,"chosen_score_lmetric":0,"t_first_token":383992.911401073,"t_first_token_unix":1779814857.925345,"t_done":383993.209259199,"t_done_unix":1779814858.2232027},{"request_id":"1259178:3:1337653:429","session_id":"1259178","input_length":22398,"t_proxy_recv":383993.190527398,"t_decision_unix":1779814858.2044685,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":19968,"affinity_cache_ratio":0.8915081703723546,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":2430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":22398,"score_linear":62618.0,"score_lmetric":22398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24097,"ongoing_decode_tokens":0,"pending_prefill_tokens":24097,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":22398,"score_linear":24097.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":22398,"score_linear":95383.0,"score_lmetric":30741},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":22398,"score_linear":116406.0,"score_lmetric":44796},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":22398,"score_linear":55130.0,"score_lmetric":22398},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":45005,"ongoing_decode_tokens":45005,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":19968,"new_prefill":2430,"score_linear":25037.0,"score_lmetric":2430},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":25037.0,"chosen_score_lmetric":2430,"t_first_token":383993.628541169,"t_first_token_unix":1779814858.6424847,"t_done":383994.473517577,"t_done_unix":1779814859.4874635},{"request_id":"1268861:5:1329060:388","session_id":"1268861","input_length":34264,"t_proxy_recv":383962.755114618,"t_decision_unix":1779814827.7690558,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":26624,"affinity_cache_ratio":0.7770254494513191,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":7640,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":34264,"score_linear":36880.0,"score_lmetric":71144},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":34264,"score_linear":62618.0,"score_lmetric":34264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1232,"cache_hit":0,"new_prefill":34264,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":34264,"score_linear":81008.0,"score_lmetric":34264},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81827,"ongoing_decode_tokens":81827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":987,"cache_hit":26624,"new_prefill":7640,"score_linear":55203.0,"score_lmetric":7640},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":34264,"score_linear":55130.0,"score_lmetric":34264},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163864,"ongoing_decode_tokens":0,"pending_prefill_tokens":70168,"num_requests":3,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":34264,"score_linear":163864.0,"score_lmetric":313296},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":34264,"score_linear":33182.0,"score_lmetric":34264}],"chosen_score_linear":55203.0,"chosen_score_lmetric":7640,"t_first_token":383964.394082923,"t_first_token_unix":1779814829.408028,"t_done":383996.707988517,"t_done_unix":1779814861.7219317},{"request_id":"1317598:4:1332127:408","session_id":"1317598","input_length":82142,"t_proxy_recv":383992.255046266,"t_decision_unix":1779814857.268988,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81920,"affinity_cache_ratio":0.9972973631029194,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81920,"estimated_new_tokens":222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":82142,"score_linear":62618.0,"score_lmetric":82142},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24097,"ongoing_decode_tokens":0,"pending_prefill_tokens":24097,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":82142,"score_linear":24097.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":124869,"ongoing_decode_tokens":124869,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":988,"cache_hit":81920,"new_prefill":222,"score_linear":42949.0,"score_lmetric":444},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":82142,"score_linear":55130.0,"score_lmetric":82142},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":20009,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":82142,"score_linear":20009.0,"score_lmetric":82142},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":42949.0,"chosen_score_lmetric":444,"t_first_token":383992.531547082,"t_first_token_unix":1779814857.5454905,"t_done":383998.037384744,"t_done_unix":1779814863.0513282},{"request_id":"1338292:1:1338292:432","session_id":"1338292","input_length":9325,"t_proxy_recv":383995.388015772,"t_decision_unix":1779814860.4019566,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9325,"score_linear":62618.0,"score_lmetric":9325},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24097,"ongoing_decode_tokens":0,"pending_prefill_tokens":24097,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":9325,"score_linear":24097.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":9325,"score_linear":95383.0,"score_lmetric":17668},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":9325,"score_linear":116406.0,"score_lmetric":18650},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":9325,"score_linear":55130.0,"score_lmetric":9325},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":0,"pending_prefill_tokens":1393,"num_requests":1,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":0,"new_prefill":9325,"score_linear":73073.0,"score_lmetric":10718},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":24097.0,"chosen_score_lmetric":0,"t_first_token":383997.985758459,"t_first_token_unix":1779814862.9997017,"t_done":383998.67009233,"t_done_unix":1779814863.6840363},{"request_id":"1311753:2:1337278:426","session_id":"1311753","input_length":36518,"t_proxy_recv":383991.763114689,"t_decision_unix":1779814856.7770553,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":19968,"affinity_cache_ratio":0.5467988389287475,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":-24097,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":36518,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12644,"ongoing_decode_tokens":0,"pending_prefill_tokens":12644,"num_requests":1,"active_p_offloads":0,"cached_blocks":862,"cache_hit":0,"new_prefill":36518,"score_linear":12644.0,"score_lmetric":49162},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":36518,"score_linear":62618.0,"score_lmetric":36518},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":-12421,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":36518,"score_linear":-12421.0,"score_lmetric":-24097},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":987,"cache_hit":19968,"new_prefill":16550,"score_linear":186728.0,"score_lmetric":51129},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":36518,"score_linear":55130.0,"score_lmetric":36518},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":0,"pending_prefill_tokens":5673,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":36518,"score_linear":20009.0,"score_lmetric":42191},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12421.0,"chosen_score_lmetric":-24097,"t_first_token":383997.273977949,"t_first_token_unix":1779814862.2879217,"t_done":383998.754806319,"t_done_unix":1779814863.7687497},{"request_id":"1317598:5:1337780:430","session_id":"1317598","input_length":83088,"t_proxy_recv":383998.05196158,"t_decision_unix":1779814863.0659027,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82432,"affinity_cache_ratio":0.99210475640285,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":82432,"estimated_new_tokens":656,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":83088,"score_linear":62618.0,"score_lmetric":83088},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55405,"ongoing_decode_tokens":60761,"pending_prefill_tokens":-5356,"num_requests":3,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":83088,"score_linear":55405.0,"score_lmetric":233196},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161535,"ongoing_decode_tokens":95383,"pending_prefill_tokens":4712,"num_requests":2,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":83088,"score_linear":161535.0,"score_lmetric":175600},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1005,"cache_hit":82432,"new_prefill":656,"score_linear":-82432.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105345,"ongoing_decode_tokens":105345,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":83088,"score_linear":105345.0,"score_lmetric":166176},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":122761,"ongoing_decode_tokens":73073,"pending_prefill_tokens":5144,"num_requests":2,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":0,"new_prefill":83088,"score_linear":122761.0,"score_lmetric":176464},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-82432.0,"chosen_score_lmetric":0,"t_first_token":383998.4818642,"t_first_token_unix":1779814863.4958072,"t_done":383999.042265352,"t_done_unix":1779814864.0562088},{"request_id":"1336620:2:1338440:434","session_id":"1336620","input_length":14918,"t_proxy_recv":383995.797306553,"t_decision_unix":1779814860.811248,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.960986727443357,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":582,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":7680,"new_prefill":7238,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14918,"score_linear":62618.0,"score_lmetric":14918},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33422,"ongoing_decode_tokens":0,"pending_prefill_tokens":33422,"num_requests":1,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":14336,"new_prefill":582,"score_linear":19086.0,"score_lmetric":34004},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":14918,"score_linear":95383.0,"score_lmetric":23261},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":14918,"score_linear":116406.0,"score_lmetric":29836},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105345,"ongoing_decode_tokens":55130,"pending_prefill_tokens":551,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":7680,"new_prefill":7238,"score_linear":97665.0,"score_lmetric":15578},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":7680,"new_prefill":7238,"score_linear":65393.0,"score_lmetric":7238},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":14918,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":19086.0,"chosen_score_lmetric":34004,"t_first_token":383997.98377094,"t_first_token_unix":1779814862.9977143,"t_done":383999.625583798,"t_done_unix":1779814864.6395297},{"request_id":"1269373:17:1338104:431","session_id":"1269373","input_length":73073,"t_proxy_recv":383994.848914529,"t_decision_unix":1779814859.862856,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9809368713478303,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":1393,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":7680,"new_prefill":65393,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":73073,"score_linear":62618.0,"score_lmetric":73073},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24097,"ongoing_decode_tokens":0,"pending_prefill_tokens":24097,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":7680,"new_prefill":65393,"score_linear":16417.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":73073,"score_linear":95383.0,"score_lmetric":81416},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":73073,"score_linear":116406.0,"score_lmetric":146146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":7680,"new_prefill":65393,"score_linear":47450.0,"score_lmetric":65393},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":71680,"new_prefill":1393,"score_linear":-71680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":73073,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":383995.495488078,"t_first_token_unix":1779814860.5094316,"t_done":384000.355195438,"t_done_unix":1779814865.3691394},{"request_id":"1253743:5:1338406:433","session_id":"1253743","input_length":50215,"t_proxy_recv":383995.713638611,"t_decision_unix":1779814860.7275798,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9890271831126157,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":551,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":50215,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":4608,"new_prefill":45607,"score_linear":58010.0,"score_lmetric":45607},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33422,"ongoing_decode_tokens":0,"pending_prefill_tokens":33422,"num_requests":1,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":50215,"score_linear":33422.0,"score_lmetric":83637},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":49664,"new_prefill":551,"score_linear":45719.0,"score_lmetric":8894},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":50215,"score_linear":116406.0,"score_lmetric":100430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":49664,"new_prefill":551,"score_linear":5466.0,"score_lmetric":551},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":0,"new_prefill":50215,"score_linear":73073.0,"score_lmetric":50215},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":50215,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":5466.0,"chosen_score_lmetric":551,"t_first_token":383995.88588035,"t_first_token_unix":1779814860.8998237,"t_done":384000.47834118,"t_done_unix":1779814865.4922853},{"request_id":"1279412:20:1337591:428","session_id":"1279412","input_length":95383,"t_proxy_recv":383992.989338353,"t_decision_unix":1779814858.00328,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":87040,"affinity_cache_ratio":0.912531583196167,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":87040,"estimated_new_tokens":8343,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":95383,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":95383,"score_linear":62618.0,"score_lmetric":95383},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24097,"ongoing_decode_tokens":0,"pending_prefill_tokens":24097,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":95383,"score_linear":24097.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":87040,"new_prefill":8343,"score_linear":-87040.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":95383,"score_linear":116406.0,"score_lmetric":190766},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":95383,"score_linear":55130.0,"score_lmetric":95383},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":45005,"ongoing_decode_tokens":45005,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":0,"new_prefill":95383,"score_linear":45005.0,"score_lmetric":95383},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":12800,"new_prefill":82583,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-87040.0,"chosen_score_lmetric":0,"t_first_token":383997.516508557,"t_first_token_unix":1779814862.5304525,"t_done":384001.385184542,"t_done_unix":1779814866.3991287},{"request_id":"1339977:1:1339977:442","session_id":"1339977","input_length":13816,"t_proxy_recv":384001.442564662,"t_decision_unix":1779814866.4565055,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":13816,"score_linear":62618.0,"score_lmetric":13816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-5356,"ongoing_decode_tokens":7065,"pending_prefill_tokens":-12421,"num_requests":0,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":13816,"score_linear":-5356.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161695,"ongoing_decode_tokens":66152,"pending_prefill_tokens":311,"num_requests":2,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":13816,"score_linear":161695.0,"score_lmetric":28254},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":13816,"score_linear":55130.0,"score_lmetric":13816},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":0,"new_prefill":13816,"score_linear":120144.0,"score_lmetric":41448},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384002.629480574,"t_first_token_unix":1779814867.6434243,"t_done":384002.82468538,"t_done_unix":1779814867.838629},{"request_id":"1315567:3:1325346:372","session_id":"1315567","input_length":55130,"t_proxy_recv":383949.295854624,"t_decision_unix":1779814814.3097959,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9937239252675494,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":346,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":7680,"new_prefill":47450,"score_linear":114288.0,"score_lmetric":47450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":55130,"score_linear":62618.0,"score_lmetric":55130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":55130,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":55130,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":55130,"score_linear":79663.0,"score_lmetric":55130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4312,"ongoing_decode_tokens":4312,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":898,"cache_hit":54784,"new_prefill":346,"score_linear":-50472.0,"score_lmetric":346},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":26994,"ongoing_decode_tokens":26994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1088,"cache_hit":17408,"new_prefill":37722,"score_linear":9586.0,"score_lmetric":37722},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":55130,"score_linear":33182.0,"score_lmetric":55130}],"chosen_score_linear":-50472.0,"chosen_score_lmetric":346,"t_first_token":383949.492082386,"t_first_token_unix":1779814814.5060256,"t_done":384003.475866491,"t_done_unix":1779814868.489812},{"request_id":"1279412:21:1339581:440","session_id":"1279412","input_length":95543,"t_proxy_recv":384001.404013525,"t_decision_unix":1779814866.417955,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":95232,"affinity_cache_ratio":0.9967449211349864,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95232,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":95543,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":95543,"score_linear":62618.0,"score_lmetric":95543},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-5356,"ongoing_decode_tokens":7065,"pending_prefill_tokens":-12421,"num_requests":0,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":95543,"score_linear":-5356.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":95232,"new_prefill":311,"score_linear":-29080.0,"score_lmetric":311},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":95543,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":95543,"score_linear":55130.0,"score_lmetric":95543},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":0,"new_prefill":95543,"score_linear":120144.0,"score_lmetric":286629},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":12800,"new_prefill":82743,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-29080.0,"chosen_score_lmetric":311,"t_first_token":384001.546234691,"t_first_token_unix":1779814866.5601785,"t_done":384004.7333938,"t_done_unix":1779814869.7473376},{"request_id":"1316848:14:1338658:435","session_id":"1316848","input_length":49688,"t_proxy_recv":383996.625297086,"t_decision_unix":1779814861.639238,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":44544,"affinity_cache_ratio":0.8964739977459346,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":5144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":49688,"score_linear":62618.0,"score_lmetric":49688},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":48340,"ongoing_decode_tokens":0,"pending_prefill_tokens":34004,"num_requests":2,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":49688,"score_linear":48340.0,"score_lmetric":167384},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":49688,"score_linear":95383.0,"score_lmetric":58031},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":989,"cache_hit":0,"new_prefill":49688,"score_linear":116406.0,"score_lmetric":99376},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105345,"ongoing_decode_tokens":105345,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":49688,"score_linear":105345.0,"score_lmetric":99376},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":44544,"new_prefill":5144,"score_linear":28529.0,"score_lmetric":5144},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":28529.0,"chosen_score_lmetric":5144,"t_first_token":383998.161212027,"t_first_token_unix":1779814863.1751559,"t_done":384005.564008625,"t_done_unix":1779814870.5779529},{"request_id":"1341005:1:1341005:447","session_id":"1341005","input_length":5280,"t_proxy_recv":384004.912490943,"t_decision_unix":1779814869.9264324,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":5280,"score_linear":48381.0,"score_lmetric":53661},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5280,"score_linear":62618.0,"score_lmetric":5280},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":5280,"score_linear":16015.0,"score_lmetric":5280},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":5280,"score_linear":66152.0,"score_lmetric":5280},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21221,"ongoing_decode_tokens":21221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":5280,"score_linear":21221.0,"score_lmetric":5280},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":5280,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":0,"new_prefill":5280,"score_linear":120144.0,"score_lmetric":15840},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2279,"ongoing_decode_tokens":2279,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":5280,"score_linear":2279.0,"score_lmetric":5280}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384005.247948878,"t_first_token_unix":1779814870.261893,"t_done":384005.601972101,"t_done_unix":1779814870.6159153},{"request_id":"1340903:1:1340903:446","session_id":"1340903","input_length":2279,"t_proxy_recv":384004.571577076,"t_decision_unix":1779814869.5855184,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":2279,"score_linear":48381.0,"score_lmetric":50660},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":2279,"score_linear":62618.0,"score_lmetric":2279},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":2279,"score_linear":16015.0,"score_lmetric":2279},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161695,"ongoing_decode_tokens":161695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":2279,"score_linear":161695.0,"score_lmetric":4558},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":21221,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":2279,"score_linear":21221.0,"score_lmetric":23500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":2279,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":0,"new_prefill":2279,"score_linear":120144.0,"score_lmetric":6837},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":2279,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384004.714489154,"t_first_token_unix":1779814869.728433,"t_done":384005.718089545,"t_done_unix":1779814870.7320328},{"request_id":"1309252:3:1339771:441","session_id":"1309252","input_length":45994,"t_proxy_recv":384000.683531682,"t_decision_unix":1779814865.697473,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":45568,"affinity_cache_ratio":0.9907379223376962,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45568,"estimated_new_tokens":426,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":45994,"score_linear":62618.0,"score_lmetric":45994},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-5356,"ongoing_decode_tokens":7065,"pending_prefill_tokens":-12421,"num_requests":0,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":45994,"score_linear":-5356.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161535,"ongoing_decode_tokens":161535,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":45994,"score_linear":161535.0,"score_lmetric":91988},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":45994,"score_linear":55130.0,"score_lmetric":45994},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":74150,"ongoing_decode_tokens":74150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":45568,"new_prefill":426,"score_linear":28582.0,"score_lmetric":852},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":28582.0,"chosen_score_lmetric":852,"t_first_token":384000.847553832,"t_first_token_unix":1779814865.8614979,"t_done":384006.318549338,"t_done_unix":1779814871.332493},{"request_id":"1340290:1:1340290:445","session_id":"1340290","input_length":21221,"t_proxy_recv":384002.564262017,"t_decision_unix":1779814867.5782034,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":21221,"score_linear":48381.0,"score_lmetric":69602},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21221,"score_linear":62618.0,"score_lmetric":21221},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":21221,"score_linear":16015.0,"score_lmetric":8800},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161695,"ongoing_decode_tokens":161695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":21221,"score_linear":161695.0,"score_lmetric":42442},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":21221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":21221,"score_linear":55130.0,"score_lmetric":21221},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":1024,"new_prefill":20197,"score_linear":119120.0,"score_lmetric":60591},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":21221,"score_linear":13816.0,"score_lmetric":35037}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384004.828908026,"t_first_token_unix":1779814869.8428516,"t_done":384006.605152143,"t_done_unix":1779814871.6190956},{"request_id":"1259178:4:1339295:439","session_id":"1259178","input_length":24462,"t_proxy_recv":383998.859353525,"t_decision_unix":1779814863.873295,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":22528,"affinity_cache_ratio":0.9209385986427929,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":1934,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":24462,"score_linear":62618.0,"score_lmetric":24462},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":9562,"ongoing_decode_tokens":21983,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1491,"cache_hit":0,"new_prefill":24462,"score_linear":9562.0,"score_lmetric":12041},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161535,"ongoing_decode_tokens":95383,"pending_prefill_tokens":4712,"num_requests":2,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":24462,"score_linear":161535.0,"score_lmetric":58348},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83088,"ongoing_decode_tokens":83088,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1005,"cache_hit":0,"new_prefill":24462,"score_linear":83088.0,"score_lmetric":24462},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105345,"ongoing_decode_tokens":105345,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":24462,"score_linear":105345.0,"score_lmetric":48924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":122761,"ongoing_decode_tokens":122761,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":22528,"new_prefill":1934,"score_linear":100233.0,"score_lmetric":3868},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":100233.0,"chosen_score_lmetric":3868,"t_first_token":383999.29169492,"t_first_token_unix":1779814864.3056393,"t_done":384007.072454858,"t_done_unix":1779814872.0863986},{"request_id":"1341912:1:1341912:449","session_id":"1341912","input_length":9909,"t_proxy_recv":384007.949376003,"t_decision_unix":1779814872.9633172,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9909,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":9909,"score_linear":48381.0,"score_lmetric":58290},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9909,"score_linear":62618.0,"score_lmetric":9909},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":28436,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":9909,"score_linear":53542.0,"score_lmetric":47768},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":9909,"score_linear":66152.0,"score_lmetric":9909},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1318,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384008.711356124,"t_first_token_unix":1779814873.7253,"t_done":384009.196263643,"t_done_unix":1779814874.2102077},{"request_id":"1342327:1:1342327:452","session_id":"1342327","input_length":6180,"t_proxy_recv":384009.371759504,"t_decision_unix":1779814874.3857007,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6180,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":6180,"score_linear":48381.0,"score_lmetric":54561},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":6180,"score_linear":62618.0,"score_lmetric":6180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":28436,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":6180,"score_linear":53542.0,"score_lmetric":40310},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":6180,"score_linear":66152.0,"score_lmetric":6180},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":41267,"ongoing_decode_tokens":0,"pending_prefill_tokens":20275,"num_requests":2,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":0,"new_prefill":6180,"score_linear":41267.0,"score_lmetric":52910},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":6180,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1337,"cache_hit":0,"new_prefill":6180,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":6180,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384009.775146808,"t_first_token_unix":1779814874.7890913,"t_done":384010.070391929,"t_done_unix":1779814875.0843375},{"request_id":"1340903:2:1342632:453","session_id":"1340903","input_length":2129,"t_proxy_recv":384010.408802056,"t_decision_unix":1779814875.4227428,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":2048,"affinity_cache_ratio":0.9619539689995303,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":2048,"estimated_new_tokens":81,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":2129,"score_linear":48381.0,"score_lmetric":50510},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":2129,"score_linear":62618.0,"score_lmetric":2129},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":28436,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":2129,"score_linear":53542.0,"score_lmetric":32208},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":2129,"score_linear":66152.0,"score_lmetric":2129},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":41267,"ongoing_decode_tokens":41267,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":0,"new_prefill":2129,"score_linear":41267.0,"score_lmetric":4258},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":2129,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":2129,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":2048,"new_prefill":81,"score_linear":-2048.0,"score_lmetric":0}],"chosen_score_linear":-2048.0,"chosen_score_lmetric":0,"t_first_token":384010.423867825,"t_first_token_unix":1779814875.437811,"t_done":384010.496175997,"t_done_unix":1779814875.5101194},{"request_id":"1341948:1:1341948:450","session_id":"1341948","input_length":19887,"t_proxy_recv":384008.069788667,"t_decision_unix":1779814873.0837295,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":19887,"score_linear":48381.0,"score_lmetric":68268},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":19887,"score_linear":62618.0,"score_lmetric":19887},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":28436,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":19887,"score_linear":53542.0,"score_lmetric":67724},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":19887,"score_linear":66152.0,"score_lmetric":19887},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":0,"new_prefill":19887,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":19887,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":9909,"ongoing_decode_tokens":0,"pending_prefill_tokens":9909,"num_requests":1,"active_p_offloads":0,"cached_blocks":1318,"cache_hit":0,"new_prefill":19887,"score_linear":9909.0,"score_lmetric":29796},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":19887,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384010.191791907,"t_first_token_unix":1779814875.2057362,"t_done":384010.524836129,"t_done_unix":1779814875.5387795},{"request_id":"1340290:2:1342119:451","session_id":"1340290","input_length":21380,"t_proxy_recv":384008.606959171,"t_decision_unix":1779814873.6209002,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9818521983161833,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":388,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":21380,"score_linear":48381.0,"score_lmetric":69761},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21380,"score_linear":62618.0,"score_lmetric":21380},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":28436,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":21380,"score_linear":53542.0,"score_lmetric":70710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":21380,"score_linear":66152.0,"score_lmetric":21380},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":19887,"ongoing_decode_tokens":0,"pending_prefill_tokens":19887,"num_requests":1,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":20992,"new_prefill":388,"score_linear":-1105.0,"score_lmetric":20275},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":21380,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":9909,"ongoing_decode_tokens":0,"pending_prefill_tokens":9909,"num_requests":1,"active_p_offloads":0,"cached_blocks":1318,"cache_hit":1024,"new_prefill":20356,"score_linear":8885.0,"score_lmetric":30265},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":21380,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1105.0,"chosen_score_lmetric":20275,"t_first_token":384010.194042189,"t_first_token_unix":1779814875.2079859,"t_done":384010.947100818,"t_done_unix":1779814875.9610453},{"request_id":"1340278:1:1340278:444","session_id":"1340278","input_length":48381,"t_proxy_recv":384002.540258162,"t_decision_unix":1779814867.5541995,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":48381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":48381,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":48381,"score_linear":62618.0,"score_lmetric":48381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":48381,"score_linear":16015.0,"score_lmetric":35960},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161695,"ongoing_decode_tokens":161695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":48381,"score_linear":161695.0,"score_lmetric":96762},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":48381,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":48381,"score_linear":55130.0,"score_lmetric":48381},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":0,"new_prefill":48381,"score_linear":120144.0,"score_lmetric":145143},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":48381,"score_linear":13816.0,"score_lmetric":62197}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384011.3108418,"t_first_token_unix":1779814876.324786,"t_done":384011.8908315,"t_done_unix":1779814876.9047751},{"request_id":"1341005:2:1342961:456","session_id":"1341005","input_length":9360,"t_proxy_recv":384011.575267178,"t_decision_unix":1779814876.5892084,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.5470085470085471,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":4240,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":48381,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":9360,"score_linear":48381.0,"score_lmetric":9360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9360,"score_linear":62618.0,"score_lmetric":9360},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":65963,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":9360,"score_linear":53542.0,"score_lmetric":18720},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":9360,"score_linear":66152.0,"score_lmetric":9360},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":9360,"score_linear":65289.0,"score_lmetric":74649},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":5120,"new_prefill":4240,"score_linear":-5120.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":9360,"score_linear":59219.0,"score_lmetric":68579},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":9360,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":384011.960188124,"t_first_token_unix":1779814876.974131,"t_done":384012.246936875,"t_done_unix":1779814877.2608805},{"request_id":"1334223:2:1341796:448","session_id":"1334223","input_length":37527,"t_proxy_recv":384007.517923689,"t_decision_unix":1779814872.5318651,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":23552,"affinity_cache_ratio":0.6276014602819303,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":13975,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":37527,"score_linear":48381.0,"score_lmetric":85908},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":37527,"score_linear":62618.0,"score_lmetric":37527},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":23552,"new_prefill":13975,"score_linear":-7537.0,"score_lmetric":13975},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":37527,"score_linear":66152.0,"score_lmetric":37527},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1318,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7537.0,"chosen_score_lmetric":13975,"t_first_token":384010.549588921,"t_first_token_unix":1779814875.5635324,"t_done":384013.377694343,"t_done_unix":1779814878.3916378},{"request_id":"1343191:1:1343191:457","session_id":"1343191","input_length":11912,"t_proxy_recv":384012.480481033,"t_decision_unix":1779814877.4944224,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11912,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":11912,"score_linear":62618.0,"score_lmetric":11912},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":65963,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":11912,"score_linear":53542.0,"score_lmetric":23824},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":11912,"score_linear":66152.0,"score_lmetric":11912},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":11912,"score_linear":65289.0,"score_lmetric":77201},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":11912,"score_linear":59219.0,"score_lmetric":71131},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384013.435189718,"t_first_token_unix":1779814878.4491343,"t_done":384013.487398504,"t_done_unix":1779814878.5013428},{"request_id":"1314357:3:1338999:437","session_id":"1314357","input_length":66152,"t_proxy_recv":383997.823156534,"t_decision_unix":1779814862.8370976,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9287701052122385,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":4712,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":66152,"score_linear":62618.0,"score_lmetric":66152},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":48340,"ongoing_decode_tokens":36518,"pending_prefill_tokens":-2514,"num_requests":2,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":66152,"score_linear":48340.0,"score_lmetric":127276},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95383,"ongoing_decode_tokens":95383,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":61440,"new_prefill":4712,"score_linear":33943.0,"score_lmetric":4712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":82142,"ongoing_decode_tokens":82142,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":66152,"score_linear":82142.0,"score_lmetric":66152},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105345,"ongoing_decode_tokens":105345,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":66152,"score_linear":105345.0,"score_lmetric":132304},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":122761,"ongoing_decode_tokens":73073,"pending_prefill_tokens":5144,"num_requests":2,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":0,"new_prefill":66152,"score_linear":122761.0,"score_lmetric":142592},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":33943.0,"chosen_score_lmetric":4712,"t_first_token":383999.865244848,"t_first_token_unix":1779814864.8791885,"t_done":384013.915153792,"t_done_unix":1779814878.9290972},{"request_id":"1338292:2:1343599:460","session_id":"1338292","input_length":14103,"t_proxy_recv":384013.687289845,"t_decision_unix":1779814878.7012308,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":9216,"affinity_cache_ratio":0.6534779834077856,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":4887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21402,"ongoing_decode_tokens":0,"pending_prefill_tokens":21402,"num_requests":1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":14103,"score_linear":21402.0,"score_lmetric":35505},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14103,"score_linear":62618.0,"score_lmetric":14103},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1519,"cache_hit":9216,"new_prefill":4887,"score_linear":6799.0,"score_lmetric":4887},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":14103,"score_linear":66152.0,"score_lmetric":14103},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":14103,"score_linear":65289.0,"score_lmetric":79392},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":14103,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69451,"ongoing_decode_tokens":0,"pending_prefill_tokens":59723,"num_requests":2,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":14103,"score_linear":69451.0,"score_lmetric":147652},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":14103,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":6799.0,"chosen_score_lmetric":4887,"t_first_token":384014.254599866,"t_first_token_unix":1779814879.2685435,"t_done":384014.37125061,"t_done_unix":1779814879.3851943},{"request_id":"1343312:1:1343312:459","session_id":"1343312","input_length":21402,"t_proxy_recv":384012.844711639,"t_decision_unix":1779814877.8586528,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21402,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":21402,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21402,"score_linear":62618.0,"score_lmetric":21402},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":65963,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":21402,"score_linear":53542.0,"score_lmetric":42804},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":21402,"score_linear":66152.0,"score_lmetric":21402},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":21402,"score_linear":65289.0,"score_lmetric":86691},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":11912,"ongoing_decode_tokens":0,"pending_prefill_tokens":11912,"num_requests":1,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":21402,"score_linear":11912.0,"score_lmetric":33314},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69451,"ongoing_decode_tokens":0,"pending_prefill_tokens":59723,"num_requests":2,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":21402,"score_linear":69451.0,"score_lmetric":162250},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":21402,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384015.146017349,"t_first_token_unix":1779814880.159961,"t_done":384015.203264497,"t_done_unix":1779814880.2172077},{"request_id":"1279412:22:1344210:462","session_id":"1279412","input_length":95781,"t_proxy_recv":384015.778153986,"t_decision_unix":1779814880.7920952,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9996137020912289,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":37,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":95781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":95781,"score_linear":62618.0,"score_lmetric":95781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":95781,"score_linear":16015.0,"score_lmetric":95781},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1133,"cache_hit":95744,"new_prefill":37,"score_linear":-95744.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":95781,"score_linear":65289.0,"score_lmetric":161070},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":95781,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":95781,"score_linear":79271.0,"score_lmetric":477540},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":12800,"new_prefill":82981,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":384015.937470296,"t_first_token_unix":1779814880.9514132,"t_done":384018.023272188,"t_done_unix":1779814883.03722},{"request_id":"1345921:1:1345921:469","session_id":"1345921","input_length":505,"t_proxy_recv":384021.610966728,"t_decision_unix":1779814886.6249077,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":505,"score_linear":50447.0,"score_lmetric":50952},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":505,"score_linear":62618.0,"score_lmetric":505},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":505,"score_linear":16015.0,"score_lmetric":505},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1133,"cache_hit":0,"new_prefill":505,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":505,"score_linear":65289.0,"score_lmetric":65794},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32816,"ongoing_decode_tokens":0,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":505,"score_linear":32816.0,"score_lmetric":33321},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":505,"score_linear":79271.0,"score_lmetric":191712},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":505,"score_linear":73946.0,"score_lmetric":74451}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384021.665164733,"t_first_token_unix":1779814886.6791084,"t_done":384021.985639875,"t_done_unix":1779814886.9995832},{"request_id":"1344773:1:1344773:465","session_id":"1344773","input_length":32816,"t_proxy_recv":384017.72729142,"t_decision_unix":1779814882.7412326,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":32816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":32816,"score_linear":50447.0,"score_lmetric":83263},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":32816,"score_linear":62618.0,"score_lmetric":32816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":32816,"score_linear":16015.0,"score_lmetric":32816},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95781,"ongoing_decode_tokens":95781,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1133,"cache_hit":0,"new_prefill":32816,"score_linear":95781.0,"score_lmetric":32816},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":32816,"score_linear":65289.0,"score_lmetric":98105},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":32816,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":32816,"score_linear":79271.0,"score_lmetric":288645},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":32816,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384022.242654263,"t_first_token_unix":1779814887.2565982,"t_done":384022.381668711,"t_done_unix":1779814887.3956137},{"request_id":"1344773:2:1346419:473","session_id":"1344773","input_length":33008,"t_proxy_recv":384023.482257079,"t_decision_unix":1779814888.4961984,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":32768,"affinity_cache_ratio":0.9927290353853612,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":32768,"estimated_new_tokens":240,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":33008,"score_linear":50447.0,"score_lmetric":83455},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":33008,"score_linear":62618.0,"score_lmetric":33008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":33008,"score_linear":16015.0,"score_lmetric":33008},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":33008,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":0,"pending_prefill_tokens":68004,"num_requests":2,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":33008,"score_linear":102308.0,"score_lmetric":202024},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":32768,"new_prefill":240,"score_linear":-32768.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":79271,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":33008,"score_linear":79271.0,"score_lmetric":99024},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":33008,"score_linear":73946.0,"score_lmetric":106954}],"chosen_score_linear":-32768.0,"chosen_score_lmetric":0,"t_first_token":384023.604913322,"t_first_token_unix":1779814888.6188567,"t_done":384023.778477805,"t_done_unix":1779814888.792421},{"request_id":"1342327:2:1343857:461","session_id":"1342327","input_length":9820,"t_proxy_recv":384014.508210475,"t_decision_unix":1779814879.522152,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":6144,"affinity_cache_ratio":0.6256619144602852,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":3676,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21402,"ongoing_decode_tokens":0,"pending_prefill_tokens":21402,"num_requests":1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":9820,"score_linear":21402.0,"score_lmetric":31222},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":9820,"score_linear":62618.0,"score_lmetric":9820},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":9820,"score_linear":16015.0,"score_lmetric":9820},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1133,"cache_hit":0,"new_prefill":9820,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":9820,"score_linear":65289.0,"score_lmetric":75109},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":9820,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69451,"ongoing_decode_tokens":0,"pending_prefill_tokens":59723,"num_requests":2,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":6144,"new_prefill":3676,"score_linear":63307.0,"score_lmetric":126798},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":9820,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":63307.0,"chosen_score_lmetric":126798,"t_first_token":384023.386053564,"t_first_token_unix":1779814888.399997,"t_done":384023.82063068,"t_done_unix":1779814888.834574},{"request_id":"1342327:3:1344788:466","session_id":"1342327","input_length":12398,"t_proxy_recv":384023.826350173,"t_decision_unix":1779814888.8402913,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.78464268430392,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":2670,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":12398,"score_linear":50447.0,"score_lmetric":62845},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":12398,"score_linear":62618.0,"score_lmetric":12398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":12398,"score_linear":16015.0,"score_lmetric":12398},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":0,"pending_prefill_tokens":68004,"num_requests":2,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":12398,"score_linear":102308.0,"score_lmetric":160804},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69451,"ongoing_decode_tokens":69451,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1356,"cache_hit":9728,"new_prefill":2670,"score_linear":59723.0,"score_lmetric":5340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":12398,"score_linear":73946.0,"score_lmetric":86344}],"chosen_score_linear":59723.0,"chosen_score_lmetric":5340,"t_first_token":384024.160132549,"t_first_token_unix":1779814889.1740763,"t_done":384024.440249587,"t_done_unix":1779814889.4541955},{"request_id":"1342327:4:1346218:471","session_id":"1342327","input_length":14842,"t_proxy_recv":384024.44550625,"t_decision_unix":1779814889.4594476,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":12288,"affinity_cache_ratio":0.8279207653954993,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":2554,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":14842,"score_linear":50447.0,"score_lmetric":65289},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14842,"score_linear":62618.0,"score_lmetric":14842},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":14842,"score_linear":16015.0,"score_lmetric":14842},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":14842,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":0,"pending_prefill_tokens":68004,"num_requests":2,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":14842,"score_linear":102308.0,"score_lmetric":165692},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":14842,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69451,"ongoing_decode_tokens":69451,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1361,"cache_hit":12288,"new_prefill":2554,"score_linear":57163.0,"score_lmetric":5108},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":14842,"score_linear":73946.0,"score_lmetric":88788}],"chosen_score_linear":57163.0,"chosen_score_lmetric":5108,"t_first_token":384024.799885948,"t_first_token_unix":1779814889.8138301,"t_done":384024.924733895,"t_done_unix":1779814889.938678},{"request_id":"1342634:1:1342634:454","session_id":"1342634","input_length":59219,"t_proxy_recv":384010.442473535,"t_decision_unix":1779814875.4564152,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":59219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":59219,"score_linear":48381.0,"score_lmetric":107600},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":59219,"score_linear":62618.0,"score_lmetric":59219},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":28436,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":59219,"score_linear":53542.0,"score_lmetric":146388},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":59219,"score_linear":66152.0,"score_lmetric":59219},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":41267,"ongoing_decode_tokens":41267,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1048,"cache_hit":0,"new_prefill":59219,"score_linear":41267.0,"score_lmetric":118438},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":59219,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":59219,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2129,"ongoing_decode_tokens":2129,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":59219,"score_linear":2129.0,"score_lmetric":59219}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384023.384416725,"t_first_token_unix":1779814888.3983603,"t_done":384025.218934869,"t_done_unix":1779814890.2328784},{"request_id":"1341912:2:1343220:458","session_id":"1341912","input_length":10232,"t_proxy_recv":384012.556644442,"t_decision_unix":1779814877.570586,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9507427677873339,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":10232,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":10232,"score_linear":62618.0,"score_lmetric":10232},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":65963,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":10232,"score_linear":53542.0,"score_lmetric":20464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":10232,"score_linear":66152.0,"score_lmetric":10232},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":10232,"score_linear":65289.0,"score_lmetric":75521},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":11912,"ongoing_decode_tokens":0,"pending_prefill_tokens":11912,"num_requests":1,"active_p_offloads":0,"cached_blocks":933,"cache_hit":0,"new_prefill":10232,"score_linear":11912.0,"score_lmetric":22144},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":9728,"new_prefill":504,"score_linear":49491.0,"score_lmetric":59723},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":10232,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":49491.0,"chosen_score_lmetric":59723,"t_first_token":384023.386786042,"t_first_token_unix":1779814888.400729,"t_done":384025.422352314,"t_done_unix":1779814890.436296},{"request_id":"1316848:15:1344261:463","session_id":"1316848","input_length":50447,"t_proxy_recv":384015.922060807,"t_decision_unix":1779814880.9360023,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":0,"affinity_cache_hit":50176,"affinity_cache_ratio":0.9946280254524551,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":50447,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":50447,"score_linear":62618.0,"score_lmetric":50447},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":50447,"score_linear":16015.0,"score_lmetric":50447},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95781,"ongoing_decode_tokens":0,"pending_prefill_tokens":37,"num_requests":1,"active_p_offloads":0,"cached_blocks":1133,"cache_hit":0,"new_prefill":50447,"score_linear":95781.0,"score_lmetric":50484},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":50447,"score_linear":65289.0,"score_lmetric":115736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":50176,"new_prefill":271,"score_linear":29095.0,"score_lmetric":191010},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384025.509487142,"t_first_token_unix":1779814890.5234306,"t_done":384025.828923474,"t_done_unix":1779814890.8428667},{"request_id":"1345921:2:1347089:474","session_id":"1345921","input_length":773,"t_proxy_recv":384025.797070395,"t_decision_unix":1779814890.8110118,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":512,"affinity_cache_ratio":0.6623544631306598,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":50447,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":773,"score_linear":50447.0,"score_lmetric":773},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":773,"score_linear":62618.0,"score_lmetric":773},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":773,"score_linear":16015.0,"score_lmetric":773},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":512,"new_prefill":261,"score_linear":-512.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":0,"pending_prefill_tokens":68004,"num_requests":2,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":773,"score_linear":102308.0,"score_lmetric":137554},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":773,"score_linear":73946.0,"score_lmetric":74719}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":384025.830710289,"t_first_token_unix":1779814890.8446536,"t_done":384026.078987511,"t_done_unix":1779814891.0929315},{"request_id":"1347763:1:1347763:476","session_id":"1347763","input_length":5465,"t_proxy_recv":384028.121746316,"t_decision_unix":1779814893.1356876,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58815,"ongoing_decode_tokens":0,"pending_prefill_tokens":8639,"num_requests":1,"active_p_offloads":0,"cached_blocks":1119,"cache_hit":0,"new_prefill":5465,"score_linear":58815.0,"score_lmetric":14104},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":5465,"score_linear":62618.0,"score_lmetric":5465},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":5465,"score_linear":16015.0,"score_lmetric":5465},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":127969,"ongoing_decode_tokens":127969,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":5465,"score_linear":127969.0,"score_lmetric":16395},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":5465,"score_linear":73946.0,"score_lmetric":79411}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384028.471747628,"t_first_token_unix":1779814893.4856908,"t_done":384028.596631895,"t_done_unix":1779814893.6105752},{"request_id":"1341948:2:1347296:475","session_id":"1341948","input_length":25661,"t_proxy_recv":384026.514266445,"t_decision_unix":1779814891.5282078,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19456,"affinity_cache_ratio":0.7581933673668212,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":6205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58815,"ongoing_decode_tokens":0,"pending_prefill_tokens":8639,"num_requests":1,"active_p_offloads":0,"cached_blocks":1119,"cache_hit":0,"new_prefill":25661,"score_linear":58815.0,"score_lmetric":34300},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":25661,"score_linear":62618.0,"score_lmetric":25661},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":25661,"score_linear":16015.0,"score_lmetric":25661},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":65289,"pending_prefill_tokens":2715,"num_requests":2,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":19456,"new_prefill":6205,"score_linear":82852.0,"score_lmetric":17840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":25661,"score_linear":73946.0,"score_lmetric":99607}],"chosen_score_linear":82852.0,"chosen_score_lmetric":17840,"t_first_token":384028.070560931,"t_first_token_unix":1779814893.0845044,"t_done":384028.704754688,"t_done_unix":1779814893.7186983},{"request_id":"1316848:16:1345678:468","session_id":"1316848","input_length":58815,"t_proxy_recv":384025.843213547,"t_decision_unix":1779814890.8571553,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":50176,"affinity_cache_ratio":0.8531157017767577,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":8639,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1119,"cache_hit":50176,"new_prefill":8639,"score_linear":-50176.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":58815,"score_linear":62618.0,"score_lmetric":58815},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":58815,"score_linear":16015.0,"score_lmetric":58815},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":773,"ongoing_decode_tokens":773,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":58815,"score_linear":773.0,"score_lmetric":58815},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":0,"pending_prefill_tokens":68004,"num_requests":2,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":58815,"score_linear":102308.0,"score_lmetric":253638},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":58815,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":50176,"new_prefill":8639,"score_linear":-50176.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":58815,"score_linear":73946.0,"score_lmetric":132761}],"chosen_score_linear":-50176.0,"chosen_score_lmetric":0,"t_first_token":384028.88873649,"t_first_token_unix":1779814893.9026804,"t_done":384029.005421053,"t_done_unix":1779814894.0193646},{"request_id":"1268861:6:1346340:472","session_id":"1268861","input_length":37019,"t_proxy_recv":384023.153535251,"t_decision_unix":1779814888.167476,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9266592830708555,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":2715,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":0,"new_prefill":37019,"score_linear":50447.0,"score_lmetric":87466},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":37019,"score_linear":62618.0,"score_lmetric":37019},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":37019,"score_linear":16015.0,"score_lmetric":37019},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1134,"cache_hit":0,"new_prefill":37019,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":34304,"new_prefill":2715,"score_linear":30985.0,"score_lmetric":68004},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":37019,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":37019,"score_linear":79271.0,"score_lmetric":301254},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":37019,"score_linear":73946.0,"score_lmetric":110965}],"chosen_score_linear":30985.0,"chosen_score_lmetric":68004,"t_first_token":384027.074047016,"t_first_token_unix":1779814892.0879905,"t_done":384031.009251222,"t_done_unix":1779814896.0231981},{"request_id":"1345921:3:1348784:483","session_id":"1345921","input_length":1397,"t_proxy_recv":384031.795422584,"t_decision_unix":1779814896.8093636,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":6,"affinity_cache_hit":512,"affinity_cache_ratio":0.36649964209019326,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12701,"ongoing_decode_tokens":0,"pending_prefill_tokens":12701,"num_requests":1,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":1397,"score_linear":12701.0,"score_lmetric":14098},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":1397,"score_linear":62618.0,"score_lmetric":1397},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":96853,"ongoing_decode_tokens":69638,"pending_prefill_tokens":3284,"num_requests":3,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":1397,"score_linear":96853.0,"score_lmetric":14043},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":512,"new_prefill":885,"score_linear":95514.0,"score_lmetric":885},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":1397,"score_linear":65289.0,"score_lmetric":1397},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":1397,"score_linear":17217.0,"score_lmetric":18614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":1397,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":1397,"score_linear":73946.0,"score_lmetric":75343}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384031.894586309,"t_first_token_unix":1779814896.90853,"t_done":384032.010394729,"t_done_unix":1779814897.024338},{"request_id":"1342921:1:1342921:455","session_id":"1342921","input_length":65289,"t_proxy_recv":384011.485645847,"t_decision_unix":1779814876.499587,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":65289,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":48381,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":65289,"score_linear":48381.0,"score_lmetric":65289},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":65289,"score_linear":62618.0,"score_lmetric":65289},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":53542,"ongoing_decode_tokens":65963,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":0,"new_prefill":65289,"score_linear":53542.0,"score_lmetric":130578},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1122,"cache_hit":0,"new_prefill":65289,"score_linear":66152.0,"score_lmetric":65289},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":65289,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":925,"cache_hit":0,"new_prefill":65289,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":65289,"score_linear":59219.0,"score_lmetric":124508},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":65289,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384026.460323901,"t_first_token_unix":1779814891.474268,"t_done":384032.148796371,"t_done_unix":1779814897.16274},{"request_id":"1311753:3:1348389:480","session_id":"1311753","input_length":39636,"t_proxy_recv":384030.604327146,"t_decision_unix":1779814895.6182683,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9171460288626501,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":3284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":39636,"score_linear":62618.0,"score_lmetric":39636},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":28436,"pending_prefill_tokens":3826,"num_requests":2,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":36352,"new_prefill":3284,"score_linear":20865.0,"score_lmetric":14220},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":39636,"score_linear":96026.0,"score_lmetric":39636},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":102308,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":19968,"new_prefill":19668,"score_linear":82340.0,"score_lmetric":39336},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":39636,"score_linear":73946.0,"score_lmetric":113582}],"chosen_score_linear":20865.0,"chosen_score_lmetric":14220,"t_first_token":384031.899462722,"t_first_token_unix":1779814896.9134057,"t_done":384032.46091932,"t_done_unix":1779814897.4748626},{"request_id":"1348394:1:1348394:481","session_id":"1348394","input_length":17217,"t_proxy_recv":384030.632739217,"t_decision_unix":1779814895.6466804,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17217,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":17217,"score_linear":62618.0,"score_lmetric":17217},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":96853,"ongoing_decode_tokens":28436,"pending_prefill_tokens":7110,"num_requests":3,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":17217,"score_linear":96853.0,"score_lmetric":72981},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":17217,"score_linear":96026.0,"score_lmetric":17217},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":102308,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":17217,"score_linear":102308.0,"score_lmetric":34434},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":17217,"score_linear":73946.0,"score_lmetric":91163}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384032.286271627,"t_first_token_unix":1779814897.3002155,"t_done":384032.660750524,"t_done_unix":1779814897.674694},{"request_id":"1348691:1:1348691:482","session_id":"1348691","input_length":12701,"t_proxy_recv":384031.494780817,"t_decision_unix":1779814896.5087218,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12701,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":12701,"score_linear":62618.0,"score_lmetric":12701},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":96853,"ongoing_decode_tokens":69638,"pending_prefill_tokens":3284,"num_requests":3,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":12701,"score_linear":96853.0,"score_lmetric":47955},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":12701,"score_linear":96026.0,"score_lmetric":12701},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":12701,"score_linear":65289.0,"score_lmetric":12701},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":12701,"score_linear":17217.0,"score_lmetric":29918},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":12701,"score_linear":73946.0,"score_lmetric":86647}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384032.548624474,"t_first_token_unix":1779814897.5625682,"t_done":384032.903401842,"t_done_unix":1779814897.9173453},{"request_id":"1344773:3:1349525:486","session_id":"1344773","input_length":33334,"t_proxy_recv":384034.429065841,"t_decision_unix":1779814899.4430072,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":32768,"affinity_cache_ratio":0.9830203395932081,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32768,"estimated_new_tokens":566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1159,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":33334,"score_linear":62618.0,"score_lmetric":33334},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":33334,"score_linear":57217.0,"score_lmetric":66668},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":33334,"score_linear":96026.0,"score_lmetric":33334},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1231,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1053,"cache_hit":32768,"new_prefill":566,"score_linear":-32768.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":33334,"score_linear":73946.0,"score_lmetric":107280}],"chosen_score_linear":-32768.0,"chosen_score_lmetric":0,"t_first_token":384034.617718548,"t_first_token_unix":1779814899.6316621,"t_done":384036.052137278,"t_done_unix":1779814901.066082},{"request_id":"1349975:1:1349975:487","session_id":"1349975","input_length":4988,"t_proxy_recv":384036.018091681,"t_decision_unix":1779814901.032033,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4988,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1159,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":4988,"score_linear":62618.0,"score_lmetric":4988},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":4988,"score_linear":57217.0,"score_lmetric":9976},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":4988,"score_linear":96026.0,"score_lmetric":4988},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1231,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33334,"ongoing_decode_tokens":33334,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1053,"cache_hit":0,"new_prefill":4988,"score_linear":33334.0,"score_lmetric":4988},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":4988,"score_linear":73946.0,"score_lmetric":78934}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384036.332897394,"t_first_token_unix":1779814901.3468413,"t_done":384036.650747153,"t_done_unix":1779814901.6646907},{"request_id":"1350162:1:1350162:488","session_id":"1350162","input_length":4594,"t_proxy_recv":384036.703960349,"t_decision_unix":1779814901.7179012,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4594,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1168,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":4594,"score_linear":62618.0,"score_lmetric":4594},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":4594,"score_linear":57217.0,"score_lmetric":9188},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":4594,"score_linear":96026.0,"score_lmetric":4594},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1231,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":4594,"score_linear":73946.0,"score_lmetric":78540}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384036.990565178,"t_first_token_unix":1779814902.0045087,"t_done":384037.105377752,"t_done_unix":1779814902.119321},{"request_id":"1350896:1:1350896:489","session_id":"1350896","input_length":1471,"t_proxy_recv":384039.150482549,"t_decision_unix":1779814904.1644237,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":1471,"score_linear":62618.0,"score_lmetric":1471},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":1471,"score_linear":57217.0,"score_lmetric":2942},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":1471,"score_linear":96026.0,"score_lmetric":1471},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1231,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":73946,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":1471,"score_linear":73946.0,"score_lmetric":1471}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384039.309313908,"t_first_token_unix":1779814904.3232574,"t_done":384039.668563561,"t_done_unix":1779814904.682507},{"request_id":"1350980:1:1350980:490","session_id":"1350980","input_length":15313,"t_proxy_recv":384039.403747489,"t_decision_unix":1779814904.4176886,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15313,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":15313,"score_linear":62618.0,"score_lmetric":15313},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":15313,"score_linear":57217.0,"score_lmetric":30626},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":15313,"score_linear":96026.0,"score_lmetric":15313},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":1471,"ongoing_decode_tokens":1471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1231,"cache_hit":0,"new_prefill":15313,"score_linear":1471.0,"score_lmetric":15313},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":73946,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":15313,"score_linear":73946.0,"score_lmetric":15313}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384040.773462016,"t_first_token_unix":1779814905.7874057,"t_done":384040.812396318,"t_done_unix":1779814905.8263395},{"request_id":"1269373:18:1345570:467","session_id":"1269373","input_length":73946,"t_proxy_recv":384020.282750809,"t_decision_unix":1779814885.2966921,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":7,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9901279311930328,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":73946,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50447,"ongoing_decode_tokens":0,"pending_prefill_tokens":50447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1021,"cache_hit":7680,"new_prefill":66266,"score_linear":42767.0,"score_lmetric":116713},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":73946,"score_linear":62618.0,"score_lmetric":73946},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":7680,"new_prefill":66266,"score_linear":8335.0,"score_lmetric":66266},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1133,"cache_hit":0,"new_prefill":73946,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":73946,"score_linear":65289.0,"score_lmetric":139235},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32816,"ongoing_decode_tokens":0,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":7680,"new_prefill":66266,"score_linear":25136.0,"score_lmetric":99082},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":73216,"new_prefill":730,"score_linear":6055.0,"score_lmetric":192387},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":73946,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384039.068711753,"t_first_token_unix":1779814904.0826552,"t_done":384042.384366341,"t_done_unix":1779814907.3983102},{"request_id":"1253743:5:1351907:492","session_id":"1253743","input_length":51340,"t_proxy_recv":384042.933072174,"t_decision_unix":1779814907.9470134,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":50176,"affinity_cache_ratio":0.9773276197896377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":1164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":4608,"new_prefill":46732,"score_linear":58010.0,"score_lmetric":46732},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":51340,"score_linear":57217.0,"score_lmetric":102680},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":49664,"new_prefill":1676,"score_linear":46362.0,"score_lmetric":1676},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":50176,"new_prefill":1164,"score_linear":-50176.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":0,"pending_prefill_tokens":2253,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":51340,"score_linear":76493.0,"score_lmetric":53593}],"chosen_score_linear":-50176.0,"chosen_score_lmetric":0,"t_first_token":384043.309211038,"t_first_token_unix":1779814908.3231544,"t_done":384043.736066967,"t_done_unix":1779814908.750015},{"request_id":"1334223:3:1348241:479","session_id":"1334223","input_length":41202,"t_proxy_recv":384030.034972047,"t_decision_unix":1779814895.0489135,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9071404300762099,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":3826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":41202,"score_linear":62618.0,"score_lmetric":41202},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":37376,"new_prefill":3826,"score_linear":-21361.0,"score_lmetric":3826},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":41202,"score_linear":96026.0,"score_lmetric":41202},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":102308,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":41202,"score_linear":102308.0,"score_lmetric":82404},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":41202,"score_linear":73946.0,"score_lmetric":115148}],"chosen_score_linear":-21361.0,"chosen_score_lmetric":3826,"t_first_token":384031.041336521,"t_first_token_unix":1779814896.0552802,"t_done":384044.489806407,"t_done_unix":1779814909.50375},{"request_id":"1344773:4:1352462:494","session_id":"1344773","input_length":33579,"t_proxy_recv":384044.728863542,"t_decision_unix":1779814909.7428048,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9910956252419667,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":299,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":0,"new_prefill":33579,"score_linear":21436.0,"score_lmetric":42727},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":33579,"score_linear":62618.0,"score_lmetric":33579},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":33579,"score_linear":16015.0,"score_lmetric":33579},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":33579,"score_linear":96026.0,"score_lmetric":33579},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":33280,"new_prefill":299,"score_linear":-33280.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":33579,"score_linear":76493.0,"score_lmetric":33579}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":384044.810800644,"t_first_token_unix":1779814909.824744,"t_done":384044.966311894,"t_done_unix":1779814909.9802558},{"request_id":"1348691:2:1352277:493","session_id":"1348691","input_length":21436,"t_proxy_recv":384044.119195824,"t_decision_unix":1779814909.1331367,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":12288,"affinity_cache_ratio":0.5732412763575294,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":9148,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":12288,"new_prefill":9148,"score_linear":-12288.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21436,"score_linear":62618.0,"score_lmetric":21436},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":21436,"score_linear":57217.0,"score_lmetric":42872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":21436,"score_linear":96026.0,"score_lmetric":21436},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":21436,"score_linear":76493.0,"score_lmetric":21436}],"chosen_score_linear":-12288.0,"chosen_score_lmetric":0,"t_first_token":384045.406741055,"t_first_token_unix":1779814910.4206843,"t_done":384045.629292813,"t_done_unix":1779814910.6432362},{"request_id":"1350162:2:1352468:495","session_id":"1350162","input_length":10575,"t_proxy_recv":384044.742370824,"t_decision_unix":1779814909.7563124,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":6,"affinity_cache_hit":4608,"affinity_cache_ratio":0.4357446808510638,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":4608,"new_prefill":5967,"score_linear":16828.0,"score_lmetric":15115},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":10575,"score_linear":62618.0,"score_lmetric":10575},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":10575,"score_linear":16015.0,"score_lmetric":10575},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":10575,"score_linear":96026.0,"score_lmetric":10575},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33579,"ongoing_decode_tokens":0,"pending_prefill_tokens":299,"num_requests":1,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":10575,"score_linear":33579.0,"score_lmetric":10874},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":10575,"score_linear":76493.0,"score_lmetric":10575}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384045.567509483,"t_first_token_unix":1779814910.581453,"t_done":384045.68968005,"t_done_unix":1779814910.7036235},{"request_id":"1339070:1:1339070:438","session_id":"1339070","input_length":7065,"t_proxy_recv":383998.032477965,"t_decision_unix":1779814863.0464194,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":-10712,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7065,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":7065,"score_linear":62618.0,"score_lmetric":7065},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":48340,"ongoing_decode_tokens":60761,"pending_prefill_tokens":-12421,"num_requests":2,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":7065,"score_linear":48340.0,"score_lmetric":-10712},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161535,"ongoing_decode_tokens":95383,"pending_prefill_tokens":4712,"num_requests":2,"active_p_offloads":0,"cached_blocks":1105,"cache_hit":0,"new_prefill":7065,"score_linear":161535.0,"score_lmetric":23554},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":82142,"ongoing_decode_tokens":82142,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":7065,"score_linear":82142.0,"score_lmetric":7065},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105345,"ongoing_decode_tokens":105345,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":7065,"score_linear":105345.0,"score_lmetric":14130},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":122761,"ongoing_decode_tokens":73073,"pending_prefill_tokens":5144,"num_requests":2,"active_p_offloads":0,"cached_blocks":1298,"cache_hit":0,"new_prefill":7065,"score_linear":122761.0,"score_lmetric":24418},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":48340.0,"chosen_score_lmetric":-10712,"t_first_token":383998.531058694,"t_first_token_unix":1779814863.5450022,"t_done":384046.973109913,"t_done_unix":1779814911.9870534},{"request_id":"1269373:19:1349406:485","session_id":"1269373","input_length":76493,"t_proxy_recv":384042.399040607,"t_decision_unix":1779814907.4129822,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":74240,"affinity_cache_ratio":0.9705463245002811,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74240,"estimated_new_tokens":2253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":7680,"new_prefill":68813,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":76493,"score_linear":62618.0,"score_lmetric":76493},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57217,"ongoing_decode_tokens":69638,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":7680,"new_prefill":68813,"score_linear":49537.0,"score_lmetric":137626},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":76493,"score_linear":96026.0,"score_lmetric":76493},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":76493,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":7680,"new_prefill":68813,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":73216,"new_prefill":3277,"score_linear":-73216.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":74240,"new_prefill":2253,"score_linear":-74240.0,"score_lmetric":0}],"chosen_score_linear":-74240.0,"chosen_score_lmetric":0,"t_first_token":384043.626062043,"t_first_token_unix":1779814908.6400054,"t_done":384047.0784377,"t_done_unix":1779814912.0923815},{"request_id":"1345921:4:1353010:501","session_id":"1345921","input_length":6935,"t_proxy_recv":384046.72212911,"t_decision_unix":1779814911.7360704,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":1024,"affinity_cache_ratio":0.14765681326604183,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":5911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14239,"ongoing_decode_tokens":0,"pending_prefill_tokens":9631,"num_requests":1,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":0,"new_prefill":6935,"score_linear":14239.0,"score_lmetric":16566},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":6935,"score_linear":62618.0,"score_lmetric":6935},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":6935,"score_linear":16015.0,"score_lmetric":6935},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":512,"new_prefill":6423,"score_linear":163773.0,"score_lmetric":12846},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102166,"ongoing_decode_tokens":0,"pending_prefill_tokens":19222,"num_requests":2,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":6935,"score_linear":102166.0,"score_lmetric":52314},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":6935,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":1024,"new_prefill":5911,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":6935,"score_linear":76493.0,"score_lmetric":6935}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":384047.123436868,"t_first_token_unix":1779814912.1373806,"t_done":384047.125621597,"t_done_unix":1779814912.1395655},{"request_id":"1349975:2:1352986:500","session_id":"1349975","input_length":14239,"t_proxy_recv":384046.682296819,"t_decision_unix":1779814911.696238,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":4608,"affinity_cache_ratio":0.32361823161738884,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":9631,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":4608,"new_prefill":9631,"score_linear":-4608.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":14239,"score_linear":62618.0,"score_lmetric":14239},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":14239,"score_linear":16015.0,"score_lmetric":14239},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":14239,"score_linear":164285.0,"score_lmetric":28478},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102166,"ongoing_decode_tokens":0,"pending_prefill_tokens":19222,"num_requests":2,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":14239,"score_linear":102166.0,"score_lmetric":66922},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":14239,"score_linear":76493.0,"score_lmetric":14239}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":384047.65790953,"t_first_token_unix":1779814912.6718528,"t_done":384047.837352642,"t_done_unix":1779814912.8512979},{"request_id":"1352606:1:1352606:496","session_id":"1352606","input_length":18840,"t_proxy_recv":384045.312809638,"t_decision_unix":1779814910.3267505,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":0,"new_prefill":18840,"score_linear":21436.0,"score_lmetric":27988},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":18840,"score_linear":62618.0,"score_lmetric":18840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":18840,"score_linear":16015.0,"score_lmetric":18840},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":18840,"score_linear":96026.0,"score_lmetric":18840},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10575,"ongoing_decode_tokens":0,"pending_prefill_tokens":10575,"num_requests":1,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":18840,"score_linear":10575.0,"score_lmetric":29415},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":18840,"score_linear":76493.0,"score_lmetric":18840}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384047.202707784,"t_first_token_unix":1779814912.2166512,"t_done":384048.211601251,"t_done_unix":1779814913.2255445},{"request_id":"1317598:6:1352957:499","session_id":"1317598","input_length":83326,"t_proxy_recv":384046.582380019,"t_decision_unix":1779814911.5963213,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82944,"affinity_cache_ratio":0.9954155965724983,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82944,"estimated_new_tokens":382,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":83326,"score_linear":62618.0,"score_lmetric":83326},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":83326,"score_linear":16015.0,"score_lmetric":83326},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":83326,"score_linear":164285.0,"score_lmetric":166652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":82944,"new_prefill":382,"score_linear":-64104.0,"score_lmetric":19222},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":83326,"score_linear":76493.0,"score_lmetric":83326}],"chosen_score_linear":-64104.0,"chosen_score_lmetric":19222,"t_first_token":384047.409957168,"t_first_token_unix":1779814912.4239006,"t_done":384048.588047792,"t_done_unix":1779814913.6019976},{"request_id":"1269373:20:1352797:498","session_id":"1269373","input_length":77790,"t_proxy_recv":384047.093235002,"t_decision_unix":1779814912.1071763,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9872734284612418,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":990,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14239,"ongoing_decode_tokens":0,"pending_prefill_tokens":9631,"num_requests":1,"active_p_offloads":0,"cached_blocks":1223,"cache_hit":7680,"new_prefill":70110,"score_linear":6559.0,"score_lmetric":79741},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":77790,"score_linear":62618.0,"score_lmetric":77790},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":7680,"new_prefill":70110,"score_linear":1270.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":77790,"score_linear":164285.0,"score_lmetric":155580},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102166,"ongoing_decode_tokens":0,"pending_prefill_tokens":19222,"num_requests":2,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":77790,"score_linear":102166.0,"score_lmetric":194024},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":7680,"new_prefill":70110,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6935,"ongoing_decode_tokens":0,"pending_prefill_tokens":5911,"num_requests":1,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":73216,"new_prefill":4574,"score_linear":-66281.0,"score_lmetric":10485},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1415,"cache_hit":76800,"new_prefill":990,"score_linear":-76800.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":384047.650189446,"t_first_token_unix":1779814912.6641364,"t_done":384049.73081791,"t_done_unix":1779814914.744762},{"request_id":"1344773:5:1353365:502","session_id":"1344773","input_length":33875,"t_proxy_recv":384048.189531569,"t_decision_unix":1779814913.2034729,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9824354243542436,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":595,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":33875,"score_linear":62618.0,"score_lmetric":33875},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":0,"new_prefill":33875,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":33875,"score_linear":164285.0,"score_lmetric":67750},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102166,"ongoing_decode_tokens":102166,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":33875,"score_linear":102166.0,"score_lmetric":67750},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":33280,"new_prefill":595,"score_linear":-33280.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77790,"ongoing_decode_tokens":77790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1415,"cache_hit":0,"new_prefill":33875,"score_linear":77790.0,"score_lmetric":33875}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":384048.32359273,"t_first_token_unix":1779814913.3375368,"t_done":384050.148788596,"t_done_unix":1779814915.1627321},{"request_id":"1279412:23:1348089:477","session_id":"1279412","input_length":96026,"t_proxy_recv":384029.418920856,"t_decision_unix":1779814894.4328623,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9970632953575074,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":282,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":96026,"score_linear":62618.0,"score_lmetric":96026},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":96026,"score_linear":16015.0,"score_lmetric":96026},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":95744,"new_prefill":282,"score_linear":-95744.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":102308,"ongoing_decode_tokens":102308,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":96026,"score_linear":102308.0,"score_lmetric":192052},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1020,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73946,"ongoing_decode_tokens":0,"pending_prefill_tokens":73946,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":12800,"new_prefill":83226,"score_linear":61146.0,"score_lmetric":157172}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":384029.575271135,"t_first_token_unix":1779814894.5892148,"t_done":384051.607858672,"t_done_unix":1779814916.6218028},{"request_id":"1253804:6:1318560:340","session_id":"1253804","input_length":62618,"t_proxy_recv":383925.233803778,"t_decision_unix":1779814790.2477453,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9403047047174934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":3738,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":62618,"score_linear":121968.0,"score_lmetric":62618},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":58880,"new_prefill":3738,"score_linear":-58880.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":64949,"ongoing_decode_tokens":64949,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1002,"cache_hit":3584,"new_prefill":59034,"score_linear":61365.0,"score_lmetric":59034},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":829,"cache_hit":0,"new_prefill":62618,"score_linear":79663.0,"score_lmetric":141769},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":806,"cache_hit":3584,"new_prefill":59034,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":62618,"score_linear":66135.0,"score_lmetric":62618},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1051,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":383926.621636239,"t_first_token_unix":1779814791.6355798,"t_done":384051.79969336,"t_done_unix":1779814916.8136368},{"request_id":"1253743:6:1354346:505","session_id":"1253743","input_length":51436,"t_proxy_recv":384051.434730086,"t_decision_unix":1779814916.4486713,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9954117738548877,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":236,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":4608,"new_prefill":46828,"score_linear":58010.0,"score_lmetric":46828},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36601,"ongoing_decode_tokens":21371,"pending_prefill_tokens":27651,"num_requests":1,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":0,"new_prefill":51436,"score_linear":36601.0,"score_lmetric":79087},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":49664,"new_prefill":1772,"score_linear":114621.0,"score_lmetric":3544},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":51200,"new_prefill":236,"score_linear":-51200.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":51436,"score_linear":83526.0,"score_lmetric":134962},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":384051.526863454,"t_first_token_unix":1779814916.540807,"t_done":384051.94621565,"t_done_unix":1779814916.960159},{"request_id":"1353821:1:1353821:503","session_id":"1353821","input_length":27651,"t_proxy_recv":384049.604725015,"t_decision_unix":1779814914.618666,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27651,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":27651,"score_linear":62618.0,"score_lmetric":27651},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":0,"new_prefill":27651,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":27651,"score_linear":164285.0,"score_lmetric":55302},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33875,"ongoing_decode_tokens":33875,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":27651,"score_linear":33875.0,"score_lmetric":27651},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77790,"ongoing_decode_tokens":77790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1415,"cache_hit":0,"new_prefill":27651,"score_linear":77790.0,"score_lmetric":27651}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384053.037030354,"t_first_token_unix":1779814918.050974,"t_done":384054.132039921,"t_done_unix":1779814919.1459835},{"request_id":"1286804:3:1354910:506","session_id":"1286804","input_length":15519,"t_proxy_recv":384053.407424609,"t_decision_unix":1779814918.421366,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8907790450415619,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1695,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36601,"ongoing_decode_tokens":49022,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":0,"new_prefill":15519,"score_linear":36601.0,"score_lmetric":15519},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":15519,"score_linear":68259.0,"score_lmetric":15519},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":1536,"new_prefill":13983,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":13824,"new_prefill":1695,"score_linear":-13824.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":15519,"score_linear":83526.0,"score_lmetric":99045},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":384054.792413158,"t_first_token_unix":1779814919.806357,"t_done":384056.373557522,"t_done_unix":1779814921.3875039},{"request_id":"1355484:1:1355484:508","session_id":"1355484","input_length":19366,"t_proxy_recv":384055.312697888,"t_decision_unix":1779814920.3266392,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":6566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":19366,"score_linear":24503.0,"score_lmetric":43869},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":19366,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":6566,"score_linear":55459.0,"score_lmetric":6566},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":0,"new_prefill":19366,"score_linear":15519.0,"score_lmetric":19366},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":19366,"score_linear":83526.0,"score_lmetric":102892},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":12800,"new_prefill":6566,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":384056.24639391,"t_first_token_unix":1779814921.260337,"t_done":384057.417924446,"t_done_unix":1779814922.4318683},{"request_id":"1344773:6:1356097:513","session_id":"1344773","input_length":34198,"t_proxy_recv":384057.567424117,"t_decision_unix":1779814922.581365,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9881279606994561,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":406,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":73480,"ongoing_decode_tokens":0,"pending_prefill_tokens":25352,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":34198,"score_linear":73480.0,"score_lmetric":119100},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":34198,"score_linear":48193.0,"score_lmetric":34198},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44258,"ongoing_decode_tokens":21371,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":34198,"score_linear":44258.0,"score_lmetric":69506},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":34198,"score_linear":68259.0,"score_lmetric":34198},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":34198,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":33792,"new_prefill":406,"score_linear":-33792.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":34198,"score_linear":83526.0,"score_lmetric":117724},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":78089,"ongoing_decode_tokens":78089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":34198,"score_linear":78089.0,"score_lmetric":34198}],"chosen_score_linear":-33792.0,"chosen_score_lmetric":0,"t_first_token":384057.648465642,"t_first_token_unix":1779814922.662409,"t_done":384057.805792516,"t_done_unix":1779814922.8197436},{"request_id":"1355325:1:1355325:507","session_id":"1355325","input_length":24503,"t_proxy_recv":384054.881888606,"t_decision_unix":1779814919.89583,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24503,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":24503,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":24503,"score_linear":68259.0,"score_lmetric":24503},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":0,"new_prefill":24503,"score_linear":15519.0,"score_lmetric":24503},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":24503,"score_linear":83526.0,"score_lmetric":108029},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384057.704428728,"t_first_token_unix":1779814922.7183728,"t_done":384057.981858757,"t_done_unix":1779814922.9958024},{"request_id":"1340278:2:1356079:512","session_id":"1340278","input_length":48977,"t_proxy_recv":384057.505343938,"t_decision_unix":1779814922.5192852,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9826653327071891,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":849,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":48128,"new_prefill":849,"score_linear":-23625.0,"score_lmetric":25352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":48977,"score_linear":48193.0,"score_lmetric":48977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44258,"ongoing_decode_tokens":21371,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":48977,"score_linear":44258.0,"score_lmetric":84285},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":48977,"score_linear":68259.0,"score_lmetric":48977},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":48977,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":48977,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":48977,"score_linear":83526.0,"score_lmetric":132503},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":78089,"ongoing_decode_tokens":78089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":48977,"score_linear":78089.0,"score_lmetric":48977}],"chosen_score_linear":-23625.0,"chosen_score_lmetric":25352,"t_first_token":384057.942581432,"t_first_token_unix":1779814922.956525,"t_done":384058.618430158,"t_done_unix":1779814923.6323738},{"request_id":"1269373:21:1355702:509","session_id":"1269373","input_length":78089,"t_proxy_recv":384056.002338233,"t_decision_unix":1779814921.0162797,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":77824,"affinity_cache_ratio":0.9966064362458221,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77824,"estimated_new_tokens":265,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":7680,"new_prefill":70409,"score_linear":16823.0,"score_lmetric":94912},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":78089,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":7680,"new_prefill":70409,"score_linear":1270.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":78089,"score_linear":68259.0,"score_lmetric":78089},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":78089,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":7680,"new_prefill":70409,"score_linear":7839.0,"score_lmetric":70409},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":73216,"new_prefill":4873,"score_linear":10310.0,"score_lmetric":88399},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19366,"ongoing_decode_tokens":0,"pending_prefill_tokens":6566,"num_requests":1,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":77824,"new_prefill":265,"score_linear":-58458.0,"score_lmetric":6831}],"chosen_score_linear":-58458.0,"chosen_score_lmetric":6831,"t_first_token":384056.363245654,"t_first_token_unix":1779814921.3771894,"t_done":384060.273848213,"t_done_unix":1779814925.2877922},{"request_id":"1356948:1:1356948:515","session_id":"1356948","input_length":6711,"t_proxy_recv":384060.603367415,"t_decision_unix":1779814925.6173089,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6711,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":6711,"score_linear":122597.0,"score_lmetric":128284},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":6711,"score_linear":48193.0,"score_lmetric":6711},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44258,"ongoing_decode_tokens":21371,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":6711,"score_linear":44258.0,"score_lmetric":42019},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":6711,"score_linear":68259.0,"score_lmetric":6711},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":6711,"score_linear":83526.0,"score_lmetric":90237},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384061.047860941,"t_first_token_unix":1779814926.0618043,"t_done":384061.319141008,"t_done_unix":1779814926.3330843},{"request_id":"1355951:1:1355951:511","session_id":"1355951","input_length":35308,"t_proxy_recv":384056.904586581,"t_decision_unix":1779814921.918528,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":35308,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":35308,"score_linear":24503.0,"score_lmetric":59811},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":35308,"score_linear":48193.0,"score_lmetric":38445},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":35308,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":35308,"score_linear":68259.0,"score_lmetric":35308},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":35308,"score_linear":83526.0,"score_lmetric":118834},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":97455,"ongoing_decode_tokens":97455,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":0,"new_prefill":35308,"score_linear":97455.0,"score_lmetric":70616}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384062.099703606,"t_first_token_unix":1779814927.1136472,"t_done":384062.825954405,"t_done_unix":1779814927.8399012},{"request_id":"1357132:1:1357132:516","session_id":"1357132","input_length":13520,"t_proxy_recv":384061.137270849,"t_decision_unix":1779814926.1512122,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":13520,"score_linear":122597.0,"score_lmetric":135093},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":13520,"score_linear":48193.0,"score_lmetric":13520},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44258,"ongoing_decode_tokens":21371,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":13520,"score_linear":44258.0,"score_lmetric":48828},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":13520,"score_linear":68259.0,"score_lmetric":13520},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":13520,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6711,"ongoing_decode_tokens":6711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":13520,"score_linear":6711.0,"score_lmetric":13520},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":13520,"score_linear":83526.0,"score_lmetric":97046},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":13520,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384062.306802904,"t_first_token_unix":1779814927.320746,"t_done":384062.908524723,"t_done_unix":1779814927.9224684},{"request_id":"1353821:2:1357420:517","session_id":"1353821","input_length":27805,"t_proxy_recv":384061.988840145,"t_decision_unix":1779814927.0027814,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9943535335371336,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":27805,"score_linear":122597.0,"score_lmetric":149378},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":27805,"score_linear":48193.0,"score_lmetric":27805},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44258,"ongoing_decode_tokens":21371,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":27648,"new_prefill":157,"score_linear":16610.0,"score_lmetric":35465},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":27805,"score_linear":68259.0,"score_lmetric":27805},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13520,"ongoing_decode_tokens":0,"pending_prefill_tokens":13520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":27805,"score_linear":13520.0,"score_lmetric":41325},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1073,"cache_hit":0,"new_prefill":27805,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":27805,"score_linear":83526.0,"score_lmetric":111331},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":27805,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":16610.0,"chosen_score_lmetric":35465,"t_first_token":384062.148553451,"t_first_token_unix":1779814927.1624968,"t_done":384063.37455642,"t_done_unix":1779814928.3885},{"request_id":"1344773:7:1357714:518","session_id":"1344773","input_length":34351,"t_proxy_recv":384063.070311495,"t_decision_unix":1779814928.084253,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9837268201799074,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":34351,"score_linear":122597.0,"score_lmetric":155924},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":34351,"score_linear":48193.0,"score_lmetric":34351},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36755,"ongoing_decode_tokens":49176,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":34351,"score_linear":36755.0,"score_lmetric":34351},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":34351,"score_linear":68259.0,"score_lmetric":34351},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":34351,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1073,"cache_hit":33792,"new_prefill":559,"score_linear":-33792.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":34351,"score_linear":83526.0,"score_lmetric":117877},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":34351,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-33792.0,"chosen_score_lmetric":0,"t_first_token":384063.173084962,"t_first_token_unix":1779814928.1870284,"t_done":384063.563455295,"t_done_unix":1779814928.577399},{"request_id":"1294611:11:1355750:510","session_id":"1294611","input_length":48193,"t_proxy_recv":384056.092352088,"t_decision_unix":1779814921.1062934,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9349075591890939,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":3137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":48193,"score_linear":24503.0,"score_lmetric":72696},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":45056,"new_prefill":3137,"score_linear":-45056.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":48193,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":48193,"score_linear":68259.0,"score_lmetric":48193},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":48193,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":0,"new_prefill":48193,"score_linear":15519.0,"score_lmetric":48193},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":12800,"new_prefill":35393,"score_linear":70726.0,"score_lmetric":118919},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":97455,"ongoing_decode_tokens":0,"pending_prefill_tokens":6831,"num_requests":2,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":12800,"new_prefill":35393,"score_linear":84655.0,"score_lmetric":84448}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":384057.012649753,"t_first_token_unix":1779814922.0265934,"t_done":384064.404166308,"t_done_unix":1779814929.4181097},{"request_id":"1344773:8:1358989:523","session_id":"1344773","input_length":34552,"t_proxy_recv":384067.597595894,"t_decision_unix":1779814932.611537,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9928224125955082,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":248,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":34552,"score_linear":122597.0,"score_lmetric":156125},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":34552,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":34552,"score_linear":68259.0,"score_lmetric":34552},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":34304,"new_prefill":248,"score_linear":-34304.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":34552,"score_linear":83526.0,"score_lmetric":118078},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":0,"pending_prefill_tokens":36604,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":34552,"score_linear":139004.0,"score_lmetric":142312}],"chosen_score_linear":-34304.0,"chosen_score_lmetric":0,"t_first_token":384067.723642662,"t_first_token_unix":1779814932.7375867,"t_done":384067.973590672,"t_done_unix":1779814932.9875345},{"request_id":"1253743:7:1359251:524","session_id":"1253743","input_length":51509,"t_proxy_recv":384068.634081892,"t_decision_unix":1779814933.6480224,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9940010483604806,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":51509,"score_linear":122597.0,"score_lmetric":173082},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":4608,"new_prefill":46901,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":51509,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":49664,"new_prefill":1845,"score_linear":18595.0,"score_lmetric":1845},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":51509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":51200,"new_prefill":309,"score_linear":-51200.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":51509,"score_linear":83526.0,"score_lmetric":135035},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":0,"pending_prefill_tokens":36604,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":51509,"score_linear":139004.0,"score_lmetric":176226}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":384068.719791214,"t_first_token_unix":1779814933.733735,"t_done":384068.889951792,"t_done_unix":1779814933.9038956},{"request_id":"1344773:9:1360064:526","session_id":"1344773","input_length":34611,"t_proxy_recv":384071.599160018,"t_decision_unix":1779814936.6131008,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9911299875762041,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":307,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":34611,"score_linear":122597.0,"score_lmetric":156184},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":34611,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":34611,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":34611,"score_linear":68259.0,"score_lmetric":34611},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":34611,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":34304,"new_prefill":307,"score_linear":-34304.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":34611,"score_linear":83526.0,"score_lmetric":118137},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":0,"pending_prefill_tokens":36641,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":34611,"score_linear":158497.0,"score_lmetric":213756}],"chosen_score_linear":-34304.0,"chosen_score_lmetric":0,"t_first_token":384071.66322754,"t_first_token_unix":1779814936.6771712,"t_done":384072.053698796,"t_done_unix":1779814937.067643},{"request_id":"1353821:3:1360898:529","session_id":"1353821","input_length":27933,"t_proxy_recv":384074.408613124,"t_decision_unix":1779814939.4225445,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27648,"affinity_cache_ratio":0.98979701428418,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":285,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":27933,"score_linear":122597.0,"score_lmetric":149506},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":27933,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":27648,"new_prefill":285,"score_linear":-18698.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":27933,"score_linear":68259.0,"score_lmetric":27933},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":33478,"ongoing_decode_tokens":0,"pending_prefill_tokens":31942,"num_requests":1,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":27933,"score_linear":33478.0,"score_lmetric":59875},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":27933,"score_linear":117888.0,"score_lmetric":145821},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":83526,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":27933,"score_linear":83526.0,"score_lmetric":27933},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":0,"pending_prefill_tokens":36641,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":27933,"score_linear":158497.0,"score_lmetric":193722}],"chosen_score_linear":-18698.0,"chosen_score_lmetric":0,"t_first_token":384074.468689315,"t_first_token_unix":1779814939.4826329,"t_done":384075.021628993,"t_done_unix":1779814940.0355756},{"request_id":"1353951:1:1353951:504","session_id":"1353951","input_length":83526,"t_proxy_recv":384050.111561908,"t_decision_unix":1779814915.1255033,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":83526,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":83526,"score_linear":62618.0,"score_lmetric":83526},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36601,"ongoing_decode_tokens":21371,"pending_prefill_tokens":27651,"num_requests":1,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":0,"new_prefill":83526,"score_linear":36601.0,"score_lmetric":111177},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":164285,"ongoing_decode_tokens":164285,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":83526,"score_linear":164285.0,"score_lmetric":167052},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33875,"ongoing_decode_tokens":33875,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":83526,"score_linear":33875.0,"score_lmetric":83526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384073.728155674,"t_first_token_unix":1779814938.7420995,"t_done":384075.102467913,"t_done_unix":1779814940.116412},{"request_id":"1353951:2:1358300:520","session_id":"1353951","input_length":83905,"t_proxy_recv":384075.120223636,"t_decision_unix":1779814940.1341648,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9946487098504261,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":449,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":83905,"score_linear":122597.0,"score_lmetric":205478},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":83905,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":83905,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":83905,"score_linear":68259.0,"score_lmetric":83905},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":99510,"ongoing_decode_tokens":0,"pending_prefill_tokens":32438,"num_requests":2,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":83905,"score_linear":99510.0,"score_lmetric":232686},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":83905,"score_linear":117888.0,"score_lmetric":201793},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":83456,"new_prefill":449,"score_linear":-83456.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":158497,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":83905,"score_linear":158497.0,"score_lmetric":251715}],"chosen_score_linear":-83456.0,"chosen_score_lmetric":0,"t_first_token":384075.393120761,"t_first_token_unix":1779814940.4070644,"t_done":384075.543297212,"t_done_unix":1779814940.5572412},{"request_id":"1355484:2:1359370:525","session_id":"1355484","input_length":19493,"t_proxy_recv":384069.088133878,"t_decision_unix":1779814934.102075,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9981018827271328,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":37,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":19493,"score_linear":122597.0,"score_lmetric":141066},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":19493,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":19493,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":6693,"score_linear":55459.0,"score_lmetric":6693},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":19493,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":19493,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":19493,"score_linear":83526.0,"score_lmetric":103019},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":0,"pending_prefill_tokens":36604,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":19456,"new_prefill":37,"score_linear":119548.0,"score_lmetric":73282}],"chosen_score_linear":119548.0,"chosen_score_lmetric":73282,"t_first_token":384074.84397997,"t_first_token_unix":1779814939.857923,"t_done":384077.600655803,"t_done_unix":1779814942.6145997},{"request_id":"1356948:2:1361262:532","session_id":"1356948","input_length":16480,"t_proxy_recv":384075.883220344,"t_decision_unix":1779814940.8971612,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":2,"affinity_cache_hit":6656,"affinity_cache_ratio":0.40388349514563104,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":16480,"score_linear":122597.0,"score_lmetric":138053},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":16480,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":16480,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":16480,"score_linear":68259.0,"score_lmetric":16480},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":99510,"ongoing_decode_tokens":0,"pending_prefill_tokens":32438,"num_requests":2,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":16480,"score_linear":99510.0,"score_lmetric":97836},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":6656,"new_prefill":9824,"score_linear":111232.0,"score_lmetric":127712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":16480,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":158497,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":16480,"score_linear":158497.0,"score_lmetric":49440}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384077.437157037,"t_first_token_unix":1779814942.4510999,"t_done":384077.684148369,"t_done_unix":1779814942.6980917},{"request_id":"1355484:3:1361065:531","session_id":"1355484","input_length":19714,"t_proxy_recv":384077.605849363,"t_decision_unix":1779814942.6197908,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9869128538094755,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":258,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":19714,"score_linear":122597.0,"score_lmetric":141287},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":19714,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":25430,"ongoing_decode_tokens":37851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":19714,"score_linear":25430.0,"score_lmetric":19714},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":6914,"score_linear":55459.0,"score_lmetric":6914},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":99510,"ongoing_decode_tokens":0,"pending_prefill_tokens":32438,"num_requests":2,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":19714,"score_linear":99510.0,"score_lmetric":104304},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":19714,"score_linear":152567.0,"score_lmetric":275954},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":19714,"score_linear":76969.0,"score_lmetric":93099},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":19456,"new_prefill":258,"score_linear":119548.0,"score_lmetric":516}],"chosen_score_linear":119548.0,"chosen_score_lmetric":516,"t_first_token":384077.699533248,"t_first_token_unix":1779814942.7134764,"t_done":384078.67322079,"t_done_unix":1779814943.687164},{"request_id":"1342921:2:1361022:530","session_id":"1342921","input_length":66032,"t_proxy_recv":384074.87225905,"t_decision_unix":1779814939.8862004,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":65536,"affinity_cache_ratio":0.992488490428883,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":66032,"score_linear":122597.0,"score_lmetric":187605},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":66032,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36883,"ongoing_decode_tokens":49304,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":66032,"score_linear":36883.0,"score_lmetric":66032},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":66032,"score_linear":68259.0,"score_lmetric":66032},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":33478,"ongoing_decode_tokens":0,"pending_prefill_tokens":31942,"num_requests":1,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":65536,"new_prefill":496,"score_linear":-32058.0,"score_lmetric":32438},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":66032,"score_linear":117888.0,"score_lmetric":183920},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":83526,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":66032,"score_linear":83526.0,"score_lmetric":66032},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":158497,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":66032,"score_linear":158497.0,"score_lmetric":198096}],"chosen_score_linear":-32058.0,"chosen_score_lmetric":32438,"t_first_token":384078.760817547,"t_first_token_unix":1779814943.7747607,"t_done":384079.218094637,"t_done_unix":1779814944.2320383},{"request_id":"1361992:1:1361992:535","session_id":"1361992","input_length":8113,"t_proxy_recv":384078.460120145,"t_decision_unix":1779814943.4740608,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":8113,"score_linear":122597.0,"score_lmetric":129686},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":8113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":8113,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":8113,"score_linear":68259.0,"score_lmetric":8113},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":99510,"ongoing_decode_tokens":0,"pending_prefill_tokens":32438,"num_requests":2,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":8113,"score_linear":99510.0,"score_lmetric":81102},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":8113,"score_linear":152567.0,"score_lmetric":252752},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":8113,"score_linear":76969.0,"score_lmetric":81498},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158718,"ongoing_decode_tokens":158718,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":8113,"score_linear":158718.0,"score_lmetric":24339}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384079.031909797,"t_first_token_unix":1779814944.0458534,"t_done":384079.24791719,"t_done_unix":1779814944.2618666},{"request_id":"1270340:3:1360716:528","session_id":"1270340","input_length":33478,"t_proxy_recv":384073.749415255,"t_decision_unix":1779814938.7633567,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":4,"affinity_cache_hit":28160,"affinity_cache_ratio":0.8411494115538563,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":31942,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":33478,"score_linear":122597.0,"score_lmetric":155051},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":33478,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":33478,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":33478,"score_linear":68259.0,"score_lmetric":33478},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":1536,"new_prefill":31942,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":33478,"score_linear":117888.0,"score_lmetric":151366},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":83526,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":33478,"score_linear":83526.0,"score_lmetric":33478},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":0,"pending_prefill_tokens":36641,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":28160,"new_prefill":5318,"score_linear":130337.0,"score_lmetric":125877}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":384078.757758327,"t_first_token_unix":1779814943.771702,"t_done":384079.419549757,"t_done_unix":1779814944.433493},{"request_id":"1362265:1:1362265:536","session_id":"1362265","input_length":8825,"t_proxy_recv":384079.306508243,"t_decision_unix":1779814944.3204496,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8825,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":8825,"score_linear":122597.0,"score_lmetric":130398},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":8825,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":8825,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":8825,"score_linear":68259.0,"score_lmetric":8825},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":33478,"ongoing_decode_tokens":33478,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1297,"cache_hit":0,"new_prefill":8825,"score_linear":33478.0,"score_lmetric":8825},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":8825,"score_linear":152567.0,"score_lmetric":254176},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":8825,"score_linear":76969.0,"score_lmetric":82210},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":8825,"score_linear":139004.0,"score_lmetric":17650}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384079.96942936,"t_first_token_unix":1779814944.9833736,"t_done":384081.019270373,"t_done_unix":1779814946.033216},{"request_id":"1361992:2:1362904:537","session_id":"1361992","input_length":10347,"t_proxy_recv":384081.551398938,"t_decision_unix":1779814946.5653396,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":7680,"affinity_cache_ratio":0.7422441287329661,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2667,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":10347,"score_linear":122597.0,"score_lmetric":131920},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":10347,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":7680,"new_prefill":2667,"score_linear":1270.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":10347,"score_linear":68259.0,"score_lmetric":10347},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":10347,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":10347,"score_linear":152567.0,"score_lmetric":257220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":10347,"score_linear":76969.0,"score_lmetric":83732},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":10347,"score_linear":139004.0,"score_lmetric":20694}],"chosen_score_linear":1270.0,"chosen_score_lmetric":0,"t_first_token":384081.811047523,"t_first_token_unix":1779814946.8249912,"t_done":384082.033044155,"t_done_unix":1779814947.0469875},{"request_id":"1363440:1:1363440:542","session_id":"1363440","input_length":543,"t_proxy_recv":384083.500300336,"t_decision_unix":1779814948.5142417,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":543,"score_linear":122597.0,"score_lmetric":122116},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":543,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":543,"score_linear":136960.0,"score_lmetric":196731},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":543,"score_linear":68259.0,"score_lmetric":543},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":543,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":543,"score_linear":168624.0,"score_lmetric":363117},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":543,"score_linear":76969.0,"score_lmetric":73928},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":543,"score_linear":139004.0,"score_lmetric":1086}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384083.56173382,"t_first_token_unix":1779814948.5756776,"t_done":384083.736314094,"t_done_unix":1779814948.7502575},{"request_id":"1313181:2:1358046:519","session_id":"1313181","input_length":58758,"t_proxy_recv":384064.27353423,"t_decision_unix":1779814929.287475,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24064,"affinity_cache_ratio":0.40954423227475406,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":34694,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":58758,"score_linear":122597.0,"score_lmetric":180331},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":58758,"score_linear":48193.0,"score_lmetric":58758},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":58758,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":45958,"score_linear":55459.0,"score_lmetric":45958},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":58758,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":58758,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":58758,"score_linear":83526.0,"score_lmetric":142284},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":24064,"new_prefill":34694,"score_linear":-24064.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":384074.837400164,"t_first_token_unix":1779814939.8513474,"t_done":384084.684776851,"t_done_unix":1779814949.698726},{"request_id":"1313181:3:1316742:330","session_id":"1313181","input_length":24451,"t_proxy_recv":384084.690570296,"t_decision_unix":1779814949.7045116,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9841724264856243,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":24451,"score_linear":122597.0,"score_lmetric":146024},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":24451,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":24451,"score_linear":136960.0,"score_lmetric":268455},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":11651,"score_linear":55459.0,"score_lmetric":11651},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":24451,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":24451,"score_linear":168624.0,"score_lmetric":434841},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":24451,"score_linear":76969.0,"score_lmetric":97836},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":24064,"new_prefill":387,"score_linear":56182.0,"score_lmetric":387}],"chosen_score_linear":56182.0,"chosen_score_lmetric":387,"t_first_token":384084.747567617,"t_first_token_unix":1779814949.7615116,"t_done":384085.823291248,"t_done_unix":1779814950.8372347},{"request_id":"1363943:1:1363943:543","session_id":"1363943","input_length":12636,"t_proxy_recv":384085.184616527,"t_decision_unix":1779814950.198544,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12636,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":8704,"new_prefill":3932,"score_linear":113893.0,"score_lmetric":125505},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":12636,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":4096,"new_prefill":8540,"score_linear":132864.0,"score_lmetric":220722},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":12636,"score_linear":68259.0,"score_lmetric":12636},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":12636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":4096,"new_prefill":8540,"score_linear":164528.0,"score_lmetric":387108},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":4096,"new_prefill":8540,"score_linear":72873.0,"score_lmetric":81925},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":104697,"ongoing_decode_tokens":104697,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":4096,"new_prefill":8540,"score_linear":100601.0,"score_lmetric":17080}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384086.246404902,"t_first_token_unix":1779814951.260349,"t_done":384087.588305111,"t_done_unix":1779814952.6022482},{"request_id":"1364128:1:1364128:545","session_id":"1364128","input_length":8706,"t_proxy_recv":384085.668799467,"t_decision_unix":1779814950.682741,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":8706,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":8706,"score_linear":122597.0,"score_lmetric":130279},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":0,"pending_prefill_tokens":13897,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":6656,"new_prefill":2050,"score_linear":7241.0,"score_lmetric":15947},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":8706,"score_linear":136960.0,"score_lmetric":221220},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":8706,"score_linear":68259.0,"score_lmetric":8706},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":12636,"ongoing_decode_tokens":0,"pending_prefill_tokens":12636,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":8706,"score_linear":12636.0,"score_lmetric":21342},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":8706,"score_linear":168624.0,"score_lmetric":387606},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":8706,"score_linear":76969.0,"score_lmetric":82091},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":104697,"ongoing_decode_tokens":104697,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":8706,"score_linear":104697.0,"score_lmetric":17412}],"chosen_score_linear":68259.0,"chosen_score_lmetric":8706,"t_first_token":384086.426847303,"t_first_token_unix":1779814951.4407914,"t_done":384088.852235862,"t_done_unix":1779814953.866181},{"request_id":"1364960:1:1364960:549","session_id":"1364960","input_length":2019,"t_proxy_recv":384088.592729472,"t_decision_unix":1779814953.6066709,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2019,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":2019,"score_linear":122597.0,"score_lmetric":123592},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":13897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":2019,"score_linear":13897.0,"score_lmetric":2019},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":2019,"score_linear":136960.0,"score_lmetric":201159},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":175003,"ongoing_decode_tokens":175003,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":2019,"score_linear":175003.0,"score_lmetric":6057},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1384,"cache_hit":0,"new_prefill":2019,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":2019,"score_linear":168624.0,"score_lmetric":367545},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":2019,"score_linear":76969.0,"score_lmetric":75404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":2019,"score_linear":159566.0,"score_lmetric":113457}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384088.725287512,"t_first_token_unix":1779814953.7392304,"t_done":384089.121727764,"t_done_unix":1779814954.1356714},{"request_id":"1279412:24:1364169:546","session_id":"1279412","input_length":98038,"t_proxy_recv":384085.81119238,"t_decision_unix":1779814950.8251338,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9974907688855342,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":98038,"score_linear":122597.0,"score_lmetric":219611},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":0,"pending_prefill_tokens":13897,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":98038,"score_linear":13897.0,"score_lmetric":111935},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":98038,"score_linear":136960.0,"score_lmetric":489216},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":76965,"ongoing_decode_tokens":68259,"pending_prefill_tokens":8706,"num_requests":2,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":97792,"new_prefill":246,"score_linear":-20827.0,"score_lmetric":17904},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":12636,"ongoing_decode_tokens":0,"pending_prefill_tokens":12636,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":98038,"score_linear":12636.0,"score_lmetric":110674},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":98038,"score_linear":168624.0,"score_lmetric":655602},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":98038,"score_linear":76969.0,"score_lmetric":171423},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":104697,"ongoing_decode_tokens":104697,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":12800,"new_prefill":85238,"score_linear":91897.0,"score_lmetric":170476}],"chosen_score_linear":-20827.0,"chosen_score_lmetric":17904,"t_first_token":384086.589411135,"t_first_token_unix":1779814951.6033547,"t_done":384089.565765813,"t_done_unix":1779814954.5797102},{"request_id":"1363440:2:1365095:551","session_id":"1363440","input_length":3866,"t_proxy_recv":384089.175070004,"t_decision_unix":1779814954.1890116,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":512,"affinity_cache_ratio":0.13243662700465597,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":3354,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":3354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":3866,"score_linear":122597.0,"score_lmetric":125439},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":13897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":512,"new_prefill":3354,"score_linear":13385.0,"score_lmetric":3354},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":3866,"score_linear":136960.0,"score_lmetric":206700},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166297,"ongoing_decode_tokens":166297,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":3866,"score_linear":166297.0,"score_lmetric":7732},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":14721,"ongoing_decode_tokens":14721,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1388,"cache_hit":0,"new_prefill":3866,"score_linear":14721.0,"score_lmetric":3866},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":3866,"score_linear":168624.0,"score_lmetric":373086},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":3866,"score_linear":76969.0,"score_lmetric":77251},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":3866,"score_linear":159566.0,"score_lmetric":118998}],"chosen_score_linear":13385.0,"chosen_score_lmetric":3354,"t_first_token":384089.394149721,"t_first_token_unix":1779814954.4080932,"t_done":384089.723139858,"t_done_unix":1779814954.7370837},{"request_id":"1357132:2:1364990:550","session_id":"1357132","input_length":14721,"t_proxy_recv":384088.668986638,"t_decision_unix":1779814953.682928,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":13312,"affinity_cache_ratio":0.9042863935873922,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":1409,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":14721,"score_linear":122597.0,"score_lmetric":136294},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":13897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":14721,"score_linear":13897.0,"score_lmetric":14721},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":14721,"score_linear":136960.0,"score_lmetric":239265},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":175003,"ongoing_decode_tokens":175003,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":14721,"score_linear":175003.0,"score_lmetric":44163},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":2019,"ongoing_decode_tokens":0,"pending_prefill_tokens":2019,"num_requests":1,"active_p_offloads":0,"cached_blocks":1384,"cache_hit":13312,"new_prefill":1409,"score_linear":-11293.0,"score_lmetric":3428},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":14721,"score_linear":168624.0,"score_lmetric":405651},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":14721,"score_linear":76969.0,"score_lmetric":88106},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":14721,"score_linear":159566.0,"score_lmetric":151563}],"chosen_score_linear":-11293.0,"chosen_score_lmetric":3428,"t_first_token":384088.904667323,"t_first_token_unix":1779814953.9186103,"t_done":384089.799692603,"t_done_unix":1779814954.813636},{"request_id":"1364090:1:1364090:544","session_id":"1364090","input_length":13897,"t_proxy_recv":384085.562400364,"t_decision_unix":1779814950.5763419,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":7680,"new_prefill":6217,"score_linear":114917.0,"score_lmetric":127790},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":13897,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":7680,"new_prefill":6217,"score_linear":129280.0,"score_lmetric":213753},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":13897,"score_linear":68259.0,"score_lmetric":13897},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":12636,"ongoing_decode_tokens":0,"pending_prefill_tokens":12636,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":13897,"score_linear":12636.0,"score_lmetric":26533},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":7680,"new_prefill":6217,"score_linear":160944.0,"score_lmetric":380139},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":11264,"new_prefill":2633,"score_linear":65705.0,"score_lmetric":76018},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":104697,"ongoing_decode_tokens":104697,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":11264,"new_prefill":2633,"score_linear":93433.0,"score_lmetric":5266}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384086.757011851,"t_first_token_unix":1779814951.770955,"t_done":384090.329857076,"t_done_unix":1779814955.3438005},{"request_id":"1365440:1:1365440:552","session_id":"1365440","input_length":9913,"t_proxy_recv":384090.394968427,"t_decision_unix":1779814955.4089093,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9913,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":9913,"score_linear":122597.0,"score_lmetric":131486},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":876,"cache_hit":0,"new_prefill":9913,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":9913,"score_linear":136960.0,"score_lmetric":224841},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":9913,"score_linear":68259.0,"score_lmetric":9913},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1391,"cache_hit":0,"new_prefill":9913,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":9913,"score_linear":168624.0,"score_lmetric":391227},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":9913,"score_linear":76969.0,"score_lmetric":83298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":9913,"score_linear":159566.0,"score_lmetric":137139}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384091.175096316,"t_first_token_unix":1779814956.1890404,"t_done":384091.282760091,"t_done_unix":1779814956.2967038},{"request_id":"1366128:1:1366128:553","session_id":"1366128","input_length":11154,"t_proxy_recv":384092.689239268,"t_decision_unix":1779814957.7031803,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11154,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":11154,"score_linear":122597.0,"score_lmetric":132727},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":11154,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":11154,"score_linear":136960.0,"score_lmetric":228564},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":11154,"score_linear":68259.0,"score_lmetric":11154},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1391,"cache_hit":0,"new_prefill":11154,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":11154,"score_linear":168624.0,"score_lmetric":394950},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":11154,"score_linear":76969.0,"score_lmetric":84539},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":11154,"score_linear":159566.0,"score_lmetric":140862}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384093.581184952,"t_first_token_unix":1779814958.595128,"t_done":384094.172696347,"t_done_unix":1779814959.1866417},{"request_id":"1357132:3:1366582:557","session_id":"1357132","input_length":14816,"t_proxy_recv":384094.339563349,"t_decision_unix":1779814959.3535047,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9676025917926566,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":14816,"score_linear":122597.0,"score_lmetric":136389},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":14816,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":14816,"score_linear":136960.0,"score_lmetric":239550},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166526,"ongoing_decode_tokens":166526,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":14816,"score_linear":166526.0,"score_lmetric":29632},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":12984,"ongoing_decode_tokens":12984,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":14336,"new_prefill":480,"score_linear":-1352.0,"score_lmetric":480},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":14816,"score_linear":168624.0,"score_lmetric":405936},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":14816,"score_linear":76969.0,"score_lmetric":88201},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":14816,"score_linear":159566.0,"score_lmetric":151848}],"chosen_score_linear":-1352.0,"chosen_score_lmetric":480,"t_first_token":384094.380287607,"t_first_token_unix":1779814959.3942318,"t_done":384096.479327178,"t_done_unix":1779814961.493271},{"request_id":"1353821:4:1363399:541","session_id":"1353821","input_length":28093,"t_proxy_recv":384083.330206023,"t_decision_unix":1779814948.3441474,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27648,"affinity_cache_ratio":0.984159755099135,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":445,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":28093,"score_linear":122597.0,"score_lmetric":149666},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":28093,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108867,"ongoing_decode_tokens":21371,"pending_prefill_tokens":64589,"num_requests":2,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":27648,"new_prefill":445,"score_linear":81219.0,"score_lmetric":130068},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":28093,"score_linear":68259.0,"score_lmetric":28093},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":28093,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":28093,"score_linear":168624.0,"score_lmetric":445767},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":28093,"score_linear":76969.0,"score_lmetric":101478},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":28093,"score_linear":139004.0,"score_lmetric":56186}],"chosen_score_linear":81219.0,"chosen_score_lmetric":130068,"t_first_token":384096.615259052,"t_first_token_unix":1779814961.6292024,"t_done":384097.116504254,"t_done_unix":1779814962.130448},{"request_id":"1314357:4:1352612:497","session_id":"1314357","input_length":68259,"t_proxy_recv":384045.346182784,"t_decision_unix":1779814910.3601239,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":67072,"affinity_cache_ratio":0.9826103517484874,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":67072,"estimated_new_tokens":1187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1206,"cache_hit":0,"new_prefill":68259,"score_linear":21436.0,"score_lmetric":77407},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":68259,"score_linear":62618.0,"score_lmetric":68259},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16015,"ongoing_decode_tokens":28436,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":68259,"score_linear":16015.0,"score_lmetric":68259},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":67072,"new_prefill":1187,"score_linear":28954.0,"score_lmetric":1187},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":68259,"score_linear":18840.0,"score_lmetric":87099},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1056,"cache_hit":0,"new_prefill":68259,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10575,"ongoing_decode_tokens":0,"pending_prefill_tokens":10575,"num_requests":1,"active_p_offloads":0,"cached_blocks":1480,"cache_hit":0,"new_prefill":68259,"score_linear":10575.0,"score_lmetric":78834},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76493,"ongoing_decode_tokens":76493,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":68259,"score_linear":76493.0,"score_lmetric":68259}],"chosen_score_linear":28954.0,"chosen_score_lmetric":1187,"t_first_token":384045.860113763,"t_first_token_unix":1779814910.8740573,"t_done":384097.241537929,"t_done_unix":1779814962.255482},{"request_id":"1367424:1:1367424:569","session_id":"1367424","input_length":3392,"t_proxy_recv":384097.424948054,"t_decision_unix":1779814962.4388895,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":10176,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":3392,"score_linear":172080.0,"score_lmetric":251616},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":42698,"ongoing_decode_tokens":0,"pending_prefill_tokens":22218,"num_requests":3,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":3392,"score_linear":42698.0,"score_lmetric":76830},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":3392,"score_linear":135704.0,"score_lmetric":90687},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":143663,"ongoing_decode_tokens":143663,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":3392,"score_linear":143663.0,"score_lmetric":10176},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":69412,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":3392,"score_linear":69412.0,"score_lmetric":10176},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":3392,"score_linear":168624.0,"score_lmetric":371664},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":3392,"score_linear":76969.0,"score_lmetric":76777},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":3392,"score_linear":159566.0,"score_lmetric":10176}],"chosen_score_linear":69412.0,"chosen_score_lmetric":10176,"t_first_token":384097.688849356,"t_first_token_unix":1779814962.702793,"t_done":384097.817660503,"t_done_unix":1779814962.8316042},{"request_id":"1277428:5:1366630:559","session_id":"1277428","input_length":36301,"t_proxy_recv":384094.489672982,"t_decision_unix":1779814959.5036144,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9308834467370045,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":2509,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":36301,"score_linear":122597.0,"score_lmetric":157874},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":4608,"new_prefill":31693,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":36301,"score_linear":136960.0,"score_lmetric":304005},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166526,"ongoing_decode_tokens":166526,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":33792,"new_prefill":2509,"score_linear":132734.0,"score_lmetric":5018},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":68817,"ongoing_decode_tokens":27800,"pending_prefill_tokens":7737,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":36301,"score_linear":68817.0,"score_lmetric":132114},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":17408,"new_prefill":18893,"score_linear":151216.0,"score_lmetric":418167},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":36301,"score_linear":76969.0,"score_lmetric":109686},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":36301,"score_linear":159566.0,"score_lmetric":216303}],"chosen_score_linear":132734.0,"chosen_score_lmetric":5018,"t_first_token":384095.152157102,"t_first_token_unix":1779814960.1661007,"t_done":384097.934030543,"t_done_unix":1779814962.947974},{"request_id":"1364128:2:1367249:565","session_id":"1364128","input_length":9095,"t_proxy_recv":384096.818938683,"t_decision_unix":1779814961.8328795,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9570093457943926,"affinity_num_requests":3,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":391,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":9095,"score_linear":172080.0,"score_lmetric":263022},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":7039,"num_requests":1,"active_p_offloads":0,"cached_blocks":895,"cache_hit":6656,"new_prefill":2439,"score_linear":12159.0,"score_lmetric":9478},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":149381,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":9095,"score_linear":136960.0,"score_lmetric":27285},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202827,"ongoing_decode_tokens":202827,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":8704,"new_prefill":391,"score_linear":194123.0,"score_lmetric":1173},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":54001,"pending_prefill_tokens":4659,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":9095,"score_linear":69412.0,"score_lmetric":41262},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":9095,"score_linear":168624.0,"score_lmetric":388773},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":9095,"score_linear":76969.0,"score_lmetric":82480},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":9095,"score_linear":159566.0,"score_lmetric":27285}],"chosen_score_linear":194123.0,"chosen_score_lmetric":1173,"t_first_token":384096.920125642,"t_first_token_unix":1779814961.9340694,"t_done":384098.037086118,"t_done_unix":1779814963.0510309},{"request_id":"1366128:2:1367220:563","session_id":"1366128","input_length":15411,"t_proxy_recv":384096.725076668,"t_decision_unix":1779814961.739018,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":10752,"affinity_cache_ratio":0.6976834728440724,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":4659,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":15411,"score_linear":122597.0,"score_lmetric":136984},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":7039,"num_requests":1,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":15411,"score_linear":18815.0,"score_lmetric":22450},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":149381,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":15411,"score_linear":136960.0,"score_lmetric":46233},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202827,"ongoing_decode_tokens":202827,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":15411,"score_linear":202827.0,"score_lmetric":46233},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":54001,"ongoing_decode_tokens":54001,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":10752,"new_prefill":4659,"score_linear":43249.0,"score_lmetric":9318},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":15411,"score_linear":168624.0,"score_lmetric":407721},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":15411,"score_linear":76969.0,"score_lmetric":88796},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":15411,"score_linear":159566.0,"score_lmetric":46233}],"chosen_score_linear":43249.0,"chosen_score_lmetric":9318,"t_first_token":384097.279500627,"t_first_token_unix":1779814962.2934444,"t_done":384098.574165902,"t_done_unix":1779814963.588109},{"request_id":"1357132:4:1367654:570","session_id":"1357132","input_length":14949,"t_proxy_recv":384098.123881065,"t_decision_unix":1779814963.1378226,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9589939126362967,"affinity_num_requests":3,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":613,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":14949,"score_linear":172080.0,"score_lmetric":274730},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":42698,"ongoing_decode_tokens":18815,"pending_prefill_tokens":15179,"num_requests":3,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":14949,"score_linear":42698.0,"score_lmetric":90384},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":14949,"score_linear":135704.0,"score_lmetric":125358},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":14949,"score_linear":98267.0,"score_lmetric":14949},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":69412,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":14336,"new_prefill":613,"score_linear":55076.0,"score_lmetric":1839},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":14949,"score_linear":168624.0,"score_lmetric":406335},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":76969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":14949,"score_linear":76969.0,"score_lmetric":14949},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":14949,"score_linear":159566.0,"score_lmetric":44847}],"chosen_score_linear":55076.0,"chosen_score_lmetric":1839,"t_first_token":384098.203484196,"t_first_token_unix":1779814963.2174275,"t_done":384098.623479879,"t_done_unix":1779814963.6374228},{"request_id":"1361694:1:1361694:534","session_id":"1361694","input_length":76969,"t_proxy_recv":384077.443160309,"t_decision_unix":1779814942.4571018,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":73385,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":76969,"score_linear":122597.0,"score_lmetric":198542},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":76969,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":25430,"ongoing_decode_tokens":37851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":76969,"score_linear":25430.0,"score_lmetric":76969},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":76969,"score_linear":68259.0,"score_lmetric":76969},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":99510,"ongoing_decode_tokens":0,"pending_prefill_tokens":32438,"num_requests":2,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":76969,"score_linear":99510.0,"score_lmetric":218814},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":76969,"score_linear":152567.0,"score_lmetric":390464},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":3584,"new_prefill":73385,"score_linear":-3584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":158497,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":76969,"score_linear":158497.0,"score_lmetric":230907}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":384097.717804768,"t_first_token_unix":1779814962.7317486,"t_done":384098.758515904,"t_done_unix":1779814963.7724597},{"request_id":"1270340:4:1366608:558","session_id":"1270340","input_length":41017,"t_proxy_recv":384094.417585385,"t_decision_unix":1779814959.4315267,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33280,"affinity_cache_ratio":0.8113708949947582,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":7737,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":41017,"score_linear":122597.0,"score_lmetric":162590},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":41017,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":41017,"score_linear":136960.0,"score_lmetric":318153},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166526,"ongoing_decode_tokens":166526,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":41017,"score_linear":166526.0,"score_lmetric":82034},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27800,"ongoing_decode_tokens":27800,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":33280,"new_prefill":7737,"score_linear":-5480.0,"score_lmetric":15474},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":41017,"score_linear":168624.0,"score_lmetric":484539},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":41017,"score_linear":76969.0,"score_lmetric":114402},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":28160,"new_prefill":12857,"score_linear":131406.0,"score_lmetric":145971}],"chosen_score_linear":-5480.0,"chosen_score_lmetric":15474,"t_first_token":384096.354322916,"t_first_token_unix":1779814961.3682668,"t_done":384098.761159059,"t_done_unix":1779814963.7751021},{"request_id":"1362265:2:1367373:568","session_id":"1362265","input_length":10134,"t_proxy_recv":384097.227633631,"t_decision_unix":1779814962.2415748,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8704,"affinity_cache_ratio":0.8588908624432603,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":1430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":10134,"score_linear":172080.0,"score_lmetric":265100},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32564,"ongoing_decode_tokens":0,"pending_prefill_tokens":20788,"num_requests":2,"active_p_offloads":0,"cached_blocks":895,"cache_hit":8704,"new_prefill":1430,"score_linear":23860.0,"score_lmetric":44436},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":10134,"score_linear":135704.0,"score_lmetric":110913},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":211922,"ongoing_decode_tokens":211922,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":6656,"new_prefill":3478,"score_linear":205266.0,"score_lmetric":13912},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":54001,"pending_prefill_tokens":4659,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":10134,"score_linear":69412.0,"score_lmetric":44379},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":10134,"score_linear":168624.0,"score_lmetric":391890},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":10134,"score_linear":76969.0,"score_lmetric":83519},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":10134,"score_linear":159566.0,"score_lmetric":30402}],"chosen_score_linear":23860.0,"chosen_score_lmetric":44436,"t_first_token":384098.765418164,"t_first_token_unix":1779814963.7793612,"t_done":384099.061523637,"t_done_unix":1779814964.0754673},{"request_id":"1363943:2:1366428:556","session_id":"1363943","input_length":12984,"t_proxy_recv":384093.798751106,"t_decision_unix":1779814958.8126924,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":12800,"affinity_cache_ratio":0.9858287122612446,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":8704,"new_prefill":4280,"score_linear":113893.0,"score_lmetric":125853},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":4096,"new_prefill":8888,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":4096,"new_prefill":8888,"score_linear":132864.0,"score_lmetric":221766},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166526,"ongoing_decode_tokens":166526,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":12984,"score_linear":166526.0,"score_lmetric":25968},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":11154,"ongoing_decode_tokens":11154,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1391,"cache_hit":12800,"new_prefill":184,"score_linear":-1646.0,"score_lmetric":184},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":4096,"new_prefill":8888,"score_linear":164528.0,"score_lmetric":388152},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":4096,"new_prefill":8888,"score_linear":72873.0,"score_lmetric":82273},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":4096,"new_prefill":8888,"score_linear":155470.0,"score_lmetric":134064}],"chosen_score_linear":-1646.0,"chosen_score_lmetric":184,"t_first_token":384093.860651983,"t_first_token_unix":1779814958.8745956,"t_done":384099.141101118,"t_done_unix":1779814964.1550446},{"request_id":"1355484:4:1364784:548","session_id":"1355484","input_length":19806,"t_proxy_recv":384087.980022776,"t_decision_unix":1779814952.993964,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9823285872967787,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":350,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":19806,"score_linear":122597.0,"score_lmetric":141379},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":13897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":19806,"score_linear":13897.0,"score_lmetric":19806},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":19806,"score_linear":136960.0,"score_lmetric":254520},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":175003,"ongoing_decode_tokens":175003,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":7006,"score_linear":162203.0,"score_lmetric":21018},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1384,"cache_hit":0,"new_prefill":19806,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":19806,"score_linear":168624.0,"score_lmetric":420906},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":19806,"score_linear":76969.0,"score_lmetric":93191},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139760,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":19456,"new_prefill":350,"score_linear":120304.0,"score_lmetric":71600}],"chosen_score_linear":120304.0,"chosen_score_lmetric":71600,"t_first_token":384096.28022233,"t_first_token_unix":1779814961.2941656,"t_done":384099.146143073,"t_done_unix":1779814964.1600862},{"request_id":"1367312:1:1367312:566","session_id":"1367312","input_length":13749,"t_proxy_recv":384097.021437886,"t_decision_unix":1779814962.0353792,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.5,"fallback_score":20788,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":13749,"score_linear":172080.0,"score_lmetric":272330},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":7039,"num_requests":1,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":13749,"score_linear":18815.0,"score_lmetric":20788},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":149381,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":13749,"score_linear":136960.0,"score_lmetric":41247},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":211922,"ongoing_decode_tokens":211922,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":13749,"score_linear":211922.0,"score_lmetric":54996},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":54001,"pending_prefill_tokens":4659,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":13749,"score_linear":69412.0,"score_lmetric":55224},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":13749,"score_linear":168624.0,"score_lmetric":402735},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":13749,"score_linear":76969.0,"score_lmetric":87134},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":13749,"score_linear":159566.0,"score_lmetric":41247}],"chosen_score_linear":18815.0,"chosen_score_lmetric":20788,"t_first_token":384098.763528927,"t_first_token_unix":1779814963.7774723,"t_done":384099.258839334,"t_done_unix":1779814964.2727826},{"request_id":"1355484:5:1366753:560","session_id":"1355484","input_length":20026,"t_proxy_recv":384099.150879285,"t_decision_unix":1779814964.1648207,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19968,"affinity_cache_ratio":0.997103765105363,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":58,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":20026,"score_linear":172080.0,"score_lmetric":284884},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32564,"ongoing_decode_tokens":32564,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":20026,"score_linear":32564.0,"score_lmetric":40052},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":20026,"score_linear":135704.0,"score_lmetric":140589},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":12800,"new_prefill":7226,"score_linear":85467.0,"score_lmetric":7226},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":20026,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":20026,"score_linear":168624.0,"score_lmetric":421566},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":20026,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139760,"ongoing_decode_tokens":139760,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":19968,"new_prefill":58,"score_linear":119792.0,"score_lmetric":116}],"chosen_score_linear":119792.0,"chosen_score_lmetric":116,"t_first_token":384099.24573703,"t_first_token_unix":1779814964.2596803,"t_done":384100.154462263,"t_done_unix":1779814965.168408},{"request_id":"1367312:2:1368064:574","session_id":"1367312","input_length":15501,"t_proxy_recv":384099.717957194,"t_decision_unix":1779814964.7318983,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":13312,"affinity_cache_ratio":0.8587833043029482,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":2189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":15501,"score_linear":172080.0,"score_lmetric":275834},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":923,"cache_hit":13312,"new_prefill":2189,"score_linear":5503.0,"score_lmetric":2189},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":15501,"score_linear":135704.0,"score_lmetric":127014},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":15501,"score_linear":98267.0,"score_lmetric":15501},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72919,"ongoing_decode_tokens":0,"pending_prefill_tokens":72919,"num_requests":1,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":15501,"score_linear":72919.0,"score_lmetric":88420},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":15501,"score_linear":168624.0,"score_lmetric":407991},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":15501,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159786,"ongoing_decode_tokens":159786,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":15501,"score_linear":159786.0,"score_lmetric":46503}],"chosen_score_linear":5503.0,"chosen_score_lmetric":2189,"t_first_token":384099.990939665,"t_first_token_unix":1779814965.0048833,"t_done":384100.418814623,"t_done_unix":1779814965.4327579},{"request_id":"1367169:1:1367169:562","session_id":"1367169","input_length":18815,"t_proxy_recv":384096.538577668,"t_decision_unix":1779814961.5525186,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":7039,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":18815,"score_linear":122597.0,"score_lmetric":140388},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":11776,"new_prefill":7039,"score_linear":-11776.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":18815,"score_linear":136960.0,"score_lmetric":251547},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202827,"ongoing_decode_tokens":202827,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":18815,"score_linear":202827.0,"score_lmetric":56445},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":54001,"ongoing_decode_tokens":54001,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":18815,"score_linear":54001.0,"score_lmetric":37630},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":18815,"score_linear":168624.0,"score_lmetric":417933},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":11776,"new_prefill":7039,"score_linear":65193.0,"score_lmetric":80424},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":18815,"score_linear":159566.0,"score_lmetric":56445}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":384097.492036986,"t_first_token_unix":1779814962.5059805,"t_done":384100.735597195,"t_done_unix":1779814965.7495406},{"request_id":"1363093:1:1363093:538","session_id":"1363093","input_length":62685,"t_proxy_recv":384082.183916816,"t_decision_unix":1779814947.197858,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":62685,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":62685,"score_linear":122597.0,"score_lmetric":184258},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":62685,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":62685,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":62685,"score_linear":68259.0,"score_lmetric":62685},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":62685,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":62685,"score_linear":152567.0,"score_lmetric":361896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":62685,"score_linear":76969.0,"score_lmetric":136070},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":62685,"score_linear":139004.0,"score_lmetric":125370}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384096.608690478,"t_first_token_unix":1779814961.622634,"t_done":384101.236090191,"t_done_unix":1779814966.2500336},{"request_id":"1355951:2:1363365:540","session_id":"1355951","input_length":37232,"t_proxy_recv":384083.207552497,"t_decision_unix":1779814948.2214937,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9488611946712505,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":1904,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":37232,"score_linear":122597.0,"score_lmetric":158805},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":37232,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":71635,"ongoing_decode_tokens":21371,"pending_prefill_tokens":62685,"num_requests":1,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":35328,"new_prefill":1904,"score_linear":36307.0,"score_lmetric":64589},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":37232,"score_linear":68259.0,"score_lmetric":37232},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":37232,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":37232,"score_linear":168624.0,"score_lmetric":473184},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":37232,"score_linear":76969.0,"score_lmetric":110617},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":37232,"score_linear":139004.0,"score_lmetric":74464}],"chosen_score_linear":36307.0,"chosen_score_lmetric":64589,"t_first_token":384096.610154761,"t_first_token_unix":1779814961.624099,"t_done":384101.591189132,"t_done_unix":1779814966.6051333},{"request_id":"1364960:2:1368239:578","session_id":"1364960","input_length":7048,"t_proxy_recv":384100.31789861,"t_decision_unix":1779814965.3318398,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":7,"affinity_cache_hit":2048,"affinity_cache_ratio":0.2905788876276958,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":14096,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7048,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":7048,"score_linear":172080.0,"score_lmetric":258928},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34316,"ongoing_decode_tokens":34316,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":923,"cache_hit":0,"new_prefill":7048,"score_linear":34316.0,"score_lmetric":14096},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":7048,"score_linear":135704.0,"score_lmetric":101655},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107112,"ongoing_decode_tokens":98267,"pending_prefill_tokens":2189,"num_requests":2,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":7048,"score_linear":107112.0,"score_lmetric":18474},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72919,"ongoing_decode_tokens":0,"pending_prefill_tokens":72919,"num_requests":1,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":2048,"new_prefill":5000,"score_linear":70871.0,"score_lmetric":77919},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":7048,"score_linear":168624.0,"score_lmetric":382632},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21773,"ongoing_decode_tokens":0,"pending_prefill_tokens":21773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":7048,"score_linear":21773.0,"score_lmetric":28821},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139760,"ongoing_decode_tokens":139760,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":7048,"score_linear":139760.0,"score_lmetric":14096}],"chosen_score_linear":139760.0,"chosen_score_lmetric":14096,"t_first_token":384100.813911219,"t_first_token_unix":1779814965.8278553,"t_done":384101.641085131,"t_done_unix":1779814966.6550286},{"request_id":"1367329:1:1367329:567","session_id":"1367329","input_length":26837,"t_proxy_recv":384097.083705411,"t_decision_unix":1779814962.097647,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":80511,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":26837,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":26837,"score_linear":172080.0,"score_lmetric":298506},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32564,"ongoing_decode_tokens":0,"pending_prefill_tokens":20788,"num_requests":2,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":26837,"score_linear":32564.0,"score_lmetric":95250},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":149381,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":26837,"score_linear":136960.0,"score_lmetric":80511},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":211922,"ongoing_decode_tokens":211922,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":26837,"score_linear":211922.0,"score_lmetric":107348},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":54001,"pending_prefill_tokens":4659,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":26837,"score_linear":69412.0,"score_lmetric":94488},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":26837,"score_linear":168624.0,"score_lmetric":441999},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":26837,"score_linear":76969.0,"score_lmetric":100222},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":26837,"score_linear":159566.0,"score_lmetric":80511}],"chosen_score_linear":136960.0,"chosen_score_lmetric":80511,"t_first_token":384100.427727238,"t_first_token_unix":1779814965.4416707,"t_done":384101.869842992,"t_done_unix":1779814966.8837864},{"request_id":"1368070:1:1368070:575","session_id":"1368070","input_length":21773,"t_proxy_recv":384099.742735682,"t_decision_unix":1779814964.7566772,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21773,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":21773,"score_linear":172080.0,"score_lmetric":288378},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34316,"ongoing_decode_tokens":18815,"pending_prefill_tokens":2189,"num_requests":2,"active_p_offloads":0,"cached_blocks":923,"cache_hit":0,"new_prefill":21773,"score_linear":34316.0,"score_lmetric":47924},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":21773,"score_linear":135704.0,"score_lmetric":145830},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":21773,"score_linear":98267.0,"score_lmetric":21773},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72919,"ongoing_decode_tokens":0,"pending_prefill_tokens":72919,"num_requests":1,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":21773,"score_linear":72919.0,"score_lmetric":94692},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":21773,"score_linear":168624.0,"score_lmetric":426807},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":21773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159786,"ongoing_decode_tokens":159786,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":21773,"score_linear":159786.0,"score_lmetric":65319}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384102.094455825,"t_first_token_unix":1779814967.1083994,"t_done":384102.231034399,"t_done_unix":1779814967.2449784},{"request_id":"1313181:3:1364311:547","session_id":"1313181","input_length":59514,"t_proxy_recv":384086.283284542,"t_decision_unix":1779814951.2972257,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24064,"affinity_cache_ratio":0.4043418355344961,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":35450,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":35450,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":59514,"score_linear":122597.0,"score_lmetric":181087},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13897,"ongoing_decode_tokens":0,"pending_prefill_tokens":13897,"num_requests":1,"active_p_offloads":0,"cached_blocks":842,"cache_hit":0,"new_prefill":59514,"score_linear":13897.0,"score_lmetric":73411},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":59514,"score_linear":136960.0,"score_lmetric":373644},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":175003,"ongoing_decode_tokens":68259,"pending_prefill_tokens":8952,"num_requests":3,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":12800,"new_prefill":46714,"score_linear":162203.0,"score_lmetric":166998},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":12636,"ongoing_decode_tokens":12636,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":59514,"score_linear":12636.0,"score_lmetric":59514},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":59514,"score_linear":168624.0,"score_lmetric":540030},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":59514,"score_linear":76969.0,"score_lmetric":132899},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":24064,"new_prefill":35450,"score_linear":56182.0,"score_lmetric":35450}],"chosen_score_linear":56182.0,"chosen_score_lmetric":35450,"t_first_token":384096.279078591,"t_first_token_unix":1779814961.2930224,"t_done":384103.428773616,"t_done_unix":1779814968.4427176},{"request_id":"1363093:2:1368700:580","session_id":"1363093","input_length":63235,"t_proxy_recv":384101.903130399,"t_decision_unix":1779814966.9170716,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":62464,"affinity_cache_ratio":0.9878073851506286,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":63235,"score_linear":172080.0,"score_lmetric":371302},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":63235,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1910,"cache_hit":62464,"new_prefill":771,"score_linear":-53514.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107112,"ongoing_decode_tokens":107112,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":63235,"score_linear":107112.0,"score_lmetric":126470},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88790,"ongoing_decode_tokens":0,"pending_prefill_tokens":73942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":63235,"score_linear":88790.0,"score_lmetric":274354},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":63235,"score_linear":168624.0,"score_lmetric":551193},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21773,"ongoing_decode_tokens":0,"pending_prefill_tokens":21773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":63235,"score_linear":21773.0,"score_lmetric":85008},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139760,"ongoing_decode_tokens":139760,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":63235,"score_linear":139760.0,"score_lmetric":126470}],"chosen_score_linear":-53514.0,"chosen_score_lmetric":0,"t_first_token":384102.237881453,"t_first_token_unix":1779814967.2518246,"t_done":384104.010799707,"t_done_unix":1779814969.024744},{"request_id":"1368132:1:1368132:577","session_id":"1368132","input_length":8845,"t_proxy_recv":384100.018192626,"t_decision_unix":1779814965.032134,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":2189,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":2189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":8845,"score_linear":172080.0,"score_lmetric":262522},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":34316,"ongoing_decode_tokens":34316,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":923,"cache_hit":6656,"new_prefill":2189,"score_linear":27660.0,"score_lmetric":4378},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":8845,"score_linear":135704.0,"score_lmetric":107046},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":6656,"new_prefill":2189,"score_linear":91611.0,"score_lmetric":2189},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72919,"ongoing_decode_tokens":0,"pending_prefill_tokens":72919,"num_requests":1,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":8845,"score_linear":72919.0,"score_lmetric":81764},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":8845,"score_linear":168624.0,"score_lmetric":388023},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21773,"ongoing_decode_tokens":0,"pending_prefill_tokens":21773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":8845,"score_linear":21773.0,"score_lmetric":30618},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159786,"ongoing_decode_tokens":159786,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":8845,"score_linear":159786.0,"score_lmetric":26535}],"chosen_score_linear":91611.0,"chosen_score_lmetric":2189,"t_first_token":384100.322388651,"t_first_token_unix":1779814965.336332,"t_done":384104.063528893,"t_done_unix":1779814969.0774722},{"request_id":"1369172:1:1369172:581","session_id":"1369172","input_length":6345,"t_proxy_recv":384103.584455935,"t_decision_unix":1779814968.5983975,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6345,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":6345,"score_linear":172080.0,"score_lmetric":257522},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":6345,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":72185,"ongoing_decode_tokens":84606,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1910,"cache_hit":0,"new_prefill":6345,"score_linear":72185.0,"score_lmetric":6345},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107112,"ongoing_decode_tokens":107112,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":6345,"score_linear":107112.0,"score_lmetric":12690},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88790,"ongoing_decode_tokens":0,"pending_prefill_tokens":73942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":6345,"score_linear":88790.0,"score_lmetric":160574},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":6345,"score_linear":168624.0,"score_lmetric":380523},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":6345,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":122950,"ongoing_decode_tokens":122950,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":6345,"score_linear":122950.0,"score_lmetric":12690}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384104.001311123,"t_first_token_unix":1779814969.015255,"t_done":384104.24077146,"t_done_unix":1779814969.2547147},{"request_id":"1313181:4:1318843:342","session_id":"1313181","input_length":42704,"t_proxy_recv":384103.443801374,"t_decision_unix":1779814968.457743,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":42496,"affinity_cache_ratio":0.9951292618958412,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":208,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":42704,"score_linear":172080.0,"score_lmetric":330240},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":42704,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":72185,"ongoing_decode_tokens":84606,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1910,"cache_hit":0,"new_prefill":42704,"score_linear":72185.0,"score_lmetric":42704},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107112,"ongoing_decode_tokens":107112,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":12800,"new_prefill":29904,"score_linear":94312.0,"score_lmetric":59808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88790,"ongoing_decode_tokens":0,"pending_prefill_tokens":73942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":42704,"score_linear":88790.0,"score_lmetric":233292},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":42704,"score_linear":168624.0,"score_lmetric":489600},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":42704,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":42496,"new_prefill":208,"score_linear":37750.0,"score_lmetric":208}],"chosen_score_linear":37750.0,"chosen_score_lmetric":208,"t_first_token":384103.527139841,"t_first_token_unix":1779814968.5410836,"t_done":384104.728956059,"t_done_unix":1779814969.7428997},{"request_id":"1369768:1:1369768:584","session_id":"1369768","input_length":7712,"t_proxy_recv":384105.593655273,"t_decision_unix":1779814970.6075969,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7712,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":7712,"score_linear":172080.0,"score_lmetric":260256},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":7712,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":7712,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":7712,"score_linear":98267.0,"score_lmetric":7712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":106950,"ongoing_decode_tokens":0,"pending_prefill_tokens":79302,"num_requests":3,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":7712,"score_linear":106950.0,"score_lmetric":261042},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":7712,"score_linear":168624.0,"score_lmetric":384624},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":7712,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":7712,"score_linear":160408.0,"score_lmetric":76230}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384106.125737522,"t_first_token_unix":1779814971.139681,"t_done":384106.240679982,"t_done_unix":1779814971.2546237},{"request_id":"1367424:2:1370211:588","session_id":"1367424","input_length":11133,"t_proxy_recv":384107.064274152,"t_decision_unix":1779814972.0782156,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":3072,"affinity_cache_ratio":0.27593640528159524,"affinity_num_requests":4,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11133,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":11133,"score_linear":172080.0,"score_lmetric":267098},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":10621,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":11133,"score_linear":18301.0,"score_lmetric":21754},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":11133,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":11133,"score_linear":98267.0,"score_lmetric":11133},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":3072,"new_prefill":8061,"score_linear":127185.0,"score_lmetric":381240},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":11133,"score_linear":168624.0,"score_lmetric":394887},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":11133,"score_linear":29501.0,"score_lmetric":19130},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":11133,"score_linear":160408.0,"score_lmetric":86493}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384107.955716207,"t_first_token_unix":1779814972.9696598,"t_done":384108.057238801,"t_done_unix":1779814973.071182},{"request_id":"1370269:1:1370269:591","session_id":"1370269","input_length":2381,"t_proxy_recv":384107.321346264,"t_decision_unix":1779814972.335288,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":2381,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":2381,"score_linear":172080.0,"score_lmetric":249594},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":10621,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":2381,"score_linear":18301.0,"score_lmetric":13002},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":20083,"ongoing_decode_tokens":21371,"pending_prefill_tokens":11133,"num_requests":1,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":2381,"score_linear":20083.0,"score_lmetric":13514},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":2381,"score_linear":98267.0,"score_lmetric":2381},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":2381,"score_linear":130257.0,"score_lmetric":358520},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":2381,"score_linear":168624.0,"score_lmetric":368631},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":0,"pending_prefill_tokens":13648,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":2381,"score_linear":94032.0,"score_lmetric":32058},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":2381,"score_linear":160408.0,"score_lmetric":60237}],"chosen_score_linear":98267.0,"chosen_score_lmetric":2381,"t_first_token":384107.635712288,"t_first_token_unix":1779814972.6496553,"t_done":384108.641056854,"t_done_unix":1779814973.655},{"request_id":"1370466:1:1370466:592","session_id":"1370466","input_length":7710,"t_proxy_recv":384108.11108409,"t_decision_unix":1779814973.1250255,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":7710,"score_linear":172080.0,"score_lmetric":260252},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":10621,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":7710,"score_linear":18301.0,"score_lmetric":18331},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1932,"cache_hit":0,"new_prefill":7710,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":100648,"ongoing_decode_tokens":100648,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":7710,"score_linear":100648.0,"score_lmetric":15420},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":7710,"score_linear":130257.0,"score_lmetric":379836},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":7710,"score_linear":168624.0,"score_lmetric":384618},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":0,"pending_prefill_tokens":13648,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":7710,"score_linear":94032.0,"score_lmetric":42716},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":7710,"score_linear":160408.0,"score_lmetric":76224}],"chosen_score_linear":8950.0,"chosen_score_lmetric":0,"t_first_token":384108.643270196,"t_first_token_unix":1779814973.6572132,"t_done":384108.823595254,"t_done_unix":1779814973.8375385},{"request_id":"1336620:3:1339999:443","session_id":"1336620","input_length":21371,"t_proxy_recv":384001.500874553,"t_decision_unix":1779814866.5148158,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.6947732909082401,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":6523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":7680,"new_prefill":13691,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":806,"cache_hit":0,"new_prefill":21371,"score_linear":62618.0,"score_lmetric":21371},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-5356,"ongoing_decode_tokens":7065,"pending_prefill_tokens":-12421,"num_requests":0,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":14848,"new_prefill":6523,"score_linear":-20204.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":161695,"ongoing_decode_tokens":66152,"pending_prefill_tokens":311,"num_requests":2,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":21371,"score_linear":161695.0,"score_lmetric":43364},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":21371,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":7680,"new_prefill":13691,"score_linear":47450.0,"score_lmetric":13691},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120144,"ongoing_decode_tokens":120144,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":7680,"new_prefill":13691,"score_linear":112464.0,"score_lmetric":41073},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":21371,"score_linear":13816.0,"score_lmetric":35187}],"chosen_score_linear":-20204.0,"chosen_score_lmetric":0,"t_first_token":384002.484312937,"t_first_token_unix":1779814867.4982574,"t_done":384109.062799746,"t_done_unix":1779814974.0767434},{"request_id":"1277428:6:1371101:593","session_id":"1277428","input_length":36583,"t_proxy_recv":384110.147903483,"t_decision_unix":1779814975.1618445,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9936855916682612,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":231,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":172080,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":36583,"score_linear":172080.0,"score_lmetric":73166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":4608,"new_prefill":31975,"score_linear":13693.0,"score_lmetric":31975},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":36583,"score_linear":-12421.0,"score_lmetric":-36583},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":36352,"new_prefill":231,"score_linear":61915.0,"score_lmetric":231},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":36583,"score_linear":130257.0,"score_lmetric":495328},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":17408,"new_prefill":19175,"score_linear":151216.0,"score_lmetric":419013},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":29501,"pending_prefill_tokens":5651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":36583,"score_linear":94032.0,"score_lmetric":84468},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":36583,"score_linear":160408.0,"score_lmetric":162843}],"chosen_score_linear":61915.0,"chosen_score_lmetric":231,"t_first_token":384110.314925292,"t_first_token_unix":1779814975.3288693,"t_done":384110.926137895,"t_done_unix":1779814975.9400842},{"request_id":"1370129:1:1370129:587","session_id":"1370129","input_length":18301,"t_proxy_recv":384106.842965376,"t_decision_unix":1779814971.8569067,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":7680,"estimated_new_tokens":10621,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":7680,"new_prefill":10621,"score_linear":164400.0,"score_lmetric":266074},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":7680,"new_prefill":10621,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":7680,"new_prefill":10621,"score_linear":1270.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":18301,"score_linear":98267.0,"score_lmetric":18301},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":4096,"new_prefill":14205,"score_linear":126161.0,"score_lmetric":405816},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":7680,"new_prefill":10621,"score_linear":160944.0,"score_lmetric":393351},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":7680,"new_prefill":10621,"score_linear":21821.0,"score_lmetric":18618},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":7680,"new_prefill":10621,"score_linear":152728.0,"score_lmetric":84957}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":384108.138275824,"t_first_token_unix":1779814973.1522188,"t_done":384111.187859047,"t_done_unix":1779814976.2018025},{"request_id":"1356885:1:1356885:514","session_id":"1356885","input_length":122597,"t_proxy_recv":384060.347656684,"t_decision_unix":1779814925.3615983,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":121573,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":1024,"new_prefill":121573,"score_linear":-1024.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":122597,"score_linear":48193.0,"score_lmetric":122597},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44258,"ongoing_decode_tokens":21371,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":122597,"score_linear":44258.0,"score_lmetric":157905},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":122597,"score_linear":68259.0,"score_lmetric":122597},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1270,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1060,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":6656,"new_prefill":115941,"score_linear":76870.0,"score_lmetric":199467},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":384108.523518046,"t_first_token_unix":1779814973.537462,"t_done":384111.251405443,"t_done_unix":1779814976.2653491},{"request_id":"1355484:6:1369697:583","session_id":"1355484","input_length":20158,"t_proxy_recv":384105.368249387,"t_decision_unix":1779814970.3821907,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9905744617521579,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":20158,"score_linear":172080.0,"score_lmetric":285148},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":20158,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":20158,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":12800,"new_prefill":7358,"score_linear":85467.0,"score_lmetric":7358},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":106950,"ongoing_decode_tokens":0,"pending_prefill_tokens":79302,"num_requests":3,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":20158,"score_linear":106950.0,"score_lmetric":298380},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":20158,"score_linear":168624.0,"score_lmetric":421962},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":20158,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17508,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":19968,"new_prefill":190,"score_linear":120282.0,"score_lmetric":35396}],"chosen_score_linear":120282.0,"chosen_score_lmetric":35396,"t_first_token":384110.621797702,"t_first_token_unix":1779814975.6357408,"t_done":384111.998273809,"t_done_unix":1779814977.012217},{"request_id":"1368070:2:1370108:586","session_id":"1368070","input_length":29501,"t_proxy_recv":384106.771801882,"t_decision_unix":1779814971.7857428,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":21504,"affinity_cache_ratio":0.7289244432392122,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":7997,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":29501,"score_linear":172080.0,"score_lmetric":303834},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":29501,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":29501,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":29501,"score_linear":98267.0,"score_lmetric":29501},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":29501,"score_linear":130257.0,"score_lmetric":467000},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":29501,"score_linear":168624.0,"score_lmetric":449991},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":21504,"new_prefill":7997,"score_linear":-21504.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":29501,"score_linear":160408.0,"score_lmetric":141597}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":384108.273352047,"t_first_token_unix":1779814973.2872956,"t_done":384112.104742776,"t_done_unix":1779814977.1186862},{"request_id":"1340278:2:1367225:564","session_id":"1340278","input_length":49483,"t_proxy_recv":384096.773816914,"t_decision_unix":1779814961.787758,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9829638461693915,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":843,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":48640,"new_prefill":843,"score_linear":73957.0,"score_lmetric":122416},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":7039,"num_requests":1,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":49483,"score_linear":18815.0,"score_lmetric":56522},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":149381,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":49483,"score_linear":136960.0,"score_lmetric":148449},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202827,"ongoing_decode_tokens":202827,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":0,"new_prefill":49483,"score_linear":202827.0,"score_lmetric":148449},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":69412,"ongoing_decode_tokens":54001,"pending_prefill_tokens":4659,"num_requests":3,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":49483,"score_linear":69412.0,"score_lmetric":162426},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":49483,"score_linear":168624.0,"score_lmetric":509937},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":49483,"score_linear":76969.0,"score_lmetric":122868},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":159566,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":49483,"score_linear":159566.0,"score_lmetric":148449}],"chosen_score_linear":73957.0,"chosen_score_lmetric":122416,"t_first_token":384108.525909958,"t_first_token_unix":1779814973.5398533,"t_done":384112.666887451,"t_done_unix":1779814977.6808307},{"request_id":"1342634:2:1370263:590","session_id":"1342634","input_length":64531,"t_proxy_recv":384107.304077044,"t_decision_unix":1779814972.3180187,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9124296849576172,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":5651,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":64531,"score_linear":172080.0,"score_lmetric":373894},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":10621,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":64531,"score_linear":18301.0,"score_lmetric":75152},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":20083,"ongoing_decode_tokens":21371,"pending_prefill_tokens":11133,"num_requests":1,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":64531,"score_linear":20083.0,"score_lmetric":75664},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":64531,"score_linear":98267.0,"score_lmetric":64531},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":64531,"score_linear":130257.0,"score_lmetric":607120},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":64531,"score_linear":168624.0,"score_lmetric":555081},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":58880,"new_prefill":5651,"score_linear":-29379.0,"score_lmetric":13648},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":64531,"score_linear":160408.0,"score_lmetric":246687}],"chosen_score_linear":-29379.0,"chosen_score_lmetric":13648,"t_first_token":384111.911222919,"t_first_token_unix":1779814976.9251664,"t_done":384112.796305364,"t_done_unix":1779814977.8102489},{"request_id":"1340278:3:1368072:576","session_id":"1340278","input_length":50124,"t_proxy_recv":384112.695896901,"t_decision_unix":1779814977.7098386,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9908227595563004,"affinity_num_requests":0,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":49664,"new_prefill":460,"score_linear":-49664.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":40321,"ongoing_decode_tokens":0,"pending_prefill_tokens":25985,"num_requests":2,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":50124,"score_linear":40321.0,"score_lmetric":152218},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29792,"ongoing_decode_tokens":42213,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":50124,"score_linear":29792.0,"score_lmetric":50124},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":50124,"score_linear":98267.0,"score_lmetric":50124},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":50124,"score_linear":130257.0,"score_lmetric":549492},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":50124,"score_linear":168624.0,"score_lmetric":511860},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64531,"ongoing_decode_tokens":64531,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1889,"cache_hit":0,"new_prefill":50124,"score_linear":64531.0,"score_lmetric":50124},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":163242,"ongoing_decode_tokens":163242,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":50124,"score_linear":163242.0,"score_lmetric":150372}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":384112.876527301,"t_first_token_unix":1779814977.890471,"t_done":384112.904352994,"t_done_unix":1779814977.9182966},{"request_id":"1371337:1:1371337:597","session_id":"1371337","input_length":9399,"t_proxy_recv":384110.981653223,"t_decision_unix":1779814975.9955947,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":172080,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":9399,"score_linear":172080.0,"score_lmetric":18798},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":9399,"score_linear":18301.0,"score_lmetric":9399},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":20393,"ongoing_decode_tokens":0,"pending_prefill_tokens":6190,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":9399,"score_linear":20393.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":9399,"score_linear":98267.0,"score_lmetric":9399},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":9399,"score_linear":130257.0,"score_lmetric":386592},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":9399,"score_linear":168624.0,"score_lmetric":389685},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":29501,"pending_prefill_tokens":5651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":9399,"score_linear":94032.0,"score_lmetric":30100},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":160408,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":9399,"score_linear":160408.0,"score_lmetric":28197}],"chosen_score_linear":20393.0,"chosen_score_lmetric":0,"t_first_token":384112.530564827,"t_first_token_unix":1779814977.5445087,"t_done":384113.343399207,"t_done_unix":1779814978.3573425},{"request_id":"1367329:2:1371226:595","session_id":"1367329","input_length":32814,"t_proxy_recv":384110.552639572,"t_decision_unix":1779814975.5665805,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8113610044493205,"affinity_num_requests":-1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":6190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":172080,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":32814,"score_linear":172080.0,"score_lmetric":65628},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":32814,"score_linear":18301.0,"score_lmetric":32814},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":26624,"new_prefill":6190,"score_linear":-39045.0,"score_lmetric":-6190},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":134850,"ongoing_decode_tokens":134850,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":32814,"score_linear":134850.0,"score_lmetric":65628},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":32814,"score_linear":130257.0,"score_lmetric":480252},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":32814,"score_linear":168624.0,"score_lmetric":459930},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":29501,"pending_prefill_tokens":5651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":32814,"score_linear":94032.0,"score_lmetric":76930},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":32814,"score_linear":160408.0,"score_lmetric":151536}],"chosen_score_linear":-39045.0,"chosen_score_lmetric":-6190,"t_first_token":384111.841274319,"t_first_token_unix":1779814976.855218,"t_done":384113.390444271,"t_done_unix":1779814978.4043875},{"request_id":"1371929:1:1371929:601","session_id":"1371929","input_length":17407,"t_proxy_recv":384113.090868674,"t_decision_unix":1779814978.10481,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17407,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":17407,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":40321,"ongoing_decode_tokens":0,"pending_prefill_tokens":25985,"num_requests":2,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":17407,"score_linear":40321.0,"score_lmetric":86784},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29792,"ongoing_decode_tokens":42213,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":17407,"score_linear":29792.0,"score_lmetric":17407},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":17407,"score_linear":98267.0,"score_lmetric":17407},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":17407,"score_linear":130257.0,"score_lmetric":418624},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":17407,"score_linear":168624.0,"score_lmetric":413709},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":17407,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":163242,"ongoing_decode_tokens":163242,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":17407,"score_linear":163242.0,"score_lmetric":52221}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384114.78223528,"t_first_token_unix":1779814979.7961793,"t_done":384115.241126195,"t_done_unix":1779814980.25507},{"request_id":"1371622:1:1371622:598","session_id":"1371622","input_length":13616,"t_proxy_recv":384111.984993605,"t_decision_unix":1779814976.9989345,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13616,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":13616,"score_linear":49483.0,"score_lmetric":13616},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":13616,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29792,"ongoing_decode_tokens":32814,"pending_prefill_tokens":9399,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":13616,"score_linear":29792.0,"score_lmetric":23015},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":13616,"score_linear":98267.0,"score_lmetric":13616},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":11264,"new_prefill":2352,"score_linear":118993.0,"score_lmetric":358404},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":13616,"score_linear":168624.0,"score_lmetric":402336},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":94032,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":13616,"score_linear":94032.0,"score_lmetric":27232},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":160408,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":13616,"score_linear":160408.0,"score_lmetric":40848}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384113.152158926,"t_first_token_unix":1779814978.1661024,"t_done":384116.146883641,"t_done_unix":1779814981.1608274},{"request_id":"1372791:1:1372791:604","session_id":"1372791","input_length":4811,"t_proxy_recv":384116.096199276,"t_decision_unix":1779814981.1101403,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":-4811,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4811,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":40321,"ongoing_decode_tokens":40321,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":4811,"score_linear":40321.0,"score_lmetric":9622},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2007,"cache_hit":0,"new_prefill":4811,"score_linear":-12421.0,"score_lmetric":-4811},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136519,"ongoing_decode_tokens":136519,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":4811,"score_linear":136519.0,"score_lmetric":9622},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":4811,"score_linear":130257.0,"score_lmetric":368240},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":4811,"score_linear":168624.0,"score_lmetric":375921},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":163242,"ongoing_decode_tokens":163242,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":4811,"score_linear":163242.0,"score_lmetric":14433}],"chosen_score_linear":-12421.0,"chosen_score_lmetric":-4811,"t_first_token":384116.397929017,"t_first_token_unix":1779814981.4118729,"t_done":384116.57574629,"t_done_unix":1779814981.5896902},{"request_id":"1355484:7:1371284:596","session_id":"1355484","input_length":22992,"t_proxy_recv":384112.004933387,"t_decision_unix":1779814977.018875,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19968,"affinity_cache_ratio":0.8684759916492694,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":3024,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":22992,"score_linear":49483.0,"score_lmetric":22992},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13616,"ongoing_decode_tokens":0,"pending_prefill_tokens":13616,"num_requests":1,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":22992,"score_linear":13616.0,"score_lmetric":36608},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29792,"ongoing_decode_tokens":32814,"pending_prefill_tokens":9399,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":22992,"score_linear":29792.0,"score_lmetric":32391},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":12800,"new_prefill":10192,"score_linear":85467.0,"score_lmetric":10192},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":22992,"score_linear":130257.0,"score_lmetric":440964},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":22992,"score_linear":168624.0,"score_lmetric":430464},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94032,"ongoing_decode_tokens":94032,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":22992,"score_linear":94032.0,"score_lmetric":45984},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":19968,"new_prefill":3024,"score_linear":120282.0,"score_lmetric":6048}],"chosen_score_linear":120282.0,"chosen_score_lmetric":6048,"t_first_token":384112.556013829,"t_first_token_unix":1779814977.5699568,"t_done":384117.058728367,"t_done_unix":1779814982.0726733},{"request_id":"1362265:3:1373357:605","session_id":"1362265","input_length":10284,"t_proxy_recv":384118.098759202,"t_decision_unix":1779814983.1127005,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9459354336833917,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":556,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":10284,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":9728,"new_prefill":556,"score_linear":16977.0,"score_lmetric":556},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10284,"score_linear":-12421.0,"score_lmetric":-10284},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136519,"ongoing_decode_tokens":136519,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":6656,"new_prefill":3628,"score_linear":129863.0,"score_lmetric":7256},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":72919,"pending_prefill_tokens":14330,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":10284,"score_linear":130257.0,"score_lmetric":98456},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":10284,"score_linear":168624.0,"score_lmetric":392340},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":10284,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":10284,"score_linear":140250.0,"score_lmetric":20568}],"chosen_score_linear":16977.0,"chosen_score_lmetric":556,"t_first_token":384118.156671619,"t_first_token_unix":1779814983.1706152,"t_done":384118.303962587,"t_done_unix":1779814983.3179061},{"request_id":"1279412:25:1366203:554","session_id":"1279412","input_length":98267,"t_proxy_recv":384092.983071034,"t_decision_unix":1779814957.9970121,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9951662307794071,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":475,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":98267,"score_linear":122597.0,"score_lmetric":219840},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":895,"cache_hit":0,"new_prefill":98267,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136960,"ongoing_decode_tokens":21371,"pending_prefill_tokens":65034,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":98267,"score_linear":136960.0,"score_lmetric":489903},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1163,"cache_hit":97792,"new_prefill":475,"score_linear":-29533.0,"score_lmetric":475},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":11154,"ongoing_decode_tokens":0,"pending_prefill_tokens":11154,"num_requests":1,"active_p_offloads":0,"cached_blocks":1391,"cache_hit":0,"new_prefill":98267,"score_linear":11154.0,"score_lmetric":109421},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":98267,"score_linear":168624.0,"score_lmetric":656289},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":98267,"score_linear":76969.0,"score_lmetric":171652},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159566,"ongoing_decode_tokens":80246,"pending_prefill_tokens":35800,"num_requests":3,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":12800,"new_prefill":85467,"score_linear":146766.0,"score_lmetric":363801}],"chosen_score_linear":-29533.0,"chosen_score_lmetric":475,"t_first_token":384093.170327922,"t_first_token_unix":1779814958.1842713,"t_done":384119.194945085,"t_done_unix":1779814984.2088916},{"request_id":"1357132:5:1368445:579","session_id":"1357132","input_length":15871,"t_proxy_recv":384101.107039049,"t_decision_unix":1779814966.12098,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":14848,"affinity_cache_ratio":0.93554281393737,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":1023,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":15871,"score_linear":172080.0,"score_lmetric":276574},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":15871,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":148125,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":15871,"score_linear":135704.0,"score_lmetric":47613},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107112,"ongoing_decode_tokens":107112,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":15871,"score_linear":107112.0,"score_lmetric":31742},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72919,"ongoing_decode_tokens":0,"pending_prefill_tokens":72919,"num_requests":1,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":14848,"new_prefill":1023,"score_linear":58071.0,"score_lmetric":73942},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":15871,"score_linear":168624.0,"score_lmetric":409101},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21773,"ongoing_decode_tokens":0,"pending_prefill_tokens":21773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":15871,"score_linear":21773.0,"score_lmetric":37644},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146808,"ongoing_decode_tokens":146808,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":15871,"score_linear":146808.0,"score_lmetric":47613}],"chosen_score_linear":58071.0,"chosen_score_lmetric":73942,"t_first_token":384118.893380954,"t_first_token_unix":1779814983.907325,"t_done":384120.141487826,"t_done_unix":1779814985.1554313},{"request_id":"1366128:3:1369902:585","session_id":"1366128","input_length":23307,"t_proxy_recv":384106.059758234,"t_decision_unix":1779814971.0736992,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":15360,"affinity_cache_ratio":0.6590294761230532,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":7947,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":23307,"score_linear":172080.0,"score_lmetric":291446},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":23307,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":23307,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":23307,"score_linear":98267.0,"score_lmetric":23307},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":106950,"ongoing_decode_tokens":0,"pending_prefill_tokens":79302,"num_requests":3,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":15360,"new_prefill":7947,"score_linear":91590.0,"score_lmetric":261747},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":23307,"score_linear":168624.0,"score_lmetric":431409},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7712,"ongoing_decode_tokens":0,"pending_prefill_tokens":7712,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":23307,"score_linear":7712.0,"score_lmetric":31019},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":160408,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17698,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":23307,"score_linear":160408.0,"score_lmetric":123015}],"chosen_score_linear":91590.0,"chosen_score_lmetric":261747,"t_first_token":384119.67085147,"t_first_token_unix":1779814984.6847951,"t_done":384120.277157692,"t_done_unix":1779814985.2911012},{"request_id":"1277428:7:1372183:602","session_id":"1277428","input_length":38252,"t_proxy_recv":384114.063685649,"t_decision_unix":1779814979.0776272,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9503293945414619,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":1900,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":38252,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":40321,"ongoing_decode_tokens":13616,"pending_prefill_tokens":12369,"num_requests":2,"active_p_offloads":0,"cached_blocks":974,"cache_hit":4608,"new_prefill":33644,"score_linear":35713.0,"score_lmetric":92026},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2007,"cache_hit":0,"new_prefill":38252,"score_linear":-12421.0,"score_lmetric":-38252},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":36352,"new_prefill":1900,"score_linear":61915.0,"score_lmetric":1900},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":38252,"score_linear":130257.0,"score_lmetric":502004},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":17408,"new_prefill":20844,"score_linear":151216.0,"score_lmetric":424020},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17407,"ongoing_decode_tokens":0,"pending_prefill_tokens":17407,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":38252,"score_linear":17407.0,"score_lmetric":55659},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":163242,"ongoing_decode_tokens":163242,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":38252,"score_linear":163242.0,"score_lmetric":114756}],"chosen_score_linear":61915.0,"chosen_score_lmetric":1900,"t_first_token":384114.590547926,"t_first_token_unix":1779814979.604492,"t_done":384120.441890882,"t_done_unix":1779814985.4558346},{"request_id":"1364090:2:1371798:600","session_id":"1364090","input_length":26705,"t_proxy_recv":384112.626664658,"t_decision_unix":1779814977.640606,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":14336,"affinity_cache_ratio":0.5368283093053735,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":12369,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":7680,"new_prefill":19025,"score_linear":41803.0,"score_lmetric":19025},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":13616,"ongoing_decode_tokens":0,"pending_prefill_tokens":13616,"num_requests":1,"active_p_offloads":0,"cached_blocks":974,"cache_hit":14336,"new_prefill":12369,"score_linear":-720.0,"score_lmetric":25985},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29792,"ongoing_decode_tokens":42213,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":7680,"new_prefill":19025,"score_linear":22112.0,"score_lmetric":19025},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":26705,"score_linear":98267.0,"score_lmetric":26705},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":0,"pending_prefill_tokens":87249,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":4096,"new_prefill":22609,"score_linear":126161.0,"score_lmetric":439432},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":7680,"new_prefill":19025,"score_linear":160944.0,"score_lmetric":418563},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":64531,"ongoing_decode_tokens":64531,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1889,"cache_hit":11264,"new_prefill":15441,"score_linear":53267.0,"score_lmetric":15441},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":163242,"ongoing_decode_tokens":163242,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":11264,"new_prefill":15441,"score_linear":151978.0,"score_lmetric":46323}],"chosen_score_linear":-720.0,"chosen_score_lmetric":25985,"t_first_token":384115.147788101,"t_first_token_unix":1779814980.1617324,"t_done":384121.547883664,"t_done_unix":1779814986.5618277},{"request_id":"1313181:4:1368020:573","session_id":"1313181","input_length":60004,"t_proxy_recv":384104.740986117,"t_decision_unix":1779814969.7549276,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":42496,"affinity_cache_ratio":0.7082194520365309,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":17508,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":60004,"score_linear":172080.0,"score_lmetric":364840},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":60004,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":60004,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":12800,"new_prefill":47204,"score_linear":85467.0,"score_lmetric":47204},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88790,"ongoing_decode_tokens":0,"pending_prefill_tokens":73942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":60004,"score_linear":88790.0,"score_lmetric":267892},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":60004,"score_linear":168624.0,"score_lmetric":541500},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":60004,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":42496,"new_prefill":17508,"score_linear":37750.0,"score_lmetric":17508}],"chosen_score_linear":37750.0,"chosen_score_lmetric":17508,"t_first_token":384110.620531989,"t_first_token_unix":1779814975.6344752,"t_done":384122.916525411,"t_done_unix":1779814987.9304695},{"request_id":"1374347:1:1374347:611","session_id":"1374347","input_length":19862,"t_proxy_recv":384121.607010995,"t_decision_unix":1779814986.6209517,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19862,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":19862,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":19862,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":193414,"ongoing_decode_tokens":0,"pending_prefill_tokens":205835,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":19862,"score_linear":193414.0,"score_lmetric":225697},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":19862,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126116,"ongoing_decode_tokens":91079,"pending_prefill_tokens":11997,"num_requests":3,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":19862,"score_linear":126116.0,"score_lmetric":95577},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":19862,"score_linear":168624.0,"score_lmetric":59586},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":19862,"score_linear":56286.0,"score_lmetric":68468},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":19862,"score_linear":140250.0,"score_lmetric":39724}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384123.653985908,"t_first_token_unix":1779814988.66793,"t_done":384124.023763278,"t_done_unix":1779814989.037707},{"request_id":"1374465:1:1374465:613","session_id":"1374465","input_length":18497,"t_proxy_recv":384122.048541127,"t_decision_unix":1779814987.0624826,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18497,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":18497,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":19862,"ongoing_decode_tokens":0,"pending_prefill_tokens":19862,"num_requests":1,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":18497,"score_linear":19862.0,"score_lmetric":38359},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":18497,"score_linear":256950.0,"score_lmetric":449784},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":18497,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126116,"ongoing_decode_tokens":91079,"pending_prefill_tokens":11997,"num_requests":3,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":18497,"score_linear":126116.0,"score_lmetric":91482},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":18497,"score_linear":168624.0,"score_lmetric":55491},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":18497,"score_linear":56286.0,"score_lmetric":67103},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":18497,"score_linear":140250.0,"score_lmetric":36994}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384123.870552338,"t_first_token_unix":1779814988.8844957,"t_done":384124.073103685,"t_done_unix":1779814989.0870473},{"request_id":"1344773:10:1361326:533","session_id":"1344773","input_length":34679,"t_proxy_recv":384076.126161494,"t_decision_unix":1779814941.1401026,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9891865394042504,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":375,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":34679,"score_linear":122597.0,"score_lmetric":156252},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":34679,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":25430,"ongoing_decode_tokens":21371,"pending_prefill_tokens":16480,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":34679,"score_linear":25430.0,"score_lmetric":51159},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":34679,"score_linear":68259.0,"score_lmetric":34679},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":99510,"ongoing_decode_tokens":0,"pending_prefill_tokens":32438,"num_requests":2,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":34679,"score_linear":99510.0,"score_lmetric":134234},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":34304,"new_prefill":375,"score_linear":83584.0,"score_lmetric":118263},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":34679,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":158497,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":34679,"score_linear":158497.0,"score_lmetric":104037}],"chosen_score_linear":83584.0,"chosen_score_lmetric":118263,"t_first_token":384118.424269046,"t_first_token_unix":1779814983.438215,"t_done":384124.997161142,"t_done_unix":1779814990.011105},{"request_id":"1344773:11:1366387:555","session_id":"1344773","input_length":35071,"t_proxy_recv":384125.004531094,"t_decision_unix":1779814990.0184724,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9927290353853612,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":35071,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":0,"pending_prefill_tokens":48,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":35071,"score_linear":35888.0,"score_lmetric":35119},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35071,"score_linear":256950.0,"score_lmetric":482932},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":35071,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":35071,"score_linear":167624.0,"score_lmetric":158860},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":133945,"ongoing_decode_tokens":133945,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":34816,"new_prefill":255,"score_linear":99129.0,"score_lmetric":510},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":35071,"score_linear":56286.0,"score_lmetric":83677},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":35071,"score_linear":186148.0,"score_lmetric":161114}],"chosen_score_linear":99129.0,"chosen_score_lmetric":510,"t_first_token":384125.103591941,"t_first_token_unix":1779814990.117535,"t_done":384126.466443898,"t_done_unix":1779814991.4803877},{"request_id":"1360649:1:1360649:527","session_id":"1360649","input_length":117888,"t_proxy_recv":384073.620128968,"t_decision_unix":1779814938.63407,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":117888,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":117888,"score_linear":122597.0,"score_lmetric":239461},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":117888,"score_linear":8950.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":117888,"score_linear":68259.0,"score_lmetric":117888},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":117888,"score_linear":83526.0,"score_lmetric":201414},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":158497,"ongoing_decode_tokens":0,"pending_prefill_tokens":36641,"num_requests":3,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":117888,"score_linear":158497.0,"score_lmetric":463587}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384118.421645555,"t_first_token_unix":1779814983.435589,"t_done":384129.113252118,"t_done_unix":1779814994.1271958},{"request_id":"1374465:2:1376358:620","session_id":"1374465","input_length":21588,"t_proxy_recv":384128.451624016,"t_decision_unix":1779814993.465565,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":18432,"affinity_cache_ratio":0.8538076709282935,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":3156,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":21588,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":0,"pending_prefill_tokens":48,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":21588,"score_linear":35888.0,"score_lmetric":21636},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":21588,"score_linear":294991.0,"score_lmetric":687480},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":18432,"new_prefill":3156,"score_linear":-18432.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":21588,"score_linear":167624.0,"score_lmetric":104928},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":169139,"ongoing_decode_tokens":169139,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":21588,"score_linear":169139.0,"score_lmetric":64764},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":21588,"score_linear":56286.0,"score_lmetric":70194},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":21588,"score_linear":186148.0,"score_lmetric":134148}],"chosen_score_linear":-18432.0,"chosen_score_lmetric":0,"t_first_token":384128.983985567,"t_first_token_unix":1779814993.9979286,"t_done":384129.300519054,"t_done_unix":1779814994.3144627},{"request_id":"1344773:12:1367864:571","session_id":"1344773","input_length":35194,"t_proxy_recv":384126.473077918,"t_decision_unix":1779814991.4870195,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9892595328749219,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":378,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":35194,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":0,"pending_prefill_tokens":48,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":35194,"score_linear":35888.0,"score_lmetric":35242},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35194,"score_linear":256950.0,"score_lmetric":483178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":35194,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":35194,"score_linear":167624.0,"score_lmetric":159352},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":133945,"ongoing_decode_tokens":133945,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":34816,"new_prefill":378,"score_linear":99129.0,"score_lmetric":756},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":35194,"score_linear":56286.0,"score_lmetric":83800},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":35194,"score_linear":186148.0,"score_lmetric":161360}],"chosen_score_linear":99129.0,"chosen_score_lmetric":756,"t_first_token":384126.587196548,"t_first_token_unix":1779814991.60114,"t_done":384129.9266412,"t_done_unix":1779814994.9405844},{"request_id":"1367957:1:1367957:572","session_id":"1367957","input_length":72919,"t_proxy_recv":384099.307457909,"t_decision_unix":1779814964.3213992,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":72919,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":72919,"score_linear":172080.0,"score_lmetric":390670},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":923,"cache_hit":0,"new_prefill":72919,"score_linear":18815.0,"score_lmetric":72919},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135704,"ongoing_decode_tokens":121288,"pending_prefill_tokens":26837,"num_requests":3,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":18944,"new_prefill":53975,"score_linear":116760.0,"score_lmetric":242436},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1172,"cache_hit":0,"new_prefill":72919,"score_linear":98267.0,"score_lmetric":72919},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":72919,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":72919,"score_linear":168624.0,"score_lmetric":580245},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":72919,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":159786,"ongoing_decode_tokens":159786,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":0,"new_prefill":72919,"score_linear":159786.0,"score_lmetric":218757}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384117.767980358,"t_first_token_unix":1779814982.781927,"t_done":384130.065046338,"t_done_unix":1779814995.0790367},{"request_id":"1344773:13:1370257:589","session_id":"1344773","input_length":35413,"t_proxy_recv":384129.934958396,"t_decision_unix":1779814994.9489,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9975997515036851,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":85,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24323,"ongoing_decode_tokens":0,"pending_prefill_tokens":24323,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":35413,"score_linear":24323.0,"score_lmetric":59736},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":35413,"score_linear":35888.0,"score_lmetric":35413},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35413,"score_linear":294991.0,"score_lmetric":728955},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1228,"cache_hit":0,"new_prefill":35413,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":167624,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":35413,"score_linear":167624.0,"score_lmetric":141652},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":135109,"ongoing_decode_tokens":135109,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1307,"cache_hit":35328,"new_prefill":85,"score_linear":99781.0,"score_lmetric":170},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":35413,"score_linear":56286.0,"score_lmetric":84019},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":35413,"score_linear":186148.0,"score_lmetric":161798}],"chosen_score_linear":99781.0,"chosen_score_lmetric":170,"t_first_token":384130.032813306,"t_first_token_unix":1779814995.0467572,"t_done":384130.106159269,"t_done_unix":1779814995.120103},{"request_id":"1366128:4:1371629:599","session_id":"1366128","input_length":35037,"t_proxy_recv":384120.289929537,"t_decision_unix":1779814985.3038712,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":23040,"affinity_cache_ratio":0.6575905471358849,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":11997,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":35037,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":35037,"score_linear":26705.0,"score_lmetric":35037},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":193414,"ongoing_decode_tokens":0,"pending_prefill_tokens":205835,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35037,"score_linear":193414.0,"score_lmetric":240872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":38252,"ongoing_decode_tokens":38252,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":35037,"score_linear":38252.0,"score_lmetric":35037},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":91079,"ongoing_decode_tokens":91079,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":23040,"new_prefill":11997,"score_linear":68039.0,"score_lmetric":23994},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":35037,"score_linear":168624.0,"score_lmetric":105111},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":35037,"score_linear":56286.0,"score_lmetric":83643},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":35037,"score_linear":140250.0,"score_lmetric":70074}],"chosen_score_linear":68039.0,"chosen_score_lmetric":23994,"t_first_token":384122.842372518,"t_first_token_unix":1779814987.856316,"t_done":384130.166661339,"t_done_unix":1779814995.180605},{"request_id":"1305906:2:1363233:539","session_id":"1305906","input_length":16057,"t_proxy_recv":384082.667794143,"t_decision_unix":1779814947.6817355,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8609329264495236,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":2233,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":0,"new_prefill":16057,"score_linear":122597.0,"score_lmetric":137630},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":841,"cache_hit":0,"new_prefill":16057,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":71635,"ongoing_decode_tokens":21371,"pending_prefill_tokens":62685,"num_requests":1,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":16057,"score_linear":71635.0,"score_lmetric":78742},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":16057,"score_linear":68259.0,"score_lmetric":16057},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":16057,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":152567,"ongoing_decode_tokens":0,"pending_prefill_tokens":118263,"num_requests":2,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":13824,"new_prefill":2233,"score_linear":138743.0,"score_lmetric":240992},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":73385,"num_requests":1,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":16057,"score_linear":76969.0,"score_lmetric":89442},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139004,"ongoing_decode_tokens":139004,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":0,"new_prefill":16057,"score_linear":139004.0,"score_lmetric":32114}],"chosen_score_linear":138743.0,"chosen_score_lmetric":240992,"t_first_token":384119.497648107,"t_first_token_unix":1779814984.5115917,"t_done":384130.274487876,"t_done_unix":1779814995.2884312},{"request_id":"1360649:2:1367022:561","session_id":"1360649","input_length":119052,"t_proxy_recv":384129.15230628,"t_decision_unix":1779814994.1662478,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":118272,"affinity_cache_ratio":0.9934482411047273,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":118272,"estimated_new_tokens":780,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24323,"ongoing_decode_tokens":0,"pending_prefill_tokens":24323,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":119052,"score_linear":24323.0,"score_lmetric":143375},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":119052,"score_linear":35888.0,"score_lmetric":119052},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":119052,"score_linear":294991.0,"score_lmetric":979872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21588,"ongoing_decode_tokens":21588,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":119052,"score_linear":21588.0,"score_lmetric":119052},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":119052,"score_linear":167624.0,"score_lmetric":494784},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":51251,"ongoing_decode_tokens":51251,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":118272,"new_prefill":780,"score_linear":-67021.0,"score_lmetric":1560},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":4096,"new_prefill":114956,"score_linear":52190.0,"score_lmetric":163562},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":119052,"score_linear":186148.0,"score_lmetric":329076}],"chosen_score_linear":-67021.0,"chosen_score_lmetric":1560,"t_first_token":384129.77903733,"t_first_token_unix":1779814994.7929804,"t_done":384131.192055683,"t_done_unix":1779814996.2060006},{"request_id":"1371337:2:1376534:621","session_id":"1371337","input_length":24323,"t_proxy_recv":384129.142158616,"t_decision_unix":1779814994.1561,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.3789006290342474,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":24323,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":24323,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":24323,"score_linear":35888.0,"score_lmetric":24323},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":9216,"new_prefill":15107,"score_linear":285775.0,"score_lmetric":668037},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21588,"ongoing_decode_tokens":21588,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":24323,"score_linear":21588.0,"score_lmetric":24323},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":24323,"score_linear":167624.0,"score_lmetric":115868},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":51251,"ongoing_decode_tokens":51251,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":24323,"score_linear":51251.0,"score_lmetric":48646},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":24323,"score_linear":56286.0,"score_lmetric":72929},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":24323,"score_linear":186148.0,"score_lmetric":139618}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384131.939165157,"t_first_token_unix":1779814996.9531088,"t_done":384132.527527838,"t_done_unix":1779814997.5414712},{"request_id":"1377061:1:1377061:622","session_id":"1377061","input_length":16241,"t_proxy_recv":384131.077911484,"t_decision_unix":1779814996.091853,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":16241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24323,"ongoing_decode_tokens":0,"pending_prefill_tokens":24323,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":16241,"score_linear":24323.0,"score_lmetric":40564},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":16241,"score_linear":35888.0,"score_lmetric":16241},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":16241,"score_linear":294991.0,"score_lmetric":671439},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1228,"cache_hit":0,"new_prefill":16241,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":106432,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1625,"cache_hit":0,"new_prefill":16241,"score_linear":106432.0,"score_lmetric":84567},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119052,"ongoing_decode_tokens":119052,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":0,"new_prefill":16241,"score_linear":119052.0,"score_lmetric":16241},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":16241,"score_linear":56286.0,"score_lmetric":16241},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":16241,"score_linear":186148.0,"score_lmetric":123454}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384132.554848711,"t_first_token_unix":1779814997.5687923,"t_done":384132.697109624,"t_done_unix":1779814997.7110531},{"request_id":"1366128:5:1373829:610","session_id":"1366128","input_length":46764,"t_proxy_recv":384130.180523366,"t_decision_unix":1779814995.194465,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34816,"affinity_cache_ratio":0.7445043195620563,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":11948,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24323,"ongoing_decode_tokens":0,"pending_prefill_tokens":24323,"num_requests":1,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":46764,"score_linear":24323.0,"score_lmetric":71087},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":46764,"score_linear":35888.0,"score_lmetric":46764},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":46764,"score_linear":294991.0,"score_lmetric":763008},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1228,"cache_hit":0,"new_prefill":46764,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":59668,"ongoing_decode_tokens":59668,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1625,"cache_hit":34816,"new_prefill":11948,"score_linear":24852.0,"score_lmetric":23896},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":135109,"ongoing_decode_tokens":135109,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1307,"cache_hit":0,"new_prefill":46764,"score_linear":135109.0,"score_lmetric":93528},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":46764,"score_linear":56286.0,"score_lmetric":46764},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":46764,"score_linear":186148.0,"score_lmetric":184500}],"chosen_score_linear":24852.0,"chosen_score_lmetric":23896,"t_first_token":384133.534891703,"t_first_token_unix":1779814998.548835,"t_done":384133.900301331,"t_done_unix":1779814998.914245},{"request_id":"1370129:2:1373467:607","session_id":"1370129","input_length":56286,"t_proxy_recv":384118.585398846,"t_decision_unix":1779814983.5993402,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":6,"affinity_cache_hit":18432,"affinity_cache_ratio":0.3274704189318836,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":7680,"estimated_new_tokens":48606,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":7680,"new_prefill":48606,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":18432,"new_prefill":37854,"score_linear":8273.0,"score_lmetric":37854},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":113919,"ongoing_decode_tokens":0,"pending_prefill_tokens":126340,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":48606,"score_linear":106239.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136519,"ongoing_decode_tokens":136519,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":56286,"score_linear":136519.0,"score_lmetric":112572},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":72919,"pending_prefill_tokens":14330,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":4096,"new_prefill":52190,"score_linear":126161.0,"score_lmetric":266080},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":152567,"pending_prefill_tokens":2233,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":7680,"new_prefill":48606,"score_linear":160944.0,"score_lmetric":152517},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":7680,"new_prefill":48606,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":7680,"new_prefill":48606,"score_linear":132570.0,"score_lmetric":97212}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":384130.052699902,"t_first_token_unix":1779814995.0666435,"t_done":384134.555505374,"t_done_unix":1779814999.569449},{"request_id":"1372791:2:1377698:624","session_id":"1372791","input_length":14851,"t_proxy_recv":384133.318371354,"t_decision_unix":1779814998.332312,"policy":"unified","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":0,"affinity_cache_hit":4608,"affinity_cache_ratio":0.3102821358831055,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1575,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":14851,"score_linear":35888.0,"score_lmetric":14851},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4608,"new_prefill":10243,"score_linear":290383.0,"score_lmetric":653445},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":106432,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1625,"cache_hit":0,"new_prefill":14851,"score_linear":106432.0,"score_lmetric":80397},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":14851,"score_linear":56286.0,"score_lmetric":14851},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":14851,"score_linear":186148.0,"score_lmetric":120674}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384134.631287716,"t_first_token_unix":1779814999.6452317,"t_done":384134.826416941,"t_done_unix":1779814999.8403602},{"request_id":"1377061:2:1378590:631","session_id":"1377061","input_length":16515,"t_proxy_recv":384136.348776415,"t_decision_unix":1779815001.3627176,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":15872,"affinity_cache_ratio":0.961065697850439,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":643,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":16515,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":16515,"score_linear":35888.0,"score_lmetric":16515},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":16515,"score_linear":294991.0,"score_lmetric":672261},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":100340,"ongoing_decode_tokens":100340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":15872,"new_prefill":643,"score_linear":84468.0,"score_lmetric":643},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":16515,"score_linear":118179.0,"score_lmetric":85302},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":22132,"ongoing_decode_tokens":22132,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":16515,"score_linear":22132.0,"score_lmetric":16515},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":5458,"ongoing_decode_tokens":0,"pending_prefill_tokens":5458,"num_requests":1,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":16515,"score_linear":5458.0,"score_lmetric":21973},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":16515,"score_linear":209605.0,"score_lmetric":187254}],"chosen_score_linear":84468.0,"chosen_score_lmetric":643,"t_first_token":384136.470708803,"t_first_token_unix":1779815001.4846525,"t_done":384136.62594589,"t_done_unix":1779815001.6398897},{"request_id":"1279412:26:1378269:628","session_id":"1279412","input_length":100340,"t_proxy_recv":384135.249827745,"t_decision_unix":1779815000.2637691,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":99840,"affinity_cache_ratio":0.9950169423958541,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":99840,"estimated_new_tokens":500,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":100340,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":100340,"score_linear":35888.0,"score_lmetric":100340},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":100340,"score_linear":294991.0,"score_lmetric":923736},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":99840,"new_prefill":500,"score_linear":-99840.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":100340,"score_linear":118179.0,"score_lmetric":336777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":22132,"ongoing_decode_tokens":0,"pending_prefill_tokens":6772,"num_requests":1,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":100340,"score_linear":22132.0,"score_lmetric":107112},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":100340,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":12800,"new_prefill":87540,"score_linear":196805.0,"score_lmetric":400329}],"chosen_score_linear":-99840.0,"chosen_score_lmetric":0,"t_first_token":384135.493672688,"t_first_token_unix":1779815000.5076168,"t_done":384136.900127514,"t_done_unix":1779815001.9140716},{"request_id":"1378684:1:1378684:632","session_id":"1378684","input_length":7810,"t_proxy_recv":384136.683348677,"t_decision_unix":1779815001.6972902,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7810,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":7810,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":7810,"score_linear":35888.0,"score_lmetric":7810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7810,"score_linear":294991.0,"score_lmetric":646146},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":100340,"ongoing_decode_tokens":100340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1260,"cache_hit":0,"new_prefill":7810,"score_linear":100340.0,"score_lmetric":7810},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":7810,"score_linear":118179.0,"score_lmetric":59187},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":22132,"ongoing_decode_tokens":22132,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":7810,"score_linear":22132.0,"score_lmetric":7810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":5458,"ongoing_decode_tokens":5458,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":7810,"score_linear":5458.0,"score_lmetric":7810},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":7810,"score_linear":209605.0,"score_lmetric":161139}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384137.223847991,"t_first_token_unix":1779815002.2377918,"t_done":384137.487548258,"t_done_unix":1779815002.5014915},{"request_id":"1378543:1:1378543:630","session_id":"1378543","input_length":5458,"t_proxy_recv":384136.193578292,"t_decision_unix":1779815001.20752,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":5458,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":5458,"score_linear":35888.0,"score_lmetric":5458},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5458,"score_linear":294991.0,"score_lmetric":639090},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":100340,"ongoing_decode_tokens":100340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":0,"new_prefill":5458,"score_linear":100340.0,"score_lmetric":5458},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":5458,"score_linear":118179.0,"score_lmetric":52131},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":22132,"ongoing_decode_tokens":22132,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":5458,"score_linear":22132.0,"score_lmetric":5458},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":5458,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":5458,"score_linear":209605.0,"score_lmetric":154083}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384136.544852923,"t_first_token_unix":1779815001.558797,"t_done":384137.60239438,"t_done_unix":1779815002.6163378},{"request_id":"1286804:4:1378156:627","session_id":"1286804","input_length":22132,"t_proxy_recv":384134.823184101,"t_decision_unix":1779814999.8371253,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":15360,"affinity_cache_ratio":0.694017711910356,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":6772,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14851,"ongoing_decode_tokens":14851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1575,"cache_hit":0,"new_prefill":22132,"score_linear":14851.0,"score_lmetric":22132},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":22132,"score_linear":35888.0,"score_lmetric":22132},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":22132,"score_linear":294991.0,"score_lmetric":689112},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":0,"new_prefill":22132,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":1536,"new_prefill":20596,"score_linear":116643.0,"score_lmetric":97545},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":15360,"new_prefill":6772,"score_linear":-15360.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":22132,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":22132,"score_linear":209605.0,"score_lmetric":204105}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":384135.826762732,"t_first_token_unix":1779815000.8407066,"t_done":384137.657423353,"t_done_unix":1779815002.6713667},{"request_id":"1379185:1:1379185:634","session_id":"1379185","input_length":1422,"t_proxy_recv":384138.403262477,"t_decision_unix":1779815003.4172032,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1422,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":1422,"score_linear":35888.0,"score_lmetric":1422},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1422,"score_linear":294991.0,"score_lmetric":626982},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":435,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":1422,"score_linear":15283.0,"score_lmetric":1857},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":118179,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":1422,"score_linear":118179.0,"score_lmetric":4266},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2041,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":1422,"score_linear":209605.0,"score_lmetric":141975}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384138.503674403,"t_first_token_unix":1779815003.5176175,"t_done":384138.682907513,"t_done_unix":1779815003.696851},{"request_id":"1363943:3:1369535:582","session_id":"1363943","input_length":18160,"t_proxy_recv":384104.76656182,"t_decision_unix":1779814969.7805033,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":12800,"affinity_cache_ratio":0.7048458149779736,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":5360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":172080,"ongoing_decode_tokens":0,"pending_prefill_tokens":122416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":8704,"new_prefill":9456,"score_linear":163376.0,"score_lmetric":263744},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":4096,"new_prefill":14064,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":4096,"new_prefill":14064,"score_linear":4854.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1176,"cache_hit":0,"new_prefill":18160,"score_linear":98267.0,"score_lmetric":18160},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88790,"ongoing_decode_tokens":0,"pending_prefill_tokens":73942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":12800,"new_prefill":5360,"score_linear":75990.0,"score_lmetric":158604},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":0,"pending_prefill_tokens":120496,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":4096,"new_prefill":14064,"score_linear":164528.0,"score_lmetric":403680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":4096,"new_prefill":14064,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":80246,"pending_prefill_tokens":17508,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":4096,"new_prefill":14064,"score_linear":136154.0,"score_lmetric":63144}],"chosen_score_linear":75990.0,"chosen_score_lmetric":158604,"t_first_token":384118.895828741,"t_first_token_unix":1779814983.9097764,"t_done":384139.290074553,"t_done_unix":1779815004.304022},{"request_id":"1268861:7:1374579:614","session_id":"1268861","input_length":41508,"t_proxy_recv":384122.520851399,"t_decision_unix":1779814987.5347924,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":36864,"affinity_cache_ratio":0.8881179531656548,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":4644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":41508,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":19862,"ongoing_decode_tokens":0,"pending_prefill_tokens":19862,"num_requests":1,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":41508,"score_linear":19862.0,"score_lmetric":61370},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":41508,"score_linear":256950.0,"score_lmetric":495806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18497,"ongoing_decode_tokens":0,"pending_prefill_tokens":18497,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":41508,"score_linear":18497.0,"score_lmetric":60005},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126116,"ongoing_decode_tokens":91079,"pending_prefill_tokens":11997,"num_requests":3,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":36864,"new_prefill":4644,"score_linear":89252.0,"score_lmetric":49923},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":41508,"score_linear":168624.0,"score_lmetric":124524},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":41508,"score_linear":56286.0,"score_lmetric":90114},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":41508,"score_linear":140250.0,"score_lmetric":83016}],"chosen_score_linear":89252.0,"chosen_score_lmetric":49923,"t_first_token":384129.695145775,"t_first_token_unix":1779814994.7090895,"t_done":384139.674787361,"t_done_unix":1779815004.6887307},{"request_id":"1379569:1:1379569:638","session_id":"1379569","input_length":2632,"t_proxy_recv":384139.631213526,"t_decision_unix":1779815004.645155,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2632,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":2632,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":2632,"score_linear":35888.0,"score_lmetric":2632},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":2632,"score_linear":294991.0,"score_lmetric":630612},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":2632,"score_linear":72939.0,"score_lmetric":7936},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118415,"ongoing_decode_tokens":118415,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1658,"cache_hit":0,"new_prefill":2632,"score_linear":118415.0,"score_lmetric":7896},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":0,"new_prefill":2632,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":0,"pending_prefill_tokens":4625,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":2632,"score_linear":61457.0,"score_lmetric":7257},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":2632,"score_linear":209605.0,"score_lmetric":145605}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384139.795432959,"t_first_token_unix":1779815004.8093762,"t_done":384140.228018392,"t_done_unix":1779815005.2419624},{"request_id":"1363943:4:1372250:603","session_id":"1363943","input_length":18396,"t_proxy_recv":384139.294630019,"t_decision_unix":1779815004.3085716,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":17920,"affinity_cache_ratio":0.974124809741248,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":476,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":8704,"new_prefill":9692,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":4096,"new_prefill":14300,"score_linear":31792.0,"score_lmetric":14300},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":14300,"score_linear":290895.0,"score_lmetric":665616},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":18396,"score_linear":72939.0,"score_lmetric":39464},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":100019,"ongoing_decode_tokens":100019,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1658,"cache_hit":17920,"new_prefill":476,"score_linear":82099.0,"score_lmetric":952},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":4096,"new_prefill":14300,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":4096,"new_prefill":14300,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":4096,"new_prefill":14300,"score_linear":205509.0,"score_lmetric":180609}],"chosen_score_linear":82099.0,"chosen_score_lmetric":952,"t_first_token":384139.353618881,"t_first_token_unix":1779815004.3675625,"t_done":384140.277873612,"t_done_unix":1779815005.2918174},{"request_id":"1366128:6:1375094:616","session_id":"1366128","input_length":58511,"t_proxy_recv":384133.915914556,"t_decision_unix":1779814998.929856,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":46592,"affinity_cache_ratio":0.7962947138144965,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":11919,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14851,"ongoing_decode_tokens":0,"pending_prefill_tokens":14851,"num_requests":1,"active_p_offloads":0,"cached_blocks":1575,"cache_hit":0,"new_prefill":58511,"score_linear":14851.0,"score_lmetric":73362},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":58511,"score_linear":35888.0,"score_lmetric":58511},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":58511,"score_linear":294991.0,"score_lmetric":798249},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":0,"new_prefill":58511,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":59668,"ongoing_decode_tokens":59668,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":46592,"new_prefill":11919,"score_linear":13076.0,"score_lmetric":23838},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":58511,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":58511,"score_linear":56286.0,"score_lmetric":58511},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":58511,"score_linear":186148.0,"score_lmetric":207994}],"chosen_score_linear":13076.0,"chosen_score_lmetric":23838,"t_first_token":384138.062598528,"t_first_token_unix":1779815003.0765417,"t_done":384140.554751207,"t_done_unix":1779815005.5686991},{"request_id":"1366128:7:1378071:626","session_id":"1366128","input_length":59007,"t_proxy_recv":384140.567380272,"t_decision_unix":1779815005.5813215,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9891707763485688,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":639,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":59007,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":59007,"score_linear":35888.0,"score_lmetric":59007},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":59007,"score_linear":294991.0,"score_lmetric":799737},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":59007,"score_linear":72939.0,"score_lmetric":120686},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18676,"ongoing_decode_tokens":18676,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":58368,"new_prefill":639,"score_linear":-39692.0,"score_lmetric":639},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":59007,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":0,"pending_prefill_tokens":4625,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":59007,"score_linear":61457.0,"score_lmetric":63632},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":59007,"score_linear":209605.0,"score_lmetric":314730}],"chosen_score_linear":-39692.0,"chosen_score_lmetric":639,"t_first_token":384140.779522523,"t_first_token_unix":1779815005.7934668,"t_done":384141.68753936,"t_done_unix":1779815006.7014837},{"request_id":"1363943:5:1373637:609","session_id":"1363943","input_length":18676,"t_proxy_recv":384140.282993312,"t_decision_unix":1779815005.2969346,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9869351038766331,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":8704,"new_prefill":9972,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":4096,"new_prefill":14580,"score_linear":31792.0,"score_lmetric":14580},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":14580,"score_linear":290895.0,"score_lmetric":666456},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":18676,"score_linear":72939.0,"score_lmetric":40024},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":58511,"ongoing_decode_tokens":58511,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":18432,"new_prefill":244,"score_linear":40079.0,"score_lmetric":244},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":4096,"new_prefill":14580,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":0,"pending_prefill_tokens":4625,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":4096,"new_prefill":14580,"score_linear":57361.0,"score_lmetric":19205},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":4096,"new_prefill":14580,"score_linear":205509.0,"score_lmetric":181449}],"chosen_score_linear":40079.0,"chosen_score_lmetric":244,"t_first_token":384140.375196414,"t_first_token_unix":1779815005.3891404,"t_done":384142.003314661,"t_done_unix":1779815007.0172586},{"request_id":"1378543:2:1380447:644","session_id":"1378543","input_length":5314,"t_proxy_recv":384142.674075585,"t_decision_unix":1779815007.688017,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":5120,"affinity_cache_ratio":0.963492660895747,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":5314,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":5314,"score_linear":35888.0,"score_lmetric":5314},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5314,"score_linear":294991.0,"score_lmetric":638658},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":5314,"score_linear":121214.0,"score_lmetric":68148},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78346,"ongoing_decode_tokens":19116,"pending_prefill_tokens":350,"num_requests":2,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":5314,"score_linear":78346.0,"score_lmetric":11328},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":5314,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":5120,"new_prefill":194,"score_linear":56337.0,"score_lmetric":194},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":5314,"score_linear":209605.0,"score_lmetric":153651}],"chosen_score_linear":56337.0,"chosen_score_lmetric":194,"t_first_token":384142.703930465,"t_first_token_unix":1779815007.7178736,"t_done":384142.710076402,"t_done_unix":1779815007.7240195},{"request_id":"1301929:2:1375154:617","session_id":"1301929","input_length":35888,"t_proxy_recv":384124.500365393,"t_decision_unix":1779814989.5143068,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":35840,"affinity_cache_ratio":0.9986625055728935,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":48,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":3584,"new_prefill":32304,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":35840,"new_prefill":48,"score_linear":-35840.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35888,"score_linear":256950.0,"score_lmetric":484566},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":35888,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":35888,"score_linear":167624.0,"score_lmetric":162128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":35888,"score_linear":168624.0,"score_lmetric":107664},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":35888,"score_linear":56286.0,"score_lmetric":84494},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":35888,"score_linear":186148.0,"score_lmetric":162748}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":384128.775716649,"t_first_token_unix":1779814993.7896602,"t_done":384143.357862811,"t_done_unix":1779815008.3718066},{"request_id":"1363943:6:1375416:618","session_id":"1363943","input_length":19116,"t_proxy_recv":384142.009263236,"t_decision_unix":1779815007.023204,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9642184557438794,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":8704,"new_prefill":10412,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":4096,"new_prefill":15020,"score_linear":31792.0,"score_lmetric":15020},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":15020,"score_linear":290895.0,"score_lmetric":667776},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":90307,"ongoing_decode_tokens":15283,"pending_prefill_tokens":2320,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":19116,"score_linear":90307.0,"score_lmetric":64308},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":18432,"new_prefill":684,"score_linear":-18432.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":4096,"new_prefill":15020,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":4096,"new_prefill":15020,"score_linear":57361.0,"score_lmetric":15020},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":4096,"new_prefill":15020,"score_linear":205509.0,"score_lmetric":182769}],"chosen_score_linear":-18432.0,"chosen_score_lmetric":0,"t_first_token":384142.101311448,"t_first_token_unix":1779815007.1152549,"t_done":384143.384628284,"t_done_unix":1779815008.398572},{"request_id":"1379569:2:1380473:645","session_id":"1379569","input_length":6767,"t_proxy_recv":384142.819032369,"t_decision_unix":1779815007.8329687,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":2560,"affinity_cache_ratio":0.37830648736515443,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":4207,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":6767,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":6767,"score_linear":35888.0,"score_lmetric":6767},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":6767,"score_linear":294991.0,"score_lmetric":643017},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":6767,"score_linear":121214.0,"score_lmetric":73960},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78346,"ongoing_decode_tokens":78346,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":6767,"score_linear":78346.0,"score_lmetric":13534},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":2560,"new_prefill":4207,"score_linear":-2560.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":6767,"score_linear":61457.0,"score_lmetric":6767},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":6767,"score_linear":209605.0,"score_lmetric":158010}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":384143.135274643,"t_first_token_unix":1779815008.1492183,"t_done":384143.74596747,"t_done_unix":1779815008.7599106},{"request_id":"1366128:8:1380438:643","session_id":"1366128","input_length":59230,"t_proxy_recv":384142.645400275,"t_decision_unix":1779815007.6593418,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9940908323484721,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":350,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":59230,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":59230,"score_linear":35888.0,"score_lmetric":59230},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":59230,"score_linear":294991.0,"score_lmetric":800406},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":59230,"score_linear":121214.0,"score_lmetric":283812},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":19116,"ongoing_decode_tokens":19116,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":58880,"new_prefill":350,"score_linear":-39764.0,"score_lmetric":350},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":59230,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":59230,"score_linear":61457.0,"score_lmetric":59230},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":59230,"score_linear":209605.0,"score_lmetric":315399}],"chosen_score_linear":-39764.0,"chosen_score_lmetric":350,"t_first_token":384142.812264975,"t_first_token_unix":1779815007.8262086,"t_done":384143.832592968,"t_done_unix":1779815008.8465366},{"request_id":"1363943:7:1377305:623","session_id":"1363943","input_length":20727,"t_proxy_recv":384143.390537728,"t_decision_unix":1779815008.4044793,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9139769382930477,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":1783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":8704,"new_prefill":12023,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":4096,"new_prefill":16631,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":16631,"score_linear":290895.0,"score_lmetric":672609},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":20727,"score_linear":121214.0,"score_lmetric":129800},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":59230,"ongoing_decode_tokens":59230,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":18944,"new_prefill":1783,"score_linear":40286.0,"score_lmetric":1783},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6767,"ongoing_decode_tokens":6767,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":4096,"new_prefill":16631,"score_linear":2671.0,"score_lmetric":16631},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":4096,"new_prefill":16631,"score_linear":57361.0,"score_lmetric":16631},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":4096,"new_prefill":16631,"score_linear":205509.0,"score_lmetric":187602}],"chosen_score_linear":40286.0,"chosen_score_lmetric":1783,"t_first_token":384143.678405172,"t_first_token_unix":1779815008.6923487,"t_done":384144.885506071,"t_done_unix":1779815009.8994496},{"request_id":"1370129:3:1379538:637","session_id":"1370129","input_length":61457,"t_proxy_recv":384139.523545153,"t_decision_unix":1779815004.5374866,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9247441300421433,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":4625,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":7680,"new_prefill":53777,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":18432,"new_prefill":43025,"score_linear":17456.0,"score_lmetric":43025},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":53777,"score_linear":287311.0,"score_lmetric":784047},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":61457,"score_linear":72939.0,"score_lmetric":125586},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118415,"ongoing_decode_tokens":118415,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1658,"cache_hit":4096,"new_prefill":57361,"score_linear":114319.0,"score_lmetric":172083},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":7680,"new_prefill":53777,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":56832,"new_prefill":4625,"score_linear":-56832.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":7680,"new_prefill":53777,"score_linear":201925.0,"score_lmetric":299040}],"chosen_score_linear":-56832.0,"chosen_score_lmetric":0,"t_first_token":384141.341175487,"t_first_token_unix":1779815006.3551197,"t_done":384146.53632009,"t_done_unix":1779815011.550264},{"request_id":"1362265:4:1381673:650","session_id":"1362265","input_length":10645,"t_proxy_recv":384147.128427273,"t_decision_unix":1779815012.1423688,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10240,"affinity_cache_ratio":0.9619539689995303,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":405,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":10645,"score_linear":100538.0,"score_lmetric":111183},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":10240,"new_prefill":405,"score_linear":-10240.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10645,"score_linear":294991.0,"score_lmetric":654651},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":6656,"new_prefill":3989,"score_linear":114558.0,"score_lmetric":62848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":10645,"score_linear":20948.0,"score_lmetric":10645},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21609,"ongoing_decode_tokens":0,"pending_prefill_tokens":14953,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":10645,"score_linear":21609.0,"score_lmetric":51196},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2053,"cache_hit":0,"new_prefill":10645,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":10645,"score_linear":209605.0,"score_lmetric":31935}],"chosen_score_linear":-10240.0,"chosen_score_lmetric":0,"t_first_token":384147.217097102,"t_first_token_unix":1779815012.2310405,"t_done":384147.433732319,"t_done_unix":1779815012.4476762},{"request_id":"1381728:1:1381728:651","session_id":"1381728","input_length":1391,"t_proxy_recv":384147.356845826,"t_decision_unix":1779815012.3707871,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1391,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":1391,"score_linear":100538.0,"score_lmetric":101929},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":10645,"ongoing_decode_tokens":10645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":1391,"score_linear":10645.0,"score_lmetric":1391},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1391,"score_linear":294991.0,"score_lmetric":626889},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":1391,"score_linear":121214.0,"score_lmetric":52456},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":1391,"score_linear":20948.0,"score_lmetric":1391},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21609,"ongoing_decode_tokens":21609,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":1391,"score_linear":21609.0,"score_lmetric":2782},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2053,"cache_hit":0,"new_prefill":1391,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":1391,"score_linear":209605.0,"score_lmetric":4173}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384147.453500732,"t_first_token_unix":1779815012.4674442,"t_done":384147.598433067,"t_done_unix":1779815012.6123767},{"request_id":"1379569:3:1381510:649","session_id":"1379569","input_length":7620,"t_proxy_recv":384146.444581688,"t_decision_unix":1779815011.4585228,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6656,"affinity_cache_ratio":0.873490813648294,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":964,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":7620,"score_linear":100538.0,"score_lmetric":108158},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":7620,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7620,"score_linear":294991.0,"score_lmetric":645576},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":7620,"score_linear":121214.0,"score_lmetric":77372},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":7620,"score_linear":20948.0,"score_lmetric":7620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":0,"pending_prefill_tokens":13989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":6656,"new_prefill":964,"score_linear":7333.0,"score_lmetric":14953},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":7620,"score_linear":61457.0,"score_lmetric":7620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":7620,"score_linear":209605.0,"score_lmetric":22860}],"chosen_score_linear":7333.0,"chosen_score_lmetric":14953,"t_first_token":384147.313872707,"t_first_token_unix":1779815012.3278167,"t_done":384147.972161096,"t_done_unix":1779815012.9861042},{"request_id":"1366128:9:1381799:652","session_id":"1366128","input_length":59374,"t_proxy_recv":384147.608706727,"t_decision_unix":1779815012.6226482,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9916798598713241,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":494,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":59374,"score_linear":100538.0,"score_lmetric":159912},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":59374,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":59374,"score_linear":294991.0,"score_lmetric":800838},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":59374,"score_linear":121214.0,"score_lmetric":284388},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":58880,"new_prefill":494,"score_linear":-37932.0,"score_lmetric":494},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21609,"ongoing_decode_tokens":21609,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":59374,"score_linear":21609.0,"score_lmetric":118748},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":59374,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":59374,"score_linear":209605.0,"score_lmetric":178122}],"chosen_score_linear":-37932.0,"chosen_score_lmetric":494,"t_first_token":384147.74890299,"t_first_token_unix":1779815012.7628462,"t_done":384148.217877065,"t_done_unix":1779815013.2318208},{"request_id":"1381387:1:1381387:648","session_id":"1381387","input_length":13989,"t_proxy_recv":384146.031317715,"t_decision_unix":1779815011.0452592,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":13989,"score_linear":100538.0,"score_lmetric":114527},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":13989,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":13989,"score_linear":294991.0,"score_lmetric":664683},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":13989,"score_linear":121214.0,"score_lmetric":102848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":13989,"score_linear":20948.0,"score_lmetric":13989},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":13989,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":13989,"score_linear":61457.0,"score_lmetric":13989},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":13989,"score_linear":209605.0,"score_lmetric":179676}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384147.23029225,"t_first_token_unix":1779815012.2442355,"t_done":384148.945582044,"t_done_unix":1779815013.9595258},{"request_id":"1382294:1:1382294:656","session_id":"1382294","input_length":3034,"t_proxy_recv":384149.353169646,"t_decision_unix":1779815014.3671107,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3034,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":3034,"score_linear":100538.0,"score_lmetric":103572},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":3034,"score_linear":47401.0,"score_lmetric":22787},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3034,"score_linear":294991.0,"score_lmetric":631818},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":3034,"score_linear":121214.0,"score_lmetric":59028},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":74960,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3034,"score_linear":74960.0,"score_lmetric":114092},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1367,"cache_hit":0,"new_prefill":3034,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":3034,"score_linear":38111.0,"score_lmetric":41145},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":3034,"score_linear":209605.0,"score_lmetric":9102}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384149.537929175,"t_first_token_unix":1779815014.5518734,"t_done":384149.692064411,"t_done_unix":1779815014.7060096},{"request_id":"1355484:8:1377993:625","session_id":"1355484","input_length":23457,"t_proxy_recv":384134.298277518,"t_decision_unix":1779814999.312219,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9822227906381891,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":417,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14851,"ongoing_decode_tokens":0,"pending_prefill_tokens":14851,"num_requests":1,"active_p_offloads":0,"cached_blocks":1575,"cache_hit":0,"new_prefill":23457,"score_linear":14851.0,"score_lmetric":38308},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":23457,"score_linear":35888.0,"score_lmetric":23457},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":23457,"score_linear":294991.0,"score_lmetric":693087},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1259,"cache_hit":12800,"new_prefill":10657,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":23457,"score_linear":118179.0,"score_lmetric":106128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1313,"cache_hit":0,"new_prefill":23457,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":23457,"score_linear":56286.0,"score_lmetric":23457},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":23040,"new_prefill":417,"score_linear":163108.0,"score_lmetric":91806}],"chosen_score_linear":163108.0,"chosen_score_lmetric":91806,"t_first_token":384146.338282868,"t_first_token_unix":1779815011.352226,"t_done":384150.378272154,"t_done_unix":1779815015.3922157},{"request_id":"1382710:1:1382710:659","session_id":"1382710","input_length":3190,"t_proxy_recv":384150.867950283,"t_decision_unix":1779815015.8818915,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":5145,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":3190,"score_linear":100538.0,"score_lmetric":103728},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":3190,"score_linear":47401.0,"score_lmetric":22943},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3190,"score_linear":294991.0,"score_lmetric":632286},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":3190,"score_linear":121214.0,"score_lmetric":59652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":74960,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3190,"score_linear":74960.0,"score_lmetric":114404},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1955,"ongoing_decode_tokens":0,"pending_prefill_tokens":1955,"num_requests":1,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":3190,"score_linear":1955.0,"score_lmetric":5145},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":3190,"score_linear":38111.0,"score_lmetric":41301},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":3190,"score_linear":209865.0,"score_lmetric":9570}],"chosen_score_linear":1955.0,"chosen_score_lmetric":5145,"t_first_token":384151.085851525,"t_first_token_unix":1779815016.099795,"t_done":384151.317086297,"t_done_unix":1779815016.3310301},{"request_id":"1382804:1:1382804:660","session_id":"1382804","input_length":627,"t_proxy_recv":384151.098354319,"t_decision_unix":1779815016.1122956,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":1254,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":627,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":627,"score_linear":100538.0,"score_lmetric":101165},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":627,"score_linear":47401.0,"score_lmetric":20380},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":627,"score_linear":294991.0,"score_lmetric":624597},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":627,"score_linear":121214.0,"score_lmetric":49400},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":74960,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":627,"score_linear":74960.0,"score_lmetric":109278},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5145,"ongoing_decode_tokens":5145,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":627,"score_linear":5145.0,"score_lmetric":1254},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":627,"score_linear":38111.0,"score_lmetric":38738},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":627,"score_linear":209865.0,"score_lmetric":1881}],"chosen_score_linear":5145.0,"chosen_score_lmetric":1254,"t_first_token":384151.174530254,"t_first_token_unix":1779815016.1884737,"t_done":384151.406358811,"t_done_unix":1779815016.4203022},{"request_id":"1382667:1:1382667:658","session_id":"1382667","input_length":1955,"t_proxy_recv":384150.769700449,"t_decision_unix":1779815015.7836416,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1955,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":1955,"score_linear":100538.0,"score_lmetric":102493},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":1955,"score_linear":47401.0,"score_lmetric":21708},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1955,"score_linear":294991.0,"score_lmetric":628581},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":1955,"score_linear":121214.0,"score_lmetric":54712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":74960,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":1955,"score_linear":74960.0,"score_lmetric":111934},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":1955,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":1955,"score_linear":38111.0,"score_lmetric":40066},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":1955,"score_linear":209865.0,"score_lmetric":5865}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384150.894360195,"t_first_token_unix":1779815015.9083033,"t_done":384151.425425259,"t_done_unix":1779815016.4393692},{"request_id":"1382294:2:1383073:664","session_id":"1382294","input_length":5164,"t_proxy_recv":384151.966293852,"t_decision_unix":1779815016.9802356,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":2560,"affinity_cache_ratio":0.4957397366382649,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":7739,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":2604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":5164,"score_linear":100538.0,"score_lmetric":105702},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":5164,"score_linear":47401.0,"score_lmetric":24917},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5164,"score_linear":294991.0,"score_lmetric":638208},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":5164,"score_linear":121214.0,"score_lmetric":67548},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5164,"score_linear":134466.0,"score_lmetric":177870},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5135,"ongoing_decode_tokens":0,"pending_prefill_tokens":5135,"num_requests":1,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":2560,"new_prefill":2604,"score_linear":2575.0,"score_lmetric":7739},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":5164,"score_linear":38111.0,"score_lmetric":43275},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":5164,"score_linear":209865.0,"score_lmetric":15492}],"chosen_score_linear":2575.0,"chosen_score_lmetric":7739,"t_first_token":384152.232726966,"t_first_token_unix":1779815017.2466702,"t_done":384152.850102197,"t_done_unix":1779815017.8640456},{"request_id":"1383009:1:1383009:663","session_id":"1383009","input_length":5135,"t_proxy_recv":384151.74156537,"t_decision_unix":1779815016.7555065,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5135,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":5135,"score_linear":100538.0,"score_lmetric":105673},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":5135,"score_linear":47401.0,"score_lmetric":24888},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5135,"score_linear":294991.0,"score_lmetric":638121},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":5135,"score_linear":121214.0,"score_lmetric":67432},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5135,"score_linear":134466.0,"score_lmetric":177783},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":0,"new_prefill":5135,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":5135,"score_linear":38111.0,"score_lmetric":43246},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":5135,"score_linear":209865.0,"score_lmetric":15405}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384152.069643689,"t_first_token_unix":1779815017.0835872,"t_done":384152.869272295,"t_done_unix":1779815017.8832154},{"request_id":"1379569:4:1383116:666","session_id":"1379569","input_length":10217,"t_proxy_recv":384152.097303465,"t_decision_unix":1779815017.1112452,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":7680,"affinity_cache_ratio":0.7516883625330332,"affinity_num_requests":2,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2537,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":10217,"score_linear":100538.0,"score_lmetric":110755},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":10217,"score_linear":47401.0,"score_lmetric":29970},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10217,"score_linear":294991.0,"score_lmetric":653367},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":10217,"score_linear":121214.0,"score_lmetric":87760},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":10217,"score_linear":134466.0,"score_lmetric":193029},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10299,"ongoing_decode_tokens":5135,"pending_prefill_tokens":2604,"num_requests":2,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":7680,"new_prefill":2537,"score_linear":2619.0,"score_lmetric":10282},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":10217,"score_linear":38111.0,"score_lmetric":48328},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":219170,"ongoing_decode_tokens":209865,"pending_prefill_tokens":9305,"num_requests":4,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":10217,"score_linear":219170.0,"score_lmetric":78088}],"chosen_score_linear":2619.0,"chosen_score_lmetric":10282,"t_first_token":384152.499954612,"t_first_token_unix":1779815017.5138981,"t_done":384152.906474599,"t_done_unix":1779815017.9204175},{"request_id":"1377061:3:1380174:641","session_id":"1377061","input_length":17368,"t_proxy_recv":384141.755937721,"t_decision_unix":1779815006.7698786,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":16384,"affinity_cache_ratio":0.943344081068632,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":984,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":17368,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":17368,"score_linear":35888.0,"score_lmetric":17368},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":17368,"score_linear":294991.0,"score_lmetric":674820},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":16384,"new_prefill":984,"score_linear":56555.0,"score_lmetric":4640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18676,"ongoing_decode_tokens":18676,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":17368,"score_linear":18676.0,"score_lmetric":17368},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":17368,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":17368,"score_linear":61457.0,"score_lmetric":17368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":17368,"score_linear":209605.0,"score_lmetric":189813}],"chosen_score_linear":56555.0,"chosen_score_lmetric":4640,"t_first_token":384152.283045622,"t_first_token_unix":1779815017.2969887,"t_done":384153.072366891,"t_done_unix":1779815018.0863101},{"request_id":"1263749:2:1379302:636","session_id":"1263749","input_length":57656,"t_proxy_recv":384138.880567088,"t_decision_unix":1779815003.8945086,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":56320,"affinity_cache_ratio":0.9768280838074095,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":1336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":57656,"score_linear":35888.0,"score_lmetric":57656},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":57656,"score_linear":294991.0,"score_lmetric":795684},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":435,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":56320,"new_prefill":1336,"score_linear":-41037.0,"score_lmetric":1771},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":118179,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":57656,"score_linear":118179.0,"score_lmetric":172968},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":57656,"score_linear":209605.0,"score_lmetric":310677}],"chosen_score_linear":-41037.0,"chosen_score_lmetric":1771,"t_first_token":384152.282116332,"t_first_token_unix":1779815017.2960591,"t_done":384153.522638268,"t_done_unix":1779815018.536582},{"request_id":"1355484:9:1379722:640","session_id":"1355484","input_length":23717,"t_proxy_recv":384150.385937458,"t_decision_unix":1779815015.399879,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9930429649618417,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":165,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":23717,"score_linear":100538.0,"score_lmetric":124255},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":23717,"score_linear":47401.0,"score_lmetric":43470},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":23717,"score_linear":294991.0,"score_lmetric":693867},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":12800,"new_prefill":10917,"score_linear":108414.0,"score_lmetric":90560},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":74960,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":23717,"score_linear":74960.0,"score_lmetric":155458},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":23717,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":23717,"score_linear":38111.0,"score_lmetric":61828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":186148,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":23552,"new_prefill":165,"score_linear":162596.0,"score_lmetric":330}],"chosen_score_linear":162596.0,"chosen_score_lmetric":330,"t_first_token":384150.494171222,"t_first_token_unix":1779815015.5081146,"t_done":384153.649320115,"t_done_unix":1779815018.6632636},{"request_id":"1383090:1:1383090:665","session_id":"1383090","input_length":9305,"t_proxy_recv":384152.007768089,"t_decision_unix":1779815017.0217097,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":27915,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9305,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":9305,"score_linear":100538.0,"score_lmetric":109843},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":9305,"score_linear":47401.0,"score_lmetric":29058},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":9305,"score_linear":294991.0,"score_lmetric":650631},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":9305,"score_linear":121214.0,"score_lmetric":84112},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":9305,"score_linear":134466.0,"score_lmetric":190293},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10299,"ongoing_decode_tokens":0,"pending_prefill_tokens":7739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":0,"new_prefill":9305,"score_linear":10299.0,"score_lmetric":34088},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":9305,"score_linear":38111.0,"score_lmetric":47416},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":9305,"score_linear":209865.0,"score_lmetric":27915}],"chosen_score_linear":209865.0,"chosen_score_lmetric":27915,"t_first_token":384152.862090395,"t_first_token_unix":1779815017.8760338,"t_done":384153.702996641,"t_done_unix":1779815018.7169397},{"request_id":"1313181:5:1320817:349","session_id":"1313181","input_length":105902,"t_proxy_recv":384122.95770483,"t_decision_unix":1779814987.9716465,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60416,"affinity_cache_ratio":0.5704896980227002,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":45486,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":105902,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":19862,"ongoing_decode_tokens":0,"pending_prefill_tokens":19862,"num_requests":1,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":105902,"score_linear":19862.0,"score_lmetric":125764},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":105902,"score_linear":256950.0,"score_lmetric":624594},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18497,"ongoing_decode_tokens":0,"pending_prefill_tokens":18497,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":12800,"new_prefill":93102,"score_linear":5697.0,"score_lmetric":111599},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":105902,"score_linear":167624.0,"score_lmetric":442184},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":105902,"score_linear":168624.0,"score_lmetric":317706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":105902,"score_linear":56286.0,"score_lmetric":154508},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":60416,"new_prefill":45486,"score_linear":19830.0,"score_lmetric":45486}],"chosen_score_linear":19830.0,"chosen_score_lmetric":45486,"t_first_token":384146.336966471,"t_first_token_unix":1779815011.3509123,"t_done":384153.788545481,"t_done_unix":1779815018.802489},{"request_id":"1374465:3:1380413:642","session_id":"1374465","input_length":30907,"t_proxy_recv":384142.545758347,"t_decision_unix":1779815007.5596998,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":21504,"affinity_cache_ratio":0.6957647134953246,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":9403,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":30907,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":30907,"score_linear":35888.0,"score_lmetric":30907},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":30907,"score_linear":294991.0,"score_lmetric":715437},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":90307,"ongoing_decode_tokens":15283,"pending_prefill_tokens":2320,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":21504,"new_prefill":9403,"score_linear":68803.0,"score_lmetric":35169},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":19116,"ongoing_decode_tokens":19116,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":30907,"score_linear":19116.0,"score_lmetric":30907},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":30907,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":30907,"score_linear":61457.0,"score_lmetric":30907},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":30907,"score_linear":209605.0,"score_lmetric":230430}],"chosen_score_linear":68803.0,"chosen_score_lmetric":35169,"t_first_token":384152.774394523,"t_first_token_unix":1779815017.788338,"t_done":384153.879212639,"t_done_unix":1779815018.893156},{"request_id":"1383625:1:1383625:668","session_id":"1383625","input_length":3186,"t_proxy_recv":384153.938665501,"t_decision_unix":1779815018.9526067,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3186,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":3186,"score_linear":100538.0,"score_lmetric":103724},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":3186,"score_linear":47401.0,"score_lmetric":3186},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3186,"score_linear":294991.0,"score_lmetric":632274},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":3186,"score_linear":15283.0,"score_lmetric":3186},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3186,"score_linear":134466.0,"score_lmetric":171936},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":3186,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":3186,"score_linear":38111.0,"score_lmetric":41297},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":3186,"score_linear":141104.0,"score_lmetric":6372}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384154.133252537,"t_first_token_unix":1779815019.1471958,"t_done":384154.262760954,"t_done_unix":1779815019.2767043},{"request_id":"1382089:1:1382089:655","session_id":"1382089","input_length":38111,"t_proxy_recv":384148.62445059,"t_decision_unix":1779815013.6383917,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":38111,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":38111,"score_linear":100538.0,"score_lmetric":138649},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":38111,"score_linear":47401.0,"score_lmetric":57864},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":34816,"new_prefill":3295,"score_linear":260175.0,"score_lmetric":632601},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":38111,"score_linear":121214.0,"score_lmetric":199336},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":38111,"score_linear":20948.0,"score_lmetric":38111},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1341,"cache_hit":0,"new_prefill":38111,"score_linear":13989.0,"score_lmetric":38111},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":38111,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":38111,"score_linear":209605.0,"score_lmetric":114333}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384154.498179619,"t_first_token_unix":1779815019.5121236,"t_done":384154.636840387,"t_done_unix":1779815019.650784},{"request_id":"1383625:2:1384279:673","session_id":"1383625","input_length":4150,"t_proxy_recv":384156.35801396,"t_decision_unix":1779815021.3719552,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":3072,"affinity_cache_ratio":0.7402409638554217,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":1078,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":4150,"score_linear":100538.0,"score_lmetric":104688},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":4150,"score_linear":47401.0,"score_lmetric":4150},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4150,"score_linear":294991.0,"score_lmetric":635166},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":4150,"score_linear":15283.0,"score_lmetric":4150},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4150,"score_linear":203931.0,"score_lmetric":246772},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":0,"pending_prefill_tokens":14559,"num_requests":1,"active_p_offloads":0,"cached_blocks":1408,"cache_hit":3072,"new_prefill":1078,"score_linear":25311.0,"score_lmetric":15637},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":20197,"num_requests":1,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":4150,"score_linear":21221.0,"score_lmetric":24347},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":4150,"score_linear":141104.0,"score_lmetric":8300}],"chosen_score_linear":25311.0,"chosen_score_lmetric":15637,"t_first_token":384156.744469232,"t_first_token_unix":1779815021.7584133,"t_done":384156.930393339,"t_done_unix":1779815021.9443367},{"request_id":"1382667:2:1384299:674","session_id":"1382667","input_length":5989,"t_proxy_recv":384156.426882538,"t_decision_unix":1779815021.440824,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.2564701953581566,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":5989,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":5989,"score_linear":100538.0,"score_lmetric":106527},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":5989,"score_linear":47401.0,"score_lmetric":5989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5989,"score_linear":294991.0,"score_lmetric":640683},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":5989,"score_linear":15283.0,"score_lmetric":5989},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5989,"score_linear":203931.0,"score_lmetric":254128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32533,"ongoing_decode_tokens":0,"pending_prefill_tokens":15637,"num_requests":2,"active_p_offloads":0,"cached_blocks":1408,"cache_hit":1536,"new_prefill":4453,"score_linear":30997.0,"score_lmetric":40180},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":20197,"num_requests":1,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":5989,"score_linear":21221.0,"score_lmetric":26186},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":5989,"score_linear":141104.0,"score_lmetric":11978}],"chosen_score_linear":15283.0,"chosen_score_lmetric":5989,"t_first_token":384156.817722812,"t_first_token_unix":1779815021.8316662,"t_done":384157.225870656,"t_done_unix":1779815022.2398138},{"request_id":"1384772:1:1384772:677","session_id":"1384772","input_length":4690,"t_proxy_recv":384157.884796247,"t_decision_unix":1779815022.8987374,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":4690,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4690,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":4690,"score_linear":150403.0,"score_lmetric":210858},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":4690,"score_linear":47401.0,"score_lmetric":4690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4690,"score_linear":294991.0,"score_lmetric":636786},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":0,"new_prefill":4690,"score_linear":15283.0,"score_lmetric":4690},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4690,"score_linear":203931.0,"score_lmetric":248932},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":28383,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":4690,"score_linear":28383.0,"score_lmetric":4690},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":20197,"num_requests":1,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":4690,"score_linear":21221.0,"score_lmetric":24887},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":166330,"ongoing_decode_tokens":166330,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":4690,"score_linear":166330.0,"score_lmetric":14070}],"chosen_score_linear":28383.0,"chosen_score_lmetric":4690,"t_first_token":384158.186567788,"t_first_token_unix":1779815023.2005122,"t_done":384158.382269057,"t_done_unix":1779815023.3962142},{"request_id":"1383009:2:1384930:679","session_id":"1383009","input_length":11113,"t_proxy_recv":384158.396127521,"t_decision_unix":1779815023.410069,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.46072167731485647,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":5993,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":5993,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":11113,"score_linear":150403.0,"score_lmetric":223704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":11113,"score_linear":47401.0,"score_lmetric":11113},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11113,"score_linear":294991.0,"score_lmetric":656055},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":0,"new_prefill":11113,"score_linear":15283.0,"score_lmetric":11113},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":11113,"score_linear":203931.0,"score_lmetric":274624},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":28383,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1419,"cache_hit":5120,"new_prefill":5993,"score_linear":23263.0,"score_lmetric":5993},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":11113,"score_linear":106405.0,"score_lmetric":68690},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":166330,"ongoing_decode_tokens":166330,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":11113,"score_linear":166330.0,"score_lmetric":33339}],"chosen_score_linear":23263.0,"chosen_score_lmetric":5993,"t_first_token":384158.963518589,"t_first_token_unix":1779815023.9774628,"t_done":384159.196253998,"t_done_unix":1779815024.2101977},{"request_id":"1381387:2:1383735:669","session_id":"1381387","input_length":28383,"t_proxy_recv":384154.258982308,"t_decision_unix":1779815019.2729235,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.4870521086565902,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":14559,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":14559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":28383,"score_linear":100538.0,"score_lmetric":128921},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":28383,"score_linear":47401.0,"score_lmetric":28383},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":28383,"score_linear":294991.0,"score_lmetric":707865},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":28383,"score_linear":15283.0,"score_lmetric":28383},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":28383,"score_linear":134466.0,"score_lmetric":247527},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":3186,"ongoing_decode_tokens":3186,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":13824,"new_prefill":14559,"score_linear":-10638.0,"score_lmetric":14559},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":28383,"score_linear":38111.0,"score_lmetric":66494},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":28383,"score_linear":141104.0,"score_lmetric":56766}],"chosen_score_linear":-10638.0,"chosen_score_lmetric":14559,"t_first_token":384156.632297934,"t_first_token_unix":1779815021.646242,"t_done":384159.437366242,"t_done_unix":1779815024.45131},{"request_id":"1364090:3:1381959:653","session_id":"1364090","input_length":47401,"t_proxy_recv":384148.134070561,"t_decision_unix":1779815013.1480117,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":27648,"affinity_cache_ratio":0.5832788337798781,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":19753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":7680,"new_prefill":39721,"score_linear":92858.0,"score_lmetric":140259},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":27648,"new_prefill":19753,"score_linear":-27648.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":39721,"score_linear":287311.0,"score_lmetric":741879},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":47401,"score_linear":121214.0,"score_lmetric":236496},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":80322,"ongoing_decode_tokens":80322,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":4096,"new_prefill":43305,"score_linear":76226.0,"score_lmetric":86610},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1341,"cache_hit":7680,"new_prefill":39721,"score_linear":6309.0,"score_lmetric":39721},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":11264,"new_prefill":36137,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":11264,"new_prefill":36137,"score_linear":198341.0,"score_lmetric":108411}],"chosen_score_linear":-27648.0,"chosen_score_lmetric":0,"t_first_token":384153.260410025,"t_first_token_unix":1779815018.2743542,"t_done":384159.46580575,"t_done_unix":1779815024.4797492},{"request_id":"1384947:1:1384947:680","session_id":"1384947","input_length":19034,"t_proxy_recv":384158.452355944,"t_decision_unix":1779815023.4662974,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":19034,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19034,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":19034,"score_linear":150403.0,"score_lmetric":239546},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":19034,"score_linear":47401.0,"score_lmetric":19034},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":19034,"score_linear":294991.0,"score_lmetric":679818},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":0,"new_prefill":19034,"score_linear":15283.0,"score_lmetric":19034},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":19034,"score_linear":203931.0,"score_lmetric":306308},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":39496,"ongoing_decode_tokens":28383,"pending_prefill_tokens":5993,"num_requests":2,"active_p_offloads":0,"cached_blocks":1419,"cache_hit":0,"new_prefill":19034,"score_linear":39496.0,"score_lmetric":50054},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":19034,"score_linear":106405.0,"score_lmetric":84532},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":166330,"ongoing_decode_tokens":166330,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":19034,"score_linear":166330.0,"score_lmetric":57102}],"chosen_score_linear":15283.0,"chosen_score_lmetric":19034,"t_first_token":384160.366588851,"t_first_token_unix":1779815025.3805327,"t_done":384160.689672585,"t_done_unix":1779815025.703616},{"request_id":"1383090:2:1385262:682","session_id":"1383090","input_length":16734,"t_proxy_recv":384159.64073331,"t_decision_unix":1779815024.6546748,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.5507350304768734,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":7518,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":16734,"score_linear":150403.0,"score_lmetric":234946},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":16734,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":16734,"score_linear":294991.0,"score_lmetric":672918},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":34317,"ongoing_decode_tokens":15283,"pending_prefill_tokens":19034,"num_requests":2,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":0,"new_prefill":16734,"score_linear":34317.0,"score_lmetric":71536},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":16734,"score_linear":203931.0,"score_lmetric":80604},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":16734,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":16734,"score_linear":106405.0,"score_lmetric":79932},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":166330,"ongoing_decode_tokens":166330,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":9216,"new_prefill":7518,"score_linear":157114.0,"score_lmetric":22554}],"chosen_score_linear":157114.0,"chosen_score_lmetric":22554,"t_first_token":384160.551845469,"t_first_token_unix":1779815025.565789,"t_done":384161.331097533,"t_done_unix":1779815026.3450415},{"request_id":"1355484:10:1384484:675","session_id":"1355484","input_length":25226,"t_proxy_recv":384157.029285313,"t_decision_unix":1779815022.0432267,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9336398953460715,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":1674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":25226,"score_linear":100538.0,"score_lmetric":125764},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":25226,"score_linear":47401.0,"score_lmetric":25226},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":25226,"score_linear":294991.0,"score_lmetric":698394},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21272,"ongoing_decode_tokens":21272,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":12800,"new_prefill":12426,"score_linear":8472.0,"score_lmetric":24852},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":25226,"score_linear":203931.0,"score_lmetric":331076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":28383,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":25226,"score_linear":28383.0,"score_lmetric":25226},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":20197,"num_requests":1,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":25226,"score_linear":21221.0,"score_lmetric":45423},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":23552,"new_prefill":1674,"score_linear":117552.0,"score_lmetric":3348}],"chosen_score_linear":117552.0,"chosen_score_lmetric":3348,"t_first_token":384157.363644653,"t_first_token_unix":1779815022.3775887,"t_done":384161.99281221,"t_done_unix":1779815027.0067556},{"request_id":"1313181:5:1374956:615","session_id":"1313181","input_length":60858,"t_proxy_recv":384153.799335625,"t_decision_unix":1779815018.8132772,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60416,"affinity_cache_ratio":0.9927371914949554,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":442,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":60858,"score_linear":100538.0,"score_lmetric":161396},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":60858,"score_linear":47401.0,"score_lmetric":60858},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":60858,"score_linear":294991.0,"score_lmetric":805290},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":46190,"ongoing_decode_tokens":46190,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1264,"cache_hit":12800,"new_prefill":48058,"score_linear":33390.0,"score_lmetric":96116},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":60858,"score_linear":134466.0,"score_lmetric":344952},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":0,"new_prefill":60858,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":60858,"score_linear":38111.0,"score_lmetric":98969},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":60416,"new_prefill":442,"score_linear":19830.0,"score_lmetric":442}],"chosen_score_linear":19830.0,"chosen_score_lmetric":442,"t_first_token":384153.896966023,"t_first_token_unix":1779815018.9109097,"t_done":384164.453554477,"t_done_unix":1779815029.4674985},{"request_id":"1381728:2:1387040:690","session_id":"1381728","input_length":12399,"t_proxy_recv":384165.67350892,"t_decision_unix":1779815030.6874502,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":1,"affinity_cache_hit":1024,"affinity_cache_ratio":0.08258730542785708,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":12399,"score_linear":150403.0,"score_lmetric":226276},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":12399,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":12399,"score_linear":294991.0,"score_lmetric":659913},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":12399,"score_linear":15283.0,"score_lmetric":12399},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":12399,"score_linear":203931.0,"score_lmetric":63264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":12399,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":1024,"new_prefill":11375,"score_linear":105381.0,"score_lmetric":69214},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186551,"ongoing_decode_tokens":80246,"pending_prefill_tokens":44865,"num_requests":2,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":12399,"score_linear":186551.0,"score_lmetric":114528}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384166.695998451,"t_first_token_unix":1779815031.709949,"t_done":384166.781098412,"t_done_unix":1779815031.7950413},{"request_id":"1384772:2:1387335:693","session_id":"1384772","input_length":11530,"t_proxy_recv":384166.773108576,"t_decision_unix":1779815031.78705,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":3,"affinity_cache_hit":4608,"affinity_cache_ratio":0.39965307892454466,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":11530,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":11530,"score_linear":150403.0,"score_lmetric":224538},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":12399,"ongoing_decode_tokens":12399,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":11530,"score_linear":12399.0,"score_lmetric":11530},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11530,"score_linear":294991.0,"score_lmetric":657306},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":11530,"score_linear":15283.0,"score_lmetric":11530},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":11530,"score_linear":203931.0,"score_lmetric":59788},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":4608,"new_prefill":6922,"score_linear":46185.0,"score_lmetric":29555},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":11530,"score_linear":106405.0,"score_lmetric":69524},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186551,"ongoing_decode_tokens":80246,"pending_prefill_tokens":44865,"num_requests":2,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":11530,"score_linear":186551.0,"score_lmetric":112790}],"chosen_score_linear":15283.0,"chosen_score_lmetric":11530,"t_first_token":384167.695348735,"t_first_token_unix":1779815032.7092927,"t_done":384167.775816052,"t_done_unix":1779815032.7897594},{"request_id":"1340290:3:1384149:672","session_id":"1340290","input_length":21221,"t_proxy_recv":384155.88170237,"t_decision_unix":1779815020.8956437,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":6,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9892088026011969,"affinity_num_requests":4,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":20197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":21221,"score_linear":100538.0,"score_lmetric":121759},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":21221,"score_linear":47401.0,"score_lmetric":21221},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":21221,"score_linear":294991.0,"score_lmetric":686379},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":21221,"score_linear":15283.0,"score_lmetric":21221},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":20992,"new_prefill":229,"score_linear":182939.0,"score_lmetric":231088},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":0,"pending_prefill_tokens":14559,"num_requests":1,"active_p_offloads":0,"cached_blocks":1408,"cache_hit":0,"new_prefill":21221,"score_linear":28383.0,"score_lmetric":35780},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":1024,"new_prefill":20197,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":21221,"score_linear":141104.0,"score_lmetric":42442}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":384158.134699302,"t_first_token_unix":1779815023.148643,"t_done":384170.860428862,"t_done_unix":1779815035.874375},{"request_id":"1382804:2:1388620:698","session_id":"1382804","input_length":3678,"t_proxy_recv":384171.382784816,"t_decision_unix":1779815036.3967261,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":3,"affinity_cache_hit":512,"affinity_cache_ratio":0.13920609026644915,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":3678,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3678,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":3678,"score_linear":150403.0,"score_lmetric":208834},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":3678,"score_linear":71899.0,"score_lmetric":75577},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3678,"score_linear":294991.0,"score_lmetric":254730},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1352,"cache_hit":0,"new_prefill":3678,"score_linear":15283.0,"score_lmetric":3678},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3678,"score_linear":203931.0,"score_lmetric":28380},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":512,"new_prefill":3166,"score_linear":50281.0,"score_lmetric":25799},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":111330,"ongoing_decode_tokens":85184,"pending_prefill_tokens":5154,"num_requests":2,"active_p_offloads":0,"cached_blocks":2168,"cache_hit":0,"new_prefill":3678,"score_linear":111330.0,"score_lmetric":17664},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":3678,"score_linear":213388.0,"score_lmetric":150876}],"chosen_score_linear":15283.0,"chosen_score_lmetric":3678,"t_first_token":384171.612577967,"t_first_token_unix":1779815036.6265213,"t_done":384171.684309693,"t_done_unix":1779815036.698253},{"request_id":"1340290:4:1385568:684","session_id":"1340290","input_length":26146,"t_proxy_recv":384170.867907465,"t_decision_unix":1779815035.881849,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":20992,"affinity_cache_ratio":0.8028761569647365,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":5154,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":26146,"score_linear":150403.0,"score_lmetric":253770},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":26146,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":26146,"score_linear":294991.0,"score_lmetric":322134},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1352,"cache_hit":0,"new_prefill":26146,"score_linear":15283.0,"score_lmetric":26146},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":20992,"new_prefill":5154,"score_linear":182939.0,"score_lmetric":34284},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":26146,"score_linear":50793.0,"score_lmetric":48779},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2168,"cache_hit":20992,"new_prefill":5154,"score_linear":64192.0,"score_lmetric":5154},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":26146,"score_linear":213388.0,"score_lmetric":218280}],"chosen_score_linear":64192.0,"chosen_score_lmetric":5154,"t_first_token":384171.776169189,"t_first_token_unix":1779815036.7901123,"t_done":384172.359508794,"t_done_unix":1779815037.3734534},{"request_id":"1340290:5:1386504:688","session_id":"1340290","input_length":27220,"t_proxy_recv":384172.366379234,"t_decision_unix":1779815037.3803205,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9592946362968405,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":27220,"score_linear":150403.0,"score_lmetric":255918},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":27220,"score_linear":71899.0,"score_lmetric":99119},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":27220,"score_linear":294991.0,"score_lmetric":325356},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":35466,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1239,"num_requests":2,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":27220,"score_linear":35466.0,"score_lmetric":56918},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":20992,"new_prefill":6228,"score_linear":182939.0,"score_lmetric":38580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":50793,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":27220,"score_linear":50793.0,"score_lmetric":27220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2178,"cache_hit":26112,"new_prefill":1108,"score_linear":59072.0,"score_lmetric":1108},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":27220,"score_linear":213388.0,"score_lmetric":221502}],"chosen_score_linear":59072.0,"chosen_score_lmetric":1108,"t_first_token":384172.654043575,"t_first_token_unix":1779815037.6679873,"t_done":384173.041919536,"t_done_unix":1779815038.0558631},{"request_id":"1384947:2:1388842:700","session_id":"1384947","input_length":20183,"t_proxy_recv":384172.142620686,"t_decision_unix":1779815037.156562,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9386117029182975,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":1239,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":20183,"score_linear":150403.0,"score_lmetric":241844},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":20183,"score_linear":71899.0,"score_lmetric":92082},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":20183,"score_linear":294991.0,"score_lmetric":304245},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":18944,"new_prefill":1239,"score_linear":-3661.0,"score_lmetric":1239},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":20183,"score_linear":203931.0,"score_lmetric":94400},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":50793,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":20183,"score_linear":50793.0,"score_lmetric":20183},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":111330,"ongoing_decode_tokens":111330,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2168,"cache_hit":0,"new_prefill":20183,"score_linear":111330.0,"score_lmetric":40366},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":20183,"score_linear":213388.0,"score_lmetric":200391}],"chosen_score_linear":-3661.0,"chosen_score_lmetric":1239,"t_first_token":384172.373486617,"t_first_token_unix":1779815037.38743,"t_done":384173.700409373,"t_done_unix":1779815038.7143548},{"request_id":"1381387:3:1387093:691","session_id":"1381387","input_length":50793,"t_proxy_recv":384165.885919849,"t_decision_unix":1779815030.8998613,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":28160,"affinity_cache_ratio":0.5544071033410115,"affinity_num_requests":0,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":22633,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":50793,"score_linear":150403.0,"score_lmetric":303064},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":12399,"ongoing_decode_tokens":0,"pending_prefill_tokens":12399,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":50793,"score_linear":12399.0,"score_lmetric":63192},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":50793,"score_linear":294991.0,"score_lmetric":775095},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":50793,"score_linear":15283.0,"score_lmetric":50793},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":50793,"score_linear":203931.0,"score_lmetric":216840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":28160,"new_prefill":22633,"score_linear":-28160.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":50793,"score_linear":106405.0,"score_lmetric":148050},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186551,"ongoing_decode_tokens":80246,"pending_prefill_tokens":44865,"num_requests":2,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":50793,"score_linear":186551.0,"score_lmetric":191316}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":384171.889135514,"t_first_token_unix":1779815036.9030795,"t_done":384173.916862502,"t_done_unix":1779815038.9308062},{"request_id":"1340290:6:1387365:695","session_id":"1340290","input_length":27285,"t_proxy_recv":384173.047884034,"t_decision_unix":1779815038.0618255,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9945391240608393,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":149,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":27285,"score_linear":150403.0,"score_lmetric":256048},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":27285,"score_linear":71899.0,"score_lmetric":99184},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":27285,"score_linear":294991.0,"score_lmetric":325551},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":35466,"ongoing_decode_tokens":35466,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":27285,"score_linear":35466.0,"score_lmetric":54570},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":20992,"new_prefill":6293,"score_linear":182939.0,"score_lmetric":38840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":50793,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":27285,"score_linear":50793.0,"score_lmetric":27285},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2180,"cache_hit":27136,"new_prefill":149,"score_linear":58048.0,"score_lmetric":149},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":27285,"score_linear":213388.0,"score_lmetric":221697}],"chosen_score_linear":58048.0,"chosen_score_lmetric":149,"t_first_token":384173.11880789,"t_first_token_unix":1779815038.1327527,"t_done":384175.171212217,"t_done_unix":1779815040.1851559},{"request_id":"1378979:1:1378979:633","session_id":"1378979","input_length":15283,"t_proxy_recv":384137.667264466,"t_decision_unix":1779815002.681206,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":15283,"score_linear":35888.0,"score_lmetric":15283},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":15283,"score_linear":294991.0,"score_lmetric":668565},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":14848,"new_prefill":435,"score_linear":-14848.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":118179,"ongoing_decode_tokens":59668,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":0,"new_prefill":15283,"score_linear":118179.0,"score_lmetric":81606},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2041,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":15283,"score_linear":209605.0,"score_lmetric":183558}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":384139.018407684,"t_first_token_unix":1779815004.0323517,"t_done":384175.456392574,"t_done_unix":1779815040.4703362},{"request_id":"1370129:4:1384856:678","session_id":"1370129","input_length":85184,"t_proxy_recv":384158.165665114,"t_decision_unix":1779815023.1796064,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":61952,"affinity_cache_ratio":0.7272727272727273,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":23232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":7680,"new_prefill":77504,"score_linear":142723.0,"score_lmetric":356486},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":18432,"new_prefill":66752,"score_linear":28969.0,"score_lmetric":66752},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":77504,"score_linear":287311.0,"score_lmetric":855228},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1293,"cache_hit":0,"new_prefill":85184,"score_linear":15283.0,"score_lmetric":85184},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":4096,"new_prefill":81088,"score_linear":199835.0,"score_lmetric":554524},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33073,"ongoing_decode_tokens":28383,"pending_prefill_tokens":4690,"num_requests":2,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":7680,"new_prefill":77504,"score_linear":25393.0,"score_lmetric":164388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21221,"ongoing_decode_tokens":21221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":61952,"new_prefill":23232,"score_linear":-40731.0,"score_lmetric":23232},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":166330,"ongoing_decode_tokens":166330,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":7680,"new_prefill":77504,"score_linear":158650.0,"score_lmetric":232512}],"chosen_score_linear":-40731.0,"chosen_score_lmetric":23232,"t_first_token":384168.886892751,"t_first_token_unix":1779815033.900836,"t_done":384176.422877393,"t_done_unix":1779815041.4368212},{"request_id":"1366128:10:1382843:661","session_id":"1366128","input_length":59506,"t_proxy_recv":384151.252274128,"t_decision_unix":1779815016.2662153,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":59392,"affinity_cache_ratio":0.9980842268006588,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":114,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":59506,"score_linear":100538.0,"score_lmetric":160044},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":59506,"score_linear":47401.0,"score_lmetric":79259},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":59506,"score_linear":294991.0,"score_lmetric":801234},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":59506,"score_linear":121214.0,"score_lmetric":284916},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":74960,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":59392,"new_prefill":114,"score_linear":15568.0,"score_lmetric":108252},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5772,"ongoing_decode_tokens":5772,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":59506,"score_linear":5772.0,"score_lmetric":178518},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":59506,"score_linear":38111.0,"score_lmetric":97617},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209865,"ongoing_decode_tokens":209865,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":0,"new_prefill":59506,"score_linear":209865.0,"score_lmetric":178518}],"chosen_score_linear":15568.0,"chosen_score_lmetric":108252,"t_first_token":384159.456060358,"t_first_token_unix":1779815024.4700036,"t_done":384177.253484454,"t_done_unix":1779815042.2674282},{"request_id":"1390240:1:1390240:705","session_id":"1390240","input_length":5110,"t_proxy_recv":384177.318960132,"t_decision_unix":1779815042.3329015,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5110,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":150403,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":5110,"score_linear":150403.0,"score_lmetric":10220},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":5110,"score_linear":71899.0,"score_lmetric":77009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5110,"score_linear":294991.0,"score_lmetric":259026},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1362,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5110,"score_linear":215679.0,"score_lmetric":67888},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":5110,"score_linear":213388.0,"score_lmetric":155172}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384177.640811011,"t_first_token_unix":1779815042.6547544,"t_done":384177.911485944,"t_done_unix":1779815042.925429},{"request_id":"1340278:3:1384549:676","session_id":"1340278","input_length":49865,"t_proxy_recv":384157.195857795,"t_decision_unix":1779815022.2097986,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9959691166148601,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":201,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":49664,"new_prefill":201,"score_linear":50874.0,"score_lmetric":100739},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":49865,"score_linear":47401.0,"score_lmetric":49865},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":49865,"score_linear":294991.0,"score_lmetric":772311},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21272,"ongoing_decode_tokens":21272,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":49865,"score_linear":21272.0,"score_lmetric":99730},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":20948,"pending_prefill_tokens":57543,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":49865,"score_linear":203931.0,"score_lmetric":429632},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":28383,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1410,"cache_hit":0,"new_prefill":49865,"score_linear":28383.0,"score_lmetric":49865},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":20197,"num_requests":1,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":49865,"score_linear":21221.0,"score_lmetric":70062},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":166330,"ongoing_decode_tokens":141104,"pending_prefill_tokens":1674,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":49865,"score_linear":166330.0,"score_lmetric":154617}],"chosen_score_linear":50874.0,"chosen_score_lmetric":100739,"t_first_token":384176.962941945,"t_first_token_unix":1779815041.9768853,"t_done":384178.815477142,"t_done_unix":1779815043.8294206},{"request_id":"1340278:3:1385417:683","session_id":"1340278","input_length":50272,"t_proxy_recv":384178.856182496,"t_decision_unix":1779815043.8701239,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9879057924888606,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":608,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":100538,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":49664,"new_prefill":608,"score_linear":50874.0,"score_lmetric":608},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":50272,"score_linear":71899.0,"score_lmetric":122171},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":50272,"score_linear":294991.0,"score_lmetric":394512},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":50272,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":50272,"score_linear":215679.0,"score_lmetric":248536},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":50272,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89036,"ongoing_decode_tokens":1349,"pending_prefill_tokens":2183,"num_requests":2,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":50272,"score_linear":89036.0,"score_lmetric":104910},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":50272,"score_linear":213388.0,"score_lmetric":290658}],"chosen_score_linear":50874.0,"chosen_score_lmetric":608,"t_first_token":384179.038279811,"t_first_token_unix":1779815044.0522232,"t_done":384179.062996766,"t_done_unix":1779815044.0769403},{"request_id":"1279412:27:1380696:646","session_id":"1279412","input_length":100538,"t_proxy_recv":384143.702848889,"t_decision_unix":1779815008.7167902,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":0,"affinity_cache_hit":100352,"affinity_cache_ratio":0.9981499532515069,"affinity_num_requests":4,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":100538,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":100538,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":100538,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":100538,"score_linear":294991.0,"score_lmetric":924330},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":100352,"new_prefill":186,"score_linear":20862.0,"score_lmetric":47636},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79957,"ongoing_decode_tokens":79957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":100538,"score_linear":79957.0,"score_lmetric":201076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6767,"ongoing_decode_tokens":6767,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":100538,"score_linear":6767.0,"score_lmetric":100538},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":100538,"score_linear":61457.0,"score_lmetric":100538},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":12800,"new_prefill":87738,"score_linear":196805.0,"score_lmetric":400923}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384176.960455176,"t_first_token_unix":1779815041.9743986,"t_done":384179.506613341,"t_done_unix":1779815044.5205576},{"request_id":"1384947:3:1390898:710","session_id":"1384947","input_length":20683,"t_proxy_recv":384179.984356955,"t_decision_unix":1779815044.9982986,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9654305468258957,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":715,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100766,"ongoing_decode_tokens":100766,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":20683,"score_linear":100766.0,"score_lmetric":20683},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":20683,"score_linear":71899.0,"score_lmetric":92582},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":20683,"score_linear":294991.0,"score_lmetric":305745},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":19968,"new_prefill":715,"score_linear":-19968.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":20683,"score_linear":215679.0,"score_lmetric":130180},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":20683,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89036,"ongoing_decode_tokens":89036,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":20683,"score_linear":89036.0,"score_lmetric":41366},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":20683,"score_linear":213388.0,"score_lmetric":201891}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":384180.118094725,"t_first_token_unix":1779815045.1320379,"t_done":384181.280921713,"t_done_unix":1779815046.2948651},{"request_id":"1279412:28:1382526:657","session_id":"1279412","input_length":100766,"t_proxy_recv":384179.523773208,"t_decision_unix":1779815044.5377142,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":100352,"affinity_cache_ratio":0.9958914713296152,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":100352,"estimated_new_tokens":414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":100352,"new_prefill":414,"score_linear":-100352.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":100766,"score_linear":71899.0,"score_lmetric":172665},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":100766,"score_linear":294991.0,"score_lmetric":545994},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":100352,"new_prefill":414,"score_linear":-100352.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":100766,"score_linear":215679.0,"score_lmetric":450512},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":100766,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89036,"ongoing_decode_tokens":1349,"pending_prefill_tokens":2183,"num_requests":2,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":100766,"score_linear":89036.0,"score_lmetric":205898},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":12800,"new_prefill":87966,"score_linear":200588.0,"score_lmetric":403740}],"chosen_score_linear":-100352.0,"chosen_score_lmetric":0,"t_first_token":384179.679164794,"t_first_token_unix":1779815044.6931086,"t_done":384181.748185482,"t_done_unix":1779815046.7621326},{"request_id":"1390356:1:1390356:706","session_id":"1390356","input_length":1349,"t_proxy_recv":384177.760642356,"t_decision_unix":1779815042.7745836,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1349,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":150403,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":1349,"score_linear":150403.0,"score_lmetric":2698},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":1349,"score_linear":71899.0,"score_lmetric":73248},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1349,"score_linear":294991.0,"score_lmetric":247743},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":5110,"ongoing_decode_tokens":5110,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1362,"cache_hit":0,"new_prefill":1349,"score_linear":5110.0,"score_lmetric":1349},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":1349,"score_linear":215679.0,"score_lmetric":52844},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":1349,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":1349,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":1349,"score_linear":213388.0,"score_lmetric":143889}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384177.855740613,"t_first_token_unix":1779815042.8696837,"t_done":384182.134374604,"t_done_unix":1779815047.1483178},{"request_id":"1279412:29:1385688:685","session_id":"1279412","input_length":101200,"t_proxy_recv":384181.764380321,"t_decision_unix":1779815046.7783217,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":100864,"affinity_cache_ratio":0.9966798418972332,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":100864,"estimated_new_tokens":336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":100864,"new_prefill":336,"score_linear":-100864.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":101200,"score_linear":71899.0,"score_lmetric":173099},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":101200,"score_linear":294991.0,"score_lmetric":547296},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1373,"cache_hit":100352,"new_prefill":848,"score_linear":-100352.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":101200,"score_linear":215679.0,"score_lmetric":452248},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":25747,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":101200,"score_linear":28307.0,"score_lmetric":126947},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89036,"ongoing_decode_tokens":89036,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":101200,"score_linear":89036.0,"score_lmetric":202400},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":12800,"new_prefill":88400,"score_linear":200588.0,"score_lmetric":405042}],"chosen_score_linear":-100864.0,"chosen_score_lmetric":0,"t_first_token":384182.08034041,"t_first_token_unix":1779815047.094284,"t_done":384182.780391992,"t_done_unix":1779815047.7943358},{"request_id":"1342921:3:1384020:670","session_id":"1342921","input_length":69465,"t_proxy_recv":384155.31516617,"t_decision_unix":1779815020.3291075,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":66048,"affinity_cache_ratio":0.950809760310948,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":66048,"estimated_new_tokens":3417,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":69465,"score_linear":100538.0,"score_lmetric":170003},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":69465,"score_linear":47401.0,"score_lmetric":69465},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":69465,"score_linear":294991.0,"score_lmetric":831111},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":0,"new_prefill":69465,"score_linear":15283.0,"score_lmetric":69465},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134466,"ongoing_decode_tokens":20948,"pending_prefill_tokens":54126,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":66048,"new_prefill":3417,"score_linear":68418.0,"score_lmetric":172629},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":0,"pending_prefill_tokens":14559,"num_requests":1,"active_p_offloads":0,"cached_blocks":1408,"cache_hit":0,"new_prefill":69465,"score_linear":28383.0,"score_lmetric":84024},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":69465,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141104,"ongoing_decode_tokens":141104,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":69465,"score_linear":141104.0,"score_lmetric":138930}],"chosen_score_linear":68418.0,"chosen_score_lmetric":172629,"t_first_token":384176.296372406,"t_first_token_unix":1779815041.3103163,"t_done":384183.241734732,"t_done_unix":1779815048.2556782},{"request_id":"1391584:1:1391584:713","session_id":"1391584","input_length":15302,"t_proxy_recv":384181.832618883,"t_decision_unix":1779815046.84656,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":15302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101200,"ongoing_decode_tokens":0,"pending_prefill_tokens":336,"num_requests":1,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":0,"new_prefill":15302,"score_linear":101200.0,"score_lmetric":15638},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":15302,"score_linear":71899.0,"score_lmetric":87201},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":15302,"score_linear":294991.0,"score_lmetric":289602},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1373,"cache_hit":0,"new_prefill":15302,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":15302,"score_linear":215679.0,"score_lmetric":108656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":25747,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":15302,"score_linear":28307.0,"score_lmetric":41049},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89036,"ongoing_decode_tokens":89036,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":15302,"score_linear":89036.0,"score_lmetric":30604},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":15302,"score_linear":213388.0,"score_lmetric":185748}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384183.189773313,"t_first_token_unix":1779815048.2037163,"t_done":384183.402200546,"t_done_unix":1779815048.416144},{"request_id":"1279412:30:1387344:694","session_id":"1279412","input_length":101396,"t_proxy_recv":384182.799143452,"t_decision_unix":1779815047.8130848,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":100864,"affinity_cache_ratio":0.9947532447039331,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":100864,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":100864,"new_prefill":532,"score_linear":-100864.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":101396,"score_linear":71899.0,"score_lmetric":173295},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":101396,"score_linear":294991.0,"score_lmetric":547884},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15302,"ongoing_decode_tokens":0,"pending_prefill_tokens":15302,"num_requests":1,"active_p_offloads":0,"cached_blocks":1373,"cache_hit":100352,"new_prefill":1044,"score_linear":-85050.0,"score_lmetric":16346},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":215679,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":101396,"score_linear":215679.0,"score_lmetric":405584},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":25747,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":101396,"score_linear":28307.0,"score_lmetric":127143},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2229,"cache_hit":0,"new_prefill":101396,"score_linear":87687.0,"score_lmetric":101396},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":12800,"new_prefill":88596,"score_linear":200588.0,"score_lmetric":405630}],"chosen_score_linear":-100864.0,"chosen_score_lmetric":0,"t_first_token":384183.023449121,"t_first_token_unix":1779815048.0373926,"t_done":384183.817009525,"t_done_unix":1779815048.830954},{"request_id":"1370129:5:1390477:708","session_id":"1370129","input_length":87687,"t_proxy_recv":384178.290181294,"t_decision_unix":1779815043.3041227,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9751046335260642,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":2183,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":150403,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":7680,"new_prefill":80007,"score_linear":142723.0,"score_lmetric":160014},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":18432,"new_prefill":69255,"score_linear":53467.0,"score_lmetric":141154},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":80007,"score_linear":287311.0,"score_lmetric":483717},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":87687,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":4096,"new_prefill":83591,"score_linear":211583.0,"score_lmetric":381812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":7680,"new_prefill":80007,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":1349,"ongoing_decode_tokens":1349,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":85504,"new_prefill":2183,"score_linear":-84155.0,"score_lmetric":2183},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":7680,"new_prefill":80007,"score_linear":205708.0,"score_lmetric":379863}],"chosen_score_linear":-84155.0,"chosen_score_lmetric":2183,"t_first_token":384179.534190058,"t_first_token_unix":1779815044.5481334,"t_done":384184.257156975,"t_done_unix":1779815049.271101},{"request_id":"1382086:1:1382086:654","session_id":"1382086","input_length":54012,"t_proxy_recv":384148.631308847,"t_decision_unix":1779815013.6452506,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":54012,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":54012,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":54012,"score_linear":100538.0,"score_lmetric":154550},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":54012,"score_linear":47401.0,"score_lmetric":73765},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":54012,"score_linear":294991.0,"score_lmetric":784752},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":54012,"score_linear":121214.0,"score_lmetric":262940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":54012,"score_linear":20948.0,"score_lmetric":54012},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1341,"cache_hit":0,"new_prefill":54012,"score_linear":13989.0,"score_lmetric":54012},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":2055,"cache_hit":0,"new_prefill":54012,"score_linear":38111.0,"score_lmetric":92123},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":209605,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":54012,"score_linear":209605.0,"score_lmetric":162036}],"chosen_score_linear":20948.0,"chosen_score_lmetric":54012,"t_first_token":384159.451187997,"t_first_token_unix":1779815024.4651318,"t_done":384184.362861657,"t_done_unix":1779815049.376805},{"request_id":"1391584:2:1392466:715","session_id":"1391584","input_length":15483,"t_proxy_recv":384185.149913555,"t_decision_unix":1779815050.1638548,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":14848,"affinity_cache_ratio":0.958987276367629,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":635,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":15483,"score_linear":101993.0,"score_lmetric":15483},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":15483,"score_linear":71899.0,"score_lmetric":87382},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":15483,"score_linear":294991.0,"score_lmetric":290145},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":14848,"new_prefill":635,"score_linear":-14848.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163192,"ongoing_decode_tokens":163192,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1808,"cache_hit":0,"new_prefill":15483,"score_linear":163192.0,"score_lmetric":46449},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":28307,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":15483,"score_linear":28307.0,"score_lmetric":15483},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":15483,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":15483,"score_linear":213388.0,"score_lmetric":186291}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":384185.224967442,"t_first_token_unix":1779815050.238911,"t_done":384185.606595572,"t_done_unix":1779815050.620541},{"request_id":"1366128:11:1384044:671","session_id":"1366128","input_length":71254,"t_proxy_recv":384177.270637591,"t_decision_unix":1779815042.284579,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":59392,"affinity_cache_ratio":0.8335251354309934,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":11862,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":150403,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":71254,"score_linear":150403.0,"score_lmetric":142508},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":71254,"score_linear":71899.0,"score_lmetric":143153},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":71254,"score_linear":294991.0,"score_lmetric":457458},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1362,"cache_hit":0,"new_prefill":71254,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":144425,"ongoing_decode_tokens":144425,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":59392,"new_prefill":11862,"score_linear":85033.0,"score_lmetric":35586},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":71254,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":71254,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":71254,"score_linear":213388.0,"score_lmetric":353604}],"chosen_score_linear":85033.0,"chosen_score_lmetric":35586,"t_first_token":384182.286611175,"t_first_token_unix":1779815047.3005552,"t_done":384185.708709847,"t_done_unix":1779815050.7226536},{"request_id":"1391404:1:1391404:712","session_id":"1391404","input_length":28307,"t_proxy_recv":384181.317731442,"t_decision_unix":1779815046.3316731,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":25747,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100766,"ongoing_decode_tokens":100766,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":28307,"score_linear":100766.0,"score_lmetric":28307},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":28307,"score_linear":71899.0,"score_lmetric":100206},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":28307,"score_linear":294991.0,"score_lmetric":328617},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1373,"cache_hit":0,"new_prefill":28307,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":215679,"ongoing_decode_tokens":144425,"pending_prefill_tokens":11862,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":1536,"new_prefill":26771,"score_linear":214143.0,"score_lmetric":154532},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":2560,"new_prefill":25747,"score_linear":-2560.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89036,"ongoing_decode_tokens":89036,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2226,"cache_hit":0,"new_prefill":28307,"score_linear":89036.0,"score_lmetric":56614},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":28307,"score_linear":213388.0,"score_lmetric":224763}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":384184.754855215,"t_first_token_unix":1779815049.7687998,"t_done":384186.059456396,"t_done_unix":1779815051.0734005},{"request_id":"1366128:12:1386045:687","session_id":"1366128","input_length":71578,"t_proxy_recv":384185.721889222,"t_decision_unix":1779815050.7358305,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9942719830115399,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":410,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":71578,"score_linear":101993.0,"score_lmetric":71578},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":71578,"score_linear":71899.0,"score_lmetric":143477},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":71578,"score_linear":294991.0,"score_lmetric":458430},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1403,"cache_hit":0,"new_prefill":71578,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":91938,"ongoing_decode_tokens":91938,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1831,"cache_hit":71168,"new_prefill":410,"score_linear":20770.0,"score_lmetric":820},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":28307,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":71578,"score_linear":28307.0,"score_lmetric":71578},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":71578,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":71578,"score_linear":213388.0,"score_lmetric":354576}],"chosen_score_linear":20770.0,"chosen_score_lmetric":820,"t_first_token":384185.96388965,"t_first_token_unix":1779815050.9778333,"t_done":384186.783584329,"t_done_unix":1779815051.7975285},{"request_id":"1279412:31:1391216:711","session_id":"1279412","input_length":101993,"t_proxy_recv":384183.836048199,"t_decision_unix":1779815048.8499894,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":101376,"affinity_cache_ratio":0.993950565234869,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":617,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":101376,"new_prefill":617,"score_linear":-101376.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":101993,"score_linear":71899.0,"score_lmetric":173892},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":101993,"score_linear":294991.0,"score_lmetric":549675},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1402,"cache_hit":100352,"new_prefill":1641,"score_linear":-100352.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217204,"ongoing_decode_tokens":146214,"pending_prefill_tokens":1870,"num_requests":4,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":101993,"score_linear":217204.0,"score_lmetric":415452},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":25747,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":101993,"score_linear":28307.0,"score_lmetric":127740},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2229,"cache_hit":0,"new_prefill":101993,"score_linear":87687.0,"score_lmetric":101993},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":12800,"new_prefill":89193,"score_linear":200588.0,"score_lmetric":407421}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":384184.34515814,"t_first_token_unix":1779815049.359102,"t_done":384187.099512148,"t_done_unix":1779815052.1134558},{"request_id":"1390240:2:1392954:717","session_id":"1390240","input_length":7440,"t_proxy_recv":384186.865910344,"t_decision_unix":1779815051.8798518,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.6881720430107527,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":2320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":7440,"score_linear":101993.0,"score_lmetric":7440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":7440,"score_linear":71899.0,"score_lmetric":79339},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7440,"score_linear":294991.0,"score_lmetric":266016},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1403,"cache_hit":5120,"new_prefill":2320,"score_linear":-5120.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163646,"ongoing_decode_tokens":91938,"pending_prefill_tokens":540,"num_requests":3,"active_p_offloads":0,"cached_blocks":1831,"cache_hit":0,"new_prefill":7440,"score_linear":163646.0,"score_lmetric":23940},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":7440,"score_linear":213388.0,"score_lmetric":162162}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":384187.084634277,"t_first_token_unix":1779815052.0985777,"t_done":384187.306404176,"t_done_unix":1779815052.3203475},{"request_id":"1366128:13:1387308:692","session_id":"1366128","input_length":71708,"t_proxy_recv":384186.795759483,"t_decision_unix":1779815051.809701,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9924694594745356,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":71708,"score_linear":101993.0,"score_lmetric":71708},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":71708,"score_linear":71899.0,"score_lmetric":143607},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":71708,"score_linear":294991.0,"score_lmetric":458820},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1403,"cache_hit":0,"new_prefill":71708,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":91938,"ongoing_decode_tokens":91938,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1831,"cache_hit":71168,"new_prefill":540,"score_linear":20770.0,"score_lmetric":1080},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":71708,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":71708,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":71708,"score_linear":213388.0,"score_lmetric":354966}],"chosen_score_linear":20770.0,"chosen_score_lmetric":1080,"t_first_token":384186.942573428,"t_first_token_unix":1779815051.9565172,"t_done":384187.612204995,"t_done_unix":1779815052.6261487},{"request_id":"1388507:1:1388507:697","session_id":"1388507","input_length":71899,"t_proxy_recv":384170.931875024,"t_decision_unix":1779815035.9458165,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":71899,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":71899,"score_linear":150403.0,"score_lmetric":345276},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":71899,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":71899,"score_linear":294991.0,"score_lmetric":459393},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1352,"cache_hit":0,"new_prefill":71899,"score_linear":15283.0,"score_lmetric":71899},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":71899,"score_linear":203931.0,"score_lmetric":301264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":71899,"score_linear":50793.0,"score_lmetric":94532},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":111330,"ongoing_decode_tokens":85184,"pending_prefill_tokens":5154,"num_requests":2,"active_p_offloads":0,"cached_blocks":2168,"cache_hit":0,"new_prefill":71899,"score_linear":111330.0,"score_lmetric":154106},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":71899,"score_linear":213388.0,"score_lmetric":355539}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384188.807010231,"t_first_token_unix":1779815053.8209536,"t_done":384189.590981058,"t_done_unix":1779815054.604925},{"request_id":"1355484:11:1388276:696","session_id":"1355484","input_length":26837,"t_proxy_recv":384170.007040712,"t_decision_unix":1779815035.020982,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9348287811603383,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":26837,"score_linear":150403.0,"score_lmetric":255152},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":26837,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":26837,"score_linear":294991.0,"score_lmetric":324207},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1352,"cache_hit":12800,"new_prefill":14037,"score_linear":2483.0,"score_lmetric":14037},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":26837,"score_linear":203931.0,"score_lmetric":121016},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":26837,"score_linear":50793.0,"score_lmetric":49470},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":106405,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":26837,"score_linear":106405.0,"score_lmetric":53674},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186551,"ongoing_decode_tokens":80246,"pending_prefill_tokens":44865,"num_requests":2,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":25088,"new_prefill":1749,"score_linear":161463.0,"score_lmetric":93228}],"chosen_score_linear":161463.0,"chosen_score_lmetric":93228,"t_first_token":384187.824958636,"t_first_token_unix":1779815052.8389018,"t_done":384190.800374947,"t_done_unix":1779815055.8143184},{"request_id":"1313181:6:1324908:369","session_id":"1313181","input_length":106305,"t_proxy_recv":384164.471251377,"t_decision_unix":1779815029.485193,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":61440,"affinity_cache_ratio":0.5779596444193594,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":44865,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":150403,"ongoing_decode_tokens":0,"pending_prefill_tokens":100739,"num_requests":2,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":0,"new_prefill":106305,"score_linear":150403.0,"score_lmetric":414088},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":106305,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":106305,"score_linear":294991.0,"score_lmetric":941631},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":12800,"new_prefill":93505,"score_linear":2483.0,"score_lmetric":93505},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":203931,"ongoing_decode_tokens":134466,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":106305,"score_linear":203931.0,"score_lmetric":438888},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":106305,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106405,"ongoing_decode_tokens":21221,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":2129,"cache_hit":0,"new_prefill":106305,"score_linear":106405.0,"score_lmetric":259074},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":61440,"new_prefill":44865,"score_linear":18806.0,"score_lmetric":44865}],"chosen_score_linear":18806.0,"chosen_score_lmetric":44865,"t_first_token":384187.823423111,"t_first_token_unix":1779815052.8373668,"t_done":384191.446051184,"t_done_unix":1779815056.4599946},{"request_id":"1394167:1:1394167:721","session_id":"1394167","input_length":4675,"t_proxy_recv":384191.130702011,"t_decision_unix":1779815056.1446428,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":4675,"score_linear":48944.0,"score_lmetric":4675},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4675,"score_linear":294991.0,"score_lmetric":19236},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":4675,"score_linear":101803.0,"score_lmetric":33262},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":4675,"score_linear":175342.0,"score_lmetric":49197},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":0,"pending_prefill_tokens":5161,"num_requests":1,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":4675,"score_linear":33321.0,"score_lmetric":9836},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":214933,"ongoing_decode_tokens":186551,"pending_prefill_tokens":1758,"num_requests":3,"active_p_offloads":0,"cached_blocks":1655,"cache_hit":0,"new_prefill":4675,"score_linear":214933.0,"score_lmetric":19299}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384191.42563816,"t_first_token_unix":1779815056.4395816,"t_done":384191.795137244,"t_done_unix":1779815056.8090806},{"request_id":"1394428:1:1394428:724","session_id":"1394428","input_length":982,"t_proxy_recv":384192.01966386,"t_decision_unix":1779815057.0336053,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":982,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1824,"cache_hit":0,"new_prefill":982,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":512,"new_prefill":470,"score_linear":48432.0,"score_lmetric":470},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":982,"score_linear":294991.0,"score_lmetric":8157},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":982,"score_linear":101803.0,"score_lmetric":29569},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":982,"score_linear":175342.0,"score_lmetric":38118},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":982,"score_linear":33321.0,"score_lmetric":982},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":982,"score_linear":106143.0,"score_lmetric":19061},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":982,"score_linear":170171.0,"score_lmetric":2946}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384192.094568334,"t_first_token_unix":1779815057.1085117,"t_done":384192.098419213,"t_done_unix":1779815057.1123624},{"request_id":"1394482:1:1394482:726","session_id":"1394482","input_length":4428,"t_proxy_recv":384192.290939162,"t_decision_unix":1779815057.3048804,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4428,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1825,"cache_hit":0,"new_prefill":4428,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":4428,"score_linear":48944.0,"score_lmetric":4428},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4428,"score_linear":294991.0,"score_lmetric":18495},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":4428,"score_linear":101803.0,"score_lmetric":33015},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":4428,"score_linear":175342.0,"score_lmetric":48456},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38057,"ongoing_decode_tokens":33321,"pending_prefill_tokens":4736,"num_requests":2,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":4428,"score_linear":38057.0,"score_lmetric":18328},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":4428,"score_linear":106143.0,"score_lmetric":22507},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":4428,"score_linear":170171.0,"score_lmetric":13284}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384192.566380526,"t_first_token_unix":1779815057.580324,"t_done":384192.65384075,"t_done_unix":1779815057.667785},{"request_id":"1394432:1:1394432:725","session_id":"1394432","input_length":4736,"t_proxy_recv":384192.037180634,"t_decision_unix":1779815057.051122,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":4736,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4736,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":982,"ongoing_decode_tokens":0,"pending_prefill_tokens":982,"num_requests":1,"active_p_offloads":0,"cached_blocks":1824,"cache_hit":0,"new_prefill":4736,"score_linear":982.0,"score_lmetric":5718},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":4736,"score_linear":48944.0,"score_lmetric":4736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4736,"score_linear":294991.0,"score_lmetric":19419},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":4736,"score_linear":101803.0,"score_lmetric":33323},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":4736,"score_linear":175342.0,"score_lmetric":49380},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":4736,"score_linear":33321.0,"score_lmetric":4736},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":4736,"score_linear":106143.0,"score_lmetric":22815},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":4736,"score_linear":170171.0,"score_lmetric":14208}],"chosen_score_linear":33321.0,"chosen_score_lmetric":4736,"t_first_token":384192.340764438,"t_first_token_unix":1779815057.354708,"t_done":384192.750364465,"t_done_unix":1779815057.7643096},{"request_id":"1364090:4:1392998:718","session_id":"1364090","input_length":48944,"t_proxy_recv":384186.971825378,"t_decision_unix":1779815051.985767,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9833278849297156,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":7680,"new_prefill":41264,"score_linear":94313.0,"score_lmetric":41264},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":48128,"new_prefill":816,"score_linear":23771.0,"score_lmetric":72715},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":41264,"score_linear":287311.0,"score_lmetric":367488},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":7440,"ongoing_decode_tokens":0,"pending_prefill_tokens":2320,"num_requests":1,"active_p_offloads":0,"cached_blocks":1403,"cache_hit":0,"new_prefill":48944,"score_linear":7440.0,"score_lmetric":51264},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163646,"ongoing_decode_tokens":163646,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1831,"cache_hit":4096,"new_prefill":44848,"score_linear":159550.0,"score_lmetric":134544},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":7680,"new_prefill":41264,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":11264,"new_prefill":37680,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":11264,"new_prefill":37680,"score_linear":202124.0,"score_lmetric":252882}],"chosen_score_linear":23771.0,"chosen_score_lmetric":72715,"t_first_token":384189.098393388,"t_first_token_unix":1779815054.1123369,"t_done":384193.96252401,"t_done_unix":1779815058.9764676},{"request_id":"1342921:4:1389290:702","session_id":"1342921","input_length":70990,"t_proxy_recv":384183.254073127,"t_decision_unix":1779815048.2680142,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9736582617270038,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":1870,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":101396,"ongoing_decode_tokens":101396,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":0,"new_prefill":70990,"score_linear":101396.0,"score_lmetric":70990},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":70990,"score_linear":71899.0,"score_lmetric":142889},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":70990,"score_linear":294991.0,"score_lmetric":456666},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15302,"ongoing_decode_tokens":15302,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1373,"cache_hit":0,"new_prefill":70990,"score_linear":15302.0,"score_lmetric":70990},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":146214,"ongoing_decode_tokens":146214,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":69120,"new_prefill":1870,"score_linear":77094.0,"score_lmetric":5610},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":25747,"num_requests":1,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":70990,"score_linear":28307.0,"score_lmetric":96737},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2229,"cache_hit":0,"new_prefill":70990,"score_linear":87687.0,"score_lmetric":70990},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":70990,"score_linear":213388.0,"score_lmetric":352812}],"chosen_score_linear":77094.0,"chosen_score_lmetric":5610,"t_first_token":384184.034184404,"t_first_token_unix":1779815049.0481286,"t_done":384194.430139771,"t_done_unix":1779815059.4440873},{"request_id":"1366128:14:1389156:701","session_id":"1366128","input_length":83404,"t_proxy_recv":384187.631699059,"t_decision_unix":1779815052.6456404,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71680,"affinity_cache_ratio":0.8594312023404154,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":11724,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120843,"ongoing_decode_tokens":0,"pending_prefill_tokens":72715,"num_requests":2,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":83404,"score_linear":120843.0,"score_lmetric":312238},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":83404,"score_linear":294991.0,"score_lmetric":493908},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":91938,"ongoing_decode_tokens":91938,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":71680,"new_prefill":11724,"score_linear":20258.0,"score_lmetric":23448},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":80246,"pending_prefill_tokens":46614,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":83404,"score_linear":213388.0,"score_lmetric":390054}],"chosen_score_linear":20258.0,"chosen_score_lmetric":23448,"t_first_token":384193.436842326,"t_first_token_unix":1779815058.4507864,"t_done":384195.061570682,"t_done_unix":1779815060.0755146},{"request_id":"1355484:12:1391879:714","session_id":"1355484","input_length":28382,"t_proxy_recv":384190.806961971,"t_decision_unix":1779815055.8209035,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9380593333803114,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":1758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":12800,"new_prefill":15582,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":28382,"score_linear":48944.0,"score_lmetric":28382},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":28382,"score_linear":294991.0,"score_lmetric":328842},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":12800,"new_prefill":15582,"score_linear":89003.0,"score_lmetric":44169},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":28382,"score_linear":175342.0,"score_lmetric":120318},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":0,"pending_prefill_tokens":5161,"num_requests":1,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":28382,"score_linear":33321.0,"score_lmetric":33543},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":28382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186551,"ongoing_decode_tokens":186551,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1655,"cache_hit":26624,"new_prefill":1758,"score_linear":159927.0,"score_lmetric":3516}],"chosen_score_linear":159927.0,"chosen_score_lmetric":3516,"t_first_token":384191.201251195,"t_first_token_unix":1779815056.2151945,"t_done":384195.113396702,"t_done_unix":1779815060.12734},{"request_id":"1394432:2:1395186:729","session_id":"1394432","input_length":6892,"t_proxy_recv":384194.624964257,"t_decision_unix":1779815059.6389058,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.6686012768427162,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":2284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":6892,"score_linear":40313.0,"score_lmetric":85194},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":6892,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":6892,"score_linear":294991.0,"score_lmetric":25887},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":6892,"score_linear":101803.0,"score_lmetric":35479},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":104352,"ongoing_decode_tokens":104352,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1836,"cache_hit":0,"new_prefill":6892,"score_linear":104352.0,"score_lmetric":13784},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1561,"cache_hit":4608,"new_prefill":2284,"score_linear":28713.0,"score_lmetric":2284},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":6892,"score_linear":106143.0,"score_lmetric":24971},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":6892,"score_linear":170171.0,"score_lmetric":20676}],"chosen_score_linear":28713.0,"chosen_score_lmetric":2284,"t_first_token":384194.829353525,"t_first_token_unix":1779815059.843297,"t_done":384195.214140718,"t_done_unix":1779815060.2280836},{"request_id":"1363943:8:1379215:635","session_id":"1363943","input_length":20948,"t_proxy_recv":384144.890612044,"t_decision_unix":1779815009.9045453,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":20480,"affinity_cache_ratio":0.97765896505633,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":468,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":100538,"ongoing_decode_tokens":0,"pending_prefill_tokens":100538,"num_requests":1,"active_p_offloads":0,"cached_blocks":1619,"cache_hit":8704,"new_prefill":12244,"score_linear":91834.0,"score_lmetric":112782},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":4096,"new_prefill":16852,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":0,"pending_prefill_tokens":207572,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":16852,"score_linear":290895.0,"score_lmetric":673272},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":121214,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11723,"num_requests":4,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":20948,"score_linear":121214.0,"score_lmetric":130684},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":20480,"new_prefill":468,"score_linear":-20480.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":4096,"new_prefill":16852,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":4096,"new_prefill":16852,"score_linear":57361.0,"score_lmetric":16852},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":209605,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45903,"num_requests":3,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":4096,"new_prefill":16852,"score_linear":205509.0,"score_lmetric":188265}],"chosen_score_linear":-20480.0,"chosen_score_lmetric":0,"t_first_token":384144.93969243,"t_first_token_unix":1779815009.9536357,"t_done":384195.36191813,"t_done_unix":1779815060.3758616},{"request_id":"1355484:13:1394384:723","session_id":"1355484","input_length":28665,"t_proxy_recv":384195.127068984,"t_decision_unix":1779815060.1410108,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9823826966684109,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":12800,"new_prefill":15865,"score_linear":27513.0,"score_lmetric":103140},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":28665,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":28665,"score_linear":294991.0,"score_lmetric":91206},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":12800,"new_prefill":15865,"score_linear":89003.0,"score_lmetric":44452},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":104570,"ongoing_decode_tokens":20948,"pending_prefill_tokens":166,"num_requests":2,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":28665,"score_linear":104570.0,"score_lmetric":57662},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":40213,"ongoing_decode_tokens":40213,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1561,"cache_hit":0,"new_prefill":28665,"score_linear":40213.0,"score_lmetric":57330},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":28665,"score_linear":106143.0,"score_lmetric":46744},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141789,"ongoing_decode_tokens":141789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":28160,"new_prefill":505,"score_linear":113629.0,"score_lmetric":1010}],"chosen_score_linear":113629.0,"chosen_score_lmetric":1010,"t_first_token":384195.215942814,"t_first_token_unix":1779815060.229886,"t_done":384196.296730943,"t_done_unix":1779815061.3106744},{"request_id":"1366128:15:1390663:709","session_id":"1366128","input_length":83622,"t_proxy_recv":384195.08107607,"t_decision_unix":1779815060.0950167,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9980148764679151,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":83622,"score_linear":40313.0,"score_lmetric":238654},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":83622,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":83622,"score_linear":294991.0,"score_lmetric":256077},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":83622,"score_linear":101803.0,"score_lmetric":112209},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":83456,"new_prefill":166,"score_linear":-62508.0,"score_lmetric":166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":40213,"ongoing_decode_tokens":40213,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1561,"cache_hit":0,"new_prefill":83622,"score_linear":40213.0,"score_lmetric":167244},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":83622,"score_linear":106143.0,"score_lmetric":101701},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":83622,"score_linear":170171.0,"score_lmetric":250866}],"chosen_score_linear":-62508.0,"chosen_score_lmetric":166,"t_first_token":384195.312008268,"t_first_token_unix":1779815060.325952,"t_done":384196.933449013,"t_done_unix":1779815061.9473977},{"request_id":"1313181:6:1379623:639","session_id":"1313181","input_length":61543,"t_proxy_recv":384191.456283535,"t_decision_unix":1779815056.470225,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9983263734299596,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":4675,"ongoing_decode_tokens":4675,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":12800,"new_prefill":48743,"score_linear":-8125.0,"score_lmetric":48743},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":61543,"score_linear":48944.0,"score_lmetric":61543},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":61543,"score_linear":294991.0,"score_lmetric":189840},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":12800,"new_prefill":48743,"score_linear":89003.0,"score_lmetric":77330},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":61543,"score_linear":175342.0,"score_lmetric":219801},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":61543,"score_linear":33321.0,"score_lmetric":61543},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":61543,"score_linear":106143.0,"score_lmetric":79622},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":108628,"ongoing_decode_tokens":108628,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":61440,"new_prefill":103,"score_linear":47188.0,"score_lmetric":206}],"chosen_score_linear":47188.0,"chosen_score_lmetric":206,"t_first_token":384191.54793675,"t_first_token_unix":1779815056.5618799,"t_done":384198.095059778,"t_done_unix":1779815063.1090043},{"request_id":"1394696:1:1394696:727","session_id":"1394696","input_length":35450,"t_proxy_recv":384193.082535323,"t_decision_unix":1779815058.096476,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":35450,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":35450,"score_linear":48944.0,"score_lmetric":35450},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35450,"score_linear":294991.0,"score_lmetric":111561},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":35450,"score_linear":101803.0,"score_lmetric":64037},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":35450,"score_linear":175342.0,"score_lmetric":141522},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1561,"cache_hit":0,"new_prefill":35450,"score_linear":33321.0,"score_lmetric":35450},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":35450,"score_linear":106143.0,"score_lmetric":53529},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":35450,"score_linear":170171.0,"score_lmetric":106350}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384198.297304773,"t_first_token_unix":1779815063.3112488,"t_done":384198.762503572,"t_done_unix":1779815063.7764475},{"request_id":"1394167:2:1395165:728","session_id":"1394167","input_length":4863,"t_proxy_recv":384194.56203988,"t_decision_unix":1779815059.575981,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":4608,"affinity_cache_ratio":0.9475632325724861,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":4608,"new_prefill":255,"score_linear":30842.0,"score_lmetric":35705},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":4863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4863,"score_linear":294991.0,"score_lmetric":19800},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":4863,"score_linear":101803.0,"score_lmetric":33450},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":104352,"ongoing_decode_tokens":104352,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1836,"cache_hit":0,"new_prefill":4863,"score_linear":104352.0,"score_lmetric":9726},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1561,"cache_hit":0,"new_prefill":4863,"score_linear":33321.0,"score_lmetric":4863},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":4863,"score_linear":106143.0,"score_lmetric":22942},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170171,"ongoing_decode_tokens":170171,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":4863,"score_linear":170171.0,"score_lmetric":14589}],"chosen_score_linear":30842.0,"chosen_score_lmetric":35705,"t_first_token":384198.301054938,"t_first_token_unix":1779815063.3149989,"t_done":384199.030658395,"t_done_unix":1779815064.0446022},{"request_id":"1395933:1:1395933:732","session_id":"1395933","input_length":21241,"t_proxy_recv":384197.360982142,"t_decision_unix":1779815062.3749235,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":9465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":21241,"score_linear":40313.0,"score_lmetric":113892},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":11776,"new_prefill":9465,"score_linear":-11776.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":21241,"score_linear":294991.0,"score_lmetric":68934},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":21241,"score_linear":112693.0,"score_lmetric":107100},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":108538,"ongoing_decode_tokens":23641,"pending_prefill_tokens":1441,"num_requests":2,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":0,"new_prefill":21241,"score_linear":108538.0,"score_lmetric":45364},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":0,"new_prefill":21241,"score_linear":33321.0,"score_lmetric":21241},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":11776,"new_prefill":9465,"score_linear":94367.0,"score_lmetric":27544},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141789,"ongoing_decode_tokens":141789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":21241,"score_linear":141789.0,"score_lmetric":42482}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":384198.746397345,"t_first_token_unix":1779815063.7603414,"t_done":384200.028092629,"t_done_unix":1779815065.042036},{"request_id":"1366128:16:1392704:716","session_id":"1366128","input_length":84897,"t_proxy_recv":384196.949009145,"t_decision_unix":1779815061.9629502,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9830264909242965,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":1441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":84897,"score_linear":40313.0,"score_lmetric":241204},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":84897,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":84897,"score_linear":294991.0,"score_lmetric":259902},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":84897,"score_linear":112693.0,"score_lmetric":234412},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":83456,"new_prefill":1441,"score_linear":-59815.0,"score_lmetric":1441},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":0,"new_prefill":84897,"score_linear":33321.0,"score_lmetric":84897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":84897,"score_linear":106143.0,"score_lmetric":102976},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141789,"ongoing_decode_tokens":141789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":84897,"score_linear":141789.0,"score_lmetric":169794}],"chosen_score_linear":-59815.0,"chosen_score_lmetric":1441,"t_first_token":384197.707797357,"t_first_token_unix":1779815062.721741,"t_done":384200.082373891,"t_done_unix":1779815065.0963209},{"request_id":"1366128:17:1395596:731","session_id":"1366128","input_length":85276,"t_proxy_recv":384200.097475875,"t_decision_unix":1779815065.1114173,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9966696374126366,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":85276,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":85276,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":85276,"score_linear":294991.0,"score_lmetric":261039},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":85276,"score_linear":112693.0,"score_lmetric":235170},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1863,"cache_hit":84992,"new_prefill":284,"score_linear":-61351.0,"score_lmetric":284},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50368,"ongoing_decode_tokens":33321,"pending_prefill_tokens":663,"num_requests":2,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":0,"new_prefill":85276,"score_linear":50368.0,"score_lmetric":171878},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":85276,"score_linear":106143.0,"score_lmetric":103355},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":85276,"score_linear":202057.0,"score_lmetric":290270}],"chosen_score_linear":-61351.0,"chosen_score_lmetric":284,"t_first_token":384200.36762898,"t_first_token_unix":1779815065.3815722,"t_done":384201.481216181,"t_done_unix":1779815066.4951603},{"request_id":"1305906:3:1396717:733","session_id":"1305906","input_length":17047,"t_proxy_recv":384199.951061891,"t_decision_unix":1779815064.9650033,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":16384,"affinity_cache_ratio":0.9611075262509532,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":663,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":17047,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":21241,"ongoing_decode_tokens":21241,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":17047,"score_linear":21241.0,"score_lmetric":17047},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":17047,"score_linear":294991.0,"score_lmetric":56352},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":17047,"score_linear":112693.0,"score_lmetric":98712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":108538,"ongoing_decode_tokens":108538,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":0,"new_prefill":17047,"score_linear":108538.0,"score_lmetric":34094},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":16384,"new_prefill":663,"score_linear":16937.0,"score_lmetric":663},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":17047,"score_linear":106143.0,"score_lmetric":35126},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":17047,"score_linear":202057.0,"score_lmetric":153812}],"chosen_score_linear":16937.0,"chosen_score_lmetric":663,"t_first_token":384201.05623535,"t_first_token_unix":1779815066.0701787,"t_done":384202.204084219,"t_done_unix":1779815067.2180276},{"request_id":"1366128:18:1397382:735","session_id":"1366128","input_length":85504,"t_proxy_recv":384202.221881489,"t_decision_unix":1779815067.2358227,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9940119760479041,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13134,"ongoing_decode_tokens":0,"pending_prefill_tokens":13134,"num_requests":1,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":85504,"score_linear":13134.0,"score_lmetric":98638},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":85504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":85504,"score_linear":294991.0,"score_lmetric":261723},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":85504,"score_linear":112693.0,"score_lmetric":235626},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1863,"cache_hit":84992,"new_prefill":512,"score_linear":-61351.0,"score_lmetric":512},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":85504,"score_linear":33321.0,"score_lmetric":85504},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":85504,"score_linear":106143.0,"score_lmetric":85504},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":85504,"score_linear":202057.0,"score_lmetric":290726}],"chosen_score_linear":-61351.0,"chosen_score_lmetric":512,"t_first_token":384202.415531358,"t_first_token_unix":1779815067.4294748,"t_done":384203.387888121,"t_done_unix":1779815068.4018342},{"request_id":"1363943:9:1390468:707","session_id":"1363943","input_length":23641,"t_proxy_recv":384195.368892439,"t_decision_unix":1779815060.382834,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9096061926314454,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":2137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":8704,"new_prefill":14937,"score_linear":31609.0,"score_lmetric":101284},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":4096,"new_prefill":19545,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":19545,"score_linear":290895.0,"score_lmetric":63846},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":23641,"score_linear":101803.0,"score_lmetric":52228},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83622,"ongoing_decode_tokens":83622,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":21504,"new_prefill":2137,"score_linear":62118.0,"score_lmetric":2137},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":4096,"new_prefill":19545,"score_linear":29225.0,"score_lmetric":19545},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":4096,"new_prefill":19545,"score_linear":102047.0,"score_lmetric":37624},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170454,"ongoing_decode_tokens":170454,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":4096,"new_prefill":19545,"score_linear":166358.0,"score_lmetric":58635}],"chosen_score_linear":62118.0,"chosen_score_lmetric":2137,"t_first_token":384195.732917638,"t_first_token_unix":1779815060.7468615,"t_done":384204.048856957,"t_done_unix":1779815069.0628004},{"request_id":"1398145:1:1398145:739","session_id":"1398145","input_length":3213,"t_proxy_recv":384205.112189562,"t_decision_unix":1779815070.1261306,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":3213,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":3213,"score_linear":13134.0,"score_lmetric":3213},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":3213,"score_linear":93040.0,"score_lmetric":96253},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3213,"score_linear":294991.0,"score_lmetric":13170},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":3213,"score_linear":112693.0,"score_lmetric":71044},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1869,"cache_hit":0,"new_prefill":3213,"score_linear":16550.0,"score_lmetric":19763},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":3213,"score_linear":33321.0,"score_lmetric":3213},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":3213,"score_linear":106143.0,"score_lmetric":3213},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":3213,"score_linear":202057.0,"score_lmetric":126144}],"chosen_score_linear":13134.0,"chosen_score_lmetric":3213,"t_first_token":384205.355753057,"t_first_token_unix":1779815070.3696973,"t_done":384205.498936433,"t_done_unix":1779815070.5128798},{"request_id":"1397840:1:1397840:737","session_id":"1397840","input_length":16550,"t_proxy_recv":384204.042044809,"t_decision_unix":1779815069.055986,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":16550,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":16550,"score_linear":13134.0,"score_lmetric":16550},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":16550,"score_linear":93040.0,"score_lmetric":109590},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":16550,"score_linear":294991.0,"score_lmetric":54861},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":16550,"score_linear":112693.0,"score_lmetric":97718},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":16550,"score_linear":23641.0,"score_lmetric":16550},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":16550,"score_linear":33321.0,"score_lmetric":16550},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":16550,"score_linear":106143.0,"score_lmetric":16550},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":16550,"score_linear":202057.0,"score_lmetric":152818}],"chosen_score_linear":23641.0,"chosen_score_lmetric":16550,"t_first_token":384205.601446695,"t_first_token_unix":1779815070.6153905,"t_done":384205.841675211,"t_done_unix":1779815070.855619},{"request_id":"1397223:1:1397223:734","session_id":"1397223","input_length":13134,"t_proxy_recv":384201.591962313,"t_decision_unix":1779815066.6059034,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13134,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":13134,"score_linear":294991.0,"score_lmetric":44613},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":13134,"score_linear":112693.0,"score_lmetric":90886},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1863,"cache_hit":0,"new_prefill":13134,"score_linear":23641.0,"score_lmetric":13134},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50368,"ongoing_decode_tokens":50368,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":0,"new_prefill":13134,"score_linear":50368.0,"score_lmetric":26268},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":13134,"score_linear":106143.0,"score_lmetric":31213},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":13134,"score_linear":202057.0,"score_lmetric":145986}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384202.688242358,"t_first_token_unix":1779815067.7021856,"t_done":384205.910599546,"t_done_unix":1779815070.924543},{"request_id":"1398213:1:1398213:742","session_id":"1398213","input_length":3891,"t_proxy_recv":384205.254964983,"t_decision_unix":1779815070.2689066,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":3891,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16347,"ongoing_decode_tokens":13134,"pending_prefill_tokens":3213,"num_requests":2,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":3891,"score_linear":16347.0,"score_lmetric":14208},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":3891,"score_linear":103776.0,"score_lmetric":194854},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3891,"score_linear":294991.0,"score_lmetric":15204},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":3891,"score_linear":112693.0,"score_lmetric":72400},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1869,"cache_hit":0,"new_prefill":3891,"score_linear":16550.0,"score_lmetric":20441},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":3891,"score_linear":33321.0,"score_lmetric":3891},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":3891,"score_linear":106143.0,"score_lmetric":3891},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":3891,"score_linear":233281.0,"score_lmetric":198906}],"chosen_score_linear":106143.0,"chosen_score_lmetric":3891,"t_first_token":384205.645208605,"t_first_token_unix":1779815070.659152,"t_done":384206.404302166,"t_done_unix":1779815071.4182456},{"request_id":"1398594:1:1398594:744","session_id":"1398594","input_length":7877,"t_proxy_recv":384206.47905535,"t_decision_unix":1779815071.4929967,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7877,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":7877,"score_linear":103776.0,"score_lmetric":202826},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7877,"score_linear":294991.0,"score_lmetric":27162},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":7877,"score_linear":112693.0,"score_lmetric":80372},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":7877,"score_linear":96579.0,"score_lmetric":39870},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":7877,"score_linear":106143.0,"score_lmetric":7877},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":7877,"score_linear":233281.0,"score_lmetric":210864}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384207.020756586,"t_first_token_unix":1779815072.0347009,"t_done":384207.135945049,"t_done_unix":1779815072.1498885},{"request_id":"1366128:19:1398824:745","session_id":"1366128","input_length":85663,"t_proxy_recv":384207.378950106,"t_decision_unix":1779815072.3928914,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9981438894271739,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":159,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1949,"cache_hit":0,"new_prefill":85663,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":85663,"score_linear":103776.0,"score_lmetric":358398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":85663,"score_linear":294991.0,"score_lmetric":260520},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":85663,"score_linear":112693.0,"score_lmetric":235944},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":85504,"new_prefill":159,"score_linear":-85504.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":85663,"score_linear":96579.0,"score_lmetric":195442},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":85663,"score_linear":106143.0,"score_lmetric":85663},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":85663,"score_linear":233281.0,"score_lmetric":444222}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":384207.565298894,"t_first_token_unix":1779815072.5792425,"t_done":384207.74644362,"t_done_unix":1779815072.7603874},{"request_id":"1400379:1:1400379:751","session_id":"1400379","input_length":3707,"t_proxy_recv":384212.606984939,"t_decision_unix":1779815077.6209261,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3707,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1949,"cache_hit":0,"new_prefill":3707,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":3707,"score_linear":103776.0,"score_lmetric":194486},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3707,"score_linear":294991.0,"score_lmetric":14652},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":3707,"score_linear":112693.0,"score_lmetric":72032},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":3707,"score_linear":31431.0,"score_lmetric":27526},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":3707,"score_linear":96579.0,"score_lmetric":31530},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":3707,"score_linear":106143.0,"score_lmetric":3707},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":3707,"score_linear":233281.0,"score_lmetric":198354}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384212.837065847,"t_first_token_unix":1779815077.8510098,"t_done":384213.117622498,"t_done_unix":1779815078.1315658},{"request_id":"1398213:2:1400590:753","session_id":"1398213","input_length":11414,"t_proxy_recv":384213.395079482,"t_decision_unix":1779815078.409021,"policy":"unified","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":0,"affinity_cache_hit":3584,"affinity_cache_ratio":0.3140003504468197,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1956,"cache_hit":0,"new_prefill":11414,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":11414,"score_linear":103776.0,"score_lmetric":209900},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11414,"score_linear":294991.0,"score_lmetric":37773},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":11414,"score_linear":112693.0,"score_lmetric":87446},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129088,"ongoing_decode_tokens":4991,"pending_prefill_tokens":22209,"num_requests":3,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":11414,"score_linear":129088.0,"score_lmetric":100869},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":11414,"score_linear":96579.0,"score_lmetric":46944},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":3584,"new_prefill":7830,"score_linear":102559.0,"score_lmetric":7830},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":11414,"score_linear":233281.0,"score_lmetric":221475}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384214.308051829,"t_first_token_unix":1779815079.3219953,"t_done":384214.702045006,"t_done_unix":1779815079.7159894},{"request_id":"1400379:2:1401201:757","session_id":"1400379","input_length":3863,"t_proxy_recv":384215.72431876,"t_decision_unix":1779815080.73826,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":3584,"affinity_cache_ratio":0.92777633963241,"affinity_num_requests":0,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":3584,"new_prefill":279,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":3863,"score_linear":166406.0,"score_lmetric":332631},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3863,"score_linear":294991.0,"score_lmetric":15120},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":3863,"score_linear":112693.0,"score_lmetric":72344},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":153530,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12531,"num_requests":4,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":3863,"score_linear":153530.0,"score_lmetric":65576},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":33321,"pending_prefill_tokens":29479,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":3863,"score_linear":164688.0,"score_lmetric":100026},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":3863,"score_linear":106143.0,"score_lmetric":3863},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":3863,"score_linear":233281.0,"score_lmetric":198822}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":384215.757877549,"t_first_token_unix":1779815080.7718208,"t_done":384216.090914139,"t_done_unix":1779815081.104858},{"request_id":"1373577:1:1373577:608","session_id":"1373577","input_length":79495,"t_proxy_recv":384119.002440504,"t_decision_unix":1779814984.0163817,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":79495,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":79495,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":79495,"score_linear":26705.0,"score_lmetric":79495},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":113919,"ongoing_decode_tokens":0,"pending_prefill_tokens":126340,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":79495,"score_linear":113919.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136519,"ongoing_decode_tokens":136519,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":79495,"score_linear":136519.0,"score_lmetric":158990},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":106950,"pending_prefill_tokens":7947,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":79495,"score_linear":130257.0,"score_lmetric":349768},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":152567,"pending_prefill_tokens":2233,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":79495,"score_linear":168624.0,"score_lmetric":245184},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":2560,"new_prefill":76935,"score_linear":53726.0,"score_lmetric":125541},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":79495,"score_linear":140250.0,"score_lmetric":158990}],"chosen_score_linear":113919.0,"chosen_score_lmetric":0,"t_first_token":384191.051697615,"t_first_token_unix":1779815056.0656416,"t_done":384217.604174103,"t_done_unix":1779815082.6181228},{"request_id":"1398213:3:1401507:759","session_id":"1398213","input_length":12910,"t_proxy_recv":384216.819128742,"t_decision_unix":1779815081.83307,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.8725019364833463,"affinity_num_requests":0,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":1646,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":11264,"new_prefill":1646,"score_linear":-11264.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":12910,"score_linear":166406.0,"score_lmetric":359772},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":12910,"score_linear":294991.0,"score_lmetric":42261},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":12910,"score_linear":112693.0,"score_lmetric":90438},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":153530,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12531,"num_requests":4,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":12910,"score_linear":153530.0,"score_lmetric":101764},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":33321,"pending_prefill_tokens":29479,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":12910,"score_linear":164688.0,"score_lmetric":127167},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":3584,"new_prefill":9326,"score_linear":102559.0,"score_lmetric":9326},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":12910,"score_linear":233281.0,"score_lmetric":225963}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":384217.029044732,"t_first_token_unix":1779815082.0429893,"t_done":384219.58368133,"t_done_unix":1779815084.5976248},{"request_id":"1399948:1:1399948:748","session_id":"1399948","input_length":4991,"t_proxy_recv":384211.290068935,"t_decision_unix":1779815076.3040097,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4991,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1949,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":4991,"score_linear":103776.0,"score_lmetric":197054},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4991,"score_linear":294991.0,"score_lmetric":18504},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":4991,"score_linear":112693.0,"score_lmetric":74600},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":4991,"score_linear":96579.0,"score_lmetric":34098},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":4991,"score_linear":106143.0,"score_lmetric":4991},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":4991,"score_linear":233281.0,"score_lmetric":202206}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384211.607565673,"t_first_token_unix":1779815076.621509,"t_done":384221.17330472,"t_done_unix":1779815086.1872482},{"request_id":"1397840:2:1400216:749","session_id":"1397840","input_length":26440,"t_proxy_recv":384212.095094608,"t_decision_unix":1779815077.109036,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":16384,"affinity_cache_ratio":0.6196671709531013,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":10056,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1949,"cache_hit":0,"new_prefill":26440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":26440,"score_linear":103776.0,"score_lmetric":239952},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":26440,"score_linear":294991.0,"score_lmetric":82851},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":26440,"score_linear":112693.0,"score_lmetric":117498},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":4991,"ongoing_decode_tokens":4991,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":16384,"new_prefill":10056,"score_linear":-11393.0,"score_lmetric":10056},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":26440,"score_linear":96579.0,"score_lmetric":76996},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":26440,"score_linear":106143.0,"score_lmetric":26440},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":26440,"score_linear":233281.0,"score_lmetric":266553}],"chosen_score_linear":-11393.0,"chosen_score_lmetric":10056,"t_first_token":384213.820145606,"t_first_token_unix":1779815078.8340893,"t_done":384221.246014633,"t_done_unix":1779815086.259958},{"request_id":"1397840:3:1402568:761","session_id":"1397840","input_length":28603,"t_proxy_recv":384221.25276296,"t_decision_unix":1779815086.2667046,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9129112330874384,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":2491,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1982,"cache_hit":0,"new_prefill":28603,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":28603,"score_linear":166406.0,"score_lmetric":406851},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296643,"ongoing_decode_tokens":189876,"pending_prefill_tokens":2452,"num_requests":3,"active_p_offloads":0,"cached_blocks":2172,"cache_hit":0,"new_prefill":28603,"score_linear":296643.0,"score_lmetric":93165},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":28603,"score_linear":112693.0,"score_lmetric":121824},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":122099,"ongoing_decode_tokens":122099,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1929,"cache_hit":26112,"new_prefill":2491,"score_linear":95987.0,"score_lmetric":4982},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":28603,"score_linear":164688.0,"score_lmetric":138072},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":28603,"score_linear":106143.0,"score_lmetric":28603},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":28603,"score_linear":233281.0,"score_lmetric":273042}],"chosen_score_linear":95987.0,"chosen_score_lmetric":4982,"t_first_token":384221.788562845,"t_first_token_unix":1779815086.8025062,"t_done":384222.158626634,"t_done_unix":1779815087.1725702},{"request_id":"1366128:20:1400446:752","session_id":"1366128","input_length":97657,"t_proxy_recv":384212.863695164,"t_decision_unix":1779815077.8776362,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":85504,"affinity_cache_ratio":0.8755542357434695,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":12153,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":3707,"ongoing_decode_tokens":3707,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1949,"cache_hit":0,"new_prefill":97657,"score_linear":3707.0,"score_lmetric":97657},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":97657,"score_linear":103776.0,"score_lmetric":382386},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":97657,"score_linear":294991.0,"score_lmetric":296502},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":97657,"score_linear":112693.0,"score_lmetric":259932},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":85504,"new_prefill":12153,"score_linear":-54073.0,"score_lmetric":44418},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":97657,"score_linear":96579.0,"score_lmetric":219430},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":97657,"score_linear":106143.0,"score_lmetric":97657},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":97657,"score_linear":233281.0,"score_lmetric":480204}],"chosen_score_linear":-54073.0,"chosen_score_lmetric":44418,"t_first_token":384220.724372703,"t_first_token_unix":1779815085.7383165,"t_done":384222.499656921,"t_done_unix":1779815087.5136037},{"request_id":"1400379:3:1402972:763","session_id":"1400379","input_length":11216,"t_proxy_recv":384221.934856769,"t_decision_unix":1779815086.948798,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":3584,"affinity_cache_ratio":0.3195435092724679,"affinity_num_requests":0,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":7632,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1982,"cache_hit":3584,"new_prefill":7632,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":11216,"score_linear":166406.0,"score_lmetric":354690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296643,"ongoing_decode_tokens":189876,"pending_prefill_tokens":2452,"num_requests":3,"active_p_offloads":0,"cached_blocks":2172,"cache_hit":0,"new_prefill":11216,"score_linear":296643.0,"score_lmetric":41004},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":11216,"score_linear":112693.0,"score_lmetric":87050},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":150702,"ongoing_decode_tokens":150702,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1929,"cache_hit":0,"new_prefill":11216,"score_linear":150702.0,"score_lmetric":33648},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":11216,"score_linear":164688.0,"score_lmetric":85911},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":11216,"score_linear":106143.0,"score_lmetric":11216},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":11216,"score_linear":233281.0,"score_lmetric":220881}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":384222.593108392,"t_first_token_unix":1779815087.6070516,"t_done":384222.830622845,"t_done_unix":1779815087.8445666},{"request_id":"1366128:21:1402408:760","session_id":"1366128","input_length":97814,"t_proxy_recv":384222.544754875,"t_decision_unix":1779815087.5586963,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9945406588013985,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":534,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11216,"ongoing_decode_tokens":0,"pending_prefill_tokens":7632,"num_requests":1,"active_p_offloads":0,"cached_blocks":1982,"cache_hit":0,"new_prefill":97814,"score_linear":11216.0,"score_lmetric":105446},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":97814,"score_linear":166406.0,"score_lmetric":614484},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296643,"ongoing_decode_tokens":189876,"pending_prefill_tokens":2452,"num_requests":3,"active_p_offloads":0,"cached_blocks":2172,"cache_hit":0,"new_prefill":97814,"score_linear":296643.0,"score_lmetric":300798},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":97814,"score_linear":112693.0,"score_lmetric":260246},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1956,"cache_hit":97280,"new_prefill":534,"score_linear":-72838.0,"score_lmetric":534},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":97814,"score_linear":164688.0,"score_lmetric":345705},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":97814,"score_linear":106143.0,"score_lmetric":97814},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":97814,"score_linear":233281.0,"score_lmetric":480675}],"chosen_score_linear":-72838.0,"chosen_score_lmetric":534,"t_first_token":384222.802095108,"t_first_token_unix":1779815087.8160388,"t_done":384223.225465474,"t_done_unix":1779815088.2394094},{"request_id":"1355951:3:1375866:619","session_id":"1355951","input_length":38041,"t_proxy_recv":384126.991161284,"t_decision_unix":1779814992.0051026,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9690596987460898,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":1177,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":38041,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35888,"ongoing_decode_tokens":0,"pending_prefill_tokens":48,"num_requests":1,"active_p_offloads":0,"cached_blocks":1064,"cache_hit":0,"new_prefill":38041,"score_linear":35888.0,"score_lmetric":38089},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":256950,"ongoing_decode_tokens":0,"pending_prefill_tokens":206395,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":36864,"new_prefill":1177,"score_linear":220086.0,"score_lmetric":415144},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":38041,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167624,"ongoing_decode_tokens":126116,"pending_prefill_tokens":4644,"num_requests":4,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":38041,"score_linear":167624.0,"score_lmetric":170740},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":169139,"ongoing_decode_tokens":169139,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":38041,"score_linear":169139.0,"score_lmetric":114123},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":38041,"score_linear":56286.0,"score_lmetric":86647},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":186148,"ongoing_decode_tokens":80246,"pending_prefill_tokens":45486,"num_requests":2,"active_p_offloads":0,"cached_blocks":1526,"cache_hit":0,"new_prefill":38041,"score_linear":186148.0,"score_lmetric":167054}],"chosen_score_linear":220086.0,"chosen_score_lmetric":415144,"t_first_token":384222.850594889,"t_first_token_unix":1779815087.8645382,"t_done":384223.879699106,"t_done_unix":1779815088.8936434},{"request_id":"1403188:1:1403188:764","session_id":"1403188","input_length":8848,"t_proxy_recv":384222.835667269,"t_decision_unix":1779815087.849609,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8848,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1996,"cache_hit":0,"new_prefill":8848,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":8848,"score_linear":166406.0,"score_lmetric":347586},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296643,"ongoing_decode_tokens":189876,"pending_prefill_tokens":2452,"num_requests":3,"active_p_offloads":0,"cached_blocks":2172,"cache_hit":0,"new_prefill":8848,"score_linear":296643.0,"score_lmetric":33900},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":8848,"score_linear":112693.0,"score_lmetric":82314},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":122256,"ongoing_decode_tokens":122256,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1956,"cache_hit":0,"new_prefill":8848,"score_linear":122256.0,"score_lmetric":17696},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":8848,"score_linear":164688.0,"score_lmetric":78807},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":8848,"score_linear":106143.0,"score_lmetric":8848},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":8848,"score_linear":233281.0,"score_lmetric":213777}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384223.505554068,"t_first_token_unix":1779815088.5194979,"t_done":384224.067701091,"t_done_unix":1779815089.0816445},{"request_id":"1390240:3:1395387:730","session_id":"1390240","input_length":10890,"t_proxy_recv":384195.41980527,"t_decision_unix":1779815060.433746,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7168,"affinity_cache_ratio":0.65821854912764,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":3722,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":10890,"score_linear":40313.0,"score_lmetric":93190},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":10890,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10890,"score_linear":294991.0,"score_lmetric":37881},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":7168,"new_prefill":3722,"score_linear":94635.0,"score_lmetric":32309},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107263,"ongoing_decode_tokens":83622,"pending_prefill_tokens":2137,"num_requests":2,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":0,"new_prefill":10890,"score_linear":107263.0,"score_lmetric":26054},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":0,"new_prefill":10890,"score_linear":33321.0,"score_lmetric":10890},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":10890,"score_linear":106143.0,"score_lmetric":28969},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":170454,"ongoing_decode_tokens":170454,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":10890,"score_linear":170454.0,"score_lmetric":32670}],"chosen_score_linear":94635.0,"chosen_score_lmetric":32309,"t_first_token":384223.059669919,"t_first_token_unix":1779815088.0736132,"t_done":384224.273049012,"t_done_unix":1779815089.2869923},{"request_id":"1403989:1:1403989:767","session_id":"1403989","input_length":1954,"t_proxy_recv":384225.330573586,"t_decision_unix":1779815090.344515,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1954,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2013,"cache_hit":0,"new_prefill":1954,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":1954,"score_linear":166406.0,"score_lmetric":326904},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":1954,"score_linear":296844.0,"score_lmetric":10749},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":1954,"score_linear":101803.0,"score_lmetric":1954},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":1954,"score_linear":166507.0,"score_lmetric":14265},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":1954,"score_linear":164688.0,"score_lmetric":58125},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":1954,"score_linear":106143.0,"score_lmetric":1954},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":1954,"score_linear":233281.0,"score_lmetric":193095}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384225.463087463,"t_first_token_unix":1779815090.4770308,"t_done":384225.808029142,"t_done_unix":1779815090.8219728},{"request_id":"1253743:8:1398344:743","session_id":"1253743","input_length":63258,"t_proxy_recv":384205.627139151,"t_decision_unix":1779815070.6410801,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":51200,"affinity_cache_ratio":0.8093837933542003,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":12058,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1908,"cache_hit":0,"new_prefill":63258,"score_linear":13134.0,"score_lmetric":63258},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":4608,"new_prefill":58650,"score_linear":99168.0,"score_lmetric":304372},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":63258,"score_linear":294991.0,"score_lmetric":193305},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":49664,"new_prefill":13594,"score_linear":63029.0,"score_lmetric":91806},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16550,"ongoing_decode_tokens":16550,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1869,"cache_hit":0,"new_prefill":63258,"score_linear":16550.0,"score_lmetric":63258},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":51200,"new_prefill":12058,"score_linear":-17879.0,"score_lmetric":12058},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":110034,"ongoing_decode_tokens":106143,"pending_prefill_tokens":3891,"num_requests":2,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":63258,"score_linear":110034.0,"score_lmetric":134298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":63258,"score_linear":233281.0,"score_lmetric":377007}],"chosen_score_linear":-17879.0,"chosen_score_lmetric":12058,"t_first_token":384220.431255232,"t_first_token_unix":1779815085.4451988,"t_done":384228.107050609,"t_done_unix":1779815093.1209946},{"request_id":"1382089:2:1404847:773","session_id":"1382089","input_length":39203,"t_proxy_recv":384228.348508843,"t_decision_unix":1779815093.3624501,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9664566487258628,"affinity_num_requests":1,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":39203,"score_linear":21684.0,"score_lmetric":60887},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":39203,"score_linear":166406.0,"score_lmetric":438651},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":34816,"new_prefill":4387,"score_linear":262028.0,"score_lmetric":18048},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":101803,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":39203,"score_linear":122812.0,"score_lmetric":120424},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":39203,"score_linear":166507.0,"score_lmetric":126012},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165073,"ongoing_decode_tokens":101430,"pending_prefill_tokens":667,"num_requests":3,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":0,"new_prefill":39203,"score_linear":165073.0,"score_lmetric":119610},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":37888,"new_prefill":1315,"score_linear":68255.0,"score_lmetric":1315},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":39203,"score_linear":233281.0,"score_lmetric":304842}],"chosen_score_linear":68255.0,"chosen_score_lmetric":1315,"t_first_token":384228.741008516,"t_first_token_unix":1779815093.754952,"t_done":384229.356966956,"t_done_unix":1779815094.3709166},{"request_id":"1253743:8:1404284:769","session_id":"1253743","input_length":63643,"t_proxy_recv":384228.119829721,"t_decision_unix":1779815093.1337714,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9895196643778578,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":667,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":63643,"score_linear":21684.0,"score_lmetric":85327},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":4608,"new_prefill":59035,"score_linear":161798.0,"score_lmetric":498147},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":63643,"score_linear":296844.0,"score_lmetric":195816},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":101803,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":49664,"new_prefill":13979,"score_linear":73148.0,"score_lmetric":69976},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":63643,"score_linear":166507.0,"score_lmetric":199332},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101430,"ongoing_decode_tokens":101430,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":62976,"new_prefill":667,"score_linear":38454.0,"score_lmetric":1334},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":63643,"score_linear":106143.0,"score_lmetric":63643},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":63643,"score_linear":233281.0,"score_lmetric":378162}],"chosen_score_linear":38454.0,"chosen_score_lmetric":1334,"t_first_token":384228.39586538,"t_first_token_unix":1779815093.4098086,"t_done":384229.610060754,"t_done_unix":1779815094.6240046},{"request_id":"1381387:4:1400724:754","session_id":"1381387","input_length":68109,"t_proxy_recv":384213.969768555,"t_decision_unix":1779815078.98371,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":50688,"affinity_cache_ratio":0.7442188257058538,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":17421,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11414,"ongoing_decode_tokens":0,"pending_prefill_tokens":11414,"num_requests":1,"active_p_offloads":0,"cached_blocks":1956,"cache_hit":0,"new_prefill":68109,"score_linear":11414.0,"score_lmetric":79523},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":68109,"score_linear":103776.0,"score_lmetric":323290},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":68109,"score_linear":294991.0,"score_lmetric":207858},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":68109,"score_linear":112693.0,"score_lmetric":200836},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129088,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12153,"num_requests":3,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":68109,"score_linear":129088.0,"score_lmetric":240786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96579,"ongoing_decode_tokens":33321,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":50688,"new_prefill":17421,"score_linear":45891.0,"score_lmetric":58958},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":68109,"score_linear":106143.0,"score_lmetric":68109},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":68109,"score_linear":233281.0,"score_lmetric":391560}],"chosen_score_linear":45891.0,"chosen_score_lmetric":58958,"t_first_token":384226.131331488,"t_first_token_unix":1779815091.145275,"t_done":384230.364723461,"t_done_unix":1779815095.378667},{"request_id":"1398594:2:1404702:771","session_id":"1398594","input_length":21009,"t_proxy_recv":384227.84884312,"t_decision_unix":1779815092.8627841,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.3655576181636441,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":21009,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21009,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":13329,"score_linear":14004.0,"score_lmetric":35013},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":21009,"score_linear":166406.0,"score_lmetric":384069},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":21009,"score_linear":296844.0,"score_lmetric":67914},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":21009,"score_linear":101803.0,"score_lmetric":21009},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":21009,"score_linear":166507.0,"score_lmetric":71430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":164688,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":21009,"score_linear":164688.0,"score_lmetric":63027},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":21009,"score_linear":106143.0,"score_lmetric":21009},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":21009,"score_linear":233281.0,"score_lmetric":250260}],"chosen_score_linear":101803.0,"chosen_score_lmetric":21009,"t_first_token":384230.088905071,"t_first_token_unix":1779815095.1028492,"t_done":384230.487214354,"t_done_unix":1779815095.501158},{"request_id":"1366128:22:1403837:766","session_id":"1366128","input_length":97917,"t_proxy_recv":384224.873953613,"t_decision_unix":1779815089.8878925,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9987234086011622,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":125,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2013,"cache_hit":0,"new_prefill":97917,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":97917,"score_linear":166406.0,"score_lmetric":614793},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":97917,"score_linear":296844.0,"score_lmetric":298638},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":97917,"score_linear":101803.0,"score_lmetric":97917},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":68590,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2676,"num_requests":2,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":97792,"new_prefill":125,"score_linear":-29202.0,"score_lmetric":5602},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":97917,"score_linear":164688.0,"score_lmetric":346014},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":97917,"score_linear":106143.0,"score_lmetric":97917},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":97917,"score_linear":233281.0,"score_lmetric":480984}],"chosen_score_linear":-29202.0,"chosen_score_lmetric":5602,"t_first_token":384232.350786664,"t_first_token_unix":1779815097.3647301,"t_done":384232.683575188,"t_done_unix":1779815097.6975188},{"request_id":"1399948:2:1405276:778","session_id":"1399948","input_length":6149,"t_proxy_recv":384229.80624535,"t_decision_unix":1779815094.8201869,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4608,"affinity_cache_ratio":0.7493901447389819,"affinity_num_requests":3,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":1541,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146445,"ongoing_decode_tokens":21684,"pending_prefill_tokens":14681,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":6149,"score_linear":146445.0,"score_lmetric":62490},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":6149,"score_linear":166406.0,"score_lmetric":339489},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":6149,"score_linear":296844.0,"score_lmetric":23334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":101803,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":6149,"score_linear":122812.0,"score_lmetric":54316},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":4608,"new_prefill":1541,"score_linear":161899.0,"score_lmetric":13026},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101430,"ongoing_decode_tokens":101430,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":6149,"score_linear":101430.0,"score_lmetric":12298},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":6149,"score_linear":139087.0,"score_lmetric":78186},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":6149,"score_linear":233281.0,"score_lmetric":205680}],"chosen_score_linear":161899.0,"chosen_score_lmetric":13026,"t_first_token":384232.502262514,"t_first_token_unix":1779815097.5162058,"t_done":384232.691596782,"t_done_unix":1779815097.70554},{"request_id":"1381387:5:1404170:768","session_id":"1381387","input_length":69508,"t_proxy_recv":384230.37607873,"t_decision_unix":1779815095.3900201,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9796857915635611,"affinity_num_requests":1,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":1412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146445,"ongoing_decode_tokens":21684,"pending_prefill_tokens":14681,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":69508,"score_linear":146445.0,"score_lmetric":252567},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":69508,"score_linear":166406.0,"score_lmetric":529566},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":69508,"score_linear":296844.0,"score_lmetric":213411},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":122812,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":69508,"score_linear":122812.0,"score_lmetric":139016},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172656,"ongoing_decode_tokens":24442,"pending_prefill_tokens":4342,"num_requests":4,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":69508,"score_linear":172656.0,"score_lmetric":295400},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1624,"cache_hit":68096,"new_prefill":1412,"score_linear":-34775.0,"score_lmetric":1412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":69508,"score_linear":139087.0,"score_lmetric":204904},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":69508,"score_linear":233281.0,"score_lmetric":395757}],"chosen_score_linear":-34775.0,"chosen_score_lmetric":1412,"t_first_token":384231.009781045,"t_first_token_unix":1779815096.0237246,"t_done":384233.184871061,"t_done_unix":1779815098.1988156},{"request_id":"1391404:2:1393919:720","session_id":"1391404","input_length":33321,"t_proxy_recv":384190.176587527,"t_decision_unix":1779815055.1905289,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":28160,"affinity_cache_ratio":0.8451126916959275,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":5161,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":33321,"score_linear":48944.0,"score_lmetric":33321},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":33321,"score_linear":294991.0,"score_lmetric":343659},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":33321,"score_linear":101803.0,"score_lmetric":61908},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":1536,"new_prefill":31785,"score_linear":173806.0,"score_lmetric":130527},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":28160,"new_prefill":5161,"score_linear":-28160.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":213388,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":33321,"score_linear":213388.0,"score_lmetric":99963}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":384191.28745193,"t_first_token_unix":1779815056.3013952,"t_done":384235.523526003,"t_done_unix":1779815100.5374699},{"request_id":"1406966:1:1406966:785","session_id":"1406966","input_length":2115,"t_proxy_recv":384235.829395196,"t_decision_unix":1779815100.8433368,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2115,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":2115,"score_linear":166411.0,"score_lmetric":58028},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":103776,"pending_prefill_tokens":13478,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":2115,"score_linear":166406.0,"score_lmetric":46779},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":2115,"score_linear":296844.0,"score_lmetric":11232},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":2115,"score_linear":101803.0,"score_lmetric":2115},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":2115,"score_linear":186159.0,"score_lmetric":62992},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":2115,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":2115,"score_linear":139087.0,"score_lmetric":4230},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":2115,"score_linear":353258.0,"score_lmetric":23472}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384235.964987263,"t_first_token_unix":1779815100.978931,"t_done":384236.19061979,"t_done_unix":1779815101.2045631},{"request_id":"1362265:5:1398180:741","session_id":"1362265","input_length":10736,"t_proxy_recv":384205.205940462,"t_decision_unix":1779815070.219882,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10240,"affinity_cache_ratio":0.9538002980625931,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16347,"ongoing_decode_tokens":13134,"pending_prefill_tokens":3213,"num_requests":2,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":10736,"score_linear":16347.0,"score_lmetric":27898},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":10240,"new_prefill":496,"score_linear":82800.0,"score_lmetric":93536},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10736,"score_linear":294991.0,"score_lmetric":35739},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":6656,"new_prefill":4080,"score_linear":106037.0,"score_lmetric":72778},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1869,"cache_hit":0,"new_prefill":10736,"score_linear":16550.0,"score_lmetric":27286},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":10736,"score_linear":33321.0,"score_lmetric":10736},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":10736,"score_linear":106143.0,"score_lmetric":10736},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":10736,"score_linear":202057.0,"score_lmetric":141190}],"chosen_score_linear":82800.0,"chosen_score_lmetric":93536,"t_first_token":384233.210588212,"t_first_token_unix":1779815098.2245317,"t_done":384236.527341396,"t_done_unix":1779815101.541285},{"request_id":"1362265:6:1399937:747","session_id":"1362265","input_length":10816,"t_proxy_recv":384236.530840336,"t_decision_unix":1779815101.544782,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9940828402366864,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":64,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10816,"score_linear":166411.0,"score_lmetric":92832},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155670,"ongoing_decode_tokens":155670,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1288,"cache_hit":10752,"new_prefill":64,"score_linear":144918.0,"score_lmetric":128},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":271023,"pending_prefill_tokens":354,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":10816,"score_linear":296844.0,"score_lmetric":33510},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":6656,"new_prefill":4160,"score_linear":95147.0,"score_lmetric":4160},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":10816,"score_linear":186159.0,"score_lmetric":97796},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":10816,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":10816,"score_linear":139087.0,"score_lmetric":21632},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":10816,"score_linear":353258.0,"score_lmetric":58276}],"chosen_score_linear":144918.0,"chosen_score_lmetric":128,"t_first_token":384236.594900589,"t_first_token_unix":1779815101.6088438,"t_done":384237.312532988,"t_done_unix":1779815102.3264775},{"request_id":"1407494:1:1407494:787","session_id":"1407494","input_length":1531,"t_proxy_recv":384237.625878779,"t_decision_unix":1779815102.63982,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1531,"score_linear":166411.0,"score_lmetric":55692},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155670,"ongoing_decode_tokens":155670,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1288,"cache_hit":0,"new_prefill":1531,"score_linear":155670.0,"score_lmetric":3062},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":271023,"pending_prefill_tokens":354,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":1531,"score_linear":296844.0,"score_lmetric":5655},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":1531,"score_linear":101803.0,"score_lmetric":1531},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":1531,"score_linear":186159.0,"score_lmetric":60656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":1531,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":1531,"score_linear":139087.0,"score_lmetric":3062},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":1531,"score_linear":353258.0,"score_lmetric":21136}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384237.730781089,"t_first_token_unix":1779815102.7447245,"t_done":384237.996086056,"t_done_unix":1779815103.0100298},{"request_id":"1373431:1:1373431:606","session_id":"1373431","input_length":126340,"t_proxy_recv":384118.494254878,"t_decision_unix":1779814983.508196,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":-126340,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":126340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":126340,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":126340,"score_linear":26705.0,"score_lmetric":126340},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":126340,"score_linear":-12421.0,"score_lmetric":-126340},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136519,"ongoing_decode_tokens":136519,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":126340,"score_linear":136519.0,"score_lmetric":252680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130257,"ongoing_decode_tokens":72919,"pending_prefill_tokens":14330,"num_requests":4,"active_p_offloads":0,"cached_blocks":1443,"cache_hit":0,"new_prefill":126340,"score_linear":130257.0,"score_lmetric":562680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":152567,"pending_prefill_tokens":2233,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":126340,"score_linear":168624.0,"score_lmetric":385719},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":1024,"new_prefill":125316,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":126340,"score_linear":140250.0,"score_lmetric":252680}],"chosen_score_linear":-12421.0,"chosen_score_lmetric":-126340,"t_first_token":384169.523715691,"t_first_token_unix":1779815034.5376604,"t_done":384238.246120703,"t_done_unix":1779815103.2600684},{"request_id":"1406966:2:1407710:789","session_id":"1406966","input_length":4789,"t_proxy_recv":384238.308176952,"t_decision_unix":1779815103.3221183,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":2048,"affinity_cache_ratio":0.42764669033201086,"affinity_num_requests":0,"avg_num_requests":2.625,"fallback_score":0,"tie_break_used":false,"cache_hit":2048,"estimated_new_tokens":2741,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4789,"score_linear":166411.0,"score_lmetric":68724},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155670,"ongoing_decode_tokens":155670,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1288,"cache_hit":0,"new_prefill":4789,"score_linear":155670.0,"score_lmetric":9578},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":4789,"score_linear":297771.0,"score_lmetric":17838},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":103304,"ongoing_decode_tokens":103304,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":4789,"score_linear":103304.0,"score_lmetric":9578},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":4789,"score_linear":186159.0,"score_lmetric":73688},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":2048,"new_prefill":2741,"score_linear":-2048.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":4789,"score_linear":139087.0,"score_lmetric":9578},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":4789,"score_linear":353258.0,"score_lmetric":34168}],"chosen_score_linear":-2048.0,"chosen_score_lmetric":0,"t_first_token":384238.510474758,"t_first_token_unix":1779815103.5244184,"t_done":384238.727885596,"t_done_unix":1779815103.7418294},{"request_id":"1397515:1:1397515:736","session_id":"1397515","input_length":93040,"t_proxy_recv":384202.698203652,"t_decision_unix":1779815067.712145,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":93040,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":0,"new_prefill":93040,"score_linear":13134.0,"score_lmetric":93040},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":93040,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":93040,"score_linear":294991.0,"score_lmetric":284331},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":93040,"score_linear":112693.0,"score_lmetric":250698},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109145,"ongoing_decode_tokens":109145,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1863,"cache_hit":512,"new_prefill":92528,"score_linear":108633.0,"score_lmetric":185056},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":93040,"score_linear":33321.0,"score_lmetric":93040},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":93040,"score_linear":106143.0,"score_lmetric":93040},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":93040,"score_linear":202057.0,"score_lmetric":305798}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384233.209432818,"t_first_token_unix":1779815098.223376,"t_done":384238.959022794,"t_done_unix":1779815103.9729664},{"request_id":"1407995:1:1407995:793","session_id":"1407995","input_length":2944,"t_proxy_recv":384239.440306414,"t_decision_unix":1779815104.454248,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":2944,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":2944,"score_linear":166411.0,"score_lmetric":61344},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62630,"ongoing_decode_tokens":62630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":2944,"score_linear":62630.0,"score_lmetric":2944},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":2944,"score_linear":297771.0,"score_lmetric":12303},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":103304,"ongoing_decode_tokens":103304,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":2944,"score_linear":103304.0,"score_lmetric":5888},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":2944,"score_linear":186159.0,"score_lmetric":66308},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27676,"ongoing_decode_tokens":0,"pending_prefill_tokens":5660,"num_requests":1,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":2944,"score_linear":27676.0,"score_lmetric":8604},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":2944,"score_linear":139087.0,"score_lmetric":5888},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":2944,"score_linear":353258.0,"score_lmetric":26788}],"chosen_score_linear":62630.0,"chosen_score_lmetric":2944,"t_first_token":384239.713789149,"t_first_token_unix":1779815104.7277324,"t_done":384240.426056364,"t_done_unix":1779815105.4400022},{"request_id":"1407599:1:1407599:788","session_id":"1407599","input_length":1501,"t_proxy_recv":384237.97477898,"t_decision_unix":1779815102.9887204,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":1501,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1501,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1501,"score_linear":166411.0,"score_lmetric":55572},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155670,"ongoing_decode_tokens":155670,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1288,"cache_hit":0,"new_prefill":1501,"score_linear":155670.0,"score_lmetric":3002},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":271023,"pending_prefill_tokens":354,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":1501,"score_linear":296844.0,"score_lmetric":5565},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":1501,"score_linear":101803.0,"score_lmetric":1501},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":1501,"score_linear":186159.0,"score_lmetric":60536},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1531,"ongoing_decode_tokens":1531,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":1501,"score_linear":1531.0,"score_lmetric":1501},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":1501,"score_linear":139087.0,"score_lmetric":3002},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":1501,"score_linear":353258.0,"score_lmetric":21016}],"chosen_score_linear":101803.0,"chosen_score_lmetric":1501,"t_first_token":384238.299100161,"t_first_token_unix":1779815103.3130434,"t_done":384240.51512927,"t_done_unix":1779815105.5290723},{"request_id":"1399948:3:1405988:782","session_id":"1399948","input_length":7995,"t_proxy_recv":384232.733374435,"t_decision_unix":1779815097.7473161,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":6144,"affinity_cache_ratio":0.7684803001876173,"affinity_num_requests":3,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":1851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7995,"score_linear":166411.0,"score_lmetric":81548},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":7995,"score_linear":166406.0,"score_lmetric":345027},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":7995,"score_linear":296844.0,"score_lmetric":28872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":7995,"score_linear":101803.0,"score_lmetric":7995},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":178164,"ongoing_decode_tokens":68590,"pending_prefill_tokens":11782,"num_requests":3,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":6144,"new_prefill":1851,"score_linear":172020.0,"score_lmetric":40899},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":102829,"ongoing_decode_tokens":102829,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1624,"cache_hit":0,"new_prefill":7995,"score_linear":102829.0,"score_lmetric":15990},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":7995,"score_linear":139087.0,"score_lmetric":81878},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":7995,"score_linear":353258.0,"score_lmetric":46992}],"chosen_score_linear":172020.0,"chosen_score_lmetric":40899,"t_first_token":384240.433851353,"t_first_token_unix":1779815105.4477944,"t_done":384241.633443642,"t_done_unix":1779815106.6473868},{"request_id":"1286804:5:1407989:792","session_id":"1286804","input_length":27676,"t_proxy_recv":384239.415975497,"t_decision_unix":1779815104.4299169,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":22016,"affinity_cache_ratio":0.795490677843619,"affinity_num_requests":0,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":5660,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":27676,"score_linear":166411.0,"score_lmetric":160272},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62630,"ongoing_decode_tokens":62630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":27676,"score_linear":62630.0,"score_lmetric":27676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":27676,"score_linear":297771.0,"score_lmetric":86499},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":103304,"ongoing_decode_tokens":103304,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":27676,"score_linear":103304.0,"score_lmetric":55352},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":1536,"new_prefill":26140,"score_linear":184623.0,"score_lmetric":159092},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":22016,"new_prefill":5660,"score_linear":-22016.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":27676,"score_linear":139087.0,"score_lmetric":55352},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":27676,"score_linear":353258.0,"score_lmetric":125716}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":384240.435157339,"t_first_token_unix":1779815105.4491003,"t_done":384241.787244756,"t_done_unix":1779815106.8011878},{"request_id":"1408430:1:1408430:797","session_id":"1408430","input_length":7553,"t_proxy_recv":384240.972080306,"t_decision_unix":1779815105.9860215,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.75,"fallback_score":7553,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7553,"score_linear":181139.0,"score_lmetric":129845},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62630,"ongoing_decode_tokens":62630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":7553,"score_linear":62630.0,"score_lmetric":7553},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":7553,"score_linear":297771.0,"score_lmetric":26130},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":7553,"score_linear":101803.0,"score_lmetric":7553},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":186159,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":7553,"score_linear":186159.0,"score_lmetric":30212},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27676,"ongoing_decode_tokens":27676,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":7553,"score_linear":27676.0,"score_lmetric":7553},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":166873,"ongoing_decode_tokens":166873,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":7553,"score_linear":166873.0,"score_lmetric":22659},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":7553,"score_linear":353258.0,"score_lmetric":45224}],"chosen_score_linear":101803.0,"chosen_score_lmetric":7553,"t_first_token":384241.506094413,"t_first_token_unix":1779815106.5200377,"t_done":384241.941967678,"t_done_unix":1779815106.9559107},{"request_id":"1340290:7:1408176:795","session_id":"1340290","input_length":27786,"t_proxy_recv":384240.127996715,"t_decision_unix":1779815105.1419382,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9766069243503923,"affinity_num_requests":2,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":27786,"score_linear":166411.0,"score_lmetric":160712},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65574,"ongoing_decode_tokens":65574,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":27786,"score_linear":65574.0,"score_lmetric":55572},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":27786,"score_linear":297771.0,"score_lmetric":86829},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":103304,"ongoing_decode_tokens":103304,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":27786,"score_linear":103304.0,"score_lmetric":55572},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":20992,"new_prefill":6794,"score_linear":165167.0,"score_lmetric":81708},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27676,"ongoing_decode_tokens":0,"pending_prefill_tokens":5660,"num_requests":1,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":27786,"score_linear":27676.0,"score_lmetric":33446},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":27136,"new_prefill":650,"score_linear":111951.0,"score_lmetric":1300},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":27786,"score_linear":353258.0,"score_lmetric":126156}],"chosen_score_linear":111951.0,"chosen_score_lmetric":1300,"t_first_token":384240.313028468,"t_first_token_unix":1779815105.326972,"t_done":384241.975644041,"t_done_unix":1779815106.9895873},{"request_id":"1399948:4:1407140:786","session_id":"1399948","input_length":8540,"t_proxy_recv":384241.637463562,"t_decision_unix":1779815106.651405,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7680,"affinity_cache_ratio":0.8992974238875878,"affinity_num_requests":3,"avg_num_requests":2.875,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":860,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":8540,"score_linear":181139.0,"score_lmetric":134780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69007,"ongoing_decode_tokens":62630,"pending_prefill_tokens":6377,"num_requests":2,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":8540,"score_linear":69007.0,"score_lmetric":29834},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":8540,"score_linear":297771.0,"score_lmetric":29091},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109356,"ongoing_decode_tokens":109356,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":8540,"score_linear":109356.0,"score_lmetric":17080},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":178164,"ongoing_decode_tokens":178164,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":7680,"new_prefill":860,"score_linear":170484.0,"score_lmetric":2580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27676,"ongoing_decode_tokens":27676,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":8540,"score_linear":27676.0,"score_lmetric":8540},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":166873,"ongoing_decode_tokens":166873,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":8540,"score_linear":166873.0,"score_lmetric":25620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":8540,"score_linear":353258.0,"score_lmetric":49172}],"chosen_score_linear":170484.0,"chosen_score_lmetric":2580,"t_first_token":384241.755639868,"t_first_token_unix":1779815106.7695837,"t_done":384242.272784157,"t_done_unix":1779815107.2867274},{"request_id":"1408779:1:1408779:802","session_id":"1408779","input_length":1801,"t_proxy_recv":384242.070582441,"t_decision_unix":1779815107.084524,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1801,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":1801,"score_linear":181139.0,"score_lmetric":101085},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80077,"ongoing_decode_tokens":69007,"pending_prefill_tokens":318,"num_requests":3,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":1801,"score_linear":80077.0,"score_lmetric":6357},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":1801,"score_linear":297771.0,"score_lmetric":8874},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":1801,"score_linear":101803.0,"score_lmetric":1801},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186704,"ongoing_decode_tokens":186704,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":1801,"score_linear":186704.0,"score_lmetric":7204},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":1801,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":1801,"score_linear":139087.0,"score_lmetric":3602},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":1801,"score_linear":353258.0,"score_lmetric":22216}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384242.190413815,"t_first_token_unix":1779815107.2043567,"t_done":384242.416922239,"t_done_unix":1779815107.4308655},{"request_id":"1408889:1:1408889:804","session_id":"1408889","input_length":3230,"t_proxy_recv":384242.442364516,"t_decision_unix":1779815107.4563062,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3230,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":3230,"score_linear":181139.0,"score_lmetric":108230},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80077,"ongoing_decode_tokens":80077,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":3230,"score_linear":80077.0,"score_lmetric":9690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":3230,"score_linear":297771.0,"score_lmetric":13161},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":3230,"score_linear":101803.0,"score_lmetric":3230},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186776,"ongoing_decode_tokens":186776,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1964,"cache_hit":0,"new_prefill":3230,"score_linear":186776.0,"score_lmetric":12920},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":0,"new_prefill":3230,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":3230,"score_linear":139087.0,"score_lmetric":6460},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":3230,"score_linear":353258.0,"score_lmetric":27932}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384242.638388358,"t_first_token_unix":1779815107.6523316,"t_done":384242.761484917,"t_done_unix":1779815107.775428},{"request_id":"1399948:5:1407922:791","session_id":"1399948","input_length":8612,"t_proxy_recv":384242.27589043,"t_decision_unix":1779815107.2898319,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":8192,"affinity_cache_ratio":0.9512308406874129,"affinity_num_requests":3,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":8612,"score_linear":181139.0,"score_lmetric":135140},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80077,"ongoing_decode_tokens":80077,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":8612,"score_linear":80077.0,"score_lmetric":25836},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":8612,"score_linear":297771.0,"score_lmetric":29307},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":8612,"score_linear":101803.0,"score_lmetric":8612},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":178164,"ongoing_decode_tokens":178164,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1964,"cache_hit":8192,"new_prefill":420,"score_linear":169972.0,"score_lmetric":1260},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1801,"ongoing_decode_tokens":1801,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":8612,"score_linear":1801.0,"score_lmetric":8612},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":8612,"score_linear":139087.0,"score_lmetric":17224},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":8612,"score_linear":353258.0,"score_lmetric":49460}],"chosen_score_linear":169972.0,"chosen_score_lmetric":1260,"t_first_token":384242.357196926,"t_first_token_unix":1779815107.3711407,"t_done":384242.897988685,"t_done_unix":1779815107.911932},{"request_id":"1366128:23:1405900:781","session_id":"1366128","input_length":109574,"t_proxy_recv":384232.72374976,"t_decision_unix":1779815097.7376914,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":97792,"affinity_cache_ratio":0.8924744921240441,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":11782,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":109574,"score_linear":166411.0,"score_lmetric":487864},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":109574,"score_linear":166406.0,"score_lmetric":649764},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":109574,"score_linear":296844.0,"score_lmetric":333609},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":109574,"score_linear":101803.0,"score_lmetric":109574},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":68590,"ongoing_decode_tokens":68590,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":97792,"new_prefill":11782,"score_linear":-29202.0,"score_lmetric":23564},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":102829,"ongoing_decode_tokens":102829,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1624,"cache_hit":0,"new_prefill":109574,"score_linear":102829.0,"score_lmetric":219148},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":109574,"score_linear":139087.0,"score_lmetric":285036},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":109574,"score_linear":353258.0,"score_lmetric":453308}],"chosen_score_linear":-29202.0,"chosen_score_lmetric":23564,"t_first_token":384240.432155755,"t_first_token_unix":1779815105.4460988,"t_done":384242.935259515,"t_done_unix":1779815107.949203},{"request_id":"1364090:5:1401054:756","session_id":"1364090","input_length":62630,"t_proxy_recv":384215.238683062,"t_decision_unix":1779815080.2526238,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":49152,"affinity_cache_ratio":0.7847996167970621,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":13478,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":7680,"new_prefill":54950,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":49152,"new_prefill":13478,"score_linear":54624.0,"score_lmetric":214028},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":54950,"score_linear":287311.0,"score_lmetric":168381},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":62630,"score_linear":112693.0,"score_lmetric":189878},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":153530,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12531,"num_requests":4,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":4096,"new_prefill":58534,"score_linear":149434.0,"score_lmetric":284260},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":33321,"pending_prefill_tokens":29479,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":7680,"new_prefill":54950,"score_linear":157008.0,"score_lmetric":253287},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":11264,"new_prefill":51366,"score_linear":94879.0,"score_lmetric":51366},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":11264,"new_prefill":51366,"score_linear":222017.0,"score_lmetric":341331}],"chosen_score_linear":54624.0,"chosen_score_lmetric":214028,"t_first_token":384236.056301116,"t_first_token_unix":1779815101.070245,"t_done":384243.03540578,"t_done_unix":1779815108.0493495},{"request_id":"1366128:24:1407996:794","session_id":"1366128","input_length":109775,"t_proxy_recv":384242.956098377,"t_decision_unix":1779815107.9700398,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":109568,"affinity_cache_ratio":0.998114324755181,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":109568,"estimated_new_tokens":207,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":109775,"score_linear":181139.0,"score_lmetric":640955},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80077,"ongoing_decode_tokens":80077,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":109775,"score_linear":80077.0,"score_lmetric":329325},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":109775,"score_linear":297771.0,"score_lmetric":332796},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":109775,"score_linear":101803.0,"score_lmetric":109775},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":68590,"ongoing_decode_tokens":68590,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":109568,"new_prefill":207,"score_linear":-40978.0,"score_lmetric":414},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":109775,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":109775,"score_linear":139087.0,"score_lmetric":219550},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":109775,"score_linear":353258.0,"score_lmetric":454112}],"chosen_score_linear":-40978.0,"chosen_score_lmetric":414,"t_first_token":384243.205327843,"t_first_token_unix":1779815108.219271,"t_done":384243.775991881,"t_done_unix":1779815108.7899356},{"request_id":"1313181:7:1327489:383","session_id":"1313181","input_length":121811,"t_proxy_recv":384198.121870172,"t_decision_unix":1779815063.1358113,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":61952,"affinity_cache_ratio":0.5085911781366215,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":59859,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":40313,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":12800,"new_prefill":109011,"score_linear":27513.0,"score_lmetric":289432},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":21241,"ongoing_decode_tokens":0,"pending_prefill_tokens":9465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1269,"cache_hit":0,"new_prefill":121811,"score_linear":21241.0,"score_lmetric":131276},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":121811,"score_linear":294991.0,"score_lmetric":370644},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":12800,"new_prefill":109011,"score_linear":99893.0,"score_lmetric":282640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":108538,"ongoing_decode_tokens":108538,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":0,"new_prefill":121811,"score_linear":108538.0,"score_lmetric":243622},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1565,"cache_hit":0,"new_prefill":121811,"score_linear":33321.0,"score_lmetric":121811},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":121811,"score_linear":106143.0,"score_lmetric":139890},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":61952,"new_prefill":59859,"score_linear":18294.0,"score_lmetric":59859}],"chosen_score_linear":18294.0,"chosen_score_lmetric":59859,"t_first_token":384232.155685961,"t_first_token_unix":1779815097.1696298,"t_done":384243.961246328,"t_done_unix":1779815108.9751909},{"request_id":"1355951:4:1389858:703","session_id":"1355951","input_length":38242,"t_proxy_recv":384223.887788868,"t_decision_unix":1779815088.9017298,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9907431619685163,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":8848,"ongoing_decode_tokens":8848,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1996,"cache_hit":0,"new_prefill":38242,"score_linear":8848.0,"score_lmetric":38242},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":38242,"score_linear":166406.0,"score_lmetric":435768},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":258602,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1275,"num_requests":2,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":37888,"new_prefill":354,"score_linear":220714.0,"score_lmetric":3258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":112693,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":38242,"score_linear":112693.0,"score_lmetric":76484},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":38242,"score_linear":24442.0,"score_lmetric":38242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":38242,"score_linear":164688.0,"score_lmetric":166989},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":34816,"new_prefill":3426,"score_linear":71327.0,"score_lmetric":3426},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":38242,"score_linear":233281.0,"score_lmetric":301959}],"chosen_score_linear":220714.0,"chosen_score_lmetric":3258,"t_first_token":384243.501564265,"t_first_token_unix":1779815108.5155098,"t_done":384244.238271397,"t_done_unix":1779815109.2522151},{"request_id":"1268861:8:1403753:765","session_id":"1268861","input_length":44148,"t_proxy_recv":384224.584402656,"t_decision_unix":1779815089.5983436,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":41472,"affinity_cache_ratio":0.939385702636586,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":41472,"estimated_new_tokens":2676,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2013,"cache_hit":0,"new_prefill":44148,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":44148,"score_linear":166406.0,"score_lmetric":453486},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":44148,"score_linear":296844.0,"score_lmetric":137331},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":44148,"score_linear":101803.0,"score_lmetric":44148},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":41472,"new_prefill":2676,"score_linear":-17030.0,"score_lmetric":2676},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":96579,"pending_prefill_tokens":17421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":44148,"score_linear":164688.0,"score_lmetric":184707},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":44148,"score_linear":106143.0,"score_lmetric":44148},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":44148,"score_linear":233281.0,"score_lmetric":319677}],"chosen_score_linear":-17030.0,"chosen_score_lmetric":2676,"t_first_token":384232.346915783,"t_first_token_unix":1779815097.3608594,"t_done":384244.583980725,"t_done_unix":1779815109.5979245},{"request_id":"1363943:10:1401002:755","session_id":"1363943","input_length":24442,"t_proxy_recv":384215.006737221,"t_decision_unix":1779815080.020678,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9845348171180754,"affinity_num_requests":3,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":378,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":8704,"new_prefill":15738,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":4096,"new_prefill":20346,"score_linear":99680.0,"score_lmetric":227764},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":4096,"new_prefill":20346,"score_linear":290895.0,"score_lmetric":64569},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":24442,"score_linear":112693.0,"score_lmetric":113502},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129088,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12153,"num_requests":3,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":24064,"new_prefill":378,"score_linear":105024.0,"score_lmetric":37593},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":33321,"pending_prefill_tokens":29479,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":4096,"new_prefill":20346,"score_linear":160592.0,"score_lmetric":149475},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":4096,"new_prefill":20346,"score_linear":102047.0,"score_lmetric":20346},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":4096,"new_prefill":20346,"score_linear":229185.0,"score_lmetric":248271}],"chosen_score_linear":105024.0,"chosen_score_lmetric":37593,"t_first_token":384220.763984895,"t_first_token_unix":1779815085.7779284,"t_done":384244.626347763,"t_done_unix":1779815109.6402912},{"request_id":"1405155:1:1405155:775","session_id":"1405155","input_length":32944,"t_proxy_recv":384229.449713266,"t_decision_unix":1779815094.4636548,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.375,"fallback_score":32944,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":32944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":32944,"score_linear":21684.0,"score_lmetric":32944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":32944,"score_linear":166406.0,"score_lmetric":419874},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":32944,"score_linear":296844.0,"score_lmetric":103719},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":101803,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":32944,"score_linear":122812.0,"score_lmetric":107906},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":32944,"score_linear":166507.0,"score_lmetric":107235},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165073,"ongoing_decode_tokens":165073,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":512,"new_prefill":32432,"score_linear":164561.0,"score_lmetric":97296},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":32944,"score_linear":106143.0,"score_lmetric":32944},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":32944,"score_linear":233281.0,"score_lmetric":286065}],"chosen_score_linear":106143.0,"chosen_score_lmetric":32944,"t_first_token":384234.084466971,"t_first_token_unix":1779815099.0984108,"t_done":384245.252860273,"t_done_unix":1779815110.266804},{"request_id":"1381387:6:1409195:806","session_id":"1381387","input_length":71570,"t_proxy_recv":384243.713698824,"t_decision_unix":1779815108.7276402,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69632,"affinity_cache_ratio":0.9729216152019002,"affinity_num_requests":0,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":1938,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":71570,"score_linear":181139.0,"score_lmetric":449930},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":90839,"ongoing_decode_tokens":17447,"pending_prefill_tokens":10416,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":71570,"score_linear":90839.0,"score_lmetric":245958},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":182925,"pending_prefill_tokens":803,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":71570,"score_linear":297771.0,"score_lmetric":217119},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":71570,"score_linear":101803.0,"score_lmetric":71570},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":178365,"ongoing_decode_tokens":178365,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":71570,"score_linear":178365.0,"score_lmetric":214710},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":69632,"new_prefill":1938,"score_linear":-69632.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168817,"ongoing_decode_tokens":139087,"pending_prefill_tokens":2082,"num_requests":3,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":71570,"score_linear":168817.0,"score_lmetric":220956},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":71570,"score_linear":353258.0,"score_lmetric":301292}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":384244.758784095,"t_first_token_unix":1779815109.7727277,"t_done":384245.677560176,"t_done_unix":1779815110.6915047},{"request_id":"1340290:8:1409129:805","session_id":"1340290","input_length":29730,"t_proxy_recv":384243.451642903,"t_decision_unix":1779815108.465584,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9299697275479314,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":2082,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":29730,"score_linear":181139.0,"score_lmetric":240730},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":90839,"ongoing_decode_tokens":17447,"pending_prefill_tokens":10416,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":29730,"score_linear":90839.0,"score_lmetric":120438},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":29730,"score_linear":297771.0,"score_lmetric":92661},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":29730,"score_linear":101803.0,"score_lmetric":29730},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":178365,"ongoing_decode_tokens":178365,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":20992,"new_prefill":8738,"score_linear":157373.0,"score_lmetric":26214},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":27648,"new_prefill":2082,"score_linear":111439.0,"score_lmetric":4164},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":29730,"score_linear":353258.0,"score_lmetric":133932}],"chosen_score_linear":111439.0,"chosen_score_lmetric":4164,"t_first_token":384243.953883121,"t_first_token_unix":1779815108.9678266,"t_done":384247.024996947,"t_done_unix":1779815112.038957},{"request_id":"1408779:2:1410032:807","session_id":"1408779","input_length":5001,"t_proxy_recv":384246.592883076,"t_decision_unix":1779815111.6068242,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.30713857228554287,"affinity_num_requests":0,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":3465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":5001,"score_linear":181139.0,"score_lmetric":93668},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":90839,"ongoing_decode_tokens":17447,"pending_prefill_tokens":10416,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":5001,"score_linear":90839.0,"score_lmetric":46251},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":5001,"score_linear":259529.0,"score_lmetric":11608},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":5001,"score_linear":101803.0,"score_lmetric":5001},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":1536,"new_prefill":3465,"score_linear":-1536.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135873,"ongoing_decode_tokens":135873,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2309,"cache_hit":0,"new_prefill":5001,"score_linear":135873.0,"score_lmetric":10002},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":5001,"score_linear":293465.0,"score_lmetric":35280}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":384246.823250798,"t_first_token_unix":1779815111.8371944,"t_done":384247.244570098,"t_done_unix":1779815112.2585137},{"request_id":"1406966:3:1410097:808","session_id":"1406966","input_length":7893,"t_proxy_recv":384246.826682455,"t_decision_unix":1779815111.840624,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.5838084378563284,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":3285,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7893,"score_linear":181139.0,"score_lmetric":105236},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":90839,"ongoing_decode_tokens":17447,"pending_prefill_tokens":10416,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":7893,"score_linear":90839.0,"score_lmetric":54927},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":7893,"score_linear":259529.0,"score_lmetric":17392},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":7893,"score_linear":101803.0,"score_lmetric":7893},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5001,"ongoing_decode_tokens":5001,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":4608,"new_prefill":3285,"score_linear":393.0,"score_lmetric":3285},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135873,"ongoing_decode_tokens":135873,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2309,"cache_hit":0,"new_prefill":7893,"score_linear":135873.0,"score_lmetric":15786},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":7893,"score_linear":293465.0,"score_lmetric":46848}],"chosen_score_linear":393.0,"chosen_score_lmetric":3285,"t_first_token":384247.10474214,"t_first_token_unix":1779815112.1186855,"t_done":384247.318777007,"t_done_unix":1779815112.332721},{"request_id":"1362265:7:1408772:800","session_id":"1362265","input_length":11070,"t_proxy_recv":384242.054873267,"t_decision_unix":1779815107.0688148,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9712737127371274,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":318,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11070,"score_linear":181139.0,"score_lmetric":147430},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69007,"ongoing_decode_tokens":69007,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":10752,"new_prefill":318,"score_linear":58255.0,"score_lmetric":636},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":11070,"score_linear":297771.0,"score_lmetric":36681},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":6656,"new_prefill":4414,"score_linear":95147.0,"score_lmetric":4414},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186704,"ongoing_decode_tokens":186704,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":11070,"score_linear":186704.0,"score_lmetric":44280},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":11070,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":11070,"score_linear":139087.0,"score_lmetric":22140},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":11070,"score_linear":353258.0,"score_lmetric":59292}],"chosen_score_linear":58255.0,"chosen_score_lmetric":636,"t_first_token":384242.135313374,"t_first_token_unix":1779815107.1492565,"t_done":384247.63090315,"t_done_unix":1779815112.6448467},{"request_id":"1407494:2:1410400:809","session_id":"1407494","input_length":4728,"t_proxy_recv":384247.690720015,"t_decision_unix":1779815112.7046611,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.3248730964467005,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":3192,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4728,"score_linear":181139.0,"score_lmetric":92576},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79769,"ongoing_decode_tokens":79769,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":4728,"score_linear":79769.0,"score_lmetric":9456},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":4728,"score_linear":259529.0,"score_lmetric":11062},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":4728,"score_linear":101803.0,"score_lmetric":4728},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":1536,"new_prefill":3192,"score_linear":-1536.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":4728,"score_linear":106143.0,"score_lmetric":4728},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":4728,"score_linear":293465.0,"score_lmetric":34188}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":384247.914742646,"t_first_token_unix":1779815112.9286864,"t_done":384248.207467589,"t_done_unix":1779815113.221411},{"request_id":"1408889:2:1410453:810","session_id":"1408889","input_length":4825,"t_proxy_recv":384247.829267302,"t_decision_unix":1779815112.8432086,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":3072,"affinity_cache_ratio":0.6366839378238341,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":1753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":4825,"score_linear":181139.0,"score_lmetric":92964},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79769,"ongoing_decode_tokens":79769,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":4825,"score_linear":79769.0,"score_lmetric":9650},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":4825,"score_linear":259529.0,"score_lmetric":11256},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":4825,"score_linear":101803.0,"score_lmetric":4825},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":4825,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4728,"ongoing_decode_tokens":0,"pending_prefill_tokens":3192,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":3072,"new_prefill":1753,"score_linear":1656.0,"score_lmetric":4945},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":4825,"score_linear":106143.0,"score_lmetric":4825},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":4825,"score_linear":293465.0,"score_lmetric":34576}],"chosen_score_linear":1656.0,"chosen_score_lmetric":4945,"t_first_token":384248.048880573,"t_first_token_unix":1779815113.0628247,"t_done":384248.362507606,"t_done_unix":1779815113.3764515},{"request_id":"1408578:1:1408578:798","session_id":"1408578","input_length":6377,"t_proxy_recv":384241.392233869,"t_decision_unix":1779815106.4061751,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.875,"fallback_score":6377,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":6377,"score_linear":181139.0,"score_lmetric":123965},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62630,"ongoing_decode_tokens":62630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":6377,"score_linear":62630.0,"score_lmetric":6377},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":6377,"score_linear":297771.0,"score_lmetric":22602},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109356,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7553,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":6377,"score_linear":109356.0,"score_lmetric":27860},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":186159,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":6377,"score_linear":186159.0,"score_lmetric":25508},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27676,"ongoing_decode_tokens":27676,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":6377,"score_linear":27676.0,"score_lmetric":6377},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":166873,"ongoing_decode_tokens":166873,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":6377,"score_linear":166873.0,"score_lmetric":19131},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":6377,"score_linear":353258.0,"score_lmetric":40520}],"chosen_score_linear":62630.0,"chosen_score_lmetric":6377,"t_first_token":384241.845235412,"t_first_token_unix":1779815106.8591785,"t_done":384248.500988806,"t_done_unix":1779815113.5149324},{"request_id":"1340290:9:1410595:811","session_id":"1340290","input_length":29958,"t_proxy_recv":384248.24880489,"t_decision_unix":1779815113.2627463,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":29696,"affinity_cache_ratio":0.9912544228586688,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":262,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":29958,"score_linear":181139.0,"score_lmetric":193496},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79769,"ongoing_decode_tokens":79769,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":29958,"score_linear":79769.0,"score_lmetric":59916},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":29958,"score_linear":259529.0,"score_lmetric":61522},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":29958,"score_linear":101803.0,"score_lmetric":29958},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":20992,"new_prefill":8966,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4825,"ongoing_decode_tokens":4825,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":29958,"score_linear":4825.0,"score_lmetric":29958},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":29696,"new_prefill":262,"score_linear":76447.0,"score_lmetric":262},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":29958,"score_linear":293465.0,"score_lmetric":135108}],"chosen_score_linear":76447.0,"chosen_score_lmetric":262,"t_first_token":384248.324801794,"t_first_token_unix":1779815113.3387456,"t_done":384248.952112463,"t_done_unix":1779815113.966056},{"request_id":"1399948:6:1410696:812","session_id":"1399948","input_length":11381,"t_proxy_recv":384248.578899731,"t_decision_unix":1779815113.5928411,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":8192,"affinity_cache_ratio":0.7197961514805378,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":3189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11381,"score_linear":181139.0,"score_lmetric":119188},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":73392,"ongoing_decode_tokens":73392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":0,"new_prefill":11381,"score_linear":73392.0,"score_lmetric":11381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":11381,"score_linear":259529.0,"score_lmetric":24368},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":11381,"score_linear":101803.0,"score_lmetric":11381},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":8192,"new_prefill":3189,"score_linear":-8192.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":136101,"ongoing_decode_tokens":136101,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":11381,"score_linear":136101.0,"score_lmetric":22762},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":11381,"score_linear":293465.0,"score_lmetric":60800}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":384248.896114649,"t_first_token_unix":1779815113.9100585,"t_done":384248.982577738,"t_done_unix":1779815113.9965212},{"request_id":"1370129:6:1394177:722","session_id":"1370129","input_length":106143,"t_proxy_recv":384191.190559267,"t_decision_unix":1779815056.2045004,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":88064,"affinity_cache_ratio":0.8296731767521174,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":18079,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":4675,"ongoing_decode_tokens":0,"pending_prefill_tokens":4675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":7680,"new_prefill":98463,"score_linear":-3005.0,"score_lmetric":103138},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":18432,"new_prefill":87711,"score_linear":30512.0,"score_lmetric":87711},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":205835,"pending_prefill_tokens":1737,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":98463,"score_linear":287311.0,"score_lmetric":300600},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":106143,"score_linear":101803.0,"score_lmetric":134730},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":4096,"new_prefill":102047,"score_linear":171246.0,"score_lmetric":341313},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":0,"pending_prefill_tokens":5161,"num_requests":1,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":7680,"new_prefill":98463,"score_linear":25641.0,"score_lmetric":103624},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":88064,"new_prefill":18079,"score_linear":-88064.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":214933,"ongoing_decode_tokens":186551,"pending_prefill_tokens":1758,"num_requests":3,"active_p_offloads":0,"cached_blocks":1655,"cache_hit":7680,"new_prefill":98463,"score_linear":207253.0,"score_lmetric":300663}],"chosen_score_linear":-88064.0,"chosen_score_lmetric":0,"t_first_token":384202.123365179,"t_first_token_unix":1779815067.1373088,"t_done":384249.338755836,"t_done_unix":1779815114.3527},{"request_id":"1408779:3:1411249:815","session_id":"1408779","input_length":7110,"t_proxy_recv":384250.606661093,"t_decision_unix":1779815115.6206021,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.6481012658227848,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":2502,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":7110,"score_linear":181139.0,"score_lmetric":102104},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":73392,"ongoing_decode_tokens":73392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":0,"new_prefill":7110,"score_linear":73392.0,"score_lmetric":7110},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":7110,"score_linear":259529.0,"score_lmetric":15826},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":7110,"score_linear":101803.0,"score_lmetric":7110},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":117746,"ongoing_decode_tokens":0,"pending_prefill_tokens":8178,"num_requests":1,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":7110,"score_linear":117746.0,"score_lmetric":15288},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":4608,"new_prefill":2502,"score_linear":-4608.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2350,"cache_hit":0,"new_prefill":7110,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":7110,"score_linear":293465.0,"score_lmetric":43716}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":384250.805817941,"t_first_token_unix":1779815115.8197625,"t_done":384250.958773263,"t_done_unix":1779815115.972717},{"request_id":"1364090:6:1408777:801","session_id":"1364090","input_length":73392,"t_proxy_recv":384243.05188634,"t_decision_unix":1779815108.0658278,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":62976,"affinity_cache_ratio":0.8580771746239372,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":10416,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":5,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":65712,"score_linear":173459.0,"score_lmetric":420640},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":17447,"ongoing_decode_tokens":17447,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":62976,"new_prefill":10416,"score_linear":-45529.0,"score_lmetric":20832},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":7680,"new_prefill":65712,"score_linear":290091.0,"score_lmetric":200607},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":73392,"score_linear":101803.0,"score_lmetric":73392},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":178365,"ongoing_decode_tokens":68590,"pending_prefill_tokens":207,"num_requests":3,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":4096,"new_prefill":69296,"score_linear":174269.0,"score_lmetric":208509},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":7680,"new_prefill":65712,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":11264,"new_prefill":62128,"score_linear":127823.0,"score_lmetric":124256},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":11264,"new_prefill":62128,"score_linear":341994.0,"score_lmetric":263524}],"chosen_score_linear":-45529.0,"chosen_score_lmetric":20832,"t_first_token":384247.591442911,"t_first_token_unix":1779815112.6053865,"t_done":384251.412390313,"t_done_unix":1779815116.4263344},{"request_id":"1340290:10:1411397:816","session_id":"1340290","input_length":30154,"t_proxy_recv":384251.233679528,"t_decision_unix":1779815116.2476206,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":29696,"affinity_cache_ratio":0.9848113019831531,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":30154,"score_linear":181139.0,"score_lmetric":194280},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":73392,"ongoing_decode_tokens":73392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":0,"new_prefill":30154,"score_linear":73392.0,"score_lmetric":30154},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":30154,"score_linear":259529.0,"score_lmetric":61914},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":30154,"score_linear":101803.0,"score_lmetric":30154},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":117746,"ongoing_decode_tokens":0,"pending_prefill_tokens":8178,"num_requests":1,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":20992,"new_prefill":9162,"score_linear":96754.0,"score_lmetric":17340},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2350,"cache_hit":29696,"new_prefill":458,"score_linear":-29696.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":30154,"score_linear":293465.0,"score_lmetric":135892}],"chosen_score_linear":-29696.0,"chosen_score_lmetric":0,"t_first_token":384251.348473949,"t_first_token_unix":1779815116.3624175,"t_done":384253.168404562,"t_done_unix":1779815118.182348},{"request_id":"1407494:3:1413526:825","session_id":"1407494","input_length":9801,"t_proxy_recv":384258.64485156,"t_decision_unix":1779815123.6587927,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.4701561065197429,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":5193,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":5193,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":9801,"score_linear":181139.0,"score_lmetric":112868},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":9801,"score_linear":86193.0,"score_lmetric":22266},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":9801,"score_linear":259529.0,"score_lmetric":21208},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142076,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1873,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":9801,"score_linear":142076.0,"score_lmetric":23348},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":236575,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14381,"num_requests":3,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":9801,"score_linear":236575.0,"score_lmetric":72546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":4608,"new_prefill":5193,"score_linear":68000.0,"score_lmetric":5193},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":35022,"ongoing_decode_tokens":35022,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":0,"new_prefill":9801,"score_linear":35022.0,"score_lmetric":9801},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":9801,"score_linear":293465.0,"score_lmetric":54480}],"chosen_score_linear":68000.0,"chosen_score_lmetric":5193,"t_first_token":384259.128025595,"t_first_token_unix":1779815124.141969,"t_done":384259.763895776,"t_done_unix":1779815124.7778394},{"request_id":"1408889:3:1414177:827","session_id":"1408889","input_length":10633,"t_proxy_recv":384260.77195045,"t_decision_unix":1779815125.7858913,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.43336781717295214,"affinity_num_requests":1,"avg_num_requests":2.375,"fallback_score":6025,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":6025,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":10633,"score_linear":181139.0,"score_lmetric":116196},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":10633,"score_linear":86193.0,"score_lmetric":23098},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":10633,"score_linear":259529.0,"score_lmetric":22872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142076,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1873,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":10633,"score_linear":142076.0,"score_lmetric":25012},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":236575,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14381,"num_requests":3,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":10633,"score_linear":236575.0,"score_lmetric":75042},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":4608,"new_prefill":6025,"score_linear":68000.0,"score_lmetric":6025},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57414,"ongoing_decode_tokens":35022,"pending_prefill_tokens":22392,"num_requests":2,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":0,"new_prefill":10633,"score_linear":57414.0,"score_lmetric":66050},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":10633,"score_linear":293465.0,"score_lmetric":57808}],"chosen_score_linear":68000.0,"chosen_score_lmetric":6025,"t_first_token":384261.3118695,"t_first_token_unix":1779815126.3258133,"t_done":384263.239986168,"t_done_unix":1779815128.2539318},{"request_id":"1340290:11:1413050:822","session_id":"1340290","input_length":35022,"t_proxy_recv":384256.847540839,"t_decision_unix":1779815121.861482,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":30208,"affinity_cache_ratio":0.8625435440580207,"affinity_num_requests":0,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30208,"estimated_new_tokens":4814,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":35022,"score_linear":181139.0,"score_lmetric":213752},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":35022,"score_linear":86193.0,"score_lmetric":47487},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":35022,"score_linear":259529.0,"score_lmetric":71650},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142076,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1873,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":35022,"score_linear":142076.0,"score_lmetric":73790},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":225038,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14108,"num_requests":2,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":20992,"new_prefill":14030,"score_linear":204046.0,"score_lmetric":56276},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":0,"new_prefill":35022,"score_linear":72608.0,"score_lmetric":35022},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":30208,"new_prefill":4814,"score_linear":-30208.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":35022,"score_linear":293465.0,"score_lmetric":155364}],"chosen_score_linear":-30208.0,"chosen_score_lmetric":0,"t_first_token":384257.954359459,"t_first_token_unix":1779815122.9683037,"t_done":384263.975116141,"t_done_unix":1779815128.9890602},{"request_id":"1407995:2:1413725:826","session_id":"1407995","input_length":22392,"t_proxy_recv":384259.269549463,"t_decision_unix":1779815124.283491,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":6,"affinity_cache_hit":2560,"affinity_cache_ratio":0.1143265451947124,"affinity_num_requests":1,"avg_num_requests":2.375,"fallback_score":22392,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":22392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":22392,"score_linear":181139.0,"score_lmetric":163232},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":2560,"new_prefill":19832,"score_linear":83633.0,"score_lmetric":32297},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":22392,"score_linear":259529.0,"score_lmetric":46390},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142076,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1873,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":22392,"score_linear":142076.0,"score_lmetric":48530},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":236575,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14381,"num_requests":3,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":22392,"score_linear":236575.0,"score_lmetric":110319},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":82409,"ongoing_decode_tokens":82409,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":0,"new_prefill":22392,"score_linear":82409.0,"score_lmetric":44784},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":35022,"ongoing_decode_tokens":35022,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":0,"new_prefill":22392,"score_linear":35022.0,"score_lmetric":22392},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":22392,"score_linear":293465.0,"score_lmetric":104844}],"chosen_score_linear":35022.0,"chosen_score_lmetric":22392,"t_first_token":384261.735953599,"t_first_token_unix":1779815126.7498977,"t_done":384264.214814765,"t_done_unix":1779815129.2287586},{"request_id":"1277428:8:1412675:821","session_id":"1277428","input_length":40273,"t_proxy_recv":384255.561414199,"t_decision_unix":1779815120.5753555,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9534924142725896,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":1873,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":40273,"score_linear":181139.0,"score_lmetric":234756},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":4608,"new_prefill":35665,"score_linear":81585.0,"score_lmetric":48130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":40273,"score_linear":259529.0,"score_lmetric":82152},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":38400,"new_prefill":1873,"score_linear":63403.0,"score_lmetric":1873},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":225038,"ongoing_decode_tokens":0,"pending_prefill_tokens":22286,"num_requests":2,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":40273,"score_linear":225038.0,"score_lmetric":125118},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":17408,"new_prefill":22865,"score_linear":55200.0,"score_lmetric":22865},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":0,"new_prefill":40273,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":40273,"score_linear":293465.0,"score_lmetric":176368}],"chosen_score_linear":63403.0,"chosen_score_lmetric":1873,"t_first_token":384261.961324762,"t_first_token_unix":1779815126.975269,"t_done":384264.586650819,"t_done_unix":1779815129.6005945},{"request_id":"1364090:7:1412644:820","session_id":"1364090","input_length":86193,"t_proxy_recv":384255.466512524,"t_decision_unix":1779815120.4804537,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":73728,"affinity_cache_ratio":0.8553826876892555,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":12465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":78513,"score_linear":173459.0,"score_lmetric":387716},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":73728,"new_prefill":12465,"score_linear":-73728.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":7680,"new_prefill":78513,"score_linear":251849.0,"score_lmetric":158632},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":86193,"score_linear":101803.0,"score_lmetric":86193},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":225038,"ongoing_decode_tokens":0,"pending_prefill_tokens":22286,"num_requests":2,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":4096,"new_prefill":82097,"score_linear":220942.0,"score_lmetric":208766},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":7680,"new_prefill":78513,"score_linear":64928.0,"score_lmetric":78513},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":11264,"new_prefill":74929,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":11264,"new_prefill":74929,"score_linear":282201.0,"score_lmetric":314992}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":384261.74664221,"t_first_token_unix":1779815126.7605863,"t_done":384266.645530315,"t_done_unix":1779815131.6594744},{"request_id":"1405155:2:1414214:828","session_id":"1405155","input_length":40330,"t_proxy_recv":384260.921560659,"t_decision_unix":1779815125.935502,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":33280,"affinity_cache_ratio":0.825192164641706,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":7050,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":40330,"score_linear":181139.0,"score_lmetric":234984},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":40330,"score_linear":86193.0,"score_lmetric":52795},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":40330,"score_linear":259529.0,"score_lmetric":82266},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142076,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1873,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":40330,"score_linear":142076.0,"score_lmetric":84406},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":236575,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14381,"num_requests":3,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":40330,"score_linear":236575.0,"score_lmetric":164133},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":83241,"ongoing_decode_tokens":72608,"pending_prefill_tokens":6025,"num_requests":2,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":512,"new_prefill":39818,"score_linear":82729.0,"score_lmetric":91686},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57414,"ongoing_decode_tokens":35022,"pending_prefill_tokens":22392,"num_requests":2,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":33280,"new_prefill":7050,"score_linear":24134.0,"score_lmetric":58884},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":40330,"score_linear":293465.0,"score_lmetric":176596}],"chosen_score_linear":24134.0,"chosen_score_lmetric":58884,"t_first_token":384263.446886762,"t_first_token_unix":1779815128.4608307,"t_done":384267.465598242,"t_done_unix":1779815132.479542},{"request_id":"1373431:2:1378320:629","session_id":"1373431","input_length":127267,"t_proxy_recv":384238.266284096,"t_decision_unix":1779815103.2802258,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":126464,"affinity_cache_ratio":0.9936904303550803,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":126464,"estimated_new_tokens":803,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":127267,"score_linear":166411.0,"score_lmetric":558636},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155670,"ongoing_decode_tokens":155670,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1288,"cache_hit":0,"new_prefill":127267,"score_linear":155670.0,"score_lmetric":254534},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":170504,"ongoing_decode_tokens":144683,"pending_prefill_tokens":354,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":126464,"new_prefill":803,"score_linear":44040.0,"score_lmetric":2314},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":103304,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1501,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":127267,"score_linear":103304.0,"score_lmetric":257536},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":127267,"score_linear":186159.0,"score_lmetric":563600},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":1024,"new_prefill":126243,"score_linear":-1024.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":139087,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":1024,"new_prefill":126243,"score_linear":138063.0,"score_lmetric":252486},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":127267,"score_linear":353258.0,"score_lmetric":524080}],"chosen_score_linear":44040.0,"chosen_score_lmetric":2314,"t_first_token":384264.296223166,"t_first_token_unix":1779815129.3101666,"t_done":384268.839952534,"t_done_unix":1779815133.8538964},{"request_id":"1373577:2:1380740:647","session_id":"1373577","input_length":81147,"t_proxy_recv":384217.618408012,"t_decision_unix":1779815082.6323495,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9842877740397057,"affinity_num_requests":2,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":1275,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12910,"ongoing_decode_tokens":12910,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":81147,"score_linear":12910.0,"score_lmetric":81147},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":81147,"score_linear":166406.0,"score_lmetric":564483},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":215496,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1177,"num_requests":2,"active_p_offloads":0,"cached_blocks":2172,"cache_hit":79872,"new_prefill":1275,"score_linear":135624.0,"score_lmetric":4904},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":0,"new_prefill":81147,"score_linear":112693.0,"score_lmetric":226912},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":153530,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12531,"num_requests":4,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":81147,"score_linear":153530.0,"score_lmetric":374712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":33321,"pending_prefill_tokens":29479,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":81147,"score_linear":164688.0,"score_lmetric":331878},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":2560,"new_prefill":78587,"score_linear":103583.0,"score_lmetric":78587},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":81147,"score_linear":233281.0,"score_lmetric":430674}],"chosen_score_linear":135624.0,"chosen_score_lmetric":4904,"t_first_token":384236.094378718,"t_first_token_unix":1779815101.1083224,"t_done":384271.967949936,"t_done_unix":1779815136.9818943},{"request_id":"1405199:1:1405199:776","session_id":"1405199","input_length":11503,"t_proxy_recv":384229.579218808,"t_decision_unix":1779815094.5931602,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.5,"fallback_score":11503,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11503,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11503,"score_linear":21684.0,"score_lmetric":11503},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":11503,"score_linear":166406.0,"score_lmetric":355551},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":11503,"score_linear":296844.0,"score_lmetric":39396},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":101803,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":11503,"score_linear":122812.0,"score_lmetric":65024},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":11503,"score_linear":166507.0,"score_lmetric":42912},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165073,"ongoing_decode_tokens":165073,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":0,"new_prefill":11503,"score_linear":165073.0,"score_lmetric":34509},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":11503,"score_linear":139087.0,"score_lmetric":88894},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":11503,"score_linear":233281.0,"score_lmetric":221742}],"chosen_score_linear":21684.0,"chosen_score_lmetric":11503,"t_first_token":384230.503762838,"t_first_token_unix":1779815095.517706,"t_done":384274.146459262,"t_done_unix":1779815139.1604083},{"request_id":"1314357:5:1393659:719","session_id":"1314357","input_length":101803,"t_proxy_recv":384189.239864827,"t_decision_unix":1779815054.253806,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":73216,"affinity_cache_ratio":0.7191929510918146,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":28587,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120843,"ongoing_decode_tokens":120843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":101803,"score_linear":120843.0,"score_lmetric":203606},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":126340,"pending_prefill_tokens":81232,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":101803,"score_linear":294991.0,"score_lmetric":549105},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":73216,"new_prefill":28587,"score_linear":-73216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":175342,"ongoing_decode_tokens":91938,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1832,"cache_hit":0,"new_prefill":101803,"score_linear":175342.0,"score_lmetric":340581},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1552,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":213388,"ongoing_decode_tokens":213388,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":101803,"score_linear":213388.0,"score_lmetric":305409}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":384223.058416869,"t_first_token_unix":1779815088.0723605,"t_done":384274.47933075,"t_done_unix":1779815139.4932747},{"request_id":"1400379:4:1405483:779","session_id":"1400379","input_length":19966,"t_proxy_recv":384230.462780763,"t_decision_unix":1779815095.4767222,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":10752,"affinity_cache_ratio":0.5385154763097265,"affinity_num_requests":3,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":9214,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146445,"ongoing_decode_tokens":21684,"pending_prefill_tokens":14681,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":10752,"new_prefill":9214,"score_linear":135693.0,"score_lmetric":71685},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":19966,"score_linear":166406.0,"score_lmetric":380940},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":19966,"score_linear":296844.0,"score_lmetric":64785},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":122812,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":19966,"score_linear":122812.0,"score_lmetric":39932},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172656,"ongoing_decode_tokens":24442,"pending_prefill_tokens":4342,"num_requests":4,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":19966,"score_linear":172656.0,"score_lmetric":97232},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":102829,"ongoing_decode_tokens":33321,"pending_prefill_tokens":1412,"num_requests":2,"active_p_offloads":0,"cached_blocks":1624,"cache_hit":0,"new_prefill":19966,"score_linear":102829.0,"score_lmetric":42756},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":19966,"score_linear":139087.0,"score_lmetric":105820},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":19966,"score_linear":233281.0,"score_lmetric":247131}],"chosen_score_linear":135693.0,"chosen_score_lmetric":71685,"t_first_token":384272.94630574,"t_first_token_unix":1779815137.9602494,"t_done":384274.494465568,"t_done_unix":1779815139.5084085},{"request_id":"1373431:3:1383388:667","session_id":"1373431","input_length":128201,"t_proxy_recv":384268.859422237,"t_decision_unix":1779815133.8733637,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":126976,"affinity_cache_ratio":0.9904446923190927,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":126976,"estimated_new_tokens":1225,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":128201,"score_linear":181139.0,"score_lmetric":586468},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":128201,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132262,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2422,"cache_hit":126976,"new_prefill":1225,"score_linear":5286.0,"score_lmetric":1225},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":128201,"score_linear":101803.0,"score_lmetric":128201},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":236575,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14381,"num_requests":3,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":128201,"score_linear":236575.0,"score_lmetric":427746},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":1024,"new_prefill":127177,"score_linear":71584.0,"score_lmetric":127177},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":1024,"new_prefill":127177,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":128201,"score_linear":293465.0,"score_lmetric":528080}],"chosen_score_linear":5286.0,"chosen_score_lmetric":1225,"t_first_token":384269.720142916,"t_first_token_unix":1779815134.734089,"t_done":384274.590808387,"t_done_unix":1779815139.604752},{"request_id":"1403188:2:1408249:796","session_id":"1403188","input_length":14728,"t_proxy_recv":384240.388899401,"t_decision_unix":1779815105.4028409,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":8704,"affinity_cache_ratio":0.5909831613253667,"affinity_num_requests":4,"avg_num_requests":2.875,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":6024,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":8704,"new_prefill":6024,"score_linear":157707.0,"score_lmetric":73664},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":65574,"ongoing_decode_tokens":65574,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":14728,"score_linear":65574.0,"score_lmetric":29456},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":144683,"pending_prefill_tokens":1157,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":14728,"score_linear":297771.0,"score_lmetric":47655},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":103304,"ongoing_decode_tokens":103304,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":14728,"score_linear":103304.0,"score_lmetric":29456},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186159,"ongoing_decode_tokens":68590,"pending_prefill_tokens":13633,"num_requests":4,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":14728,"score_linear":186159.0,"score_lmetric":113444},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27676,"ongoing_decode_tokens":0,"pending_prefill_tokens":5660,"num_requests":1,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":14728,"score_linear":27676.0,"score_lmetric":20388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":166873,"ongoing_decode_tokens":166873,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":14728,"score_linear":166873.0,"score_lmetric":44184},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":353258,"ongoing_decode_tokens":233281,"pending_prefill_tokens":3753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":14728,"score_linear":353258.0,"score_lmetric":73924}],"chosen_score_linear":157707.0,"chosen_score_lmetric":73664,"t_first_token":384273.525297578,"t_first_token_unix":1779815138.5392413,"t_done":384274.920290674,"t_done_unix":1779815139.9342344},{"request_id":"1400379:5:1406380:784","session_id":"1400379","input_length":22009,"t_proxy_recv":384274.500358196,"t_decision_unix":1779815139.5142996,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9072652096869462,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":2041,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149670,"ongoing_decode_tokens":149670,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2056,"cache_hit":19968,"new_prefill":2041,"score_linear":129702.0,"score_lmetric":4082},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":0,"pending_prefill_tokens":10343,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":22009,"score_linear":134247.0,"score_lmetric":64704},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":264754,"ongoing_decode_tokens":277175,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":0,"new_prefill":22009,"score_linear":264754.0,"score_lmetric":44018},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":22009,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":22009,"score_linear":280338.0,"score_lmetric":156772},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":22009,"score_linear":72608.0,"score_lmetric":22009},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":22009,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":22009,"score_linear":293465.0,"score_lmetric":103312}],"chosen_score_linear":129702.0,"chosen_score_lmetric":4082,"t_first_token":384274.913193568,"t_first_token_unix":1779815139.9271376,"t_done":384275.88161814,"t_done_unix":1779815140.895562},{"request_id":"1373577:3:1404917:774","session_id":"1373577","input_length":85438,"t_proxy_recv":384271.98334095,"t_decision_unix":1779815136.9972825,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9528312928673424,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":4030,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":146445,"pending_prefill_tokens":15238,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":85438,"score_linear":181139.0,"score_lmetric":402704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":85438,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":179316,"ongoing_decode_tokens":191737,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":81408,"new_prefill":4030,"score_linear":97908.0,"score_lmetric":4030},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":85438,"score_linear":101803.0,"score_lmetric":85438},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":85438,"score_linear":280338.0,"score_lmetric":410488},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":85438,"score_linear":72608.0,"score_lmetric":85438},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":2560,"new_prefill":82878,"score_linear":-2560.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":85438,"score_linear":293465.0,"score_lmetric":357028}],"chosen_score_linear":97908.0,"chosen_score_lmetric":4030,"t_first_token":384274.135857712,"t_first_token_unix":1779815139.1498015,"t_done":384277.921402473,"t_done_unix":1779815142.9353485},{"request_id":"1355484:14:1398178:740","session_id":"1355484","input_length":31224,"t_proxy_recv":384205.210050915,"t_decision_unix":1779815070.223992,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9182679989751473,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":2552,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16347,"ongoing_decode_tokens":13134,"pending_prefill_tokens":3213,"num_requests":2,"active_p_offloads":0,"cached_blocks":1902,"cache_hit":12800,"new_prefill":18424,"score_linear":3547.0,"score_lmetric":43274},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93536,"num_requests":2,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":31224,"score_linear":103776.0,"score_lmetric":249520},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":294991,"ongoing_decode_tokens":269371,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":31224,"score_linear":294991.0,"score_lmetric":97203},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112693,"ongoing_decode_tokens":0,"pending_prefill_tokens":32309,"num_requests":2,"active_p_offloads":0,"cached_blocks":1407,"cache_hit":12800,"new_prefill":18424,"score_linear":99893.0,"score_lmetric":101466},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1869,"cache_hit":0,"new_prefill":31224,"score_linear":16550.0,"score_lmetric":47774},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":31224,"score_linear":33321.0,"score_lmetric":31224},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":31224,"score_linear":106143.0,"score_lmetric":31224},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":202057,"ongoing_decode_tokens":80246,"pending_prefill_tokens":59859,"num_requests":2,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":28672,"new_prefill":2552,"score_linear":173385.0,"score_lmetric":124822}],"chosen_score_linear":173385.0,"chosen_score_lmetric":124822,"t_first_token":384232.157304731,"t_first_token_unix":1779815097.1712477,"t_done":384282.51983965,"t_done_unix":1779815147.533785},{"request_id":"1373577:4:1408642:799","session_id":"1373577","input_length":90818,"t_proxy_recv":384277.940067314,"t_decision_unix":1779815142.9540086,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9414873703450858,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":5314,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":90818,"score_linear":134942.0,"score_lmetric":90818},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":0,"pending_prefill_tokens":10343,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":90818,"score_linear":134247.0,"score_lmetric":202322},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":51115,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2435,"cache_hit":85504,"new_prefill":5314,"score_linear":-34389.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":90818,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":90818,"score_linear":280338.0,"score_lmetric":432008},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":90818,"score_linear":72608.0,"score_lmetric":90818},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":2560,"new_prefill":88258,"score_linear":-2560.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":90818,"score_linear":293465.0,"score_lmetric":378548}],"chosen_score_linear":-34389.0,"chosen_score_lmetric":0,"t_first_token":384280.85436242,"t_first_token_unix":1779815145.8683062,"t_done":384283.490249885,"t_done_unix":1779815148.504194},{"request_id":"1362265:8:1419710:834","session_id":"1362265","input_length":11132,"t_proxy_recv":384280.355715922,"t_decision_unix":1779815145.369657,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9658641753503413,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":380,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":11132,"score_linear":134942.0,"score_lmetric":11132},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":96849,"pending_prefill_tokens":22,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":10752,"new_prefill":380,"score_linear":123495.0,"score_lmetric":804},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":141933,"ongoing_decode_tokens":63536,"pending_prefill_tokens":5314,"num_requests":1,"active_p_offloads":0,"cached_blocks":2435,"cache_hit":0,"new_prefill":11132,"score_linear":141933.0,"score_lmetric":16446},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":0,"pending_prefill_tokens":23475,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":6656,"new_prefill":4476,"score_linear":25523.0,"score_lmetric":27951},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":11132,"score_linear":280338.0,"score_lmetric":113264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":11132,"score_linear":72608.0,"score_lmetric":11132},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":11132,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":11132,"score_linear":293465.0,"score_lmetric":59804}],"chosen_score_linear":123495.0,"chosen_score_lmetric":804,"t_first_token":384283.716680871,"t_first_token_unix":1779815148.7306242,"t_done":384284.328377643,"t_done_unix":1779815149.3423212},{"request_id":"1275274:2:1405679:780","session_id":"1275274","input_length":119977,"t_proxy_recv":384231.257637033,"t_decision_unix":1779815096.271578,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9687190044758579,"affinity_num_requests":3,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":3753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":166411,"ongoing_decode_tokens":33187,"pending_prefill_tokens":12392,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":119977,"score_linear":166411.0,"score_lmetric":529476},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":119977,"score_linear":166406.0,"score_lmetric":680973},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":119977,"score_linear":296844.0,"score_lmetric":364818},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":119977,"score_linear":101803.0,"score_lmetric":119977},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172656,"ongoing_decode_tokens":24442,"pending_prefill_tokens":4342,"num_requests":4,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":119977,"score_linear":172656.0,"score_lmetric":497276},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":102829,"ongoing_decode_tokens":102829,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1624,"cache_hit":0,"new_prefill":119977,"score_linear":102829.0,"score_lmetric":239954},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":119977,"score_linear":139087.0,"score_lmetric":305842},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":116224,"new_prefill":3753,"score_linear":117057.0,"score_lmetric":198492}],"chosen_score_linear":117057.0,"chosen_score_lmetric":198492,"t_first_token":384280.713423983,"t_first_token_unix":1779815145.7273674,"t_done":384284.478937568,"t_done_unix":1779815149.4928813},{"request_id":"1355484:15:1400281:750","session_id":"1355484","input_length":31469,"t_proxy_recv":384282.536056232,"t_decision_unix":1779815147.5499976,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9924687787981823,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":237,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":12800,"new_prefill":18669,"score_linear":122142.0,"score_lmetric":18669},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":145379,"ongoing_decode_tokens":96849,"pending_prefill_tokens":402,"num_requests":3,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":31469,"score_linear":145379.0,"score_lmetric":95613},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":141933,"ongoing_decode_tokens":154354,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2435,"cache_hit":0,"new_prefill":31469,"score_linear":141933.0,"score_lmetric":31469},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":0,"pending_prefill_tokens":23475,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":12800,"new_prefill":18669,"score_linear":19379.0,"score_lmetric":42144},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":31469,"score_linear":280338.0,"score_lmetric":194612},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":31469,"score_linear":72608.0,"score_lmetric":31469},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":31469,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262241,"ongoing_decode_tokens":200223,"pending_prefill_tokens":66,"num_requests":3,"active_p_offloads":0,"cached_blocks":1699,"cache_hit":31232,"new_prefill":237,"score_linear":231009.0,"score_lmetric":909}],"chosen_score_linear":231009.0,"chosen_score_lmetric":909,"t_first_token":384285.339076067,"t_first_token_unix":1779815150.3530245,"t_done":384287.068738274,"t_done_unix":1779815152.0826845},{"request_id":"1340290:12:1421294:835","session_id":"1340290","input_length":35303,"t_proxy_recv":384286.005843579,"t_decision_unix":1779815151.0197847,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9862051383735093,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":487,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":35303,"score_linear":134942.0,"score_lmetric":35303},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":134247,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":35303,"score_linear":134247.0,"score_lmetric":70606},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":51115,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":0,"new_prefill":35303,"score_linear":51115.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":35303,"score_linear":32179.0,"score_lmetric":35303},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":20992,"new_prefill":14311,"score_linear":259346.0,"score_lmetric":125980},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":35303,"score_linear":72608.0,"score_lmetric":35303},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":34816,"new_prefill":487,"score_linear":-34816.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":173733,"ongoing_decode_tokens":173733,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":35303,"score_linear":173733.0,"score_lmetric":105909}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":384286.09607608,"t_first_token_unix":1779815151.110019,"t_done":384287.50463359,"t_done_unix":1779815152.5185776},{"request_id":"1404395:1:1404395:770","session_id":"1404395","input_length":21684,"t_proxy_recv":384226.745386689,"t_decision_unix":1779815091.7593277,"policy":"unified","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":21684,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":21684,"score_linear":166406.0,"score_lmetric":386094},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":21684,"score_linear":296844.0,"score_lmetric":69939},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":21684,"score_linear":101803.0,"score_lmetric":21684},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":512,"new_prefill":21172,"score_linear":165995.0,"score_lmetric":71919},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":164688,"ongoing_decode_tokens":164688,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":512,"new_prefill":21172,"score_linear":164176.0,"score_lmetric":63516},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":21684,"score_linear":106143.0,"score_lmetric":21684},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":21684,"score_linear":233281.0,"score_lmetric":252285}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384229.083056849,"t_first_token_unix":1779815094.0970004,"t_done":384288.879318904,"t_done_unix":1779815153.8932621},{"request_id":"1264679:2:1405259:777","session_id":"1264679","input_length":113258,"t_proxy_recv":384229.775277585,"t_decision_unix":1779815094.7892191,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":110080,"affinity_cache_ratio":0.9719401719966801,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":110080,"estimated_new_tokens":3178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33187,"ongoing_decode_tokens":21684,"pending_prefill_tokens":11503,"num_requests":2,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":110080,"new_prefill":3178,"score_linear":-76893.0,"score_lmetric":29362},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":166406,"ongoing_decode_tokens":0,"pending_prefill_tokens":107014,"num_requests":3,"active_p_offloads":0,"cached_blocks":1287,"cache_hit":0,"new_prefill":113258,"score_linear":166406.0,"score_lmetric":660816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":296844,"ongoing_decode_tokens":189876,"pending_prefill_tokens":1629,"num_requests":3,"active_p_offloads":0,"cached_blocks":2174,"cache_hit":0,"new_prefill":113258,"score_linear":296844.0,"score_lmetric":344661},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122812,"ongoing_decode_tokens":101803,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1414,"cache_hit":0,"new_prefill":113258,"score_linear":122812.0,"score_lmetric":268534},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":166507,"ongoing_decode_tokens":24442,"pending_prefill_tokens":2801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":113258,"score_linear":166507.0,"score_lmetric":348177},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101430,"ongoing_decode_tokens":101430,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":113258,"score_linear":101430.0,"score_lmetric":226516},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139087,"ongoing_decode_tokens":106143,"pending_prefill_tokens":32944,"num_requests":2,"active_p_offloads":0,"cached_blocks":2243,"cache_hit":0,"new_prefill":113258,"score_linear":139087.0,"score_lmetric":292404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":233281,"ongoing_decode_tokens":80246,"pending_prefill_tokens":62411,"num_requests":3,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":113258,"score_linear":233281.0,"score_lmetric":527007}],"chosen_score_linear":-76893.0,"chosen_score_lmetric":29362,"t_first_token":384271.907663481,"t_first_token_unix":1779815136.9216073,"t_done":384289.129706288,"t_done_unix":1779815154.14365},{"request_id":"1381387:7:1411928:819","session_id":"1381387","input_length":72608,"t_proxy_recv":384253.072446326,"t_decision_unix":1779815118.0863874,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9872190392243279,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":928,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":72608,"score_linear":181139.0,"score_lmetric":364096},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":72608,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":72608,"score_linear":259529.0,"score_lmetric":146822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":72608,"score_linear":101803.0,"score_lmetric":72608},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":225038,"ongoing_decode_tokens":0,"pending_prefill_tokens":22286,"num_requests":2,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":72608,"score_linear":225038.0,"score_lmetric":189788},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":71680,"new_prefill":928,"score_linear":-71680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30154,"ongoing_decode_tokens":30154,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2350,"cache_hit":512,"new_prefill":72096,"score_linear":29642.0,"score_lmetric":72096},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":72608,"score_linear":293465.0,"score_lmetric":305708}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":384253.715994054,"t_first_token_unix":1779815118.7299376,"t_done":384289.445689138,"t_done_unix":1779815154.459633},{"request_id":"1362265:9:1422050:838","session_id":"1362265","input_length":11879,"t_proxy_recv":384288.822676435,"t_decision_unix":1779815153.8366177,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9051266941661756,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":1127,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":11879,"score_linear":134942.0,"score_lmetric":11879},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":134247,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":10752,"new_prefill":1127,"score_linear":123495.0,"score_lmetric":2254},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":100423,"ongoing_decode_tokens":63536,"pending_prefill_tokens":49308,"num_requests":1,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":0,"new_prefill":11879,"score_linear":100423.0,"score_lmetric":61187},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":6656,"new_prefill":5223,"score_linear":25523.0,"score_lmetric":5223},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":11879,"score_linear":280338.0,"score_lmetric":116252},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":11879,"score_linear":72608.0,"score_lmetric":11879},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":11879,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":174596,"ongoing_decode_tokens":174596,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":11879,"score_linear":174596.0,"score_lmetric":35637}],"chosen_score_linear":123495.0,"chosen_score_lmetric":2254,"t_first_token":384289.067554993,"t_first_token_unix":1779815154.0814986,"t_done":384289.558804307,"t_done_unix":1779815154.5727491},{"request_id":"1364090:8:1417347:830","session_id":"1364090","input_length":96849,"t_proxy_recv":384272.128427702,"t_decision_unix":1779815137.1423688,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":86528,"affinity_cache_ratio":0.893432043696889,"affinity_num_requests":0,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":86528,"estimated_new_tokens":10321,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":146445,"pending_prefill_tokens":15238,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":7680,"new_prefill":89169,"score_linear":173459.0,"score_lmetric":417628},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":86528,"new_prefill":10321,"score_linear":-86528.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":264754,"ongoing_decode_tokens":191737,"pending_prefill_tokens":4030,"num_requests":2,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":7680,"new_prefill":89169,"score_linear":257074.0,"score_lmetric":186398},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":96849,"score_linear":101803.0,"score_lmetric":96849},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":4096,"new_prefill":92753,"score_linear":276242.0,"score_lmetric":439748},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":7680,"new_prefill":89169,"score_linear":64928.0,"score_lmetric":89169},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":11264,"new_prefill":85585,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":11264,"new_prefill":85585,"score_linear":282201.0,"score_lmetric":357616}],"chosen_score_linear":-86528.0,"chosen_score_lmetric":0,"t_first_token":384278.064445285,"t_first_token_unix":1779815143.0783885,"t_done":384289.817940498,"t_done_unix":1779815154.8318872},{"request_id":"1313181:7:1382851:662","session_id":"1313181","input_length":62018,"t_proxy_recv":384243.974112825,"t_decision_unix":1779815108.9880543,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9989357928343384,"affinity_num_requests":3,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":66,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":12800,"new_prefill":49218,"score_linear":168339.0,"score_lmetric":270536},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":90839,"ongoing_decode_tokens":17447,"pending_prefill_tokens":10416,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":62018,"score_linear":90839.0,"score_lmetric":217302},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":297771,"ongoing_decode_tokens":182925,"pending_prefill_tokens":803,"num_requests":3,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":62018,"score_linear":297771.0,"score_lmetric":188463},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":12800,"new_prefill":49218,"score_linear":89003.0,"score_lmetric":49218},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":68590,"ongoing_decode_tokens":68590,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":62018,"score_linear":68590.0,"score_lmetric":124036},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71570,"ongoing_decode_tokens":0,"pending_prefill_tokens":1938,"num_requests":1,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":62018,"score_linear":71570.0,"score_lmetric":63956},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168817,"ongoing_decode_tokens":168817,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":0,"new_prefill":62018,"score_linear":168817.0,"score_lmetric":186054},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":231447,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":61952,"new_prefill":66,"score_linear":169495.0,"score_lmetric":11457}],"chosen_score_linear":169495.0,"chosen_score_lmetric":11457,"t_first_token":384284.075968549,"t_first_token_unix":1779815149.0899136,"t_done":384293.911317938,"t_done_unix":1779815158.925266},{"request_id":"1314357:6:1422517:839","session_id":"1314357","input_length":105709,"t_proxy_recv":384290.34427107,"t_decision_unix":1779815155.3582125,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9977579960079085,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":237,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":-105709},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":0,"new_prefill":105709,"score_linear":37398.0,"score_lmetric":105709},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":100423,"ongoing_decode_tokens":63536,"pending_prefill_tokens":49308,"num_requests":1,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":0,"new_prefill":105709,"score_linear":100423.0,"score_lmetric":155017},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":105472,"new_prefill":237,"score_linear":-73293.0,"score_lmetric":237},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":105709,"score_linear":280338.0,"score_lmetric":491572},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":174596,"ongoing_decode_tokens":174596,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":105709,"score_linear":174596.0,"score_lmetric":317127}],"chosen_score_linear":-73293.0,"chosen_score_lmetric":237,"t_first_token":384290.537975613,"t_first_token_unix":1779815155.5519197,"t_done":384297.216953349,"t_done_unix":1779815162.2308972},{"request_id":"1355484:16:1401320:758","session_id":"1355484","input_length":32332,"t_proxy_recv":384287.076886149,"t_decision_unix":1779815152.0908277,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9659779784733391,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":1100,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":12800,"new_prefill":19532,"score_linear":122142.0,"score_lmetric":19532},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":134247,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":32332,"score_linear":134247.0,"score_lmetric":64664},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":100423,"ongoing_decode_tokens":63536,"pending_prefill_tokens":49308,"num_requests":1,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":0,"new_prefill":32332,"score_linear":100423.0,"score_lmetric":81640},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":12800,"new_prefill":19532,"score_linear":19379.0,"score_lmetric":19532},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":32332,"score_linear":280338.0,"score_lmetric":198064},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":32332,"score_linear":72608.0,"score_lmetric":32332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":35303,"ongoing_decode_tokens":35303,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":32332,"score_linear":35303.0,"score_lmetric":32332},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":142264,"ongoing_decode_tokens":142264,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":31232,"new_prefill":1100,"score_linear":111032.0,"score_lmetric":2200}],"chosen_score_linear":111032.0,"chosen_score_lmetric":2200,"t_first_token":384287.35193967,"t_first_token_unix":1779815152.3658834,"t_done":384297.257390655,"t_done_unix":1779815162.2713342},{"request_id":"1268861:9:1421319:836","session_id":"1268861","input_length":49308,"t_proxy_recv":384286.090582655,"t_decision_unix":1779815151.1045234,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":44032,"affinity_cache_ratio":0.8929991076498742,"affinity_num_requests":4,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":49308,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":49308,"score_linear":134942.0,"score_lmetric":49308},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":134247,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":49308,"score_linear":134247.0,"score_lmetric":98616},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":51115,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":0,"new_prefill":49308,"score_linear":51115.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":49308,"score_linear":32179.0,"score_lmetric":49308},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":44032,"new_prefill":5276,"score_linear":236306.0,"score_lmetric":89840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":49308,"score_linear":72608.0,"score_lmetric":49308},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":35303,"ongoing_decode_tokens":0,"pending_prefill_tokens":487,"num_requests":1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":49308,"score_linear":35303.0,"score_lmetric":49795},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":173733,"ongoing_decode_tokens":173733,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":49308,"score_linear":173733.0,"score_lmetric":147924}],"chosen_score_linear":51115.0,"chosen_score_lmetric":0,"t_first_token":384295.264990636,"t_first_token_unix":1779815160.2789342,"t_done":384297.888288594,"t_done_unix":1779815162.9022322},{"request_id":"1364128:3:1419644:833","session_id":"1364128","input_length":32179,"t_proxy_recv":384280.13343151,"t_decision_unix":1779815145.1473727,"policy":"unified","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.2704869635476553,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":23475,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134942,"ongoing_decode_tokens":134942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":32179,"score_linear":134942.0,"score_lmetric":32179},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":134247,"ongoing_decode_tokens":96849,"pending_prefill_tokens":22,"num_requests":2,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":6656,"new_prefill":25523,"score_linear":127591.0,"score_lmetric":51090},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":141933,"ongoing_decode_tokens":63536,"pending_prefill_tokens":5314,"num_requests":1,"active_p_offloads":0,"cached_blocks":2435,"cache_hit":0,"new_prefill":32179,"score_linear":141933.0,"score_lmetric":37493},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":8704,"new_prefill":23475,"score_linear":-8704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":32179,"score_linear":280338.0,"score_lmetric":197452},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":32179,"score_linear":72608.0,"score_lmetric":32179},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":32179,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":32179,"score_linear":293465.0,"score_lmetric":143992}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":384284.484849177,"t_first_token_unix":1779815149.4987924,"t_done":384298.300210828,"t_done_unix":1779815163.3141544},{"request_id":"1363093:3:1374394:612","session_id":"1363093","input_length":63536,"t_proxy_recv":384121.76172004,"t_decision_unix":1779814986.7756612,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9911860992193402,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":560,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1528,"cache_hit":0,"new_prefill":63536,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":19862,"ongoing_decode_tokens":0,"pending_prefill_tokens":19862,"num_requests":1,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":63536,"score_linear":19862.0,"score_lmetric":83398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":193414,"ongoing_decode_tokens":0,"pending_prefill_tokens":205835,"num_requests":1,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":62976,"new_prefill":560,"score_linear":130438.0,"score_lmetric":206395},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":63536,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126116,"ongoing_decode_tokens":91079,"pending_prefill_tokens":11997,"num_requests":3,"active_p_offloads":0,"cached_blocks":1460,"cache_hit":0,"new_prefill":63536,"score_linear":126116.0,"score_lmetric":226599},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":168624,"ongoing_decode_tokens":168624,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":0,"new_prefill":63536,"score_linear":168624.0,"score_lmetric":190608},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":48606,"num_requests":1,"active_p_offloads":0,"cached_blocks":1934,"cache_hit":0,"new_prefill":63536,"score_linear":56286.0,"score_lmetric":112142},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":140250,"ongoing_decode_tokens":140250,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":0,"new_prefill":63536,"score_linear":140250.0,"score_lmetric":127072}],"chosen_score_linear":130438.0,"chosen_score_lmetric":206395,"t_first_token":384204.872541856,"t_first_token_unix":1779815069.8864858,"t_done":384298.693961285,"t_done_unix":1779815163.7079048},{"request_id":"1269373:22:1358956:522","session_id":"1269373","input_length":80246,"t_proxy_recv":384067.505381018,"t_decision_unix":1779814932.5193222,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9761981905640157,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":1910,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":121573,"num_requests":1,"active_p_offloads":0,"cached_blocks":1289,"cache_hit":7680,"new_prefill":72566,"score_linear":114917.0,"score_lmetric":194139},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":80246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8950,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":7680,"new_prefill":72566,"score_linear":1270.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1146,"cache_hit":0,"new_prefill":80246,"score_linear":68259.0,"score_lmetric":80246},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1296,"cache_hit":0,"new_prefill":80246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1074,"cache_hit":7680,"new_prefill":72566,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":73216,"new_prefill":7030,"score_linear":10310.0,"score_lmetric":90556},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":58758,"ongoing_decode_tokens":0,"pending_prefill_tokens":34694,"num_requests":1,"active_p_offloads":0,"cached_blocks":1431,"cache_hit":78336,"new_prefill":1910,"score_linear":-19578.0,"score_lmetric":36604}],"chosen_score_linear":-19578.0,"chosen_score_lmetric":36604,"t_first_token":384074.843793816,"t_first_token_unix":1779814939.8577383,"t_done":384301.175846647,"t_done_unix":1779815166.1897943},{"request_id":"1366128:25:1411126:813","session_id":"1366128","input_length":117746,"t_proxy_recv":384250.206324909,"t_decision_unix":1779815115.2202659,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":109568,"affinity_cache_ratio":0.9305454113090891,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":109568,"estimated_new_tokens":8178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":117746,"score_linear":181139.0,"score_lmetric":544648},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":73392,"ongoing_decode_tokens":73392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":0,"new_prefill":117746,"score_linear":73392.0,"score_lmetric":117746},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":117746,"score_linear":259529.0,"score_lmetric":237098},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":117746,"score_linear":101803.0,"score_lmetric":117746},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":109568,"new_prefill":8178,"score_linear":-109568.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":117746,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2350,"cache_hit":0,"new_prefill":117746,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":117746,"score_linear":293465.0,"score_lmetric":486260}],"chosen_score_linear":-109568.0,"chosen_score_lmetric":0,"t_first_token":384255.793287795,"t_first_token_unix":1779815120.8072314,"t_done":384301.211749718,"t_done_unix":1779815166.2256935},{"request_id":"1399948:7:1413205:824","session_id":"1399948","input_length":11537,"t_proxy_recv":384257.455415473,"t_decision_unix":1779815122.469357,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9763370026870071,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":273,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":11537,"score_linear":181139.0,"score_lmetric":119812},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86193,"ongoing_decode_tokens":0,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":11537,"score_linear":86193.0,"score_lmetric":24002},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":11537,"score_linear":259529.0,"score_lmetric":24680},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142076,"ongoing_decode_tokens":101803,"pending_prefill_tokens":1873,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":11537,"score_linear":142076.0,"score_lmetric":26820},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":225038,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14108,"num_requests":2,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":11264,"new_prefill":273,"score_linear":213774.0,"score_lmetric":28762},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":0,"new_prefill":11537,"score_linear":72608.0,"score_lmetric":11537},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":35022,"ongoing_decode_tokens":0,"pending_prefill_tokens":4814,"num_requests":1,"active_p_offloads":0,"cached_blocks":2351,"cache_hit":0,"new_prefill":11537,"score_linear":35022.0,"score_lmetric":16351},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":11537,"score_linear":293465.0,"score_lmetric":61424}],"chosen_score_linear":213774.0,"chosen_score_lmetric":28762,"t_first_token":384293.845443863,"t_first_token_unix":1779815158.859387,"t_done":384301.39440542,"t_done_unix":1779815166.4083486},{"request_id":"1399948:8:1425345:844","session_id":"1399948","input_length":11736,"t_proxy_recv":384301.397984375,"t_decision_unix":1779815166.411926,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9597818677573279,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":472,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":11736,"score_linear":149315.0,"score_lmetric":139547},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":138830,"ongoing_decode_tokens":138830,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":0,"new_prefill":11736,"score_linear":138830.0,"score_lmetric":23472},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":95555,"ongoing_decode_tokens":68187,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":2545,"cache_hit":0,"new_prefill":11736,"score_linear":95555.0,"score_lmetric":13637},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151055,"ongoing_decode_tokens":151055,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2015,"cache_hit":11264,"new_prefill":472,"score_linear":139791.0,"score_lmetric":944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":11736,"score_linear":127989.0,"score_lmetric":139725}],"chosen_score_linear":139791.0,"chosen_score_lmetric":944,"t_first_token":384301.491624617,"t_first_token_unix":1779815166.505568,"t_done":384301.862483446,"t_done_unix":1779815166.876427},{"request_id":"1364090:9:1423736:840","session_id":"1364090","input_length":101432,"t_proxy_recv":384294.942755595,"t_decision_unix":1779815159.9566965,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9590661724110734,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":4152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":0,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":7680,"new_prefill":93752,"score_linear":116410.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":97280,"new_prefill":4152,"score_linear":-59882.0,"score_lmetric":4152},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":100423,"ongoing_decode_tokens":63536,"pending_prefill_tokens":49308,"num_requests":1,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":7680,"new_prefill":93752,"score_linear":92743.0,"score_lmetric":143060},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":137888,"ongoing_decode_tokens":137888,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":101432,"score_linear":137888.0,"score_lmetric":202864},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":236575,"pending_prefill_tokens":2803,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":4096,"new_prefill":97336,"score_linear":276242.0,"score_lmetric":400556},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":7680,"new_prefill":93752,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":11264,"new_prefill":90168,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112578,"ongoing_decode_tokens":112578,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":11264,"new_prefill":90168,"score_linear":101314.0,"score_lmetric":180336}],"chosen_score_linear":-59882.0,"chosen_score_lmetric":4152,"t_first_token":384297.645957491,"t_first_token_unix":1779815162.6599011,"t_done":384302.150773974,"t_done_unix":1779815167.1647177},{"request_id":"1270606:2:1411654:817","session_id":"1270606","input_length":107292,"t_proxy_recv":384252.25495734,"t_decision_unix":1779815117.2688985,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":93184,"affinity_cache_ratio":0.8685083696827349,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":14108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":107292,"score_linear":181139.0,"score_lmetric":502832},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1535,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":259529,"ongoing_decode_tokens":144683,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":107292,"score_linear":259529.0,"score_lmetric":216190},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":107292,"score_linear":101803.0,"score_lmetric":107292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":117746,"ongoing_decode_tokens":0,"pending_prefill_tokens":8178,"num_requests":1,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":93184,"new_prefill":14108,"score_linear":24562.0,"score_lmetric":22286},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30154,"ongoing_decode_tokens":30154,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2350,"cache_hit":0,"new_prefill":107292,"score_linear":30154.0,"score_lmetric":107292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":1536,"new_prefill":105756,"score_linear":291929.0,"score_lmetric":438300}],"chosen_score_linear":24562.0,"chosen_score_lmetric":22286,"t_first_token":384293.844799487,"t_first_token_unix":1779815158.8587441,"t_done":384302.683418476,"t_done_unix":1779815167.6973622},{"request_id":"1301929:3:1417873:832","session_id":"1301929","input_length":37398,"t_proxy_recv":384273.954277801,"t_decision_unix":1779815138.9682188,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9994117332477672,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":22,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":181139,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":3584,"new_prefill":33814,"score_linear":177555.0,"score_lmetric":135256},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":96849,"ongoing_decode_tokens":0,"pending_prefill_tokens":10321,"num_requests":1,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":37376,"new_prefill":22,"score_linear":59473.0,"score_lmetric":10343},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":264754,"ongoing_decode_tokens":191737,"pending_prefill_tokens":4030,"num_requests":2,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":0,"new_prefill":37398,"score_linear":264754.0,"score_lmetric":82856},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":37398,"score_linear":101803.0,"score_lmetric":37398},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":117746,"pending_prefill_tokens":17184,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":37398,"score_linear":280338.0,"score_lmetric":218328},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":37398,"score_linear":72608.0,"score_lmetric":37398},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":37398,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":37398,"score_linear":293465.0,"score_lmetric":164868}],"chosen_score_linear":59473.0,"chosen_score_lmetric":10343,"t_first_token":384283.714917216,"t_first_token_unix":1779815148.7288604,"t_done":384304.588227568,"t_done_unix":1779815169.6021738},{"request_id":"1355951:5:1425005:843","session_id":"1355951","input_length":39789,"t_proxy_recv":384299.319263115,"t_decision_unix":1779815164.3332043,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9522229761994521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1901,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":39789,"score_linear":149315.0,"score_lmetric":167600},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":138830,"ongoing_decode_tokens":138830,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":0,"new_prefill":39789,"score_linear":138830.0,"score_lmetric":79578},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55766,"ongoing_decode_tokens":0,"pending_prefill_tokens":3163,"num_requests":0,"active_p_offloads":0,"cached_blocks":2545,"cache_hit":37888,"new_prefill":1901,"score_linear":17878.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":39789,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":236575,"pending_prefill_tokens":2803,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":39789,"score_linear":280338.0,"score_lmetric":170368},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":39789,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":34816,"new_prefill":4973,"score_linear":-34816.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1709,"cache_hit":0,"new_prefill":39789,"score_linear":80246.0,"score_lmetric":39789}],"chosen_score_linear":17878.0,"chosen_score_lmetric":0,"t_first_token":384306.185331225,"t_first_token_unix":1779815171.1992748,"t_done":384306.419295998,"t_done_unix":1779815171.4332397},{"request_id":"1270606:3:1427164:848","session_id":"1270606","input_length":108318,"t_proxy_recv":384306.98281559,"t_decision_unix":1779815171.996757,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":107008,"affinity_cache_ratio":0.987905980538784,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1310,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":108318,"score_linear":149315.0,"score_lmetric":236129},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":0,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":108318,"score_linear":108020.0,"score_lmetric":114962},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55766,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2548,"cache_hit":0,"new_prefill":108318,"score_linear":55766.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":108318,"score_linear":42342.0,"score_lmetric":108318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2042,"cache_hit":107008,"new_prefill":1310,"score_linear":-63245.0,"score_lmetric":1310},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":108318,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":108318,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":1536,"new_prefill":106782,"score_linear":126453.0,"score_lmetric":234771}],"chosen_score_linear":-63245.0,"chosen_score_lmetric":1310,"t_first_token":384307.775997548,"t_first_token_unix":1779815172.790007,"t_done":384308.157680776,"t_done_unix":1779815173.171625},{"request_id":"1363093:4:1390050:704","session_id":"1363093","input_length":68187,"t_proxy_recv":384298.707246876,"t_decision_unix":1779815163.7211883,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9536128587560678,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":3163,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":68187,"score_linear":149315.0,"score_lmetric":195998},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":138830,"ongoing_decode_tokens":138830,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":0,"new_prefill":68187,"score_linear":138830.0,"score_lmetric":136374},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2545,"cache_hit":65024,"new_prefill":3163,"score_linear":-77445.0,"score_lmetric":-3163},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":236575,"pending_prefill_tokens":2803,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":68187,"score_linear":280338.0,"score_lmetric":283960},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1709,"cache_hit":0,"new_prefill":68187,"score_linear":80246.0,"score_lmetric":68187}],"chosen_score_linear":-77445.0,"chosen_score_lmetric":-3163,"t_first_token":384299.958648251,"t_first_token_unix":1779815164.9725919,"t_done":384309.966995753,"t_done_unix":1779815174.9809396},{"request_id":"1277428:8:1426669:846","session_id":"1277428","input_length":42342,"t_proxy_recv":384305.225333613,"t_decision_unix":1779815170.2392745,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9552690000472345,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":1894,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":42342,"score_linear":149315.0,"score_lmetric":170153},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":4608,"new_prefill":37734,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":95555,"ongoing_decode_tokens":68187,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":2545,"cache_hit":0,"new_prefill":42342,"score_linear":95555.0,"score_lmetric":44243},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":40448,"new_prefill":1894,"score_linear":-40448.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2042,"cache_hit":0,"new_prefill":42342,"score_linear":43763.0,"score_lmetric":42342},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":17408,"new_prefill":24934,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":42342,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":42342,"score_linear":127989.0,"score_lmetric":170331}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":384305.872319809,"t_first_token_unix":1779815170.8862636,"t_done":384310.663575386,"t_done_unix":1779815175.677519},{"request_id":"1363093:5:1407810:790","session_id":"1363093","input_length":73188,"t_proxy_recv":384309.980811771,"t_decision_unix":1779815174.9947534,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68608,"affinity_cache_ratio":0.9374214352079576,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68608,"estimated_new_tokens":4580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":73188,"score_linear":149315.0,"score_lmetric":200999},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120616,"ongoing_decode_tokens":0,"pending_prefill_tokens":7464,"num_requests":2,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":73188,"score_linear":120616.0,"score_lmetric":161304},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2555,"cache_hit":68608,"new_prefill":4580,"score_linear":-81029.0,"score_lmetric":-4580},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":148621,"ongoing_decode_tokens":148621,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":73188,"score_linear":148621.0,"score_lmetric":146376},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2044,"cache_hit":0,"new_prefill":73188,"score_linear":43763.0,"score_lmetric":73188},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":73188,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":73188,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":73188,"score_linear":127989.0,"score_lmetric":201177}],"chosen_score_linear":-81029.0,"chosen_score_lmetric":-4580,"t_first_token":384312.107786801,"t_first_token_unix":1779815177.1217306,"t_done":384312.627637051,"t_done_unix":1779815177.641581},{"request_id":"1270340:5:1417075:829","session_id":"1270340","input_length":43763,"t_proxy_recv":384271.322935031,"t_decision_unix":1779815136.3368764,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":40960,"affinity_cache_ratio":0.9359504604346137,"affinity_num_requests":3,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":40960,"estimated_new_tokens":2803,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181139,"ongoing_decode_tokens":33187,"pending_prefill_tokens":18416,"num_requests":4,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":43763,"score_linear":181139.0,"score_lmetric":248716},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1560,"cache_hit":0,"new_prefill":43763,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":260463,"ongoing_decode_tokens":272884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2422,"cache_hit":0,"new_prefill":43763,"score_linear":260463.0,"score_lmetric":87526},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":43763,"score_linear":101803.0,"score_lmetric":43763},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":236575,"ongoing_decode_tokens":117746,"pending_prefill_tokens":14381,"num_requests":3,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":40960,"new_prefill":2803,"score_linear":195615.0,"score_lmetric":51552},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":0,"new_prefill":43763,"score_linear":72608.0,"score_lmetric":43763},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":43763,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":293465,"ongoing_decode_tokens":111470,"pending_prefill_tokens":3819,"num_requests":4,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":28160,"new_prefill":15603,"score_linear":265305.0,"score_lmetric":77688}],"chosen_score_linear":195615.0,"chosen_score_lmetric":51552,"t_first_token":384300.680224782,"t_first_token_unix":1779815165.6941693,"t_done":384313.540875899,"t_done_unix":1779815178.554821},{"request_id":"1362265:10:1427606:850","session_id":"1362265","input_length":12596,"t_proxy_recv":384308.259047148,"t_decision_unix":1779815173.2729883,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":11776,"affinity_cache_ratio":0.934899968243887,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":820,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":12596,"score_linear":149315.0,"score_lmetric":140407},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":0,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":11776,"new_prefill":820,"score_linear":96244.0,"score_lmetric":7464},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55766,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2548,"cache_hit":0,"new_prefill":12596,"score_linear":55766.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":6656,"new_prefill":5940,"score_linear":35686.0,"score_lmetric":5940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2044,"cache_hit":0,"new_prefill":12596,"score_linear":43763.0,"score_lmetric":12596},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":12596,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":12596,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":12596,"score_linear":127989.0,"score_lmetric":140585}],"chosen_score_linear":96244.0,"chosen_score_lmetric":7464,"t_first_token":384310.327162944,"t_first_token_unix":1779815175.341107,"t_done":384314.574256663,"t_done_unix":1779815179.5882},{"request_id":"1314357:7:1427957:851","session_id":"1314357","input_length":106279,"t_proxy_recv":384309.537793049,"t_decision_unix":1779815174.551734,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9972242870181315,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":295,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":106279,"score_linear":149315.0,"score_lmetric":234090},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120616,"ongoing_decode_tokens":0,"pending_prefill_tokens":7464,"num_requests":2,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":106279,"score_linear":120616.0,"score_lmetric":227486},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55766,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2548,"cache_hit":0,"new_prefill":106279,"score_linear":55766.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":105984,"new_prefill":295,"score_linear":-63642.0,"score_lmetric":295},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2044,"cache_hit":0,"new_prefill":106279,"score_linear":43763.0,"score_lmetric":106279},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":106279,"score_linear":127989.0,"score_lmetric":234268}],"chosen_score_linear":-63642.0,"chosen_score_lmetric":295,"t_first_token":384309.747252138,"t_first_token_unix":1779815174.7611954,"t_done":384315.122562588,"t_done_unix":1779815180.1365063},{"request_id":"1314357:8:1431749:854","session_id":"1314357","input_length":106805,"t_proxy_recv":384322.926027185,"t_decision_unix":1779815187.939968,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":106496,"affinity_cache_ratio":0.9971068770188661,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":106805,"score_linear":275262.0,"score_lmetric":492774},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":106805,"score_linear":108020.0,"score_lmetric":106805},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":106805,"score_linear":-12421.0,"score_lmetric":-106805},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1585,"cache_hit":106496,"new_prefill":309,"score_linear":-104656.0,"score_lmetric":309},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":106805,"score_linear":127989.0,"score_lmetric":234794}],"chosen_score_linear":-104656.0,"chosen_score_lmetric":309,"t_first_token":384323.137504099,"t_first_token_unix":1779815188.1514475,"t_done":384324.525205633,"t_done_unix":1779815189.5391555},{"request_id":"1407599:2:1430593:852","session_id":"1407599","input_length":1840,"t_proxy_recv":384318.973553321,"t_decision_unix":1779815183.9874945,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.8347826086956521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":304,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":1840,"score_linear":149315.0,"score_lmetric":129651},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":1840,"score_linear":108020.0,"score_lmetric":1840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":1840,"score_linear":-12421.0,"score_lmetric":-1840},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1585,"cache_hit":1536,"new_prefill":304,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":1840,"score_linear":127989.0,"score_lmetric":129829}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":384319.009551668,"t_first_token_unix":1779815184.0234952,"t_done":384330.618177228,"t_done_unix":1779815195.6321208},{"request_id":"1382089:3:1433211:856","session_id":"1382089","input_length":40567,"t_proxy_recv":384328.221064513,"t_decision_unix":1779815193.2350059,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":38912,"affinity_cache_ratio":0.9592032933172283,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38912,"estimated_new_tokens":1655,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":40567,"score_linear":275262.0,"score_lmetric":360298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":40567,"score_linear":108020.0,"score_lmetric":40567},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":34816,"new_prefill":5751,"score_linear":-47237.0,"score_lmetric":-5751},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1585,"cache_hit":0,"new_prefill":40567,"score_linear":1840.0,"score_lmetric":40567},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":40567,"score_linear":73878.0,"score_lmetric":43277},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":38912,"new_prefill":1655,"score_linear":-38912.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":40567,"score_linear":127989.0,"score_lmetric":168556}],"chosen_score_linear":-38912.0,"chosen_score_lmetric":0,"t_first_token":384328.694371547,"t_first_token_unix":1779815193.7083156,"t_done":384330.793716067,"t_done_unix":1779815195.8076596},{"request_id":"1314357:9:1435219:861","session_id":"1314357","input_length":106959,"t_proxy_recv":384335.390774145,"t_decision_unix":1779815200.404715,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":106496,"affinity_cache_ratio":0.9956712385119532,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":463,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":106959,"score_linear":275262.0,"score_lmetric":493082},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":106959,"score_linear":108020.0,"score_lmetric":106959},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":106496,"new_prefill":463,"score_linear":-106496.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131140,"ongoing_decode_tokens":0,"pending_prefill_tokens":3652,"num_requests":3,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":106959,"score_linear":131140.0,"score_lmetric":331833},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":106959,"score_linear":127989.0,"score_lmetric":234948}],"chosen_score_linear":-106496.0,"chosen_score_lmetric":0,"t_first_token":384335.55835109,"t_first_token_unix":1779815200.5722947,"t_done":384338.113380988,"t_done_unix":1779815203.127331},{"request_id":"1399948:9:1433544:857","session_id":"1399948","input_length":11993,"t_proxy_recv":384329.437845026,"t_decision_unix":1779815194.4517863,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9392145418160593,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":11993,"score_linear":275262.0,"score_lmetric":303150},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":11993,"score_linear":108020.0,"score_lmetric":11993},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":11993,"score_linear":-12421.0,"score_lmetric":-11993},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1585,"cache_hit":0,"new_prefill":11993,"score_linear":1840.0,"score_lmetric":11993},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":11264,"new_prefill":729,"score_linear":62614.0,"score_lmetric":3439},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":40567,"ongoing_decode_tokens":40567,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":11993,"score_linear":40567.0,"score_lmetric":11993},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":11993,"score_linear":127989.0,"score_lmetric":139982}],"chosen_score_linear":62614.0,"chosen_score_lmetric":3439,"t_first_token":384347.149090499,"t_first_token_unix":1779815212.163034,"t_done":384347.244977438,"t_done_unix":1779815212.2589207},{"request_id":"1399948:10:1434418:858","session_id":"1399948","input_length":12032,"t_proxy_recv":384347.248993343,"t_decision_unix":1779815212.262935,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9787234042553191,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":256,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":304674,"ongoing_decode_tokens":124090,"pending_prefill_tokens":35176,"num_requests":3,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":12032,"score_linear":304674.0,"score_lmetric":141624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":12032,"score_linear":108020.0,"score_lmetric":12032},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119147,"ongoing_decode_tokens":119147,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2052,"cache_hit":11776,"new_prefill":256,"score_linear":107371.0,"score_lmetric":512},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":12032,"score_linear":127488.0,"score_lmetric":132864},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":12032,"score_linear":127989.0,"score_lmetric":140021}],"chosen_score_linear":107371.0,"chosen_score_lmetric":512,"t_first_token":384347.31194293,"t_first_token_unix":1779815212.325887,"t_done":384347.824561917,"t_done_unix":1779815212.8385053},{"request_id":"1399948:11:1435163:860","session_id":"1399948","input_length":12106,"t_proxy_recv":384347.832676934,"t_decision_unix":1779815212.8466184,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9727407896910623,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":304674,"ongoing_decode_tokens":124090,"pending_prefill_tokens":35176,"num_requests":3,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":12106,"score_linear":304674.0,"score_lmetric":141846},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":12106,"score_linear":108020.0,"score_lmetric":12106},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119147,"ongoing_decode_tokens":119147,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2052,"cache_hit":11776,"new_prefill":330,"score_linear":107371.0,"score_lmetric":660},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":12106,"score_linear":127488.0,"score_lmetric":132938},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":12106,"score_linear":127989.0,"score_lmetric":140095}],"chosen_score_linear":107371.0,"chosen_score_lmetric":660,"t_first_token":384347.904217024,"t_first_token_unix":1779815212.918161,"t_done":384348.032136771,"t_done_unix":1779815213.0460804},{"request_id":"1399948:12:1436179:863","session_id":"1399948","input_length":12164,"t_proxy_recv":384348.036344255,"t_decision_unix":1779815213.050286,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9681025978296613,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":388,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":304674,"ongoing_decode_tokens":124090,"pending_prefill_tokens":35176,"num_requests":3,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":12164,"score_linear":304674.0,"score_lmetric":142020},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":12164,"score_linear":108020.0,"score_lmetric":12164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119147,"ongoing_decode_tokens":119147,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2052,"cache_hit":11776,"new_prefill":388,"score_linear":107371.0,"score_lmetric":776},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":12164,"score_linear":127488.0,"score_lmetric":132996},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":12164,"score_linear":127989.0,"score_lmetric":140153}],"chosen_score_linear":107371.0,"chosen_score_lmetric":776,"t_first_token":384348.098219665,"t_first_token_unix":1779815213.112163,"t_done":384348.432720985,"t_done_unix":1779815213.4466643},{"request_id":"1342921:5:1433192:855","session_id":"1342921","input_length":73878,"t_proxy_recv":384328.151760109,"t_decision_unix":1779815193.1656995,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9633179024878854,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":2710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":73878,"score_linear":275262.0,"score_lmetric":426920},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":73878,"score_linear":108020.0,"score_lmetric":73878},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":73878,"score_linear":-12421.0,"score_lmetric":-73878},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1585,"cache_hit":0,"new_prefill":73878,"score_linear":1840.0,"score_lmetric":73878},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":71168,"new_prefill":2710,"score_linear":-71168.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":73878,"score_linear":127989.0,"score_lmetric":201867}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":384347.148078761,"t_first_token_unix":1779815212.1620219,"t_done":384348.811819109,"t_done_unix":1779815213.8257627},{"request_id":"1270340:6:1434904:859","session_id":"1270340","input_length":45269,"t_proxy_recv":384334.092981852,"t_decision_unix":1779815199.1069233,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9952947933464402,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":45269,"score_linear":275262.0,"score_lmetric":369702},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":45269,"score_linear":108020.0,"score_lmetric":45269},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":85871,"ongoing_decode_tokens":0,"pending_prefill_tokens":3439,"num_requests":2,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":45056,"new_prefill":213,"score_linear":40815.0,"score_lmetric":7304},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":28160,"new_prefill":17109,"score_linear":99829.0,"score_lmetric":145098}],"chosen_score_linear":40815.0,"chosen_score_lmetric":7304,"t_first_token":384347.150799484,"t_first_token_unix":1779815212.1647425,"t_done":384349.345952069,"t_done_unix":1779815214.3598952},{"request_id":"1314357:10:1439373:867","session_id":"1314357","input_length":107228,"t_proxy_recv":384349.236447221,"t_decision_unix":1779815214.2503881,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":107008,"affinity_cache_ratio":0.9979482970865818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":220,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":304674,"ongoing_decode_tokens":124090,"pending_prefill_tokens":35176,"num_requests":3,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":107228,"score_linear":304674.0,"score_lmetric":427212},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":107228,"score_linear":108020.0,"score_lmetric":107228},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":52920,"ongoing_decode_tokens":0,"pending_prefill_tokens":3768,"num_requests":1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":107228,"score_linear":52920.0,"score_lmetric":110996},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":107008,"new_prefill":220,"score_linear":-107008.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":45269,"ongoing_decode_tokens":45269,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":107228,"score_linear":45269.0,"score_lmetric":107228},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":107228,"score_linear":127488.0,"score_lmetric":228060},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":107228,"score_linear":127989.0,"score_lmetric":235217}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":384349.396553521,"t_first_token_unix":1779815214.410497,"t_done":384349.679100002,"t_done_unix":1779815214.693044},{"request_id":"1268861:10:1439325:866","session_id":"1268861","input_length":52920,"t_proxy_recv":384349.106838849,"t_decision_unix":1779815214.12078,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9287981859410431,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":3768,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":304674,"ongoing_decode_tokens":124090,"pending_prefill_tokens":35176,"num_requests":3,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":52920,"score_linear":304674.0,"score_lmetric":264288},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":52920,"score_linear":108020.0,"score_lmetric":52920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":49152,"new_prefill":3768,"score_linear":-49152.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":52920,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":45269,"ongoing_decode_tokens":45269,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":44032,"new_prefill":8888,"score_linear":1237.0,"score_lmetric":8888},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":52920,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":52920,"score_linear":127488.0,"score_lmetric":173752},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":52920,"score_linear":127989.0,"score_lmetric":180909}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":384350.315195263,"t_first_token_unix":1779815215.3291404,"t_done":384351.420091784,"t_done_unix":1779815216.4340353},{"request_id":"1313181:8:1329951:394","session_id":"1313181","input_length":124090,"t_proxy_recv":384293.939533644,"t_decision_unix":1779815158.953475,"policy":"unified","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":0,"affinity_cache_hit":61952,"affinity_cache_ratio":0.499250543960029,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":-111290,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":111290,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":12800,"new_prefill":111290,"score_linear":-12800.0,"score_lmetric":-111290},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":0,"new_prefill":124090,"score_linear":37398.0,"score_lmetric":124090},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":100423,"ongoing_decode_tokens":63536,"pending_prefill_tokens":49308,"num_requests":1,"active_p_offloads":0,"cached_blocks":2445,"cache_hit":0,"new_prefill":124090,"score_linear":100423.0,"score_lmetric":173398},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":137888,"ongoing_decode_tokens":137888,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":12800,"new_prefill":111290,"score_linear":125088.0,"score_lmetric":222580},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":236575,"pending_prefill_tokens":2803,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":124090,"score_linear":280338.0,"score_lmetric":507572},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":124090,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":124090,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112578,"ongoing_decode_tokens":112578,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":61952,"new_prefill":62138,"score_linear":50626.0,"score_lmetric":124276}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":-111290,"t_first_token":384342.592481921,"t_first_token_unix":1779815207.606426,"t_done":384355.320664872,"t_done_unix":1779815220.3346086},{"request_id":"1366128:26:1413108:823","session_id":"1366128","input_length":127989,"t_proxy_recv":384301.238378982,"t_decision_unix":1779815166.25232,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":7,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9200790692950176,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":127989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":0,"new_prefill":127989,"score_linear":149315.0,"score_lmetric":255800},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":138830,"ongoing_decode_tokens":138830,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":0,"new_prefill":127989,"score_linear":138830.0,"score_lmetric":255978},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":95555,"ongoing_decode_tokens":68187,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":2545,"cache_hit":0,"new_prefill":127989,"score_linear":95555.0,"score_lmetric":129890},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162592,"ongoing_decode_tokens":162592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2015,"cache_hit":117760,"new_prefill":10229,"score_linear":44832.0,"score_lmetric":30687},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384352.779353649,"t_first_token_unix":1779815217.7932973,"t_done":384355.567532347,"t_done_unix":1779815220.5814805},{"request_id":"1366128:27:1417788:831","session_id":"1366128","input_length":128433,"t_proxy_recv":384355.587898539,"t_decision_unix":1779815220.60184,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":128000,"affinity_cache_ratio":0.9966285923399749,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":128000,"estimated_new_tokens":433,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":243028,"ongoing_decode_tokens":151172,"pending_prefill_tokens":7376,"num_requests":3,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":0,"new_prefill":128433,"score_linear":243028.0,"score_lmetric":407427},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":128433,"score_linear":108020.0,"score_lmetric":128433},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":117760,"new_prefill":10673,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":128433,"score_linear":127488.0,"score_lmetric":249265},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1964,"cache_hit":128000,"new_prefill":433,"score_linear":-128000.0,"score_lmetric":0}],"chosen_score_linear":-128000.0,"chosen_score_lmetric":0,"t_first_token":384355.97789769,"t_first_token_unix":1779815220.9918413,"t_done":384356.973031502,"t_done_unix":1779815221.9869757},{"request_id":"1366128:28:1421998:837","session_id":"1366128","input_length":128642,"t_proxy_recv":384356.994069353,"t_decision_unix":1779815222.0080109,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":128512,"affinity_cache_ratio":0.9989894435720837,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":128512,"estimated_new_tokens":130,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":243028,"ongoing_decode_tokens":151172,"pending_prefill_tokens":7376,"num_requests":3,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":0,"new_prefill":128642,"score_linear":243028.0,"score_lmetric":408054},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":171173,"ongoing_decode_tokens":108020,"pending_prefill_tokens":14001,"num_requests":2,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":128642,"score_linear":171173.0,"score_lmetric":285286},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":128642,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":128642,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":117760,"new_prefill":10882,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":128642,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":128642,"score_linear":127488.0,"score_lmetric":249474},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":128512,"new_prefill":130,"score_linear":-128512.0,"score_lmetric":0}],"chosen_score_linear":-128512.0,"chosen_score_lmetric":0,"t_first_token":384357.268675629,"t_first_token_unix":1779815222.2826195,"t_done":384357.768734916,"t_done_unix":1779815222.7826786},{"request_id":"1313181:8:1385690:686","session_id":"1313181","input_length":62444,"t_proxy_recv":384355.330736849,"t_decision_unix":1779815220.3446784,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9921209403625648,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":492,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":180584,"ongoing_decode_tokens":151172,"pending_prefill_tokens":6884,"num_requests":2,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":61952,"new_prefill":492,"score_linear":118632.0,"score_lmetric":14752},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":62444,"score_linear":108020.0,"score_lmetric":62444},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":12800,"new_prefill":49644,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":62444,"score_linear":127488.0,"score_lmetric":183276},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":127989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":61952,"new_prefill":492,"score_linear":66037.0,"score_lmetric":492}],"chosen_score_linear":118632.0,"chosen_score_lmetric":14752,"t_first_token":384358.891222495,"t_first_token_unix":1779815223.9051661,"t_done":384360.71164559,"t_done_unix":1779815225.7255898},{"request_id":"1363943:11:1424840:842","session_id":"1363943","input_length":25225,"t_proxy_recv":384298.667100191,"t_decision_unix":1779815163.6810415,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":0,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9742715559960357,"affinity_num_requests":4,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":16521,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":0,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":8704,"new_prefill":16521,"score_linear":115386.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":138830,"ongoing_decode_tokens":138830,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1583,"cache_hit":4096,"new_prefill":21129,"score_linear":134734.0,"score_lmetric":42258},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":51115,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2541,"cache_hit":4096,"new_prefill":21129,"score_linear":47019.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":25225,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":280338,"ongoing_decode_tokens":236575,"pending_prefill_tokens":2803,"num_requests":4,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":24576,"new_prefill":649,"score_linear":255762.0,"score_lmetric":13808},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1709,"cache_hit":4096,"new_prefill":21129,"score_linear":76150.0,"score_lmetric":21129}],"chosen_score_linear":115386.0,"chosen_score_lmetric":0,"t_first_token":384350.95817079,"t_first_token_unix":1779815215.9721143,"t_done":384361.07759137,"t_done_unix":1779815226.091535},{"request_id":"1314357:11:1442554:870","session_id":"1314357","input_length":108166,"t_proxy_recv":384359.750924707,"t_decision_unix":1779815224.7648659,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":107008,"affinity_cache_ratio":0.9892942329382616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1158,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":243028,"ongoing_decode_tokens":243028,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":0,"new_prefill":108166,"score_linear":243028.0,"score_lmetric":324498},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":190229,"ongoing_decode_tokens":108020,"pending_prefill_tokens":19745,"num_requests":3,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":108166,"score_linear":190229.0,"score_lmetric":383733},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":107008,"new_prefill":1158,"score_linear":-107008.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":108166,"score_linear":127488.0,"score_lmetric":228998},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":126198,"ongoing_decode_tokens":126198,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":108166,"score_linear":126198.0,"score_lmetric":108166}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":384360.499211199,"t_first_token_unix":1779815225.5131545,"t_done":384362.53226499,"t_done_unix":1779815227.5462086},{"request_id":"1366128:29:1424316:841","session_id":"1366128","input_length":126198,"t_proxy_recv":384357.864052087,"t_decision_unix":1779815222.8779936,"policy":"unified","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":125952,"affinity_cache_ratio":0.9980506822612085,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":125952,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":243028,"ongoing_decode_tokens":151172,"pending_prefill_tokens":7376,"num_requests":3,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":0,"new_prefill":126198,"score_linear":243028.0,"score_lmetric":400722},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":171173,"ongoing_decode_tokens":108020,"pending_prefill_tokens":14001,"num_requests":2,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":126198,"score_linear":171173.0,"score_lmetric":280398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":117760,"new_prefill":8438,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":126198,"score_linear":127488.0,"score_lmetric":247030},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":125952,"new_prefill":246,"score_linear":-125952.0,"score_lmetric":0}],"chosen_score_linear":-125952.0,"chosen_score_lmetric":0,"t_first_token":384358.018723667,"t_first_token_unix":1779815223.0326672,"t_done":384365.318183191,"t_done_unix":1779815230.332127},{"request_id":"1363943:12:1426646:845","session_id":"1363943","input_length":26923,"t_proxy_recv":384361.084851857,"t_decision_unix":1779815226.0987935,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9318426624076068,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1835,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2370,"cache_hit":25088,"new_prefill":1835,"score_linear":130271.0,"score_lmetric":1835},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":190229,"ongoing_decode_tokens":108020,"pending_prefill_tokens":19745,"num_requests":3,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":4096,"new_prefill":22827,"score_linear":186133.0,"score_lmetric":127716},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108166,"ongoing_decode_tokens":108166,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":26923,"score_linear":108166.0,"score_lmetric":26923},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":24576,"new_prefill":2347,"score_linear":105097.0,"score_lmetric":132020},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":4096,"new_prefill":22827,"score_linear":123392.0,"score_lmetric":143659},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":126198,"ongoing_decode_tokens":126198,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":4096,"new_prefill":22827,"score_linear":122102.0,"score_lmetric":22827}],"chosen_score_linear":130271.0,"chosen_score_lmetric":1835,"t_first_token":384361.49652248,"t_first_token_unix":1779815226.510466,"t_done":384371.500339632,"t_done_unix":1779815236.514283},{"request_id":"1371622:2:1442319:869","session_id":"1371622","input_length":19056,"t_proxy_recv":384358.960799483,"t_decision_unix":1779815223.9747412,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":13312,"affinity_cache_ratio":0.6985726280436608,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":5744,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":243028,"ongoing_decode_tokens":243028,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":0,"new_prefill":19056,"score_linear":243028.0,"score_lmetric":57168},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":171173,"ongoing_decode_tokens":108020,"pending_prefill_tokens":14001,"num_requests":2,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":13312,"new_prefill":5744,"score_linear":157861.0,"score_lmetric":39490},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":11264,"new_prefill":7792,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":19056,"score_linear":127488.0,"score_lmetric":139888},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":126198,"ongoing_decode_tokens":126198,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":19056,"score_linear":126198.0,"score_lmetric":19056}],"chosen_score_linear":157861.0,"chosen_score_lmetric":39490,"t_first_token":384372.263355867,"t_first_token_unix":1779815237.277306,"t_done":384373.810622138,"t_done_unix":1779815238.8245654},{"request_id":"1314357:12:1446681:873","session_id":"1314357","input_length":108409,"t_proxy_recv":384373.476557348,"t_decision_unix":1779815238.4904985,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":108032,"affinity_cache_ratio":0.996522428949626,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184070,"ongoing_decode_tokens":184070,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":0,"new_prefill":108409,"score_linear":184070.0,"score_lmetric":216818},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":190229,"ongoing_decode_tokens":190229,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":108409,"score_linear":190229.0,"score_lmetric":325227},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":108032,"new_prefill":377,"score_linear":-108032.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":108409,"score_linear":129673.0,"score_lmetric":238082},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":108409,"score_linear":127488.0,"score_lmetric":229241},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":384373.686780221,"t_first_token_unix":1779815238.7007236,"t_done":384374.285363063,"t_done_unix":1779815239.2993069},{"request_id":"1294611:12:1441557:868","session_id":"1294611","input_length":63153,"t_proxy_recv":384356.221767506,"t_decision_unix":1779815221.2357092,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":49152,"affinity_cache_ratio":0.7783003182746663,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":14001,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":243028,"ongoing_decode_tokens":151172,"pending_prefill_tokens":7376,"num_requests":3,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":0,"new_prefill":63153,"score_linear":243028.0,"score_lmetric":211587},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":49152,"new_prefill":14001,"score_linear":58868.0,"score_lmetric":14001},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":12800,"new_prefill":50353,"score_linear":114688.0,"score_lmetric":171185},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":128433,"ongoing_decode_tokens":128433,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1964,"cache_hit":12800,"new_prefill":50353,"score_linear":115633.0,"score_lmetric":50353}],"chosen_score_linear":58868.0,"chosen_score_lmetric":14001,"t_first_token":384370.470930603,"t_first_token_unix":1779815235.4848742,"t_done":384377.511734955,"t_done_unix":1779815242.5256817},{"request_id":"1364090:10:1426859:847","session_id":"1364090","input_length":108020,"t_proxy_recv":384305.953980834,"t_decision_unix":1779815170.9679222,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9384928716904277,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":6644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":7680,"new_prefill":100340,"score_linear":141635.0,"score_lmetric":228151},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":101376,"new_prefill":6644,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":95555,"ongoing_decode_tokens":68187,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":2545,"cache_hit":7680,"new_prefill":100340,"score_linear":87875.0,"score_lmetric":102241},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":108020,"score_linear":42342.0,"score_lmetric":108020},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2042,"cache_hit":4096,"new_prefill":103924,"score_linear":39667.0,"score_lmetric":103924},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":7680,"new_prefill":100340,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":11264,"new_prefill":96756,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":11264,"new_prefill":96756,"score_linear":116725.0,"score_lmetric":224745}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":384310.142299489,"t_first_token_unix":1779815175.1562428,"t_done":384379.650384385,"t_done_unix":1779815244.6643283},{"request_id":"1294611:13:1446349:872","session_id":"1294611","input_length":63488,"t_proxy_recv":384377.52282811,"t_decision_unix":1779815242.5367696,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9919354838709677,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184070,"ongoing_decode_tokens":184070,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":0,"new_prefill":63488,"score_linear":184070.0,"score_lmetric":126976},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127312,"ongoing_decode_tokens":127312,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1631,"cache_hit":62976,"new_prefill":512,"score_linear":64336.0,"score_lmetric":1024},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":63488,"score_linear":129673.0,"score_lmetric":193161},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":12800,"new_prefill":50688,"score_linear":114688.0,"score_lmetric":171520},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":50688,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":64336.0,"chosen_score_lmetric":1024,"t_first_token":384377.664036333,"t_first_token_unix":1779815242.6779819,"t_done":384379.71010666,"t_done_unix":1779815244.7240503},{"request_id":"1363943:13:1438562:865","session_id":"1363943","input_length":28711,"t_proxy_recv":384371.507162624,"t_decision_unix":1779815236.5211043,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9451429765595069,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":1575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":27136,"new_prefill":1575,"score_linear":128223.0,"score_lmetric":1575},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":190229,"ongoing_decode_tokens":171173,"pending_prefill_tokens":5744,"num_requests":3,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":4096,"new_prefill":24615,"score_linear":186133.0,"score_lmetric":91077},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":28711,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":24576,"new_prefill":4135,"score_linear":105097.0,"score_lmetric":133808},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":4096,"new_prefill":24615,"score_linear":123392.0,"score_lmetric":145447},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":128223.0,"chosen_score_lmetric":1575,"t_first_token":384371.872490289,"t_first_token_unix":1779815236.8864453,"t_done":384380.369554,"t_done_unix":1779815245.3834977},{"request_id":"1314357:13:1448346:875","session_id":"1314357","input_length":108791,"t_proxy_recv":384379.144166606,"t_decision_unix":1779815244.158108,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9930233199437454,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":759,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184070,"ongoing_decode_tokens":184070,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":0,"new_prefill":108791,"score_linear":184070.0,"score_lmetric":217582},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":190800,"ongoing_decode_tokens":190800,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1631,"cache_hit":0,"new_prefill":108791,"score_linear":190800.0,"score_lmetric":326373},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":108032,"new_prefill":759,"score_linear":-108032.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":108791,"score_linear":129673.0,"score_lmetric":238464},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":108791,"score_linear":127488.0,"score_lmetric":229623},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":384379.670150732,"t_first_token_unix":1779815244.6840942,"t_done":384381.454811658,"t_done_unix":1779815246.4687557},{"request_id":"1371622:3:1443876:871","session_id":"1371622","input_length":19292,"t_proxy_recv":384373.815028423,"t_decision_unix":1779815238.82897,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9819614347916235,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184070,"ongoing_decode_tokens":184070,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":0,"new_prefill":19292,"score_linear":184070.0,"score_lmetric":38584},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":171173,"ongoing_decode_tokens":171173,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":18944,"new_prefill":348,"score_linear":152229.0,"score_lmetric":696},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108409,"ongoing_decode_tokens":108409,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":19292,"score_linear":108409.0,"score_lmetric":19292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":11264,"new_prefill":8028,"score_linear":118409.0,"score_lmetric":137701},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":19292,"score_linear":127488.0,"score_lmetric":140124},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":152229.0,"chosen_score_lmetric":696,"t_first_token":384373.93505666,"t_first_token_unix":1779815238.949,"t_done":384385.87718952,"t_done_unix":1779815250.8911328},{"request_id":"1294611:14:1449074:877","session_id":"1294611","input_length":63616,"t_proxy_recv":384381.520535129,"t_decision_unix":1779815246.5344765,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":63488,"affinity_cache_ratio":0.9979879275653923,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":63488,"estimated_new_tokens":128,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":63616,"score_linear":155359.0,"score_lmetric":63616},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":19292,"ongoing_decode_tokens":19292,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1653,"cache_hit":63488,"new_prefill":128,"score_linear":-44196.0,"score_lmetric":128},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":63616,"score_linear":205434.0,"score_lmetric":390644},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":12800,"new_prefill":50816,"score_linear":114688.0,"score_lmetric":171648},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":50816,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-44196.0,"chosen_score_lmetric":128,"t_first_token":384381.618027896,"t_first_token_unix":1779815246.6319711,"t_done":384387.115683602,"t_done_unix":1779815252.1296275},{"request_id":"1314357:14:1450740:878","session_id":"1314357","input_length":109010,"t_proxy_recv":384386.970925943,"t_decision_unix":1779815251.9848669,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":108544,"affinity_cache_ratio":0.9957251628290983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108544,"estimated_new_tokens":466,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":109010,"score_linear":155359.0,"score_lmetric":109010},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63616,"ongoing_decode_tokens":63616,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1655,"cache_hit":0,"new_prefill":109010,"score_linear":63616.0,"score_lmetric":109010},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":108544,"new_prefill":466,"score_linear":-108544.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":109010,"score_linear":205434.0,"score_lmetric":481432},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":109010,"score_linear":127488.0,"score_lmetric":229842},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-108544.0,"chosen_score_lmetric":0,"t_first_token":384387.205067606,"t_first_token_unix":1779815252.219011,"t_done":384388.473746375,"t_done_unix":1779815253.4876902},{"request_id":"1371622:4:1452210:881","session_id":"1371622","input_length":20439,"t_proxy_recv":384391.942132664,"t_decision_unix":1779815256.9560745,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9769558197563482,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":20439,"score_linear":155359.0,"score_lmetric":20439},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1656,"cache_hit":19968,"new_prefill":471,"score_linear":-19968.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55050,"ongoing_decode_tokens":0,"pending_prefill_tokens":2314,"num_requests":1,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":20439,"score_linear":55050.0,"score_lmetric":22753},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":11264,"new_prefill":9175,"score_linear":194170.0,"score_lmetric":281762},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":20439,"score_linear":127488.0,"score_lmetric":141271},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":384392.001188877,"t_first_token_unix":1779815257.0151322,"t_done":384392.526109442,"t_done_unix":1779815257.5400548},{"request_id":"1268861:11:1452208:880","session_id":"1268861","input_length":55050,"t_proxy_recv":384391.9344584,"t_decision_unix":1779815256.9483993,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9579654859218892,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2314,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":55050,"score_linear":155359.0,"score_lmetric":55050},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1656,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":52736,"new_prefill":2314,"score_linear":-52736.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":44032,"new_prefill":11018,"score_linear":161402.0,"score_lmetric":285448},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":55050,"score_linear":127488.0,"score_lmetric":175882},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":384392.765635948,"t_first_token_unix":1779815257.7795794,"t_done":384393.239286602,"t_done_unix":1779815258.25323},{"request_id":"1314357:15:1452292:882","session_id":"1314357","input_length":109164,"t_proxy_recv":384392.196647435,"t_decision_unix":1779815257.210589,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9990106628558866,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":109164,"score_linear":155359.0,"score_lmetric":109164},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":20439,"ongoing_decode_tokens":20439,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1656,"cache_hit":0,"new_prefill":109164,"score_linear":20439.0,"score_lmetric":109164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":55050,"ongoing_decode_tokens":0,"pending_prefill_tokens":2314,"num_requests":1,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":109164,"score_linear":55050.0,"score_lmetric":111478},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":109056,"new_prefill":108,"score_linear":-109056.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":109164,"score_linear":205434.0,"score_lmetric":481740},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":109164,"score_linear":127488.0,"score_lmetric":229996},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":384392.362746115,"t_first_token_unix":1779815257.3766894,"t_done":384396.306185641,"t_done_unix":1779815261.3201299},{"request_id":"1356885:2:1438037:864","session_id":"1356885","input_length":127488,"t_proxy_recv":384344.842155871,"t_decision_unix":1779815209.8560967,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":6,"affinity_cache_hit":122368,"affinity_cache_ratio":0.9598393574297188,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":120832,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":304674,"ongoing_decode_tokens":124090,"pending_prefill_tokens":35176,"num_requests":3,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":122368,"new_prefill":5120,"score_linear":182306.0,"score_lmetric":120888},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":127488,"score_linear":108020.0,"score_lmetric":127488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131140,"ongoing_decode_tokens":0,"pending_prefill_tokens":3652,"num_requests":3,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":127488,"score_linear":131140.0,"score_lmetric":393420},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":6656,"new_prefill":120832,"score_linear":-6656.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":127488,"score_linear":127989.0,"score_lmetric":255477}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":384396.49064831,"t_first_token_unix":1779815261.504592,"t_done":384398.082237781,"t_done_unix":1779815263.0961819},{"request_id":"1264679:3:1431512:853","session_id":"1264679","input_length":125947,"t_proxy_recv":384321.966874504,"t_decision_unix":1779815186.980816,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":114176,"affinity_cache_ratio":0.9065400525617918,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":114176,"estimated_new_tokens":11771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":149315,"ongoing_decode_tokens":0,"pending_prefill_tokens":127811,"num_requests":1,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":114176,"new_prefill":11771,"score_linear":35139.0,"score_lmetric":139582},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":125947,"score_linear":108020.0,"score_lmetric":125947},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":-12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":125947,"score_linear":-12421.0,"score_lmetric":-125947},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1585,"cache_hit":0,"new_prefill":125947,"score_linear":1840.0,"score_lmetric":125947},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":125947,"score_linear":127989.0,"score_lmetric":253936}],"chosen_score_linear":35139.0,"chosen_score_lmetric":139582,"t_first_token":384353.958990384,"t_first_token_unix":1779815218.9729345,"t_done":384399.408348617,"t_done_unix":1779815264.4222925},{"request_id":"1404395:2:1435941:862","session_id":"1404395","input_length":29412,"t_proxy_recv":384337.736425924,"t_decision_unix":1779815202.7503672,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":22528,"affinity_cache_ratio":0.7659458724330205,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":6884,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":275262,"ongoing_decode_tokens":0,"pending_prefill_tokens":139582,"num_requests":2,"active_p_offloads":0,"cached_blocks":2122,"cache_hit":22528,"new_prefill":6884,"score_linear":252734.0,"score_lmetric":292932},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":29412,"score_linear":108020.0,"score_lmetric":29412},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2564,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":106959,"ongoing_decode_tokens":106959,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1589,"cache_hit":0,"new_prefill":29412,"score_linear":106959.0,"score_lmetric":29412},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131140,"ongoing_decode_tokens":0,"pending_prefill_tokens":3652,"num_requests":3,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":512,"new_prefill":28900,"score_linear":130628.0,"score_lmetric":97656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":512,"new_prefill":28900,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":127989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":29412,"score_linear":127989.0,"score_lmetric":157401}],"chosen_score_linear":252734.0,"chosen_score_lmetric":292932,"t_first_token":384358.888629671,"t_first_token_unix":1779815223.9025733,"t_done":384400.481190497,"t_done_unix":1779815265.4951339},{"request_id":"1371622:5:1455608:884","session_id":"1371622","input_length":21518,"t_proxy_recv":384403.722054888,"t_decision_unix":1779815268.735996,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":20480,"affinity_cache_ratio":0.951761316107445,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":1038,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":-21518},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":20480,"new_prefill":1038,"score_linear":-20480.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":11264,"new_prefill":10254,"score_linear":194170.0,"score_lmetric":283920},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":0,"new_prefill":21518,"score_linear":128563.0,"score_lmetric":21518},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-20480.0,"chosen_score_lmetric":0,"t_first_token":384403.959093222,"t_first_token_unix":1779815268.9730365,"t_done":384404.402598226,"t_done_unix":1779815269.4165418},{"request_id":"1363943:14:1458616:885","session_id":"1363943","input_length":29268,"t_proxy_recv":384413.667855973,"t_decision_unix":1779815278.6817973,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29184,"affinity_cache_ratio":0.997129971299713,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":84,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":29184,"new_prefill":84,"score_linear":-29184.0,"score_lmetric":-84},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":29268,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":24576,"new_prefill":4692,"score_linear":180858.0,"score_lmetric":272796},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":4096,"new_prefill":25172,"score_linear":124467.0,"score_lmetric":25172},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":-84,"t_first_token":384413.749705933,"t_first_token_unix":1779815278.7636492,"t_done":384414.310713825,"t_done_unix":1779815279.3246577},{"request_id":"1356885:3:1451307:879","session_id":"1356885","input_length":128563,"t_proxy_recv":384398.103901885,"t_decision_unix":1779815263.1178434,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":127488,"affinity_cache_ratio":0.9916383407356705,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":127488,"estimated_new_tokens":1075,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155359,"ongoing_decode_tokens":155359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":122368,"new_prefill":6195,"score_linear":32991.0,"score_lmetric":6195},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1657,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":205434,"ongoing_decode_tokens":0,"pending_prefill_tokens":131706,"num_requests":2,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":128563,"score_linear":205434.0,"score_lmetric":520538},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":127488,"new_prefill":1075,"score_linear":-127488.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-127488.0,"chosen_score_lmetric":0,"t_first_token":384399.192151745,"t_first_token_unix":1779815264.2060955,"t_done":384415.635377444,"t_done_unix":1779815280.6493216},{"request_id":"1342921:6:1448548:876","session_id":"1342921","input_length":75761,"t_proxy_recv":384379.701716667,"t_decision_unix":1779815244.7156582,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9731656129142963,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":2033,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184070,"ongoing_decode_tokens":184070,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":0,"new_prefill":75761,"score_linear":184070.0,"score_lmetric":151522},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":82780,"ongoing_decode_tokens":82780,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":75761,"score_linear":82780.0,"score_lmetric":151522},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108791,"ongoing_decode_tokens":108791,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":75761,"score_linear":108791.0,"score_lmetric":75761},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":129673,"ongoing_decode_tokens":0,"pending_prefill_tokens":129673,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":73728,"new_prefill":2033,"score_linear":55945.0,"score_lmetric":131706},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":75761,"score_linear":127488.0,"score_lmetric":196593},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":55945.0,"chosen_score_lmetric":131706,"t_first_token":384415.215334123,"t_first_token_unix":1779815280.2292776,"t_done":384415.861366027,"t_done_unix":1779815280.8753095},{"request_id":"1313181:9:1333349:415","session_id":"1313181","input_length":129673,"t_proxy_recv":384360.735252236,"t_decision_unix":1779815225.7491937,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":4,"affinity_cache_hit":62464,"affinity_cache_ratio":0.481703978468918,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":129673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":180584,"ongoing_decode_tokens":180584,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2339,"cache_hit":62464,"new_prefill":67209,"score_linear":118120.0,"score_lmetric":134418},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":190229,"ongoing_decode_tokens":108020,"pending_prefill_tokens":19745,"num_requests":3,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":129673,"score_linear":190229.0,"score_lmetric":448254},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108166,"ongoing_decode_tokens":108166,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1590,"cache_hit":12800,"new_prefill":116873,"score_linear":95366.0,"score_lmetric":116873},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":120832,"num_requests":1,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":0,"new_prefill":129673,"score_linear":127488.0,"score_lmetric":250505},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":126198,"ongoing_decode_tokens":126198,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":61952,"new_prefill":67721,"score_linear":64246.0,"score_lmetric":67721}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384414.917746884,"t_first_token_unix":1779815279.9316902,"t_done":384417.102404816,"t_done_unix":1779815282.1163485},{"request_id":"1242838:5:1460026:886","session_id":"1242838","input_length":26406,"t_proxy_recv":384418.154927076,"t_decision_unix":1779815283.1688683,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9888661667802772,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":294,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":26112,"new_prefill":294,"score_linear":-26112.0,"score_lmetric":-294},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":3584,"new_prefill":22822,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":62513,"ongoing_decode_tokens":62513,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":26406,"score_linear":62513.0,"score_lmetric":26406},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26112.0,"chosen_score_lmetric":-294,"t_first_token":384421.928530375,"t_first_token_unix":1779815286.942474,"t_done":384424.946912376,"t_done_unix":1779815289.9609272},{"request_id":"1363093:6:1460799:888","session_id":"1363093","input_length":81299,"t_proxy_recv":384420.736896218,"t_decision_unix":1779815285.7508376,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9005768828644879,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":8083,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60798,"ongoing_decode_tokens":0,"pending_prefill_tokens":2942,"num_requests":1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":0,"new_prefill":81299,"score_linear":60798.0,"score_lmetric":84241},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":73216,"new_prefill":8083,"score_linear":-73216.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":62513,"ongoing_decode_tokens":62513,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":81299,"score_linear":62513.0,"score_lmetric":81299},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":384424.688723716,"t_first_token_unix":1779815289.7026672,"t_done":384425.288075855,"t_done_unix":1779815290.3020194},{"request_id":"1404395:3:1460072:887","session_id":"1404395","input_length":34392,"t_proxy_recv":384418.304825634,"t_decision_unix":1779815283.3187668,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9230053500814143,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":2648,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26406,"ongoing_decode_tokens":0,"pending_prefill_tokens":294,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":31744,"new_prefill":2648,"score_linear":-5338.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":62513,"ongoing_decode_tokens":62513,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":512,"new_prefill":33880,"score_linear":62001.0,"score_lmetric":33880},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":512,"new_prefill":33880,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5338.0,"chosen_score_lmetric":0,"t_first_token":384421.93092251,"t_first_token_unix":1779815286.9448655,"t_done":384425.392807511,"t_done_unix":1779815290.4067507},{"request_id":"1363943:15:1461716:889","session_id":"1363943","input_length":29651,"t_proxy_recv":384423.590824136,"t_decision_unix":1779815288.6047654,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29184,"affinity_cache_ratio":0.984250109608445,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60798,"ongoing_decode_tokens":60798,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":29184,"new_prefill":467,"score_linear":31614.0,"score_lmetric":467},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81299,"ongoing_decode_tokens":0,"pending_prefill_tokens":8083,"num_requests":1,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":4096,"new_prefill":25555,"score_linear":77203.0,"score_lmetric":33638},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":29651,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":62513,"ongoing_decode_tokens":62513,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":24576,"new_prefill":5075,"score_linear":37937.0,"score_lmetric":5075},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":31614.0,"chosen_score_lmetric":467,"t_first_token":384423.76671121,"t_first_token_unix":1779815288.7806547,"t_done":384425.743147238,"t_done_unix":1779815290.7570906},{"request_id":"1363943:16:1463626:890","session_id":"1363943","input_length":34671,"t_proxy_recv":384430.060944812,"t_decision_unix":1779815295.074886,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29696,"affinity_cache_ratio":0.8565083210752502,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":4975,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2423,"cache_hit":29696,"new_prefill":4975,"score_linear":-29696.0,"score_lmetric":-4975},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2590,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":34671,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":62513,"ongoing_decode_tokens":62513,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":24576,"new_prefill":10095,"score_linear":37937.0,"score_lmetric":10095},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-29696.0,"chosen_score_lmetric":-4975,"t_first_token":384431.21669798,"t_first_token_unix":1779815296.230642,"t_done":384432.671466838,"t_done_unix":1779815297.6854107},{"request_id":"1268861:12:1463977:891","session_id":"1268861","input_length":56147,"t_proxy_recv":384431.347424116,"t_decision_unix":1779815296.3613656,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9757244376369174,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":1363,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34671,"ongoing_decode_tokens":34671,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2423,"cache_hit":0,"new_prefill":56147,"score_linear":34671.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2590,"cache_hit":54784,"new_prefill":1363,"score_linear":-54784.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":62513,"ongoing_decode_tokens":62513,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":44032,"new_prefill":12115,"score_linear":18481.0,"score_lmetric":12115},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":384431.873880373,"t_first_token_unix":1779815296.887824,"t_done":384432.760909757,"t_done_unix":1779815297.7748537},{"request_id":"1313181:9:1386945:689","session_id":"1313181","input_length":62513,"t_proxy_recv":384417.112673695,"t_decision_unix":1779815282.1266153,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":62464,"affinity_cache_ratio":0.999216163038088,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":49,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":62464,"new_prefill":49,"score_linear":-62464.0,"score_lmetric":-49},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2575,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":49713,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":62464,"new_prefill":49,"score_linear":-62464.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":561,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-62464.0,"chosen_score_lmetric":0,"t_first_token":384417.198148196,"t_first_token_unix":1779815282.2120914,"t_done":384434.142576162,"t_done_unix":1779815299.156524},{"request_id":"1371622:6:1465333:892","session_id":"1371622","input_length":23079,"t_proxy_recv":384435.604624711,"t_decision_unix":1779815300.6185658,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9317561419472248,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":1575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":129839,"ongoing_decode_tokens":0,"pending_prefill_tokens":67375,"num_requests":0,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":23079,"score_linear":129839.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":21504,"new_prefill":1575,"score_linear":-21504.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":11264,"new_prefill":11815,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":384435.915365705,"t_first_token_unix":1779815300.9293091,"t_done":384436.429902748,"t_done_unix":1779815301.4438462},{"request_id":"1371622:7:1468305:895","session_id":"1371622","input_length":24036,"t_proxy_recv":384445.829110338,"t_decision_unix":1779815310.8430507,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9585621567648527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":200693,"ongoing_decode_tokens":0,"pending_prefill_tokens":69109,"num_requests":2,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":24036,"score_linear":200693.0,"score_lmetric":186290},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":23040,"new_prefill":996,"score_linear":-23040.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":11264,"new_prefill":12772,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":384446.045387327,"t_first_token_unix":1779815311.0593305,"t_done":384446.879460026,"t_done_unix":1779815311.8934035},{"request_id":"1405155:3:1469167:897","session_id":"1405155","input_length":66246,"t_proxy_recv":384448.725949588,"t_decision_unix":1779815313.7398906,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":40448,"affinity_cache_ratio":0.610572713824231,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":25798,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":200693,"ongoing_decode_tokens":0,"pending_prefill_tokens":69109,"num_requests":2,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":66246,"score_linear":200693.0,"score_lmetric":270710},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":512,"new_prefill":65734,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":40448,"new_prefill":25798,"score_linear":-40448.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":384457.661454926,"t_first_token_unix":1779815322.6754003,"t_done":384459.463238375,"t_done_unix":1779815324.4771826},{"request_id":"1399948:13:1472968:898","session_id":"1399948","input_length":12247,"t_proxy_recv":384461.178921523,"t_decision_unix":1779815326.1928625,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9615416020249857,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":200693,"ongoing_decode_tokens":0,"pending_prefill_tokens":69109,"num_requests":2,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":12247,"score_linear":200693.0,"score_lmetric":162712},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":11776,"new_prefill":471,"score_linear":-11776.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":384461.236411373,"t_first_token_unix":1779815326.250355,"t_done":384461.372842349,"t_done_unix":1779815326.3867857},{"request_id":"1342921:7:1473812:900","session_id":"1342921","input_length":76600,"t_proxy_recv":384464.141252862,"t_decision_unix":1779815329.155194,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9892428198433421,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":824,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":200693,"ongoing_decode_tokens":0,"pending_prefill_tokens":69109,"num_requests":2,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":76600,"score_linear":200693.0,"score_lmetric":291418},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24569,"ongoing_decode_tokens":24569,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":76600,"score_linear":24569.0,"score_lmetric":76600},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":75776,"new_prefill":824,"score_linear":-75776.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":384464.68113703,"t_first_token_unix":1779815329.695081,"t_done":384466.01126796,"t_done_unix":1779815331.0252168},{"request_id":"1371622:8:1473416:899","session_id":"1371622","input_length":24569,"t_proxy_recv":384462.847596826,"t_decision_unix":1779815327.8615375,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9794456428833083,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":200693,"ongoing_decode_tokens":0,"pending_prefill_tokens":69109,"num_requests":2,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":24569,"score_linear":200693.0,"score_lmetric":187356},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":24064,"new_prefill":505,"score_linear":-24064.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":11264,"new_prefill":13305,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":384463.005616269,"t_first_token_unix":1779815328.01956,"t_done":384466.115483213,"t_done_unix":1779815331.1294265},{"request_id":"1313181:10:1338837:436","session_id":"1313181","input_length":129839,"t_proxy_recv":384434.165105565,"t_decision_unix":1779815299.179047,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":0,"affinity_cache_hit":64512,"affinity_cache_ratio":0.4968614977009989,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":-67375,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":67375,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":62464,"new_prefill":67375,"score_linear":-62464.0,"score_lmetric":-67375},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":117039,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":64512,"new_prefill":65327,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":67887,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-62464.0,"chosen_score_lmetric":-67375,"t_first_token":384476.39818313,"t_first_token_unix":1779815341.4121268,"t_done":384478.421582659,"t_done_unix":1779815343.4355266},{"request_id":"1363943:17:1466811:893","session_id":"1363943","input_length":35991,"t_proxy_recv":384440.741092501,"t_decision_unix":1779815305.7550335,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9673529493484482,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":1175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":129839,"ongoing_decode_tokens":0,"pending_prefill_tokens":67375,"num_requests":0,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":34816,"new_prefill":1175,"score_linear":95023.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":35991,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":24576,"new_prefill":11415,"score_linear":-24576.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":95023.0,"chosen_score_lmetric":0,"t_first_token":384476.624276634,"t_first_token_unix":1779815341.63822,"t_done":384479.636719551,"t_done_unix":1779815344.650663},{"request_id":"1305906:4:1476757:902","session_id":"1305906","input_length":44949,"t_proxy_recv":384474.216992341,"t_decision_unix":1779815339.2309337,"policy":"unified","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":16896,"affinity_cache_ratio":0.375892678368818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":28053,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":200693,"ongoing_decode_tokens":0,"pending_prefill_tokens":69109,"num_requests":2,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":0,"new_prefill":44949,"score_linear":200693.0,"score_lmetric":228116},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":16896,"new_prefill":28053,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":384480.428982636,"t_first_token_unix":1779815345.4429264,"t_done":384481.737571057,"t_done_unix":1779815346.7515144},{"request_id":"1404395:4:1467473:894","session_id":"1404395","input_length":34863,"t_proxy_recv":384443.057521909,"t_decision_unix":1779815308.0714633,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9839658090238935,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":165830,"ongoing_decode_tokens":0,"pending_prefill_tokens":68550,"num_requests":1,"active_p_offloads":0,"cached_blocks":2433,"cache_hit":34304,"new_prefill":559,"score_linear":131526.0,"score_lmetric":69109},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1662,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":512,"new_prefill":34351,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":512,"new_prefill":34351,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":131526.0,"chosen_score_lmetric":69109,"t_first_token":384476.627486797,"t_first_token_unix":1779815341.6414304,"t_done":384483.014411882,"t_done_unix":1779815348.0283554},{"request_id":"1371622:9:1479535:905","session_id":"1371622","input_length":25286,"t_proxy_recv":384483.524448274,"t_decision_unix":1779815348.5383894,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9719212212291386,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":112027,"ongoing_decode_tokens":112027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2452,"cache_hit":0,"new_prefill":25286,"score_linear":112027.0,"score_lmetric":25286},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":24576,"new_prefill":710,"score_linear":14251.0,"score_lmetric":710},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":11264,"new_prefill":14022,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":14251.0,"chosen_score_lmetric":710,"t_first_token":384483.629938046,"t_first_token_unix":1779815348.6438816,"t_done":384484.429149975,"t_done_unix":1779815349.4430935},{"request_id":"1313181:10:1399867:746","session_id":"1313181","input_length":64724,"t_proxy_recv":384478.433250805,"t_decision_unix":1779815343.4471924,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9967245534886595,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":212,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":70854,"ongoing_decode_tokens":70854,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2449,"cache_hit":64512,"new_prefill":212,"score_linear":6342.0,"score_lmetric":212},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":51924,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":64512,"new_prefill":212,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44949,"ongoing_decode_tokens":0,"pending_prefill_tokens":28053,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":64724,"score_linear":44949.0,"score_lmetric":92777},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":2772,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":6342.0,"chosen_score_lmetric":212,"t_first_token":384478.526208377,"t_first_token_unix":1779815343.540152,"t_done":384486.73637539,"t_done_unix":1779815351.750319},{"request_id":"1268861:13:1481831:907","session_id":"1268861","input_length":57130,"t_proxy_recv":384491.357351155,"t_decision_unix":1779815356.3712924,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":55808,"affinity_cache_ratio":0.976859793453527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":1322,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":214222,"ongoing_decode_tokens":84291,"pending_prefill_tokens":64907,"num_requests":2,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":0,"new_prefill":57130,"score_linear":214222.0,"score_lmetric":244074},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":57130,"score_linear":38827.0,"score_lmetric":57130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":55808,"new_prefill":1322,"score_linear":-55808.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":44032,"new_prefill":13098,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":384491.78407742,"t_first_token_unix":1779815356.7980208,"t_done":384493.065486587,"t_done_unix":1779815358.0794327},{"request_id":"1301929:4:1479037:904","session_id":"1301929","input_length":38827,"t_proxy_recv":384481.780085097,"t_decision_unix":1779815346.7940266,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9890024982615191,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":427,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146890,"ongoing_decode_tokens":99587,"pending_prefill_tokens":11463,"num_requests":2,"active_p_offloads":0,"cached_blocks":2451,"cache_hit":3584,"new_prefill":35243,"score_linear":143306.0,"score_lmetric":93412},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":38400,"new_prefill":427,"score_linear":-38400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":384481.842799253,"t_first_token_unix":1779815346.8567421,"t_done":384493.533777739,"t_done_unix":1779815358.5477211},{"request_id":"1363943:18:1469143:896","session_id":"1363943","input_length":47303,"t_proxy_recv":384479.658482231,"t_decision_unix":1779815344.6724236,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":35840,"affinity_cache_ratio":0.7576686468088705,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":11463,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":99587,"ongoing_decode_tokens":99587,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2451,"cache_hit":35840,"new_prefill":11463,"score_linear":63747.0,"score_lmetric":11463},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":47303,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":22727,"score_linear":-24576.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44949,"ongoing_decode_tokens":0,"pending_prefill_tokens":28053,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":43207,"score_linear":40853.0,"score_lmetric":71260},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":63747.0,"chosen_score_lmetric":11463,"t_first_token":384482.906833073,"t_first_token_unix":1779815347.9207766,"t_done":384531.417552224,"t_done_unix":1779815396.4314964},{"request_id":"1313181:11:1344301:464","session_id":"1313181","input_length":129931,"t_proxy_recv":384486.757751576,"t_decision_unix":1779815351.771693,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.5004502389729933,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":64907,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":84291,"ongoing_decode_tokens":84291,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":65024,"new_prefill":64907,"score_linear":19267.0,"score_lmetric":64907},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":129931,"score_linear":38827.0,"score_lmetric":129931},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":117131,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":64512,"new_prefill":65419,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":67979,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":19267.0,"chosen_score_lmetric":64907,"t_first_token":384525.746447761,"t_first_token_unix":1779815390.7603927,"t_done":384531.440252981,"t_done_unix":1779815396.4541967},{"request_id":"1313181:11:1402841:762","session_id":"1313181","input_length":65123,"t_proxy_recv":384531.451938692,"t_decision_unix":1779815396.4658804,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9984797997635244,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":99,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122947,"ongoing_decode_tokens":66891,"pending_prefill_tokens":8440,"num_requests":2,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":65024,"new_prefill":99,"score_linear":57923.0,"score_lmetric":17078},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":52323,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":64512,"new_prefill":611,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":3171,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":57923.0,"chosen_score_lmetric":17078,"t_first_token":384534.431167385,"t_first_token_unix":1779815399.4451106,"t_done":384535.60566168,"t_done_unix":1779815400.6196058},{"request_id":"1242838:6:1486863:911","session_id":"1242838","input_length":29903,"t_proxy_recv":384508.363602495,"t_decision_unix":1779815373.3775437,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8903454502892686,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":3279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":214222,"ongoing_decode_tokens":84291,"pending_prefill_tokens":64907,"num_requests":2,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":26624,"new_prefill":3279,"score_linear":187598.0,"score_lmetric":136372},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":26319,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":187598.0,"chosen_score_lmetric":136372,"t_first_token":384529.513329541,"t_first_token_unix":1779815394.5272737,"t_done":384536.654419355,"t_done_unix":1779815401.668363},{"request_id":"1363943:19:1473899:901","session_id":"1363943","input_length":56056,"t_proxy_recv":384531.431285318,"t_decision_unix":1779815396.4452264,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":47616,"affinity_cache_ratio":0.8494362780077066,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47616,"estimated_new_tokens":8440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":196822,"ongoing_decode_tokens":196822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2476,"cache_hit":47616,"new_prefill":8440,"score_linear":149206.0,"score_lmetric":16880},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":56056,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":31480,"score_linear":-24576.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":149206.0,"chosen_score_lmetric":16880,"t_first_token":384534.425285054,"t_first_token_unix":1779815399.43923,"t_done":384537.812994879,"t_done_unix":1779815402.8269384},{"request_id":"1404395:5:1480170:906","session_id":"1404395","input_length":36988,"t_proxy_recv":384485.764803953,"t_decision_unix":1779815350.7787454,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9412782524061858,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":2172,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":112027,"ongoing_decode_tokens":112027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2452,"cache_hit":34816,"new_prefill":2172,"score_linear":77211.0,"score_lmetric":2172},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":36988,"score_linear":38827.0,"score_lmetric":36988},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2592,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":512,"new_prefill":36476,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":512,"new_prefill":36476,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":77211.0,"chosen_score_lmetric":2172,"t_first_token":384486.349240871,"t_first_token_unix":1779815351.3631845,"t_done":384539.723830198,"t_done_unix":1779815404.7377741},{"request_id":"1404395:6:1483967:909","session_id":"1404395","input_length":37689,"t_proxy_recv":384539.732439137,"t_decision_unix":1779815404.7463806,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9781103239672053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":825,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60761,"ongoing_decode_tokens":60761,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2503,"cache_hit":36864,"new_prefill":825,"score_linear":23897.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":512,"new_prefill":37177,"score_linear":129967.0,"score_lmetric":103144},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":512,"new_prefill":37177,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":23897.0,"chosen_score_lmetric":0,"t_first_token":384539.939102255,"t_first_token_unix":1779815404.9530458,"t_done":384543.998235651,"t_done_unix":1779815409.0121791},{"request_id":"1363943:20:1476805:903","session_id":"1363943","input_length":60761,"t_proxy_recv":384537.825993086,"t_decision_unix":1779815402.8399339,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9184838959200803,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":4953,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36988,"ongoing_decode_tokens":36988,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2499,"cache_hit":55808,"new_prefill":4953,"score_linear":-18820.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":60761,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":36185,"score_linear":105903.0,"score_lmetric":102152},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-18820.0,"chosen_score_lmetric":0,"t_first_token":384539.611906334,"t_first_token_unix":1779815404.625851,"t_done":384544.937432697,"t_done_unix":1779815409.9513762},{"request_id":"1404395:7:1491186:914","session_id":"1404395","input_length":39569,"t_proxy_recv":384544.007550059,"t_decision_unix":1779815409.0214915,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9575172483509818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1681,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60761,"ongoing_decode_tokens":60761,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2505,"cache_hit":37888,"new_prefill":1681,"score_linear":22873.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":39569,"score_linear":75760.0,"score_lmetric":43649},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":512,"new_prefill":39057,"score_linear":129967.0,"score_lmetric":105024},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":512,"new_prefill":39057,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":22873.0,"chosen_score_lmetric":0,"t_first_token":384544.538930381,"t_first_token_unix":1779815409.552875,"t_done":384545.028038727,"t_done_unix":1779815410.0419822},{"request_id":"1268861:14:1498281:920","session_id":"1268861","input_length":61910,"t_proxy_recv":384546.748982627,"t_decision_unix":1779815411.7629237,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9179777095784203,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":5078,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105478,"ongoing_decode_tokens":0,"pending_prefill_tokens":5126,"num_requests":1,"active_p_offloads":0,"cached_blocks":2518,"cache_hit":0,"new_prefill":61910,"score_linear":105478.0,"score_lmetric":67036},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":61910,"score_linear":75760.0,"score_lmetric":65990},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":56832,"new_prefill":5078,"score_linear":-56832.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":44032,"new_prefill":17878,"score_linear":86447.0,"score_lmetric":83845},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56832.0,"chosen_score_lmetric":0,"t_first_token":384548.58234908,"t_first_token_unix":1779815413.596293,"t_done":384549.150682373,"t_done_unix":1779815414.164626},{"request_id":"1363943:21:1482184:908","session_id":"1363943","input_length":65658,"t_proxy_recv":384544.951501669,"t_decision_unix":1779815409.965443,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9279600353346127,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":4730,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":39569,"ongoing_decode_tokens":39569,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":60928,"new_prefill":4730,"score_linear":-21359.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":61562,"score_linear":71664.0,"score_lmetric":65642},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":65658,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":41082,"score_linear":105903.0,"score_lmetric":107049},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-21359.0,"chosen_score_lmetric":0,"t_first_token":384546.872093561,"t_first_token_unix":1779815411.8860366,"t_done":384552.261276295,"t_done_unix":1779815417.27522},{"request_id":"1404395:8:1494219:916","session_id":"1404395","input_length":39820,"t_proxy_recv":384545.035693998,"t_decision_unix":1779815410.0496356,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":39424,"affinity_cache_ratio":0.9900552486187846,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39424,"estimated_new_tokens":396,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65658,"ongoing_decode_tokens":0,"pending_prefill_tokens":4730,"num_requests":0,"active_p_offloads":0,"cached_blocks":2518,"cache_hit":39424,"new_prefill":396,"score_linear":26234.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":39820,"score_linear":75760.0,"score_lmetric":43900},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":512,"new_prefill":39308,"score_linear":129967.0,"score_lmetric":105275},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":512,"new_prefill":39308,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":26234.0,"chosen_score_lmetric":0,"t_first_token":384546.967512995,"t_first_token_unix":1779815411.9814563,"t_done":384556.065775285,"t_done_unix":1779815421.079721},{"request_id":"1242838:7:1499476:921","session_id":"1242838","input_length":33352,"t_proxy_recv":384550.579983971,"t_decision_unix":1779815415.5939248,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29696,"affinity_cache_ratio":0.8903813864236028,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":3656,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105478,"ongoing_decode_tokens":105478,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2518,"cache_hit":29696,"new_prefill":3656,"score_linear":75782.0,"score_lmetric":3656},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":29768,"score_linear":72176.0,"score_lmetric":33848},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":33352,"score_linear":130479.0,"score_lmetric":99319},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":75782.0,"chosen_score_lmetric":3656,"t_first_token":384551.391096065,"t_first_token_unix":1779815416.4050395,"t_done":384557.402829413,"t_done_unix":1779815422.4167728},{"request_id":"1363943:22:1485341:910","session_id":"1363943","input_length":70238,"t_proxy_recv":384552.275488,"t_decision_unix":1779815417.2894292,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65536,"affinity_cache_ratio":0.9330561804151599,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":4702,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":73172,"ongoing_decode_tokens":73172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2527,"cache_hit":65536,"new_prefill":4702,"score_linear":7636.0,"score_lmetric":4702},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":66142,"score_linear":71664.0,"score_lmetric":70222},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":70238,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":45662,"score_linear":105903.0,"score_lmetric":111629},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":7636.0,"chosen_score_lmetric":4702,"t_first_token":384554.193883618,"t_first_token_unix":1779815419.207828,"t_done":384558.742151996,"t_done_unix":1779815423.7560956},{"request_id":"1363943:23:1488713:912","session_id":"1363943","input_length":72516,"t_proxy_recv":384558.75572875,"t_decision_unix":1779815423.7696705,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9672899773843014,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":2372,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2544,"cache_hit":70144,"new_prefill":2372,"score_linear":-70144.0,"score_lmetric":-2372},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":68420,"score_linear":71664.0,"score_lmetric":72500},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":72516,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":47940,"score_linear":105903.0,"score_lmetric":113907},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":-2372,"t_first_token":384559.797147324,"t_first_token_unix":1779815424.811091,"t_done":384561.765529233,"t_done_unix":1779815426.779473},{"request_id":"1363943:24:1491020:913","session_id":"1363943","input_length":74939,"t_proxy_recv":384561.779184782,"t_decision_unix":1779815426.7931263,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9701757429375892,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":2235,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2549,"cache_hit":72704,"new_prefill":2235,"score_linear":-72704.0,"score_lmetric":-2235},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":70843,"score_linear":175557.0,"score_lmetric":163104},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":74939,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":50363,"score_linear":105903.0,"score_lmetric":116330},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":-2235,"t_first_token":384562.989190793,"t_first_token_unix":1779815428.0031347,"t_done":384564.57529788,"t_done_unix":1779815429.5892413},{"request_id":"1363943:25:1493325:915","session_id":"1363943","input_length":75711,"t_proxy_recv":384564.58909572,"t_decision_unix":1779815429.6030374,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9873334125820554,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":959,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2553,"cache_hit":74752,"new_prefill":959,"score_linear":-74752.0,"score_lmetric":-959},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":71615,"score_linear":175557.0,"score_lmetric":164648},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":75711,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":209201,"ongoing_decode_tokens":0,"pending_prefill_tokens":68401,"num_requests":2,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":51135,"score_linear":184625.0,"score_lmetric":239072},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":-959,"t_first_token":384565.005921482,"t_first_token_unix":1779815430.0198655,"t_done":384567.158275617,"t_done_unix":1779815432.1722193},{"request_id":"1363943:26:1495648:917","session_id":"1363943","input_length":83861,"t_proxy_recv":384567.175715146,"t_decision_unix":1779815432.1896565,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":75776,"affinity_cache_ratio":0.903590465174515,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":8085,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2555,"cache_hit":75776,"new_prefill":8085,"score_linear":-75776.0,"score_lmetric":-8085},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":79765,"score_linear":175557.0,"score_lmetric":180948},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":83861,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":209201,"ongoing_decode_tokens":0,"pending_prefill_tokens":68401,"num_requests":2,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":59285,"score_linear":184625.0,"score_lmetric":255372},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":-8085,"t_first_token":384571.181951116,"t_first_token_unix":1779815436.195895,"t_done":384573.010168666,"t_done_unix":1779815438.0241125},{"request_id":"1363943:27:1497882:919","session_id":"1363943","input_length":84090,"t_proxy_recv":384573.024517721,"t_decision_unix":1779815438.038459,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":83968,"affinity_cache_ratio":0.9985491735045784,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83968,"estimated_new_tokens":122,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":83968,"new_prefill":122,"score_linear":-83968.0,"score_lmetric":-122},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":79994,"score_linear":175557.0,"score_lmetric":181406},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":84090,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":223390,"ongoing_decode_tokens":0,"pending_prefill_tokens":70814,"num_requests":3,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":59514,"score_linear":198814.0,"score_lmetric":390984},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-83968.0,"chosen_score_lmetric":-122,"t_first_token":384573.156893545,"t_first_token_unix":1779815438.170837,"t_done":384576.702430723,"t_done_unix":1779815441.7163746},{"request_id":"1342921:8:1503584:925","session_id":"1342921","input_length":78722,"t_proxy_recv":384564.443247801,"t_decision_unix":1779815429.4571888,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":76288,"affinity_cache_ratio":0.9690810700947639,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76288,"estimated_new_tokens":2434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":74939,"ongoing_decode_tokens":74939,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2549,"cache_hit":0,"new_prefill":78722,"score_linear":74939.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":78722,"score_linear":179653.0,"score_lmetric":178862},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":76288,"new_prefill":2434,"score_linear":54191.0,"score_lmetric":68401},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":54191.0,"chosen_score_lmetric":68401,"t_first_token":384576.36858925,"t_first_token_unix":1779815441.3825324,"t_done":384576.731539784,"t_done_unix":1779815441.745483},{"request_id":"1399948:14:1504493:926","session_id":"1399948","input_length":14189,"t_proxy_recv":384567.21928324,"t_decision_unix":1779815432.2332246,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":11776,"affinity_cache_ratio":0.829938684896751,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":2413,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83861,"ongoing_decode_tokens":0,"pending_prefill_tokens":8085,"num_requests":0,"active_p_offloads":0,"cached_blocks":2555,"cache_hit":0,"new_prefill":14189,"score_linear":83861.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":14189,"score_linear":179653.0,"score_lmetric":49796},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":209201,"ongoing_decode_tokens":0,"pending_prefill_tokens":68401,"num_requests":2,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":11776,"new_prefill":2413,"score_linear":197425.0,"score_lmetric":141628},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":197425.0,"chosen_score_lmetric":141628,"t_first_token":384576.369698829,"t_first_token_unix":1779815441.3836422,"t_done":384577.10827911,"t_done_unix":1779815442.1222227},{"request_id":"1313181:12:1346194:470","session_id":"1313181","input_length":130479,"t_proxy_recv":384535.628499289,"t_decision_unix":1779815400.6424327,"policy":"unified","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":4,"affinity_cache_hit":65024,"affinity_cache_ratio":0.49834839322802904,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":65967,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122947,"ongoing_decode_tokens":122947,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":65024,"new_prefill":65455,"score_linear":57923.0,"score_lmetric":130910},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":117679,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":64512,"new_prefill":65967,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":68527,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-64512.0,"chosen_score_lmetric":0,"t_first_token":384576.364965676,"t_first_token_unix":1779815441.3789096,"t_done":384577.45348657,"t_done_unix":1779815442.4674306},{"request_id":"1313181:12:1404813:772","session_id":"1313181","input_length":65179,"t_proxy_recv":384577.463214754,"t_decision_unix":1779815442.4771564,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9976219334448212,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":155,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":86984,"ongoing_decode_tokens":0,"pending_prefill_tokens":3016,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":65024,"new_prefill":155,"score_linear":21960.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":65179,"score_linear":179653.0,"score_lmetric":151776},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":52379,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":65024,"new_prefill":155,"score_linear":-65024.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":3227,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":384577.55773987,"t_first_token_unix":1779815442.5716834,"t_done":384578.09981943,"t_done_unix":1779815443.113763},{"request_id":"1363943:28:1500984:922","session_id":"1363943","input_length":86984,"t_proxy_recv":384576.717931488,"t_decision_unix":1779815441.731873,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":83968,"affinity_cache_ratio":0.9653269566816886,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83968,"estimated_new_tokens":3016,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":83968,"new_prefill":3016,"score_linear":-83968.0,"score_lmetric":-3016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":82888,"score_linear":175557.0,"score_lmetric":187194},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":86984,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":223390,"ongoing_decode_tokens":223390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":24576,"new_prefill":62408,"score_linear":198814.0,"score_lmetric":187224},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-83968.0,"chosen_score_lmetric":-3016,"t_first_token":384578.263511183,"t_first_token_unix":1779815443.2774549,"t_done":384580.424756155,"t_done_unix":1779815445.4387002},{"request_id":"1363943:29:1503515:924","session_id":"1363943","input_length":89469,"t_proxy_recv":384580.440424655,"t_decision_unix":1779815445.454366,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":87040,"affinity_cache_ratio":0.972850931607596,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":87040,"estimated_new_tokens":2429,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2577,"cache_hit":87040,"new_prefill":2429,"score_linear":-87040.0,"score_lmetric":-2429},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":85373,"score_linear":175557.0,"score_lmetric":192164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":89469,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":0,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":24576,"new_prefill":64893,"score_linear":107123.0,"score_lmetric":131568},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-87040.0,"chosen_score_lmetric":-2429,"t_first_token":384581.865130586,"t_first_token_unix":1779815446.879074,"t_done":384583.888864408,"t_done_unix":1779815448.9028168},{"request_id":"1268861:15:1508874:928","session_id":"1268861","input_length":63035,"t_proxy_recv":384582.07356459,"t_decision_unix":1779815447.0875056,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9828190687713175,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":1083,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89469,"ongoing_decode_tokens":89469,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2577,"cache_hit":0,"new_prefill":63035,"score_linear":89469.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":63035,"score_linear":179653.0,"score_lmetric":147488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":61952,"new_prefill":1083,"score_linear":-61952.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":0,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":44032,"new_prefill":19003,"score_linear":87667.0,"score_lmetric":85678},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-61952.0,"chosen_score_lmetric":0,"t_first_token":384582.64957946,"t_first_token_unix":1779815447.6635227,"t_done":384584.075788496,"t_done_unix":1779815449.089732},{"request_id":"1363943:30:1506171:927","session_id":"1363943","input_length":89713,"t_proxy_recv":384583.908701363,"t_decision_unix":1779815448.922643,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9987404278086788,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":89600,"new_prefill":113,"score_linear":-89600.0,"score_lmetric":-113},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":85617,"score_linear":175557.0,"score_lmetric":192652},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":63035,"ongoing_decode_tokens":63035,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":4096,"new_prefill":85617,"score_linear":58939.0,"score_lmetric":85617},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":89713,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":0,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":24576,"new_prefill":65137,"score_linear":107123.0,"score_lmetric":131812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-89600.0,"chosen_score_lmetric":-113,"t_first_token":384584.048848309,"t_first_token_unix":1779815449.0627916,"t_done":384584.704263448,"t_done_unix":1779815449.7182076},{"request_id":"1277428:9:1513231:932","session_id":"1277428","input_length":44364,"t_proxy_recv":384596.551800678,"t_decision_unix":1779815461.565742,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":42496,"affinity_cache_ratio":0.9578937877558381,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":1868,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":0,"new_prefill":44364,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":179653,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4608,"new_prefill":39756,"score_linear":175045.0,"score_lmetric":79512},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":42496,"new_prefill":1868,"score_linear":-42496.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147368,"ongoing_decode_tokens":0,"pending_prefill_tokens":68520,"num_requests":2,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":0,"new_prefill":44364,"score_linear":147368.0,"score_lmetric":225768},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":17408,"new_prefill":26956,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130532,"ongoing_decode_tokens":130532,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":44364,"score_linear":130532.0,"score_lmetric":44364},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-42496.0,"chosen_score_lmetric":0,"t_first_token":384597.067044856,"t_first_token_unix":1779815462.080989,"t_done":384597.364881786,"t_done_unix":1779815462.3788257},{"request_id":"1388507:2:1496686:918","session_id":"1388507","input_length":75760,"t_proxy_recv":384541.371715962,"t_decision_unix":1779815406.3856573,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9461457233368532,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":4080,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":98450,"ongoing_decode_tokens":98450,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2503,"cache_hit":0,"new_prefill":75760,"score_linear":98450.0,"score_lmetric":75760},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":71680,"new_prefill":4080,"score_linear":-71680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":75760,"score_linear":130479.0,"score_lmetric":141727},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":384561.067413819,"t_first_token_unix":1779815426.081357,"t_done":384598.737640934,"t_done_unix":1779815463.7515848},{"request_id":"1356885:4:1512902:931","session_id":"1356885","input_length":130532,"t_proxy_recv":384595.431215628,"t_decision_unix":1779815460.4451568,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":129536,"affinity_cache_ratio":0.9923696871265284,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":129536,"estimated_new_tokens":996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":122368,"new_prefill":8164,"score_linear":-32578.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":130532,"score_linear":179653.0,"score_lmetric":282482},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147368,"ongoing_decode_tokens":0,"pending_prefill_tokens":68520,"num_requests":2,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":0,"new_prefill":130532,"score_linear":147368.0,"score_lmetric":398104},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":129536,"new_prefill":996,"score_linear":-129536.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-129536.0,"chosen_score_lmetric":0,"t_first_token":384596.087797605,"t_first_token_unix":1779815461.1017416,"t_done":384599.500649928,"t_done_unix":1779815464.5145965},{"request_id":"1397515:2:1502033:923","session_id":"1397515","input_length":103893,"t_proxy_recv":384559.143266147,"t_decision_unix":1779815424.1572075,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.8969227955685176,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":10709,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72516,"ongoing_decode_tokens":0,"pending_prefill_tokens":2372,"num_requests":0,"active_p_offloads":0,"cached_blocks":2544,"cache_hit":0,"new_prefill":103893,"score_linear":72516.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":93184,"new_prefill":10709,"score_linear":-17424.0,"score_lmetric":14789},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":65967,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":512,"new_prefill":103381,"score_linear":129967.0,"score_lmetric":169348},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17424.0,"chosen_score_lmetric":14789,"t_first_token":384596.252066154,"t_first_token_unix":1779815461.2660098,"t_done":384600.714358989,"t_done_unix":1779815465.7283032},{"request_id":"1277428:10:1517408:935","session_id":"1277428","input_length":45851,"t_proxy_recv":384610.346165913,"t_decision_unix":1779815475.3601072,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9603280190181239,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1819,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":0,"new_prefill":45851,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":4608,"new_prefill":41243,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1597,"cache_hit":44032,"new_prefill":1819,"score_linear":-44032.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147368,"ongoing_decode_tokens":0,"pending_prefill_tokens":68520,"num_requests":2,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":0,"new_prefill":45851,"score_linear":147368.0,"score_lmetric":228742},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":17408,"new_prefill":28443,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":384610.874343205,"t_first_token_unix":1779815475.888287,"t_done":384612.949046878,"t_done_unix":1779815477.9629946},{"request_id":"1399948:15:1512300:930","session_id":"1399948","input_length":15669,"t_proxy_recv":384593.535193323,"t_decision_unix":1779815458.5491345,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8822515795519816,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":0,"new_prefill":15669,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":15669,"score_linear":179653.0,"score_lmetric":52756},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":0,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":13824,"new_prefill":1845,"score_linear":117875.0,"score_lmetric":68520},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":117875.0,"chosen_score_lmetric":68520,"t_first_token":384618.660354373,"t_first_token_unix":1779815483.6742973,"t_done":384619.207530402,"t_done_unix":1779815484.2214735},{"request_id":"1363943:31:1509815:929","session_id":"1363943","input_length":89790,"t_proxy_recv":384585.105227709,"t_decision_unix":1779815450.1191692,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9978839514422542,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":89600,"new_prefill":190,"score_linear":-89600.0,"score_lmetric":-190},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4096,"new_prefill":85694,"score_linear":175557.0,"score_lmetric":192806},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":89790,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":0,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":24576,"new_prefill":65214,"score_linear":107123.0,"score_lmetric":131889},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-89600.0,"chosen_score_lmetric":-190,"t_first_token":384585.229685311,"t_first_token_unix":1779815450.2436287,"t_done":384620.357942507,"t_done_unix":1779815485.371886},{"request_id":"1399948:16:1513839:933","session_id":"1399948","input_length":15913,"t_proxy_recv":384619.213105118,"t_decision_unix":1779815484.2270467,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":15360,"affinity_cache_ratio":0.9652485389304343,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":0,"new_prefill":15913,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":131699,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2333,"cache_hit":15360,"new_prefill":553,"score_linear":116339.0,"score_lmetric":553},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":116339.0,"chosen_score_lmetric":553,"t_first_token":384619.331453996,"t_first_token_unix":1779815484.3453977,"t_done":384620.366455838,"t_done_unix":1779815485.380399},{"request_id":"1313181:13:1349104:484","session_id":"1313181","input_length":131699,"t_proxy_recv":384578.120470746,"t_decision_unix":1779815443.1344123,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":65024,"affinity_cache_ratio":0.49373191899710706,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":65024,"estimated_new_tokens":66675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":86984,"ongoing_decode_tokens":0,"pending_prefill_tokens":3016,"num_requests":0,"active_p_offloads":0,"cached_blocks":2571,"cache_hit":65024,"new_prefill":66675,"score_linear":21960.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":131699,"score_linear":179653.0,"score_lmetric":284816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":12800,"new_prefill":118899,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2330,"cache_hit":65024,"new_prefill":66675,"score_linear":-65024.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2711,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":69747,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":384618.659269264,"t_first_token_unix":1779815483.6732128,"t_done":384620.878518958,"t_done_unix":1779815485.8924627},{"request_id":"1277428:11:1520449:937","session_id":"1277428","input_length":46361,"t_proxy_recv":384620.335633243,"t_decision_unix":1779815485.3495743,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":46080,"affinity_cache_ratio":0.9939388710338432,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2582,"cache_hit":0,"new_prefill":46361,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":4608,"new_prefill":41753,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":46080,"new_prefill":281,"score_linear":-46080.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147612,"ongoing_decode_tokens":147612,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2333,"cache_hit":0,"new_prefill":46361,"score_linear":147612.0,"score_lmetric":92722},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":17408,"new_prefill":28953,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":384620.502431036,"t_first_token_unix":1779815485.5163748,"t_done":384620.897273197,"t_done_unix":1779815485.9112165},{"request_id":"1399948:17:1518102:936","session_id":"1399948","input_length":16604,"t_proxy_recv":384620.372712542,"t_decision_unix":1779815485.3866541,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":15872,"affinity_cache_ratio":0.9559142375331245,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":732,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":-16604},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":46361,"ongoing_decode_tokens":0,"pending_prefill_tokens":281,"num_requests":1,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":16604,"score_linear":46361.0,"score_lmetric":16885},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131699,"ongoing_decode_tokens":131699,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":15872,"new_prefill":732,"score_linear":115827.0,"score_lmetric":732},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":115827.0,"chosen_score_lmetric":732,"t_first_token":384620.695425715,"t_first_token_unix":1779815485.7093694,"t_done":384621.348060441,"t_done_unix":1779815486.3620038},{"request_id":"1313181:13:1406095:783","session_id":"1313181","input_length":65279,"t_proxy_recv":384620.889066542,"t_decision_unix":1779815485.903008,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9960936901606948,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":65024,"new_prefill":255,"score_linear":-65024.0,"score_lmetric":-255},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":46361,"ongoing_decode_tokens":46361,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":12800,"new_prefill":52479,"score_linear":33561.0,"score_lmetric":52479},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16604,"ongoing_decode_tokens":16604,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2338,"cache_hit":65024,"new_prefill":255,"score_linear":-48420.0,"score_lmetric":255},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":3327,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-48420.0,"chosen_score_lmetric":255,"t_first_token":384620.98638173,"t_first_token_unix":1779815486.0003254,"t_done":384623.214108734,"t_done_unix":1779815488.2280529},{"request_id":"1243831:2:1528168:943","session_id":"1243831","input_length":36568,"t_proxy_recv":384646.514903428,"t_decision_unix":1779815511.5288448,"policy":"unified","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.30802887770728504,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":36568,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":25304,"score_linear":76312.0,"score_lmetric":36080},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":36568,"score_linear":235719.0,"score_lmetric":137949},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":384652.021148436,"t_first_token_unix":1779815517.035092,"t_done":384656.257245633,"t_done_unix":1779815521.271189},{"request_id":"1268861:16:1529894:946","session_id":"1268861","input_length":71192,"t_proxy_recv":384652.2612691,"t_decision_unix":1779815517.2752101,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":62976,"affinity_cache_ratio":0.8845937745814136,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":8216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36568,"ongoing_decode_tokens":36568,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":0,"new_prefill":71192,"score_linear":36568.0,"score_lmetric":71192},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":71192,"score_linear":87576.0,"score_lmetric":81968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":62976,"new_prefill":8216,"score_linear":-62976.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":44032,"new_prefill":27160,"score_linear":191687.0,"score_lmetric":109725},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":384655.724332379,"t_first_token_unix":1779815520.738276,"t_done":384656.848685705,"t_done_unix":1779815521.8626301},{"request_id":"1243831:3:1270336:110","session_id":"1243831","input_length":11584,"t_proxy_recv":384656.260688136,"t_decision_unix":1779815521.2746296,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9723756906077348,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2655,"cache_hit":11264,"new_prefill":320,"score_linear":-11264.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":320,"score_linear":76312.0,"score_lmetric":11096},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":71192,"ongoing_decode_tokens":71192,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":11584,"score_linear":71192.0,"score_lmetric":11584},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":11584,"score_linear":235719.0,"score_lmetric":62997},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":384656.291949891,"t_first_token_unix":1779815521.3058934,"t_done":384657.123184504,"t_done_unix":1779815522.1371286},{"request_id":"1243831:4:1284306:183","session_id":"1243831","input_length":14515,"t_proxy_recv":384657.129967568,"t_decision_unix":1779815522.1439092,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.7760248019290389,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":3251,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2655,"cache_hit":11264,"new_prefill":3251,"score_linear":-11264.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":3251,"score_linear":76312.0,"score_lmetric":14027},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":14515,"score_linear":235719.0,"score_lmetric":71790},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":384657.500860868,"t_first_token_unix":1779815522.5148048,"t_done":384657.926158775,"t_done_unix":1779815522.9401042},{"request_id":"1243831:5:1303288:273","session_id":"1243831","input_length":14627,"t_proxy_recv":384657.930185225,"t_decision_unix":1779815522.9441266,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":14336,"affinity_cache_ratio":0.980105284747385,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":14336,"new_prefill":291,"score_linear":-14336.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":3363,"score_linear":76312.0,"score_lmetric":14139},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":14627,"score_linear":235719.0,"score_lmetric":72126},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":384657.976011902,"t_first_token_unix":1779815522.9899547,"t_done":384658.424461229,"t_done_unix":1779815523.4384046},{"request_id":"1243831:6:1313694:320","session_id":"1243831","input_length":17410,"t_proxy_recv":384658.4302598,"t_decision_unix":1779815523.4442012,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":14336,"affinity_cache_ratio":0.8234348075818495,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":3074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":14336,"new_prefill":3074,"score_linear":-14336.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":6146,"score_linear":76312.0,"score_lmetric":16922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":17410,"score_linear":235719.0,"score_lmetric":80475},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":384658.84564859,"t_first_token_unix":1779815523.8595922,"t_done":384659.297036116,"t_done_unix":1779815524.3109794},{"request_id":"1243831:7:1323865:366","session_id":"1243831","input_length":19460,"t_proxy_recv":384659.302757457,"t_decision_unix":1779815524.316699,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":17408,"affinity_cache_ratio":0.8945529290853032,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":2052,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":17408,"new_prefill":2052,"score_linear":-17408.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":8196,"score_linear":76312.0,"score_lmetric":18972},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":19460,"score_linear":235719.0,"score_lmetric":86625},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":384659.656480751,"t_first_token_unix":1779815524.670424,"t_done":384660.25435812,"t_done_unix":1779815525.2683015},{"request_id":"1243831:8:1333049:414","session_id":"1243831","input_length":24512,"t_proxy_recv":384660.261431351,"t_decision_unix":1779815525.275373,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":19456,"affinity_cache_ratio":0.793733681462141,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":5056,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2671,"cache_hit":19456,"new_prefill":5056,"score_linear":-19456.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":13248,"score_linear":76312.0,"score_lmetric":24024},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":24512,"score_linear":235719.0,"score_lmetric":101781},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":384661.133533847,"t_first_token_unix":1779815526.147478,"t_done":384661.8045375,"t_done_unix":1779815526.8184812},{"request_id":"1243831:9:1348240:478","session_id":"1243831","input_length":25075,"t_proxy_recv":384661.810196726,"t_decision_unix":1779815526.8241382,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24576,"affinity_cache_ratio":0.980099700897308,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":499,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2681,"cache_hit":24576,"new_prefill":499,"score_linear":-24576.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":13811,"score_linear":76312.0,"score_lmetric":24587},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":25075,"score_linear":235719.0,"score_lmetric":103470},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":384661.970559678,"t_first_token_unix":1779815526.984503,"t_done":384662.375102482,"t_done_unix":1779815527.3890455},{"request_id":"1243831:10:1358921:521","session_id":"1243831","input_length":26343,"t_proxy_recv":384662.380953428,"t_decision_unix":1779815527.3948948,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9523592605246175,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2682,"cache_hit":25088,"new_prefill":1255,"score_linear":-25088.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":15079,"score_linear":76312.0,"score_lmetric":25855},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":26343,"score_linear":235719.0,"score_lmetric":107274},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":0,"t_first_token":384662.666202825,"t_first_token_unix":1779815527.6801465,"t_done":384663.357705386,"t_done_unix":1779815528.3716488},{"request_id":"1243831:11:1371191:594","session_id":"1243831","input_length":26818,"t_proxy_recv":384663.363549492,"t_decision_unix":1779815528.3774912,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9736743977925274,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2684,"cache_hit":26112,"new_prefill":706,"score_linear":-26112.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":15554,"score_linear":76312.0,"score_lmetric":26330},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":26818,"score_linear":235719.0,"score_lmetric":108699},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26112.0,"chosen_score_lmetric":0,"t_first_token":384663.527350205,"t_first_token_unix":1779815528.5412939,"t_done":384663.981336401,"t_done_unix":1779815528.9952796},{"request_id":"1243831:12:1385174:681","session_id":"1243831","input_length":27164,"t_proxy_recv":384663.98820339,"t_decision_unix":1779815529.0021448,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9801207480488883,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2685,"cache_hit":26624,"new_prefill":540,"score_linear":-26624.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":15900,"score_linear":76312.0,"score_lmetric":26676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":27164,"score_linear":235719.0,"score_lmetric":109737},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":384664.101666572,"t_first_token_unix":1779815529.11561,"t_done":384664.505997785,"t_done_unix":1779815529.519941},{"request_id":"1243831:13:1398072:738","session_id":"1243831","input_length":27286,"t_proxy_recv":384664.511731866,"t_decision_unix":1779815529.5256732,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9945026753646559,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":150,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2686,"cache_hit":27136,"new_prefill":150,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":16022,"score_linear":76312.0,"score_lmetric":26798},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":27286,"score_linear":235719.0,"score_lmetric":110103},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":384664.587316505,"t_first_token_unix":1779815529.6012602,"t_done":384665.115484769,"t_done_unix":1779815530.1294281},{"request_id":"1243831:14:1411189:814","session_id":"1243831","input_length":28085,"t_proxy_recv":384665.121468321,"t_decision_unix":1779815530.1354098,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9662097204913654,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2686,"cache_hit":27136,"new_prefill":949,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":16821,"score_linear":76312.0,"score_lmetric":27597},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":28085,"score_linear":235719.0,"score_lmetric":112500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130906,"ongoing_decode_tokens":0,"pending_prefill_tokens":346,"num_requests":1,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":28085,"score_linear":130906.0,"score_lmetric":28431},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":384665.355883382,"t_first_token_unix":1779815530.3698268,"t_done":384665.884247447,"t_done_unix":1779815530.8981907},{"request_id":"1243831:15:1427593:849","session_id":"1243831","input_length":29382,"t_proxy_recv":384665.890575212,"t_decision_unix":1779815530.9045167,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9584099108297597,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":1222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2688,"cache_hit":28160,"new_prefill":1222,"score_linear":-28160.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":0,"pending_prefill_tokens":18763,"num_requests":2,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":18118,"score_linear":148299.0,"score_lmetric":73762},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":29382,"score_linear":235719.0,"score_lmetric":116391},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130906,"ongoing_decode_tokens":130906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":29382,"score_linear":130906.0,"score_lmetric":29382},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":384666.2013716,"t_first_token_unix":1779815531.215315,"t_done":384667.051274487,"t_done_unix":1779815532.0652177},{"request_id":"1356885:5:1533696:948","session_id":"1356885","input_length":130906,"t_proxy_recv":384664.914945861,"t_decision_unix":1779815529.9288871,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":130560,"affinity_cache_ratio":0.9973568820374925,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":130560,"estimated_new_tokens":346,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":27286,"ongoing_decode_tokens":27286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2686,"cache_hit":122368,"new_prefill":8538,"score_linear":-95082.0,"score_lmetric":8538},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":130906,"score_linear":87576.0,"score_lmetric":141682},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":130906,"score_linear":235719.0,"score_lmetric":420963},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":130560,"new_prefill":346,"score_linear":-130560.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-130560.0,"chosen_score_lmetric":0,"t_first_token":384665.160126924,"t_first_token_unix":1779815530.1740701,"t_done":384667.345428726,"t_done_unix":1779815532.3593724},{"request_id":"1243831:16:1446717:874","session_id":"1243831","input_length":29571,"t_proxy_recv":384667.057332259,"t_decision_unix":1779815532.071274,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9869128538094755,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":29184,"new_prefill":387,"score_linear":-29184.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":0,"pending_prefill_tokens":18763,"num_requests":2,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":18307,"score_linear":148299.0,"score_lmetric":74140},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":29571,"score_linear":235719.0,"score_lmetric":116958},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130906,"ongoing_decode_tokens":130906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":29571,"score_linear":130906.0,"score_lmetric":29571},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":384667.137735393,"t_first_token_unix":1779815532.1516788,"t_done":384667.562307671,"t_done_unix":1779815532.576251},{"request_id":"1363943:32:1537767:950","session_id":"1363943","input_length":93368,"t_proxy_recv":384678.705742292,"t_decision_unix":1779815543.7196834,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9980293034015937,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":93184,"new_prefill":184,"score_linear":-62023.0,"score_lmetric":184},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":87576,"pending_prefill_tokens":7987,"num_requests":2,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":4096,"new_prefill":89272,"score_linear":155467.0,"score_lmetric":194518},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":93368,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":156633,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":24576,"new_prefill":68792,"score_linear":211143.0,"score_lmetric":208626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-62023.0,"chosen_score_lmetric":184,"t_first_token":384678.908158574,"t_first_token_unix":1779815543.922102,"t_done":384681.323146744,"t_done_unix":1779815546.3370943},{"request_id":"1294611:15:1533841:949","session_id":"1294611","input_length":71987,"t_proxy_recv":384665.383295403,"t_decision_unix":1779815530.397237,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":64000,"affinity_cache_ratio":0.8890494116993346,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64000,"estimated_new_tokens":7987,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28085,"ongoing_decode_tokens":28085,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2686,"cache_hit":0,"new_prefill":71987,"score_linear":28085.0,"score_lmetric":71987},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":64000,"new_prefill":7987,"score_linear":23576.0,"score_lmetric":18763},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":71987,"score_linear":235719.0,"score_lmetric":244206},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130906,"ongoing_decode_tokens":130906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":12800,"new_prefill":59187,"score_linear":118106.0,"score_lmetric":59187},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":59187,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":23576.0,"chosen_score_lmetric":18763,"t_first_token":384684.889456067,"t_first_token_unix":1779815549.9034,"t_done":384689.392689359,"t_done_unix":1779815554.4066336},{"request_id":"1268861:17:1540278:951","session_id":"1268861","input_length":75693,"t_proxy_recv":384686.788037628,"t_decision_unix":1779815551.8019788,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9402190427120077,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":4525,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":75693,"score_linear":31161.0,"score_lmetric":75693},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":159563,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":75693,"score_linear":159563.0,"score_lmetric":151386},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":71168,"new_prefill":4525,"score_linear":-71168.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":156633,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":44032,"new_prefill":31661,"score_linear":191687.0,"score_lmetric":97233},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":384688.982971236,"t_first_token_unix":1779815553.9969149,"t_done":384690.429590961,"t_done_unix":1779815555.4435349},{"request_id":"1342921:9:1525898:939","session_id":"1342921","input_length":79086,"t_proxy_recv":384638.925704709,"t_decision_unix":1779815503.9396458,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9905166527577574,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":750,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":156633,"ongoing_decode_tokens":0,"pending_prefill_tokens":8665,"num_requests":2,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":78336,"new_prefill":750,"score_linear":78297.0,"score_lmetric":18830},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":78297.0,"chosen_score_lmetric":18830,"t_first_token":384690.520776267,"t_first_token_unix":1779815555.53472,"t_done":384690.754474649,"t_done_unix":1779815555.7684183},{"request_id":"1399948:18:1524432:938","session_id":"1399948","input_length":17276,"t_proxy_recv":384633.893630549,"t_decision_unix":1779815498.9075706,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":16384,"affinity_cache_ratio":0.948367677703172,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":892,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":-17276},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139357,"ongoing_decode_tokens":0,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":16384,"new_prefill":892,"score_linear":122973.0,"score_lmetric":8665},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":122973.0,"chosen_score_lmetric":8665,"t_first_token":384669.889823474,"t_first_token_unix":1779815534.9037669,"t_done":384691.322209337,"t_done_unix":1779815556.3361526},{"request_id":"1399948:19:1526739:941","session_id":"1399948","input_length":18091,"t_proxy_recv":384691.327398297,"t_decision_unix":1779815556.3413398,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":16896,"affinity_cache_ratio":0.9339450555524846,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":1195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124757,"ongoing_decode_tokens":124757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":18091,"score_linear":124757.0,"score_lmetric":36182},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":18091,"score_linear":87576.0,"score_lmetric":18091},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2342,"cache_hit":16896,"new_prefill":1195,"score_linear":122461.0,"score_lmetric":1195},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":122461.0,"chosen_score_lmetric":1195,"t_first_token":384691.661928596,"t_first_token_unix":1779815556.6758723,"t_done":384692.369290071,"t_done_unix":1779815557.3832333},{"request_id":"1399948:20:1527857:942","session_id":"1399948","input_length":18164,"t_proxy_recv":384692.374560398,"t_decision_unix":1779815557.3885021,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":17920,"affinity_cache_ratio":0.9865668354987888,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124757,"ongoing_decode_tokens":124757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":18164,"score_linear":124757.0,"score_lmetric":36328},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":18164,"score_linear":87576.0,"score_lmetric":18164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2344,"cache_hit":17920,"new_prefill":244,"score_linear":121437.0,"score_lmetric":244},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":121437.0,"chosen_score_lmetric":244,"t_first_token":384692.448519817,"t_first_token_unix":1779815557.462463,"t_done":384693.728710689,"t_done_unix":1779815558.7426543},{"request_id":"1399948:21:1528978:944","session_id":"1399948","input_length":18388,"t_proxy_recv":384693.733639442,"t_decision_unix":1779815558.747581,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":17920,"affinity_cache_ratio":0.9745486186643463,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":468,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124757,"ongoing_decode_tokens":124757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":18388,"score_linear":124757.0,"score_lmetric":36776},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":18388,"score_linear":87576.0,"score_lmetric":18388},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2344,"cache_hit":17920,"new_prefill":468,"score_linear":121437.0,"score_lmetric":468},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":121437.0,"chosen_score_lmetric":468,"t_first_token":384693.832427155,"t_first_token_unix":1779815558.8463705,"t_done":384695.222156474,"t_done_unix":1779815560.2361007},{"request_id":"1399948:22:1530122:947","session_id":"1399948","input_length":18563,"t_proxy_recv":384695.227535933,"t_decision_unix":1779815560.2414775,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":18432,"affinity_cache_ratio":0.992942951031622,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124757,"ongoing_decode_tokens":124757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":18563,"score_linear":124757.0,"score_lmetric":37126},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":18563,"score_linear":87576.0,"score_lmetric":18563},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2345,"cache_hit":18432,"new_prefill":131,"score_linear":120925.0,"score_lmetric":131},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":120925.0,"chosen_score_lmetric":131,"t_first_token":384695.318978607,"t_first_token_unix":1779815560.3329225,"t_done":384695.932340615,"t_done_unix":1779815560.9462864},{"request_id":"1363943:33:1541065:952","session_id":"1363943","input_length":93596,"t_proxy_recv":384689.436210017,"t_decision_unix":1779815554.4501517,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9955981024830121,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":93184,"new_prefill":412,"score_linear":-62023.0,"score_lmetric":412},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":4096,"new_prefill":89500,"score_linear":83480.0,"score_lmetric":89500},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75693,"ongoing_decode_tokens":75693,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":4096,"new_prefill":89500,"score_linear":71597.0,"score_lmetric":89500},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":93596,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":156633,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":24576,"new_prefill":69020,"score_linear":211143.0,"score_lmetric":209310},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-62023.0,"chosen_score_lmetric":412,"t_first_token":384689.612455673,"t_first_token_unix":1779815554.6263995,"t_done":384697.771941779,"t_done_unix":1779815562.7858858},{"request_id":"1313181:14:1351342:491","session_id":"1313181","input_length":139357,"t_proxy_recv":384623.239353046,"t_decision_unix":1779815488.2532947,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9442223928471479,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":7773,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":65024,"new_prefill":74333,"score_linear":-65024.0,"score_lmetric":-74333},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":12800,"new_prefill":126557,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":131584,"new_prefill":7773,"score_linear":-131584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":77405,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-131584.0,"chosen_score_lmetric":0,"t_first_token":384669.888369995,"t_first_token_unix":1779815534.9023154,"t_done":384700.094388586,"t_done_unix":1779815565.1083329},{"request_id":"1399948:23:1544108:954","session_id":"1399948","input_length":20031,"t_proxy_recv":384699.298120182,"t_decision_unix":1779815564.3120615,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9201737307173881,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":1599,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2691,"cache_hit":0,"new_prefill":20031,"score_linear":31161.0,"score_lmetric":20031},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":20031,"score_linear":87576.0,"score_lmetric":20031},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2345,"cache_hit":18432,"new_prefill":1599,"score_linear":120925.0,"score_lmetric":1599},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":120925.0,"chosen_score_lmetric":1599,"t_first_token":384699.659056112,"t_first_token_unix":1779815564.6729999,"t_done":384700.527575999,"t_done_unix":1779815565.5415194},{"request_id":"1253804:7:1526643:940","session_id":"1253804","input_length":87576,"t_proxy_recv":384641.379359784,"t_decision_unix":1779815506.393301,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":76800,"affinity_cache_ratio":0.8769525897506166,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":10776,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2583,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":76800,"new_prefill":10776,"score_linear":-76800.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2606,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":3584,"new_prefill":83992,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":87576,"score_linear":235719.0,"score_lmetric":290973},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":83992,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2713,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":384667.0670726,"t_first_token_unix":1779815532.0810156,"t_done":384700.960321041,"t_done_unix":1779815565.9742649},{"request_id":"1253804:8:1541192:953","session_id":"1253804","input_length":89116,"t_proxy_recv":384700.97516414,"t_decision_unix":1779815565.9891057,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88576,"affinity_cache_ratio":0.9939404820683154,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88576,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2691,"cache_hit":0,"new_prefill":89116,"score_linear":31161.0,"score_lmetric":89116},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":88576,"new_prefill":540,"score_linear":-88576.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":3584,"new_prefill":85532,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65876,"ongoing_decode_tokens":65876,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":89116,"score_linear":65876.0,"score_lmetric":89116},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":85532,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-88576.0,"chosen_score_lmetric":0,"t_first_token":384701.119398621,"t_first_token_unix":1779815566.1333425,"t_done":384701.528186268,"t_done_unix":1779815566.54213},{"request_id":"1313181:14:1408792:803","session_id":"1313181","input_length":65876,"t_proxy_recv":384700.104508948,"t_decision_unix":1779815565.1184504,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":65536,"affinity_cache_ratio":0.9948387880259882,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2691,"cache_hit":65024,"new_prefill":852,"score_linear":-33863.0,"score_lmetric":852},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":65876,"score_linear":87576.0,"score_lmetric":65876},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":12800,"new_prefill":53076,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":20031,"ongoing_decode_tokens":20031,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":65536,"new_prefill":340,"score_linear":-45505.0,"score_lmetric":340},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":3924,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-45505.0,"chosen_score_lmetric":340,"t_first_token":384700.196227093,"t_first_token_unix":1779815565.2101705,"t_done":384703.216028055,"t_done_unix":1779815568.2299721},{"request_id":"1313181:15:1411723:818","session_id":"1313181","input_length":66259,"t_proxy_recv":384703.228483692,"t_decision_unix":1779815568.2424252,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":66048,"affinity_cache_ratio":0.9968155269472826,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66048,"estimated_new_tokens":211,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2691,"cache_hit":65024,"new_prefill":1235,"score_linear":-33863.0,"score_lmetric":1235},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":12800,"new_prefill":53459,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":66048,"new_prefill":211,"score_linear":-66048.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":61952,"new_prefill":4307,"score_linear":-61952.0,"score_lmetric":0}],"chosen_score_linear":-66048.0,"chosen_score_lmetric":0,"t_first_token":384703.35159049,"t_first_token_unix":1779815568.365534,"t_done":384706.566714953,"t_done_unix":1779815571.5806587},{"request_id":"1399948:24:1546940:955","session_id":"1399948","input_length":21809,"t_proxy_recv":384708.746332687,"t_decision_unix":1779815573.760274,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9155853088174607,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":1841,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2691,"cache_hit":0,"new_prefill":21809,"score_linear":31161.0,"score_lmetric":21809},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2366,"cache_hit":19968,"new_prefill":1841,"score_linear":-19968.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":384709.092579568,"t_first_token_unix":1779815574.106523,"t_done":384709.342684801,"t_done_unix":1779815574.3566282},{"request_id":"1243831:17:1453633:883","session_id":"1243831","input_length":31161,"t_proxy_recv":384667.568854061,"t_decision_unix":1779815532.5827956,"policy":"unified","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9365553095215173,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":1977,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":29184,"new_prefill":1977,"score_linear":-29184.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":87576,"pending_prefill_tokens":7987,"num_requests":2,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":11264,"new_prefill":19897,"score_linear":148299.0,"score_lmetric":55768},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2622,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":235719,"ongoing_decode_tokens":0,"pending_prefill_tokens":9415,"num_requests":3,"active_p_offloads":0,"cached_blocks":2340,"cache_hit":0,"new_prefill":31161,"score_linear":235719.0,"score_lmetric":121728},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":384667.961519876,"t_first_token_unix":1779815532.9754634,"t_done":384725.024463312,"t_done_unix":1779815590.0384088},{"request_id":"1399948:25:1553234:957","session_id":"1399948","input_length":22250,"t_proxy_recv":384729.278924523,"t_decision_unix":1779815594.292866,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9664719101123596,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":746,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":76017,"ongoing_decode_tokens":76017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":22250,"score_linear":76017.0,"score_lmetric":22250},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2369,"cache_hit":21504,"new_prefill":746,"score_linear":-21504.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":384729.427777826,"t_first_token_unix":1779815594.4417212,"t_done":384729.968602157,"t_done_unix":1779815594.9825535},{"request_id":"1268861:18:1553083:956","session_id":"1268861","input_length":76017,"t_proxy_recv":384728.841091007,"t_decision_unix":1779815593.8550322,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9968296565241985,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":75776,"new_prefill":241,"score_linear":-75776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2369,"cache_hit":44032,"new_prefill":31985,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":384729.084051142,"t_first_token_unix":1779815594.0979948,"t_done":384730.110368491,"t_done_unix":1779815595.1243124},{"request_id":"1399948:26:1557859:959","session_id":"1399948","input_length":23042,"t_proxy_recv":384745.24403789,"t_decision_unix":1779815610.2579794,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9554726152243729,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":1026,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2370,"cache_hit":22016,"new_prefill":1026,"score_linear":-22016.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":384745.452348237,"t_first_token_unix":1779815610.4662917,"t_done":384745.735159074,"t_done_unix":1779815610.7491024},{"request_id":"1399948:27:1559017:960","session_id":"1399948","input_length":24139,"t_proxy_recv":384748.902399795,"t_decision_unix":1779815613.916341,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9544720162392808,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1099,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2372,"cache_hit":23040,"new_prefill":1099,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":384749.171814163,"t_first_token_unix":1779815614.1857579,"t_done":384750.123088548,"t_done_unix":1779815615.1370318},{"request_id":"1399948:28:1560859:961","session_id":"1399948","input_length":24386,"t_proxy_recv":384755.034639382,"t_decision_unix":1779815620.0485811,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9867957024522267,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":322,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2374,"cache_hit":24064,"new_prefill":322,"score_linear":-24064.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":384755.116773123,"t_first_token_unix":1779815620.1307166,"t_done":384756.378385286,"t_done_unix":1779815621.3923287},{"request_id":"1399948:29:1571125:963","session_id":"1399948","input_length":28781,"t_proxy_recv":384788.900187298,"t_decision_unix":1779815653.9141285,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":24576,"affinity_cache_ratio":0.8538966679406553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":4205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":24576,"new_prefill":4205,"score_linear":-24576.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":131413,"ongoing_decode_tokens":131413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":0,"new_prefill":28781,"score_linear":131413.0,"score_lmetric":28781},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":384789.773616413,"t_first_token_unix":1779815654.78756,"t_done":384790.042186618,"t_done_unix":1779815655.056135},{"request_id":"1356885:6:1570780:962","session_id":"1356885","input_length":131413,"t_proxy_recv":384787.867386618,"t_decision_unix":1779815652.8813279,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":131072,"affinity_cache_ratio":0.9974051273466096,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131072,"estimated_new_tokens":341,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":9045,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2714,"cache_hit":131072,"new_prefill":341,"score_linear":-131072.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131072.0,"chosen_score_lmetric":0,"t_first_token":384788.503415388,"t_first_token_unix":1779815653.5173588,"t_done":384790.679952058,"t_done_unix":1779815655.6938956},{"request_id":"1268861:19:1578134:966","session_id":"1268861","input_length":76963,"t_proxy_recv":384812.748864981,"t_decision_unix":1779815677.7628064,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9845770045346465,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":1187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":75776,"new_prefill":1187,"score_linear":-75776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":44032,"new_prefill":32931,"score_linear":65051.0,"score_lmetric":33982},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":384813.29468605,"t_first_token_unix":1779815678.3086295,"t_done":384814.060827775,"t_done_unix":1779815679.0747712},{"request_id":"1356885:7:1580925:969","session_id":"1356885","input_length":131775,"t_proxy_recv":384822.632925826,"t_decision_unix":1779815687.6468673,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9985505596660975,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":191,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":9407,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139856,"ongoing_decode_tokens":0,"pending_prefill_tokens":3152,"num_requests":2,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":0,"new_prefill":131775,"score_linear":139856.0,"score_lmetric":269854},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":131584,"new_prefill":191,"score_linear":-131584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131584.0,"chosen_score_lmetric":0,"t_first_token":384823.031657531,"t_first_token_unix":1779815688.0456014,"t_done":384825.034989069,"t_done_unix":1779815690.0489326},{"request_id":"1277428:12:1586139:973","session_id":"1277428","input_length":47660,"t_proxy_recv":384840.120054067,"t_decision_unix":1779815705.1339953,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":46080,"affinity_cache_ratio":0.9668485102811583,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":1580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":4608,"new_prefill":43052,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":46080,"new_prefill":1580,"score_linear":-46080.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":139856,"ongoing_decode_tokens":0,"pending_prefill_tokens":3152,"num_requests":2,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":0,"new_prefill":47660,"score_linear":139856.0,"score_lmetric":101624},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":17408,"new_prefill":30252,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":384840.58416367,"t_first_token_unix":1779815705.598107,"t_done":384841.188755666,"t_done_unix":1779815706.202699},{"request_id":"1270606:4:1578042:965","session_id":"1270606","input_length":109083,"t_proxy_recv":384812.521038867,"t_decision_unix":1779815677.53498,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9903651348056067,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":1051,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2631,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":108032,"new_prefill":1051,"score_linear":-108032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":107547,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":384851.636250321,"t_first_token_unix":1779815716.6501942,"t_done":384852.150134701,"t_done_unix":1779815717.164081},{"request_id":"1399948:30:1578524:967","session_id":"1399948","input_length":30773,"t_proxy_recv":384814.088647919,"t_decision_unix":1779815679.1025891,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9317258635817113,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":2101,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":28672,"new_prefill":2101,"score_linear":80411.0,"score_lmetric":3152},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":80411.0,"chosen_score_lmetric":3152,"t_first_token":384851.637515879,"t_first_token_unix":1779815716.651459,"t_done":384852.164911629,"t_done_unix":1779815717.178855},{"request_id":"1399948:31:1579418:968","session_id":"1399948","input_length":30925,"t_proxy_recv":384852.206185796,"t_decision_unix":1779815717.2201276,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9933710590137429,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111387,"ongoing_decode_tokens":0,"pending_prefill_tokens":2331,"num_requests":1,"active_p_offloads":0,"cached_blocks":2389,"cache_hit":30720,"new_prefill":205,"score_linear":80667.0,"score_lmetric":2536},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":80667.0,"chosen_score_lmetric":2536,"t_first_token":384852.331408197,"t_first_token_unix":1779815717.3453512,"t_done":384856.650716682,"t_done_unix":1779815721.6646614},{"request_id":"1270606:5:1581455:971","session_id":"1270606","input_length":111387,"t_proxy_recv":384852.194828774,"t_decision_unix":1779815717.2087703,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9790729618357618,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":2331,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2389,"cache_hit":109056,"new_prefill":2331,"score_linear":-109056.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":109851,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":384854.014197434,"t_first_token_unix":1779815719.028141,"t_done":384857.494226071,"t_done_unix":1779815722.5081701},{"request_id":"1294611:15:1590202:975","session_id":"1294611","input_length":75249,"t_proxy_recv":384853.652283242,"t_decision_unix":1779815718.6662245,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9593748754136268,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":3057,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":72192,"new_prefill":3057,"score_linear":-72192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":142312,"ongoing_decode_tokens":30925,"pending_prefill_tokens":2331,"num_requests":2,"active_p_offloads":0,"cached_blocks":2389,"cache_hit":0,"new_prefill":75249,"score_linear":142312.0,"score_lmetric":155160},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-72192.0,"chosen_score_lmetric":0,"t_first_token":384855.166296293,"t_first_token_unix":1779815720.18024,"t_done":384857.848430213,"t_done_unix":1779815722.862374},{"request_id":"1399948:32:1581424:970","session_id":"1399948","input_length":31231,"t_proxy_recv":384856.657704175,"t_decision_unix":1779815721.6716454,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9836380519355769,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":511,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75249,"ongoing_decode_tokens":75249,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":31231,"score_linear":75249.0,"score_lmetric":31231},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111387,"ongoing_decode_tokens":111387,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2389,"cache_hit":30720,"new_prefill":511,"score_linear":80667.0,"score_lmetric":511},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":80667.0,"chosen_score_lmetric":511,"t_first_token":384856.773560863,"t_first_token_unix":1779815721.7875042,"t_done":384858.14908055,"t_done_unix":1779815723.163024},{"request_id":"1399948:33:1583165:972","session_id":"1399948","input_length":31445,"t_proxy_recv":384858.155981763,"t_decision_unix":1779815723.1699233,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9932262680871363,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":31232,"new_prefill":213,"score_linear":-31232.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":384858.244262433,"t_first_token_unix":1779815723.258206,"t_done":384858.890804799,"t_done_unix":1779815723.9047482},{"request_id":"1399948:34:1586232:974","session_id":"1399948","input_length":32143,"t_proxy_recv":384858.897951461,"t_decision_unix":1779815723.9118931,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":31232,"affinity_cache_ratio":0.97165790374265,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":31232,"new_prefill":911,"score_linear":-31232.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":384859.102798406,"t_first_token_unix":1779815724.116742,"t_done":384859.993122082,"t_done_unix":1779815725.0070653},{"request_id":"1277428:13:1593499:976","session_id":"1277428","input_length":49316,"t_proxy_recv":384865.295115791,"t_decision_unix":1779815730.309057,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":47616,"affinity_cache_ratio":0.9655284289074539,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47616,"estimated_new_tokens":1700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":4608,"new_prefill":44708,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":47616,"new_prefill":1700,"score_linear":-47616.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":17408,"new_prefill":31908,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47616.0,"chosen_score_lmetric":0,"t_first_token":384865.942810883,"t_first_token_unix":1779815730.9567547,"t_done":384867.451285057,"t_done_unix":1779815732.4652288},{"request_id":"1294611:15:1594038:977","session_id":"1294611","input_length":75584,"t_proxy_recv":384867.016458333,"t_decision_unix":1779815732.0303998,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":75264,"affinity_cache_ratio":0.995766299745978,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":75264,"new_prefill":320,"score_linear":-75264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49316,"ongoing_decode_tokens":49316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":75584,"score_linear":49316.0,"score_lmetric":75584},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":62784,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":62784,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":384867.142598436,"t_first_token_unix":1779815732.156542,"t_done":384868.244126934,"t_done_unix":1779815733.2580705},{"request_id":"1268861:20:1595141:978","session_id":"1268861","input_length":77218,"t_proxy_recv":384870.994688078,"t_decision_unix":1779815736.008629,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9945867543836929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":76800,"new_prefill":418,"score_linear":-76800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":44032,"new_prefill":33186,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":384871.24012601,"t_first_token_unix":1779815736.2540693,"t_done":384871.767519584,"t_done_unix":1779815736.7814639},{"request_id":"1399948:35:1602048:980","session_id":"1399948","input_length":33533,"t_proxy_recv":384894.367145259,"t_decision_unix":1779815759.3810863,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":32256,"affinity_cache_ratio":0.9619181105179972,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":1277,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75716,"ongoing_decode_tokens":75716,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":33533,"score_linear":75716.0,"score_lmetric":33533},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":32256,"new_prefill":1277,"score_linear":-32256.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-32256.0,"chosen_score_lmetric":0,"t_first_token":384894.773972403,"t_first_token_unix":1779815759.7879157,"t_done":384895.773213766,"t_done_unix":1779815760.7871609},{"request_id":"1253804:9:1605110:981","session_id":"1253804","input_length":90656,"t_proxy_recv":384904.357421234,"t_decision_unix":1779815769.3713624,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":89088,"affinity_cache_ratio":0.9827038475114719,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89088,"estimated_new_tokens":1568,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75716,"ongoing_decode_tokens":75716,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":89088,"new_prefill":1568,"score_linear":-13372.0,"score_lmetric":1568},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":87072,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2399,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":87072,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13372.0,"chosen_score_lmetric":1568,"t_first_token":384905.325737552,"t_first_token_unix":1779815770.3396816,"t_done":384910.604242124,"t_done_unix":1779815775.6181886},{"request_id":"1294611:15:1596163:979","session_id":"1294611","input_length":75716,"t_proxy_recv":384874.178191511,"t_decision_unix":1779815739.1921327,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9940303238417243,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":452,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":75264,"new_prefill":452,"score_linear":-75264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":384874.292510714,"t_first_token_unix":1779815739.3064542,"t_done":384915.116390494,"t_done_unix":1779815780.1303341},{"request_id":"1268861:21:1609831:982","session_id":"1268861","input_length":77293,"t_proxy_recv":384920.099043479,"t_decision_unix":1779815785.1129844,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9936216733727504,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2633,"cache_hit":76800,"new_prefill":493,"score_linear":-76800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2399,"cache_hit":44032,"new_prefill":33261,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":384920.206437312,"t_first_token_unix":1779815785.220381,"t_done":384921.795816416,"t_done_unix":1779815786.80976},{"request_id":"1253804:10:1611505:983","session_id":"1253804","input_length":91103,"t_proxy_recv":384925.580690041,"t_decision_unix":1779815790.5946312,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":90624,"affinity_cache_ratio":0.9947422148557128,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":90624,"estimated_new_tokens":479,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":90624,"new_prefill":479,"score_linear":-90624.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":87519,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2399,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":87519,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-90624.0,"chosen_score_lmetric":0,"t_first_token":384925.751654043,"t_first_token_unix":1779815790.7655983,"t_done":384925.879755057,"t_done_unix":1779815790.8936982},{"request_id":"1399948:36:1612467:984","session_id":"1399948","input_length":34773,"t_proxy_recv":384928.685829858,"t_decision_unix":1779815793.6997712,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9570643890374716,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":1493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2399,"cache_hit":33280,"new_prefill":1493,"score_linear":-33280.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":384929.040518099,"t_first_token_unix":1779815794.0544617,"t_done":384929.576099912,"t_done_unix":1779815794.5900455},{"request_id":"1253804:11:1613030:985","session_id":"1253804","input_length":91131,"t_proxy_recv":384930.915245345,"t_decision_unix":1779815795.9291866,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":90624,"affinity_cache_ratio":0.9944365803074695,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":90624,"estimated_new_tokens":507,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":90624,"new_prefill":507,"score_linear":-90624.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":87547,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2402,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":87547,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-90624.0,"chosen_score_lmetric":0,"t_first_token":384931.033567872,"t_first_token_unix":1779815796.0475116,"t_done":384933.089698764,"t_done_unix":1779815798.1036425},{"request_id":"1399948:37:1613628:986","session_id":"1399948","input_length":35308,"t_proxy_recv":384932.76639262,"t_decision_unix":1779815797.7803338,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9860654809108418,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":492,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":91131,"ongoing_decode_tokens":91131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":35308,"score_linear":91131.0,"score_lmetric":35308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2402,"cache_hit":34816,"new_prefill":492,"score_linear":-34816.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":384932.984786362,"t_first_token_unix":1779815797.99873,"t_done":384934.104594354,"t_done_unix":1779815799.1185377},{"request_id":"1399948:38:1616890:987","session_id":"1399948","input_length":35581,"t_proxy_recv":384943.949887633,"t_decision_unix":1779815808.9638288,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9928894634776988,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2403,"cache_hit":35328,"new_prefill":253,"score_linear":-35328.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":384944.058041235,"t_first_token_unix":1779815809.0719852,"t_done":384944.572351258,"t_done_unix":1779815809.5862954},{"request_id":"1399948:39:1618250:989","session_id":"1399948","input_length":35682,"t_proxy_recv":384948.637570356,"t_decision_unix":1779815813.651512,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9900790314444258,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2403,"cache_hit":35328,"new_prefill":354,"score_linear":-35328.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":384948.706628874,"t_first_token_unix":1779815813.7205727,"t_done":384949.145436978,"t_done_unix":1779815814.1593804},{"request_id":"1399948:40:1620970:991","session_id":"1399948","input_length":35958,"t_proxy_recv":384957.626601475,"t_decision_unix":1779815822.640543,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9824795594860671,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":630,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78439,"ongoing_decode_tokens":0,"pending_prefill_tokens":1127,"num_requests":1,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":0,"new_prefill":35958,"score_linear":78439.0,"score_lmetric":37085},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2403,"cache_hit":35328,"new_prefill":630,"score_linear":-35328.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":384957.760235132,"t_first_token_unix":1779815822.7741785,"t_done":384958.122506443,"t_done_unix":1779815823.1364498},{"request_id":"1268861:22:1620830:990","session_id":"1268861","input_length":78439,"t_proxy_recv":384957.162158347,"t_decision_unix":1779815822.1760995,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":77312,"affinity_cache_ratio":0.9856321472736777,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77312,"estimated_new_tokens":1127,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2634,"cache_hit":77312,"new_prefill":1127,"score_linear":-77312.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2403,"cache_hit":44032,"new_prefill":34407,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-77312.0,"chosen_score_lmetric":0,"t_first_token":384957.85780171,"t_first_token_unix":1779815822.871745,"t_done":384959.121872213,"t_done_unix":1779815824.1358156},{"request_id":"1253804:12:1621957:992","session_id":"1253804","input_length":91389,"t_proxy_recv":384961.073402277,"t_decision_unix":1779815826.0873435,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9972316143080677,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":91136,"new_prefill":253,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":87805,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":87805,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":384961.256537015,"t_first_token_unix":1779815826.2704806,"t_done":384961.5406564,"t_done_unix":1779815826.5546005},{"request_id":"1399948:41:1624143:993","session_id":"1399948","input_length":36168,"t_proxy_recv":384968.437912997,"t_decision_unix":1779815833.451854,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35840,"affinity_cache_ratio":0.990931209909312,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":35840,"new_prefill":328,"score_linear":-35840.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":384968.568852565,"t_first_token_unix":1779815833.5827966,"t_done":384969.232017761,"t_done_unix":1779815834.2459612},{"request_id":"1253804:13:1624613:994","session_id":"1253804","input_length":91440,"t_proxy_recv":384970.012210921,"t_decision_unix":1779815835.0261521,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9966754155730534,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":304,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":91136,"new_prefill":304,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":87856,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":87856,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":384970.13967057,"t_first_token_unix":1779815835.153614,"t_done":384971.132538382,"t_done_unix":1779815836.1464825},{"request_id":"1253804:14:1626575:995","session_id":"1253804","input_length":92367,"t_proxy_recv":384976.529265623,"t_decision_unix":1779815841.5432065,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9866727294380028,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":1231,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":91136,"new_prefill":1231,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":88783,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":88783,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":384977.166308964,"t_first_token_unix":1779815842.1802523,"t_done":384977.969046503,"t_done_unix":1779815842.9829924},{"request_id":"1253804:15:1628485:997","session_id":"1253804","input_length":92701,"t_proxy_recv":384982.854774303,"t_decision_unix":1779815847.8687158,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92160,"affinity_cache_ratio":0.9941640327504557,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92160,"estimated_new_tokens":541,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":92160,"new_prefill":541,"score_linear":-92160.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":89117,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":36984,"ongoing_decode_tokens":0,"pending_prefill_tokens":1144,"num_requests":1,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":0,"new_prefill":92701,"score_linear":36984.0,"score_lmetric":93845},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":89117,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-92160.0,"chosen_score_lmetric":0,"t_first_token":384983.142149997,"t_first_token_unix":1779815848.1560934,"t_done":384983.517161527,"t_done_unix":1779815848.5311053},{"request_id":"1399948:42:1628429:996","session_id":"1399948","input_length":36984,"t_proxy_recv":384982.628713991,"t_decision_unix":1779815847.6426547,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35840,"affinity_cache_ratio":0.9690677049534934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":1144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":35840,"new_prefill":1144,"score_linear":-35840.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":384982.918262276,"t_first_token_unix":1779815847.932206,"t_done":384984.115473848,"t_done_unix":1779815849.1294174},{"request_id":"1268861:23:1631587:1001","session_id":"1268861","input_length":79693,"t_proxy_recv":384992.900950344,"t_decision_unix":1779815857.9148915,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9829721556472965,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":1357,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":251917,"ongoing_decode_tokens":0,"pending_prefill_tokens":4109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":79693,"score_linear":251917.0,"score_lmetric":251406},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":78336,"new_prefill":1357,"score_linear":-78336.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":44032,"new_prefill":35661,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":384993.605632252,"t_first_token_unix":1779815858.6195762,"t_done":384994.242954897,"t_done_unix":1779815859.2568989},{"request_id":"1388507:3:1629072:998","session_id":"1388507","input_length":79074,"t_proxy_recv":384984.941967787,"t_decision_unix":1779815849.955909,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9582922325922554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":3298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":75776,"new_prefill":3298,"score_linear":-75776.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":385006.203122457,"t_first_token_unix":1779815871.2170668,"t_done":385007.34220342,"t_done_unix":1779815872.3561506},{"request_id":"1253804:16:1629713:999","session_id":"1253804","input_length":92953,"t_proxy_recv":384986.903483514,"t_decision_unix":1779815851.917425,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92672,"affinity_cache_ratio":0.9969769668542167,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92672,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79074,"ongoing_decode_tokens":0,"pending_prefill_tokens":3298,"num_requests":1,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":92672,"new_prefill":281,"score_linear":-13598.0,"score_lmetric":3579},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":89369,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":89369,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13598.0,"chosen_score_lmetric":3579,"t_first_token":385006.211558572,"t_first_token_unix":1779815871.2255025,"t_done":385007.880154127,"t_done_unix":1779815872.8940978},{"request_id":"1253804:17:1631602:1002","session_id":"1253804","input_length":93219,"t_proxy_recv":385007.89644124,"t_decision_unix":1779815872.9103825,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92672,"affinity_cache_ratio":0.9941320975337645,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92672,"estimated_new_tokens":547,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1756,"cache_hit":92672,"new_prefill":547,"score_linear":-12782.0,"score_lmetric":547},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":89635,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":89635,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12782.0,"chosen_score_lmetric":547,"t_first_token":385008.180633333,"t_first_token_unix":1779815873.1945772,"t_done":385009.316406062,"t_done_unix":1779815874.3303502},{"request_id":"1253804:18:1633257:1003","session_id":"1253804","input_length":93509,"t_proxy_recv":385009.332403684,"t_decision_unix":1779815874.3463452,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9965243987209788,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":93184,"new_prefill":325,"score_linear":-13294.0,"score_lmetric":325},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":89925,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":89925,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13294.0,"chosen_score_lmetric":325,"t_first_token":385009.618927593,"t_first_token_unix":1779815874.632871,"t_done":385010.921890838,"t_done_unix":1779815875.9358344},{"request_id":"1294611:15:1631116:1000","session_id":"1294611","input_length":79890,"t_proxy_recv":384991.486589946,"t_decision_unix":1779815856.5005312,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":79360,"affinity_cache_ratio":0.9933658780823632,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79360,"estimated_new_tokens":530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":172027,"ongoing_decode_tokens":0,"pending_prefill_tokens":3579,"num_requests":2,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":79360,"new_prefill":530,"score_linear":92667.0,"score_lmetric":8218},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2636,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":92667.0,"chosen_score_lmetric":8218,"t_first_token":385006.211724388,"t_first_token_unix":1779815871.2256675,"t_done":385011.178584021,"t_done_unix":1779815876.1925275},{"request_id":"1294611:15:1634779:1004","session_id":"1294611","input_length":80221,"t_proxy_recv":385011.199380204,"t_decision_unix":1779815876.213322,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":79872,"affinity_cache_ratio":0.995649518205956,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":349,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":93664,"ongoing_decode_tokens":93664,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1758,"cache_hit":79872,"new_prefill":349,"score_linear":13792.0,"score_lmetric":349},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":13792.0,"chosen_score_lmetric":349,"t_first_token":385011.353293139,"t_first_token_unix":1779815876.3672366,"t_done":385012.264988911,"t_done_unix":1779815877.2789326},{"request_id":"1253804:19:1634903:1005","session_id":"1253804","input_length":93664,"t_proxy_recv":385010.937154927,"t_decision_unix":1779815875.9510965,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9948752989408951,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":93184,"new_prefill":480,"score_linear":-13294.0,"score_lmetric":480},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":90080,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":90080,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13294.0,"chosen_score_lmetric":480,"t_first_token":385011.131860216,"t_first_token_unix":1779815876.1458037,"t_done":385017.290405818,"t_done_unix":1779815882.30435},{"request_id":"1253804:20:1638889:1007","session_id":"1253804","input_length":94111,"t_proxy_recv":385017.306172372,"t_decision_unix":1779815882.3201137,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93696,"affinity_cache_ratio":0.9955903135658956,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93696,"estimated_new_tokens":415,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":93696,"new_prefill":415,"score_linear":-12979.0,"score_lmetric":415},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":3584,"new_prefill":90527,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":90527,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12979.0,"chosen_score_lmetric":415,"t_first_token":385017.498156231,"t_first_token_unix":1779815882.5120995,"t_done":385018.734945722,"t_done_unix":1779815883.7488897},{"request_id":"1258908:2:1639411:1008","session_id":"1258908","input_length":9804,"t_proxy_recv":385018.947317822,"t_decision_unix":1779815883.9612591,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9400244798041616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":588,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":9804,"score_linear":80717.0,"score_lmetric":9804},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":9216,"new_prefill":588,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":385019.700638516,"t_first_token_unix":1779815884.7145822,"t_done":385021.246374198,"t_done_unix":1779815886.2603178},{"request_id":"1268861:24:1643502:1011","session_id":"1268861","input_length":80019,"t_proxy_recv":385032.773324509,"t_decision_unix":1779815897.787266,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":79360,"affinity_cache_ratio":0.9917644559417138,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79360,"estimated_new_tokens":659,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":174986,"ongoing_decode_tokens":174986,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":80019,"score_linear":174986.0,"score_lmetric":160038},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":79360,"new_prefill":659,"score_linear":-79360.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":38102,"ongoing_decode_tokens":0,"pending_prefill_tokens":1238,"num_requests":1,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":44032,"new_prefill":35987,"score_linear":-5930.0,"score_lmetric":37225},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79360.0,"chosen_score_lmetric":0,"t_first_token":385033.036170408,"t_first_token_unix":1779815898.0501142,"t_done":385033.494708544,"t_done_unix":1779815898.5086548},{"request_id":"1399948:43:1643413:1010","session_id":"1399948","input_length":38102,"t_proxy_recv":385032.426522338,"t_decision_unix":1779815897.4404635,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9675082672825573,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":1238,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":174986,"ongoing_decode_tokens":174986,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":38102,"score_linear":174986.0,"score_lmetric":76204},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":36864,"new_prefill":1238,"score_linear":-36864.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":385032.794568139,"t_first_token_unix":1779815897.808511,"t_done":385033.570759279,"t_done_unix":1779815898.5847025},{"request_id":"1399948:44:1644970:1012","session_id":"1399948","input_length":38308,"t_proxy_recv":385037.54992714,"t_decision_unix":1779815902.5638685,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9890362326407017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":174986,"ongoing_decode_tokens":174986,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":38308,"score_linear":174986.0,"score_lmetric":76616},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":37888,"new_prefill":420,"score_linear":-37888.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37888.0,"chosen_score_lmetric":0,"t_first_token":385037.661223719,"t_first_token_unix":1779815902.6751673,"t_done":385039.166520904,"t_done_unix":1779815904.1804647},{"request_id":"1253804:21:1640487:1009","session_id":"1253804","input_length":94269,"t_proxy_recv":385022.434324221,"t_decision_unix":1779815887.4482653,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93696,"affinity_cache_ratio":0.9939216497470006,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93696,"estimated_new_tokens":573,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":93696,"new_prefill":573,"score_linear":-12979.0,"score_lmetric":573},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":90685,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":90685,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12979.0,"chosen_score_lmetric":573,"t_first_token":385022.635632099,"t_first_token_unix":1779815887.6495757,"t_done":385043.624269933,"t_done_unix":1779815908.6382136},{"request_id":"1294611:15:1636645:1006","session_id":"1294611","input_length":80717,"t_proxy_recv":385012.286208008,"t_decision_unix":1779815877.3001494,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9895313254952488,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":93664,"ongoing_decode_tokens":93664,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1758,"cache_hit":79872,"new_prefill":845,"score_linear":13792.0,"score_lmetric":845},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":13792.0,"chosen_score_lmetric":845,"t_first_token":385012.693594353,"t_first_token_unix":1779815877.707538,"t_done":385045.808931485,"t_done_unix":1779815910.822875},{"request_id":"1253804:22:1650001:1013","session_id":"1253804","input_length":95715,"t_proxy_recv":385054.139528516,"t_decision_unix":1779815919.1534693,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":95232,"affinity_cache_ratio":0.9949537690017238,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95232,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1764,"cache_hit":95232,"new_prefill":483,"score_linear":-95232.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":92131,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2409,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":92131,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-95232.0,"chosen_score_lmetric":0,"t_first_token":385054.326118237,"t_first_token_unix":1779815919.3400614,"t_done":385054.8165794,"t_done_unix":1779815919.8305228},{"request_id":"1399948:45:1650679:1014","session_id":"1399948","input_length":38758,"t_proxy_recv":385056.591802332,"t_decision_unix":1779815921.6057436,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9907631972754012,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":358,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1765,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2409,"cache_hit":38400,"new_prefill":358,"score_linear":-38400.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":385056.734158201,"t_first_token_unix":1779815921.7481017,"t_done":385057.322889937,"t_done_unix":1779815922.3368332},{"request_id":"1253804:23:1651448:1015","session_id":"1253804","input_length":96944,"t_proxy_recv":385058.890401839,"t_decision_unix":1779815923.9043434,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9876217197557353,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":1200,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1765,"cache_hit":95744,"new_prefill":1200,"score_linear":-95744.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":93360,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2409,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":93360,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":385059.725763896,"t_first_token_unix":1779815924.7397082,"t_done":385060.128555194,"t_done_unix":1779815925.1424994},{"request_id":"1399948:46:1658183:1018","session_id":"1399948","input_length":39837,"t_proxy_recv":385081.727331311,"t_decision_unix":1779815946.7412727,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9639280066270051,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":1437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":39837,"score_linear":83204.0,"score_lmetric":39837},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":39837,"score_linear":80406.0,"score_lmetric":39837},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2409,"cache_hit":38400,"new_prefill":1437,"score_linear":-38400.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":385082.110472737,"t_first_token_unix":1779815947.1244156,"t_done":385082.958823418,"t_done_unix":1779815947.972772},{"request_id":"1253804:24:1659020:1019","session_id":"1253804","input_length":97769,"t_proxy_recv":385084.624683486,"t_decision_unix":1779815949.6386247,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":96768,"affinity_cache_ratio":0.9897615808691916,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":96768,"estimated_new_tokens":1001,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":96768,"new_prefill":1001,"score_linear":-13564.0,"score_lmetric":1001},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":97769,"score_linear":80406.0,"score_lmetric":97769},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":94185,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2412,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":94185,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13564.0,"chosen_score_lmetric":1001,"t_first_token":385085.291616361,"t_first_token_unix":1779815950.3055599,"t_done":385085.91197966,"t_done_unix":1779815950.9259238},{"request_id":"1268861:25:1653400:1016","session_id":"1268861","input_length":80406,"t_proxy_recv":385065.329054017,"t_decision_unix":1779815930.3429952,"policy":"unified","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9933587045742855,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":534,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":79872,"new_prefill":534,"score_linear":-79872.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2409,"cache_hit":44032,"new_prefill":36374,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":385065.73413258,"t_first_token_unix":1779815930.748076,"t_done":385089.982765831,"t_done_unix":1779815954.9967098},{"request_id":"1253804:25:1662273:1020","session_id":"1253804","input_length":98187,"t_proxy_recv":385095.486740134,"t_decision_unix":1779815960.5006814,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9959770641734649,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":395,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":97792,"new_prefill":395,"score_linear":-14588.0,"score_lmetric":395},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":94603,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2412,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":94603,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14588.0,"chosen_score_lmetric":395,"t_first_token":385095.969286767,"t_first_token_unix":1779815960.9832304,"t_done":385096.5913966,"t_done_unix":1779815961.6053405},{"request_id":"1399948:47:1664702:1022","session_id":"1399948","input_length":40261,"t_proxy_recv":385104.088483814,"t_decision_unix":1779815969.1024253,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9919276719405876,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":181458,"ongoing_decode_tokens":181458,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":40261,"score_linear":181458.0,"score_lmetric":80522},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2412,"cache_hit":39936,"new_prefill":325,"score_linear":-39936.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":385104.309681065,"t_first_token_unix":1779815969.3236244,"t_done":385104.727090959,"t_done_unix":1779815969.7410386},{"request_id":"1294611:15:1657992:1017","session_id":"1294611","input_length":83204,"t_proxy_recv":385081.252025523,"t_decision_unix":1779815946.2659667,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":82944,"affinity_cache_ratio":0.9968751502331619,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82944,"estimated_new_tokens":260,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":82944,"new_prefill":260,"score_linear":-82944.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2639,"cache_hit":0,"new_prefill":83204,"score_linear":80406.0,"score_lmetric":83204},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2409,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-82944.0,"chosen_score_lmetric":0,"t_first_token":385081.434808817,"t_first_token_unix":1779815946.4487524,"t_done":385107.342790577,"t_done_unix":1779815972.3567345},{"request_id":"1356885:8:1665690:1023","session_id":"1356885","input_length":132537,"t_proxy_recv":385107.308135853,"t_decision_unix":1779815972.3220773,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9928095550676415,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":953,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":10169,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":181458,"ongoing_decode_tokens":181458,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":132537,"score_linear":181458.0,"score_lmetric":265074},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2412,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":131584,"new_prefill":953,"score_linear":-131584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131584.0,"chosen_score_lmetric":0,"t_first_token":385107.972830006,"t_first_token_unix":1779815972.9867737,"t_done":385109.753767454,"t_done_unix":1779815974.767711},{"request_id":"1399948:48:1666394:1024","session_id":"1399948","input_length":40343,"t_proxy_recv":385109.724289727,"t_decision_unix":1779815974.7382307,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9899115088119377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":407,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1770,"cache_hit":0,"new_prefill":40343,"score_linear":98254.0,"score_lmetric":40343},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2412,"cache_hit":39936,"new_prefill":407,"score_linear":-39936.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":132537,"ongoing_decode_tokens":132537,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":40343,"score_linear":132537.0,"score_lmetric":40343},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":385109.796058249,"t_first_token_unix":1779815974.8100014,"t_done":385111.172371631,"t_done_unix":1779815976.1863153},{"request_id":"1399948:49:1668825:1025","session_id":"1399948","input_length":40642,"t_proxy_recv":385118.283368837,"t_decision_unix":1779815983.2973096,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9952266128635402,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1770,"cache_hit":0,"new_prefill":40642,"score_linear":98254.0,"score_lmetric":40642},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2413,"cache_hit":40448,"new_prefill":194,"score_linear":-40448.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":385118.402519112,"t_first_token_unix":1779815983.4164627,"t_done":385119.471818797,"t_done_unix":1779815984.4857624},{"request_id":"1294611:15:1673197:1026","session_id":"1294611","input_length":85542,"t_proxy_recv":385133.496829965,"t_decision_unix":1779815998.510771,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9935704098571462,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1770,"cache_hit":84992,"new_prefill":550,"score_linear":13262.0,"score_lmetric":550},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2413,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":13262.0,"chosen_score_lmetric":550,"t_first_token":385133.658868168,"t_first_token_unix":1779815998.6728117,"t_done":385136.248414741,"t_done_unix":1779816001.262366},{"request_id":"1253804:26:1663639:1021","session_id":"1253804","input_length":98254,"t_proxy_recv":385100.320631297,"t_decision_unix":1779815965.3345726,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9952979013577056,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":462,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":97792,"new_prefill":462,"score_linear":-14588.0,"score_lmetric":462},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":94670,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2412,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":94670,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2715,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14588.0,"chosen_score_lmetric":462,"t_first_token":385100.488806902,"t_first_token_unix":1779815965.5027502,"t_done":385139.671469398,"t_done_unix":1779816004.6854131},{"request_id":"1294611:15:1676489:1027","session_id":"1294611","input_length":85722,"t_proxy_recv":385144.881843543,"t_decision_unix":1779816009.8957849,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9974568955460675,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":218,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1772,"cache_hit":85504,"new_prefill":218,"score_linear":-85504.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2413,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":385145.010610768,"t_first_token_unix":1779816010.0245547,"t_done":385147.574356349,"t_done_unix":1779816012.5883002},{"request_id":"1399948:50:1677482:1028","session_id":"1399948","input_length":42648,"t_proxy_recv":385148.137243362,"t_decision_unix":1779816013.1511843,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9484149315325455,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":2200,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1772,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2413,"cache_hit":40448,"new_prefill":2200,"score_linear":-40448.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":385148.728246471,"t_first_token_unix":1779816013.7421904,"t_done":385152.348086951,"t_done_unix":1779816017.3620307},{"request_id":"1294611:15:1679070:1029","session_id":"1294611","input_length":86602,"t_proxy_recv":385153.564060051,"t_decision_unix":1779816018.5780013,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":85504,"affinity_cache_ratio":0.987321308976698,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":1098,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1772,"cache_hit":85504,"new_prefill":1098,"score_linear":-85504.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":385154.005665817,"t_first_token_unix":1779816019.0196097,"t_done":385156.764060063,"t_done_unix":1779816021.7780035},{"request_id":"1253804:27:1683133:1031","session_id":"1253804","input_length":101743,"t_proxy_recv":385167.19392603,"t_decision_unix":1779816032.2078671,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9963928722369106,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":367,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86925,"ongoing_decode_tokens":86925,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1774,"cache_hit":101376,"new_prefill":367,"score_linear":-14451.0,"score_lmetric":367},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":98159,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":98159,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14451.0,"chosen_score_lmetric":367,"t_first_token":385167.399976524,"t_first_token_unix":1779816032.4139202,"t_done":385167.876904415,"t_done_unix":1779816032.890848},{"request_id":"1294611:15:1682649:1030","session_id":"1294611","input_length":86925,"t_proxy_recv":385165.474122016,"t_decision_unix":1779816030.4880633,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":86528,"affinity_cache_ratio":0.9954328444060973,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":86528,"estimated_new_tokens":397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1774,"cache_hit":86528,"new_prefill":397,"score_linear":-86528.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-86528.0,"chosen_score_lmetric":0,"t_first_token":385165.610475871,"t_first_token_unix":1779816030.624419,"t_done":385169.85948425,"t_done_unix":1779816034.8734276},{"request_id":"1253804:28:1685257:1032","session_id":"1253804","input_length":101794,"t_proxy_recv":385174.194054114,"t_decision_unix":1779816039.2079952,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9958936676031986,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":101376,"new_prefill":418,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":98210,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":98210,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":385174.334968233,"t_first_token_unix":1779816039.3489113,"t_done":385175.046585221,"t_done_unix":1779816040.0605292},{"request_id":"1399948:51:1686626:1033","session_id":"1399948","input_length":43407,"t_proxy_recv":385179.126112069,"t_decision_unix":1779816044.1400533,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":43008,"affinity_cache_ratio":0.9908079342041606,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43008,"estimated_new_tokens":399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":43008,"new_prefill":399,"score_linear":-43008.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43008.0,"chosen_score_lmetric":0,"t_first_token":385179.287873401,"t_first_token_unix":1779816044.3018172,"t_done":385180.715797979,"t_done_unix":1779816045.7297416},{"request_id":"1253804:29:1688398:1034","session_id":"1253804","input_length":102067,"t_proxy_recv":385185.181140695,"t_decision_unix":1779816050.1950817,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9932299371981149,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":691,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":101376,"new_prefill":691,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":98483,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":98483,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":385185.493174792,"t_first_token_unix":1779816050.507118,"t_done":385186.499884484,"t_done_unix":1779816051.5138335},{"request_id":"1399948:52:1689144:1035","session_id":"1399948","input_length":43673,"t_proxy_recv":385187.760910399,"t_decision_unix":1779816052.7748518,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9964966913195796,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":153,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":43520,"new_prefill":153,"score_linear":-43520.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":385187.870317914,"t_first_token_unix":1779816052.8842616,"t_done":385188.598980654,"t_done_unix":1779816053.6129243},{"request_id":"1356885:9:1689871:1036","session_id":"1356885","input_length":132823,"t_proxy_recv":385190.139853594,"t_decision_unix":1779816055.1537943,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":132608,"affinity_cache_ratio":0.9983813044427546,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":132608,"estimated_new_tokens":215,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":10455,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":132608,"new_prefill":215,"score_linear":-132608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-132608.0,"chosen_score_lmetric":0,"t_first_token":385190.426589791,"t_first_token_unix":1779816055.440533,"t_done":385192.107082512,"t_done_unix":1779816057.121026},{"request_id":"1253804:30:1690362:1037","session_id":"1253804","input_length":102214,"t_proxy_recv":385191.79396224,"t_decision_unix":1779816056.8079038,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9968106130275696,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":326,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":101888,"new_prefill":326,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":98630,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":98630,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":132823,"ongoing_decode_tokens":132823,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":102214,"score_linear":132823.0,"score_lmetric":102214},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":385191.985747267,"t_first_token_unix":1779816056.9996908,"t_done":385192.739751257,"t_done_unix":1779816057.753695},{"request_id":"1253804:31:1691981:1038","session_id":"1253804","input_length":102322,"t_proxy_recv":385197.368858601,"t_decision_unix":1779816062.3827996,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9957584879107132,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":101888,"new_prefill":434,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":98738,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":98738,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":385197.520804502,"t_first_token_unix":1779816062.5347476,"t_done":385197.901958818,"t_done_unix":1779816062.9159024},{"request_id":"1399948:53:1692115:1039","session_id":"1399948","input_length":43938,"t_proxy_recv":385197.882411151,"t_decision_unix":1779816062.8963525,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9904865947471437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102322,"ongoing_decode_tokens":102322,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":0,"new_prefill":43938,"score_linear":102322.0,"score_lmetric":43938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":43520,"new_prefill":418,"score_linear":-43520.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":385198.03496463,"t_first_token_unix":1779816063.0489078,"t_done":385199.393282652,"t_done_unix":1779816064.407226},{"request_id":"1253804:32:1693715:1040","session_id":"1253804","input_length":102509,"t_proxy_recv":385203.452951811,"t_decision_unix":1779816068.4668932,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9939419953369948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":621,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":101888,"new_prefill":621,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":98925,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":98925,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":385203.763442299,"t_first_token_unix":1779816068.777386,"t_done":385204.536157097,"t_done_unix":1779816069.5501008},{"request_id":"1399948:54:1694570:1041","session_id":"1399948","input_length":44182,"t_proxy_recv":385206.542049988,"t_decision_unix":1779816071.5559914,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9966049522429948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":150,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":44032,"new_prefill":150,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":385206.650525106,"t_first_token_unix":1779816071.6644688,"t_done":385206.925561264,"t_done_unix":1779816071.9395046},{"request_id":"1253804:33:1695393:1042","session_id":"1253804","input_length":102632,"t_proxy_recv":385209.206078124,"t_decision_unix":1779816074.2200193,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102400,"affinity_cache_ratio":0.9977394964533479,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102400,"estimated_new_tokens":232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":102400,"new_prefill":232,"score_linear":-102400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":99048,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":99048,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102400.0,"chosen_score_lmetric":0,"t_first_token":385209.399081736,"t_first_token_unix":1779816074.4130254,"t_done":385209.898792022,"t_done_unix":1779816074.9127362},{"request_id":"1253804:34:1697569:1043","session_id":"1253804","input_length":102792,"t_proxy_recv":385217.042634656,"t_decision_unix":1779816082.056576,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102400,"affinity_cache_ratio":0.9961864736555374,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102400,"estimated_new_tokens":392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":102400,"new_prefill":392,"score_linear":-102400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":99208,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":99208,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102400.0,"chosen_score_lmetric":0,"t_first_token":385217.292028391,"t_first_token_unix":1779816082.3059716,"t_done":385220.67302985,"t_done_unix":1779816085.686974},{"request_id":"1253804:35:1701250:1044","session_id":"1253804","input_length":103349,"t_proxy_recv":385229.587252291,"t_decision_unix":1779816094.6011934,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102912,"affinity_cache_ratio":0.9957716088205981,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102912,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1778,"cache_hit":102912,"new_prefill":437,"score_linear":-102912.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":99765,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":99765,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102912.0,"chosen_score_lmetric":0,"t_first_token":385229.905770911,"t_first_token_unix":1779816094.919715,"t_done":385230.211621086,"t_done_unix":1779816095.2255654},{"request_id":"1253804:36:1702697:1045","session_id":"1253804","input_length":103400,"t_proxy_recv":385234.740928596,"t_decision_unix":1779816099.75487,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102912,"affinity_cache_ratio":0.9952804642166344,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102912,"estimated_new_tokens":488,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1778,"cache_hit":102912,"new_prefill":488,"score_linear":-102912.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":99816,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":99816,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102912.0,"chosen_score_lmetric":0,"t_first_token":385234.881589822,"t_first_token_unix":1779816099.8955336,"t_done":385235.329394954,"t_done_unix":1779816100.3433392},{"request_id":"1399948:55:1704272:1047","session_id":"1399948","input_length":45284,"t_proxy_recv":385240.005322231,"t_decision_unix":1779816105.0192637,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9723522657009098,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":45284,"score_linear":103471.0,"score_lmetric":45284},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":44032,"new_prefill":1252,"score_linear":-44032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":385240.438949777,"t_first_token_unix":1779816105.452894,"t_done":385242.099410991,"t_done_unix":1779816107.1133566},{"request_id":"1356885:10:1706624:1048","session_id":"1356885","input_length":133014,"t_proxy_recv":385248.333336202,"t_decision_unix":1779816113.3472772,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":132608,"affinity_cache_ratio":0.9969476897168719,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":132608,"estimated_new_tokens":406,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":10646,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":133014,"score_linear":103471.0,"score_lmetric":133014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2422,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":132608,"new_prefill":406,"score_linear":-132608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-132608.0,"chosen_score_lmetric":0,"t_first_token":385248.594551786,"t_first_token_unix":1779816113.6084955,"t_done":385250.054016257,"t_done_unix":1779816115.0679605},{"request_id":"1253804:37:1704071:1046","session_id":"1253804","input_length":103471,"t_proxy_recv":385239.209738301,"t_decision_unix":1779816104.2236793,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":103424,"affinity_cache_ratio":0.9995457664466372,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":103424,"estimated_new_tokens":47,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":103424,"new_prefill":47,"score_linear":-103424.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":99887,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":99887,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2717,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-103424.0,"chosen_score_lmetric":0,"t_first_token":385239.350991375,"t_first_token_unix":1779816104.3649352,"t_done":385254.710118285,"t_done_unix":1779816119.7240622},{"request_id":"1399948:56:1708284:1049","session_id":"1399948","input_length":45571,"t_proxy_recv":385254.043990033,"t_decision_unix":1779816119.057931,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9886989532816923,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":515,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":45571,"score_linear":103471.0,"score_lmetric":45571},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2422,"cache_hit":45056,"new_prefill":515,"score_linear":-45056.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":385254.159538595,"t_first_token_unix":1779816119.173482,"t_done":385255.049837002,"t_done_unix":1779816120.0637803},{"request_id":"1399948:57:1711464:1050","session_id":"1399948","input_length":45756,"t_proxy_recv":385264.839578042,"t_decision_unix":1779816129.8535192,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":45568,"affinity_cache_ratio":0.995891249235073,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45568,"estimated_new_tokens":188,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1781,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2423,"cache_hit":45568,"new_prefill":188,"score_linear":-45568.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45568.0,"chosen_score_lmetric":0,"t_first_token":385264.951847964,"t_first_token_unix":1779816129.9657917,"t_done":385267.407255512,"t_done_unix":1779816132.421199},{"request_id":"1253804:38:1712824:1051","session_id":"1253804","input_length":104953,"t_proxy_recv":385269.667715785,"t_decision_unix":1779816134.6816568,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104448,"affinity_cache_ratio":0.9951883223919278,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104448,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1781,"cache_hit":104448,"new_prefill":505,"score_linear":-104448.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":101369,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":101369,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104448.0,"chosen_score_lmetric":0,"t_first_token":385269.868198772,"t_first_token_unix":1779816134.8821428,"t_done":385270.180199147,"t_done_unix":1779816135.1941433},{"request_id":"1253804:39:1714767:1052","session_id":"1253804","input_length":105004,"t_proxy_recv":385276.249746133,"t_decision_unix":1779816141.2636874,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104960,"affinity_cache_ratio":0.9995809683440631,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104960,"estimated_new_tokens":44,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1782,"cache_hit":104960,"new_prefill":44,"score_linear":-104960.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":101420,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":101420,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104960.0,"chosen_score_lmetric":0,"t_first_token":385276.394417025,"t_first_token_unix":1779816141.4083605,"t_done":385276.965486588,"t_done_unix":1779816141.9794302},{"request_id":"1253804:40:1716790:1053","session_id":"1253804","input_length":105156,"t_proxy_recv":385282.958741914,"t_decision_unix":1779816147.9726832,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104960,"affinity_cache_ratio":0.9981361025523984,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104960,"estimated_new_tokens":196,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1782,"cache_hit":104960,"new_prefill":196,"score_linear":-104960.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":101572,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":3584,"new_prefill":101572,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104960.0,"chosen_score_lmetric":0,"t_first_token":385283.212772436,"t_first_token_unix":1779816148.226716,"t_done":385287.844067761,"t_done_unix":1779816152.8580117},{"request_id":"1305906:4:1718131:1054","session_id":"1305906","input_length":47861,"t_proxy_recv":385287.413774385,"t_decision_unix":1779816152.4277153,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9413927832682142,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":2805,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":105156,"ongoing_decode_tokens":105156,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1782,"cache_hit":0,"new_prefill":47861,"score_linear":105156.0,"score_lmetric":47861},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":45056,"new_prefill":2805,"score_linear":-45056.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":385288.350439405,"t_first_token_unix":1779816153.364383,"t_done":385290.404750739,"t_done_unix":1779816155.4186978},{"request_id":"1305906:5:1514292:934","session_id":"1305906","input_length":49817,"t_proxy_recv":385290.41634123,"t_decision_unix":1779816155.4302824,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9660959110343859,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":1689,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1786,"cache_hit":48128,"new_prefill":1689,"score_linear":-48128.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37173,"ongoing_decode_tokens":0,"pending_prefill_tokens":1845,"num_requests":1,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":0,"new_prefill":49817,"score_linear":37173.0,"score_lmetric":51662},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":385291.074208678,"t_first_token_unix":1779816156.088153,"t_done":385291.738521232,"t_done_unix":1779816156.7524645},{"request_id":"1340290:13:1718889:1055","session_id":"1340290","input_length":37173,"t_proxy_recv":385290.040755861,"t_decision_unix":1779816155.0546968,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9503672020014526,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":1845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":20992,"new_prefill":16181,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":47861,"ongoing_decode_tokens":47861,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":37173,"score_linear":47861.0,"score_lmetric":37173},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2718,"cache_hit":35328,"new_prefill":1845,"score_linear":-35328.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":385290.562977753,"t_first_token_unix":1779816155.5769217,"t_done":385292.166218537,"t_done_unix":1779816157.1801622},{"request_id":"1253804:41:1721979:1057","session_id":"1253804","input_length":105638,"t_proxy_recv":385300.635891245,"t_decision_unix":1779816165.6498322,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9984285957704614,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":105472,"new_prefill":166,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":102054,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":102054,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37438,"ongoing_decode_tokens":37438,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":0,"new_prefill":105638,"score_linear":37438.0,"score_lmetric":105638},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":385300.83759928,"t_first_token_unix":1779816165.851543,"t_done":385301.482251882,"t_done_unix":1779816166.496196},{"request_id":"1340290:14:1721731:1056","session_id":"1340290","input_length":37438,"t_proxy_recv":385299.763819126,"t_decision_unix":1779816164.77776,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":37376,"affinity_cache_ratio":0.998343928628666,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":62,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":20992,"new_prefill":16446,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":37376,"new_prefill":62,"score_linear":-37376.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":385299.853630502,"t_first_token_unix":1779816164.8675742,"t_done":385301.594936533,"t_done_unix":1779816166.60888},{"request_id":"1253804:42:1724453:1058","session_id":"1253804","input_length":105715,"t_proxy_recv":385309.13989282,"t_decision_unix":1779816174.153832,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9977013668826562,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":243,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":105472,"new_prefill":243,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":102131,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":102131,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":385309.2847814,"t_first_token_unix":1779816174.2987254,"t_done":385310.061764207,"t_done_unix":1779816175.0757089},{"request_id":"1253804:43:1726322:1060","session_id":"1253804","input_length":105845,"t_proxy_recv":385315.212943392,"t_decision_unix":1779816180.2268846,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9964759790259341,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":373,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":105472,"new_prefill":373,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":102261,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":102261,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":0,"new_prefill":105845,"score_linear":37724.0,"score_lmetric":105845},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":385315.412410802,"t_first_token_unix":1779816180.4263544,"t_done":385316.100735224,"t_done_unix":1779816181.1146793},{"request_id":"1399948:58:1726693:1061","session_id":"1399948","input_length":46886,"t_proxy_recv":385316.428201614,"t_decision_unix":1779816181.4421427,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":46080,"affinity_cache_ratio":0.982809367401783,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":806,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":46080,"new_prefill":806,"score_linear":-46080.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":0,"new_prefill":46886,"score_linear":37724.0,"score_lmetric":46886},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":385316.782354794,"t_first_token_unix":1779816181.7962987,"t_done":385316.911707706,"t_done_unix":1779816181.9256516},{"request_id":"1399948:59:1728305:1062","session_id":"1399948","input_length":46927,"t_proxy_recv":385321.721802942,"t_decision_unix":1779816186.7357442,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":46592,"affinity_cache_ratio":0.9928612525838004,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":335,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":46592,"new_prefill":335,"score_linear":-46592.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":0,"new_prefill":46927,"score_linear":37724.0,"score_lmetric":46927},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46592.0,"chosen_score_lmetric":0,"t_first_token":385321.810337725,"t_first_token_unix":1779816186.8242817,"t_done":385321.946545304,"t_done_unix":1779816186.9604893},{"request_id":"1253804:44:1728625:1063","session_id":"1253804","input_length":106070,"t_proxy_recv":385322.915307399,"t_decision_unix":1779816187.9292483,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9943622136325069,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":598,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":105472,"new_prefill":598,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":102486,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":102486,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":0,"new_prefill":106070,"score_linear":37724.0,"score_lmetric":106070},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":385323.235744165,"t_first_token_unix":1779816188.2496884,"t_done":385324.271297017,"t_done_unix":1779816189.2852411},{"request_id":"1340290:15:1725612:1059","session_id":"1340290","input_length":37724,"t_proxy_recv":385312.946258512,"t_decision_unix":1779816177.9601994,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9907751033824621,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":20992,"new_prefill":16732,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2722,"cache_hit":37376,"new_prefill":348,"score_linear":-37376.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":385313.022184504,"t_first_token_unix":1779816178.0361283,"t_done":385330.34213714,"t_done_unix":1779816195.356092},{"request_id":"1253804:45:1732408:1064","session_id":"1253804","input_length":106394,"t_proxy_recv":385335.882036625,"t_decision_unix":1779816200.895977,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9961463992330395,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":410,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":105984,"new_prefill":410,"score_linear":-105984.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":102810,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":102810,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":385336.209664371,"t_first_token_unix":1779816201.2236083,"t_done":385336.57928057,"t_done_unix":1779816201.5932245},{"request_id":"1399948:60:1732843:1065","session_id":"1399948","input_length":47074,"t_proxy_recv":385337.47402466,"t_decision_unix":1779816202.4879656,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":46592,"affinity_cache_ratio":0.9897608021413095,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":482,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":46592,"new_prefill":482,"score_linear":-46592.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46592.0,"chosen_score_lmetric":0,"t_first_token":385337.606119422,"t_first_token_unix":1779816202.6200633,"t_done":385337.967355756,"t_done_unix":1779816202.9812992},{"request_id":"1253804:46:1733935:1066","session_id":"1253804","input_length":106443,"t_proxy_recv":385340.973527428,"t_decision_unix":1779816205.9874685,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9956878329246639,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":459,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":105984,"new_prefill":459,"score_linear":-105984.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":102859,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":102859,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":385341.126463607,"t_first_token_unix":1779816206.1404076,"t_done":385341.835694287,"t_done_unix":1779816206.8496385},{"request_id":"1399948:61:1735933:1067","session_id":"1399948","input_length":47205,"t_proxy_recv":385347.671481514,"t_decision_unix":1779816212.6854227,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":47104,"affinity_cache_ratio":0.9978603961444762,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47104,"estimated_new_tokens":101,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":47104,"new_prefill":101,"score_linear":-47104.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47104.0,"chosen_score_lmetric":0,"t_first_token":385347.786297098,"t_first_token_unix":1779816212.800241,"t_done":385349.299485701,"t_done_unix":1779816214.3134298},{"request_id":"1253804:47:1736337:1068","session_id":"1253804","input_length":107137,"t_proxy_recv":385348.951068251,"t_decision_unix":1779816213.9650097,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":106496,"affinity_cache_ratio":0.994017006263009,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":641,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":106496,"new_prefill":641,"score_linear":-106496.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":103553,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":47205,"ongoing_decode_tokens":47205,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":107137,"score_linear":47205.0,"score_lmetric":107137},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":103553,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-106496.0,"chosen_score_lmetric":0,"t_first_token":385349.664126035,"t_first_token_unix":1779816214.6780696,"t_done":385350.076704986,"t_done_unix":1779816215.0906487},{"request_id":"1253804:48:1737694:1069","session_id":"1253804","input_length":108145,"t_proxy_recv":385353.387294586,"t_decision_unix":1779816218.401235,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":107008,"affinity_cache_ratio":0.98948633778723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1786,"cache_hit":107008,"new_prefill":1137,"score_linear":-107008.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":104561,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":104561,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":385354.305818425,"t_first_token_unix":1779816219.3197622,"t_done":385354.729210803,"t_done_unix":1779816219.7431552},{"request_id":"1253804:49:1739030:1070","session_id":"1253804","input_length":109454,"t_proxy_recv":385357.782637198,"t_decision_unix":1779816222.796578,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9870082409048551,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":1422,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":108032,"new_prefill":1422,"score_linear":-108032.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":105870,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":105870,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":385358.919505699,"t_first_token_unix":1779816223.9334495,"t_done":385359.344827776,"t_done_unix":1779816224.358772},{"request_id":"1253804:50:1741670:1071","session_id":"1253804","input_length":110854,"t_proxy_recv":385366.752816925,"t_decision_unix":1779816231.7667582,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9837804680029588,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":1798,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1790,"cache_hit":109056,"new_prefill":1798,"score_linear":-109056.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":107270,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":107270,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":385367.901059792,"t_first_token_unix":1779816232.915003,"t_done":385368.333355332,"t_done_unix":1779816233.347299},{"request_id":"1253804:51:1744514:1072","session_id":"1253804","input_length":111661,"t_proxy_recv":385376.171805765,"t_decision_unix":1779816241.1857471,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":110592,"affinity_cache_ratio":0.9904263798461415,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":110592,"estimated_new_tokens":1069,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1793,"cache_hit":110592,"new_prefill":1069,"score_linear":-110592.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":108077,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":108077,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-110592.0,"chosen_score_lmetric":0,"t_first_token":385376.92627045,"t_first_token_unix":1779816241.9402137,"t_done":385377.350877618,"t_done_unix":1779816242.3648212},{"request_id":"1340290:16:1745847:1073","session_id":"1340290","input_length":40200,"t_proxy_recv":385380.78495215,"t_decision_unix":1779816245.7988932,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9934328358208955,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":264,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":20992,"new_prefill":19208,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":39936,"new_prefill":264,"score_linear":-39936.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":385380.863990616,"t_first_token_unix":1779816245.877934,"t_done":385381.581388343,"t_done_unix":1779816246.595332},{"request_id":"1253804:52:1746191:1074","session_id":"1253804","input_length":111724,"t_proxy_recv":385381.815269431,"t_decision_unix":1779816246.8292105,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9990333321399162,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":111616,"new_prefill":108,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":108140,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":108140,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":385381.967485664,"t_first_token_unix":1779816246.981429,"t_done":385382.74784155,"t_done_unix":1779816247.761789},{"request_id":"1253804:53:1748377:1075","session_id":"1253804","input_length":111811,"t_proxy_recv":385389.14887442,"t_decision_unix":1779816254.1628153,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9982559855470392,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":111616,"new_prefill":195,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":108227,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":108227,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":385389.298949421,"t_first_token_unix":1779816254.3128932,"t_done":385389.788824079,"t_done_unix":1779816254.8027682},{"request_id":"1399948:62:1749028:1076","session_id":"1399948","input_length":48212,"t_proxy_recv":385391.313127596,"t_decision_unix":1779816256.3270683,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":47104,"affinity_cache_ratio":0.9770181697502697,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47104,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":47104,"new_prefill":1108,"score_linear":-47104.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47104.0,"chosen_score_lmetric":0,"t_first_token":385391.675296587,"t_first_token_unix":1779816256.6892402,"t_done":385392.224380167,"t_done_unix":1779816257.238324},{"request_id":"1253804:54:1750056:1077","session_id":"1253804","input_length":112074,"t_proxy_recv":385394.745233048,"t_decision_unix":1779816259.759174,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9959134143512323,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":111616,"new_prefill":458,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":3584,"new_prefill":108490,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2428,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":3584,"new_prefill":108490,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":385395.083791049,"t_first_token_unix":1779816260.0977354,"t_done":385400.98796565,"t_done_unix":1779816266.0019102},{"request_id":"1399948:63:1753316:1079","session_id":"1399948","input_length":48636,"t_proxy_recv":385405.610872343,"t_decision_unix":1779816270.6248136,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9895550620939222,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":508,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2428,"cache_hit":48128,"new_prefill":508,"score_linear":-48128.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":133552,"ongoing_decode_tokens":0,"pending_prefill_tokens":432,"num_requests":1,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":48636,"score_linear":133552.0,"score_lmetric":49068},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":385405.870775752,"t_first_token_unix":1779816270.8847194,"t_done":385405.978889142,"t_done_unix":1779816270.9928331},{"request_id":"1399948:64:1754453:1080","session_id":"1399948","input_length":48693,"t_proxy_recv":385409.52210188,"t_decision_unix":1779816274.5360432,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9989115478610888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":53,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2429,"cache_hit":48640,"new_prefill":53,"score_linear":-48640.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":133552,"ongoing_decode_tokens":133552,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":0,"new_prefill":48693,"score_linear":133552.0,"score_lmetric":48693},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48640.0,"chosen_score_lmetric":0,"t_first_token":385409.656171687,"t_first_token_unix":1779816274.6701148,"t_done":385410.907296085,"t_done_unix":1779816275.9212396},{"request_id":"1356885:11:1753167:1078","session_id":"1356885","input_length":133552,"t_proxy_recv":385405.18722387,"t_decision_unix":1779816270.201164,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":133120,"affinity_cache_ratio":0.9967653048999641,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":133120,"estimated_new_tokens":432,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":11184,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2428,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2723,"cache_hit":133120,"new_prefill":432,"score_linear":-133120.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-133120.0,"chosen_score_lmetric":0,"t_first_token":385405.83634139,"t_first_token_unix":1779816270.8502855,"t_done":385423.000346853,"t_done_unix":1779816288.0142903},{"request_id":"1399948:65:1759200:1081","session_id":"1399948","input_length":49220,"t_proxy_recv":385426.017734981,"t_decision_unix":1779816291.0316765,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9882161722876879,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2429,"cache_hit":48640,"new_prefill":580,"score_linear":-48640.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48640.0,"chosen_score_lmetric":0,"t_first_token":385426.289441426,"t_first_token_unix":1779816291.3033848,"t_done":385431.806924531,"t_done_unix":1779816296.8208706},{"request_id":"1277428:14:1767578:1082","session_id":"1277428","input_length":49716,"t_proxy_recv":385454.888662148,"t_decision_unix":1779816319.9026036,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9886555636012552,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":564,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":45108,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":49152,"new_prefill":564,"score_linear":-49152.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2431,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":17408,"new_prefill":32308,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":385455.066023636,"t_first_token_unix":1779816320.079967,"t_done":385456.098289842,"t_done_unix":1779816321.1122332},{"request_id":"1277428:14:1770237:1083","session_id":"1277428","input_length":49925,"t_proxy_recv":385464.226310959,"t_decision_unix":1779816329.240252,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.994772158237356,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":45317,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1609,"cache_hit":49664,"new_prefill":261,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2431,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":17408,"new_prefill":32517,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":385464.337464862,"t_first_token_unix":1779816329.3514087,"t_done":385464.647844705,"t_done_unix":1779816329.6617885},{"request_id":"1277428:15:1771467:1084","session_id":"1277428","input_length":51398,"t_proxy_recv":385468.296334587,"t_decision_unix":1779816333.3102741,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9662632787267987,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":1734,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":46790,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1609,"cache_hit":49664,"new_prefill":1734,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2431,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":17408,"new_prefill":33990,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":385468.876270161,"t_first_token_unix":1779816333.8902142,"t_done":385472.352052824,"t_done_unix":1779816337.3659961},{"request_id":"1399948:66:1772336:1085","session_id":"1399948","input_length":51012,"t_proxy_recv":385471.245459224,"t_decision_unix":1779816336.2594004,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9735748451344781,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":1348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":51398,"ongoing_decode_tokens":51398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1609,"cache_hit":0,"new_prefill":51012,"score_linear":51398.0,"score_lmetric":51012},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2431,"cache_hit":49664,"new_prefill":1348,"score_linear":-49664.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":385471.722903014,"t_first_token_unix":1779816336.7368467,"t_done":385474.661628427,"t_done_unix":1779816339.6755722},{"request_id":"1399948:67:1777074:1086","session_id":"1399948","input_length":52331,"t_proxy_recv":385487.311659503,"t_decision_unix":1779816352.3256009,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9783875714203818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":1131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1613,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2434,"cache_hit":51200,"new_prefill":1131,"score_linear":-51200.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":385487.791181333,"t_first_token_unix":1779816352.8051245,"t_done":385492.075357856,"t_done_unix":1779816357.0893016},{"request_id":"1399948:68:1784799:1087","session_id":"1399948","input_length":53289,"t_proxy_recv":385513.811851027,"t_decision_unix":1779816378.8257926,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9896226238060387,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1613,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2437,"cache_hit":52736,"new_prefill":553,"score_linear":-52736.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":385514.095930728,"t_first_token_unix":1779816379.1098745,"t_done":385518.367887246,"t_done_unix":1779816383.3818307},{"request_id":"1277428:16:1787662:1088","session_id":"1277428","input_length":52754,"t_proxy_recv":385524.249261888,"t_decision_unix":1779816389.2632031,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51712,"affinity_cache_ratio":0.9802479432839216,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51712,"estimated_new_tokens":1042,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":48146,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1613,"cache_hit":51712,"new_prefill":1042,"score_linear":-51712.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2439,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":17408,"new_prefill":35346,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51712.0,"chosen_score_lmetric":0,"t_first_token":385524.645831897,"t_first_token_unix":1779816389.659776,"t_done":385525.235230903,"t_done_unix":1779816390.2491744},{"request_id":"1305906:5:1788459:1089","session_id":"1305906","input_length":52461,"t_proxy_recv":385526.78479005,"t_decision_unix":1779816391.798731,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.946684203503555,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":2797,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1615,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2439,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":49664,"new_prefill":2797,"score_linear":-49664.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":385527.778486174,"t_first_token_unix":1779816392.7924302,"t_done":385528.279575126,"t_done_unix":1779816393.2935212},{"request_id":"1399948:69:1790968:1090","session_id":"1399948","input_length":54141,"t_proxy_recv":385535.380419985,"t_decision_unix":1779816400.3943613,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9929628193051476,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1615,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2439,"cache_hit":53760,"new_prefill":381,"score_linear":-53760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":51255,"ongoing_decode_tokens":51255,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1794,"cache_hit":0,"new_prefill":54141,"score_linear":51255.0,"score_lmetric":54141},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":385535.66441866,"t_first_token_unix":1779816400.678362,"t_done":385539.520752188,"t_done_unix":1779816404.534696},{"request_id":"1305906:6:1529600:945","session_id":"1305906","input_length":51255,"t_proxy_recv":385528.289783972,"t_decision_unix":1779816393.3037252,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9989269339576626,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":55,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1615,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2439,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1794,"cache_hit":51200,"new_prefill":55,"score_linear":-51200.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":385528.365128739,"t_first_token_unix":1779816393.3790722,"t_done":385543.22253002,"t_done_unix":1779816408.236474},{"request_id":"1277428:17:1793546:1091","session_id":"1277428","input_length":53574,"t_proxy_recv":385544.382488168,"t_decision_unix":1779816409.3964295,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9843580841452944,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":838,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":48966,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1615,"cache_hit":52736,"new_prefill":838,"score_linear":-52736.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2440,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":17408,"new_prefill":36166,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":385544.777150451,"t_first_token_unix":1779816409.7910943,"t_done":385546.080165064,"t_done_unix":1779816411.0941083},{"request_id":"1399948:70:1795589:1092","session_id":"1399948","input_length":54654,"t_proxy_recv":385551.703456712,"t_decision_unix":1779816416.717398,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9930105756211806,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":382,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1616,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2440,"cache_hit":54272,"new_prefill":382,"score_linear":-54272.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":385551.796628209,"t_first_token_unix":1779816416.8105717,"t_done":385552.721961978,"t_done_unix":1779816417.7359056},{"request_id":"1277428:18:1796824:1093","session_id":"1277428","input_length":53805,"t_proxy_recv":385556.300305776,"t_decision_unix":1779816421.3142471,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":53248,"affinity_cache_ratio":0.9896478022488616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53248,"estimated_new_tokens":557,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":49197,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1616,"cache_hit":53248,"new_prefill":557,"score_linear":-53248.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2440,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":17408,"new_prefill":36397,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53248.0,"chosen_score_lmetric":0,"t_first_token":385556.433285444,"t_first_token_unix":1779816421.4472291,"t_done":385556.799277887,"t_done_unix":1779816421.8132215},{"request_id":"1399948:71:1800797:1094","session_id":"1399948","input_length":54920,"t_proxy_recv":385569.884707804,"t_decision_unix":1779816434.898649,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9882010196649672,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":648,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2440,"cache_hit":54272,"new_prefill":648,"score_linear":-54272.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":385570.064600118,"t_first_token_unix":1779816435.0785437,"t_done":385572.121926635,"t_done_unix":1779816437.1358702},{"request_id":"1399948:72:1804699:1097","session_id":"1399948","input_length":55246,"t_proxy_recv":385583.343787942,"t_decision_unix":1779816448.3577292,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9916374036129313,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":462,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":55246,"score_linear":112634.0,"score_lmetric":55246},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2441,"cache_hit":54784,"new_prefill":462,"score_linear":56952.0,"score_lmetric":462},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":56952.0,"chosen_score_lmetric":462,"t_first_token":385583.46207799,"t_first_token_unix":1779816448.4760213,"t_done":385584.219274621,"t_done_unix":1779816449.2332246},{"request_id":"1305906:6:1806419:1099","session_id":"1305906","input_length":52932,"t_proxy_recv":385589.032534943,"t_decision_unix":1779816454.0464761,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9962971359480087,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":196,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":52932,"score_linear":112634.0,"score_lmetric":52932},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167295,"ongoing_decode_tokens":167295,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2442,"cache_hit":0,"new_prefill":52932,"score_linear":167295.0,"score_lmetric":105864},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":52736,"new_prefill":196,"score_linear":-52736.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":385589.120919304,"t_first_token_unix":1779816454.134863,"t_done":385589.818458766,"t_done_unix":1779816454.8324027},{"request_id":"1399948:73:1805981:1098","session_id":"1399948","input_length":55559,"t_proxy_recv":385587.522718654,"t_decision_unix":1779816452.5366597,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9952662934898037,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":263,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":55559,"score_linear":112634.0,"score_lmetric":55559},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2442,"cache_hit":55296,"new_prefill":263,"score_linear":56440.0,"score_lmetric":263},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":56440.0,"chosen_score_lmetric":263,"t_first_token":385587.721449338,"t_first_token_unix":1779816452.735393,"t_done":385590.128210582,"t_done_unix":1779816455.1421545},{"request_id":"1305906:7:1572780:964","session_id":"1305906","input_length":54789,"t_proxy_recv":385589.82974237,"t_decision_unix":1779816454.843684,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9625289747942105,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2053,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":54789,"score_linear":112634.0,"score_lmetric":54789},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167295,"ongoing_decode_tokens":167295,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2442,"cache_hit":0,"new_prefill":54789,"score_linear":167295.0,"score_lmetric":109578},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":52736,"new_prefill":2053,"score_linear":-52736.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":385590.547130623,"t_first_token_unix":1779816455.5610745,"t_done":385590.845729718,"t_done_unix":1779816455.8596733},{"request_id":"1399948:74:1808473:1100","session_id":"1399948","input_length":55791,"t_proxy_recv":385596.223973923,"t_decision_unix":1779816461.237915,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9911276012260042,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":495,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":55791,"score_linear":112634.0,"score_lmetric":55791},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2442,"cache_hit":55296,"new_prefill":495,"score_linear":56440.0,"score_lmetric":495},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":56440.0,"chosen_score_lmetric":495,"t_first_token":385596.37428446,"t_first_token_unix":1779816461.3882282,"t_done":385599.865858945,"t_done_unix":1779816464.879805},{"request_id":"1399948:75:1817312:1101","session_id":"1399948","input_length":57308,"t_proxy_recv":385624.760062177,"t_decision_unix":1779816489.7740033,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9738256438891604,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":1500,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":57308,"score_linear":112634.0,"score_lmetric":57308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2443,"cache_hit":55808,"new_prefill":1500,"score_linear":55928.0,"score_lmetric":1500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":55928.0,"chosen_score_lmetric":1500,"t_first_token":385625.400220467,"t_first_token_unix":1779816490.4141648,"t_done":385626.985154344,"t_done_unix":1779816491.999106},{"request_id":"1270606:6:1804345:1096","session_id":"1270606","input_length":111736,"t_proxy_recv":385582.181454419,"t_decision_unix":1779816447.1953955,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9989260399513138,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":120,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":111736,"score_linear":112634.0,"score_lmetric":111736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2441,"cache_hit":111616,"new_prefill":120,"score_linear":-111616.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":110200,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":385582.456768564,"t_first_token_unix":1779816447.4707117,"t_done":385627.617759697,"t_done_unix":1779816492.6317036},{"request_id":"1399948:76:1821495:1102","session_id":"1399948","input_length":57659,"t_proxy_recv":385638.417504786,"t_decision_unix":1779816503.4314458,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9945368459390554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":57659,"score_linear":112634.0,"score_lmetric":57659},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2448,"cache_hit":57344,"new_prefill":315,"score_linear":-57344.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":385638.618783519,"t_first_token_unix":1779816503.6327274,"t_done":385639.270171063,"t_done_unix":1779816504.2841148},{"request_id":"1270606:6:1822681:1103","session_id":"1270606","input_length":112180,"t_proxy_recv":385642.258990635,"t_decision_unix":1779816507.2729318,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9995364592619005,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":52,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":112180,"score_linear":112634.0,"score_lmetric":112180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2448,"cache_hit":112128,"new_prefill":52,"score_linear":-112128.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":110644,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":385642.400017189,"t_first_token_unix":1779816507.413961,"t_done":385643.283997441,"t_done_unix":1779816508.2979515},{"request_id":"1270606:7:1825806:1104","session_id":"1270606","input_length":112645,"t_proxy_recv":385652.878095266,"t_decision_unix":1779816517.8920364,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9954103599804697,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":517,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":112645,"score_linear":112634.0,"score_lmetric":112645},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2448,"cache_hit":112128,"new_prefill":517,"score_linear":-112128.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":111109,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":385653.434417594,"t_first_token_unix":1779816518.4483616,"t_done":385657.471407501,"t_done_unix":1779816522.4853556},{"request_id":"1277428:19:1834491:1105","session_id":"1277428","input_length":58474,"t_proxy_recv":385682.146967244,"t_decision_unix":1779816547.1609085,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9193829736293053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":4714,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":4608,"new_prefill":53866,"score_linear":108026.0,"score_lmetric":53866},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":53760,"new_prefill":4714,"score_linear":-53760.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2449,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":17408,"new_prefill":41066,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":385683.883786243,"t_first_token_unix":1779816548.89773,"t_done":385684.210540663,"t_done_unix":1779816549.2244844},{"request_id":"1270606:8:1837578:1106","session_id":"1270606","input_length":113482,"t_proxy_recv":385692.974827025,"t_decision_unix":1779816557.9887683,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":112640,"affinity_cache_ratio":0.9925803211081934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":842,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":0,"new_prefill":113482,"score_linear":112634.0,"score_lmetric":113482},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2449,"cache_hit":112640,"new_prefill":842,"score_linear":-112640.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":111946,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":385693.540095997,"t_first_token_unix":1779816558.5540392,"t_done":385693.963828184,"t_done_unix":1779816558.9777722},{"request_id":"1253804:55:1803044:1095","session_id":"1253804","input_length":112634,"t_proxy_recv":385577.764158421,"t_decision_unix":1779816442.7780998,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9955075732016976,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":506,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1796,"cache_hit":112128,"new_prefill":506,"score_linear":-112128.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":3584,"new_prefill":109050,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2441,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":3584,"new_prefill":109050,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":385577.930387414,"t_first_token_unix":1779816442.9443312,"t_done":385701.726010079,"t_done_unix":1779816566.7399545},{"request_id":"1270606:9:1847569:1107","session_id":"1270606","input_length":116467,"t_proxy_recv":385726.858258905,"t_decision_unix":1779816591.8722003,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":113152,"affinity_cache_ratio":0.9715370018975332,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":113152,"estimated_new_tokens":3315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2450,"cache_hit":113152,"new_prefill":3315,"score_linear":-113152.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":114931,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-113152.0,"chosen_score_lmetric":0,"t_first_token":385729.105256125,"t_first_token_unix":1779816594.1191998,"t_done":385730.626190154,"t_done_unix":1779816595.640143},{"request_id":"1270606:10:1851128:1108","session_id":"1270606","input_length":116659,"t_proxy_recv":385738.959417497,"t_decision_unix":1779816603.9733586,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9962711835349181,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2456,"cache_hit":116224,"new_prefill":435,"score_linear":-116224.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":115123,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-116224.0,"chosen_score_lmetric":0,"t_first_token":385739.204785782,"t_first_token_unix":1779816604.2187293,"t_done":385739.956376506,"t_done_unix":1779816604.9703202},{"request_id":"1305906:7:1851943:1109","session_id":"1305906","input_length":58042,"t_proxy_recv":385741.506150519,"t_decision_unix":1779816606.520092,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9438682333482651,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":3258,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2456,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":54784,"new_prefill":3258,"score_linear":-54784.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":385742.809221827,"t_first_token_unix":1779816607.8231657,"t_done":385745.036210314,"t_done_unix":1779816610.050154},{"request_id":"1305906:8:1866131:1110","session_id":"1305906","input_length":58687,"t_proxy_recv":385790.007061257,"t_decision_unix":1779816655.0210025,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9858401349532264,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":831,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2456,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1805,"cache_hit":57856,"new_prefill":831,"score_linear":-57856.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":385790.315350891,"t_first_token_unix":1779816655.329295,"t_done":385792.184968328,"t_done_unix":1779816657.1989121},{"request_id":"1270606:11:1868274:1111","session_id":"1270606","input_length":117828,"t_proxy_recv":385797.247856537,"t_decision_unix":1779816662.2617977,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9863869368910615,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":1604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2456,"cache_hit":116224,"new_prefill":1604,"score_linear":-116224.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":116292,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-116224.0,"chosen_score_lmetric":0,"t_first_token":385798.249859805,"t_first_token_unix":1779816663.2638035,"t_done":385799.97576458,"t_done_unix":1779816664.9897087},{"request_id":"1270606:11:1870810:1113","session_id":"1270606","input_length":118012,"t_proxy_recv":385805.743858368,"t_decision_unix":1779816670.7577994,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9978646239365488,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":118012,"score_linear":112926.0,"score_lmetric":118012},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2459,"cache_hit":117760,"new_prefill":252,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":116476,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":385805.913235369,"t_first_token_unix":1779816670.9271784,"t_done":385806.417843015,"t_done_unix":1779816671.4317865},{"request_id":"1356885:12:1874205:1114","session_id":"1356885","input_length":135435,"t_proxy_recv":385817.214223086,"t_decision_unix":1779816682.2281644,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":134656,"affinity_cache_ratio":0.9942481633255805,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":134656,"estimated_new_tokens":779,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":13067,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":135435,"score_linear":112926.0,"score_lmetric":135435},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2459,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":134656,"new_prefill":779,"score_linear":-134656.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-134656.0,"chosen_score_lmetric":0,"t_first_token":385817.880695484,"t_first_token_unix":1779816682.8946388,"t_done":385820.505941094,"t_done_unix":1779816685.519892},{"request_id":"1340290:17:1875101:1115","session_id":"1340290","input_length":40328,"t_proxy_recv":385820.139853655,"t_decision_unix":1779816685.153795,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9902797064074589,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":40328,"score_linear":112926.0,"score_lmetric":40328},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2459,"cache_hit":20992,"new_prefill":19336,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135435,"ongoing_decode_tokens":135435,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":39936,"new_prefill":392,"score_linear":95499.0,"score_lmetric":392},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":95499.0,"chosen_score_lmetric":392,"t_first_token":385820.243156555,"t_first_token_unix":1779816685.2571,"t_done":385823.480195014,"t_done_unix":1779816688.4941385},{"request_id":"1270606:12:1876851:1116","session_id":"1270606","input_length":118600,"t_proxy_recv":385826.105056537,"t_decision_unix":1779816691.1189976,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9929173693086003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":118600,"score_linear":112926.0,"score_lmetric":118600},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2459,"cache_hit":117760,"new_prefill":840,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2727,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":117064,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":385826.694013381,"t_first_token_unix":1779816691.7079568,"t_done":385828.847016664,"t_done_unix":1779816693.8609607},{"request_id":"1340290:18:1878955:1117","session_id":"1340290","input_length":40583,"t_proxy_recv":385833.814347964,"t_decision_unix":1779816698.8282893,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9966734839711209,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":135,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":40583,"score_linear":112926.0,"score_lmetric":40583},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2461,"cache_hit":20992,"new_prefill":19591,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2727,"cache_hit":40448,"new_prefill":135,"score_linear":-40448.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":385833.874984615,"t_first_token_unix":1779816698.8889287,"t_done":385834.085704415,"t_done_unix":1779816699.099648},{"request_id":"1340290:19:1880565:1118","session_id":"1340290","input_length":40676,"t_proxy_recv":385839.089559462,"t_decision_unix":1779816704.1035008,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9943947290785722,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":40676,"score_linear":112926.0,"score_lmetric":40676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2461,"cache_hit":20992,"new_prefill":19684,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2727,"cache_hit":40448,"new_prefill":228,"score_linear":-40448.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":385839.19330192,"t_first_token_unix":1779816704.207245,"t_done":385839.747452048,"t_done_unix":1779816704.7613955},{"request_id":"1340290:20:1882251:1120","session_id":"1340290","input_length":40883,"t_proxy_recv":385844.902063779,"t_decision_unix":1779816709.916005,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9893598806349827,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":40883,"score_linear":112926.0,"score_lmetric":40883},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119030,"ongoing_decode_tokens":119030,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2461,"cache_hit":20992,"new_prefill":19891,"score_linear":98038.0,"score_lmetric":19891},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2727,"cache_hit":40448,"new_prefill":435,"score_linear":-40448.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":385845.013851288,"t_first_token_unix":1779816710.0277948,"t_done":385845.3356667,"t_done_unix":1779816710.349614},{"request_id":"1270606:12:1881189:1119","session_id":"1270606","input_length":119030,"t_proxy_recv":385841.493567978,"t_decision_unix":1779816706.5075092,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":118784,"affinity_cache_ratio":0.9979332941275308,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":118784,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":119030,"score_linear":112926.0,"score_lmetric":119030},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2461,"cache_hit":118784,"new_prefill":246,"score_linear":-118784.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2727,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":117494,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-118784.0,"chosen_score_lmetric":0,"t_first_token":385841.860731815,"t_first_token_unix":1779816706.8746762,"t_done":385845.862577166,"t_done_unix":1779816710.8765206},{"request_id":"1340290:21:1883855:1121","session_id":"1340290","input_length":41002,"t_proxy_recv":385850.365241504,"t_decision_unix":1779816715.3791828,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":40448,"affinity_cache_ratio":0.986488463977367,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":554,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":41002,"score_linear":112926.0,"score_lmetric":41002},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":20010,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2727,"cache_hit":40448,"new_prefill":554,"score_linear":-40448.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":385850.470271081,"t_first_token_unix":1779816715.4842143,"t_done":385850.720417393,"t_done_unix":1779816715.734361},{"request_id":"1340290:22:1884847:1122","session_id":"1340290","input_length":41909,"t_proxy_recv":385853.837995699,"t_decision_unix":1779816718.8519368,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":40960,"affinity_cache_ratio":0.9773556992531437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40960,"estimated_new_tokens":949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":41909,"score_linear":112926.0,"score_lmetric":41909},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":20917,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2728,"cache_hit":40960,"new_prefill":949,"score_linear":-40960.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40960.0,"chosen_score_lmetric":0,"t_first_token":385854.17318846,"t_first_token_unix":1779816719.1871321,"t_done":385854.510198811,"t_done_unix":1779816719.5241423},{"request_id":"1253804:55:1869941:1112","session_id":"1253804","input_length":112926,"t_proxy_recv":385802.878179212,"t_decision_unix":1779816667.8921204,"policy":"unified","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":112640,"affinity_cache_ratio":0.9974673680109098,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":286,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":112640,"new_prefill":286,"score_linear":-112640.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":3584,"new_prefill":109342,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2459,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":3584,"new_prefill":109342,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2725,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":385803.022331559,"t_first_token_unix":1779816668.0362754,"t_done":385855.531353097,"t_done_unix":1779816720.545297},{"request_id":"1340290:23:1886013:1124","session_id":"1340290","input_length":42086,"t_proxy_recv":385857.868370216,"t_decision_unix":1779816722.8823113,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":41472,"affinity_cache_ratio":0.9854108254526446,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41472,"estimated_new_tokens":614,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":0,"pending_prefill_tokens":5477,"num_requests":1,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":42086,"score_linear":63845.0,"score_lmetric":47563},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":21094,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2729,"cache_hit":41472,"new_prefill":614,"score_linear":-41472.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41472.0,"chosen_score_lmetric":0,"t_first_token":385857.978919685,"t_first_token_unix":1779816722.9928627,"t_done":385858.271367888,"t_done_unix":1779816723.2853112},{"request_id":"1270606:12:1886765:1125","session_id":"1270606","input_length":119440,"t_proxy_recv":385860.616598729,"t_decision_unix":1779816725.6305401,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9987943737441393,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":119440,"score_linear":63845.0,"score_lmetric":119440},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":119296,"new_prefill":144,"score_linear":-119296.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2730,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":117904,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":385860.849294218,"t_first_token_unix":1779816725.8632376,"t_done":385861.893087537,"t_done_unix":1779816726.9070313},{"request_id":"1340290:24:1887125:1126","session_id":"1340290","input_length":42199,"t_proxy_recv":385861.649331102,"t_decision_unix":1779816726.6632724,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9949050925377378,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":215,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":42199,"score_linear":63845.0,"score_lmetric":42199},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119440,"ongoing_decode_tokens":119440,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":21207,"score_linear":98448.0,"score_lmetric":21207},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2730,"cache_hit":41984,"new_prefill":215,"score_linear":-41984.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":385861.759132834,"t_first_token_unix":1779816726.773076,"t_done":385861.928793113,"t_done_unix":1779816726.9427364},{"request_id":"1340290:25:1888447:1127","session_id":"1340290","input_length":42444,"t_proxy_recv":385866.037904869,"t_decision_unix":1779816731.051846,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9891621901800018,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":0,"new_prefill":42444,"score_linear":63845.0,"score_lmetric":42444},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":21452,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2730,"cache_hit":41984,"new_prefill":460,"score_linear":-41984.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":385866.189183114,"t_first_token_unix":1779816731.2031264,"t_done":385866.489420161,"t_done_unix":1779816731.5033636},{"request_id":"1277428:20:1885419:1123","session_id":"1277428","input_length":63845,"t_proxy_recv":385855.755243995,"t_decision_unix":1779816720.7691853,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9142141123032343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":5477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":4608,"new_prefill":59237,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1626,"cache_hit":58368,"new_prefill":5477,"score_linear":-58368.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":17408,"new_prefill":46437,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2729,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":385857.977633839,"t_first_token_unix":1779816722.9915774,"t_done":385868.005467087,"t_done_unix":1779816733.019411},{"request_id":"1340290:26:1889402:1128","session_id":"1340290","input_length":48504,"t_proxy_recv":385869.35847646,"t_decision_unix":1779816734.3724177,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":41984,"affinity_cache_ratio":0.8655780966518225,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":6520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":27512,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2730,"cache_hit":41984,"new_prefill":6520,"score_linear":-41984.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":385871.259208069,"t_first_token_unix":1779816736.2731524,"t_done":385871.465560686,"t_done_unix":1779816736.4795043},{"request_id":"1270606:13:1890252:1129","session_id":"1270606","input_length":119686,"t_proxy_recv":385872.345899742,"t_decision_unix":1779816737.359841,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9967414735223836,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":390,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":119296,"new_prefill":390,"score_linear":-119296.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2742,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":118150,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":385872.709388311,"t_first_token_unix":1779816737.723332,"t_done":385873.624197616,"t_done_unix":1779816738.638147},{"request_id":"1340290:27:1892591:1131","session_id":"1340290","input_length":49361,"t_proxy_recv":385879.945957507,"t_decision_unix":1779816744.9598987,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9750207653815766,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":1233,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119828,"ongoing_decode_tokens":119828,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":20992,"new_prefill":28369,"score_linear":98836.0,"score_lmetric":28369},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2742,"cache_hit":48128,"new_prefill":1233,"score_linear":-48128.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":385880.318978513,"t_first_token_unix":1779816745.3329217,"t_done":385880.639629602,"t_done_unix":1779816745.6535728},{"request_id":"1270606:14:1892412:1130","session_id":"1270606","input_length":119828,"t_proxy_recv":385879.285797069,"t_decision_unix":1779816744.2997384,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9955603031011115,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":119296,"new_prefill":532,"score_linear":-119296.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2742,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":118292,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":385879.542215462,"t_first_token_unix":1779816744.556159,"t_done":385881.494914993,"t_done_unix":1779816746.508859},{"request_id":"1340290:28:1893837:1132","session_id":"1340290","input_length":49454,"t_proxy_recv":385884.253148905,"t_decision_unix":1779816749.2670898,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9938933149997978,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":20992,"new_prefill":28462,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2744,"cache_hit":49152,"new_prefill":302,"score_linear":-49152.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":385884.363723111,"t_first_token_unix":1779816749.3776667,"t_done":385884.615253355,"t_done_unix":1779816749.6291974},{"request_id":"1305906:9:1893880:1133","session_id":"1305906","input_length":59265,"t_proxy_recv":385884.419187176,"t_decision_unix":1779816749.4331284,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9935037543237999,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":385,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":58880,"new_prefill":385,"score_linear":-58880.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":49454,"ongoing_decode_tokens":49454,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2744,"cache_hit":0,"new_prefill":59265,"score_linear":49454.0,"score_lmetric":59265},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":385884.732974235,"t_first_token_unix":1779816749.7469177,"t_done":385885.343433026,"t_done_unix":1779816750.3573766},{"request_id":"1270606:15:1895310:1134","session_id":"1270606","input_length":120058,"t_proxy_recv":385889.088517205,"t_decision_unix":1779816754.1024566,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119808,"affinity_cache_ratio":0.9979176731246564,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119808,"estimated_new_tokens":250,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":119808,"new_prefill":250,"score_linear":-119808.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2744,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":118522,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119808.0,"chosen_score_lmetric":0,"t_first_token":385889.343128721,"t_first_token_unix":1779816754.357072,"t_done":385890.317220996,"t_done_unix":1779816755.331165},{"request_id":"1356885:13:1895311:1135","session_id":"1356885","input_length":135905,"t_proxy_recv":385889.106867313,"t_decision_unix":1779816754.120809,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":135168,"affinity_cache_ratio":0.9945770942938081,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":135168,"estimated_new_tokens":737,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":13537,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":120058,"ongoing_decode_tokens":0,"pending_prefill_tokens":250,"num_requests":1,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":0,"new_prefill":135905,"score_linear":120058.0,"score_lmetric":136155},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2744,"cache_hit":135168,"new_prefill":737,"score_linear":-135168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-135168.0,"chosen_score_lmetric":0,"t_first_token":385889.525718537,"t_first_token_unix":1779816754.539662,"t_done":385892.089036206,"t_done_unix":1779816757.10298},{"request_id":"1340290:29:1896119:1136","session_id":"1340290","input_length":49576,"t_proxy_recv":385891.578879034,"t_decision_unix":1779816756.5928202,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9914474745844764,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":424,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":20992,"new_prefill":28584,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":135905,"ongoing_decode_tokens":135905,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2744,"cache_hit":49152,"new_prefill":424,"score_linear":86753.0,"score_lmetric":424},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":86753.0,"chosen_score_lmetric":424,"t_first_token":385891.714538876,"t_first_token_unix":1779816756.7284822,"t_done":385892.168334277,"t_done_unix":1779816757.1822777},{"request_id":"1340290:30:1896991:1137","session_id":"1340290","input_length":49695,"t_proxy_recv":385894.5514219,"t_decision_unix":1779816759.565363,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9890733474192575,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":20992,"new_prefill":28703,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2745,"cache_hit":49152,"new_prefill":543,"score_linear":-49152.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":385894.66042658,"t_first_token_unix":1779816759.67437,"t_done":385896.151154255,"t_done_unix":1779816761.165098},{"request_id":"1340290:31:1899492:1138","session_id":"1340290","input_length":49927,"t_proxy_recv":385902.935446407,"t_decision_unix":1779816767.9493878,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9947323091713902,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":263,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":20992,"new_prefill":28935,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2746,"cache_hit":49664,"new_prefill":263,"score_linear":-49664.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":385903.030587878,"t_first_token_unix":1779816768.044531,"t_done":385903.681208167,"t_done_unix":1779816768.6951516},{"request_id":"1270606:16:1902252:1140","session_id":"1270606","input_length":120572,"t_proxy_recv":385911.446314348,"t_decision_unix":1779816776.4602554,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119808,"affinity_cache_ratio":0.9936635371396344,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119808,"estimated_new_tokens":764,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":119808,"new_prefill":764,"score_linear":-119808.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50078,"ongoing_decode_tokens":50078,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2746,"cache_hit":0,"new_prefill":120572,"score_linear":50078.0,"score_lmetric":120572},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":119036,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119808.0,"chosen_score_lmetric":0,"t_first_token":385912.034991596,"t_first_token_unix":1779816777.0489357,"t_done":385912.98490776,"t_done_unix":1779816777.9988515},{"request_id":"1270606:17:1908800:1141","session_id":"1270606","input_length":121006,"t_proxy_recv":385933.033024204,"t_decision_unix":1779816798.0469654,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":120320,"affinity_cache_ratio":0.9943308596267953,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":120320,"estimated_new_tokens":686,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2464,"cache_hit":120320,"new_prefill":686,"score_linear":-120320.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50078,"ongoing_decode_tokens":50078,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2746,"cache_hit":0,"new_prefill":121006,"score_linear":50078.0,"score_lmetric":121006},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":119470,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-120320.0,"chosen_score_lmetric":0,"t_first_token":385933.617860167,"t_first_token_unix":1779816798.631805,"t_done":385934.234084138,"t_done_unix":1779816799.248032},{"request_id":"1340290:32:1901260:1139","session_id":"1340290","input_length":50078,"t_proxy_recv":385908.346401498,"t_decision_unix":1779816773.3603427,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9917328966811774,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2463,"cache_hit":20992,"new_prefill":29086,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2746,"cache_hit":49664,"new_prefill":414,"score_linear":-49664.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":385908.468583305,"t_first_token_unix":1779816773.4825268,"t_done":385938.691565346,"t_done_unix":1779816803.7055109},{"request_id":"1270606:18:1915824:1142","session_id":"1270606","input_length":121288,"t_proxy_recv":385956.01294602,"t_decision_unix":1779816821.0268874,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":120832,"affinity_cache_ratio":0.9962403535386848,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":120832,"estimated_new_tokens":456,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2465,"cache_hit":120832,"new_prefill":456,"score_linear":-120832.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2748,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":119752,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-120832.0,"chosen_score_lmetric":0,"t_first_token":385956.383788366,"t_first_token_unix":1779816821.3977318,"t_done":385957.252071024,"t_done_unix":1779816822.2660146},{"request_id":"1270606:19:1920499:1143","session_id":"1270606","input_length":121560,"t_proxy_recv":385971.166116877,"t_decision_unix":1779816836.1800578,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":121344,"affinity_cache_ratio":0.9982230997038499,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":121344,"estimated_new_tokens":216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":121344,"new_prefill":216,"score_linear":-121344.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2748,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":120024,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-121344.0,"chosen_score_lmetric":0,"t_first_token":385971.537655964,"t_first_token_unix":1779816836.5516002,"t_done":385972.510953321,"t_done_unix":1779816837.5249026},{"request_id":"1270606:20:1922639:1144","session_id":"1270606","input_length":121704,"t_proxy_recv":385978.606840591,"t_decision_unix":1779816843.6207817,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":121344,"affinity_cache_ratio":0.9970420035495957,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":121344,"estimated_new_tokens":360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":121344,"new_prefill":360,"score_linear":-121344.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2748,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":1536,"new_prefill":120168,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-121344.0,"chosen_score_lmetric":0,"t_first_token":385978.854654782,"t_first_token_unix":1779816843.8685982,"t_done":385980.16356477,"t_done_unix":1779816845.1775086},{"request_id":"1305906:10:1928316:1145","session_id":"1305906","input_length":61801,"t_proxy_recv":385997.167846406,"t_decision_unix":1779816862.1817873,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9527353926311872,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":2921,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":58880,"new_prefill":2921,"score_linear":-58880.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2748,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":385998.221163303,"t_first_token_unix":1779816863.2351072,"t_done":385998.552107094,"t_done_unix":1779816863.5660508},{"request_id":"1340290:33:1939781:1146","session_id":"1340290","input_length":53990,"t_proxy_recv":386034.92665016,"t_decision_unix":1779816899.940591,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9957399518429338,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":230,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":32998,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2748,"cache_hit":53760,"new_prefill":230,"score_linear":-53760.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":386035.025980379,"t_first_token_unix":1779816900.0399263,"t_done":386036.1073126,"t_done_unix":1779816901.121256},{"request_id":"1340290:34:1942249:1147","session_id":"1340290","input_length":54164,"t_proxy_recv":386042.767448124,"t_decision_unix":1779816907.7813892,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":53760,"affinity_cache_ratio":0.992541171257662,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":404,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":33172,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2748,"cache_hit":53760,"new_prefill":404,"score_linear":-53760.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":386042.864416086,"t_first_token_unix":1779816907.87836,"t_done":386045.308204548,"t_done_unix":1779816910.322148},{"request_id":"1356885:14:1948151:1148","session_id":"1356885","input_length":136210,"t_proxy_recv":386062.53329645,"t_decision_unix":1779816927.5472379,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":135680,"affinity_cache_ratio":0.9961089494163424,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":135680,"estimated_new_tokens":530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":13842,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2749,"cache_hit":135680,"new_prefill":530,"score_linear":-135680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-135680.0,"chosen_score_lmetric":0,"t_first_token":386062.863694236,"t_first_token_unix":1779816927.8776379,"t_done":386064.555958771,"t_done_unix":1779816929.5699027},{"request_id":"1340290:35:1964727:1149","session_id":"1340290","input_length":54498,"t_proxy_recv":386117.24935116,"t_decision_unix":1779816982.2632923,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9958530588278469,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":226,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":33506,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2750,"cache_hit":54272,"new_prefill":226,"score_linear":-54272.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":386117.347691225,"t_first_token_unix":1779816982.3616345,"t_done":386121.10576466,"t_done_unix":1779816986.119708},{"request_id":"1340290:36:1969509:1150","session_id":"1340290","input_length":54811,"t_proxy_recv":386132.992995487,"t_decision_unix":1779816998.0069366,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9995073981500063,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":27,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":33819,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2751,"cache_hit":54784,"new_prefill":27,"score_linear":-54784.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":386133.073756798,"t_first_token_unix":1779816998.0877001,"t_done":386133.524953456,"t_done_unix":1779816998.5388975},{"request_id":"1340290:37:1971106:1151","session_id":"1340290","input_length":55358,"t_proxy_recv":386138.144300342,"t_decision_unix":1779817003.1582415,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9896311282922071,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":574,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":34366,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2751,"cache_hit":54784,"new_prefill":574,"score_linear":-54784.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":386138.440758273,"t_first_token_unix":1779817003.4547021,"t_done":386138.898574807,"t_done_unix":1779817003.9125273},{"request_id":"1340290:38:1972289:1152","session_id":"1340290","input_length":56006,"t_proxy_recv":386142.07386422,"t_decision_unix":1779817007.0878055,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9873227868442667,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":35014,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2752,"cache_hit":55296,"new_prefill":710,"score_linear":-55296.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":386142.380453977,"t_first_token_unix":1779817007.394398,"t_done":386143.0385329,"t_done_unix":1779817008.0524764},{"request_id":"1340290:39:1973889:1153","session_id":"1340290","input_length":56242,"t_proxy_recv":386147.499579184,"t_decision_unix":1779817012.5135205,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9922833469649017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":35250,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2753,"cache_hit":55808,"new_prefill":434,"score_linear":-55808.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":386147.686791727,"t_first_token_unix":1779817012.7007356,"t_done":386148.343550989,"t_done_unix":1779817013.3574948},{"request_id":"1340290:40:1975278:1154","session_id":"1340290","input_length":56416,"t_proxy_recv":386152.062445707,"t_decision_unix":1779817017.0763872,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":56320,"affinity_cache_ratio":0.998298355076574,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":96,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":35424,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2754,"cache_hit":56320,"new_prefill":96,"score_linear":-56320.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56320.0,"chosen_score_lmetric":0,"t_first_token":386152.178624657,"t_first_token_unix":1779817017.192568,"t_done":386152.660049905,"t_done_unix":1779817017.6739936},{"request_id":"1340290:41:1977055:1156","session_id":"1340290","input_length":57181,"t_proxy_recv":386157.996648185,"t_decision_unix":1779817023.0105894,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":56320,"affinity_cache_ratio":0.9849425508473094,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":861,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":67793,"ongoing_decode_tokens":0,"pending_prefill_tokens":2769,"num_requests":1,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":57181,"score_linear":67793.0,"score_lmetric":59950},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":36189,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2754,"cache_hit":56320,"new_prefill":861,"score_linear":-56320.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56320.0,"chosen_score_lmetric":0,"t_first_token":386158.410071827,"t_first_token_unix":1779817023.4240155,"t_done":386160.378358772,"t_done_unix":1779817025.392302},{"request_id":"1277428:21:1976968:1155","session_id":"1277428","input_length":67793,"t_proxy_recv":386157.710963311,"t_decision_unix":1779817022.7249045,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9591550750077442,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":2769,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":4608,"new_prefill":63185,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":65024,"new_prefill":2769,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":17408,"new_prefill":50385,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2754,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":386158.964848036,"t_first_token_unix":1779817023.978792,"t_done":386164.802421679,"t_done_unix":1779817029.8163657},{"request_id":"1340290:42:1982198:1157","session_id":"1340290","input_length":57463,"t_proxy_recv":386174.902487984,"t_decision_unix":1779817039.916429,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9979291022048971,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":119,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":36471,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2756,"cache_hit":57344,"new_prefill":119,"score_linear":-57344.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":386175.001302778,"t_first_token_unix":1779817040.0152464,"t_done":386175.48963769,"t_done_unix":1779817040.5035818},{"request_id":"1340290:43:1983901:1158","session_id":"1340290","input_length":57640,"t_proxy_recv":386180.296588482,"t_decision_unix":1779817045.3105295,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9948646773074254,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":296,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":36648,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2756,"cache_hit":57344,"new_prefill":296,"score_linear":-57344.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":386180.468578183,"t_first_token_unix":1779817045.4825213,"t_done":386180.963438467,"t_done_unix":1779817045.977383},{"request_id":"1340290:44:1986230:1159","session_id":"1340290","input_length":57809,"t_proxy_recv":386188.37952521,"t_decision_unix":1779817053.3934665,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9919562697849815,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":36817,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2756,"cache_hit":57344,"new_prefill":465,"score_linear":-57344.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":386188.537221467,"t_first_token_unix":1779817053.5511653,"t_done":386189.247269992,"t_done_unix":1779817054.2612135},{"request_id":"1277428:21:1989132:1160","session_id":"1277428","input_length":69987,"t_proxy_recv":386197.798860817,"t_decision_unix":1779817062.812802,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9729806964150485,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":1891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":4608,"new_prefill":65379,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":68096,"new_prefill":1891,"score_linear":-68096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":17408,"new_prefill":52579,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2757,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":386198.566658494,"t_first_token_unix":1779817063.5806024,"t_done":386198.9092068,"t_done_unix":1779817063.9231505},{"request_id":"1277428:22:1990436:1161","session_id":"1277428","input_length":70055,"t_proxy_recv":386202.339672843,"t_decision_unix":1779817067.3536143,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":69632,"affinity_cache_ratio":0.993961887088716,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":423,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":4608,"new_prefill":65447,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":69632,"new_prefill":423,"score_linear":-69632.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":17408,"new_prefill":52647,"score_linear":-17408.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2757,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":386202.456633805,"t_first_token_unix":1779817067.4705775,"t_done":386202.864196337,"t_done_unix":1779817067.87814},{"request_id":"1340290:45:1991694:1162","session_id":"1340290","input_length":58053,"t_proxy_recv":386206.351651066,"t_decision_unix":1779817071.365592,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9966065491878111,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37061,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2757,"cache_hit":57856,"new_prefill":197,"score_linear":-57856.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":386206.542528078,"t_first_token_unix":1779817071.5564716,"t_done":386206.794596398,"t_done_unix":1779817071.8085399},{"request_id":"1340290:46:1992980:1163","session_id":"1340290","input_length":58122,"t_proxy_recv":386210.577548475,"t_decision_unix":1779817075.5914896,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9954234197033826,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":266,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37130,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2757,"cache_hit":57856,"new_prefill":266,"score_linear":-57856.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":386210.675961068,"t_first_token_unix":1779817075.6899047,"t_done":386211.092278607,"t_done_unix":1779817076.1062222},{"request_id":"1340290:47:1995358:1164","session_id":"1340290","input_length":58307,"t_proxy_recv":386218.440548347,"t_decision_unix":1779817083.4544892,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9922650796645343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":451,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37315,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2757,"cache_hit":57856,"new_prefill":451,"score_linear":-57856.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":386218.583285038,"t_first_token_unix":1779817083.5972285,"t_done":386218.832191927,"t_done_unix":1779817083.8461356},{"request_id":"1340290:48:1996945:1165","session_id":"1340290","input_length":58339,"t_proxy_recv":386223.744786639,"t_decision_unix":1779817088.7587278,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9917208042647285,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37347,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2757,"cache_hit":57856,"new_prefill":483,"score_linear":-57856.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":386223.839249206,"t_first_token_unix":1779817088.8531928,"t_done":386225.834318837,"t_done_unix":1779817090.8482623},{"request_id":"1356885:15:1998292:1166","session_id":"1356885","input_length":136653,"t_proxy_recv":386228.216763001,"t_decision_unix":1779817093.2307043,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":136192,"affinity_cache_ratio":0.9966264919174844,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":136192,"estimated_new_tokens":461,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":14285,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2758,"cache_hit":136192,"new_prefill":461,"score_linear":-136192.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-136192.0,"chosen_score_lmetric":0,"t_first_token":386228.873998761,"t_first_token_unix":1779817093.8879528,"t_done":386230.536739915,"t_done_unix":1779817095.5506876},{"request_id":"1340290:48:1999591:1167","session_id":"1340290","input_length":58622,"t_proxy_recv":386232.758429801,"t_decision_unix":1779817097.772371,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9956671556753437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":254,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37630,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2759,"cache_hit":58368,"new_prefill":254,"score_linear":-58368.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":386232.861083523,"t_first_token_unix":1779817097.8750272,"t_done":386233.454073883,"t_done_unix":1779817098.4680176},{"request_id":"1340290:48:2001313:1168","session_id":"1340290","input_length":58808,"t_proxy_recv":386238.226822347,"t_decision_unix":1779817103.2407637,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9925180247585362,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37816,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2759,"cache_hit":58368,"new_prefill":440,"score_linear":-58368.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":386238.384194601,"t_first_token_unix":1779817103.3981378,"t_done":386238.896936301,"t_done_unix":1779817103.91088},{"request_id":"1340290:48:2003195:1169","session_id":"1340290","input_length":58977,"t_proxy_recv":386244.551448233,"t_decision_unix":1779817109.5653896,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58368,"affinity_cache_ratio":0.989673940688743,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":37985,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2759,"cache_hit":58368,"new_prefill":609,"score_linear":-58368.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":386244.709348086,"t_first_token_unix":1779817109.7232916,"t_done":386245.58965137,"t_done_unix":1779817110.6035953},{"request_id":"1340290:48:2005449:1170","session_id":"1340290","input_length":59220,"t_proxy_recv":386251.940892629,"t_decision_unix":1779817116.954834,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58880,"affinity_cache_ratio":0.994258696386356,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":38228,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2760,"cache_hit":58880,"new_prefill":340,"score_linear":-58880.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":386252.083803555,"t_first_token_unix":1779817117.097747,"t_done":386252.923210732,"t_done_unix":1779817117.9371545},{"request_id":"1340290:48:2007287:1171","session_id":"1340290","input_length":59487,"t_proxy_recv":386258.065393277,"t_decision_unix":1779817123.0793345,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9897960899019954,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":607,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":38495,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2760,"cache_hit":58880,"new_prefill":607,"score_linear":-58880.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":386258.26280985,"t_first_token_unix":1779817123.2767537,"t_done":386258.643262962,"t_done_unix":1779817123.6572065},{"request_id":"1340290:48:2008380:1173","session_id":"1340290","input_length":60935,"t_proxy_recv":386262.167528988,"t_decision_unix":1779817127.1814702,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":59392,"affinity_cache_ratio":0.9746779355050463,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":1543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":39943,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66506,"ongoing_decode_tokens":0,"pending_prefill_tokens":5066,"num_requests":1,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":60935,"score_linear":66506.0,"score_lmetric":66001},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2761,"cache_hit":59392,"new_prefill":1543,"score_linear":-59392.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-59392.0,"chosen_score_lmetric":0,"t_first_token":386262.839646588,"t_first_token_unix":1779817127.8535905,"t_done":386263.525244614,"t_done_unix":1779817128.5391881},{"request_id":"1305906:11:2008110:1172","session_id":"1305906","input_length":66506,"t_proxy_recv":386261.157356308,"t_decision_unix":1779817126.1712973,"policy":"unified","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9238264216762397,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":5066,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":61440,"new_prefill":5066,"score_linear":-61440.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2761,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":386263.107482407,"t_first_token_unix":1779817128.1214259,"t_done":386265.43685253,"t_done_unix":1779817130.4507964},{"request_id":"1340290:48:2010180:1174","session_id":"1340290","input_length":61080,"t_proxy_recv":386268.023409525,"t_decision_unix":1779817133.037351,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9975114603798297,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":40088,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2764,"cache_hit":60928,"new_prefill":152,"score_linear":-60928.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":386268.161050366,"t_first_token_unix":1779817133.174994,"t_done":386269.179164133,"t_done_unix":1779817134.1931076},{"request_id":"1340290:48:2012871:1175","session_id":"1340290","input_length":61365,"t_proxy_recv":386276.704230927,"t_decision_unix":1779817141.718172,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9928786767701459,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":40373,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2764,"cache_hit":60928,"new_prefill":437,"score_linear":-60928.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":386276.905180286,"t_first_token_unix":1779817141.919124,"t_done":386277.426567404,"t_done_unix":1779817142.4405122},{"request_id":"1340290:48:2014153:1176","session_id":"1340290","input_length":61518,"t_proxy_recv":386281.100158672,"t_decision_unix":1779817146.1141,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9904093110959394,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":590,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":40526,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2764,"cache_hit":60928,"new_prefill":590,"score_linear":-60928.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":386281.22432336,"t_first_token_unix":1779817146.238267,"t_done":386281.719932538,"t_done_unix":1779817146.733876},{"request_id":"1340290:48:2015982:1177","session_id":"1340290","input_length":69113,"t_proxy_recv":386287.19939035,"t_decision_unix":1779817152.2133315,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":61440,"affinity_cache_ratio":0.8889789185826111,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":7673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":48121,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2765,"cache_hit":61440,"new_prefill":7673,"score_linear":-61440.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":386290.438355317,"t_first_token_unix":1779817155.4522994,"t_done":386292.866137699,"t_done_unix":1779817157.8800817},{"request_id":"1340290:48:2018973:1178","session_id":"1340290","input_length":69426,"t_proxy_recv":386296.985128559,"t_decision_unix":1779817161.9990695,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9955924293492352,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":306,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":48434,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2780,"cache_hit":69120,"new_prefill":306,"score_linear":-69120.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":386297.10165265,"t_first_token_unix":1779817162.115596,"t_done":386297.688440707,"t_done_unix":1779817162.7023845},{"request_id":"1340290:48:2020779:1179","session_id":"1340290","input_length":69601,"t_proxy_recv":386303.038962395,"t_decision_unix":1779817168.0529034,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9930891797531645,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":481,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":48609,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2780,"cache_hit":69120,"new_prefill":481,"score_linear":-69120.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":386303.219083758,"t_first_token_unix":1779817168.2330272,"t_done":386303.787249479,"t_done_unix":1779817168.8011928},{"request_id":"1340290:48:2023753:1180","session_id":"1340290","input_length":69951,"t_proxy_recv":386312.659973666,"t_decision_unix":1779817177.673915,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69632,"affinity_cache_ratio":0.9954396649082929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":319,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":48959,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2781,"cache_hit":69632,"new_prefill":319,"score_linear":-69632.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":386312.89519116,"t_first_token_unix":1779817177.909135,"t_done":386313.778734369,"t_done_unix":1779817178.7926807},{"request_id":"1340290:48:2026751:1181","session_id":"1340290","input_length":70342,"t_proxy_recv":386322.93818079,"t_decision_unix":1779817187.9521215,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69632,"affinity_cache_ratio":0.989906457024253,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":49350,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2781,"cache_hit":69632,"new_prefill":710,"score_linear":-69632.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":386323.176926302,"t_first_token_unix":1779817188.1908698,"t_done":386323.699186093,"t_done_unix":1779817188.7131295},{"request_id":"1340290:48:2028652:1182","session_id":"1340290","input_length":70503,"t_proxy_recv":386329.185934869,"t_decision_unix":1779817194.199876,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9949080180985206,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":359,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":49511,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2782,"cache_hit":70144,"new_prefill":359,"score_linear":-70144.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":386329.366225406,"t_first_token_unix":1779817194.380169,"t_done":386330.259851426,"t_done_unix":1779817195.2737951},{"request_id":"1340290:48:2033065:1183","session_id":"1340290","input_length":70851,"t_proxy_recv":386343.917974998,"t_decision_unix":1779817208.9319162,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9900213123315126,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":707,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":49859,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2782,"cache_hit":70144,"new_prefill":707,"score_linear":-70144.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":386344.154244603,"t_first_token_unix":1779817209.168188,"t_done":386344.78802958,"t_done_unix":1779817209.8019738},{"request_id":"1340290:48:2034908:1184","session_id":"1340290","input_length":71067,"t_proxy_recv":386350.139995034,"t_decision_unix":1779817215.1539354,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":70656,"affinity_cache_ratio":0.9942167250622652,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70656,"estimated_new_tokens":411,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":50075,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2783,"cache_hit":70656,"new_prefill":411,"score_linear":-70656.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70656.0,"chosen_score_lmetric":0,"t_first_token":386350.305184772,"t_first_token_unix":1779817215.3191288,"t_done":386350.818420031,"t_done_unix":1779817215.8323638},{"request_id":"1258908:2:2035438:1185","session_id":"1258908","input_length":7844,"t_proxy_recv":386351.947921963,"t_decision_unix":1779817216.9618633,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.9790922998470168,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":7680,"new_prefill":164,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2783,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":386351.974355997,"t_first_token_unix":1779817216.9882994,"t_done":386352.9931814,"t_done_unix":1779817218.0071247},{"request_id":"1258908:3:1388683:699","session_id":"1258908","input_length":9120,"t_proxy_recv":386352.997132211,"t_decision_unix":1779817218.0110738,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.8421052631578947,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":1440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1646,"cache_hit":7680,"new_prefill":1440,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2783,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":386353.140957994,"t_first_token_unix":1779817218.1549013,"t_done":386353.811715307,"t_done_unix":1779817218.8256588},{"request_id":"1340290:48:2036994:1186","session_id":"1340290","input_length":71240,"t_proxy_recv":386357.081543496,"t_decision_unix":1779817222.0954828,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":70656,"affinity_cache_ratio":0.9918023582257159,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70656,"estimated_new_tokens":584,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":50248,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2783,"cache_hit":70656,"new_prefill":584,"score_linear":-70656.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70656.0,"chosen_score_lmetric":0,"t_first_token":386357.265439263,"t_first_token_unix":1779817222.279383,"t_done":386357.981782363,"t_done_unix":1779817222.9957259},{"request_id":"1340290:48:2040473:1187","session_id":"1340290","input_length":71545,"t_proxy_recv":386368.611050292,"t_decision_unix":1779817233.624991,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9947305891397022,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":50553,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2784,"cache_hit":71168,"new_prefill":377,"score_linear":-71168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":386368.845921609,"t_first_token_unix":1779817233.8598657,"t_done":386369.986089116,"t_done_unix":1779817235.0000331},{"request_id":"1340290:48:2043771:1188","session_id":"1340290","input_length":71867,"t_proxy_recv":386379.627884339,"t_decision_unix":1779817244.6418254,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9902737000292207,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":699,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":50875,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2784,"cache_hit":71168,"new_prefill":699,"score_linear":-71168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":386379.861809982,"t_first_token_unix":1779817244.8757539,"t_done":386380.436531285,"t_done_unix":1779817245.4504752},{"request_id":"1340290:48:2045403:1189","session_id":"1340290","input_length":72025,"t_proxy_recv":386385.137327907,"t_decision_unix":1779817250.1512692,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71680,"affinity_cache_ratio":0.995209996528983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":345,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":51033,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2785,"cache_hit":71680,"new_prefill":345,"score_linear":-71680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":386385.290755929,"t_first_token_unix":1779817250.3046994,"t_done":386385.973828304,"t_done_unix":1779817250.9877722},{"request_id":"1340290:48:2047167:1190","session_id":"1340290","input_length":72211,"t_proxy_recv":386390.903249582,"t_decision_unix":1779817255.9171906,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9926465496946448,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":51219,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2785,"cache_hit":71680,"new_prefill":531,"score_linear":-71680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":386391.090423146,"t_first_token_unix":1779817256.104367,"t_done":386391.640031264,"t_done_unix":1779817256.6539757},{"request_id":"1340290:48:2048793:1191","session_id":"1340290","input_length":72777,"t_proxy_recv":386396.336322532,"t_decision_unix":1779817261.3502636,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9919617461560658,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":585,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":51785,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2786,"cache_hit":72192,"new_prefill":585,"score_linear":-72192.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72192.0,"chosen_score_lmetric":0,"t_first_token":386396.714738766,"t_first_token_unix":1779817261.728683,"t_done":386397.235803669,"t_done_unix":1779817262.2497475},{"request_id":"1340290:48:2050838:1192","session_id":"1340290","input_length":72952,"t_proxy_recv":386403.559253584,"t_decision_unix":1779817268.5731947,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9966005044412765,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":248,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":51960,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2787,"cache_hit":72704,"new_prefill":248,"score_linear":-72704.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":386403.748266669,"t_first_token_unix":1779817268.7622108,"t_done":386404.107863373,"t_done_unix":1779817269.1218073},{"request_id":"1340290:48:2052523:1193","session_id":"1340290","input_length":73208,"t_proxy_recv":386409.128732021,"t_decision_unix":1779817274.1426725,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9931155065020216,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":52216,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2787,"cache_hit":72704,"new_prefill":504,"score_linear":-72704.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":386409.368280783,"t_first_token_unix":1779817274.382225,"t_done":386410.149108417,"t_done_unix":1779817275.1630528},{"request_id":"1340290:48:2055365:1194","session_id":"1340290","input_length":73454,"t_proxy_recv":386418.84077517,"t_decision_unix":1779817283.854716,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9967598769297792,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":238,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":52462,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2788,"cache_hit":73216,"new_prefill":238,"score_linear":-73216.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":386419.073552072,"t_first_token_unix":1779817284.0874968,"t_done":386419.495865243,"t_done_unix":1779817284.5098093},{"request_id":"1340290:48:2057042:1195","session_id":"1340290","input_length":73636,"t_proxy_recv":386424.211515497,"t_decision_unix":1779817289.2254567,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9942962681297192,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":52644,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2788,"cache_hit":73216,"new_prefill":420,"score_linear":-73216.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":386424.381411568,"t_first_token_unix":1779817289.395356,"t_done":386424.652591444,"t_done_unix":1779817289.6665385},{"request_id":"1340290:48:2058614:1196","session_id":"1340290","input_length":73653,"t_proxy_recv":386429.349749161,"t_decision_unix":1779817294.3636906,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9940667725686666,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":52661,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2788,"cache_hit":73216,"new_prefill":437,"score_linear":-73216.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":386429.483848183,"t_first_token_unix":1779817294.497792,"t_done":386431.205755027,"t_done_unix":1779817296.2196987},{"request_id":"1340290:48:2061834:1197","session_id":"1340290","input_length":73858,"t_proxy_recv":386439.50354702,"t_decision_unix":1779817304.5174885,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9982398656882125,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":130,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":52866,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2789,"cache_hit":73728,"new_prefill":130,"score_linear":-73728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":386439.614107725,"t_first_token_unix":1779817304.628051,"t_done":386440.162473343,"t_done_unix":1779817305.1764174},{"request_id":"1258908:3:2063441:1198","session_id":"1258908","input_length":9359,"t_proxy_recv":386444.540259922,"t_decision_unix":1779817309.5542011,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9847205898066033,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":9216,"new_prefill":143,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2789,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":386444.590182257,"t_first_token_unix":1779817309.6041257,"t_done":386445.657685694,"t_done_unix":1779817310.671629},{"request_id":"1340290:48:2063837:1199","session_id":"1340290","input_length":74011,"t_proxy_recv":386445.897016855,"t_decision_unix":1779817310.9109583,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9961762440718271,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9740,"ongoing_decode_tokens":9740,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":74011,"score_linear":9740.0,"score_lmetric":74011},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":53019,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2789,"cache_hit":73728,"new_prefill":283,"score_linear":-73728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":386446.041699598,"t_first_token_unix":1779817311.0556428,"t_done":386446.616397731,"t_done_unix":1779817311.6303458},{"request_id":"1258908:4:1553508:958","session_id":"1258908","input_length":9740,"t_proxy_recv":386445.66197384,"t_decision_unix":1779817310.6759155,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9462012320328542,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":524,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":9216,"new_prefill":524,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2789,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":386445.722270502,"t_first_token_unix":1779817310.7362137,"t_done":386447.610727487,"t_done_unix":1779817312.624671},{"request_id":"1258908:5:1617181:988","session_id":"1258908","input_length":10201,"t_proxy_recv":386447.614159428,"t_decision_unix":1779817312.6281009,"policy":"unified","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9536319968630527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":473,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":9728,"new_prefill":473,"score_linear":-9728.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2789,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":386447.663212325,"t_first_token_unix":1779817312.6771557,"t_done":386449.713236794,"t_done_unix":1779817314.7271802},{"request_id":"1340290:48:2066647:1200","session_id":"1340290","input_length":74557,"t_proxy_recv":386455.3345201,"t_decision_unix":1779817320.3484614,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9888809903831968,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":829,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":53565,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2789,"cache_hit":73728,"new_prefill":829,"score_linear":-73728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":386455.716199116,"t_first_token_unix":1779817320.7301424,"t_done":386456.95401957,"t_done_unix":1779817321.9679632},{"request_id":"1340290:48:2071598:1201","session_id":"1340290","input_length":74863,"t_proxy_recv":386471.991176912,"t_decision_unix":1779817337.0051181,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":74240,"affinity_cache_ratio":0.991678132054553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74240,"estimated_new_tokens":623,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":53871,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2790,"cache_hit":74240,"new_prefill":623,"score_linear":-74240.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74240.0,"chosen_score_lmetric":0,"t_first_token":386472.240976206,"t_first_token_unix":1779817337.25492,"t_done":386473.049336751,"t_done_unix":1779817338.0632803},{"request_id":"1340290:48:2076822:1202","session_id":"1340290","input_length":75113,"t_proxy_recv":386489.501653022,"t_decision_unix":1779817354.5155942,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9951939078455128,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":361,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":54121,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2791,"cache_hit":74752,"new_prefill":361,"score_linear":-74752.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":386489.743435994,"t_first_token_unix":1779817354.7573802,"t_done":386490.180742626,"t_done_unix":1779817355.1946862},{"request_id":"1340290:48:2078461:1203","session_id":"1340290","input_length":75299,"t_proxy_recv":386494.796611586,"t_decision_unix":1779817359.8105524,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9927356272991673,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":547,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":54307,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2791,"cache_hit":74752,"new_prefill":547,"score_linear":-74752.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":386495.036296256,"t_first_token_unix":1779817360.05024,"t_done":386495.316116801,"t_done_unix":1779817360.3300607},{"request_id":"1340290:48:2080016:1204","session_id":"1340290","input_length":75338,"t_proxy_recv":386500.087336069,"t_decision_unix":1779817365.101277,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9990177599617723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":74,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":54346,"score_linear":-20992.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2792,"cache_hit":75264,"new_prefill":74,"score_linear":-75264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":386500.191238374,"t_first_token_unix":1779817365.2051816,"t_done":386500.56430556,"t_done_unix":1779817365.5782495},{"request_id":"1340290:48:2082644:1206","session_id":"1340290","input_length":75439,"t_proxy_recv":386508.764252606,"t_decision_unix":1779817373.778194,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9976802449661316,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":54447,"score_linear":93979.0,"score_lmetric":115658},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2792,"cache_hit":75264,"new_prefill":175,"score_linear":-75264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":386508.916698665,"t_first_token_unix":1779817373.9306421,"t_done":386509.898690098,"t_done_unix":1779817374.9126341},{"request_id":"1356885:16:2084239:1207","session_id":"1356885","input_length":136991,"t_proxy_recv":386513.857983906,"t_decision_unix":1779817378.8719249,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":136704,"affinity_cache_ratio":0.9979049718594653,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":136704,"estimated_new_tokens":287,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":14623,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":0,"new_prefill":136991,"score_linear":114971.0,"score_lmetric":198202},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2792,"cache_hit":136704,"new_prefill":287,"score_linear":-136704.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-136704.0,"chosen_score_lmetric":0,"t_first_token":386514.271981408,"t_first_token_unix":1779817379.2859251,"t_done":386517.09447347,"t_done_unix":1779817382.1084213},{"request_id":"1340290:48:2085626:1208","session_id":"1340290","input_length":77337,"t_proxy_recv":386518.838919287,"t_decision_unix":1779817383.8528607,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9731952364327553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":2073,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":56345,"score_linear":93979.0,"score_lmetric":117556},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2793,"cache_hit":75264,"new_prefill":2073,"score_linear":-75264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":386519.819887292,"t_first_token_unix":1779817384.833831,"t_done":386520.325768887,"t_done_unix":1779817385.339713},{"request_id":"1340290:48:2087584:1209","session_id":"1340290","input_length":78683,"t_proxy_recv":386525.416703485,"t_decision_unix":1779817390.430645,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":77312,"affinity_cache_ratio":0.9825756516655441,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77312,"estimated_new_tokens":1371,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":57691,"score_linear":93979.0,"score_lmetric":118902},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2797,"cache_hit":77312,"new_prefill":1371,"score_linear":-77312.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-77312.0,"chosen_score_lmetric":0,"t_first_token":386526.252579325,"t_first_token_unix":1779817391.266523,"t_done":386527.712835047,"t_done_unix":1779817392.7267785},{"request_id":"1340290:48:2092759:1211","session_id":"1340290","input_length":79023,"t_proxy_recv":386542.699175406,"t_decision_unix":1779817407.7131166,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9913063285372613,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":687,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":20992,"new_prefill":58031,"score_linear":93979.0,"score_lmetric":119242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2799,"cache_hit":78336,"new_prefill":687,"score_linear":-78336.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":386542.95399653,"t_first_token_unix":1779817407.96794,"t_done":386544.230528282,"t_done_unix":1779817409.2444718},{"request_id":"1382086:2:2082052:1205","session_id":"1382086","input_length":114971,"t_proxy_recv":386506.746662858,"t_decision_unix":1779817371.7606041,"policy":"unified","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":53760,"affinity_cache_ratio":0.467596176427099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":61211,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2466,"cache_hit":53760,"new_prefill":61211,"score_linear":-53760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2792,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":386549.298395314,"t_first_token_unix":1779817414.3123388,"t_done":386550.471485192,"t_done_unix":1779817415.4854293},{"request_id":"1382086:3:2089879:1210","session_id":"1382086","input_length":115184,"t_proxy_recv":386550.489749652,"t_decision_unix":1779817415.503691,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":114688,"affinity_cache_ratio":0.9956938463675511,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":114688,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2585,"cache_hit":114688,"new_prefill":496,"score_linear":-114688.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2800,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-114688.0,"chosen_score_lmetric":0,"t_first_token":386550.774149623,"t_first_token_unix":1779817415.7880929,"t_done":386551.281556276,"t_done_unix":1779817416.2955005},{"request_id":"1382086:4:2092953:1212","session_id":"1382086","input_length":115246,"t_proxy_recv":386551.30085607,"t_decision_unix":1779817416.3147976,"policy":"unified","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":115200,"affinity_cache_ratio":0.9996008538257293,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":115200,"estimated_new_tokens":46,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2586,"cache_hit":115200,"new_prefill":46,"score_linear":-115200.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2800,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-115200.0,"chosen_score_lmetric":0,"t_first_token":386551.454442132,"t_first_token_unix":1779817416.4683855,"t_done":386558.533706293,"t_done_unix":1779817423.5476503},{"request_id":"1356885:17:2097011:1213","session_id":"1356885","input_length":137546,"t_proxy_recv":386556.575442134,"t_decision_unix":1779817421.5893831,"policy":"unified","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":137216,"affinity_cache_ratio":0.9976008026405712,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":137216,"estimated_new_tokens":330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696,"cache_hit":122368,"new_prefill":15178,"score_linear":-122368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":115246,"ongoing_decode_tokens":115246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2586,"cache_hit":0,"new_prefill":137546,"score_linear":115246.0,"score_lmetric":137546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2800,"cache_hit":137216,"new_prefill":330,"score_linear":-137216.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-137216.0,"chosen_score_lmetric":0,"t_first_token":386557.247230768,"t_first_token_unix":1779817422.2611752,"t_done":386559.912660174,"t_done_unix":1779817424.9266047}] \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/metrics.jsonl b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/metrics.jsonl new file mode 100644 index 0000000..ddf4e9b --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/metrics.jsonl @@ -0,0 +1,1214 @@ +{"actual_output_tokens": 21, "cached_tokens": 0, "effective_input_length": 8228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8228, "latency_s": 0.999479463964235, "output_length": 21, "proxy_request_id": "1237198:1:1237198:0", "request_id": "1237198:1:1237198:0", "request_type": "coder", "requested_output_tokens": 21, "session_id": "1237198", "t_dispatch_unix": 1779814509.132484, "t_finish_unix": 1779814510.1319633, "t_first_token_unix": 1779814510.0381267, "tpot_s": 0.004673258800175972, "trace_hash_ids": [12292995, 12292996, 12292997, 12304212, 12304213, 12304214, 12304215, 12304216, 12304217, 12311566, 12311567, 12311568, 12311569, 12311570, 12318563, 12318564, 12318565], "trace_timestamp_s": 0.0, "ttft_s": 0.90563909499906, "turn_id": 1} +{"actual_output_tokens": 78, "cached_tokens": 0, "effective_input_length": 3976, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3976, "latency_s": 0.9186065259855241, "output_length": 78, "proxy_request_id": "1237337:1:1237337:1", "request_id": "1237337:1:1237337:1", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1237337", "t_dispatch_unix": 1779814509.552592, "t_finish_unix": 1779814510.4711986, "t_first_token_unix": 1779814510.0864875, "tpot_s": 0.0049924503901501655, "trace_hash_ids": [12309322, 12309323, 12309324, 12319949, 12319950, 12319951, 12319952, 12319953], "trace_timestamp_s": 0.4420000000000073, "ttft_s": 0.5338929349672981, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 8240, "effective_input_length": 10237, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10237, "latency_s": 0.4212239959742874, "output_length": 27, "proxy_request_id": "1237198:2:1237773:2", "request_id": "1237198:2:1237773:2", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1237198", "t_dispatch_unix": 1779814511.102193, "t_finish_unix": 1779814511.523417, "t_first_token_unix": 1779814511.3917427, "tpot_s": 0.005052305115476394, "trace_hash_ids": [12292995, 12292996, 12292997, 12304212, 12304213, 12304214, 12304215, 12304216, 12304217, 12311566, 12311567, 12311568, 12311569, 12311570, 12318563, 12318564, 12323845, 12323846, 12323847, 12323848], "trace_timestamp_s": 1.9920000000001892, "ttft_s": 0.2895475919940509, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 749, "latency_s": 0.24461472599068657, "output_length": 27, "proxy_request_id": "1237877:1:1237877:3", "request_id": "1237877:1:1237877:3", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1237877", "t_dispatch_unix": 1779814511.561455, "t_finish_unix": 1779814511.8060699, "t_first_token_unix": 1779814511.6801758, "tpot_s": 0.004831819423438551, "trace_hash_ids": [12325182, 12325183], "trace_timestamp_s": 2.4520000000002256, "ttft_s": 0.11871929897461087, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 13489, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13489, "latency_s": 1.9424257799983025, "output_length": 83, "proxy_request_id": "1239034:1:1239034:4", "request_id": "1239034:1:1239034:4", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1239034", "t_dispatch_unix": 1779814515.3385954, "t_finish_unix": 1779814517.2810206, "t_first_token_unix": 1779814516.8361096, "tpot_s": 0.00542205895180814, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12336730], "trace_timestamp_s": 6.222000000000662, "ttft_s": 1.49751249095425, "turn_id": 1} +{"actual_output_tokens": 91, "cached_tokens": 768, "effective_input_length": 1620, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1620, "latency_s": 0.5245660200016573, "output_length": 91, "proxy_request_id": "1237877:2:1239577:6", "request_id": "1237877:2:1239577:6", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1237877", "t_dispatch_unix": 1779814517.2226286, "t_finish_unix": 1779814517.747194, "t_first_token_unix": 1779814517.3038933, "tpot_s": 0.004922462578138544, "trace_hash_ids": [12325182, 12342035, 12342036, 12342037], "trace_timestamp_s": 8.113000000000284, "ttft_s": 0.08126379299210384, "turn_id": 2} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 5194, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5194, "latency_s": 0.8874093919876032, "output_length": 54, "proxy_request_id": "1239704:1:1239704:7", "request_id": "1239704:1:1239704:7", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1239704", "t_dispatch_unix": 1779814517.6652143, "t_finish_unix": 1779814518.552624, "t_first_token_unix": 1779814518.2866137, "tpot_s": 0.005013229433042964, "trace_hash_ids": [12325298, 12325299, 12325300, 12325301, 12325302, 12325303, 12325304, 12335875, 12343073, 12343074, 12343075], "trace_timestamp_s": 8.554000000000087, "ttft_s": 0.6213971120305359, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 7429, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7429, "latency_s": 0.7133035550359637, "output_length": 35, "proxy_request_id": "1240924:1:1240924:11", "request_id": "1240924:1:1240924:11", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1240924", "t_dispatch_unix": 1779814521.6861744, "t_finish_unix": 1779814522.3994782, "t_first_token_unix": 1779814522.2250051, "tpot_s": 0.0051195831774213515, "trace_hash_ids": [12342008, 12342009, 12342010, 12342011, 12342012, 12342013, 12342014, 12342015, 12342016, 12342017, 12342018, 12342019, 12354472, 12354473, 12354474], "trace_timestamp_s": 12.574000000000524, "ttft_s": 0.5388290089904331, "turn_id": 1} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 37165, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37165, "latency_s": 7.229942019039299, "output_length": 183, "proxy_request_id": "1239100:1:1239100:5", "request_id": "1239100:1:1239100:5", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1239100", "t_dispatch_unix": 1779814515.5747325, "t_finish_unix": 1779814522.8046746, "t_first_token_unix": 1779814521.5663242, "tpot_s": 0.0068025240494874765, "trace_hash_ids": [44767, 44768, 44769, 44770, 44771, 44772, 44773, 127444, 75740, 127445, 127446, 127447, 127448, 127449, 127450, 127451, 127452, 127453, 127454, 127455, 127456, 127457, 127458, 127459, 127460, 127461, 127462, 127463, 127464, 127465, 127466, 127467, 127468, 127469, 8983871, 8983872, 8983873, 8983874, 12337377, 12337378, 12337379, 12337380, 12337381, 12337382, 12337383, 12337384, 12337385, 12337386, 12337386, 12337387, 1738555, 1738555, 12337388, 12337389, 12337390, 12337391, 12337392, 12337393, 12337394, 12337395, 12337396, 12337397, 12337398, 12337399, 12337400, 12337401, 12337402, 12337403, 12337404, 12337405, 12337406, 12337407, 12337408], "trace_timestamp_s": 6.451000000000022, "ttft_s": 5.991589390032459, "turn_id": 1} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 30040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30040, "latency_s": 4.575672177015804, "output_length": 101, "proxy_request_id": "1240198:1:1240198:9", "request_id": "1240198:1:1240198:9", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1240198", "t_dispatch_unix": 1779814519.194776, "t_finish_unix": 1779814523.7704477, "t_first_token_unix": 1779814523.1371841, "tpot_s": 0.006329778990475461, "trace_hash_ids": [156827, 156828, 156829, 156830, 156831, 156832, 156833, 156834, 156835, 156836, 156837, 5767151, 5767152, 5767153, 5767154, 5767155, 5767156, 5767157, 5767158, 5767159, 5767160, 5767161, 5767162, 5767163, 5767164, 5767165, 5767166, 5767167, 5767168, 5767169, 5767170, 5767171, 8388251, 8388252, 8388253, 8388254, 8388255, 8388256, 8388257, 8388258, 8388259, 8388260, 8388261, 8388262, 8388263, 8388264, 8388265, 8388266, 8388267, 8388268, 8388269, 8388270, 8388271, 8388272, 12328522, 12348124, 12348125, 12348126, 12328526], "trace_timestamp_s": 10.07300000000032, "ttft_s": 3.9424062150064856, "turn_id": 1} +{"actual_output_tokens": 105, "cached_tokens": 0, "effective_input_length": 1093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1093, "latency_s": 0.6259511939715594, "output_length": 105, "proxy_request_id": "1241953:1:1241953:13", "request_id": "1241953:1:1241953:13", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1241953", "t_dispatch_unix": 1779814525.1030755, "t_finish_unix": 1779814525.729027, "t_first_token_unix": 1779814525.219192, "tpot_s": 0.0048995086539294925, "trace_hash_ids": [12364240, 12364241, 12364242], "trace_timestamp_s": 15.994000000000597, "ttft_s": 0.11611513595562428, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 7587, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7587, "latency_s": 0.7282720709918067, "output_length": 38, "proxy_request_id": "1241942:1:1241942:12", "request_id": "1241942:1:1241942:12", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1241942", "t_dispatch_unix": 1779814525.0573533, "t_finish_unix": 1779814525.7856255, "t_first_token_unix": 1779814525.5975013, "tpot_s": 0.005076572947153771, "trace_hash_ids": [12364172, 12364173, 12364174, 12364175, 12364176, 12364177, 12364178, 12364179, 12364180, 12364181, 12364182, 12364183, 12364184, 12364185, 12364186], "trace_timestamp_s": 15.945000000000618, "ttft_s": 0.5401464839815162, "turn_id": 1} +{"actual_output_tokens": 14, "cached_tokens": 1696, "effective_input_length": 2659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2659, "latency_s": 0.16042935498990119, "output_length": 14, "proxy_request_id": "1237877:3:1242953:15", "request_id": "1237877:3:1242953:15", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1237877", "t_dispatch_unix": 1779814528.4886756, "t_finish_unix": 1779814528.6491046, "t_first_token_unix": 1779814528.5863457, "tpot_s": 0.004804182461856936, "trace_hash_ids": [12325182, 12342035, 12342036, 12357464, 12373319, 12373320], "trace_timestamp_s": 19.379000000000815, "ttft_s": 0.09766948100877926, "turn_id": 3} +{"actual_output_tokens": 155, "cached_tokens": 0, "effective_input_length": 17157, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17157, "latency_s": 2.597673625976313, "output_length": 155, "proxy_request_id": "1242838:1:1242838:14", "request_id": "1242838:1:1242838:14", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1242838", "t_dispatch_unix": 1779814528.1084013, "t_finish_unix": 1779814530.7060752, "t_first_token_unix": 1779814529.8186548, "tpot_s": 0.0057605403700734595, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275], "trace_timestamp_s": 18.993000000000393, "ttft_s": 1.710251477023121, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 5232, "effective_input_length": 14812, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14812, "latency_s": 1.198615240980871, "output_length": 23, "proxy_request_id": "1239704:2:1243943:17", "request_id": "1239704:2:1243943:17", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1239704", "t_dispatch_unix": 1779814531.7668347, "t_finish_unix": 1779814532.9654498, "t_first_token_unix": 1779814532.853211, "tpot_s": 0.0050887041381263935, "trace_hash_ids": [12325298, 12325299, 12325300, 12325301, 12325302, 12325303, 12325304, 12335875, 12343073, 12343074, 12353398, 12353399, 12353400, 12353401, 12353402, 12362248, 12362249, 12362250, 12362251, 12362252, 12362253, 12374360, 12374361, 12374362, 12374363, 12374364, 12382332, 12382333, 12382334], "trace_timestamp_s": 22.65400000000045, "ttft_s": 1.0863744739908725, "turn_id": 2} +{"actual_output_tokens": 264, "cached_tokens": 0, "effective_input_length": 11074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11074, "latency_s": 2.3792625719797798, "output_length": 264, "proxy_request_id": "1243831:1:1243831:16", "request_id": "1243831:1:1243831:16", "request_type": "coder", "requested_output_tokens": 264, "session_id": "1243831", "t_dispatch_unix": 1779814531.3647654, "t_finish_unix": 1779814533.7440279, "t_first_token_unix": 1779814532.3028479, "tpot_s": 0.005478569190017879, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12381653], "trace_timestamp_s": 22.252000000000407, "ttft_s": 0.9380808109999634, "turn_id": 1} +{"actual_output_tokens": 2204, "cached_tokens": 13568, "effective_input_length": 18420, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18420, "latency_s": 13.968112508999184, "output_length": 2204, "proxy_request_id": "1239034:2:1240558:10", "request_id": "1239034:2:1240558:10", "request_type": "coder", "requested_output_tokens": 2204, "session_id": "1239034", "t_dispatch_unix": 1779814520.433761, "t_finish_unix": 1779814534.4018729, "t_first_token_unix": 1779814521.1455348, "tpot_s": 0.006017277661377637, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445], "trace_timestamp_s": 11.321000000000822, "ttft_s": 0.711771507980302, "turn_id": 2} +{"actual_output_tokens": 86, "cached_tokens": 0, "effective_input_length": 66214, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66214, "latency_s": 16.567568590980954, "output_length": 86, "proxy_request_id": "1239755:1:1239755:8", "request_id": "1239755:1:1239755:8", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1239755", "t_dispatch_unix": 1779814517.8670905, "t_finish_unix": 1779814534.4346583, "t_first_token_unix": 1779814533.7670538, "tpot_s": 0.007851262905580155, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12343455, 6866241, 2853774, 6866242, 7163, 7164, 7165, 7166, 7167, 7168, 7169, 7170, 7171, 7172, 7173, 7174, 7175, 7176, 7177, 7178, 7179, 7180, 7181, 7182, 7183, 7184, 6866243, 6866244, 6866245, 6866246, 6866247, 6866248, 6866249, 6866250, 6866251, 6866252, 6866253, 6866254, 6866255, 6866256, 6866257, 8545375, 8556763, 8697639, 8697640, 8697641, 8697642, 8697643, 8697644, 8801955, 9096778, 9096779, 9096780, 9096781, 9096782, 9096783, 9096784, 9096785, 9096786, 9149397, 9149398, 9362937, 9625264, 9969708, 9969709, 9969710, 9969711, 9969712, 10041460, 11312552, 11312553, 11312554, 11312555, 11312556, 11738834, 11738835, 11738836, 11738837, 11817307, 11870242, 11870243, 12068422, 12068423, 12068424, 12068425, 12068426, 12068427, 12068428, 12068429, 12180426, 12180427, 12343456, 12343457], "trace_timestamp_s": 8.731000000000677, "ttft_s": 15.899961289018393, "turn_id": 1} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 8274, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8274, "latency_s": 0.7969986429670826, "output_length": 40, "proxy_request_id": "1244640:1:1244640:18", "request_id": "1244640:1:1244640:18", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1244640", "t_dispatch_unix": 1779814534.2614734, "t_finish_unix": 1779814535.0584722, "t_first_token_unix": 1779814534.8588722, "tpot_s": 0.005110242075692766, "trace_hash_ids": [12346349, 12346350, 12346351, 12346352, 12346353, 12346354, 12346355, 12353250, 12363902, 12363903, 12363904, 12370522, 12389149, 12389150, 12389151, 12389152, 12389153], "trace_timestamp_s": 25.149000000000342, "ttft_s": 0.5973964940058067, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 0, "effective_input_length": 6109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6109, "latency_s": 1.0046595589956269, "output_length": 49, "proxy_request_id": "1245572:1:1245572:19", "request_id": "1245572:1:1245572:19", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1245572", "t_dispatch_unix": 1779814537.3958712, "t_finish_unix": 1779814538.4005303, "t_first_token_unix": 1779814538.1610348, "tpot_s": 0.004983661229440865, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667], "trace_timestamp_s": 28.282000000000153, "ttft_s": 0.7651619230164215, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 1184, "effective_input_length": 10382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10382, "latency_s": 0.9562248119618744, "output_length": 36, "proxy_request_id": "1241953:2:1245624:20", "request_id": "1241953:2:1245624:20", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1241953", "t_dispatch_unix": 1779814537.486227, "t_finish_unix": 1779814538.4424517, "t_first_token_unix": 1779814538.2604835, "tpot_s": 0.005189882486592978, "trace_hash_ids": [12364240, 12364241, 12380769, 12380770, 12380771, 12380772, 12380773, 12380774, 12380775, 12380776, 12380777, 12380778, 12398115, 12398116, 12398117, 12398118, 12398119, 12398120, 12398121, 12398122, 12398123], "trace_timestamp_s": 28.373000000000502, "ttft_s": 0.7742552369600162, "turn_id": 2} +{"actual_output_tokens": 36, "cached_tokens": 6144, "effective_input_length": 6182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6182, "latency_s": 0.211891713028308, "output_length": 36, "proxy_request_id": "1245572:2:1246348:22", "request_id": "1245572:2:1246348:22", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1245572", "t_dispatch_unix": 1779814539.9915361, "t_finish_unix": 1779814540.2034276, "t_first_token_unix": 1779814540.0271518, "tpot_s": 0.005027645771458213, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667, 12405800], "trace_timestamp_s": 30.882000000000517, "ttft_s": 0.03561422601342201, "turn_id": 2} +{"actual_output_tokens": 66, "cached_tokens": 7456, "effective_input_length": 17447, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17447, "latency_s": 1.5927913400228135, "output_length": 66, "proxy_request_id": "1240924:2:1246244:21", "request_id": "1240924:2:1246244:21", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1240924", "t_dispatch_unix": 1779814539.6179638, "t_finish_unix": 1779814541.2107546, "t_first_token_unix": 1779814540.8384676, "tpot_s": 0.005722095815536494, "trace_hash_ids": [12342008, 12342009, 12342010, 12342011, 12342012, 12342013, 12342014, 12342015, 12342016, 12342017, 12342018, 12342019, 12354472, 12354473, 12365097, 12370962, 12370963, 12370964, 12370965, 12378987, 12378988, 12378989, 12378990, 12384895, 12384896, 12384897, 12384898, 12393889, 12393890, 12393891, 12404797, 12404798, 12404799, 12404800, 12404801], "trace_timestamp_s": 30.502000000000407, "ttft_s": 1.220500984985847, "turn_id": 2} +{"actual_output_tokens": 35, "cached_tokens": 7616, "effective_input_length": 17975, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17975, "latency_s": 1.472865063988138, "output_length": 35, "proxy_request_id": "1241942:2:1247111:23", "request_id": "1241942:2:1247111:23", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1241942", "t_dispatch_unix": 1779814542.663481, "t_finish_unix": 1779814544.1363456, "t_first_token_unix": 1779814543.9543574, "tpot_s": 0.005343983852071688, "trace_hash_ids": [12364172, 12364173, 12364174, 12364175, 12364176, 12364177, 12364178, 12364179, 12364180, 12364181, 12364182, 12364183, 12364184, 12364185, 12370891, 12379261, 12379262, 12379263, 12379264, 12386129, 12386130, 12386131, 12386132, 12386133, 12391712, 12391713, 12391714, 12391715, 12398819, 12398820, 12398821, 12398822, 12412294, 12412295, 12412296, 12412297], "trace_timestamp_s": 33.54899999999998, "ttft_s": 1.2908742740401067, "turn_id": 2} +{"actual_output_tokens": 11, "cached_tokens": 8304, "effective_input_length": 10696, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10696, "latency_s": 0.37224296800559387, "output_length": 11, "proxy_request_id": "1244640:2:1247941:24", "request_id": "1244640:2:1247941:24", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1244640", "t_dispatch_unix": 1779814545.4808245, "t_finish_unix": 1779814545.853067, "t_first_token_unix": 1779814545.8099303, "tpot_s": 0.004286210198188201, "trace_hash_ids": [12421739, 12421740, 12421741, 12421742, 12421743, 12421744, 12421745, 12421746, 12421747, 12421748, 12421749, 12421750, 12421751, 12421752, 12421753, 12421754, 12421755, 12421756, 12421757, 12421758, 12421759], "trace_timestamp_s": 36.365999999999985, "ttft_s": 0.32910412800265476, "turn_id": 2} +{"actual_output_tokens": 49, "cached_tokens": 0, "effective_input_length": 11515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11515, "latency_s": 1.237326463975478, "output_length": 49, "proxy_request_id": "1248768:1:1248768:25", "request_id": "1248768:1:1248768:25", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1248768", "t_dispatch_unix": 1779814548.2606142, "t_finish_unix": 1779814549.49794, "t_first_token_unix": 1779814549.241252, "tpot_s": 0.005341845146176638, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12429472], "trace_timestamp_s": 39.14500000000044, "ttft_s": 0.9806363669922575, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 4126, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4126, "latency_s": 0.43098112300504, "output_length": 34, "proxy_request_id": "1249058:1:1249058:26", "request_id": "1249058:1:1249058:26", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1249058", "t_dispatch_unix": 1779814549.2819562, "t_finish_unix": 1779814549.7129374, "t_first_token_unix": 1779814549.54924, "tpot_s": 0.004952834151812236, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12432334], "trace_timestamp_s": 40.17100000000028, "ttft_s": 0.26728215196635574, "turn_id": 1} +{"actual_output_tokens": 85, "cached_tokens": 11552, "effective_input_length": 12188, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12188, "latency_s": 0.6058030509739183, "output_length": 85, "proxy_request_id": "1248768:2:1249765:27", "request_id": "1248768:2:1249765:27", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1248768", "t_dispatch_unix": 1779814551.5437953, "t_finish_unix": 1779814552.1495981, "t_first_token_unix": 1779814551.689482, "tpot_s": 0.005474305559930924, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396], "trace_timestamp_s": 42.43299999999999, "ttft_s": 0.14568498794687912, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 4144, "effective_input_length": 7482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7482, "latency_s": 0.4470797479734756, "output_length": 26, "proxy_request_id": "1249058:2:1249872:28", "request_id": "1249058:2:1249872:28", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1249058", "t_dispatch_unix": 1779814551.9359396, "t_finish_unix": 1779814552.3830192, "t_first_token_unix": 1779814552.257233, "tpot_s": 0.005021423238795251, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12440459, 12440460, 12440461, 12440462, 12440463, 12440464, 12440465], "trace_timestamp_s": 42.82600000000002, "ttft_s": 0.3212913310271688, "turn_id": 2} +{"actual_output_tokens": 83, "cached_tokens": 17296, "effective_input_length": 21578, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21578, "latency_s": 1.205011422978714, "output_length": 83, "proxy_request_id": "1242838:2:1250503:29", "request_id": "1242838:2:1250503:29", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1242838", "t_dispatch_unix": 1779814554.2096524, "t_finish_unix": 1779814555.4146638, "t_first_token_unix": 1779814554.9358928, "tpot_s": 0.005835445109391358, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12446387], "trace_timestamp_s": 45.09700000000066, "ttft_s": 0.7262384970090352, "turn_id": 2} +{"actual_output_tokens": 297, "cached_tokens": 0, "effective_input_length": 6829, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6829, "latency_s": 2.3736718359868973, "output_length": 297, "proxy_request_id": "1250772:1:1250772:30", "request_id": "1250772:1:1250772:30", "request_type": "coder", "requested_output_tokens": 297, "session_id": "1250772", "t_dispatch_unix": 1779814555.0719404, "t_finish_unix": 1779814557.4456122, "t_first_token_unix": 1779814555.875537, "tpot_s": 0.005303370111505501, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12449313], "trace_timestamp_s": 45.960000000000036, "ttft_s": 0.80359473900171, "turn_id": 1} +{"actual_output_tokens": 1, "cached_tokens": 0, "effective_input_length": 16512, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16512, "latency_s": 1.5652062520384789, "output_length": 1, "proxy_request_id": "1251059:1:1251059:32", "request_id": "1251059:1:1251059:32", "request_type": "coder", "requested_output_tokens": 1, "session_id": "1251059", "t_dispatch_unix": 1779814556.2524326, "t_finish_unix": 1779814557.8176386, "t_first_token_unix": 1779814557.8171966, "tpot_s": 0.0, "trace_hash_ids": [7062, 7063, 7064, 7065, 7066, 7067, 7068, 7069, 7070, 7071, 7072, 7073, 7074, 7075, 7076, 7077, 7078, 7079, 7080, 7081, 7082, 7083, 7084, 7085, 490787, 490788, 490789, 585565, 585566, 8073040, 572419, 572420, 572421], "trace_timestamp_s": 47.137000000000626, "ttft_s": 1.5647625510464422, "turn_id": 1} +{"actual_output_tokens": 167, "cached_tokens": 12272, "effective_input_length": 16989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16989, "latency_s": 1.6450394359999336, "output_length": 167, "proxy_request_id": "1248768:3:1251261:33", "request_id": "1248768:3:1251261:33", "request_type": "coder", "requested_output_tokens": 167, "session_id": "1248768", "t_dispatch_unix": 1779814556.8260267, "t_finish_unix": 1779814558.4710658, "t_first_token_unix": 1779814557.5154097, "tpot_s": 0.00575550627706752, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396, 12454154, 12454155, 12454156, 12454157, 12454158, 12454159, 12454160, 12454161, 12454162, 12454163], "trace_timestamp_s": 47.715000000000146, "ttft_s": 0.6893813399947248, "turn_id": 3} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 1090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1090, "latency_s": 0.19452945404918864, "output_length": 23, "proxy_request_id": "1251828:1:1251828:35", "request_id": "1251828:1:1251828:35", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1251828", "t_dispatch_unix": 1779814558.7579172, "t_finish_unix": 1779814558.9524465, "t_first_token_unix": 1779814558.8459659, "tpot_s": 0.004829175548035313, "trace_hash_ids": [12459863, 12459864, 12459865], "trace_timestamp_s": 49.64900000000034, "ttft_s": 0.08804677199805155, "turn_id": 1} +{"actual_output_tokens": 211, "cached_tokens": 0, "effective_input_length": 20086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20086, "latency_s": 3.326537702989299, "output_length": 211, "proxy_request_id": "1250935:1:1250935:31", "request_id": "1250935:1:1250935:31", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1250935", "t_dispatch_unix": 1779814555.6942852, "t_finish_unix": 1779814559.0208223, "t_first_token_unix": 1779814557.7818017, "tpot_s": 0.005899243738080952, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 59796, 4849633, 12365971, 12450880, 12450881, 12450882, 12450883, 12450884, 12450885, 12450886, 12450887, 12450888, 12450889, 12450890, 12450891, 12450892, 603588], "trace_timestamp_s": 46.577000000000226, "ttft_s": 2.0875150299980305, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 6208, "effective_input_length": 13780, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13780, "latency_s": 1.0408308660262264, "output_length": 42, "proxy_request_id": "1245572:3:1251662:34", "request_id": "1245572:3:1251662:34", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1245572", "t_dispatch_unix": 1779814558.2377062, "t_finish_unix": 1779814559.278537, "t_first_token_unix": 1779814559.0544565, "tpot_s": 0.005459924951116214, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667, 12411607, 12411608, 12419790, 12419791, 12419792, 12419793, 12419794, 12438738, 12438739, 12438740, 12447608, 12447609, 12458533, 12458534, 12458535], "trace_timestamp_s": 49.126000000000204, "ttft_s": 0.8167490470223129, "turn_id": 3} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 9855, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9855, "latency_s": 0.9839376339805312, "output_length": 34, "proxy_request_id": "1252010:1:1252010:36", "request_id": "1252010:1:1252010:36", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1252010", "t_dispatch_unix": 1779814559.3659503, "t_finish_unix": 1779814560.3498883, "t_first_token_unix": 1779814560.180557, "tpot_s": 0.005123728787470044, "trace_hash_ids": [12424913, 12432715, 12432716, 12432717, 12440818, 12440819, 12440820, 12440821, 12452285, 12452286, 12452287, 12452288, 12452289, 12452290, 12452291, 12461892, 12461893, 12461894, 12461895, 12461896], "trace_timestamp_s": 50.25300000000061, "ttft_s": 0.8146037950064056, "turn_id": 1} +{"actual_output_tokens": 501, "cached_tokens": 17152, "effective_input_length": 17309, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17309, "latency_s": 3.0080620030057617, "output_length": 501, "proxy_request_id": "1248768:4:1253385:37", "request_id": "1248768:4:1253385:37", "request_type": "coder", "requested_output_tokens": 501, "session_id": "1248768", "t_dispatch_unix": 1779814564.139834, "t_finish_unix": 1779814567.1478953, "t_first_token_unix": 1779814564.2276628, "tpot_s": 0.005840015765978024, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396, 12454154, 12454155, 12454156, 12454157, 12454158, 12454159, 12454160, 12454161, 12454162, 12475383], "trace_timestamp_s": 55.02600000000075, "ttft_s": 0.08782682300079614, "turn_id": 4} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 3934, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3934, "latency_s": 0.3918019499978982, "output_length": 30, "proxy_request_id": "1251828:2:1254272:41", "request_id": "1251828:2:1254272:41", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1251828", "t_dispatch_unix": 1779814567.1101284, "t_finish_unix": 1779814567.5019302, "t_first_token_unix": 1779814567.359422, "tpot_s": 0.004905098035594384, "trace_hash_ids": [12459863, 12459864, 12467072, 12467073, 12467074, 12467075, 12477189, 12485024], "trace_timestamp_s": 58.0, "ttft_s": 0.24929281399818137, "turn_id": 2} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 748, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 748, "latency_s": 0.2205681669875048, "output_length": 32, "proxy_request_id": "1254584:1:1254584:42", "request_id": "1254584:1:1254584:42", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1254584", "t_dispatch_unix": 1779814568.2433698, "t_finish_unix": 1779814568.4639378, "t_first_token_unix": 1779814568.313224, "tpot_s": 0.004853633934661986, "trace_hash_ids": [12480388, 12487633], "trace_timestamp_s": 59.134000000000015, "ttft_s": 0.06985358102247119, "turn_id": 1} +{"actual_output_tokens": 33, "cached_tokens": 9888, "effective_input_length": 13092, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13092, "latency_s": 0.5934957949793898, "output_length": 33, "proxy_request_id": "1252010:2:1254691:43", "request_id": "1252010:2:1254691:43", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1252010", "t_dispatch_unix": 1779814568.6945775, "t_finish_unix": 1779814569.2880733, "t_first_token_unix": 1779814569.1217537, "tpot_s": 0.005189758845517645, "trace_hash_ids": [12424913, 12432715, 12432716, 12432717, 12440818, 12440819, 12440820, 12440821, 12452285, 12452286, 12452287, 12452288, 12452289, 12452290, 12452291, 12461892, 12461893, 12461894, 12461895, 12469281, 12469282, 12480858, 12480859, 12488817, 12488818, 12488819], "trace_timestamp_s": 59.58400000000074, "ttft_s": 0.4271747159655206, "turn_id": 2} +{"actual_output_tokens": 410, "cached_tokens": 7120, "effective_input_length": 10764, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10764, "latency_s": 2.623106244020164, "output_length": 410, "proxy_request_id": "1250772:2:1254198:40", "request_id": "1250772:2:1254198:40", "request_type": "coder", "requested_output_tokens": 410, "session_id": "1250772", "t_dispatch_unix": 1779814566.83661, "t_finish_unix": 1779814569.4597163, "t_first_token_unix": 1779814567.2235925, "tpot_s": 0.00546666310515487, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12484460], "trace_timestamp_s": 57.72600000000057, "ttft_s": 0.38698076200671494, "turn_id": 2} +{"actual_output_tokens": 321, "cached_tokens": 0, "effective_input_length": 35221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35221, "latency_s": 7.3549830070114695, "output_length": 321, "proxy_request_id": "1253804:1:1253804:39", "request_id": "1253804:1:1253804:39", "request_type": "coder", "requested_output_tokens": 321, "session_id": "1253804", "t_dispatch_unix": 1779814565.7249265, "t_finish_unix": 1779814573.0799093, "t_first_token_unix": 1779814570.89587, "tpot_s": 0.006824331028292363, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114], "trace_timestamp_s": 56.60400000000027, "ttft_s": 5.170940798998345, "turn_id": 1} +{"actual_output_tokens": 58, "cached_tokens": 0, "effective_input_length": 1694, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1694, "latency_s": 0.4253717109677382, "output_length": 58, "proxy_request_id": "1256273:1:1256273:46", "request_id": "1256273:1:1256273:46", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1256273", "t_dispatch_unix": 1779814573.9267597, "t_finish_unix": 1779814574.3521314, "t_first_token_unix": 1779814574.0720725, "tpot_s": 0.00490867582419397, "trace_hash_ids": [12492922, 12504484, 12504485, 12504486], "trace_timestamp_s": 64.81600000000071, "ttft_s": 0.14531142701162025, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 11328, "effective_input_length": 11448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11448, "latency_s": 0.4887339129927568, "output_length": 80, "proxy_request_id": "1243831:2:1256324:47", "request_id": "1243831:2:1256324:47", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1243831", "t_dispatch_unix": 1779814574.0895963, "t_finish_unix": 1779814574.5783303, "t_first_token_unix": 1779814574.1455095, "tpot_s": 0.005475753430524676, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12504841], "trace_timestamp_s": 64.98000000000047, "ttft_s": 0.055911406991072, "turn_id": 2} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 49624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49624, "latency_s": 9.646873441990465, "output_length": 57, "proxy_request_id": "1253743:1:1253743:38", "request_id": "1253743:1:1253743:38", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1253743", "t_dispatch_unix": 1779814565.4807072, "t_finish_unix": 1779814575.12758, "t_first_token_unix": 1779814574.7407951, "tpot_s": 0.0069021437863869195, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411], "trace_timestamp_s": 56.35200000000077, "ttft_s": 9.260085457994137, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 7504, "effective_input_length": 17786, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17786, "latency_s": 1.3844577129930258, "output_length": 23, "proxy_request_id": "1249058:3:1256222:45", "request_id": "1249058:3:1256222:45", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1249058", "t_dispatch_unix": 1779814573.7764719, "t_finish_unix": 1779814575.1609292, "t_first_token_unix": 1779814575.0488372, "tpot_s": 0.0050856336363887585, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12440459, 12440460, 12440461, 12440462, 12440463, 12440464, 12464529, 12464530, 12464531, 12464532, 12474164, 12474165, 12474166, 12481572, 12481573, 12481574, 12481575, 12481576, 12481577, 12481578, 12494816, 12494817, 12494818, 12494819, 12504084, 12504085, 12504086], "trace_timestamp_s": 64.66300000000047, "ttft_s": 1.2723633429850452, "turn_id": 3} +{"actual_output_tokens": 112, "cached_tokens": 49680, "effective_input_length": 49687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49687, "latency_s": 0.9004950380185619, "output_length": 112, "proxy_request_id": "1253743:2:1256070:44", "request_id": "1253743:2:1256070:44", "request_type": "coder", "requested_output_tokens": 112, "session_id": "1253743", "t_dispatch_unix": 1779814575.1297266, "t_finish_unix": 1779814576.0302215, "t_first_token_unix": 1779814575.2200136, "tpot_s": 0.007296572162492855, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12502790], "trace_timestamp_s": 64.15700000000015, "ttft_s": 0.0902845420059748, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 1744, "effective_input_length": 6170, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6170, "latency_s": 0.6247106969822198, "output_length": 59, "proxy_request_id": "1256273:2:1257769:51", "request_id": "1256273:2:1257769:51", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1256273", "t_dispatch_unix": 1779814578.9076717, "t_finish_unix": 1779814579.5323827, "t_first_token_unix": 1779814579.238659, "tpot_s": 0.005058623947692907, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12519481], "trace_timestamp_s": 69.79700000000048, "ttft_s": 0.3309857490239665, "turn_id": 2} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 4434, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4434, "latency_s": 1.507240817998536, "output_length": 237, "proxy_request_id": "1257572:1:1257572:50", "request_id": "1257572:1:1257572:50", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1257572", "t_dispatch_unix": 1779814578.2750478, "t_finish_unix": 1779814579.7822886, "t_first_token_unix": 1779814578.563753, "tpot_s": 0.005162128855788022, "trace_hash_ids": [12494641, 12494642, 12494643, 12494644, 12494645, 12494646, 12494647, 12516925, 12516926], "trace_timestamp_s": 69.16400000000067, "ttft_s": 0.28870320902206004, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 768, "effective_input_length": 1257, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1257, "latency_s": 0.3850256290170364, "output_length": 68, "proxy_request_id": "1254584:2:1258039:52", "request_id": "1254584:2:1258039:52", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1254584", "t_dispatch_unix": 1779814579.929418, "t_finish_unix": 1779814580.3144436, "t_first_token_unix": 1779814579.9848897, "tpot_s": 0.004914603701709255, "trace_hash_ids": [12480388, 12511291, 12522116], "trace_timestamp_s": 70.82000000000062, "ttft_s": 0.055470779014285654, "turn_id": 2} +{"actual_output_tokens": 92, "cached_tokens": 21648, "effective_input_length": 22262, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22262, "latency_s": 0.7108921820181422, "output_length": 92, "proxy_request_id": "1242838:3:1258161:53", "request_id": "1242838:3:1258161:53", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1242838", "t_dispatch_unix": 1779814580.3878553, "t_finish_unix": 1779814581.0987546, "t_first_token_unix": 1779814580.5606463, "tpot_s": 0.005910609703597991, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892], "trace_timestamp_s": 71.27700000000004, "ttft_s": 0.1727889989851974, "turn_id": 3} +{"actual_output_tokens": 116, "cached_tokens": 6224, "effective_input_length": 7934, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7934, "latency_s": 0.7944240039796568, "output_length": 116, "proxy_request_id": "1256273:3:1258499:55", "request_id": "1256273:3:1258499:55", "request_type": "coder", "requested_output_tokens": 116, "session_id": "1256273", "t_dispatch_unix": 1779814581.551953, "t_finish_unix": 1779814582.346377, "t_first_token_unix": 1779814581.739594, "tpot_s": 0.00527400919135012, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12526397, 12526398, 12526399, 12526400], "trace_timestamp_s": 72.44200000000001, "ttft_s": 0.18763951497385278, "turn_id": 3} +{"actual_output_tokens": 362, "cached_tokens": 0, "effective_input_length": 9250, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9250, "latency_s": 2.6677178919781, "output_length": 362, "proxy_request_id": "1258908:1:1258908:58", "request_id": "1258908:1:1258908:58", "request_type": "coder", "requested_output_tokens": 362, "session_id": "1258908", "t_dispatch_unix": 1779814583.005815, "t_finish_unix": 1779814585.673533, "t_first_token_unix": 1779814583.7066245, "tpot_s": 0.00544777367595542, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 12530208, 12530209, 12530210, 12530211], "trace_timestamp_s": 73.89300000000003, "ttft_s": 0.7008076189667918, "turn_id": 1} +{"actual_output_tokens": 341, "cached_tokens": 0, "effective_input_length": 14291, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14291, "latency_s": 3.1788852000026964, "output_length": 341, "proxy_request_id": "1259178:1:1259178:59", "request_id": "1259178:1:1259178:59", "request_type": "coder", "requested_output_tokens": 341, "session_id": "1259178", "t_dispatch_unix": 1779814583.9671297, "t_finish_unix": 1779814587.1460147, "t_first_token_unix": 1779814585.222358, "tpot_s": 0.005656778096967815, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319], "trace_timestamp_s": 74.85200000000077, "ttft_s": 1.2552267599967308, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 27387, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27387, "latency_s": 9.08282751700608, "output_length": 45, "proxy_request_id": "1257525:1:1257525:49", "request_id": "1257525:1:1257525:49", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1257525", "t_dispatch_unix": 1779814578.1862495, "t_finish_unix": 1779814587.2690768, "t_first_token_unix": 1779814581.6498837, "tpot_s": 0.1277008871587565, "trace_hash_ids": [12479517, 12479518, 12479519, 12479520, 12479521, 12479522, 12479523, 12479524, 12479525, 12479526, 12479527, 12479528, 12479529, 12479530, 12479531, 12479532, 12479533, 12479534, 12479535, 12479536, 12479537, 12479538, 12479539, 12479540, 12479541, 12479542, 12479543, 12479544, 12479545, 12479546, 12479547, 12479548, 12479549, 12479550, 12479551, 12479552, 12479553, 12479554, 12479555, 12479556, 12479557, 12479558, 12479559, 12479560, 12479561, 12479562, 12479563, 12499990, 12499991, 12509015, 12516559, 12516560, 12516561, 12516562], "trace_timestamp_s": 69.06500000000051, "ttft_s": 3.463631662016269, "turn_id": 1} +{"actual_output_tokens": 110, "cached_tokens": 35536, "effective_input_length": 52978, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52978, "latency_s": 6.722800040966831, "output_length": 110, "proxy_request_id": "1253804:2:1258346:54", "request_id": "1253804:2:1258346:54", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1253804", "t_dispatch_unix": 1779814581.0937665, "t_finish_unix": 1779814587.8165658, "t_first_token_unix": 1779814586.9070494, "tpot_s": 0.008341706963469607, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968], "trace_timestamp_s": 71.97700000000077, "ttft_s": 5.8132810879615135, "turn_id": 2} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 9571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9571, "latency_s": 1.139845562982373, "output_length": 73, "proxy_request_id": "1260746:1:1260746:62", "request_id": "1260746:1:1260746:62", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1260746", "t_dispatch_unix": 1779814589.5098953, "t_finish_unix": 1779814590.6497407, "t_first_token_unix": 1779814590.2656388, "tpot_s": 0.005331313083944324, "trace_hash_ids": [12532255, 12532256, 12532257, 12532258, 12532259, 12532260, 12538543, 12538544, 12538545, 12547747, 12547748, 12547749, 12547750, 12547751, 12547752, 12547753, 12547754, 12547755, 12547756], "trace_timestamp_s": 80.39699999999993, "ttft_s": 0.7557417019852437, "turn_id": 1} +{"actual_output_tokens": 62, "cached_tokens": 0, "effective_input_length": 12522, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12522, "latency_s": 1.3633827720186673, "output_length": 62, "proxy_request_id": "1260792:1:1260792:63", "request_id": "1260792:1:1260792:63", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1260792", "t_dispatch_unix": 1779814589.628334, "t_finish_unix": 1779814590.9917166, "t_first_token_unix": 1779814590.661797, "tpot_s": 0.005404450491711986, "trace_hash_ids": [12518548, 12518549, 12518550, 12528577, 12528578, 12528579, 12538129, 12538130, 12538131, 12538132, 12538133, 12538134, 12538135, 12538136, 12538137, 12538138, 12548530, 12548531, 12548532, 12548533, 12548534, 12548535, 12548536, 12548537, 12548538], "trace_timestamp_s": 80.51299999999992, "ttft_s": 1.033461666025687, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 5640, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5640, "latency_s": 0.5378800369799137, "output_length": 34, "proxy_request_id": "1261126:1:1261126:65", "request_id": "1261126:1:1261126:65", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1261126", "t_dispatch_unix": 1779814590.664354, "t_finish_unix": 1779814591.202234, "t_first_token_unix": 1779814591.0360053, "tpot_s": 0.00503034042511982, "trace_hash_ids": [12523217, 12523218, 12542338, 12542339, 12542340, 12542341, 12550806, 12550807, 12550808, 12550809, 12550810, 12550811], "trace_timestamp_s": 81.5530000000008, "ttft_s": 0.37164948298595846, "turn_id": 1} +{"actual_output_tokens": 79, "cached_tokens": 53072, "effective_input_length": 55138, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55138, "latency_s": 1.4707180029945448, "output_length": 79, "proxy_request_id": "1253804:3:1260997:64", "request_id": "1253804:3:1260997:64", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1253804", "t_dispatch_unix": 1779814590.3603356, "t_finish_unix": 1779814591.8310535, "t_first_token_unix": 1779814591.2630181, "tpot_s": 0.007279252551364688, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987], "trace_timestamp_s": 81.2490000000007, "ttft_s": 0.9026802029693499, "turn_id": 3} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 30655, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30655, "latency_s": 4.710612202994525, "output_length": 101, "proxy_request_id": "1260327:1:1260327:61", "request_id": "1260327:1:1260327:61", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1260327", "t_dispatch_unix": 1779814587.7883112, "t_finish_unix": 1779814592.4989233, "t_first_token_unix": 1779814591.865693, "tpot_s": 0.006329915199894458, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103], "trace_timestamp_s": 78.66800000000057, "ttft_s": 4.077380064991303, "turn_id": 1} +{"actual_output_tokens": 9, "cached_tokens": 27424, "effective_input_length": 29988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29988, "latency_s": 0.6669193779816851, "output_length": 9, "proxy_request_id": "1257525:2:1262205:67", "request_id": "1257525:2:1262205:67", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1257525", "t_dispatch_unix": 1779814594.4761045, "t_finish_unix": 1779814595.1430233, "t_first_token_unix": 1779814595.125726, "tpot_s": 0.00212890900002094, "trace_hash_ids": [12560509, 12560510, 12560511, 12560512, 12560513, 12560514, 12560515, 12560516, 12560517, 12560518, 12560519, 12560520, 12560521, 12560522, 12560523, 12560524, 12560525, 12560526, 12560527, 12560528, 12560529, 12560530, 12560531, 12560532, 12560533, 12560534, 12560535, 12560536, 12560537, 12560538, 12560539, 12560540, 12560541, 12560542, 12560543, 12560544, 12560545, 12560546, 12560547, 12560548, 12560549, 12560550, 12560551, 12560552, 12560553, 12560554, 12560555, 12560556, 12560557, 12560558, 12560559, 12560560, 12560561, 12560562, 12560563, 12560564, 12560565, 12560566, 12560567], "trace_timestamp_s": 85.35500000000047, "ttft_s": 0.6496193209895864, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 5465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5465, "latency_s": 0.48733119398821145, "output_length": 27, "proxy_request_id": "1262757:1:1262757:73", "request_id": "1262757:1:1262757:73", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1262757", "t_dispatch_unix": 1779814596.3612483, "t_finish_unix": 1779814596.8485794, "t_first_token_unix": 1779814596.7191129, "tpot_s": 0.004969042537805553, "trace_hash_ids": [12513740, 12528866, 12528867, 12537233, 12537234, 12537235, 12547253, 12557610, 12557611, 12557612, 12566807], "trace_timestamp_s": 87.2490000000007, "ttft_s": 0.3578640249907039, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 5664, "effective_input_length": 6953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6953, "latency_s": 0.39432012499310076, "output_length": 46, "proxy_request_id": "1261126:2:1262820:74", "request_id": "1261126:2:1262820:74", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1261126", "t_dispatch_unix": 1779814596.5318725, "t_finish_unix": 1779814596.9261923, "t_first_token_unix": 1779814596.6952088, "tpot_s": 0.005127244222805732, "trace_hash_ids": [12523217, 12523218, 12542338, 12542339, 12542340, 12542341, 12550806, 12550807, 12550808, 12550809, 12550810, 12557298, 12567376, 12567377], "trace_timestamp_s": 87.42200000000048, "ttft_s": 0.16333490394754335, "turn_id": 2} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 21510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21510, "latency_s": 2.9196547140018083, "output_length": 101, "proxy_request_id": "1262354:1:1262354:69", "request_id": "1262354:1:1262354:69", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1262354", "t_dispatch_unix": 1779814595.075003, "t_finish_unix": 1779814597.9946578, "t_first_token_unix": 1779814597.4034078, "tpot_s": 0.005908283550525084, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12562242], "trace_timestamp_s": 85.95800000000054, "ttft_s": 2.32840276096249, "turn_id": 1} +{"actual_output_tokens": 139, "cached_tokens": 0, "effective_input_length": 68131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68131, "latency_s": 17.543830120004714, "output_length": 139, "proxy_request_id": "1258611:1:1258611:56", "request_id": "1258611:1:1258611:56", "request_type": "coder", "requested_output_tokens": 139, "session_id": "1258611", "t_dispatch_unix": 1779814581.9402857, "t_finish_unix": 1779814599.4841151, "t_first_token_unix": 1779814598.334745, "tpot_s": 0.008326890195493816, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 72.80500000000029, "ttft_s": 16.394456912006717, "turn_id": 1} +{"actual_output_tokens": 10, "cached_tokens": 68256, "effective_input_length": 68320, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68320, "latency_s": 0.19342848705127835, "output_length": 10, "proxy_request_id": "1258611:2:1261594:66", "request_id": "1258611:2:1261594:66", "request_type": "coder", "requested_output_tokens": 10, "session_id": "1258611", "t_dispatch_unix": 1779814599.4873056, "t_finish_unix": 1779814599.6807342, "t_first_token_unix": 1779814599.6509254, "tpot_s": 0.003281267883721739, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 83.19100000000071, "ttft_s": 0.16361722204601392, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 68320, "effective_input_length": 68377, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68377, "latency_s": 0.5814840699895285, "output_length": 55, "proxy_request_id": "1258611:3:1262709:71", "request_id": "1258611:3:1262709:71", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1258611", "t_dispatch_unix": 1779814599.6844227, "t_finish_unix": 1779814600.2659066, "t_first_token_unix": 1779814599.8433487, "tpot_s": 0.007821054444691443, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 87.12800000000061, "ttft_s": 0.158924121002201, "turn_id": 3} +{"actual_output_tokens": 76, "cached_tokens": 0, "effective_input_length": 5990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5990, "latency_s": 0.7921687459456734, "output_length": 76, "proxy_request_id": "1263611:1:1263611:76", "request_id": "1263611:1:1263611:76", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1263611", "t_dispatch_unix": 1779814599.556484, "t_finish_unix": 1779814600.3486488, "t_first_token_unix": 1779814599.9651713, "tpot_s": 0.005109651333186776, "trace_hash_ids": [12565267, 12565268, 12565269, 12565270, 12574728, 12574729, 12574730, 12574731, 12574732, 12574733, 12574734, 12574735], "trace_timestamp_s": 90.44100000000071, "ttft_s": 0.40868988999864087, "turn_id": 1} +{"actual_output_tokens": 202, "cached_tokens": 21600, "effective_input_length": 22109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22109, "latency_s": 1.3857641069917008, "output_length": 202, "proxy_request_id": "1262354:2:1263593:75", "request_id": "1262354:2:1263593:75", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1262354", "t_dispatch_unix": 1779814599.4392, "t_finish_unix": 1779814600.8249638, "t_first_token_unix": 1779814599.6142535, "tpot_s": 0.00602224009952494, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12574479], "trace_timestamp_s": 90.32900000000063, "ttft_s": 0.1750515649910085, "turn_id": 2} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 6336, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6336, "latency_s": 0.7772045349702239, "output_length": 71, "proxy_request_id": "1263971:1:1263971:80", "request_id": "1263971:1:1263971:80", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1263971", "t_dispatch_unix": 1779814600.8628292, "t_finish_unix": 1779814601.640034, "t_first_token_unix": 1779814601.2816029, "tpot_s": 0.00511673497135884, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12579286], "trace_timestamp_s": 91.7510000000002, "ttft_s": 0.4187610099907033, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 0, "effective_input_length": 90488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90488, "latency_s": 27.992789880023338, "output_length": 42, "proxy_request_id": "1257323:1:1257323:48", "request_id": "1257323:1:1257323:48", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1257323", "t_dispatch_unix": 1779814577.5800023, "t_finish_unix": 1779814605.5727916, "t_first_token_unix": 1779814605.1827006, "tpot_s": 0.009505305293004779, "trace_hash_ids": [2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518, 46994, 46995, 46996, 46997, 46998, 46999, 47000, 47001, 47002, 47003, 47004, 47005, 47006, 47007, 47008, 47009, 47010, 47011, 47012, 4751454, 2379937, 2379938, 2379939, 2379940, 2379941, 4751455, 4751456, 4751457, 4751458, 4751459, 4751460, 4751461, 4751462, 4751463, 4751464, 4751465, 4751466, 4751467, 4751468, 4751469, 4751470, 4751471, 4751472, 4751473, 4751474, 4751475, 4751476, 4751477, 4751478, 4751479, 4751480, 4751481, 4751482, 4751483, 4751484, 4751485, 10670236, 10670237, 10670238, 10670239, 10670240, 10670241, 10670242, 10670243, 10670244, 10670245, 10670246, 10670247, 10670248, 10670249, 10670250, 10670251, 10670252, 10670253, 10670254, 10670255, 10670256, 10670257, 10670258, 10670259, 10670260, 10670261, 10994656, 10994657, 10994658, 10994659, 10994660, 10994661, 10994662, 10994663, 10994664, 10994665, 10994666, 10994667, 10994668, 10994669, 10994670, 10994671, 10994672, 10994673, 10994674, 10994675, 10994676, 10994677, 10994678, 10994679, 10994680, 10994681, 10994682, 10994683, 10994684, 10994685, 10994686, 10994687, 10994688, 10994689, 10994690, 10994691, 10994692, 10994693, 10994694, 10994695, 10994696, 10994697, 10994698, 10994699, 10994700, 10994701, 10994702, 10994703, 10994704, 10994705, 10994706, 10994707, 10994708, 10994709, 10994710, 10994711, 10994712, 10994713, 10994714, 10994715, 10994716, 10994717, 10994718, 10994719, 10994720, 10994721, 10994722, 10994723, 10994724, 10994725, 10994726, 10994727, 11134572, 11161915, 11261064, 11282181, 11360636, 11420052, 11420053, 11446131, 11701929, 12264742, 12297965, 12385798, 12385799, 12514819, 12514820], "trace_timestamp_s": 68.43299999999999, "ttft_s": 27.602696435991675, "turn_id": 1} +{"actual_output_tokens": 63, "cached_tokens": 20608, "effective_input_length": 22565, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22565, "latency_s": 10.652565600001253, "output_length": 63, "proxy_request_id": "1239034:3:1262346:68", "request_id": "1239034:3:1262346:68", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1239034", "t_dispatch_unix": 1779814595.0440614, "t_finish_unix": 1779814605.6966267, "t_first_token_unix": 1779814605.1687188, "tpot_s": 0.008510675612694373, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445, 12562130, 12562131, 12562132, 12562133, 12562134, 12562135, 12562136, 12562137, 12562138], "trace_timestamp_s": 85.9320000000007, "ttft_s": 10.124653553008102, "turn_id": 3} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 301, "latency_s": 1.5518407670315355, "output_length": 68, "proxy_request_id": "1265000:1:1265000:83", "request_id": "1265000:1:1265000:83", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1265000", "t_dispatch_unix": 1779814604.489498, "t_finish_unix": 1779814606.0413387, "t_first_token_unix": 1779814604.5290542, "tpot_s": 0.02256475441738157, "trace_hash_ids": [12589398], "trace_timestamp_s": 95.38000000000011, "ttft_s": 0.03955503401812166, "turn_id": 1} +{"actual_output_tokens": 77, "cached_tokens": 0, "effective_input_length": 14028, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14028, "latency_s": 1.6494587399647571, "output_length": 77, "proxy_request_id": "1265128:1:1265128:85", "request_id": "1265128:1:1265128:85", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1265128", "t_dispatch_unix": 1779814604.8153858, "t_finish_unix": 1779814606.4648442, "t_first_token_unix": 1779814606.0397346, "tpot_s": 0.005590227157594391, "trace_hash_ids": [12531602, 12531603, 12531604, 12531605, 12531606, 12531607, 12531608, 12531609, 12531610, 12531611, 12531612, 12531613, 12531614, 12531615, 12531616, 12531617, 12544382, 12544383, 12544384, 12557454, 12557455, 12557456, 12557457, 12557458, 12590524, 12590525, 12590526, 12590527], "trace_timestamp_s": 95.70100000000002, "ttft_s": 1.2243473699782044, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 579, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 579, "latency_s": 0.2825961670023389, "output_length": 23, "proxy_request_id": "1266067:1:1266067:91", "request_id": "1266067:1:1266067:91", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1266067", "t_dispatch_unix": 1779814608.0391467, "t_finish_unix": 1779814608.3217428, "t_first_token_unix": 1779814608.1567836, "tpot_s": 0.007486011406978254, "trace_hash_ids": [12599495, 12599496], "trace_timestamp_s": 98.93000000000029, "ttft_s": 0.11763628502376378, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 13178, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13178, "latency_s": 1.3612864469760098, "output_length": 47, "proxy_request_id": "1263611:2:1265770:88", "request_id": "1263611:2:1265770:88", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1263611", "t_dispatch_unix": 1779814607.135541, "t_finish_unix": 1779814608.4968271, "t_first_token_unix": 1779814608.248763, "tpot_s": 0.005387450500047239, "trace_hash_ids": [12565267, 12565268, 12565269, 12565270, 12574728, 12574729, 12574730, 12574731, 12574732, 12574733, 12574734, 12587940, 12587941, 12587942, 12587943, 12587944, 12587945, 12587946, 12587947, 12596811, 12596812, 12596813, 12596814, 12596815, 12596816, 12596817], "trace_timestamp_s": 98.02400000000034, "ttft_s": 1.1132208199705929, "turn_id": 2} +{"actual_output_tokens": 203, "cached_tokens": 0, "effective_input_length": 23540, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23540, "latency_s": 4.2969468659721315, "output_length": 203, "proxy_request_id": "1250772:3:1265019:84", "request_id": "1250772:3:1265019:84", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1250772", "t_dispatch_unix": 1779814604.5553057, "t_finish_unix": 1779814608.8522527, "t_first_token_unix": 1779814607.2520218, "tpot_s": 0.007920753658290418, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12546417, 12546418, 12546419, 12546420, 12546421, 12546422, 12546423, 12546424, 12546425, 12546426, 12546427, 12546428, 12546429, 12546430, 12546431, 12546432, 12546433, 12546434, 12589516, 12589517, 12589518, 12589519, 12589520, 12589521, 12589522], "trace_timestamp_s": 95.44100000000071, "ttft_s": 2.6967141079949215, "turn_id": 3} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 4070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4070, "latency_s": 1.1546106499736197, "output_length": 92, "proxy_request_id": "1265942:1:1265942:89", "request_id": "1265942:1:1265942:89", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1265942", "t_dispatch_unix": 1779814607.7648637, "t_finish_unix": 1779814608.919474, "t_first_token_unix": 1779814608.080474, "tpot_s": 0.009216200780369097, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596], "trace_timestamp_s": 98.65400000000045, "ttft_s": 0.3156089619733393, "turn_id": 1} +{"actual_output_tokens": 331, "cached_tokens": 22304, "effective_input_length": 22344, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22344, "latency_s": 4.72297386295395, "output_length": 331, "proxy_request_id": "1262354:3:1265178:86", "request_id": "1262354:3:1265178:86", "request_type": "coder", "requested_output_tokens": 331, "session_id": "1262354", "t_dispatch_unix": 1779814604.9228024, "t_finish_unix": 1779814609.6457758, "t_first_token_unix": 1779814607.2542753, "tpot_s": 0.007246095848544924, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12591121], "trace_timestamp_s": 95.8130000000001, "ttft_s": 2.33147164597176, "turn_id": 3} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 5381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5381, "latency_s": 0.676969650958199, "output_length": 59, "proxy_request_id": "1266440:1:1266440:92", "request_id": "1266440:1:1266440:92", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1266440", "t_dispatch_unix": 1779814609.1115055, "t_finish_unix": 1779814609.7884748, "t_first_token_unix": 1779814609.4915922, "tpot_s": 0.005114411223671752, "trace_hash_ids": [12582173, 12582174, 12582175, 12603412, 12603413, 12603414, 12603415, 12603416, 12603417, 12603418, 12603419], "trace_timestamp_s": 100.0010000000002, "ttft_s": 0.3800851679989137, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 50783, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50783, "latency_s": 9.907421880983748, "output_length": 29, "proxy_request_id": "1263727:1:1263727:77", "request_id": "1263727:1:1263727:77", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1263727", "t_dispatch_unix": 1779814600.0170019, "t_finish_unix": 1779814609.9244237, "t_first_token_unix": 1779814609.7525866, "tpot_s": 0.006129065642848478, "trace_hash_ids": [12556738, 12556739, 12556740, 12556741, 12556742, 12556743, 12556744, 12556745, 12556746, 12556747, 12556748, 12556749, 12556750, 12556751, 12556752, 12556753, 12556754, 12556755, 12556756, 12556757, 12556758, 12556759, 12556760, 12556761, 12556762, 12556763, 12556764, 12556765, 12556766, 12556767, 12556768, 12556769, 12556770, 12556771, 12556772, 12556773, 12556774, 12556775, 12556776, 12556777, 12556778, 12556779, 12556780, 12556781, 12556782, 12556783, 12556784, 12556785, 12556786, 12556787, 12556788, 12556789, 12556790, 12556791, 12556792, 12556793, 12556794, 12556795, 12556796, 12556797, 12556798, 12556799, 12556800, 12556801, 12556802, 12556803, 12556804, 12556805, 12556806, 12556807, 12556808, 12556809, 12556810, 12556811, 12556812, 12556813, 12556814, 12556815, 12556816, 12556817, 12556818, 12556819, 12556820, 12556821, 12556822, 12556823, 12556824, 12556825, 12556826, 12556827, 12556828, 12556829, 12556830, 12556831, 12556832, 12556833, 12556834, 12556835, 12575902, 12575903], "trace_timestamp_s": 90.88900000000012, "ttft_s": 9.735582021996379, "turn_id": 1} +{"actual_output_tokens": 1649, "cached_tokens": 55216, "effective_input_length": 55989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55989, "latency_s": 14.109680109017063, "output_length": 1649, "proxy_request_id": "1253804:4:1262690:70", "request_id": "1253804:4:1262690:70", "request_type": "coder", "requested_output_tokens": 1649, "session_id": "1253804", "t_dispatch_unix": 1779814596.1688516, "t_finish_unix": 1779814610.2785313, "t_first_token_unix": 1779814596.6237197, "tpot_s": 0.008285537436906841, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12566184], "trace_timestamp_s": 87.0560000000005, "ttft_s": 0.4548659059801139, "turn_id": 4} +{"actual_output_tokens": 30, "cached_tokens": 6400, "effective_input_length": 9504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9504, "latency_s": 0.5148311830125749, "output_length": 30, "proxy_request_id": "1263971:2:1266797:94", "request_id": "1263971:2:1266797:94", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1263971", "t_dispatch_unix": 1779814610.460572, "t_finish_unix": 1779814610.9754026, "t_first_token_unix": 1779814610.8257995, "tpot_s": 0.005150567587657735, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12597530, 12597531, 12597532, 12606764, 12606765, 12606766, 12606767], "trace_timestamp_s": 101.35000000000036, "ttft_s": 0.3652269080048427, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 12576, "effective_input_length": 20985, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20985, "latency_s": 5.449934445961844, "output_length": 46, "proxy_request_id": "1260792:2:1265951:90", "request_id": "1260792:2:1265951:90", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1260792", "t_dispatch_unix": 1779814607.7901058, "t_finish_unix": 1779814613.2400403, "t_first_token_unix": 1779814612.7301595, "tpot_s": 0.011320434510707855, "trace_hash_ids": [12598651, 12598652, 12598653, 12598654, 12598655, 12598656, 12598657, 12598658, 12598659, 12598660, 12598661, 12598662, 12598663, 12598664, 12598665, 12598666, 12598667, 12598668, 12598669, 12598670, 12598671, 12598672, 12598673, 12598674, 12598675, 12598676, 12598677, 12598678, 12598679, 12598680, 12598681, 12598682, 12598683, 12598684, 12598685, 12598686, 12598687, 12598688, 12598689, 12598690, 12598691], "trace_timestamp_s": 98.67300000000068, "ttft_s": 4.9400517829926684, "turn_id": 2} +{"actual_output_tokens": 143, "cached_tokens": 0, "effective_input_length": 56292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56292, "latency_s": 14.08483905903995, "output_length": 143, "proxy_request_id": "1263749:1:1263749:79", "request_id": "1263749:1:1263749:79", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1263749", "t_dispatch_unix": 1779814600.0894763, "t_finish_unix": 1779814614.1743152, "t_first_token_unix": 1779814611.564235, "tpot_s": 0.01837874280287176, "trace_hash_ids": [51262, 61305, 61306, 637504, 637505, 637506, 637507, 637508, 637509, 637510, 637511, 637512, 637513, 637514, 637515, 637516, 637517, 637518, 637519, 637520, 637521, 637522, 637523, 637524, 637525, 637526, 584014, 637527, 637528, 1022562, 637530, 1022563, 637532, 637533, 248930, 1022564, 4415649, 4415650, 4415651, 12449838, 12449839, 12449840, 12449841, 12449842, 12449843, 12449844, 12449845, 12449846, 12449847, 12449848, 12449849, 12449850, 12449851, 12449852, 12449853, 12449854, 12449855, 12449856, 12449857, 12449858, 12449859, 12449860, 12449861, 12449862, 12449863, 12449864, 12449865, 12449866, 12449867, 12449868, 12449869, 12449870, 12449871, 12449872, 12449873, 12449874, 12449875, 12449876, 12449877, 12449878, 12449879, 12449880, 12449881, 12449882, 12449883, 12449884, 12449885, 12449886, 12449887, 12449888, 12449889, 12449890, 12449891, 12449892, 12449893, 12449894, 12449895, 12449896, 12449897, 12553020, 12553021, 12553022, 12553023, 12553024, 12553025, 12553026, 12553027, 12553028, 12553029, 12553030], "trace_timestamp_s": 90.95900000000074, "ttft_s": 11.474756087991409, "turn_id": 1} +{"actual_output_tokens": 662, "cached_tokens": 0, "effective_input_length": 17466, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17466, "latency_s": 5.558824511012062, "output_length": 662, "proxy_request_id": "1266668:1:1266668:93", "request_id": "1266668:1:1266668:93", "request_type": "coder", "requested_output_tokens": 662, "session_id": "1266668", "t_dispatch_unix": 1779814610.0114481, "t_finish_unix": 1779814615.5702727, "t_first_token_unix": 1779814611.7200427, "tpot_s": 0.005824433662629237, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12605179], "trace_timestamp_s": 100.89699999999993, "ttft_s": 1.7085930720204487, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 4160, "effective_input_length": 10457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10457, "latency_s": 0.9313933440134861, "output_length": 67, "proxy_request_id": "1265942:2:1268069:97", "request_id": "1265942:2:1268069:97", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1265942", "t_dispatch_unix": 1779814614.7685301, "t_finish_unix": 1779814615.6999235, "t_first_token_unix": 1779814615.3483436, "tpot_s": 0.005322995651195842, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596, 12609655, 12609656, 12609657, 12609658, 12618768, 12618769, 12618770, 12618771, 12618772, 12618773, 12618774, 12618775, 12618776], "trace_timestamp_s": 105.65700000000015, "ttft_s": 0.5798114039935172, "turn_id": 2} +{"actual_output_tokens": 202, "cached_tokens": 22672, "effective_input_length": 28671, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28671, "latency_s": 2.4829904370126314, "output_length": 202, "proxy_request_id": "1262354:4:1267821:95", "request_id": "1262354:4:1267821:95", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1262354", "t_dispatch_unix": 1779814614.0672255, "t_finish_unix": 1779814616.5502155, "t_first_token_unix": 1779814615.265418, "tpot_s": 0.006390734412939061, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939], "trace_timestamp_s": 104.95499999999993, "ttft_s": 1.1981904100393876, "turn_id": 4} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 2298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2298, "latency_s": 0.3938434299780056, "output_length": 24, "proxy_request_id": "1268634:1:1268634:99", "request_id": "1268634:1:1268634:99", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1268634", "t_dispatch_unix": 1779814616.9760127, "t_finish_unix": 1779814617.3698566, "t_first_token_unix": 1779814617.257349, "tpot_s": 0.004878637654220928, "trace_hash_ids": [12598584, 12598585, 12598586, 12612307, 12624657], "trace_timestamp_s": 107.82400000000052, "ttft_s": 0.28133455995703116, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 18638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18638, "latency_s": 2.0850278009893373, "output_length": 27, "proxy_request_id": "1268649:1:1268649:100", "request_id": "1268649:1:1268649:100", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1268649", "t_dispatch_unix": 1779814616.9838536, "t_finish_unix": 1779814619.0688818, "t_first_token_unix": 1779814618.9313822, "tpot_s": 0.005279082847454657, "trace_hash_ids": [12606450, 12606451, 12606452, 12606453, 12606454, 12606455, 12606456, 12606457, 12606458, 12606459, 12606460, 12606461, 12606462, 12606463, 12606464, 12606465, 12606466, 12606467, 12606468, 12606469, 12606470, 12606471, 12606472, 12606473, 12606474, 12606475, 12606476, 12606477, 12606478, 12606479, 12606480, 12606481, 12606482, 12606483, 12624720, 12624721, 12624722], "trace_timestamp_s": 107.86400000000049, "ttft_s": 1.947526576987002, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 9520, "effective_input_length": 13955, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13955, "latency_s": 0.979947304003872, "output_length": 31, "proxy_request_id": "1263971:3:1269088:104", "request_id": "1263971:3:1269088:104", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1263971", "t_dispatch_unix": 1779814618.4003854, "t_finish_unix": 1779814619.380332, "t_first_token_unix": 1779814619.1064985, "tpot_s": 0.009117548934106405, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12597530, 12597531, 12597532, 12606764, 12606765, 12606766, 12613478, 12613479, 12622426, 12622427, 12622428, 12622429, 12622430, 12622431, 12629103, 12629104], "trace_timestamp_s": 109.28900000000067, "ttft_s": 0.7061121969600208, "turn_id": 3} +{"actual_output_tokens": 128, "cached_tokens": 23728, "effective_input_length": 24029, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24029, "latency_s": 2.6529912460246123, "output_length": 128, "proxy_request_id": "1250772:4:1268869:103", "request_id": "1250772:4:1268869:103", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1250772", "t_dispatch_unix": 1779814617.659648, "t_finish_unix": 1779814620.3126392, "t_first_token_unix": 1779814618.6485214, "tpot_s": 0.013101269944761624, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12546417, 12546418, 12546419, 12546420, 12546421, 12546422, 12546423, 12546424, 12546425, 12546426, 12546427, 12546428, 12546429, 12546430, 12546431, 12546432, 12546433, 12546434, 12589516, 12589517, 12589518, 12589519, 12589520, 12589521, 12589522, 12627093], "trace_timestamp_s": 108.55000000000018, "ttft_s": 0.9888711420353502, "turn_id": 4} +{"actual_output_tokens": 102, "cached_tokens": 28864, "effective_input_length": 28906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28906, "latency_s": 1.0115957839880139, "output_length": 102, "proxy_request_id": "1262354:5:1269336:105", "request_id": "1262354:5:1269336:105", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1262354", "t_dispatch_unix": 1779814619.3544238, "t_finish_unix": 1779814620.3660195, "t_first_token_unix": 1779814619.4385822, "tpot_s": 0.009179113415475603, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12632148], "trace_timestamp_s": 110.2450000000008, "ttft_s": 0.08415656600845978, "turn_id": 5} +{"actual_output_tokens": 248, "cached_tokens": 0, "effective_input_length": 12195, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12195, "latency_s": 3.488782625005115, "output_length": 248, "proxy_request_id": "1268831:1:1268831:101", "request_id": "1268831:1:1268831:101", "request_type": "coder", "requested_output_tokens": 248, "session_id": "1268831", "t_dispatch_unix": 1779814617.5041163, "t_finish_unix": 1779814620.9928992, "t_first_token_unix": 1779814618.506455, "tpot_s": 0.010065411583017105, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771], "trace_timestamp_s": 108.39000000000033, "ttft_s": 1.0023374169832096, "turn_id": 1} +{"actual_output_tokens": 234, "cached_tokens": 7680, "effective_input_length": 14104, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14104, "latency_s": 2.0381560750538483, "output_length": 234, "proxy_request_id": "1269373:1:1269373:106", "request_id": "1269373:1:1269373:106", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1269373", "t_dispatch_unix": 1779814619.4811845, "t_finish_unix": 1779814621.5193403, "t_first_token_unix": 1779814620.2088275, "tpot_s": 0.005623415330336968, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12632634], "trace_timestamp_s": 110.3700000000008, "ttft_s": 0.7276413700310513, "turn_id": 1} +{"actual_output_tokens": 383, "cached_tokens": 0, "effective_input_length": 12320, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12320, "latency_s": 3.9956755250459537, "output_length": 383, "proxy_request_id": "1268861:1:1268861:102", "request_id": "1268861:1:1268861:102", "request_type": "coder", "requested_output_tokens": 383, "session_id": "1268861", "t_dispatch_unix": 1779814617.6228912, "t_finish_unix": 1779814621.6185668, "t_first_token_unix": 1779814618.657445, "tpot_s": 0.007750894473737632, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12627028], "trace_timestamp_s": 108.50900000000001, "ttft_s": 1.034552307042759, "turn_id": 1} +{"actual_output_tokens": 94, "cached_tokens": 0, "effective_input_length": 1323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1323, "latency_s": 0.7380884169833735, "output_length": 94, "proxy_request_id": "1269901:1:1269901:107", "request_id": "1269901:1:1269901:107", "request_type": "coder", "requested_output_tokens": 94, "session_id": "1269901", "t_dispatch_unix": 1779814621.0417309, "t_finish_unix": 1779814621.7798193, "t_first_token_unix": 1779814621.1894138, "tpot_s": 0.006345430558662541, "trace_hash_ids": [12637519, 12637520, 12637521], "trace_timestamp_s": 111.9320000000007, "ttft_s": 0.14768215402727947, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 30752, "effective_input_length": 30828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30828, "latency_s": 0.46912411402445287, "output_length": 55, "proxy_request_id": "1260327:2:1270005:108", "request_id": "1260327:2:1270005:108", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1260327", "t_dispatch_unix": 1779814621.4631495, "t_finish_unix": 1779814621.9322734, "t_first_token_unix": 1779814621.5593948, "tpot_s": 0.006900577944987971, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12638441], "trace_timestamp_s": 112.35300000000007, "ttft_s": 0.09624346299096942, "turn_id": 2} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 11128, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11128, "latency_s": 1.1184483479592018, "output_length": 32, "proxy_request_id": "1266440:2:1270501:112", "request_id": "1266440:2:1270501:112", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1266440", "t_dispatch_unix": 1779814623.234223, "t_finish_unix": 1779814624.352671, "t_first_token_unix": 1779814624.1402125, "tpot_s": 0.006842347742584083, "trace_hash_ids": [12582173, 12582174, 12582175, 12603412, 12603413, 12603414, 12603415, 12603416, 12603417, 12603418, 12611059, 12611060, 12611061, 12618733, 12618734, 12618735, 12618736, 12629763, 12642862, 12642863, 12642864, 12642865], "trace_timestamp_s": 114.1230000000005, "ttft_s": 0.9059879849664867, "turn_id": 2} +{"actual_output_tokens": 86, "cached_tokens": 8048, "effective_input_length": 12270, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12270, "latency_s": 39.803558960033115, "output_length": 86, "proxy_request_id": "1256273:4:1259632:60", "request_id": "1256273:4:1259632:60", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1256273", "t_dispatch_unix": 1779814585.5084171, "t_finish_unix": 1779814625.311976, "t_first_token_unix": 1779814624.2718248, "tpot_s": 0.012231988199603031, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12526397, 12526398, 12526399, 12536749, 12536750, 12536751, 12536752, 12536753, 12536754, 12536755, 12536756, 12536757], "trace_timestamp_s": 76.39800000000014, "ttft_s": 38.7634056690149, "turn_id": 4} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 112793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112793, "latency_s": 42.51575814001262, "output_length": 97, "proxy_request_id": "1258859:1:1258859:57", "request_id": "1258859:1:1258859:57", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1258859", "t_dispatch_unix": 1779814582.9078898, "t_finish_unix": 1779814625.4236474, "t_first_token_unix": 1779814624.0554943, "tpot_s": 0.014248897968476134, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503], "trace_timestamp_s": 73.75200000000041, "ttft_s": 41.147602702025324, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 50800, "effective_input_length": 57803, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57803, "latency_s": 4.6022497859667055, "output_length": 29, "proxy_request_id": "1263727:2:1270052:109", "request_id": "1263727:2:1270052:109", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1263727", "t_dispatch_unix": 1779814621.6549294, "t_finish_unix": 1779814626.2571785, "t_first_token_unix": 1779814624.2102797, "tpot_s": 0.07309566789315015, "trace_hash_ids": [12556738, 12556739, 12556740, 12556741, 12556742, 12556743, 12556744, 12556745, 12556746, 12556747, 12556748, 12556749, 12556750, 12556751, 12556752, 12556753, 12556754, 12556755, 12556756, 12556757, 12556758, 12556759, 12556760, 12556761, 12556762, 12556763, 12556764, 12556765, 12556766, 12556767, 12556768, 12556769, 12556770, 12556771, 12556772, 12556773, 12556774, 12556775, 12556776, 12556777, 12556778, 12556779, 12556780, 12556781, 12556782, 12556783, 12556784, 12556785, 12556786, 12556787, 12556788, 12556789, 12556790, 12556791, 12556792, 12556793, 12556794, 12556795, 12556796, 12556797, 12556798, 12556799, 12556800, 12556801, 12556802, 12556803, 12556804, 12556805, 12556806, 12556807, 12556808, 12556809, 12556810, 12556811, 12556812, 12556813, 12556814, 12556815, 12556816, 12556817, 12556818, 12556819, 12556820, 12556821, 12556822, 12556823, 12556824, 12556825, 12556826, 12556827, 12556828, 12556829, 12556830, 12556831, 12556832, 12556833, 12556834, 12556835, 12575902, 12585534, 12585535, 12585536, 12585537, 12600891, 12600892, 12600893, 12600894, 12600895, 12638702, 12638703, 12638704, 12638705, 12638706], "trace_timestamp_s": 112.54100000000017, "ttft_s": 2.555348430003505, "turn_id": 2} +{"actual_output_tokens": 138, "cached_tokens": 0, "effective_input_length": 751, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 751, "latency_s": 1.0544838460045867, "output_length": 138, "proxy_request_id": "1271459:1:1271459:118", "request_id": "1271459:1:1271459:118", "request_type": "coder", "requested_output_tokens": 138, "session_id": "1271459", "t_dispatch_unix": 1779814626.628726, "t_finish_unix": 1779814627.6832094, "t_first_token_unix": 1779814626.7301207, "tpot_s": 0.006954705467138331, "trace_hash_ids": [12654275, 12654276], "trace_timestamp_s": 117.51900000000023, "ttft_s": 0.1013940279954113, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 2524, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2524, "latency_s": 0.3789616379654035, "output_length": 27, "proxy_request_id": "1271847:1:1271847:123", "request_id": "1271847:1:1271847:123", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1271847", "t_dispatch_unix": 1779814627.9240148, "t_finish_unix": 1779814628.3029766, "t_first_token_unix": 1779814628.127315, "tpot_s": 0.006742170461131116, "trace_hash_ids": [12630061, 12635974, 12658850, 12658851, 12658852], "trace_timestamp_s": 118.8140000000003, "ttft_s": 0.2032986049889587, "turn_id": 1} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 27927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27927, "latency_s": 5.883225863042753, "output_length": 50, "proxy_request_id": "1270340:1:1270340:111", "request_id": "1270340:1:1270340:111", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1270340", "t_dispatch_unix": 1779814622.6651192, "t_finish_unix": 1779814628.5483449, "t_first_token_unix": 1779814627.0312436, "tpot_s": 0.03095623573445126, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646], "trace_timestamp_s": 113.54500000000007, "ttft_s": 4.3661205770331435, "turn_id": 1} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 2851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2851, "latency_s": 0.38330282602692023, "output_length": 30, "proxy_request_id": "1271991:1:1271991:124", "request_id": "1271991:1:1271991:124", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1271991", "t_dispatch_unix": 1779814628.454805, "t_finish_unix": 1779814628.8381073, "t_first_token_unix": 1779814628.6421921, "tpot_s": 0.0067439978974389615, "trace_hash_ids": [12652320, 12652321, 12652322, 12652323, 12652324, 12659858], "trace_timestamp_s": 119.34500000000025, "ttft_s": 0.1873861409840174, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 17706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17706, "latency_s": 3.319558954972308, "output_length": 81, "proxy_request_id": "1271328:1:1271328:117", "request_id": "1271328:1:1271328:117", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1271328", "t_dispatch_unix": 1779814626.208697, "t_finish_unix": 1779814629.528256, "t_first_token_unix": 1779814628.054111, "tpot_s": 0.01842367406206904, "trace_hash_ids": [12623302, 12623303, 12623304, 12623305, 12623306, 12623307, 12623308, 12623309, 12623310, 12623311, 12623312, 12623313, 12623314, 12623315, 12623316, 12637741, 12637742, 12637743, 12637744, 12637745, 12652577, 12652578, 12652579, 12652580, 12652581, 12652582, 12652583, 12652584, 12652585, 12652586, 12652587, 12652588, 12652589, 12652590, 12652591], "trace_timestamp_s": 117.09300000000076, "ttft_s": 1.845411801012233, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 5302, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5302, "latency_s": 1.3879940879996866, "output_length": 73, "proxy_request_id": "1272085:1:1272085:125", "request_id": "1272085:1:1272085:125", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1272085", "t_dispatch_unix": 1779814628.7907932, "t_finish_unix": 1779814630.1787872, "t_first_token_unix": 1779814629.2584612, "tpot_s": 0.012778309333144635, "trace_hash_ids": [12650221, 12650222, 12660755, 12660756, 12660757, 12660758, 12660759, 12660760, 12660761, 12660762, 12660763], "trace_timestamp_s": 119.68000000000029, "ttft_s": 0.46766693401150405, "turn_id": 1} +{"actual_output_tokens": 204, "cached_tokens": 12432, "effective_input_length": 19448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19448, "latency_s": 5.304654285020661, "output_length": 204, "proxy_request_id": "1268831:2:1271087:116", "request_id": "1268831:2:1271087:116", "request_type": "coder", "requested_output_tokens": 204, "session_id": "1268831", "t_dispatch_unix": 1779814625.4806423, "t_finish_unix": 1779814630.785297, "t_first_token_unix": 1779814627.9214778, "tpot_s": 0.014105948541838713, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753], "trace_timestamp_s": 116.3690000000006, "ttft_s": 2.4408333119936287, "turn_id": 2} +{"actual_output_tokens": 239, "cached_tokens": 27968, "effective_input_length": 28323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28323, "latency_s": 3.048072968958877, "output_length": 239, "proxy_request_id": "1270340:2:1271641:121", "request_id": "1270340:2:1271641:121", "request_type": "coder", "requested_output_tokens": 239, "session_id": "1270340", "t_dispatch_unix": 1779814628.5494976, "t_finish_unix": 1779814631.5975711, "t_first_token_unix": 1779814628.7321162, "tpot_s": 0.012038385159748864, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 12656113], "trace_timestamp_s": 118.08300000000054, "ttft_s": 0.1826165429665707, "turn_id": 2} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 21719, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21719, "latency_s": 5.470084022032097, "output_length": 237, "proxy_request_id": "1271486:1:1271486:119", "request_id": "1271486:1:1271486:119", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1271486", "t_dispatch_unix": 1779814626.7231069, "t_finish_unix": 1779814632.1931908, "t_first_token_unix": 1779814629.0956786, "tpot_s": 0.013123832508365197, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 41451, 41452, 41453, 41454, 41455, 41456, 41457, 41458, 41459, 41460, 12602726, 12602727, 12602728, 9026439, 12602729, 12602730, 12654424, 12654425], "trace_timestamp_s": 117.60600000000068, "ttft_s": 2.3725697090267204, "turn_id": 1} +{"actual_output_tokens": 374, "cached_tokens": 18112, "effective_input_length": 28385, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28385, "latency_s": 8.640686620026827, "output_length": 374, "proxy_request_id": "1266668:2:1270661:115", "request_id": "1266668:2:1270661:115", "request_type": "coder", "requested_output_tokens": 374, "session_id": "1266668", "t_dispatch_unix": 1779814623.8482816, "t_finish_unix": 1779814632.4889684, "t_first_token_unix": 1779814626.0249565, "tpot_s": 0.017328901989316824, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12644244], "trace_timestamp_s": 114.73400000000038, "ttft_s": 2.1766719139995985, "turn_id": 2} +{"actual_output_tokens": 3514, "cached_tokens": 0, "effective_input_length": 15283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15283, "latency_s": 36.7595898329746, "output_length": 3514, "proxy_request_id": "1262727:1:1262727:72", "request_id": "1262727:1:1262727:72", "request_type": "coder", "requested_output_tokens": 3514, "session_id": "1262727", "t_dispatch_unix": 1779814596.2806997, "t_finish_unix": 1779814633.0402896, "t_first_token_unix": 1779814597.6933234, "tpot_s": 0.01006168553230151, "trace_hash_ids": [1978, 1979, 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007], "trace_timestamp_s": 87.16600000000017, "ttft_s": 1.412622214993462, "turn_id": 1} +{"actual_output_tokens": 408, "cached_tokens": 7680, "effective_input_length": 9718, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9718, "latency_s": 6.0338536279741675, "output_length": 408, "proxy_request_id": "1272313:1:1272313:126", "request_id": "1272313:1:1272313:126", "request_type": "coder", "requested_output_tokens": 408, "session_id": "1272313", "t_dispatch_unix": 1779814629.7023506, "t_finish_unix": 1779814635.7362041, "t_first_token_unix": 1779814629.952957, "tpot_s": 0.014208546788597603, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675], "trace_timestamp_s": 120.59300000000076, "ttft_s": 0.2506052330136299, "turn_id": 1} +{"actual_output_tokens": 490, "cached_tokens": 14336, "effective_input_length": 14404, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14404, "latency_s": 8.836630714009516, "output_length": 490, "proxy_request_id": "1269373:2:1271580:120", "request_id": "1269373:2:1271580:120", "request_type": "coder", "requested_output_tokens": 490, "session_id": "1269373", "t_dispatch_unix": 1779814627.0384004, "t_finish_unix": 1779814635.8750315, "t_first_token_unix": 1779814629.0970209, "tpot_s": 0.01386021721273935, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12655307], "trace_timestamp_s": 117.92900000000009, "ttft_s": 2.0586191219626926, "turn_id": 2} +{"actual_output_tokens": 103, "cached_tokens": 30880, "effective_input_length": 31283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31283, "latency_s": 1.6097898139851168, "output_length": 103, "proxy_request_id": "1260327:3:1273741:132", "request_id": "1260327:3:1273741:132", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1260327", "t_dispatch_unix": 1779814634.8218741, "t_finish_unix": 1779814636.431664, "t_first_token_unix": 1779814635.315289, "tpot_s": 0.010940678264744872, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12677039], "trace_timestamp_s": 125.71200000000044, "ttft_s": 0.493413012009114, "turn_id": 3} +{"actual_output_tokens": 67, "cached_tokens": 5360, "effective_input_length": 8017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8017, "latency_s": 2.5529638419975527, "output_length": 67, "proxy_request_id": "1272085:2:1273645:130", "request_id": "1272085:2:1273645:130", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1272085", "t_dispatch_unix": 1779814634.4234886, "t_finish_unix": 1779814636.9764526, "t_first_token_unix": 1779814634.8053398, "tpot_s": 0.03289164706031002, "trace_hash_ids": [12650221, 12650222, 12660755, 12660756, 12660757, 12660758, 12660759, 12660760, 12660761, 12660762, 12676216, 12676217, 12676218, 12676219, 12676220, 12676221], "trace_timestamp_s": 125.3130000000001, "ttft_s": 0.38185011502355337, "turn_id": 2} +{"actual_output_tokens": 380, "cached_tokens": 28752, "effective_input_length": 33711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33711, "latency_s": 4.517501113994513, "output_length": 380, "proxy_request_id": "1266668:3:1273119:128", "request_id": "1266668:3:1273119:128", "request_type": "coder", "requested_output_tokens": 380, "session_id": "1266668", "t_dispatch_unix": 1779814632.492433, "t_finish_unix": 1779814637.0099337, "t_first_token_unix": 1779814633.6467953, "tpot_s": 0.008873107176707777, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12670179], "trace_timestamp_s": 123.36300000000028, "ttft_s": 1.154359063017182, "turn_id": 3} +{"actual_output_tokens": 670, "cached_tokens": 112880, "effective_input_length": 113172, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113172, "latency_s": 12.101223387988284, "output_length": 670, "proxy_request_id": "1258859:2:1264639:81", "request_id": "1258859:2:1264639:81", "request_type": "coder", "requested_output_tokens": 670, "session_id": "1258859", "t_dispatch_unix": 1779814625.4296427, "t_finish_unix": 1779814637.530866, "t_first_token_unix": 1779814625.8142745, "tpot_s": 0.017513233058343215, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12585542], "trace_timestamp_s": 94.09700000000066, "ttft_s": 0.38462921197060496, "turn_id": 2} +{"actual_output_tokens": 717, "cached_tokens": 28992, "effective_input_length": 32774, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32774, "latency_s": 13.895342334988527, "output_length": 717, "proxy_request_id": "1262354:6:1270643:114", "request_id": "1262354:6:1270643:114", "request_type": "coder", "requested_output_tokens": 717, "session_id": "1262354", "t_dispatch_unix": 1779814623.7670112, "t_finish_unix": 1779814637.6623535, "t_first_token_unix": 1779814627.034576, "tpot_s": 0.014842831050276667, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12644066], "trace_timestamp_s": 114.65599999999995, "ttft_s": 3.267562614986673, "turn_id": 6} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 6208, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6208, "latency_s": 0.8761901010293514, "output_length": 92, "proxy_request_id": "1274405:1:1274405:134", "request_id": "1274405:1:1274405:134", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1274405", "t_dispatch_unix": 1779814637.2217224, "t_finish_unix": 1779814638.0979123, "t_first_token_unix": 1779814637.6319227, "tpot_s": 0.005118206120991649, "trace_hash_ids": [12683425, 12683426, 12683427, 12683428, 12683429, 12683430, 12683431, 12683432, 12683433, 12683434, 12683435, 12683436, 12683437], "trace_timestamp_s": 128.11000000000058, "ttft_s": 0.4101993049844168, "turn_id": 1} +{"actual_output_tokens": 553, "cached_tokens": 0, "effective_input_length": 21963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21963, "latency_s": 6.774341576965526, "output_length": 553, "proxy_request_id": "1273203:1:1273203:129", "request_id": "1273203:1:1273203:129", "request_type": "coder", "requested_output_tokens": 553, "session_id": "1273203", "t_dispatch_unix": 1779814632.7792952, "t_finish_unix": 1779814639.5536366, "t_first_token_unix": 1779814635.1597373, "tpot_s": 0.007959458552553164, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 788374, 12645257, 12645258, 109688, 109689, 109690, 109691, 109692, 109693, 12645259, 12645260, 2777791, 2777792, 12645261, 12645262, 12671102, 12671103, 12671104], "trace_timestamp_s": 123.66700000000037, "ttft_s": 2.380439967964776, "turn_id": 1} +{"actual_output_tokens": 439, "cached_tokens": 17776, "effective_input_length": 25108, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25108, "latency_s": 4.966555018967483, "output_length": 439, "proxy_request_id": "1271328:2:1273711:131", "request_id": "1271328:2:1273711:131", "request_type": "coder", "requested_output_tokens": 439, "session_id": "1271328", "t_dispatch_unix": 1779814634.6844006, "t_finish_unix": 1779814639.6509554, "t_first_token_unix": 1779814636.0404508, "tpot_s": 0.008242609426932043, "trace_hash_ids": [12623302, 12623303, 12623304, 12623305, 12623306, 12623307, 12623308, 12623309, 12623310, 12623311, 12623312, 12623313, 12623314, 12623315, 12623316, 12637741, 12637742, 12637743, 12637744, 12637745, 12652577, 12652578, 12652579, 12652580, 12652581, 12652582, 12652583, 12652584, 12652585, 12652586, 12652587, 12652588, 12652589, 12652590, 12668017, 12668018, 12668019, 12668020, 12668021, 12668022, 12668023, 12668024, 12668025, 12668026, 12676731, 12676732, 12676733, 12676734, 12676735, 12676736], "trace_timestamp_s": 125.57100000000082, "ttft_s": 1.3560479839798063, "turn_id": 2} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 10506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10506, "latency_s": 1.0727182760019787, "output_length": 48, "proxy_request_id": "1274890:1:1274890:135", "request_id": "1274890:1:1274890:135", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1274890", "t_dispatch_unix": 1779814638.7472444, "t_finish_unix": 1779814639.8199623, "t_first_token_unix": 1779814639.5731614, "tpot_s": 0.00524451851007588, "trace_hash_ids": [12642876, 12642877, 12654445, 12654446, 12654447, 12654448, 12654449, 12668949, 12668950, 12668951, 12668952, 12668953, 12679551, 12679552, 12679553, 12679554, 12679555, 12687863, 12687864, 12687865, 12687866], "trace_timestamp_s": 129.63300000000072, "ttft_s": 0.8259155070409179, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 7794, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7794, "latency_s": 0.5921289619873278, "output_length": 12, "proxy_request_id": "1275433:1:1275433:137", "request_id": "1275433:1:1275433:137", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1275433", "t_dispatch_unix": 1779814640.4976964, "t_finish_unix": 1779814641.0898247, "t_first_token_unix": 1779814641.0393472, "tpot_s": 0.004560080817265605, "trace_hash_ids": [12648375, 12648376, 12656103, 12660867, 12660868, 12660869, 12660870, 12681196, 12681197, 12681198, 12681199, 12681200, 12692620, 12692621, 12692622, 12692623], "trace_timestamp_s": 131.38500000000022, "ttft_s": 0.5416496859979816, "turn_id": 1} +{"actual_output_tokens": 4, "cached_tokens": 7456, "effective_input_length": 7463, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7463, "latency_s": 0.03752342500956729, "output_length": 4, "proxy_request_id": "1275433:2:1276027:139", "request_id": "1275433:2:1276027:139", "request_type": "coder", "requested_output_tokens": 4, "session_id": "1275433", "t_dispatch_unix": 1779814642.7691963, "t_finish_unix": 1779814642.8067195, "t_first_token_unix": 1779814642.7981417, "tpot_s": 0.002770551674378415, "trace_hash_ids": [12698576, 12698577, 12698578, 12698579, 12698580, 12698581, 12698582, 12698583, 12698584, 12698585, 12698586, 12698587, 12698588, 12698589, 12698590], "trace_timestamp_s": 133.65700000000015, "ttft_s": 0.028943820972926915, "turn_id": 2} +{"actual_output_tokens": 235, "cached_tokens": 10112, "effective_input_length": 10639, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10639, "latency_s": 1.4203099599690177, "output_length": 235, "proxy_request_id": "1272313:2:1275926:138", "request_id": "1272313:2:1275926:138", "request_type": "coder", "requested_output_tokens": 235, "session_id": "1272313", "t_dispatch_unix": 1779814642.4383285, "t_finish_unix": 1779814643.8586388, "t_first_token_unix": 1779814642.5946443, "tpot_s": 0.005400376311805831, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12697306], "trace_timestamp_s": 133.32700000000023, "ttft_s": 0.15631415700772777, "turn_id": 2} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 110048, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 110048, "latency_s": 40.780431518971454, "output_length": 93, "proxy_request_id": "1264679:1:1264679:82", "request_id": "1264679:1:1264679:82", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1264679", "t_dispatch_unix": 1779814603.3872545, "t_finish_unix": 1779814644.167686, "t_first_token_unix": 1779814643.179794, "tpot_s": 0.010733138598405512, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281], "trace_timestamp_s": 94.22100000000046, "ttft_s": 39.79253780096769, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 15783, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15783, "latency_s": 1.6250127169769257, "output_length": 35, "proxy_request_id": "1276111:1:1276111:140", "request_id": "1276111:1:1276111:140", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1276111", "t_dispatch_unix": 1779814643.1166034, "t_finish_unix": 1779814644.7416158, "t_first_token_unix": 1779814644.561512, "tpot_s": 0.005288471087731202, "trace_hash_ids": [12617937, 12617938, 12617939, 12617940, 12617941, 12617942, 12617943, 12617944, 12617945, 12617946, 12637526, 12637527, 12637528, 12637529, 12637530, 12637531, 12637532, 12637533, 12643664, 12659893, 12659894, 12659895, 12659896, 12659897, 12676458, 12676459, 12682485, 12682486, 12682487, 12682488, 12699285], "trace_timestamp_s": 134.0020000000004, "ttft_s": 1.4449070119881071, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 17280, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17280, "latency_s": 2.028128317964729, "output_length": 67, "proxy_request_id": "1276136:1:1276136:141", "request_id": "1276136:1:1276136:141", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1276136", "t_dispatch_unix": 1779814643.2005246, "t_finish_unix": 1779814645.2286534, "t_first_token_unix": 1779814644.8569639, "tpot_s": 0.005627170727221352, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12699544], "trace_timestamp_s": 134.08500000000004, "ttft_s": 1.6564376839669421, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 2880, "effective_input_length": 11292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11292, "latency_s": 0.9104725530487485, "output_length": 31, "proxy_request_id": "1271991:2:1276999:145", "request_id": "1271991:2:1276999:145", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1271991", "t_dispatch_unix": 1779814646.218882, "t_finish_unix": 1779814647.1293542, "t_first_token_unix": 1779814646.972938, "tpot_s": 0.00520314653404057, "trace_hash_ids": [12652320, 12652321, 12652322, 12652323, 12652324, 12677010, 12677011, 12677012, 12677013, 12686644, 12686645, 12686646, 12686647, 12686648, 12693874, 12700012, 12700013, 12700014, 12708525, 12708526, 12708527, 12708528, 12708529], "trace_timestamp_s": 137.10600000000068, "ttft_s": 0.7540544890216552, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 4729, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4729, "latency_s": 0.4419663440203294, "output_length": 29, "proxy_request_id": "1277533:1:1277533:150", "request_id": "1277533:1:1277533:150", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1277533", "t_dispatch_unix": 1779814648.2509947, "t_finish_unix": 1779814648.692961, "t_first_token_unix": 1779814648.5530217, "tpot_s": 0.0049882046795184055, "trace_hash_ids": [12707525, 12707526, 12707527, 12707528, 12707529, 12707530, 12707531, 12707532, 12714414, 12714415], "trace_timestamp_s": 139.14000000000033, "ttft_s": 0.3020248939865269, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 6288, "effective_input_length": 6360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6360, "latency_s": 4.801181207993068, "output_length": 34, "proxy_request_id": "1274405:2:1276717:144", "request_id": "1274405:2:1276717:144", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1274405", "t_dispatch_unix": 1779814645.232587, "t_finish_unix": 1779814650.0337682, "t_first_token_unix": 1779814649.4393663, "tpot_s": 0.01800237878783126, "trace_hash_ids": [12683425, 12683426, 12683427, 12683428, 12683429, 12683430, 12683431, 12683432, 12683433, 12683434, 12683435, 12683436, 12705637], "trace_timestamp_s": 136.1230000000005, "ttft_s": 4.206777966988739, "turn_id": 2} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 8704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8704, "latency_s": 5.724867653974798, "output_length": 50, "proxy_request_id": "1276498:1:1276498:142", "request_id": "1276498:1:1276498:142", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1276498", "t_dispatch_unix": 1779814644.4500442, "t_finish_unix": 1779814650.1749113, "t_first_token_unix": 1779814645.0940852, "tpot_s": 0.10368556679554322, "trace_hash_ids": [12669649, 12669650, 12669651, 12669652, 12669653, 12669654, 12669655, 12669656, 12680491, 12680492, 12689566, 12689567, 12695712, 12695713, 12695714, 12695715, 12703411], "trace_timestamp_s": 135.33700000000044, "ttft_s": 0.6440398310078308, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 17408, "effective_input_length": 27221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27221, "latency_s": 2.395156975951977, "output_length": 97, "proxy_request_id": "1277428:1:1277428:149", "request_id": "1277428:1:1277428:149", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1277428", "t_dispatch_unix": 1779814647.8193583, "t_finish_unix": 1779814650.2145154, "t_first_token_unix": 1779814649.6138952, "tpot_s": 0.0062530686664104, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12713186], "trace_timestamp_s": 138.70600000000013, "ttft_s": 1.7945349109941162, "turn_id": 1} +{"actual_output_tokens": 437, "cached_tokens": 0, "effective_input_length": 8884, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8884, "latency_s": 4.046736955991946, "output_length": 437, "proxy_request_id": "1271459:2:1277544:151", "request_id": "1271459:2:1277544:151", "request_type": "coder", "requested_output_tokens": 437, "session_id": "1271459", "t_dispatch_unix": 1779814648.287607, "t_finish_unix": 1779814652.3343441, "t_first_token_unix": 1779814648.9747837, "tpot_s": 0.0077046873852975855, "trace_hash_ids": [12654275, 12668550, 12668551, 12668552, 12668553, 12668554, 12668555, 12668556, 12681215, 12681216, 12703400, 12703401, 12703402, 12703403, 12714450, 12714451, 12714452, 12714453], "trace_timestamp_s": 139.17600000000039, "ttft_s": 0.6871753119630739, "turn_id": 2} +{"actual_output_tokens": 44, "cached_tokens": 10512, "effective_input_length": 18093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18093, "latency_s": 22.6866362959845, "output_length": 44, "proxy_request_id": "1265942:3:1272453:127", "request_id": "1265942:3:1272453:127", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1265942", "t_dispatch_unix": 1779814630.253322, "t_finish_unix": 1779814652.9399583, "t_first_token_unix": 1779814651.8627543, "tpot_s": 0.02504262669813321, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596, 12609655, 12609656, 12609657, 12609658, 12618768, 12618769, 12618770, 12618771, 12618772, 12618773, 12618774, 12618775, 12635330, 12635331, 12635332, 12635333, 12643363, 12643364, 12643365, 12643366, 12643367, 12654593, 12654594, 12663906, 12663907, 12663908, 12663909, 12663910], "trace_timestamp_s": 121.14100000000053, "ttft_s": 21.609430646989495, "turn_id": 3} +{"actual_output_tokens": 77, "cached_tokens": 18128, "effective_input_length": 21229, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21229, "latency_s": 1.8199419989832677, "output_length": 77, "proxy_request_id": "1265942:4:1274182:133", "request_id": "1265942:4:1274182:133", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1265942", "t_dispatch_unix": 1779814652.94869, "t_finish_unix": 1779814654.7686322, "t_first_token_unix": 1779814653.5196016, "tpot_s": 0.016430704736481665, "trace_hash_ids": [12681319, 12681320, 12681321, 12681322, 12681323, 12681324, 12681325, 12681326, 12681327, 12681328, 12681329, 12681330, 12681331, 12681332, 12681333, 12681334, 12681335, 12681336, 12681337, 12681338, 12681339, 12681340, 12681341, 12681342, 12681343, 12681344, 12681345, 12681346, 12681347, 12681348, 12681349, 12681350, 12681351, 12681352, 12681353, 12681354, 12681355, 12681356, 12681357, 12681358, 12681359, 12681360], "trace_timestamp_s": 127.1860000000006, "ttft_s": 0.5709092380129732, "turn_id": 4} +{"actual_output_tokens": 170, "cached_tokens": 0, "effective_input_length": 93430, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93430, "latency_s": 31.12340686499374, "output_length": 170, "proxy_request_id": "1270606:1:1270606:113", "request_id": "1270606:1:1270606:113", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1270606", "t_dispatch_unix": 1779814623.6614513, "t_finish_unix": 1779814654.7848575, "t_first_token_unix": 1779814652.7692814, "tpot_s": 0.011925152041425807, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 12643740, 12643741, 12643742, 12643743, 12643744, 12643745, 12643746, 12643747, 12643748, 12643749, 12643750, 12643751, 12643752, 12643753, 12643754, 12643755, 12643756, 12643757, 12643758, 12643759, 12643760, 12643761, 12643762, 12643763, 12643764, 12643765, 12643766, 12643767, 12643768, 12643769, 12643770, 12643771, 12643772, 12643773, 12643774, 12643775, 12643776, 12643777, 12643778, 12643779, 12643780, 12643781, 12643782, 12643783, 12643784, 12643785, 12643786, 12643787, 12643788, 12643789, 12643790, 12643791, 12643792, 12643793, 12643794, 12643795, 12643796, 12643797, 12643798, 12643799, 12643800, 12643801, 12643802, 12643803, 12643804, 12643805, 12643806, 12643807, 12643808, 12643809, 12643810, 12643811, 12643812, 12643813, 12643814, 12643815, 12643816, 12643817, 12643818, 12643819, 12643820, 12643821, 12643822, 12643823, 12643824, 12643825, 12643826, 12643827], "trace_timestamp_s": 114.51500000000033, "ttft_s": 29.10782668396132, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 8752, "effective_input_length": 16650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16650, "latency_s": 1.5493206169921905, "output_length": 34, "proxy_request_id": "1276498:2:1278996:157", "request_id": "1276498:2:1278996:157", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1276498", "t_dispatch_unix": 1779814653.4026456, "t_finish_unix": 1779814654.951966, "t_first_token_unix": 1779814654.3699675, "tpot_s": 0.017625300091987647, "trace_hash_ids": [12669649, 12669650, 12669651, 12669652, 12669653, 12669654, 12669655, 12669656, 12680491, 12680492, 12689566, 12689567, 12695712, 12695713, 12695714, 12695715, 12703411, 12712744, 12712745, 12712746, 12712747, 12712748, 12721667, 12721668, 12721669, 12721670, 12728508, 12728509, 12728510, 12728511, 12728512, 12728513, 12728514], "trace_timestamp_s": 144.28999999999996, "ttft_s": 0.9673205809667706, "turn_id": 2} +{"actual_output_tokens": 147, "cached_tokens": 3584, "effective_input_length": 102074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102074, "latency_s": 38.13142150599742, "output_length": 147, "proxy_request_id": "1268630:1:1268630:98", "request_id": "1268630:1:1268630:98", "request_type": "coder", "requested_output_tokens": 147, "session_id": "1268630", "t_dispatch_unix": 1779814616.967956, "t_finish_unix": 1779814655.099377, "t_first_token_unix": 1779814651.880259, "tpot_s": 0.022046614712190316, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 5771, 5772, 5773, 5774, 5775, 5776, 5777, 5778, 5779, 5780, 5781, 5782, 5783, 317795, 317796, 317797, 3750293, 3750294, 3750295, 1646386, 11179983, 11179984, 270680, 270681, 11179985, 470650, 11179986, 11179987, 11179988, 11179989, 11179990, 11179991, 11179992, 11179993, 11179994, 11179995, 11179996, 11179997, 11179998, 11179999, 11180000, 11180001, 11180002, 11180003, 11180004, 11180005, 11180006, 11180007, 11180008, 11180009, 11180010, 395622, 395623, 282458, 2459748, 11180011, 419587, 419588, 419589, 427120, 11180012, 11180013, 11180014, 11180015, 11180016, 11180017, 11180018, 11180019, 11180020, 11180021, 11180022, 11180023, 11180024, 11180025, 11180026, 11180027, 11180028, 11180029, 11180030, 11180031, 11180032, 11180033, 11180034, 11180035, 11180036, 11180037, 12624518, 12624519, 12624520, 12624521, 12624522, 12624523, 12624524, 12624525, 12624526, 12624527, 12624528, 12624529, 12624530, 12624531, 12624532, 12624533, 12624534, 12624535, 12624536, 12624537, 12624538, 12624539, 12624540, 12624541, 12624542, 12624543, 12624544, 12624545, 12624546, 12624547, 12624548, 12624549, 12624550, 12624551, 12624552, 12624553, 12624554, 12624555, 12624556, 12624557, 12624558, 12624559, 12624560, 12624561, 12624562, 12624563, 12624564, 12624565, 12624566, 12624567, 12624568, 12624569, 12624570, 12624571, 12624572, 12624573, 12624574, 12624575, 12624576, 12624577, 12624578, 12624579, 12624580, 12624581, 12624582, 12624583, 12624584, 12624585, 12624586, 12624587, 12624588, 12624589, 12624590, 12624591, 12624592, 12624593, 12624594, 12624595, 12624596, 12624597, 12624598, 12624599, 12624600, 12624601, 12624602, 12624603, 12624604, 12624605, 12624606, 12624607, 12624608, 12624609, 12624610, 12624611, 12624612, 12624613, 12624614, 12624615, 12624616, 12624617, 12624618, 12624619, 12624620, 12624621, 12624622], "trace_timestamp_s": 107.81600000000071, "ttft_s": 34.91229986201506, "turn_id": 1} +{"actual_output_tokens": 531, "cached_tokens": 34080, "effective_input_length": 49380, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49380, "latency_s": 11.5115970930201, "output_length": 531, "proxy_request_id": "1266668:4:1276519:143", "request_id": "1266668:4:1276519:143", "request_type": "coder", "requested_output_tokens": 531, "session_id": "1266668", "t_dispatch_unix": 1779814644.5053265, "t_finish_unix": 1779814656.0169234, "t_first_token_unix": 1779814649.4056704, "tpot_s": 0.012473609645187608, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12703762], "trace_timestamp_s": 135.38799999999992, "ttft_s": 4.900341776025016, "turn_id": 4} +{"actual_output_tokens": 606, "cached_tokens": 14880, "effective_input_length": 16900, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16900, "latency_s": 9.02302790095564, "output_length": 606, "proxy_request_id": "1269373:3:1277365:148", "request_id": "1269373:3:1277365:148", "request_type": "coder", "requested_output_tokens": 606, "session_id": "1269373", "t_dispatch_unix": 1779814647.5401156, "t_finish_unix": 1779814656.5631433, "t_first_token_unix": 1779814649.7140527, "tpot_s": 0.011320276973549707, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12712211], "trace_timestamp_s": 138.4300000000003, "ttft_s": 2.173935779952444, "turn_id": 3} +{"actual_output_tokens": 210, "cached_tokens": 10864, "effective_input_length": 11549, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11549, "latency_s": 2.5016716769896448, "output_length": 210, "proxy_request_id": "1272313:3:1279208:159", "request_id": "1272313:3:1279208:159", "request_type": "coder", "requested_output_tokens": 210, "session_id": "1272313", "t_dispatch_unix": 1779814654.066019, "t_finish_unix": 1779814656.5676908, "t_first_token_unix": 1779814654.5130942, "tpot_s": 0.009829301353929449, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12730483], "trace_timestamp_s": 144.95600000000013, "ttft_s": 0.447073535004165, "turn_id": 3} +{"actual_output_tokens": 504, "cached_tokens": 57632, "effective_input_length": 58752, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58752, "latency_s": 6.486479719984345, "output_length": 504, "proxy_request_id": "1253804:5:1278488:156", "request_id": "1253804:5:1278488:156", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1253804", "t_dispatch_unix": 1779814651.547481, "t_finish_unix": 1779814658.0339603, "t_first_token_unix": 1779814652.3324876, "tpot_s": 0.011334326687925281, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261], "trace_timestamp_s": 142.4350000000004, "ttft_s": 0.7850044359802268, "turn_id": 5} +{"actual_output_tokens": 36, "cached_tokens": 17344, "effective_input_length": 24519, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24519, "latency_s": 1.4865957130095921, "output_length": 36, "proxy_request_id": "1276136:2:1280145:162", "request_id": "1276136:2:1280145:162", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1276136", "t_dispatch_unix": 1779814657.1769168, "t_finish_unix": 1779814658.6635122, "t_first_token_unix": 1779814658.3979716, "tpot_s": 0.007574871343760086, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12713815, 12713816, 12713817, 12713818, 12713819, 12713820, 12725899, 12725900, 12725901, 12725902, 12725903, 12725904, 12739099, 12739100, 12739101], "trace_timestamp_s": 148.0610000000006, "ttft_s": 1.2210520100197755, "turn_id": 2} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 20136, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20136, "latency_s": 4.744105029036291, "output_length": 237, "proxy_request_id": "1279412:1:1279412:160", "request_id": "1279412:1:1279412:160", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1279412", "t_dispatch_unix": 1779814654.8693626, "t_finish_unix": 1779814659.6134677, "t_first_token_unix": 1779814656.9722493, "tpot_s": 0.011190378533822279, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12732189], "trace_timestamp_s": 145.75700000000052, "ttft_s": 2.102884008025285, "turn_id": 1} +{"actual_output_tokens": 409, "cached_tokens": 12688, "effective_input_length": 12765, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12765, "latency_s": 3.271362161030993, "output_length": 409, "proxy_request_id": "1268861:2:1280530:164", "request_id": "1268861:2:1280530:164", "request_type": "coder", "requested_output_tokens": 409, "session_id": "1268861", "t_dispatch_unix": 1779814658.3997989, "t_finish_unix": 1779814661.6711614, "t_first_token_unix": 1779814658.4625657, "tpot_s": 0.007863482375065432, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481], "trace_timestamp_s": 149.28999999999996, "ttft_s": 0.0627650489914231, "turn_id": 2} +{"actual_output_tokens": 81, "cached_tokens": 24544, "effective_input_length": 25923, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25923, "latency_s": 1.9899674400221556, "output_length": 81, "proxy_request_id": "1276136:3:1280987:166", "request_id": "1276136:3:1280987:166", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1276136", "t_dispatch_unix": 1779814660.1242888, "t_finish_unix": 1779814662.1142564, "t_first_token_unix": 1779814660.4731812, "tpot_s": 0.02051021174993366, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12713815, 12713816, 12713817, 12713818, 12713819, 12713820, 12725899, 12725900, 12725901, 12725902, 12725903, 12725904, 12739099, 12739100, 12747337, 12747338, 12747339, 12747340], "trace_timestamp_s": 151.01400000000012, "ttft_s": 0.34889057104010135, "turn_id": 3} +{"actual_output_tokens": 607, "cached_tokens": 113840, "effective_input_length": 118097, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118097, "latency_s": 13.345263056980912, "output_length": 607, "proxy_request_id": "1258859:3:1278118:155", "request_id": "1258859:3:1278118:155", "request_type": "coder", "requested_output_tokens": 607, "session_id": "1258859", "t_dispatch_unix": 1779814650.3801548, "t_finish_unix": 1779814663.7254174, "t_first_token_unix": 1779814655.492175, "tpot_s": 0.013585726046249295, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12719963, 12719964, 12719965, 12719966, 12719967, 12719968, 12719969, 12719970, 12719971, 12719972], "trace_timestamp_s": 141.26500000000033, "ttft_s": 5.112017898994964, "turn_id": 3} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 9370, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9370, "latency_s": 0.8770658940193243, "output_length": 33, "proxy_request_id": "1281887:1:1281887:171", "request_id": "1281887:1:1281887:171", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1281887", "t_dispatch_unix": 1779814663.0414598, "t_finish_unix": 1779814663.9185255, "t_first_token_unix": 1779814663.752675, "tpot_s": 0.005175612812308827, "trace_hash_ids": [12732193, 12732194, 12749330, 12749331, 12749332, 12749333, 12749334, 12749335, 12749336, 12749337, 12749338, 12749339, 12749340, 12749341, 12754932, 12754933, 12754934, 12754935, 12754936], "trace_timestamp_s": 153.9290000000001, "ttft_s": 0.711214184993878, "turn_id": 1} +{"actual_output_tokens": 659, "cached_tokens": 0, "effective_input_length": 24222, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24222, "latency_s": 14.369016495998949, "output_length": 659, "proxy_request_id": "1277909:1:1277909:153", "request_id": "1277909:1:1277909:153", "request_type": "coder", "requested_output_tokens": 659, "session_id": "1277909", "t_dispatch_unix": 1779814649.673164, "t_finish_unix": 1779814664.0421798, "t_first_token_unix": 1779814652.5377939, "tpot_s": 0.017483542389063005, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12718539], "trace_timestamp_s": 140.558, "ttft_s": 2.864628257986624, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 4972, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4972, "latency_s": 0.5755983990384266, "output_length": 34, "proxy_request_id": "1282082:1:1282082:173", "request_id": "1282082:1:1282082:173", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1282082", "t_dispatch_unix": 1779814663.7166643, "t_finish_unix": 1779814664.2922626, "t_first_token_unix": 1779814664.041195, "tpot_s": 0.007601797908798538, "trace_hash_ids": [12740904, 12740905, 12740906, 12740907, 12757070, 12757071, 12757072, 12757073, 12757074, 12757075], "trace_timestamp_s": 154.60600000000068, "ttft_s": 0.3245298840338364, "turn_id": 1} +{"actual_output_tokens": 618, "cached_tokens": 20368, "effective_input_length": 26426, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26426, "latency_s": 5.125894799013622, "output_length": 618, "proxy_request_id": "1279412:2:1281113:167", "request_id": "1279412:2:1281113:167", "request_type": "coder", "requested_output_tokens": 618, "session_id": "1279412", "t_dispatch_unix": 1779814660.6592612, "t_finish_unix": 1779814665.785156, "t_first_token_unix": 1779814661.7871408, "tpot_s": 0.00647936249104656, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12748544], "trace_timestamp_s": 151.54700000000048, "ttft_s": 1.1278774139937013, "turn_id": 2} +{"actual_output_tokens": 63, "cached_tokens": 18944, "effective_input_length": 126924, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126924, "latency_s": 51.70976478297962, "output_length": 63, "proxy_request_id": "1267915:1:1267915:96", "request_id": "1267915:1:1267915:96", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1267915", "t_dispatch_unix": 1779814614.3793478, "t_finish_unix": 1779814666.0891123, "t_first_token_unix": 1779814664.8081973, "tpot_s": 0.02065342885438323, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12617736, 8430096, 227717, 2410525, 7163, 7164, 7165, 7166, 7167, 7168, 7169, 7170, 7171, 7172, 7173, 7174, 7175, 7176, 7177, 7178, 7179, 7180, 7181, 7182, 7183, 7184, 8430097, 8430098, 8430099, 8430100, 18464, 18465, 8430101, 8430102, 8546028, 9019404, 9169593, 9266923, 9266924, 9266925, 9266926, 9266927, 9266928, 9266929, 9266930, 9266931, 9266932, 9266933, 9266934, 9266935, 9266936, 9266937, 9266938, 9266939, 9341348, 9533636, 9533637, 9533638, 9533639, 9533640, 9533641, 9533642, 9533643, 9533644, 9533645, 9533646, 9533647, 9533648, 9533649, 9533650, 9533651, 9533652, 9533653, 9533654, 9706094, 9706095, 9865188, 9865189, 9865190, 9970890, 10129168, 10129169, 10129170, 10129171, 10129172, 10129173, 10129174, 10129175, 10129176, 10129177, 10129178, 10129179, 10129180, 10129181, 10129182, 10129183, 10129184, 10209871, 10209872, 10209873, 10209874, 10209875, 10209876, 10209877, 10209878, 10209879, 10209880, 10209881, 10209882, 10209883, 10209884, 10209885, 10209886, 10209887, 10274360, 10274361, 10377876, 10377877, 10562058, 10646138, 10646139, 10646140, 10826772, 10826773, 10961137, 10961138, 10961139, 10961140, 10961141, 10961142, 10961143, 11025646, 11025647, 11025648, 11025649, 11025650, 11025651, 11207611, 11207612, 11207613, 11207614, 11207615, 11207616, 11207617, 11395719, 11395720, 11395721, 11395722, 11395723, 11395724, 11395725, 11395726, 11395727, 11395728, 11395729, 11395730, 11395731, 11497760, 11742899, 11895597, 12087820, 12087821, 12087822, 12087823, 12087824, 12087825, 12087826, 12087827, 12087828, 12087829, 12087830, 12087831, 12134161, 12292796, 12292797, 12239354, 12239355, 12239356, 12239357, 12239358, 12239359, 12239360, 12239361, 12239362, 12292798, 12292799, 12292800, 12292801, 12292802, 12292803, 12292804, 12292805, 12292806, 12292807, 12292808, 12292809, 12395930, 12395931, 12395932, 12395933, 12395934, 12395935, 12395936, 12395937, 12395938, 12395939, 12395940, 12395941, 12395942, 12455493, 12617737], "trace_timestamp_s": 105.23199999999997, "ttft_s": 50.42884749098448, "turn_id": 1} +{"actual_output_tokens": 120, "cached_tokens": 14096, "effective_input_length": 23650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23650, "latency_s": 39.21356602496235, "output_length": 120, "proxy_request_id": "1265128:2:1271655:122", "request_id": "1265128:2:1271655:122", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1265128", "t_dispatch_unix": 1779814627.2336664, "t_finish_unix": 1779814666.447232, "t_first_token_unix": 1779814665.2882657, "tpot_s": 0.009736931856874251, "trace_hash_ids": [12656235, 12656236, 12656237, 12656238, 12656239, 12656240, 12656241, 12656242, 12656243, 12656244, 12656245, 12656246, 12656247, 12656248, 12656249, 12656250, 12656251, 12656252, 12656253, 12656254, 12656255, 12656256, 12656257, 12656258, 12656259, 12656260, 12656261, 12656262, 12656263, 12656264, 12656265, 12656266, 12656267, 12656268, 12656269, 12656270, 12656271, 12656272, 12656273, 12656274, 12656275, 12656276, 12656277, 12656278, 12656279, 12656280, 12656281], "trace_timestamp_s": 118.11500000000069, "ttft_s": 38.054595028981566, "turn_id": 2} +{"actual_output_tokens": 6, "cached_tokens": 4752, "effective_input_length": 16299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16299, "latency_s": 1.4721130860270932, "output_length": 6, "proxy_request_id": "1277533:2:1282872:175", "request_id": "1277533:2:1282872:175", "request_type": "coder", "requested_output_tokens": 6, "session_id": "1277533", "t_dispatch_unix": 1779814666.4596875, "t_finish_unix": 1779814667.9318006, "t_first_token_unix": 1779814667.7474988, "tpot_s": 0.03659142120741308, "trace_hash_ids": [12764556, 12764557, 12764558, 12764559, 12764560, 12764561, 12764562, 12764563, 12764564, 12764565, 12764566, 12764567, 12764568, 12764569, 12764570, 12764571, 12764572, 12764573, 12764574, 12764575, 12764576, 12764577, 12764578, 12764579, 12764580, 12764581, 12764582, 12764583, 12764584, 12764585, 12764586, 12764587], "trace_timestamp_s": 157.34400000000005, "ttft_s": 1.2878094739862718, "turn_id": 2} +{"actual_output_tokens": 3746, "cached_tokens": 22352, "effective_input_length": 25187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25187, "latency_s": 62.092315258982126, "output_length": 3746, "proxy_request_id": "1242838:4:1265709:87", "request_id": "1242838:4:1265709:87", "request_type": "coder", "requested_output_tokens": 3746, "session_id": "1242838", "t_dispatch_unix": 1779814606.8635886, "t_finish_unix": 1779814668.9559038, "t_first_token_unix": 1779814643.1643615, "tpot_s": 0.006886847008010981, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 12596375], "trace_timestamp_s": 97.75300000000061, "ttft_s": 36.30077081697527, "turn_id": 4} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 8510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8510, "latency_s": 0.9414930879720487, "output_length": 60, "proxy_request_id": "1283642:1:1283642:178", "request_id": "1283642:1:1283642:178", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1283642", "t_dispatch_unix": 1779814668.8997087, "t_finish_unix": 1779814669.8412018, "t_first_token_unix": 1779814669.5341969, "tpot_s": 0.00519867827109519, "trace_hash_ids": [12764037, 12764038, 12764039, 12764040, 12764041, 12764042, 12764043, 12764044, 12764045, 12772097, 12772098, 12772099, 12772100, 12772101, 12772102, 12772103, 12772104], "trace_timestamp_s": 159.78400000000056, "ttft_s": 0.6344861550023779, "turn_id": 1} +{"actual_output_tokens": 347, "cached_tokens": 118688, "effective_input_length": 118736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118736, "latency_s": 7.085885682026856, "output_length": 347, "proxy_request_id": "1258859:4:1282900:176", "request_id": "1258859:4:1282900:176", "request_type": "coder", "requested_output_tokens": 347, "session_id": "1258859", "t_dispatch_unix": 1779814666.5219522, "t_finish_unix": 1779814673.6078267, "t_first_token_unix": 1779814667.8841603, "tpot_s": 0.01654166613289591, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12719963, 12719964, 12719965, 12719966, 12719967, 12719968, 12719969, 12719970, 12719971, 12719972, 12765270], "trace_timestamp_s": 157.40900000000056, "ttft_s": 1.3622166240238585, "turn_id": 4} +{"actual_output_tokens": 14, "cached_tokens": 27040, "effective_input_length": 27077, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27077, "latency_s": 0.13036596798337996, "output_length": 14, "proxy_request_id": "1279412:3:1285475:187", "request_id": "1279412:3:1285475:187", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1279412", "t_dispatch_unix": 1779814675.358602, "t_finish_unix": 1779814675.4889677, "t_first_token_unix": 1779814675.42864, "tpot_s": 0.0046219344591148775, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281], "trace_timestamp_s": 166.2490000000007, "ttft_s": 0.0700358219910413, "turn_id": 3} +{"actual_output_tokens": 681, "cached_tokens": 24880, "effective_input_length": 30965, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30965, "latency_s": 7.54871343402192, "output_length": 681, "proxy_request_id": "1277909:2:1283679:179", "request_id": "1277909:2:1283679:179", "request_type": "coder", "requested_output_tokens": 681, "session_id": "1277909", "t_dispatch_unix": 1779814669.003951, "t_finish_unix": 1779814676.5526552, "t_first_token_unix": 1779814670.3001077, "tpot_s": 0.009194467333830236, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12772584, 12772585, 12772586, 12772587, 12772588, 12772589, 12772590, 12772591, 12772592, 12772593, 12772594, 12772595, 12772596, 12772597], "trace_timestamp_s": 159.88799999999992, "ttft_s": 1.2961642530281097, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 4510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4510, "latency_s": 0.5670551829971373, "output_length": 55, "proxy_request_id": "1285800:1:1285800:191", "request_id": "1285800:1:1285800:191", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1285800", "t_dispatch_unix": 1779814676.4723275, "t_finish_unix": 1779814677.0393822, "t_first_token_unix": 1779814676.762695, "tpot_s": 0.0051190916856285185, "trace_hash_ids": [12776768, 12784744, 12784745, 12784746, 12793479, 12793480, 12793481, 12793482, 12793483], "trace_timestamp_s": 167.36200000000008, "ttft_s": 0.2903665869962424, "turn_id": 1} +{"actual_output_tokens": 5747, "cached_tokens": 22624, "effective_input_length": 27639, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27639, "latency_s": 71.5041770550306, "output_length": 5747, "proxy_request_id": "1239034:4:1263738:78", "request_id": "1239034:4:1263738:78", "request_type": "coder", "requested_output_tokens": 5747, "session_id": "1239034", "t_dispatch_unix": 1779814605.699599, "t_finish_unix": 1779814677.2037764, "t_first_token_unix": 1779814606.7150316, "tpot_s": 0.01226740360163247, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445, 12562130, 12562131, 12562132, 12562133, 12562134, 12562135, 12562136, 12562137, 12576042, 12576043, 12576044, 12576045, 12576046, 12576047, 12576048, 12576049, 12576050, 12576051], "trace_timestamp_s": 90.9380000000001, "ttft_s": 1.015430344035849, "turn_id": 4} +{"actual_output_tokens": 70, "cached_tokens": 8560, "effective_input_length": 14192, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14192, "latency_s": 1.041405563999433, "output_length": 70, "proxy_request_id": "1283642:2:1285731:190", "request_id": "1283642:2:1285731:190", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1283642", "t_dispatch_unix": 1779814676.217028, "t_finish_unix": 1779814677.2584336, "t_first_token_unix": 1779814676.8765228, "tpot_s": 0.005532035796457659, "trace_hash_ids": [12764037, 12764038, 12764039, 12764040, 12764041, 12764042, 12764043, 12764044, 12764045, 12772097, 12772098, 12772099, 12772100, 12772101, 12772102, 12772103, 12782108, 12782109, 12782110, 12782111, 12782112, 12782113, 12782114, 12792906, 12792907, 12792908, 12792909, 12792910], "trace_timestamp_s": 167.10600000000068, "ttft_s": 0.6594929230050184, "turn_id": 2} +{"actual_output_tokens": 347, "cached_tokens": 0, "effective_input_length": 11, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11, "latency_s": 1.695613264979329, "output_length": 347, "proxy_request_id": "1285558:1:1285558:188", "request_id": "1285558:1:1285558:188", "request_type": "coder", "requested_output_tokens": 347, "session_id": "1285558", "t_dispatch_unix": 1779814675.5655909, "t_finish_unix": 1779814677.2612045, "t_first_token_unix": 1779814675.5830715, "tpot_s": 0.004849101690645464, "trace_hash_ids": [26603], "trace_timestamp_s": 166.45700000000033, "ttft_s": 0.017479453003033996, "turn_id": 1} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 1700, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1700, "latency_s": 0.3602654790156521, "output_length": 40, "proxy_request_id": "1286551:1:1286551:194", "request_id": "1286551:1:1286551:194", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1286551", "t_dispatch_unix": 1779814679.43579, "t_finish_unix": 1779814679.7960553, "t_first_token_unix": 1779814679.6060562, "tpot_s": 0.0048632038449749155, "trace_hash_ids": [12800256, 12800257, 12800258, 12800259], "trace_timestamp_s": 170.32600000000002, "ttft_s": 0.17026416002772748, "turn_id": 1} +{"actual_output_tokens": 242, "cached_tokens": 27088, "effective_input_length": 31898, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31898, "latency_s": 2.683706430019811, "output_length": 242, "proxy_request_id": "1279412:4:1286447:193", "request_id": "1279412:4:1286447:193", "request_type": "coder", "requested_output_tokens": 242, "session_id": "1279412", "t_dispatch_unix": 1779814679.0348992, "t_finish_unix": 1779814681.718605, "t_first_token_unix": 1779814680.11731, "tpot_s": 0.006643268419091524, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12799351], "trace_timestamp_s": 169.92000000000007, "ttft_s": 1.0824090570094995, "turn_id": 4} +{"actual_output_tokens": 124, "cached_tokens": 0, "effective_input_length": 13962, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13962, "latency_s": 1.8969649900100194, "output_length": 124, "proxy_request_id": "1286804:1:1286804:195", "request_id": "1286804:1:1286804:195", "request_type": "coder", "requested_output_tokens": 124, "session_id": "1286804", "t_dispatch_unix": 1779814680.1678684, "t_finish_unix": 1779814682.064833, "t_first_token_unix": 1779814681.3740447, "tpot_s": 0.005614109398376923, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12802941], "trace_timestamp_s": 171.0530000000008, "ttft_s": 1.2061748820124194, "turn_id": 1} +{"actual_output_tokens": 240, "cached_tokens": 0, "effective_input_length": 9925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9925, "latency_s": 2.118432349001523, "output_length": 240, "proxy_request_id": "1287588:1:1287588:198", "request_id": "1287588:1:1287588:198", "request_type": "coder", "requested_output_tokens": 240, "session_id": "1287588", "t_dispatch_unix": 1779814682.7182314, "t_finish_unix": 1779814684.8366635, "t_first_token_unix": 1779814683.5323927, "tpot_s": 0.005455976217657826, "trace_hash_ids": [12755829, 12755830, 12755831, 12755832, 12755833, 12755834, 12768457, 12768458, 12768459, 12768460, 12768461, 12768462, 12768463, 12768464, 12768465, 12768466, 12768467, 12810245, 12810246, 12810247], "trace_timestamp_s": 173.60500000000047, "ttft_s": 0.8141598210204393, "turn_id": 1} +{"actual_output_tokens": 106, "cached_tokens": 0, "effective_input_length": 448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 448, "latency_s": 0.5591368269524537, "output_length": 106, "proxy_request_id": "1288143:1:1288143:200", "request_id": "1288143:1:1288143:200", "request_type": "coder", "requested_output_tokens": 106, "session_id": "1288143", "t_dispatch_unix": 1779814684.684313, "t_finish_unix": 1779814685.2434502, "t_first_token_unix": 1779814684.732641, "tpot_s": 0.004862496923721794, "trace_hash_ids": [12815534], "trace_timestamp_s": 175.57500000000073, "ttft_s": 0.04832640697713941, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 31376, "effective_input_length": 31430, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31430, "latency_s": 36.462104260979686, "output_length": 66, "proxy_request_id": "1260327:4:1277974:154", "request_id": "1260327:4:1277974:154", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1260327", "t_dispatch_unix": 1779814649.8703501, "t_finish_unix": 1779814686.3324547, "t_first_token_unix": 1779814684.591714, "tpot_s": 0.026773920569282312, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041], "trace_timestamp_s": 140.76100000000042, "ttft_s": 34.721361401025206, "turn_id": 4} +{"actual_output_tokens": 869, "cached_tokens": 0, "effective_input_length": 49619, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49619, "latency_s": 16.019066067994572, "output_length": 869, "proxy_request_id": "1284132:1:1284132:182", "request_id": "1284132:1:1284132:182", "request_type": "coder", "requested_output_tokens": 869, "session_id": "1284132", "t_dispatch_unix": 1779814670.6828725, "t_finish_unix": 1779814686.7019384, "t_first_token_unix": 1779814680.0760891, "tpot_s": 0.0076331783583374856, "trace_hash_ids": [12776618, 12776619, 12776620, 12776621, 12776622, 12776623, 12776624, 12776625, 12776626, 12776627, 12776628, 12776629, 12776630, 12776631, 12776632, 12776633, 12776634, 12776635, 12776636, 12776637, 12776638, 12776639, 12776640, 12776641, 12776642, 12776643, 12776644, 12776645, 12776646, 12776647, 12776648, 12776649, 12776650, 12776651, 12776652, 12776653, 12776654, 12776655, 12776656, 12776657, 12776658, 12776659, 12776660, 12776661, 12776662, 12776663, 12776664, 12776665, 12776666, 12776667, 12776668, 12776669, 12776670, 12776671, 12776672, 12776673, 12776674, 12776675, 12776676, 12776677, 12776678, 12776679, 12776680, 12776681, 12776682, 12776683, 12776684, 12776685, 12776686, 12776687, 12776688, 12776689, 12776690, 12776691, 12776692, 12776693, 12776694, 12776695, 12776696, 12776697, 12776698, 12776699, 12776700, 12776701, 12776702, 12776703, 12776704, 12776705, 12776706, 12776707, 12776708, 12776709, 12776710, 12776711, 12776712, 12776713, 12776714], "trace_timestamp_s": 161.5550000000003, "ttft_s": 9.393213553994428, "turn_id": 1} +{"actual_output_tokens": 237, "cached_tokens": 19648, "effective_input_length": 31845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31845, "latency_s": 42.69458275404759, "output_length": 237, "proxy_request_id": "1268831:3:1277112:147", "request_id": "1268831:3:1277112:147", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1268831", "t_dispatch_unix": 1779814646.6641726, "t_finish_unix": 1779814689.3587554, "t_first_token_unix": 1779814684.5805326, "tpot_s": 0.02024484335166655, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12709565], "trace_timestamp_s": 137.54899999999998, "ttft_s": 37.91635777504416, "turn_id": 3} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 88317, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 88317, "latency_s": 33.152881355024874, "output_length": 93, "proxy_request_id": "1279994:1:1279994:161", "request_id": "1279994:1:1279994:161", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1279994", "t_dispatch_unix": 1779814656.777912, "t_finish_unix": 1779814689.9307928, "t_first_token_unix": 1779814683.03071, "tpot_s": 0.07499809379362926, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12737958, 12737959, 12737960, 12737961, 12737962, 12737963, 12737964, 12737965, 12737966, 12737967, 12737968], "trace_timestamp_s": 147.59200000000055, "ttft_s": 26.25279588700505, "turn_id": 1} +{"actual_output_tokens": 272, "cached_tokens": 22512, "effective_input_length": 22573, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22573, "latency_s": 41.119226614013314, "output_length": 272, "proxy_request_id": "1273203:2:1277744:152", "request_id": "1273203:2:1277744:152", "request_type": "coder", "requested_output_tokens": 272, "session_id": "1273203", "t_dispatch_unix": 1779814648.9720345, "t_finish_unix": 1779814690.0912611, "t_first_token_unix": 1779814684.58974, "tpot_s": 0.0203000230221095, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 788374, 12645257, 12645258, 109688, 109689, 109690, 109691, 109692, 109693, 12645259, 12645260, 2777791, 2777792, 12645261, 12645262, 12671102, 12671103, 12671104, 12717031, 12717032], "trace_timestamp_s": 139.86200000000008, "ttft_s": 35.61770309600979, "turn_id": 2} +{"actual_output_tokens": 69, "cached_tokens": 0, "effective_input_length": 9610, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9610, "latency_s": 1.1089384839870036, "output_length": 69, "proxy_request_id": "1286551:2:1289450:202", "request_id": "1286551:2:1289450:202", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1286551", "t_dispatch_unix": 1779814689.028219, "t_finish_unix": 1779814690.1371572, "t_first_token_unix": 1779814689.7770412, "tpot_s": 0.00529253451489186, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12827808], "trace_timestamp_s": 179.91600000000017, "ttft_s": 0.7488209760049358, "turn_id": 2} +{"actual_output_tokens": 155, "cached_tokens": 32128, "effective_input_length": 32191, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32191, "latency_s": 1.1034605739987455, "output_length": 155, "proxy_request_id": "1279412:4:1289482:203", "request_id": "1279412:4:1289482:203", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1279412", "t_dispatch_unix": 1779814689.105417, "t_finish_unix": 1779814690.208877, "t_first_token_unix": 1779814689.1960142, "tpot_s": 0.0065755799284972875, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932], "trace_timestamp_s": 179.9950000000008, "ttft_s": 0.09059481299482286, "turn_id": 4} +{"actual_output_tokens": 371, "cached_tokens": 33488, "effective_input_length": 33524, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33524, "latency_s": 45.639489929017145, "output_length": 371, "proxy_request_id": "1262354:7:1277104:146", "request_id": "1262354:7:1277104:146", "request_type": "coder", "requested_output_tokens": 371, "session_id": "1262354", "t_dispatch_unix": 1779814646.623037, "t_finish_unix": 1779814692.2625265, "t_first_token_unix": 1779814682.2124166, "tpot_s": 0.02716181348376857, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12709527], "trace_timestamp_s": 137.51299999999992, "ttft_s": 35.58937686600257, "turn_id": 7} +{"actual_output_tokens": 87, "cached_tokens": 88400, "effective_input_length": 88940, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 88940, "latency_s": 2.453476664959453, "output_length": 87, "proxy_request_id": "1279994:2:1283011:177", "request_id": "1279994:2:1283011:177", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1279994", "t_dispatch_unix": 1779814689.9364786, "t_finish_unix": 1779814692.3899553, "t_first_token_unix": 1779814690.437664, "tpot_s": 0.022691105034873756, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 303055, 12766561, 12766562, 12766563, 12766564, 12766565, 12766566, 12766567, 12766568, 12766569], "trace_timestamp_s": 157.82100000000082, "ttft_s": 0.5011832399759442, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 7261, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7261, "latency_s": 0.6353118940023705, "output_length": 29, "proxy_request_id": "1290442:1:1290442:210", "request_id": "1290442:1:1290442:210", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1290442", "t_dispatch_unix": 1779814692.2989972, "t_finish_unix": 1779814692.9343095, "t_first_token_unix": 1779814692.7921922, "tpot_s": 0.005067075929088917, "trace_hash_ids": [12815773, 12815774, 12815775, 12824652, 12824653, 12824654, 12824655, 12824656, 12824657, 12836855, 12836856, 12836857, 12836858, 12836859, 12836860], "trace_timestamp_s": 183.1870000000008, "ttft_s": 0.49319357599597424, "turn_id": 1} +{"actual_output_tokens": 177, "cached_tokens": 32080, "effective_input_length": 32346, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32346, "latency_s": 3.9904515119851567, "output_length": 177, "proxy_request_id": "1268831:4:1279168:158", "request_id": "1268831:4:1279168:158", "request_type": "coder", "requested_output_tokens": 177, "session_id": "1268831", "t_dispatch_unix": 1779814689.3605878, "t_finish_unix": 1779814693.3510392, "t_first_token_unix": 1779814689.570113, "tpot_s": 0.021480643449070736, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12730103, 12730104], "trace_timestamp_s": 144.77600000000075, "ttft_s": 0.20952151995152235, "turn_id": 4} +{"actual_output_tokens": 68, "cached_tokens": 1536, "effective_input_length": 13552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13552, "latency_s": 1.4614816310349852, "output_length": 68, "proxy_request_id": "1290426:1:1290426:209", "request_id": "1290426:1:1290426:209", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1290426", "t_dispatch_unix": 1779814692.273392, "t_finish_unix": 1779814693.7348735, "t_first_token_unix": 1779814693.3735795, "tpot_s": 0.005388751865795522, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12836762, 12836763, 12836764, 12836765, 12836766, 12836767, 12836768, 12836769, 12836770], "trace_timestamp_s": 183.16300000000047, "ttft_s": 1.1001859090174548, "turn_id": 1} +{"actual_output_tokens": 266, "cached_tokens": 17504, "effective_input_length": 30262, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30262, "latency_s": 35.132949460006785, "output_length": 266, "proxy_request_id": "1269373:4:1280765:165", "request_id": "1269373:4:1280765:165", "request_type": "coder", "requested_output_tokens": 266, "session_id": "1269373", "t_dispatch_unix": 1779814659.2838576, "t_finish_unix": 1779814694.416807, "t_first_token_unix": 1779814686.8896215, "tpot_s": 0.02840303056983207, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12745691], "trace_timestamp_s": 150.16900000000078, "ttft_s": 27.605761868006084, "turn_id": 4} +{"actual_output_tokens": 273, "cached_tokens": 11744, "effective_input_length": 13901, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13901, "latency_s": 32.1480530470144, "output_length": 273, "proxy_request_id": "1272313:4:1281720:170", "request_id": "1272313:4:1281720:170", "request_type": "coder", "requested_output_tokens": 273, "session_id": "1272313", "t_dispatch_unix": 1779814662.4752061, "t_finish_unix": 1779814694.623259, "t_first_token_unix": 1779814688.1375427, "tpot_s": 0.023842284058713737, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12753629], "trace_timestamp_s": 153.3650000000007, "ttft_s": 25.662334925029427, "turn_id": 4} +{"actual_output_tokens": 80, "cached_tokens": 0, "effective_input_length": 1744, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1744, "latency_s": 0.5330991710070521, "output_length": 80, "proxy_request_id": "1291100:1:1291100:212", "request_id": "1291100:1:1291100:212", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1291100", "t_dispatch_unix": 1779814694.5147586, "t_finish_unix": 1779814695.0478578, "t_first_token_unix": 1779814694.6589086, "tpot_s": 0.0049199884428784155, "trace_hash_ids": [12831468, 12842817, 12842818, 12842819], "trace_timestamp_s": 185.40500000000065, "ttft_s": 0.14414884004509076, "turn_id": 1} +{"actual_output_tokens": 119, "cached_tokens": 0, "effective_input_length": 23228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23228, "latency_s": 3.293981337978039, "output_length": 119, "proxy_request_id": "1290365:1:1290365:208", "request_id": "1290365:1:1290365:208", "request_type": "coder", "requested_output_tokens": 119, "session_id": "1290365", "t_dispatch_unix": 1779814692.090469, "t_finish_unix": 1779814695.3844502, "t_first_token_unix": 1779814694.675415, "tpot_s": 0.006006689389508565, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12836049], "trace_timestamp_s": 182.97400000000016, "ttft_s": 2.584944316011388, "turn_id": 1} +{"actual_output_tokens": 59, "cached_tokens": 33888, "effective_input_length": 33928, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33928, "latency_s": 3.8752776450128295, "output_length": 59, "proxy_request_id": "1262354:8:1280463:163", "request_id": "1262354:8:1280463:163", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1262354", "t_dispatch_unix": 1779814692.2641196, "t_finish_unix": 1779814696.1393974, "t_first_token_unix": 1779814692.379384, "tpot_s": 0.06482366068943018, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12742762], "trace_timestamp_s": 149.07100000000082, "ttft_s": 0.1152620540233329, "turn_id": 8} +{"actual_output_tokens": 89, "cached_tokens": 32336, "effective_input_length": 32359, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32359, "latency_s": 0.640889314992819, "output_length": 89, "proxy_request_id": "1279412:5:1291651:214", "request_id": "1279412:5:1291651:214", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1279412", "t_dispatch_unix": 1779814696.4363613, "t_finish_unix": 1779814697.0772502, "t_first_token_unix": 1779814696.5113652, "tpot_s": 0.006427747125351082, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12846974], "trace_timestamp_s": 187.32600000000002, "ttft_s": 0.07500230998266488, "turn_id": 5} +{"actual_output_tokens": 380, "cached_tokens": 49904, "effective_input_length": 58032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58032, "latency_s": 36.406606565986294, "output_length": 380, "proxy_request_id": "1266668:5:1281133:168", "request_id": "1266668:5:1281133:168", "request_type": "coder", "requested_output_tokens": 380, "session_id": "1266668", "t_dispatch_unix": 1779814660.7123961, "t_finish_unix": 1779814697.1190023, "t_first_token_unix": 1779814688.1442947, "tpot_s": 0.02367915394196857, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12748644], "trace_timestamp_s": 151.59799999999996, "ttft_s": 27.431896914960817, "turn_id": 5} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 42023, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42023, "latency_s": 11.21537371299928, "output_length": 93, "proxy_request_id": "1260327:5:1281915:172", "request_id": "1260327:5:1281915:172", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1260327", "t_dispatch_unix": 1779814686.3379326, "t_finish_unix": 1779814697.5533063, "t_first_token_unix": 1779814694.9592476, "tpot_s": 0.028192897401901933, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12755397], "trace_timestamp_s": 154.04100000000017, "ttft_s": 8.62131275300635, "turn_id": 5} +{"actual_output_tokens": 54, "cached_tokens": 23344, "effective_input_length": 23414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23414, "latency_s": 0.3959928620024584, "output_length": 54, "proxy_request_id": "1290365:2:1292000:217", "request_id": "1290365:2:1292000:217", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1290365", "t_dispatch_unix": 1779814697.6882, "t_finish_unix": 1779814698.084193, "t_first_token_unix": 1779814697.7783813, "tpot_s": 0.005764371868143877, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942], "trace_timestamp_s": 188.57900000000063, "ttft_s": 0.09017962001962587, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 8144, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8144, "latency_s": 0.70956574002048, "output_length": 29, "proxy_request_id": "1291944:1:1291944:216", "request_id": "1291944:1:1291944:216", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1291944", "t_dispatch_unix": 1779814697.4938486, "t_finish_unix": 1779814698.2034142, "t_first_token_unix": 1779814698.0621405, "tpot_s": 0.005036265678687154, "trace_hash_ids": [12831732, 12831733, 12831734, 12831735, 12831736, 12831737, 12831738, 12844495, 12844496, 12844497, 12844498, 12850497, 12850498, 12850499, 12850500, 12850501], "trace_timestamp_s": 188.38200000000052, "ttft_s": 0.5682901290128939, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 42112, "effective_input_length": 42153, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42153, "latency_s": 0.7539258729666471, "output_length": 68, "proxy_request_id": "1260327:6:1291827:215", "request_id": "1260327:6:1291827:215", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1260327", "t_dispatch_unix": 1779814697.5548875, "t_finish_unix": 1779814698.3088136, "t_first_token_unix": 1779814697.6648178, "tpot_s": 0.009608267253932, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182], "trace_timestamp_s": 188.01000000000022, "ttft_s": 0.10992860497208312, "turn_id": 6} +{"actual_output_tokens": 186, "cached_tokens": 32512, "effective_input_length": 42264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42264, "latency_s": 5.749144950998016, "output_length": 186, "proxy_request_id": "1268831:5:1284640:184", "request_id": "1268831:5:1284640:184", "request_type": "coder", "requested_output_tokens": 186, "session_id": "1268831", "t_dispatch_unix": 1779814693.3562322, "t_finish_unix": 1779814699.1053774, "t_first_token_unix": 1779814696.020717, "tpot_s": 0.016672318021930452, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12730103, 12782348, 12782349, 12782350, 12782351, 12782352, 12782353, 12782354, 12782355, 12782356, 12782357, 12782358, 12782359, 12782360, 12782361, 12782362, 12782363, 12782364, 12782365, 12782366, 12782367], "trace_timestamp_s": 163.29400000000078, "ttft_s": 2.6644822319503874, "turn_id": 5} +{"actual_output_tokens": 221, "cached_tokens": 33984, "effective_input_length": 34028, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34028, "latency_s": 3.6260162890539505, "output_length": 221, "proxy_request_id": "1262354:9:1281632:169", "request_id": "1262354:9:1281632:169", "request_type": "coder", "requested_output_tokens": 221, "session_id": "1262354", "t_dispatch_unix": 1779814696.1406746, "t_finish_unix": 1779814699.7666914, "t_first_token_unix": 1779814696.2576091, "tpot_s": 0.015948846381930212, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12752803], "trace_timestamp_s": 153.0650000000005, "ttft_s": 0.11693280702456832, "turn_id": 9} +{"actual_output_tokens": 66, "cached_tokens": 34240, "effective_input_length": 34282, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34282, "latency_s": 0.9563940439838916, "output_length": 66, "proxy_request_id": "1262354:10:1283773:180", "request_id": "1262354:10:1283773:180", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1262354", "t_dispatch_unix": 1779814699.7687888, "t_finish_unix": 1779814700.7251828, "t_first_token_unix": 1779814699.8669667, "tpot_s": 0.01319950318429619, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490], "trace_timestamp_s": 160.21700000000055, "ttft_s": 0.09817619499517605, "turn_id": 10} +{"actual_output_tokens": 86, "cached_tokens": 0, "effective_input_length": 4684, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4684, "latency_s": 0.7343250890262425, "output_length": 86, "proxy_request_id": "1292750:1:1292750:220", "request_id": "1292750:1:1292750:220", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1292750", "t_dispatch_unix": 1779814699.9954884, "t_finish_unix": 1779814700.7298136, "t_first_token_unix": 1779814700.2916515, "tpot_s": 0.005151456835515359, "trace_hash_ids": [12851054, 12851055, 12851056, 12851057, 12851058, 12851059, 12851060, 12858884, 12858885, 12858886], "trace_timestamp_s": 190.88500000000022, "ttft_s": 0.2961617130204104, "turn_id": 1} +{"actual_output_tokens": 481, "cached_tokens": 89024, "effective_input_length": 89226, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89226, "latency_s": 8.81007787201088, "output_length": 481, "proxy_request_id": "1279994:3:1286181:192", "request_id": "1279994:3:1286181:192", "request_type": "coder", "requested_output_tokens": 481, "session_id": "1279994", "t_dispatch_unix": 1779814692.402118, "t_finish_unix": 1779814701.2121954, "t_first_token_unix": 1779814692.7191281, "tpot_s": 0.01769342108539907, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 12796644, 12796645, 12796646, 12796647, 12796648, 12796649, 12796650, 12796651, 12796652, 12796653, 12796654], "trace_timestamp_s": 168.88300000000072, "ttft_s": 0.3170076470123604, "turn_id": 3} +{"actual_output_tokens": 64, "cached_tokens": 0, "effective_input_length": 77805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77805, "latency_s": 21.34549557301216, "output_length": 64, "proxy_request_id": "1287100:1:1287100:196", "request_id": "1287100:1:1287100:196", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1287100", "t_dispatch_unix": 1779814681.1308317, "t_finish_unix": 1779814702.476327, "t_first_token_unix": 1779814701.9636643, "tpot_s": 0.008133753634331423, "trace_hash_ids": [61256, 776286, 192478, 776287, 776288, 776289, 776290, 776291, 776292, 776293, 776294, 776295, 776296, 776297, 776298, 776299, 776300, 776301, 776302, 776303, 776304, 776305, 776306, 776307, 776308, 776309, 776310, 776311, 776312, 776313, 776314, 776315, 776316, 12805558, 167529, 167530, 1729741, 1729742, 1729743, 527276, 527277, 611084, 611085, 6750692, 6750693, 6750694, 6750695, 6750696, 6750697, 6750698, 6750699, 6750700, 6750701, 6750702, 6750703, 6750704, 9671050, 9671051, 9671052, 9671053, 9671054, 9671055, 9671056, 2149400, 2149401, 2149402, 9671057, 7270289, 173464, 9671058, 9671059, 9671060, 9671061, 9671062, 9671063, 9671064, 9671065, 9671066, 9671067, 9671068, 9671069, 9739253, 9739254, 9739255, 9739256, 10166701, 10457216, 10457217, 10457218, 10457219, 10457220, 10457221, 10457222, 10457223, 10457224, 10457225, 10457226, 10457227, 10457228, 10457229, 10457230, 10457231, 10457232, 10457233, 10457234, 10457235, 10642319, 10642320, 10642321, 10642322, 10642323, 10642324, 10642325, 10642326, 10843616, 10843617, 10843618, 10843619, 11736040, 11736041, 11736042, 11736043, 11736044, 11736045, 11736046, 11736047, 11736048, 11736049, 11736050, 11736051, 11736052, 11736053, 11736054, 11736055, 11736056, 11736057, 11736058, 11736059, 12076230, 12076231, 12076232, 12076233, 12179754, 12179755, 12408409, 12408410, 12408411, 12442683, 12643996, 12643997, 12805559, 12805560], "trace_timestamp_s": 171.99099999999999, "ttft_s": 20.832830956031103, "turn_id": 1} +{"actual_output_tokens": 486, "cached_tokens": 14160, "effective_input_length": 14885, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14885, "latency_s": 7.8955932020326145, "output_length": 486, "proxy_request_id": "1272313:5:1284744:185", "request_id": "1272313:5:1284744:185", "request_type": "coder", "requested_output_tokens": 486, "session_id": "1272313", "t_dispatch_unix": 1779814694.624472, "t_finish_unix": 1779814702.5200648, "t_first_token_unix": 1779814694.8739715, "tpot_s": 0.01576436130934846, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12783550], "trace_timestamp_s": 163.7400000000007, "ttft_s": 0.24949843401554972, "turn_id": 5} +{"actual_output_tokens": 31, "cached_tokens": 1808, "effective_input_length": 2572, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2572, "latency_s": 0.22889252100139856, "output_length": 31, "proxy_request_id": "1291100:2:1293458:223", "request_id": "1291100:2:1293458:223", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1291100", "t_dispatch_unix": 1779814702.4852355, "t_finish_unix": 1779814702.714128, "t_first_token_unix": 1779814702.564682, "tpot_s": 0.004974306198225046, "trace_hash_ids": [12831468, 12842817, 12842818, 12852078, 12865966, 12865967], "trace_timestamp_s": 193.3760000000002, "ttft_s": 0.07944539200980216, "turn_id": 2} +{"actual_output_tokens": 523, "cached_tokens": 30512, "effective_input_length": 30594, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30594, "latency_s": 8.57546529499814, "output_length": 523, "proxy_request_id": "1269373:5:1282812:174", "request_id": "1269373:5:1282812:174", "request_type": "coder", "requested_output_tokens": 523, "session_id": "1269373", "t_dispatch_unix": 1779814694.4181824, "t_finish_unix": 1779814702.9936476, "t_first_token_unix": 1779814694.5546465, "tpot_s": 0.016166202398485385, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12764050], "trace_timestamp_s": 157.13600000000042, "ttft_s": 0.13646212598541752, "turn_id": 5} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 6460, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6460, "latency_s": 0.5568988909944892, "output_length": 25, "proxy_request_id": "1293507:1:1293507:224", "request_id": "1293507:1:1293507:224", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1293507", "t_dispatch_unix": 1779814702.670819, "t_finish_unix": 1779814703.227718, "t_first_token_unix": 1779814703.1089792, "tpot_s": 0.004937905876431614, "trace_hash_ids": [12835633, 12835634, 12835635, 12835636, 12835637, 12835638, 12835639, 12835640, 12843654, 12851154, 12851155, 12866668, 12866669], "trace_timestamp_s": 193.5600000000004, "ttft_s": 0.438159101002384, "turn_id": 1} +{"actual_output_tokens": 63, "cached_tokens": 8160, "effective_input_length": 12388, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12388, "latency_s": 0.8097321860259399, "output_length": 63, "proxy_request_id": "1291944:2:1293798:227", "request_id": "1291944:2:1293798:227", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1291944", "t_dispatch_unix": 1779814703.756203, "t_finish_unix": 1779814704.5659351, "t_first_token_unix": 1779814704.23112, "tpot_s": 0.005396388934910177, "trace_hash_ids": [12831732, 12831733, 12831734, 12831735, 12831736, 12831737, 12831738, 12844495, 12844496, 12844497, 12844498, 12850497, 12850498, 12850499, 12850500, 12861564, 12861565, 12861566, 12861567, 12861568, 12861569, 12869790, 12869791, 12869792, 12869793], "trace_timestamp_s": 194.64500000000044, "ttft_s": 0.474915940023493, "turn_id": 2} +{"actual_output_tokens": 207, "cached_tokens": 89696, "effective_input_length": 89749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89749, "latency_s": 4.937681188981514, "output_length": 207, "proxy_request_id": "1279994:4:1290711:211", "request_id": "1279994:4:1290711:211", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1279994", "t_dispatch_unix": 1779814701.2189784, "t_finish_unix": 1779814706.1566594, "t_first_token_unix": 1779814701.4066415, "tpot_s": 0.023057065398072896, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 12839503, 12839504, 12839505, 12839506, 12839507, 12839508, 12839509, 12839510, 12839511, 12839512, 12839513, 12839514], "trace_timestamp_s": 184.05000000000018, "ttft_s": 0.1876608749735169, "turn_id": 4} +{"actual_output_tokens": 329, "cached_tokens": 23456, "effective_input_length": 24482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24482, "latency_s": 4.581853832001798, "output_length": 329, "proxy_request_id": "1290365:3:1293216:222", "request_id": "1290365:3:1293216:222", "request_type": "coder", "requested_output_tokens": 329, "session_id": "1290365", "t_dispatch_unix": 1779814701.6231484, "t_finish_unix": 1779814706.205002, "t_first_token_unix": 1779814701.8983514, "tpot_s": 0.013129118374952047, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486], "trace_timestamp_s": 192.51299999999992, "ttft_s": 0.2752008400275372, "turn_id": 3} +{"actual_output_tokens": 273, "cached_tokens": 15360, "effective_input_length": 15547, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15547, "latency_s": 4.940219387004618, "output_length": 273, "proxy_request_id": "1272313:6:1287745:199", "request_id": "1272313:6:1287745:199", "request_type": "coder", "requested_output_tokens": 273, "session_id": "1272313", "t_dispatch_unix": 1779814702.521101, "t_finish_unix": 1779814707.4613209, "t_first_token_unix": 1779814702.6489606, "tpot_s": 0.01769108227573965, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12811862], "trace_timestamp_s": 174.15700000000015, "ttft_s": 0.12785781099228188, "turn_id": 6} +{"actual_output_tokens": 491, "cached_tokens": 32432, "effective_input_length": 40278, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40278, "latency_s": 5.734302942990325, "output_length": 491, "proxy_request_id": "1279412:6:1293655:225", "request_id": "1279412:6:1293655:225", "request_type": "coder", "requested_output_tokens": 491, "session_id": "1279412", "t_dispatch_unix": 1779814703.247047, "t_finish_unix": 1779814708.98135, "t_first_token_unix": 1779814705.2846198, "tpot_s": 0.007543848812276003, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278], "trace_timestamp_s": 194.13400000000001, "ttft_s": 2.0375708079664037, "turn_id": 6} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 21947, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21947, "latency_s": 3.028166713018436, "output_length": 111, "proxy_request_id": "1294611:1:1294611:229", "request_id": "1294611:1:1294611:229", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1294611", "t_dispatch_unix": 1779814706.2150562, "t_finish_unix": 1779814709.243223, "t_first_token_unix": 1779814708.5890493, "tpot_s": 0.0059448797001757404, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479], "trace_timestamp_s": 197.10300000000007, "ttft_s": 2.3739914420293644, "turn_id": 1} +{"actual_output_tokens": 444, "cached_tokens": 31104, "effective_input_length": 38788, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38788, "latency_s": 6.282331249967683, "output_length": 444, "proxy_request_id": "1269373:6:1285668:189", "request_id": "1269373:6:1285668:189", "request_type": "coder", "requested_output_tokens": 444, "session_id": "1269373", "t_dispatch_unix": 1779814702.998276, "t_finish_unix": 1779814709.2806072, "t_first_token_unix": 1779814704.9250395, "tpot_s": 0.009831402099320274, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12792393], "trace_timestamp_s": 166.90500000000065, "ttft_s": 1.9267612519906834, "turn_id": 6} +{"actual_output_tokens": 683, "cached_tokens": 34336, "effective_input_length": 34353, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34353, "latency_s": 9.469442847010214, "output_length": 683, "proxy_request_id": "1262354:11:1284987:186", "request_id": "1262354:11:1284987:186", "request_type": "coder", "requested_output_tokens": 683, "session_id": "1262354", "t_dispatch_unix": 1779814700.7265248, "t_finish_unix": 1779814710.1959677, "t_first_token_unix": 1779814700.8140535, "tpot_s": 0.013756100630491448, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12786017], "trace_timestamp_s": 164.70100000000002, "ttft_s": 0.08752677001757547, "turn_id": 11} +{"actual_output_tokens": 80, "cached_tokens": 35024, "effective_input_length": 35099, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35099, "latency_s": 1.1787931420258246, "output_length": 80, "proxy_request_id": "1262354:12:1291548:213", "request_id": "1262354:12:1291548:213", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1262354", "t_dispatch_unix": 1779814710.1978724, "t_finish_unix": 1779814711.3766658, "t_first_token_unix": 1779814710.3113854, "tpot_s": 0.013480751380277208, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12846191], "trace_timestamp_s": 187.04100000000017, "ttft_s": 0.11351078399457037, "turn_id": 12} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 10857, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10857, "latency_s": 1.3098911310080439, "output_length": 82, "proxy_request_id": "1295690:1:1295690:232", "request_id": "1295690:1:1295690:232", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1295690", "t_dispatch_unix": 1779814710.1204238, "t_finish_unix": 1779814711.430315, "t_first_token_unix": 1779814710.9993105, "tpot_s": 0.005318102653908693, "trace_hash_ids": [12865131, 12865132, 12865133, 12865134, 12865135, 12865136, 12865137, 12877451, 12877452, 12877453, 12877454, 12877455, 12888257, 12888258, 12888259, 12888260, 12888261, 12888262, 12888263, 12888264, 12888265, 12888266], "trace_timestamp_s": 201.00700000000052, "ttft_s": 0.8788857749896124, "turn_id": 1} +{"actual_output_tokens": 338, "cached_tokens": 15808, "effective_input_length": 15969, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15969, "latency_s": 4.102811620978173, "output_length": 338, "proxy_request_id": "1272313:7:1290281:206", "request_id": "1272313:7:1290281:206", "request_type": "coder", "requested_output_tokens": 338, "session_id": "1272313", "t_dispatch_unix": 1779814707.4624848, "t_finish_unix": 1779814711.5652964, "t_first_token_unix": 1779814707.555663, "tpot_s": 0.011897050670571957, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12835696], "trace_timestamp_s": 182.72299999999996, "ttft_s": 0.09317648300202563, "turn_id": 7} +{"actual_output_tokens": 13, "cached_tokens": 10160, "effective_input_length": 10195, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10195, "latency_s": 22.314513886987697, "output_length": 13, "proxy_request_id": "1287588:2:1289701:205", "request_id": "1287588:2:1289701:205", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1287588", "t_dispatch_unix": 1779814689.9437456, "t_finish_unix": 1779814712.2582598, "t_first_token_unix": 1779814712.1887844, "tpot_s": 0.005757610245685403, "trace_hash_ids": [12755829, 12755830, 12755831, 12755832, 12755833, 12755834, 12768457, 12768458, 12768459, 12768460, 12768461, 12768462, 12768463, 12768464, 12768465, 12768466, 12768467, 12810245, 12810246, 12830253], "trace_timestamp_s": 180.83500000000004, "ttft_s": 22.24503693904262, "turn_id": 2} +{"actual_output_tokens": 220, "cached_tokens": 22048, "effective_input_length": 23610, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23610, "latency_s": 1.7137944370042533, "output_length": 220, "proxy_request_id": "1294611:2:1295852:233", "request_id": "1294611:2:1295852:233", "request_type": "coder", "requested_output_tokens": 220, "session_id": "1294611", "t_dispatch_unix": 1779814710.6231797, "t_finish_unix": 1779814712.3369741, "t_first_token_unix": 1779814710.9891627, "tpot_s": 0.006153233447399194, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12890138], "trace_timestamp_s": 201.51299999999992, "ttft_s": 0.36598124098964036, "turn_id": 2} +{"actual_output_tokens": 91, "cached_tokens": 35168, "effective_input_length": 35210, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35210, "latency_s": 1.2994465210358612, "output_length": 91, "proxy_request_id": "1262354:13:1293000:221", "request_id": "1262354:13:1293000:221", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1262354", "t_dispatch_unix": 1779814711.3786826, "t_finish_unix": 1779814712.6781297, "t_first_token_unix": 1779814711.4692001, "tpot_s": 0.013429280277341605, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540], "trace_timestamp_s": 191.72700000000077, "ttft_s": 0.0905155130312778, "turn_id": 13} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 82014, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82014, "latency_s": 23.258836457971483, "output_length": 61, "proxy_request_id": "1289570:1:1289570:204", "request_id": "1289570:1:1289570:204", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1289570", "t_dispatch_unix": 1779814689.4541025, "t_finish_unix": 1779814712.7129385, "t_first_token_unix": 1779814712.2037203, "tpot_s": 0.008482989566982724, "trace_hash_ids": [44148, 44149, 44150, 44151, 44152, 44153, 326399, 326400, 326401, 192485, 192486, 326402, 326403, 326404, 326405, 186604, 326406, 326407, 326408, 326409, 326410, 326411, 8410093, 8410094, 8410095, 8410096, 334886, 8410097, 8410098, 8410099, 8410100, 8410101, 8410102, 8410103, 8410104, 8410105, 8410106, 8410107, 8410108, 12828955, 127129, 127130, 127131, 127132, 9195123, 124871, 124872, 2501130, 2501131, 9195124, 9195125, 9195126, 9195127, 9195128, 9195129, 9195130, 9195131, 9195132, 9195133, 9195134, 9195135, 9195136, 9195137, 9195138, 9195139, 9195140, 9195141, 9195142, 9932953, 9932954, 9932955, 9932956, 9798604, 10563697, 10563698, 10563699, 10563700, 10563701, 10563702, 10563703, 10563704, 10563705, 10563706, 10563707, 10563708, 10563709, 10563710, 10563711, 10563712, 10563713, 11618308, 11618309, 11618310, 11618311, 11922778, 11922779, 11922780, 11922781, 11922782, 11922783, 11922784, 11922785, 11922786, 11922787, 11922788, 11922789, 11922790, 11922791, 11922792, 11922793, 11922794, 11922795, 11922796, 11922797, 11922798, 11922799, 11922800, 11922801, 11922802, 11922803, 11922804, 11922805, 11922806, 11922807, 11922808, 11922809, 11922810, 11922811, 11922812, 11922813, 11922814, 11922815, 11922816, 11922817, 11922818, 11922819, 11922820, 11922821, 11922822, 11922823, 11922824, 11922825, 11922826, 11922827, 11922828, 11922829, 11922830, 11922831, 11922832, 11922833, 12148250, 12148251, 12148252, 12442632, 12442633, 12442634, 12542377, 12828956, 12828957, 12828958, 12828959], "trace_timestamp_s": 180.3120000000008, "ttft_s": 22.74961647897726, "turn_id": 1} +{"actual_output_tokens": 22, "cached_tokens": 0, "effective_input_length": 624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 624, "latency_s": 0.16762141202343628, "output_length": 22, "proxy_request_id": "1296872:1:1296872:235", "request_id": "1296872:1:1296872:235", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1296872", "t_dispatch_unix": 1779814714.1856425, "t_finish_unix": 1779814714.3532639, "t_first_token_unix": 1779814714.2516358, "tpot_s": 0.004828183002592553, "trace_hash_ids": [12899223, 12899224], "trace_timestamp_s": 205.07600000000002, "ttft_s": 0.06599186599487439, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 1791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1791, "latency_s": 0.34112582699162886, "output_length": 46, "proxy_request_id": "1296983:1:1296983:236", "request_id": "1296983:1:1296983:236", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1296983", "t_dispatch_unix": 1779814714.61888, "t_finish_unix": 1779814714.9600062, "t_first_token_unix": 1779814714.7391942, "tpot_s": 0.004900056776952827, "trace_hash_ids": [12890444, 12900454, 12900455, 12900456], "trace_timestamp_s": 205.50900000000001, "ttft_s": 0.12031290703453124, "turn_id": 1} +{"actual_output_tokens": 201, "cached_tokens": 35296, "effective_input_length": 35435, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35435, "latency_s": 2.854250698990654, "output_length": 201, "proxy_request_id": "1262354:14:1294243:228", "request_id": "1262354:14:1294243:228", "request_type": "coder", "requested_output_tokens": 201, "session_id": "1262354", "t_dispatch_unix": 1779814712.6800766, "t_finish_unix": 1779814715.5343275, "t_first_token_unix": 1779814712.8195019, "tpot_s": 0.013572156575100962, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540, 12873922], "trace_timestamp_s": 195.8110000000006, "ttft_s": 0.13942288397811353, "turn_id": 14} +{"actual_output_tokens": 279, "cached_tokens": 16304, "effective_input_length": 28796, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28796, "latency_s": 4.923249676998239, "output_length": 279, "proxy_request_id": "1272313:8:1293738:226", "request_id": "1272313:8:1293738:226", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1272313", "t_dispatch_unix": 1779814711.5711668, "t_finish_unix": 1779814716.4944165, "t_first_token_unix": 1779814713.781034, "tpot_s": 0.009759285370609891, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12868987], "trace_timestamp_s": 194.49099999999999, "ttft_s": 2.209865003998857, "turn_id": 8} +{"actual_output_tokens": 1887, "cached_tokens": 0, "effective_input_length": 114612, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 114612, "latency_s": 76.85615392500767, "output_length": 1887, "proxy_request_id": "1275274:1:1275274:136", "request_id": "1275274:1:1275274:136", "request_type": "coder", "requested_output_tokens": 1887, "session_id": "1275274", "t_dispatch_unix": 1779814639.9850094, "t_finish_unix": 1779814716.8411627, "t_first_token_unix": 1779814682.2280328, "tpot_s": 0.01835249647349865, "trace_hash_ids": [9491467, 195037, 195038, 195039, 195040, 195041, 195042, 195043, 195044, 10319406, 10319407, 10319408, 10319409, 10319410, 10319411, 10319412, 10319413, 10319414, 5374859, 10319415, 10319416, 816846, 10319417, 10319418, 10319419, 10319420, 194680, 194681, 10319421, 10319422, 10319423, 10319424, 10319425, 10319426, 10319427, 10319428, 10319429, 10319430, 10319431, 10319432, 10319433, 10319434, 10319435, 10319436, 10319437, 10319438, 10319439, 10319440, 10319441, 10319442, 10319443, 10319444, 10319445, 10319446, 10319447, 10319448, 10319449, 10319450, 10319451, 10319452, 10319453, 10319454, 10319455, 10319456, 10319457, 10319458, 10319459, 10319460, 10319461, 10319462, 10319463, 10319464, 10319465, 10319466, 10319467, 10319468, 10319469, 10319470, 10319471, 10319472, 10319473, 10319474, 10319475, 10319476, 10319477, 10319478, 10319479, 10319480, 10319481, 10319482, 10319483, 10319484, 10319485, 10319486, 10319487, 10319488, 10319489, 10319490, 10319491, 10319492, 10319493, 10319494, 10319495, 10319496, 10319497, 10319498, 10319499, 10319500, 10319501, 10319502, 10319503, 10319504, 10319505, 10319506, 10319507, 10319508, 10319509, 10319510, 10319511, 10319512, 10319513, 10319514, 10319515, 10319516, 10319517, 10319518, 10319519, 10319520, 10319521, 10319522, 10319523, 10319524, 10319525, 10319526, 10319527, 10319528, 10319529, 10319530, 10319531, 10319532, 10319533, 10319534, 10319535, 10319536, 10319537, 10319538, 10319539, 10319540, 10319541, 10319542, 10319543, 10319544, 10319545, 10319546, 10319547, 10319548, 10319549, 10319550, 10319551, 10319552, 10319553, 10319554, 10319555, 10319556, 10319557, 10319558, 10319559, 10319560, 10319561, 10319562, 10319563, 10319564, 10319565, 10319566, 10319567, 10319568, 10319569, 10319570, 10319571, 10319572, 10319573, 10451843, 10538212, 10538213, 10590028, 10695557, 10848849, 10848850, 10848851, 10949071, 11065667, 11650526, 11650527, 11650528, 11717015, 11717016, 11717017, 11717018, 11717019, 11717020, 11796353, 11796354, 11796355, 11796356, 11895285, 12041647, 12041648, 12041649, 12041650, 12193888, 12247657, 12247658, 12247659, 12247660, 12374859, 12374860, 12374861, 12437166, 12437167, 12596754, 12596755, 12690937, 12690938, 12690939], "trace_timestamp_s": 130.82999999999993, "ttft_s": 42.243020730966236, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 42208, "effective_input_length": 42363, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42363, "latency_s": 0.5002118480042554, "output_length": 36, "proxy_request_id": "1260327:7:1297673:242", "request_id": "1260327:7:1297673:242", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1260327", "t_dispatch_unix": 1779814716.8024333, "t_finish_unix": 1779814717.3026447, "t_first_token_unix": 1779814716.9690657, "tpot_s": 0.009508723200165799, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182], "trace_timestamp_s": 207.692, "ttft_s": 0.16663070599315688, "turn_id": 7} +{"actual_output_tokens": 2687, "cached_tokens": 31632, "effective_input_length": 44920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44920, "latency_s": 29.28144282399444, "output_length": 2687, "proxy_request_id": "1277909:3:1289205:201", "request_id": "1277909:3:1289205:201", "request_type": "coder", "requested_output_tokens": 2687, "session_id": "1277909", "t_dispatch_unix": 1779814688.158329, "t_finish_unix": 1779814717.4397717, "t_first_token_unix": 1779814696.6767201, "tpot_s": 0.0077300221705055095, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12772584, 12772585, 12772586, 12772587, 12772588, 12772589, 12772590, 12772591, 12772592, 12772593, 12772594, 12772595, 12772596, 12825757, 12825758, 12825759, 12825760, 12825761, 12825762, 12825763, 12825764, 12825765, 12825766, 12825767, 12825768, 12825769, 12825770, 12825771, 12825772, 12825773, 12825774, 12825775, 12825776, 12825777, 12825778, 12825779, 12825780, 12825781, 12825782, 12825783, 12825784], "trace_timestamp_s": 179.04300000000057, "ttft_s": 8.518388729018625, "turn_id": 3} +{"actual_output_tokens": 546, "cached_tokens": 39216, "effective_input_length": 42745, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42745, "latency_s": 8.215859435033053, "output_length": 546, "proxy_request_id": "1269373:7:1290314:207", "request_id": "1269373:7:1290314:207", "request_type": "coder", "requested_output_tokens": 546, "session_id": "1269373", "t_dispatch_unix": 1779814709.2842531, "t_finish_unix": 1779814717.5001125, "t_first_token_unix": 1779814710.3636615, "tpot_s": 0.013093858053202852, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12835840], "trace_timestamp_s": 182.8120000000008, "ttft_s": 1.0794061730266549, "turn_id": 7} +{"actual_output_tokens": 355, "cached_tokens": 35632, "effective_input_length": 35669, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35669, "latency_s": 3.118746502965223, "output_length": 355, "proxy_request_id": "1262354:15:1296106:234", "request_id": "1262354:15:1296106:234", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1262354", "t_dispatch_unix": 1779814715.5364945, "t_finish_unix": 1779814718.6552413, "t_first_token_unix": 1779814715.6292248, "tpot_s": 0.00854734675139899, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540, 12892843], "trace_timestamp_s": 202.45900000000074, "ttft_s": 0.09272743196925148, "turn_id": 15} +{"actual_output_tokens": 18, "cached_tokens": 7280, "effective_input_length": 11994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11994, "latency_s": 0.6280510480282828, "output_length": 18, "proxy_request_id": "1290442:2:1298058:246", "request_id": "1290442:2:1298058:246", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1290442", "t_dispatch_unix": 1779814718.1551754, "t_finish_unix": 1779814718.7832263, "t_first_token_unix": 1779814718.666632, "tpot_s": 0.006844486469430301, "trace_hash_ids": [12909662, 12909663, 12909664, 12909665, 12909666, 12909667, 12909668, 12909669, 12909670, 12909671, 12909672, 12909673, 12909674, 12909675, 12909676, 12909677, 12909678, 12909679, 12909680, 12909681, 12909682, 12909683, 12909684, 12909685], "trace_timestamp_s": 209.04100000000017, "ttft_s": 0.5114549450227059, "turn_id": 2} +{"actual_output_tokens": 34, "cached_tokens": 9664, "effective_input_length": 16914, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16914, "latency_s": 20.54885084903799, "output_length": 34, "proxy_request_id": "1286551:3:1292589:219", "request_id": "1286551:3:1292589:219", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1286551", "t_dispatch_unix": 1779814699.3600707, "t_finish_unix": 1779814719.9089212, "t_first_token_unix": 1779814719.5660806, "tpot_s": 0.010382335059782208, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12836762, 12836763, 12836764, 12836765, 12836766, 12836767, 12836768, 12836769, 12845101, 12845102, 12857466, 12857467, 12857468, 12857469, 12857470, 12857471], "trace_timestamp_s": 190.2490000000007, "ttft_s": 20.206008121022023, "turn_id": 3} +{"actual_output_tokens": 488, "cached_tokens": 23824, "effective_input_length": 23863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23863, "latency_s": 3.584627065982204, "output_length": 488, "proxy_request_id": "1294611:3:1297534:240", "request_id": "1294611:3:1297534:240", "request_type": "coder", "requested_output_tokens": 488, "session_id": "1294611", "t_dispatch_unix": 1779814716.4606616, "t_finish_unix": 1779814720.0452886, "t_first_token_unix": 1779814716.5233562, "tpot_s": 0.0072314378376849365, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12905263], "trace_timestamp_s": 207.35100000000057, "ttft_s": 0.06269299302948639, "turn_id": 3} +{"actual_output_tokens": 144, "cached_tokens": 29072, "effective_input_length": 29149, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29149, "latency_s": 3.77475779899396, "output_length": 144, "proxy_request_id": "1272313:9:1297810:243", "request_id": "1272313:9:1297810:243", "request_type": "coder", "requested_output_tokens": 144, "session_id": "1272313", "t_dispatch_unix": 1779814717.2750697, "t_finish_unix": 1779814721.0498278, "t_first_token_unix": 1779814717.4137754, "tpot_s": 0.025424714622713, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593], "trace_timestamp_s": 208.16499999999996, "ttft_s": 0.13870384194888175, "turn_id": 9} +{"actual_output_tokens": 226, "cached_tokens": 0, "effective_input_length": 13992, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13992, "latency_s": 4.188903054979164, "output_length": 226, "proxy_request_id": "1297811:1:1297811:244", "request_id": "1297811:1:1297811:244", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1297811", "t_dispatch_unix": 1779814717.282976, "t_finish_unix": 1779814721.4718792, "t_first_token_unix": 1779814718.529001, "tpot_s": 0.013078133586483697, "trace_hash_ids": [3411, 3412, 3413, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 2642723, 18908, 18909, 18910, 2642724, 1369412, 12886430, 12886431, 12907594, 12907595, 41662, 12907596], "trace_timestamp_s": 208.16600000000017, "ttft_s": 1.2460234590107575, "turn_id": 1} +{"actual_output_tokens": 353, "cached_tokens": 13168, "effective_input_length": 21630, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21630, "latency_s": 4.1295955430250615, "output_length": 353, "proxy_request_id": "1268861:3:1298057:245", "request_id": "1268861:3:1298057:245", "request_type": "coder", "requested_output_tokens": 353, "session_id": "1268861", "t_dispatch_unix": 1779814718.1399949, "t_finish_unix": 1779814722.2695897, "t_first_token_unix": 1779814719.7699778, "tpot_s": 0.007100305593749826, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 12909661], "trace_timestamp_s": 209.02700000000004, "ttft_s": 1.6299817300168797, "turn_id": 3} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 9530, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9530, "latency_s": 0.9096356360241771, "output_length": 36, "proxy_request_id": "1298970:1:1298970:248", "request_id": "1298970:1:1298970:248", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1298970", "t_dispatch_unix": 1779814721.4233413, "t_finish_unix": 1779814722.3329768, "t_first_token_unix": 1779814722.1507435, "tpot_s": 0.005200040914184813, "trace_hash_ids": [12901321, 12901322, 12901323, 12901324, 12901325, 12901326, 12901327, 12906384, 12906385, 12911458, 12918873, 12918874, 12918875, 12918876, 12918877, 12918878, 12918879, 12918880, 12918881], "trace_timestamp_s": 212.3110000000006, "ttft_s": 0.7274010410183109, "turn_id": 1} +{"actual_output_tokens": 226, "cached_tokens": 0, "effective_input_length": 881, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 881, "latency_s": 1.184480823983904, "output_length": 226, "proxy_request_id": "1299073:1:1299073:249", "request_id": "1299073:1:1299073:249", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1299073", "t_dispatch_unix": 1779814721.7840855, "t_finish_unix": 1779814722.9685657, "t_first_token_unix": 1779814721.8633552, "tpot_s": 0.004910804737721467, "trace_hash_ids": [7025, 12919848], "trace_timestamp_s": 212.67500000000018, "ttft_s": 0.07926898502046242, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 7963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7963, "latency_s": 0.7428161179996096, "output_length": 38, "proxy_request_id": "1296983:2:1299368:250", "request_id": "1296983:2:1299368:250", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1296983", "t_dispatch_unix": 1779814722.60869, "t_finish_unix": 1779814723.351506, "t_first_token_unix": 1779814723.1620889, "tpot_s": 0.0051113649450771105, "trace_hash_ids": [12890444, 12900454, 12900455, 12907879, 12907880, 12907881, 12907882, 12914282, 12914283, 12914284, 12921804, 12921805, 12921806, 12921807, 12921808, 12921809], "trace_timestamp_s": 213.4970000000003, "ttft_s": 0.5533973699784838, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 8352, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8352, "latency_s": 0.7442515990114771, "output_length": 27, "proxy_request_id": "1296872:2:1299394:251", "request_id": "1296872:2:1299394:251", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1296872", "t_dispatch_unix": 1779814722.721677, "t_finish_unix": 1779814723.4659288, "t_first_token_unix": 1779814723.3359692, "tpot_s": 0.004989760307720504, "trace_hash_ids": [12899223, 12908829, 12908830, 12908831, 12908832, 12915224, 12915225, 12915226, 12915227, 12915228, 12915229, 12915230, 12921915, 12921916, 12921917, 12921918, 12921919], "trace_timestamp_s": 213.61000000000058, "ttft_s": 0.6142909560003318, "turn_id": 2} +{"actual_output_tokens": 513, "cached_tokens": 43280, "effective_input_length": 50680, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50680, "latency_s": 6.5658577579888515, "output_length": 513, "proxy_request_id": "1269373:8:1295332:230", "request_id": "1269373:8:1295332:230", "request_type": "coder", "requested_output_tokens": 513, "session_id": "1269373", "t_dispatch_unix": 1779814717.504934, "t_finish_unix": 1779814724.0707922, "t_first_token_unix": 1779814719.8677301, "tpot_s": 0.00820862253510768, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629], "trace_timestamp_s": 199.65000000000055, "ttft_s": 2.362793806998525, "turn_id": 8} +{"actual_output_tokens": 492, "cached_tokens": 4096, "effective_input_length": 80055, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80055, "latency_s": 27.057469923980534, "output_length": 492, "proxy_request_id": "1266668:6:1284003:181", "request_id": "1266668:6:1284003:181", "request_type": "coder", "requested_output_tokens": 492, "session_id": "1266668", "t_dispatch_unix": 1779814697.1298823, "t_finish_unix": 1779814724.1873522, "t_first_token_unix": 1779814719.4058037, "tpot_s": 0.009737938130369255, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12775718], "trace_timestamp_s": 161.10300000000007, "ttft_s": 22.275918937986717, "turn_id": 6} +{"actual_output_tokens": 18, "cached_tokens": 0, "effective_input_length": 19157, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19157, "latency_s": 2.033039053028915, "output_length": 18, "proxy_request_id": "1292750:2:1299406:252", "request_id": "1292750:2:1299406:252", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1292750", "t_dispatch_unix": 1779814722.7615914, "t_finish_unix": 1779814724.7946308, "t_first_token_unix": 1779814724.7100713, "tpot_s": 0.004958624177721932, "trace_hash_ids": [12922192, 12922193, 12922194, 12922195, 12922196, 12922197, 12922198, 12922199, 12922200, 12922201, 12922202, 12922203, 12922204, 12922205, 12922206, 12922207, 12922208, 12922209, 12922210, 12922211, 12922212, 12922213, 12922214, 12922215, 12922216, 12922217, 12922218, 12922219, 12922220, 12922221, 12922222, 12922223, 12922224, 12922225, 12922226, 12922227, 12922228, 12922229], "trace_timestamp_s": 213.64500000000044, "ttft_s": 1.9484771320130676, "turn_id": 2} +{"actual_output_tokens": 222, "cached_tokens": 29280, "effective_input_length": 29486, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29486, "latency_s": 1.5600103419856168, "output_length": 222, "proxy_request_id": "1272313:10:1299814:254", "request_id": "1272313:10:1299814:254", "request_type": "coder", "requested_output_tokens": 222, "session_id": "1272313", "t_dispatch_unix": 1779814724.1384218, "t_finish_unix": 1779814725.6984322, "t_first_token_unix": 1779814724.2650583, "tpot_s": 0.006484778072501689, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593, 12926791], "trace_timestamp_s": 215.02900000000045, "ttft_s": 0.12663436797447503, "turn_id": 10} +{"actual_output_tokens": 114, "cached_tokens": 14080, "effective_input_length": 14213, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14213, "latency_s": 0.6931607130100019, "output_length": 114, "proxy_request_id": "1286804:2:1300234:256", "request_id": "1286804:2:1300234:256", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1286804", "t_dispatch_unix": 1779814725.5885065, "t_finish_unix": 1779814726.2816672, "t_first_token_unix": 1779814725.649595, "tpot_s": 0.005591253460018146, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548], "trace_timestamp_s": 216.47900000000027, "ttft_s": 0.06108718801988289, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 24336, "effective_input_length": 24384, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24384, "latency_s": 0.5293798920465633, "output_length": 61, "proxy_request_id": "1294611:4:1300505:257", "request_id": "1294611:4:1300505:257", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1294611", "t_dispatch_unix": 1779814726.6053858, "t_finish_unix": 1779814727.1347656, "t_first_token_unix": 1779814726.6717103, "tpot_s": 0.007713467483214723, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12933072], "trace_timestamp_s": 217.4960000000001, "ttft_s": 0.06632235000142828, "turn_id": 4} +{"actual_output_tokens": 44, "cached_tokens": 18944, "effective_input_length": 62414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62414, "latency_s": 12.408835751994047, "output_length": 44, "proxy_request_id": "1297473:1:1297473:239", "request_id": "1297473:1:1297473:239", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1297473", "t_dispatch_unix": 1779814716.3533454, "t_finish_unix": 1779814728.7621808, "t_first_token_unix": 1779814728.4493022, "tpot_s": 0.007269336232850545, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12904663, 5910591, 5910592, 5910593, 185213, 185214, 185215, 185216, 185217, 185218, 185219, 185220, 185221, 185222, 185223, 185224, 185225, 185226, 185227, 185228, 185229, 185230, 185231, 185232, 185233, 185234, 5910594, 5910595, 5910596, 5910597, 5910598, 5910599, 5910600, 5910601, 5910602, 5910603, 5910604, 5910605, 5910606, 5910607, 5910608, 5910609, 10616321, 10652041, 10652042, 10652043, 10652044, 10652045, 10652046, 10652047, 10652048, 10652049, 10652050, 10652051, 494688, 494689, 494690, 494691, 494692, 494693, 494694, 494695, 494696, 494697, 10806837, 10877108, 10877109, 10877110, 11193681, 11243946, 11449317, 11449318, 11562111, 11620173, 11788107, 11788108, 11788109, 11935542, 11935543, 12633973, 12633974, 12633975, 12904664, 12904665, 12904666], "trace_timestamp_s": 207.22700000000077, "ttft_s": 12.095954952004831, "turn_id": 1} +{"actual_output_tokens": 51, "cached_tokens": 24432, "effective_input_length": 25650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25650, "latency_s": 0.6802476099692285, "output_length": 51, "proxy_request_id": "1294611:5:1301356:262", "request_id": "1294611:5:1301356:262", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1294611", "t_dispatch_unix": 1779814729.4270933, "t_finish_unix": 1779814730.1073403, "t_first_token_unix": 1779814729.7173877, "tpot_s": 0.007792745979968458, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 11891732], "trace_timestamp_s": 220.3160000000007, "ttft_s": 0.2902937159524299, "turn_id": 5} +{"actual_output_tokens": 935, "cached_tokens": 0, "effective_input_length": 18893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18893, "latency_s": 7.98923908197321, "output_length": 935, "proxy_request_id": "1299507:1:1299507:253", "request_id": "1299507:1:1299507:253", "request_type": "coder", "requested_output_tokens": 935, "session_id": "1299507", "t_dispatch_unix": 1779814723.0221233, "t_finish_unix": 1779814731.0113623, "t_first_token_unix": 1779814724.9368215, "tpot_s": 0.006503443079237772, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4629805, 12866561, 12923203, 12923204, 12923205, 12923206, 12923207, 12923208, 12923209, 12923210, 12923211, 12923212, 12923213, 12923214], "trace_timestamp_s": 213.91000000000076, "ttft_s": 1.9146962399827316, "turn_id": 1} +{"actual_output_tokens": 406, "cached_tokens": 80544, "effective_input_length": 87741, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87741, "latency_s": 7.8576087150140665, "output_length": 406, "proxy_request_id": "1266668:7:1287468:197", "request_id": "1266668:7:1287468:197", "request_type": "coder", "requested_output_tokens": 406, "session_id": "1266668", "t_dispatch_unix": 1779814724.1941292, "t_finish_unix": 1779814732.051738, "t_first_token_unix": 1779814728.1290174, "tpot_s": 0.009684982210006795, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12809031], "trace_timestamp_s": 173.22299999999996, "ttft_s": 3.934886050003115, "turn_id": 7} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 6527, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6527, "latency_s": 0.8916145890252665, "output_length": 48, "proxy_request_id": "1302071:1:1302071:267", "request_id": "1302071:1:1302071:267", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1302071", "t_dispatch_unix": 1779814732.145517, "t_finish_unix": 1779814733.0371318, "t_first_token_unix": 1779814732.6008484, "tpot_s": 0.009273250106761747, "trace_hash_ids": [12922724, 12922725, 12922726, 12922727, 12932131, 12932132, 12932133, 12932134, 12932135, 12948308, 12948309, 12948310, 12948311], "trace_timestamp_s": 223.02900000000045, "ttft_s": 0.4553301029955037, "turn_id": 1} +{"actual_output_tokens": 487, "cached_tokens": 51184, "effective_input_length": 54451, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54451, "latency_s": 5.725290949980263, "output_length": 487, "proxy_request_id": "1269373:9:1300958:261", "request_id": "1269373:9:1300958:261", "request_type": "coder", "requested_output_tokens": 487, "session_id": "1269373", "t_dispatch_unix": 1779814728.270089, "t_finish_unix": 1779814733.9953797, "t_first_token_unix": 1779814729.5534687, "tpot_s": 0.009139248971212195, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12937628], "trace_timestamp_s": 219.15800000000036, "ttft_s": 1.2833768569980748, "turn_id": 9} +{"actual_output_tokens": 90, "cached_tokens": 0, "effective_input_length": 1105, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1105, "latency_s": 0.9265445600030944, "output_length": 90, "proxy_request_id": "1302449:1:1302449:269", "request_id": "1302449:1:1302449:269", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1302449", "t_dispatch_unix": 1779814733.6839595, "t_finish_unix": 1779814734.610504, "t_first_token_unix": 1779814733.8610013, "tpot_s": 0.008416789708125373, "trace_hash_ids": [12952117, 12952118, 12952119], "trace_timestamp_s": 224.57500000000073, "ttft_s": 0.1770405870047398, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 28972, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28972, "latency_s": 3.987821304006502, "output_length": 45, "proxy_request_id": "1295690:2:1301706:264", "request_id": "1295690:2:1301706:264", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1295690", "t_dispatch_unix": 1779814730.7144582, "t_finish_unix": 1779814734.7022786, "t_first_token_unix": 1779814734.449823, "tpot_s": 0.005732342158973386, "trace_hash_ids": [12944696, 12944697, 12944698, 12944699, 12944700, 12944701, 12944702, 12944703, 12944704, 12944705, 12944706, 12944707, 12944708, 12944709, 12944710, 12944711, 12944712, 12944713, 12944714, 12944715, 12944716, 12944717, 12944718, 12944719, 12944720, 12944721, 12944722, 12944723, 12944724, 12944725, 12944726, 12944727, 12944728, 12944729, 12944730, 12944731, 12944732, 12944733, 12944734, 12944735, 12944736, 12944737, 12944738, 12944739, 12944740, 12944741, 12944742, 12944743, 12944744, 12944745, 12944746, 12944747, 12944748, 12944749, 12944750, 12944751, 12944752], "trace_timestamp_s": 221.59400000000005, "ttft_s": 3.7353633230086416, "turn_id": 2} +{"actual_output_tokens": 43, "cached_tokens": 0, "effective_input_length": 26441, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26441, "latency_s": 3.495793259993661, "output_length": 43, "proxy_request_id": "1302063:1:1302063:266", "request_id": "1302063:1:1302063:266", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1302063", "t_dispatch_unix": 1779814732.1398573, "t_finish_unix": 1779814735.6356487, "t_first_token_unix": 1779814735.3892746, "tpot_s": 0.005858649284900388, "trace_hash_ids": [12896607, 12896608, 12896609, 12896610, 12896611, 12896612, 12896613, 12896614, 12896615, 12896616, 12896617, 12896618, 12896619, 12896620, 12896621, 12896622, 12896623, 12896624, 12896625, 12896626, 12896627, 12896628, 12896629, 12905071, 12905072, 12905073, 12905074, 12920854, 12920855, 12920856, 12920857, 12920858, 12920859, 12920860, 12920861, 12920862, 12920863, 12920864, 12928167, 12928168, 12928169, 12928170, 12928171, 12935909, 12935910, 12935911, 12935912, 12948081, 12948082, 12948083, 12948084, 12948085], "trace_timestamp_s": 223.01400000000012, "ttft_s": 3.2494175320025533, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 15958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15958, "latency_s": 1.654146997956559, "output_length": 37, "proxy_request_id": "1302907:1:1302907:272", "request_id": "1302907:1:1302907:272", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1302907", "t_dispatch_unix": 1779814735.0490978, "t_finish_unix": 1779814736.7032447, "t_first_token_unix": 1779814736.5074103, "tpot_s": 0.005433240638618979, "trace_hash_ids": [12894270, 12894271, 12894272, 12894273, 12894274, 12894275, 12894276, 12894277, 12894278, 12894279, 12894280, 12894281, 12894282, 12894283, 12894284, 12894285, 12894286, 12894287, 12902788, 12902789, 12902790, 12902791, 12911614, 12911615, 12911616, 12911617, 12942345, 12942346, 12942347, 12956121, 12956122, 12956123], "trace_timestamp_s": 225.9340000000002, "ttft_s": 1.4583111339597963, "turn_id": 1} +{"actual_output_tokens": 169, "cached_tokens": 24800, "effective_input_length": 25103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25103, "latency_s": 17.518455919984262, "output_length": 169, "proxy_request_id": "1290365:4:1298540:247", "request_id": "1290365:4:1298540:247", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1290365", "t_dispatch_unix": 1779814719.8611228, "t_finish_unix": 1779814737.3795786, "t_first_token_unix": 1779814734.211995, "tpot_s": 0.018849777875099488, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486, 12914159, 12914160], "trace_timestamp_s": 210.7490000000007, "ttft_s": 14.350870406953618, "turn_id": 4} +{"actual_output_tokens": 96, "cached_tokens": 88144, "effective_input_length": 96105, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96105, "latency_s": 5.5225436659529805, "output_length": 96, "proxy_request_id": "1266668:8:1292408:218", "request_id": "1266668:8:1292408:218", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1266668", "t_dispatch_unix": 1779814732.0601494, "t_finish_unix": 1779814737.5826929, "t_first_token_unix": 1779814736.7255695, "tpot_s": 0.009018225526118553, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12855425], "trace_timestamp_s": 189.6910000000007, "ttft_s": 4.66541805799352, "turn_id": 8} +{"actual_output_tokens": 45, "cached_tokens": 1184, "effective_input_length": 3709, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3709, "latency_s": 0.5317787930252962, "output_length": 45, "proxy_request_id": "1302449:2:1303563:277", "request_id": "1302449:2:1303563:277", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1302449", "t_dispatch_unix": 1779814737.374677, "t_finish_unix": 1779814737.906456, "t_first_token_unix": 1779814737.5777447, "tpot_s": 0.00746161163657565, "trace_hash_ids": [12952117, 12952118, 12962314, 12962315, 12962316, 12962317, 12962318, 12962319], "trace_timestamp_s": 228.26500000000033, "ttft_s": 0.20306579599855468, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 3065, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3065, "latency_s": 0.6286700110067613, "output_length": 46, "proxy_request_id": "1303651:1:1303651:278", "request_id": "1303651:1:1303651:278", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1303651", "t_dispatch_unix": 1779814737.6815736, "t_finish_unix": 1779814738.310244, "t_first_token_unix": 1779814737.929541, "tpot_s": 0.008452375400035331, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324], "trace_timestamp_s": 228.57200000000012, "ttft_s": 0.2479657439980656, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 96192, "effective_input_length": 96717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96717, "latency_s": 0.7997401040047407, "output_length": 35, "proxy_request_id": "1266668:9:1295576:231", "request_id": "1266668:9:1295576:231", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1266668", "t_dispatch_unix": 1779814737.5883787, "t_finish_unix": 1779814738.3881185, "t_first_token_unix": 1779814738.1204793, "tpot_s": 0.007865112559075522, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825], "trace_timestamp_s": 200.66200000000026, "ttft_s": 0.532098428986501, "turn_id": 9} +{"actual_output_tokens": 224, "cached_tokens": 0, "effective_input_length": 59507, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59507, "latency_s": 23.47475191502599, "output_length": 224, "proxy_request_id": "1297117:1:1297117:237", "request_id": "1297117:1:1297117:237", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1297117", "t_dispatch_unix": 1779814715.091637, "t_finish_unix": 1779814738.5663881, "t_first_token_unix": 1779814729.5221076, "tpot_s": 0.04055509023314066, "trace_hash_ids": [260868, 260869, 260870, 519720, 519721, 519722, 519723, 519724, 8258402, 8258403, 8258404, 8258405, 8258406, 8258407, 8258408, 8258409, 8258410, 8258411, 8258412, 8258413, 11600903, 407435, 11420699, 11420700, 11600904, 11600905, 11600906, 11600907, 11600908, 11600909, 11600910, 11600911, 11600912, 11600913, 11600914, 11600915, 11600916, 11600917, 11600918, 11600919, 11600920, 11600921, 11600922, 11600923, 11600924, 11600925, 11600926, 11600927, 11600928, 11600929, 11600930, 11600931, 11600932, 11600933, 11600934, 11600935, 11600936, 11600937, 11600938, 11600939, 11600940, 11600941, 11600942, 11600943, 11600944, 11600945, 11600946, 11600947, 11600948, 11600949, 11600950, 11600951, 11600952, 11600953, 11600954, 11600955, 11600956, 11600957, 11600958, 11600959, 11600960, 11600961, 11600962, 11600963, 11600964, 11600965, 11600966, 11600967, 11779968, 11779969, 11779970, 11888331, 11888332, 12280028, 12280029, 12280030, 12280031, 12280032, 12280033, 12280034, 12280035, 12280036, 12386666, 12386667, 12386668, 12386669, 12386670, 12480643, 12480644, 12480645, 12480646, 12480647, 12672549, 12672550, 12901437, 12901438, 12901439], "trace_timestamp_s": 205.96000000000004, "ttft_s": 14.430468350008596, "turn_id": 1} +{"actual_output_tokens": 224, "cached_tokens": 40768, "effective_input_length": 60193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60193, "latency_s": 22.970953903044574, "output_length": 224, "proxy_request_id": "1279412:7:1297236:238", "request_id": "1279412:7:1297236:238", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1279412", "t_dispatch_unix": 1779814715.615361, "t_finish_unix": 1779814738.5863144, "t_first_token_unix": 1779814734.2097108, "tpot_s": 0.019624556955096267, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12902561], "trace_timestamp_s": 206.4970000000003, "ttft_s": 18.594348139013164, "turn_id": 7} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 15081, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15081, "latency_s": 1.6730971259530634, "output_length": 61, "proxy_request_id": "1303517:1:1303517:275", "request_id": "1303517:1:1303517:275", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1303517", "t_dispatch_unix": 1779814737.2457561, "t_finish_unix": 1779814738.918853, "t_first_token_unix": 1779814738.5956542, "tpot_s": 0.00538277533390404, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12961789], "trace_timestamp_s": 228.1310000000003, "ttft_s": 1.3498968039639294, "turn_id": 1} +{"actual_output_tokens": 52, "cached_tokens": 26480, "effective_input_length": 30248, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30248, "latency_s": 1.2528768769698218, "output_length": 52, "proxy_request_id": "1302063:2:1303816:279", "request_id": "1302063:2:1303816:279", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1302063", "t_dispatch_unix": 1779814738.3522468, "t_finish_unix": 1779814739.6051235, "t_first_token_unix": 1779814739.2447498, "tpot_s": 0.007058472588302239, "trace_hash_ids": [12965292, 12965293, 12965294, 12965295, 12965296, 12965297, 12965298, 12965299, 12965300, 12965301, 12965302, 12965303, 12965304, 12965305, 12965306, 12965307, 12965308, 12965309, 12965310, 12965311, 12965312, 12965313, 12965314, 12965315, 12965316, 12965317, 12965318, 12965319, 12965320, 12965321, 12965322, 12965323, 12965324, 12965325, 12965326, 12965327, 12965328, 12965329, 12965330, 12965331, 12965332, 12965333, 12965334, 12965335, 12965336, 12965337, 12965338, 12965339, 12965340, 12965341, 12965342, 12965343, 12965344, 12965345, 12965346, 12965347, 12965348, 12965349, 12965350, 12965351], "trace_timestamp_s": 229.23100000000068, "ttft_s": 0.8925008099758998, "turn_id": 2} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 14944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14944, "latency_s": 2.525257554021664, "output_length": 54, "proxy_request_id": "1303462:1:1303462:274", "request_id": "1303462:1:1303462:274", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1303462", "t_dispatch_unix": 1779814737.0803568, "t_finish_unix": 1779814739.6056144, "t_first_token_unix": 1779814738.417609, "tpot_s": 0.022401504244936525, "trace_hash_ids": [12910193, 12910194, 12919198, 12919199, 12919200, 12919201, 12919202, 12919203, 12919204, 12928156, 12928157, 12928158, 12928159, 12928160, 12928161, 12928162, 12945250, 12945251, 12945252, 12945253, 12952336, 12952337, 12952338, 12952339, 12961346, 12961347, 12961348, 12961349, 12961350, 12961351], "trace_timestamp_s": 227.96600000000035, "ttft_s": 1.3372509520268068, "turn_id": 1} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 1300, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1300, "latency_s": 0.23742004903033376, "output_length": 30, "proxy_request_id": "1304239:1:1304239:280", "request_id": "1304239:1:1304239:280", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1304239", "t_dispatch_unix": 1779814739.8811617, "t_finish_unix": 1779814740.1185818, "t_first_token_unix": 1779814739.9773614, "tpot_s": 0.0048574569317961815, "trace_hash_ids": [12969576, 12969577, 12969578], "trace_timestamp_s": 230.77199999999993, "ttft_s": 0.09619891102192923, "turn_id": 1} +{"actual_output_tokens": 317, "cached_tokens": 25696, "effective_input_length": 30645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30645, "latency_s": 6.781139236991294, "output_length": 317, "proxy_request_id": "1294611:6:1302460:270", "request_id": "1294611:6:1302460:270", "request_type": "coder", "requested_output_tokens": 317, "session_id": "1294611", "t_dispatch_unix": 1779814733.7018259, "t_finish_unix": 1779814740.482965, "t_first_token_unix": 1779814737.6225321, "tpot_s": 0.009051049575968528, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210], "trace_timestamp_s": 224.59000000000015, "ttft_s": 3.9207042250200175, "turn_id": 6} +{"actual_output_tokens": 211, "cached_tokens": 60416, "effective_input_length": 60678, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60678, "latency_s": 2.3740600179880857, "output_length": 211, "proxy_request_id": "1279412:8:1300001:255", "request_id": "1279412:8:1300001:255", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1279412", "t_dispatch_unix": 1779814738.5897982, "t_finish_unix": 1779814740.9638581, "t_first_token_unix": 1779814738.8289347, "tpot_s": 0.010165183133323721, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12928377], "trace_timestamp_s": 215.70900000000074, "ttft_s": 0.2391338080051355, "turn_id": 8} +{"actual_output_tokens": 330, "cached_tokens": 25264, "effective_input_length": 25948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25948, "latency_s": 3.965168312948663, "output_length": 330, "proxy_request_id": "1290365:5:1300807:259", "request_id": "1290365:5:1300807:259", "request_type": "coder", "requested_output_tokens": 330, "session_id": "1290365", "t_dispatch_unix": 1779814737.3807998, "t_finish_unix": 1779814741.3459685, "t_first_token_unix": 1779814737.6247122, "tpot_s": 0.011310024927037634, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486, 12914159, 12936005, 12936006], "trace_timestamp_s": 218.67300000000068, "ttft_s": 0.24391045595984906, "turn_id": 5} +{"actual_output_tokens": 270, "cached_tokens": 96736, "effective_input_length": 97145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97145, "latency_s": 3.2331499540014192, "output_length": 270, "proxy_request_id": "1266668:10:1297641:241", "request_id": "1266668:10:1297641:241", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1266668", "t_dispatch_unix": 1779814738.3933434, "t_finish_unix": 1779814741.6264935, "t_first_token_unix": 1779814738.9080336, "tpot_s": 0.010104872390401089, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12905917], "trace_timestamp_s": 207.59799999999996, "ttft_s": 0.5146881869877689, "turn_id": 10} +{"actual_output_tokens": 30, "cached_tokens": 1328, "effective_input_length": 7798, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7798, "latency_s": 0.6270950399921276, "output_length": 30, "proxy_request_id": "1304239:2:1304866:281", "request_id": "1304239:2:1304866:281", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1304239", "t_dispatch_unix": 1779814742.032483, "t_finish_unix": 1779814742.659578, "t_first_token_unix": 1779814742.5120955, "tpot_s": 0.005075382965954085, "trace_hash_ids": [12969576, 12969577, 12975186, 12975187, 12975188, 12975189, 12975190, 12975191, 12975192, 12975193, 12975194, 12975195, 12975196, 12975197, 12975198, 12975199], "trace_timestamp_s": 232.91800000000057, "ttft_s": 0.47961186000611633, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 2772, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2772, "latency_s": 0.5164494380005635, "output_length": 60, "proxy_request_id": "1304943:1:1304943:283", "request_id": "1304943:1:1304943:283", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1304943", "t_dispatch_unix": 1779814742.2823973, "t_finish_unix": 1779814742.7988465, "t_first_token_unix": 1779814742.5008287, "tpot_s": 0.0050473662706928615, "trace_hash_ids": [12975642, 12975643, 12975644, 12975645, 12975646, 12975647], "trace_timestamp_s": 233.17200000000048, "ttft_s": 0.21843021700624377, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 49855, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49855, "latency_s": 10.153685776982456, "output_length": 81, "proxy_request_id": "1253743:3:1302294:268", "request_id": "1253743:3:1302294:268", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253743", "t_dispatch_unix": 1779814733.0635748, "t_finish_unix": 1779814743.2172606, "t_first_token_unix": 1779814742.4258413, "tpot_s": 0.009889563050091966, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12950606], "trace_timestamp_s": 223.95300000000043, "ttft_s": 9.362264962983318, "turn_id": 3} +{"actual_output_tokens": 200, "cached_tokens": 30960, "effective_input_length": 30995, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30995, "latency_s": 1.9119884769897908, "output_length": 200, "proxy_request_id": "1294611:6:1305080:284", "request_id": "1294611:6:1305080:284", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1294611", "t_dispatch_unix": 1779814742.7883406, "t_finish_unix": 1779814744.7003286, "t_first_token_unix": 1779814742.8748937, "tpot_s": 0.00917165864805396, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12976597], "trace_timestamp_s": 233.6790000000001, "ttft_s": 0.08655124600045383, "turn_id": 6} +{"actual_output_tokens": 308, "cached_tokens": 97408, "effective_input_length": 97811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97811, "latency_s": 3.6340948400320485, "output_length": 308, "proxy_request_id": "1266668:11:1300918:260", "request_id": "1266668:11:1300918:260", "request_type": "coder", "requested_output_tokens": 308, "session_id": "1266668", "t_dispatch_unix": 1779814741.6319563, "t_finish_unix": 1779814745.2660506, "t_first_token_unix": 1779814742.1644764, "tpot_s": 0.01010200404562056, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12937140, 12937141, 1592266], "trace_timestamp_s": 219.01100000000042, "ttft_s": 0.5325179170467891, "turn_id": 11} +{"actual_output_tokens": 660, "cached_tokens": 42384, "effective_input_length": 43181, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43181, "latency_s": 14.685109279002063, "output_length": 660, "proxy_request_id": "1260327:8:1301686:263", "request_id": "1260327:8:1301686:263", "request_type": "coder", "requested_output_tokens": 660, "session_id": "1260327", "t_dispatch_unix": 1779814730.6262746, "t_finish_unix": 1779814745.3113832, "t_first_token_unix": 1779814731.0108328, "tpot_s": 0.02169910762524402, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182, 12944584, 12944585], "trace_timestamp_s": 221.51600000000053, "ttft_s": 0.38455608498770744, "turn_id": 8} +{"actual_output_tokens": 109, "cached_tokens": 60880, "effective_input_length": 61291, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61291, "latency_s": 1.1921663579996675, "output_length": 109, "proxy_request_id": "1279412:9:1305633:286", "request_id": "1279412:9:1305633:286", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1279412", "t_dispatch_unix": 1779814744.952253, "t_finish_unix": 1779814746.1444197, "t_first_token_unix": 1779814745.3228552, "tpot_s": 0.007604890768696485, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330], "trace_timestamp_s": 235.84100000000035, "ttft_s": 0.3705993299954571, "turn_id": 9} +{"actual_output_tokens": 234, "cached_tokens": 54928, "effective_input_length": 59146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59146, "latency_s": 4.15348926698789, "output_length": 234, "proxy_request_id": "1269373:10:1304899:282", "request_id": "1269373:10:1304899:282", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1269373", "t_dispatch_unix": 1779814742.151493, "t_finish_unix": 1779814746.3049817, "t_first_token_unix": 1779814743.8145547, "tpot_s": 0.010687409909871754, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12975438], "trace_timestamp_s": 233.03900000000067, "ttft_s": 1.663051898998674, "turn_id": 10} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 12795, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12795, "latency_s": 1.1825172250391915, "output_length": 24, "proxy_request_id": "1303651:2:1305707:287", "request_id": "1303651:2:1305707:287", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1303651", "t_dispatch_unix": 1779814745.2229075, "t_finish_unix": 1779814746.4054248, "t_first_token_unix": 1779814746.2887108, "tpot_s": 0.005063412781885784, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324, 12971828, 12971829, 12971830, 12971831, 12971832, 12971833, 12976416, 12976417, 12976418, 12976419, 12976420, 12976421, 12982240, 12982241, 12982242, 12982243, 12982244, 12982245, 12982246], "trace_timestamp_s": 236.11000000000058, "ttft_s": 1.065800668031443, "turn_id": 2} +{"actual_output_tokens": 9, "cached_tokens": 14992, "effective_input_length": 18631, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18631, "latency_s": 0.5835289820097387, "output_length": 9, "proxy_request_id": "1303462:2:1306126:290", "request_id": "1303462:2:1306126:290", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1303462", "t_dispatch_unix": 1779814746.4498734, "t_finish_unix": 1779814747.0334022, "t_first_token_unix": 1779814747.0008307, "tpot_s": 0.00403778249892639, "trace_hash_ids": [12985881, 12985882, 12985883, 12985884, 12985885, 12985886, 12985887, 12985888, 12985889, 12985890, 12985891, 12985892, 12985893, 12985894, 12985895, 12985896, 12985897, 12985898, 12985899, 12985900, 12985901, 12985902, 12985903, 12985904, 12985905, 12985906, 12985907, 12985908, 12985909, 12985910, 12985911, 12985912, 12985913, 12985914, 12985915, 12985916, 12985917], "trace_timestamp_s": 237.33400000000074, "ttft_s": 0.5509557899786159, "turn_id": 2} +{"actual_output_tokens": 224, "cached_tokens": 18912, "effective_input_length": 18915, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18915, "latency_s": 1.9737917539896443, "output_length": 224, "proxy_request_id": "1299507:2:1305770:288", "request_id": "1299507:2:1305770:288", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1299507", "t_dispatch_unix": 1779814745.4161081, "t_finish_unix": 1779814747.3899, "t_first_token_unix": 1779814745.4748266, "tpot_s": 0.008585891587452987, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4629805, 12866561, 12923203, 12923204, 12923205, 12923206, 12923207, 12923208, 12923209, 12923210, 12923211, 12923212, 12923213, 12983096], "trace_timestamp_s": 236.3070000000007, "ttft_s": 0.05871615500655025, "turn_id": 2} +{"actual_output_tokens": 75, "cached_tokens": 0, "effective_input_length": 897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 897, "latency_s": 0.4662650710088201, "output_length": 75, "proxy_request_id": "1306347:1:1306347:291", "request_id": "1306347:1:1306347:291", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1306347", "t_dispatch_unix": 1779814747.2398932, "t_finish_unix": 1779814747.7061582, "t_first_token_unix": 1779814747.3437033, "tpot_s": 0.004894224824572637, "trace_hash_ids": [12988101, 12988102], "trace_timestamp_s": 238.1310000000003, "ttft_s": 0.1038090189686045, "turn_id": 1} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 14027, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14027, "latency_s": 2.248078688979149, "output_length": 183, "proxy_request_id": "1305906:1:1305906:289", "request_id": "1305906:1:1305906:289", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1305906", "t_dispatch_unix": 1779814745.8339813, "t_finish_unix": 1779814748.0820599, "t_first_token_unix": 1779814747.0527616, "tpot_s": 0.0056541082417275144, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 12984070], "trace_timestamp_s": 236.72000000000025, "ttft_s": 1.218779133982025, "turn_id": 1} +{"actual_output_tokens": 1838, "cached_tokens": 29696, "effective_input_length": 29948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29948, "latency_s": 15.099473895970732, "output_length": 1838, "proxy_request_id": "1272313:11:1302571:271", "request_id": "1272313:11:1302571:271", "request_type": "coder", "requested_output_tokens": 1838, "session_id": "1272313", "t_dispatch_unix": 1779814734.006384, "t_finish_unix": 1779814749.1058578, "t_first_token_unix": 1779814734.1412916, "tpot_s": 0.00814607673271792, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593, 12953259, 12953260], "trace_timestamp_s": 224.89600000000064, "ttft_s": 0.1349057229817845, "turn_id": 11} +{"actual_output_tokens": 64, "cached_tokens": 49920, "effective_input_length": 49975, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49975, "latency_s": 0.5751301320269704, "output_length": 64, "proxy_request_id": "1253743:4:1307058:295", "request_id": "1253743:4:1307058:295", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1253743", "t_dispatch_unix": 1779814749.7887447, "t_finish_unix": 1779814750.3638747, "t_first_token_unix": 1779814749.9144053, "tpot_s": 0.00713055654029761, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12995459], "trace_timestamp_s": 240.6780000000008, "ttft_s": 0.12565855897264555, "turn_id": 4} +{"actual_output_tokens": 524, "cached_tokens": 27312, "effective_input_length": 31058, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31058, "latency_s": 4.33023115497781, "output_length": 524, "proxy_request_id": "1277428:2:1306373:292", "request_id": "1277428:2:1306373:292", "request_type": "coder", "requested_output_tokens": 524, "session_id": "1277428", "t_dispatch_unix": 1779814747.346746, "t_finish_unix": 1779814751.6769772, "t_first_token_unix": 1779814748.2305565, "tpot_s": 0.006589162761094423, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395], "trace_timestamp_s": 238.2360000000008, "ttft_s": 0.883799941977486, "turn_id": 2} +{"actual_output_tokens": 155, "cached_tokens": 31184, "effective_input_length": 43378, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43378, "latency_s": 4.695049898000434, "output_length": 155, "proxy_request_id": "1294611:7:1306822:293", "request_id": "1294611:7:1306822:293", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1294611", "t_dispatch_unix": 1779814749.0571795, "t_finish_unix": 1779814753.752229, "t_first_token_unix": 1779814752.240059, "tpot_s": 0.009816999636384865, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800], "trace_timestamp_s": 239.9430000000002, "ttft_s": 3.1828778000199236, "turn_id": 7} +{"actual_output_tokens": 18, "cached_tokens": 0, "effective_input_length": 8729, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8729, "latency_s": 0.7352873720228672, "output_length": 18, "proxy_request_id": "1302449:3:1308121:299", "request_id": "1302449:3:1308121:299", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1302449", "t_dispatch_unix": 1779814753.5276237, "t_finish_unix": 1779814754.2629113, "t_first_token_unix": 1779814754.180112, "tpot_s": 0.004856778000590994, "trace_hash_ids": [13004569, 13004570, 13004571, 13004572, 13004573, 13004574, 13004575, 13004576, 13004577, 13004578, 13004579, 13004580, 13004581, 13004582, 13004583, 13004584, 13004585, 115654], "trace_timestamp_s": 244.41499999999996, "ttft_s": 0.6524866439867765, "turn_id": 3} +{"actual_output_tokens": 98, "cached_tokens": 61392, "effective_input_length": 61505, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61505, "latency_s": 0.9411166490172036, "output_length": 98, "proxy_request_id": "1279412:10:1308091:298", "request_id": "1279412:10:1308091:298", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1279412", "t_dispatch_unix": 1779814753.4308865, "t_finish_unix": 1779814754.3720028, "t_first_token_unix": 1779814753.613418, "tpot_s": 0.007817453206708827, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13004461], "trace_timestamp_s": 244.3130000000001, "ttft_s": 0.18252956098876894, "turn_id": 10} +{"actual_output_tokens": 504, "cached_tokens": 59376, "effective_input_length": 59446, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59446, "latency_s": 4.221390585007612, "output_length": 504, "proxy_request_id": "1269373:11:1307381:296", "request_id": "1269373:11:1307381:296", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1269373", "t_dispatch_unix": 1779814750.9569175, "t_finish_unix": 1779814755.1783078, "t_first_token_unix": 1779814751.1195257, "tpot_s": 0.008068569669931401, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 12998344], "trace_timestamp_s": 241.84600000000046, "ttft_s": 0.162605719990097, "turn_id": 11} +{"actual_output_tokens": 16, "cached_tokens": 12816, "effective_input_length": 22896, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22896, "latency_s": 1.6332618439919315, "output_length": 16, "proxy_request_id": "1303651:3:1308202:300", "request_id": "1303651:3:1308202:300", "request_type": "coder", "requested_output_tokens": 16, "session_id": "1303651", "t_dispatch_unix": 1779814753.7807217, "t_finish_unix": 1779814755.4139838, "t_first_token_unix": 1779814755.339733, "tpot_s": 0.00493064106364424, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324, 12971828, 12971829, 12971830, 12971831, 12971832, 12971833, 12976416, 12976417, 12976418, 12976419, 12976420, 12976421, 12982240, 12982241, 12982242, 12982243, 12982244, 12982245, 12982246, 12989553, 12989554, 12989555, 12989556, 12997676, 12997677, 12997678, 12997679, 12997680, 12997681, 12997682, 13005482, 13005483, 13005484, 13005485, 13005486, 13005487, 13005488, 13005489, 13005490], "trace_timestamp_s": 244.66800000000057, "ttft_s": 1.5590084280120209, "turn_id": 3} +{"actual_output_tokens": 96, "cached_tokens": 0, "effective_input_length": 4679, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4679, "latency_s": 0.7829691559891216, "output_length": 96, "proxy_request_id": "1309040:1:1309040:302", "request_id": "1309040:1:1309040:302", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1309040", "t_dispatch_unix": 1779814756.8991506, "t_finish_unix": 1779814757.6821198, "t_first_token_unix": 1779814757.1927438, "tpot_s": 0.005148208999736724, "trace_hash_ids": [13004558, 13004559, 13004560, 13004561, 13004562, 13013455, 13013456, 13013457, 13013458, 13013459], "trace_timestamp_s": 247.78800000000047, "ttft_s": 0.29359197401208803, "turn_id": 1} +{"actual_output_tokens": 176, "cached_tokens": 43520, "effective_input_length": 43710, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43710, "latency_s": 1.8726424680207856, "output_length": 176, "proxy_request_id": "1294611:8:1308970:301", "request_id": "1294611:8:1308970:301", "request_type": "coder", "requested_output_tokens": 176, "session_id": "1294611", "t_dispatch_unix": 1779814756.564585, "t_finish_unix": 1779814758.4372275, "t_first_token_unix": 1779814756.7332964, "tpot_s": 0.009734840662817337, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13012865], "trace_timestamp_s": 247.45400000000063, "ttft_s": 0.16870869899867103, "turn_id": 8} +{"actual_output_tokens": 2669, "cached_tokens": 0, "effective_input_length": 34706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34706, "latency_s": 30.372753232019022, "output_length": 2669, "proxy_request_id": "1301929:1:1301929:265", "request_id": "1301929:1:1301929:265", "request_type": "coder", "requested_output_tokens": 2669, "session_id": "1301929", "t_dispatch_unix": 1779814731.5813122, "t_finish_unix": 1779814761.954065, "t_first_token_unix": 1779814737.6198661, "tpot_s": 0.009120668801722518, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950], "trace_timestamp_s": 222.46100000000024, "ttft_s": 6.038552472018637, "turn_id": 1} +{"actual_output_tokens": 300, "cached_tokens": 0, "effective_input_length": 24545, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24545, "latency_s": 4.674457771005109, "output_length": 300, "proxy_request_id": "1309252:1:1309252:304", "request_id": "1309252:1:1309252:304", "request_type": "coder", "requested_output_tokens": 300, "session_id": "1309252", "t_dispatch_unix": 1779814757.7272012, "t_finish_unix": 1779814762.4016593, "t_first_token_unix": 1779814760.570493, "tpot_s": 0.006123509672104403, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13015384, 13015385, 13015386, 13015387, 13015388, 13015389, 13015390, 13015391, 13015392, 13015393, 13015394, 13015395, 13015396, 13015397, 13015398, 13015399, 13015400, 13015401, 13015402, 13015403, 13015404, 13015405, 13015406, 13015407, 13015408, 13015409, 13015410, 13015411], "trace_timestamp_s": 248.60900000000038, "ttft_s": 2.84328897803789, "turn_id": 1} +{"actual_output_tokens": 166, "cached_tokens": 61600, "effective_input_length": 64558, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64558, "latency_s": 2.697190855978988, "output_length": 166, "proxy_request_id": "1279412:11:1310014:305", "request_id": "1279412:11:1310014:305", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1279412", "t_dispatch_unix": 1779814760.3593075, "t_finish_unix": 1779814763.0564983, "t_first_token_unix": 1779814761.6938145, "tpot_s": 0.008256983127317983, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13022377], "trace_timestamp_s": 251.2470000000003, "ttft_s": 1.3345050549833104, "turn_id": 11} +{"actual_output_tokens": 85, "cached_tokens": 0, "effective_input_length": 18089, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18089, "latency_s": 2.286225949996151, "output_length": 85, "proxy_request_id": "1310590:1:1310590:306", "request_id": "1310590:1:1310590:306", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1310590", "t_dispatch_unix": 1779814762.310986, "t_finish_unix": 1779814764.5972116, "t_first_token_unix": 1779814764.1089985, "tpot_s": 0.0058092571430495895, "trace_hash_ids": [12996713, 12996714, 12996715, 12996716, 12996717, 12996718, 12996719, 12996720, 12996721, 12996722, 12996723, 12996724, 12996725, 12996726, 12996727, 12996728, 12996729, 12996730, 12996731, 12996732, 12996733, 12996734, 12996735, 12996736, 13016155, 13016156, 13016157, 13016158, 13016159, 13016160, 13027764, 13027765, 13027766, 13027767, 13027768, 13027769], "trace_timestamp_s": 253.19500000000062, "ttft_s": 1.7980108259944245, "turn_id": 1} +{"actual_output_tokens": 4192, "cached_tokens": 14208, "effective_input_length": 43607, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43607, "latency_s": 37.885828390019014, "output_length": 4192, "proxy_request_id": "1297811:2:1300578:258", "request_id": "1297811:2:1300578:258", "request_type": "coder", "requested_output_tokens": 4192, "session_id": "1297811", "t_dispatch_unix": 1779814726.924629, "t_finish_unix": 1779814764.810457, "t_first_token_unix": 1779814733.1393435, "tpot_s": 0.007556877964203681, "trace_hash_ids": [3411, 3412, 3413, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 2642723, 18908, 18909, 18910, 2642724, 1369412, 12886430, 12886431, 12907594, 12907595, 41662, 12933568, 12933569, 12933570, 12933571, 12933572, 12933573, 12933574, 12933575, 12933576, 12933577, 12933578, 12933579, 12933580, 12933581, 12933582, 12933583, 12933584, 12933585, 12933586, 12933587, 12933588, 12933589, 12933590, 12933591, 12933592, 12933593, 12933594, 12933595, 12933596, 12933597, 12933598, 12933599, 12933600, 12933601, 12933602, 12933603, 12933604, 12933605, 12933606, 12933607, 12933608, 12933609, 12933610, 12933611, 12933612, 12933613, 12933614, 12933615, 12933616, 12933617, 12933618, 12933619, 12933620, 12933621, 12933622, 12933623, 12933624, 12933625, 12933626], "trace_timestamp_s": 217.8030000000008, "ttft_s": 6.214711979031563, "turn_id": 2} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 13164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13164, "latency_s": 1.1542888699914329, "output_length": 12, "proxy_request_id": "1304943:2:1311189:307", "request_id": "1304943:2:1311189:307", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1304943", "t_dispatch_unix": 1779814764.443243, "t_finish_unix": 1779814765.5975323, "t_first_token_unix": 1779814765.5474563, "tpot_s": 0.004530362186911093, "trace_hash_ids": [12975642, 12975643, 12975644, 12975645, 12975646, 12982335, 12982336, 12991755, 12991756, 12991757, 12991758, 13001111, 13001112, 13001113, 13001114, 13008530, 13008531, 13008532, 13008533, 13008534, 13008535, 13016603, 13016604, 13016605, 13025488, 13033993], "trace_timestamp_s": 255.32999999999993, "ttft_s": 1.1042116469470784, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 7824, "effective_input_length": 13840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13840, "latency_s": 16.257025710016023, "output_length": 31, "proxy_request_id": "1304239:3:1307007:294", "request_id": "1304239:3:1307007:294", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1304239", "t_dispatch_unix": 1779814749.5930047, "t_finish_unix": 1779814765.8500304, "t_first_token_unix": 1779814764.3841896, "tpot_s": 0.04885074123352145, "trace_hash_ids": [12969576, 12969577, 12975186, 12975187, 12975188, 12975189, 12975190, 12975191, 12975192, 12975193, 12975194, 12975195, 12975196, 12975197, 12975198, 12980422, 12980423, 12980424, 12980425, 12980426, 12980427, 12980428, 12980429, 12987843, 12994759, 12994760, 12994761, 12994762], "trace_timestamp_s": 240.48100000000068, "ttft_s": 14.791183791996446, "turn_id": 3} +{"actual_output_tokens": 65, "cached_tokens": 15136, "effective_input_length": 23131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23131, "latency_s": 14.125032212003134, "output_length": 65, "proxy_request_id": "1303517:2:1307703:297", "request_id": "1303517:2:1307703:297", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1303517", "t_dispatch_unix": 1779814752.1177857, "t_finish_unix": 1779814766.2428179, "t_first_token_unix": 1779814765.5239184, "tpot_s": 0.011227653984860808, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13001399], "trace_timestamp_s": 243.0050000000001, "ttft_s": 13.406130882969592, "turn_id": 2} +{"actual_output_tokens": 75, "cached_tokens": 0, "effective_input_length": 75826, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75826, "latency_s": 22.33030916703865, "output_length": 75, "proxy_request_id": "1305420:1:1305420:285", "request_id": "1305420:1:1305420:285", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1305420", "t_dispatch_unix": 1779814744.039393, "t_finish_unix": 1779814766.369701, "t_first_token_unix": 1779814764.3940976, "tpot_s": 0.026694194553734583, "trace_hash_ids": [442944, 442945, 442946, 442947, 442948, 442949, 442950, 442951, 442952, 442953, 442954, 442955, 442956, 442957, 442958, 442959, 1172223, 1172224, 1172225, 1172226, 1172227, 1172228, 1172229, 4960061, 8457619, 8457620, 8457621, 8457622, 8457623, 8457624, 8457625, 8457626, 8457627, 8457628, 8457629, 8457630, 8457631, 8457632, 8457633, 8457634, 8457635, 8457636, 8457637, 8457638, 8457639, 8457640, 8457641, 8457642, 8457643, 8457644, 8457645, 8457646, 8457647, 8457648, 8457649, 8457650, 8457651, 8457652, 8457653, 8457654, 8457655, 8457656, 8457657, 8457658, 8457659, 8457660, 8457661, 8457662, 8457663, 8457664, 8457665, 8457666, 8457667, 8457668, 8457669, 8457670, 8457671, 8457672, 8457673, 8457674, 8457675, 8457676, 8457677, 8457678, 8457679, 8457680, 8457681, 8457682, 8457683, 9708906, 9708907, 9708908, 9708909, 9708910, 9708911, 9708912, 9708913, 9708914, 9708915, 9708916, 9708917, 9708918, 9708919, 9708920, 9708921, 9708922, 9708923, 10055928, 10055929, 10055930, 10055931, 10055932, 10055933, 10055934, 10055935, 10055936, 10055937, 10481518, 10481519, 10481520, 10481521, 10481522, 10481523, 10481524, 12979484, 12979485, 12979486, 12979487, 12979488, 12979489, 12979490, 12979491, 12979492, 12979493, 12979494, 12979495, 12979496, 12979497, 12979498, 12979499, 12979500, 12979501, 12979502, 12979503, 12979504, 12979505, 12979506, 12979507, 12979508], "trace_timestamp_s": 234.89900000000034, "ttft_s": 20.354703754012007, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 23184, "effective_input_length": 23259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23259, "latency_s": 0.15999326499877498, "output_length": 12, "proxy_request_id": "1303517:3:1309213:303", "request_id": "1303517:3:1309213:303", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1303517", "t_dispatch_unix": 1779814766.2439575, "t_finish_unix": 1779814766.4039507, "t_first_token_unix": 1779814766.330897, "tpot_s": 0.006623157093682411, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13015129], "trace_timestamp_s": 248.41400000000067, "ttft_s": 0.08693732798565179, "turn_id": 3} +{"actual_output_tokens": 31, "cached_tokens": 23264, "effective_input_length": 24638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24638, "latency_s": 0.49387646600371227, "output_length": 31, "proxy_request_id": "1303517:4:1311293:308", "request_id": "1303517:4:1311293:308", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1303517", "t_dispatch_unix": 1779814766.4054914, "t_finish_unix": 1779814766.8993685, "t_first_token_unix": 1779814766.7328923, "tpot_s": 0.0055399349327975266, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13021779, 13021780, 13034659, 13034660], "trace_timestamp_s": 255.64800000000014, "ttft_s": 0.32739897101419047, "turn_id": 4} +{"actual_output_tokens": 55, "cached_tokens": 31568, "effective_input_length": 31611, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31611, "latency_s": 0.938993715972174, "output_length": 55, "proxy_request_id": "1277428:3:1311644:311", "request_id": "1277428:3:1311644:311", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1277428", "t_dispatch_unix": 1779814766.065102, "t_finish_unix": 1779814767.0040956, "t_first_token_unix": 1779814766.6102173, "tpot_s": 0.007287842426362827, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512], "trace_timestamp_s": 256.9549999999999, "ttft_s": 0.5451124709798023, "turn_id": 3} +{"actual_output_tokens": 346, "cached_tokens": 0, "effective_input_length": 8996, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8996, "latency_s": 2.703943327011075, "output_length": 346, "proxy_request_id": "1258908:2:1311606:310", "request_id": "1258908:2:1311606:310", "request_type": "coder", "requested_output_tokens": 346, "session_id": "1258908", "t_dispatch_unix": 1779814765.8871465, "t_finish_unix": 1779814768.5910904, "t_first_token_unix": 1779814766.5623415, "tpot_s": 0.005879545721657358, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13037147, 13037148], "trace_timestamp_s": 256.77800000000025, "ttft_s": 0.6751935480278917, "turn_id": 2} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 20175, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20175, "latency_s": 2.310127837001346, "output_length": 33, "proxy_request_id": "1311753:1:1311753:312", "request_id": "1311753:1:1311753:312", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1311753", "t_dispatch_unix": 1779814766.4581344, "t_finish_unix": 1779814768.7682626, "t_first_token_unix": 1779814768.5987408, "tpot_s": 0.005289922155498061, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13038944], "trace_timestamp_s": 257.34200000000055, "ttft_s": 2.1406037930282764, "turn_id": 1} +{"actual_output_tokens": 178, "cached_tokens": 43872, "effective_input_length": 44335, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44335, "latency_s": 1.5377113139838912, "output_length": 178, "proxy_request_id": "1294611:9:1312398:313", "request_id": "1294611:9:1312398:313", "request_type": "coder", "requested_output_tokens": 178, "session_id": "1294611", "t_dispatch_unix": 1779814768.7396405, "t_finish_unix": 1779814770.2773516, "t_first_token_unix": 1779814769.0002108, "tpot_s": 0.0072138866947011465, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13044795], "trace_timestamp_s": 259.6290000000008, "ttft_s": 0.2605675950180739, "turn_id": 9} +{"actual_output_tokens": 9, "cached_tokens": 24656, "effective_input_length": 25637, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25637, "latency_s": 0.3403657709714025, "output_length": 9, "proxy_request_id": "1303517:5:1313040:317", "request_id": "1303517:5:1313040:317", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1303517", "t_dispatch_unix": 1779814770.8051276, "t_finish_unix": 1779814771.1454935, "t_first_token_unix": 1779814771.1172006, "tpot_s": 0.003501218125165906, "trace_hash_ids": [13050284, 13050285, 13050286, 13050287, 13050288, 13050289, 13050290, 13050291, 13050292, 13050293, 13050294, 13050295, 13050296, 13050297, 13050298, 13050299, 13050300, 13050301, 13050302, 13050303, 13050304, 13050305, 13050306, 13050307, 13050308, 13050309, 13050310, 13050311, 13050312, 13050313, 13050314, 13050315, 13050316, 13050317, 13050318, 13050319, 13050320, 13050321, 13050322, 13050323, 13050324, 13050325, 13050326, 13050327, 13050328, 13050329, 13050330, 13050331, 13050332, 13050333, 13050334], "trace_timestamp_s": 261.6860000000006, "ttft_s": 0.3120707380003296, "turn_id": 5} +{"actual_output_tokens": 99, "cached_tokens": 960, "effective_input_length": 13360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13360, "latency_s": 1.6396210449747741, "output_length": 99, "proxy_request_id": "1306347:2:1312642:314", "request_id": "1306347:2:1312642:314", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1306347", "t_dispatch_unix": 1779814769.6344697, "t_finish_unix": 1779814771.2740905, "t_first_token_unix": 1779814770.7359967, "tpot_s": 0.0054881454288617385, "trace_hash_ids": [12988101, 12997381, 12997382, 12997383, 12997384, 13005782, 13011406, 13018410, 13018411, 13018412, 13033270, 13033271, 13033272, 13033273, 13033274, 13033275, 13033276, 13039898, 13046883, 13046884, 13046885, 13046886, 13046887, 13046888, 13046889, 13046890, 13046891], "trace_timestamp_s": 260.52000000000044, "ttft_s": 1.1015251679928042, "turn_id": 2} +{"actual_output_tokens": 198, "cached_tokens": 21968, "effective_input_length": 26885, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26885, "latency_s": 2.1996933449991047, "output_length": 198, "proxy_request_id": "1268861:4:1312689:315", "request_id": "1268861:4:1312689:315", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1268861", "t_dispatch_unix": 1779814769.8105814, "t_finish_unix": 1779814772.010275, "t_first_token_unix": 1779814770.777278, "tpot_s": 0.006257471614304533, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13047223], "trace_timestamp_s": 260.6890000000003, "ttft_s": 0.9666945019853301, "turn_id": 4} +{"actual_output_tokens": 96, "cached_tokens": 24832, "effective_input_length": 44792, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44792, "latency_s": 7.106847504968755, "output_length": 96, "proxy_request_id": "1309252:2:1311531:309", "request_id": "1309252:2:1311531:309", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1309252", "t_dispatch_unix": 1779814765.6537187, "t_finish_unix": 1779814772.7605662, "t_first_token_unix": 1779814770.5640063, "tpot_s": 0.023119032368872708, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13036739, 13036740, 13036741, 13036742, 13036743, 13036744, 13036745, 13036746, 13036747, 13036748, 13036749, 13036750, 13036751, 13036752, 13036753, 13036754, 13036755, 13036756, 13036757, 13036758, 13036759, 13036760, 13036761, 13036762, 13036763, 13036764, 13036765, 13036766, 13036767], "trace_timestamp_s": 256.53099999999995, "ttft_s": 4.910284617973957, "turn_id": 2} +{"actual_output_tokens": 109, "cached_tokens": 12800, "effective_input_length": 22686, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22686, "latency_s": 2.152893587015569, "output_length": 109, "proxy_request_id": "1313181:1:1313181:318", "request_id": "1313181:1:1313181:318", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1313181", "t_dispatch_unix": 1779814771.4210098, "t_finish_unix": 1779814773.5739033, "t_first_token_unix": 1779814772.9192185, "tpot_s": 0.006059650166813905, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13052042], "trace_timestamp_s": 262.308, "ttft_s": 1.4982067070086487, "turn_id": 1} +{"actual_output_tokens": 157, "cached_tokens": 64720, "effective_input_length": 64755, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64755, "latency_s": 1.415800501999911, "output_length": 157, "proxy_request_id": "1279412:12:1313518:319", "request_id": "1279412:12:1313518:319", "request_type": "coder", "requested_output_tokens": 157, "session_id": "1279412", "t_dispatch_unix": 1779814772.5380368, "t_finish_unix": 1779814773.9538372, "t_first_token_unix": 1779814772.683251, "tpot_s": 0.008143205237082349, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13054780], "trace_timestamp_s": 263.4270000000006, "ttft_s": 0.14521251601399854, "turn_id": 12} +{"actual_output_tokens": 372, "cached_tokens": 59936, "effective_input_length": 62840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62840, "latency_s": 4.925089367025066, "output_length": 372, "proxy_request_id": "1269373:12:1312836:316", "request_id": "1269373:12:1312836:316", "request_type": "coder", "requested_output_tokens": 372, "session_id": "1269373", "t_dispatch_unix": 1779814770.1703029, "t_finish_unix": 1779814775.0953918, "t_first_token_unix": 1779814771.7859173, "tpot_s": 0.00891976473844206, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13048674], "trace_timestamp_s": 261.0560000000005, "ttft_s": 1.6156115130288526, "turn_id": 12} +{"actual_output_tokens": 198, "cached_tokens": 44512, "effective_input_length": 45362, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45362, "latency_s": 1.8059302269830368, "output_length": 198, "proxy_request_id": "1294611:10:1314495:322", "request_id": "1294611:10:1314495:322", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1294611", "t_dispatch_unix": 1779814776.1965187, "t_finish_unix": 1779814778.0024486, "t_first_token_unix": 1779814776.5551455, "tpot_s": 0.007345486157231014, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13063311], "trace_timestamp_s": 267.08600000000024, "ttft_s": 0.358624704007525, "turn_id": 10} +{"actual_output_tokens": 98, "cached_tokens": 22784, "effective_input_length": 24306, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24306, "latency_s": 0.9223299029981717, "output_length": 98, "proxy_request_id": "1313181:2:1314940:323", "request_id": "1313181:2:1314940:323", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1313181", "t_dispatch_unix": 1779814777.6107824, "t_finish_unix": 1779814778.533112, "t_first_token_unix": 1779814777.9480941, "tpot_s": 0.0060286991335403595, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13067419], "trace_timestamp_s": 268.5010000000002, "ttft_s": 0.33731016103411093, "turn_id": 2} +{"actual_output_tokens": 2, "cached_tokens": 0, "effective_input_length": 7, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7, "latency_s": 0.020932908984832466, "output_length": 2, "proxy_request_id": "1315313:1:1315313:325", "request_id": "1315313:1:1315313:325", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1315313", "t_dispatch_unix": 1779814778.8451507, "t_finish_unix": 1779814778.8660831, "t_first_token_unix": 1779814778.8614056, "tpot_s": 0.0044440149795264006, "trace_hash_ids": [37638], "trace_timestamp_s": 269.7360000000008, "ttft_s": 0.016254224989097565, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 18160, "effective_input_length": 32440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32440, "latency_s": 2.882856116979383, "output_length": 26, "proxy_request_id": "1310590:2:1315212:324", "request_id": "1310590:2:1315212:324", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1310590", "t_dispatch_unix": 1779814778.4898021, "t_finish_unix": 1779814781.372658, "t_first_token_unix": 1779814781.2307508, "tpot_s": 0.005664268080145121, "trace_hash_ids": [12996713, 12996714, 12996715, 12996716, 12996717, 12996718, 12996719, 12996720, 12996721, 12996722, 12996723, 12996724, 12996725, 12996726, 12996727, 12996728, 12996729, 12996730, 12996731, 12996732, 12996733, 12996734, 12996735, 12996736, 13016155, 13016156, 13016157, 13016158, 13016159, 13016160, 13027764, 13027765, 13027766, 13027767, 13027768, 13036928, 13036929, 13036930, 13036931, 13036932, 13036933, 13036934, 13036935, 13048761, 13048762, 13048763, 13048764, 13048765, 13048766, 13048767, 13048768, 13048769, 13048770, 13048771, 13048772, 13048773, 13060483, 13060484, 13060485, 13060486, 13060487, 13060488, 13060489, 13070580], "trace_timestamp_s": 269.3740000000007, "ttft_s": 2.7409458070178516, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 4768, "effective_input_length": 23097, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23097, "latency_s": 2.703541183960624, "output_length": 61, "proxy_request_id": "1309040:2:1315488:326", "request_id": "1309040:2:1315488:326", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1309040", "t_dispatch_unix": 1779814779.5632594, "t_finish_unix": 1779814782.2668002, "t_first_token_unix": 1779814781.9123333, "tpot_s": 0.005903825132797162, "trace_hash_ids": [13072947, 13072948, 13072949, 13072950, 13072951, 13072952, 13072953, 13072954, 13072955, 13072956, 13072957, 13072958, 13072959, 13072960, 13072961, 13072962, 13072963, 13072964, 13072965, 13072966, 13072967, 13072968, 13072969, 13072970, 13072971, 13072972, 13072973, 13072974, 13072975, 13072976, 13072977, 13072978, 13072979, 13072980, 13072981, 13072982, 13072983, 13072984, 13072985, 13072986, 13072987, 13072988, 13072989, 13072990, 13072991, 13072992], "trace_timestamp_s": 270.4440000000004, "ttft_s": 2.3490713060018606, "turn_id": 2} +{"actual_output_tokens": 528, "cached_tokens": 7680, "effective_input_length": 16960, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16960, "latency_s": 4.181497493991628, "output_length": 528, "proxy_request_id": "1315567:1:1315567:327", "request_id": "1315567:1:1315567:327", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1315567", "t_dispatch_unix": 1779814779.831666, "t_finish_unix": 1779814784.0131633, "t_first_token_unix": 1779814780.9560463, "tpot_s": 0.005800458178365077, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13073863], "trace_timestamp_s": 270.71900000000005, "ttft_s": 1.1243784099933691, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 1024, "effective_input_length": 5985, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5985, "latency_s": 0.5243304049945436, "output_length": 37, "proxy_request_id": "1316848:1:1316848:331", "request_id": "1316848:1:1316848:331", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1316848", "t_dispatch_unix": 1779814784.1867452, "t_finish_unix": 1779814784.7110753, "t_first_token_unix": 1779814784.532658, "tpot_s": 0.0049487384175234995, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13085635], "trace_timestamp_s": 275.0750000000007, "ttft_s": 0.34591184998862445, "turn_id": 1} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 24487, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24487, "latency_s": 3.1091690469766036, "output_length": 50, "proxy_request_id": "1316201:1:1316201:329", "request_id": "1316201:1:1316201:329", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1316201", "t_dispatch_unix": 1779814782.0955367, "t_finish_unix": 1779814785.2047057, "t_first_token_unix": 1779814784.91885, "tpot_s": 0.005828569307020504, "trace_hash_ids": [79834, 1044525, 1044526, 1044527, 1044528, 1044529, 1044530, 2181165, 2181166, 2181167, 2181168, 2181169, 2181170, 2181171, 2181172, 2181173, 2181174, 2181175, 2181176, 2181177, 2181178, 2181179, 2181180, 2181181, 2181182, 2181183, 2181184, 11014457, 11014458, 9320, 11014459, 79866, 11014460, 13079135, 11014462, 11014463, 11014464, 11014465, 11014466, 11014467, 11014468, 11014469, 11014470, 11014471, 11014472, 11014473, 11014474, 11014475], "trace_timestamp_s": 272.97700000000077, "ttft_s": 2.8233111549634486, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 3441, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3441, "latency_s": 0.365736368985381, "output_length": 32, "proxy_request_id": "1317160:1:1317160:332", "request_id": "1317160:1:1317160:332", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1317160", "t_dispatch_unix": 1779814785.340489, "t_finish_unix": 1779814785.7062254, "t_first_token_unix": 1779814785.5544538, "tpot_s": 0.004887722387549377, "trace_hash_ids": [13073227, 13079093, 13088584, 13088585, 13088586, 13088587, 13088588], "trace_timestamp_s": 276.2300000000005, "ttft_s": 0.21396333101438358, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 6016, "effective_input_length": 6040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6040, "latency_s": 1.811484201985877, "output_length": 80, "proxy_request_id": "1316848:2:1317438:333", "request_id": "1316848:2:1317438:333", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1316848", "t_dispatch_unix": 1779814786.4209042, "t_finish_unix": 1779814788.2323883, "t_first_token_unix": 1779814786.4498487, "tpot_s": 0.022559215734665624, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13090822], "trace_timestamp_s": 277.3120000000008, "ttft_s": 0.028943497978616506, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 7440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7440, "latency_s": 0.6331509199808352, "output_length": 26, "proxy_request_id": "1317160:2:1317773:336", "request_id": "1317160:2:1317773:336", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1317160", "t_dispatch_unix": 1779814787.738885, "t_finish_unix": 1779814788.3720357, "t_first_token_unix": 1779814788.2496128, "tpot_s": 0.004886358119547367, "trace_hash_ids": [13073227, 13079093, 13088584, 13088585, 13088586, 13088587, 13093585, 13093586, 13093587, 13093588, 13093589, 13093590, 13093591, 13093592, 13093593], "trace_timestamp_s": 278.6280000000006, "ttft_s": 0.5107260649674572, "turn_id": 2} +{"actual_output_tokens": 90, "cached_tokens": 24528, "effective_input_length": 24768, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24768, "latency_s": 0.6525803370168433, "output_length": 90, "proxy_request_id": "1316201:2:1317776:337", "request_id": "1316201:2:1317776:337", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1316201", "t_dispatch_unix": 1779814787.756399, "t_finish_unix": 1779814788.408979, "t_first_token_unix": 1779814787.8722296, "tpot_s": 0.006027325955114924, "trace_hash_ids": [79834, 1044525, 1044526, 1044527, 1044528, 1044529, 1044530, 2181165, 2181166, 2181167, 2181168, 2181169, 2181170, 2181171, 2181172, 2181173, 2181174, 2181175, 2181176, 2181177, 2181178, 2181179, 2181180, 2181181, 2181182, 2181183, 2181184, 11014457, 11014458, 9320, 11014459, 79866, 11014460, 13079135, 11014462, 11014463, 11014464, 11014465, 11014466, 11014467, 11014468, 11014469, 11014470, 11014471, 11014472, 11014473, 11014474, 11014475, 13093608], "trace_timestamp_s": 278.64600000000064, "ttft_s": 0.11582844099029899, "turn_id": 2} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 5219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5219, "latency_s": 0.5549742639996111, "output_length": 44, "proxy_request_id": "1318031:1:1318031:338", "request_id": "1318031:1:1318031:338", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1318031", "t_dispatch_unix": 1779814788.40132, "t_finish_unix": 1779814788.9562938, "t_first_token_unix": 1779814788.7373168, "tpot_s": 0.005086980511022862, "trace_hash_ids": [13085657, 13085658, 13085659, 13085660, 13085661, 13090893, 13090894, 13090895, 13095689, 13095690, 13095691], "trace_timestamp_s": 279.28999999999996, "ttft_s": 0.3359961310052313, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 2696, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2696, "latency_s": 0.6522162379696965, "output_length": 97, "proxy_request_id": "1318036:1:1318036:339", "request_id": "1318036:1:1318036:339", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1318036", "t_dispatch_unix": 1779814788.405734, "t_finish_unix": 1779814789.0579503, "t_first_token_unix": 1779814788.5750186, "tpot_s": 0.005028165885354004, "trace_hash_ids": [13077094, 13085876, 13085877, 13085878, 13085879, 13095707], "trace_timestamp_s": 279.2960000000003, "ttft_s": 0.1692835179856047, "turn_id": 1} +{"actual_output_tokens": 241, "cached_tokens": 3584, "effective_input_length": 57051, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57051, "latency_s": 14.508809437975287, "output_length": 241, "proxy_request_id": "1314357:1:1314357:321", "request_id": "1314357:1:1314357:321", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1314357", "t_dispatch_unix": 1779814775.7339628, "t_finish_unix": 1779814790.2427714, "t_first_token_unix": 1779814787.47475, "tpot_s": 0.011531775112477287, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13062231, 13062232], "trace_timestamp_s": 266.60400000000027, "ttft_s": 11.740785269008484, "turn_id": 1} +{"actual_output_tokens": 307, "cached_tokens": 64896, "effective_input_length": 64949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64949, "latency_s": 10.18373186798999, "output_length": 307, "proxy_request_id": "1279412:13:1315780:328", "request_id": "1279412:13:1315780:328", "request_type": "coder", "requested_output_tokens": 307, "session_id": "1279412", "t_dispatch_unix": 1779814780.6238077, "t_finish_unix": 1779814790.8075395, "t_first_token_unix": 1779814787.480962, "tpot_s": 0.010869664637093414, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834], "trace_timestamp_s": 271.5110000000004, "ttft_s": 6.857152821030468, "turn_id": 13} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 14412, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14412, "latency_s": 1.429872885986697, "output_length": 35, "proxy_request_id": "1318604:1:1318604:341", "request_id": "1318604:1:1318604:341", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1318604", "t_dispatch_unix": 1779814790.4479148, "t_finish_unix": 1779814791.877787, "t_first_token_unix": 1779814791.6963358, "tpot_s": 0.005330057323376155, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13101221], "trace_timestamp_s": 281.33400000000074, "ttft_s": 1.2484199940226972, "turn_id": 1} +{"actual_output_tokens": 470, "cached_tokens": 63200, "effective_input_length": 66135, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66135, "latency_s": 5.398282088979613, "output_length": 470, "proxy_request_id": "1269373:13:1317516:334", "request_id": "1269373:13:1317516:334", "request_type": "coder", "requested_output_tokens": 470, "session_id": "1269373", "t_dispatch_unix": 1779814786.6754985, "t_finish_unix": 1779814792.0737805, "t_first_token_unix": 1779814788.0323331, "tpot_s": 0.008616458586375438, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13091422], "trace_timestamp_s": 277.5630000000001, "ttft_s": 1.3568324449588545, "turn_id": 13} +{"actual_output_tokens": 54, "cached_tokens": 6112, "effective_input_length": 6298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6298, "latency_s": 0.42714775900822133, "output_length": 54, "proxy_request_id": "1316848:3:1318975:343", "request_id": "1316848:3:1318975:343", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1316848", "t_dispatch_unix": 1779814791.8208508, "t_finish_unix": 1779814792.2479987, "t_first_token_unix": 1779814791.8908558, "tpot_s": 0.006732736093668654, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13104212], "trace_timestamp_s": 282.71200000000044, "ttft_s": 0.07000381703255698, "turn_id": 3} +{"actual_output_tokens": 35, "cached_tokens": 14432, "effective_input_length": 15745, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15745, "latency_s": 0.42709644697606564, "output_length": 35, "proxy_request_id": "1318604:2:1319895:347", "request_id": "1318604:2:1319895:347", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1318604", "t_dispatch_unix": 1779814794.9583218, "t_finish_unix": 1779814795.3854184, "t_first_token_unix": 1779814795.2049677, "tpot_s": 0.005300054441356812, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13112541], "trace_timestamp_s": 285.82900000000063, "ttft_s": 0.24664326995844021, "turn_id": 2} +{"actual_output_tokens": 326, "cached_tokens": 65248, "effective_input_length": 71854, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71854, "latency_s": 5.83741255197674, "output_length": 326, "proxy_request_id": "1279412:14:1319059:344", "request_id": "1279412:14:1319059:344", "request_type": "coder", "requested_output_tokens": 326, "session_id": "1279412", "t_dispatch_unix": 1779814792.1728427, "t_finish_unix": 1779814798.010255, "t_first_token_unix": 1779814795.158526, "tpot_s": 0.00877371813546723, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13104852], "trace_timestamp_s": 283.058, "ttft_s": 2.985679989971686, "turn_id": 14} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 3099, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3099, "latency_s": 0.39031612302642316, "output_length": 40, "proxy_request_id": "1320630:1:1320630:348", "request_id": "1320630:1:1320630:348", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1320630", "t_dispatch_unix": 1779814797.7403922, "t_finish_unix": 1779814798.1307082, "t_first_token_unix": 1779814797.9364483, "tpot_s": 0.004974245384801179, "trace_hash_ids": [13120494, 13120495, 13120496, 13120497, 13120498, 13120499, 13120500], "trace_timestamp_s": 288.6300000000001, "ttft_s": 0.19605476298602298, "turn_id": 1} +{"actual_output_tokens": 302, "cached_tokens": 6336, "effective_input_length": 21140, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21140, "latency_s": 3.6707211050088517, "output_length": 302, "proxy_request_id": "1316848:4:1319820:345", "request_id": "1316848:4:1319820:345", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1316848", "t_dispatch_unix": 1779814794.727259, "t_finish_unix": 1779814798.3979795, "t_first_token_unix": 1779814796.5855744, "tpot_s": 0.006020494345521424, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13111733], "trace_timestamp_s": 285.6120000000001, "ttft_s": 1.858313626027666, "turn_id": 4} +{"actual_output_tokens": 41, "cached_tokens": 15776, "effective_input_length": 17883, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17883, "latency_s": 0.6124686340335757, "output_length": 41, "proxy_request_id": "1318604:3:1320865:350", "request_id": "1318604:3:1320865:350", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1318604", "t_dispatch_unix": 1779814798.5828192, "t_finish_unix": 1779814799.1952877, "t_first_token_unix": 1779814798.9773834, "tpot_s": 0.005441139799950178, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13122653, 13122654, 13122655, 13122656, 13122657], "trace_timestamp_s": 289.47200000000066, "ttft_s": 0.39456161903217435, "turn_id": 3} +{"actual_output_tokens": 3, "cached_tokens": 2672, "effective_input_length": 2677, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2677, "latency_s": 0.03472342697205022, "output_length": 3, "proxy_request_id": "1318036:2:1321282:353", "request_id": "1318036:2:1321282:353", "request_type": "coder", "requested_output_tokens": 3, "session_id": "1318036", "t_dispatch_unix": 1779814800.045423, "t_finish_unix": 1779814800.0801466, "t_first_token_unix": 1779814800.073819, "tpot_s": 0.0030068284831941128, "trace_hash_ids": [13126973, 13126974, 13126975, 13126976, 13126977, 13126978], "trace_timestamp_s": 290.9350000000004, "ttft_s": 0.028394441993441433, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 8095, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8095, "latency_s": 0.8759119220194407, "output_length": 60, "proxy_request_id": "1321042:1:1321042:351", "request_id": "1321042:1:1321042:351", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1321042", "t_dispatch_unix": 1779814799.234404, "t_finish_unix": 1779814800.110316, "t_first_token_unix": 1779814799.8037345, "tpot_s": 0.005192602338403527, "trace_hash_ids": [13106720, 13106721, 13114808, 13114809, 13114810, 13114811, 13114812, 13114813, 13114814, 13114815, 13124503, 13124504, 13124505, 13124506, 13124507, 13124508], "trace_timestamp_s": 290.1220000000003, "ttft_s": 0.5693284450098872, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 31664, "effective_input_length": 33906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33906, "latency_s": 1.4274841320002452, "output_length": 97, "proxy_request_id": "1277428:4:1321259:352", "request_id": "1277428:4:1321259:352", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1277428", "t_dispatch_unix": 1779814799.989821, "t_finish_unix": 1779814801.4173045, "t_first_token_unix": 1779814800.611838, "tpot_s": 0.00838717866705944, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13126544], "trace_timestamp_s": 290.8780000000006, "ttft_s": 0.6220148479915224, "turn_id": 4} +{"actual_output_tokens": 42, "cached_tokens": 17920, "effective_input_length": 21033, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21033, "latency_s": 0.7574713909998536, "output_length": 42, "proxy_request_id": "1318604:4:1321889:356", "request_id": "1318604:4:1321889:356", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1318604", "t_dispatch_unix": 1779814802.174325, "t_finish_unix": 1779814802.931796, "t_first_token_unix": 1779814802.700021, "tpot_s": 0.005646861219358426, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13122653, 13122654, 13122655, 13122656, 13122657, 13132633, 13132634, 13132635, 13132636, 13132637, 13132638, 13132639], "trace_timestamp_s": 293.0630000000001, "ttft_s": 0.5256942250416614, "turn_id": 4} +{"actual_output_tokens": 256, "cached_tokens": 66592, "effective_input_length": 66840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66840, "latency_s": 2.3969840810168535, "output_length": 256, "proxy_request_id": "1269373:14:1321512:354", "request_id": "1269373:14:1321512:354", "request_type": "coder", "requested_output_tokens": 256, "session_id": "1269373", "t_dispatch_unix": 1779814800.8233502, "t_finish_unix": 1779814803.2203343, "t_first_token_unix": 1779814801.0620928, "tpot_s": 0.008462773317553322, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13129270], "trace_timestamp_s": 291.71100000000024, "ttft_s": 0.23874017101479694, "turn_id": 14} +{"actual_output_tokens": 255, "cached_tokens": 72176, "effective_input_length": 72402, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72402, "latency_s": 2.489682678016834, "output_length": 255, "proxy_request_id": "1279412:15:1321613:355", "request_id": "1279412:15:1321613:355", "request_type": "coder", "requested_output_tokens": 255, "session_id": "1279412", "t_dispatch_unix": 1779814801.1567097, "t_finish_unix": 1779814803.6463923, "t_first_token_unix": 1779814801.4156897, "tpot_s": 0.008781188133715352, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13129897], "trace_timestamp_s": 292.0450000000001, "ttft_s": 0.2589781100396067, "turn_id": 15} +{"actual_output_tokens": 90, "cached_tokens": 21440, "effective_input_length": 21471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21471, "latency_s": 0.5803127210238017, "output_length": 90, "proxy_request_id": "1316848:5:1322192:357", "request_id": "1316848:5:1322192:357", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1316848", "t_dispatch_unix": 1779814803.3515825, "t_finish_unix": 1779814803.931895, "t_first_token_unix": 1779814803.4177232, "tpot_s": 0.005774435685330144, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116], "trace_timestamp_s": 294.2420000000002, "ttft_s": 0.06613872904563323, "turn_id": 5} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 8939, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8939, "latency_s": 0.9318892220035195, "output_length": 50, "proxy_request_id": "1322540:1:1322540:359", "request_id": "1322540:1:1322540:359", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1322540", "t_dispatch_unix": 1779814804.6352556, "t_finish_unix": 1779814805.5671444, "t_first_token_unix": 1779814805.309053, "tpot_s": 0.005261250387886729, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13138570], "trace_timestamp_s": 295.52300000000014, "ttft_s": 0.6737963770283386, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 11145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11145, "latency_s": 0.9458454929990694, "output_length": 12, "proxy_request_id": "1318031:2:1322552:360", "request_id": "1318031:2:1322552:360", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1318031", "t_dispatch_unix": 1779814804.6886637, "t_finish_unix": 1779814805.6345093, "t_first_token_unix": 1779814805.5851693, "tpot_s": 0.004461714817973023, "trace_hash_ids": [13138691, 13138692, 13138693, 13138694, 13138695, 13138696, 13138697, 13138698, 13138699, 13138700, 13138701, 13138702, 13138703, 13138704, 13138705, 13138706, 13138707, 13138708, 13138709, 13138710, 13138711, 13138712], "trace_timestamp_s": 295.5750000000007, "ttft_s": 0.8965039639733732, "turn_id": 2} +{"actual_output_tokens": 355, "cached_tokens": 7680, "effective_input_length": 54546, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54546, "latency_s": 13.096645982004702, "output_length": 355, "proxy_request_id": "1315567:2:1319894:346", "request_id": "1315567:2:1319894:346", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1315567", "t_dispatch_unix": 1779814794.952936, "t_finish_unix": 1779814808.0495813, "t_first_token_unix": 1779814805.2878873, "tpot_s": 0.007800683192053736, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13112465, 13112466, 13112467, 13112468, 13112469, 13112470, 13112471, 13112472, 13112473, 13112474, 13112475, 13112476, 13112477, 13112478, 13112479, 13112480, 13112481, 13112482, 13112483, 13112484, 13112485, 13112486, 13112487, 13112488, 13112489, 13112490, 13112491, 13112492, 13112493, 13112494, 13112495, 13112496, 13112497, 13112498, 13112499, 13112500, 13112501, 13112502, 13112503, 13112504, 13112505, 13112506, 13112507, 13112508, 13112509, 13112510, 13112511, 13112512, 13112513, 13112514, 13112515, 13112516, 13112517, 13112518, 13112519, 13112520, 13112521, 13112522, 13112523, 13112524, 13112525, 13112526, 13112527, 13112528, 13112529, 13112530, 13112531, 13112532, 13112533, 13112534, 13112535, 13112536, 13112537, 13112538], "trace_timestamp_s": 285.82800000000043, "ttft_s": 10.334948864998296, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 8976, "effective_input_length": 9016, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9016, "latency_s": 0.6462123740348034, "output_length": 25, "proxy_request_id": "1322540:2:1323519:362", "request_id": "1322540:2:1323519:362", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1322540", "t_dispatch_unix": 1779814807.9309123, "t_finish_unix": 1779814808.5771246, "t_first_token_unix": 1779814808.4223747, "tpot_s": 0.006435292957273002, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13147526], "trace_timestamp_s": 298.8220000000001, "ttft_s": 0.491461371013429, "turn_id": 2} +{"actual_output_tokens": 72, "cached_tokens": 8144, "effective_input_length": 13008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13008, "latency_s": 0.967744900030084, "output_length": 72, "proxy_request_id": "1321042:2:1323492:361", "request_id": "1321042:2:1323492:361", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1321042", "t_dispatch_unix": 1779814807.8618941, "t_finish_unix": 1779814808.829639, "t_first_token_unix": 1779814808.405996, "tpot_s": 0.00596360307068787, "trace_hash_ids": [13106720, 13106721, 13114808, 13114809, 13114810, 13114811, 13114812, 13114813, 13114814, 13114815, 13124503, 13124504, 13124505, 13124506, 13124507, 13132187, 13132188, 13132189, 13147309, 13147310, 13147311, 13147312, 13147313, 13147314, 13147315, 13147316], "trace_timestamp_s": 298.7510000000002, "ttft_s": 0.5441004380118102, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 21552, "effective_input_length": 24395, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24395, "latency_s": 1.1586351409787312, "output_length": 98, "proxy_request_id": "1316848:6:1323535:363", "request_id": "1316848:6:1323535:363", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1316848", "t_dispatch_unix": 1779814807.9790695, "t_finish_unix": 1779814809.1377044, "t_first_token_unix": 1779814808.554299, "tpot_s": 0.006011475144631047, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13147765], "trace_timestamp_s": 298.8690000000006, "ttft_s": 0.5752281629829668, "turn_id": 6} +{"actual_output_tokens": 52, "cached_tokens": 0, "effective_input_length": 11298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11298, "latency_s": 2.8336999880266376, "output_length": 52, "proxy_request_id": "1320630:2:1323748:364", "request_id": "1320630:2:1323748:364", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1320630", "t_dispatch_unix": 1779814808.7031355, "t_finish_unix": 1779814811.5368357, "t_first_token_unix": 1779814809.6046352, "tpot_s": 0.037881136843341164, "trace_hash_ids": [13120494, 13120495, 13120496, 13120497, 13120498, 13120499, 13127257, 13127258, 13135970, 13135971, 13135972, 13135973, 13135974, 13135975, 13143084, 13143085, 13143086, 13143087, 13143088, 13149788, 13149789, 13149790, 13149791], "trace_timestamp_s": 299.59100000000035, "ttft_s": 0.9014980909996666, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 14863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14863, "latency_s": 1.5719738089828752, "output_length": 46, "proxy_request_id": "1324227:1:1324227:367", "request_id": "1324227:1:1324227:367", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1324227", "t_dispatch_unix": 1779814810.4923337, "t_finish_unix": 1779814812.0643075, "t_first_token_unix": 1779814811.833521, "tpot_s": 0.005122306222458266, "trace_hash_ids": [13121168, 13121169, 13121170, 13121171, 13121172, 13121173, 13121174, 13121175, 13121176, 13121177, 13121178, 13121179, 13129551, 13129552, 13129553, 13129554, 13137620, 13137621, 13146223, 13146224, 13146225, 13146226, 13146227, 13155024, 13155025, 13155026, 13155027, 13155028, 13155029, 13155030], "trace_timestamp_s": 301.3780000000006, "ttft_s": 1.3411856789607555, "turn_id": 1} +{"actual_output_tokens": 282, "cached_tokens": 72656, "effective_input_length": 75624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75624, "latency_s": 4.841662122984417, "output_length": 282, "proxy_request_id": "1279412:16:1323780:365", "request_id": "1279412:16:1323780:365", "request_type": "coder", "requested_output_tokens": 282, "session_id": "1279412", "t_dispatch_unix": 1779814808.792451, "t_finish_unix": 1779814813.634113, "t_first_token_unix": 1779814811.065238, "tpot_s": 0.009140817840000303, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117], "trace_timestamp_s": 299.6800000000003, "ttft_s": 2.2727841419982724, "turn_id": 16} +{"actual_output_tokens": 103, "cached_tokens": 24480, "effective_input_length": 26994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26994, "latency_s": 1.1945353670162149, "output_length": 103, "proxy_request_id": "1316848:7:1325031:371", "request_id": "1316848:7:1325031:371", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1316848", "t_dispatch_unix": 1779814813.1536536, "t_finish_unix": 1779814814.3481889, "t_first_token_unix": 1779814813.7248304, "tpot_s": 0.006108151980465753, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13162818], "trace_timestamp_s": 304.0430000000006, "ttft_s": 0.5711749740294181, "turn_id": 7} +{"actual_output_tokens": 25, "cached_tokens": 9040, "effective_input_length": 12118, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12118, "latency_s": 0.4867216300335713, "output_length": 25, "proxy_request_id": "1322540:3:1325410:373", "request_id": "1322540:3:1325410:373", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1322540", "t_dispatch_unix": 1779814814.5288198, "t_finish_unix": 1779814815.0155418, "t_first_token_unix": 1779814814.8911014, "tpot_s": 0.005169944583030883, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13153725, 13153726, 13160450, 13160451, 13167028, 13167029, 13167030], "trace_timestamp_s": 305.41700000000037, "ttft_s": 0.3622796449926682, "turn_id": 3} +{"actual_output_tokens": 313, "cached_tokens": 0, "effective_input_length": 4312, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4312, "latency_s": 2.320845798996743, "output_length": 313, "proxy_request_id": "1324964:1:1324964:370", "request_id": "1324964:1:1324964:370", "request_type": "coder", "requested_output_tokens": 313, "session_id": "1324964", "t_dispatch_unix": 1779814812.9119716, "t_finish_unix": 1779814815.2328172, "t_first_token_unix": 1779814813.1822767, "tpot_s": 0.006571260346204209, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13162336], "trace_timestamp_s": 303.8010000000004, "ttft_s": 0.27030386502156034, "turn_id": 1} +{"actual_output_tokens": 772, "cached_tokens": 0, "effective_input_length": 79663, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79663, "latency_s": 28.895300865988247, "output_length": 772, "proxy_request_id": "1317598:1:1317598:335", "request_id": "1317598:1:1317598:335", "request_type": "coder", "requested_output_tokens": 772, "session_id": "1317598", "t_dispatch_unix": 1779814786.9767246, "t_finish_unix": 1779814815.8720255, "t_first_token_unix": 1779814808.7257712, "tpot_s": 0.00926840925809955, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044], "trace_timestamp_s": 277.83700000000044, "ttft_s": 21.749044748954475, "turn_id": 1} +{"actual_output_tokens": 4682, "cached_tokens": 98112, "effective_input_length": 121968, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121968, "latency_s": 71.50113275798503, "output_length": 4682, "proxy_request_id": "1266668:12:1303535:276", "request_id": "1266668:12:1303535:276", "request_type": "coder", "requested_output_tokens": 4682, "session_id": "1266668", "t_dispatch_unix": 1779814745.281487, "t_finish_unix": 1779814816.78262, "t_first_token_unix": 1779814761.2969165, "tpot_s": 0.011853313367016302, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12937140, 12937141, 12961861, 12961862, 12961863, 12961864, 12961865, 12961866, 12961867, 12961868, 12961869, 12961870, 12961871, 12961872, 12961873, 12961874, 12961875, 12961876, 12961877, 12961878, 12961879, 12961880, 12961881, 12961882, 12961883, 12961884, 12961885, 12961886, 12961887, 12961888, 12961889, 12961890, 12961891, 12961892, 12961893, 12961894, 12961895, 12961896, 12961897, 12961898, 12961899, 12961900, 12961901, 12961902, 12961903, 12961904, 12961905, 12961906, 12961907, 12961908], "trace_timestamp_s": 228.19700000000012, "ttft_s": 16.015426962985657, "turn_id": 12} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 1823, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1823, "latency_s": 0.31165711500216275, "output_length": 38, "proxy_request_id": "1325987:1:1325987:376", "request_id": "1325987:1:1325987:376", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1325987", "t_dispatch_unix": 1779814816.6230254, "t_finish_unix": 1779814816.9346826, "t_first_token_unix": 1779814816.7529118, "tpot_s": 0.004904624458553421, "trace_hash_ids": [13172375, 13172376, 13172377, 13172378], "trace_timestamp_s": 307.5129999999999, "ttft_s": 0.12988545797998086, "turn_id": 1} +{"actual_output_tokens": 100, "cached_tokens": 0, "effective_input_length": 9513, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9513, "latency_s": 1.2706411029794253, "output_length": 100, "proxy_request_id": "1326192:1:1326192:378", "request_id": "1326192:1:1326192:378", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1326192", "t_dispatch_unix": 1779814817.5014443, "t_finish_unix": 1779814818.7720852, "t_first_token_unix": 1779814818.2383573, "tpot_s": 0.0053885536464730825, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13174254], "trace_timestamp_s": 308.3890000000001, "ttft_s": 0.7369106049882248, "turn_id": 1} +{"actual_output_tokens": 305, "cached_tokens": 80432, "effective_input_length": 81220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81220, "latency_s": 3.4298046400072053, "output_length": 305, "proxy_request_id": "1317598:2:1324364:368", "request_id": "1317598:2:1324364:368", "request_type": "coder", "requested_output_tokens": 305, "session_id": "1317598", "t_dispatch_unix": 1779814815.8771036, "t_finish_unix": 1779814819.3069081, "t_first_token_unix": 1779814816.4846845, "tpot_s": 0.009282818250013454, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196], "trace_timestamp_s": 301.8890000000001, "ttft_s": 0.607578392024152, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 12128, "effective_input_length": 13249, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13249, "latency_s": 0.31516932498198, "output_length": 26, "proxy_request_id": "1322540:4:1326861:380", "request_id": "1322540:4:1326861:380", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1322540", "t_dispatch_unix": 1779814819.777633, "t_finish_unix": 1779814820.0928023, "t_first_token_unix": 1779814819.9641159, "tpot_s": 0.005131724239327014, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13153725, 13153726, 13160450, 13160451, 13167028, 13167029, 13180706, 13180707, 13180708], "trace_timestamp_s": 310.6680000000006, "ttft_s": 0.18648163898615167, "turn_id": 4} +{"actual_output_tokens": 69, "cached_tokens": 9600, "effective_input_length": 15253, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15253, "latency_s": 1.0734680779860355, "output_length": 69, "proxy_request_id": "1326192:2:1327234:381", "request_id": "1326192:2:1327234:381", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1326192", "t_dispatch_unix": 1779814821.060734, "t_finish_unix": 1779814822.1342018, "t_first_token_unix": 1779814821.756128, "tpot_s": 0.005555645779275116, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13183880, 13183881, 13183882, 13183883, 13183884, 13183885, 13183886, 13183887, 13183888, 13183889, 13183890, 13183891], "trace_timestamp_s": 311.9490000000005, "ttft_s": 0.695393037982285, "turn_id": 2} +{"actual_output_tokens": 88, "cached_tokens": 4624, "effective_input_length": 5146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5146, "latency_s": 0.9367031989968382, "output_length": 88, "proxy_request_id": "1324964:2:1327382:382", "request_id": "1324964:2:1327382:382", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1324964", "t_dispatch_unix": 1779814821.665359, "t_finish_unix": 1779814822.6020617, "t_first_token_unix": 1779814821.8288674, "tpot_s": 0.008883751574876964, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13184956], "trace_timestamp_s": 312.5560000000005, "ttft_s": 0.1635076419916004, "turn_id": 2} +{"actual_output_tokens": 42, "cached_tokens": 5232, "effective_input_length": 5234, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5234, "latency_s": 0.4045203470159322, "output_length": 42, "proxy_request_id": "1324964:3:1328499:384", "request_id": "1324964:3:1328499:384", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1324964", "t_dispatch_unix": 1779814825.6807678, "t_finish_unix": 1779814826.085288, "t_first_token_unix": 1779814825.7175758, "tpot_s": 0.008962272437823163, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13195781], "trace_timestamp_s": 316.5720000000001, "ttft_s": 0.03680684504797682, "turn_id": 3} +{"actual_output_tokens": 2884, "cached_tokens": 0, "effective_input_length": 33182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33182, "latency_s": 24.425953304977156, "output_length": 2884, "proxy_request_id": "1322225:1:1322225:358", "request_id": "1322225:1:1322225:358", "request_type": "coder", "requested_output_tokens": 2884, "session_id": "1322225", "t_dispatch_unix": 1779814803.4547555, "t_finish_unix": 1779814827.8807092, "t_first_token_unix": 1779814808.1236227, "tpot_s": 0.006852860179661275, "trace_hash_ids": [12158201, 426358, 11990609, 11990610, 5741838, 11990611, 5631170, 426364, 426365, 426366, 426367, 426368, 113957, 113958, 13135430, 9465731, 9465732, 9465733, 9465734, 9465735, 13135431, 13135432, 13135433, 13135434, 13135435, 13135436, 13135437, 13135438, 13135439, 13135440, 13135441, 13135442, 13135443, 13135444, 13135445, 13135446, 13135447, 13135448, 13135449, 13135450, 13135451, 13135452, 13135453, 13135454, 13135455, 13135456, 13135457, 13135458, 13135459, 13135460, 13135461, 13135462, 13135463, 13135464, 13135465, 13135466, 13135467, 13135468, 13135469, 13135470, 13135471, 13135472, 13135473, 13135474, 13135475], "trace_timestamp_s": 294.33300000000054, "ttft_s": 4.668865228013601, "turn_id": 1} +{"actual_output_tokens": 905, "cached_tokens": 75904, "effective_input_length": 81008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81008, "latency_s": 11.146535813983064, "output_length": 905, "proxy_request_id": "1279412:17:1326166:377", "request_id": "1279412:17:1326166:377", "request_type": "coder", "requested_output_tokens": 905, "session_id": "1279412", "t_dispatch_unix": 1779814817.3385415, "t_finish_unix": 1779814828.4850771, "t_first_token_unix": 1779814820.0145037, "tpot_s": 0.009369807024367887, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13174094], "trace_timestamp_s": 308.22500000000036, "ttft_s": 2.6759579979698174, "turn_id": 17} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 9292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9292, "latency_s": 1.0126617260393687, "output_length": 59, "proxy_request_id": "1329110:1:1329110:389", "request_id": "1329110:1:1329110:389", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1329110", "t_dispatch_unix": 1779814827.8933873, "t_finish_unix": 1779814828.9060488, "t_first_token_unix": 1779814828.5978658, "tpot_s": 0.005308610344996098, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13201495], "trace_timestamp_s": 318.78099999999995, "ttft_s": 0.7044772970257327, "turn_id": 1} +{"actual_output_tokens": 76, "cached_tokens": 5264, "effective_input_length": 5414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5414, "latency_s": 0.7584074350306764, "output_length": 76, "proxy_request_id": "1324964:4:1329201:390", "request_id": "1324964:4:1329201:390", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1324964", "t_dispatch_unix": 1779814828.2038453, "t_finish_unix": 1779814828.9622526, "t_first_token_unix": 1779814828.2637408, "tpot_s": 0.009309090866396825, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13202375], "trace_timestamp_s": 319.09500000000025, "ttft_s": 0.05989375204080716, "turn_id": 4} +{"actual_output_tokens": 40, "cached_tokens": 1856, "effective_input_length": 7423, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7423, "latency_s": 0.6255969990161248, "output_length": 40, "proxy_request_id": "1325987:2:1329336:391", "request_id": "1325987:2:1329336:391", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1325987", "t_dispatch_unix": 1779814828.741582, "t_finish_unix": 1779814829.3671787, "t_first_token_unix": 1779814829.1657367, "tpot_s": 0.005157663768981225, "trace_hash_ids": [13172375, 13172376, 13172377, 13189325, 13189326, 13189327, 13189328, 13189329, 13189330, 13203552, 13203553, 13203554, 13203555, 13203556, 13203557], "trace_timestamp_s": 319.6300000000001, "ttft_s": 0.42415327701019123, "turn_id": 2} +{"actual_output_tokens": 274, "cached_tokens": 0, "effective_input_length": 10847, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10847, "latency_s": 2.349312079953961, "output_length": 274, "proxy_request_id": "1329470:1:1329470:392", "request_id": "1329470:1:1329470:392", "request_type": "coder", "requested_output_tokens": 274, "session_id": "1329470", "t_dispatch_unix": 1779814829.227293, "t_finish_unix": 1779814831.576605, "t_first_token_unix": 1779814830.0895236, "tpot_s": 0.0054461429596643195, "trace_hash_ids": [13131336, 13131337, 13131338, 13142097, 13142098, 13142099, 13149758, 13149759, 13149760, 13149761, 13160564, 13160565, 13160566, 13160567, 13181977, 13181978, 13181979, 13181980, 13205182, 13205183, 13205184, 13205185], "trace_timestamp_s": 320.1140000000005, "ttft_s": 0.8622289689956233, "turn_id": 1} +{"actual_output_tokens": 41, "cached_tokens": 5488, "effective_input_length": 6691, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6691, "latency_s": 0.5546476260060444, "output_length": 41, "proxy_request_id": "1324964:5:1330169:397", "request_id": "1324964:5:1330169:397", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1324964", "t_dispatch_unix": 1779814831.5984879, "t_finish_unix": 1779814832.1531355, "t_first_token_unix": 1779814831.7945406, "tpot_s": 0.008955330775643233, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13211094, 13211095, 13211096, 13211097], "trace_timestamp_s": 322.4890000000005, "ttft_s": 0.19605137297185138, "turn_id": 5} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 66703, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66703, "latency_s": 17.340916188026313, "output_length": 37, "proxy_request_id": "1325541:1:1325541:374", "request_id": "1325541:1:1325541:374", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1325541", "t_dispatch_unix": 1779814815.1064858, "t_finish_unix": 1779814832.4474018, "t_first_token_unix": 1779814831.8142867, "tpot_s": 0.017579618167170945, "trace_hash_ids": [13148586, 13148587, 13148588, 13148589, 13148590, 13148591, 13148592, 13148593, 13148594, 13148595, 13148596, 13148597, 13148598, 13148599, 13148600, 13148601, 13148602, 13148603, 13148604, 13148605, 13148606, 13148607, 13148608, 13148609, 13148610, 13148611, 13148612, 13148613, 13148614, 13148615, 13148616, 13148617, 13148618, 13148619, 13148620, 13148621, 13148622, 13148623, 13148624, 13148625, 13148626, 13148627, 13148628, 13148629, 13148630, 13148631, 13148632, 13148633, 13148634, 13148635, 13148636, 13148637, 13148638, 13148639, 13148640, 13148641, 13148642, 13148643, 13148644, 13148645, 13148646, 13148647, 13148648, 13148649, 13148650, 13148651, 13148652, 13148653, 13148654, 13148655, 13148656, 13148657, 13148658, 13148659, 13148660, 13148661, 13148662, 13148663, 13148664, 13148665, 13148666, 13148667, 13148668, 13148669, 13148670, 13148671, 13148672, 13148673, 13148674, 13148675, 13148676, 13148677, 13148678, 13148679, 13148680, 13148681, 13148682, 13148683, 13148684, 13148685, 13148686, 13148687, 13148688, 13148689, 13148690, 13148691, 13148692, 13148693, 13148694, 13148695, 13148696, 13148697, 13148698, 13148699, 13148700, 13148701, 13148702, 13148703, 13148704, 13148705, 13148706, 13148707, 13148708, 13148709, 13148710, 13148711, 13168103, 13168104, 13168105, 13168106, 13168107], "trace_timestamp_s": 305.97200000000066, "ttft_s": 16.707797968003433, "turn_id": 1} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 36880, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36880, "latency_s": 5.982078974018805, "output_length": 59, "proxy_request_id": "1328753:1:1328753:387", "request_id": "1328753:1:1328753:387", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1328753", "t_dispatch_unix": 1779814826.638387, "t_finish_unix": 1779814832.6204655, "t_first_token_unix": 1779814832.245355, "tpot_s": 0.006463273172467497, "trace_hash_ids": [13155620, 13155621, 13155622, 13155623, 13155624, 13155625, 13155626, 13155627, 13155628, 13155629, 13155630, 13155631, 13155632, 13155633, 13155634, 13155635, 13155636, 13155637, 13155638, 13155639, 13155640, 13155641, 13155642, 13155643, 13155644, 13155645, 13155646, 13155647, 13155648, 13155649, 13155650, 13155651, 13155652, 13155653, 13155654, 13155655, 13155656, 13155657, 13155658, 13155659, 13155660, 13155661, 13155662, 13155663, 13155664, 13155665, 13155666, 13155667, 13155668, 13155669, 13155670, 13155671, 13155672, 13155673, 13155674, 13155675, 13155676, 13155677, 13155678, 13155679, 13155680, 13172041, 13182089, 13182090, 13182091, 13182092, 13182093, 13182094, 13182095, 13198580, 13198581, 13198582, 13198583], "trace_timestamp_s": 317.5010000000002, "ttft_s": 5.606965531012975, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 11725, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11725, "latency_s": 1.3982664379873313, "output_length": 83, "proxy_request_id": "1330130:1:1330130:396", "request_id": "1330130:1:1330130:396", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1330130", "t_dispatch_unix": 1779814831.4958525, "t_finish_unix": 1779814832.8941185, "t_first_token_unix": 1779814832.446685, "tpot_s": 0.0054534522925855635, "trace_hash_ids": [13186800, 13186801, 13186802, 13186803, 13186804, 13186805, 13186806, 13186807, 13186808, 13186809, 13186810, 13186811, 13186812, 13186813, 13197582, 13197583, 13197584, 13197585, 13197586, 13210629, 13210630, 13210631, 13210632], "trace_timestamp_s": 322.3830000000007, "ttft_s": 0.9508314349805005, "turn_id": 1} +{"actual_output_tokens": 69, "cached_tokens": 36928, "effective_input_length": 37007, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37007, "latency_s": 0.5552945960080251, "output_length": 69, "proxy_request_id": "1328753:2:1330033:395", "request_id": "1328753:2:1330033:395", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1328753", "t_dispatch_unix": 1779814832.622009, "t_finish_unix": 1779814833.1773038, "t_first_token_unix": 1779814832.727938, "tpot_s": 0.006604832353118314, "trace_hash_ids": [13155620, 13155621, 13155622, 13155623, 13155624, 13155625, 13155626, 13155627, 13155628, 13155629, 13155630, 13155631, 13155632, 13155633, 13155634, 13155635, 13155636, 13155637, 13155638, 13155639, 13155640, 13155641, 13155642, 13155643, 13155644, 13155645, 13155646, 13155647, 13155648, 13155649, 13155650, 13155651, 13155652, 13155653, 13155654, 13155655, 13155656, 13155657, 13155658, 13155659, 13155660, 13155661, 13155662, 13155663, 13155664, 13155665, 13155666, 13155667, 13155668, 13155669, 13155670, 13155671, 13155672, 13155673, 13155674, 13155675, 13155676, 13155677, 13155678, 13155679, 13155680, 13172041, 13182089, 13182090, 13182091, 13182092, 13182093, 13182094, 13182095, 13198580, 13198581, 13198582, 13209966], "trace_timestamp_s": 322.0010000000002, "ttft_s": 0.10592721001012251, "turn_id": 2} +{"actual_output_tokens": 72, "cached_tokens": 0, "effective_input_length": 3866, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3866, "latency_s": 0.6001855490030721, "output_length": 72, "proxy_request_id": "1330881:1:1330881:400", "request_id": "1330881:1:1330881:400", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1330881", "t_dispatch_unix": 1779814834.2569203, "t_finish_unix": 1779814834.857106, "t_first_token_unix": 1779814834.4990494, "tpot_s": 0.005038139548867573, "trace_hash_ids": [13217939, 13217940, 13217941, 13217942, 13217943, 13217944, 13217945, 13217946], "trace_timestamp_s": 325.14600000000064, "ttft_s": 0.24212769500445575, "turn_id": 1} +{"actual_output_tokens": 296, "cached_tokens": 27088, "effective_input_length": 28120, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28120, "latency_s": 17.137557295965962, "output_length": 296, "proxy_request_id": "1316848:8:1326380:379", "request_id": "1316848:8:1326380:379", "request_type": "coder", "requested_output_tokens": 296, "session_id": "1316848", "t_dispatch_unix": 1779814818.1109302, "t_finish_unix": 1779814835.2484875, "t_first_token_unix": 1779814831.817995, "tpot_s": 0.011627494284717398, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273], "trace_timestamp_s": 309.0010000000002, "ttft_s": 13.70706153998617, "turn_id": 8} +{"actual_output_tokens": 48, "cached_tokens": 15312, "effective_input_length": 25688, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25688, "latency_s": 2.042799264017958, "output_length": 48, "proxy_request_id": "1326192:3:1330643:399", "request_id": "1326192:3:1330643:399", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1326192", "t_dispatch_unix": 1779814833.3957882, "t_finish_unix": 1779814835.4385877, "t_first_token_unix": 1779814835.1711876, "tpot_s": 0.005683720999823368, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13183880, 13183881, 13183882, 13183883, 13183884, 13183885, 13183886, 13183887, 13183888, 13183889, 13183890, 13193351, 13193352, 13193353, 13193354, 13193355, 13200805, 13200806, 13200807, 13200808, 13200809, 13200810, 13200811, 13200812, 13200813, 13208998, 13208999, 13209000, 13215467, 13215468, 13215469, 13215470, 13215471], "trace_timestamp_s": 324.28200000000015, "ttft_s": 1.7753952990169637, "turn_id": 3} +{"actual_output_tokens": 57, "cached_tokens": 25728, "effective_input_length": 27049, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27049, "latency_s": 0.6915042150067165, "output_length": 57, "proxy_request_id": "1326192:4:1331370:401", "request_id": "1326192:4:1331370:401", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1326192", "t_dispatch_unix": 1779814836.0282469, "t_finish_unix": 1779814836.7197504, "t_first_token_unix": 1779814836.3913627, "tpot_s": 0.005859592035579096, "trace_hash_ids": [13222275, 13222276, 13222277, 13222278, 13222279, 13222280, 13222281, 13222282, 13222283, 13222284, 13222285, 13222286, 13222287, 13222288, 13222289, 13222290, 13222291, 13222292, 13222293, 13222294, 13222295, 13222296, 13222297, 13222298, 13222299, 13222300, 13222301, 13222302, 13222303, 13222304, 13222305, 13222306, 13222307, 13222308, 13222309, 13222310, 13222311, 13222312, 13222313, 13222314, 13222315, 13222316, 13222317, 13222318, 13222319, 13222320, 13222321, 13222322, 13222323, 13222324, 13222325, 13222326, 13222327], "trace_timestamp_s": 326.90800000000036, "ttft_s": 0.3631140579818748, "turn_id": 4} +{"actual_output_tokens": 68, "cached_tokens": 9344, "effective_input_length": 12781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12781, "latency_s": 0.7751446689944714, "output_length": 68, "proxy_request_id": "1329110:2:1331399:402", "request_id": "1329110:2:1331399:402", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1329110", "t_dispatch_unix": 1779814836.1072025, "t_finish_unix": 1779814836.8823476, "t_first_token_unix": 1779814836.5187955, "tpot_s": 0.005422687687070123, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13211079, 13211080, 13211081, 13211082, 13222555, 13222556, 13222557], "trace_timestamp_s": 326.9970000000003, "ttft_s": 0.41159146797144786, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 11792, "effective_input_length": 14067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14067, "latency_s": 0.4544462710036896, "output_length": 27, "proxy_request_id": "1330130:2:1331784:403", "request_id": "1330130:2:1331784:403", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1330130", "t_dispatch_unix": 1779814837.3013027, "t_finish_unix": 1779814837.7557487, "t_first_token_unix": 1779814837.6192973, "tpot_s": 0.005238810115350554, "trace_hash_ids": [13186800, 13186801, 13186802, 13186803, 13186804, 13186805, 13186806, 13186807, 13186808, 13186809, 13186810, 13186811, 13186812, 13186813, 13197582, 13197583, 13197584, 13197585, 13197586, 13210629, 13210630, 13210631, 13220514, 13226126, 13226127, 13226128, 13226129, 13226130], "trace_timestamp_s": 328.1910000000007, "ttft_s": 0.31799295800738037, "turn_id": 2} +{"actual_output_tokens": 14, "cached_tokens": 11120, "effective_input_length": 11766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11766, "latency_s": 0.2020265799947083, "output_length": 14, "proxy_request_id": "1329470:2:1332133:409", "request_id": "1329470:2:1332133:409", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1329470", "t_dispatch_unix": 1779814838.4593976, "t_finish_unix": 1779814838.661424, "t_first_token_unix": 1779814838.5996068, "tpot_s": 0.004734175078248462, "trace_hash_ids": [13131336, 13131337, 13131338, 13142097, 13142098, 13142099, 13149758, 13149759, 13149760, 13149761, 13160564, 13160565, 13160566, 13160567, 13181977, 13181978, 13181979, 13181980, 13205182, 13205183, 13205184, 13229764, 13229765], "trace_timestamp_s": 329.35000000000036, "ttft_s": 0.14020812802482396, "turn_id": 2} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 12421, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12421, "latency_s": 1.285026055003982, "output_length": 48, "proxy_request_id": "1332021:1:1332021:407", "request_id": "1332021:1:1332021:407", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1332021", "t_dispatch_unix": 1779814838.1006775, "t_finish_unix": 1779814839.3857036, "t_first_token_unix": 1779814839.1332388, "tpot_s": 0.005366198148855821, "trace_hash_ids": [29988, 29989, 29990, 29991, 29992, 29993, 29994, 29995, 29996, 29997, 29998, 29999, 30000, 12895103, 12895104, 12895105, 12895106, 12895107, 13045377, 13061172, 13096182, 13114659, 13149439, 13200204, 13228947], "trace_timestamp_s": 328.9870000000001, "ttft_s": 1.0325599610223435, "turn_id": 1} +{"actual_output_tokens": 13, "cached_tokens": 66736, "effective_input_length": 73234, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73234, "latency_s": 3.0748096630559303, "output_length": 13, "proxy_request_id": "1325541:2:1331846:404", "request_id": "1325541:2:1331846:404", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1325541", "t_dispatch_unix": 1779814837.496508, "t_finish_unix": 1779814840.5713174, "t_first_token_unix": 1779814840.4377344, "tpot_s": 0.011111890581863312, "trace_hash_ids": [13148586, 13148587, 13148588, 13148589, 13148590, 13148591, 13148592, 13148593, 13148594, 13148595, 13148596, 13148597, 13148598, 13148599, 13148600, 13148601, 13148602, 13148603, 13148604, 13148605, 13148606, 13148607, 13148608, 13148609, 13148610, 13148611, 13148612, 13148613, 13148614, 13148615, 13148616, 13148617, 13148618, 13148619, 13148620, 13148621, 13148622, 13148623, 13148624, 13148625, 13148626, 13148627, 13148628, 13148629, 13148630, 13148631, 13148632, 13148633, 13148634, 13148635, 13148636, 13148637, 13148638, 13148639, 13148640, 13148641, 13148642, 13148643, 13148644, 13148645, 13148646, 13148647, 13148648, 13148649, 13148650, 13148651, 13148652, 13148653, 13148654, 13148655, 13148656, 13148657, 13148658, 13148659, 13148660, 13148661, 13148662, 13148663, 13148664, 13148665, 13148666, 13148667, 13148668, 13148669, 13148670, 13148671, 13148672, 13148673, 13148674, 13148675, 13148676, 13148677, 13148678, 13148679, 13148680, 13148681, 13148682, 13148683, 13148684, 13148685, 13148686, 13148687, 13148688, 13148689, 13148690, 13148691, 13148692, 13148693, 13148694, 13148695, 13148696, 13148697, 13148698, 13148699, 13148700, 13148701, 13148702, 13148703, 13148704, 13148705, 13148706, 13148707, 13148708, 13148709, 13148710, 13148711, 13168103, 13168104, 13168105, 13168106, 13183375, 13195564, 13195565, 13195566, 13210778, 13210779, 13210780, 13210781, 13210782, 13210783, 13227100, 13227101, 13227102, 13227103], "trace_timestamp_s": 328.3820000000005, "ttft_s": 2.9412243960541673, "turn_id": 2} +{"actual_output_tokens": 140, "cached_tokens": 0, "effective_input_length": 1810, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1810, "latency_s": 0.8594310919870622, "output_length": 140, "proxy_request_id": "1332472:1:1332472:410", "request_id": "1332472:1:1332472:410", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1332472", "t_dispatch_unix": 1779814839.758446, "t_finish_unix": 1779814840.617877, "t_first_token_unix": 1779814839.9308329, "tpot_s": 0.004941073151241667, "trace_hash_ids": [13232681, 13232682, 13232683, 13232684], "trace_timestamp_s": 330.64900000000034, "ttft_s": 0.17238578898832202, "turn_id": 1} +{"actual_output_tokens": 552, "cached_tokens": 67088, "effective_input_length": 69041, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69041, "latency_s": 25.56222164898645, "output_length": 552, "proxy_request_id": "1269373:15:1325630:375", "request_id": "1269373:15:1325630:375", "request_type": "coder", "requested_output_tokens": 552, "session_id": "1269373", "t_dispatch_unix": 1779814815.364532, "t_finish_unix": 1779814840.9267535, "t_first_token_unix": 1779814831.8239212, "tpot_s": 0.016519123823876356, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187], "trace_timestamp_s": 306.2520000000004, "ttft_s": 16.45938722800929, "turn_id": 15} +{"actual_output_tokens": 260, "cached_tokens": 28400, "effective_input_length": 28615, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28615, "latency_s": 5.737941675004549, "output_length": 260, "proxy_request_id": "1316848:9:1328693:386", "request_id": "1316848:9:1328693:386", "request_type": "coder", "requested_output_tokens": 260, "session_id": "1316848", "t_dispatch_unix": 1779814835.2502418, "t_finish_unix": 1779814840.9881835, "t_first_token_unix": 1779814835.378367, "tpot_s": 0.021658410787677686, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13198070], "trace_timestamp_s": 317.28300000000036, "ttft_s": 0.1281230219756253, "turn_id": 9} +{"actual_output_tokens": 66, "cached_tokens": 12848, "effective_input_length": 13479, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13479, "latency_s": 1.2412652170169167, "output_length": 66, "proxy_request_id": "1329110:3:1332476:411", "request_id": "1329110:3:1332476:411", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1329110", "t_dispatch_unix": 1779814839.7822554, "t_finish_unix": 1779814841.0235207, "t_first_token_unix": 1779814840.525837, "tpot_s": 0.007650033707837932, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13211079, 13211080, 13211081, 13211082, 13222555, 13222556, 13222557, 13232695, 13232696], "trace_timestamp_s": 330.6730000000007, "ttft_s": 0.7435802930267528, "turn_id": 3} +{"actual_output_tokens": 187, "cached_tokens": 0, "effective_input_length": 21680, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21680, "latency_s": 3.661582012020517, "output_length": 187, "proxy_request_id": "1332013:1:1332013:406", "request_id": "1332013:1:1332013:406", "request_type": "coder", "requested_output_tokens": 187, "session_id": "1332013", "t_dispatch_unix": 1779814838.0835779, "t_finish_unix": 1779814841.7451599, "t_first_token_unix": 1779814840.4091296, "tpot_s": 0.007181233215090689, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 52726, 52727, 52728, 52729, 52730, 52731, 52732, 52733, 52734, 13228755, 13228756, 13228757, 13228758, 13228759, 13228760, 13228761, 13228762, 13228763], "trace_timestamp_s": 328.97100000000046, "ttft_s": 2.3255504479748197, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 19766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19766, "latency_s": 2.517022929037921, "output_length": 83, "proxy_request_id": "1332754:1:1332754:412", "request_id": "1332754:1:1332754:412", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1332754", "t_dispatch_unix": 1779814840.7834404, "t_finish_unix": 1779814843.3004634, "t_first_token_unix": 1779814842.8241997, "tpot_s": 0.005805026450926983, "trace_hash_ids": [13174116, 13174117, 13180993, 13180994, 13180995, 13180996, 13180997, 13180998, 13180999, 13190141, 13190142, 13190143, 13190144, 13190145, 13200026, 13200027, 13200028, 13200029, 13200030, 13200031, 13200032, 13206846, 13206847, 13206848, 13206849, 13206850, 13223085, 13223086, 13223087, 13223088, 13223089, 13223090, 13223091, 13235741, 13235742, 13235743, 13235744, 13235745, 13235746], "trace_timestamp_s": 331.66700000000037, "ttft_s": 2.0407575470162556, "turn_id": 1} +{"actual_output_tokens": 296, "cached_tokens": 81904, "effective_input_length": 82488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82488, "latency_s": 3.195201875991188, "output_length": 296, "proxy_request_id": "1279412:18:1332945:413", "request_id": "1279412:18:1332945:413", "request_type": "coder", "requested_output_tokens": 296, "session_id": "1279412", "t_dispatch_unix": 1779814841.6160984, "t_finish_unix": 1779814844.8112993, "t_first_token_unix": 1779814842.0850508, "tpot_s": 0.00924067107459404, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13237340], "trace_timestamp_s": 332.5, "ttft_s": 0.4689509669551626, "turn_id": 18} +{"actual_output_tokens": 300, "cached_tokens": 69584, "effective_input_length": 71777, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71777, "latency_s": 4.581052034976892, "output_length": 300, "proxy_request_id": "1269373:16:1331896:405", "request_id": "1269373:16:1331896:405", "request_type": "coder", "requested_output_tokens": 300, "session_id": "1269373", "t_dispatch_unix": 1779814840.9385312, "t_finish_unix": 1779814845.5195832, "t_first_token_unix": 1779814842.1278965, "tpot_s": 0.01134252217388011, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13227519], "trace_timestamp_s": 328.57800000000043, "ttft_s": 1.1893629300175235, "turn_id": 16} +{"actual_output_tokens": 468, "cached_tokens": 28864, "effective_input_length": 28977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28977, "latency_s": 5.629658997990191, "output_length": 468, "proxy_request_id": "1316848:10:1330509:398", "request_id": "1316848:10:1330509:398", "request_type": "coder", "requested_output_tokens": 468, "session_id": "1316848", "t_dispatch_unix": 1779814840.9906023, "t_finish_unix": 1779814846.6202612, "t_first_token_unix": 1779814842.1647136, "tpot_s": 0.009540246590938044, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13214124], "trace_timestamp_s": 323.7550000000001, "ttft_s": 1.1741096730111167, "turn_id": 10} +{"actual_output_tokens": 47, "cached_tokens": 29440, "effective_input_length": 29656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29656, "latency_s": 0.40322893200209364, "output_length": 47, "proxy_request_id": "1316848:11:1333994:416", "request_id": "1316848:11:1333994:416", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779814846.6219015, "t_finish_unix": 1779814847.0251307, "t_first_token_unix": 1779814846.7451382, "tpot_s": 0.0060811248473802825, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823], "trace_timestamp_s": 336.0480000000007, "ttft_s": 0.1232346860342659, "turn_id": 11} +{"actual_output_tokens": 98, "cached_tokens": 0, "effective_input_length": 23689, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23689, "latency_s": 3.27874067297671, "output_length": 98, "proxy_request_id": "1334223:1:1334223:417", "request_id": "1334223:1:1334223:417", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1334223", "t_dispatch_unix": 1779814846.02956, "t_finish_unix": 1779814849.3083, "t_first_token_unix": 1779814848.7167745, "tpot_s": 0.006095123391468846, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13248824, 13248825, 13248826, 13248827, 13248828], "trace_timestamp_s": 336.91200000000026, "ttft_s": 2.6872130010160618, "turn_id": 1} +{"actual_output_tokens": 130, "cached_tokens": 29696, "effective_input_length": 44664, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44664, "latency_s": 5.469955620006658, "output_length": 130, "proxy_request_id": "1316848:12:1334743:418", "request_id": "1316848:12:1334743:418", "request_type": "coder", "requested_output_tokens": 130, "session_id": "1316848", "t_dispatch_unix": 1779814847.9857922, "t_finish_unix": 1779814853.4557478, "t_first_token_unix": 1779814852.1606944, "tpot_s": 0.010036553186274227, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13254136], "trace_timestamp_s": 338.8700000000008, "ttft_s": 4.174900289974175, "turn_id": 12} +{"actual_output_tokens": 31, "cached_tokens": 3936, "effective_input_length": 11989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11989, "latency_s": 0.9035619419883005, "output_length": 31, "proxy_request_id": "1330881:2:1336222:422", "request_id": "1330881:2:1336222:422", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1330881", "t_dispatch_unix": 1779814853.1149702, "t_finish_unix": 1779814854.0185318, "t_first_token_unix": 1779814853.8640385, "tpot_s": 0.0051401563667847466, "trace_hash_ids": [13217939, 13217940, 13217941, 13217942, 13217943, 13217944, 13217945, 13226639, 13226640, 13226641, 13226642, 13226643, 13226644, 13238415, 13238416, 13238417, 13247360, 13247361, 13247362, 13258417, 13258418, 13258419, 13258420, 13266737], "trace_timestamp_s": 344.0030000000006, "ttft_s": 0.7490671190316789, "turn_id": 2} +{"actual_output_tokens": 219, "cached_tokens": 44880, "effective_input_length": 45601, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45601, "latency_s": 6.099455724004656, "output_length": 219, "proxy_request_id": "1309252:2:1334746:419", "request_id": "1309252:2:1334746:419", "request_type": "coder", "requested_output_tokens": 219, "session_id": "1309252", "t_dispatch_unix": 1779814847.9970398, "t_finish_unix": 1779814854.0964956, "t_first_token_unix": 1779814848.3720317, "tpot_s": 0.026257924133176923, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13254144, 13254145, 13254146, 13254147, 13254148, 13254149, 13254150, 13254151, 13254152, 13254153, 13254154, 13254155, 13254156, 13254157, 13254158, 13254159, 13254160, 13254161, 13254162, 13254163, 13254164, 13254165, 13254166, 13254167, 13254168, 13254169, 13254170, 13254171, 13254172, 13254173, 13254174], "trace_timestamp_s": 338.8730000000005, "ttft_s": 0.37497977196471766, "turn_id": 2} +{"actual_output_tokens": 209, "cached_tokens": 82768, "effective_input_length": 87264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87264, "latency_s": 5.889395214966498, "output_length": 209, "proxy_request_id": "1279412:19:1335444:421", "request_id": "1279412:19:1335444:421", "request_type": "coder", "requested_output_tokens": 209, "session_id": "1279412", "t_dispatch_unix": 1779814850.287588, "t_finish_unix": 1779814856.176983, "t_first_token_unix": 1779814853.4089365, "tpot_s": 0.013306237995353652, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13260063], "trace_timestamp_s": 341.1690000000008, "ttft_s": 3.121346084983088, "turn_id": 19} +{"actual_output_tokens": 241, "cached_tokens": 57280, "effective_input_length": 61229, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61229, "latency_s": 7.063660893996712, "output_length": 241, "proxy_request_id": "1314357:2:1335184:420", "request_id": "1314357:2:1335184:420", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1314357", "t_dispatch_unix": 1779814849.3613148, "t_finish_unix": 1779814856.4249759, "t_first_token_unix": 1779814850.968752, "tpot_s": 0.022732778149899484, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13257866], "trace_timestamp_s": 340.2470000000003, "ttft_s": 1.6074339440092444, "turn_id": 2} +{"actual_output_tokens": 169, "cached_tokens": 0, "effective_input_length": 14666, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14666, "latency_s": 2.2548430809983984, "output_length": 169, "proxy_request_id": "1336620:1:1336620:423", "request_id": "1336620:1:1336620:423", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1336620", "t_dispatch_unix": 1779814854.4167793, "t_finish_unix": 1779814856.671622, "t_first_token_unix": 1779814855.7186873, "tpot_s": 0.005670591238110016, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13270075], "trace_timestamp_s": 345.3050000000003, "ttft_s": 1.3019062699750066, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 12644, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12644, "latency_s": 1.2289856940042228, "output_length": 34, "proxy_request_id": "1337035:1:1337035:425", "request_id": "1337035:1:1337035:425", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1337035", "t_dispatch_unix": 1779814855.9133184, "t_finish_unix": 1779814857.1423032, "t_first_token_unix": 1779814856.9701006, "tpot_s": 0.005201596394534025, "trace_hash_ids": [13244966, 13244967, 13244968, 13251581, 13251582, 13251583, 13251584, 13251585, 13251586, 13259082, 13259083, 13259084, 13267038, 13267039, 13267040, 13267041, 13267042, 13267043, 13267044, 13267045, 13274119, 13274120, 13274121, 13274122, 13274123], "trace_timestamp_s": 346.7960000000003, "ttft_s": 1.0567817720002495, "turn_id": 1} +{"actual_output_tokens": 163, "cached_tokens": 81520, "effective_input_length": 81827, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81827, "latency_s": 30.900585892028175, "output_length": 163, "proxy_request_id": "1317598:3:1328678:385", "request_id": "1317598:3:1328678:385", "request_type": "coder", "requested_output_tokens": 163, "session_id": "1317598", "t_dispatch_unix": 1779814826.3481152, "t_finish_unix": 1779814857.2487001, "t_first_token_unix": 1779814826.7981052, "tpot_s": 0.18796384959865395, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980], "trace_timestamp_s": 317.2350000000006, "ttft_s": 0.4499874930479564, "turn_id": 3} +{"actual_output_tokens": 137, "cached_tokens": 0, "effective_input_length": 20009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20009, "latency_s": 2.860381554986816, "output_length": 137, "proxy_request_id": "1259178:2:1336768:424", "request_id": "1259178:2:1336768:424", "request_type": "coder", "requested_output_tokens": 137, "session_id": "1259178", "t_dispatch_unix": 1779814854.8812418, "t_finish_unix": 1779814857.7416234, "t_first_token_unix": 1779814856.9489617, "tpot_s": 0.0058265252279371075, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13271726], "trace_timestamp_s": 345.77000000000044, "ttft_s": 2.0677185659878887, "turn_id": 2} +{"actual_output_tokens": 40, "cached_tokens": 512, "effective_input_length": 90605, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90605, "latency_s": 28.286562968976796, "output_length": 40, "proxy_request_id": "1257323:2:1329541:393", "request_id": "1257323:2:1329541:393", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1257323", "t_dispatch_unix": 1779814829.6634545, "t_finish_unix": 1779814857.9500165, "t_first_token_unix": 1779814857.1728213, "tpot_s": 0.019915964152926628, "trace_hash_ids": [2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518, 46994, 46995, 46996, 46997, 46998, 46999, 47000, 47001, 47002, 47003, 47004, 47005, 47006, 47007, 47008, 47009, 47010, 47011, 47012, 4751454, 2379937, 2379938, 2379939, 2379940, 2379941, 4751455, 4751456, 4751457, 4751458, 4751459, 4751460, 4751461, 4751462, 4751463, 4751464, 4751465, 4751466, 4751467, 4751468, 4751469, 4751470, 4751471, 4751472, 4751473, 4751474, 4751475, 4751476, 4751477, 4751478, 4751479, 4751480, 4751481, 4751482, 4751483, 4751484, 4751485, 10670236, 10670237, 10670238, 10670239, 10670240, 10670241, 10670242, 10670243, 10670244, 10670245, 10670246, 10670247, 10670248, 10670249, 10670250, 10670251, 10670252, 10670253, 10670254, 10670255, 10670256, 10670257, 10670258, 10670259, 10670260, 10670261, 10994656, 10994657, 10994658, 10994659, 10994660, 10994661, 10994662, 10994663, 10994664, 10994665, 10994666, 10994667, 10994668, 10994669, 10994670, 10994671, 10994672, 10994673, 10994674, 10994675, 10994676, 10994677, 10994678, 10994679, 10994680, 10994681, 10994682, 10994683, 10994684, 10994685, 10994686, 10994687, 10994688, 10994689, 10994690, 10994691, 10994692, 10994693, 10994694, 10994695, 10994696, 10994697, 10994698, 10994699, 10994700, 10994701, 10994702, 10994703, 10994704, 10994705, 10994706, 10994707, 10994708, 10994709, 10994710, 10994711, 10994712, 10994713, 10994714, 10994715, 10994716, 10994717, 10994718, 10994719, 10994720, 10994721, 10994722, 10994723, 10994724, 10994725, 10994726, 10994727, 11134572, 11161915, 11261064, 11282181, 11360636, 11420052, 11420053, 11446131, 11701929, 12264742, 12297965, 12385798, 12385799, 12514819, 13206085], "trace_timestamp_s": 320.5510000000004, "ttft_s": 27.50936476100469, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 44784, "effective_input_length": 45005, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45005, "latency_s": 0.47661748103564605, "output_length": 47, "proxy_request_id": "1316848:13:1337519:427", "request_id": "1316848:13:1337519:427", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779814857.746123, "t_finish_unix": 1779814858.2227404, "t_first_token_unix": 1779814857.9488537, "tpot_s": 0.005948954521243096, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605], "trace_timestamp_s": 348.6350000000002, "ttft_s": 0.20272743504028767, "turn_id": 13} +{"actual_output_tokens": 142, "cached_tokens": 20144, "effective_input_length": 22398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22398, "latency_s": 1.2962235279846936, "output_length": 142, "proxy_request_id": "1259178:3:1337653:429", "request_id": "1259178:3:1337653:429", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1259178", "t_dispatch_unix": 1779814858.1916435, "t_finish_unix": 1779814859.4878674, "t_first_token_unix": 1779814858.6459725, "tpot_s": 0.005966563645505895, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13280050, 13280051, 13280052, 13280053, 13280054], "trace_timestamp_s": 349.08100000000013, "ttft_s": 0.45432662998791784, "turn_id": 3} +{"actual_output_tokens": 403, "cached_tokens": 27072, "effective_input_length": 34264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34264, "latency_s": 33.958491576020606, "output_length": 403, "proxy_request_id": "1268861:5:1329060:388", "request_id": "1268861:5:1329060:388", "request_type": "coder", "requested_output_tokens": 403, "session_id": "1268861", "t_dispatch_unix": 1779814827.7629614, "t_finish_unix": 1779814861.7214527, "t_first_token_unix": 1779814829.4135442, "tpot_s": 0.08036715960705222, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049], "trace_timestamp_s": 318.65000000000055, "ttft_s": 1.6505814630072564, "turn_id": 5} +{"actual_output_tokens": 489, "cached_tokens": 81984, "effective_input_length": 82142, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82142, "latency_s": 5.793317960982677, "output_length": 489, "proxy_request_id": "1317598:4:1332127:408", "request_id": "1317598:4:1332127:408", "request_type": "coder", "requested_output_tokens": 489, "session_id": "1317598", "t_dispatch_unix": 1779814857.256173, "t_finish_unix": 1779814863.0494905, "t_first_token_unix": 1779814857.5581884, "tpot_s": 0.011252160284875273, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753], "trace_timestamp_s": 329.33500000000004, "ttft_s": 0.3020134369726293, "turn_id": 4} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 9325, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9325, "latency_s": 3.285823215963319, "output_length": 24, "proxy_request_id": "1338292:1:1338292:432", "request_id": "1338292:1:1338292:432", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1338292", "t_dispatch_unix": 1779814860.3980026, "t_finish_unix": 1779814863.6838255, "t_first_token_unix": 1779814863.0015028, "tpot_s": 0.029654987999136843, "trace_hash_ids": [13265284, 13265285, 13265286, 13265287, 13265288, 13265289, 13265290, 13265291, 13265292, 13265293, 13265294, 13265295, 13273919, 13273920, 13286188, 13286189, 13286190, 13286191, 13286192], "trace_timestamp_s": 351.28500000000076, "ttft_s": 2.603499758988619, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 36518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36518, "latency_s": 6.998862349952105, "output_length": 34, "proxy_request_id": "1311753:2:1337278:426", "request_id": "1311753:2:1337278:426", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1311753", "t_dispatch_unix": 1779814856.7693372, "t_finish_unix": 1779814863.7681992, "t_first_token_unix": 1779814862.293932, "tpot_s": 0.04466319578932598, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13276135, 13276136, 13276137, 13276138, 13276139, 13276140, 13276141, 13276142, 13276143, 13276144, 13276145, 13276146, 13276147, 13276148, 13276149, 13276150, 13276151, 13276152, 13276153, 13276154, 13276155, 13276156, 13276157, 13276158, 13276159, 13276160, 13276161, 13276162, 13276163, 13276164, 13276165, 13276166, 13276167], "trace_timestamp_s": 347.65400000000045, "ttft_s": 5.524592699948698, "turn_id": 2} +{"actual_output_tokens": 65, "cached_tokens": 82624, "effective_input_length": 83088, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83088, "latency_s": 1.0015520020388067, "output_length": 65, "proxy_request_id": "1317598:5:1337780:430", "request_id": "1317598:5:1337780:430", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1317598", "t_dispatch_unix": 1779814863.053521, "t_finish_unix": 1779814864.055073, "t_first_token_unix": 1779814863.510483, "tpot_s": 0.008505481671818416, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753, 13281236, 13281237], "trace_timestamp_s": 349.5450000000001, "ttft_s": 0.4569596530054696, "turn_id": 5} +{"actual_output_tokens": 154, "cached_tokens": 14832, "effective_input_length": 14918, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14918, "latency_s": 3.8314991950173862, "output_length": 154, "proxy_request_id": "1336620:2:1338440:434", "request_id": "1336620:2:1338440:434", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1336620", "t_dispatch_unix": 1779814860.8080132, "t_finish_unix": 1779814864.6395125, "t_first_token_unix": 1779814863.0007534, "tpot_s": 0.010708423261758963, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13287309, 13287310], "trace_timestamp_s": 351.6980000000003, "ttft_s": 2.1927387039759196, "turn_id": 2} +{"actual_output_tokens": 271, "cached_tokens": 72064, "effective_input_length": 73073, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73073, "latency_s": 5.515929293003865, "output_length": 271, "proxy_request_id": "1269373:17:1338104:431", "request_id": "1269373:17:1338104:431", "request_type": "coder", "requested_output_tokens": 271, "session_id": "1269373", "t_dispatch_unix": 1779814859.8517363, "t_finish_unix": 1779814865.3676653, "t_first_token_unix": 1779814860.5207765, "tpot_s": 0.017950348559275478, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13284368], "trace_timestamp_s": 350.7370000000001, "ttft_s": 0.6690380979562178, "turn_id": 17} +{"actual_output_tokens": 397, "cached_tokens": 50032, "effective_input_length": 50215, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50215, "latency_s": 4.777099573984742, "output_length": 397, "proxy_request_id": "1253743:5:1338406:433", "request_id": "1253743:5:1338406:433", "request_type": "coder", "requested_output_tokens": 397, "session_id": "1253743", "t_dispatch_unix": 1779814860.7148917, "t_finish_unix": 1779814865.4919913, "t_first_token_unix": 1779814860.9074957, "tpot_s": 0.011575766744867034, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13287121, 13287122], "trace_timestamp_s": 351.60400000000027, "ttft_s": 0.19260198500705883, "turn_id": 5} +{"actual_output_tokens": 152, "cached_tokens": 87472, "effective_input_length": 95383, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95383, "latency_s": 8.407884132000618, "output_length": 152, "proxy_request_id": "1279412:20:1337591:428", "request_id": "1279412:20:1337591:428", "request_type": "coder", "requested_output_tokens": 152, "session_id": "1279412", "t_dispatch_unix": 1779814857.98881, "t_finish_unix": 1779814866.396694, "t_first_token_unix": 1779814862.5470295, "tpot_s": 0.025492568390863325, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13279440], "trace_timestamp_s": 348.8720000000003, "ttft_s": 4.55821610998828, "turn_id": 20} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 13816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13816, "latency_s": 1.386178266024217, "output_length": 37, "proxy_request_id": "1339977:1:1339977:442", "request_id": "1339977:1:1339977:442", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1339977", "t_dispatch_unix": 1779814866.452598, "t_finish_unix": 1779814867.8387764, "t_first_token_unix": 1779814867.6456552, "tpot_s": 0.0053563953325566314, "trace_hash_ids": [13245098, 13245099, 13245100, 13245101, 13253631, 13253632, 13253633, 13253634, 13253635, 13253636, 13266203, 13266204, 13266205, 13266206, 13266207, 13266208, 13273953, 13273954, 13280192, 13280193, 13280194, 13288772, 13288773, 13296702, 13296703, 13296704, 13302390], "trace_timestamp_s": 357.33800000000065, "ttft_s": 1.1930558960302733, "turn_id": 1} +{"actual_output_tokens": 6362, "cached_tokens": 54896, "effective_input_length": 55130, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55130, "latency_s": 54.19266646995675, "output_length": 6362, "proxy_request_id": "1315567:3:1325346:372", "request_id": "1315567:3:1325346:372", "request_type": "coder", "requested_output_tokens": 6362, "session_id": "1315567", "t_dispatch_unix": 1779814814.2955647, "t_finish_unix": 1779814868.488231, "t_first_token_unix": 1779814814.5166733, "tpot_s": 0.008484707878160762, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13112465, 13112466, 13112467, 13112468, 13112469, 13112470, 13112471, 13112472, 13112473, 13112474, 13112475, 13112476, 13112477, 13112478, 13112479, 13112480, 13112481, 13112482, 13112483, 13112484, 13112485, 13112486, 13112487, 13112488, 13112489, 13112490, 13112491, 13112492, 13112493, 13112494, 13112495, 13112496, 13112497, 13112498, 13112499, 13112500, 13112501, 13112502, 13112503, 13112504, 13112505, 13112506, 13112507, 13112508, 13112509, 13112510, 13112511, 13112512, 13112513, 13112514, 13112515, 13112516, 13112517, 13112518, 13112519, 13112520, 13112521, 13112522, 13112523, 13112524, 13112525, 13112526, 13112527, 13112528, 13112529, 13112530, 13112531, 13112532, 13112533, 13112534, 13112535, 13112536, 13112537, 13166089, 13166090], "trace_timestamp_s": 305.1810000000005, "ttft_s": 0.2211070609628223, "turn_id": 3} +{"actual_output_tokens": 230, "cached_tokens": 95520, "effective_input_length": 95543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95543, "latency_s": 3.3427848119754344, "output_length": 230, "proxy_request_id": "1279412:21:1339581:440", "request_id": "1279412:21:1339581:440", "request_type": "coder", "requested_output_tokens": 230, "session_id": "1279412", "t_dispatch_unix": 1779814866.4026642, "t_finish_unix": 1779814869.7454486, "t_first_token_unix": 1779814866.5762749, "tpot_s": 0.013838108022001827, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13298376], "trace_timestamp_s": 355.84200000000055, "ttft_s": 0.1736087339813821, "turn_id": 21} +{"actual_output_tokens": 547, "cached_tokens": 45040, "effective_input_length": 49688, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49688, "latency_s": 8.946187678026035, "output_length": 547, "proxy_request_id": "1316848:14:1338658:435", "request_id": "1316848:14:1338658:435", "request_type": "coder", "requested_output_tokens": 547, "session_id": "1316848", "t_dispatch_unix": 1779814861.630834, "t_finish_unix": 1779814870.5770214, "t_first_token_unix": 1779814863.1830935, "tpot_s": 0.01354149606404229, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13289620], "trace_timestamp_s": 352.51800000000003, "ttft_s": 1.5522574640344828, "turn_id": 14} +{"actual_output_tokens": 70, "cached_tokens": 0, "effective_input_length": 5280, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5280, "latency_s": 0.6918217649799772, "output_length": 70, "proxy_request_id": "1341005:1:1341005:447", "request_id": "1341005:1:1341005:447", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1341005", "t_dispatch_unix": 1779814869.924171, "t_finish_unix": 1779814870.6159925, "t_first_token_unix": 1779814870.2624953, "tpot_s": 0.005119946087622826, "trace_hash_ids": [13311826, 13311827, 13311828, 13311829, 13311830, 13311831, 13311832, 13311833, 13311834, 13311835, 13311836], "trace_timestamp_s": 360.8130000000001, "ttft_s": 0.33832262398209423, "turn_id": 1} +{"actual_output_tokens": 200, "cached_tokens": 0, "effective_input_length": 2279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2279, "latency_s": 1.1484675169922411, "output_length": 200, "proxy_request_id": "1340903:1:1340903:446", "request_id": "1340903:1:1340903:446", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1340903", "t_dispatch_unix": 1779814869.583725, "t_finish_unix": 1779814870.7321925, "t_first_token_unix": 1779814869.7288427, "tpot_s": 0.0050408469496093615, "trace_hash_ids": [13297157, 13304628, 13304629, 13311075, 13311076], "trace_timestamp_s": 360.47400000000016, "ttft_s": 0.1451167929917574, "turn_id": 1} +{"actual_output_tokens": 455, "cached_tokens": 45808, "effective_input_length": 45994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45994, "latency_s": 5.642478251014836, "output_length": 455, "proxy_request_id": "1309252:3:1339771:441", "request_id": "1309252:3:1339771:441", "request_type": "coder", "requested_output_tokens": 455, "session_id": "1309252", "t_dispatch_unix": 1779814865.6890104, "t_finish_unix": 1779814871.3314884, "t_first_token_unix": 1779814865.8685887, "tpot_s": 0.012032138574883826, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13254144, 13254145, 13300607, 13300608, 13300609, 13300610, 13300611, 13300612, 13300613, 13300614, 13300615, 13300616, 13300617, 13300618, 13300619, 13300620, 13300621, 13300622, 13300623, 13300624, 13300625, 13300626, 13300627, 13300628, 13300629, 13300630, 13300631, 13300632, 13300633, 13300634, 13300635], "trace_timestamp_s": 356.5730000000003, "ttft_s": 0.1795765749993734, "turn_id": 3} +{"actual_output_tokens": 293, "cached_tokens": 0, "effective_input_length": 21221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21221, "latency_s": 4.045986739976797, "output_length": 293, "proxy_request_id": "1340290:1:1340290:445", "request_id": "1340290:1:1340290:445", "request_type": "coder", "requested_output_tokens": 293, "session_id": "1340290", "t_dispatch_unix": 1779814867.5728383, "t_finish_unix": 1779814871.6188252, "t_first_token_unix": 1779814869.8467963, "tpot_s": 0.006067794157600362, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13305218], "trace_timestamp_s": 358.45600000000013, "ttft_s": 2.273954693984706, "turn_id": 1} +{"actual_output_tokens": 684, "cached_tokens": 22528, "effective_input_length": 24462, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24462, "latency_s": 8.21759104100056, "output_length": 684, "proxy_request_id": "1259178:4:1339295:439", "request_id": "1259178:4:1339295:439", "request_type": "coder", "requested_output_tokens": 684, "session_id": "1259178", "t_dispatch_unix": 1779814863.8685317, "t_finish_unix": 1779814872.086123, "t_first_token_unix": 1779814864.3098958, "tpot_s": 0.011385026019022937, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13280050, 13280051, 13280052, 13280053, 13280054, 13295757, 13295758, 13295759, 13295760], "trace_timestamp_s": 354.7580000000007, "ttft_s": 0.44136175099993125, "turn_id": 4} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 9909, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9909, "latency_s": 1.249543578014709, "output_length": 92, "proxy_request_id": "1341912:1:1341912:449", "request_id": "1341912:1:1341912:449", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1341912", "t_dispatch_unix": 1779814872.9606252, "t_finish_unix": 1779814874.2101688, "t_first_token_unix": 1779814873.726647, "tpot_s": 0.005310176999645901, "trace_hash_ids": [13307661, 13307662, 13307663, 13314126, 13314127, 13314128, 13314129, 13314130, 13314131, 13314132, 13314133, 13314134, 13314135, 13314136, 13314137, 13314138, 13319756, 13319757, 13319758, 13319759], "trace_timestamp_s": 363.84799999999996, "ttft_s": 0.7660194510244764, "turn_id": 1} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 6180, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6180, "latency_s": 0.7014040740323253, "output_length": 59, "proxy_request_id": "1342327:1:1342327:452", "request_id": "1342327:1:1342327:452", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1342327", "t_dispatch_unix": 1779814874.3829923, "t_finish_unix": 1779814875.0843961, "t_first_token_unix": 1779814874.7898057, "tpot_s": 0.005074417810678354, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13323580], "trace_timestamp_s": 365.27199999999993, "ttft_s": 0.4068113500252366, "turn_id": 1} +{"actual_output_tokens": 16, "cached_tokens": 2128, "effective_input_length": 2129, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2129, "latency_s": 0.08952601702185348, "output_length": 16, "proxy_request_id": "1340903:2:1342632:453", "request_id": "1340903:2:1342632:453", "request_type": "coder", "requested_output_tokens": 16, "session_id": "1340903", "t_dispatch_unix": 1779814875.4207807, "t_finish_unix": 1779814875.5103064, "t_first_token_unix": 1779814875.4506476, "tpot_s": 0.003961727733258158, "trace_hash_ids": [13326527, 13326528, 13326529, 13326530, 13326531], "trace_timestamp_s": 366.3110000000006, "ttft_s": 0.02986615599365905, "turn_id": 2} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 19887, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19887, "latency_s": 2.4594009009888396, "output_length": 45, "proxy_request_id": "1341948:1:1341948:450", "request_id": "1341948:1:1341948:450", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1341948", "t_dispatch_unix": 1779814873.0792382, "t_finish_unix": 1779814875.5386388, "t_first_token_unix": 1779814875.2093735, "tpot_s": 0.007476394341210835, "trace_hash_ids": [13296198, 13296199, 13296200, 13296201, 13296202, 13296203, 13296204, 13296205, 13296206, 13296207, 13296208, 13296209, 13296210, 13296211, 13296212, 13296213, 13296214, 13296215, 13296216, 13296217, 13296218, 13296219, 13296220, 13296221, 13296222, 13296223, 13296224, 13296225, 13296226, 13296227, 13296228, 13296229, 13296230, 13308586, 13308587, 13308588, 13308589, 13320340, 13320341], "trace_timestamp_s": 363.96200000000044, "ttft_s": 2.1301323020015843, "turn_id": 1} +{"actual_output_tokens": 114, "cached_tokens": 21376, "effective_input_length": 21380, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21380, "latency_s": 2.3454566100263037, "output_length": 114, "proxy_request_id": "1340290:2:1342119:451", "request_id": "1340290:2:1342119:451", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1340290", "t_dispatch_unix": 1779814873.6152081, "t_finish_unix": 1779814875.9606645, "t_first_token_unix": 1779814875.2115333, "tpot_s": 0.006627226309681856, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13321903], "trace_timestamp_s": 364.5060000000003, "ttft_s": 1.5963230510242283, "turn_id": 2} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 48381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48381, "latency_s": 9.358211475948337, "output_length": 81, "proxy_request_id": "1340278:1:1340278:444", "request_id": "1340278:1:1340278:444", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1340278", "t_dispatch_unix": 1779814867.5457978, "t_finish_unix": 1779814876.9040096, "t_first_token_unix": 1779814876.332261, "tpot_s": 0.007143395987804979, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13305070, 13305071, 13305072, 13305073, 13305074, 13305075, 13305076, 13305077, 13305078, 13305079, 13305080, 13305081, 13305082, 13305083, 13305084, 13305085, 13305086, 13305087, 13305088, 13305089, 13305090, 13305091, 13305092, 13305093, 13305094, 13305095, 13305096, 13305097, 13305098, 13305099, 13305100, 13305101, 13305102, 13305103, 13305104, 13305105, 13305106, 13305107, 13305108, 13305109, 13305110, 13305111, 13305112, 13305113, 13305114, 13305115, 13305116, 13305117, 13305118, 13305119, 13305120, 13305121, 13305122, 13305123, 13305124, 13305125, 13305126, 13305127, 13305128, 13305129, 13305130, 13305131, 13305132, 13305133, 13305134, 13305135, 13305136, 13305137, 13305138, 13305139, 13305140, 13305141, 13305142, 13305143, 13305144], "trace_timestamp_s": 358.4190000000008, "ttft_s": 8.786461133975536, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 5344, "effective_input_length": 9360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9360, "latency_s": 0.6743378429673612, "output_length": 55, "proxy_request_id": "1341005:2:1342961:456", "request_id": "1341005:2:1342961:456", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1341005", "t_dispatch_unix": 1779814876.586618, "t_finish_unix": 1779814877.2609558, "t_first_token_unix": 1779814876.9752235, "tpot_s": 0.005287064480836745, "trace_hash_ids": [13311826, 13311827, 13311828, 13311829, 13311830, 13311831, 13311832, 13311833, 13311834, 13311835, 13319583, 13319584, 13319585, 13329855, 13329856, 13329857, 13329858, 13329859, 13329860], "trace_timestamp_s": 367.47600000000057, "ttft_s": 0.38860421400750056, "turn_id": 2} +{"actual_output_tokens": 272, "cached_tokens": 23776, "effective_input_length": 37527, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37527, "latency_s": 5.8655125590157695, "output_length": 272, "proxy_request_id": "1334223:2:1341796:448", "request_id": "1334223:2:1341796:448", "request_type": "coder", "requested_output_tokens": 272, "session_id": "1334223", "t_dispatch_unix": 1779814872.525331, "t_finish_unix": 1779814878.3908436, "t_first_token_unix": 1779814875.5699341, "tpot_s": 0.010408375505443896, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13248824, 13248825, 13248826, 13248827, 13318839, 13318840, 13318841, 13318842, 13318843, 13318844, 13318845, 13318846, 13318847, 13318848, 13318849, 13318850, 13318851, 13318852, 13318853, 13318854, 13318855, 13318856, 13318857, 13318858, 13318859, 13318860, 13318861, 13318862, 13318863, 13318864, 13318865, 13318866], "trace_timestamp_s": 363.41000000000076, "ttft_s": 3.0446010809973814, "turn_id": 2} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 11912, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11912, "latency_s": 1.009918796014972, "output_length": 12, "proxy_request_id": "1343191:1:1343191:457", "request_id": "1343191:1:1343191:457", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1343191", "t_dispatch_unix": 1779814877.491407, "t_finish_unix": 1779814878.5013256, "t_first_token_unix": 1779814878.4510925, "tpot_s": 0.004546841818161986, "trace_hash_ids": [13317487, 13317488, 13317489, 13317490, 13317491, 13317492, 13317493, 13317494, 13317495, 13317496, 13317497, 13317498, 13317499, 13317500, 13317501, 13317502, 13317503, 13317504, 13317505, 13317506, 13324213, 13331765, 13331766, 13331767], "trace_timestamp_s": 368.3780000000006, "ttft_s": 0.9596841839957051, "turn_id": 1} +{"actual_output_tokens": 1409, "cached_tokens": 61456, "effective_input_length": 66152, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66152, "latency_s": 16.10007903102087, "output_length": 1409, "proxy_request_id": "1314357:3:1338999:437", "request_id": "1314357:3:1338999:437", "request_type": "coder", "requested_output_tokens": 1409, "session_id": "1314357", "t_dispatch_unix": 1779814862.8275676, "t_finish_unix": 1779814878.9276464, "t_first_token_unix": 1779814864.8897555, "tpot_s": 0.009969891404828311, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13292862, 13292863], "trace_timestamp_s": 353.71500000000015, "ttft_s": 2.062185936025344, "turn_id": 3} +{"actual_output_tokens": 14, "cached_tokens": 9344, "effective_input_length": 14103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14103, "latency_s": 0.6880394740146585, "output_length": 14, "proxy_request_id": "1338292:2:1343599:460", "request_id": "1338292:2:1343599:460", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1338292", "t_dispatch_unix": 1779814878.6971586, "t_finish_unix": 1779814879.3851976, "t_first_token_unix": 1779814879.2712185, "tpot_s": 0.008749079693538638, "trace_hash_ids": [13336050, 13336051, 13336052, 13336053, 13336054, 13336055, 13336056, 13336057, 13336058, 13336059, 13336060, 13336061, 13336062, 13336063, 13336064, 13336065, 13336066, 13336067, 13336068, 13336069, 13336070, 13336071, 13336072, 13336073, 13336074, 13336075, 13336076, 13336077], "trace_timestamp_s": 369.58300000000054, "ttft_s": 0.574058527010493, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 21402, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21402, "latency_s": 2.363292152003851, "output_length": 13, "proxy_request_id": "1343312:1:1343312:459", "request_id": "1343312:1:1343312:459", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1343312", "t_dispatch_unix": 1779814877.8538132, "t_finish_unix": 1779814880.2171054, "t_first_token_unix": 1779814880.163656, "tpot_s": 0.004432708670113546, "trace_hash_ids": [13332570, 13332571, 13332572, 13332573, 13332574, 13332575, 13332576, 13332577, 13332578, 13332579, 13332580, 13332581, 13332582, 13332583, 13332584, 13332585, 13332586, 13332587, 13332588, 13332589, 13332590, 13332591, 13332592, 13332593, 13332594, 13332595, 13332596, 13332597, 13332598, 13332599, 13332600, 13332601, 13332602, 13332603, 13332604, 13332605, 13332606, 13332607, 13332608, 13332609, 13332610, 13332611], "trace_timestamp_s": 368.7370000000001, "ttft_s": 2.3098407029756345, "turn_id": 1} +{"actual_output_tokens": 212, "cached_tokens": 95760, "effective_input_length": 95781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95781, "latency_s": 2.2582705629756674, "output_length": 212, "proxy_request_id": "1279412:22:1344210:462", "request_id": "1279412:22:1344210:462", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1279412", "t_dispatch_unix": 1779814880.7776437, "t_finish_unix": 1779814883.035914, "t_first_token_unix": 1779814880.9683394, "tpot_s": 0.00979767123212976, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13341145], "trace_timestamp_s": 371.66499999999996, "ttft_s": 0.19069384498288855, "turn_id": 22} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 505, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 505, "latency_s": 0.37653790501644835, "output_length": 67, "proxy_request_id": "1345921:1:1345921:469", "request_id": "1345921:1:1345921:469", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1345921", "t_dispatch_unix": 1779814886.6232667, "t_finish_unix": 1779814886.999805, "t_first_token_unix": 1779814886.6794837, "tpot_s": 0.004848593666930824, "trace_hash_ids": [13357030], "trace_timestamp_s": 377.5140000000001, "ttft_s": 0.0562154270010069, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 32816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32816, "latency_s": 4.661944599996787, "output_length": 25, "proxy_request_id": "1344773:1:1344773:465", "request_id": "1344773:1:1344773:465", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1344773", "t_dispatch_unix": 1779814882.7332354, "t_finish_unix": 1779814887.39518, "t_first_token_unix": 1779814887.2647288, "tpot_s": 0.005423086998537959, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13346692], "trace_timestamp_s": 373.59900000000016, "ttft_s": 4.5314899170189165, "turn_id": 1} +{"actual_output_tokens": 30, "cached_tokens": 32832, "effective_input_length": 33008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33008, "latency_s": 0.30370972998207435, "output_length": 30, "proxy_request_id": "1344773:2:1346419:473", "request_id": "1344773:2:1346419:473", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1344773", "t_dispatch_unix": 1779814888.488532, "t_finish_unix": 1779814888.7922418, "t_first_token_unix": 1779814888.624071, "tpot_s": 0.005789458791821681, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13361257], "trace_timestamp_s": 379.3780000000006, "ttft_s": 0.13553635799326003, "turn_id": 2} +{"actual_output_tokens": 45, "cached_tokens": 6224, "effective_input_length": 9820, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9820, "latency_s": 9.315176592965145, "output_length": 45, "proxy_request_id": "1342327:2:1343857:461", "request_id": "1342327:2:1343857:461", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1342327", "t_dispatch_unix": 1779814879.5195053, "t_finish_unix": 1779814888.8346815, "t_first_token_unix": 1779814888.4020767, "tpot_s": 0.009821949453908019, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13338087], "trace_timestamp_s": 370.40900000000056, "ttft_s": 8.882569795008749, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 9856, "effective_input_length": 12398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12398, "latency_s": 0.6174250039621256, "output_length": 28, "proxy_request_id": "1342327:3:1344788:466", "request_id": "1342327:3:1344788:466", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1342327", "t_dispatch_unix": 1779814888.836721, "t_finish_unix": 1779814889.454146, "t_first_token_unix": 1779814889.1761336, "tpot_s": 0.010284368517912097, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13346828, 13346829, 13346830, 13346831, 13346832, 13346833], "trace_timestamp_s": 373.65100000000075, "ttft_s": 0.3394111689995043, "turn_id": 3} +{"actual_output_tokens": 11, "cached_tokens": 12416, "effective_input_length": 14842, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14842, "latency_s": 0.48248451098334044, "output_length": 11, "proxy_request_id": "1342327:4:1346218:471", "request_id": "1342327:4:1346218:471", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1342327", "t_dispatch_unix": 1779814889.4556963, "t_finish_unix": 1779814889.9381812, "t_first_token_unix": 1779814889.8166833, "tpot_s": 0.012116439896635712, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13346828, 13346829, 13346830, 13346831, 13346832, 13352845, 13352846, 13352847, 13352848, 13359282], "trace_timestamp_s": 378.6120000000001, "ttft_s": 0.36098424799274653, "turn_id": 4} +{"actual_output_tokens": 121, "cached_tokens": 0, "effective_input_length": 59219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59219, "latency_s": 14.785941429028753, "output_length": 121, "proxy_request_id": "1342634:1:1342634:454", "request_id": "1342634:1:1342634:454", "request_type": "coder", "requested_output_tokens": 121, "session_id": "1342634", "t_dispatch_unix": 1779814875.4458947, "t_finish_unix": 1779814890.231836, "t_first_token_unix": 1779814888.4148042, "tpot_s": 0.015139679225103463, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 4565053, 4565054, 4565055, 127456, 127457, 127458, 127459, 4565056, 4565057, 61286, 4565058, 4565059, 4565060, 4565061, 4565062, 4565063, 4565064, 4565065, 4565066, 4565067, 4565068, 4565069, 4565070, 4565071, 4565072, 4565073, 4565074, 4565075, 4565076, 4565077, 4565078, 4565079, 4565080, 4565081, 4565082, 4565083, 4565084, 4565085, 4565086, 4565087, 4565088, 4565089, 13036298, 13036299, 13036300, 13036301, 13036302, 13036303, 13036304, 13036305, 13036306, 13036307, 13036308, 13036309, 13036310, 13036311, 13036312, 13036313, 13036314, 13036315, 13036316, 13036317, 13036318, 13036319, 13036320, 13036321, 13036322, 13036323, 13036324, 13036325, 13036326, 13036327, 13036328, 13036329, 13036330, 13036331, 13036332, 13036333, 13036334, 13036335, 13036336, 13036337, 13068093, 13326543, 13326544, 13326545, 13326546, 13326547, 13326548, 13326549, 13326550, 13326551, 13326552, 13326553, 13326554, 13326555, 13326556, 13326557, 13326558, 13326559, 13326560, 13326561, 13326562, 13326563, 13326564, 13326565, 13326566, 13326567, 13326568, 13326569, 13326570], "trace_timestamp_s": 366.3150000000005, "ttft_s": 12.96890653501032, "turn_id": 1} +{"actual_output_tokens": 159, "cached_tokens": 10000, "effective_input_length": 10232, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10232, "latency_s": 12.868369906966109, "output_length": 159, "proxy_request_id": "1341912:2:1343220:458", "request_id": "1341912:2:1343220:458", "request_type": "coder", "requested_output_tokens": 159, "session_id": "1341912", "t_dispatch_unix": 1779814877.5678008, "t_finish_unix": 1779814890.4361715, "t_first_token_unix": 1779814888.402857, "tpot_s": 0.012867597797502399, "trace_hash_ids": [13307661, 13307662, 13307663, 13314126, 13314127, 13314128, 13314129, 13314130, 13314131, 13314132, 13314133, 13314134, 13314135, 13314136, 13314137, 13314138, 13319756, 13319757, 13319758, 13331957], "trace_timestamp_s": 368.45900000000074, "ttft_s": 10.834991641982924, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 50447, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50447, "latency_s": 9.917937666992657, "output_length": 47, "proxy_request_id": "1316848:15:1344261:463", "request_id": "1316848:15:1344261:463", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779814880.924153, "t_finish_unix": 1779814890.8420906, "t_first_token_unix": 1779814890.531405, "tpot_s": 0.00674849521728111, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13341597, 13341598], "trace_timestamp_s": 371.8140000000003, "ttft_s": 9.607249966997188, "turn_id": 15} +{"actual_output_tokens": 52, "cached_tokens": 560, "effective_input_length": 773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 773, "latency_s": 0.2837434210232459, "output_length": 52, "proxy_request_id": "1345921:2:1347089:474", "request_id": "1345921:2:1347089:474", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1345921", "t_dispatch_unix": 1779814890.8093984, "t_finish_unix": 1779814891.0931418, "t_first_token_unix": 1779814890.8524258, "tpot_s": 0.004714730137493461, "trace_hash_ids": [13357030, 13367292], "trace_timestamp_s": 381.7000000000007, "ttft_s": 0.043026364990510046, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 5465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5465, "latency_s": 0.47751028498169035, "output_length": 26, "proxy_request_id": "1347763:1:1347763:476", "request_id": "1347763:1:1347763:476", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1347763", "t_dispatch_unix": 1779814893.1333911, "t_finish_unix": 1779814893.6109016, "t_first_token_unix": 1779814893.4861784, "tpot_s": 0.00497703196015209, "trace_hash_ids": [13347549, 13347550, 13358055, 13358056, 13358057, 13358058, 13367259, 13373800, 13373801, 13373802, 13373803], "trace_timestamp_s": 384.02199999999993, "ttft_s": 0.3527860249741934, "turn_id": 1} +{"actual_output_tokens": 50, "cached_tokens": 19920, "effective_input_length": 25661, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25661, "latency_s": 2.1952806769986637, "output_length": 50, "proxy_request_id": "1341948:2:1347296:475", "request_id": "1341948:2:1347296:475", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1341948", "t_dispatch_unix": 1779814891.5232084, "t_finish_unix": 1779814893.718489, "t_first_token_unix": 1779814893.088311, "tpot_s": 0.012854584286046423, "trace_hash_ids": [13296198, 13296199, 13296200, 13296201, 13296202, 13296203, 13296204, 13296205, 13296206, 13296207, 13296208, 13296209, 13296210, 13296211, 13296212, 13296213, 13296214, 13296215, 13296216, 13296217, 13296218, 13296219, 13296220, 13296221, 13296222, 13296223, 13296224, 13296225, 13296226, 13296227, 13296228, 13296229, 13296230, 13308586, 13308587, 13308588, 13308589, 13320340, 13328210, 13335592, 13335593, 13335594, 13351220, 13351221, 13351222, 13360455, 13360456, 13368789, 13368790, 13368791, 13368792], "trace_timestamp_s": 382.41100000000006, "ttft_s": 1.565101024985779, "turn_id": 2} +{"actual_output_tokens": 20, "cached_tokens": 50480, "effective_input_length": 58815, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58815, "latency_s": 3.1705996110104024, "output_length": 20, "proxy_request_id": "1316848:16:1345678:468", "request_id": "1316848:16:1345678:468", "request_type": "coder", "requested_output_tokens": 20, "session_id": "1316848", "t_dispatch_unix": 1779814890.8476505, "t_finish_unix": 1779814894.01825, "t_first_token_unix": 1779814893.9116585, "tpot_s": 0.005595226787447341, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13341597, 13355058, 13355059, 13355060, 13355061, 13355062, 13355063, 13355064, 13355065, 13355066, 13355067, 13355068, 13355069, 13355070, 13355071, 13355072, 13355073, 13355074], "trace_timestamp_s": 376.6190000000006, "ttft_s": 3.0640055130352266, "turn_id": 16} +{"actual_output_tokens": 263, "cached_tokens": 34656, "effective_input_length": 37019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37019, "latency_s": 7.862161827972159, "output_length": 263, "proxy_request_id": "1268861:6:1346340:472", "request_id": "1268861:6:1346340:472", "request_type": "coder", "requested_output_tokens": 263, "session_id": "1268861", "t_dispatch_unix": 1779814888.1609802, "t_finish_unix": 1779814896.0231416, "t_first_token_unix": 1779814892.0932767, "tpot_s": 0.01499788420615213, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13360572], "trace_timestamp_s": 379.0500000000002, "ttft_s": 3.9322952899965458, "turn_id": 6} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 1397, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1397, "latency_s": 0.21708454098552465, "output_length": 25, "proxy_request_id": "1345921:3:1348784:483", "request_id": "1345921:3:1348784:483", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1345921", "t_dispatch_unix": 1779814896.8075268, "t_finish_unix": 1779814897.024611, "t_first_token_unix": 1779814896.9088058, "tpot_s": 0.00481290304257224, "trace_hash_ids": [13357030, 13375155, 13383042], "trace_timestamp_s": 387.6980000000003, "ttft_s": 0.10127813898725435, "turn_id": 3} +{"actual_output_tokens": 397, "cached_tokens": 0, "effective_input_length": 65289, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65289, "latency_s": 20.672161515976768, "output_length": 397, "proxy_request_id": "1342921:1:1342921:455", "request_id": "1342921:1:1342921:455", "request_type": "coder", "requested_output_tokens": 397, "session_id": "1342921", "t_dispatch_unix": 1779814876.4891133, "t_finish_unix": 1779814897.161275, "t_first_token_unix": 1779814891.4848619, "tpot_s": 0.014333751853414331, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13329706], "trace_timestamp_s": 367.3550000000005, "ttft_s": 14.995745946012903, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 36544, "effective_input_length": 39636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39636, "latency_s": 1.863937659014482, "output_length": 44, "proxy_request_id": "1311753:3:1348389:480", "request_id": "1311753:3:1348389:480", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1311753", "t_dispatch_unix": 1779814895.6105554, "t_finish_unix": 1779814897.4744928, "t_first_token_unix": 1779814896.9193425, "tpot_s": 0.012902577953185713, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13276135, 13276136, 13276137, 13276138, 13276139, 13276140, 13276141, 13276142, 13276143, 13276144, 13276145, 13276146, 13276147, 13276148, 13276149, 13276150, 13276151, 13276152, 13276153, 13276154, 13276155, 13276156, 13276157, 13276158, 13276159, 13276160, 13276161, 13276162, 13276163, 13276164, 13276165, 13276166, 13379352, 13379353, 13379354, 13379355, 13379356, 13379357, 13379358], "trace_timestamp_s": 386.4990000000007, "ttft_s": 1.3087857239879668, "turn_id": 3} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 17217, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17217, "latency_s": 2.0325937650050037, "output_length": 67, "proxy_request_id": "1348394:1:1348394:481", "request_id": "1348394:1:1348394:481", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1348394", "t_dispatch_unix": 1779814895.6420476, "t_finish_unix": 1779814897.6746411, "t_first_token_unix": 1779814897.3042035, "tpot_s": 0.005609053000102214, "trace_hash_ids": [13379385, 13379386, 13379387, 13379388, 13379389, 13379390, 13379391, 13379392, 13379393, 13379394, 13379395, 13379396, 13379397, 13379398, 13379399, 13379400, 13379401, 13379402, 13379403, 13379404, 13379405, 13379406, 13379407, 13379408, 13379409, 13379410, 13379411, 13379412, 13379413, 13379414, 13379415, 13379416, 13379417, 13379418], "trace_timestamp_s": 386.52600000000075, "ttft_s": 1.6621534809819423, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 0, "effective_input_length": 12701, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12701, "latency_s": 1.4123479599948041, "output_length": 66, "proxy_request_id": "1348691:1:1348691:482", "request_id": "1348691:1:1348691:482", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1348691", "t_dispatch_unix": 1779814896.5051098, "t_finish_unix": 1779814897.9174573, "t_first_token_unix": 1779814897.5645103, "tpot_s": 0.0054255051233877355, "trace_hash_ids": [13351879, 13351880, 13351881, 13351882, 13351883, 13351884, 13351885, 13351886, 13351887, 13373772, 13373773, 13373774, 13373775, 13373776, 13373777, 13373778, 13373779, 13373780, 13373781, 13382121, 13382122, 13382123, 13382124, 13382125, 13382126], "trace_timestamp_s": 387.39100000000053, "ttft_s": 1.0593998999684118, "turn_id": 1} +{"actual_output_tokens": 216, "cached_tokens": 33024, "effective_input_length": 33334, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33334, "latency_s": 1.62905602902174, "output_length": 216, "proxy_request_id": "1344773:3:1349525:486", "request_id": "1344773:3:1349525:486", "request_type": "coder", "requested_output_tokens": 216, "session_id": "1344773", "t_dispatch_unix": 1779814899.4367454, "t_finish_unix": 1779814901.0658011, "t_first_token_unix": 1779814899.6375175, "tpot_s": 0.006642186548831591, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13389569], "trace_timestamp_s": 390.3270000000002, "ttft_s": 0.20076969999354333, "turn_id": 3} +{"actual_output_tokens": 63, "cached_tokens": 0, "effective_input_length": 4988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4988, "latency_s": 0.6353001169627532, "output_length": 63, "proxy_request_id": "1349975:1:1349975:487", "request_id": "1349975:1:1349975:487", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1349975", "t_dispatch_unix": 1779814901.0295737, "t_finish_unix": 1779814901.664874, "t_first_token_unix": 1779814901.3473675, "tpot_s": 0.005116295564221218, "trace_hash_ids": [13378687, 13378688, 13378689, 13394474, 13394475, 13394476, 13394477, 13394478, 13394479, 13394480], "trace_timestamp_s": 391.9190000000008, "ttft_s": 0.31779265200020745, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 4594, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4594, "latency_s": 0.40410966996569186, "output_length": 24, "proxy_request_id": "1350162:1:1350162:488", "request_id": "1350162:1:1350162:488", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1350162", "t_dispatch_unix": 1779814901.7154264, "t_finish_unix": 1779814902.1195366, "t_first_token_unix": 1779814902.0050175, "tpot_s": 0.004965345739670422, "trace_hash_ids": [13396122, 13396123, 13396124, 13396125, 13396126, 13396127, 13396128, 13396129, 13396130], "trace_timestamp_s": 392.6050000000005, "ttft_s": 0.2895898819551803, "turn_id": 1} +{"actual_output_tokens": 74, "cached_tokens": 0, "effective_input_length": 1471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1471, "latency_s": 0.5198394789476879, "output_length": 74, "proxy_request_id": "1350896:1:1350896:489", "request_id": "1350896:1:1350896:489", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1350896", "t_dispatch_unix": 1779814904.1628637, "t_finish_unix": 1779814904.682703, "t_first_token_unix": 1779814904.3234892, "tpot_s": 0.0049172181513300805, "trace_hash_ids": [13402641, 13402642, 13402643], "trace_timestamp_s": 395.0530000000008, "ttft_s": 0.16062453895574436, "turn_id": 1} +{"actual_output_tokens": 10, "cached_tokens": 0, "effective_input_length": 15313, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15313, "latency_s": 1.4175496799871325, "output_length": 10, "proxy_request_id": "1350980:1:1350980:490", "request_id": "1350980:1:1350980:490", "request_type": "coder", "requested_output_tokens": 10, "session_id": "1350980", "t_dispatch_unix": 1779814904.4085696, "t_finish_unix": 1779814905.8261192, "t_first_token_unix": 1779814905.7901814, "tpot_s": 0.003965470894602024, "trace_hash_ids": [13395393, 13395394, 13395395, 13395396, 13395397, 13395398, 13395399, 13395400, 13395401, 13395402, 13395403, 13395404, 13395405, 13395406, 13395407, 13395408, 13395409, 13395410, 13395411, 13395412, 13395413, 13395414, 13395415, 13395416, 13395417, 13395418, 13395419, 13395420, 13403335, 13403336], "trace_timestamp_s": 395.2940000000008, "ttft_s": 1.3816105029545724, "turn_id": 1} +{"actual_output_tokens": 371, "cached_tokens": 0, "effective_input_length": 73946, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73946, "latency_s": 22.110692138958257, "output_length": 371, "proxy_request_id": "1269373:18:1345570:467", "request_id": "1269373:18:1345570:467", "request_type": "coder", "requested_output_tokens": 371, "session_id": "1269373", "t_dispatch_unix": 1779814885.2856793, "t_finish_unix": 1779814907.396371, "t_first_token_unix": 1779814904.098991, "tpot_s": 0.008911212767486939, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13353639], "trace_timestamp_s": 376.174, "ttft_s": 18.813309622986708, "turn_id": 18} +{"actual_output_tokens": 60, "cached_tokens": 50608, "effective_input_length": 51340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51340, "latency_s": 0.8105516480281949, "output_length": 60, "proxy_request_id": "1253743:5:1351907:492", "request_id": "1253743:5:1351907:492", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1253743", "t_dispatch_unix": 1779814907.9388418, "t_finish_unix": 1779814908.7493932, "t_first_token_unix": 1779814908.3305233, "tpot_s": 0.007095470678226991, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 971291], "trace_timestamp_s": 398.82800000000043, "ttft_s": 0.391679494001437, "turn_id": 5} +{"actual_output_tokens": 1107, "cached_tokens": 37792, "effective_input_length": 41202, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41202, "latency_s": 14.46168290101923, "output_length": 1107, "proxy_request_id": "1334223:3:1348241:479", "request_id": "1334223:3:1348241:479", "request_type": "coder", "requested_output_tokens": 1107, "session_id": "1334223", "t_dispatch_unix": 1779814895.041454, "t_finish_unix": 1779814909.5031369, "t_first_token_unix": 1779814896.0612988, "tpot_s": 0.012153226788434458, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13377885, 13377886, 13377887, 13377888, 13377889, 13377890, 13377891, 13377892, 13377893, 13377894, 13377895, 13377896, 13377897, 13377898, 13377899, 13377900, 13377901, 13377902, 13377903, 13377904, 13377905, 13377906, 13377907, 13377908, 13377909, 13377910, 13377911, 13377912, 13377913, 13377914, 13377915, 13377916, 13377917, 13377918, 13377919, 13377920, 13377921, 13377922, 13377923], "trace_timestamp_s": 385.924, "ttft_s": 1.0198433750192635, "turn_id": 3} +{"actual_output_tokens": 29, "cached_tokens": 33536, "effective_input_length": 33579, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33579, "latency_s": 0.24288587999762967, "output_length": 29, "proxy_request_id": "1344773:4:1352462:494", "request_id": "1344773:4:1352462:494", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1344773", "t_dispatch_unix": 1779814909.7370033, "t_finish_unix": 1779814909.9798894, "t_first_token_unix": 1779814909.8293078, "tpot_s": 0.005367574213388642, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13417820], "trace_timestamp_s": 400.6270000000004, "ttft_s": 0.09230262000346556, "turn_id": 4} +{"actual_output_tokens": 40, "cached_tokens": 12752, "effective_input_length": 21436, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21436, "latency_s": 1.5146354250027798, "output_length": 40, "proxy_request_id": "1348691:2:1352277:493", "request_id": "1348691:2:1352277:493", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1348691", "t_dispatch_unix": 1779814909.1283488, "t_finish_unix": 1779814910.6429842, "t_first_token_unix": 1779814910.4238226, "tpot_s": 0.005611865409614088, "trace_hash_ids": [13351879, 13351880, 13351881, 13351882, 13351883, 13351884, 13351885, 13351886, 13351887, 13373772, 13373773, 13373774, 13373775, 13373776, 13373777, 13373778, 13373779, 13373780, 13373781, 13382121, 13382122, 13382123, 13382124, 13382125, 13389881, 13389882, 13389883, 13389884, 13389885, 13389886, 13389887, 13389888, 13402829, 13402830, 13402831, 13402832, 13402833, 13415762, 13415763, 13415764, 13415765, 13415766], "trace_timestamp_s": 400.0150000000003, "ttft_s": 1.2954716340173036, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 10575, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10575, "latency_s": 0.9499959079548717, "output_length": 25, "proxy_request_id": "1350162:2:1352468:495", "request_id": "1350162:2:1352468:495", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1350162", "t_dispatch_unix": 1779814909.7536917, "t_finish_unix": 1779814910.7036877, "t_first_token_unix": 1779814910.5832584, "tpot_s": 0.00500610737556902, "trace_hash_ids": [13396122, 13396123, 13396124, 13396125, 13396126, 13396127, 13396128, 13396129, 13396130, 13407504, 13407505, 13407506, 13407507, 13407508, 13411995, 13411996, 13417843, 13417844, 13417845, 13417846, 13417847], "trace_timestamp_s": 400.64200000000073, "ttft_s": 0.8295647769700736, "turn_id": 2} +{"actual_output_tokens": 4929, "cached_tokens": 0, "effective_input_length": 7065, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7065, "latency_s": 48.94371006498113, "output_length": 4929, "proxy_request_id": "1339070:1:1339070:438", "request_id": "1339070:1:1339070:438", "request_type": "coder", "requested_output_tokens": 4929, "session_id": "1339070", "t_dispatch_unix": 1779814863.0434473, "t_finish_unix": 1779814911.9871578, "t_first_token_unix": 1779814863.545589, "tpot_s": 0.00982980671754128, "trace_hash_ids": [720115, 720116, 720117, 720118, 720119, 720120, 720121, 720122, 720123, 720124, 13293798, 13293799, 13293800, 13293801], "trace_timestamp_s": 353.9320000000007, "ttft_s": 0.5021406369633041, "turn_id": 1} +{"actual_output_tokens": 381, "cached_tokens": 74304, "effective_input_length": 76493, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76493, "latency_s": 4.689550208044238, "output_length": 381, "proxy_request_id": "1269373:19:1349406:485", "request_id": "1269373:19:1349406:485", "request_type": "coder", "requested_output_tokens": 381, "session_id": "1269373", "t_dispatch_unix": 1779814907.4012995, "t_finish_unix": 1779814912.0908492, "t_first_token_unix": 1779814908.652168, "tpot_s": 0.00904843186313213, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13388487], "trace_timestamp_s": 389.97200000000066, "ttft_s": 1.2508663820335642, "turn_id": 19} +{"actual_output_tokens": 2, "cached_tokens": 1408, "effective_input_length": 6935, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6935, "latency_s": 0.4059585600043647, "output_length": 2, "proxy_request_id": "1345921:4:1353010:501", "request_id": "1345921:4:1353010:501", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1345921", "t_dispatch_unix": 1779814911.7337992, "t_finish_unix": 1779814912.1397576, "t_first_token_unix": 1779814912.138462, "tpot_s": 0.0010191539768129587, "trace_hash_ids": [13421944, 13421945, 13421946, 13421947, 13421948, 13421949, 13421950, 13421951, 13421952, 13421953, 13421954, 13421955, 13421956, 13421957], "trace_timestamp_s": 402.6220000000003, "ttft_s": 0.40466107201064005, "turn_id": 4} +{"actual_output_tokens": 36, "cached_tokens": 5040, "effective_input_length": 14239, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14239, "latency_s": 1.158767270972021, "output_length": 36, "proxy_request_id": "1349975:2:1352986:500", "request_id": "1349975:2:1352986:500", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1349975", "t_dispatch_unix": 1779814911.692428, "t_finish_unix": 1779814912.8511953, "t_first_token_unix": 1779814912.6789374, "tpot_s": 0.004913428485659617, "trace_hash_ids": [13378687, 13378688, 13378689, 13394474, 13394475, 13394476, 13394477, 13394478, 13394479, 13402114, 13402115, 13402116, 13402117, 13402118, 13408855, 13408856, 13408857, 13408858, 13408859, 13408860, 13415611, 13415612, 13415613, 13415614, 13415615, 13421803, 13421804, 13421805], "trace_timestamp_s": 402.5799999999999, "ttft_s": 0.9865076889982447, "turn_id": 2} +{"actual_output_tokens": 77, "cached_tokens": 0, "effective_input_length": 18840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18840, "latency_s": 2.9032692419714294, "output_length": 77, "proxy_request_id": "1352606:1:1352606:496", "request_id": "1352606:1:1352606:496", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1352606", "t_dispatch_unix": 1779814910.322252, "t_finish_unix": 1779814913.2255208, "t_first_token_unix": 1779814912.2198315, "tpot_s": 0.013228591986453944, "trace_hash_ids": [13400902, 13400903, 13400904, 13400905, 13400906, 13400907, 13400908, 13400909, 13400910, 13400911, 13409153, 13409154, 13409155, 13409156, 13409157, 13409158, 13409159, 13409160, 13409161, 13418934, 13418935, 13418936, 13418937, 13418938, 13418939, 13418940, 13418941, 13418942, 13418943, 13418944, 13418945, 13418946, 13418947, 13418948, 13418949, 13418950, 13418951], "trace_timestamp_s": 401.20400000000063, "ttft_s": 1.8975779649917968, "turn_id": 1} +{"actual_output_tokens": 115, "cached_tokens": 83152, "effective_input_length": 83326, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83326, "latency_s": 2.0170381310163066, "output_length": 115, "proxy_request_id": "1317598:6:1352957:499", "request_id": "1317598:6:1352957:499", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1317598", "t_dispatch_unix": 1779814911.5836117, "t_finish_unix": 1779814913.6006498, "t_first_token_unix": 1779814912.445983, "tpot_s": 0.010126145991594776, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753, 13281236, 13421614], "trace_timestamp_s": 402.47100000000046, "ttft_s": 0.8623689339729026, "turn_id": 6} +{"actual_output_tokens": 233, "cached_tokens": 76864, "effective_input_length": 77790, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77790, "latency_s": 2.6483163069933653, "output_length": 233, "proxy_request_id": "1269373:20:1352797:498", "request_id": "1269373:20:1352797:498", "request_type": "coder", "requested_output_tokens": 233, "session_id": "1269373", "t_dispatch_unix": 1779814912.095077, "t_finish_unix": 1779814914.7433932, "t_first_token_unix": 1779814912.6778078, "tpot_s": 0.008902375142246581, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385], "trace_timestamp_s": 401.8740000000007, "ttft_s": 0.5827281799865887, "turn_id": 20} +{"actual_output_tokens": 270, "cached_tokens": 33600, "effective_input_length": 33875, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33875, "latency_s": 1.9653101949952543, "output_length": 270, "proxy_request_id": "1344773:5:1353365:502", "request_id": "1344773:5:1353365:502", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1344773", "t_dispatch_unix": 1779814913.197018, "t_finish_unix": 1779814915.1623275, "t_first_token_unix": 1779814913.3435166, "tpot_s": 0.00676050583280616, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13425453], "trace_timestamp_s": 404.08600000000024, "ttft_s": 0.14649681595619768, "turn_id": 5} +{"actual_output_tokens": 1948, "cached_tokens": 95984, "effective_input_length": 96026, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96026, "latency_s": 22.20006739901146, "output_length": 1948, "proxy_request_id": "1279412:23:1348089:477", "request_id": "1279412:23:1348089:477", "request_type": "coder", "requested_output_tokens": 1948, "session_id": "1279412", "t_dispatch_unix": 1779814894.4190173, "t_finish_unix": 1779814916.6190841, "t_first_token_unix": 1779814894.606649, "tpot_s": 0.011305700873135257, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13376365], "trace_timestamp_s": 385.3070000000007, "ttft_s": 0.18762880098074675, "turn_id": 23} +{"actual_output_tokens": 14236, "cached_tokens": 59248, "effective_input_length": 62618, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62618, "latency_s": 126.57348435500171, "output_length": 14236, "proxy_request_id": "1253804:6:1318560:340", "request_id": "1253804:6:1318560:340", "request_type": "coder", "requested_output_tokens": 14236, "session_id": "1253804", "t_dispatch_unix": 1779814790.2378128, "t_finish_unix": 1779814916.811297, "t_first_token_unix": 1779814791.6462946, "tpot_s": 0.008792745490343526, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 13100557], "trace_timestamp_s": 281.1200000000008, "ttft_s": 1.4084797879913822, "turn_id": 6} +{"actual_output_tokens": 59, "cached_tokens": 51392, "effective_input_length": 51436, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51436, "latency_s": 0.5194297099951655, "output_length": 59, "proxy_request_id": "1253743:6:1354346:505", "request_id": "1253743:6:1354346:505", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1253743", "t_dispatch_unix": 1779814916.4402385, "t_finish_unix": 1779814916.9596677, "t_first_token_unix": 1779814916.5498302, "tpot_s": 0.00706204901758485, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 13433516], "trace_timestamp_s": 407.3299999999999, "ttft_s": 0.10958957800175995, "turn_id": 6} +{"actual_output_tokens": 127, "cached_tokens": 0, "effective_input_length": 27651, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27651, "latency_s": 4.533216323994566, "output_length": 127, "proxy_request_id": "1353821:1:1353821:503", "request_id": "1353821:1:1353821:503", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1353821", "t_dispatch_unix": 1779814914.6126444, "t_finish_unix": 1779814919.1458604, "t_first_token_unix": 1779814918.0558138, "tpot_s": 0.008649115008117247, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13429918], "trace_timestamp_s": 405.4940000000006, "ttft_s": 3.4431674539810047, "turn_id": 1} +{"actual_output_tokens": 278, "cached_tokens": 0, "effective_input_length": 15519, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15519, "latency_s": 2.974970220006071, "output_length": 278, "proxy_request_id": "1286804:3:1354910:506", "request_id": "1286804:3:1354910:506", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1286804", "t_dispatch_unix": 1779814918.4179146, "t_finish_unix": 1779814921.3928847, "t_first_token_unix": 1779814919.8092558, "tpot_s": 0.005715438566760695, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13438558], "trace_timestamp_s": 409.308, "ttft_s": 1.3913393859984353, "turn_id": 3} +{"actual_output_tokens": 102, "cached_tokens": 12800, "effective_input_length": 19366, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19366, "latency_s": 2.1095401530037634, "output_length": 102, "proxy_request_id": "1355484:1:1355484:508", "request_id": "1355484:1:1355484:508", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1355484", "t_dispatch_unix": 1779814920.322301, "t_finish_unix": 1779814922.4318414, "t_first_token_unix": 1779814921.2631326, "tpot_s": 0.011568557861777446, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13443776], "trace_timestamp_s": 411.21000000000004, "ttft_s": 0.9408301839721389, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 34144, "effective_input_length": 34198, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34198, "latency_s": 0.2430423140176572, "output_length": 27, "proxy_request_id": "1344773:6:1356097:513", "request_id": "1344773:6:1356097:513", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1344773", "t_dispatch_unix": 1779814922.57528, "t_finish_unix": 1779814922.8183224, "t_first_token_unix": 1779814922.6675055, "tpot_s": 0.0057899509220778085, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13450022], "trace_timestamp_s": 413.46500000000015, "ttft_s": 0.09222367400070652, "turn_id": 6} +{"actual_output_tokens": 11, "cached_tokens": 0, "effective_input_length": 24503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24503, "latency_s": 3.1060123660136014, "output_length": 11, "proxy_request_id": "1355325:1:1355325:507", "request_id": "1355325:1:1355325:507", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1355325", "t_dispatch_unix": 1779814919.889134, "t_finish_unix": 1779814922.9951463, "t_first_token_unix": 1779814922.7221167, "tpot_s": 0.027278702601324766, "trace_hash_ids": [2091, 2092, 2093, 41146, 41147, 41148, 41149, 41150, 41151, 41152, 41153, 41154, 41155, 41156, 41157, 41158, 41159, 41160, 41161, 41162, 41163, 41164, 252986, 252987, 252988, 252989, 6349953, 6349954, 6349955, 6349956, 6349957, 6349958, 6349959, 5104499, 10973669, 10973670, 13442398, 496454, 496455, 1203620, 1203621, 13442399, 459358, 459359, 1000032, 57326, 13442400, 13442401], "trace_timestamp_s": 410.77000000000044, "ttft_s": 2.83298113202909, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 48448, "effective_input_length": 48977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48977, "latency_s": 1.1205176429939456, "output_length": 92, "proxy_request_id": "1340278:2:1356079:512", "request_id": "1340278:2:1356079:512", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1340278", "t_dispatch_unix": 1779814922.5108774, "t_finish_unix": 1779814923.631395, "t_first_token_unix": 1779814922.9640698, "tpot_s": 0.007330037087360704, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13449829, 13449830, 13449831, 13449832, 13449833, 13449834, 13449835, 13449836, 13449837, 13449838, 13449839, 13449840, 13449841, 13449842, 13449843, 13449844, 13449845, 13449846, 13449847, 13449848, 13449849, 13449850, 13449851, 13449852, 13449853, 13449854, 13449855, 13449856, 13449857, 13449858, 13449859, 13449860, 13449861, 13449862, 13449863, 13449864, 13449865, 13449866, 13449867, 13449868, 13449869, 13449870, 13449871, 13449872, 13449873, 13449874, 13449875, 13449876, 13449877, 13449878, 13449879, 13449880, 13449881, 13449882, 13449883, 13449884, 13449885, 13449886, 13449887, 13449888, 13449889, 13449890, 13449891, 13449892, 13449893, 13449894, 13449895, 13449896, 13449897, 13449898, 13449899, 13449900, 13449901, 13449902], "trace_timestamp_s": 413.3860000000004, "ttft_s": 0.4531908589997329, "turn_id": 2} +{"actual_output_tokens": 408, "cached_tokens": 78016, "effective_input_length": 78089, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78089, "latency_s": 4.288167816004716, "output_length": 408, "proxy_request_id": "1269373:21:1355702:509", "request_id": "1269373:21:1355702:509", "request_type": "coder", "requested_output_tokens": 408, "session_id": "1269373", "t_dispatch_unix": 1779814920.9978757, "t_finish_unix": 1779814925.2860432, "t_first_token_unix": 1779814921.3920896, "tpot_s": 0.009566774916450702, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385, 13446158], "trace_timestamp_s": 411.8860000000004, "ttft_s": 0.3942118469858542, "turn_id": 21} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 6711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6711, "latency_s": 0.7258520850446075, "output_length": 54, "proxy_request_id": "1356948:1:1356948:515", "request_id": "1356948:1:1356948:515", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1356948", "t_dispatch_unix": 1779814925.6073592, "t_finish_unix": 1779814926.3332114, "t_first_token_unix": 1779814926.062452, "tpot_s": 0.005102656113932717, "trace_hash_ids": [13432238, 13432239, 13432240, 13432241, 13442185, 13452093, 13452094, 13452095, 13452096, 13452097, 13457944, 13457945, 13457946, 13457947], "trace_timestamp_s": 416.4960000000001, "ttft_s": 0.4550918620079756, "turn_id": 1} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 35308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35308, "latency_s": 5.926822734007146, "output_length": 61, "proxy_request_id": "1355951:1:1355951:511", "request_id": "1355951:1:1355951:511", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1355951", "t_dispatch_unix": 1779814921.912203, "t_finish_unix": 1779814927.8390257, "t_first_token_unix": 1779814927.1191647, "tpot_s": 0.01199248173312905, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626], "trace_timestamp_s": 412.78999999999996, "ttft_s": 5.206959538976662, "turn_id": 1} +{"actual_output_tokens": 109, "cached_tokens": 0, "effective_input_length": 13520, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13520, "latency_s": 1.7744655709830113, "output_length": 109, "proxy_request_id": "1357132:1:1357132:516", "request_id": "1357132:1:1357132:516", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1357132", "t_dispatch_unix": 1779814926.1479661, "t_finish_unix": 1779814927.922432, "t_first_token_unix": 1779814927.322514, "tpot_s": 0.00555226804647612, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13459305], "trace_timestamp_s": 417.03400000000056, "ttft_s": 1.174546455964446, "turn_id": 1} +{"actual_output_tokens": 119, "cached_tokens": 27776, "effective_input_length": 27805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27805, "latency_s": 1.3905545240268111, "output_length": 119, "proxy_request_id": "1353821:2:1357420:517", "request_id": "1353821:2:1357420:517", "request_type": "coder", "requested_output_tokens": 119, "session_id": "1353821", "t_dispatch_unix": 1779814926.9978137, "t_finish_unix": 1779814928.388368, "t_first_token_unix": 1779814927.1663437, "tpot_s": 0.010353842033941489, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13462486], "trace_timestamp_s": 417.8879999999999, "ttft_s": 0.1685283380211331, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 34224, "effective_input_length": 34351, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34351, "latency_s": 0.4980789139517583, "output_length": 61, "proxy_request_id": "1344773:7:1357714:518", "request_id": "1344773:7:1357714:518", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1344773", "t_dispatch_unix": 1779814928.078956, "t_finish_unix": 1779814928.5770345, "t_first_token_unix": 1779814928.1918108, "tpot_s": 0.006416174266875411, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13465009], "trace_timestamp_s": 418.96900000000005, "ttft_s": 0.1128506749519147, "turn_id": 7} +{"actual_output_tokens": 972, "cached_tokens": 45552, "effective_input_length": 48193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48193, "latency_s": 8.318348329048604, "output_length": 972, "proxy_request_id": "1294611:11:1355750:510", "request_id": "1294611:11:1355750:510", "request_type": "coder", "requested_output_tokens": 972, "session_id": "1294611", "t_dispatch_unix": 1779814921.0985792, "t_finish_unix": 1779814929.4169278, "t_first_token_unix": 1779814922.034655, "tpot_s": 0.007602518388244249, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 13446612], "trace_timestamp_s": 411.9870000000001, "ttft_s": 0.9360722080455162, "turn_id": 11} +{"actual_output_tokens": 41, "cached_tokens": 34400, "effective_input_length": 34552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34552, "latency_s": 0.3819513670168817, "output_length": 41, "proxy_request_id": "1344773:8:1358989:523", "request_id": "1344773:8:1358989:523", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1344773", "t_dispatch_unix": 1779814932.6052506, "t_finish_unix": 1779814932.9872015, "t_first_token_unix": 1779814932.743318, "tpot_s": 0.0060906437007361095, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13477517], "trace_timestamp_s": 423.4950000000008, "ttft_s": 0.1380627269973047, "turn_id": 8} +{"actual_output_tokens": 27, "cached_tokens": 51488, "effective_input_length": 51509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51509, "latency_s": 0.2635688210139051, "output_length": 27, "proxy_request_id": "1253743:7:1359251:524", "request_id": "1253743:7:1359251:524", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1253743", "t_dispatch_unix": 1779814933.6397207, "t_finish_unix": 1779814933.903289, "t_first_token_unix": 1779814933.74202, "tpot_s": 0.006193731268957401, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 13480204], "trace_timestamp_s": 424.52900000000045, "ttft_s": 0.10229708900442347, "turn_id": 7} +{"actual_output_tokens": 61, "cached_tokens": 34592, "effective_input_length": 34611, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34611, "latency_s": 0.46317339001689106, "output_length": 61, "proxy_request_id": "1344773:9:1360064:526", "request_id": "1344773:9:1360064:526", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1344773", "t_dispatch_unix": 1779814936.6044781, "t_finish_unix": 1779814937.0676513, "t_first_token_unix": 1779814936.6842978, "tpot_s": 0.00637935951720768, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13488056], "trace_timestamp_s": 427.4940000000006, "ttft_s": 0.07981739798560739, "turn_id": 9} +{"actual_output_tokens": 64, "cached_tokens": 27920, "effective_input_length": 27933, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27933, "latency_s": 0.6219377979869023, "output_length": 64, "proxy_request_id": "1353821:3:1360898:529", "request_id": "1353821:3:1360898:529", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1353821", "t_dispatch_unix": 1779814939.4136617, "t_finish_unix": 1779814940.0355995, "t_first_token_unix": 1779814939.4868395, "tpot_s": 0.0087034402540811, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13496092], "trace_timestamp_s": 430.3040000000001, "ttft_s": 0.07317603297997266, "turn_id": 3} +{"actual_output_tokens": 150, "cached_tokens": 0, "effective_input_length": 83526, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83526, "latency_s": 25.024452958023176, "output_length": 150, "proxy_request_id": "1353951:1:1353951:504", "request_id": "1353951:1:1353951:504", "request_type": "coder", "requested_output_tokens": 150, "session_id": "1353951", "t_dispatch_unix": 1779814915.0898879, "t_finish_unix": 1779814940.1143403, "t_first_token_unix": 1779814938.7599142, "tpot_s": 0.009088063516869716, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 63992, 63993, 63994, 63995, 63996, 63997, 63998, 63999, 64000, 64001, 64002, 64003, 64004, 64005, 64006, 64007, 64008, 64009, 8107570, 8107571, 2409606, 2409607, 8107572, 8107573, 2891280, 8107574, 8107575, 8107576, 8107577, 8107578, 8107579, 8107580, 8107581, 8107582, 9028327, 9028328, 9028329, 10714983, 10714984, 10714985, 10714986, 10714987, 10714988, 10714989, 10714990, 10714991, 10714992, 10714993, 10714994, 10714995, 10714996, 10714997, 10714998, 10714999, 10715000, 10715001, 10715002, 10715003, 10715004, 10715005, 10715006, 10715007, 10715008, 10715009, 10715010, 10715011, 10715012, 10715013, 10715014, 10715015, 10715016, 10715017, 10715018, 10715019, 10715020, 10715021, 10715022, 10715023, 10715024, 10715025, 10715026, 10715027, 10715028, 10715029, 10715030, 10715031, 10715032, 10715033, 10715034, 10715035, 10715036, 10715037, 10715038, 10715039, 10715040, 10715041, 10715042, 10715043, 10715044, 10715045, 10715046, 10715047, 10715048, 10715049, 10715050, 10715051, 10715052, 10715053, 10715054, 10715055, 10715056, 10715057, 10715058, 10715059, 10715060, 10715061, 10715062, 10759522, 10759523, 10759524, 10759525, 10759526, 10759527, 10759528, 10759529, 10759530, 10778264, 10805988, 10825765, 10910663, 10910664, 10910665, 11006287, 11006288, 11333088, 11333089, 11432622, 11432623, 11610384, 11610385, 13198983, 13198984, 13198985, 13198986, 13409591, 13409592, 13409593, 13409594, 13430835, 13430836, 13430837, 13430838, 13430839, 13430840, 13430841, 13430842], "trace_timestamp_s": 405.9470000000001, "ttft_s": 23.67002483701799, "turn_id": 1} +{"actual_output_tokens": 22, "cached_tokens": 83664, "effective_input_length": 83905, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83905, "latency_s": 0.4340049260063097, "output_length": 22, "proxy_request_id": "1353951:2:1358300:520", "request_id": "1353951:2:1358300:520", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1353951", "t_dispatch_unix": 1779814940.1211815, "t_finish_unix": 1779814940.5551863, "t_first_token_unix": 1779814940.4249022, "tpot_s": 0.0061901206666204545, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 63992, 63993, 63994, 63995, 63996, 63997, 63998, 63999, 64000, 64001, 64002, 64003, 64004, 64005, 64006, 64007, 64008, 64009, 8107570, 8107571, 2409606, 2409607, 8107572, 8107573, 2891280, 8107574, 8107575, 8107576, 8107577, 8107578, 8107579, 8107580, 8107581, 8107582, 9028327, 9028328, 9028329, 10714983, 10714984, 10714985, 10714986, 10714987, 10714988, 10714989, 10714990, 10714991, 10714992, 10714993, 10714994, 10714995, 10714996, 10714997, 10714998, 10714999, 10715000, 10715001, 10715002, 10715003, 10715004, 10715005, 10715006, 10715007, 10715008, 10715009, 10715010, 10715011, 10715012, 10715013, 10715014, 10715015, 10715016, 10715017, 10715018, 10715019, 10715020, 10715021, 10715022, 10715023, 10715024, 10715025, 10715026, 10715027, 10715028, 10715029, 10715030, 10715031, 10715032, 10715033, 10715034, 10715035, 10715036, 10715037, 10715038, 10715039, 10715040, 10715041, 10715042, 10715043, 10715044, 10715045, 10715046, 10715047, 10715048, 10715049, 10715050, 10715051, 10715052, 10715053, 10715054, 10715055, 10715056, 10715057, 10715058, 10715059, 10715060, 10715061, 10715062, 10759522, 10759523, 10759524, 10759525, 10759526, 10759527, 10759528, 10759529, 10759530, 10778264, 10805988, 10825765, 10910663, 10910664, 10910665, 11006287, 11006288, 11333088, 11333089, 11432622, 11432623, 11610384, 11610385, 13198983, 13198984, 13198985, 13198986, 13409591, 13409592, 13409593, 13409594, 13430835, 13471008, 13471009, 13471010, 13471011, 13471012, 13471013, 13471014], "trace_timestamp_s": 420.991, "ttft_s": 0.3037184060085565, "turn_id": 2} +{"actual_output_tokens": 189, "cached_tokens": 19456, "effective_input_length": 19493, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19493, "latency_s": 8.516224093968049, "output_length": 189, "proxy_request_id": "1355484:2:1359370:525", "request_id": "1355484:2:1359370:525", "request_type": "coder", "requested_output_tokens": 189, "session_id": "1355484", "t_dispatch_unix": 1779814934.0982933, "t_finish_unix": 1779814942.6145172, "t_first_token_unix": 1779814939.8646338, "tpot_s": 0.01462553340961483, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13481586], "trace_timestamp_s": 424.9890000000005, "ttft_s": 5.7663387329666875, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 16480, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16480, "latency_s": 1.8045739110093564, "output_length": 31, "proxy_request_id": "1356948:2:1361262:532", "request_id": "1356948:2:1361262:532", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1356948", "t_dispatch_unix": 1779814940.8932028, "t_finish_unix": 1779814942.6977763, "t_first_token_unix": 1779814942.453656, "tpot_s": 0.00812958476599306, "trace_hash_ids": [13499396, 13499397, 13499398, 13499399, 13499400, 13499401, 13499402, 13499403, 13499404, 13499405, 13499406, 13499407, 13499408, 13499409, 13499410, 13499411, 13499412, 13499413, 13499414, 13499415, 13499416, 13499417, 13499418, 13499419, 13499420, 13499421, 13499422, 13499423, 13499424, 13499425, 13499426, 13499427, 13499428], "trace_timestamp_s": 431.77800000000025, "ttft_s": 1.560451939003542, "turn_id": 2} +{"actual_output_tokens": 66, "cached_tokens": 19680, "effective_input_length": 19714, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19714, "latency_s": 1.0719390850281343, "output_length": 66, "proxy_request_id": "1355484:3:1361065:531", "request_id": "1355484:3:1361065:531", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1355484", "t_dispatch_unix": 1779814942.6153839, "t_finish_unix": 1779814943.687323, "t_first_token_unix": 1779814942.7173007, "tpot_s": 0.014919509522867604, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13497881], "trace_timestamp_s": 430.9370000000008, "ttft_s": 0.10191524203401059, "turn_id": 3} +{"actual_output_tokens": 48, "cached_tokens": 65680, "effective_input_length": 66032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66032, "latency_s": 4.354447755031288, "output_length": 48, "proxy_request_id": "1342921:2:1361022:530", "request_id": "1342921:2:1361022:530", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1342921", "t_dispatch_unix": 1779814939.8763459, "t_finish_unix": 1779814944.230794, "t_first_token_unix": 1779814943.7857397, "tpot_s": 0.009461096765354593, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390], "trace_timestamp_s": 430.7650000000003, "ttft_s": 3.909391701046843, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 0, "effective_input_length": 8113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8113, "latency_s": 0.7909366310341284, "output_length": 28, "proxy_request_id": "1361992:1:1361992:535", "request_id": "1361992:1:1361992:535", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1361992", "t_dispatch_unix": 1779814943.4711735, "t_finish_unix": 1779814944.26211, "t_first_token_unix": 1779814944.0466108, "tpot_s": 0.007971041853091231, "trace_hash_ids": [13476591, 13499228, 13499229, 13499230, 13499231, 13499232, 13499233, 13499234, 13499235, 13499236, 13506610, 13506611, 13506612, 13506613, 13506614, 13506615], "trace_timestamp_s": 434.3590000000004, "ttft_s": 0.5754363280138932, "turn_id": 1} +{"actual_output_tokens": 78, "cached_tokens": 0, "effective_input_length": 33478, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33478, "latency_s": 5.68173290300183, "output_length": 78, "proxy_request_id": "1270340:3:1360716:528", "request_id": "1270340:3:1360716:528", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1270340", "t_dispatch_unix": 1779814938.751182, "t_finish_unix": 1779814944.4329154, "t_first_token_unix": 1779814943.7764966, "tpot_s": 0.008521543765839721, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13494265], "trace_timestamp_s": 429.6390000000001, "ttft_s": 5.025311133998912, "turn_id": 3} +{"actual_output_tokens": 197, "cached_tokens": 0, "effective_input_length": 8825, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8825, "latency_s": 1.7160790030029602, "output_length": 197, "proxy_request_id": "1362265:1:1362265:536", "request_id": "1362265:1:1362265:536", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1362265", "t_dispatch_unix": 1779814944.3174014, "t_finish_unix": 1779814946.0334802, "t_first_token_unix": 1779814944.9841404, "tpot_s": 0.005351810617198959, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13509133], "trace_timestamp_s": 435.2049999999999, "ttft_s": 0.6667377339908853, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 8128, "effective_input_length": 10347, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10347, "latency_s": 0.4849171859677881, "output_length": 29, "proxy_request_id": "1361992:2:1362904:537", "request_id": "1361992:2:1362904:537", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1361992", "t_dispatch_unix": 1779814946.562179, "t_finish_unix": 1779814947.047096, "t_first_token_unix": 1779814946.8257847, "tpot_s": 0.00789531589336028, "trace_hash_ids": [13476591, 13499228, 13499229, 13499230, 13499231, 13499232, 13499233, 13499234, 13499235, 13499236, 13506610, 13506611, 13506612, 13506613, 13506614, 13515206, 13515207, 13515208, 13515209, 13515210, 13515211], "trace_timestamp_s": 437.4520000000002, "ttft_s": 0.2636042359517887, "turn_id": 2} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 543, "latency_s": 0.23791600699769333, "output_length": 37, "proxy_request_id": "1363440:1:1363440:542", "request_id": "1363440:1:1363440:542", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1363440", "t_dispatch_unix": 1779814948.512584, "t_finish_unix": 1779814948.7504997, "t_first_token_unix": 1779814948.5759194, "tpot_s": 0.004841249610763043, "trace_hash_ids": [13519619, 13519620], "trace_timestamp_s": 439.40300000000025, "ttft_s": 0.06333467300282791, "turn_id": 1} +{"actual_output_tokens": 723, "cached_tokens": 24400, "effective_input_length": 58758, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58758, "latency_s": 20.41936135297874, "output_length": 723, "proxy_request_id": "1313181:2:1358046:519", "request_id": "1313181:2:1358046:519", "request_type": "coder", "requested_output_tokens": 723, "session_id": "1313181", "t_dispatch_unix": 1779814929.278261, "t_finish_unix": 1779814949.697622, "t_first_token_unix": 1779814939.861899, "tpot_s": 0.013622102739613173, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720], "trace_timestamp_s": 420.15500000000065, "ttft_s": 10.583635465009138, "turn_id": 2} +{"actual_output_tokens": 97, "cached_tokens": 24448, "effective_input_length": 24451, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24451, "latency_s": 1.13767452101456, "output_length": 97, "proxy_request_id": "1313181:3:1316742:330", "request_id": "1313181:3:1316742:330", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1313181", "t_dispatch_unix": 1779814949.6994128, "t_finish_unix": 1779814950.8370872, "t_first_token_unix": 1779814949.7662737, "tpot_s": 0.011151818187499885, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713], "trace_timestamp_s": 274.71900000000005, "ttft_s": 0.06685819098493084, "turn_id": 3} +{"actual_output_tokens": 242, "cached_tokens": 0, "effective_input_length": 12636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12636, "latency_s": 2.408718569960911, "output_length": 242, "proxy_request_id": "1363943:1:1363943:543", "request_id": "1363943:1:1363943:543", "request_type": "coder", "requested_output_tokens": 242, "session_id": "1363943", "t_dispatch_unix": 1779814950.1933537, "t_finish_unix": 1779814952.6020722, "t_first_token_unix": 1779814951.2624884, "tpot_s": 0.005557403207516985, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13524052], "trace_timestamp_s": 441.08300000000054, "ttft_s": 1.069128793955315, "turn_id": 1} +{"actual_output_tokens": 148, "cached_tokens": 0, "effective_input_length": 8706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8706, "latency_s": 3.1861590450280346, "output_length": 148, "proxy_request_id": "1364128:1:1364128:545", "request_id": "1364128:1:1364128:545", "request_type": "coder", "requested_output_tokens": 148, "session_id": "1364128", "t_dispatch_unix": 1779814950.6802917, "t_finish_unix": 1779814953.8664508, "t_first_token_unix": 1779814951.4418535, "tpot_s": 0.01649089442204912, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13525789], "trace_timestamp_s": 441.5700000000006, "ttft_s": 0.761560307990294, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 2019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2019, "latency_s": 0.53101695101941, "output_length": 37, "proxy_request_id": "1364960:1:1364960:549", "request_id": "1364960:1:1364960:549", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1364960", "t_dispatch_unix": 1779814953.604987, "t_finish_unix": 1779814954.1360042, "t_first_token_unix": 1779814953.7394824, "tpot_s": 0.011005868832904121, "trace_hash_ids": [13526287, 13526288, 13526289, 13533401], "trace_timestamp_s": 444.4950000000008, "ttft_s": 0.13449464802397415, "turn_id": 1} +{"actual_output_tokens": 196, "cached_tokens": 97968, "effective_input_length": 98038, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98038, "latency_s": 3.76765426696511, "output_length": 196, "proxy_request_id": "1279412:24:1364169:546", "request_id": "1279412:24:1364169:546", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1279412", "t_dispatch_unix": 1779814950.810752, "t_finish_unix": 1779814954.5784059, "t_first_token_unix": 1779814951.622173, "tpot_s": 0.015158803933240378, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13526218], "trace_timestamp_s": 441.6970000000001, "ttft_s": 0.8114177659736015, "turn_id": 24} +{"actual_output_tokens": 51, "cached_tokens": 576, "effective_input_length": 3866, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3866, "latency_s": 0.5502587619703263, "output_length": 51, "proxy_request_id": "1363440:2:1365095:551", "request_id": "1363440:2:1365095:551", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1363440", "t_dispatch_unix": 1779814954.1870184, "t_finish_unix": 1779814954.7372773, "t_first_token_unix": 1779814954.408843, "tpot_s": 0.006563893159618601, "trace_hash_ids": [13519619, 13526758, 13526759, 13534597, 13534598, 13534599, 13534600, 13534601], "trace_timestamp_s": 445.0770000000002, "ttft_s": 0.22182360896840692, "turn_id": 2} +{"actual_output_tokens": 153, "cached_tokens": 13616, "effective_input_length": 14721, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14721, "latency_s": 1.1350117840338498, "output_length": 153, "proxy_request_id": "1357132:2:1364990:550", "request_id": "1357132:2:1364990:550", "request_type": "coder", "requested_output_tokens": 153, "session_id": "1357132", "t_dispatch_unix": 1779814953.6786706, "t_finish_unix": 1779814954.813682, "t_first_token_unix": 1779814953.9213204, "tpot_s": 0.005868766651378553, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13533536], "trace_timestamp_s": 444.5690000000004, "ttft_s": 0.2426478760316968, "turn_id": 2} +{"actual_output_tokens": 584, "cached_tokens": 0, "effective_input_length": 13897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13897, "latency_s": 4.772046985977795, "output_length": 584, "proxy_request_id": "1364090:1:1364090:544", "request_id": "1364090:1:1364090:544", "request_type": "coder", "requested_output_tokens": 584, "session_id": "1364090", "t_dispatch_unix": 1779814950.5716677, "t_finish_unix": 1779814955.3437154, "t_first_token_unix": 1779814951.7729235, "tpot_s": 0.006124314317307204, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 11789930], "trace_timestamp_s": 441.46200000000044, "ttft_s": 1.2012539560091682, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 9913, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9913, "latency_s": 0.8908409309806302, "output_length": 23, "proxy_request_id": "1365440:1:1365440:552", "request_id": "1365440:1:1365440:552", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1365440", "t_dispatch_unix": 1779814955.4059932, "t_finish_unix": 1779814956.2968338, "t_first_token_unix": 1779814956.1898522, "tpot_s": 0.004850560862740333, "trace_hash_ids": [13493986, 13493987, 13493988, 13493989, 13493990, 13502611, 13502612, 13502613, 13502614, 13502615, 13512497, 13512498, 13521747, 13521748, 13529243, 13529244, 13529245, 13529246, 13537645, 13537646], "trace_timestamp_s": 446.2930000000006, "ttft_s": 0.7838579179951921, "turn_id": 1} +{"actual_output_tokens": 94, "cached_tokens": 0, "effective_input_length": 11154, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11154, "latency_s": 1.4868293749750592, "output_length": 94, "proxy_request_id": "1366128:1:1366128:553", "request_id": "1366128:1:1366128:553", "request_type": "coder", "requested_output_tokens": 94, "session_id": "1366128", "t_dispatch_unix": 1779814957.69998, "t_finish_unix": 1779814959.186809, "t_first_token_unix": 1779814958.5967581, "tpot_s": 0.006340608806274231, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2239018, 2239019, 2239020, 2239021, 2239022, 177637, 177638, 177639, 2239023, 2239024, 2239025, 2239026, 2239027], "trace_timestamp_s": 448.58700000000044, "ttft_s": 0.8967769659939222, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 14800, "effective_input_length": 14816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14816, "latency_s": 2.143572837987449, "output_length": 27, "proxy_request_id": "1357132:3:1366582:557", "request_id": "1357132:3:1366582:557", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1357132", "t_dispatch_unix": 1779814959.3498878, "t_finish_unix": 1779814961.493461, "t_first_token_unix": 1779814959.3968632, "tpot_s": 0.08062197073013522, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710], "trace_timestamp_s": 450.241, "ttft_s": 0.046973463031463325, "turn_id": 3} +{"actual_output_tokens": 28, "cached_tokens": 27984, "effective_input_length": 28093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28093, "latency_s": 13.794688327005133, "output_length": 28, "proxy_request_id": "1353821:4:1363399:541", "request_id": "1353821:4:1363399:541", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1353821", "t_dispatch_unix": 1779814948.3358223, "t_finish_unix": 1779814962.1305106, "t_first_token_unix": 1779814961.6384008, "tpot_s": 0.018209428073734872, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13496092], "trace_timestamp_s": 439.22600000000057, "ttft_s": 13.30257622001227, "turn_id": 4} +{"actual_output_tokens": 5049, "cached_tokens": 67552, "effective_input_length": 68259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68259, "latency_s": 51.91094786999747, "output_length": 5049, "proxy_request_id": "1314357:4:1352612:497", "request_id": "1314357:4:1352612:497", "request_type": "coder", "requested_output_tokens": 5049, "session_id": "1314357", "t_dispatch_unix": 1779814910.3441422, "t_finish_unix": 1779814962.2550895, "t_first_token_unix": 1779814910.885528, "tpot_s": 0.010175925269814264, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13419015, 13419016], "trace_timestamp_s": 401.23199999999997, "ttft_s": 0.5413836689549498, "turn_id": 4} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 3392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3392, "latency_s": 0.3948786329710856, "output_length": 13, "proxy_request_id": "1367424:1:1367424:569", "request_id": "1367424:1:1367424:569", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1367424", "t_dispatch_unix": 1779814962.4370916, "t_finish_unix": 1779814962.8319702, "t_first_token_unix": 1779814962.7038987, "tpot_s": 0.010647582331633506, "trace_hash_ids": [13550847, 13550848, 13555750, 13555751, 13555752, 13555753, 13555754], "trace_timestamp_s": 453.3270000000002, "ttft_s": 0.26680529199074954, "turn_id": 1} +{"actual_output_tokens": 127, "cached_tokens": 34000, "effective_input_length": 36301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36301, "latency_s": 3.451670304988511, "output_length": 127, "proxy_request_id": "1277428:5:1366630:559", "request_id": "1277428:5:1366630:559", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1277428", "t_dispatch_unix": 1779814959.4961667, "t_finish_unix": 1779814962.9478369, "t_first_token_unix": 1779814960.1726577, "tpot_s": 0.022022041873285724, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983], "trace_timestamp_s": 450.3850000000002, "ttft_s": 0.6764886489836499, "turn_id": 5} +{"actual_output_tokens": 65, "cached_tokens": 8848, "effective_input_length": 9095, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9095, "latency_s": 1.2209120640181936, "output_length": 65, "proxy_request_id": "1364128:2:1367249:565", "request_id": "1364128:2:1367249:565", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1364128", "t_dispatch_unix": 1779814961.8302846, "t_finish_unix": 1779814963.0511968, "t_first_token_unix": 1779814961.9351056, "tpot_s": 0.017433114874620514, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13554127], "trace_timestamp_s": 452.72100000000046, "ttft_s": 0.10481959604658186, "turn_id": 2} +{"actual_output_tokens": 92, "cached_tokens": 11232, "effective_input_length": 15411, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15411, "latency_s": 1.8528817549813539, "output_length": 92, "proxy_request_id": "1366128:2:1367220:563", "request_id": "1366128:2:1367220:563", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1366128", "t_dispatch_unix": 1779814961.7352934, "t_finish_unix": 1779814963.5881748, "t_first_token_unix": 1779814962.2964485, "tpot_s": 0.014192092505534394, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13553898], "trace_timestamp_s": 452.6220000000003, "ttft_s": 0.5611539039527997, "turn_id": 2} +{"actual_output_tokens": 33, "cached_tokens": 14832, "effective_input_length": 14949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14949, "latency_s": 0.5029817349859513, "output_length": 33, "proxy_request_id": "1357132:4:1367654:570", "request_id": "1357132:4:1367654:570", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1357132", "t_dispatch_unix": 1779814963.1345136, "t_finish_unix": 1779814963.6374953, "t_first_token_unix": 1779814963.2198894, "tpot_s": 0.01304065965632617, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710, 13557420], "trace_timestamp_s": 454.02500000000055, "ttft_s": 0.08537417202023789, "turn_id": 4} +{"actual_output_tokens": 120, "cached_tokens": 0, "effective_input_length": 76969, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76969, "latency_s": 21.331509507028386, "output_length": 120, "proxy_request_id": "1361694:1:1361694:534", "request_id": "1361694:1:1361694:534", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1361694", "t_dispatch_unix": 1779814942.4392898, "t_finish_unix": 1779814963.770799, "t_first_token_unix": 1779814962.7442043, "tpot_s": 0.008624933579811403, "trace_hash_ids": [44767, 44768, 44769, 44770, 44771, 44772, 44773, 44774, 44775, 44776, 44777, 44778, 44779, 44780, 44781, 44782, 44783, 44784, 44785, 44786, 44787, 44788, 44789, 44790, 44791, 44792, 44793, 44794, 44795, 44796, 44797, 44798, 44799, 44800, 3558548, 3558549, 3558550, 3558551, 3558552, 3558553, 13503874, 1011240, 1011241, 1011242, 1011243, 3586252, 74020, 74021, 74022, 74023, 3586253, 3586254, 3586255, 3586256, 3586257, 3586258, 3586259, 3586260, 3586261, 3586262, 3586263, 3586264, 3586265, 3586266, 3586267, 3586268, 3586269, 3586270, 3586271, 3586272, 3586273, 3586274, 3586275, 3586276, 3586277, 3586278, 3663116, 4797128, 4797129, 4797130, 4797131, 4797132, 5846177, 5846178, 5846179, 5846180, 5865004, 8339969, 8339970, 8339971, 8339972, 8339973, 8339974, 10027756, 10027757, 10027758, 10027759, 10027760, 10027761, 10027762, 11077600, 11077601, 11077602, 11077603, 11077604, 11077605, 11077606, 11077607, 11077608, 11077609, 11077610, 11866485, 11866486, 11866487, 11866488, 11866489, 11866490, 11866491, 11866492, 11866493, 11866494, 11866495, 11866496, 11866497, 11866498, 11866499, 11866500, 11866501, 11866502, 11866503, 11866504, 11866505, 11866506, 11986357, 11986358, 12039293, 12039294, 12105265, 12125556, 12125557, 13503875, 13503876, 13503877, 13503878, 13503879, 13503880, 13503881, 13503882, 13503883, 13503884, 13503885], "trace_timestamp_s": 433.3020000000006, "ttft_s": 20.304912507010158, "turn_id": 1} +{"actual_output_tokens": 161, "cached_tokens": 33552, "effective_input_length": 41017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41017, "latency_s": 4.350047824031208, "output_length": 161, "proxy_request_id": "1270340:4:1366608:558", "request_id": "1270340:4:1366608:558", "request_type": "coder", "requested_output_tokens": 161, "session_id": "1270340", "t_dispatch_unix": 1779814959.4248202, "t_finish_unix": 1779814963.7748678, "t_first_token_unix": 1779814961.374263, "tpot_s": 0.015002234025087092, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 13547874], "trace_timestamp_s": 450.3120000000008, "ttft_s": 1.9494408720056526, "turn_id": 4} +{"actual_output_tokens": 34, "cached_tokens": 9008, "effective_input_length": 10134, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10134, "latency_s": 1.8380285180173814, "output_length": 34, "proxy_request_id": "1362265:2:1367373:568", "request_id": "1362265:2:1367373:568", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1362265", "t_dispatch_unix": 1779814962.2377236, "t_finish_unix": 1779814964.0757523, "t_first_token_unix": 1779814963.7803712, "tpot_s": 0.008938605576104514, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218], "trace_timestamp_s": 453.1280000000006, "ttft_s": 1.542646323039662, "turn_id": 2} +{"actual_output_tokens": 322, "cached_tokens": 12864, "effective_input_length": 12984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12984, "latency_s": 5.345346771995537, "output_length": 322, "proxy_request_id": "1363943:2:1366428:556", "request_id": "1363943:2:1366428:556", "request_type": "coder", "requested_output_tokens": 322, "session_id": "1363943", "t_dispatch_unix": 1779814958.8096654, "t_finish_unix": 1779814964.1550124, "t_first_token_unix": 1779814958.8765564, "tpot_s": 0.016443100788179392, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13546053], "trace_timestamp_s": 449.7000000000007, "ttft_s": 0.06688007398042828, "turn_id": 2} +{"actual_output_tokens": 188, "cached_tokens": 19776, "effective_input_length": 19806, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19806, "latency_s": 11.169394303986337, "output_length": 188, "proxy_request_id": "1355484:4:1364784:548", "request_id": "1355484:4:1364784:548", "request_type": "coder", "requested_output_tokens": 188, "session_id": "1355484", "t_dispatch_unix": 1779814952.9901705, "t_finish_unix": 1779814964.1595643, "t_first_token_unix": 1779814961.2982702, "tpot_s": 0.01529948483937156, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13531652], "trace_timestamp_s": 443.8810000000003, "ttft_s": 8.308096622989979, "turn_id": 4} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 13749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13749, "latency_s": 2.240657882008236, "output_length": 60, "proxy_request_id": "1367312:1:1367312:566", "request_id": "1367312:1:1367312:566", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1367312", "t_dispatch_unix": 1779814962.03217, "t_finish_unix": 1779814964.2728276, "t_first_token_unix": 1779814963.779515, "tpot_s": 0.008357716321755769, "trace_hash_ids": [13521767, 13521768, 13521769, 13521770, 13521771, 13521772, 13529702, 13529703, 13529704, 13529705, 13529706, 13529707, 13537903, 13537904, 13537905, 13537906, 13537907, 13537908, 13537909, 13537910, 13554581, 13554582, 13554583, 13554584, 13554585, 13554586, 13554587], "trace_timestamp_s": 452.9180000000006, "ttft_s": 1.7473437070148066, "turn_id": 1} +{"actual_output_tokens": 60, "cached_tokens": 19984, "effective_input_length": 20026, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20026, "latency_s": 1.0077663089614362, "output_length": 60, "proxy_request_id": "1355484:5:1366753:560", "request_id": "1355484:5:1366753:560", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1355484", "t_dispatch_unix": 1779814964.1607125, "t_finish_unix": 1779814965.168479, "t_first_token_unix": 1779814964.2628963, "tpot_s": 0.015343162609990371, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13549316], "trace_timestamp_s": 450.7640000000001, "ttft_s": 0.10218267200980335, "turn_id": 5} +{"actual_output_tokens": 58, "cached_tokens": 13808, "effective_input_length": 15501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15501, "latency_s": 0.7047392909880728, "output_length": 58, "proxy_request_id": "1367312:2:1368064:574", "request_id": "1367312:2:1368064:574", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1367312", "t_dispatch_unix": 1779814964.7281363, "t_finish_unix": 1779814965.4328752, "t_first_token_unix": 1779814965.030683, "tpot_s": 0.007051070333099025, "trace_hash_ids": [13521767, 13521768, 13521769, 13521770, 13521771, 13521772, 13529702, 13529703, 13529704, 13529705, 13529706, 13529707, 13537903, 13537904, 13537905, 13537906, 13537907, 13537908, 13537909, 13537910, 13554581, 13554582, 13554583, 13554584, 13554585, 13554586, 13561194, 13561195, 13561196, 13561197, 13561198], "trace_timestamp_s": 455.6180000000004, "ttft_s": 0.3025450099958107, "turn_id": 2} +{"actual_output_tokens": 254, "cached_tokens": 11776, "effective_input_length": 18815, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18815, "latency_s": 4.201385412015952, "output_length": 254, "proxy_request_id": "1367169:1:1367169:562", "request_id": "1367169:1:1367169:562", "request_type": "coder", "requested_output_tokens": 254, "session_id": "1367169", "t_dispatch_unix": 1779814961.5479066, "t_finish_unix": 1779814965.7492914, "t_first_token_unix": 1779814962.5086231, "tpot_s": 0.012807907608637712, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 1489202, 13282259, 13553463, 13553464, 3656637, 13553465, 13553466, 13553467, 13424449, 13424450, 13424451, 13424452, 13553468, 13553469], "trace_timestamp_s": 452.4360000000006, "ttft_s": 0.9607157740392722, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 62685, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62685, "latency_s": 19.0605465490371, "output_length": 68, "proxy_request_id": "1363093:1:1363093:538", "request_id": "1363093:1:1363093:538", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1363093", "t_dispatch_unix": 1779814947.1884177, "t_finish_unix": 1779814966.2489643, "t_first_token_unix": 1779814961.6326423, "tpot_s": 0.06889642106018154, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933], "trace_timestamp_s": 438.0560000000005, "ttft_s": 14.444221334997565, "turn_id": 1} +{"actual_output_tokens": 96, "cached_tokens": 35360, "effective_input_length": 37232, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37232, "latency_s": 18.3890671270201, "output_length": 96, "proxy_request_id": "1355951:2:1363365:540", "request_id": "1355951:2:1363365:540", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1355951", "t_dispatch_unix": 1779814948.2154248, "t_finish_unix": 1779814966.6044922, "t_first_token_unix": 1779814961.6355796, "tpot_s": 0.052301339442400556, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978], "trace_timestamp_s": 439.1050000000005, "ttft_s": 13.420152882987168, "turn_id": 2} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 7048, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7048, "latency_s": 1.3260605180403218, "output_length": 57, "proxy_request_id": "1364960:2:1368239:578", "request_id": "1364960:2:1368239:578", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1364960", "t_dispatch_unix": 1779814965.3291712, "t_finish_unix": 1779814966.6552315, "t_first_token_unix": 1779814965.8289812, "tpot_s": 0.014750163642539909, "trace_hash_ids": [13526287, 13526288, 13526289, 13533401, 13540695, 13540696, 13540697, 13540698, 13540699, 13549445, 13549446, 13556212, 13562654, 13562655], "trace_timestamp_s": 456.21800000000076, "ttft_s": 0.49980880302609876, "turn_id": 2} +{"actual_output_tokens": 95, "cached_tokens": 0, "effective_input_length": 26837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26837, "latency_s": 4.792180404008832, "output_length": 95, "proxy_request_id": "1367329:1:1367329:567", "request_id": "1367329:1:1367329:567", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1367329", "t_dispatch_unix": 1779814962.0915196, "t_finish_unix": 1779814966.8836997, "t_first_token_unix": 1779814965.4461136, "tpot_s": 0.015290578872465746, "trace_hash_ids": [13554866, 13554867, 13554868, 13554869, 13554870, 13554871, 13554872, 13554873, 13554874, 13554875, 13554876, 13554877, 13554878, 13554879, 13554880, 13554881, 13554882, 13554883, 13554884, 13554885, 13554886, 13554887, 13554888, 13554889, 13554890, 13554891, 13554892, 13554893, 13554894, 13554895, 13554896, 13554897, 13554898, 13554899, 13554900, 13554901, 13554902, 13554903, 13554904, 13554905, 13554906, 13554907, 13554908, 13554909, 13554910, 13554911, 13554912, 13554913, 13554914, 13554915, 13554916, 13554917, 13554918], "trace_timestamp_s": 452.97200000000066, "ttft_s": 3.354592508985661, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 21773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21773, "latency_s": 2.493148147012107, "output_length": 26, "proxy_request_id": "1368070:1:1368070:575", "request_id": "1368070:1:1368070:575", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1368070", "t_dispatch_unix": 1779814964.75198, "t_finish_unix": 1779814967.2451284, "t_first_token_unix": 1779814967.1115665, "tpot_s": 0.005320652960799635, "trace_hash_ids": [13522908, 13522909, 13522910, 13522911, 13529691, 13529692, 13529693, 13529694, 13529695, 13529696, 13529697, 13529698, 13529699, 13537845, 13537846, 13537847, 13537848, 13547043, 13547044, 13547045, 13547046, 13547047, 13547048, 13547049, 13556102, 13556103, 13556104, 13556105, 13556106, 13556107, 13556108, 13556109, 13556110, 13556111, 13556112, 13561206, 13561207, 13561208, 13561209, 13561210, 13561211, 13561212, 13561213], "trace_timestamp_s": 455.634, "ttft_s": 2.3595844759838656, "turn_id": 1} +{"actual_output_tokens": 457, "cached_tokens": 24544, "effective_input_length": 59514, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59514, "latency_s": 17.156665163987782, "output_length": 457, "proxy_request_id": "1313181:3:1364311:547", "request_id": "1313181:3:1364311:547", "request_type": "coder", "requested_output_tokens": 457, "session_id": "1313181", "t_dispatch_unix": 1779814951.2848277, "t_finish_unix": 1779814968.4414928, "t_first_token_unix": 1779814961.3072731, "tpot_s": 0.015644503841988473, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13527469], "trace_timestamp_s": 442.174, "ttft_s": 10.022442362038419, "turn_id": 3} +{"actual_output_tokens": 162, "cached_tokens": 62752, "effective_input_length": 63235, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63235, "latency_s": 2.1178225749754347, "output_length": 162, "proxy_request_id": "1363093:2:1368700:580", "request_id": "1363093:2:1368700:580", "request_type": "coder", "requested_output_tokens": 162, "session_id": "1363093", "t_dispatch_unix": 1779814966.9053235, "t_finish_unix": 1779814969.0231452, "t_first_token_unix": 1779814967.2622218, "tpot_s": 0.010935582385054264, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147], "trace_timestamp_s": 457.7940000000008, "ttft_s": 0.3568960779812187, "turn_id": 2} +{"actual_output_tokens": 330, "cached_tokens": 6656, "effective_input_length": 8845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8845, "latency_s": 4.078562263981439, "output_length": 330, "proxy_request_id": "1368132:1:1368132:577", "request_id": "1368132:1:1368132:577", "request_type": "coder", "requested_output_tokens": 330, "session_id": "1368132", "t_dispatch_unix": 1779814964.9990203, "t_finish_unix": 1779814969.0775826, "t_first_token_unix": 1779814965.3372402, "tpot_s": 0.011367940455908663, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13561809, 13561810, 13561811, 8518241, 13561812], "trace_timestamp_s": 455.8890000000001, "ttft_s": 0.3382188440300524, "turn_id": 1} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 6345, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6345, "latency_s": 0.6583653219859116, "output_length": 48, "proxy_request_id": "1369172:1:1369172:581", "request_id": "1369172:1:1369172:581", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1369172", "t_dispatch_unix": 1779814968.5963862, "t_finish_unix": 1779814969.2547517, "t_first_token_unix": 1779814969.015855, "tpot_s": 0.005077604957400484, "trace_hash_ids": [13562302, 13562303, 13562304, 13562305, 13562306, 13562307, 13562308, 13562309, 13571383, 13571384, 13571385, 13571386, 13571387], "trace_timestamp_s": 459.4850000000006, "ttft_s": 0.41946702101267874, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 42688, "effective_input_length": 42704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42704, "latency_s": 1.29223338002339, "output_length": 97, "proxy_request_id": "1313181:4:1318843:342", "request_id": "1313181:4:1318843:342", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1313181", "t_dispatch_unix": 1779814968.450283, "t_finish_unix": 1779814969.7425168, "t_first_token_unix": 1779814968.5479028, "tpot_s": 0.012439900635096516, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13103391], "trace_timestamp_s": 282.26900000000023, "ttft_s": 0.09761775803053752, "turn_id": 4} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7712, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7712, "latency_s": 0.651852817973122, "output_length": 24, "proxy_request_id": "1369768:1:1369768:584", "request_id": "1369768:1:1369768:584", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1369768", "t_dispatch_unix": 1779814970.6028657, "t_finish_unix": 1779814971.2547185, "t_first_token_unix": 1779814971.1403277, "tpot_s": 0.0049628904797946625, "trace_hash_ids": [13550468, 13550469, 13550470, 13550471, 13562017, 13562018, 13562019, 13562020, 13562021, 13562022, 13562023, 13568764, 13568765, 13568766, 13576622, 13576623], "trace_timestamp_s": 461.4880000000003, "ttft_s": 0.537460844963789, "turn_id": 1} +{"actual_output_tokens": 14, "cached_tokens": 0, "effective_input_length": 11133, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11133, "latency_s": 0.9960253689787351, "output_length": 14, "proxy_request_id": "1367424:2:1370211:588", "request_id": "1367424:2:1370211:588", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1367424", "t_dispatch_unix": 1779814972.0753572, "t_finish_unix": 1779814973.0713825, "t_first_token_unix": 1779814972.9716926, "tpot_s": 0.007647945232187899, "trace_hash_ids": [13550847, 13550848, 13555750, 13555751, 13555752, 13555753, 13566763, 13566764, 13566765, 13566766, 13566767, 13571939, 13571940, 13571941, 13571942, 13581578, 13581579, 13581580, 13581581, 13581582, 13581583, 13581584], "trace_timestamp_s": 462.96300000000065, "ttft_s": 0.8963343069772236, "turn_id": 2} +{"actual_output_tokens": 89, "cached_tokens": 0, "effective_input_length": 2381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2381, "latency_s": 1.3216415300266817, "output_length": 89, "proxy_request_id": "1370269:1:1370269:591", "request_id": "1370269:1:1370269:591", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1370269", "t_dispatch_unix": 1779814972.3337831, "t_finish_unix": 1779814973.6554246, "t_first_token_unix": 1779814972.6502323, "tpot_s": 0.01141819469326451, "trace_hash_ids": [13582035, 13582036, 13582037, 13582038, 13582039], "trace_timestamp_s": 463.22400000000016, "ttft_s": 0.31644810701254755, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7710, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7710, "latency_s": 0.7150681769708171, "output_length": 24, "proxy_request_id": "1370466:1:1370466:592", "request_id": "1370466:1:1370466:592", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1370466", "t_dispatch_unix": 1779814973.1227157, "t_finish_unix": 1779814973.8377843, "t_first_token_unix": 1779814973.6578457, "tpot_s": 0.007809767087050916, "trace_hash_ids": [13584429, 13584430, 13584431, 13584432, 13584433, 13584434, 13584435, 13584436, 13584437, 13584438, 13584439, 13584440, 13584441, 13584442, 13584443, 13584444], "trace_timestamp_s": 464.0110000000004, "ttft_s": 0.535128838964738, "turn_id": 1} +{"actual_output_tokens": 8887, "cached_tokens": 15056, "effective_input_length": 21371, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21371, "latency_s": 107.57578512100736, "output_length": 8887, "proxy_request_id": "1336620:3:1339999:443", "request_id": "1336620:3:1339999:443", "request_type": "coder", "requested_output_tokens": 8887, "session_id": "1336620", "t_dispatch_unix": 1779814866.5003152, "t_finish_unix": 1779814974.0761003, "t_first_token_unix": 1779814867.5016036, "tpot_s": 0.011993479170041435, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13287309, 13302600, 13302601, 13302602, 13302603, 13302604, 13302605, 13302606, 13302607, 13302608, 13302609, 13302610, 13302611, 13302612], "trace_timestamp_s": 357.3890000000001, "ttft_s": 1.0012864420423284, "turn_id": 3} +{"actual_output_tokens": 51, "cached_tokens": 36416, "effective_input_length": 36583, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36583, "latency_s": 0.7862368630012497, "output_length": 51, "proxy_request_id": "1277428:6:1371101:593", "request_id": "1277428:6:1371101:593", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1277428", "t_dispatch_unix": 1779814975.153399, "t_finish_unix": 1779814975.9396358, "t_first_token_unix": 1779814975.3353813, "tpot_s": 0.012079837080091239, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983, 13590659], "trace_timestamp_s": 466.0430000000006, "ttft_s": 0.18197239801520482, "turn_id": 6} +{"actual_output_tokens": 512, "cached_tokens": 7680, "effective_input_length": 18301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18301, "latency_s": 4.349316687032115, "output_length": 512, "proxy_request_id": "1370129:1:1370129:587", "request_id": "1370129:1:1370129:587", "request_type": "coder", "requested_output_tokens": 512, "session_id": "1370129", "t_dispatch_unix": 1779814971.8524408, "t_finish_unix": 1779814976.2017574, "t_first_token_unix": 1779814973.1549215, "tpot_s": 0.005962031737718104, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13580719], "trace_timestamp_s": 462.7390000000005, "ttft_s": 1.3024786910391413, "turn_id": 1} +{"actual_output_tokens": 190, "cached_tokens": 1024, "effective_input_length": 122597, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 122597, "latency_s": 50.91857780399732, "output_length": 190, "proxy_request_id": "1356885:1:1356885:514", "request_id": "1356885:1:1356885:514", "request_type": "coder", "requested_output_tokens": 190, "session_id": "1356885", "t_dispatch_unix": 1779814925.3438334, "t_finish_unix": 1779814976.2624114, "t_first_token_unix": 1779814973.5687406, "tpot_s": 0.014250738687613713, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250], "trace_timestamp_s": 416.1880000000001, "ttft_s": 48.22490521101281, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 20080, "effective_input_length": 20158, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20158, "latency_s": 6.634818433027249, "output_length": 92, "proxy_request_id": "1355484:6:1369697:583", "request_id": "1355484:6:1369697:583", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1355484", "t_dispatch_unix": 1779814970.3773901, "t_finish_unix": 1779814977.0122087, "t_first_token_unix": 1779814975.6465008, "tpot_s": 0.015004758043777567, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13576108], "trace_timestamp_s": 461.26800000000003, "ttft_s": 5.269109375018161, "turn_id": 6} +{"actual_output_tokens": 26, "cached_tokens": 21792, "effective_input_length": 29501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29501, "latency_s": 5.339467724028509, "output_length": 26, "proxy_request_id": "1368070:2:1370108:586", "request_id": "1368070:2:1370108:586", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1368070", "t_dispatch_unix": 1779814971.7791183, "t_finish_unix": 1779814977.1185858, "t_first_token_unix": 1779814973.2914627, "tpot_s": 0.1530711909197271, "trace_hash_ids": [13580541, 13580542, 13580543, 13580544, 13580545, 13580546, 13580547, 13580548, 13580549, 13580550, 13580551, 13580552, 13580553, 13580554, 13580555, 13580556, 13580557, 13580558, 13580559, 13580560, 13580561, 13580562, 13580563, 13580564, 13580565, 13580566, 13580567, 13580568, 13580569, 13580570, 13580571, 13580572, 13580573, 13580574, 13580575, 13580576, 13580577, 13580578, 13580579, 13580580, 13580581, 13580582, 13580583, 13580584, 13580585, 13580586, 13580587, 13580588, 13580589, 13580590, 13580591, 13580592, 13580593, 13580594, 13580595, 13580596, 13580597, 13580598], "trace_timestamp_s": 462.65900000000056, "ttft_s": 1.51234255800955, "turn_id": 2} +{"actual_output_tokens": 375, "cached_tokens": 49056, "effective_input_length": 49483, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49483, "latency_s": 15.90232068405021, "output_length": 375, "proxy_request_id": "1340278:2:1367225:564", "request_id": "1340278:2:1367225:564", "request_type": "coder", "requested_output_tokens": 375, "session_id": "1340278", "t_dispatch_unix": 1779814961.7775667, "t_finish_unix": 1779814977.6798875, "t_first_token_unix": 1779814973.5496883, "tpot_s": 0.01104255150791935, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13553910, 13553911, 13553912, 13553913, 13553914, 13553915, 13553916, 13553917, 13553918, 13553919, 13553920, 13553921, 13553922, 13553923, 13553924, 13553925, 13553926, 13553927, 13553928, 13553929, 13553930, 13553931, 13553932, 13553933, 13553934, 13553935, 13553936, 13553937, 13553938, 13553939, 13553940, 13553941, 13553942, 13553943, 13553944, 13553945, 13553946, 13553947, 13553948, 13553949, 13553950, 13553951, 13553952, 13553953, 13553954, 13553955, 13553956, 13553957, 13553958, 13553959, 13553960, 13553961, 13553962, 13553963, 13553964, 13553965, 13553966, 13553967, 13553968, 13553969, 13553970, 13553971, 13553972, 13553973, 13553974, 13553975, 13553976, 13553977, 13553978, 13553979, 13553980, 13553981, 13553982, 13553983, 13553984], "trace_timestamp_s": 452.65300000000025, "ttft_s": 11.77211902703857, "turn_id": 2} +{"actual_output_tokens": 104, "cached_tokens": 55152, "effective_input_length": 64531, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64531, "latency_s": 5.502360490965657, "output_length": 104, "proxy_request_id": "1342634:2:1370263:590", "request_id": "1342634:2:1370263:590", "request_type": "coder", "requested_output_tokens": 104, "session_id": "1342634", "t_dispatch_unix": 1779814972.3070385, "t_finish_unix": 1779814977.8093994, "t_first_token_unix": 1779814976.9352686, "tpot_s": 0.008483898300944277, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 4565053, 4565054, 4565055, 127456, 127457, 127458, 127459, 4565056, 4565057, 61286, 4565058, 4565059, 4565060, 4565061, 4565062, 4565063, 4565064, 4565065, 4565066, 4565067, 4565068, 4565069, 4565070, 4565071, 4565072, 4565073, 4565074, 4565075, 4565076, 4565077, 4565078, 4565079, 4565080, 4565081, 4565082, 4565083, 4565084, 4565085, 4565086, 4565087, 4565088, 4565089, 13036298, 13036299, 13036300, 13036301, 13036302, 13036303, 13036304, 13036305, 13036306, 13036307, 13036308, 13036309, 13036310, 13036311, 13036312, 13036313, 13036314, 13036315, 13036316, 13036317, 13036318, 13036319, 13036320, 13036321, 13036322, 13036323, 13036324, 13036325, 13036326, 13036327, 13036328, 13036329, 13036330, 13036331, 13036332, 13036333, 13036334, 13036335, 13036336, 13036337, 13068093, 13326543, 13326544, 13326545, 13326546, 13326547, 13326548, 13326549, 13326550, 13326551, 13326552, 13326553, 13326554, 13326555, 13326556, 13326557, 13326558, 13326559, 13326560, 13326561, 13326562, 13326563, 13326564, 13326565, 13326566, 13326567, 13326568, 13326569, 13326570, 13582003, 13582004, 13582005, 13582006, 13582007, 13582008, 13582009, 13582010, 13582011, 13582012, 13582013], "trace_timestamp_s": 463.1940000000004, "ttft_s": 4.628227546985727, "turn_id": 2} +{"actual_output_tokens": 5, "cached_tokens": 49856, "effective_input_length": 50124, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50124, "latency_s": 0.22154002700699493, "output_length": 5, "proxy_request_id": "1340278:3:1368072:576", "request_id": "1340278:3:1368072:576", "request_type": "coder", "requested_output_tokens": 5, "session_id": "1340278", "t_dispatch_unix": 1779814977.6964142, "t_finish_unix": 1779814977.9179537, "t_first_token_unix": 1779814977.8983023, "tpot_s": 0.004832134509342723, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13561220, 13561221, 13561222, 13561223, 13561224, 13561225, 13561226, 13561227, 13561228, 13561229, 13561230, 13561231, 13561232, 13561233, 13561234, 13561235, 13561236, 13561237, 13561238, 13561239, 13561240, 13561241, 13561242, 13561243, 13561244, 13561245, 13561246, 13561247, 13561248, 13561249, 13561250, 13561251, 13561252, 13561253, 13561254, 13561255, 13561256, 13561257, 13561258, 13561259, 13561260, 13561261, 13561262, 13561263, 13561264, 13561265, 13561266, 13561267, 13561268, 13561269, 13561270, 13561271, 13561272, 13561273, 13561274, 13561275, 13561276, 13561277, 13561278, 13561279, 13561280, 13561281, 13561282, 13561283, 13561284, 13561285, 13561286, 13561287, 13561288, 13561289, 13561290, 13561291, 13561292, 13561293], "trace_timestamp_s": 455.64100000000053, "ttft_s": 0.20188600796973333, "turn_id": 3} +{"actual_output_tokens": 99, "cached_tokens": 0, "effective_input_length": 9399, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9399, "latency_s": 2.3649955129949376, "output_length": 99, "proxy_request_id": "1371337:1:1371337:597", "request_id": "1371337:1:1371337:597", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1371337", "t_dispatch_unix": 1779814975.992387, "t_finish_unix": 1779814978.3573828, "t_first_token_unix": 1779814977.5454636, "tpot_s": 0.008281674469483788, "trace_hash_ids": [13566840, 13566841, 13566842, 13566843, 13566844, 13566845, 13566846, 13566847, 13581073, 13592764, 13592765, 13592766, 13592767, 13592768, 13592769, 13592770, 13592771, 13592772, 13592773], "trace_timestamp_s": 466.8800000000001, "ttft_s": 1.5530750069883652, "turn_id": 1} +{"actual_output_tokens": 109, "cached_tokens": 26928, "effective_input_length": 32814, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32814, "latency_s": 2.8434918490238488, "output_length": 109, "proxy_request_id": "1367329:2:1371226:595", "request_id": "1367329:2:1371226:595", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1367329", "t_dispatch_unix": 1779814975.560568, "t_finish_unix": 1779814978.4040594, "t_first_token_unix": 1779814976.8610752, "tpot_s": 0.014284464786652717, "trace_hash_ids": [13554866, 13554867, 13554868, 13554869, 13554870, 13554871, 13554872, 13554873, 13554874, 13554875, 13554876, 13554877, 13554878, 13554879, 13554880, 13554881, 13554882, 13554883, 13554884, 13554885, 13554886, 13554887, 13554888, 13554889, 13554890, 13554891, 13554892, 13554893, 13554894, 13554895, 13554896, 13554897, 13554898, 13554899, 13554900, 13554901, 13554902, 13554903, 13554904, 13554905, 13554906, 13554907, 13554908, 13554909, 13554910, 13554911, 13554912, 13554913, 13554914, 13554915, 13554916, 13554917, 13580089, 13580090, 13580091, 13580092, 13580093, 13580094, 13580095, 13580096, 13591778, 13591779, 13591780, 13591781, 13591782], "trace_timestamp_s": 466.4480000000003, "ttft_s": 1.30050532304449, "turn_id": 2} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 17407, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17407, "latency_s": 2.154433068993967, "output_length": 82, "proxy_request_id": "1371929:1:1371929:601", "request_id": "1371929:1:1371929:601", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1371929", "t_dispatch_unix": 1779814978.1005437, "t_finish_unix": 1779814980.2549765, "t_first_token_unix": 1779814979.7993608, "tpot_s": 0.005621251913166985, "trace_hash_ids": [13547800, 13547801, 13547802, 13547803, 13547804, 13547805, 13547806, 13558211, 13558212, 13558213, 13558214, 13558215, 13558216, 13558217, 13558218, 13558219, 13558220, 13558221, 13558222, 13558223, 13558224, 13558225, 13558226, 13566670, 13566671, 13566672, 13566673, 13566674, 13566675, 13576731, 13576732, 13590638, 13599021, 13599022], "trace_timestamp_s": 468.9850000000006, "ttft_s": 1.6988150090328418, "turn_id": 1} +{"actual_output_tokens": 131, "cached_tokens": 0, "effective_input_length": 13616, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13616, "latency_s": 4.16582394199213, "output_length": 131, "proxy_request_id": "1371622:1:1371622:598", "request_id": "1371622:1:1371622:598", "request_type": "coder", "requested_output_tokens": 131, "session_id": "1371622", "t_dispatch_unix": 1779814976.995015, "t_finish_unix": 1779814981.1608386, "t_first_token_unix": 1779814978.168258, "tpot_s": 0.023017055953655823, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 13595701], "trace_timestamp_s": 467.8850000000002, "ttft_s": 1.173241547017824, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 4811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4811, "latency_s": 0.48213432397460565, "output_length": 36, "proxy_request_id": "1372791:1:1372791:604", "request_id": "1372791:1:1372791:604", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1372791", "t_dispatch_unix": 1779814981.1077435, "t_finish_unix": 1779814981.5898778, "t_first_token_unix": 1779814981.4123573, "tpot_s": 0.00506319859996438, "trace_hash_ids": [13606288, 13606289, 13606290, 13606291, 13606292, 13606293, 13606294, 13606295, 13606296, 13606297], "trace_timestamp_s": 471.9970000000003, "ttft_s": 0.3046126809786074, "turn_id": 1} +{"actual_output_tokens": 288, "cached_tokens": 20240, "effective_input_length": 22992, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22992, "latency_s": 5.058255099982489, "output_length": 288, "proxy_request_id": "1355484:7:1371284:596", "request_id": "1355484:7:1371284:596", "request_type": "coder", "requested_output_tokens": 288, "session_id": "1355484", "t_dispatch_unix": 1779814977.014232, "t_finish_unix": 1779814982.0724869, "t_first_token_unix": 1779814977.574594, "tpot_s": 0.015670833714307976, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13592323], "trace_timestamp_s": 466.6750000000002, "ttft_s": 0.5603604189818725, "turn_id": 7} +{"actual_output_tokens": 21, "cached_tokens": 10160, "effective_input_length": 10284, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10284, "latency_s": 0.20849247102160007, "output_length": 21, "proxy_request_id": "1362265:3:1373357:605", "request_id": "1362265:3:1373357:605", "request_type": "coder", "requested_output_tokens": 21, "session_id": "1362265", "t_dispatch_unix": 1779814983.1094608, "t_finish_unix": 1779814983.3179533, "t_first_token_unix": 1779814983.1716545, "tpot_s": 0.007293544698040932, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13610624], "trace_timestamp_s": 474.0, "ttft_s": 0.06219235004391521, "turn_id": 3} +{"actual_output_tokens": 2009, "cached_tokens": 98224, "effective_input_length": 98267, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98267, "latency_s": 26.223305313033052, "output_length": 2009, "proxy_request_id": "1279412:25:1366203:554", "request_id": "1279412:25:1366203:554", "request_type": "coder", "requested_output_tokens": 2009, "session_id": "1279412", "t_dispatch_unix": 1779814957.9834569, "t_finish_unix": 1779814984.2067618, "t_first_token_unix": 1779814958.2008507, "tpot_s": 0.012950999787333793, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104], "trace_timestamp_s": 448.8700000000008, "ttft_s": 0.21739140403224155, "turn_id": 25} +{"actual_output_tokens": 32, "cached_tokens": 14976, "effective_input_length": 15871, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15871, "latency_s": 19.039015290967654, "output_length": 32, "proxy_request_id": "1357132:5:1368445:579", "request_id": "1357132:5:1368445:579", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1357132", "t_dispatch_unix": 1779814966.1164963, "t_finish_unix": 1779814985.1555119, "t_first_token_unix": 1779814983.9108775, "tpot_s": 0.04013367390425335, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710, 13564577, 13564578], "trace_timestamp_s": 457.0070000000005, "ttft_s": 17.794377959973644, "turn_id": 5} +{"actual_output_tokens": 42, "cached_tokens": 15488, "effective_input_length": 23307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23307, "latency_s": 14.226244696998037, "output_length": 42, "proxy_request_id": "1366128:3:1369902:585", "request_id": "1366128:3:1369902:585", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1366128", "t_dispatch_unix": 1779814971.0647883, "t_finish_unix": 1779814985.2910328, "t_first_token_unix": 1779814984.688691, "tpot_s": 0.01468020475543354, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13578302], "trace_timestamp_s": 461.9520000000002, "ttft_s": 13.623901129001752, "turn_id": 3} +{"actual_output_tokens": 520, "cached_tokens": 36624, "effective_input_length": 38252, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38252, "latency_s": 6.387916548002977, "output_length": 520, "proxy_request_id": "1277428:7:1372183:602", "request_id": "1277428:7:1372183:602", "request_type": "coder", "requested_output_tokens": 520, "session_id": "1277428", "t_dispatch_unix": 1779814979.0670843, "t_finish_unix": 1779814985.4550009, "t_first_token_unix": 1779814979.6101923, "tpot_s": 0.011261151219661633, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983, 13601623, 13601624, 13601625, 13601626], "trace_timestamp_s": 469.9549999999999, "ttft_s": 0.543105838005431, "turn_id": 7} +{"actual_output_tokens": 956, "cached_tokens": 14480, "effective_input_length": 26705, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26705, "latency_s": 8.927207781991456, "output_length": 956, "proxy_request_id": "1364090:2:1371798:600", "request_id": "1364090:2:1371798:600", "request_type": "coder", "requested_output_tokens": 956, "session_id": "1364090", "t_dispatch_unix": 1779814977.634094, "t_finish_unix": 1779814986.561302, "t_first_token_unix": 1779814980.1663532, "tpot_s": 0.006696021182191953, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13597497], "trace_timestamp_s": 468.52000000000044, "ttft_s": 2.532256322039757, "turn_id": 2} +{"actual_output_tokens": 821, "cached_tokens": 42800, "effective_input_length": 60004, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60004, "latency_s": 18.183976005995646, "output_length": 821, "proxy_request_id": "1313181:4:1368020:573", "request_id": "1313181:4:1368020:573", "request_type": "coder", "requested_output_tokens": 821, "session_id": "1313181", "t_dispatch_unix": 1779814969.7451944, "t_finish_unix": 1779814987.9291701, "t_first_token_unix": 1779814975.6452127, "tpot_s": 0.014980109911000287, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13560946], "trace_timestamp_s": 455.47700000000077, "ttft_s": 5.900016154977493, "turn_id": 4} +{"actual_output_tokens": 65, "cached_tokens": 0, "effective_input_length": 19862, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19862, "latency_s": 2.4213914020219818, "output_length": 65, "proxy_request_id": "1374347:1:1374347:611", "request_id": "1374347:1:1374347:611", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1374347", "t_dispatch_unix": 1779814986.6162636, "t_finish_unix": 1779814989.037655, "t_first_token_unix": 1779814988.6710002, "tpot_s": 0.005722027719457401, "trace_hash_ids": [13586651, 13586652, 13586653, 13586654, 13586655, 13586656, 13586657, 13586658, 13586659, 13586660, 13586661, 13586662, 13586663, 13586664, 13586665, 13586666, 13586667, 13586668, 13586669, 13586670, 13586671, 13598853, 13598854, 13598855, 13598856, 13598857, 13598858, 13598859, 13598860, 13608483, 13608484, 13608485, 13608486, 13608487, 13619670, 13619671, 13619672, 13619673, 13619674], "trace_timestamp_s": 477.5, "ttft_s": 2.054734628996812, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 18497, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18497, "latency_s": 2.028885675012134, "output_length": 38, "proxy_request_id": "1374465:1:1374465:613", "request_id": "1374465:1:1374465:613", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1374465", "t_dispatch_unix": 1779814987.0581286, "t_finish_unix": 1779814989.0870144, "t_first_token_unix": 1779814988.887024, "tpot_s": 0.005397203216341803, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867], "trace_timestamp_s": 477.942, "ttft_s": 1.8288933250005357, "turn_id": 1} +{"actual_output_tokens": 356, "cached_tokens": 34656, "effective_input_length": 34679, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34679, "latency_s": 48.87631587602664, "output_length": 356, "proxy_request_id": "1344773:10:1361326:533", "request_id": "1344773:10:1361326:533", "request_type": "coder", "requested_output_tokens": 356, "session_id": "1344773", "t_dispatch_unix": 1779814941.1343257, "t_finish_unix": 1779814990.0106423, "t_first_token_unix": 1779814983.4978309, "tpot_s": 0.018344507706974645, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13500244], "trace_timestamp_s": 432.02500000000055, "ttft_s": 42.36350304703228, "turn_id": 10} +{"actual_output_tokens": 89, "cached_tokens": 35024, "effective_input_length": 35071, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35071, "latency_s": 1.4672071580425836, "output_length": 89, "proxy_request_id": "1344773:11:1366387:555", "request_id": "1344773:11:1366387:555", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1344773", "t_dispatch_unix": 1779814990.0126715, "t_finish_unix": 1779814991.4798782, "t_first_token_unix": 1779814990.1230595, "tpot_s": 0.015414560761366209, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13545744], "trace_timestamp_s": 449.5610000000006, "ttft_s": 0.11038657004246488, "turn_id": 11} +{"actual_output_tokens": 614, "cached_tokens": 0, "effective_input_length": 117888, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117888, "latency_s": 55.51588735502446, "output_length": 614, "proxy_request_id": "1360649:1:1360649:527", "request_id": "1360649:1:1360649:527", "request_type": "coder", "requested_output_tokens": 614, "session_id": "1360649", "t_dispatch_unix": 1779814938.615908, "t_finish_unix": 1779814994.1317947, "t_first_token_unix": 1779814983.5216594, "tpot_s": 0.017307643722598465, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 102342, 102343, 102344, 102345, 102346, 102347, 102348, 102349, 102350, 102351, 1097540, 1097541, 1097542, 1097543, 1097544, 1097545, 1097546, 1097547, 1097548, 1097549, 1097550, 1097551, 1097552, 2097078, 2097079, 2097080, 6400718, 6400719, 6400720, 6400721, 6400722, 6400723, 6400724, 6400725, 6400726, 6400727, 6400728, 6400729, 6400730, 6400731, 6400732, 6400733, 6400734, 6400735, 6400736, 6400737, 6400738, 6400739, 6400740, 6400741, 6400742, 6400743, 6400744, 6400745, 6400746, 6400747, 6400748, 6400749, 6400750, 6400751, 6400752, 6400753, 6400754, 6400755, 6400756, 6400757, 8009133, 8009134, 8009135, 8009136, 8009137, 8009138, 8009139, 8009140, 8009141, 8009142, 8009143, 8009144, 8009145, 8009146, 8009147, 8009148, 8009149, 8009150, 8009151, 8348761, 8348762, 9534642, 9534643, 9534644, 9534645, 9534646, 9534647, 9534648, 9534649, 9534650, 9534651, 9534652, 9534653, 9534654, 9868654, 9868655, 9868656, 10214275, 10214276, 10214277, 10237087, 10237088, 10237089, 10271265, 10271266, 10765786, 10765787, 10765788, 10765789, 10765790, 10765791, 10765792, 10795530, 10795531, 10795532, 10876221, 10876222, 10876223, 11181494, 11232572, 11232573, 11277307, 11277308, 11298127, 11298128, 11298129, 11490882, 11490883, 11490884, 11490885, 12220320, 12220321, 12220322, 12220323, 12220324, 12220325, 12220326, 12220327, 12241076, 12241077, 12241078, 12241079, 12241080, 12241081, 12703418, 12703419, 12703420, 12703421, 12703422, 12703423, 12703424, 12703425, 12703426, 12703427, 12703428, 12703429, 12773085, 12833183, 12857953, 12905536, 12905537, 12905538, 12948771, 12948772, 13065333, 13065334, 13102786, 13102787, 13102788, 13102789, 13121628, 13174865, 13174866, 13240785, 13240786, 13240787, 13311934, 13311935, 13311936, 13468170, 13468171, 13493539, 13493540, 13493541, 13493542, 13493543, 13493544, 13493545, 13493546, 13493547, 13493548, 13493549, 13493550, 13493551, 13493552, 13493553, 13493554, 13493555, 13493556, 13493557, 13493558, 13493559, 13493560, 13493561, 13493562, 13493563, 13493564, 13493565, 13493566, 13493567, 13493568, 13493569, 13493570, 13493571, 13493572, 13493573, 13493574], "trace_timestamp_s": 429.46200000000044, "ttft_s": 44.905749273020774, "turn_id": 1} +{"actual_output_tokens": 56, "cached_tokens": 18528, "effective_input_length": 21588, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21588, "latency_s": 0.853488013963215, "output_length": 56, "proxy_request_id": "1374465:2:1376358:620", "request_id": "1374465:2:1376358:620", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1374465", "t_dispatch_unix": 1779814993.4607942, "t_finish_unix": 1779814994.3142817, "t_first_token_unix": 1779814994.0008354, "tpot_s": 0.005693926163737408, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867, 13637304, 5578065, 5578066, 5578067, 5578068, 5578069], "trace_timestamp_s": 484.35000000000036, "ttft_s": 0.5400399969657883, "turn_id": 2} +{"actual_output_tokens": 191, "cached_tokens": 35152, "effective_input_length": 35194, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35194, "latency_s": 3.459166735992767, "output_length": 191, "proxy_request_id": "1344773:12:1367864:571", "request_id": "1344773:12:1367864:571", "request_type": "coder", "requested_output_tokens": 191, "session_id": "1344773", "t_dispatch_unix": 1779814991.4812791, "t_finish_unix": 1779814994.9404464, "t_first_token_unix": 1779814991.60616, "tpot_s": 0.017546548926283753, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13559222], "trace_timestamp_s": 454.8190000000004, "ttft_s": 0.12487822998082265, "turn_id": 12} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 72919, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72919, "latency_s": 30.766700192994904, "output_length": 82, "proxy_request_id": "1367957:1:1367957:572", "request_id": "1367957:1:1367957:572", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1367957", "t_dispatch_unix": 1779814964.3099213, "t_finish_unix": 1779814995.0766213, "t_first_token_unix": 1779814982.7970543, "tpot_s": 0.15159626177765062, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 13560201, 5631592, 280979, 5631593, 1028, 1029, 1030, 1031, 1032, 1033, 1034, 1035, 1036, 1037, 1038, 1039, 1040, 1041, 1042, 1043, 1044, 1045, 1046, 1047, 1048, 1049, 5631594, 5631595, 5631596, 5631597, 5631598, 5631599, 706016, 706017, 1656985, 1656986, 1656987, 1656988, 1656989, 5631600, 10791724, 10856701, 11045334, 11180683, 11180684, 11180685, 11180686, 11180687, 11180688, 11180689, 11180690, 11180691, 11180692, 11180693, 11180694, 11395208, 11395209, 11395210, 11395211, 11395212, 11395213, 11395214, 11395215, 11395216, 11395217, 11395218, 11395219, 11416612, 11498725, 11563787, 11669770, 11900719, 11900720, 11900721, 11900722, 11900723, 11900724, 11900725, 11900726, 11900727, 11900728, 11900729, 11900730, 11900731, 12056875, 12056876, 12056877, 12056878, 12719496, 12719497, 12719498, 12719499, 12719500, 12719501, 12752184, 12786713, 12836975, 12926110, 12926111, 12926112, 12955719, 13336475, 13382319, 13469603, 13469604, 13560202], "trace_timestamp_s": 455.1790000000001, "ttft_s": 18.48712967004394, "turn_id": 1} +{"actual_output_tokens": 7, "cached_tokens": 35376, "effective_input_length": 35413, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35413, "latency_s": 0.1772782129701227, "output_length": 7, "proxy_request_id": "1344773:13:1370257:589", "request_id": "1344773:13:1370257:589", "request_type": "coder", "requested_output_tokens": 7, "session_id": "1344773", "t_dispatch_unix": 1779814994.9423828, "t_finish_unix": 1779814995.1196613, "t_first_token_unix": 1779814995.0523932, "tpot_s": 0.011141432002962878, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13581991, 13581992], "trace_timestamp_s": 463.15700000000015, "ttft_s": 0.1100083320052363, "turn_id": 13} +{"actual_output_tokens": 42, "cached_tokens": 23344, "effective_input_length": 35037, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35037, "latency_s": 9.883127245993819, "output_length": 42, "proxy_request_id": "1366128:4:1371629:599", "request_id": "1366128:4:1371629:599", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1366128", "t_dispatch_unix": 1779814985.2971675, "t_finish_unix": 1779814995.1802948, "t_first_token_unix": 1779814987.8618033, "tpot_s": 0.1784882842443838, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13595748], "trace_timestamp_s": 467.90000000000055, "ttft_s": 2.5646335409837775, "turn_id": 4} +{"actual_output_tokens": 663, "cached_tokens": 0, "effective_input_length": 16057, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16057, "latency_s": 47.60990591504378, "output_length": 663, "proxy_request_id": "1305906:2:1363233:539", "request_id": "1305906:2:1363233:539", "request_type": "coder", "requested_output_tokens": 663, "session_id": "1305906", "t_dispatch_unix": 1779814947.6784897, "t_finish_unix": 1779814995.288396, "t_first_token_unix": 1779814984.5148535, "tpot_s": 0.016273656374637003, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13517857, 13517858, 13517859, 13517860, 13517861], "trace_timestamp_s": 438.5680000000002, "ttft_s": 36.83636046200991, "turn_id": 2} +{"actual_output_tokens": 120, "cached_tokens": 118496, "effective_input_length": 119052, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119052, "latency_s": 2.0590777960023843, "output_length": 120, "proxy_request_id": "1360649:2:1367022:561", "request_id": "1360649:2:1367022:561", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1360649", "t_dispatch_unix": 1779814994.1451182, "t_finish_unix": 1779814996.2041955, "t_first_token_unix": 1779814994.815228, "tpot_s": 0.011667495260324267, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 102342, 102343, 102344, 102345, 102346, 102347, 102348, 102349, 102350, 102351, 1097540, 1097541, 1097542, 1097543, 1097544, 1097545, 1097546, 1097547, 1097548, 1097549, 1097550, 1097551, 1097552, 2097078, 2097079, 2097080, 6400718, 6400719, 6400720, 6400721, 6400722, 6400723, 6400724, 6400725, 6400726, 6400727, 6400728, 6400729, 6400730, 6400731, 6400732, 6400733, 6400734, 6400735, 6400736, 6400737, 6400738, 6400739, 6400740, 6400741, 6400742, 6400743, 6400744, 6400745, 6400746, 6400747, 6400748, 6400749, 6400750, 6400751, 6400752, 6400753, 6400754, 6400755, 6400756, 6400757, 8009133, 8009134, 8009135, 8009136, 8009137, 8009138, 8009139, 8009140, 8009141, 8009142, 8009143, 8009144, 8009145, 8009146, 8009147, 8009148, 8009149, 8009150, 8009151, 8348761, 8348762, 9534642, 9534643, 9534644, 9534645, 9534646, 9534647, 9534648, 9534649, 9534650, 9534651, 9534652, 9534653, 9534654, 9868654, 9868655, 9868656, 10214275, 10214276, 10214277, 10237087, 10237088, 10237089, 10271265, 10271266, 10765786, 10765787, 10765788, 10765789, 10765790, 10765791, 10765792, 10795530, 10795531, 10795532, 10876221, 10876222, 10876223, 11181494, 11232572, 11232573, 11277307, 11277308, 11298127, 11298128, 11298129, 11490882, 11490883, 11490884, 11490885, 12220320, 12220321, 12220322, 12220323, 12220324, 12220325, 12220326, 12220327, 12241076, 12241077, 12241078, 12241079, 12241080, 12241081, 12703418, 12703419, 12703420, 12703421, 12703422, 12703423, 12703424, 12703425, 12703426, 12703427, 12703428, 12703429, 12773085, 12833183, 12857953, 12905536, 12905537, 12905538, 12948771, 12948772, 13065333, 13065334, 13102786, 13102787, 13102788, 13102789, 13121628, 13174865, 13174866, 13240785, 13240786, 13240787, 13311934, 13311935, 13311936, 13468170, 13468171, 13493539, 13551893, 13551894, 13551895, 13551896, 13551897, 13551898, 13551899, 13551900, 13551901, 13551902, 13551903, 13551904, 13551905, 13551906, 13551907, 13551908, 13551909, 13551910, 13551911, 13551912, 13551913, 13551914, 13551915, 13551916, 13551917, 13551918, 13551919, 13551920, 13551921, 13551922, 13551923, 13551924, 13551925, 13551926, 13551927, 13551928, 13551929], "trace_timestamp_s": 451.77600000000075, "ttft_s": 0.670106896024663, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 0, "effective_input_length": 24323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24323, "latency_s": 3.416712006961461, "output_length": 98, "proxy_request_id": "1371337:2:1376534:621", "request_id": "1371337:2:1376534:621", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1371337", "t_dispatch_unix": 1779814994.1248305, "t_finish_unix": 1779814997.5415423, "t_first_token_unix": 1779814996.9567516, "tpot_s": 0.006025733567231824, "trace_hash_ids": [13566840, 13566841, 13566842, 13566843, 13566844, 13566845, 13566846, 13566847, 13581073, 13592764, 13592765, 13592766, 13592767, 13592768, 13592769, 13592770, 13592771, 13592772, 13602976, 13602977, 13602978, 13602979, 13602980, 13602981, 13602982, 13602983, 13602984, 13611256, 13611257, 13611258, 13611259, 13611260, 13611261, 13611262, 13621634, 13621635, 13621636, 13621637, 13621638, 13621639, 13621640, 13630722, 13630723, 13630724, 13639093, 13639094, 13639095, 13639096], "trace_timestamp_s": 485.0100000000002, "ttft_s": 2.8319184859865345, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 0, "effective_input_length": 16241, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16241, "latency_s": 1.6229278250248171, "output_length": 28, "proxy_request_id": "1377061:1:1377061:622", "request_id": "1377061:1:1377061:622", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1377061", "t_dispatch_unix": 1779814996.0880966, "t_finish_unix": 1779814997.711024, "t_first_token_unix": 1779814997.5711086, "tpot_s": 0.005172921185105763, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13643801], "trace_timestamp_s": 486.97299999999996, "ttft_s": 1.4830106730223633, "turn_id": 1} +{"actual_output_tokens": 33, "cached_tokens": 35072, "effective_input_length": 46764, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46764, "latency_s": 3.727239297993947, "output_length": 33, "proxy_request_id": "1366128:5:1373829:610", "request_id": "1366128:5:1373829:610", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1366128", "t_dispatch_unix": 1779814995.1865711, "t_finish_unix": 1779814998.9138107, "t_first_token_unix": 1779814998.5565274, "tpot_s": 0.011150992062539444, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13614741], "trace_timestamp_s": 475.71100000000024, "ttft_s": 3.369954025023617, "turn_id": 5} +{"actual_output_tokens": 567, "cached_tokens": 0, "effective_input_length": 56286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56286, "latency_s": 15.984387926990166, "output_length": 567, "proxy_request_id": "1370129:2:1373467:607", "request_id": "1370129:2:1373467:607", "request_type": "coder", "requested_output_tokens": 567, "session_id": "1370129", "t_dispatch_unix": 1779814983.583864, "t_finish_unix": 1779814999.5682518, "t_first_token_unix": 1779814995.075429, "tpot_s": 0.00793742470142132, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500], "trace_timestamp_s": 474.45900000000074, "ttft_s": 11.491562918003183, "turn_id": 2} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 14851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14851, "latency_s": 1.5119242470245808, "output_length": 37, "proxy_request_id": "1372791:2:1377698:624", "request_id": "1372791:2:1377698:624", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1372791", "t_dispatch_unix": 1779814998.3286083, "t_finish_unix": 1779814999.840532, "t_first_token_unix": 1779814999.647673, "tpot_s": 0.005350481667038467, "trace_hash_ids": [13606288, 13606289, 13606290, 13606291, 13606292, 13606293, 13606294, 13606295, 13606296, 13634971, 13634972, 13634973, 13634974, 13634975, 13634976, 13634977, 13642781, 13642782, 13642783, 13642784, 13642785, 13642786, 13650522, 13650523, 13650524, 13650525, 13650526, 13650527, 13650528, 13650529], "trace_timestamp_s": 489.21500000000015, "ttft_s": 1.3190635810024105, "turn_id": 2} +{"actual_output_tokens": 15, "cached_tokens": 16256, "effective_input_length": 16515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16515, "latency_s": 0.2821673650178127, "output_length": 15, "proxy_request_id": "1377061:2:1378590:631", "request_id": "1377061:2:1378590:631", "request_type": "coder", "requested_output_tokens": 15, "session_id": "1377061", "t_dispatch_unix": 1779815001.3578148, "t_finish_unix": 1779815001.6399817, "t_first_token_unix": 1779815001.487197, "tpot_s": 0.010886890073639474, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13658414, 13658415], "trace_timestamp_s": 492.2480000000005, "ttft_s": 0.12938019796274602, "turn_id": 2} +{"actual_output_tokens": 135, "cached_tokens": 100272, "effective_input_length": 100340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100340, "latency_s": 1.6674296730197966, "output_length": 135, "proxy_request_id": "1279412:26:1378269:628", "request_id": "1279412:26:1378269:628", "request_type": "coder", "requested_output_tokens": 135, "session_id": "1279412", "t_dispatch_unix": 1779815000.2444293, "t_finish_unix": 1779815001.911859, "t_first_token_unix": 1779815000.524637, "tpot_s": 0.010349877440169065, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367], "trace_timestamp_s": 491.1310000000003, "ttft_s": 0.2802046540309675, "turn_id": 26} +{"actual_output_tokens": 52, "cached_tokens": 0, "effective_input_length": 7810, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7810, "latency_s": 0.8070430230000056, "output_length": 52, "proxy_request_id": "1378684:1:1378684:632", "request_id": "1378684:1:1378684:632", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1378684", "t_dispatch_unix": 1779815001.694488, "t_finish_unix": 1779815002.5015311, "t_first_token_unix": 1779815002.2384982, "tpot_s": 0.005152560980515737, "trace_hash_ids": [13630792, 13630793, 13630794, 13630795, 13645188, 13645189, 13645190, 13645191, 13659421, 13659422, 13659423, 13659424, 13659425, 13659426, 13659427, 13659428], "trace_timestamp_s": 492.58300000000054, "ttft_s": 0.5440086820162833, "turn_id": 1} +{"actual_output_tokens": 206, "cached_tokens": 0, "effective_input_length": 5458, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5458, "latency_s": 1.4140118039795198, "output_length": 206, "proxy_request_id": "1378543:1:1378543:630", "request_id": "1378543:1:1378543:630", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1378543", "t_dispatch_unix": 1779815001.2026186, "t_finish_unix": 1779815002.6166306, "t_first_token_unix": 1779815001.5593874, "tpot_s": 0.005155850595101805, "trace_hash_ids": [13642933, 13642934, 13642935, 13642936, 13652140, 13652141, 13657982, 13657983, 13657984, 13657985, 13657986], "trace_timestamp_s": 492.09200000000055, "ttft_s": 0.3567669859621674, "turn_id": 1} +{"actual_output_tokens": 302, "cached_tokens": 15792, "effective_input_length": 22132, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22132, "latency_s": 2.838196745957248, "output_length": 302, "proxy_request_id": "1286804:4:1378156:627", "request_id": "1286804:4:1378156:627", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1286804", "t_dispatch_unix": 1779814999.8325918, "t_finish_unix": 1779815002.6707885, "t_first_token_unix": 1779815000.843801, "tpot_s": 0.006068965714259315, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13654392, 13654393, 13654394, 13654395, 13654396, 13654397, 13654398, 13654399, 13654400, 13654401, 13654402, 13654403, 13654404, 13654405], "trace_timestamp_s": 490.72100000000046, "ttft_s": 1.0112073139753193, "turn_id": 4} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 1422, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1422, "latency_s": 0.2817895660409704, "output_length": 38, "proxy_request_id": "1379185:1:1379185:634", "request_id": "1379185:1:1379185:634", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1379185", "t_dispatch_unix": 1779815003.4152672, "t_finish_unix": 1779815003.6970568, "t_first_token_unix": 1779815003.5178683, "tpot_s": 0.004836053134420434, "trace_hash_ids": [13664231, 13664232, 13664233], "trace_timestamp_s": 494.3050000000003, "ttft_s": 0.10260008403565735, "turn_id": 1} +{"actual_output_tokens": 232, "cached_tokens": 13296, "effective_input_length": 18160, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18160, "latency_s": 34.526810775045305, "output_length": 232, "proxy_request_id": "1363943:3:1369535:582", "request_id": "1363943:3:1369535:582", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1363943", "t_dispatch_unix": 1779814969.776692, "t_finish_unix": 1779815004.3035026, "t_first_token_unix": 1779814983.9138463, "tpot_s": 0.08826532678777409, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13574495], "trace_timestamp_s": 460.66499999999996, "ttft_s": 14.137151800037827, "turn_id": 3} +{"actual_output_tokens": 206, "cached_tokens": 0, "effective_input_length": 41508, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41508, "latency_s": 17.166817538964096, "output_length": 206, "proxy_request_id": "1268861:7:1374579:614", "request_id": "1268861:7:1374579:614", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1268861", "t_dispatch_unix": 1779814987.5209951, "t_finish_unix": 1779815004.687812, "t_first_token_unix": 1779814994.716301, "tpot_s": 0.048640435955930136, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13621774], "trace_timestamp_s": 478.40900000000056, "ttft_s": 7.195303610002156, "turn_id": 7} +{"actual_output_tokens": 87, "cached_tokens": 0, "effective_input_length": 2632, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2632, "latency_s": 0.5986329360166565, "output_length": 87, "proxy_request_id": "1379569:1:1379569:638", "request_id": "1379569:1:1379569:638", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1379569", "t_dispatch_unix": 1779815004.643522, "t_finish_unix": 1779815005.242155, "t_first_token_unix": 1779815004.8097973, "tpot_s": 0.005023907941798572, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13667379], "trace_timestamp_s": 495.53400000000056, "ttft_s": 0.16627412103116512, "turn_id": 1} +{"actual_output_tokens": 88, "cached_tokens": 18384, "effective_input_length": 18396, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18396, "latency_s": 0.9871110639651306, "output_length": 88, "proxy_request_id": "1363943:4:1372250:603", "request_id": "1363943:4:1372250:603", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1363943", "t_dispatch_unix": 1779815004.304668, "t_finish_unix": 1779815005.2917793, "t_first_token_unix": 1779815004.3711314, "tpot_s": 0.010579215184030733, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124], "trace_timestamp_s": 470.22900000000027, "ttft_s": 0.0664613859844394, "turn_id": 4} +{"actual_output_tokens": 212, "cached_tokens": 46784, "effective_input_length": 58511, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58511, "latency_s": 6.646185975987464, "output_length": 212, "proxy_request_id": "1366128:6:1375094:616", "request_id": "1366128:6:1375094:616", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1366128", "t_dispatch_unix": 1779814998.9205666, "t_finish_unix": 1779815005.5667522, "t_first_token_unix": 1779815003.0855362, "tpot_s": 0.01175806882473424, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13626307], "trace_timestamp_s": 480.20400000000063, "ttft_s": 4.164967925986275, "turn_id": 6} +{"actual_output_tokens": 99, "cached_tokens": 58720, "effective_input_length": 59007, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59007, "latency_s": 1.1302719250088558, "output_length": 99, "proxy_request_id": "1366128:7:1378071:626", "request_id": "1366128:7:1378071:626", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1366128", "t_dispatch_unix": 1779815005.5703025, "t_finish_unix": 1779815006.7005746, "t_first_token_unix": 1779815005.8052726, "tpot_s": 0.00913181966313218, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13653793], "trace_timestamp_s": 490.46300000000065, "ttft_s": 0.23496723599964753, "turn_id": 7} +{"actual_output_tokens": 181, "cached_tokens": 18480, "effective_input_length": 18676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18676, "latency_s": 1.724422525963746, "output_length": 181, "proxy_request_id": "1363943:5:1373637:609", "request_id": "1363943:5:1373637:609", "request_type": "coder", "requested_output_tokens": 181, "session_id": "1363943", "t_dispatch_unix": 1779815005.2928374, "t_finish_unix": 1779815007.0172606, "t_first_token_unix": 1779815005.3924675, "tpot_s": 0.009024863633223705, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13613147], "trace_timestamp_s": 475.0650000000005, "ttft_s": 0.09962746000383049, "turn_id": 5} +{"actual_output_tokens": 2, "cached_tokens": 5312, "effective_input_length": 5314, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5314, "latency_s": 0.04218159499578178, "output_length": 2, "proxy_request_id": "1378543:2:1380447:644", "request_id": "1378543:2:1380447:644", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1378543", "t_dispatch_unix": 1779815007.682043, "t_finish_unix": 1779815007.7242246, "t_first_token_unix": 1779815007.7183943, "tpot_s": 0.005561996018514037, "trace_hash_ids": [13674795, 13674796, 13674797, 13674798, 13674799, 13674800, 13674801, 13674802, 13674803, 13674804, 13674805], "trace_timestamp_s": 498.5710000000008, "ttft_s": 0.03635026596020907, "turn_id": 2} +{"actual_output_tokens": 2085, "cached_tokens": 12368, "effective_input_length": 35888, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35888, "latency_s": 18.862984128994867, "output_length": 2085, "proxy_request_id": "1301929:2:1375154:617", "request_id": "1301929:2:1375154:617", "request_type": "coder", "requested_output_tokens": 2085, "session_id": "1301929", "t_dispatch_unix": 1779814989.5081542, "t_finish_unix": 1779815008.3711379, "t_first_token_unix": 1779814993.7955837, "tpot_s": 0.006993903411232112, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 5975800], "trace_timestamp_s": 480.39800000000014, "ttft_s": 4.287428034003824, "turn_id": 2} +{"actual_output_tokens": 160, "cached_tokens": 18848, "effective_input_length": 19116, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19116, "latency_s": 1.3799071829998866, "output_length": 160, "proxy_request_id": "1363943:6:1375416:618", "request_id": "1363943:6:1375416:618", "request_type": "coder", "requested_output_tokens": 160, "session_id": "1363943", "t_dispatch_unix": 1779815007.0186381, "t_finish_unix": 1779815008.3985448, "t_first_token_unix": 1779815007.118032, "tpot_s": 0.008051990760920816, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13629311], "trace_timestamp_s": 481.2580000000007, "ttft_s": 0.09939228399889544, "turn_id": 6} +{"actual_output_tokens": 117, "cached_tokens": 2704, "effective_input_length": 6767, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6767, "latency_s": 0.9315816490561701, "output_length": 117, "proxy_request_id": "1379569:2:1380473:645", "request_id": "1379569:2:1380473:645", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1379569", "t_dispatch_unix": 1779815007.828528, "t_finish_unix": 1779815008.7601094, "t_first_token_unix": 1779815008.1498513, "tpot_s": 0.005258332370431162, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13674978], "trace_timestamp_s": 498.71800000000076, "ttft_s": 0.3213218010496348, "turn_id": 2} +{"actual_output_tokens": 82, "cached_tokens": 59104, "effective_input_length": 59230, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59230, "latency_s": 1.2083182479836978, "output_length": 82, "proxy_request_id": "1366128:8:1380438:643", "request_id": "1366128:8:1380438:643", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1366128", "t_dispatch_unix": 1779815007.6374626, "t_finish_unix": 1779815008.8457804, "t_first_token_unix": 1779815007.8358715, "tpot_s": 0.012465013357822173, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13674751], "trace_timestamp_s": 498.52500000000055, "ttft_s": 0.1984063140116632, "turn_id": 8} +{"actual_output_tokens": 189, "cached_tokens": 19264, "effective_input_length": 20727, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20727, "latency_s": 1.4990811590105295, "output_length": 189, "proxy_request_id": "1363943:7:1377305:623", "request_id": "1363943:7:1377305:623", "request_type": "coder", "requested_output_tokens": 189, "session_id": "1363943", "t_dispatch_unix": 1779815008.4002805, "t_finish_unix": 1779815009.8993618, "t_first_token_unix": 1779815008.7091982, "tpot_s": 0.00632897589914253, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13646868], "trace_timestamp_s": 487.90300000000025, "ttft_s": 0.30891644197981805, "turn_id": 7} +{"actual_output_tokens": 633, "cached_tokens": 56848, "effective_input_length": 61457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61457, "latency_s": 7.020437970000785, "output_length": 633, "proxy_request_id": "1370129:3:1379538:637", "request_id": "1370129:3:1379538:637", "request_type": "coder", "requested_output_tokens": 633, "session_id": "1370129", "t_dispatch_unix": 1779815004.52846, "t_finish_unix": 1779815011.548898, "t_first_token_unix": 1779815006.366539, "tpot_s": 0.008199499037961883, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13667066], "trace_timestamp_s": 495.41600000000017, "ttft_s": 1.838076013023965, "turn_id": 3} +{"actual_output_tokens": 42, "cached_tokens": 10304, "effective_input_length": 10645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10645, "latency_s": 0.30810307600768283, "output_length": 42, "proxy_request_id": "1362265:4:1381673:650", "request_id": "1362265:4:1381673:650", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1362265", "t_dispatch_unix": 1779815012.1396565, "t_finish_unix": 1779815012.4477596, "t_first_token_unix": 1779815012.2325122, "tpot_s": 0.005242686561115722, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588], "trace_timestamp_s": 503.03000000000065, "ttft_s": 0.09285412600729614, "turn_id": 4} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 1391, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1391, "latency_s": 0.2552013300010003, "output_length": 31, "proxy_request_id": "1381728:1:1381728:651", "request_id": "1381728:1:1381728:651", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1381728", "t_dispatch_unix": 1779815012.3627646, "t_finish_unix": 1779815012.617966, "t_first_token_unix": 1779815012.4677842, "tpot_s": 0.0049819782997171085, "trace_hash_ids": [13687007, 13687008, 13687009], "trace_timestamp_s": 503.2530000000006, "ttft_s": 0.10501832998124883, "turn_id": 1} +{"actual_output_tokens": 96, "cached_tokens": 6880, "effective_input_length": 7620, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7620, "latency_s": 1.5300702120293863, "output_length": 96, "proxy_request_id": "1379569:3:1381510:649", "request_id": "1379569:3:1381510:649", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1379569", "t_dispatch_unix": 1779815011.4562058, "t_finish_unix": 1779815012.9862761, "t_first_token_unix": 1779815012.328473, "tpot_s": 0.006920967410980283, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13685191, 13685192], "trace_timestamp_s": 502.34700000000066, "ttft_s": 0.872265919984784, "turn_id": 3} +{"actual_output_tokens": 51, "cached_tokens": 59296, "effective_input_length": 59374, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59374, "latency_s": 0.6184186349855736, "output_length": 51, "proxy_request_id": "1366128:9:1381799:652", "request_id": "1366128:9:1381799:652", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1366128", "t_dispatch_unix": 1779815012.6129067, "t_finish_unix": 1779815013.2313251, "t_first_token_unix": 1779815012.771103, "tpot_s": 0.009198052559513599, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389], "trace_timestamp_s": 503.5010000000002, "ttft_s": 0.1581944900099188, "turn_id": 9} +{"actual_output_tokens": 267, "cached_tokens": 0, "effective_input_length": 13989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13989, "latency_s": 2.917199002986308, "output_length": 267, "proxy_request_id": "1381387:1:1381387:648", "request_id": "1381387:1:1381387:648", "request_type": "coder", "requested_output_tokens": 267, "session_id": "1381387", "t_dispatch_unix": 1779815011.042029, "t_finish_unix": 1779815013.9592278, "t_first_token_unix": 1779815012.2461028, "tpot_s": 0.006439047887233345, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13684112], "trace_timestamp_s": 501.9280000000008, "ttft_s": 1.2040728490101174, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 3034, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3034, "latency_s": 0.3408625340089202, "output_length": 32, "proxy_request_id": "1382294:1:1382294:656", "request_id": "1382294:1:1382294:656", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1382294", "t_dispatch_unix": 1779815014.3652508, "t_finish_unix": 1779815014.7061133, "t_first_token_unix": 1779815014.5523057, "tpot_s": 0.004953221934321787, "trace_hash_ids": [13692603, 13692604, 13692605, 13692606, 13692607, 13692608], "trace_timestamp_s": 505.2550000000001, "ttft_s": 0.18705384200438857, "turn_id": 1} +{"actual_output_tokens": 228, "cached_tokens": 23264, "effective_input_length": 23457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23457, "latency_s": 16.08404980401974, "output_length": 228, "proxy_request_id": "1355484:8:1377993:625", "request_id": "1355484:8:1377993:625", "request_type": "coder", "requested_output_tokens": 228, "session_id": "1355484", "t_dispatch_unix": 1779814999.3076103, "t_finish_unix": 1779815015.39166, "t_first_token_unix": 1779815011.356331, "tpot_s": 0.017775372330238837, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13653201], "trace_timestamp_s": 490.1980000000003, "ttft_s": 12.04871932201786, "turn_id": 8} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 3190, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3190, "latency_s": 0.45130852999864146, "output_length": 26, "proxy_request_id": "1382710:1:1382710:659", "request_id": "1382710:1:1382710:659", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1382710", "t_dispatch_unix": 1779815015.8800342, "t_finish_unix": 1779815016.3313432, "t_first_token_unix": 1779815016.1001976, "tpot_s": 0.009233533800579608, "trace_hash_ids": [13684985, 13690307, 13696041, 13696042, 13696043, 13696044, 13696045], "trace_timestamp_s": 506.77000000000044, "ttft_s": 0.22016201302176341, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 627, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 627, "latency_s": 0.3100125180208124, "output_length": 35, "proxy_request_id": "1382804:1:1382804:660", "request_id": "1382804:1:1382804:660", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1382804", "t_dispatch_unix": 1779815016.1105964, "t_finish_unix": 1779815016.420609, "t_first_token_unix": 1779815016.1886718, "tpot_s": 0.0068111097943448625, "trace_hash_ids": [13696917, 13696918], "trace_timestamp_s": 507.0010000000002, "ttft_s": 0.07807422697078437, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 1955, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1955, "latency_s": 0.658037981018424, "output_length": 47, "proxy_request_id": "1382667:1:1382667:658", "request_id": "1382667:1:1382667:658", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1382667", "t_dispatch_unix": 1779815015.7815785, "t_finish_unix": 1779815016.4396162, "t_first_token_unix": 1779815015.9087155, "tpot_s": 0.011535387391315611, "trace_hash_ids": [13695912, 13695913, 13695914, 13695915], "trace_timestamp_s": 506.6720000000005, "ttft_s": 0.12713608902413398, "turn_id": 1} +{"actual_output_tokens": 48, "cached_tokens": 3056, "effective_input_length": 5164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5164, "latency_s": 0.8860201359493658, "output_length": 48, "proxy_request_id": "1382294:2:1383073:664", "request_id": "1382294:2:1383073:664", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1382294", "t_dispatch_unix": 1779815016.978218, "t_finish_unix": 1779815017.864238, "t_first_token_unix": 1779815017.24716, "tpot_s": 0.013123602107256414, "trace_hash_ids": [13692603, 13692604, 13692605, 13692606, 13692607, 13692608, 13699684, 13699685, 13699686, 13699687, 13699688], "trace_timestamp_s": 507.8670000000002, "ttft_s": 0.26894118095515296, "turn_id": 2} +{"actual_output_tokens": 53, "cached_tokens": 0, "effective_input_length": 5135, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5135, "latency_s": 1.1305250820005313, "output_length": 53, "proxy_request_id": "1383009:1:1383009:663", "request_id": "1383009:1:1383009:663", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1383009", "t_dispatch_unix": 1779815016.7530816, "t_finish_unix": 1779815017.8836062, "t_first_token_unix": 1779815017.0842044, "tpot_s": 0.015365760020078877, "trace_hash_ids": [13680021, 13680022, 13690856, 13690857, 13690858, 13690859, 13690860, 13690861, 13690862, 13698936, 13698937], "trace_timestamp_s": 507.64200000000073, "ttft_s": 0.33112177200382575, "turn_id": 1} +{"actual_output_tokens": 57, "cached_tokens": 7712, "effective_input_length": 10217, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10217, "latency_s": 0.8117169389734045, "output_length": 57, "proxy_request_id": "1379569:4:1383116:666", "request_id": "1379569:4:1383116:666", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1379569", "t_dispatch_unix": 1779815017.108789, "t_finish_unix": 1779815017.9205058, "t_first_token_unix": 1779815017.5151765, "tpot_s": 0.007233806036570708, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13685191, 13692448, 13692449, 13699991, 13699992, 13699993, 13699994], "trace_timestamp_s": 507.9990000000007, "ttft_s": 0.40638401597971097, "turn_id": 4} +{"actual_output_tokens": 20, "cached_tokens": 16528, "effective_input_length": 17368, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17368, "latency_s": 11.32182415301213, "output_length": 20, "proxy_request_id": "1377061:3:1380174:641", "request_id": "1377061:3:1380174:641", "request_type": "coder", "requested_output_tokens": 20, "session_id": "1377061", "t_dispatch_unix": 1779815006.7643673, "t_finish_unix": 1779815018.0861912, "t_first_token_unix": 1779815017.3001027, "tpot_s": 0.041352685684901906, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13658414, 13666839, 13672311], "trace_timestamp_s": 497.65400000000045, "ttft_s": 10.53573389700614, "turn_id": 3} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 57656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57656, "latency_s": 14.6491389030125, "output_length": 57, "proxy_request_id": "1263749:2:1379302:636", "request_id": "1263749:2:1379302:636", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1263749", "t_dispatch_unix": 1779815003.88627, "t_finish_unix": 1779815018.5354092, "t_first_token_unix": 1779815017.3069878, "tpot_s": 0.02193101171412439, "trace_hash_ids": [51262, 61305, 61306, 637504, 637505, 637506, 637507, 637508, 637509, 637510, 637511, 637512, 637513, 637514, 637515, 637516, 637517, 637518, 637519, 637520, 637521, 637522, 637523, 637524, 637525, 637526, 584014, 637527, 637528, 1022562, 637530, 1022563, 637532, 637533, 248930, 1022564, 4415649, 4415650, 4415651, 12449838, 12449839, 12449840, 12449841, 12449842, 12449843, 12449844, 12449845, 12449846, 12449847, 12449848, 12449849, 12449850, 12449851, 12449852, 12449853, 12449854, 12449855, 12449856, 12449857, 12449858, 12449859, 12449860, 12449861, 12449862, 12449863, 12449864, 12449865, 12449866, 12449867, 12449868, 12449869, 12449870, 12449871, 12449872, 12449873, 12449874, 12449875, 12449876, 12449877, 12449878, 12449879, 12449880, 12449881, 12449882, 12449883, 12449884, 12449885, 12449886, 12449887, 12449888, 12449889, 12449890, 12449891, 12449892, 12449893, 12449894, 12449895, 12449896, 12449897, 12553020, 12553021, 12553022, 12553023, 12553024, 12553025, 12553026, 12553027, 12553028, 12553029, 12553030, 12911454, 13469821, 13639785], "trace_timestamp_s": 494.77500000000055, "ttft_s": 13.420715724991169, "turn_id": 2} +{"actual_output_tokens": 131, "cached_tokens": 23680, "effective_input_length": 23717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23717, "latency_s": 3.2694579910021275, "output_length": 131, "proxy_request_id": "1355484:9:1379722:640", "request_id": "1355484:9:1379722:640", "request_type": "coder", "requested_output_tokens": 131, "session_id": "1355484", "t_dispatch_unix": 1779815015.3938735, "t_finish_unix": 1779815018.6633313, "t_first_token_unix": 1779815015.5130267, "tpot_s": 0.024231178861541244, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13668401], "trace_timestamp_s": 496.0470000000005, "ttft_s": 0.11915197700727731, "turn_id": 9} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 9305, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9305, "latency_s": 1.6985005830065347, "output_length": 46, "proxy_request_id": "1383090:1:1383090:665", "request_id": "1383090:1:1383090:665", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1383090", "t_dispatch_unix": 1779815017.0190077, "t_finish_unix": 1779815018.7175083, "t_first_token_unix": 1779815017.8768144, "tpot_s": 0.01867117333329386, "trace_hash_ids": [13676594, 13676595, 13676596, 13676597, 13676598, 13676599, 13676600, 13684524, 13684525, 13684526, 13684527, 13693279, 13693280, 13693281, 13693282, 13693283, 13699848, 13699849, 13699850], "trace_timestamp_s": 507.90599999999995, "ttft_s": 0.8578056729747914, "turn_id": 1} +{"actual_output_tokens": 370, "cached_tokens": 60816, "effective_input_length": 105902, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105902, "latency_s": 30.84304001700366, "output_length": 370, "proxy_request_id": "1313181:5:1320817:349", "request_id": "1313181:5:1320817:349", "request_type": "coder", "requested_output_tokens": 370, "session_id": "1313181", "t_dispatch_unix": 1779814987.9565024, "t_finish_unix": 1779815018.7995424, "t_first_token_unix": 1779815011.3716674, "tpot_s": 0.02012866211920689, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275], "trace_timestamp_s": 289.299, "ttft_s": 23.415162403020076, "turn_id": 5} +{"actual_output_tokens": 99, "cached_tokens": 21632, "effective_input_length": 30907, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30907, "latency_s": 11.338879348011687, "output_length": 99, "proxy_request_id": "1374465:3:1380413:642", "request_id": "1374465:3:1380413:642", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1374465", "t_dispatch_unix": 1779815007.553732, "t_finish_unix": 1779815018.8926108, "t_first_token_unix": 1779815017.7929122, "tpot_s": 0.011218750142558877, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867, 13637304, 5578065, 5578066, 5578067, 5578068, 5578069, 13674597, 13674598, 2474295, 13674599, 13674600, 13674601, 13674602, 13674603, 13674604, 13674605, 13674606, 13674607, 13674608, 13674609, 13674610, 13674611, 13674612, 13674613], "trace_timestamp_s": 498.4410000000007, "ttft_s": 10.239178473013453, "turn_id": 3} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 3186, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3186, "latency_s": 0.32648452097782865, "output_length": 27, "proxy_request_id": "1383625:1:1383625:668", "request_id": "1383625:1:1383625:668", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1383625", "t_dispatch_unix": 1779815018.9507413, "t_finish_unix": 1779815019.2772257, "t_first_token_unix": 1779815019.14769, "tpot_s": 0.004964869075383131, "trace_hash_ids": [13696954, 13704618, 13704619, 13704620, 13704621, 13704622, 13704623], "trace_timestamp_s": 509.84100000000035, "ttft_s": 0.19694658601656556, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 38111, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38111, "latency_s": 6.0191992949694395, "output_length": 25, "proxy_request_id": "1382089:1:1382089:655", "request_id": "1382089:1:1382089:655", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1382089", "t_dispatch_unix": 1779815013.6312013, "t_finish_unix": 1779815019.6504004, "t_first_token_unix": 1779815019.5183086, "tpot_s": 0.005491945082515788, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 504.5050000000001, "ttft_s": 5.8871048300061375, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 3200, "effective_input_length": 4150, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4150, "latency_s": 0.5746967509621754, "output_length": 27, "proxy_request_id": "1383625:2:1384279:673", "request_id": "1383625:2:1384279:673", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1383625", "t_dispatch_unix": 1779815021.3699107, "t_finish_unix": 1779815021.9446077, "t_first_token_unix": 1779815021.7590275, "tpot_s": 0.007120683923578606, "trace_hash_ids": [13696954, 13704618, 13704619, 13704620, 13704621, 13704622, 13709928, 13709929, 13709930], "trace_timestamp_s": 512.2600000000002, "ttft_s": 0.38911507395096123, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 5989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5989, "latency_s": 0.8062638689880259, "output_length": 60, "proxy_request_id": "1382667:2:1384299:674", "request_id": "1382667:2:1384299:674", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1382667", "t_dispatch_unix": 1779815021.4339986, "t_finish_unix": 1779815022.2402625, "t_first_token_unix": 1779815021.8321834, "tpot_s": 0.00690879959265812, "trace_hash_ids": [13695912, 13695913, 13695914, 13703943, 13703944, 13703945, 13703946, 13710107, 13710108, 13710109, 13710110, 13710111], "trace_timestamp_s": 512.3230000000003, "ttft_s": 0.39818344003288075, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 4690, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4690, "latency_s": 0.500053689989727, "output_length": 27, "proxy_request_id": "1384772:1:1384772:677", "request_id": "1384772:1:1384772:677", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1384772", "t_dispatch_unix": 1779815022.896213, "t_finish_unix": 1779815023.3962662, "t_first_token_unix": 1779815023.2010345, "tpot_s": 0.0074970141532293595, "trace_hash_ids": [13696008, 13696009, 13702186, 13702187, 13702188, 13702189, 13702190, 13707543, 13707544, 13714402], "trace_timestamp_s": 513.7860000000001, "ttft_s": 0.30482091300655156, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 5184, "effective_input_length": 11113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11113, "latency_s": 0.8059869339922443, "output_length": 32, "proxy_request_id": "1383009:2:1384930:679", "request_id": "1383009:2:1384930:679", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1383009", "t_dispatch_unix": 1779815023.4043615, "t_finish_unix": 1779815024.2103486, "t_first_token_unix": 1779815023.9793832, "tpot_s": 0.007440016935429265, "trace_hash_ids": [13680021, 13680022, 13690856, 13690857, 13690858, 13690859, 13690860, 13690861, 13690862, 13698936, 13705525, 13705526, 13705527, 13705528, 13705529, 13705530, 13705531, 13716553, 13716554, 13716555, 13716556, 13716557], "trace_timestamp_s": 514.2930000000006, "ttft_s": 0.5750201860209927, "turn_id": 2} +{"actual_output_tokens": 279, "cached_tokens": 14240, "effective_input_length": 28383, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28383, "latency_s": 5.185292517009657, "output_length": 279, "proxy_request_id": "1381387:2:1383735:669", "request_id": "1381387:2:1383735:669", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1381387", "t_dispatch_unix": 1779815019.2654967, "t_finish_unix": 1779815024.450789, "t_first_token_unix": 1779815021.6508343, "tpot_s": 0.010070852697667793, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13705337], "trace_timestamp_s": 510.14500000000044, "ttft_s": 2.385336088016629, "turn_id": 2} +{"actual_output_tokens": 824, "cached_tokens": 27648, "effective_input_length": 47401, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47401, "latency_s": 11.339553105994128, "output_length": 824, "proxy_request_id": "1364090:3:1381959:653", "request_id": "1364090:3:1381959:653", "request_type": "coder", "requested_output_tokens": 824, "session_id": "1364090", "t_dispatch_unix": 1779815013.14023, "t_finish_unix": 1779815024.4797826, "t_first_token_unix": 1779815018.2819953, "tpot_s": 0.007530427746005687, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13688849], "trace_timestamp_s": 504.02300000000014, "ttft_s": 5.141762804007158, "turn_id": 3} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 19034, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19034, "latency_s": 2.241349696996622, "output_length": 47, "proxy_request_id": "1384947:1:1384947:680", "request_id": "1384947:1:1384947:680", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1384947", "t_dispatch_unix": 1779815023.462282, "t_finish_unix": 1779815025.7036316, "t_first_token_unix": 1779815025.3836107, "tpot_s": 0.006949348956012451, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13716768, 13716769, 13716770, 13716771, 13716772, 13716773, 13716774, 13716775, 13716776, 13716777], "trace_timestamp_s": 514.3460000000005, "ttft_s": 1.9213265610160306, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 9344, "effective_input_length": 16734, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16734, "latency_s": 1.6942239539930597, "output_length": 46, "proxy_request_id": "1383090:2:1385262:682", "request_id": "1383090:2:1385262:682", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1383090", "t_dispatch_unix": 1779815024.6509268, "t_finish_unix": 1779815026.3451512, "t_first_token_unix": 1779815025.5685012, "tpot_s": 0.017249478534277943, "trace_hash_ids": [13676594, 13676595, 13676596, 13676597, 13676598, 13676599, 13676600, 13684524, 13684525, 13684526, 13684527, 13693279, 13693280, 13693281, 13693282, 13693283, 13699848, 13699849, 13706451, 13706452, 13706453, 13706454, 13706455, 13711662, 13711663, 13711664, 13711665, 13711666, 13711667, 13711668, 13711669, 13719432, 13719433], "trace_timestamp_s": 515.5390000000007, "ttft_s": 0.9175727010006085, "turn_id": 2} +{"actual_output_tokens": 232, "cached_tokens": 23840, "effective_input_length": 25226, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25226, "latency_s": 4.971012260997668, "output_length": 232, "proxy_request_id": "1355484:10:1384484:675", "request_id": "1355484:10:1384484:675", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1355484", "t_dispatch_unix": 1779815022.0360734, "t_finish_unix": 1779815027.0070858, "t_first_token_unix": 1779815022.3816984, "tpot_s": 0.020021057000043058, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13711657], "trace_timestamp_s": 512.9250000000002, "ttft_s": 0.3456229980220087, "turn_id": 10} +{"actual_output_tokens": 652, "cached_tokens": 60848, "effective_input_length": 60858, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60858, "latency_s": 10.663123496982735, "output_length": 652, "proxy_request_id": "1313181:5:1374956:615", "request_id": "1313181:5:1374956:615", "request_type": "coder", "requested_output_tokens": 652, "session_id": "1313181", "t_dispatch_unix": 1779815018.8036475, "t_finish_unix": 1779815029.4667704, "t_first_token_unix": 1779815018.921393, "tpot_s": 0.016198116413299022, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981], "trace_timestamp_s": 479.66400000000067, "ttft_s": 0.11774355795932934, "turn_id": 5} +{"actual_output_tokens": 18, "cached_tokens": 0, "effective_input_length": 12399, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12399, "latency_s": 1.1106066210195422, "output_length": 18, "proxy_request_id": "1381728:2:1387040:690", "request_id": "1381728:2:1387040:690", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1381728", "t_dispatch_unix": 1779815030.6845357, "t_finish_unix": 1779815031.7951422, "t_first_token_unix": 1779815031.7117534, "tpot_s": 0.004889596883645829, "trace_hash_ids": [13687007, 13687008, 13696180, 13696181, 13696182, 13696183, 13696184, 13703126, 13703127, 13703128, 13711511, 13711512, 13711513, 13711514, 13721898, 13721899, 13721900, 13721901, 13721902, 13729312, 13729313, 13729314, 13729315, 13735232, 13735233], "trace_timestamp_s": 521.5710000000008, "ttft_s": 1.0272166639915667, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 11530, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11530, "latency_s": 1.0057322990032844, "output_length": 13, "proxy_request_id": "1384772:2:1387335:693", "request_id": "1384772:2:1387335:693", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1384772", "t_dispatch_unix": 1779815031.7841408, "t_finish_unix": 1779815032.7898734, "t_first_token_unix": 1779815032.7112389, "tpot_s": 0.0065314132467998815, "trace_hash_ids": [13696008, 13696009, 13702186, 13702187, 13702188, 13702189, 13702190, 13707543, 13707544, 13719995, 13719996, 13719997, 13719998, 13725304, 13732414, 13732415, 13732416, 13732417, 13732418, 13738419, 13738420, 13738421, 13738422], "trace_timestamp_s": 522.6730000000007, "ttft_s": 0.9270959520363249, "turn_id": 2} +{"actual_output_tokens": 197, "cached_tokens": 0, "effective_input_length": 21221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21221, "latency_s": 14.983516999986023, "output_length": 197, "proxy_request_id": "1340290:3:1384149:672", "request_id": "1340290:3:1384149:672", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1340290", "t_dispatch_unix": 1779815020.8907661, "t_finish_unix": 1779815035.8742828, "t_first_token_unix": 1779815023.1687126, "tpot_s": 0.06482308357657048, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13305218], "trace_timestamp_s": 511.78099999999995, "ttft_s": 2.277944018947892, "turn_id": 3} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 3678, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3678, "latency_s": 0.30358787899604067, "output_length": 12, "proxy_request_id": "1382804:2:1388620:698", "request_id": "1382804:2:1388620:698", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1382804", "t_dispatch_unix": 1779815036.394911, "t_finish_unix": 1779815036.6984987, "t_first_token_unix": 1779815036.6270318, "tpot_s": 0.00646675100274892, "trace_hash_ids": [13696917, 13723655, 13723656, 13723657, 13723658, 13736021, 13736022, 13751607], "trace_timestamp_s": 527.2850000000008, "ttft_s": 0.23211961897322908, "turn_id": 2} +{"actual_output_tokens": 53, "cached_tokens": 21408, "effective_input_length": 26146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26146, "latency_s": 1.4960924899787642, "output_length": 53, "proxy_request_id": "1340290:4:1385568:684", "request_id": "1340290:4:1385568:684", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1340290", "t_dispatch_unix": 1779815035.877245, "t_finish_unix": 1779815037.3733377, "t_first_token_unix": 1779815036.794701, "tpot_s": 0.011121984692111325, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13722203], "trace_timestamp_s": 516.6480000000001, "ttft_s": 0.9174538049846888, "turn_id": 4} +{"actual_output_tokens": 36, "cached_tokens": 26192, "effective_input_length": 27220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27220, "latency_s": 0.6806974530336447, "output_length": 36, "proxy_request_id": "1340290:5:1386504:688", "request_id": "1340290:5:1386504:688", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779815037.3750832, "t_finish_unix": 1779815038.0557804, "t_first_token_unix": 1779815037.6721601, "tpot_s": 0.010952766798436642, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13730728], "trace_timestamp_s": 519.7940000000008, "ttft_s": 0.2970756580471061, "turn_id": 5} +{"actual_output_tokens": 179, "cached_tokens": 19072, "effective_input_length": 20183, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20183, "latency_s": 1.561785781988874, "output_length": 179, "proxy_request_id": "1384947:2:1388842:700", "request_id": "1384947:2:1388842:700", "request_type": "coder", "requested_output_tokens": 179, "session_id": "1384947", "t_dispatch_unix": 1779815037.1525273, "t_finish_unix": 1779815038.7143133, "t_first_token_unix": 1779815037.3908124, "tpot_s": 0.0074334216629170675, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13753560, 13753561, 13753562, 13753563, 13753564, 13753565, 13753566, 13753567, 13753568, 13753569, 13753570, 13753571], "trace_timestamp_s": 528.0410000000002, "ttft_s": 0.2382829840062186, "turn_id": 2} +{"actual_output_tokens": 265, "cached_tokens": 28656, "effective_input_length": 50793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50793, "latency_s": 8.037656019965652, "output_length": 265, "proxy_request_id": "1381387:3:1387093:691", "request_id": "1381387:3:1387093:691", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1381387", "t_dispatch_unix": 1779815030.8922606, "t_finish_unix": 1779815038.9299166, "t_first_token_unix": 1779815036.9109933, "tpot_s": 0.007646371939424143, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13736168], "trace_timestamp_s": 521.7730000000001, "ttft_s": 6.018730855954345, "turn_id": 3} +{"actual_output_tokens": 175, "cached_tokens": 27248, "effective_input_length": 27285, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27285, "latency_s": 2.128167468996253, "output_length": 175, "proxy_request_id": "1340290:6:1387365:695", "request_id": "1340290:6:1387365:695", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1340290", "t_dispatch_unix": 1779815038.0569236, "t_finish_unix": 1779815040.1850913, "t_first_token_unix": 1779815038.1365416, "tpot_s": 0.011771736080469242, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13738577], "trace_timestamp_s": 522.7670000000007, "ttft_s": 0.07961640896974131, "turn_id": 6} +{"actual_output_tokens": 3119, "cached_tokens": 0, "effective_input_length": 15283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15283, "latency_s": 37.79220125300344, "output_length": 3119, "proxy_request_id": "1378979:1:1378979:633", "request_id": "1378979:1:1378979:633", "request_type": "coder", "requested_output_tokens": 3119, "session_id": "1378979", "t_dispatch_unix": 1779815002.6777632, "t_finish_unix": 1779815040.4699647, "t_first_token_unix": 1779815004.0344944, "tpot_s": 0.01168544339674323, "trace_hash_ids": [1978, 1979, 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007], "trace_timestamp_s": 493.5690000000004, "ttft_s": 1.356729736959096, "turn_id": 1} +{"actual_output_tokens": 582, "cached_tokens": 62080, "effective_input_length": 85184, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85184, "latency_s": 18.27479521598434, "output_length": 582, "proxy_request_id": "1370129:4:1384856:678", "request_id": "1370129:4:1384856:678", "request_type": "coder", "requested_output_tokens": 582, "session_id": "1370129", "t_dispatch_unix": 1779815023.1609166, "t_finish_unix": 1779815041.4357111, "t_first_token_unix": 1779815033.9177113, "tpot_s": 0.012939281055039331, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13715535], "trace_timestamp_s": 514.0410000000002, "ttft_s": 10.7567927929922, "turn_id": 4} +{"actual_output_tokens": 66, "cached_tokens": 59424, "effective_input_length": 59506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59506, "latency_s": 26.038444212987088, "output_length": 66, "proxy_request_id": "1366128:10:1382843:661", "request_id": "1366128:10:1382843:661", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1366128", "t_dispatch_unix": 1779815016.2281928, "t_finish_unix": 1779815042.2666368, "t_first_token_unix": 1779815024.4791276, "tpot_s": 0.2736499460458827, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13697230], "trace_timestamp_s": 507.1170000000002, "ttft_s": 8.250932594994083, "turn_id": 10} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 5110, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5110, "latency_s": 0.5943914059898816, "output_length": 54, "proxy_request_id": "1390240:1:1390240:705", "request_id": "1390240:1:1390240:705", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1390240", "t_dispatch_unix": 1779815042.3308873, "t_finish_unix": 1779815042.925279, "t_first_token_unix": 1779815042.6553373, "tpot_s": 0.005088805678994658, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529], "trace_timestamp_s": 533.2200000000003, "ttft_s": 0.3244481509900652, "turn_id": 1} +{"actual_output_tokens": 141, "cached_tokens": 49856, "effective_input_length": 49865, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49865, "latency_s": 21.63197449001018, "output_length": 141, "proxy_request_id": "1340278:3:1384549:676", "request_id": "1340278:3:1384549:676", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1340278", "t_dispatch_unix": 1779815022.196867, "t_finish_unix": 1779815043.8288414, "t_first_token_unix": 1779815042.000258, "tpot_s": 0.013058960656884925, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13712170, 13712171, 13712172, 13712173, 13712174, 13712175, 13712176, 13712177, 13712178, 13712179, 13712180, 13712181, 13712182, 13712183, 13712184, 13712185, 13712186, 13712187, 13712188, 13712189, 13712190, 13712191, 13712192, 13712193, 13712194, 13712195, 13712196, 13712197, 13712198, 13712199, 13712200, 13712201, 13712202, 13712203, 13712204, 13712205, 13712206, 13712207, 13712208, 13712209, 13712210, 13712211, 13712212, 13712213, 13712214, 13712215, 13712216, 13712217, 13712218, 13712219, 13712220, 13712221, 13712222, 13712223, 13712224, 13712225, 13712226, 13712227, 13712228, 13712229, 13712230, 13712231, 13712232, 13712233, 13712234, 13712235, 13712236, 13712237, 13712238, 13712239, 13712240, 13712241, 13712242, 13712243], "trace_timestamp_s": 513.0550000000003, "ttft_s": 19.803388332016766, "turn_id": 3} +{"actual_output_tokens": 5, "cached_tokens": 50000, "effective_input_length": 50272, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50272, "latency_s": 0.2164703769958578, "output_length": 5, "proxy_request_id": "1340278:3:1385417:683", "request_id": "1340278:3:1385417:683", "request_type": "coder", "requested_output_tokens": 5, "session_id": "1340278", "t_dispatch_unix": 1779815043.8603804, "t_finish_unix": 1779815044.0768504, "t_first_token_unix": 1779815044.0615206, "tpot_s": 0.003749604249605909, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13720652, 1600817, 13720653, 13720654, 13720655, 13720656, 13720657, 13720658, 13720659, 13720660, 13720661, 13720662, 13720663, 13720664, 13720665, 13720666, 13720667, 13720668, 13720669, 13720670, 13720671, 13720672, 13720673, 13720674, 13720675, 13720676, 13720677, 13720678, 13720679, 13720680, 13720681, 13720682, 13720683, 13720684, 13720685, 13720686, 13720687, 13720688, 13720689, 13720690, 13720691, 13720692, 13720693, 13720694, 13720695, 13720696, 13720697, 13720698, 13720699, 13720700, 13720701, 13720702, 13720703, 13720704, 13720705, 13720706, 13720707, 13720708, 13720709, 13720710, 13720711, 13720712, 13720713, 13720714, 13720715, 13720716, 13720717, 13720718, 13720719, 13720720, 13720721, 13720722, 13720723, 13720724, 13720725], "trace_timestamp_s": 516.067, "ttft_s": 0.201137188996654, "turn_id": 3} +{"actual_output_tokens": 195, "cached_tokens": 0, "effective_input_length": 100538, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100538, "latency_s": 35.823144589026924, "output_length": 195, "proxy_request_id": "1279412:27:1380696:646", "request_id": "1279412:27:1380696:646", "request_type": "coder", "requested_output_tokens": 195, "session_id": "1279412", "t_dispatch_unix": 1779815008.6954184, "t_finish_unix": 1779815044.5185626, "t_first_token_unix": 1779815041.9955368, "tpot_s": 0.01300378018040834, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13677275], "trace_timestamp_s": 499.58100000000013, "ttft_s": 33.3001165210153, "turn_id": 27} +{"actual_output_tokens": 194, "cached_tokens": 20352, "effective_input_length": 20683, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20683, "latency_s": 1.3124115049722604, "output_length": 194, "proxy_request_id": "1384947:3:1390898:710", "request_id": "1384947:3:1390898:710", "request_type": "coder", "requested_output_tokens": 194, "session_id": "1384947", "t_dispatch_unix": 1779815044.9824278, "t_finish_unix": 1779815046.2948394, "t_first_token_unix": 1779815045.1354508, "tpot_s": 0.006005750005157577, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13753560, 13753561, 13753562, 13772382, 13772383, 13772384, 13772385, 13772386, 13772387, 13772388, 13772389, 13772390, 13772391], "trace_timestamp_s": 535.8690000000006, "ttft_s": 0.15302083699498326, "turn_id": 3} +{"actual_output_tokens": 203, "cached_tokens": 100720, "effective_input_length": 100766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100766, "latency_s": 2.236117254011333, "output_length": 203, "proxy_request_id": "1279412:28:1382526:657", "request_id": "1279412:28:1382526:657", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1279412", "t_dispatch_unix": 1779815044.5239608, "t_finish_unix": 1779815046.7600777, "t_first_token_unix": 1779815044.7109299, "tpot_s": 0.0101429775494409, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899], "trace_timestamp_s": 506.16000000000076, "ttft_s": 0.18696643301518634, "turn_id": 28} +{"actual_output_tokens": 337, "cached_tokens": 0, "effective_input_length": 1349, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1349, "latency_s": 4.375968060048763, "output_length": 337, "proxy_request_id": "1390356:1:1390356:706", "request_id": "1390356:1:1390356:706", "request_type": "coder", "requested_output_tokens": 337, "session_id": "1390356", "t_dispatch_unix": 1779815042.7728493, "t_finish_unix": 1779815047.1488178, "t_first_token_unix": 1779815042.8698926, "tpot_s": 0.012733938892779406, "trace_hash_ids": [498451, 7523068, 6847035], "trace_timestamp_s": 533.6630000000005, "ttft_s": 0.0970416110358201, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 100960, "effective_input_length": 101200, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101200, "latency_s": 1.0288218999630772, "output_length": 73, "proxy_request_id": "1279412:29:1385688:685", "request_id": "1279412:29:1385688:685", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1279412", "t_dispatch_unix": 1779815046.7643597, "t_finish_unix": 1779815047.7931817, "t_first_token_unix": 1779815047.1106284, "tpot_s": 0.009474096736489123, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276], "trace_timestamp_s": 517.1180000000004, "ttft_s": 0.34626602195203304, "turn_id": 29} +{"actual_output_tokens": 117, "cached_tokens": 0, "effective_input_length": 69465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69465, "latency_s": 27.93619309499627, "output_length": 117, "proxy_request_id": "1342921:3:1384020:670", "request_id": "1342921:3:1384020:670", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1342921", "t_dispatch_unix": 1779815020.31815, "t_finish_unix": 1779815048.2543426, "t_first_token_unix": 1779815041.3226085, "tpot_s": 0.059752847267222464, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13707851], "trace_timestamp_s": 511.20600000000013, "ttft_s": 21.004455832997337, "turn_id": 3} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 15302, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15302, "latency_s": 1.572775206004735, "output_length": 40, "proxy_request_id": "1391584:1:1391584:713", "request_id": "1391584:1:1391584:713", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1391584", "t_dispatch_unix": 1779815046.8433857, "t_finish_unix": 1779815048.4161613, "t_first_token_unix": 1779815048.205776, "tpot_s": 0.005386878307968474, "trace_hash_ids": [13707702, 13707703, 13720726, 13720727, 13720728, 13720729, 13733320, 13733321, 13733322, 13733323, 13733324, 13733325, 13733326, 13746256, 13746257, 13746258, 13746259, 13754848, 13763119, 13763120, 13763121, 13763122, 13763123, 13770106, 13770107, 13770108, 13770109, 13779081, 13779082, 13779083], "trace_timestamp_s": 537.7290000000003, "ttft_s": 1.3623886209679767, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 101264, "effective_input_length": 101396, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101396, "latency_s": 1.0312905120081268, "output_length": 81, "proxy_request_id": "1279412:30:1387344:694", "request_id": "1279412:30:1387344:694", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1279412", "t_dispatch_unix": 1779815047.798166, "t_finish_unix": 1779815048.8294566, "t_first_token_unix": 1779815048.053022, "tpot_s": 0.009700873787369346, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276, 13738467], "trace_timestamp_s": 522.6910000000007, "ttft_s": 0.2548532690270804, "turn_id": 30} +{"actual_output_tokens": 457, "cached_tokens": 85760, "effective_input_length": 87687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87687, "latency_s": 5.977779485983774, "output_length": 457, "proxy_request_id": "1370129:5:1390477:708", "request_id": "1370129:5:1390477:708", "request_type": "coder", "requested_output_tokens": 457, "session_id": "1370129", "t_dispatch_unix": 1779815043.2921548, "t_finish_unix": 1779815049.2699344, "t_first_token_unix": 1779815044.5615728, "tpot_s": 0.010324812004431519, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13768317, 13768318, 13768319, 13768320, 13768321, 13768322], "trace_timestamp_s": 534.1800000000003, "ttft_s": 1.2694159820093773, "turn_id": 5} +{"actual_output_tokens": 151, "cached_tokens": 0, "effective_input_length": 54012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54012, "latency_s": 35.75272111099912, "output_length": 151, "proxy_request_id": "1382086:1:1382086:654", "request_id": "1382086:1:1382086:654", "request_type": "coder", "requested_output_tokens": 151, "session_id": "1382086", "t_dispatch_unix": 1779815013.6260195, "t_finish_unix": 1779815049.3787403, "t_first_token_unix": 1779815024.4735887, "tpot_s": 0.16602455176025008, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977], "trace_timestamp_s": 504.4960000000001, "ttft_s": 10.847567771968897, "turn_id": 1} +{"actual_output_tokens": 70, "cached_tokens": 15328, "effective_input_length": 15483, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15483, "latency_s": 0.4607385309645906, "output_length": 70, "proxy_request_id": "1391584:2:1392466:715", "request_id": "1391584:2:1392466:715", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1391584", "t_dispatch_unix": 1779815050.1598494, "t_finish_unix": 1779815050.6205878, "t_first_token_unix": 1779815050.2410643, "tpot_s": 0.005496013797380948, "trace_hash_ids": [13786395, 13786396, 13786397, 13786398, 13786399, 13786400, 13786401, 13786402, 13786403, 13786404, 13786405, 13786406, 13786407, 13786408, 13786409, 13786410, 13786411, 13786412, 13786413, 13786414, 13786415, 13786416, 13786417, 13786418, 13786419, 13786420, 13786421, 13786422, 13786423, 13786424, 13786425], "trace_timestamp_s": 541.0450000000001, "ttft_s": 0.08121349394787103, "turn_id": 2} +{"actual_output_tokens": 168, "cached_tokens": 59568, "effective_input_length": 71254, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71254, "latency_s": 8.447401330980938, "output_length": 168, "proxy_request_id": "1366128:11:1384044:671", "request_id": "1366128:11:1384044:671", "request_type": "coder", "requested_output_tokens": 168, "session_id": "1366128", "t_dispatch_unix": 1779815042.273823, "t_finish_unix": 1779815050.7212245, "t_first_token_unix": 1779815047.311416, "tpot_s": 0.020416417299605305, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13708083], "trace_timestamp_s": 511.3190000000004, "ttft_s": 5.0375906129484065, "turn_id": 11} +{"actual_output_tokens": 204, "cached_tokens": 2560, "effective_input_length": 28307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28307, "latency_s": 4.746687281993218, "output_length": 204, "proxy_request_id": "1391404:1:1391404:712", "request_id": "1391404:1:1391404:712", "request_type": "coder", "requested_output_tokens": 204, "session_id": "1391404", "t_dispatch_unix": 1779815046.3265858, "t_finish_unix": 1779815051.073273, "t_first_token_unix": 1779815049.77278, "tpot_s": 0.006404997394110531, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 94557, 94558, 94559, 94560, 94561, 94562, 94563, 94564, 94565, 238090, 238091, 3841644, 3841645, 3841646, 3841647, 3841648, 3841649, 13750192, 3809872, 13750193, 13750194, 13777397, 13777398, 13777399, 13777400, 13777401, 13777402, 13777403, 13777404, 13777405, 13777406, 13777407, 13777408, 13777409, 13777410, 13777411, 13777412, 13777413, 13777414, 13777415, 13777416, 13777417, 13777418, 13777419, 13777420, 13777421, 13777422, 13777423, 13777424, 13777425, 13777426], "trace_timestamp_s": 537.2080000000005, "ttft_s": 3.4461921789916232, "turn_id": 1} +{"actual_output_tokens": 58, "cached_tokens": 71408, "effective_input_length": 71578, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71578, "latency_s": 1.0709656990366057, "output_length": 58, "proxy_request_id": "1366128:12:1386045:687", "request_id": "1366128:12:1386045:687", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1366128", "t_dispatch_unix": 1779815050.7248, "t_finish_unix": 1779815051.7957654, "t_first_token_unix": 1779815050.9882848, "tpot_s": 0.014161942421515849, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175], "trace_timestamp_s": 518.5060000000003, "ttft_s": 0.2634826930006966, "turn_id": 12} +{"actual_output_tokens": 265, "cached_tokens": 101472, "effective_input_length": 101993, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101993, "latency_s": 3.276803718006704, "output_length": 265, "proxy_request_id": "1279412:31:1391216:711", "request_id": "1279412:31:1391216:711", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1279412", "t_dispatch_unix": 1779815048.8353379, "t_finish_unix": 1779815052.1121414, "t_first_token_unix": 1779815049.376776, "tpot_s": 0.010360220643853994, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276, 13775473, 13775474], "trace_timestamp_s": 536.75, "ttft_s": 0.5414352620136924, "turn_id": 31} +{"actual_output_tokens": 44, "cached_tokens": 5152, "effective_input_length": 7440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7440, "latency_s": 0.44281553401378915, "output_length": 44, "proxy_request_id": "1390240:2:1392954:717", "request_id": "1390240:2:1392954:717", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1390240", "t_dispatch_unix": 1779815051.8777945, "t_finish_unix": 1779815052.3206103, "t_first_token_unix": 1779815052.0994503, "tpot_s": 0.005135819768034961, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529, 13772017, 13790409, 13790410, 13790411, 13790412], "trace_timestamp_s": 542.768, "ttft_s": 0.22165417700307444, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 71632, "effective_input_length": 71708, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71708, "latency_s": 0.8264385220245458, "output_length": 46, "proxy_request_id": "1366128:13:1387308:692", "request_id": "1366128:13:1387308:692", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1366128", "t_dispatch_unix": 1779815051.7988393, "t_finish_unix": 1779815052.6252778, "t_first_token_unix": 1779815051.9671547, "tpot_s": 0.01461997068901029, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13738057], "trace_timestamp_s": 522.5910000000003, "ttft_s": 0.16831252101110294, "turn_id": 13} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 71899, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71899, "latency_s": 18.668521703977603, "output_length": 45, "proxy_request_id": "1388507:1:1388507:697", "request_id": "1388507:1:1388507:697", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1388507", "t_dispatch_unix": 1779815035.935285, "t_finish_unix": 1779815054.6038067, "t_first_token_unix": 1779815053.8325372, "tpot_s": 0.017520083408188922, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728], "trace_timestamp_s": 526.7930000000006, "ttft_s": 17.897249469999224, "turn_id": 1} +{"actual_output_tokens": 166, "cached_tokens": 25456, "effective_input_length": 26837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26837, "latency_s": 20.797762339003384, "output_length": 166, "proxy_request_id": "1355484:11:1388276:696", "request_id": "1355484:11:1388276:696", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1355484", "t_dispatch_unix": 1779815035.0162232, "t_finish_unix": 1779815055.8139856, "t_first_token_unix": 1779815052.843591, "tpot_s": 0.018000003102828156, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13748329], "trace_timestamp_s": 525.906, "ttft_s": 17.827365958015434, "turn_id": 11} +{"actual_output_tokens": 185, "cached_tokens": 61504, "effective_input_length": 106305, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106305, "latency_s": 26.987319334992208, "output_length": 185, "proxy_request_id": "1313181:6:1324908:369", "request_id": "1313181:6:1324908:369", "request_type": "coder", "requested_output_tokens": 185, "session_id": "1313181", "t_dispatch_unix": 1779815029.4705117, "t_finish_unix": 1779815056.4578311, "t_first_token_unix": 1779815052.8576758, "tpot_s": 0.019564463440316184, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13161676], "trace_timestamp_s": 303.64200000000073, "ttft_s": 23.38716145599028, "turn_id": 6} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 4675, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4675, "latency_s": 0.6665863799862564, "output_length": 73, "proxy_request_id": "1394167:1:1394167:721", "request_id": "1394167:1:1394167:721", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1394167", "t_dispatch_unix": 1779815056.1426423, "t_finish_unix": 1779815056.809229, "t_first_token_unix": 1779815056.4401157, "tpot_s": 0.005122441236582947, "trace_hash_ids": [13801402, 13801403, 13801404, 13801405, 13801406, 13801407, 13801408, 13801409, 13801410, 13801411], "trace_timestamp_s": 547.0320000000002, "ttft_s": 0.29747229896020144, "turn_id": 1} +{"actual_output_tokens": 2, "cached_tokens": 0, "effective_input_length": 982, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 982, "latency_s": 0.08076882903696969, "output_length": 2, "proxy_request_id": "1394428:1:1394428:724", "request_id": "1394428:1:1394428:724", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1394428", "t_dispatch_unix": 1779815057.0320442, "t_finish_unix": 1779815057.1128128, "t_first_token_unix": 1779815057.1088102, "tpot_s": 0.0036240550107322633, "trace_hash_ids": [7025, 13804096], "trace_timestamp_s": 547.9230000000007, "ttft_s": 0.07676513103069738, "turn_id": 1} +{"actual_output_tokens": 19, "cached_tokens": 0, "effective_input_length": 4428, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4428, "latency_s": 0.36529309302568436, "output_length": 19, "proxy_request_id": "1394482:1:1394482:726", "request_id": "1394482:1:1394482:726", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1394482", "t_dispatch_unix": 1779815057.3026702, "t_finish_unix": 1779815057.667963, "t_first_token_unix": 1779815057.5808094, "tpot_s": 0.004825005443611492, "trace_hash_ids": [13785573, 13792906, 13792907, 13792908, 13792909, 13798843, 13804481, 13804482, 13804483], "trace_timestamp_s": 548.192, "ttft_s": 0.2781381160020828, "turn_id": 1} +{"actual_output_tokens": 51, "cached_tokens": 0, "effective_input_length": 4736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4736, "latency_s": 0.7154660599771887, "output_length": 51, "proxy_request_id": "1394432:1:1394432:725", "request_id": "1394432:1:1394432:725", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1394432", "t_dispatch_unix": 1779815057.0491266, "t_finish_unix": 1779815057.764593, "t_first_token_unix": 1779815057.355155, "tpot_s": 0.008180717800278216, "trace_hash_ids": [13788220, 13788221, 13788222, 13788223, 13788224, 13804106, 13804107, 13804108, 13804109, 13804110], "trace_timestamp_s": 547.9380000000001, "ttft_s": 0.3060268730041571, "turn_id": 1} +{"actual_output_tokens": 613, "cached_tokens": 48224, "effective_input_length": 48944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48944, "latency_s": 6.997064983006567, "output_length": 613, "proxy_request_id": "1364090:4:1392998:718", "request_id": "1364090:4:1392998:718", "request_type": "coder", "requested_output_tokens": 613, "session_id": "1364090", "t_dispatch_unix": 1779815051.9786854, "t_finish_unix": 1779815058.9757507, "t_first_token_unix": 1779815054.1191132, "tpot_s": 0.007935114089894913, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13790837], "trace_timestamp_s": 542.8680000000004, "ttft_s": 2.140425528981723, "turn_id": 4} +{"actual_output_tokens": 277, "cached_tokens": 69568, "effective_input_length": 70990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70990, "latency_s": 11.18512074497994, "output_length": 277, "proxy_request_id": "1342921:4:1389290:702", "request_id": "1342921:4:1389290:702", "request_type": "coder", "requested_output_tokens": 277, "session_id": "1342921", "t_dispatch_unix": 1779815048.257463, "t_finish_unix": 1779815059.442584, "t_first_token_unix": 1779815049.0585709, "tpot_s": 0.037621466221078634, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 13758038], "trace_timestamp_s": 529.6910000000007, "ttft_s": 0.8011047010077164, "turn_id": 4} +{"actual_output_tokens": 103, "cached_tokens": 71744, "effective_input_length": 83404, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83404, "latency_s": 7.440597851003986, "output_length": 103, "proxy_request_id": "1366128:14:1389156:701", "request_id": "1366128:14:1389156:701", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1366128", "t_dispatch_unix": 1779815052.633255, "t_finish_unix": 1779815060.0738533, "t_first_token_unix": 1779815058.4676058, "tpot_s": 0.01574377369651498, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710], "trace_timestamp_s": 529.2550000000001, "ttft_s": 5.83434815495275, "turn_id": 14} +{"actual_output_tokens": 251, "cached_tokens": 26992, "effective_input_length": 28382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28382, "latency_s": 4.311689209018368, "output_length": 251, "proxy_request_id": "1355484:12:1391879:714", "request_id": "1355484:12:1391879:714", "request_type": "coder", "requested_output_tokens": 251, "session_id": "1355484", "t_dispatch_unix": 1779815055.8157914, "t_finish_unix": 1779815060.1274807, "t_first_token_unix": 1779815056.2201865, "tpot_s": 0.015627219900023193, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13781560], "trace_timestamp_s": 538.8690000000006, "ttft_s": 0.4043929160106927, "turn_id": 12} +{"actual_output_tokens": 49, "cached_tokens": 4784, "effective_input_length": 6892, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6892, "latency_s": 0.5915802390081808, "output_length": 49, "proxy_request_id": "1394432:2:1395186:729", "request_id": "1394432:2:1395186:729", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1394432", "t_dispatch_unix": 1779815059.636871, "t_finish_unix": 1779815060.2284515, "t_first_token_unix": 1779815059.8438861, "tpot_s": 0.008003235666061906, "trace_hash_ids": [13788220, 13788221, 13788222, 13788223, 13788224, 13804106, 13804107, 13804108, 13804109, 13810289, 13810290, 13810291, 13810292, 13810293], "trace_timestamp_s": 550.527, "ttft_s": 0.20701342303073034, "turn_id": 2} +{"actual_output_tokens": 1054, "cached_tokens": 20912, "effective_input_length": 20948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20948, "latency_s": 50.47530429705512, "output_length": 1054, "proxy_request_id": "1363943:8:1379215:635", "request_id": "1363943:8:1379215:635", "request_type": "coder", "requested_output_tokens": 1054, "session_id": "1363943", "t_dispatch_unix": 1779815009.9003558, "t_finish_unix": 1779815060.3756607, "t_first_token_unix": 1779815009.956458, "tpot_s": 0.04788113832758989, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416], "trace_timestamp_s": 494.45700000000033, "ttft_s": 0.05610028904629871, "turn_id": 8} +{"actual_output_tokens": 71, "cached_tokens": 28624, "effective_input_length": 28665, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28665, "latency_s": 1.1816639800090343, "output_length": 71, "proxy_request_id": "1355484:13:1394384:723", "request_id": "1355484:13:1394384:723", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1355484", "t_dispatch_unix": 1779815060.1289127, "t_finish_unix": 1779815061.310577, "t_first_token_unix": 1779815060.2344458, "tpot_s": 0.015367277528691504, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562], "trace_timestamp_s": 547.7760000000007, "ttft_s": 0.10553117899689823, "turn_id": 13} +{"actual_output_tokens": 118, "cached_tokens": 83504, "effective_input_length": 83622, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83622, "latency_s": 1.8675796540337615, "output_length": 118, "proxy_request_id": "1366128:15:1390663:709", "request_id": "1366128:15:1390663:709", "request_type": "coder", "requested_output_tokens": 118, "session_id": "1366128", "t_dispatch_unix": 1779815060.0780203, "t_finish_unix": 1779815061.9455998, "t_first_token_unix": 1779815060.3392825, "tpot_s": 0.013726485120013164, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13769857], "trace_timestamp_s": 534.7930000000006, "ttft_s": 0.2612603949964978, "turn_id": 15} +{"actual_output_tokens": 442, "cached_tokens": 61536, "effective_input_length": 61543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61543, "latency_s": 6.64741281903116, "output_length": 442, "proxy_request_id": "1313181:6:1379623:639", "request_id": "1313181:6:1379623:639", "request_type": "coder", "requested_output_tokens": 442, "session_id": "1313181", "t_dispatch_unix": 1779815056.4607792, "t_finish_unix": 1779815063.108192, "t_first_token_unix": 1779815056.571125, "tpot_s": 0.01482264405893069, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13667684], "trace_timestamp_s": 495.71700000000055, "ttft_s": 0.11034354299772531, "turn_id": 6} +{"actual_output_tokens": 65, "cached_tokens": 0, "effective_input_length": 35450, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35450, "latency_s": 5.689156392996665, "output_length": 65, "proxy_request_id": "1394696:1:1394696:727", "request_id": "1394696:1:1394696:727", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1394696", "t_dispatch_unix": 1779815058.0872402, "t_finish_unix": 1779815063.7763958, "t_first_token_unix": 1779815063.3170714, "tpot_s": 0.007168671610088495, "trace_hash_ids": [13806090, 13806091, 13806092, 13806093, 13806094, 13806095, 13806096, 13806097, 13806098, 13806099, 13806100, 13806101, 13806102, 13806103, 13806104, 13806105, 13806106, 13806107, 13806108, 13806109, 13806110, 13806111, 13806112, 13806113, 13806114, 13806115, 13806116, 9511238, 9511239, 9511240, 9511241, 13806117, 13806118, 13806119, 13806120, 13806121, 13806122, 13806123, 13806124, 13806125, 13806126, 13806127, 13806128, 13806129, 13806130, 13806131, 13806132, 13806133, 13806134, 13806135, 13806136, 13806137, 13806138, 13806139, 13806140, 13806141, 13806142, 13806143, 13806144, 13806145, 13806146, 13806147, 13806148, 13806149, 13806150, 13806151, 13806152, 13806153, 13806154, 13806155], "trace_timestamp_s": 548.9520000000002, "ttft_s": 5.229829944961239, "turn_id": 1} +{"actual_output_tokens": 117, "cached_tokens": 4736, "effective_input_length": 4863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4863, "latency_s": 4.471067983016837, "output_length": 117, "proxy_request_id": "1394167:2:1395165:728", "request_id": "1394167:2:1395165:728", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1394167", "t_dispatch_unix": 1779815059.5738935, "t_finish_unix": 1779815064.0449615, "t_first_token_unix": 1779815063.3175406, "tpot_s": 0.006267238171983928, "trace_hash_ids": [13801402, 13801403, 13801404, 13801405, 13801406, 13801407, 13801408, 13801409, 13801410, 13810026], "trace_timestamp_s": 550.4650000000001, "ttft_s": 3.7436459910240956, "turn_id": 2} +{"actual_output_tokens": 213, "cached_tokens": 11776, "effective_input_length": 21241, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21241, "latency_s": 2.671462547034025, "output_length": 213, "proxy_request_id": "1395933:1:1395933:732", "request_id": "1395933:1:1395933:732", "request_type": "coder", "requested_output_tokens": 213, "session_id": "1395933", "t_dispatch_unix": 1779815062.3703222, "t_finish_unix": 1779815065.0417845, "t_first_token_unix": 1779815063.7650688, "tpot_s": 0.00602106512266097, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4820695, 12527506, 12667198, 12747031, 12878182, 12930465, 13027097, 13219058, 13256881, 13445564, 13599228, 13718544, 13817211, 13817212, 13817213, 13817214, 13817215, 13817216, 13817217], "trace_timestamp_s": 553.2570000000005, "ttft_s": 1.394743486016523, "turn_id": 1} +{"actual_output_tokens": 206, "cached_tokens": 83728, "effective_input_length": 84897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 84897, "latency_s": 3.1443723660195246, "output_length": 206, "proxy_request_id": "1366128:16:1392704:716", "request_id": "1366128:16:1392704:716", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1366128", "t_dispatch_unix": 1779815061.949897, "t_finish_unix": 1779815065.0942693, "t_first_token_unix": 1779815062.7365994, "tpot_s": 0.011499730073392573, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167], "trace_timestamp_s": 541.9360000000006, "ttft_s": 0.7866998629760928, "turn_id": 16} +{"actual_output_tokens": 99, "cached_tokens": 85088, "effective_input_length": 85276, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85276, "latency_s": 1.3945672630215995, "output_length": 99, "proxy_request_id": "1366128:17:1395596:731", "request_id": "1366128:17:1395596:731", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1366128", "t_dispatch_unix": 1779815065.09913, "t_finish_unix": 1779815066.4936976, "t_first_token_unix": 1779815065.3950472, "tpot_s": 0.011206787969318352, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13813611], "trace_timestamp_s": 552.0660000000007, "ttft_s": 0.29591465403791517, "turn_id": 17} +{"actual_output_tokens": 132, "cached_tokens": 8208, "effective_input_length": 17047, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17047, "latency_s": 2.2685683600138873, "output_length": 132, "proxy_request_id": "1305906:3:1396717:733", "request_id": "1305906:3:1396717:733", "request_type": "coder", "requested_output_tokens": 132, "session_id": "1305906", "t_dispatch_unix": 1779815064.9608903, "t_finish_unix": 1779815067.229458, "t_first_token_unix": 1779815066.0727906, "tpot_s": 0.008826301152771695, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 13824632], "trace_timestamp_s": 555.8500000000004, "ttft_s": 1.1118990349932574, "turn_id": 3} +{"actual_output_tokens": 87, "cached_tokens": 85360, "effective_input_length": 85504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85504, "latency_s": 1.181899612012785, "output_length": 87, "proxy_request_id": "1366128:18:1397382:735", "request_id": "1366128:18:1397382:735", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1366128", "t_dispatch_unix": 1779815067.218229, "t_finish_unix": 1779815068.4001286, "t_first_token_unix": 1779815067.4426737, "tpot_s": 0.011130151034977158, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174], "trace_timestamp_s": 558.107, "ttft_s": 0.2244424499804154, "turn_id": 18} +{"actual_output_tokens": 743, "cached_tokens": 22000, "effective_input_length": 23641, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23641, "latency_s": 8.684322335000616, "output_length": 743, "proxy_request_id": "1363943:9:1390468:707", "request_id": "1363943:9:1390468:707", "request_type": "coder", "requested_output_tokens": 743, "session_id": "1363943", "t_dispatch_unix": 1779815060.3780956, "t_finish_unix": 1779815069.0624173, "t_first_token_unix": 1779815060.750394, "tpot_s": 0.011201905734530171, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13768294], "trace_timestamp_s": 534.134, "ttft_s": 0.37229732400737703, "turn_id": 9} +{"actual_output_tokens": 22, "cached_tokens": 0, "effective_input_length": 3213, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3213, "latency_s": 0.38969642599113286, "output_length": 22, "proxy_request_id": "1398145:1:1398145:739", "request_id": "1398145:1:1398145:739", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1398145", "t_dispatch_unix": 1779815070.1234777, "t_finish_unix": 1779815070.5131738, "t_first_token_unix": 1779815070.3703194, "tpot_s": 0.006787780334152991, "trace_hash_ids": [13836943, 13836944, 13836945, 13836946, 13836947, 13836948, 13836949], "trace_timestamp_s": 561.0129999999999, "ttft_s": 0.24684031697688624, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 16550, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16550, "latency_s": 1.8032566170440987, "output_length": 44, "proxy_request_id": "1397840:1:1397840:737", "request_id": "1397840:1:1397840:737", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1397840", "t_dispatch_unix": 1779815069.0521846, "t_finish_unix": 1779815070.8554413, "t_first_token_unix": 1779815070.6356068, "tpot_s": 0.005105524954689277, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13834593], "trace_timestamp_s": 559.9370000000008, "ttft_s": 1.5834205040009692, "turn_id": 1} +{"actual_output_tokens": 531, "cached_tokens": 0, "effective_input_length": 13134, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13134, "latency_s": 4.3221279790159315, "output_length": 531, "proxy_request_id": "1397223:1:1397223:734", "request_id": "1397223:1:1397223:734", "request_type": "coder", "requested_output_tokens": 531, "session_id": "1397223", "t_dispatch_unix": 1779815066.6022663, "t_finish_unix": 1779815070.9243946, "t_first_token_unix": 1779815067.7058191, "tpot_s": 0.00607227814342071, "trace_hash_ids": [13793541, 13793542, 13793543, 13802362, 13802363, 13802364, 13802365, 13802366, 13802367, 13811273, 13811274, 13811275, 13811276, 13811277, 13811278, 13811279, 13811280, 13819026, 13819027, 13819028, 13819029, 13828841, 13828842, 13828843, 13828844, 13828845], "trace_timestamp_s": 557.4880000000003, "ttft_s": 1.1035513210226782, "turn_id": 1} +{"actual_output_tokens": 64, "cached_tokens": 0, "effective_input_length": 3891, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3891, "latency_s": 1.1520651589962654, "output_length": 64, "proxy_request_id": "1398213:1:1398213:742", "request_id": "1398213:1:1398213:742", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1398213", "t_dispatch_unix": 1779815070.26667, "t_finish_unix": 1779815071.418735, "t_first_token_unix": 1779815070.6595917, "tpot_s": 0.012042934491690839, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13837656], "trace_timestamp_s": 561.1540000000005, "ttft_s": 0.3929202320287004, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7877, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7877, "latency_s": 0.6593243389506824, "output_length": 24, "proxy_request_id": "1398594:1:1398594:744", "request_id": "1398594:1:1398594:744", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1398594", "t_dispatch_unix": 1779815071.490688, "t_finish_unix": 1779815072.1500125, "t_first_token_unix": 1779815072.0356805, "tpot_s": 0.004959024129556897, "trace_hash_ids": [13835320, 13835321, 13835322, 13835323, 13835324, 13835325, 13835326, 13841636, 13841637, 13841638, 13841639, 13841640, 13841641, 13841642, 13841643, 13841644], "trace_timestamp_s": 562.3790000000008, "ttft_s": 0.5449903549742885, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 85584, "effective_input_length": 85663, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85663, "latency_s": 0.379634328011889, "output_length": 25, "proxy_request_id": "1366128:19:1398824:745", "request_id": "1366128:19:1398824:745", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1366128", "t_dispatch_unix": 1779815072.3796172, "t_finish_unix": 1779815072.7592514, "t_first_token_unix": 1779815072.5936377, "tpot_s": 0.006890349085248697, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13843754], "trace_timestamp_s": 563.2670000000007, "ttft_s": 0.2140178779955022, "turn_id": 19} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 3707, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3707, "latency_s": 0.5129098650068045, "output_length": 57, "proxy_request_id": "1400379:1:1400379:751", "request_id": "1400379:1:1400379:751", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1400379", "t_dispatch_unix": 1779815077.6188538, "t_finish_unix": 1779815078.1317632, "t_first_token_unix": 1779815077.8516676, "tpot_s": 0.0049965721607025315, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13858195], "trace_timestamp_s": 568.5080000000007, "ttft_s": 0.23281251301523298, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 11414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11414, "latency_s": 1.3099973219796084, "output_length": 73, "proxy_request_id": "1398213:2:1400590:753", "request_id": "1398213:2:1400590:753", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1398213", "t_dispatch_unix": 1779815078.4061308, "t_finish_unix": 1779815079.7161283, "t_first_token_unix": 1779815079.324545, "tpot_s": 0.005434051638682528, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13846300, 13846301, 13846302, 13846303, 13846304, 13851656, 13851657, 13851658, 13851659, 13851660, 13851661, 13860134, 13860135, 13860136, 13860137, 13860138], "trace_timestamp_s": 569.2930000000006, "ttft_s": 0.9184127390035428, "turn_id": 2} +{"actual_output_tokens": 67, "cached_tokens": 3760, "effective_input_length": 3863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3863, "latency_s": 0.3710629559936933, "output_length": 67, "proxy_request_id": "1400379:2:1401201:757", "request_id": "1400379:2:1401201:757", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1400379", "t_dispatch_unix": 1779815080.7342167, "t_finish_unix": 1779815081.1052797, "t_first_token_unix": 1779815080.7722948, "tpot_s": 0.005038563727408253, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13866334], "trace_timestamp_s": 571.625, "ttft_s": 0.038076773984357715, "turn_id": 2} +{"actual_output_tokens": 387, "cached_tokens": 0, "effective_input_length": 79495, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79495, "latency_s": 98.61555420502555, "output_length": 387, "proxy_request_id": "1373577:1:1373577:608", "request_id": "1373577:1:1373577:608", "request_type": "coder", "requested_output_tokens": 387, "session_id": "1373577", "t_dispatch_unix": 1779814984.0013342, "t_finish_unix": 1779815082.6168883, "t_first_token_unix": 1779815056.082341, "tpot_s": 0.06874125105690168, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13612453], "trace_timestamp_s": 474.8630000000003, "ttft_s": 72.08100401301635, "turn_id": 1} +{"actual_output_tokens": 458, "cached_tokens": 11472, "effective_input_length": 12910, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12910, "latency_s": 2.7676100300159305, "output_length": 458, "proxy_request_id": "1398213:3:1401507:759", "request_id": "1398213:3:1401507:759", "request_type": "coder", "requested_output_tokens": 458, "session_id": "1398213", "t_dispatch_unix": 1779815081.8299825, "t_finish_unix": 1779815084.5975926, "t_first_token_unix": 1779815082.045268, "tpot_s": 0.005584345188213989, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13846300, 13846301, 13846302, 13846303, 13846304, 13851656, 13851657, 13851658, 13851659, 13851660, 13851661, 13860134, 13860135, 13860136, 13860137, 13869190, 13869191, 13869192, 13869193], "trace_timestamp_s": 572.7200000000003, "ttft_s": 0.21528401802061126, "turn_id": 3} +{"actual_output_tokens": 128, "cached_tokens": 0, "effective_input_length": 4991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4991, "latency_s": 9.886048524000216, "output_length": 128, "proxy_request_id": "1399948:1:1399948:748", "request_id": "1399948:1:1399948:748", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1399948", "t_dispatch_unix": 1779815076.301673, "t_finish_unix": 1779815086.1877213, "t_first_token_unix": 1779815076.6220095, "tpot_s": 0.07531809334654185, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13854387], "trace_timestamp_s": 567.1910000000007, "ttft_s": 0.3203355249715969, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 16592, "effective_input_length": 26440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26440, "latency_s": 9.161147482984234, "output_length": 32, "proxy_request_id": "1397840:2:1400216:749", "request_id": "1397840:2:1400216:749", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1397840", "t_dispatch_unix": 1779815077.0987594, "t_finish_unix": 1779815086.259907, "t_first_token_unix": 1779815078.8381736, "tpot_s": 0.2393981846455004, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13843674, 13843675, 13843676, 13843677, 13843678, 13843679, 13843680, 13843681, 13843682, 13843683, 13843684, 13856781, 13856782, 13856783, 13856784, 13856785, 13856786, 13856787, 13856788, 13856789], "trace_timestamp_s": 567.9860000000008, "ttft_s": 1.7394118619849905, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 26464, "effective_input_length": 28603, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28603, "latency_s": 0.91063589398982, "output_length": 27, "proxy_request_id": "1397840:3:1402568:761", "request_id": "1397840:3:1402568:761", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1397840", "t_dispatch_unix": 1779815086.261742, "t_finish_unix": 1779815087.172378, "t_first_token_unix": 1779815086.8065605, "tpot_s": 0.014057510883923477, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13843674, 13843675, 13843676, 13843677, 13843678, 13843679, 13843680, 13843681, 13843682, 13843683, 13843684, 13856781, 13856782, 13856783, 13856784, 13856785, 13856786, 13856787, 13856788, 13878865, 13878866, 13878867, 13878868, 13878869], "trace_timestamp_s": 576.335, "ttft_s": 0.5448161989916116, "turn_id": 3} +{"actual_output_tokens": 88, "cached_tokens": 85680, "effective_input_length": 97657, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97657, "latency_s": 9.650917098973878, "output_length": 88, "proxy_request_id": "1366128:20:1400446:752", "request_id": "1366128:20:1400446:752", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1366128", "t_dispatch_unix": 1779815077.861078, "t_finish_unix": 1779815087.511995, "t_first_token_unix": 1779815085.755665, "tpot_s": 0.020183714505434894, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600], "trace_timestamp_s": 568.7440000000006, "ttft_s": 7.894584610010497, "turn_id": 20} +{"actual_output_tokens": 46, "cached_tokens": 3920, "effective_input_length": 11216, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11216, "latency_s": 0.9023762659635395, "output_length": 46, "proxy_request_id": "1400379:3:1402972:763", "request_id": "1400379:3:1402972:763", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1400379", "t_dispatch_unix": 1779815086.9457579, "t_finish_unix": 1779815087.848134, "t_first_token_unix": 1779815087.608847, "tpot_s": 0.005310373444161895, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13882808], "trace_timestamp_s": 577.8340000000007, "ttft_s": 0.6630873749963939, "turn_id": 3} +{"actual_output_tokens": 43, "cached_tokens": 97744, "effective_input_length": 97814, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97814, "latency_s": 0.7212972230045125, "output_length": 43, "proxy_request_id": "1366128:21:1402408:760", "request_id": "1366128:21:1402408:760", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1366128", "t_dispatch_unix": 1779815087.5168083, "t_finish_unix": 1779815088.2381053, "t_first_token_unix": 1779815087.833341, "tpot_s": 0.009628948166556213, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13877569], "trace_timestamp_s": 575.7920000000004, "ttft_s": 0.31653021601960063, "turn_id": 21} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 38041, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38041, "latency_s": 96.89355447195703, "output_length": 55, "proxy_request_id": "1355951:3:1375866:619", "request_id": "1355951:3:1375866:619", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1355951", "t_dispatch_unix": 1779814991.9992359, "t_finish_unix": 1779815088.8927903, "t_first_token_unix": 1779815087.8707027, "tpot_s": 0.01892208951822896, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 482.8890000000001, "ttft_s": 95.87146548600867, "turn_id": 3} +{"actual_output_tokens": 108, "cached_tokens": 0, "effective_input_length": 8848, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8848, "latency_s": 1.2352818720391952, "output_length": 108, "proxy_request_id": "1403188:1:1403188:764", "request_id": "1403188:1:1403188:764", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1403188", "t_dispatch_unix": 1779815087.8465574, "t_finish_unix": 1779815089.081839, "t_first_token_unix": 1779815088.5204427, "tpot_s": 0.00524420763592227, "trace_hash_ids": [13861837, 13861838, 13861839, 13861840, 13861841, 13861842, 13861843, 13861844, 13873939, 13873940, 13873941, 13873942, 13884865, 13884866, 13884867, 13884868, 13884869, 13884870], "trace_timestamp_s": 578.7340000000004, "ttft_s": 0.6738745979964733, "turn_id": 1} +{"actual_output_tokens": 107, "cached_tokens": 7472, "effective_input_length": 10890, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10890, "latency_s": 28.856598640966695, "output_length": 107, "proxy_request_id": "1390240:3:1395387:730", "request_id": "1390240:3:1395387:730", "request_type": "coder", "requested_output_tokens": 107, "session_id": "1390240", "t_dispatch_unix": 1779815060.430262, "t_finish_unix": 1779815089.2868607, "t_first_token_unix": 1779815088.075533, "tpot_s": 0.011425390755010874, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529, 13772017, 13790409, 13790410, 13790411, 13798738, 13798739, 13805950, 13805951, 13805952, 13812101, 13812102, 13812103], "trace_timestamp_s": 551.3200000000006, "ttft_s": 27.64526867197128, "turn_id": 3} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 1954, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1954, "latency_s": 0.4802136430516839, "output_length": 71, "proxy_request_id": "1403989:1:1403989:767", "request_id": "1403989:1:1403989:767", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1403989", "t_dispatch_unix": 1779815090.3419883, "t_finish_unix": 1779815090.822202, "t_first_token_unix": 1779815090.4773161, "tpot_s": 0.004922942571075899, "trace_hash_ids": [13892332, 13892333, 13892334, 13892335], "trace_timestamp_s": 581.232, "ttft_s": 0.13532659003976732, "turn_id": 1} +{"actual_output_tokens": 133, "cached_tokens": 0, "effective_input_length": 63258, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63258, "latency_s": 22.490681776951533, "output_length": 133, "proxy_request_id": "1253743:8:1398344:743", "request_id": "1253743:8:1398344:743", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1253743", "t_dispatch_unix": 1779815070.6290822, "t_finish_unix": 1779815093.1197631, "t_first_token_unix": 1779815085.4557874, "tpot_s": 0.0580573447117455, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 481346, 481347, 481348, 710670, 710671, 710672, 710673, 710674, 710675, 710676, 710677, 710678, 710679, 13839194, 13839195, 13839196, 13839197, 13839198, 13839199, 13839200, 13839201, 13839202, 13839203, 13839204, 13839205, 13839206, 13839207, 13839208, 13839209, 13839210, 13839211, 13839212, 13839213, 13839214, 13839215, 13839216, 13839217, 13839218, 13839219, 184023, 184024, 567789, 13839220, 13839221, 146857, 146858, 146859, 146860, 13839222, 11521, 13839223, 13839224, 13839225, 13839226, 13839227, 13839228, 13839229, 13839230, 13839231, 13839232, 13839233, 13839234, 13839235, 13839236, 13839237, 13839238, 13839239, 13839240, 13839241, 13839242, 13839243, 13839244, 13839245, 13839246, 13839247, 13839248, 13839249, 13839250, 13839251, 13839252, 13839253, 13839254, 13839255, 13839256, 13839257, 11719668, 13839258, 13839259, 13839260, 13839261, 13839262, 13839263, 13839264, 13839265, 13839266, 13839267, 13839268, 13839269, 13839270, 13839271, 13839272, 13839273], "trace_timestamp_s": 561.4990000000007, "ttft_s": 14.82670346100349, "turn_id": 8} +{"actual_output_tokens": 47, "cached_tokens": 38128, "effective_input_length": 39203, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39203, "latency_s": 1.0141440820298158, "output_length": 47, "proxy_request_id": "1382089:2:1404847:773", "request_id": "1382089:2:1404847:773", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1382089", "t_dispatch_unix": 1779815093.3558958, "t_finish_unix": 1779815094.3700402, "t_first_token_unix": 1779815093.7606215, "tpot_s": 0.013241065998875496, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463], "trace_timestamp_s": 584.2460000000001, "ttft_s": 0.40472371503710747, "turn_id": 2} +{"actual_output_tokens": 81, "cached_tokens": 63376, "effective_input_length": 63643, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63643, "latency_s": 1.4990297330077738, "output_length": 81, "proxy_request_id": "1253743:8:1404284:769", "request_id": "1253743:8:1404284:769", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253743", "t_dispatch_unix": 1779815093.124361, "t_finish_unix": 1779815094.6233907, "t_first_token_unix": 1779815093.4205105, "tpot_s": 0.015031669650488766, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 481346, 481347, 481348, 710670, 710671, 710672, 710673, 710674, 710675, 710676, 710677, 710678, 710679, 13839194, 13839195, 13839196, 13839197, 13839198, 13839199, 13839200, 13839201, 13839202, 13839203, 13839204, 13839205, 13839206, 13839207, 13839208, 13839209, 13839210, 13839211, 13839212, 13839213, 13839214, 13839215, 13839216, 13839217, 13839218, 13839219, 184023, 184024, 567789, 13839220, 13839221, 146857, 146858, 146859, 146860, 13839222, 11521, 13839223, 13839224, 13839225, 13839226, 13839227, 13839228, 13839229, 13839230, 13839231, 13839232, 13839233, 13839234, 13839235, 13839236, 13839237, 13839238, 13839239, 13839240, 13839241, 13839242, 13839243, 13839244, 13839245, 13839246, 13839247, 13839248, 13839249, 13839250, 13839251, 13839252, 13839253, 13839254, 13839255, 13839256, 13839257, 11719668, 13839258, 13839259, 13839260, 13839261, 13839262, 13839263, 13839264, 13839265, 13839266, 13839267, 13839268, 13839269, 13839270, 13839271, 13839272, 13839273, 13894363], "trace_timestamp_s": 582.25, "ttft_s": 0.2961468669818714, "turn_id": 8} +{"actual_output_tokens": 283, "cached_tokens": 51056, "effective_input_length": 68109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68109, "latency_s": 16.403791120043024, "output_length": 283, "proxy_request_id": "1381387:4:1400724:754", "request_id": "1381387:4:1400724:754", "request_type": "coder", "requested_output_tokens": 283, "session_id": "1381387", "t_dispatch_unix": 1779815078.9735262, "t_finish_unix": 1779815095.3773174, "t_first_token_unix": 1779815091.155994, "tpot_s": 0.014967836730441423, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13861879], "trace_timestamp_s": 569.8560000000007, "ttft_s": 12.182465209043585, "turn_id": 4} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 21009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21009, "latency_s": 2.644478415022604, "output_length": 34, "proxy_request_id": "1398594:2:1404702:771", "request_id": "1398594:2:1404702:771", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1398594", "t_dispatch_unix": 1779815092.856714, "t_finish_unix": 1779815095.5011919, "t_first_token_unix": 1779815095.1070378, "tpot_s": 0.011937074758338205, "trace_hash_ids": [13835320, 13835321, 13835322, 13835323, 13835324, 13835325, 13835326, 13841636, 13841637, 13841638, 13841639, 13841640, 13841641, 13841642, 13841643, 13848797, 13848798, 13848799, 13848800, 13848801, 13848802, 13858752, 13858753, 13858754, 13858755, 13858756, 13858757, 13858758, 13858759, 13858760, 13858761, 13867990, 13867991, 13867992, 13867993, 13877954, 13877955, 13884204, 13884205, 13897216, 13897217, 13897218], "trace_timestamp_s": 583.7370000000001, "ttft_s": 2.2503218129859306, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 97856, "effective_input_length": 97917, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97917, "latency_s": 7.824589507014025, "output_length": 13, "proxy_request_id": "1366128:22:1403837:766", "request_id": "1366128:22:1403837:766", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1366128", "t_dispatch_unix": 1779815089.8717086, "t_finish_unix": 1779815097.6962981, "t_first_token_unix": 1779815097.3798938, "tpot_s": 0.026329344502300955, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13890604], "trace_timestamp_s": 580.759, "ttft_s": 7.508182359975763, "turn_id": 22} +{"actual_output_tokens": 13, "cached_tokens": 5104, "effective_input_length": 6149, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6149, "latency_s": 2.913273330021184, "output_length": 13, "proxy_request_id": "1399948:2:1405276:778", "request_id": "1399948:2:1405276:778", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1399948", "t_dispatch_unix": 1779815094.813201, "t_finish_unix": 1779815097.726474, "t_first_token_unix": 1779815097.5173085, "tpot_s": 0.017305086585110985, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13902108], "trace_timestamp_s": 585.7030000000004, "ttft_s": 2.7041063479846343, "turn_id": 2} +{"actual_output_tokens": 191, "cached_tokens": 68384, "effective_input_length": 69508, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69508, "latency_s": 2.8174624430248514, "output_length": 191, "proxy_request_id": "1381387:5:1404170:768", "request_id": "1381387:5:1404170:768", "request_type": "coder", "requested_output_tokens": 191, "session_id": "1381387", "t_dispatch_unix": 1779815095.380433, "t_finish_unix": 1779815098.197896, "t_first_token_unix": 1779815096.0351918, "tpot_s": 0.011380510163297386, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13893570], "trace_timestamp_s": 581.8360000000002, "ttft_s": 0.6547564479988068, "turn_id": 5} +{"actual_output_tokens": 2641, "cached_tokens": 28496, "effective_input_length": 33321, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33321, "latency_s": 45.35230772203067, "output_length": 2641, "proxy_request_id": "1391404:2:1393919:720", "request_id": "1391404:2:1393919:720", "request_type": "coder", "requested_output_tokens": 2641, "session_id": "1391404", "t_dispatch_unix": 1779815055.1848118, "t_finish_unix": 1779815100.5371194, "t_first_token_unix": 1779815056.3061802, "tpot_s": 0.01675403241438978, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 94557, 94558, 94559, 94560, 94561, 94562, 94563, 94564, 94565, 238090, 238091, 3841644, 3841645, 3841646, 3841647, 3841648, 3841649, 13750192, 3809872, 13750193, 13750194, 13777397, 13777398, 13777399, 13777400, 13777401, 13777402, 13777403, 13777404, 13777405, 13777406, 13777407, 13777408, 13777409, 13777410, 13777411, 13777412, 13777413, 13777414, 13777415, 13777416, 13777417, 13777418, 13777419, 13777420, 13777421, 13777422, 13777423, 13777424, 13777425, 13799002, 13799003, 13799004, 13799005, 13799006, 13799007, 13799008, 13799009, 13799010, 13799011, 13799012], "trace_timestamp_s": 546.0730000000003, "ttft_s": 1.1213661780348048, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 2115, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2115, "latency_s": 0.3629901090171188, "output_length": 47, "proxy_request_id": "1406966:1:1406966:785", "request_id": "1406966:1:1406966:785", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1406966", "t_dispatch_unix": 1779815100.8416812, "t_finish_unix": 1779815101.204671, "t_first_token_unix": 1779815100.9792855, "tpot_s": 0.00489378136926857, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13917925], "trace_timestamp_s": 591.732, "ttft_s": 0.13760315702529624, "turn_id": 1} +{"actual_output_tokens": 33, "cached_tokens": 10672, "effective_input_length": 10736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10736, "latency_s": 31.3291551329894, "output_length": 33, "proxy_request_id": "1362265:5:1398180:741", "request_id": "1362265:5:1398180:741", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1362265", "t_dispatch_unix": 1779815070.2120352, "t_finish_unix": 1779815101.5411904, "t_first_token_unix": 1779815098.2264123, "tpot_s": 0.1035790857495158, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588], "trace_timestamp_s": 561.094, "ttft_s": 28.014375515980646, "turn_id": 5} +{"actual_output_tokens": 46, "cached_tokens": 10768, "effective_input_length": 10816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10816, "latency_s": 0.7848590649664402, "output_length": 46, "proxy_request_id": "1362265:6:1399937:747", "request_id": "1362265:6:1399937:747", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1362265", "t_dispatch_unix": 1779815101.5418081, "t_finish_unix": 1779815102.3266678, "t_first_token_unix": 1779815101.6106749, "tpot_s": 0.01590383120088114, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 13854355], "trace_timestamp_s": 567.1610000000001, "ttft_s": 0.06886541395215318, "turn_id": 6} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 1531, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1531, "latency_s": 0.3719847630127333, "output_length": 55, "proxy_request_id": "1407494:1:1407494:787", "request_id": "1407494:1:1407494:787", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1407494", "t_dispatch_unix": 1779815102.6382146, "t_finish_unix": 1779815103.0101993, "t_first_token_unix": 1779815102.744977, "tpot_s": 0.004906997406915589, "trace_hash_ids": [13922818, 13922819, 13922820], "trace_timestamp_s": 593.5290000000005, "ttft_s": 0.1067613530321978, "turn_id": 1} +{"actual_output_tokens": 528, "cached_tokens": 0, "effective_input_length": 126340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126340, "latency_s": 119.77390573400771, "output_length": 528, "proxy_request_id": "1373431:1:1373431:606", "request_id": "1373431:1:1373431:606", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1373431", "t_dispatch_unix": 1779814983.4833586, "t_finish_unix": 1779815103.2572641, "t_first_token_unix": 1779815034.5597277, "tpot_s": 0.13035513030738877, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13611159], "trace_timestamp_s": 474.3240000000005, "ttft_s": 51.07636679301504, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 2160, "effective_input_length": 4789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4789, "latency_s": 0.4220655999961309, "output_length": 44, "proxy_request_id": "1406966:2:1407710:789", "request_id": "1406966:2:1407710:789", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1406966", "t_dispatch_unix": 1779815103.3200152, "t_finish_unix": 1779815103.742081, "t_first_token_unix": 1779815103.5251043, "tpot_s": 0.005038016441895432, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13924515, 13924516, 13924517, 13924518, 13924519, 13924520], "trace_timestamp_s": 594.21, "ttft_s": 0.20508777198847383, "turn_id": 2} +{"actual_output_tokens": 196, "cached_tokens": 0, "effective_input_length": 93040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93040, "latency_s": 36.27315429999726, "output_length": 196, "proxy_request_id": "1397515:1:1397515:736", "request_id": "1397515:1:1397515:736", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1397515", "t_dispatch_unix": 1779815067.6979568, "t_finish_unix": 1779815103.9711108, "t_first_token_unix": 1779815098.2382317, "tpot_s": 0.029397751138402293, "trace_hash_ids": [61256, 61257, 9334, 61258, 61259, 61260, 61261, 61262, 61263, 61264, 61265, 139791, 92491, 139792, 139793, 139794, 139795, 139796, 139797, 139798, 740834, 740835, 740836, 740837, 1942273, 1942274, 1942275, 1942276, 1942277, 1942278, 1942279, 1942280, 1942281, 590845, 590846, 590847, 590848, 1942282, 161018, 161019, 161020, 161021, 1942283, 10351134, 10351135, 10351136, 10351137, 10351138, 10351139, 10351140, 10351141, 10351142, 10351143, 13831505, 2806911, 13831506, 13831507, 13831508, 13831509, 13831510, 13831511, 13831512, 13831513, 13831514, 13831515, 13831516, 13831517, 13831518, 13831519, 13831520, 13831521, 13831522, 13831523, 13831524, 13831525, 13831526, 13831527, 13831528, 13831529, 13831530, 13831531, 13831532, 13831533, 13831534, 13831535, 13831536, 13831537, 13831538, 13831539, 13831540, 13831541, 13831542, 13831543, 13831544, 13831545, 13831546, 13831547, 13831548, 13831549, 13831550, 13831551, 13831552, 13831553, 13831554, 13831555, 13831556, 13831557, 13831558, 13831559, 13831560, 13831561, 13831562, 13831563, 13831564, 13831565, 13831566, 13831567, 13831568, 13831569, 13831570, 13831571, 13831572, 13831573, 13831574, 13831575, 13831576, 13831577, 13831578, 13831579, 13831580, 13831581, 13831582, 13831583, 13831584, 13831585, 13831586, 13831587, 13831588, 13831589, 13831590, 13831591, 13831592, 13831593, 13831594, 13831595, 13831596, 13831597, 13831598, 13831599, 13831600, 13831601, 13831602, 13831603, 13831604, 13831605, 13831606, 13831607, 13831608, 13831609, 13831610, 13831611, 13831612, 13831613, 13831614, 13831615, 13831616, 13831617, 13831618, 13831619, 13831620, 13831621, 13831622, 13831623, 13831624, 13831625, 13831626, 13831627, 13831628, 13831629, 13831630, 13831631, 13831632], "trace_timestamp_s": 558.5540000000001, "ttft_s": 30.540273113001604, "turn_id": 1} +{"actual_output_tokens": 76, "cached_tokens": 0, "effective_input_length": 2944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2944, "latency_s": 0.9875763530144468, "output_length": 76, "proxy_request_id": "1407995:1:1407995:793", "request_id": "1407995:1:1407995:793", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1407995", "t_dispatch_unix": 1779815104.4526489, "t_finish_unix": 1779815105.4402254, "t_first_token_unix": 1779815104.7280815, "tpot_s": 0.009492034039770563, "trace_hash_ids": [13926947, 13926948, 13926949, 13926950, 13926951, 13926952], "trace_timestamp_s": 595.3430000000008, "ttft_s": 0.27543131704442203, "turn_id": 1} +{"actual_output_tokens": 193, "cached_tokens": 0, "effective_input_length": 1501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1501, "latency_s": 2.542202061973512, "output_length": 193, "proxy_request_id": "1407599:1:1407599:788", "request_id": "1407599:1:1407599:788", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1407599", "t_dispatch_unix": 1779815102.9871192, "t_finish_unix": 1779815105.5293207, "t_first_token_unix": 1779815103.3133247, "tpot_s": 0.011540445619781773, "trace_hash_ids": [10764018, 13923669, 13923670], "trace_timestamp_s": 593.8770000000004, "ttft_s": 0.3262045320007019, "turn_id": 1} +{"actual_output_tokens": 56, "cached_tokens": 6160, "effective_input_length": 7995, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7995, "latency_s": 8.91924104100326, "output_length": 56, "proxy_request_id": "1399948:3:1405988:782", "request_id": "1399948:3:1405988:782", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1399948", "t_dispatch_unix": 1779815097.7285278, "t_finish_unix": 1779815106.647769, "t_first_token_unix": 1779815105.4484143, "tpot_s": 0.021798469946423375, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13907778], "trace_timestamp_s": 588.3230000000003, "ttft_s": 7.719885021972004, "turn_id": 3} +{"actual_output_tokens": 212, "cached_tokens": 22432, "effective_input_length": 27676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27676, "latency_s": 2.376400178007316, "output_length": 212, "proxy_request_id": "1286804:5:1407989:792", "request_id": "1286804:5:1407989:792", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1286804", "t_dispatch_unix": 1779815104.424596, "t_finish_unix": 1779815106.8009956, "t_first_token_unix": 1779815105.4534488, "tpot_s": 0.006385363568882877, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13654392, 13654393, 13654394, 13654395, 13654396, 13654397, 13654398, 13654399, 13654400, 13654401, 13654402, 13654403, 13654404, 13926882, 13926883, 13926884, 13926885, 13926886, 13926887, 13926888, 13926889, 13926890, 13926891, 13926892, 13926893], "trace_timestamp_s": 595.3130000000001, "ttft_s": 1.0288513620034792, "turn_id": 5} +{"actual_output_tokens": 39, "cached_tokens": 0, "effective_input_length": 7553, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7553, "latency_s": 0.9729290999821387, "output_length": 39, "proxy_request_id": "1408430:1:1408430:797", "request_id": "1408430:1:1408430:797", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1408430", "t_dispatch_unix": 1779815105.9831178, "t_finish_unix": 1779815106.9560463, "t_first_token_unix": 1779815106.5206463, "tpot_s": 0.011451721920533791, "trace_hash_ids": [13895286, 13899747, 13899748, 13906888, 13906889, 13914310, 13914311, 13914312, 13925471, 13925472, 13930592, 13930593, 13930594, 13930595, 13930596], "trace_timestamp_s": 596.8710000000001, "ttft_s": 0.537527829001192, "turn_id": 1} +{"actual_output_tokens": 110, "cached_tokens": 27456, "effective_input_length": 27786, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27786, "latency_s": 1.852202890033368, "output_length": 110, "proxy_request_id": "1340290:7:1408176:795", "request_id": "1340290:7:1408176:795", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1340290", "t_dispatch_unix": 1779815105.1372747, "t_finish_unix": 1779815106.9894774, "t_first_token_unix": 1779815105.3308265, "tpot_s": 0.015214891302711203, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13928402], "trace_timestamp_s": 596.0280000000002, "ttft_s": 0.19355039799120277, "turn_id": 7} +{"actual_output_tokens": 23, "cached_tokens": 8048, "effective_input_length": 8540, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8540, "latency_s": 0.638393469969742, "output_length": 23, "proxy_request_id": "1399948:4:1407140:786", "request_id": "1399948:4:1407140:786", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1399948", "t_dispatch_unix": 1779815106.6485198, "t_finish_unix": 1779815107.2869136, "t_first_token_unix": 1779815106.770248, "tpot_s": 0.02347412754633379, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13919490], "trace_timestamp_s": 592.2640000000001, "ttft_s": 0.12172681896481663, "turn_id": 4} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 1801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1801, "latency_s": 0.34785820404067636, "output_length": 47, "proxy_request_id": "1408779:1:1408779:802", "request_id": "1408779:1:1408779:802", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1408779", "t_dispatch_unix": 1779815107.08323, "t_finish_unix": 1779815107.4310882, "t_first_token_unix": 1779815107.2046018, "tpot_s": 0.004917181304494, "trace_hash_ids": [13934169, 13934170, 13934171, 13934172], "trace_timestamp_s": 597.9740000000002, "ttft_s": 0.12137082999106497, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 3230, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3230, "latency_s": 0.3215855400194414, "output_length": 26, "proxy_request_id": "1408889:1:1408889:804", "request_id": "1408889:1:1408889:804", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1408889", "t_dispatch_unix": 1779815107.4540684, "t_finish_unix": 1779815107.7756538, "t_first_token_unix": 1779815107.6526797, "tpot_s": 0.004906652879435569, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13935101], "trace_timestamp_s": 598.344, "ttft_s": 0.1986101070069708, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 8560, "effective_input_length": 8612, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8612, "latency_s": 0.6245862689684145, "output_length": 24, "proxy_request_id": "1399948:5:1407922:791", "request_id": "1399948:5:1407922:791", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1399948", "t_dispatch_unix": 1779815107.2874675, "t_finish_unix": 1779815107.9120543, "t_first_token_unix": 1779815107.3718739, "tpot_s": 0.02347323465231887, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13926411], "trace_timestamp_s": 595.0500000000002, "ttft_s": 0.08440451096976176, "turn_id": 5} +{"actual_output_tokens": 109, "cached_tokens": 97920, "effective_input_length": 109574, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109574, "latency_s": 10.235844461014494, "output_length": 109, "proxy_request_id": "1366128:23:1405900:781", "request_id": "1366128:23:1405900:781", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1366128", "t_dispatch_unix": 1779815097.711924, "t_finish_unix": 1779815107.9477687, "t_first_token_unix": 1779815105.4657767, "tpot_s": 0.022976946009159158, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13907243], "trace_timestamp_s": 587.9760000000006, "ttft_s": 7.753850785025861, "turn_id": 23} +{"actual_output_tokens": 556, "cached_tokens": 49552, "effective_input_length": 62630, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62630, "latency_s": 27.8061562210205, "output_length": 556, "proxy_request_id": "1364090:5:1401054:756", "request_id": "1364090:5:1401054:756", "request_type": "coder", "requested_output_tokens": 556, "session_id": "1364090", "t_dispatch_unix": 1779815080.242424, "t_finish_unix": 1779815108.0485802, "t_first_token_unix": 1779815101.0803554, "tpot_s": 0.012554892331470844, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13865242], "trace_timestamp_s": 571.1260000000002, "ttft_s": 20.8379291180172, "turn_id": 5} +{"actual_output_tokens": 39, "cached_tokens": 109680, "effective_input_length": 109775, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109775, "latency_s": 0.8355704689747654, "output_length": 39, "proxy_request_id": "1366128:24:1407996:794", "request_id": "1366128:24:1407996:794", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1366128", "t_dispatch_unix": 1779815107.953086, "t_finish_unix": 1779815108.7886558, "t_first_token_unix": 1779815108.2362957, "tpot_s": 0.014522926606188872, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13926953], "trace_timestamp_s": 595.344, "ttft_s": 0.28320758597692475, "turn_id": 24} +{"actual_output_tokens": 115, "cached_tokens": 61984, "effective_input_length": 121811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121811, "latency_s": 45.85592567495769, "output_length": 115, "proxy_request_id": "1313181:7:1327489:383", "request_id": "1313181:7:1327489:383", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1313181", "t_dispatch_unix": 1779815063.1180573, "t_finish_unix": 1779815108.9739826, "t_first_token_unix": 1779815097.19473, "tpot_s": 0.10330691529854544, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321], "trace_timestamp_s": 313.01800000000003, "ttft_s": 34.07667052996112, "turn_id": 7} +{"actual_output_tokens": 46, "cached_tokens": 9280, "effective_input_length": 38242, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38242, "latency_s": 20.357537389965728, "output_length": 46, "proxy_request_id": "1355951:4:1389858:703", "request_id": "1355951:4:1389858:703", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1355951", "t_dispatch_unix": 1779815088.89412, "t_finish_unix": 1779815109.2516575, "t_first_token_unix": 1779815108.52087, "tpot_s": 0.016230564887842372, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 531.8220000000001, "ttft_s": 19.626747875008732, "turn_id": 4} +{"actual_output_tokens": 264, "cached_tokens": 0, "effective_input_length": 44148, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44148, "latency_s": 20.00650807103375, "output_length": 264, "proxy_request_id": "1268861:8:1403753:765", "request_id": "1268861:8:1403753:765", "request_type": "coder", "requested_output_tokens": 264, "session_id": "1268861", "t_dispatch_unix": 1779815089.5907412, "t_finish_unix": 1779815109.5972493, "t_first_token_unix": 1779815097.3670392, "tpot_s": 0.04650165142576448, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 13890053], "trace_timestamp_s": 580.4790000000003, "ttft_s": 7.776295741030481, "turn_id": 8} +{"actual_output_tokens": 641, "cached_tokens": 24368, "effective_input_length": 24442, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24442, "latency_s": 29.62730495701544, "output_length": 641, "proxy_request_id": "1363943:10:1401002:755", "request_id": "1363943:10:1401002:755", "request_type": "coder", "requested_output_tokens": 641, "session_id": "1363943", "t_dispatch_unix": 1779815080.0127053, "t_finish_unix": 1779815109.6400094, "t_first_token_unix": 1779815085.7814758, "tpot_s": 0.03727853897808018, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 13864501], "trace_timestamp_s": 570.9030000000002, "ttft_s": 5.7687699280213565, "turn_id": 10} +{"actual_output_tokens": 747, "cached_tokens": 0, "effective_input_length": 32944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32944, "latency_s": 15.808876727998722, "output_length": 747, "proxy_request_id": "1405155:1:1405155:775", "request_id": "1405155:1:1405155:775", "request_type": "coder", "requested_output_tokens": 747, "session_id": "1405155", "t_dispatch_unix": 1779815094.457613, "t_finish_unix": 1779815110.2664897, "t_first_token_unix": 1779815099.103332, "tpot_s": 0.014963599349869586, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13900957], "trace_timestamp_s": 585.3360000000002, "ttft_s": 4.645716690050904, "turn_id": 1} +{"actual_output_tokens": 110, "cached_tokens": 69696, "effective_input_length": 71570, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71570, "latency_s": 1.9737775799585506, "output_length": 110, "proxy_request_id": "1381387:6:1409195:806", "request_id": "1381387:6:1409195:806", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1381387", "t_dispatch_unix": 1779815108.716798, "t_finish_unix": 1779815110.6905756, "t_first_token_unix": 1779815109.7859569, "tpot_s": 0.008296730330559946, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13937687, 13937688, 13937689, 13937690, 13937691], "trace_timestamp_s": 599.6050000000005, "ttft_s": 1.0691569739719853, "turn_id": 6} +{"actual_output_tokens": 196, "cached_tokens": 27888, "effective_input_length": 29730, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29730, "latency_s": 3.578153470007237, "output_length": 196, "proxy_request_id": "1340290:8:1409129:805", "request_id": "1340290:8:1409129:805", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1340290", "t_dispatch_unix": 1779815108.4606357, "t_finish_unix": 1779815112.038789, "t_first_token_unix": 1779815108.9736938, "tpot_s": 0.015716752712913337, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13936967], "trace_timestamp_s": 599.3500000000004, "ttft_s": 0.513056477997452, "turn_id": 8} +{"actual_output_tokens": 30, "cached_tokens": 1840, "effective_input_length": 5001, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5001, "latency_s": 0.6543210059753619, "output_length": 30, "proxy_request_id": "1408779:2:1410032:807", "request_id": "1408779:2:1410032:807", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1408779", "t_dispatch_unix": 1779815111.604494, "t_finish_unix": 1779815112.2588148, "t_first_token_unix": 1779815111.8391685, "tpot_s": 0.014457152345506796, "trace_hash_ids": [13934169, 13934170, 13934171, 13940285, 13940286, 13945464, 13945465, 13945466, 13945467, 13945468], "trace_timestamp_s": 602.4940000000006, "ttft_s": 0.23467364197131246, "turn_id": 2} +{"actual_output_tokens": 39, "cached_tokens": 4832, "effective_input_length": 7893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7893, "latency_s": 0.49531173397554085, "output_length": 39, "proxy_request_id": "1406966:3:1410097:808", "request_id": "1406966:3:1410097:808", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1406966", "t_dispatch_unix": 1779815111.8374918, "t_finish_unix": 1779815112.3328032, "t_first_token_unix": 1779815112.119374, "tpot_s": 0.005609667657776491, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13924515, 13924516, 13924517, 13924518, 13924519, 13938672, 13938673, 13938674, 13938675, 13938676, 13945877, 13945878], "trace_timestamp_s": 602.7270000000008, "ttft_s": 0.2818812789628282, "turn_id": 3} +{"actual_output_tokens": 91, "cached_tokens": 10848, "effective_input_length": 11070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11070, "latency_s": 5.5797038589953445, "output_length": 91, "proxy_request_id": "1362265:7:1408772:800", "request_id": "1362265:7:1408772:800", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1362265", "t_dispatch_unix": 1779815107.0659256, "t_finish_unix": 1779815112.6456294, "t_first_token_unix": 1779815107.1511059, "tpot_s": 0.06104710654472001, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 13934071], "trace_timestamp_s": 597.9570000000003, "ttft_s": 0.08517911296803504, "turn_id": 7} +{"actual_output_tokens": 28, "cached_tokens": 1584, "effective_input_length": 4728, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4728, "latency_s": 0.5191212520003319, "output_length": 28, "proxy_request_id": "1407494:2:1410400:809", "request_id": "1407494:2:1410400:809", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1407494", "t_dispatch_unix": 1779815112.7025557, "t_finish_unix": 1779815113.2216768, "t_first_token_unix": 1779815112.9291306, "tpot_s": 0.010820540146798723, "trace_hash_ids": [13922818, 13922819, 13922820, 13939528, 13939529, 13939530, 13948712, 13948713, 13948714, 13948715], "trace_timestamp_s": 603.5920000000006, "ttft_s": 0.22657362202880904, "turn_id": 2} +{"actual_output_tokens": 56, "cached_tokens": 3248, "effective_input_length": 4825, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4825, "latency_s": 0.535557342984248, "output_length": 56, "proxy_request_id": "1408889:2:1410453:810", "request_id": "1408889:2:1410453:810", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1408889", "t_dispatch_unix": 1779815112.841086, "t_finish_unix": 1779815113.376644, "t_first_token_unix": 1779815113.0634673, "tpot_s": 0.005688850272616202, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13940392, 13940393, 13948965, 13948966], "trace_timestamp_s": 603.7310000000007, "ttft_s": 0.22238019498763606, "turn_id": 2} +{"actual_output_tokens": 207, "cached_tokens": 0, "effective_input_length": 6377, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6377, "latency_s": 7.111069559992757, "output_length": 207, "proxy_request_id": "1408578:1:1408578:798", "request_id": "1408578:1:1408578:798", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1408578", "t_dispatch_unix": 1779815106.4039803, "t_finish_unix": 1779815113.5150497, "t_first_token_unix": 1779815106.859881, "tpot_s": 0.03230537367968829, "trace_hash_ids": [13916254, 13916255, 13916256, 13916257, 13916258, 13916259, 13916260, 13921648, 13926172, 13926173, 13926174, 13931865, 13931866], "trace_timestamp_s": 597.2930000000006, "ttft_s": 0.455899728985969, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 29920, "effective_input_length": 29958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29958, "latency_s": 0.7086936520063318, "output_length": 49, "proxy_request_id": "1340290:9:1410595:811", "request_id": "1340290:9:1410595:811", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1340290", "t_dispatch_unix": 1779815113.257057, "t_finish_unix": 1779815113.9657507, "t_first_token_unix": 1779815113.343264, "tpot_s": 0.012962367521443715, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13950218], "trace_timestamp_s": 604.1469999999999, "ttft_s": 0.08620509295724332, "turn_id": 9} +{"actual_output_tokens": 18, "cached_tokens": 8624, "effective_input_length": 11381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11381, "latency_s": 0.40661607100628316, "output_length": 18, "proxy_request_id": "1399948:6:1410696:812", "request_id": "1399948:6:1410696:812", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1399948", "t_dispatch_unix": 1779815113.5898547, "t_finish_unix": 1779815113.9964707, "t_first_token_unix": 1779815113.91182, "tpot_s": 0.00496431823258343, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 13951145], "trace_timestamp_s": 604.4790000000003, "ttft_s": 0.32196390302851796, "turn_id": 6} +{"actual_output_tokens": 3525, "cached_tokens": 88128, "effective_input_length": 106143, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106143, "latency_s": 58.16805879998719, "output_length": 3525, "proxy_request_id": "1370129:6:1394177:722", "request_id": "1370129:6:1394177:722", "request_type": "coder", "requested_output_tokens": 3525, "session_id": "1370129", "t_dispatch_unix": 1779815056.1820567, "t_finish_unix": 1779815114.3501155, "t_first_token_unix": 1779815067.1543887, "tpot_s": 0.013392583903508122, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13768317, 13768318, 13768319, 13768320, 13768321, 13801467, 13801468, 13801469, 13801470, 13801471, 13801472, 13801473, 13801474, 13801475, 13801476, 13801477, 13801478, 13801479, 13801480, 13801481, 13801482, 13801483, 13801484, 13801485, 13801486, 13801487, 13801488, 13801489, 13801490, 13801491, 13801492, 13801493, 13801494, 13801495, 13801496, 13801497, 13801498, 13801499, 13801500, 13801501, 13801502, 13801503], "trace_timestamp_s": 547.0610000000006, "ttft_s": 10.972329679992981, "turn_id": 6} +{"actual_output_tokens": 31, "cached_tokens": 5024, "effective_input_length": 7110, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7110, "latency_s": 0.35489134601084515, "output_length": 31, "proxy_request_id": "1408779:3:1411249:815", "request_id": "1408779:3:1411249:815", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1408779", "t_dispatch_unix": 1779815115.6179566, "t_finish_unix": 1779815115.972848, "t_first_token_unix": 1779815115.8205094, "tpot_s": 0.0050691107326808075, "trace_hash_ids": [13934169, 13934170, 13934171, 13940285, 13940286, 13945464, 13945465, 13945466, 13945467, 13956042, 13956043, 13956044, 13956045, 13956046], "trace_timestamp_s": 606.5080000000007, "ttft_s": 0.20255157898645848, "turn_id": 3} +{"actual_output_tokens": 417, "cached_tokens": 63184, "effective_input_length": 73392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73392, "latency_s": 8.369912697991822, "output_length": 417, "proxy_request_id": "1364090:6:1408777:801", "request_id": "1364090:6:1408777:801", "request_type": "coder", "requested_output_tokens": 417, "session_id": "1364090", "t_dispatch_unix": 1779815108.055379, "t_finish_unix": 1779815116.4252915, "t_first_token_unix": 1779815112.616976, "tpot_s": 0.00915388312023424, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13934141], "trace_timestamp_s": 597.969, "ttft_s": 4.5615952929947525, "turn_id": 6} +{"actual_output_tokens": 280, "cached_tokens": 30000, "effective_input_length": 30154, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30154, "latency_s": 1.9395892770262435, "output_length": 280, "proxy_request_id": "1340290:10:1411397:816", "request_id": "1340290:10:1411397:816", "request_type": "coder", "requested_output_tokens": 280, "session_id": "1340290", "t_dispatch_unix": 1779815116.2425072, "t_finish_unix": 1779815118.1820962, "t_first_token_unix": 1779815116.3678098, "tpot_s": 0.0065018914193065176, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145], "trace_timestamp_s": 607.1330000000007, "ttft_s": 0.12530019000405446, "turn_id": 10} +{"actual_output_tokens": 63, "cached_tokens": 4752, "effective_input_length": 9801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9801, "latency_s": 1.1257792329997756, "output_length": 63, "proxy_request_id": "1407494:3:1413526:825", "request_id": "1407494:3:1413526:825", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1407494", "t_dispatch_unix": 1779815123.6522052, "t_finish_unix": 1779815124.7779849, "t_first_token_unix": 1779815124.1429384, "tpot_s": 0.010236618822560675, "trace_hash_ids": [13922818, 13922819, 13922820, 13939528, 13939529, 13939530, 13948712, 13948713, 13948714, 13962495, 13962496, 13962497, 13962498, 13962499, 13962500, 13962501, 13962502, 13977212, 13977213, 13977214], "trace_timestamp_s": 614.5410000000002, "ttft_s": 0.49073140003019944, "turn_id": 3} +{"actual_output_tokens": 185, "cached_tokens": 4880, "effective_input_length": 10633, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10633, "latency_s": 2.4712220649817027, "output_length": 185, "proxy_request_id": "1408889:3:1414177:827", "request_id": "1408889:3:1414177:827", "request_type": "coder", "requested_output_tokens": 185, "session_id": "1408889", "t_dispatch_unix": 1779815125.7827885, "t_finish_unix": 1779815128.2540107, "t_first_token_unix": 1779815126.3278263, "tpot_s": 0.010466273271721666, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13940392, 13940393, 13948965, 13956064, 13956065, 13962134, 13962135, 13962136, 13968978, 13968979, 13968980, 13968981, 13968982, 13983352, 13983353], "trace_timestamp_s": 616.6710000000003, "ttft_s": 0.5450360359973274, "turn_id": 3} +{"actual_output_tokens": 249, "cached_tokens": 30432, "effective_input_length": 35022, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35022, "latency_s": 7.133565524010919, "output_length": 249, "proxy_request_id": "1340290:11:1413050:822", "request_id": "1340290:11:1413050:822", "request_type": "coder", "requested_output_tokens": 249, "session_id": "1340290", "t_dispatch_unix": 1779815121.8553023, "t_finish_unix": 1779815128.9888678, "t_first_token_unix": 1779815122.9733129, "tpot_s": 0.02425505510097625, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 13972768], "trace_timestamp_s": 612.7440000000006, "ttft_s": 1.1180085020023398, "turn_id": 11} +{"actual_output_tokens": 74, "cached_tokens": 0, "effective_input_length": 22392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22392, "latency_s": 4.949963466031477, "output_length": 74, "proxy_request_id": "1407995:2:1413725:826", "request_id": "1407995:2:1413725:826", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1407995", "t_dispatch_unix": 1779815124.278827, "t_finish_unix": 1779815129.2287903, "t_first_token_unix": 1779815126.753229, "tpot_s": 0.033907821438632496, "trace_hash_ids": [13926947, 13926948, 13926949, 13926950, 13926951, 13936036, 13936037, 13936038, 13936039, 13936040, 13945776, 13945777, 13945778, 13945779, 13955974, 13955975, 13955976, 13955977, 13955978, 13955979, 13955980, 13964295, 13964296, 13964297, 13964298, 13964299, 13964300, 13964301, 13964302, 13971392, 13971393, 13971394, 13971395, 13971396, 13971397, 13971398, 13978636, 13978637, 13978638, 13978639, 13978640, 13978641, 13978642, 13978643], "trace_timestamp_s": 615.1620000000003, "ttft_s": 2.4744003629893996, "turn_id": 2} +{"actual_output_tokens": 193, "cached_tokens": 0, "effective_input_length": 40273, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40273, "latency_s": 9.031316397013143, "output_length": 193, "proxy_request_id": "1277428:8:1412675:821", "request_id": "1277428:8:1412675:821", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1277428", "t_dispatch_unix": 1779815120.5690222, "t_finish_unix": 1779815129.6003392, "t_first_token_unix": 1779815126.981274, "tpot_s": 0.013639265182064264, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 13969076], "trace_timestamp_s": 611.4540000000006, "ttft_s": 6.412248655047733, "turn_id": 8} +{"actual_output_tokens": 510, "cached_tokens": 73808, "effective_input_length": 86193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86193, "latency_s": 11.189796079997905, "output_length": 510, "proxy_request_id": "1364090:7:1412644:820", "request_id": "1364090:7:1412644:820", "request_type": "coder", "requested_output_tokens": 510, "session_id": "1364090", "t_dispatch_unix": 1779815120.468174, "t_finish_unix": 1779815131.6579702, "t_first_token_unix": 1779815126.774416, "tpot_s": 0.00959366488017504, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 13968786], "trace_timestamp_s": 611.3520000000008, "ttft_s": 6.3062398550100625, "turn_id": 7} +{"actual_output_tokens": 528, "cached_tokens": 33680, "effective_input_length": 40330, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40330, "latency_s": 6.549949171021581, "output_length": 528, "proxy_request_id": "1405155:2:1414214:828", "request_id": "1405155:2:1414214:828", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1405155", "t_dispatch_unix": 1779815125.9292336, "t_finish_unix": 1779815132.4791825, "t_first_token_unix": 1779815128.4685235, "tpot_s": 0.0076098153530001515, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13983589, 13983590, 13983591, 13983592, 13983593, 13983594, 13983595, 13983596, 13983597, 13983598, 13983599, 13983600, 13983601, 13983602, 13983603], "trace_timestamp_s": 616.817, "ttft_s": 2.5392879199935123, "turn_id": 2} +{"actual_output_tokens": 140, "cached_tokens": 97744, "effective_input_length": 127267, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127267, "latency_s": 30.58732880401658, "output_length": 140, "proxy_request_id": "1373431:2:1378320:629", "request_id": "1373431:2:1378320:629", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1373431", "t_dispatch_unix": 1779815103.2630138, "t_finish_unix": 1779815133.850343, "t_first_token_unix": 1779815129.3319786, "tpot_s": 0.03250366674816544, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13655780, 13655781, 13655782], "trace_timestamp_s": 491.299, "ttft_s": 26.068961573007982, "turn_id": 2} +{"actual_output_tokens": 338, "cached_tokens": 52544, "effective_input_length": 81147, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81147, "latency_s": 54.35962877696147, "output_length": 338, "proxy_request_id": "1373577:2:1380740:647", "request_id": "1373577:2:1380740:647", "request_type": "coder", "requested_output_tokens": 338, "session_id": "1373577", "t_dispatch_unix": 1779815082.6210248, "t_finish_unix": 1779815136.9806538, "t_first_token_unix": 1779815101.1208744, "tpot_s": 0.10640800625237136, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13677773], "trace_timestamp_s": 499.7430000000004, "ttft_s": 18.49984741595108, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 11503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11503, "latency_s": 44.5738771110191, "output_length": 47, "proxy_request_id": "1405199:1:1405199:776", "request_id": "1405199:1:1405199:776", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1405199", "t_dispatch_unix": 1779815094.5898538, "t_finish_unix": 1779815139.1637304, "t_first_token_unix": 1779815095.5193887, "tpot_s": 0.948777855891461, "trace_hash_ids": [13880436, 13880437, 13880438, 13880439, 13880440, 13880441, 13880442, 13880443, 13880444, 13880445, 13880446, 13880447, 13880448, 13880449, 13886683, 13886684, 13886685, 13893489, 13901376, 13901377, 13901378, 13901379, 13901380], "trace_timestamp_s": 585.4770000000008, "ttft_s": 0.9295337329967879, "turn_id": 1} +{"actual_output_tokens": 3875, "cached_tokens": 0, "effective_input_length": 101803, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101803, "latency_s": 85.25129815802211, "output_length": 3875, "proxy_request_id": "1314357:5:1393659:719", "request_id": "1314357:5:1393659:719", "request_type": "coder", "requested_output_tokens": 3875, "session_id": "1314357", "t_dispatch_unix": 1779815054.2398891, "t_finish_unix": 1779815139.491187, "t_first_token_unix": 1779815088.088421, "tpot_s": 0.013268582186379548, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 13796640], "trace_timestamp_s": 545.116, "ttft_s": 33.84853010997176, "turn_id": 5} +{"actual_output_tokens": 49, "cached_tokens": 11248, "effective_input_length": 19966, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19966, "latency_s": 44.03581317298813, "output_length": 49, "proxy_request_id": "1400379:4:1405483:779", "request_id": "1400379:4:1405483:779", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1400379", "t_dispatch_unix": 1779815095.4727778, "t_finish_unix": 1779815139.508591, "t_first_token_unix": 1779815137.9652793, "tpot_s": 0.03214231695892522, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13889270, 13889271, 13889272, 13889273, 13889274, 13895605, 13895606, 13895607, 13895608, 13895609, 13903871, 13903872, 13903873, 13903874, 13903875, 13903876, 13903877, 13903878], "trace_timestamp_s": 586.3600000000006, "ttft_s": 42.4924992750166, "turn_id": 4} +{"actual_output_tokens": 90, "cached_tokens": 127392, "effective_input_length": 128201, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128201, "latency_s": 5.746591578004882, "output_length": 90, "proxy_request_id": "1373431:3:1383388:667", "request_id": "1373431:3:1383388:667", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1373431", "t_dispatch_unix": 1779815133.8562248, "t_finish_unix": 1779815139.6028163, "t_first_token_unix": 1779815134.756007, "tpot_s": 0.05445275470755701, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13655780, 13655781, 13702464, 13702465, 13702466], "trace_timestamp_s": 508.9840000000004, "ttft_s": 0.8997798540513031, "turn_id": 3} +{"actual_output_tokens": 53, "cached_tokens": 8944, "effective_input_length": 14728, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14728, "latency_s": 34.53463242400903, "output_length": 53, "proxy_request_id": "1403188:2:1408249:796", "request_id": "1403188:2:1408249:796", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1403188", "t_dispatch_unix": 1779815105.3995407, "t_finish_unix": 1779815139.9341729, "t_first_token_unix": 1779815138.542266, "tpot_s": 0.026762378249818888, "trace_hash_ids": [13929233, 13929234, 13929235, 13929236, 13929237, 13929238, 13929239, 13929240, 13929241, 13929242, 13929243, 13929244, 13929245, 13929246, 13929247, 13929248, 13929249, 13929250, 13929251, 13929252, 13929253, 13929254, 13929255, 13929256, 13929257, 13929258, 13929259, 13929260, 13929261], "trace_timestamp_s": 596.2850000000008, "ttft_s": 33.142723506025504, "turn_id": 2} +{"actual_output_tokens": 64, "cached_tokens": 20000, "effective_input_length": 22009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22009, "latency_s": 1.385359278996475, "output_length": 64, "proxy_request_id": "1400379:5:1406380:784", "request_id": "1400379:5:1406380:784", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1400379", "t_dispatch_unix": 1779815139.5101416, "t_finish_unix": 1779815140.8955014, "t_first_token_unix": 1779815139.9320433, "tpot_s": 0.015288781666655153, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13889270, 13889271, 13889272, 13889273, 13889274, 13895605, 13895606, 13895607, 13895608, 13895609, 13903871, 13903872, 13903873, 13903874, 13903875, 13903876, 13903877, 13903878, 13912279, 13912280, 13912281, 13912282], "trace_timestamp_s": 589.7420000000002, "ttft_s": 0.42189900699304417, "turn_id": 5} +{"actual_output_tokens": 249, "cached_tokens": 81472, "effective_input_length": 85438, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85438, "latency_s": 5.948474653006997, "output_length": 249, "proxy_request_id": "1373577:3:1404917:774", "request_id": "1373577:3:1404917:774", "request_type": "coder", "requested_output_tokens": 249, "session_id": "1373577", "t_dispatch_unix": 1779815136.9858024, "t_finish_unix": 1779815142.934277, "t_first_token_unix": 1779815139.1627383, "tpot_s": 0.015206828641126893, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13898584, 13898585, 13898586, 13898587, 13898588, 13898589, 13898590, 13898591, 13898592], "trace_timestamp_s": 584.531, "ttft_s": 2.1769341269973665, "turn_id": 3} +{"actual_output_tokens": 213, "cached_tokens": 28720, "effective_input_length": 31224, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31224, "latency_s": 77.33140683500096, "output_length": 213, "proxy_request_id": "1355484:14:1398178:740", "request_id": "1355484:14:1398178:740", "request_type": "coder", "requested_output_tokens": 213, "session_id": "1355484", "t_dispatch_unix": 1779815070.201468, "t_finish_unix": 1779815147.532875, "t_first_token_unix": 1779815097.1767304, "tpot_s": 0.23752753245770572, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299], "trace_timestamp_s": 561.0889999999999, "ttft_s": 26.975259781989735, "turn_id": 14} +{"actual_output_tokens": 192, "cached_tokens": 85680, "effective_input_length": 90818, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90818, "latency_s": 5.5608344249776565, "output_length": 192, "proxy_request_id": "1373577:4:1408642:799", "request_id": "1373577:4:1408642:799", "request_type": "coder", "requested_output_tokens": 192, "session_id": "1373577", "t_dispatch_unix": 1779815142.941146, "t_finish_unix": 1779815148.5019803, "t_first_token_unix": 1779815145.8833005, "tpot_s": 0.013709046879444388, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13898584, 13898585, 13898586, 13898587, 13898588, 13898589, 13898590, 13898591, 13898592, 13932466, 13932467, 13932468, 13932469, 13932470, 13932471, 13932472, 13932473, 13932474, 13932475, 13932476], "trace_timestamp_s": 597.5, "ttft_s": 2.942153402022086, "turn_id": 4} +{"actual_output_tokens": 46, "cached_tokens": 11120, "effective_input_length": 11132, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11132, "latency_s": 3.975394666020293, "output_length": 46, "proxy_request_id": "1362265:8:1419710:834", "request_id": "1362265:8:1419710:834", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1362265", "t_dispatch_unix": 1779815145.3669813, "t_finish_unix": 1779815149.3423762, "t_first_token_unix": 1779815148.7351604, "tpot_s": 0.013486729110849815, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065], "trace_timestamp_s": 636.2580000000007, "ttft_s": 3.368177034019027, "turn_id": 8} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 119977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119977, "latency_s": 53.24056991800899, "output_length": 111, "proxy_request_id": "1275274:2:1405679:780", "request_id": "1275274:2:1405679:780", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1275274", "t_dispatch_unix": 1779815096.250838, "t_finish_unix": 1779815149.491408, "t_first_token_unix": 1779815145.7461798, "tpot_s": 0.03404495375474322, "trace_hash_ids": [9491467, 195037, 195038, 195039, 195040, 195041, 195042, 195043, 195044, 10319406, 10319407, 10319408, 10319409, 10319410, 10319411, 10319412, 10319413, 10319414, 5374859, 10319415, 10319416, 816846, 10319417, 10319418, 10319419, 10319420, 194680, 194681, 10319421, 10319422, 10319423, 10319424, 10319425, 10319426, 10319427, 10319428, 10319429, 10319430, 10319431, 10319432, 10319433, 10319434, 10319435, 10319436, 10319437, 10319438, 10319439, 10319440, 10319441, 10319442, 10319443, 10319444, 10319445, 10319446, 10319447, 10319448, 10319449, 10319450, 10319451, 10319452, 10319453, 10319454, 10319455, 10319456, 10319457, 10319458, 10319459, 10319460, 10319461, 10319462, 10319463, 10319464, 10319465, 10319466, 10319467, 10319468, 10319469, 10319470, 10319471, 10319472, 10319473, 10319474, 10319475, 10319476, 10319477, 10319478, 10319479, 10319480, 10319481, 10319482, 10319483, 10319484, 10319485, 10319486, 10319487, 10319488, 10319489, 10319490, 10319491, 10319492, 10319493, 10319494, 10319495, 10319496, 10319497, 10319498, 10319499, 10319500, 10319501, 10319502, 10319503, 10319504, 10319505, 10319506, 10319507, 10319508, 10319509, 10319510, 10319511, 10319512, 10319513, 10319514, 10319515, 10319516, 10319517, 10319518, 10319519, 10319520, 10319521, 10319522, 10319523, 10319524, 10319525, 10319526, 10319527, 10319528, 10319529, 10319530, 10319531, 10319532, 10319533, 10319534, 10319535, 10319536, 10319537, 10319538, 10319539, 10319540, 10319541, 10319542, 10319543, 10319544, 10319545, 10319546, 10319547, 10319548, 10319549, 10319550, 10319551, 10319552, 10319553, 10319554, 10319555, 10319556, 10319557, 10319558, 10319559, 10319560, 10319561, 10319562, 10319563, 10319564, 10319565, 10319566, 10319567, 10319568, 10319569, 10319570, 10319571, 10319572, 10319573, 10451843, 10538212, 10538213, 10590028, 10695557, 10848849, 10848850, 10848851, 10949071, 11065667, 11650526, 11650527, 11650528, 11717015, 11717016, 11717017, 11717018, 11717019, 11717020, 11796353, 11796354, 11796355, 11796356, 11895285, 12041647, 12041648, 12041649, 12041650, 12193888, 12247657, 12247658, 12247659, 12247660, 12374859, 12374860, 12374861, 12437166, 12437167, 12596754, 12596755, 12690937, 12844572, 12844573, 12844574, 12844575, 12958938, 13103548, 13103549, 13454539, 13674772, 13905368, 13905369, 13905370, 13905371], "trace_timestamp_s": 587.1360000000004, "ttft_s": 49.49533974897349, "turn_id": 2} +{"actual_output_tokens": 79, "cached_tokens": 27632, "effective_input_length": 31469, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31469, "latency_s": 4.547626000014134, "output_length": 79, "proxy_request_id": "1355484:15:1400281:750", "request_id": "1355484:15:1400281:750", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1355484", "t_dispatch_unix": 1779815147.5349045, "t_finish_unix": 1779815152.0825307, "t_first_token_unix": 1779815150.357829, "tpot_s": 0.02210771149988525, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299, 13857350], "trace_timestamp_s": 568.1950000000006, "ttft_s": 2.8229231240111403, "turn_id": 15} +{"actual_output_tokens": 212, "cached_tokens": 35264, "effective_input_length": 35303, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35303, "latency_s": 1.5043429710203782, "output_length": 212, "proxy_request_id": "1340290:12:1421294:835", "request_id": "1340290:12:1421294:835", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1340290", "t_dispatch_unix": 1779815151.0135763, "t_finish_unix": 1779815152.5179193, "t_first_token_unix": 1779815151.1155276, "tpot_s": 0.006645076881412205, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840], "trace_timestamp_s": 641.9040000000005, "ttft_s": 0.10194946004776284, "turn_id": 12} +{"actual_output_tokens": 1206, "cached_tokens": 0, "effective_input_length": 21684, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21684, "latency_s": 62.13803257100517, "output_length": 1206, "proxy_request_id": "1404395:1:1404395:770", "request_id": "1404395:1:1404395:770", "request_type": "coder", "requested_output_tokens": 1206, "session_id": "1404395", "t_dispatch_unix": 1779815091.754982, "t_finish_unix": 1779815153.8930142, "t_first_token_unix": 1779815094.099969, "tpot_s": 0.04962057321742022, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13895255], "trace_timestamp_s": 582.6379999999999, "ttft_s": 2.3449853640049696, "turn_id": 1} +{"actual_output_tokens": 1126, "cached_tokens": 0, "effective_input_length": 113258, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113258, "latency_s": 59.36749095498817, "output_length": 1126, "proxy_request_id": "1264679:2:1405259:777", "request_id": "1264679:2:1405259:777", "request_type": "coder", "requested_output_tokens": 1126, "session_id": "1264679", "t_dispatch_unix": 1779815094.7741668, "t_finish_unix": 1779815154.1416576, "t_first_token_unix": 1779815136.9399836, "tpot_s": 0.015290055944015168, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281, 13901868, 13901869, 13901870, 13901871, 13901872, 13901873, 13901874], "trace_timestamp_s": 585.6600000000008, "ttft_s": 42.16581139800837, "turn_id": 2} +{"actual_output_tokens": 3818, "cached_tokens": 71664, "effective_input_length": 72608, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72608, "latency_s": 36.38193587597925, "output_length": 3818, "proxy_request_id": "1381387:7:1411928:819", "request_id": "1381387:7:1411928:819", "request_type": "coder", "requested_output_tokens": 3818, "session_id": "1381387", "t_dispatch_unix": 1779815118.0762527, "t_finish_unix": 1779815154.4581883, "t_first_token_unix": 1779815118.7412355, "tpot_s": 0.009357268704739607, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13937687, 13937688, 13937689, 13937690, 13937691, 13962250, 13962251], "trace_timestamp_s": 608.9650000000001, "ttft_s": 0.6649805419729091, "turn_id": 7} +{"actual_output_tokens": 35, "cached_tokens": 11168, "effective_input_length": 11879, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11879, "latency_s": 0.7390003820182756, "output_length": 35, "proxy_request_id": "1362265:9:1422050:838", "request_id": "1362265:9:1422050:838", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1362265", "t_dispatch_unix": 1779815153.833709, "t_finish_unix": 1779815154.5727093, "t_first_token_unix": 1779815154.0835216, "tpot_s": 0.014377657322363709, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065, 14053142, 14053143], "trace_timestamp_s": 644.7240000000002, "ttft_s": 0.249811033019796, "turn_id": 9} +{"actual_output_tokens": 444, "cached_tokens": 86688, "effective_input_length": 96849, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96849, "latency_s": 17.70374887000071, "output_length": 444, "proxy_request_id": "1364090:8:1417347:830", "request_id": "1364090:8:1417347:830", "request_type": "coder", "requested_output_tokens": 444, "session_id": "1364090", "t_dispatch_unix": 1779815137.1267898, "t_finish_unix": 1779815154.8305383, "t_first_token_unix": 1779815143.0949032, "tpot_s": 0.026490427282193158, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14010113], "trace_timestamp_s": 628.009, "ttft_s": 5.968111421971116, "turn_id": 8} +{"actual_output_tokens": 393, "cached_tokens": 58272, "effective_input_length": 62018, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62018, "latency_s": 49.946316618006676, "output_length": 393, "proxy_request_id": "1313181:7:1382851:662", "request_id": "1313181:7:1382851:662", "request_type": "coder", "requested_output_tokens": 393, "session_id": "1313181", "t_dispatch_unix": 1779815108.9771538, "t_finish_unix": 1779815158.9234703, "t_first_token_unix": 1779815149.0999515, "tpot_s": 0.025059248530573203, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13697374], "trace_timestamp_s": 507.1290000000008, "ttft_s": 40.122785303974524, "turn_id": 7} +{"actual_output_tokens": 525, "cached_tokens": 105664, "effective_input_length": 105709, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105709, "latency_s": 6.886763731017709, "output_length": 525, "proxy_request_id": "1314357:6:1422517:839", "request_id": "1314357:6:1422517:839", "request_type": "coder", "requested_output_tokens": 525, "session_id": "1314357", "t_dispatch_unix": 1779815155.3424811, "t_finish_unix": 1779815162.2292447, "t_first_token_unix": 1779815155.5691235, "tpot_s": 0.012709519698463189, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14056875, 14056876], "trace_timestamp_s": 646.2290000000003, "ttft_s": 0.22664054104825482, "turn_id": 6} +{"actual_output_tokens": 568, "cached_tokens": 31536, "effective_input_length": 32332, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32332, "latency_s": 10.186303771974053, "output_length": 568, "proxy_request_id": "1355484:16:1401320:758", "request_id": "1355484:16:1401320:758", "request_type": "coder", "requested_output_tokens": 568, "session_id": "1355484", "t_dispatch_unix": 1779815152.0845542, "t_finish_unix": 1779815162.270849, "t_first_token_unix": 1779815152.373677, "tpot_s": 0.017454748139351217, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299, 13867393, 13867394, 13867395], "trace_timestamp_s": 572.0710000000008, "ttft_s": 0.2891293769935146, "turn_id": 16} +{"actual_output_tokens": 221, "cached_tokens": 0, "effective_input_length": 49308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49308, "latency_s": 11.805768720980268, "output_length": 221, "proxy_request_id": "1268861:9:1421319:836", "request_id": "1268861:9:1421319:836", "request_type": "coder", "requested_output_tokens": 221, "session_id": "1268861", "t_dispatch_unix": 1779815151.0956326, "t_finish_unix": 1779815162.9014013, "t_first_token_unix": 1779815160.2866936, "tpot_s": 0.011883742559108545, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14046030], "trace_timestamp_s": 641.9830000000002, "ttft_s": 9.191058913012967, "turn_id": 9} +{"actual_output_tokens": 1565, "cached_tokens": 0, "effective_input_length": 32179, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32179, "latency_s": 18.17187835398363, "output_length": 1565, "proxy_request_id": "1364128:3:1419644:833", "request_id": "1364128:3:1419644:833", "request_type": "coder", "requested_output_tokens": 1565, "session_id": "1364128", "t_dispatch_unix": 1779815145.1418295, "t_finish_unix": 1779815163.3137078, "t_first_token_unix": 1779815149.5035186, "tpot_s": 0.00882988285613925, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13554127, 14030453, 14030454, 14030455, 14030456, 14030457, 14030458, 14030459, 14030460, 14030461, 14030462, 14030463, 14030464, 14030465, 14030466, 14030467, 14030468, 14030469, 14030470, 14030471, 14030472, 14030473, 14030474, 14030475, 14030476, 14030477, 14030478, 14030479, 14030480, 14030481, 14030482, 14030483, 14030484, 14030485, 14030486, 14030487, 14030488, 14030489, 14030490, 14030491, 14030492, 14030493, 14030494, 14030495, 14030496, 14030497], "trace_timestamp_s": 636.0240000000003, "ttft_s": 4.36168677295791, "turn_id": 3} +{"actual_output_tokens": 1861, "cached_tokens": 0, "effective_input_length": 63536, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63536, "latency_s": 176.94107239099685, "output_length": 1861, "proxy_request_id": "1363093:3:1374394:612", "request_id": "1363093:3:1374394:612", "request_type": "coder", "requested_output_tokens": 1861, "session_id": "1363093", "t_dispatch_unix": 1779814986.7655063, "t_finish_unix": 1779815163.7065785, "t_first_token_unix": 1779815069.8981886, "tpot_s": 0.05043447593656389, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062], "trace_timestamp_s": 477.65500000000065, "ttft_s": 83.13267889694544, "turn_id": 3} +{"actual_output_tokens": 5258, "cached_tokens": 78496, "effective_input_length": 80246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80246, "latency_s": 233.68181424803333, "output_length": 5258, "proxy_request_id": "1269373:22:1358956:522", "request_id": "1269373:22:1358956:522", "request_type": "coder", "requested_output_tokens": 5258, "session_id": "1269373", "t_dispatch_unix": 1779814932.5056515, "t_finish_unix": 1779815166.1874657, "t_first_token_unix": 1779814939.873276, "tpot_s": 0.043050008535672396, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385, 13476943, 13476944, 13476945, 13476946, 13476947], "trace_timestamp_s": 423.39200000000073, "ttft_s": 7.367622116988059, "turn_id": 22} +{"actual_output_tokens": 46, "cached_tokens": 109808, "effective_input_length": 117746, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117746, "latency_s": 51.02001835801639, "output_length": 46, "proxy_request_id": "1366128:25:1411126:813", "request_id": "1366128:25:1411126:813", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1366128", "t_dispatch_unix": 1779815115.2032447, "t_finish_unix": 1779815166.223263, "t_first_token_unix": 1779815120.8291283, "tpot_s": 1.0087514512447848, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916], "trace_timestamp_s": 606.0870000000004, "ttft_s": 5.625880355015397, "turn_id": 25} +{"actual_output_tokens": 43, "cached_tokens": 11392, "effective_input_length": 11537, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11537, "latency_s": 43.942101413034834, "output_length": 43, "proxy_request_id": "1399948:7:1413205:824", "request_id": "1399948:7:1413205:824", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1399948", "t_dispatch_unix": 1779815122.4662557, "t_finish_unix": 1779815166.4083567, "t_first_token_unix": 1779815158.8621442, "tpot_s": 0.17966485749985578, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 13974423], "trace_timestamp_s": 613.357, "ttft_s": 36.39588697301224, "turn_id": 7} +{"actual_output_tokens": 25, "cached_tokens": 11568, "effective_input_length": 11736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11736, "latency_s": 0.46760878298664466, "output_length": 25, "proxy_request_id": "1399948:8:1425345:844", "request_id": "1399948:8:1425345:844", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1399948", "t_dispatch_unix": 1779815166.4090676, "t_finish_unix": 1779815166.8766763, "t_first_token_unix": 1779815166.5074983, "tpot_s": 0.01536389374814462, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14082944], "trace_timestamp_s": 656.451, "ttft_s": 0.09842948999721557, "turn_id": 8} +{"actual_output_tokens": 344, "cached_tokens": 97280, "effective_input_length": 101432, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101432, "latency_s": 7.223537172016222, "output_length": 344, "proxy_request_id": "1364090:9:1423736:840", "request_id": "1364090:9:1423736:840", "request_type": "coder", "requested_output_tokens": 344, "session_id": "1364090", "t_dispatch_unix": 1779815159.9396408, "t_finish_unix": 1779815167.163178, "t_first_token_unix": 1779815162.6761057, "tpot_s": 0.0130805494139886, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14068318, 14068319, 14068320, 14068321, 14068322, 14068323, 14068324, 14068325, 14068326, 14068327], "trace_timestamp_s": 650.826, "ttft_s": 2.736462422995828, "turn_id": 9} +{"actual_output_tokens": 129, "cached_tokens": 0, "effective_input_length": 107292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107292, "latency_s": 50.44140196900116, "output_length": 129, "proxy_request_id": "1270606:2:1411654:817", "request_id": "1270606:2:1411654:817", "request_type": "coder", "requested_output_tokens": 129, "session_id": "1270606", "t_dispatch_unix": 1779815117.254223, "t_finish_unix": 1779815167.695625, "t_first_token_unix": 1779815158.8763351, "tpot_s": 0.06889758767965759, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 13959615, 13959616, 13959617, 13959618, 13959619, 13959620, 13959621, 13959622, 13959623, 13959624, 13959625, 13959626, 13959627, 13959628, 13959629, 13959630, 13959631, 13959632, 13959633, 13959634, 13959635, 13959636, 13959637, 13959638, 13959639, 13959640, 13959641, 13959642, 13959643, 13959644, 13959645, 13959646, 13959647, 13959648, 13959649, 13959650, 13959651, 13959652, 13959653, 13959654, 13959655, 13959656, 13959657, 13959658, 13959659, 13959660, 13959661, 13959662, 13959663, 13959664, 13959665, 13959666, 13959667, 13959668, 13959669, 13959670, 13959671, 13959672, 13959673, 13959674, 13959675, 13959676, 13959677, 13959678, 13959679, 13959680, 13959681, 13959682, 13959683, 13959684, 13959685, 13959686, 13959687, 13959688, 13959689, 13959690, 13959691, 13959692, 13959693, 13959694, 13959695, 13959696, 13959697, 13959698, 13959699, 13959700, 13959701, 13959702, 13959703, 13959704, 13959705, 13959706, 13959707, 13959708, 13959709, 13959710, 13959711, 13959712, 13959713, 13959714, 13959715, 13959716, 13959717, 13959718, 13959719, 13959720, 13959721, 13959722, 13959723, 13959724, 13959725, 13959726, 13959727, 13959728], "trace_timestamp_s": 608.1200000000008, "ttft_s": 41.622109483985696, "turn_id": 2} +{"actual_output_tokens": 1859, "cached_tokens": 0, "effective_input_length": 37398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37398, "latency_s": 30.639988048002124, "output_length": 1859, "proxy_request_id": "1301929:3:1417873:832", "request_id": "1301929:3:1417873:832", "request_type": "coder", "requested_output_tokens": 1859, "session_id": "1301929", "t_dispatch_unix": 1779815138.9617336, "t_finish_unix": 1779815169.6017218, "t_first_token_unix": 1779815148.7459006, "tpot_s": 0.011224706859516573, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 14014871, 14014872, 14014873, 14014874], "trace_timestamp_s": 629.8510000000006, "ttft_s": 9.784164856013376, "turn_id": 3} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 39789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39789, "latency_s": 7.108558624982834, "output_length": 24, "proxy_request_id": "1355951:5:1425005:843", "request_id": "1355951:5:1425005:843", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1355951", "t_dispatch_unix": 1779815164.3241825, "t_finish_unix": 1779815171.4327412, "t_first_token_unix": 1779815171.2051392, "tpot_s": 0.009874528261286247, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463, 14061275], "trace_timestamp_s": 655.2139999999999, "ttft_s": 6.880954945983831, "turn_id": 5} +{"actual_output_tokens": 33, "cached_tokens": 107408, "effective_input_length": 108318, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108318, "latency_s": 1.1876807250082493, "output_length": 33, "proxy_request_id": "1270606:3:1427164:848", "request_id": "1270606:3:1427164:848", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1270606", "t_dispatch_unix": 1779815171.981978, "t_finish_unix": 1779815173.1696584, "t_first_token_unix": 1779815172.8120587, "tpot_s": 0.01116473740512447, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 13959615, 13959616, 13959617, 13959618, 13959619, 13959620, 13959621, 13959622, 13959623, 13959624, 13959625, 13959626, 13959627, 13959628, 13959629, 13959630, 13959631, 13959632, 13959633, 13959634, 13959635, 13959636, 13959637, 13959638, 13959639, 13959640, 13959641, 14099892, 14099893, 14099894, 14099895, 14099896, 14099897, 14099898, 14099899, 14099900, 14099901, 14099902, 14099903, 14099904, 14099905, 14099906, 14099907, 14099908, 14099909, 14099910, 14099911, 14099912, 14099913, 14099914, 14099915, 14099916, 14099917, 14099918, 14099919, 14099920, 14099921, 14099922, 14099923, 14099924, 14099925, 14099926, 14099927, 14099928, 14099929, 14099930, 14099931, 14099932, 14099933, 14099934, 14099935, 14099936, 14099937, 14099938, 14099939, 14099940, 14099941, 14099942, 14099943, 14099944, 14099945, 14099946, 14099947, 14099948, 14099949, 14099950, 14099951, 14099952, 14099953, 14099954, 14099955, 14099956, 14099957, 14099958, 14099959, 14099960, 14099961, 14099962, 14099963, 14099964, 14099965, 14099966, 14099967, 14099968, 14099969, 14099970, 14099971, 14099972, 14099973, 14099974, 14099975, 14099976, 14099977, 14099978, 14099979, 14099980], "trace_timestamp_s": 662.8530000000001, "ttft_s": 0.8300787350162864, "turn_id": 3} +{"actual_output_tokens": 438, "cached_tokens": 65392, "effective_input_length": 68187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68187, "latency_s": 11.268493867013603, "output_length": 438, "proxy_request_id": "1363093:4:1390050:704", "request_id": "1363093:4:1390050:704", "request_type": "coder", "requested_output_tokens": 438, "session_id": "1363093", "t_dispatch_unix": 1779815163.7113466, "t_finish_unix": 1779815174.9798408, "t_first_token_unix": 1779815164.9835417, "tpot_s": 0.022874272519427412, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678], "trace_timestamp_s": 532.4470000000001, "ttft_s": 1.2721922480268404, "turn_id": 4} +{"actual_output_tokens": 589, "cached_tokens": 40464, "effective_input_length": 42342, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42342, "latency_s": 5.446496771008242, "output_length": 589, "proxy_request_id": "1277428:8:1426669:846", "request_id": "1277428:8:1426669:846", "request_type": "coder", "requested_output_tokens": 589, "session_id": "1277428", "t_dispatch_unix": 1779815170.2303627, "t_finish_unix": 1779815175.6768591, "t_first_token_unix": 1779815170.8926466, "tpot_s": 0.008135807450696806, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14095200, 14095201, 14095202, 14095203, 14095204], "trace_timestamp_s": 661.1190000000006, "ttft_s": 0.6622825450031087, "turn_id": 8} +{"actual_output_tokens": 65, "cached_tokens": 68624, "effective_input_length": 73188, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73188, "latency_s": 2.6553892609663308, "output_length": 65, "proxy_request_id": "1363093:5:1407810:790", "request_id": "1363093:5:1407810:790", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1363093", "t_dispatch_unix": 1779815174.9841766, "t_finish_unix": 1779815177.6395662, "t_first_token_unix": 1779815177.1338434, "tpot_s": 0.007897259234596277, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678, 13925441, 13925442, 13925443, 13925444, 13925445, 13925446, 13925447, 13925448, 13925449], "trace_timestamp_s": 594.6500000000005, "ttft_s": 2.1496641549747437, "turn_id": 5} +{"actual_output_tokens": 1465, "cached_tokens": 1536, "effective_input_length": 43763, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43763, "latency_s": 42.22409785899799, "output_length": 1465, "proxy_request_id": "1270340:5:1417075:829", "request_id": "1270340:5:1417075:829", "request_type": "coder", "requested_output_tokens": 1465, "session_id": "1270340", "t_dispatch_unix": 1779815136.3299038, "t_finish_unix": 1779815178.5540018, "t_first_token_unix": 1779815165.7009232, "tpot_s": 0.008779250262958784, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 14007776, 14007777, 14007778, 14007779, 14007780, 14007781], "trace_timestamp_s": 627.219, "ttft_s": 29.37101697002072, "turn_id": 5} +{"actual_output_tokens": 339, "cached_tokens": 11904, "effective_input_length": 12596, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12596, "latency_s": 6.334123756969348, "output_length": 339, "proxy_request_id": "1362265:10:1427606:850", "request_id": "1362265:10:1427606:850", "request_type": "coder", "requested_output_tokens": 339, "session_id": "1362265", "t_dispatch_unix": 1779815173.2541099, "t_finish_unix": 1779815179.5882337, "t_first_token_unix": 1779815175.34376, "tpot_s": 0.012556572065181678, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065, 14053142, 14104310, 14104311], "trace_timestamp_s": 664.1450000000004, "ttft_s": 2.0896479029906914, "turn_id": 10} +{"actual_output_tokens": 485, "cached_tokens": 106224, "effective_input_length": 106279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106279, "latency_s": 5.597364688990638, "output_length": 485, "proxy_request_id": "1314357:7:1427957:851", "request_id": "1314357:7:1427957:851", "request_type": "coder", "requested_output_tokens": 485, "session_id": "1314357", "t_dispatch_unix": 1779815174.536981, "t_finish_unix": 1779815180.1343455, "t_first_token_unix": 1779815174.7829134, "tpot_s": 0.01105615687602265, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14107729], "trace_timestamp_s": 665.424, "ttft_s": 0.24593019700841978, "turn_id": 7} +{"actual_output_tokens": 122, "cached_tokens": 106752, "effective_input_length": 106805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106805, "latency_s": 1.6133003119612113, "output_length": 122, "proxy_request_id": "1314357:8:1431749:854", "request_id": "1314357:8:1431749:854", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1314357", "t_dispatch_unix": 1779815187.92451, "t_finish_unix": 1779815189.5378103, "t_first_token_unix": 1779815188.1679666, "tpot_s": 0.011317629652859812, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14144523], "trace_timestamp_s": 678.8120000000008, "ttft_s": 0.243454831012059, "turn_id": 8} +{"actual_output_tokens": 2116, "cached_tokens": 1680, "effective_input_length": 1840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1840, "latency_s": 11.646675325988326, "output_length": 2116, "proxy_request_id": "1407599:2:1430593:852", "request_id": "1407599:2:1430593:852", "request_type": "coder", "requested_output_tokens": 2116, "session_id": "1407599", "t_dispatch_unix": 1779815183.9854712, "t_finish_unix": 1779815195.6321466, "t_first_token_unix": 1779815184.0240154, "tpot_s": 0.005488345302128394, "trace_hash_ids": [10764018, 14132941, 14132942, 14132943], "trace_timestamp_s": 674.8760000000002, "ttft_s": 0.038542472990229726, "turn_id": 2} +{"actual_output_tokens": 298, "cached_tokens": 39248, "effective_input_length": 40567, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40567, "latency_s": 2.580212819040753, "output_length": 298, "proxy_request_id": "1382089:3:1433211:856", "request_id": "1382089:3:1433211:856", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1382089", "t_dispatch_unix": 1779815193.2270787, "t_finish_unix": 1779815195.807291, "t_first_token_unix": 1779815193.7148921, "tpot_s": 0.007044346488248682, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463, 14061275, 14158620, 14158621], "trace_timestamp_s": 684.116, "ttft_s": 0.48781134001910686, "turn_id": 3} +{"actual_output_tokens": 243, "cached_tokens": 106912, "effective_input_length": 106959, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106959, "latency_s": 2.7370912120095454, "output_length": 243, "proxy_request_id": "1314357:9:1435219:861", "request_id": "1314357:9:1435219:861", "request_type": "coder", "requested_output_tokens": 243, "session_id": "1314357", "t_dispatch_unix": 1779815200.3887832, "t_finish_unix": 1779815203.1258736, "t_first_token_unix": 1779815200.593187, "tpot_s": 0.010464629561982833, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14177399], "trace_timestamp_s": 691.2760000000007, "ttft_s": 0.20440248202066869, "turn_id": 9} +{"actual_output_tokens": 14, "cached_tokens": 11760, "effective_input_length": 11993, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11993, "latency_s": 17.810958611953538, "output_length": 14, "proxy_request_id": "1399948:9:1433544:857", "request_id": "1399948:9:1433544:857", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1399948", "t_dispatch_unix": 1779815194.4483092, "t_finish_unix": 1779815212.2592678, "t_first_token_unix": 1779815212.1649806, "tpot_s": 0.007227810229568814, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14161913], "trace_timestamp_s": 685.3389999999999, "ttft_s": 17.716670074965805, "turn_id": 9} +{"actual_output_tokens": 40, "cached_tokens": 12000, "effective_input_length": 12032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12032, "latency_s": 0.5785952730220743, "output_length": 40, "proxy_request_id": "1399948:10:1434418:858", "request_id": "1399948:10:1434418:858", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1399948", "t_dispatch_unix": 1779815212.2600057, "t_finish_unix": 1779815212.838601, "t_first_token_unix": 1779815212.3281994, "tpot_s": 0.013080826153059322, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14170064], "trace_timestamp_s": 688.3510000000006, "ttft_s": 0.06819230504333973, "turn_id": 10} +{"actual_output_tokens": 11, "cached_tokens": 12064, "effective_input_length": 12106, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12106, "latency_s": 0.20705988397821784, "output_length": 11, "proxy_request_id": "1399948:11:1435163:860", "request_id": "1399948:11:1435163:860", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1399948", "t_dispatch_unix": 1779815212.8392677, "t_finish_unix": 1779815213.046328, "t_first_token_unix": 1779815212.9204268, "tpot_s": 0.012562120502116159, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14176836], "trace_timestamp_s": 691.0540000000001, "ttft_s": 0.08115736296167597, "turn_id": 11} +{"actual_output_tokens": 26, "cached_tokens": 12112, "effective_input_length": 12164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12164, "latency_s": 0.3995640490320511, "output_length": 26, "proxy_request_id": "1399948:12:1436179:863", "request_id": "1399948:12:1436179:863", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1399948", "t_dispatch_unix": 1779815213.0471885, "t_finish_unix": 1779815213.446753, "t_first_token_unix": 1779815213.1142514, "tpot_s": 0.013288787081837655, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14186143], "trace_timestamp_s": 694.4800000000005, "ttft_s": 0.06706147600198165, "turn_id": 12} +{"actual_output_tokens": 129, "cached_tokens": 0, "effective_input_length": 73878, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73878, "latency_s": 20.67331326403655, "output_length": 129, "proxy_request_id": "1342921:5:1433192:855", "request_id": "1342921:5:1433192:855", "request_type": "coder", "requested_output_tokens": 129, "session_id": "1342921", "t_dispatch_unix": 1779815193.1514068, "t_finish_unix": 1779815213.82472, "t_first_token_unix": 1779815212.1749234, "tpot_s": 0.01288675576552123, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14158436], "trace_timestamp_s": 684.0380000000005, "ttft_s": 19.02351546502905, "turn_id": 5} +{"actual_output_tokens": 200, "cached_tokens": 45216, "effective_input_length": 45269, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45269, "latency_s": 15.260103918029927, "output_length": 200, "proxy_request_id": "1270340:6:1434904:859", "request_id": "1270340:6:1434904:859", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1270340", "t_dispatch_unix": 1779815199.099012, "t_finish_unix": 1779815214.3591158, "t_first_token_unix": 1779815212.1778693, "tpot_s": 0.010959536024958982, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 14007776, 14007777, 14007778, 14007779, 14007780, 14174577, 14174578, 14174579, 14174580], "trace_timestamp_s": 689.9880000000003, "ttft_s": 13.078855684027076, "turn_id": 6} +{"actual_output_tokens": 33, "cached_tokens": 107200, "effective_input_length": 107228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107228, "latency_s": 0.4555503930314444, "output_length": 33, "proxy_request_id": "1314357:10:1439373:867", "request_id": "1314357:10:1439373:867", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1314357", "t_dispatch_unix": 1779815214.23592, "t_finish_unix": 1779815214.6914701, "t_first_token_unix": 1779815214.4273858, "tpot_s": 0.008241960998930153, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14214206, 14214207], "trace_timestamp_s": 705.1230000000005, "ttft_s": 0.19146316702244803, "turn_id": 10} +{"actual_output_tokens": 145, "cached_tokens": 49520, "effective_input_length": 52920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52920, "latency_s": 2.3208740479894914, "output_length": 145, "proxy_request_id": "1268861:10:1439325:866", "request_id": "1268861:10:1439325:866", "request_type": "coder", "requested_output_tokens": 145, "session_id": "1268861", "t_dispatch_unix": 1779815214.1122603, "t_finish_unix": 1779815216.433134, "t_first_token_unix": 1779815215.3369834, "tpot_s": 0.007610236604200004, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14214018], "trace_timestamp_s": 705.0, "ttft_s": 1.2247205940075219, "turn_id": 10} +{"actual_output_tokens": 71, "cached_tokens": 9440, "effective_input_length": 124090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 124090, "latency_s": 61.400750749977306, "output_length": 71, "proxy_request_id": "1313181:8:1329951:394", "request_id": "1313181:8:1329951:394", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1313181", "t_dispatch_unix": 1779815158.9310722, "t_finish_unix": 1779815220.3318226, "t_first_token_unix": 1779815207.6256719, "tpot_s": 0.18151033260011382, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13209153], "trace_timestamp_s": 321.7550000000001, "ttft_s": 48.69459715497214, "turn_id": 8} +{"actual_output_tokens": 241, "cached_tokens": 0, "effective_input_length": 127989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127989, "latency_s": 54.345540465961676, "output_length": 241, "proxy_request_id": "1366128:26:1413108:823", "request_id": "1366128:26:1413108:823", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1366128", "t_dispatch_unix": 1779815166.233042, "t_finish_unix": 1779815220.5785823, "t_first_token_unix": 1779815217.8149135, "tpot_s": 0.011514264033273018, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401], "trace_timestamp_s": 612.9639999999999, "ttft_s": 51.58186849299818, "turn_id": 26} +{"actual_output_tokens": 90, "cached_tokens": 128224, "effective_input_length": 128433, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128433, "latency_s": 1.4006664750049822, "output_length": 90, "proxy_request_id": "1366128:27:1417788:831", "request_id": "1366128:27:1417788:831", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1366128", "t_dispatch_unix": 1779815220.5842094, "t_finish_unix": 1779815221.984876, "t_first_token_unix": 1779815221.0110502, "tpot_s": 0.010939129899004788, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401, 14013930], "trace_timestamp_s": 629.5560000000005, "ttft_s": 0.4268389649805613, "turn_id": 27} +{"actual_output_tokens": 49, "cached_tokens": 128512, "effective_input_length": 128642, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128642, "latency_s": 0.7902204199926928, "output_length": 49, "proxy_request_id": "1366128:28:1421998:837", "request_id": "1366128:28:1421998:837", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1366128", "t_dispatch_unix": 1779815221.99064, "t_finish_unix": 1779815222.7808602, "t_first_token_unix": 1779815222.3018126, "tpot_s": 0.009973627729777945, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401, 14013930, 14052730], "trace_timestamp_s": 644.5350000000008, "ttft_s": 0.31117076199734583, "turn_id": 28} +{"actual_output_tokens": 64, "cached_tokens": 62432, "effective_input_length": 62444, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62444, "latency_s": 5.389791059016716, "output_length": 64, "proxy_request_id": "1313181:8:1385690:686", "request_id": "1313181:8:1385690:686", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1313181", "t_dispatch_unix": 1779815220.3350344, "t_finish_unix": 1779815225.7248251, "t_first_token_unix": 1779815223.9155943, "tpot_s": 0.02871387874585621, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278], "trace_timestamp_s": 517.1500000000005, "ttft_s": 3.5805579419829883, "turn_id": 8} +{"actual_output_tokens": 156, "cached_tokens": 0, "effective_input_length": 25225, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25225, "latency_s": 62.415103785984684, "output_length": 156, "proxy_request_id": "1363943:11:1424840:842", "request_id": "1363943:11:1424840:842", "request_type": "coder", "requested_output_tokens": 156, "session_id": "1363943", "t_dispatch_unix": 1779815163.676199, "t_finish_unix": 1779815226.0913024, "t_first_token_unix": 1779815215.9762242, "tpot_s": 0.0652565935806882, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14078449], "trace_timestamp_s": 654.5660000000007, "ttft_s": 52.30002358998172, "turn_id": 11} +{"actual_output_tokens": 193, "cached_tokens": 107248, "effective_input_length": 108166, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108166, "latency_s": 2.794133718998637, "output_length": 193, "proxy_request_id": "1314357:11:1442554:870", "request_id": "1314357:11:1442554:870", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1314357", "t_dispatch_unix": 1779815224.750692, "t_finish_unix": 1779815227.5448253, "t_first_token_unix": 1779815225.5306852, "tpot_s": 0.01048899046357595, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14243700, 14243701], "trace_timestamp_s": 715.6370000000006, "ttft_s": 0.7799908429733478, "turn_id": 11} +{"actual_output_tokens": 620, "cached_tokens": 126192, "effective_input_length": 126198, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126198, "latency_s": 7.498996158014052, "output_length": 620, "proxy_request_id": "1366128:29:1424316:841", "request_id": "1366128:29:1424316:841", "request_type": "coder", "requested_output_tokens": 620, "session_id": "1366128", "t_dispatch_unix": 1779815222.831171, "t_finish_unix": 1779815230.3301673, "t_first_token_unix": 1779815223.0533645, "tpot_s": 0.011755237673666563, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2239018, 2239019, 2239020, 2239021, 2239022, 177637, 177638, 177639, 2239023, 2239024, 2239025, 2239026, 2239027, 14073495, 14073496, 14073497, 14073498, 6887633, 6887634, 6887635, 6887636, 14073499, 14073500, 14073501, 14073502, 14073503, 14073504, 14073505, 14073506, 14073507, 14073508, 14073509, 14073510, 14073511, 14073512, 14073513, 14073514, 14073515, 14073516, 14073517, 14073518, 14073519, 14073520, 14073521, 14073522, 14073523, 14073524, 14073525, 14073526, 14073527, 14073528, 14073529, 14073530, 14073531, 14073532, 14073533, 14073534, 14073535, 14073536, 14073537, 14073538, 14073539, 14073540, 14073541, 14073542, 14073543, 14073544, 14073545, 14073546, 14073547, 14073548, 14073549, 14073550, 14073551, 14073552, 14073553, 14073554, 14073555, 14073556, 14073557, 14073558, 14073559, 14073560, 14073561, 14073562, 14073563, 14073564, 14073565, 14073566, 14073567, 14073568, 14073569, 14073570, 14073571, 14073572, 14073573, 14073574, 14073575, 14073576, 14073577, 14073578, 14073579, 14073580, 14073581, 14073582, 14073583, 14073584, 14073585, 14073586, 14073587, 14073588, 14073589, 14073590, 14073591, 14073592, 14073593, 14073594, 14073595, 14073596, 14073597, 14073598, 14073599, 14073600, 14073601, 14073602, 14073603, 14073604, 14073605, 14073606, 14073607, 14073608, 14073609, 14073610, 14073611, 14073612, 14073613, 14073614, 14073615, 14073616, 14073617, 14073618, 14073619, 14073620, 14073621, 14073622, 14073623, 14073624, 14073625, 14073626, 14073627, 14073628, 14073629, 14073630, 14073631, 14073632, 14073633, 7128120, 7128121, 7128122, 7128123, 14073634, 14073635, 14073636, 14073637, 14073638, 14073639, 14073640, 14073641, 14073642, 14073643, 14073644, 14073645, 14073646, 14073647, 14073648, 14073649, 14073650, 14073651, 14073652, 14073653, 14073654, 14073655, 14073656, 14073657, 14073658, 14073659, 14073660, 14073661, 14073662, 14073663, 14073664, 14073665, 14073666, 14073667, 14073668, 14073669, 14073670, 14073671, 14073672, 14073673, 14073674, 14073675, 14073676, 14073677, 14073678, 14073679, 14073680, 14073681, 14073682, 14073683, 14073684, 14073685, 14073686, 14073687, 14073688, 14073689, 14073690, 14073691, 14073692, 14073693, 14073694, 14073695, 14073696, 14073697, 14073698, 14073699, 14073700, 14073701, 14073702, 14073703, 14073704, 14073705, 14073706, 14073707, 14073708, 14073709, 14073710, 14073711], "trace_timestamp_s": 652.6850000000004, "ttft_s": 0.22219113999744877, "turn_id": 29} +{"actual_output_tokens": 599, "cached_tokens": 25376, "effective_input_length": 26923, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26923, "latency_s": 10.42025719198864, "output_length": 599, "proxy_request_id": "1363943:12:1426646:845", "request_id": "1363943:12:1426646:845", "request_type": "coder", "requested_output_tokens": 599, "session_id": "1363943", "t_dispatch_unix": 1779815226.0935214, "t_finish_unix": 1779815236.513779, "t_first_token_unix": 1779815226.5144165, "tpot_s": 0.01672093107199209, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14094824], "trace_timestamp_s": 661.0390000000007, "ttft_s": 0.4208921999670565, "turn_id": 12} +{"actual_output_tokens": 90, "cached_tokens": 0, "effective_input_length": 19056, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19056, "latency_s": 14.859308329003397, "output_length": 90, "proxy_request_id": "1371622:2:1442319:869", "request_id": "1371622:2:1442319:869", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1371622", "t_dispatch_unix": 1779815223.9650056, "t_finish_unix": 1779815238.824314, "t_first_token_unix": 1779815237.2805443, "tpot_s": 0.01734308395508593, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14240621], "trace_timestamp_s": 714.8530000000001, "ttft_s": 13.315536984999198, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 108352, "effective_input_length": 108409, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108409, "latency_s": 0.8230387920048088, "output_length": 61, "proxy_request_id": "1314357:12:1446681:873", "request_id": "1314357:12:1446681:873", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1314357", "t_dispatch_unix": 1779815238.4745915, "t_finish_unix": 1779815239.2976296, "t_first_token_unix": 1779815238.717892, "tpot_s": 0.009657859083381482, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14283553], "trace_timestamp_s": 729.3620000000001, "ttft_s": 0.2432985350023955, "turn_id": 12} +{"actual_output_tokens": 302, "cached_tokens": 0, "effective_input_length": 63153, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63153, "latency_s": 21.297788508003578, "output_length": 302, "proxy_request_id": "1294611:12:1441557:868", "request_id": "1294611:12:1441557:868", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1294611", "t_dispatch_unix": 1779815221.2268221, "t_finish_unix": 1779815242.5246108, "t_first_token_unix": 1779815235.4959948, "tpot_s": 0.023349830870318576, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14232859], "trace_timestamp_s": 712.1100000000006, "ttft_s": 14.269169703009538, "turn_id": 12} +{"actual_output_tokens": 4542, "cached_tokens": 101760, "effective_input_length": 108020, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108020, "latency_s": 73.70920522802044, "output_length": 4542, "proxy_request_id": "1364090:10:1426859:847", "request_id": "1364090:10:1426859:847", "request_type": "coder", "requested_output_tokens": 4542, "session_id": "1364090", "t_dispatch_unix": 1779815170.9530761, "t_finish_unix": 1779815244.6622813, "t_first_token_unix": 1779815175.1776412, "tpot_s": 0.015301565208545734, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14068318, 14068319, 14068320, 14068321, 14068322, 14068323, 14068324, 14068325, 14068326, 14096917, 14096918, 14096919, 14096920, 14096921, 14096922, 14096923, 14096924, 14096925, 14096926, 14096927, 14096928, 14096929], "trace_timestamp_s": 661.8389999999999, "ttft_s": 4.224562632036395, "turn_id": 10} +{"actual_output_tokens": 123, "cached_tokens": 63440, "effective_input_length": 63488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63488, "latency_s": 2.196161544008646, "output_length": 123, "proxy_request_id": "1294611:13:1446349:872", "request_id": "1294611:13:1446349:872", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1294611", "t_dispatch_unix": 1779815242.5273445, "t_finish_unix": 1779815244.7235055, "t_first_token_unix": 1779815242.687671, "tpot_s": 0.01668432455740823, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911], "trace_timestamp_s": 728.4270000000006, "ttft_s": 0.16032477701082826, "turn_id": 13} +{"actual_output_tokens": 493, "cached_tokens": 27520, "effective_input_length": 28711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28711, "latency_s": 8.867482835019473, "output_length": 493, "proxy_request_id": "1363943:13:1438562:865", "request_id": "1363943:13:1438562:865", "request_type": "coder", "requested_output_tokens": 493, "session_id": "1363943", "t_dispatch_unix": 1779815236.5160866, "t_finish_unix": 1779815245.3835695, "t_first_token_unix": 1779815236.8906398, "tpot_s": 0.017261462833290366, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14206732], "trace_timestamp_s": 702.4480000000003, "ttft_s": 0.3745517100323923, "turn_id": 13} +{"actual_output_tokens": 169, "cached_tokens": 108464, "effective_input_length": 108791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108791, "latency_s": 2.329709592042491, "output_length": 169, "proxy_request_id": "1314357:13:1448346:875", "request_id": "1314357:13:1448346:875", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1314357", "t_dispatch_unix": 1779815244.1374235, "t_finish_unix": 1779815246.4671333, "t_first_token_unix": 1779815244.7011113, "tpot_s": 0.010510230077280929, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14298706], "trace_timestamp_s": 735.0250000000005, "ttft_s": 0.5636860470403917, "turn_id": 13} +{"actual_output_tokens": 1070, "cached_tokens": 19136, "effective_input_length": 19292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19292, "latency_s": 12.065461496007629, "output_length": 1070, "proxy_request_id": "1371622:3:1443876:871", "request_id": "1371622:3:1443876:871", "request_type": "coder", "requested_output_tokens": 1070, "session_id": "1371622", "t_dispatch_unix": 1779815238.8252277, "t_finish_unix": 1779815250.8906896, "t_first_token_unix": 1779815238.9518588, "tpot_s": 0.011167970719360428, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523], "trace_timestamp_s": 719.9639999999999, "ttft_s": 0.1266289230552502, "turn_id": 3} +{"actual_output_tokens": 575, "cached_tokens": 63600, "effective_input_length": 63616, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63616, "latency_s": 5.603616409993265, "output_length": 575, "proxy_request_id": "1294611:14:1449074:877", "request_id": "1294611:14:1449074:877", "request_type": "coder", "requested_output_tokens": 575, "session_id": "1294611", "t_dispatch_unix": 1779815246.524539, "t_finish_unix": 1779815252.128155, "t_first_token_unix": 1779815246.6426435, "tpot_s": 0.009556148754301374, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 14306306], "trace_timestamp_s": 737.4130000000005, "ttft_s": 0.11810249701375142, "turn_id": 14} +{"actual_output_tokens": 122, "cached_tokens": 108944, "effective_input_length": 109010, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109010, "latency_s": 1.517064018000383, "output_length": 122, "proxy_request_id": "1314357:14:1450740:878", "request_id": "1314357:14:1450740:878", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1314357", "t_dispatch_unix": 1779815251.9690652, "t_finish_unix": 1779815253.4861288, "t_first_token_unix": 1779815252.238081, "tpot_s": 0.010312360991850834, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14320601], "trace_timestamp_s": 742.8560000000007, "ttft_s": 0.2690135129960254, "turn_id": 14} +{"actual_output_tokens": 89, "cached_tokens": 20352, "effective_input_length": 20439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20439, "latency_s": 0.591212944011204, "output_length": 89, "proxy_request_id": "1371622:4:1452210:881", "request_id": "1371622:4:1452210:881", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1371622", "t_dispatch_unix": 1779815256.948669, "t_finish_unix": 1779815257.5398817, "t_first_token_unix": 1779815257.017867, "tpot_s": 0.00592919973860262, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572], "trace_timestamp_s": 747.8389999999999, "ttft_s": 0.06919653998920694, "turn_id": 4} +{"actual_output_tokens": 65, "cached_tokens": 53056, "effective_input_length": 55050, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55050, "latency_s": 1.312816407007631, "output_length": 65, "proxy_request_id": "1268861:11:1452208:880", "request_id": "1268861:11:1452208:880", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1268861", "t_dispatch_unix": 1779815256.9397647, "t_finish_unix": 1779815258.2525814, "t_first_token_unix": 1779815257.7874906, "tpot_s": 0.00726293187472038, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14334566], "trace_timestamp_s": 747.8280000000004, "ttft_s": 0.8477236090111546, "turn_id": 11} +{"actual_output_tokens": 365, "cached_tokens": 109120, "effective_input_length": 109164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109164, "latency_s": 4.12333174503874, "output_length": 365, "proxy_request_id": "1314357:15:1452292:882", "request_id": "1314357:15:1452292:882", "request_type": "coder", "requested_output_tokens": 365, "session_id": "1314357", "t_dispatch_unix": 1779815257.1953337, "t_finish_unix": 1779815261.3186655, "t_first_token_unix": 1779815257.3939643, "tpot_s": 0.01078112893414832, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14335068, 14335069], "trace_timestamp_s": 748.0830000000005, "ttft_s": 0.19862776302034035, "turn_id": 15} +{"actual_output_tokens": 140, "cached_tokens": 0, "effective_input_length": 127488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127488, "latency_s": 53.25440138304839, "output_length": 140, "proxy_request_id": "1356885:2:1438037:864", "request_id": "1356885:2:1438037:864", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1356885", "t_dispatch_unix": 1779815209.8394637, "t_finish_unix": 1779815263.0938644, "t_first_token_unix": 1779815261.5266297, "tpot_s": 0.01127335639576689, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14202196, 14202197, 14202198, 14202199, 14202200, 14202201, 14202202, 14202203, 14202204], "trace_timestamp_s": 700.7250000000004, "ttft_s": 51.687163794005755, "turn_id": 2} +{"actual_output_tokens": 2588, "cached_tokens": 114368, "effective_input_length": 125947, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 125947, "latency_s": 77.45702777901897, "output_length": 2588, "proxy_request_id": "1264679:3:1431512:853", "request_id": "1264679:3:1431512:853", "request_type": "coder", "requested_output_tokens": 2588, "session_id": "1264679", "t_dispatch_unix": 1779815186.9627342, "t_finish_unix": 1779815264.4197621, "t_first_token_unix": 1779815218.9931967, "tpot_s": 0.017559420845375383, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281, 13901868, 13901869, 13901870, 13901871, 13901872, 13901873, 13901874, 14141972, 14141973, 14141974, 14141975, 14141976, 14141977, 14141978, 14141979, 14141980, 14141981, 14141982, 14141983, 14141984, 14141985, 14141986, 14141987, 14141988, 14141989, 14141990, 14141991, 14141992, 14141993, 14141994, 14141995], "trace_timestamp_s": 677.8460000000005, "ttft_s": 32.030460225010756, "turn_id": 3} +{"actual_output_tokens": 2679, "cached_tokens": 5936, "effective_input_length": 29412, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29412, "latency_s": 62.74976647802396, "output_length": 2679, "proxy_request_id": "1404395:2:1435941:862", "request_id": "1404395:2:1435941:862", "request_type": "coder", "requested_output_tokens": 2679, "session_id": "1404395", "t_dispatch_unix": 1779815202.7449362, "t_finish_unix": 1779815265.4947026, "t_first_token_unix": 1779815223.9067497, "tpot_s": 0.015529388103790962, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14183679], "trace_timestamp_s": 693.6320000000005, "ttft_s": 21.16181135905208, "turn_id": 2} +{"actual_output_tokens": 76, "cached_tokens": 20512, "effective_input_length": 21518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21518, "latency_s": 0.6847155700088479, "output_length": 76, "proxy_request_id": "1371622:5:1455608:884", "request_id": "1371622:5:1455608:884", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1371622", "t_dispatch_unix": 1779815268.7317183, "t_finish_unix": 1779815269.4164405, "t_first_token_unix": 1779815268.9769917, "tpot_s": 0.0058560064931710565, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14366141], "trace_timestamp_s": 759.6210000000001, "ttft_s": 0.24526919604977593, "turn_id": 5} +{"actual_output_tokens": 90, "cached_tokens": 29200, "effective_input_length": 29268, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29268, "latency_s": 0.648132661008276, "output_length": 90, "proxy_request_id": "1363943:14:1458616:885", "request_id": "1363943:14:1458616:885", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1363943", "t_dispatch_unix": 1779815278.676321, "t_finish_unix": 1779815279.3244534, "t_first_token_unix": 1779815278.7686884, "tpot_s": 0.006241738606568719, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14395120], "trace_timestamp_s": 769.5660000000007, "ttft_s": 0.0923656279919669, "turn_id": 14} +{"actual_output_tokens": 1368, "cached_tokens": 127616, "effective_input_length": 128563, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128563, "latency_s": 17.54687053296948, "output_length": 1368, "proxy_request_id": "1356885:3:1451307:879", "request_id": "1356885:3:1451307:879", "request_type": "coder", "requested_output_tokens": 1368, "session_id": "1356885", "t_dispatch_unix": 1779815263.0995886, "t_finish_unix": 1779815280.6464593, "t_first_token_unix": 1779815264.2271984, "tpot_s": 0.012010981460870396, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14202196, 14202197, 14202198, 14202199, 14202200, 14202201, 14202202, 14202203, 14202204, 14325634, 14325635, 14325636], "trace_timestamp_s": 744.8150000000005, "ttft_s": 1.1276073519838974, "turn_id": 3} +{"actual_output_tokens": 46, "cached_tokens": 74000, "effective_input_length": 75761, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75761, "latency_s": 36.16976625297684, "output_length": 46, "proxy_request_id": "1342921:6:1448548:876", "request_id": "1342921:6:1448548:876", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1342921", "t_dispatch_unix": 1779815244.7040598, "t_finish_unix": 1779815280.8738263, "t_first_token_unix": 1779815280.2416506, "tpot_s": 0.014043529332977617, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705], "trace_timestamp_s": 735.5860000000002, "ttft_s": 35.53758863499388, "turn_id": 6} +{"actual_output_tokens": 149, "cached_tokens": 0, "effective_input_length": 129673, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129673, "latency_s": 56.382157395011745, "output_length": 149, "proxy_request_id": "1313181:9:1333349:415", "request_id": "1313181:9:1333349:415", "request_type": "coder", "requested_output_tokens": 149, "session_id": "1313181", "t_dispatch_unix": 1779815225.7313678, "t_finish_unix": 1779815282.1135254, "t_first_token_unix": 1779815279.9543796, "tpot_s": 0.014587139243156196, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13240573], "trace_timestamp_s": 333.6930000000002, "ttft_s": 54.22300907300087, "turn_id": 9} +{"actual_output_tokens": 303, "cached_tokens": 0, "effective_input_length": 26406, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26406, "latency_s": 6.796397608006373, "output_length": 303, "proxy_request_id": "1242838:5:1460026:886", "request_id": "1242838:5:1460026:886", "request_type": "coder", "requested_output_tokens": 303, "session_id": "1242838", "t_dispatch_unix": 1779815283.1642861, "t_finish_unix": 1779815289.9606833, "t_first_token_unix": 1779815286.9463005, "tpot_s": 0.009980228354280123, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082], "trace_timestamp_s": 774.0540000000001, "ttft_s": 3.782012340030633, "turn_id": 5} +{"actual_output_tokens": 71, "cached_tokens": 73248, "effective_input_length": 81299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81299, "latency_s": 4.564986307988875, "output_length": 71, "proxy_request_id": "1363093:6:1460799:888", "request_id": "1363093:6:1460799:888", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1363093", "t_dispatch_unix": 1779815285.7360787, "t_finish_unix": 1779815290.301065, "t_first_token_unix": 1779815289.7152646, "tpot_s": 0.008364756214931341, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678, 13925441, 13925442, 13925443, 13925444, 13925445, 13925446, 13925447, 13925448, 13925449, 14416033, 14416034, 14416035, 14416036, 14416037, 14416038, 14416039, 14416040, 14416041, 14416042, 14416043, 14416044, 14416045, 14416046, 14416047, 14416048], "trace_timestamp_s": 776.6220000000003, "ttft_s": 3.9791834159987047, "turn_id": 6} +{"actual_output_tokens": 352, "cached_tokens": 32080, "effective_input_length": 34392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34392, "latency_s": 7.093507809971925, "output_length": 352, "proxy_request_id": "1404395:3:1460072:887", "request_id": "1404395:3:1460072:887", "request_type": "coder", "requested_output_tokens": 352, "session_id": "1404395", "t_dispatch_unix": 1779815283.312977, "t_finish_unix": 1779815290.406485, "t_first_token_unix": 1779815286.9496107, "tpot_s": 0.009847992014251331, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14408522], "trace_timestamp_s": 774.201, "ttft_s": 3.636632000969257, "turn_id": 3} +{"actual_output_tokens": 210, "cached_tokens": 29344, "effective_input_length": 29651, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29651, "latency_s": 2.157583593041636, "output_length": 210, "proxy_request_id": "1363943:15:1461716:889", "request_id": "1363943:15:1461716:889", "request_type": "coder", "requested_output_tokens": 210, "session_id": "1363943", "t_dispatch_unix": 1779815288.5991294, "t_finish_unix": 1779815290.756713, "t_first_token_unix": 1779815288.785026, "tpot_s": 0.009432729655591566, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564], "trace_timestamp_s": 779.4890000000005, "ttft_s": 0.18589356099255383, "turn_id": 15} +{"actual_output_tokens": 215, "cached_tokens": 29856, "effective_input_length": 34671, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34671, "latency_s": 2.6164044789620675, "output_length": 215, "proxy_request_id": "1363943:16:1463626:890", "request_id": "1363943:16:1463626:890", "request_type": "coder", "requested_output_tokens": 215, "session_id": "1363943", "t_dispatch_unix": 1779815295.068537, "t_finish_unix": 1779815297.6849482, "t_first_token_unix": 1779815296.2364423, "tpot_s": 0.00676743920553023, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14441618], "trace_timestamp_s": 785.9570000000003, "ttft_s": 1.1678944369778037, "turn_id": 16} +{"actual_output_tokens": 116, "cached_tokens": 55104, "effective_input_length": 56147, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56147, "latency_s": 1.4215533760143444, "output_length": 116, "proxy_request_id": "1268861:12:1463977:891", "request_id": "1268861:12:1463977:891", "request_type": "coder", "requested_output_tokens": 116, "session_id": "1268861", "t_dispatch_unix": 1779815296.3525145, "t_finish_unix": 1779815297.7740679, "t_first_token_unix": 1779815296.896738, "tpot_s": 0.007626638452158026, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14445190], "trace_timestamp_s": 787.241, "ttft_s": 0.5442213540081866, "turn_id": 12} +{"actual_output_tokens": 2012, "cached_tokens": 62512, "effective_input_length": 62513, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62513, "latency_s": 17.03826287202537, "output_length": 2012, "proxy_request_id": "1313181:9:1386945:689", "request_id": "1313181:9:1386945:689", "request_type": "coder", "requested_output_tokens": 2012, "session_id": "1313181", "t_dispatch_unix": 1779815282.1168916, "t_finish_unix": 1779815299.1551547, "t_first_token_unix": 1779815282.222114, "tpot_s": 0.008420076440078032, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13734424], "trace_timestamp_s": 521.2310000000007, "ttft_s": 0.10521975200390443, "turn_id": 9} +{"actual_output_tokens": 86, "cached_tokens": 21584, "effective_input_length": 23079, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23079, "latency_s": 0.8299470400088467, "output_length": 86, "proxy_request_id": "1371622:6:1465333:892", "request_id": "1371622:6:1465333:892", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1371622", "t_dispatch_unix": 1779815300.6137862, "t_finish_unix": 1779815301.4437325, "t_first_token_unix": 1779815300.9328597, "tpot_s": 0.006007322293761022, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14456423], "trace_timestamp_s": 791.5020000000004, "ttft_s": 0.3190719360136427, "turn_id": 6} +{"actual_output_tokens": 137, "cached_tokens": 23152, "effective_input_length": 24036, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24036, "latency_s": 1.055057404038962, "output_length": 137, "proxy_request_id": "1371622:7:1468305:895", "request_id": "1371622:7:1468305:895", "request_type": "coder", "requested_output_tokens": 137, "session_id": "1371622", "t_dispatch_unix": 1779815310.838192, "t_finish_unix": 1779815311.893249, "t_first_token_unix": 1779815311.0633457, "tpot_s": 0.0061004624850979515, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666], "trace_timestamp_s": 801.7260000000006, "ttft_s": 0.22515244502574205, "turn_id": 7} +{"actual_output_tokens": 217, "cached_tokens": 40848, "effective_input_length": 66246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66246, "latency_s": 10.74597620498389, "output_length": 217, "proxy_request_id": "1405155:3:1469167:897", "request_id": "1405155:3:1469167:897", "request_type": "coder", "requested_output_tokens": 217, "session_id": "1405155", "t_dispatch_unix": 1779815313.7300463, "t_finish_unix": 1779815324.476022, "t_first_token_unix": 1779815322.6889539, "tpot_s": 0.00827232534249089, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13983589, 13983590, 13983591, 13983592, 13983593, 13983594, 13983595, 13983596, 13983597, 13983598, 13983599, 13983600, 13983601, 13983602, 13983603, 14163102, 14163103, 14163104, 14163105, 14163106, 14163107, 14163108, 14163109, 14163110, 14163111, 14163112, 14163113, 14163114, 14163115, 14163116, 14493552, 14493553, 14493554, 14493555, 14493556, 14493557, 14493558, 14493559, 14493560, 14493561, 14493562, 14493563, 14493564, 14493565, 14493566, 14493567, 14493568, 14493569, 14493570, 14493571, 14493572, 14493573, 14493574, 14493575, 14493576, 14493577, 14493578, 14493579, 14493580, 14493581, 14493582, 14493583, 14493584, 14493585, 14493586, 14493587], "trace_timestamp_s": 804.6080000000002, "ttft_s": 8.95890483201947, "turn_id": 3} +{"actual_output_tokens": 27, "cached_tokens": 12176, "effective_input_length": 12247, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12247, "latency_s": 0.19721961504546925, "output_length": 27, "proxy_request_id": "1399948:13:1472968:898", "request_id": "1399948:13:1472968:898", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1399948", "t_dispatch_unix": 1779815326.1896687, "t_finish_unix": 1779815326.3868883, "t_first_token_unix": 1779815326.2522526, "tpot_s": 0.005168677383783058, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14529718], "trace_timestamp_s": 817.0790000000006, "ttft_s": 0.06258276605512947, "turn_id": 13} +{"actual_output_tokens": 150, "cached_tokens": 75792, "effective_input_length": 76600, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76600, "latency_s": 1.8803125620470382, "output_length": 150, "proxy_request_id": "1342921:7:1473812:900", "request_id": "1342921:7:1473812:900", "request_type": "coder", "requested_output_tokens": 150, "session_id": "1342921", "t_dispatch_unix": 1779815329.1439247, "t_finish_unix": 1779815331.0242372, "t_first_token_unix": 1779815329.7079816, "tpot_s": 0.008832190838961192, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14537884], "trace_timestamp_s": 820.0320000000002, "ttft_s": 0.5640547130024061, "turn_id": 7} +{"actual_output_tokens": 499, "cached_tokens": 24160, "effective_input_length": 24569, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24569, "latency_s": 3.2727726440061815, "output_length": 499, "proxy_request_id": "1371622:8:1473416:899", "request_id": "1371622:8:1473416:899", "request_type": "coder", "requested_output_tokens": 499, "session_id": "1371622", "t_dispatch_unix": 1779815327.8565369, "t_finish_unix": 1779815331.1293092, "t_first_token_unix": 1779815328.0234683, "tpot_s": 0.006236153012132235, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666, 14534121], "trace_timestamp_s": 818.7460000000001, "ttft_s": 0.16692981700180098, "turn_id": 8} +{"actual_output_tokens": 79, "cached_tokens": 56416, "effective_input_length": 129839, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129839, "latency_s": 44.27353102801135, "output_length": 79, "proxy_request_id": "1313181:10:1338837:436", "request_id": "1313181:10:1338837:436", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1313181", "t_dispatch_unix": 1779815299.1601322, "t_finish_unix": 1779815343.433663, "t_first_token_unix": 1779815341.438681, "tpot_s": 0.025572394282043647, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13291139], "trace_timestamp_s": 353.08300000000054, "ttft_s": 42.27854649501387, "turn_id": 10} +{"actual_output_tokens": 166, "cached_tokens": 34880, "effective_input_length": 35991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35991, "latency_s": 38.901502911001444, "output_length": 166, "proxy_request_id": "1363943:17:1466811:893", "request_id": "1363943:17:1466811:893", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1363943", "t_dispatch_unix": 1779815305.7490041, "t_finish_unix": 1779815344.650507, "t_first_token_unix": 1779815341.643907, "tpot_s": 0.018219964703276866, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14471076], "trace_timestamp_s": 796.6350000000002, "ttft_s": 35.89490086497972, "turn_id": 17} +{"actual_output_tokens": 183, "cached_tokens": 17168, "effective_input_length": 44949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44949, "latency_s": 7.527273933985271, "output_length": 183, "proxy_request_id": "1305906:4:1476757:902", "request_id": "1305906:4:1476757:902", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1305906", "t_dispatch_unix": 1779815339.2237527, "t_finish_unix": 1779815346.7510262, "t_first_token_unix": 1779815345.4509363, "tpot_s": 0.007142009835301356, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14566041, 14566042], "trace_timestamp_s": 830.094, "ttft_s": 6.227180943998974, "turn_id": 4} +{"actual_output_tokens": 183, "cached_tokens": 34736, "effective_input_length": 34863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34863, "latency_s": 39.96272257901728, "output_length": 183, "proxy_request_id": "1404395:4:1467473:894", "request_id": "1404395:4:1467473:894", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1404395", "t_dispatch_unix": 1779815308.0654078, "t_finish_unix": 1779815348.02813, "t_first_token_unix": 1779815341.6478956, "tpot_s": 0.03505448209874045, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14477863], "trace_timestamp_s": 798.9530000000004, "ttft_s": 33.58248608303256, "turn_id": 4} +{"actual_output_tokens": 90, "cached_tokens": 25056, "effective_input_length": 25286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25286, "latency_s": 0.909948313026689, "output_length": 90, "proxy_request_id": "1371622:9:1479535:905", "request_id": "1371622:9:1479535:905", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1371622", "t_dispatch_unix": 1779815348.533145, "t_finish_unix": 1779815349.4430935, "t_first_token_unix": 1779815348.647769, "tpot_s": 0.008931971988326797, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666, 14534121, 14590128, 14590129], "trace_timestamp_s": 839.4230000000007, "ttft_s": 0.11462274001678452, "turn_id": 9} +{"actual_output_tokens": 366, "cached_tokens": 64720, "effective_input_length": 64724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64724, "latency_s": 8.311223801982123, "output_length": 366, "proxy_request_id": "1313181:10:1399867:746", "request_id": "1313181:10:1399867:746", "request_type": "coder", "requested_output_tokens": 366, "session_id": "1313181", "t_dispatch_unix": 1779815343.4377944, "t_finish_unix": 1779815351.7490184, "t_first_token_unix": 1779815343.5505245, "tpot_s": 0.022460919380672788, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13853445], "trace_timestamp_s": 566.9639999999999, "ttft_s": 0.11272791103692725, "turn_id": 10} +{"actual_output_tokens": 164, "cached_tokens": 56256, "effective_input_length": 57130, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57130, "latency_s": 1.716424393991474, "output_length": 164, "proxy_request_id": "1268861:13:1481831:907", "request_id": "1268861:13:1481831:907", "request_type": "coder", "requested_output_tokens": 164, "session_id": "1268861", "t_dispatch_unix": 1779815356.3624113, "t_finish_unix": 1779815358.0788355, "t_first_token_unix": 1779815356.8069077, "tpot_s": 0.007801371901881727, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14610203], "trace_timestamp_s": 847.2510000000002, "ttft_s": 0.44449404400074854, "turn_id": 13} +{"actual_output_tokens": 1604, "cached_tokens": 38816, "effective_input_length": 38827, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38827, "latency_s": 11.759084044024348, "output_length": 1604, "proxy_request_id": "1301929:4:1479037:904", "request_id": "1301929:4:1479037:904", "request_type": "coder", "requested_output_tokens": 1604, "session_id": "1301929", "t_dispatch_unix": 1779815346.7878656, "t_finish_unix": 1779815358.5469499, "t_first_token_unix": 1779815346.8631651, "tpot_s": 0.007288542942628229, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 14014871, 14014872, 14014873, 14585791, 14585792, 14585793], "trace_timestamp_s": 837.6770000000006, "ttft_s": 0.07529817498289049, "turn_id": 4} +{"actual_output_tokens": 366, "cached_tokens": 36144, "effective_input_length": 47303, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47303, "latency_s": 51.76802819099976, "output_length": 366, "proxy_request_id": "1363943:18:1469143:896", "request_id": "1363943:18:1469143:896", "request_type": "coder", "requested_output_tokens": 366, "session_id": "1363943", "t_dispatch_unix": 1779815344.6624315, "t_finish_unix": 1779815396.4304602, "t_first_token_unix": 1779815347.9280338, "tpot_s": 0.13288254670699906, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14493422], "trace_timestamp_s": 804.5360000000001, "ttft_s": 3.265600029961206, "turn_id": 18} +{"actual_output_tokens": 76, "cached_tokens": 65088, "effective_input_length": 129931, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129931, "latency_s": 44.6986910419655, "output_length": 76, "proxy_request_id": "1313181:11:1344301:464", "request_id": "1313181:11:1344301:464", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1313181", "t_dispatch_unix": 1779815351.753723, "t_finish_unix": 1779815396.4524136, "t_first_token_unix": 1779815390.7870896, "tpot_s": 0.07553342528020342, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342], "trace_timestamp_s": 371.9440000000004, "ttft_s": 39.0333640279714, "turn_id": 11} +{"actual_output_tokens": 51, "cached_tokens": 65120, "effective_input_length": 65123, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65123, "latency_s": 4.162847066007089, "output_length": 51, "proxy_request_id": "1313181:11:1402841:762", "request_id": "1313181:11:1402841:762", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1313181", "t_dispatch_unix": 1779815396.4559126, "t_finish_unix": 1779815400.6187603, "t_first_token_unix": 1779815399.458414, "tpot_s": 0.02320097787887789, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13881594], "trace_timestamp_s": 577.3000000000002, "ttft_s": 3.0024987720535137, "turn_id": 11} +{"actual_output_tokens": 205, "cached_tokens": 1552, "effective_input_length": 29903, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29903, "latency_s": 28.29647219198523, "output_length": 205, "proxy_request_id": "1242838:6:1486863:911", "request_id": "1242838:6:1486863:911", "request_type": "coder", "requested_output_tokens": 205, "session_id": "1242838", "t_dispatch_unix": 1779815373.3719306, "t_finish_unix": 1779815401.6684022, "t_first_token_unix": 1779815394.5336337, "tpot_s": 0.03497271182348806, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082, 14660531, 14660532, 14660533, 14660534, 14660535, 14660536, 14660537], "trace_timestamp_s": 864.2580000000007, "ttft_s": 21.16170095000416, "turn_id": 6} +{"actual_output_tokens": 235, "cached_tokens": 47664, "effective_input_length": 56056, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56056, "latency_s": 6.389619243971538, "output_length": 235, "proxy_request_id": "1363943:19:1473899:901", "request_id": "1363943:19:1473899:901", "request_type": "coder", "requested_output_tokens": 235, "session_id": "1363943", "t_dispatch_unix": 1779815396.4363446, "t_finish_unix": 1779815402.8259633, "t_first_token_unix": 1779815399.447929, "tpot_s": 0.014434977465918144, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14538809], "trace_timestamp_s": 820.3120000000008, "ttft_s": 3.0115819439524785, "turn_id": 19} +{"actual_output_tokens": 378, "cached_tokens": 35040, "effective_input_length": 36988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36988, "latency_s": 53.96514039998874, "output_length": 378, "proxy_request_id": "1404395:5:1480170:906", "request_id": "1404395:5:1480170:906", "request_type": "coder", "requested_output_tokens": 378, "session_id": "1404395", "t_dispatch_unix": 1779815350.7723045, "t_finish_unix": 1779815404.7374449, "t_first_token_unix": 1779815351.368734, "tpot_s": 0.1415605953104352, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14596005], "trace_timestamp_s": 841.6610000000001, "ttft_s": 0.5964271759730764, "turn_id": 5} +{"actual_output_tokens": 359, "cached_tokens": 37360, "effective_input_length": 37689, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37689, "latency_s": 4.271796674991492, "output_length": 359, "proxy_request_id": "1404395:6:1483967:909", "request_id": "1404395:6:1483967:909", "request_type": "coder", "requested_output_tokens": 359, "session_id": "1404395", "t_dispatch_unix": 1779815404.7397192, "t_finish_unix": 1779815409.011516, "t_first_token_unix": 1779815404.959007, "tpot_s": 0.011318604986042867, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14632577], "trace_timestamp_s": 854.5040000000008, "ttft_s": 0.2192852949956432, "turn_id": 6} +{"actual_output_tokens": 419, "cached_tokens": 56288, "effective_input_length": 60761, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60761, "latency_s": 7.120313040970359, "output_length": 419, "proxy_request_id": "1363943:20:1476805:903", "request_id": "1363943:20:1476805:903", "request_type": "coder", "requested_output_tokens": 419, "session_id": "1363943", "t_dispatch_unix": 1779815402.8303232, "t_finish_unix": 1779815409.9506366, "t_first_token_unix": 1779815404.6356957, "tpot_s": 0.012714512102833935, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14566556], "trace_timestamp_s": 830.2800000000007, "ttft_s": 1.8053689390071668, "turn_id": 20} +{"actual_output_tokens": 45, "cached_tokens": 38032, "effective_input_length": 39569, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39569, "latency_s": 1.0272512640221976, "output_length": 45, "proxy_request_id": "1404395:7:1491186:914", "request_id": "1404395:7:1491186:914", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1404395", "t_dispatch_unix": 1779815409.0144978, "t_finish_unix": 1779815410.041749, "t_first_token_unix": 1779815409.5595758, "tpot_s": 0.01095229631755501, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14668041, 14668042, 14668043, 14701438, 14701439], "trace_timestamp_s": 879.0480000000007, "ttft_s": 0.5450750940362923, "turn_id": 7} +{"actual_output_tokens": 74, "cached_tokens": 57280, "effective_input_length": 61910, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61910, "latency_s": 2.4103492239955813, "output_length": 74, "proxy_request_id": "1268861:14:1498281:920", "request_id": "1268861:14:1498281:920", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1268861", "t_dispatch_unix": 1779815411.7534711, "t_finish_unix": 1779815414.16382, "t_first_token_unix": 1779815413.6053028, "tpot_s": 0.007647528684672529, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224], "trace_timestamp_s": 902.6390000000001, "ttft_s": 1.851829991035629, "turn_id": 14} +{"actual_output_tokens": 370, "cached_tokens": 61168, "effective_input_length": 65658, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65658, "latency_s": 7.318940274999477, "output_length": 370, "proxy_request_id": "1363943:21:1482184:908", "request_id": "1363943:21:1482184:908", "request_type": "coder", "requested_output_tokens": 370, "session_id": "1363943", "t_dispatch_unix": 1779815409.9556186, "t_finish_unix": 1779815417.2745588, "t_first_token_unix": 1779815411.8965209, "tpot_s": 0.01457390243908123, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14613732], "trace_timestamp_s": 848.5780000000004, "ttft_s": 1.9408999299630523, "turn_id": 21} +{"actual_output_tokens": 504, "cached_tokens": 39600, "effective_input_length": 39820, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39820, "latency_s": 11.036018526996486, "output_length": 504, "proxy_request_id": "1404395:8:1494219:916", "request_id": "1404395:8:1494219:916", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1404395", "t_dispatch_unix": 1779815410.0434535, "t_finish_unix": 1779815421.0794723, "t_first_token_unix": 1779815411.9870768, "tpot_s": 0.018075601846858243, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14668041, 14668042, 14668043, 14701438, 14730229], "trace_timestamp_s": 889.1580000000004, "ttft_s": 1.9436210870044306, "turn_id": 8} +{"actual_output_tokens": 298, "cached_tokens": 30096, "effective_input_length": 33352, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33352, "latency_s": 6.82859443401685, "output_length": 298, "proxy_request_id": "1242838:7:1499476:921", "request_id": "1242838:7:1499476:921", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1242838", "t_dispatch_unix": 1779815415.5880883, "t_finish_unix": 1779815422.4166827, "t_first_token_unix": 1779815416.4104152, "tpot_s": 0.020221888909064647, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082, 14660531, 14660532, 14660533, 14660534, 14660535, 14660536, 14660537, 14778951, 14778952, 14778953, 14778954, 14778955, 14778956, 14778957], "trace_timestamp_s": 906.4770000000008, "ttft_s": 0.822324461012613, "turn_id": 7} +{"actual_output_tokens": 398, "cached_tokens": 66016, "effective_input_length": 70238, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70238, "latency_s": 6.475908457010519, "output_length": 398, "proxy_request_id": "1363943:22:1485341:910", "request_id": "1363943:22:1485341:910", "request_type": "coder", "requested_output_tokens": 398, "session_id": "1363943", "t_dispatch_unix": 1779815417.2792902, "t_finish_unix": 1779815423.7551987, "t_first_token_unix": 1779815419.2196813, "tpot_s": 0.011423785685179216, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14647276], "trace_timestamp_s": 859.232, "ttft_s": 1.9403888080269098, "turn_id": 22} +{"actual_output_tokens": 226, "cached_tokens": 70624, "effective_input_length": 72516, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72516, "latency_s": 3.0190266870195046, "output_length": 226, "proxy_request_id": "1363943:23:1488713:912", "request_id": "1363943:23:1488713:912", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1363943", "t_dispatch_unix": 1779815423.7593293, "t_finish_unix": 1779815426.778356, "t_first_token_unix": 1779815424.821691, "tpot_s": 0.00869517800449911, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14678082], "trace_timestamp_s": 870.3830000000007, "ttft_s": 1.0623595000361092, "turn_id": 23} +{"actual_output_tokens": 181, "cached_tokens": 72736, "effective_input_length": 74939, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74939, "latency_s": 2.805566110997461, "output_length": 181, "proxy_request_id": "1363943:24:1491020:913", "request_id": "1363943:24:1491020:913", "request_type": "coder", "requested_output_tokens": 181, "session_id": "1363943", "t_dispatch_unix": 1779815426.7825637, "t_finish_unix": 1779815429.5881298, "t_first_token_unix": 1779815428.0143466, "tpot_s": 0.008741789761309822, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14700163], "trace_timestamp_s": 878.643, "ttft_s": 1.2317801129538566, "turn_id": 24} +{"actual_output_tokens": 246, "cached_tokens": 75104, "effective_input_length": 75711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75711, "latency_s": 2.579225997964386, "output_length": 246, "proxy_request_id": "1363943:25:1493325:915", "request_id": "1363943:25:1493325:915", "request_type": "coder", "requested_output_tokens": 246, "session_id": "1363943", "t_dispatch_unix": 1779815429.5919876, "t_finish_unix": 1779815432.1712139, "t_first_token_unix": 1779815430.0333622, "tpot_s": 0.008724690322545641, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986], "trace_timestamp_s": 886.1260000000002, "ttft_s": 0.44137189496541396, "turn_id": 25} +{"actual_output_tokens": 197, "cached_tokens": 75952, "effective_input_length": 83861, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83861, "latency_s": 5.845121448975988, "output_length": 197, "proxy_request_id": "1363943:26:1495648:917", "request_id": "1363943:26:1495648:917", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1363943", "t_dispatch_unix": 1779815432.1778336, "t_finish_unix": 1779815438.022955, "t_first_token_unix": 1779815436.2086983, "tpot_s": 0.009255024178633086, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228], "trace_timestamp_s": 893.8879999999999, "ttft_s": 4.03086290799547, "turn_id": 26} +{"actual_output_tokens": 376, "cached_tokens": 84048, "effective_input_length": 84090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 84090, "latency_s": 3.6884390610503033, "output_length": 376, "proxy_request_id": "1363943:27:1497882:919", "request_id": "1363943:27:1497882:919", "request_type": "coder", "requested_output_tokens": 376, "session_id": "1363943", "t_dispatch_unix": 1779815438.026629, "t_finish_unix": 1779815441.7150679, "t_first_token_unix": 1779815438.1827006, "tpot_s": 0.009418958730685214, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14764349], "trace_timestamp_s": 901.1640000000007, "ttft_s": 0.15606977901188657, "turn_id": 27} +{"actual_output_tokens": 25, "cached_tokens": 76736, "effective_input_length": 78722, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78722, "latency_s": 12.302256359020248, "output_length": 25, "proxy_request_id": "1342921:8:1503584:925", "request_id": "1342921:8:1503584:925", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1342921", "t_dispatch_unix": 1779815429.4417632, "t_finish_unix": 1779815441.744019, "t_first_token_unix": 1779815441.4127707, "tpot_s": 0.013790416790773937, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14818583, 14818584, 14818585, 14818586, 14818587], "trace_timestamp_s": 920.3299999999999, "ttft_s": 11.97100561100524, "turn_id": 8} +{"actual_output_tokens": 53, "cached_tokens": 12272, "effective_input_length": 14189, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14189, "latency_s": 9.892086947045755, "output_length": 53, "proxy_request_id": "1399948:14:1504493:926", "request_id": "1399948:14:1504493:926", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1399948", "t_dispatch_unix": 1779815432.2302358, "t_finish_unix": 1779815442.122323, "t_first_token_unix": 1779815441.3867865, "tpot_s": 0.0141386720956339, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14827845], "trace_timestamp_s": 923.1200000000008, "ttft_s": 9.156547792023048, "turn_id": 14} +{"actual_output_tokens": 81, "cached_tokens": 64512, "effective_input_length": 130479, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130479, "latency_s": 41.84037210000679, "output_length": 81, "proxy_request_id": "1313181:12:1346194:470", "request_id": "1313181:12:1346194:470", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1313181", "t_dispatch_unix": 1779815400.6240458, "t_finish_unix": 1779815442.4644172, "t_first_token_unix": 1779815441.4059992, "tpot_s": 0.013227313287643483, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182], "trace_timestamp_s": 378.5650000000005, "ttft_s": 40.78195073502138, "turn_id": 12} +{"actual_output_tokens": 69, "cached_tokens": 65168, "effective_input_length": 65179, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65179, "latency_s": 0.6450913640437648, "output_length": 69, "proxy_request_id": "1313181:12:1404813:772", "request_id": "1313181:12:1404813:772", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1313181", "t_dispatch_unix": 1779815442.467866, "t_finish_unix": 1779815443.1129575, "t_first_token_unix": 1779815442.5824482, "tpot_s": 0.0077977911766056954, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13897933], "trace_timestamp_s": 584.0840000000007, "ttft_s": 0.11457984003936872, "turn_id": 12} +{"actual_output_tokens": 229, "cached_tokens": 84464, "effective_input_length": 86984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86984, "latency_s": 3.7176768130157143, "output_length": 229, "proxy_request_id": "1363943:28:1500984:922", "request_id": "1363943:28:1500984:922", "request_type": "coder", "requested_output_tokens": 229, "session_id": "1363943", "t_dispatch_unix": 1779815441.7197247, "t_finish_unix": 1779815445.4374013, "t_first_token_unix": 1779815443.2904327, "tpot_s": 0.009415359157923887, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559], "trace_timestamp_s": 911.473, "ttft_s": 1.570706092985347, "turn_id": 28} +{"actual_output_tokens": 212, "cached_tokens": 87200, "effective_input_length": 89469, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89469, "latency_s": 3.4594304979545996, "output_length": 212, "proxy_request_id": "1363943:29:1503515:924", "request_id": "1363943:29:1503515:924", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1363943", "t_dispatch_unix": 1779815445.441996, "t_finish_unix": 1779815448.9014268, "t_first_token_unix": 1779815446.893265, "tpot_s": 0.009516161208546398, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14817740], "trace_timestamp_s": 920.0750000000007, "ttft_s": 1.4512661159969866, "turn_id": 29} +{"actual_output_tokens": 174, "cached_tokens": 61968, "effective_input_length": 63035, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63035, "latency_s": 2.010982452018652, "output_length": 174, "proxy_request_id": "1268861:15:1508874:928", "request_id": "1268861:15:1508874:928", "request_type": "coder", "requested_output_tokens": 174, "session_id": "1268861", "t_dispatch_unix": 1779815447.0780332, "t_finish_unix": 1779815449.0890152, "t_first_token_unix": 1779815447.6732497, "tpot_s": 0.008182077554883597, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 14868809], "trace_timestamp_s": 937.9670000000006, "ttft_s": 0.5952147149946541, "turn_id": 15} +{"actual_output_tokens": 73, "cached_tokens": 89680, "effective_input_length": 89713, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89713, "latency_s": 0.8113381870207377, "output_length": 73, "proxy_request_id": "1363943:30:1506171:927", "request_id": "1363943:30:1506171:927", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1363943", "t_dispatch_unix": 1779815448.9055037, "t_finish_unix": 1779815449.716842, "t_first_token_unix": 1779815449.0769207, "tpot_s": 0.008884240708236272, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 14843115], "trace_timestamp_s": 928.9100000000008, "ttft_s": 0.1714152530184947, "turn_id": 30} +{"actual_output_tokens": 45, "cached_tokens": 42928, "effective_input_length": 44364, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44364, "latency_s": 0.8191854209871963, "output_length": 45, "proxy_request_id": "1277428:9:1513231:932", "request_id": "1277428:9:1513231:932", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779815461.558583, "t_finish_unix": 1779815462.3777685, "t_first_token_unix": 1779815462.087893, "tpot_s": 0.0065813069999090985, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14911410], "trace_timestamp_s": 952.4470000000001, "ttft_s": 0.529307949997019, "turn_id": 9} +{"actual_output_tokens": 184, "cached_tokens": 0, "effective_input_length": 75760, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75760, "latency_s": 57.3811146869557, "output_length": 184, "proxy_request_id": "1388507:2:1496686:918", "request_id": "1388507:2:1496686:918", "request_type": "coder", "requested_output_tokens": 184, "session_id": "1388507", "t_dispatch_unix": 1779815406.3671596, "t_finish_unix": 1779815463.7482736, "t_first_token_unix": 1779815426.092827, "tpot_s": 0.20576612343165585, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728, 14709792, 14709793, 14709794, 14709795, 14709796, 14709797, 14709798], "trace_timestamp_s": 897.2540000000008, "ttft_s": 19.725666383979842, "turn_id": 2} +{"actual_output_tokens": 288, "cached_tokens": 129920, "effective_input_length": 130532, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130532, "latency_s": 4.087807231990155, "output_length": 288, "proxy_request_id": "1356885:4:1512902:931", "request_id": "1356885:4:1512902:931", "request_type": "coder", "requested_output_tokens": 288, "session_id": "1356885", "t_dispatch_unix": 1779815460.4235303, "t_finish_unix": 1779815464.5113375, "t_first_token_unix": 1779815461.1239066, "tpot_s": 0.01180192942849526, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770], "trace_timestamp_s": 951.308, "ttft_s": 0.7003740220097825, "turn_id": 4} +{"actual_output_tokens": 355, "cached_tokens": 0, "effective_input_length": 103893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103893, "latency_s": 41.5809512870037, "output_length": 355, "proxy_request_id": "1397515:2:1502033:923", "request_id": "1397515:2:1502033:923", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1397515", "t_dispatch_unix": 1779815424.14337, "t_finish_unix": 1779815465.7243218, "t_first_token_unix": 1779815461.2821636, "tpot_s": 0.012547637839107064, "trace_hash_ids": [61256, 61257, 9334, 61258, 61259, 61260, 61261, 61262, 61263, 61264, 61265, 139791, 92491, 139792, 139793, 139794, 139795, 139796, 139797, 139798, 740834, 740835, 740836, 740837, 1942273, 1942274, 1942275, 1942276, 1942277, 1942278, 1942279, 1942280, 1942281, 590845, 590846, 590847, 590848, 1942282, 161018, 161019, 161020, 161021, 1942283, 10351134, 10351135, 10351136, 10351137, 10351138, 10351139, 10351140, 10351141, 10351142, 10351143, 13831505, 2806911, 13831506, 13831507, 13831508, 13831509, 13831510, 13831511, 13831512, 13831513, 13831514, 13831515, 13831516, 13831517, 13831518, 13831519, 13831520, 13831521, 13831522, 13831523, 13831524, 13831525, 13831526, 13831527, 13831528, 13831529, 13831530, 13831531, 13831532, 13831533, 13831534, 13831535, 13831536, 13831537, 13831538, 13831539, 13831540, 13831541, 13831542, 13831543, 13831544, 13831545, 13831546, 13831547, 13831548, 13831549, 13831550, 13831551, 13831552, 13831553, 13831554, 13831555, 13831556, 13831557, 13831558, 13831559, 13831560, 13831561, 13831562, 13831563, 13831564, 13831565, 13831566, 13831567, 13831568, 13831569, 13831570, 13831571, 13831572, 13831573, 13831574, 13831575, 13831576, 13831577, 13831578, 13831579, 13831580, 13831581, 13831582, 13831583, 13831584, 13831585, 13831586, 13831587, 13831588, 13831589, 13831590, 13831591, 13831592, 13831593, 13831594, 13831595, 13831596, 13831597, 13831598, 13831599, 13831600, 13831601, 13831602, 13831603, 13831604, 13831605, 13831606, 13831607, 13831608, 13831609, 13831610, 13831611, 13831612, 13831613, 13831614, 13831615, 13831616, 13831617, 13831618, 13831619, 13831620, 13831621, 13831622, 13831623, 13831624, 13831625, 13831626, 13831627, 13831628, 14027210, 14027211, 14027212, 14697579, 14697580, 14697581, 14697582, 14697583, 14697584, 14697585, 14697586, 14697587, 14697588, 14697589, 14697590, 14697591, 14803950, 14803951, 14803952, 14803953, 14803954, 14803955, 14803956, 14803957, 14803958], "trace_timestamp_s": 915.0260000000007, "ttft_s": 37.13879158697091, "turn_id": 2} +{"actual_output_tokens": 284, "cached_tokens": 44400, "effective_input_length": 45851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45851, "latency_s": 2.610008295974694, "output_length": 284, "proxy_request_id": "1277428:10:1517408:935", "request_id": "1277428:10:1517408:935", "request_type": "coder", "requested_output_tokens": 284, "session_id": "1277428", "t_dispatch_unix": 1779815475.3526175, "t_finish_unix": 1779815477.9626257, "t_first_token_unix": 1779815475.8953078, "tpot_s": 0.007303962275647483, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14951061], "trace_timestamp_s": 966.2420000000002, "ttft_s": 0.5426886019995436, "turn_id": 10} +{"actual_output_tokens": 46, "cached_tokens": 14240, "effective_input_length": 15669, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15669, "latency_s": 25.675573275017086, "output_length": 46, "proxy_request_id": "1399948:15:1512300:930", "request_id": "1399948:15:1512300:930", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1399948", "t_dispatch_unix": 1779815458.5458272, "t_finish_unix": 1779815484.2214005, "t_first_token_unix": 1779815483.6768303, "tpot_s": 0.012094993511628774, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14902700], "trace_timestamp_s": 949.4360000000006, "ttft_s": 25.131001306988765, "turn_id": 15} +{"actual_output_tokens": 3516, "cached_tokens": 89776, "effective_input_length": 89790, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89790, "latency_s": 35.26705108594615, "output_length": 3516, "proxy_request_id": "1363943:31:1509815:929", "request_id": "1363943:31:1509815:929", "request_type": "coder", "requested_output_tokens": 3516, "session_id": "1363943", "t_dispatch_unix": 1779815450.1017857, "t_finish_unix": 1779815485.3688364, "t_first_token_unix": 1779815450.260504, "tpot_s": 0.009988060840395588, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 14877475], "trace_timestamp_s": 940.9880000000003, "ttft_s": 0.1587150919949636, "turn_id": 31} +{"actual_output_tokens": 76, "cached_tokens": 15712, "effective_input_length": 15913, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15913, "latency_s": 1.1577507259789854, "output_length": 76, "proxy_request_id": "1399948:16:1513839:933", "request_id": "1399948:16:1513839:933", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1399948", "t_dispatch_unix": 1779815484.222955, "t_finish_unix": 1779815485.3807058, "t_first_token_unix": 1779815484.348043, "tpot_s": 0.013764970479533076, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14917327], "trace_timestamp_s": 954.6170000000002, "ttft_s": 0.1250862930319272, "turn_id": 16} +{"actual_output_tokens": 143, "cached_tokens": 65232, "effective_input_length": 131699, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131699, "latency_s": 42.772403624956496, "output_length": 143, "proxy_request_id": "1313181:13:1349104:484", "request_id": "1313181:13:1349104:484", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1313181", "t_dispatch_unix": 1779815443.117421, "t_finish_unix": 1779815485.8898246, "t_first_token_unix": 1779815483.6962693, "tpot_s": 0.015444992436424002, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182, 13385557, 13385558, 13385559], "trace_timestamp_s": 388.8780000000006, "ttft_s": 40.57884590799222, "turn_id": 13} +{"actual_output_tokens": 57, "cached_tokens": 46128, "effective_input_length": 46361, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46361, "latency_s": 0.5715902479714714, "output_length": 57, "proxy_request_id": "1277428:11:1520449:937", "request_id": "1277428:11:1520449:937", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1277428", "t_dispatch_unix": 1779815485.339421, "t_finish_unix": 1779815485.9110105, "t_first_token_unix": 1779815485.5247984, "tpot_s": 0.006893136785947718, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 14979348], "trace_timestamp_s": 976.2290000000003, "ttft_s": 0.18537505698623136, "turn_id": 11} +{"actual_output_tokens": 63, "cached_tokens": 15984, "effective_input_length": 16604, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16604, "latency_s": 0.9798415139666758, "output_length": 63, "proxy_request_id": "1399948:17:1518102:936", "request_id": "1399948:17:1518102:936", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779815485.3823426, "t_finish_unix": 1779815486.3621845, "t_first_token_unix": 1779815485.712138, "tpot_s": 0.010478470290470268, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 14957862], "trace_timestamp_s": 968.7300000000005, "ttft_s": 0.3297937759780325, "turn_id": 17} +{"actual_output_tokens": 257, "cached_tokens": 65264, "effective_input_length": 65279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65279, "latency_s": 2.333935795992147, "output_length": 257, "proxy_request_id": "1313181:13:1406095:783", "request_id": "1313181:13:1406095:783", "request_type": "coder", "requested_output_tokens": 257, "session_id": "1313181", "t_dispatch_unix": 1779815485.8932939, "t_finish_unix": 1779815488.2272298, "t_first_token_unix": 1779815486.010487, "tpot_s": 0.008658138445298391, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13909100], "trace_timestamp_s": 588.6900000000005, "ttft_s": 0.1171909180120565, "turn_id": 13} +{"actual_output_tokens": 607, "cached_tokens": 0, "effective_input_length": 36568, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36568, "latency_s": 9.750732594984584, "output_length": 607, "proxy_request_id": "1243831:2:1528168:943", "request_id": "1243831:2:1528168:943", "request_type": "coder", "requested_output_tokens": 607, "session_id": "1243831", "t_dispatch_unix": 1779815511.5201223, "t_finish_unix": 1779815521.2708547, "t_first_token_unix": 1779815517.0409927, "tpot_s": 0.006979564521496304, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 15055359, 15055360, 15055361, 15055362, 15055363, 15055364, 15055365, 15055366, 15055367, 15055368, 15055369, 15055370, 15055371, 15055372, 15055373, 15055374, 15055375, 15055376, 15055377, 15055378, 15055379, 15055380, 15055381, 15055382, 15055383, 15055384, 15055385, 15055386, 15055387, 15055388, 15055389, 15055390, 15055391, 15055392, 15055393, 15055394, 15055395, 15055396, 15055397, 15055398, 15055399, 15055400, 15055401, 15055402, 15055403, 15055404, 15055405, 15055406, 15055407, 15055408], "trace_timestamp_s": 1002.3960000000006, "ttft_s": 5.520868147956207, "turn_id": 2} +{"actual_output_tokens": 133, "cached_tokens": 63200, "effective_input_length": 71192, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71192, "latency_s": 4.596764775982592, "output_length": 133, "proxy_request_id": "1268861:16:1529894:946", "request_id": "1268861:16:1529894:946", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1268861", "t_dispatch_unix": 1779815517.2647662, "t_finish_unix": 1779815521.8615315, "t_first_token_unix": 1779815520.749359, "tpot_s": 0.0084233505983844, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15072129], "trace_timestamp_s": 1008.1510000000007, "ttft_s": 3.4845904519897886, "turn_id": 16} +{"actual_output_tokens": 151, "cached_tokens": 11568, "effective_input_length": 11584, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11584, "latency_s": 0.8654157229466364, "output_length": 151, "proxy_request_id": "1243831:3:1270336:110", "request_id": "1243831:3:1270336:110", "request_type": "coder", "requested_output_tokens": 151, "session_id": "1243831", "t_dispatch_unix": 1779815521.2718174, "t_finish_unix": 1779815522.1372313, "t_first_token_unix": 1779815521.307477, "tpot_s": 0.005529697326710448, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12641626], "trace_timestamp_s": 113.52800000000025, "ttft_s": 0.035660359950270504, "turn_id": 3} +{"actual_output_tokens": 77, "cached_tokens": 11728, "effective_input_length": 14515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14515, "latency_s": 0.800557188980747, "output_length": 77, "proxy_request_id": "1243831:4:1284306:183", "request_id": "1243831:4:1284306:183", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1243831", "t_dispatch_unix": 1779815522.139489, "t_finish_unix": 1779815522.9400458, "t_first_token_unix": 1779815522.5170848, "tpot_s": 0.005561895762711126, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 12778587], "trace_timestamp_s": 162.09900000000016, "ttft_s": 0.3775942160282284, "turn_id": 4} +{"actual_output_tokens": 81, "cached_tokens": 14576, "effective_input_length": 14627, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14627, "latency_s": 0.4975980200106278, "output_length": 81, "proxy_request_id": "1243831:5:1303288:273", "request_id": "1243831:5:1303288:273", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1243831", "t_dispatch_unix": 1779815522.9408271, "t_finish_unix": 1779815523.4384253, "t_first_token_unix": 1779815522.9922988, "tpot_s": 0.005573535362054826, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 12959828], "trace_timestamp_s": 227.3050000000003, "ttft_s": 0.05146969703491777, "turn_id": 5} +{"actual_output_tokens": 80, "cached_tokens": 14704, "effective_input_length": 17410, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17410, "latency_s": 0.8706627180217765, "output_length": 80, "proxy_request_id": "1243831:6:1313694:320", "request_id": "1243831:6:1313694:320", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1243831", "t_dispatch_unix": 1779815523.440428, "t_finish_unix": 1779815524.311091, "t_first_token_unix": 1779815523.8622043, "tpot_s": 0.00567847478448095, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13056746], "trace_timestamp_s": 264.14500000000044, "ttft_s": 0.4217744170455262, "turn_id": 6} +{"actual_output_tokens": 103, "cached_tokens": 17488, "effective_input_length": 19460, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19460, "latency_s": 0.9554529219749384, "output_length": 103, "proxy_request_id": "1243831:7:1323865:366", "request_id": "1243831:7:1323865:366", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1243831", "t_dispatch_unix": 1779815524.3127697, "t_finish_unix": 1779815525.2682228, "t_first_token_unix": 1779815524.6733923, "tpot_s": 0.005829332186383944, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13151112], "trace_timestamp_s": 300.0500000000002, "ttft_s": 0.3606204869574867, "turn_id": 7} +{"actual_output_tokens": 111, "cached_tokens": 19552, "effective_input_length": 24512, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24512, "latency_s": 1.547496579005383, "output_length": 111, "proxy_request_id": "1243831:8:1333049:414", "request_id": "1243831:8:1333049:414", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1243831", "t_dispatch_unix": 1779815525.2709625, "t_finish_unix": 1779815526.818459, "t_first_token_unix": 1779815526.1511042, "tpot_s": 0.006064280909380283, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173], "trace_timestamp_s": 332.8090000000002, "ttft_s": 0.8801396389608271, "turn_id": 8} +{"actual_output_tokens": 67, "cached_tokens": 24608, "effective_input_length": 25075, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25075, "latency_s": 0.5693228549789637, "output_length": 67, "proxy_request_id": "1243831:9:1348240:478", "request_id": "1243831:9:1348240:478", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1243831", "t_dispatch_unix": 1779815526.8195758, "t_finish_unix": 1779815527.3888988, "t_first_token_unix": 1779815526.9881382, "tpot_s": 0.006068544999421151, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884], "trace_timestamp_s": 385.9180000000006, "ttft_s": 0.1685600940254517, "turn_id": 9} +{"actual_output_tokens": 112, "cached_tokens": 25136, "effective_input_length": 26343, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26343, "latency_s": 0.9811052309814841, "output_length": 112, "proxy_request_id": "1243831:10:1358921:521", "request_id": "1243831:10:1358921:521", "request_type": "coder", "requested_output_tokens": 112, "session_id": "1243831", "t_dispatch_unix": 1779815527.3903549, "t_finish_unix": 1779815528.3714604, "t_first_token_unix": 1779815527.6841426, "tpot_s": 0.006189821297428696, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13476530], "trace_timestamp_s": 423.28400000000056, "ttft_s": 0.29378472099779174, "turn_id": 10} +{"actual_output_tokens": 75, "cached_tokens": 26448, "effective_input_length": 26818, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26818, "latency_s": 0.6223271720227785, "output_length": 75, "proxy_request_id": "1243831:11:1371191:594", "request_id": "1243831:11:1371191:594", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1243831", "t_dispatch_unix": 1779815528.3728013, "t_finish_unix": 1779815528.9951284, "t_first_token_unix": 1779815528.5451956, "tpot_s": 0.0060768929322728435, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13591639], "trace_timestamp_s": 466.35400000000027, "ttft_s": 0.1723920910153538, "turn_id": 11} +{"actual_output_tokens": 66, "cached_tokens": 26880, "effective_input_length": 27164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27164, "latency_s": 0.5234836509916931, "output_length": 66, "proxy_request_id": "1243831:12:1385174:681", "request_id": "1243831:12:1385174:681", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1243831", "t_dispatch_unix": 1779815528.9964082, "t_finish_unix": 1779815529.5198922, "t_first_token_unix": 1779815529.1195798, "tpot_s": 0.006154569292154449, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13718858], "trace_timestamp_s": 515.2120000000004, "ttft_s": 0.12316926597850397, "turn_id": 12} +{"actual_output_tokens": 85, "cached_tokens": 27216, "effective_input_length": 27286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27286, "latency_s": 0.608346936001908, "output_length": 85, "proxy_request_id": "1243831:13:1398072:738", "request_id": "1243831:13:1398072:738", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1243831", "t_dispatch_unix": 1779815529.5210164, "t_finish_unix": 1779815530.1293638, "t_first_token_unix": 1779815529.605156, "tpot_s": 0.006237481285574003, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13836022], "trace_timestamp_s": 560.7880000000005, "ttft_s": 0.0841375130112283, "turn_id": 13} +{"actual_output_tokens": 85, "cached_tokens": 27360, "effective_input_length": 28085, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28085, "latency_s": 0.7672931250417605, "output_length": 85, "proxy_request_id": "1243831:14:1411189:814", "request_id": "1243831:14:1411189:814", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1243831", "t_dispatch_unix": 1779815530.1307108, "t_finish_unix": 1779815530.898004, "t_first_token_unix": 1779815530.3737574, "tpot_s": 0.006238112083381219, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434], "trace_timestamp_s": 606.2490000000007, "ttft_s": 0.2430447840015404, "turn_id": 14} +{"actual_output_tokens": 133, "cached_tokens": 28160, "effective_input_length": 29382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29382, "latency_s": 1.1653214099933393, "output_length": 133, "proxy_request_id": "1243831:15:1427593:849", "request_id": "1243831:15:1427593:849", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1243831", "t_dispatch_unix": 1779815530.8996105, "t_finish_unix": 1779815532.064932, "t_first_token_unix": 1779815531.2193527, "tpot_s": 0.006404094954522214, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14104163], "trace_timestamp_s": 664.1060000000007, "ttft_s": 0.3197398909833282, "turn_id": 15} +{"actual_output_tokens": 187, "cached_tokens": 130816, "effective_input_length": 130906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130906, "latency_s": 2.447107794985641, "output_length": 187, "proxy_request_id": "1356885:5:1533696:948", "request_id": "1356885:5:1533696:948", "request_type": "coder", "requested_output_tokens": 187, "session_id": "1356885", "t_dispatch_unix": 1779815529.9100282, "t_finish_unix": 1779815532.3571358, "t_first_token_unix": 1779815530.195886, "tpot_s": 0.011618306134296682, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124], "trace_timestamp_s": 1020.7970000000005, "ttft_s": 0.28585515200393274, "turn_id": 5} +{"actual_output_tokens": 68, "cached_tokens": 29504, "effective_input_length": 29571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29571, "latency_s": 0.5098229689756408, "output_length": 68, "proxy_request_id": "1243831:16:1446717:874", "request_id": "1243831:16:1446717:874", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1243831", "t_dispatch_unix": 1779815532.0662074, "t_finish_unix": 1779815532.5760305, "t_first_token_unix": 1779815532.1555896, "tpot_s": 0.006271527581431194, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14283881], "trace_timestamp_s": 729.4750000000004, "ttft_s": 0.08938049100106582, "turn_id": 16} +{"actual_output_tokens": 196, "cached_tokens": 93296, "effective_input_length": 93368, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93368, "latency_s": 2.629127617983613, "output_length": 196, "proxy_request_id": "1363943:32:1537767:950", "request_id": "1363943:32:1537767:950", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1363943", "t_dispatch_unix": 1779815543.7066755, "t_finish_unix": 1779815546.335803, "t_first_token_unix": 1779815543.9366298, "tpot_s": 0.012302228656466095, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 15147439, 15147440, 15147441, 15147442, 15147443, 15147444, 15147445, 15147446], "trace_timestamp_s": 1034.5930000000008, "ttft_s": 0.22995206201449037, "turn_id": 32} +{"actual_output_tokens": 314, "cached_tokens": 0, "effective_input_length": 71987, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71987, "latency_s": 24.020951197016984, "output_length": 314, "proxy_request_id": "1294611:15:1533841:949", "request_id": "1294611:15:1533841:949", "request_type": "coder", "requested_output_tokens": 314, "session_id": "1294611", "t_dispatch_unix": 1779815530.3843224, "t_finish_unix": 1779815554.4052734, "t_first_token_unix": 1779815549.914564, "tpot_s": 0.014346547108649398, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15109253, 15109254, 15109255, 15109256, 15109257, 15109258, 15109259, 15109260, 15109261, 15109262, 15109263, 15109264, 15109265, 15109266, 15109267, 15109268, 15109269], "trace_timestamp_s": 1021.2700000000004, "ttft_s": 19.530238097999245, "turn_id": 15} +{"actual_output_tokens": 165, "cached_tokens": 71312, "effective_input_length": 75693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75693, "latency_s": 3.6518643790041097, "output_length": 165, "proxy_request_id": "1268861:17:1540278:951", "request_id": "1268861:17:1540278:951", "request_type": "coder", "requested_output_tokens": 165, "session_id": "1268861", "t_dispatch_unix": 1779815551.7906184, "t_finish_unix": 1779815555.4424827, "t_first_token_unix": 1779815554.0082057, "tpot_s": 0.008744094133939275, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15173450], "trace_timestamp_s": 1042.6770000000006, "ttft_s": 2.2175848570186645, "turn_id": 17} +{"actual_output_tokens": 15, "cached_tokens": 0, "effective_input_length": 79086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79086, "latency_s": 51.83877906197449, "output_length": 15, "proxy_request_id": "1342921:9:1525898:939", "request_id": "1342921:9:1525898:939", "request_type": "coder", "requested_output_tokens": 15, "session_id": "1342921", "t_dispatch_unix": 1779815503.927501, "t_finish_unix": 1779815555.7662797, "t_first_token_unix": 1779815555.5470169, "tpot_s": 0.01563500357276228, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14818583, 14818584, 14818585, 14818586, 15032686, 15032687], "trace_timestamp_s": 994.8110000000006, "ttft_s": 51.619514203979634, "turn_id": 9} +{"actual_output_tokens": 63, "cached_tokens": 16656, "effective_input_length": 17276, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17276, "latency_s": 57.43371335195843, "output_length": 63, "proxy_request_id": "1399948:18:1524432:938", "request_id": "1399948:18:1524432:938", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779815498.9023645, "t_finish_unix": 1779815556.3360772, "t_first_token_unix": 1779815534.907158, "tpot_s": 0.345622180225966, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15019330], "trace_timestamp_s": 989.781, "ttft_s": 36.00479167298181, "turn_id": 18} +{"actual_output_tokens": 50, "cached_tokens": 17328, "effective_input_length": 18091, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18091, "latency_s": 1.0458908860455267, "output_length": 50, "proxy_request_id": "1399948:19:1526739:941", "request_id": "1399948:19:1526739:941", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1399948", "t_dispatch_unix": 1779815556.337372, "t_finish_unix": 1779815557.3832638, "t_first_token_unix": 1779815556.678772, "tpot_s": 0.01437001383735095, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15040983], "trace_timestamp_s": 997.7020000000002, "ttft_s": 0.34139769501052797, "turn_id": 19} +{"actual_output_tokens": 92, "cached_tokens": 18128, "effective_input_length": 18164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18164, "latency_s": 1.3584039580309764, "output_length": 92, "proxy_request_id": "1399948:20:1527857:942", "request_id": "1399948:20:1527857:942", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1399948", "t_dispatch_unix": 1779815557.384335, "t_finish_unix": 1779815558.7427392, "t_first_token_unix": 1779815557.4654915, "tpot_s": 0.014031263977893024, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15053152], "trace_timestamp_s": 1001.2000000000007, "ttft_s": 0.08115464402362704, "turn_id": 20} +{"actual_output_tokens": 100, "cached_tokens": 18240, "effective_input_length": 18388, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18388, "latency_s": 1.492381471034605, "output_length": 100, "proxy_request_id": "1399948:21:1528978:944", "request_id": "1399948:21:1528978:944", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1399948", "t_dispatch_unix": 1779815558.7436826, "t_finish_unix": 1779815560.2360644, "t_first_token_unix": 1779815558.8492188, "tpot_s": 0.014004836454540679, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128], "trace_timestamp_s": 1005.1450000000004, "ttft_s": 0.10553439700743183, "turn_id": 21} +{"actual_output_tokens": 45, "cached_tokens": 18480, "effective_input_length": 18563, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18563, "latency_s": 0.7091377939796075, "output_length": 45, "proxy_request_id": "1399948:22:1530122:947", "request_id": "1399948:22:1530122:947", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779815560.2371645, "t_finish_unix": 1779815560.9463027, "t_first_token_unix": 1779815560.3371387, "tpot_s": 0.013835802954748611, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15074294], "trace_timestamp_s": 1008.9760000000006, "ttft_s": 0.09997211198788136, "turn_id": 22} +{"actual_output_tokens": 643, "cached_tokens": 93552, "effective_input_length": 93596, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93596, "latency_s": 8.347100310958922, "output_length": 643, "proxy_request_id": "1363943:33:1541065:952", "request_id": "1363943:33:1541065:952", "request_type": "coder", "requested_output_tokens": 643, "session_id": "1363943", "t_dispatch_unix": 1779815554.4374123, "t_finish_unix": 1779815562.7845128, "t_first_token_unix": 1779815554.639916, "tpot_s": 0.012685889733691969, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 15147439, 15147440, 15147441, 15147442, 15147443, 15147444, 15147445, 15180688], "trace_timestamp_s": 1045.3250000000007, "ttft_s": 0.20250137196853757, "turn_id": 33} +{"actual_output_tokens": 662, "cached_tokens": 65520, "effective_input_length": 139357, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 139357, "latency_s": 76.86937956296606, "output_length": 662, "proxy_request_id": "1313181:14:1351342:491", "request_id": "1313181:14:1351342:491", "request_type": "coder", "requested_output_tokens": 662, "session_id": "1313181", "t_dispatch_unix": 1779815488.234838, "t_finish_unix": 1779815565.1042175, "t_first_token_unix": 1779815534.9303043, "tpot_s": 0.045648523913777425, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182, 13385557, 13385558, 13407607, 13407608, 13407609, 13407610, 13407611, 13407612, 13407613, 13407614, 13407615, 13407616, 13407617, 13407618, 13407619, 13407620, 13407621, 13407622], "trace_timestamp_s": 396.7470000000003, "ttft_s": 46.6954637899762, "turn_id": 14} +{"actual_output_tokens": 76, "cached_tokens": 18592, "effective_input_length": 20031, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20031, "latency_s": 1.2335303419968113, "output_length": 76, "proxy_request_id": "1399948:23:1544108:954", "request_id": "1399948:23:1544108:954", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1399948", "t_dispatch_unix": 1779815564.3079185, "t_finish_unix": 1779815565.541449, "t_first_token_unix": 1779815564.6764674, "tpot_s": 0.01152864949312061, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15209349], "trace_timestamp_s": 1055.1980000000003, "ttft_s": 0.36854661599500105, "turn_id": 23} +{"actual_output_tokens": 1497, "cached_tokens": 0, "effective_input_length": 87576, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87576, "latency_s": 59.60175016004359, "output_length": 1497, "proxy_request_id": "1253804:7:1526643:940", "request_id": "1253804:7:1526643:940", "request_type": "coder", "requested_output_tokens": 1497, "session_id": "1253804", "t_dispatch_unix": 1779815506.3700583, "t_finish_unix": 1779815565.971808, "t_first_token_unix": 1779815532.0935094, "tpot_s": 0.022645726852919868, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15040216], "trace_timestamp_s": 997.2470000000003, "ttft_s": 25.723449530021753, "turn_id": 7} +{"actual_output_tokens": 48, "cached_tokens": 89072, "effective_input_length": 89116, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89116, "latency_s": 0.5644691589986905, "output_length": 48, "proxy_request_id": "1253804:8:1541192:953", "request_id": "1253804:8:1541192:953", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1253804", "t_dispatch_unix": 1779815565.9765015, "t_finish_unix": 1779815566.5409708, "t_first_token_unix": 1779815566.1469612, "tpot_s": 0.00837779163749532, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15182013], "trace_timestamp_s": 1045.741, "ttft_s": 0.17045763903297484, "turn_id": 8} +{"actual_output_tokens": 350, "cached_tokens": 65872, "effective_input_length": 65876, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65876, "latency_s": 3.1210323270061053, "output_length": 350, "proxy_request_id": "1313181:14:1408792:803", "request_id": "1313181:14:1408792:803", "request_type": "coder", "requested_output_tokens": 350, "session_id": "1313181", "t_dispatch_unix": 1779815565.1080177, "t_finish_unix": 1779815568.2290502, "t_first_token_unix": 1779815565.2217984, "tpot_s": 0.008616011280714559, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13934257, 13934258], "trace_timestamp_s": 598.0260000000007, "ttft_s": 0.11377823899965733, "turn_id": 14} +{"actual_output_tokens": 382, "cached_tokens": 66224, "effective_input_length": 66259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66259, "latency_s": 3.3465182049549185, "output_length": 382, "proxy_request_id": "1313181:15:1411723:818", "request_id": "1313181:15:1411723:818", "request_type": "coder", "requested_output_tokens": 382, "session_id": "1313181", "t_dispatch_unix": 1779815568.2325723, "t_finish_unix": 1779815571.5790908, "t_first_token_unix": 1779815568.376162, "tpot_s": 0.008405865044632482, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13934257, 13934258, 13960252], "trace_timestamp_s": 608.4310000000005, "ttft_s": 0.14358667196938768, "turn_id": 15} +{"actual_output_tokens": 45, "cached_tokens": 20096, "effective_input_length": 21809, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21809, "latency_s": 0.6005988949909806, "output_length": 45, "proxy_request_id": "1399948:24:1546940:955", "request_id": "1399948:24:1546940:955", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779815573.756031, "t_finish_unix": 1779815574.3566298, "t_first_token_unix": 1779815574.10976, "tpot_s": 0.005604368068320168, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15237108], "trace_timestamp_s": 1064.6450000000004, "ttft_s": 0.3537273029796779, "turn_id": 24} +{"actual_output_tokens": 7535, "cached_tokens": 29632, "effective_input_length": 31161, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31161, "latency_s": 57.459997585974634, "output_length": 7535, "proxy_request_id": "1243831:17:1453633:883", "request_id": "1243831:17:1453633:883", "request_type": "coder", "requested_output_tokens": 7535, "session_id": "1243831", "t_dispatch_unix": 1779815532.5776868, "t_finish_unix": 1779815590.0376847, "t_first_token_unix": 1779815532.9798868, "tpot_s": 0.007573339775419317, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14283881, 14347482, 14347483, 14347484], "trace_timestamp_s": 752.9440000000004, "ttft_s": 0.40219749498646706, "turn_id": 17} +{"actual_output_tokens": 92, "cached_tokens": 21840, "effective_input_length": 22250, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22250, "latency_s": 0.6940577649511397, "output_length": 92, "proxy_request_id": "1399948:25:1553234:957", "request_id": "1399948:25:1553234:957", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1399948", "t_dispatch_unix": 1779815594.2885354, "t_finish_unix": 1779815594.9825933, "t_first_token_unix": 1779815594.4458096, "tpot_s": 0.005895528054519833, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15296678], "trace_timestamp_s": 1085.179, "ttft_s": 0.157272053998895, "turn_id": 25} +{"actual_output_tokens": 117, "cached_tokens": 75856, "effective_input_length": 76017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76017, "latency_s": 1.279216518974863, "output_length": 117, "proxy_request_id": "1268861:18:1553083:956", "request_id": "1268861:18:1553083:956", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1268861", "t_dispatch_unix": 1779815593.8440955, "t_finish_unix": 1779815595.1233118, "t_first_token_unix": 1779815594.1102977, "tpot_s": 0.008730880646657295, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15295378], "trace_timestamp_s": 1084.7290000000003, "ttft_s": 0.2661999029805884, "turn_id": 18} +{"actual_output_tokens": 49, "cached_tokens": 22336, "effective_input_length": 23042, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23042, "latency_s": 0.4955556690110825, "output_length": 49, "proxy_request_id": "1399948:26:1557859:959", "request_id": "1399948:26:1557859:959", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1399948", "t_dispatch_unix": 1779815610.253452, "t_finish_unix": 1779815610.749007, "t_first_token_unix": 1779815610.4700994, "tpot_s": 0.005805414250062313, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15340884], "trace_timestamp_s": 1101.1350000000002, "ttft_s": 0.2166455760016106, "turn_id": 26} +{"actual_output_tokens": 156, "cached_tokens": 23088, "effective_input_length": 24139, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24139, "latency_s": 1.2254249920370057, "output_length": 156, "proxy_request_id": "1399948:27:1559017:960", "request_id": "1399948:27:1559017:960", "request_type": "coder", "requested_output_tokens": 156, "session_id": "1399948", "t_dispatch_unix": 1779815613.9114892, "t_finish_unix": 1779815615.136914, "t_first_token_unix": 1779815614.1896253, "tpot_s": 0.006109974045126188, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15352258], "trace_timestamp_s": 1104.8010000000004, "ttft_s": 0.2781343180104159, "turn_id": 27} +{"actual_output_tokens": 205, "cached_tokens": 24288, "effective_input_length": 24386, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24386, "latency_s": 1.3486518299905583, "output_length": 205, "proxy_request_id": "1399948:28:1560859:961", "request_id": "1399948:28:1560859:961", "request_type": "coder", "requested_output_tokens": 205, "session_id": "1399948", "t_dispatch_unix": 1779815620.0436087, "t_finish_unix": 1779815621.39226, "t_first_token_unix": 1779815620.134481, "tpot_s": 0.006164138456155984, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15369258], "trace_timestamp_s": 1110.929, "ttft_s": 0.09086931397905573, "turn_id": 28} +{"actual_output_tokens": 45, "cached_tokens": 24576, "effective_input_length": 28781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28781, "latency_s": 1.1477231500321068, "output_length": 45, "proxy_request_id": "1399948:29:1571125:963", "request_id": "1399948:29:1571125:963", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779815653.9070477, "t_finish_unix": 1779815655.054771, "t_first_token_unix": 1779815654.7917895, "tpot_s": 0.005971030113869347, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15466683], "trace_timestamp_s": 1144.795, "ttft_s": 0.8847395459888503, "turn_id": 29} +{"actual_output_tokens": 184, "cached_tokens": 131088, "effective_input_length": 131413, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131413, "latency_s": 2.827215099008754, "output_length": 184, "proxy_request_id": "1356885:6:1570780:962", "request_id": "1356885:6:1570780:962", "request_type": "coder", "requested_output_tokens": 184, "session_id": "1356885", "t_dispatch_unix": 1779815652.863595, "t_finish_unix": 1779815655.69081, "t_first_token_unix": 1779815653.5393102, "tpot_s": 0.011755475011028227, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784], "trace_timestamp_s": 1143.7480000000005, "ttft_s": 0.6757127739838324, "turn_id": 6} +{"actual_output_tokens": 89, "cached_tokens": 76128, "effective_input_length": 76963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76963, "latency_s": 1.322115635033697, "output_length": 89, "proxy_request_id": "1268861:19:1578134:966", "request_id": "1268861:19:1578134:966", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1268861", "t_dispatch_unix": 1779815677.7516348, "t_finish_unix": 1779815679.0737505, "t_first_token_unix": 1779815678.3317802, "tpot_s": 0.008428586227554742, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15533477], "trace_timestamp_s": 1168.6400000000003, "ttft_s": 0.5801427679834887, "turn_id": 19} +{"actual_output_tokens": 170, "cached_tokens": 131584, "effective_input_length": 131775, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131775, "latency_s": 2.4185408540070057, "output_length": 170, "proxy_request_id": "1356885:7:1580925:969", "request_id": "1356885:7:1580925:969", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1356885", "t_dispatch_unix": 1779815687.6284635, "t_finish_unix": 1779815690.0470045, "t_first_token_unix": 1779815688.0690854, "tpot_s": 0.011702024893485253, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 15560627], "trace_timestamp_s": 1178.5070000000005, "ttft_s": 0.440618759021163, "turn_id": 7} +{"actual_output_tokens": 84, "cached_tokens": 46416, "effective_input_length": 47660, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47660, "latency_s": 1.0755513879703358, "output_length": 84, "proxy_request_id": "1277428:12:1586139:973", "request_id": "1277428:12:1586139:973", "request_type": "coder", "requested_output_tokens": 84, "session_id": "1277428", "t_dispatch_unix": 1779815705.1265793, "t_finish_unix": 1779815706.20213, "t_first_token_unix": 1779815705.6050558, "tpot_s": 0.007190611650353769, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 15609252, 15609253, 15609254, 15609255], "trace_timestamp_s": 1196.0, "ttft_s": 0.4784747560042888, "turn_id": 12} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 109083, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109083, "latency_s": 39.64252224500524, "output_length": 46, "proxy_request_id": "1270606:4:1578042:965", "request_id": "1270606:4:1578042:965", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1270606", "t_dispatch_unix": 1779815677.5200796, "t_finish_unix": 1779815717.1626012, "t_first_token_unix": 1779815716.670277, "tpot_s": 0.010932251332431205, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 15532602, 15532603, 15532604, 15532605, 15532606, 15532607, 15532608, 15532609, 15532610, 15532611, 15532612, 15532613, 15532614, 15532615, 15532616, 15532617, 15532618, 15532619, 15532620, 15532621, 15532622, 15532623, 15532624, 15532625, 15532626, 15532627, 15532628, 15532629, 15532630, 15532631, 15532632, 15532633, 15532634, 15532635, 15532636, 15532637, 15532638, 15532639, 15532640, 15532641, 15532642, 15532643, 15532644, 15532645, 15532646, 15532647, 15532648, 15532649, 15532650, 15532651, 15532652, 15532653, 15532654, 15532655, 15532656, 15532657, 15532658, 15532659, 15532660, 15532661, 15532662, 15532663, 15532664, 15532665, 15532666, 15532667, 15532668, 15532669, 15532670, 15532671, 15532672, 15532673, 15532674, 15532675, 15532676, 15532677, 15532678, 15532679, 15532680, 15532681, 15532682, 15532683, 15532684, 15532685, 15532686, 15532687, 15532688, 15532689, 15532690, 15532691, 15532692, 15532693, 15532694, 15532695, 15532696, 15532697, 15532698, 15532699, 15532700, 15532701, 15532702, 15532703, 15532704, 15532705, 15532706, 15532707, 15532708, 15532709, 15532710, 15532711, 15532712, 15532713, 15532714, 15532715], "trace_timestamp_s": 1168.3640000000005, "ttft_s": 39.15019606600981, "turn_id": 4} +{"actual_output_tokens": 49, "cached_tokens": 28816, "effective_input_length": 30773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30773, "latency_s": 38.100537904014345, "output_length": 49, "proxy_request_id": "1399948:30:1578524:967", "request_id": "1399948:30:1578524:967", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1399948", "t_dispatch_unix": 1779815679.096431, "t_finish_unix": 1779815717.196969, "t_first_token_unix": 1779815716.6565387, "tpot_s": 0.011253897833133427, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15536842], "trace_timestamp_s": 1169.9860000000008, "ttft_s": 37.56010490801418, "turn_id": 30} +{"actual_output_tokens": 203, "cached_tokens": 30816, "effective_input_length": 30925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30925, "latency_s": 4.465960562985856, "output_length": 203, "proxy_request_id": "1399948:31:1579418:968", "request_id": "1399948:31:1579418:968", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1399948", "t_dispatch_unix": 1779815717.1983829, "t_finish_unix": 1779815721.6643438, "t_first_token_unix": 1779815717.349684, "tpot_s": 0.021358540400950293, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15544685], "trace_timestamp_s": 1173.21, "ttft_s": 0.1512989749899134, "turn_id": 31} +{"actual_output_tokens": 260, "cached_tokens": 109120, "effective_input_length": 111387, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111387, "latency_s": 5.3172369779786095, "output_length": 260, "proxy_request_id": "1270606:5:1581455:971", "request_id": "1270606:5:1581455:971", "request_type": "coder", "requested_output_tokens": 260, "session_id": "1270606", "t_dispatch_unix": 1779815717.1892688, "t_finish_unix": 1779815722.5065062, "t_first_token_unix": 1779815719.0473917, "tpot_s": 0.013354211980719694, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 15532602, 15565484, 15565485, 15565486, 15565487, 15565488, 15565489, 15565490, 15565491, 15565492, 15565493, 15565494, 15565495, 15565496, 15565497, 15565498, 15565499, 15565500, 15565501, 15565502, 15565503, 15565504, 15565505, 15565506, 15565507, 15565508, 15565509, 15565510, 15565511, 15565512, 15565513, 15565514, 15565515, 15565516, 15565517, 15565518, 15565519, 15565520, 15565521, 15565522, 15565523, 15565524, 15565525, 15565526, 15565527, 15565528, 15565529, 15565530, 15565531, 15565532, 15565533, 15565534, 15565535, 15565536, 15565537, 15565538, 15565539, 15565540, 15565541, 15565542, 15565543, 15565544, 15565545, 15565546, 15565547, 15565548, 15565549, 15565550, 15565551, 15565552, 15565553, 15565554, 15565555, 15565556, 15565557, 15565558, 15565559, 15565560, 15565561, 15565562, 15565563, 15565564, 15565565, 15565566, 15565567, 15565568, 15565569, 15565570, 15565571, 15565572, 15565573, 15565574, 15565575, 15565576, 15565577, 15565578, 15565579, 15565580, 15565581, 15565582, 15565583, 15565584, 15565585, 15565586, 15565587, 15565588, 15565589, 15565590, 15565591, 15565592, 15565593, 15565594, 15565595, 15565596, 15565597, 15565598, 15565599, 15565600], "trace_timestamp_s": 1180.0900000000001, "ttft_s": 1.85811983095482, "turn_id": 5} +{"actual_output_tokens": 302, "cached_tokens": 72288, "effective_input_length": 75249, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75249, "latency_s": 4.205916563048959, "output_length": 302, "proxy_request_id": "1294611:15:1590202:975", "request_id": "1294611:15:1590202:975", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1294611", "t_dispatch_unix": 1779815718.6553087, "t_finish_unix": 1779815722.861225, "t_first_token_unix": 1779815720.1922355, "tpot_s": 0.00886609767771719, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15647388, 15647389, 15647390, 15647391, 15647392, 15647393, 15647394, 15647395, 15647396, 15647397, 15647398, 15647399, 15647400, 15647401, 15647402, 15647403, 15647404, 15647405, 15647406, 15647407, 15647408, 15647409, 15647410], "trace_timestamp_s": 1209.5380000000005, "ttft_s": 1.5369247420458123, "turn_id": 15} +{"actual_output_tokens": 154, "cached_tokens": 31120, "effective_input_length": 31231, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31231, "latency_s": 1.4968523179995827, "output_length": 154, "proxy_request_id": "1399948:32:1581424:970", "request_id": "1399948:32:1581424:970", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1399948", "t_dispatch_unix": 1779815721.6659055, "t_finish_unix": 1779815723.1627579, "t_first_token_unix": 1779815721.7921207, "tpot_s": 0.008956762013220368, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283], "trace_timestamp_s": 1179.964, "ttft_s": 0.12621331895934418, "turn_id": 32} +{"actual_output_tokens": 102, "cached_tokens": 31376, "effective_input_length": 31445, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31445, "latency_s": 0.7401573699899018, "output_length": 102, "proxy_request_id": "1399948:33:1583165:972", "request_id": "1399948:33:1583165:972", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1399948", "t_dispatch_unix": 1779815723.1643462, "t_finish_unix": 1779815723.9045033, "t_first_token_unix": 1779815723.2625303, "tpot_s": 0.006353722217880042, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15583196], "trace_timestamp_s": 1185.8700000000008, "ttft_s": 0.09818213200196624, "turn_id": 33} +{"actual_output_tokens": 136, "cached_tokens": 31536, "effective_input_length": 32143, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32143, "latency_s": 1.1006268770433962, "output_length": 136, "proxy_request_id": "1399948:34:1586232:974", "request_id": "1399948:34:1586232:974", "request_type": "coder", "requested_output_tokens": 136, "session_id": "1399948", "t_dispatch_unix": 1779815723.9062433, "t_finish_unix": 1779815725.0068705, "t_first_token_unix": 1779815724.121422, "tpot_s": 0.0065570625480850814, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15610086], "trace_timestamp_s": 1196.362, "ttft_s": 0.21517631702590734, "turn_id": 34} +{"actual_output_tokens": 202, "cached_tokens": 47728, "effective_input_length": 49316, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49316, "latency_s": 2.1633985270163976, "output_length": 202, "proxy_request_id": "1277428:13:1593499:976", "request_id": "1277428:13:1593499:976", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1277428", "t_dispatch_unix": 1779815730.301263, "t_finish_unix": 1779815732.4646614, "t_first_token_unix": 1779815730.9640906, "tpot_s": 0.007464266721268106, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 15609252, 15609253, 15609254, 15678100, 15678101, 15678102, 15678103], "trace_timestamp_s": 1221.1850000000004, "ttft_s": 0.6628258950076997, "turn_id": 13} +{"actual_output_tokens": 127, "cached_tokens": 75536, "effective_input_length": 75584, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75584, "latency_s": 1.2374656540341675, "output_length": 127, "proxy_request_id": "1294611:15:1594038:977", "request_id": "1294611:15:1594038:977", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1294611", "t_dispatch_unix": 1779815732.0195572, "t_finish_unix": 1779815733.2570226, "t_first_token_unix": 1779815732.1679637, "tpot_s": 0.008641412476122025, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15684252, 15684253, 15684254, 15684255, 15684256, 15684257, 15684258, 15684259, 15684260, 15684261, 15684262, 15684263, 15684264, 15684265, 15684266, 15684267, 15684268, 15684269, 15684270, 15684271, 15684272, 15684273, 15684274, 15684275], "trace_timestamp_s": 1222.902, "ttft_s": 0.1484044740209356, "turn_id": 15} +{"actual_output_tokens": 63, "cached_tokens": 77040, "effective_input_length": 77218, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77218, "latency_s": 0.7822599270148203, "output_length": 63, "proxy_request_id": "1268861:20:1595141:978", "request_id": "1268861:20:1595141:978", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1268861", "t_dispatch_unix": 1779815735.9975243, "t_finish_unix": 1779815736.779784, "t_first_token_unix": 1779815736.265958, "tpot_s": 0.00828345948379607, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15693702], "trace_timestamp_s": 1226.8830000000007, "ttft_s": 0.26843143004225567, "turn_id": 20} +{"actual_output_tokens": 153, "cached_tokens": 32272, "effective_input_length": 33533, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33533, "latency_s": 1.4123144620098174, "output_length": 153, "proxy_request_id": "1399948:35:1602048:980", "request_id": "1399948:35:1602048:980", "request_type": "coder", "requested_output_tokens": 153, "session_id": "1399948", "t_dispatch_unix": 1779815759.3745334, "t_finish_unix": 1779815760.7868476, "t_first_token_unix": 1779815759.7927938, "tpot_s": 0.006538194046266941, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15759381], "trace_timestamp_s": 1250.2640000000001, "ttft_s": 0.4182590979617089, "turn_id": 35} +{"actual_output_tokens": 365, "cached_tokens": 89152, "effective_input_length": 90656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90656, "latency_s": 6.258058633015025, "output_length": 365, "proxy_request_id": "1253804:9:1605110:981", "request_id": "1253804:9:1605110:981", "request_type": "coder", "requested_output_tokens": 365, "session_id": "1253804", "t_dispatch_unix": 1779815769.3581388, "t_finish_unix": 1779815775.6161976, "t_first_token_unix": 1779815770.3542347, "tpot_s": 0.014455121618044398, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15786880], "trace_timestamp_s": 1260.2450000000008, "ttft_s": 0.9960936430143192, "turn_id": 9} +{"actual_output_tokens": 4115, "cached_tokens": 75696, "effective_input_length": 75716, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75716, "latency_s": 40.9476210239809, "output_length": 4115, "proxy_request_id": "1294611:15:1596163:979", "request_id": "1294611:15:1596163:979", "request_type": "coder", "requested_output_tokens": 4115, "session_id": "1294611", "t_dispatch_unix": 1779815739.1812348, "t_finish_unix": 1779815780.1288562, "t_first_token_unix": 1779815739.3215828, "tpot_s": 0.009919037629072484, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15703736, 15703737, 15703738, 15703739, 15703740, 15703741, 15703742, 15703743, 15703744, 15703745, 15703746, 15703747, 15703748, 15703749, 15703750, 15703751, 15703752, 15703753, 15703754, 15703755, 15703756, 15703757, 15703758, 15703759], "trace_timestamp_s": 1230.063, "ttft_s": 0.14034593699034303, "turn_id": 15} +{"actual_output_tokens": 178, "cached_tokens": 77280, "effective_input_length": 77293, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77293, "latency_s": 1.707006343989633, "output_length": 178, "proxy_request_id": "1268861:21:1609831:982", "request_id": "1268861:21:1609831:982", "request_type": "coder", "requested_output_tokens": 178, "session_id": "1268861", "t_dispatch_unix": 1779815785.101704, "t_finish_unix": 1779815786.8087096, "t_first_token_unix": 1779815785.2324975, "tpot_s": 0.008903731237491856, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363], "trace_timestamp_s": 1275.9880000000003, "ttft_s": 0.13079179596388713, "turn_id": 21} +{"actual_output_tokens": 19, "cached_tokens": 91008, "effective_input_length": 91103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91103, "latency_s": 0.31107803602935746, "output_length": 19, "proxy_request_id": "1253804:10:1611505:983", "request_id": "1253804:10:1611505:983", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1253804", "t_dispatch_unix": 1779815790.5816805, "t_finish_unix": 1779815790.8927581, "t_first_token_unix": 1779815790.779079, "tpot_s": 0.006301664278402718, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080], "trace_timestamp_s": 1281.4660000000003, "ttft_s": 0.19739640201441944, "turn_id": 10} +{"actual_output_tokens": 83, "cached_tokens": 33680, "effective_input_length": 34773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34773, "latency_s": 0.8960944029968232, "output_length": 83, "proxy_request_id": "1399948:36:1612467:984", "request_id": "1399948:36:1612467:984", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1399948", "t_dispatch_unix": 1779815793.6936674, "t_finish_unix": 1779815794.5897613, "t_first_token_unix": 1779815794.059786, "tpot_s": 0.006459907829483244, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946], "trace_timestamp_s": 1284.5810000000001, "ttft_s": 0.36611604801146314, "turn_id": 36} +{"actual_output_tokens": 212, "cached_tokens": 91120, "effective_input_length": 91131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91131, "latency_s": 2.18626793398289, "output_length": 212, "proxy_request_id": "1253804:11:1613030:985", "request_id": "1253804:11:1613030:985", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1253804", "t_dispatch_unix": 1779815795.9157417, "t_finish_unix": 1779815798.1020093, "t_first_token_unix": 1779815796.0612707, "tpot_s": 0.009670539047365999, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080], "trace_timestamp_s": 1286.8030000000008, "ttft_s": 0.14552692498546094, "turn_id": 11} +{"actual_output_tokens": 168, "cached_tokens": 34848, "effective_input_length": 35308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35308, "latency_s": 1.3493954600417055, "output_length": 168, "proxy_request_id": "1399948:37:1613628:986", "request_id": "1399948:37:1613628:986", "request_type": "coder", "requested_output_tokens": 168, "session_id": "1399948", "t_dispatch_unix": 1779815797.768808, "t_finish_unix": 1779815799.1182032, "t_first_token_unix": 1779815798.0037906, "tpot_s": 0.006671657341373471, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752], "trace_timestamp_s": 1288.6590000000006, "ttft_s": 0.2349803730030544, "turn_id": 37} +{"actual_output_tokens": 79, "cached_tokens": 35472, "effective_input_length": 35581, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35581, "latency_s": 0.6283713719458319, "output_length": 79, "proxy_request_id": "1399948:38:1616890:987", "request_id": "1399948:38:1616890:987", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1399948", "t_dispatch_unix": 1779815808.957532, "t_finish_unix": 1779815809.5859034, "t_first_token_unix": 1779815809.0771916, "tpot_s": 0.006518316896966634, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15894792], "trace_timestamp_s": 1299.8360000000002, "ttft_s": 0.11965765798231587, "turn_id": 38} +{"actual_output_tokens": 68, "cached_tokens": 35648, "effective_input_length": 35682, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35682, "latency_s": 0.5145654199877754, "output_length": 68, "proxy_request_id": "1399948:39:1618250:989", "request_id": "1399948:39:1618250:989", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1399948", "t_dispatch_unix": 1779815813.6444674, "t_finish_unix": 1779815814.1590319, "t_first_token_unix": 1779815813.7259889, "tpot_s": 0.006459540537204037, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15907502], "trace_timestamp_s": 1304.5330000000004, "ttft_s": 0.08152005897136405, "turn_id": 39} +{"actual_output_tokens": 57, "cached_tokens": 35744, "effective_input_length": 35958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35958, "latency_s": 0.5021501600276679, "output_length": 57, "proxy_request_id": "1399948:40:1620970:991", "request_id": "1399948:40:1620970:991", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1399948", "t_dispatch_unix": 1779815822.6342428, "t_finish_unix": 1779815823.136393, "t_first_token_unix": 1779815822.779264, "tpot_s": 0.006371903571042432, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 15932234], "trace_timestamp_s": 1313.5230000000001, "ttft_s": 0.14501891302643344, "turn_id": 40} +{"actual_output_tokens": 141, "cached_tokens": 77456, "effective_input_length": 78439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78439, "latency_s": 1.9700575720053166, "output_length": 141, "proxy_request_id": "1268861:22:1620830:990", "request_id": "1268861:22:1620830:990", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1268861", "t_dispatch_unix": 1779815822.1647975, "t_finish_unix": 1779815824.1348543, "t_first_token_unix": 1779815822.8835356, "tpot_s": 0.008936105999912668, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 15930461], "trace_timestamp_s": 1313.0500000000002, "ttft_s": 0.7187369160237722, "turn_id": 22} +{"actual_output_tokens": 35, "cached_tokens": 91328, "effective_input_length": 91389, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91389, "latency_s": 0.4793341630138457, "output_length": 35, "proxy_request_id": "1253804:12:1621957:992", "request_id": "1253804:12:1621957:992", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779815826.0740047, "t_finish_unix": 1779815826.5533388, "t_first_token_unix": 1779815826.284455, "tpot_s": 0.00790133508716655, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810], "trace_timestamp_s": 1316.96, "ttft_s": 0.2104482750291936, "turn_id": 12} +{"actual_output_tokens": 100, "cached_tokens": 36000, "effective_input_length": 36168, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36168, "latency_s": 0.8002029699855484, "output_length": 100, "proxy_request_id": "1399948:41:1624143:993", "request_id": "1399948:41:1624143:993", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1399948", "t_dispatch_unix": 1779815833.4455628, "t_finish_unix": 1779815834.2457657, "t_first_token_unix": 1779815833.588023, "tpot_s": 0.006640977232077281, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 15963281], "trace_timestamp_s": 1324.3290000000006, "ttft_s": 0.14245789701817557, "turn_id": 41} +{"actual_output_tokens": 105, "cached_tokens": 91408, "effective_input_length": 91440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91440, "latency_s": 1.1318699899711646, "output_length": 105, "proxy_request_id": "1253804:13:1624613:994", "request_id": "1253804:13:1624613:994", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1253804", "t_dispatch_unix": 1779815835.013167, "t_finish_unix": 1779815836.1450367, "t_first_token_unix": 1779815835.1672137, "tpot_s": 0.00939927570177063, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810], "trace_timestamp_s": 1325.9010000000007, "ttft_s": 0.1540444539859891, "turn_id": 13} +{"actual_output_tokens": 85, "cached_tokens": 91536, "effective_input_length": 92367, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92367, "latency_s": 1.4518897520028986, "output_length": 85, "proxy_request_id": "1253804:14:1626575:995", "request_id": "1253804:14:1626575:995", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1253804", "t_dispatch_unix": 1779815841.529144, "t_finish_unix": 1779815842.9810328, "t_first_token_unix": 1779815842.1963491, "tpot_s": 0.009338224487562132, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 15986054], "trace_timestamp_s": 1332.411, "ttft_s": 0.6672037850366905, "turn_id": 14} +{"actual_output_tokens": 43, "cached_tokens": 92448, "effective_input_length": 92701, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92701, "latency_s": 0.6780820410349406, "output_length": 43, "proxy_request_id": "1253804:15:1628485:997", "request_id": "1253804:15:1628485:997", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1253804", "t_dispatch_unix": 1779815847.8519258, "t_finish_unix": 1779815848.5300076, "t_first_token_unix": 1779815848.1723187, "tpot_s": 0.008510064429304163, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16004240], "trace_timestamp_s": 1338.7400000000007, "ttft_s": 0.3203912029857747, "turn_id": 15} +{"actual_output_tokens": 175, "cached_tokens": 36256, "effective_input_length": 36984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36984, "latency_s": 1.493185587984044, "output_length": 175, "proxy_request_id": "1399948:42:1628429:996", "request_id": "1399948:42:1628429:996", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1399948", "t_dispatch_unix": 1779815847.6360745, "t_finish_unix": 1779815849.1292596, "t_first_token_unix": 1779815847.937511, "tpot_s": 0.00684715178159558, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16003843], "trace_timestamp_s": 1338.5230000000001, "ttft_s": 0.30143496999517083, "turn_id": 42} +{"actual_output_tokens": 74, "cached_tokens": 78576, "effective_input_length": 79693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79693, "latency_s": 1.3529239479685202, "output_length": 74, "proxy_request_id": "1268861:23:1631587:1001", "request_id": "1268861:23:1631587:1001", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1268861", "t_dispatch_unix": 1779815857.9029849, "t_finish_unix": 1779815859.2559085, "t_first_token_unix": 1779815858.63291, "tpot_s": 0.008526882753956246, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16034091], "trace_timestamp_s": 1348.79, "ttft_s": 0.7299223669688217, "turn_id": 23} +{"actual_output_tokens": 65, "cached_tokens": 4416, "effective_input_length": 79074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79074, "latency_s": 22.411790386016946, "output_length": 65, "proxy_request_id": "1388507:3:1629072:998", "request_id": "1388507:3:1629072:998", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1388507", "t_dispatch_unix": 1779815849.943225, "t_finish_unix": 1779815872.3550153, "t_first_token_unix": 1779815871.2299762, "tpot_s": 0.017572642812410777, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728, 14709792, 14709793, 14709794, 14709795, 14709796, 14709797, 14709798, 16009495, 16009496, 16009497, 16009498, 16009499, 16009500, 16009501], "trace_timestamp_s": 1340.8290000000006, "ttft_s": 21.286748744023498, "turn_id": 3} +{"actual_output_tokens": 102, "cached_tokens": 92736, "effective_input_length": 92953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92953, "latency_s": 20.988624418969266, "output_length": 102, "proxy_request_id": "1253804:16:1629713:999", "request_id": "1253804:16:1629713:999", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1253804", "t_dispatch_unix": 1779815851.9042382, "t_finish_unix": 1779815872.8928628, "t_first_token_unix": 1779815871.247286, "tpot_s": 0.016290512346860832, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597], "trace_timestamp_s": 1342.79, "ttft_s": 19.343045767978765, "turn_id": 16} +{"actual_output_tokens": 81, "cached_tokens": 93040, "effective_input_length": 93219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93219, "latency_s": 1.4322683599893935, "output_length": 81, "proxy_request_id": "1253804:17:1631602:1002", "request_id": "1253804:17:1631602:1002", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253804", "t_dispatch_unix": 1779815872.896836, "t_finish_unix": 1779815874.3291047, "t_first_token_unix": 1779815873.2089963, "tpot_s": 0.013998168912803522, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16034156], "trace_timestamp_s": 1348.8640000000005, "ttft_s": 0.3121561949956231, "turn_id": 17} +{"actual_output_tokens": 93, "cached_tokens": 93296, "effective_input_length": 93509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93509, "latency_s": 1.601427756017074, "output_length": 93, "proxy_request_id": "1253804:18:1633257:1003", "request_id": "1253804:18:1633257:1003", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1253804", "t_dispatch_unix": 1779815874.333172, "t_finish_unix": 1779815875.9345996, "t_first_token_unix": 1779815874.6468472, "tpot_s": 0.013994538543477614, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428], "trace_timestamp_s": 1354.3140000000003, "ttft_s": 0.31367366801714525, "turn_id": 18} +{"actual_output_tokens": 298, "cached_tokens": 79824, "effective_input_length": 79890, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79890, "latency_s": 19.70349099097075, "output_length": 298, "proxy_request_id": "1294611:15:1631116:1000", "request_id": "1294611:15:1631116:1000", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1294611", "t_dispatch_unix": 1779815856.4888039, "t_finish_unix": 1779815876.1922941, "t_first_token_unix": 1779815871.2408392, "tpot_s": 0.016668336346795664, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16029362, 16029363, 16029364, 16029365, 16029366, 16029367, 16029368, 16029369, 16029370, 16029371, 16029372, 16029373, 16029374, 16029375, 16029376, 16029377, 16029378, 16029379, 16029380, 16029381, 16029382, 16029383, 16029384, 16029385, 16029386, 16029387, 16029388, 16029389, 16029390, 16029391, 16029392, 16029393, 16029394], "trace_timestamp_s": 1347.3670000000002, "ttft_s": 14.752033345983364, "turn_id": 15} +{"actual_output_tokens": 65, "cached_tokens": 80176, "effective_input_length": 80221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80221, "latency_s": 1.0802482519648038, "output_length": 65, "proxy_request_id": "1294611:15:1634779:1004", "request_id": "1294611:15:1634779:1004", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1294611", "t_dispatch_unix": 1779815876.1976347, "t_finish_unix": 1779815877.277883, "t_first_token_unix": 1779815876.3797896, "tpot_s": 0.0140291166408133, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16063555, 15647389, 15647390, 15647391, 15647392, 15647393, 15647394, 15647395, 15647396, 15647397, 15647398, 15647399, 15647400, 15647401, 15647402, 15647403, 15647404, 15647405, 15647406, 15647407, 15647408, 15647409, 15647410, 16063556, 16063557, 16063558, 16063559, 16063560, 16063561, 16063562, 16063563, 16063564, 16063565], "trace_timestamp_s": 1359.4810000000007, "ttft_s": 0.1821524479892105, "turn_id": 15} +{"actual_output_tokens": 399, "cached_tokens": 93600, "effective_input_length": 93664, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93664, "latency_s": 6.364845155039802, "output_length": 399, "proxy_request_id": "1253804:19:1634903:1005", "request_id": "1253804:19:1634903:1005", "request_type": "coder", "requested_output_tokens": 399, "session_id": "1253804", "t_dispatch_unix": 1779815875.9383194, "t_finish_unix": 1779815882.303165, "t_first_token_unix": 1779815876.1598382, "tpot_s": 0.015434563474819748, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428], "trace_timestamp_s": 1359.8590000000004, "ttft_s": 0.22151659801602364, "turn_id": 19} +{"actual_output_tokens": 87, "cached_tokens": 94048, "effective_input_length": 94111, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 94111, "latency_s": 1.4399431479978375, "output_length": 87, "proxy_request_id": "1253804:20:1638889:1007", "request_id": "1253804:20:1638889:1007", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1253804", "t_dispatch_unix": 1779815882.307124, "t_finish_unix": 1779815883.7470677, "t_first_token_unix": 1779815882.526114, "tpot_s": 0.014192789709087201, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467], "trace_timestamp_s": 1373.0350000000008, "ttft_s": 0.2189877670025453, "turn_id": 20} +{"actual_output_tokens": 285, "cached_tokens": 0, "effective_input_length": 9804, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9804, "latency_s": 2.3016563419951126, "output_length": 285, "proxy_request_id": "1258908:2:1639411:1008", "request_id": "1258908:2:1639411:1008", "request_type": "coder", "requested_output_tokens": 285, "session_id": "1258908", "t_dispatch_unix": 1779815883.9587321, "t_finish_unix": 1779815886.2603881, "t_first_token_unix": 1779815884.715344, "tpot_s": 0.00543945348960131, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 16107627, 16107628, 16107629, 16107630, 16107631], "trace_timestamp_s": 1374.8490000000002, "ttft_s": 0.7566107820020989, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 79760, "effective_input_length": 80019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80019, "latency_s": 0.73229870502837, "output_length": 55, "proxy_request_id": "1268861:24:1643502:1011", "request_id": "1268861:24:1643502:1011", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1268861", "t_dispatch_unix": 1779815897.7752159, "t_finish_unix": 1779815898.5075147, "t_first_token_unix": 1779815898.063736, "tpot_s": 0.008212835721982023, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16147319, 16147320], "trace_timestamp_s": 1388.6640000000007, "ttft_s": 0.28851869102800265, "turn_id": 24} +{"actual_output_tokens": 115, "cached_tokens": 37152, "effective_input_length": 38102, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38102, "latency_s": 1.1509156109532341, "output_length": 115, "proxy_request_id": "1399948:43:1643413:1010", "request_id": "1399948:43:1643413:1010", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1399948", "t_dispatch_unix": 1779815897.4335096, "t_finish_unix": 1779815898.584425, "t_first_token_unix": 1779815897.8145442, "tpot_s": 0.006751138701618306, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16146472], "trace_timestamp_s": 1388.3220000000001, "ttft_s": 0.3810331349959597, "turn_id": 43} +{"actual_output_tokens": 219, "cached_tokens": 38208, "effective_input_length": 38308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38308, "latency_s": 1.6229121119831689, "output_length": 219, "proxy_request_id": "1399948:44:1644970:1012", "request_id": "1399948:44:1644970:1012", "request_type": "coder", "requested_output_tokens": 219, "session_id": "1399948", "t_dispatch_unix": 1779815902.557174, "t_finish_unix": 1779815904.180086, "t_first_token_unix": 1779815902.6806087, "tpot_s": 0.006877213820906937, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765], "trace_timestamp_s": 1393.4470000000001, "ttft_s": 0.12343236902961507, "turn_id": 44} +{"actual_output_tokens": 1400, "cached_tokens": 94192, "effective_input_length": 94269, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 94269, "latency_s": 21.202223863976542, "output_length": 1400, "proxy_request_id": "1253804:21:1640487:1009", "request_id": "1253804:21:1640487:1009", "request_type": "coder", "requested_output_tokens": 1400, "session_id": "1253804", "t_dispatch_unix": 1779815887.4345913, "t_finish_unix": 1779815908.6368148, "t_first_token_unix": 1779815887.6637518, "tpot_s": 0.014991295701227323, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16119050], "trace_timestamp_s": 1378.3230000000003, "ttft_s": 0.22915916697820649, "turn_id": 21} +{"actual_output_tokens": 2429, "cached_tokens": 80272, "effective_input_length": 80717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80717, "latency_s": 33.532627450011205, "output_length": 2429, "proxy_request_id": "1294611:15:1636645:1006", "request_id": "1294611:15:1636645:1006", "request_type": "coder", "requested_output_tokens": 2429, "session_id": "1294611", "t_dispatch_unix": 1779815877.289012, "t_finish_unix": 1779815910.8216398, "t_first_token_unix": 1779815877.7216818, "tpot_s": 0.013632467100916498, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16080826, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859], "trace_timestamp_s": 1365.5200000000004, "ttft_s": 0.43266772298375145, "turn_id": 15} +{"actual_output_tokens": 54, "cached_tokens": 95664, "effective_input_length": 95715, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95715, "latency_s": 0.6906824000179768, "output_length": 54, "proxy_request_id": "1253804:22:1650001:1013", "request_id": "1253804:22:1650001:1013", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1253804", "t_dispatch_unix": 1779815919.1385355, "t_finish_unix": 1779815919.829217, "t_first_token_unix": 1779815919.3572085, "tpot_s": 0.008900429378044, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630], "trace_timestamp_s": 1410.0170000000007, "ttft_s": 0.21866978099569678, "turn_id": 22} +{"actual_output_tokens": 87, "cached_tokens": 38512, "effective_input_length": 38758, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38758, "latency_s": 0.7375993009773083, "output_length": 87, "proxy_request_id": "1399948:45:1650679:1014", "request_id": "1399948:45:1650679:1014", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1399948", "t_dispatch_unix": 1779815921.599017, "t_finish_unix": 1779815922.3366156, "t_first_token_unix": 1779815921.7537634, "tpot_s": 0.006774029023078985, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16213486], "trace_timestamp_s": 1412.487, "ttft_s": 0.15474450401961803, "turn_id": 45} +{"actual_output_tokens": 45, "cached_tokens": 95760, "effective_input_length": 96944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96944, "latency_s": 1.2503486189525574, "output_length": 45, "proxy_request_id": "1253804:23:1651448:1015", "request_id": "1253804:23:1651448:1015", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779815923.8908002, "t_finish_unix": 1779815925.1411483, "t_first_token_unix": 1779815924.7545006, "tpot_s": 0.008781739546314137, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16220458], "trace_timestamp_s": 1414.777, "ttft_s": 0.8636980469455011, "turn_id": 23} +{"actual_output_tokens": 123, "cached_tokens": 38832, "effective_input_length": 39837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39837, "latency_s": 1.2382003979873843, "output_length": 123, "proxy_request_id": "1399948:46:1658183:1018", "request_id": "1399948:46:1658183:1018", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1399948", "t_dispatch_unix": 1779815946.7341657, "t_finish_unix": 1779815947.972366, "t_first_token_unix": 1779815947.1300933, "tpot_s": 0.006901520458966127, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828], "trace_timestamp_s": 1437.6230000000005, "ttft_s": 0.3959261800046079, "turn_id": 46} +{"actual_output_tokens": 45, "cached_tokens": 96976, "effective_input_length": 97769, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97769, "latency_s": 1.299825611000415, "output_length": 45, "proxy_request_id": "1253804:24:1659020:1019", "request_id": "1253804:24:1659020:1019", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779815949.6234596, "t_finish_unix": 1779815950.923285, "t_first_token_unix": 1779815950.3253493, "tpot_s": 0.013580330681923608, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091], "trace_timestamp_s": 1440.5100000000002, "ttft_s": 0.7018868519808166, "turn_id": 24} +{"actual_output_tokens": 2557, "cached_tokens": 80064, "effective_input_length": 80406, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80406, "latency_s": 24.664079802983906, "output_length": 2557, "proxy_request_id": "1268861:25:1653400:1016", "request_id": "1268861:25:1653400:1016", "request_type": "coder", "requested_output_tokens": 2557, "session_id": "1268861", "t_dispatch_unix": 1779815930.3312106, "t_finish_unix": 1779815954.9952898, "t_first_token_unix": 1779815930.7615612, "tpot_s": 0.00948089264396648, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16147319, 16238847, 16238848], "trace_timestamp_s": 1421.2150000000001, "ttft_s": 0.4303481740062125, "turn_id": 25} +{"actual_output_tokens": 45, "cached_tokens": 97808, "effective_input_length": 98187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98187, "latency_s": 1.1170624570222571, "output_length": 45, "proxy_request_id": "1253804:25:1662273:1020", "request_id": "1253804:25:1662273:1020", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779815960.4862492, "t_finish_unix": 1779815961.6033115, "t_first_token_unix": 1779815960.9996731, "tpot_s": 0.01371160154469015, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784], "trace_timestamp_s": 1451.3740000000007, "ttft_s": 0.5134208270465024, "turn_id": 25} +{"actual_output_tokens": 63, "cached_tokens": 39952, "effective_input_length": 40261, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40261, "latency_s": 0.6450851389672607, "output_length": 63, "proxy_request_id": "1399948:47:1664702:1022", "request_id": "1399948:47:1664702:1022", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779815969.095533, "t_finish_unix": 1779815969.7406178, "t_first_token_unix": 1779815969.329578, "tpot_s": 0.006625168112805113, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16343814], "trace_timestamp_s": 1459.9850000000006, "ttft_s": 0.23404290800681338, "turn_id": 47} +{"actual_output_tokens": 2280, "cached_tokens": 83136, "effective_input_length": 83204, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83204, "latency_s": 26.103931427001953, "output_length": 2280, "proxy_request_id": "1294611:15:1657992:1017", "request_id": "1294611:15:1657992:1017", "request_type": "coder", "requested_output_tokens": 2280, "session_id": "1294611", "t_dispatch_unix": 1779815946.2510948, "t_finish_unix": 1779815972.3550253, "t_first_token_unix": 1779815946.4642925, "tpot_s": 0.01136042276305809, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16281887, 16281888, 16281889, 16281890, 16281891, 16281892, 16281893, 16281894, 16281895, 16281896, 16281897, 16281898, 16281899, 16281900, 16281901, 16281902, 16281903, 16281904, 16281905, 16281906, 16281907, 16281908, 16281909, 16281910, 16281911, 16281912, 16281913, 16281914, 16281915, 16281916, 16281917, 16281918, 16281919, 16281920, 16281921, 16281922, 16281923, 16281924, 16281925], "trace_timestamp_s": 1437.1310000000003, "ttft_s": 0.21319524198770523, "turn_id": 15} +{"actual_output_tokens": 152, "cached_tokens": 131936, "effective_input_length": 132537, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 132537, "latency_s": 2.4666686220443808, "output_length": 152, "proxy_request_id": "1356885:8:1665690:1023", "request_id": "1356885:8:1665690:1023", "request_type": "coder", "requested_output_tokens": 152, "session_id": "1356885", "t_dispatch_unix": 1779815972.2990181, "t_finish_unix": 1779815974.7656863, "t_first_token_unix": 1779815973.0096123, "tpot_s": 0.011627925781530038, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835], "trace_timestamp_s": 1463.1860000000006, "ttft_s": 0.7105916430009529, "turn_id": 8} +{"actual_output_tokens": 197, "cached_tokens": 40320, "effective_input_length": 40343, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40343, "latency_s": 1.4604145449702628, "output_length": 197, "proxy_request_id": "1399948:48:1666394:1024", "request_id": "1399948:48:1666394:1024", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1399948", "t_dispatch_unix": 1779815974.725614, "t_finish_unix": 1779815976.1860287, "t_first_token_unix": 1779815974.8156242, "tpot_s": 0.006990193357282527, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763], "trace_timestamp_s": 1465.6150000000007, "ttft_s": 0.09000814595492557, "turn_id": 48} +{"actual_output_tokens": 154, "cached_tokens": 40528, "effective_input_length": 40642, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40642, "latency_s": 1.1968901489744894, "output_length": 154, "proxy_request_id": "1399948:49:1668825:1025", "request_id": "1399948:49:1668825:1025", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1399948", "t_dispatch_unix": 1779815983.2880704, "t_finish_unix": 1779815984.48496, "t_first_token_unix": 1779815983.4227085, "tpot_s": 0.006941146535716732, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16382119], "trace_timestamp_s": 1474.1770000000006, "ttft_s": 0.1346366570214741, "turn_id": 49} +{"actual_output_tokens": 169, "cached_tokens": 85472, "effective_input_length": 85542, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85542, "latency_s": 2.763244304980617, "output_length": 169, "proxy_request_id": "1294611:15:1673197:1026", "request_id": "1294611:15:1673197:1026", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1294611", "t_dispatch_unix": 1779815998.498077, "t_finish_unix": 1779816001.261321, "t_first_token_unix": 1779815998.6864474, "tpot_s": 0.01532422871414816, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16425840, 16425841, 16425842, 16425843, 16425844, 16425845, 16425846, 16425847, 16425848, 16425849, 16425850, 16425851, 16425852, 16425853, 16425854, 16425855, 16425856, 16425857, 16425858, 16425859, 16425860, 16425861, 16425862, 16425863, 16425864, 16425865, 16425866, 16425867, 16425868, 16425869, 16425870, 16425871, 16425872, 16425873, 16425874, 16425875, 16425876, 16425877, 16425878, 16425879, 16425880, 16425881, 16425882, 16425883], "trace_timestamp_s": 1489.3780000000006, "ttft_s": 0.18836790102068335, "turn_id": 15} +{"actual_output_tokens": 3441, "cached_tokens": 98224, "effective_input_length": 98254, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98254, "latency_s": 39.36305496603018, "output_length": 3441, "proxy_request_id": "1253804:26:1663639:1021", "request_id": "1253804:26:1663639:1021", "request_type": "coder", "requested_output_tokens": 3441, "session_id": "1253804", "t_dispatch_unix": 1779815965.3203776, "t_finish_unix": 1779816004.683432, "t_first_token_unix": 1779815965.517894, "tpot_s": 0.011385254402625304, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784], "trace_timestamp_s": 1456.2080000000005, "ttft_s": 0.1975136729888618, "turn_id": 26} +{"actual_output_tokens": 270, "cached_tokens": 85696, "effective_input_length": 85722, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85722, "latency_s": 2.704360106959939, "output_length": 270, "proxy_request_id": "1294611:15:1676489:1027", "request_id": "1294611:15:1676489:1027", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1294611", "t_dispatch_unix": 1779816009.8826656, "t_finish_unix": 1779816012.5870256, "t_first_token_unix": 1779816010.037966, "tpot_s": 0.009474940289878268, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16456400, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859, 16456401, 16456402, 16456403, 16456404, 16456405, 16456406, 16456407, 16456408, 16456409, 16456410], "trace_timestamp_s": 1500.7660000000005, "ttft_s": 0.15529822697862983, "turn_id": 15} +{"actual_output_tokens": 500, "cached_tokens": 40784, "effective_input_length": 42648, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42648, "latency_s": 4.218544245988596, "output_length": 500, "proxy_request_id": "1399948:50:1677482:1028", "request_id": "1399948:50:1677482:1028", "request_type": "coder", "requested_output_tokens": 500, "session_id": "1399948", "t_dispatch_unix": 1779816013.142931, "t_finish_unix": 1779816017.361475, "t_first_token_unix": 1779816013.748375, "tpot_s": 0.0072401003286388065, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16467283], "trace_timestamp_s": 1504.031, "ttft_s": 0.6054418639978394, "turn_id": 50} +{"actual_output_tokens": 290, "cached_tokens": 85984, "effective_input_length": 86602, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86602, "latency_s": 3.2118564199772663, "output_length": 290, "proxy_request_id": "1294611:15:1679070:1029", "request_id": "1294611:15:1679070:1029", "request_type": "coder", "requested_output_tokens": 290, "session_id": "1294611", "t_dispatch_unix": 1779816018.5648973, "t_finish_unix": 1779816021.7767532, "t_first_token_unix": 1779816019.0333626, "tpot_s": 0.00949182766441346, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16482842, 15703737, 15703738, 15703739, 15703740, 15703741, 15703742, 15703743, 15703744, 15703745, 15703746, 15703747, 15703748, 15703749, 15703750, 15703751, 15703752, 15703753, 15703754, 15703755, 15703756, 15703757, 15703758, 15703759, 16482843, 16482844, 16482845, 16482846, 16482847, 16482848, 16482849, 16482850, 16482851, 16482852, 16482853, 16482854, 16482855, 16482856, 16482857, 16482858, 16482859, 16482860, 16482861, 16482862, 16482863, 16482864], "trace_timestamp_s": 1509.4470000000001, "ttft_s": 0.4684629489784129, "turn_id": 15} +{"actual_output_tokens": 35, "cached_tokens": 101680, "effective_input_length": 101743, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101743, "latency_s": 0.6972070709452964, "output_length": 35, "proxy_request_id": "1253804:27:1683133:1031", "request_id": "1253804:27:1683133:1031", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779816032.192291, "t_finish_unix": 1779816032.889498, "t_first_token_unix": 1779816032.4299734, "tpot_s": 0.013508398734676815, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388], "trace_timestamp_s": 1523.0790000000006, "ttft_s": 0.2376801299978979, "turn_id": 27} +{"actual_output_tokens": 412, "cached_tokens": 86880, "effective_input_length": 86925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86925, "latency_s": 4.396962374972645, "output_length": 412, "proxy_request_id": "1294611:15:1682649:1030", "request_id": "1294611:15:1682649:1030", "request_type": "coder", "requested_output_tokens": 412, "session_id": "1294611", "t_dispatch_unix": 1779816030.4751673, "t_finish_unix": 1779816034.8721294, "t_first_token_unix": 1779816030.6380577, "tpot_s": 0.010301250756640042, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16515797, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859, 16456401, 16456402, 16456403, 16456404, 16456405, 16456406, 16456407, 16456408, 16456409, 16456410, 16515798, 16515799], "trace_timestamp_s": 1521.3540000000003, "ttft_s": 0.16288827697280794, "turn_id": 15} +{"actual_output_tokens": 73, "cached_tokens": 101776, "effective_input_length": 101794, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101794, "latency_s": 0.8650726400082931, "output_length": 73, "proxy_request_id": "1253804:28:1685257:1032", "request_id": "1253804:28:1685257:1032", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1253804", "t_dispatch_unix": 1779816039.1937392, "t_finish_unix": 1779816040.0588114, "t_first_token_unix": 1779816039.364104, "tpot_s": 0.009645309027594825, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388], "trace_timestamp_s": 1530.0770000000002, "ttft_s": 0.17036282503977418, "turn_id": 28} +{"actual_output_tokens": 199, "cached_tokens": 43136, "effective_input_length": 43407, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43407, "latency_s": 1.5969064419623464, "output_length": 199, "proxy_request_id": "1399948:51:1686626:1033", "request_id": "1399948:51:1686626:1033", "request_type": "coder", "requested_output_tokens": 199, "session_id": "1399948", "t_dispatch_unix": 1779816044.1323812, "t_finish_unix": 1779816045.729287, "t_first_token_unix": 1779816044.3091152, "tpot_s": 0.00717123111620583, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913], "trace_timestamp_s": 1535.0170000000007, "ttft_s": 0.17673155496595427, "turn_id": 51} +{"actual_output_tokens": 101, "cached_tokens": 101856, "effective_input_length": 102067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102067, "latency_s": 1.3317324060481042, "output_length": 101, "proxy_request_id": "1253804:29:1688398:1034", "request_id": "1253804:29:1688398:1034", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1253804", "t_dispatch_unix": 1779816050.1806586, "t_finish_unix": 1779816051.5123906, "t_first_token_unix": 1779816050.5227456, "tpot_s": 0.009894138089730404, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16571621], "trace_timestamp_s": 1541.063, "ttft_s": 0.3420848030364141, "turn_id": 29} +{"actual_output_tokens": 105, "cached_tokens": 43600, "effective_input_length": 43673, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43673, "latency_s": 0.8446464230073616, "output_length": 105, "proxy_request_id": "1399948:52:1689144:1035", "request_id": "1399948:52:1689144:1035", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1399948", "t_dispatch_unix": 1779816052.767785, "t_finish_unix": 1779816053.6124313, "t_first_token_unix": 1779816052.8908117, "tpot_s": 0.006936228731109832, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16578337], "trace_timestamp_s": 1543.656, "ttft_s": 0.12302437797188759, "turn_id": 52} +{"actual_output_tokens": 144, "cached_tokens": 132688, "effective_input_length": 132823, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 132823, "latency_s": 1.9839180979761295, "output_length": 144, "proxy_request_id": "1356885:9:1689871:1036", "request_id": "1356885:9:1689871:1036", "request_type": "coder", "requested_output_tokens": 144, "session_id": "1356885", "t_dispatch_unix": 1779816055.1351123, "t_finish_unix": 1779816057.1190298, "t_first_token_unix": 1779816055.4625359, "tpot_s": 0.011582139084096086, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16586340], "trace_timestamp_s": 1546.0200000000004, "ttft_s": 0.32742162997601554, "turn_id": 9} +{"actual_output_tokens": 77, "cached_tokens": 102160, "effective_input_length": 102214, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102214, "latency_s": 0.9607480169506744, "output_length": 77, "proxy_request_id": "1253804:30:1690362:1037", "request_id": "1253804:30:1690362:1037", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1253804", "t_dispatch_unix": 1779816056.7916396, "t_finish_unix": 1779816057.7523875, "t_first_token_unix": 1779816057.016142, "tpot_s": 0.00968403801303602, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691], "trace_timestamp_s": 1547.679, "ttft_s": 0.22449982195394114, "turn_id": 30} +{"actual_output_tokens": 42, "cached_tokens": 102288, "effective_input_length": 102322, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102322, "latency_s": 0.5456916110124439, "output_length": 42, "proxy_request_id": "1253804:31:1691981:1038", "request_id": "1253804:31:1691981:1038", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1253804", "t_dispatch_unix": 1779816062.3687863, "t_finish_unix": 1779816062.9144773, "t_first_token_unix": 1779816062.5520191, "tpot_s": 0.00883483556070842, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691], "trace_timestamp_s": 1553.2520000000004, "ttft_s": 0.18323039798997343, "turn_id": 31} +{"actual_output_tokens": 188, "cached_tokens": 43776, "effective_input_length": 43938, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43938, "latency_s": 1.517760963004548, "output_length": 188, "proxy_request_id": "1399948:53:1692115:1039", "request_id": "1399948:53:1692115:1039", "request_type": "coder", "requested_output_tokens": 188, "session_id": "1399948", "t_dispatch_unix": 1779816062.8891368, "t_finish_unix": 1779816064.406898, "t_first_token_unix": 1779816063.0554192, "tpot_s": 0.0072257463530174156, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324], "trace_timestamp_s": 1553.7790000000005, "ttft_s": 0.16628058103378862, "turn_id": 53} +{"actual_output_tokens": 79, "cached_tokens": 102352, "effective_input_length": 102509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102509, "latency_s": 1.09539211896481, "output_length": 79, "proxy_request_id": "1253804:32:1693715:1040", "request_id": "1253804:32:1693715:1040", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1253804", "t_dispatch_unix": 1779816068.45261, "t_finish_unix": 1779816069.5480018, "t_first_token_unix": 1779816068.7932503, "tpot_s": 0.009672786769582532, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16624791], "trace_timestamp_s": 1559.3360000000002, "ttft_s": 0.34063825296470895, "turn_id": 32} +{"actual_output_tokens": 42, "cached_tokens": 44112, "effective_input_length": 44182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44182, "latency_s": 0.3908439449733123, "output_length": 42, "proxy_request_id": "1399948:54:1694570:1041", "request_id": "1399948:54:1694570:1041", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1399948", "t_dispatch_unix": 1779816071.5482688, "t_finish_unix": 1779816071.9391122, "t_first_token_unix": 1779816071.6711178, "tpot_s": 0.006530492073890367, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16632677], "trace_timestamp_s": 1562.4360000000006, "ttft_s": 0.12284475297201425, "turn_id": 54} +{"actual_output_tokens": 53, "cached_tokens": 102576, "effective_input_length": 102632, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102632, "latency_s": 0.7053767470060848, "output_length": 53, "proxy_request_id": "1253804:33:1695393:1042", "request_id": "1253804:33:1695393:1042", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1253804", "t_dispatch_unix": 1779816074.2059245, "t_finish_unix": 1779816074.911301, "t_first_token_unix": 1779816074.428123, "tpot_s": 0.009287312345874783, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284], "trace_timestamp_s": 1565.0910000000003, "ttft_s": 0.22219652502099052, "turn_id": 33} +{"actual_output_tokens": 323, "cached_tokens": 102672, "effective_input_length": 102792, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102792, "latency_s": 3.6425955640152097, "output_length": 323, "proxy_request_id": "1253804:34:1697569:1043", "request_id": "1253804:34:1697569:1043", "request_type": "coder", "requested_output_tokens": 323, "session_id": "1253804", "t_dispatch_unix": 1779816082.0422075, "t_finish_unix": 1779816085.6848028, "t_first_token_unix": 1779816082.3238008, "tpot_s": 0.010437157176983085, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284], "trace_timestamp_s": 1572.9230000000007, "ttft_s": 0.28159137803595513, "turn_id": 34} +{"actual_output_tokens": 35, "cached_tokens": 103104, "effective_input_length": 103349, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103349, "latency_s": 0.637485385988839, "output_length": 35, "proxy_request_id": "1253804:35:1701250:1044", "request_id": "1253804:35:1701250:1044", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779816094.5866706, "t_finish_unix": 1779816095.224156, "t_first_token_unix": 1779816094.9355946, "tpot_s": 0.008478537499767673, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908], "trace_timestamp_s": 1585.4650000000001, "ttft_s": 0.3489212639979087, "turn_id": 35} +{"actual_output_tokens": 48, "cached_tokens": 103376, "effective_input_length": 103400, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103400, "latency_s": 0.6054531330009922, "output_length": 48, "proxy_request_id": "1253804:36:1702697:1045", "request_id": "1253804:36:1702697:1045", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1253804", "t_dispatch_unix": 1779816099.7360346, "t_finish_unix": 1779816100.3414872, "t_first_token_unix": 1779816099.9117725, "tpot_s": 0.009137567468334306, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908], "trace_timestamp_s": 1590.6190000000006, "ttft_s": 0.17573573999106884, "turn_id": 36} +{"actual_output_tokens": 226, "cached_tokens": 44208, "effective_input_length": 45284, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45284, "latency_s": 2.100995213026181, "output_length": 226, "proxy_request_id": "1399948:55:1704272:1047", "request_id": "1399948:55:1704272:1047", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1399948", "t_dispatch_unix": 1779816105.0118423, "t_finish_unix": 1779816107.112837, "t_first_token_unix": 1779816105.4602208, "tpot_s": 0.007343764271224952, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16728012], "trace_timestamp_s": 1595.9010000000007, "ttft_s": 0.4483763870084658, "turn_id": 55} +{"actual_output_tokens": 126, "cached_tokens": 132960, "effective_input_length": 133014, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 133014, "latency_s": 1.7374560229945928, "output_length": 126, "proxy_request_id": "1356885:10:1706624:1048", "request_id": "1356885:10:1706624:1048", "request_type": "coder", "requested_output_tokens": 126, "session_id": "1356885", "t_dispatch_unix": 1779816113.328303, "t_finish_unix": 1779816115.0657587, "t_first_token_unix": 1779816113.632219, "tpot_s": 0.011466364864259958, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16751243], "trace_timestamp_s": 1604.2150000000001, "ttft_s": 0.30391440098173916, "turn_id": 10} +{"actual_output_tokens": 1433, "cached_tokens": 103440, "effective_input_length": 103471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103471, "latency_s": 15.513146832003258, "output_length": 1433, "proxy_request_id": "1253804:37:1704071:1046", "request_id": "1253804:37:1704071:1046", "request_type": "coder", "requested_output_tokens": 1433, "session_id": "1253804", "t_dispatch_unix": 1779816104.2094226, "t_finish_unix": 1779816119.722569, "t_first_token_unix": 1779816104.3804567, "tpot_s": 0.010713581159893312, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16725569], "trace_timestamp_s": 1595.0930000000008, "ttft_s": 0.1710320279817097, "turn_id": 37} +{"actual_output_tokens": 123, "cached_tokens": 45504, "effective_input_length": 45571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45571, "latency_s": 1.013470504025463, "output_length": 123, "proxy_request_id": "1399948:56:1708284:1049", "request_id": "1399948:56:1708284:1049", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1399948", "t_dispatch_unix": 1779816119.0499008, "t_finish_unix": 1779816120.063371, "t_first_token_unix": 1779816119.1803362, "tpot_s": 0.007235945311191752, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16766349], "trace_timestamp_s": 1609.9390000000003, "ttft_s": 0.13043217704398558, "turn_id": 56} +{"actual_output_tokens": 336, "cached_tokens": 45680, "effective_input_length": 45756, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45756, "latency_s": 2.574817831045948, "output_length": 336, "proxy_request_id": "1399948:57:1711464:1050", "request_id": "1399948:57:1711464:1050", "request_type": "coder", "requested_output_tokens": 336, "session_id": "1399948", "t_dispatch_unix": 1779816129.8459976, "t_finish_unix": 1779816132.4208157, "t_first_token_unix": 1779816129.97245, "tpot_s": 0.007307523620877859, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16797835], "trace_timestamp_s": 1620.7250000000004, "ttft_s": 0.12645016005262733, "turn_id": 57} +{"actual_output_tokens": 35, "cached_tokens": 104896, "effective_input_length": 104953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 104953, "latency_s": 0.5283070289879106, "output_length": 35, "proxy_request_id": "1253804:38:1712824:1051", "request_id": "1253804:38:1712824:1051", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779816134.6643882, "t_finish_unix": 1779816135.1926944, "t_first_token_unix": 1779816134.8990545, "tpot_s": 0.008628482264398104, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701], "trace_timestamp_s": 1625.5480000000007, "ttft_s": 0.23466415202710778, "turn_id": 38} +{"actual_output_tokens": 59, "cached_tokens": 104976, "effective_input_length": 105004, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105004, "latency_s": 0.7291067810147069, "output_length": 59, "proxy_request_id": "1253804:39:1714767:1052", "request_id": "1253804:39:1714767:1052", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1253804", "t_dispatch_unix": 1779816141.2490299, "t_finish_unix": 1779816141.9781365, "t_first_token_unix": 1779816141.4239192, "tpot_s": 0.0095509598443108, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16829979], "trace_timestamp_s": 1632.1290000000008, "ttft_s": 0.17488679703092203, "turn_id": 39} +{"actual_output_tokens": 435, "cached_tokens": 105056, "effective_input_length": 105156, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105156, "latency_s": 4.898459284042474, "output_length": 435, "proxy_request_id": "1253804:40:1716790:1053", "request_id": "1253804:40:1716790:1053", "request_type": "coder", "requested_output_tokens": 435, "session_id": "1253804", "t_dispatch_unix": 1779816147.9581301, "t_finish_unix": 1779816152.856589, "t_first_token_unix": 1779816148.2493446, "tpot_s": 0.010615115783425168, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093], "trace_timestamp_s": 1638.8400000000001, "ttft_s": 0.2912120360415429, "turn_id": 40} +{"actual_output_tokens": 278, "cached_tokens": 45120, "effective_input_length": 47861, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47861, "latency_s": 3.003856634022668, "output_length": 278, "proxy_request_id": "1305906:4:1718131:1054", "request_id": "1305906:4:1718131:1054", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1305906", "t_dispatch_unix": 1779816152.4141858, "t_finish_unix": 1779816155.4180427, "t_first_token_unix": 1779816153.372372, "tpot_s": 0.007384019700427025, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16863272], "trace_timestamp_s": 1643.3010000000004, "ttft_s": 0.9581844150088727, "turn_id": 4} +{"actual_output_tokens": 92, "cached_tokens": 48128, "effective_input_length": 49817, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49817, "latency_s": 1.3294452260015532, "output_length": 92, "proxy_request_id": "1305906:5:1514292:934", "request_id": "1305906:5:1514292:934", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1305906", "t_dispatch_unix": 1779816155.4225574, "t_finish_unix": 1779816156.751991, "t_first_token_unix": 1779816156.0970755, "tpot_s": 0.007191475890167467, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 14922071, 14922072], "trace_timestamp_s": 956.3870000000006, "ttft_s": 0.6745272920234129, "turn_id": 5} +{"actual_output_tokens": 233, "cached_tokens": 35504, "effective_input_length": 37173, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37173, "latency_s": 2.1319982939749025, "output_length": 233, "proxy_request_id": "1340290:13:1718889:1055", "request_id": "1340290:13:1718889:1055", "request_type": "coder", "requested_output_tokens": 233, "session_id": "1340290", "t_dispatch_unix": 1779816155.047806, "t_finish_unix": 1779816157.1798038, "t_first_token_unix": 1779816155.5826542, "tpot_s": 0.0068831517630064025, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832], "trace_timestamp_s": 1645.9370000000008, "ttft_s": 0.5348467219737358, "turn_id": 13} +{"actual_output_tokens": 66, "cached_tokens": 105584, "effective_input_length": 105638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105638, "latency_s": 0.8600147750112228, "output_length": 66, "proxy_request_id": "1253804:41:1721979:1057", "request_id": "1253804:41:1721979:1057", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1253804", "t_dispatch_unix": 1779816165.6343596, "t_finish_unix": 1779816166.494374, "t_first_token_unix": 1779816165.8687165, "tpot_s": 0.00962190713840895, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16901523], "trace_timestamp_s": 1656.522, "ttft_s": 0.23435530700953677, "turn_id": 41} +{"actual_output_tokens": 254, "cached_tokens": 37392, "effective_input_length": 37438, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37438, "latency_s": 1.8373400149866939, "output_length": 254, "proxy_request_id": "1340290:14:1721731:1056", "request_id": "1340290:14:1721731:1056", "request_type": "coder", "requested_output_tokens": 254, "session_id": "1340290", "t_dispatch_unix": 1779816164.7712994, "t_finish_unix": 1779816166.608639, "t_first_token_unix": 1779816164.8732922, "tpot_s": 0.006857829695528837, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16899322], "trace_timestamp_s": 1655.656, "ttft_s": 0.10199104499770328, "turn_id": 14} +{"actual_output_tokens": 78, "cached_tokens": 105696, "effective_input_length": 105715, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105715, "latency_s": 0.9362822959665209, "output_length": 78, "proxy_request_id": "1253804:42:1724453:1058", "request_id": "1253804:42:1724453:1058", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1253804", "t_dispatch_unix": 1779816174.137726, "t_finish_unix": 1779816175.0740075, "t_first_token_unix": 1779816174.3167734, "tpot_s": 0.009830326376355846, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815], "trace_timestamp_s": 1665.0170000000007, "ttft_s": 0.17904563201591372, "turn_id": 42} +{"actual_output_tokens": 70, "cached_tokens": 105792, "effective_input_length": 105845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105845, "latency_s": 0.9038403209997341, "output_length": 70, "proxy_request_id": "1253804:43:1726322:1060", "request_id": "1253804:43:1726322:1060", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1253804", "t_dispatch_unix": 1779816180.2093952, "t_finish_unix": 1779816181.1132352, "t_first_token_unix": 1779816180.4431558, "tpot_s": 0.009707722826388435, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815], "trace_timestamp_s": 1671.0960000000005, "ttft_s": 0.23375770001439378, "turn_id": 43} +{"actual_output_tokens": 22, "cached_tokens": 46080, "effective_input_length": 46886, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46886, "latency_s": 0.4903897490003146, "output_length": 22, "proxy_request_id": "1399948:58:1726693:1061", "request_id": "1399948:58:1726693:1061", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1399948", "t_dispatch_unix": 1779816181.4345367, "t_finish_unix": 1779816181.9249265, "t_first_token_unix": 1779816181.803503, "tpot_s": 0.0057711536203333665, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 16945463], "trace_timestamp_s": 1672.3230000000003, "ttft_s": 0.3689642900135368, "turn_id": 58} +{"actual_output_tokens": 24, "cached_tokens": 46896, "effective_input_length": 46927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46927, "latency_s": 0.23326081898994744, "output_length": 24, "proxy_request_id": "1399948:59:1728305:1062", "request_id": "1399948:59:1728305:1062", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1399948", "t_dispatch_unix": 1779816186.726873, "t_finish_unix": 1779816186.9601336, "t_first_token_unix": 1779816186.8318267, "tpot_s": 0.005557279955373024, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 16960933], "trace_timestamp_s": 1677.616, "ttft_s": 0.10495080699911341, "turn_id": 59} +{"actual_output_tokens": 101, "cached_tokens": 105904, "effective_input_length": 106070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106070, "latency_s": 1.3706457400112413, "output_length": 101, "proxy_request_id": "1253804:44:1728625:1063", "request_id": "1253804:44:1728625:1063", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1253804", "t_dispatch_unix": 1779816187.9128141, "t_finish_unix": 1779816189.2834594, "t_first_token_unix": 1779816188.2685354, "tpot_s": 0.010146641689934767, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 16964762], "trace_timestamp_s": 1678.799, "ttft_s": 0.3557191279833205, "turn_id": 44} +{"actual_output_tokens": 2444, "cached_tokens": 37680, "effective_input_length": 37724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37724, "latency_s": 17.40177410200704, "output_length": 2444, "proxy_request_id": "1340290:15:1725612:1059", "request_id": "1340290:15:1725612:1059", "request_type": "coder", "requested_output_tokens": 2444, "session_id": "1340290", "t_dispatch_unix": 1779816177.9532857, "t_finish_unix": 1779816195.355059, "t_first_token_unix": 1779816178.0420156, "tpot_s": 0.007086678463363325, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638], "trace_timestamp_s": 1668.8400000000001, "ttft_s": 0.08872794301714748, "turn_id": 15} +{"actual_output_tokens": 40, "cached_tokens": 106160, "effective_input_length": 106394, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106394, "latency_s": 0.712351422989741, "output_length": 40, "proxy_request_id": "1253804:45:1732408:1064", "request_id": "1253804:45:1732408:1064", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1253804", "t_dispatch_unix": 1779816200.8792937, "t_finish_unix": 1779816201.5916452, "t_first_token_unix": 1779816201.2451775, "tpot_s": 0.008875320384947535, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607], "trace_timestamp_s": 1691.7610000000004, "ttft_s": 0.36588143795961514, "turn_id": 45} +{"actual_output_tokens": 54, "cached_tokens": 46944, "effective_input_length": 47074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47074, "latency_s": 0.501099343993701, "output_length": 54, "proxy_request_id": "1399948:60:1732843:1065", "request_id": "1399948:60:1732843:1065", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1399948", "t_dispatch_unix": 1779816202.4796731, "t_finish_unix": 1779816202.9807718, "t_first_token_unix": 1779816202.6286986, "tpot_s": 0.0066369973773242165, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902], "trace_timestamp_s": 1693.3680000000004, "ttft_s": 0.14902342401910573, "turn_id": 60} +{"actual_output_tokens": 71, "cached_tokens": 106432, "effective_input_length": 106443, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106443, "latency_s": 0.8765987940132618, "output_length": 71, "proxy_request_id": "1253804:46:1733935:1066", "request_id": "1253804:46:1733935:1066", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1253804", "t_dispatch_unix": 1779816205.9713051, "t_finish_unix": 1779816206.8479037, "t_first_token_unix": 1779816206.1571314, "tpot_s": 0.009863794886041433, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607], "trace_timestamp_s": 1696.8550000000005, "ttft_s": 0.1858238959684968, "turn_id": 46} +{"actual_output_tokens": 207, "cached_tokens": 47120, "effective_input_length": 47205, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47205, "latency_s": 1.6355148910079151, "output_length": 207, "proxy_request_id": "1399948:61:1735933:1067", "request_id": "1399948:61:1735933:1067", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1399948", "t_dispatch_unix": 1779816212.6769922, "t_finish_unix": 1779816214.3125067, "t_first_token_unix": 1779816212.8078587, "tpot_s": 0.007302609208724868, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17034825], "trace_timestamp_s": 1703.5600000000004, "ttft_s": 0.13086396805010736, "turn_id": 61} +{"actual_output_tokens": 44, "cached_tokens": 106512, "effective_input_length": 107137, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107137, "latency_s": 1.1415649649570696, "output_length": 44, "proxy_request_id": "1253804:47:1736337:1068", "request_id": "1253804:47:1736337:1068", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1253804", "t_dispatch_unix": 1779816213.9472976, "t_finish_unix": 1779816215.0888624, "t_first_token_unix": 1779816214.6951425, "tpot_s": 0.009149538627879823, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17038931], "trace_timestamp_s": 1704.8340000000007, "ttft_s": 0.7478420819970779, "turn_id": 47} +{"actual_output_tokens": 45, "cached_tokens": 107168, "effective_input_length": 108145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108145, "latency_s": 1.3560882760211825, "output_length": 45, "proxy_request_id": "1253804:48:1737694:1069", "request_id": "1253804:48:1737694:1069", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779816218.3851843, "t_finish_unix": 1779816219.741272, "t_first_token_unix": 1779816219.337299, "tpot_s": 0.009174649726694704, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17053260], "trace_timestamp_s": 1709.268, "ttft_s": 0.9521127620246261, "turn_id": 48} +{"actual_output_tokens": 45, "cached_tokens": 108176, "effective_input_length": 109454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109454, "latency_s": 1.5881946519948542, "output_length": 45, "proxy_request_id": "1253804:49:1739030:1070", "request_id": "1253804:49:1739030:1070", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779816222.769159, "t_finish_unix": 1779816224.3573532, "t_first_token_unix": 1779816223.953231, "tpot_s": 0.00917807727290148, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558], "trace_timestamp_s": 1713.652, "ttft_s": 1.1840696659637615, "turn_id": 49} +{"actual_output_tokens": 45, "cached_tokens": 109488, "effective_input_length": 110854, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 110854, "latency_s": 1.59468103304971, "output_length": 45, "proxy_request_id": "1253804:50:1741670:1071", "request_id": "1253804:50:1741670:1071", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779816231.7512457, "t_finish_unix": 1779816233.3459272, "t_first_token_unix": 1779816232.9316876, "tpot_s": 0.0094074759994824, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030], "trace_timestamp_s": 1722.6290000000008, "ttft_s": 1.180439361021854, "turn_id": 50} +{"actual_output_tokens": 45, "cached_tokens": 110896, "effective_input_length": 111661, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111661, "latency_s": 1.1945697870105505, "output_length": 45, "proxy_request_id": "1253804:51:1744514:1072", "request_id": "1253804:51:1744514:1072", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779816241.168968, "t_finish_unix": 1779816242.363537, "t_first_token_unix": 1779816241.9576864, "tpot_s": 0.009212539340792731, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17117868], "trace_timestamp_s": 1732.054, "ttft_s": 0.7887163150007837, "turn_id": 51} +{"actual_output_tokens": 105, "cached_tokens": 40160, "effective_input_length": 40200, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40200, "latency_s": 0.8062344760401174, "output_length": 105, "proxy_request_id": "1340290:16:1745847:1073", "request_id": "1340290:16:1745847:1073", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1340290", "t_dispatch_unix": 1779816245.7887785, "t_finish_unix": 1779816246.5950131, "t_first_token_unix": 1779816245.8837485, "tpot_s": 0.006836342461890756, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 17129420], "trace_timestamp_s": 1736.6730000000007, "ttft_s": 0.09496811399003491, "turn_id": 16} +{"actual_output_tokens": 76, "cached_tokens": 111696, "effective_input_length": 111724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111724, "latency_s": 0.9462730920058675, "output_length": 76, "proxy_request_id": "1253804:52:1746191:1074", "request_id": "1253804:52:1746191:1074", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1253804", "t_dispatch_unix": 1779816246.8135378, "t_finish_unix": 1779816247.7598102, "t_first_token_unix": 1779816246.9999561, "tpot_s": 0.010127739546975741, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17132107], "trace_timestamp_s": 1737.7000000000007, "ttft_s": 0.1864167379681021, "turn_id": 52} +{"actual_output_tokens": 50, "cached_tokens": 111792, "effective_input_length": 111811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111811, "latency_s": 0.6548810649546795, "output_length": 50, "proxy_request_id": "1253804:53:1748377:1075", "request_id": "1253804:53:1748377:1075", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1253804", "t_dispatch_unix": 1779816254.1464033, "t_finish_unix": 1779816254.8012843, "t_first_token_unix": 1779816254.3307328, "tpot_s": 0.009596797693473267, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17153201], "trace_timestamp_s": 1745.0320000000002, "ttft_s": 0.18432786100311205, "turn_id": 53} +{"actual_output_tokens": 78, "cached_tokens": 47408, "effective_input_length": 48212, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48212, "latency_s": 0.9185642550000921, "output_length": 78, "proxy_request_id": "1399948:62:1749028:1076", "request_id": "1399948:62:1749028:1076", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1399948", "t_dispatch_unix": 1779816256.3191934, "t_finish_unix": 1779816257.237757, "t_first_token_unix": 1779816256.6967993, "tpot_s": 0.007021849519911815, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17159596], "trace_timestamp_s": 1747.2060000000001, "ttft_s": 0.377603871980682, "turn_id": 62} +{"actual_output_tokens": 534, "cached_tokens": 111856, "effective_input_length": 112074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112074, "latency_s": 6.256898513995111, "output_length": 534, "proxy_request_id": "1253804:54:1750056:1077", "request_id": "1253804:54:1750056:1077", "request_type": "coder", "requested_output_tokens": 534, "session_id": "1253804", "t_dispatch_unix": 1779816259.7429686, "t_finish_unix": 1779816265.999867, "t_first_token_unix": 1779816260.1173325, "tpot_s": 0.01103618339773907, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17153201], "trace_timestamp_s": 1750.6280000000006, "ttft_s": 0.3743610440287739, "turn_id": 54} +{"actual_output_tokens": 19, "cached_tokens": 48288, "effective_input_length": 48636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48636, "latency_s": 0.37807292700745165, "output_length": 19, "proxy_request_id": "1399948:63:1753316:1079", "request_id": "1399948:63:1753316:1079", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1399948", "t_dispatch_unix": 1779816270.6141107, "t_finish_unix": 1779816270.9921832, "t_first_token_unix": 1779816270.8917637, "tpot_s": 0.005565178777841438, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857], "trace_timestamp_s": 1761.5030000000006, "ttft_s": 0.27765135798836127, "turn_id": 63} +{"actual_output_tokens": 171, "cached_tokens": 48640, "effective_input_length": 48693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48693, "latency_s": 1.3925906980293803, "output_length": 171, "proxy_request_id": "1399948:64:1754453:1080", "request_id": "1399948:64:1754453:1080", "request_type": "coder", "requested_output_tokens": 171, "session_id": "1399948", "t_dispatch_unix": 1779816274.5276923, "t_finish_unix": 1779816275.9202828, "t_first_token_unix": 1779816274.6783407, "tpot_s": 0.007303940899916651, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17212612], "trace_timestamp_s": 1765.4160000000002, "ttft_s": 0.15064630302367732, "turn_id": 64} +{"actual_output_tokens": 1391, "cached_tokens": 133136, "effective_input_length": 133552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 133552, "latency_s": 17.82955032301834, "output_length": 1391, "proxy_request_id": "1356885:11:1753167:1078", "request_id": "1356885:11:1753167:1078", "request_type": "coder", "requested_output_tokens": 1391, "session_id": "1356885", "t_dispatch_unix": 1779816270.1818547, "t_finish_unix": 1779816288.0114045, "t_first_token_unix": 1779816270.874829, "tpot_s": 0.012328230937408525, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16751243, 17201151], "trace_timestamp_s": 1761.0650000000005, "ttft_s": 0.6929720260086469, "turn_id": 11} +{"actual_output_tokens": 725, "cached_tokens": 48848, "effective_input_length": 49220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49220, "latency_s": 5.796604841016233, "output_length": 725, "proxy_request_id": "1399948:65:1759200:1081", "request_id": "1399948:65:1759200:1081", "request_type": "coder", "requested_output_tokens": 725, "session_id": "1399948", "t_dispatch_unix": 1779816291.0236773, "t_finish_unix": 1779816296.8202825, "t_first_token_unix": 1779816291.3104916, "tpot_s": 0.007609842528987197, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17258496], "trace_timestamp_s": 1781.9100000000008, "ttft_s": 0.2868120160419494, "turn_id": 65} +{"actual_output_tokens": 140, "cached_tokens": 49504, "effective_input_length": 49716, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49716, "latency_s": 1.2181517429999076, "output_length": 140, "proxy_request_id": "1277428:14:1767578:1082", "request_id": "1277428:14:1767578:1082", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1277428", "t_dispatch_unix": 1779816319.893558, "t_finish_unix": 1779816321.1117089, "t_first_token_unix": 1779816320.088267, "tpot_s": 0.007360716949622381, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17338220], "trace_timestamp_s": 1810.7580000000007, "ttft_s": 0.19470756500959396, "turn_id": 14} +{"actual_output_tokens": 45, "cached_tokens": 49840, "effective_input_length": 49925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49925, "latency_s": 0.42902912897989154, "output_length": 45, "proxy_request_id": "1277428:14:1770237:1083", "request_id": "1277428:14:1770237:1083", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779816329.2320912, "t_finish_unix": 1779816329.6611197, "t_first_token_unix": 1779816329.3589096, "tpot_s": 0.006861796681980856, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17363127], "trace_timestamp_s": 1820.1130000000003, "ttft_s": 0.12681649799924344, "turn_id": 14} +{"actual_output_tokens": 450, "cached_tokens": 49968, "effective_input_length": 51398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51398, "latency_s": 4.063379623985384, "output_length": 450, "proxy_request_id": "1277428:15:1771467:1084", "request_id": "1277428:15:1771467:1084", "request_type": "coder", "requested_output_tokens": 450, "session_id": "1277428", "t_dispatch_unix": 1779816333.3021567, "t_finish_unix": 1779816337.3655365, "t_first_token_unix": 1779816333.8988948, "tpot_s": 0.007720126561200317, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17375444], "trace_timestamp_s": 1824.1870000000008, "ttft_s": 0.5967352410079911, "turn_id": 15} +{"actual_output_tokens": 382, "cached_tokens": 49936, "effective_input_length": 51012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51012, "latency_s": 3.4240780739928596, "output_length": 382, "proxy_request_id": "1399948:66:1772336:1085", "request_id": "1399948:66:1772336:1085", "request_type": "coder", "requested_output_tokens": 382, "session_id": "1399948", "t_dispatch_unix": 1779816336.25103, "t_finish_unix": 1779816339.675108, "t_first_token_unix": 1779816336.744461, "tpot_s": 0.0076911732624101595, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17382969], "trace_timestamp_s": 1827.1390000000001, "ttft_s": 0.49342945200623944, "turn_id": 66} +{"actual_output_tokens": 555, "cached_tokens": 51392, "effective_input_length": 52331, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52331, "latency_s": 4.7710531370248646, "output_length": 555, "proxy_request_id": "1399948:67:1777074:1086", "request_id": "1399948:67:1777074:1086", "request_type": "coder", "requested_output_tokens": 555, "session_id": "1399948", "t_dispatch_unix": 1779816352.317002, "t_finish_unix": 1779816357.088055, "t_first_token_unix": 1779816352.8127728, "tpot_s": 0.007716604272581953, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17430076], "trace_timestamp_s": 1843.1980000000003, "ttft_s": 0.49576896900543943, "turn_id": 67} +{"actual_output_tokens": 544, "cached_tokens": 52880, "effective_input_length": 53289, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53289, "latency_s": 4.564860351965763, "output_length": 544, "proxy_request_id": "1399948:68:1784799:1087", "request_id": "1399948:68:1784799:1087", "request_type": "coder", "requested_output_tokens": 544, "session_id": "1399948", "t_dispatch_unix": 1779816378.8168516, "t_finish_unix": 1779816383.3817117, "t_first_token_unix": 1779816379.1179724, "tpot_s": 0.007851047690702228, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17500500], "trace_timestamp_s": 1869.6820000000007, "ttft_s": 0.30111929395934567, "turn_id": 68} +{"actual_output_tokens": 81, "cached_tokens": 51840, "effective_input_length": 52754, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52754, "latency_s": 0.993519818992354, "output_length": 81, "proxy_request_id": "1277428:16:1787662:1088", "request_id": "1277428:16:1787662:1088", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1277428", "t_dispatch_unix": 1779816389.2551405, "t_finish_unix": 1779816390.2486603, "t_first_token_unix": 1779816389.6676672, "tpot_s": 0.00725856421267963, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 303055], "trace_timestamp_s": 1880.138, "ttft_s": 0.41252356895711273, "turn_id": 16} +{"actual_output_tokens": 70, "cached_tokens": 49904, "effective_input_length": 52461, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52461, "latency_s": 1.5021289069554769, "output_length": 70, "proxy_request_id": "1305906:5:1788459:1089", "request_id": "1305906:5:1788459:1089", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1305906", "t_dispatch_unix": 1779816391.7907674, "t_finish_unix": 1779816393.2928963, "t_first_token_unix": 1779816392.8007221, "tpot_s": 0.007128997203097611, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17479967], "trace_timestamp_s": 1882.6760000000004, "ttft_s": 1.0099518739734776, "turn_id": 5} +{"actual_output_tokens": 492, "cached_tokens": 53824, "effective_input_length": 54141, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54141, "latency_s": 4.1481719860457815, "output_length": 492, "proxy_request_id": "1399948:69:1790968:1090", "request_id": "1399948:69:1790968:1090", "request_type": "coder", "requested_output_tokens": 492, "session_id": "1399948", "t_dispatch_unix": 1779816400.3857572, "t_finish_unix": 1779816404.5339286, "t_first_token_unix": 1779816400.686349, "tpot_s": 0.007835263437937657, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437], "trace_timestamp_s": 1891.2740000000003, "ttft_s": 0.3005898440023884, "turn_id": 69} +{"actual_output_tokens": 1904, "cached_tokens": 51248, "effective_input_length": 51255, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51255, "latency_s": 14.939480577013455, "output_length": 1904, "proxy_request_id": "1305906:6:1529600:945", "request_id": "1305906:6:1529600:945", "request_type": "coder", "requested_output_tokens": 1904, "session_id": "1305906", "t_dispatch_unix": 1779816393.295939, "t_finish_unix": 1779816408.2354198, "t_first_token_unix": 1779816393.3877249, "tpot_s": 0.007802125004732406, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 15068951, 15068952, 15068953, 15068954, 15068955], "trace_timestamp_s": 1007.1970000000001, "ttft_s": 0.09178215300198644, "turn_id": 6} +{"actual_output_tokens": 170, "cached_tokens": 52832, "effective_input_length": 53574, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53574, "latency_s": 1.7052882630378008, "output_length": 170, "proxy_request_id": "1277428:17:1793546:1091", "request_id": "1277428:17:1793546:1091", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1277428", "t_dispatch_unix": 1779816409.3882244, "t_finish_unix": 1779816411.0935125, "t_first_token_unix": 1779816409.7991061, "tpot_s": 0.007657531159792162, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 17586052, 17586053], "trace_timestamp_s": 1900.2750000000005, "ttft_s": 0.41087984101613984, "turn_id": 17} +{"actual_output_tokens": 122, "cached_tokens": 54624, "effective_input_length": 54654, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54654, "latency_s": 1.026875319017563, "output_length": 122, "proxy_request_id": "1399948:70:1795589:1092", "request_id": "1399948:70:1795589:1092", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1399948", "t_dispatch_unix": 1779816416.7084274, "t_finish_unix": 1779816417.735303, "t_first_token_unix": 1779816416.8192134, "tpot_s": 0.007568674272672881, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564], "trace_timestamp_s": 1907.5920000000006, "ttft_s": 0.11078325001290068, "turn_id": 70} +{"actual_output_tokens": 52, "cached_tokens": 53728, "effective_input_length": 53805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53805, "latency_s": 0.5070170919643715, "output_length": 52, "proxy_request_id": "1277428:18:1796824:1093", "request_id": "1277428:18:1796824:1093", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1277428", "t_dispatch_unix": 1779816421.3056862, "t_finish_unix": 1779816421.8127031, "t_first_token_unix": 1779816421.4552405, "tpot_s": 0.007003062941115715, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 17586052, 17617726, 17617727], "trace_timestamp_s": 1912.1900000000005, "ttft_s": 0.14955224195728078, "turn_id": 18} +{"actual_output_tokens": 265, "cached_tokens": 54768, "effective_input_length": 54920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54920, "latency_s": 2.246413591026794, "output_length": 265, "proxy_request_id": "1399948:71:1800797:1094", "request_id": "1399948:71:1800797:1094", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1399948", "t_dispatch_unix": 1779816434.888865, "t_finish_unix": 1779816437.1352782, "t_first_token_unix": 1779816435.0868368, "tpot_s": 0.007758227075762327, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17654371], "trace_timestamp_s": 1925.7700000000004, "ttft_s": 0.19796953501645476, "turn_id": 71} +{"actual_output_tokens": 54, "cached_tokens": 55184, "effective_input_length": 55246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55246, "latency_s": 0.8863086720230058, "output_length": 54, "proxy_request_id": "1399948:72:1804699:1097", "request_id": "1399948:72:1804699:1097", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1399948", "t_dispatch_unix": 1779816448.3462641, "t_finish_unix": 1779816449.232572, "t_first_token_unix": 1779816448.486818, "tpot_s": 0.014064269170015698, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778], "trace_timestamp_s": 1939.2340000000004, "ttft_s": 0.14055183401796967, "turn_id": 72} +{"actual_output_tokens": 95, "cached_tokens": 52928, "effective_input_length": 52932, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52932, "latency_s": 0.7938543659984134, "output_length": 95, "proxy_request_id": "1305906:6:1806419:1099", "request_id": "1305906:6:1806419:1099", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1305906", "t_dispatch_unix": 1779816454.037596, "t_finish_unix": 1779816454.8314497, "t_first_token_unix": 1779816454.143327, "tpot_s": 0.007317661372152098, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17708612], "trace_timestamp_s": 1944.9260000000004, "ttft_s": 0.10572959500132129, "turn_id": 6} +{"actual_output_tokens": 164, "cached_tokens": 55296, "effective_input_length": 55559, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55559, "latency_s": 2.614871949015651, "output_length": 164, "proxy_request_id": "1399948:73:1805981:1098", "request_id": "1399948:73:1805981:1098", "request_type": "coder", "requested_output_tokens": 164, "session_id": "1399948", "t_dispatch_unix": 1779816452.5265827, "t_finish_unix": 1779816455.1414547, "t_first_token_unix": 1779816452.7466612, "tpot_s": 0.014690081061483961, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17704700], "trace_timestamp_s": 1943.415, "ttft_s": 0.22007601300720125, "turn_id": 73} +{"actual_output_tokens": 43, "cached_tokens": 53024, "effective_input_length": 54789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54789, "latency_s": 1.0236679280060343, "output_length": 43, "proxy_request_id": "1305906:7:1572780:964", "request_id": "1305906:7:1572780:964", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1305906", "t_dispatch_unix": 1779816454.8349507, "t_finish_unix": 1779816455.8586187, "t_first_token_unix": 1779816455.5696328, "tpot_s": 0.006870055881639321, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 15068951, 15068952, 15068953, 15068954, 15254840, 15254841, 15254842, 15254843, 15321386, 15404408, 15482090, 15482091], "trace_timestamp_s": 1150.469, "ttft_s": 0.734680462977849, "turn_id": 7} +{"actual_output_tokens": 236, "cached_tokens": 55712, "effective_input_length": 55791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55791, "latency_s": 3.6506631610100158, "output_length": 236, "proxy_request_id": "1399948:74:1808473:1100", "request_id": "1399948:74:1808473:1100", "request_type": "coder", "requested_output_tokens": 236, "session_id": "1399948", "t_dispatch_unix": 1779816461.2282674, "t_finish_unix": 1779816464.8789303, "t_first_token_unix": 1779816461.3972144, "tpot_s": 0.014814821319119568, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098], "trace_timestamp_s": 1952.1170000000002, "ttft_s": 0.1689454090083018, "turn_id": 74} +{"actual_output_tokens": 108, "cached_tokens": 56016, "effective_input_length": 57308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57308, "latency_s": 2.2347156350151636, "output_length": 108, "proxy_request_id": "1399948:75:1817312:1101", "request_id": "1399948:75:1817312:1101", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1399948", "t_dispatch_unix": 1779816489.76366, "t_finish_unix": 1779816491.9983752, "t_first_token_unix": 1779816490.4240365, "tpot_s": 0.01471019923364935, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098, 17807927, 17807928, 17807929], "trace_timestamp_s": 1980.652, "ttft_s": 0.6603750269860029, "turn_id": 75} +{"actual_output_tokens": 3764, "cached_tokens": 111632, "effective_input_length": 111736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111736, "latency_s": 45.455606661969796, "output_length": 3764, "proxy_request_id": "1270606:6:1804345:1096", "request_id": "1270606:6:1804345:1096", "request_type": "coder", "requested_output_tokens": 3764, "session_id": "1270606", "t_dispatch_unix": 1779816447.173376, "t_finish_unix": 1779816492.6289823, "t_first_token_unix": 1779816447.496372, "tpot_s": 0.011993666519257462, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17689050, 17689051, 17689052, 17689053, 17689054, 17689055, 17689056, 17689057, 17689058, 17689059, 17689060, 17689061, 17689062, 17689063, 17689064, 17689065, 17689066, 17689067, 17689068, 17689069, 17689070, 17689071, 17689072, 17689073, 17689074, 17689075, 17689076, 17689077, 17689078, 17689079, 17689080, 17689081, 17689082, 17689083, 17689084, 17689085, 17689086, 17689087, 17689088, 17689089, 17689090, 17689091, 17689092, 17689093, 17689094, 17689095, 17689096, 17689097, 17689098, 17689099, 17689100, 17689101, 17689102, 17689103, 17689104, 17689105, 17689106, 17689107, 17689108, 17689109, 17689110, 17689111, 17689112, 17689113, 17689114, 17689115, 17689116, 17689117, 17689118, 17689119, 17689120, 17689121, 17689122, 17689123, 17689124, 17689125, 17689126, 17689127, 17689128, 17689129, 17689130, 17689131, 17689132, 17689133, 17689134, 17689135, 17689136, 17689137, 17689138, 17689139, 17689140, 17689141, 17689142, 17689143, 17689144, 17689145, 17689146, 17689147, 17689148, 17689149, 17689150, 17689151, 17689152, 17689153, 17689154, 17689155, 17689156, 17689157, 17689158, 17689159, 17689160, 17689161, 17689162], "trace_timestamp_s": 1938.0380000000005, "ttft_s": 0.32299255300313234, "turn_id": 6} +{"actual_output_tokens": 85, "cached_tokens": 57408, "effective_input_length": 57659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57659, "latency_s": 0.8621470259968191, "output_length": 85, "proxy_request_id": "1399948:76:1821495:1102", "request_id": "1399948:76:1821495:1102", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1399948", "t_dispatch_unix": 1779816503.4214883, "t_finish_unix": 1779816504.2836354, "t_first_token_unix": 1779816503.6443322, "tpot_s": 0.007606462809018835, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098, 17807927, 17807928, 17807929, 17846855], "trace_timestamp_s": 1994.3100000000004, "ttft_s": 0.22284182900330052, "turn_id": 76} +{"actual_output_tokens": 86, "cached_tokens": 112176, "effective_input_length": 112180, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112180, "latency_s": 1.037258894997649, "output_length": 86, "proxy_request_id": "1270606:6:1822681:1103", "request_id": "1270606:6:1822681:1103", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1270606", "t_dispatch_unix": 1779816507.2569394, "t_finish_unix": 1779816508.294198, "t_first_token_unix": 1779816507.4368823, "tpot_s": 0.0100827202474808, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17857677, 17857678, 17857679, 17857680, 17857681, 17857682, 17857683, 17857684, 17857685, 17857686, 17857687, 17857688, 17857689, 17857690, 17857691, 17857692, 17857693, 17857694, 17857695, 17857696, 17857697, 17857698, 17857699, 17857700, 17857701, 17857702, 17857703, 17857704, 17857705, 17857706, 17857707, 17857708, 17857709, 17857710, 17857711, 17857712, 17857713, 17857714, 17857715, 17857716, 17857717, 17857718, 17857719, 17857720, 17857721, 17857722, 17857723, 17857724, 17857725, 17857726, 17857727, 17857728, 17857729, 17857730, 17857731, 17857732, 17857733, 17857734, 17857735, 17857736, 17857737, 17857738, 17857739, 17857740, 17857741, 17857742, 17857743, 17857744, 17857745, 17857746, 17857747, 17857748, 17857749, 17857750, 17857751, 17857752, 17857753, 17857754, 17857755, 17857756, 17857757, 17857758, 17857759, 17857760, 17857761, 17857762, 17857763, 17857764, 17857765, 17857766, 17857767, 17857768, 17857769, 17857770, 17857771, 17857772, 17857773, 17857774, 17857775, 17857776, 17857777, 17857778, 17857779, 17857780, 17857781, 17857782, 17857783, 17857784, 17857785, 17857786, 17857787, 17857788, 17857789], "trace_timestamp_s": 1998.1220000000003, "ttft_s": 0.17993984697386622, "turn_id": 6} +{"actual_output_tokens": 367, "cached_tokens": 112256, "effective_input_length": 112645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112645, "latency_s": 4.607902029994875, "output_length": 367, "proxy_request_id": "1270606:7:1825806:1104", "request_id": "1270606:7:1825806:1104", "request_type": "coder", "requested_output_tokens": 367, "session_id": "1270606", "t_dispatch_unix": 1779816517.8759236, "t_finish_unix": 1779816522.4838254, "t_first_token_unix": 1779816518.47402, "tpot_s": 0.010954275068221359, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 17887190, 17887191, 17887192, 17887193, 17887194, 17887195, 17887196, 17887197, 17887198, 17887199, 17887200, 17887201, 17887202, 17887203, 17887204, 17887205, 17887206, 17887207, 17887208, 17887209, 17887210, 17887211, 17887212, 17887213, 17887214, 17887215, 17887216, 17887217, 17887218, 17887219, 17887220, 17887221, 17887222, 17887223, 17887224, 17887225, 17887226, 17887227, 17887228, 17887229, 17887230, 17887231, 17887232, 17887233, 17887234, 17887235, 17887236, 17887237, 17887238, 17887239, 17887240, 17887241, 17887242, 17887243, 17887244, 17887245, 17887246, 17887247, 17887248, 17887249, 17887250, 17887251, 17887252, 17887253, 17887254, 17887255, 17887256, 17887257, 17887258, 17887259, 17887260, 17887261, 17887262, 17887263, 17887264, 17887265, 17887266, 17887267, 17887268, 17887269, 17887270, 17887271, 17887272, 17887273, 17887274, 17887275, 17887276, 17887277, 17887278, 17887279, 17887280, 17887281, 17887282, 17887283, 17887284, 17887285, 17887286, 17887287, 17887288, 17887289, 17887290, 17887291, 17887292, 17887293, 17887294, 17887295, 17887296, 17887297, 17887298, 17887299, 17887300, 17887301, 17887302], "trace_timestamp_s": 2008.7350000000006, "ttft_s": 0.5980923370225355, "turn_id": 7} +{"actual_output_tokens": 46, "cached_tokens": 53856, "effective_input_length": 58474, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58474, "latency_s": 2.0759840329992585, "output_length": 46, "proxy_request_id": "1277428:19:1834491:1105", "request_id": "1277428:19:1834491:1105", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1277428", "t_dispatch_unix": 1779816547.1480224, "t_finish_unix": 1779816549.2240062, "t_first_token_unix": 1779816548.9073951, "tpot_s": 0.007024367134242008, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 17970607, 17970608, 17970609, 17970610, 17970611, 17970612, 17970613, 17970614], "trace_timestamp_s": 2038.0340000000006, "ttft_s": 1.7593700219877064, "turn_id": 19} +{"actual_output_tokens": 45, "cached_tokens": 113008, "effective_input_length": 113482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113482, "latency_s": 1.0039236049633473, "output_length": 45, "proxy_request_id": "1270606:8:1837578:1106", "request_id": "1270606:8:1837578:1106", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1270606", "t_dispatch_unix": 1779816557.9722028, "t_finish_unix": 1779816558.9761262, "t_first_token_unix": 1779816558.575636, "tpot_s": 0.009095700705074705, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18001581, 18001582, 18001583, 18001584, 18001585, 18001586, 18001587, 18001588, 18001589, 18001590, 18001591, 18001592, 18001593, 18001594, 18001595, 18001596, 18001597, 18001598, 18001599, 18001600, 18001601, 18001602, 18001603, 18001604, 18001605, 18001606, 18001607, 18001608, 18001609, 18001610, 18001611, 18001612, 18001613, 18001614, 18001615, 18001616, 18001617, 18001618, 18001619, 18001620, 18001621, 18001622, 18001623, 18001624, 18001625, 18001626, 18001627, 18001628, 18001629, 18001630, 18001631, 18001632, 18001633, 18001634, 18001635, 18001636, 18001637, 18001638, 18001639, 18001640, 18001641, 18001642, 18001643, 18001644, 18001645, 18001646, 18001647, 18001648, 18001649, 18001650, 18001651, 18001652, 18001653, 18001654, 18001655, 18001656, 18001657, 18001658, 18001659, 18001660, 18001661, 18001662, 18001663, 18001664, 18001665, 18001666, 18001667, 18001668, 18001669, 18001670, 18001671, 18001672, 18001673, 18001674, 18001675, 18001676, 18001677, 18001678, 18001679, 18001680, 18001681, 18001682, 18001683, 18001684, 18001685, 18001686, 18001687, 18001688, 18001689, 18001690, 18001691, 18001692], "trace_timestamp_s": 2048.8380000000006, "ttft_s": 0.603429808979854, "turn_id": 8} +{"actual_output_tokens": 10766, "cached_tokens": 112592, "effective_input_length": 112634, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112634, "latency_s": 123.97555807797471, "output_length": 10766, "proxy_request_id": "1253804:55:1803044:1095", "request_id": "1253804:55:1803044:1095", "request_type": "coder", "requested_output_tokens": 10766, "session_id": "1253804", "t_dispatch_unix": 1779816442.7625625, "t_finish_unix": 1779816566.7381208, "t_first_token_unix": 1779816442.9681344, "tpot_s": 0.011497417194701738, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 17676585, 17676586, 17676587, 17676588, 17676589, 17676590, 17676591, 17676592, 17676593, 17676594, 17676595, 17676596, 17676597, 17676598, 17676599, 17676600, 17676601, 17676602, 17676603, 17676604, 17676605, 17676606, 17676607, 17676608, 17676609, 17676610, 17676611, 17676612, 17676613, 17676614, 17676615, 17676616, 17676617, 17676618, 17676619, 17676620, 17676621, 17676622, 17676623, 17676624, 17676625, 17676626, 17676627, 17676628, 17676629, 5483415, 17676630, 17676631, 17676632, 17676633, 17676634, 17676635, 17676636, 17676637, 17676638, 17676639, 17676640, 17676641, 17676642, 17676643, 17676644, 17676645, 17676646, 17676647, 17676648, 17676649, 17676650, 17676651, 17676652, 17676653, 17676654, 17676655, 17676656, 17676657, 17676658, 17676659, 17676660, 17676661, 17676662, 17676663, 17676664, 17676665, 17676666, 17676667, 17676668, 17676669, 17676670, 17676671, 17676672, 17676673, 17676674, 17676675, 17676676, 17676677, 17676678, 17676679, 17676680, 17676681, 17676682, 17676683, 17676684, 17676685, 17676686, 17676687, 17676688, 17676689, 17676690, 17676691, 17676692, 17676693, 17676694, 17676695, 17676696, 17676697, 17676698, 17676699, 17676700, 17676701, 17676702, 17676703, 17676704, 17676705, 17676706, 17676707, 17676708, 17676709, 17676710, 17676711, 17676712, 17676713, 17676714, 17676715, 17676716, 17676717, 17676718, 17676719, 17676720, 17676721, 17676722, 17676723, 17676724, 17676725, 17676726, 17676727, 17676728, 17676729, 17676730, 17676731, 17676732, 17676733, 17676734, 17676735, 17676736, 17676737, 17676738], "trace_timestamp_s": 1933.6150000000007, "ttft_s": 0.20556835999013856, "turn_id": 55} +{"actual_output_tokens": 141, "cached_tokens": 113520, "effective_input_length": 116467, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 116467, "latency_s": 3.7823358960449696, "output_length": 141, "proxy_request_id": "1270606:9:1847569:1107", "request_id": "1270606:9:1847569:1107", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1270606", "t_dispatch_unix": 1779816591.8562012, "t_finish_unix": 1779816595.6385367, "t_first_token_unix": 1779816594.1403027, "tpot_s": 0.010699363286091414, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18099243, 18099244, 18099245, 18099246, 18099247, 18099248, 18099249, 18099250, 18099251, 18099252, 18099253, 18099254, 18099255, 18099256, 18099257, 18099258, 18099259, 18099260, 18099261, 18099262, 18099263, 18099264, 18099265, 18099266, 18099267, 18099268, 18099269, 18099270, 18099271, 18099272, 18099273, 18099274, 18099275, 18099276, 18099277, 18099278, 18099279, 18099280, 18099281, 18099282, 18099283, 18099284, 18099285, 18099286, 18099287, 18099288, 18099289, 18099290, 18099291, 18099292, 18099293, 18099294, 18099295, 18099296, 18099297, 18099298, 18099299, 18099300, 18099301, 18099302, 18099303, 18099304, 18099305, 18099306, 18099307, 18099308, 18099309, 18099310, 18099311, 18099312, 18099313, 18099314, 18099315, 18099316, 18099317, 18099318, 18099319, 18099320, 18099321, 18099322, 18099323, 18099324, 18099325, 18099326, 18099327, 18099328, 18099329, 18099330, 18099331, 18099332, 18099333, 18099334, 18099335, 18099336, 18099337, 18099338, 18099339, 18099340, 18099341, 18099342, 18099343, 18099344, 18099345, 18099346, 18099347, 18099348, 18099349, 18099350, 18099351, 18099352, 18099353, 18099354, 18099355, 18099356, 18099357, 18099358, 18099359, 18099360], "trace_timestamp_s": 2082.7170000000006, "ttft_s": 2.2840986700030044, "turn_id": 9} +{"actual_output_tokens": 73, "cached_tokens": 116592, "effective_input_length": 116659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 116659, "latency_s": 1.0110803890274838, "output_length": 73, "proxy_request_id": "1270606:10:1851128:1108", "request_id": "1270606:10:1851128:1108", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1270606", "t_dispatch_unix": 1779816603.9575577, "t_finish_unix": 1779816604.968638, "t_first_token_unix": 1779816604.2390742, "tpot_s": 0.010128618875266207, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18099243, 18099244, 18099245, 18099246, 18099247, 18133288, 18133289, 18133290, 18133291, 18133292, 18133293, 18133294, 18133295, 18133296, 18133297, 18133298, 18133299, 18133300, 18133301, 18133302, 18133303, 18133304, 18133305, 18133306, 18133307, 18133308, 18133309, 18133310, 18133311, 18133312, 18133313, 18133314, 18133315, 18133316, 18133317, 18133318, 18133319, 18133320, 18133321, 18133322, 18133323, 18133324, 18133325, 18133326, 18133327, 18133328, 18133329, 18133330, 18133331, 18133332, 18133333, 18133334, 18133335, 18133336, 18133337, 18133338, 18133339, 18133340, 18133341, 18133342, 18133343, 18133344, 18133345, 18133346, 18133347, 18133348, 18133349, 18133350, 18133351, 18133352, 18133353, 18133354, 18133355, 18133356, 18133357, 18133358, 18133359, 18133360, 18133361, 18133362, 18133363, 18133364, 18133365, 18133366, 18133367, 18133368, 18133369, 18133370, 18133371, 18133372, 18133373, 18133374, 18133375, 18133376, 18133377, 18133378, 18133379, 18133380, 18133381, 18133382, 18133383, 18133384, 18133385, 18133386, 18133387, 18133388, 18133389, 18133390, 18133391, 18133392, 18133393, 18133394, 18133395, 18133396, 18133397, 18133398, 18133399, 18133400], "trace_timestamp_s": 2094.818, "ttft_s": 0.2815144670312293, "turn_id": 10} +{"actual_output_tokens": 279, "cached_tokens": 54816, "effective_input_length": 58042, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58042, "latency_s": 3.5456247049733065, "output_length": 279, "proxy_request_id": "1305906:7:1851943:1109", "request_id": "1305906:7:1851943:1109", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1305906", "t_dispatch_unix": 1779816606.5038369, "t_finish_unix": 1779816610.049461, "t_first_token_unix": 1779816607.8321705, "tpot_s": 0.007974942147576002, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18141935], "trace_timestamp_s": 2097.389, "ttft_s": 1.3283307749661617, "turn_id": 7} +{"actual_output_tokens": 234, "cached_tokens": 58320, "effective_input_length": 58687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58687, "latency_s": 2.185869476001244, "output_length": 234, "proxy_request_id": "1305906:8:1866131:1110", "request_id": "1305906:8:1866131:1110", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1305906", "t_dispatch_unix": 1779816655.0122643, "t_finish_unix": 1779816657.1981335, "t_first_token_unix": 1779816655.3381023, "tpot_s": 0.007981780382091092, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18280928], "trace_timestamp_s": 2145.857, "ttft_s": 0.3258353300043382, "turn_id": 8} +{"actual_output_tokens": 157, "cached_tokens": 116720, "effective_input_length": 117828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117828, "latency_s": 2.7424063030048274, "output_length": 157, "proxy_request_id": "1270606:11:1868274:1111", "request_id": "1270606:11:1868274:1111", "request_type": "coder", "requested_output_tokens": 157, "session_id": "1270606", "t_dispatch_unix": 1779816662.2456799, "t_finish_unix": 1779816664.9880857, "t_first_token_unix": 1779816663.2851381, "tpot_s": 0.01091432460928515, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18302637, 18302638, 18302639, 18302640, 18302641, 18302642, 18302643, 18302644, 18302645, 18302646, 18302647, 18302648, 18302649, 18302650, 18302651, 18302652, 18302653, 18302654, 18302655, 18302656, 18302657, 18302658, 18302659, 18302660, 18302661, 18302662, 18302663, 18302664, 18302665, 18302666, 18302667, 18302668, 18302669, 18302670, 18302671, 18302672, 18302673, 18302674, 18302675, 18302676, 18302677, 18302678, 18302679, 18302680, 18302681, 18302682, 18302683, 18302684, 18302685, 18302686, 18302687, 18302688, 18302689, 18302690, 18302691, 18302692, 18302693, 18302694, 18302695, 18302696, 18302697, 18302698, 18302699, 18302700, 18302701, 18302702, 18302703, 18302704, 18302705, 18302706, 18302707, 18302708, 18302709, 18302710, 18302711, 18302712, 18302713, 18302714, 18302715, 18302716, 18302717, 18302718, 18302719, 18302720, 18302721, 18302722, 18302723, 18302724, 18302725, 18302726, 18302727, 18302728, 18302729, 18302730, 18302731, 18302732, 18302733, 18302734, 18302735, 18302736, 18302737, 18302738, 18302739, 18302740, 18302741, 18302742, 18302743, 18302744, 18302745, 18302746, 18302747, 18302748, 18302749], "trace_timestamp_s": 2153.103, "ttft_s": 1.0394550149794668, "turn_id": 11} +{"actual_output_tokens": 51, "cached_tokens": 117984, "effective_input_length": 118012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118012, "latency_s": 0.688710656017065, "output_length": 51, "proxy_request_id": "1270606:11:1870810:1113", "request_id": "1270606:11:1870810:1113", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1270606", "t_dispatch_unix": 1779816670.7415216, "t_finish_unix": 1779816671.430232, "t_first_token_unix": 1779816670.9484334, "tpot_s": 0.009626830259803683, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18328449, 18328450, 18328451, 18328452, 18328453, 18328454, 18328455, 18328456, 18328457, 18328458, 18328459, 18328460, 18328461, 18328462, 18328463, 18328464, 18328465, 18328466, 18328467, 18328468, 18328469, 18328470, 18328471, 18328472, 18328473, 18328474, 18328475, 18328476, 18328477, 18328478, 18328479, 18328480, 18328481, 18328482, 18328483, 18328484, 18328485, 18328486, 18328487, 18328488, 18328489, 18328490, 18328491, 18328492, 18328493, 18328494, 18328495, 18328496, 18328497, 18328498, 18328499, 18328500, 18328501, 18328502, 18328503, 18328504, 18328505, 18328506, 18328507, 18328508, 18328509, 18328510, 18328511, 18328512, 18328513, 18328514, 18328515, 18328516, 18328517, 18328518, 18328519, 18328520, 18328521, 18328522, 18328523, 18328524, 18328525, 18328526, 18328527, 18328528, 18328529, 18328530, 18328531, 18328532, 18328533, 18328534, 18328535, 18328536, 18328537, 18328538, 18328539, 18328540, 18328541, 18328542, 18328543, 18328544, 18328545, 18328546, 18328547, 18328548, 18328549, 18328550, 18328551, 18328552, 18328553, 18328554, 18328555, 18328556, 18328557, 18328558, 18328559, 18328560, 18328561], "trace_timestamp_s": 2161.6060000000007, "ttft_s": 0.20690982701489702, "turn_id": 11} +{"actual_output_tokens": 211, "cached_tokens": 134928, "effective_input_length": 135435, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 135435, "latency_s": 3.3151593660004437, "output_length": 211, "proxy_request_id": "1356885:12:1874205:1114", "request_id": "1356885:12:1874205:1114", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1356885", "t_dispatch_unix": 1779816682.2029307, "t_finish_unix": 1779816685.5180893, "t_first_token_unix": 1779816682.919814, "tpot_s": 0.012370425914525099, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18360942], "trace_timestamp_s": 2173.0870000000004, "ttft_s": 0.7168816810008138, "turn_id": 12} +{"actual_output_tokens": 436, "cached_tokens": 40304, "effective_input_length": 40328, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40328, "latency_s": 3.3466175910434686, "output_length": 436, "proxy_request_id": "1340290:17:1875101:1115", "request_id": "1340290:17:1875101:1115", "request_type": "coder", "requested_output_tokens": 436, "session_id": "1340290", "t_dispatch_unix": 1779816685.147156, "t_finish_unix": 1779816688.493774, "t_first_token_unix": 1779816685.2647316, "tpot_s": 0.0074224300942137495, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956], "trace_timestamp_s": 2176.0350000000008, "ttft_s": 0.11757295404095203, "turn_id": 17} +{"actual_output_tokens": 194, "cached_tokens": 118048, "effective_input_length": 118600, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118600, "latency_s": 2.756227719015442, "output_length": 194, "proxy_request_id": "1270606:12:1876851:1116", "request_id": "1270606:12:1876851:1116", "request_type": "coder", "requested_output_tokens": 194, "session_id": "1270606", "t_dispatch_unix": 1779816691.1028674, "t_finish_unix": 1779816693.859095, "t_first_token_unix": 1779816691.7290888, "tpot_s": 0.011034823108737121, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18387421, 18387422, 18387423, 18387424, 18387425, 18387426, 18387427, 18387428, 18387429, 18387430, 18387431, 18387432, 18387433, 18387434, 18387435, 18387436, 18387437, 18387438, 18387439, 18387440, 18387441, 18387442, 18387443, 18387444, 18387445, 18387446, 18387447, 18387448, 18387449, 18387450, 18387451, 18387452, 18387453, 18387454, 18387455, 18387456, 18387457, 18387458, 18387459, 18387460, 18387461, 18387462, 18387463, 18387464, 18387465, 18387466, 18387467, 18387468, 18387469, 18387470, 18387471, 18387472, 18387473, 18387474, 18387475, 18387476, 18387477, 18387478, 18387479, 18387480, 18387481, 18387482, 18387483, 18387484, 18387485, 18387486, 18387487, 18387488, 18387489, 18387490, 18387491, 18387492, 18387493, 18387494, 18387495, 18387496, 18387497, 18387498, 18387499, 18387500, 18387501, 18387502, 18387503, 18387504, 18387505, 18387506, 18387507, 18387508, 18387509, 18387510, 18387511, 18387512, 18387513, 18387514, 18387515, 18387516, 18387517, 18387518, 18387519, 18387520, 18387521, 18387522, 18387523, 18387524, 18387525, 18387526, 18387527, 18387528, 18387529, 18387530, 18387531, 18387532, 18387533], "trace_timestamp_s": 2181.9670000000006, "ttft_s": 0.6262187390238978, "turn_id": 12} +{"actual_output_tokens": 34, "cached_tokens": 40576, "effective_input_length": 40583, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40583, "latency_s": 0.27762791799614206, "output_length": 34, "proxy_request_id": "1340290:18:1878955:1117", "request_id": "1340290:18:1878955:1117", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1340290", "t_dispatch_unix": 1779816698.821588, "t_finish_unix": 1779816699.0992153, "t_first_token_unix": 1779816698.8952143, "tpot_s": 0.006174336938949471, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18407653], "trace_timestamp_s": 2189.7110000000002, "ttft_s": 0.07362451701192185, "turn_id": 18} +{"actual_output_tokens": 82, "cached_tokens": 40608, "effective_input_length": 40676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40676, "latency_s": 0.6659609340131283, "output_length": 82, "proxy_request_id": "1340290:19:1880565:1118", "request_id": "1340290:19:1880565:1118", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1340290", "t_dispatch_unix": 1779816704.0948713, "t_finish_unix": 1779816704.760832, "t_first_token_unix": 1779816704.215339, "tpot_s": 0.006731443555542716, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18422775], "trace_timestamp_s": 2194.9840000000004, "ttft_s": 0.12046599300811067, "turn_id": 19} +{"actual_output_tokens": 49, "cached_tokens": 40752, "effective_input_length": 40883, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40883, "latency_s": 0.4459602989954874, "output_length": 49, "proxy_request_id": "1340290:20:1882251:1120", "request_id": "1340290:20:1882251:1120", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1340290", "t_dispatch_unix": 1779816709.9036098, "t_finish_unix": 1779816710.34957, "t_first_token_unix": 1779816710.0341103, "tpot_s": 0.006563480145511373, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436], "trace_timestamp_s": 2200.7930000000006, "ttft_s": 0.1304981280118227, "turn_id": 20} +{"actual_output_tokens": 355, "cached_tokens": 118784, "effective_input_length": 119030, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119030, "latency_s": 4.3841287980321795, "output_length": 355, "proxy_request_id": "1270606:12:1881189:1119", "request_id": "1270606:12:1881189:1119", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1270606", "t_dispatch_unix": 1779816706.4906366, "t_finish_unix": 1779816710.8747647, "t_first_token_unix": 1779816706.8972464, "tpot_s": 0.011235161742990005, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18428324, 18428325, 18428326, 18428327, 18428328, 18428329, 18428330, 18428331, 18428332, 18428333, 18428334, 18428335, 18428336, 18428337, 18428338, 18428339, 18428340, 18428341, 18428342, 18428343, 18428344, 18428345, 18428346, 18428347, 18428348, 18428349, 18428350, 18428351, 18428352, 18428353, 18428354, 18428355, 18428356, 18428357, 18428358, 18428359, 18428360, 18428361, 18428362, 18428363, 18428364, 18428365, 18428366, 18428367, 18428368, 18428369, 18428370, 18428371, 18428372, 18428373, 18428374, 18428375, 18428376, 18428377, 18428378, 18428379, 18428380, 18428381, 18428382, 18428383, 18428384, 18428385, 18428386, 18428387, 18428388, 18428389, 18428390, 18428391, 18428392, 18428393, 18428394, 18428395, 18428396, 18428397, 18428398, 18428399, 18428400, 18428401, 18428402, 18428403, 18428404, 18428405, 18428406, 18428407, 18428408, 18428409, 18428410, 18428411, 18428412, 18428413, 18428414, 18428415, 18428416, 18428417, 18428418, 18428419, 18428420, 18428421, 18428422, 18428423, 18428424, 18428425, 18428426, 18428427, 18428428, 18428429, 18428430, 18428431, 18428432, 18428433, 18428434, 18428435, 18428436], "trace_timestamp_s": 2197.3560000000007, "ttft_s": 0.40660795400617644, "turn_id": 12} +{"actual_output_tokens": 39, "cached_tokens": 40928, "effective_input_length": 41002, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41002, "latency_s": 0.3616289009805769, "output_length": 39, "proxy_request_id": "1340290:21:1883855:1121", "request_id": "1340290:21:1883855:1121", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1340290", "t_dispatch_unix": 1779816715.3724566, "t_finish_unix": 1779816715.734085, "t_first_token_unix": 1779816715.4900262, "tpot_s": 0.006415565920944668, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18454570], "trace_timestamp_s": 2206.2620000000006, "ttft_s": 0.11756719800177962, "turn_id": 21} +{"actual_output_tokens": 51, "cached_tokens": 41040, "effective_input_length": 41909, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41909, "latency_s": 0.678745960991364, "output_length": 51, "proxy_request_id": "1340290:22:1884847:1122", "request_id": "1340290:22:1884847:1122", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1340290", "t_dispatch_unix": 1779816718.8450303, "t_finish_unix": 1779816719.5237763, "t_first_token_unix": 1779816719.1932127, "tpot_s": 0.006605476159602403, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633], "trace_timestamp_s": 2209.7340000000004, "ttft_s": 0.34818017500219867, "turn_id": 22} +{"actual_output_tokens": 4631, "cached_tokens": 112912, "effective_input_length": 112926, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112926, "latency_s": 52.66676922800252, "output_length": 4631, "proxy_request_id": "1253804:55:1869941:1112", "request_id": "1253804:55:1869941:1112", "request_type": "coder", "requested_output_tokens": 4631, "session_id": "1253804", "t_dispatch_unix": 1779816667.8761082, "t_finish_unix": 1779816720.5428777, "t_first_token_unix": 1779816668.056504, "tpot_s": 0.011336092008418579, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 17676585, 17676586, 17676587, 17676588, 17676589, 17676590, 17676591, 17676592, 17676593, 17676594, 17676595, 17676596, 17676597, 17676598, 17676599, 17676600, 17676601, 17676602, 17676603, 17676604, 17676605, 17676606, 17676607, 17676608, 17676609, 17676610, 17676611, 17676612, 17676613, 17676614, 17676615, 17676616, 17676617, 17676618, 17676619, 17676620, 17676621, 17676622, 17676623, 17676624, 17676625, 17676626, 17676627, 17676628, 17676629, 5483415, 17676630, 17676631, 17676632, 17676633, 17676634, 17676635, 17676636, 17676637, 17676638, 17676639, 17676640, 17676641, 17676642, 17676643, 17676644, 17676645, 17676646, 17676647, 17676648, 17676649, 17676650, 17676651, 17676652, 17676653, 17676654, 17676655, 17676656, 17676657, 17676658, 17676659, 17676660, 17676661, 17676662, 17676663, 17676664, 17676665, 17676666, 17676667, 17676668, 17676669, 17676670, 17676671, 17676672, 17676673, 17676674, 17676675, 17676676, 17676677, 17676678, 17676679, 17676680, 17676681, 17676682, 17676683, 17676684, 17676685, 17676686, 17676687, 17676688, 17676689, 17676690, 17676691, 17676692, 17676693, 17676694, 17676695, 17676696, 17676697, 17676698, 17676699, 17676700, 17676701, 17676702, 17676703, 17676704, 17676705, 17676706, 17676707, 17676708, 18319657, 18319658, 18319659, 18319660, 18319661, 18319662, 18319663, 18319664, 18319665, 18319666, 18319667, 18319668, 18319669, 18319670, 18319671, 18319672, 18319673, 18319674, 18319675, 18319676, 18319677, 18319678, 18319679, 18319680, 18319681, 18319682, 18319683, 18319684, 18319685, 18319686, 18319687], "trace_timestamp_s": 2158.754000000001, "ttft_s": 0.18039253598544747, "turn_id": 55} +{"actual_output_tokens": 45, "cached_tokens": 41952, "effective_input_length": 42086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42086, "latency_s": 0.4096638660412282, "output_length": 45, "proxy_request_id": "1340290:23:1886013:1124", "request_id": "1340290:23:1886013:1124", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1340290", "t_dispatch_unix": 1779816722.8753316, "t_finish_unix": 1779816723.2849958, "t_first_token_unix": 1779816723.0073228, "tpot_s": 0.0063041038864122875, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18475697], "trace_timestamp_s": 2213.763, "ttft_s": 0.1319894500193186, "turn_id": 23} +{"actual_output_tokens": 98, "cached_tokens": 119376, "effective_input_length": 119440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119440, "latency_s": 1.2914451759424992, "output_length": 98, "proxy_request_id": "1270606:12:1886765:1125", "request_id": "1270606:12:1886765:1125", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1270606", "t_dispatch_unix": 1779816725.6137388, "t_finish_unix": 1779816726.9051833, "t_first_token_unix": 1779816725.8841946, "tpot_s": 0.010522925958623053, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18483775, 18483776, 18483777, 18483778, 18483779, 18483780, 18483781, 18483782, 18483783, 18483784, 18483785, 18483786, 18483787, 18483788, 18483789, 18483790, 18483791, 18483792, 18483793, 18483794, 18483795, 18483796, 18483797, 18483798, 18483799, 18483800, 18483801, 18483802, 18483803, 18483804, 18483805, 18483806, 18483807, 18483808, 18483809, 18483810, 18483811, 18483812, 18483813, 18483814, 18483815, 18483816, 18483817, 18483818, 18483819, 18483820, 18483821, 18483822, 18483823, 18483824, 18483825, 18483826, 18483827, 18483828, 18483829, 18483830, 18483831, 18483832, 18483833, 18483834, 18483835, 18483836, 18483837, 18483838, 18483839, 18483840, 18483841, 18483842, 18483843, 18483844, 18483845, 18483846, 18483847, 18483848, 18483849, 18483850, 18483851, 18483852, 18483853, 18483854, 18483855, 18483856, 18483857, 18483858, 18483859, 18483860, 18483861, 18483862, 18483863, 18483864, 18483865, 18483866, 18483867, 18483868, 18483869, 18483870, 18483871, 18483872, 18483873, 18483874, 18483875, 18483876, 18483877, 18483878, 18483879, 18483880, 18483881, 18483882, 18483883, 18483884, 18483885, 18483886, 18483887], "trace_timestamp_s": 2216.473, "ttft_s": 0.2704538839752786, "turn_id": 12} +{"actual_output_tokens": 28, "cached_tokens": 42128, "effective_input_length": 42199, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42199, "latency_s": 0.2904753860202618, "output_length": 28, "proxy_request_id": "1340290:24:1887125:1126", "request_id": "1340290:24:1887125:1126", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1340290", "t_dispatch_unix": 1779816726.6519046, "t_finish_unix": 1779816726.9423792, "t_first_token_unix": 1779816726.78026, "tpot_s": 0.0059962132967215165, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18487325], "trace_timestamp_s": 2217.541, "ttft_s": 0.1283532059751451, "turn_id": 24} +{"actual_output_tokens": 46, "cached_tokens": 42224, "effective_input_length": 42444, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42444, "latency_s": 0.4582702540210448, "output_length": 46, "proxy_request_id": "1340290:25:1888447:1127", "request_id": "1340290:25:1888447:1127", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1340290", "t_dispatch_unix": 1779816731.0447693, "t_finish_unix": 1779816731.5030391, "t_first_token_unix": 1779816731.2090952, "tpot_s": 0.006526007977986915, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279], "trace_timestamp_s": 2221.934, "ttft_s": 0.16432385297957808, "turn_id": 25} +{"actual_output_tokens": 1188, "cached_tokens": 58512, "effective_input_length": 63845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63845, "latency_s": 12.258852451981511, "output_length": 1188, "proxy_request_id": "1277428:20:1885419:1123", "request_id": "1277428:20:1885419:1123", "request_type": "coder", "requested_output_tokens": 1188, "session_id": "1277428", "t_dispatch_unix": 1779816720.759765, "t_finish_unix": 1779816733.0186176, "t_first_token_unix": 1779816723.0039895, "tpot_s": 0.008436655901390479, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 18468806, 18468807, 18468808, 18468809, 18468810, 18468811, 18468812, 18468813, 18468814, 18468815, 18468816, 18468817, 18468818], "trace_timestamp_s": 2211.6440000000002, "ttft_s": 2.2442225650302134, "turn_id": 20} +{"actual_output_tokens": 32, "cached_tokens": 42480, "effective_input_length": 48504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48504, "latency_s": 2.113975065003615, "output_length": 32, "proxy_request_id": "1340290:26:1889402:1128", "request_id": "1340290:26:1889402:1128", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1340290", "t_dispatch_unix": 1779816734.3647292, "t_finish_unix": 1779816736.478703, "t_first_token_unix": 1779816736.280417, "tpot_s": 0.006385846741332282, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944], "trace_timestamp_s": 2225.25, "ttft_s": 1.9156858390197158, "turn_id": 26} +{"actual_output_tokens": 87, "cached_tokens": 119536, "effective_input_length": 119686, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119686, "latency_s": 1.2934473700006492, "output_length": 87, "proxy_request_id": "1270606:13:1890252:1129", "request_id": "1270606:13:1890252:1129", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1270606", "t_dispatch_unix": 1779816737.3429163, "t_finish_unix": 1779816738.636363, "t_first_token_unix": 1779816737.7450194, "tpot_s": 0.010361010244598092, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18517741, 18517742, 18517743, 18517744, 18517745, 18517746, 18517747, 18517748, 18517749, 18517750, 18517751, 18517752, 18517753, 18517754, 18517755, 18517756, 18517757, 18517758, 18517759, 18517760, 18517761, 18517762, 18517763, 18517764, 18517765, 18517766, 18517767, 18517768, 18517769, 18517770, 18517771, 18517772, 18517773, 18517774, 18517775, 18517776, 18517777, 18517778, 18517779, 18517780, 18517781, 18517782, 18517783, 18517784, 18517785, 18517786, 18517787, 18517788, 18517789, 18517790, 18517791, 18517792, 18517793, 18517794, 18517795, 18517796, 18517797, 18517798, 18517799, 18517800, 18517801, 18517802, 18517803, 18517804, 18517805, 18517806, 18517807, 18517808, 18517809, 18517810, 18517811, 18517812, 18517813, 18517814, 18517815, 18517816, 18517817, 18517818, 18517819, 18517820, 18517821, 18517822, 18517823, 18517824, 18517825, 18517826, 18517827, 18517828, 18517829, 18517830, 18517831, 18517832, 18517833, 18517834, 18517835, 18517836, 18517837, 18517838, 18517839, 18517840, 18517841, 18517842, 18517843, 18517844, 18517845, 18517846, 18517847, 18517848, 18517849, 18517850, 18517851, 18517852, 18517853], "trace_timestamp_s": 2228.202, "ttft_s": 0.4021006979746744, "turn_id": 13} +{"actual_output_tokens": 47, "cached_tokens": 48528, "effective_input_length": 49361, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49361, "latency_s": 0.7012668530223891, "output_length": 47, "proxy_request_id": "1340290:27:1892591:1131", "request_id": "1340290:27:1892591:1131", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1340290", "t_dispatch_unix": 1779816744.9520047, "t_finish_unix": 1779816745.653271, "t_first_token_unix": 1779816745.3402984, "tpot_s": 0.0067928407832210805, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18539337], "trace_timestamp_s": 2235.84, "ttft_s": 0.3882918119779788, "turn_id": 27} +{"actual_output_tokens": 175, "cached_tokens": 119760, "effective_input_length": 119828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119828, "latency_s": 2.222667040012311, "output_length": 175, "proxy_request_id": "1270606:14:1892412:1130", "request_id": "1270606:14:1892412:1130", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1270606", "t_dispatch_unix": 1779816744.2830036, "t_finish_unix": 1779816746.5056696, "t_first_token_unix": 1779816744.578127, "tpot_s": 0.011075736172350081, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18537949, 18537950, 18537951, 18537952, 18537953, 18537954, 18537955, 18537956, 18537957, 18537958, 18537959, 18537960, 18537961, 18537962, 18537963, 18537964, 18537965, 18537966, 18537967, 18537968, 18537969, 18537970, 18537971, 18537972, 18537973, 18537974, 18537975, 18537976, 18537977, 18537978, 18537979, 18537980, 18537981, 18537982, 18537983, 18537984, 18537985, 18537986, 18537987, 18537988, 18537989, 18537990, 18537991, 18537992, 18537993, 18537994, 18537995, 18537996, 18537997, 18537998, 18537999, 18538000, 18538001, 18538002, 18538003, 18538004, 18538005, 18538006, 18538007, 18538008, 18538009, 18538010, 18538011, 18538012, 18538013, 18538014, 18538015, 18538016, 18538017, 18538018, 18538019, 18538020, 18538021, 18538022, 18538023, 18538024, 18538025, 18538026, 18538027, 18538028, 18538029, 18538030, 18538031, 18538032, 18538033, 18538034, 18538035, 18538036, 18538037, 18538038, 18538039, 18538040, 18538041, 18538042, 18538043, 18538044, 18538045, 18538046, 18538047, 18538048, 18538049, 18538050, 18538051, 18538052, 18538053, 18538054, 18538055, 18538056, 18538057, 18538058, 18538059, 18538060, 18538061, 18538062], "trace_timestamp_s": 2235.143, "ttft_s": 0.29511057201307267, "turn_id": 14} +{"actual_output_tokens": 38, "cached_tokens": 49392, "effective_input_length": 49454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49454, "latency_s": 0.3697163329925388, "output_length": 38, "proxy_request_id": "1340290:28:1893837:1132", "request_id": "1340290:28:1893837:1132", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1340290", "t_dispatch_unix": 1779816749.2590919, "t_finish_unix": 1779816749.628808, "t_first_token_unix": 1779816749.385831, "tpot_s": 0.006558456027100014, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462], "trace_timestamp_s": 2240.1460000000006, "ttft_s": 0.1267376120085828, "turn_id": 28} +{"actual_output_tokens": 80, "cached_tokens": 58912, "effective_input_length": 59265, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59265, "latency_s": 0.9321682250010781, "output_length": 80, "proxy_request_id": "1305906:9:1893880:1133", "request_id": "1305906:9:1893880:1133", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1305906", "t_dispatch_unix": 1779816749.42436, "t_finish_unix": 1779816750.356528, "t_first_token_unix": 1779816749.756078, "tpot_s": 0.007596951822420182, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509], "trace_timestamp_s": 2240.313, "ttft_s": 0.3317153740208596, "turn_id": 9} +{"actual_output_tokens": 91, "cached_tokens": 120000, "effective_input_length": 120058, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 120058, "latency_s": 1.2569762850180268, "output_length": 91, "proxy_request_id": "1270606:15:1895310:1134", "request_id": "1270606:15:1895310:1134", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1270606", "t_dispatch_unix": 1779816754.0725198, "t_finish_unix": 1779816755.3294957, "t_first_token_unix": 1779816754.3795345, "tpot_s": 0.010551604333644111, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18566130, 18566131, 18566132, 18566133, 18566134, 18566135, 18566136, 18566137, 18566138, 18566139, 18566140, 18566141, 18566142, 18566143, 18566144, 18566145, 18566146, 18566147, 18566148, 18566149, 18566150, 18566151, 18566152, 18566153, 18566154, 18566155, 18566156, 18566157, 18566158, 18566159, 18566160, 18566161, 18566162, 18566163, 18566164, 18566165, 18566166, 18566167, 18566168, 18566169, 18566170, 18566171, 18566172, 18566173, 18566174, 18566175, 18566176, 18566177, 18566178, 18566179, 18566180, 18566181, 18566182, 18566183, 18566184, 18566185, 18566186, 18566187, 18566188, 18566189, 18566190, 18566191, 18566192, 18566193, 18566194, 18566195, 18566196, 18566197, 18566198, 18566199, 18566200, 18566201, 18566202, 18566203, 18566204, 18566205, 18566206, 18566207, 18566208, 18566209, 18566210, 18566211, 18566212, 18566213, 18566214, 18566215, 18566216, 18566217, 18566218, 18566219, 18566220, 18566221, 18566222, 18566223, 18566224, 18566225, 18566226, 18566227, 18566228, 18566229, 18566230, 18566231, 18566232, 18566233, 18566234, 18566235, 18566236, 18566237, 18566238, 18566239, 18566240, 18566241, 18566242], "trace_timestamp_s": 2244.9320000000007, "ttft_s": 0.3070133790024556, "turn_id": 15} +{"actual_output_tokens": 200, "cached_tokens": 135632, "effective_input_length": 135905, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 135905, "latency_s": 3.016638186003547, "output_length": 200, "proxy_request_id": "1356885:13:1895311:1135", "request_id": "1356885:13:1895311:1135", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1356885", "t_dispatch_unix": 1779816754.0844047, "t_finish_unix": 1779816757.1010432, "t_first_token_unix": 1779816754.5633097, "tpot_s": 0.01275053172870703, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 18566244], "trace_timestamp_s": 2244.933, "ttft_s": 0.4789016980212182, "turn_id": 13} +{"actual_output_tokens": 37, "cached_tokens": 49488, "effective_input_length": 49576, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49576, "latency_s": 0.596905012964271, "output_length": 37, "proxy_request_id": "1340290:29:1896119:1136", "request_id": "1340290:29:1896119:1136", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1340290", "t_dispatch_unix": 1779816756.5848138, "t_finish_unix": 1779816757.1817183, "t_first_token_unix": 1779816756.7361434, "tpot_s": 0.01236956336005177, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462], "trace_timestamp_s": 2247.473, "ttft_s": 0.15132781100692227, "turn_id": 29} +{"actual_output_tokens": 200, "cached_tokens": 49600, "effective_input_length": 49695, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49695, "latency_s": 1.6073730300413445, "output_length": 200, "proxy_request_id": "1340290:30:1896991:1137", "request_id": "1340290:30:1896991:1137", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1340290", "t_dispatch_unix": 1779816759.5571609, "t_finish_unix": 1779816761.1645336, "t_first_token_unix": 1779816759.681803, "tpot_s": 0.007449516276279043, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18582285], "trace_timestamp_s": 2250.4440000000004, "ttft_s": 0.12463988404488191, "turn_id": 30} +{"actual_output_tokens": 89, "cached_tokens": 49888, "effective_input_length": 49927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49927, "latency_s": 0.7532330540125258, "output_length": 89, "proxy_request_id": "1340290:31:1899492:1138", "request_id": "1340290:31:1899492:1138", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1340290", "t_dispatch_unix": 1779816767.9414654, "t_finish_unix": 1779816768.694698, "t_first_token_unix": 1779816768.0524158, "tpot_s": 0.007295166874510786, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609], "trace_timestamp_s": 2258.8240000000005, "ttft_s": 0.11094871204113588, "turn_id": 31} +{"actual_output_tokens": 89, "cached_tokens": 120144, "effective_input_length": 120572, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 120572, "latency_s": 1.5540398790035397, "output_length": 89, "proxy_request_id": "1270606:16:1902252:1140", "request_id": "1270606:16:1902252:1140", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1270606", "t_dispatch_unix": 1779816776.4430315, "t_finish_unix": 1779816777.997071, "t_first_token_unix": 1779816777.0707319, "tpot_s": 0.010523337363503577, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18635959, 18635960, 18635961, 18635962, 18635963, 18635964, 18635965, 18635966, 18635967, 18635968, 18635969, 18635970, 18635971, 18635972, 18635973, 18635974, 18635975, 18635976, 18635977, 18635978, 18635979, 18635980, 18635981, 18635982, 18635983, 18635984, 18635985, 18635986, 18635987, 18635988, 18635989, 18635990, 18635991, 18635992, 18635993, 18635994, 18635995, 18635996, 18635997, 18635998, 18635999, 18636000, 18636001, 18636002, 18636003, 18636004, 18636005, 18636006, 18636007, 18636008, 18636009, 18636010, 18636011, 18636012, 18636013, 18636014, 18636015, 18636016, 18636017, 18636018, 18636019, 18636020, 18636021, 18636022, 18636023, 18636024, 18636025, 18636026, 18636027, 18636028, 18636029, 18636030, 18636031, 18636032, 18636033, 18636034, 18636035, 18636036, 18636037, 18636038, 18636039, 18636040, 18636041, 18636042, 18636043, 18636044, 18636045, 18636046, 18636047, 18636048, 18636049, 18636050, 18636051, 18636052, 18636053, 18636054, 18636055, 18636056, 18636057, 18636058, 18636059, 18636060, 18636061, 18636062, 18636063, 18636064, 18636065, 18636066, 18636067, 18636068, 18636069, 18636070, 18636071], "trace_timestamp_s": 2267.299, "ttft_s": 0.6276982090203092, "turn_id": 16} +{"actual_output_tokens": 60, "cached_tokens": 120656, "effective_input_length": 121006, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121006, "latency_s": 1.2152692190138623, "output_length": 60, "proxy_request_id": "1270606:17:1908800:1141", "request_id": "1270606:17:1908800:1141", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1270606", "t_dispatch_unix": 1779816798.03011, "t_finish_unix": 1779816799.2453785, "t_first_token_unix": 1779816798.656496, "tpot_s": 0.009976279982997074, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18700457, 18700458, 18700459, 18700460, 18700461, 18700462, 18700463, 18700464, 18700465, 18700466, 18700467, 18700468, 18700469, 18700470, 18700471, 18700472, 18700473, 18700474, 18700475, 18700476, 18700477, 18700478, 18700479, 18700480, 18700481, 18700482, 18700483, 18700484, 18700485, 18700486, 18700487, 18700488, 18700489, 18700490, 18700491, 18700492, 18700493, 18700494, 18700495, 18700496, 18700497, 18700498, 18700499, 18700500, 18700501, 18700502, 18700503, 18700504, 18700505, 18700506, 18700507, 18700508, 18700509, 18700510, 18700511, 18700512, 18700513, 18700514, 18700515, 18700516, 18700517, 18700518, 18700519, 18700520, 18700521, 18700522, 18700523, 18700524, 18700525, 18700526, 18700527, 18700528, 18700529, 18700530, 18700531, 18700532, 18700533, 18700534, 18700535, 18700536, 18700537, 18700538, 18700539, 18700540, 18700541, 18700542, 18700543, 18700544, 18700545, 18700546, 18700547, 18700548, 18700549, 18700550, 18700551, 18700552, 18700553, 18700554, 18700555, 18700556, 18700557, 18700558, 18700559, 18700560, 18700561, 18700562, 18700563, 18700564, 18700565, 18700566, 18700567, 18700568, 18700569], "trace_timestamp_s": 2288.8940000000002, "ttft_s": 0.6263843239867128, "turn_id": 17} +{"actual_output_tokens": 3883, "cached_tokens": 50000, "effective_input_length": 50078, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50078, "latency_s": 30.352339201024733, "output_length": 3883, "proxy_request_id": "1340290:32:1901260:1139", "request_id": "1340290:32:1901260:1139", "request_type": "coder", "requested_output_tokens": 3883, "session_id": "1340290", "t_dispatch_unix": 1779816773.3522964, "t_finish_unix": 1779816803.7046351, "t_first_token_unix": 1779816773.4899733, "tpot_s": 0.007783140477848286, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609], "trace_timestamp_s": 2264.237, "ttft_s": 0.13767490099417046, "turn_id": 32} +{"actual_output_tokens": 82, "cached_tokens": 121056, "effective_input_length": 121288, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121288, "latency_s": 1.2536816900246777, "output_length": 82, "proxy_request_id": "1270606:18:1915824:1142", "request_id": "1270606:18:1915824:1142", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1270606", "t_dispatch_unix": 1779816821.0105193, "t_finish_unix": 1779816822.2642007, "t_first_token_unix": 1779816821.4189599, "tpot_s": 0.010431640864102698, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18770157, 18770158, 18770159, 18770160, 18770161, 18770162, 18770163, 18770164, 18770165, 18770166, 18770167, 18770168, 18770169, 18770170, 18770171, 18770172, 18770173, 18770174, 18770175, 18770176, 18770177, 18770178, 18770179, 18770180, 18770181, 18770182, 18770183, 18770184, 18770185, 18770186, 18770187, 18770188, 18770189, 18770190, 18770191, 18770192, 18770193, 18770194, 18770195, 18770196, 18770197, 18770198, 18770199, 18770200, 18770201, 18770202, 18770203, 18770204, 18770205, 18770206, 18770207, 18770208, 18770209, 18770210, 18770211, 18770212, 18770213, 18770214, 18770215, 18770216, 18770217, 18770218, 18770219, 18770220, 18770221, 18770222, 18770223, 18770224, 18770225, 18770226, 18770227, 18770228, 18770229, 18770230, 18770231, 18770232, 18770233, 18770234, 18770235, 18770236, 18770237, 18770238, 18770239, 18770240, 18770241, 18770242, 18770243, 18770244, 18770245, 18770246, 18770247, 18770248, 18770249, 18770250, 18770251, 18770252, 18770253, 18770254, 18770255, 18770256, 18770257, 18770258, 18770259, 18770260, 18770261, 18770262, 18770263, 18770264, 18770265, 18770266, 18770267, 18770268, 18770269], "trace_timestamp_s": 2311.8590000000004, "ttft_s": 0.40843829803634435, "turn_id": 18} +{"actual_output_tokens": 91, "cached_tokens": 121360, "effective_input_length": 121560, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121560, "latency_s": 1.360497004003264, "output_length": 91, "proxy_request_id": "1270606:19:1920499:1143", "request_id": "1270606:19:1920499:1143", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1270606", "t_dispatch_unix": 1779816836.1627874, "t_finish_unix": 1779816837.5232835, "t_first_token_unix": 1779816836.5731137, "tpot_s": 0.010554046566701598, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18814461, 18814462, 18814463, 18814464, 18814465, 18814466, 18814467, 18814468, 18814469, 18814470, 18814471, 18814472, 18814473, 18814474, 18814475, 18814476, 18814477, 18814478, 18814479, 18814480, 18814481, 18814482, 18814483, 18814484, 18814485, 18814486, 18814487, 18814488, 18814489, 18814490, 18814491, 18814492, 18814493, 18814494, 18814495, 18814496, 18814497, 18814498, 18814499, 18814500, 18814501, 18814502, 18814503, 18814504, 18814505, 18814506, 18814507, 18814508, 18814509, 18814510, 18814511, 18814512, 18814513, 18814514, 18814515, 18814516, 18814517, 18814518, 18814519, 18814520, 18814521, 18814522, 18814523, 18814524, 18814525, 18814526, 18814527, 18814528, 18814529, 18814530, 18814531, 18814532, 18814533, 18814534, 18814535, 18814536, 18814537, 18814538, 18814539, 18814540, 18814541, 18814542, 18814543, 18814544, 18814545, 18814546, 18814547, 18814548, 18814549, 18814550, 18814551, 18814552, 18814553, 18814554, 18814555, 18814556, 18814557, 18814558, 18814559, 18814560, 18814561, 18814562, 18814563, 18814564, 18814565, 18814566, 18814567, 18814568, 18814569, 18814570, 18814571, 18814572, 18814573, 18814574], "trace_timestamp_s": 2327.013, "ttft_s": 0.4103247890016064, "turn_id": 19} +{"actual_output_tokens": 120, "cached_tokens": 121648, "effective_input_length": 121704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121704, "latency_s": 1.5771730879787356, "output_length": 120, "proxy_request_id": "1270606:20:1922639:1144", "request_id": "1270606:20:1922639:1144", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1270606", "t_dispatch_unix": 1779816843.5986807, "t_finish_unix": 1779816845.1758537, "t_first_token_unix": 1779816843.8897212, "tpot_s": 0.01080538222699293, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18814461, 18833388, 18833389, 18833390, 18833391, 18833392, 18833393, 18833394, 18833395, 18833396, 18833397, 18833398, 18833399, 18833400, 18833401, 18833402, 18833403, 18833404, 18833405, 18833406, 18833407, 18833408, 18833409, 18833410, 18833411, 18833412, 18833413, 18833414, 18833415, 18833416, 18833417, 18833418, 18833419, 18833420, 18833421, 18833422, 18833423, 18833424, 18833425, 18833426, 18833427, 18833428, 18833429, 18833430, 18833431, 18833432, 18833433, 18833434, 18833435, 18833436, 18833437, 18833438, 18833439, 18833440, 18833441, 18833442, 18833443, 18833444, 18833445, 18833446, 18833447, 18833448, 18833449, 18833450, 18833451, 18833452, 18833453, 18833454, 18833455, 18833456, 18833457, 18833458, 18833459, 18833460, 18833461, 18833462, 18833463, 18833464, 18833465, 18833466, 18833467, 18833468, 18833469, 18833470, 18833471, 18833472, 18833473, 18833474, 18833475, 18833476, 18833477, 18833478, 18833479, 18833480, 18833481, 18833482, 18833483, 18833484, 18833485, 18833486, 18833487, 18833488, 18833489, 18833490, 18833491, 18833492, 18833493, 18833494, 18833495, 18833496, 18833497, 18833498, 18833499, 18833500], "trace_timestamp_s": 2334.46, "ttft_s": 0.29103808995569125, "turn_id": 20} +{"actual_output_tokens": 48, "cached_tokens": 59344, "effective_input_length": 61801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61801, "latency_s": 1.3938489760039374, "output_length": 48, "proxy_request_id": "1305906:10:1928316:1145", "request_id": "1305906:10:1928316:1145", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1305906", "t_dispatch_unix": 1779816862.1715558, "t_finish_unix": 1779816863.5654037, "t_first_token_unix": 1779816863.2448363, "tpot_s": 0.006814971000223638, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509, 18736108, 18851869, 18889037, 18889038, 18889039], "trace_timestamp_s": 2353.0420000000004, "ttft_s": 1.0732793000061065, "turn_id": 10} +{"actual_output_tokens": 142, "cached_tokens": 53952, "effective_input_length": 53990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53990, "latency_s": 1.1886660659802146, "output_length": 142, "proxy_request_id": "1340290:33:1939781:1146", "request_id": "1340290:33:1939781:1146", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1340290", "t_dispatch_unix": 1779816899.9320219, "t_finish_unix": 1779816901.120688, "t_first_token_unix": 1779816900.0493512, "tpot_s": 0.007595959588462579, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 18997503], "trace_timestamp_s": 2390.7840000000006, "ttft_s": 0.11732637899694964, "turn_id": 33} +{"actual_output_tokens": 314, "cached_tokens": 54128, "effective_input_length": 54164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54164, "latency_s": 2.5495433419710025, "output_length": 314, "proxy_request_id": "1340290:34:1942249:1147", "request_id": "1340290:34:1942249:1147", "request_type": "coder", "requested_output_tokens": 314, "session_id": "1340290", "t_dispatch_unix": 1779816907.772676, "t_finish_unix": 1779816910.3222187, "t_first_token_unix": 1779816907.8865788, "tpot_s": 0.007778669303556839, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002], "trace_timestamp_s": 2398.6550000000007, "ttft_s": 0.11389901797519997, "turn_id": 34} +{"actual_output_tokens": 142, "cached_tokens": 136096, "effective_input_length": 136210, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136210, "latency_s": 2.0389045999618247, "output_length": 142, "proxy_request_id": "1356885:14:1948151:1148", "request_id": "1356885:14:1948151:1148", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1356885", "t_dispatch_unix": 1779816927.5288217, "t_finish_unix": 1779816929.5677264, "t_first_token_unix": 1779816927.9012587, "tpot_s": 0.011816701311816244, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19076313], "trace_timestamp_s": 2418.398, "ttft_s": 0.37243471801048145, "turn_id": 14} +{"actual_output_tokens": 480, "cached_tokens": 54464, "effective_input_length": 54498, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54498, "latency_s": 3.8644524630508386, "output_length": 480, "proxy_request_id": "1340290:35:1964727:1149", "request_id": "1340290:35:1964727:1149", "request_type": "coder", "requested_output_tokens": 480, "session_id": "1340290", "t_dispatch_unix": 1779816982.2546759, "t_finish_unix": 1779816986.119128, "t_first_token_unix": 1779816982.3698196, "tpot_s": 0.007826744640875016, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19236085], "trace_timestamp_s": 2473.0910000000003, "ttft_s": 0.11514195601921529, "turn_id": 35} +{"actual_output_tokens": 62, "cached_tokens": 54800, "effective_input_length": 54811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54811, "latency_s": 0.5400746479863301, "output_length": 62, "proxy_request_id": "1340290:36:1969509:1150", "request_id": "1340290:36:1969509:1150", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1340290", "t_dispatch_unix": 1779816997.998032, "t_finish_unix": 1779816998.538106, "t_first_token_unix": 1779816998.0957837, "tpot_s": 0.007246649000587583, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19281054], "trace_timestamp_s": 2488.8830000000007, "ttft_s": 0.09774981398368254, "turn_id": 36} +{"actual_output_tokens": 62, "cached_tokens": 54864, "effective_input_length": 55358, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55358, "latency_s": 0.7621544799767435, "output_length": 62, "proxy_request_id": "1340290:37:1971106:1151", "request_id": "1340290:37:1971106:1151", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1340290", "t_dispatch_unix": 1779817003.1497638, "t_finish_unix": 1779817003.9119186, "t_first_token_unix": 1779817003.4628675, "tpot_s": 0.007357021180157107, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19296412], "trace_timestamp_s": 2494.0340000000006, "ttft_s": 0.3131006669718772, "turn_id": 37} +{"actual_output_tokens": 87, "cached_tokens": 55408, "effective_input_length": 56006, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56006, "latency_s": 0.9729645249899477, "output_length": 87, "proxy_request_id": "1340290:38:1972289:1152", "request_id": "1340290:38:1972289:1152", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779817007.0789373, "t_finish_unix": 1779817008.051901, "t_first_token_unix": 1779817007.402629, "tpot_s": 0.007546424709374172, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19308727], "trace_timestamp_s": 2497.964, "ttft_s": 0.3236898480099626, "turn_id": 38} +{"actual_output_tokens": 87, "cached_tokens": 56080, "effective_input_length": 56242, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56242, "latency_s": 0.8522764609660953, "output_length": 87, "proxy_request_id": "1340290:39:1973889:1153", "request_id": "1340290:39:1973889:1153", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779817012.5047789, "t_finish_unix": 1779817013.3570547, "t_first_token_unix": 1779817012.708904, "tpot_s": 0.007533314965427095, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773], "trace_timestamp_s": 2503.389, "ttft_s": 0.20412281097378582, "turn_id": 39} +{"actual_output_tokens": 65, "cached_tokens": 56320, "effective_input_length": 56416, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56416, "latency_s": 0.6058495719917119, "output_length": 65, "proxy_request_id": "1340290:40:1975278:1154", "request_id": "1340290:40:1975278:1154", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779817017.0675788, "t_finish_unix": 1779817017.6734285, "t_first_token_unix": 1779817017.2005923, "tpot_s": 0.007383791780739557, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19337746], "trace_timestamp_s": 2507.952, "ttft_s": 0.13301127700833604, "turn_id": 40} +{"actual_output_tokens": 250, "cached_tokens": 56480, "effective_input_length": 57181, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57181, "latency_s": 2.3899466120055877, "output_length": 250, "proxy_request_id": "1340290:41:1977055:1156", "request_id": "1340290:41:1977055:1156", "request_type": "coder", "requested_output_tokens": 250, "session_id": "1340290", "t_dispatch_unix": 1779817023.0019348, "t_finish_unix": 1779817025.3918815, "t_first_token_unix": 1779817023.4339104, "tpot_s": 0.00786125079923156, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819], "trace_timestamp_s": 2513.8910000000005, "ttft_s": 0.4319730519782752, "turn_id": 41} +{"actual_output_tokens": 677, "cached_tokens": 65024, "effective_input_length": 67793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 67793, "latency_s": 7.10095148102846, "output_length": 677, "proxy_request_id": "1277428:21:1976968:1155", "request_id": "1277428:21:1976968:1155", "request_type": "coder", "requested_output_tokens": 677, "session_id": "1277428", "t_dispatch_unix": 1779817022.7145767, "t_finish_unix": 1779817029.8155272, "t_first_token_unix": 1779817023.9891658, "tpot_s": 0.008618476644940894, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19354134, 19354135, 19354136, 19354137, 19354138, 19354139, 19354140, 19354141, 19354142, 19354143, 19354144], "trace_timestamp_s": 2513.5970000000007, "ttft_s": 1.2745875290129334, "turn_id": 21} +{"actual_output_tokens": 66, "cached_tokens": 57424, "effective_input_length": 57463, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57463, "latency_s": 0.5951590310432948, "output_length": 66, "proxy_request_id": "1340290:42:1982198:1157", "request_id": "1340290:42:1982198:1157", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1340290", "t_dispatch_unix": 1779817039.9078825, "t_finish_unix": 1779817040.5030413, "t_first_token_unix": 1779817040.023514, "tpot_s": 0.007373215461400552, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19402723], "trace_timestamp_s": 2530.7870000000003, "ttft_s": 0.11562966601923108, "turn_id": 42} +{"actual_output_tokens": 68, "cached_tokens": 57520, "effective_input_length": 57640, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57640, "latency_s": 0.6749803050188348, "output_length": 68, "proxy_request_id": "1340290:43:1983901:1158", "request_id": "1340290:43:1983901:1158", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779817045.301835, "t_finish_unix": 1779817045.9768157, "t_first_token_unix": 1779817045.4908745, "tpot_s": 0.007248197657007502, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878], "trace_timestamp_s": 2536.1860000000006, "ttft_s": 0.18903794902144, "turn_id": 43} +{"actual_output_tokens": 92, "cached_tokens": 57696, "effective_input_length": 57809, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57809, "latency_s": 0.875815395032987, "output_length": 92, "proxy_request_id": "1340290:44:1986230:1159", "request_id": "1340290:44:1986230:1159", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1340290", "t_dispatch_unix": 1779817053.3845043, "t_finish_unix": 1779817054.2603195, "t_first_token_unix": 1779817053.5597303, "tpot_s": 0.007695834131931866, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878], "trace_timestamp_s": 2544.2660000000005, "ttft_s": 0.17522359400754794, "turn_id": 44} +{"actual_output_tokens": 45, "cached_tokens": 68464, "effective_input_length": 69987, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69987, "latency_s": 1.1203942489810288, "output_length": 45, "proxy_request_id": "1277428:21:1989132:1160", "request_id": "1277428:21:1989132:1160", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779817062.8019898, "t_finish_unix": 1779817063.9223838, "t_first_token_unix": 1779817063.5913613, "tpot_s": 0.00751660997709471, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19467851, 19467852, 19467853, 19467854, 19467855, 19467856, 19467857, 19467858, 19467859, 19467860, 19467861, 19467862, 19467863, 19467864, 19467865], "trace_timestamp_s": 2553.679, "ttft_s": 0.7893689589691348, "turn_id": 21} +{"actual_output_tokens": 52, "cached_tokens": 70016, "effective_input_length": 70055, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70055, "latency_s": 0.5347019759938121, "output_length": 52, "proxy_request_id": "1277428:22:1990436:1161", "request_id": "1277428:22:1990436:1161", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1277428", "t_dispatch_unix": 1779817067.3425264, "t_finish_unix": 1779817067.8772283, "t_first_token_unix": 1779817067.4812512, "tpot_s": 0.007758816372027949, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19467851, 19467852, 19467853, 19467854, 19479910, 19479911, 19479912, 19479913, 19479914, 19479915, 19479916, 19479917, 19479918, 19479919, 19479920], "trace_timestamp_s": 2558.2250000000004, "ttft_s": 0.1387225550133735, "turn_id": 22} +{"actual_output_tokens": 36, "cached_tokens": 57888, "effective_input_length": 58053, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58053, "latency_s": 0.4511066930135712, "output_length": 36, "proxy_request_id": "1340290:45:1991694:1162", "request_id": "1340290:45:1991694:1162", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779817071.3568633, "t_finish_unix": 1779817071.8079698, "t_first_token_unix": 1779817071.5649877, "tpot_s": 0.006933641827864838, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19491520], "trace_timestamp_s": 2562.2430000000004, "ttft_s": 0.20812234201002866, "turn_id": 45} +{"actual_output_tokens": 56, "cached_tokens": 58080, "effective_input_length": 58122, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58122, "latency_s": 0.5232748489943333, "output_length": 56, "proxy_request_id": "1340290:46:1992980:1163", "request_id": "1340290:46:1992980:1163", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1340290", "t_dispatch_unix": 1779817075.5823803, "t_finish_unix": 1779817076.1056547, "t_first_token_unix": 1779817075.7181437, "tpot_s": 0.007039814036000859, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2566.4670000000006, "ttft_s": 0.13576128403656185, "turn_id": 46} +{"actual_output_tokens": 36, "cached_tokens": 58176, "effective_input_length": 58307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58307, "latency_s": 0.39992390002589673, "output_length": 36, "proxy_request_id": "1340290:47:1995358:1164", "request_id": "1340290:47:1995358:1164", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779817083.4455547, "t_finish_unix": 1779817083.8454778, "t_first_token_unix": 1779817083.6077805, "tpot_s": 0.006783281798873629, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2574.327, "ttft_s": 0.1622231260407716, "turn_id": 47} +{"actual_output_tokens": 251, "cached_tokens": 58336, "effective_input_length": 58339, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58339, "latency_s": 2.098022930964362, "output_length": 251, "proxy_request_id": "1340290:48:1996945:1165", "request_id": "1340290:48:1996945:1165", "request_type": "coder", "requested_output_tokens": 251, "session_id": "1340290", "t_dispatch_unix": 1779817088.7496839, "t_finish_unix": 1779817090.8477066, "t_first_token_unix": 1779817088.863035, "tpot_s": 0.007937475108075886, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2579.634, "ttft_s": 0.11334872397128493, "turn_id": 48} +{"actual_output_tokens": 140, "cached_tokens": 136336, "effective_input_length": 136653, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136653, "latency_s": 2.336787252977956, "output_length": 140, "proxy_request_id": "1356885:15:1998292:1166", "request_id": "1356885:15:1998292:1166", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1356885", "t_dispatch_unix": 1779817093.2117698, "t_finish_unix": 1779817095.5485566, "t_first_token_unix": 1779817093.913014, "tpot_s": 0.011764305000102965, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016], "trace_timestamp_s": 2584.094, "ttft_s": 0.7012416899669915, "turn_id": 15} +{"actual_output_tokens": 78, "cached_tokens": 58576, "effective_input_length": 58622, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58622, "latency_s": 0.7043132329708897, "output_length": 78, "proxy_request_id": "1340290:48:1999591:1167", "request_id": "1340290:48:1999591:1167", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1340290", "t_dispatch_unix": 1779817097.7631114, "t_finish_unix": 1779817098.4674242, "t_first_token_unix": 1779817097.8858438, "tpot_s": 0.007549436454503954, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958], "trace_timestamp_s": 2588.652, "ttft_s": 0.12273005000315607, "turn_id": 48} +{"actual_output_tokens": 68, "cached_tokens": 58688, "effective_input_length": 58808, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58808, "latency_s": 0.6788143260055222, "output_length": 68, "proxy_request_id": "1340290:48:2001313:1168", "request_id": "1340290:48:2001313:1168", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779817103.2314136, "t_finish_unix": 1779817103.9102278, "t_first_token_unix": 1779817103.4073558, "tpot_s": 0.007501551925739858, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958], "trace_timestamp_s": 2594.116, "ttft_s": 0.17594049900071695, "turn_id": 48} +{"actual_output_tokens": 113, "cached_tokens": 58864, "effective_input_length": 58977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58977, "latency_s": 1.046512549975887, "output_length": 113, "proxy_request_id": "1340290:48:2003195:1169", "request_id": "1340290:48:2003195:1169", "request_type": "coder", "requested_output_tokens": 113, "session_id": "1340290", "t_dispatch_unix": 1779817109.556389, "t_finish_unix": 1779817110.6029012, "t_first_token_unix": 1779817109.7321503, "tpot_s": 0.007772266526964293, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19598292], "trace_timestamp_s": 2600.4390000000003, "ttft_s": 0.1757590799825266, "turn_id": 48} +{"actual_output_tokens": 108, "cached_tokens": 59088, "effective_input_length": 59220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59220, "latency_s": 0.9905660630320199, "output_length": 108, "proxy_request_id": "1340290:48:2005449:1170", "request_id": "1340290:48:2005449:1170", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1340290", "t_dispatch_unix": 1779817116.9458845, "t_finish_unix": 1779817117.9364498, "t_first_token_unix": 1779817117.106634, "tpot_s": 0.00775273460742504, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999], "trace_timestamp_s": 2607.8280000000004, "ttft_s": 0.16074742301134393, "turn_id": 48} +{"actual_output_tokens": 52, "cached_tokens": 59312, "effective_input_length": 59487, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59487, "latency_s": 0.586136556987185, "output_length": 52, "proxy_request_id": "1340290:48:2007287:1171", "request_id": "1340290:48:2007287:1171", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1340290", "t_dispatch_unix": 1779817123.0703511, "t_finish_unix": 1779817123.6564875, "t_first_token_unix": 1779817123.2854757, "tpot_s": 0.007269718705941283, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19641799], "trace_timestamp_s": 2613.9540000000006, "ttft_s": 0.21512262598844245, "turn_id": 48} +{"actual_output_tokens": 88, "cached_tokens": 59536, "effective_input_length": 60935, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60935, "latency_s": 1.3663631019880995, "output_length": 88, "proxy_request_id": "1340290:48:2008380:1173", "request_id": "1340290:48:2008380:1173", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1340290", "t_dispatch_unix": 1779817127.172146, "t_finish_unix": 1779817128.5385087, "t_first_token_unix": 1779817127.8629923, "tpot_s": 0.00776109233332648, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19653243], "trace_timestamp_s": 2618.0600000000004, "ttft_s": 0.6908435359946452, "turn_id": 48} +{"actual_output_tokens": 278, "cached_tokens": 61840, "effective_input_length": 66506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66506, "latency_s": 4.288855254009832, "output_length": 278, "proxy_request_id": "1305906:11:2008110:1172", "request_id": "1305906:11:2008110:1172", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1305906", "t_dispatch_unix": 1779817126.1611757, "t_finish_unix": 1779817130.4500303, "t_first_token_unix": 1779817128.131905, "tpot_s": 0.008367627144233065, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509, 18736108, 18851869, 18889037, 18889038, 18889039, 19018877, 19530559, 19650064, 19650065, 19650066, 19650067, 19650068, 19650069, 19650070], "trace_timestamp_s": 2617.0460000000003, "ttft_s": 1.9707275580149144, "turn_id": 11} +{"actual_output_tokens": 128, "cached_tokens": 61008, "effective_input_length": 61080, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61080, "latency_s": 1.1647707580123097, "output_length": 128, "proxy_request_id": "1340290:48:2010180:1174", "request_id": "1340290:48:2010180:1174", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1340290", "t_dispatch_unix": 1779817133.0276155, "t_finish_unix": 1779817134.1923864, "t_first_token_unix": 1779817133.1843443, "tpot_s": 0.007935213432903952, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19669693], "trace_timestamp_s": 2623.916, "ttft_s": 0.15672615700168535, "turn_id": 48} +{"actual_output_tokens": 68, "cached_tokens": 61200, "effective_input_length": 61365, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61365, "latency_s": 0.7294846980366856, "output_length": 68, "proxy_request_id": "1340290:48:2012871:1175", "request_id": "1340290:48:2012871:1175", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779817141.7089155, "t_finish_unix": 1779817142.4383998, "t_first_token_unix": 1779817141.9293654, "tpot_s": 0.0075932468510052165, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456], "trace_timestamp_s": 2632.5910000000003, "ttft_s": 0.22044791601365432, "turn_id": 48} +{"actual_output_tokens": 65, "cached_tokens": 61424, "effective_input_length": 61518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61518, "latency_s": 0.6283312090090476, "output_length": 65, "proxy_request_id": "1340290:48:2014153:1176", "request_id": "1340290:48:2014153:1176", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779817146.1048079, "t_finish_unix": 1779817146.7331393, "t_first_token_unix": 1779817146.247726, "tpot_s": 0.007580227296784869, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19707873], "trace_timestamp_s": 2636.992, "ttft_s": 0.14291621901793405, "turn_id": 48} +{"actual_output_tokens": 281, "cached_tokens": 61568, "effective_input_length": 69113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69113, "latency_s": 5.676336758013349, "output_length": 281, "proxy_request_id": "1340290:48:2015982:1177", "request_id": "1340290:48:2015982:1177", "request_type": "coder", "requested_output_tokens": 281, "session_id": "1340290", "t_dispatch_unix": 1779817152.2027557, "t_finish_unix": 1779817157.8790925, "t_first_token_unix": 1779817155.4630666, "tpot_s": 0.008627394264372664, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875], "trace_timestamp_s": 2643.0860000000002, "ttft_s": 3.2603083699941635, "turn_id": 48} +{"actual_output_tokens": 72, "cached_tokens": 69392, "effective_input_length": 69426, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69426, "latency_s": 0.7134489250020124, "output_length": 72, "proxy_request_id": "1340290:48:2018973:1178", "request_id": "1340290:48:2018973:1178", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1340290", "t_dispatch_unix": 1779817161.9881155, "t_finish_unix": 1779817162.7015638, "t_first_token_unix": 1779817162.12587, "tpot_s": 0.008104061112660443, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176], "trace_timestamp_s": 2652.8720000000003, "ttft_s": 0.1377523909904994, "turn_id": 48} +{"actual_output_tokens": 70, "cached_tokens": 69488, "effective_input_length": 69601, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69601, "latency_s": 0.7592862040037289, "output_length": 70, "proxy_request_id": "1340290:48:2020779:1179", "request_id": "1340290:48:2020779:1179", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1340290", "t_dispatch_unix": 1779817168.0410035, "t_finish_unix": 1779817168.8002896, "t_first_token_unix": 1779817168.2436547, "tpot_s": 0.008063326260763342, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176], "trace_timestamp_s": 2658.928000000001, "ttft_s": 0.20264893403509632, "turn_id": 48} +{"actual_output_tokens": 106, "cached_tokens": 69664, "effective_input_length": 69951, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69951, "latency_s": 1.1281783419544809, "output_length": 106, "proxy_request_id": "1340290:48:2023753:1180", "request_id": "1340290:48:2023753:1180", "request_type": "coder", "requested_output_tokens": 106, "session_id": "1340290", "t_dispatch_unix": 1779817177.663593, "t_finish_unix": 1779817178.7917712, "t_first_token_unix": 1779817177.9201207, "tpot_s": 0.008298847905271465, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067], "trace_timestamp_s": 2668.5430000000006, "ttft_s": 0.25652586395153776, "turn_id": 48} +{"actual_output_tokens": 65, "cached_tokens": 70048, "effective_input_length": 70342, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70342, "latency_s": 0.7707855890039355, "output_length": 65, "proxy_request_id": "1340290:48:2026751:1181", "request_id": "1340290:48:2026751:1181", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779817187.9414911, "t_finish_unix": 1779817188.7122765, "t_first_token_unix": 1779817188.2019234, "tpot_s": 0.00797016868727951, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19829875], "trace_timestamp_s": 2678.8200000000006, "ttft_s": 0.2604295019991696, "turn_id": 48} +{"actual_output_tokens": 107, "cached_tokens": 70400, "effective_input_length": 70503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70503, "latency_s": 1.0835095010115765, "output_length": 107, "proxy_request_id": "1340290:48:2028652:1182", "request_id": "1340290:48:2028652:1182", "request_type": "coder", "requested_output_tokens": 107, "session_id": "1340290", "t_dispatch_unix": 1779817194.1893473, "t_finish_unix": 1779817195.2728565, "t_first_token_unix": 1779817194.3910422, "tpot_s": 0.008316513820867634, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190], "trace_timestamp_s": 2685.077, "ttft_s": 0.2016928960219957, "turn_id": 48} +{"actual_output_tokens": 78, "cached_tokens": 70608, "effective_input_length": 70851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70851, "latency_s": 0.8797696850378998, "output_length": 78, "proxy_request_id": "1340290:48:2033065:1183", "request_id": "1340290:48:2033065:1183", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1340290", "t_dispatch_unix": 1779817208.921239, "t_finish_unix": 1779817209.801008, "t_first_token_unix": 1779817209.179154, "tpot_s": 0.008072425532699018, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19891018], "trace_timestamp_s": 2699.7960000000003, "ttft_s": 0.257912966015283, "turn_id": 48} +{"actual_output_tokens": 64, "cached_tokens": 70928, "effective_input_length": 71067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71067, "latency_s": 0.6881162900244817, "output_length": 64, "proxy_request_id": "1340290:48:2034908:1184", "request_id": "1340290:48:2034908:1184", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1340290", "t_dispatch_unix": 1779817215.1433358, "t_finish_unix": 1779817215.8314517, "t_first_token_unix": 1779817215.32989, "tpot_s": 0.007957025492076008, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243], "trace_timestamp_s": 2706.0260000000007, "ttft_s": 0.18655193399172276, "turn_id": 48} +{"actual_output_tokens": 193, "cached_tokens": 7840, "effective_input_length": 7844, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7844, "latency_s": 1.048001540999394, "output_length": 193, "proxy_request_id": "1258908:2:2035438:1185", "request_id": "1258908:2:2035438:1185", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1258908", "t_dispatch_unix": 1779817216.959265, "t_finish_unix": 1779817218.0072665, "t_first_token_unix": 1779817216.989183, "tpot_s": 0.005301084755349923, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 19912315], "trace_timestamp_s": 2707.849, "ttft_s": 0.029916693980339915, "turn_id": 2} +{"actual_output_tokens": 125, "cached_tokens": 8032, "effective_input_length": 9120, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9120, "latency_s": 0.817471923015546, "output_length": 125, "proxy_request_id": "1258908:3:1388683:699", "request_id": "1258908:3:1388683:699", "request_type": "coder", "requested_output_tokens": 125, "session_id": "1258908", "t_dispatch_unix": 1779817218.008331, "t_finish_unix": 1779817218.825803, "t_first_token_unix": 1779817218.1558182, "tpot_s": 0.00540084017754247, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 13752030], "trace_timestamp_s": 527.4590000000007, "ttft_s": 0.14748561399756, "turn_id": 3} +{"actual_output_tokens": 87, "cached_tokens": 71120, "effective_input_length": 71240, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71240, "latency_s": 0.909965472004842, "output_length": 87, "proxy_request_id": "1340290:48:2036994:1186", "request_id": "1340290:48:2036994:1186", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779817222.0848324, "t_finish_unix": 1779817222.9947975, "t_first_token_unix": 1779817222.29056, "tpot_s": 0.008185567813492271, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19926625], "trace_timestamp_s": 2712.9700000000003, "ttft_s": 0.20572485303273425, "turn_id": 48} +{"actual_output_tokens": 133, "cached_tokens": 71312, "effective_input_length": 71545, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71545, "latency_s": 1.3870954310405068, "output_length": 133, "proxy_request_id": "1340290:48:2040473:1187", "request_id": "1340290:48:2040473:1187", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1340290", "t_dispatch_unix": 1779817233.611933, "t_finish_unix": 1779817234.9990284, "t_first_token_unix": 1779817233.8716388, "tpot_s": 0.00853805784859243, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166], "trace_timestamp_s": 2724.4890000000005, "ttft_s": 0.25970329699339345, "turn_id": 48} +{"actual_output_tokens": 70, "cached_tokens": 71664, "effective_input_length": 71867, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71867, "latency_s": 0.8187078489572741, "output_length": 70, "proxy_request_id": "1340290:48:2043771:1188", "request_id": "1340290:48:2043771:1188", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1340290", "t_dispatch_unix": 1779817244.6306837, "t_finish_unix": 1779817245.4493914, "t_first_token_unix": 1779817244.8871787, "tpot_s": 0.00814423914509488, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 19990868], "trace_timestamp_s": 2735.509, "ttft_s": 0.2564916489645839, "turn_id": 48} +{"actual_output_tokens": 82, "cached_tokens": 71936, "effective_input_length": 72025, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72025, "latency_s": 0.8459149060072377, "output_length": 82, "proxy_request_id": "1340290:48:2045403:1189", "request_id": "1340290:48:2045403:1189", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1340290", "t_dispatch_unix": 1779817250.1400397, "t_finish_unix": 1779817250.9859543, "t_first_token_unix": 1779817250.3159144, "tpot_s": 0.008268751221979152, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917], "trace_timestamp_s": 2741.0240000000003, "ttft_s": 0.1758728590211831, "turn_id": 48} +{"actual_output_tokens": 67, "cached_tokens": 72096, "effective_input_length": 72211, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72211, "latency_s": 0.7463703160174191, "output_length": 67, "proxy_request_id": "1340290:48:2047167:1190", "request_id": "1340290:48:2047167:1190", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1340290", "t_dispatch_unix": 1779817255.905753, "t_finish_unix": 1779817256.652123, "t_first_token_unix": 1779817256.1177583, "tpot_s": 0.008092447136401792, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20025386], "trace_timestamp_s": 2746.7890000000007, "ttft_s": 0.2120026450138539, "turn_id": 48} +{"actual_output_tokens": 64, "cached_tokens": 72272, "effective_input_length": 72777, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72777, "latency_s": 0.9096901289885864, "output_length": 64, "proxy_request_id": "1340290:48:2048793:1191", "request_id": "1340290:48:2048793:1191", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1340290", "t_dispatch_unix": 1779817261.3389592, "t_finish_unix": 1779817262.2486486, "t_first_token_unix": 1779817261.7440352, "tpot_s": 0.008005063031016597, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20040840], "trace_timestamp_s": 2752.2220000000007, "ttft_s": 0.4050742370309308, "turn_id": 48} +{"actual_output_tokens": 46, "cached_tokens": 72832, "effective_input_length": 72952, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72952, "latency_s": 0.5587500419933349, "output_length": 46, "proxy_request_id": "1340290:48:2050838:1192", "request_id": "1340290:48:2050838:1192", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1340290", "t_dispatch_unix": 1779817268.5618467, "t_finish_unix": 1779817269.1205964, "t_first_token_unix": 1779817268.773962, "tpot_s": 0.00769700735496978, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229], "trace_timestamp_s": 2759.443, "ttft_s": 0.21211358101572841, "turn_id": 48} +{"actual_output_tokens": 93, "cached_tokens": 72992, "effective_input_length": 73208, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73208, "latency_s": 1.0334698209771886, "output_length": 93, "proxy_request_id": "1340290:48:2052523:1193", "request_id": "1340290:48:2052523:1193", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1340290", "t_dispatch_unix": 1779817274.1283302, "t_finish_unix": 1779817275.1617994, "t_first_token_unix": 1779817274.3941174, "tpot_s": 0.008341482815170742, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229], "trace_timestamp_s": 2765.0120000000006, "ttft_s": 0.26578500599134713, "turn_id": 48} +{"actual_output_tokens": 53, "cached_tokens": 73296, "effective_input_length": 73454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73454, "latency_s": 0.6652150269947015, "output_length": 53, "proxy_request_id": "1340290:48:2055365:1194", "request_id": "1340290:48:2055365:1194", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1340290", "t_dispatch_unix": 1779817283.84341, "t_finish_unix": 1779817284.5086246, "t_first_token_unix": 1779817284.0990083, "tpot_s": 0.007871973270084709, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2774.7220000000007, "ttft_s": 0.255595602968242, "turn_id": 48} +{"actual_output_tokens": 36, "cached_tokens": 73504, "effective_input_length": 73636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73636, "latency_s": 0.4520288750063628, "output_length": 36, "proxy_request_id": "1340290:48:2057042:1195", "request_id": "1340290:48:2057042:1195", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779817289.2135942, "t_finish_unix": 1779817289.6656222, "t_first_token_unix": 1779817289.407108, "tpot_s": 0.0073772167437709864, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2780.098, "ttft_s": 0.19351190997986123, "turn_id": 48} +{"actual_output_tokens": 199, "cached_tokens": 73648, "effective_input_length": 73653, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73653, "latency_s": 1.8661403139703907, "output_length": 199, "proxy_request_id": "1340290:48:2058614:1196", "request_id": "1340290:48:2058614:1196", "request_type": "coder", "requested_output_tokens": 199, "session_id": "1340290", "t_dispatch_unix": 1779817294.3526037, "t_finish_unix": 1779817296.2187436, "t_first_token_unix": 1779817294.5085323, "tpot_s": 0.008635947565757434, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2785.241, "ttft_s": 0.15592638397356495, "turn_id": 48} +{"actual_output_tokens": 66, "cached_tokens": 73840, "effective_input_length": 73858, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73858, "latency_s": 0.6688847310142592, "output_length": 66, "proxy_request_id": "1340290:48:2061834:1197", "request_id": "1340290:48:2061834:1197", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1340290", "t_dispatch_unix": 1779817304.5066006, "t_finish_unix": 1779817305.1754854, "t_first_token_unix": 1779817304.639752, "tpot_s": 0.008237816215170404, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20166404], "trace_timestamp_s": 2795.3860000000004, "ttft_s": 0.13314864999847487, "turn_id": 48} +{"actual_output_tokens": 198, "cached_tokens": 9232, "effective_input_length": 9359, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9359, "latency_s": 1.1203764940146357, "output_length": 198, "proxy_request_id": "1258908:3:2063441:1198", "request_id": "1258908:3:2063441:1198", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1258908", "t_dispatch_unix": 1779817309.5513494, "t_finish_unix": 1779817310.6717255, "t_first_token_unix": 1779817309.6055856, "tpot_s": 0.005410546934182477, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 20179862, 20179863, 20179864, 20179865], "trace_timestamp_s": 2800.4400000000005, "ttft_s": 0.054233931994531304, "turn_id": 3} +{"actual_output_tokens": 69, "cached_tokens": 73920, "effective_input_length": 74011, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74011, "latency_s": 0.7291697119944729, "output_length": 69, "proxy_request_id": "1340290:48:2063837:1199", "request_id": "1340290:48:2063837:1199", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1340290", "t_dispatch_unix": 1779817310.9000926, "t_finish_unix": 1779817311.6292605, "t_first_token_unix": 1779817311.067462, "tpot_s": 0.008256431058672367, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245], "trace_timestamp_s": 2801.7870000000003, "ttft_s": 0.16736812697490677, "turn_id": 48} +{"actual_output_tokens": 348, "cached_tokens": 9552, "effective_input_length": 9740, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9740, "latency_s": 1.9514323599869385, "output_length": 348, "proxy_request_id": "1258908:4:1553508:958", "request_id": "1258908:4:1553508:958", "request_type": "coder", "requested_output_tokens": 348, "session_id": "1258908", "t_dispatch_unix": 1779817310.6732676, "t_finish_unix": 1779817312.6247003, "t_first_token_unix": 1779817310.7371972, "tpot_s": 0.00543870502879564, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 15299521, 15299522, 15299523], "trace_timestamp_s": 1086.2330000000002, "ttft_s": 0.06392753799445927, "turn_id": 4} +{"actual_output_tokens": 377, "cached_tokens": 10080, "effective_input_length": 10201, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10201, "latency_s": 2.101893896004185, "output_length": 377, "proxy_request_id": "1258908:5:1617181:988", "request_id": "1258908:5:1617181:988", "request_type": "coder", "requested_output_tokens": 377, "session_id": "1258908", "t_dispatch_unix": 1779817312.625368, "t_finish_unix": 1779817314.7272625, "t_first_token_unix": 1779817312.6780672, "tpot_s": 0.005449295776649725, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 15299521, 15299522, 15897219], "trace_timestamp_s": 1300.7890000000007, "ttft_s": 0.05269759800285101, "turn_id": 5} +{"actual_output_tokens": 142, "cached_tokens": 74064, "effective_input_length": 74557, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74557, "latency_s": 1.6295136740081944, "output_length": 142, "proxy_request_id": "1340290:48:2066647:1200", "request_id": "1340290:48:2066647:1200", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1340290", "t_dispatch_unix": 1779817320.3374972, "t_finish_unix": 1779817321.9670105, "t_first_token_unix": 1779817320.7415876, "tpot_s": 0.008688953546196195, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606], "trace_timestamp_s": 2811.2200000000003, "ttft_s": 0.40408798900898546, "turn_id": 48} +{"actual_output_tokens": 95, "cached_tokens": 74688, "effective_input_length": 74863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74863, "latency_s": 1.068458982044831, "output_length": 95, "proxy_request_id": "1340290:48:2071598:1201", "request_id": "1340290:48:2071598:1201", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1340290", "t_dispatch_unix": 1779817336.9937978, "t_finish_unix": 1779817338.0622566, "t_first_token_unix": 1779817337.266482, "tpot_s": 0.00846299184040424, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20256523], "trace_timestamp_s": 2827.867, "ttft_s": 0.2726817310322076, "turn_id": 48} +{"actual_output_tokens": 54, "cached_tokens": 74944, "effective_input_length": 75113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75113, "latency_s": 0.6889110679621808, "output_length": 54, "proxy_request_id": "1340290:48:2076822:1202", "request_id": "1340290:48:2076822:1202", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1340290", "t_dispatch_unix": 1779817354.5043778, "t_finish_unix": 1779817355.1932888, "t_first_token_unix": 1779817354.769588, "tpot_s": 0.007989352943489925, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700], "trace_timestamp_s": 2845.3820000000005, "ttft_s": 0.265207341988571, "turn_id": 48} +{"actual_output_tokens": 37, "cached_tokens": 75152, "effective_input_length": 75299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75299, "latency_s": 0.5316934150177985, "output_length": 37, "proxy_request_id": "1340290:48:2078461:1203", "request_id": "1340290:48:2078461:1203", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1340290", "t_dispatch_unix": 1779817359.7994475, "t_finish_unix": 1779817360.3311403, "t_first_token_unix": 1779817360.0613754, "tpot_s": 0.007435992777269955, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20321756], "trace_timestamp_s": 2850.683, "ttft_s": 0.26192549301777035, "turn_id": 48} +{"actual_output_tokens": 47, "cached_tokens": 75328, "effective_input_length": 75338, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75338, "latency_s": 0.4868648090050556, "output_length": 47, "proxy_request_id": "1340290:48:2080016:1204", "request_id": "1340290:48:2080016:1204", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1340290", "t_dispatch_unix": 1779817365.0901918, "t_finish_unix": 1779817365.577056, "t_first_token_unix": 1779817365.2167504, "tpot_s": 0.007826594260025202, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20335310], "trace_timestamp_s": 2855.973, "ttft_s": 0.12655701400944963, "turn_id": 48} +{"actual_output_tokens": 114, "cached_tokens": 75376, "effective_input_length": 75439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75439, "latency_s": 1.146826134994626, "output_length": 114, "proxy_request_id": "1340290:48:2082644:1206", "request_id": "1340290:48:2082644:1206", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1340290", "t_dispatch_unix": 1779817373.765039, "t_finish_unix": 1779817374.9118648, "t_first_token_unix": 1779817373.9432988, "tpot_s": 0.008566923663576455, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630], "trace_timestamp_s": 2864.6510000000007, "ttft_s": 0.17825659300433472, "turn_id": 48} +{"actual_output_tokens": 232, "cached_tokens": 136784, "effective_input_length": 136991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136991, "latency_s": 3.252905656991061, "output_length": 232, "proxy_request_id": "1356885:16:2084239:1207", "request_id": "1356885:16:2084239:1207", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1356885", "t_dispatch_unix": 1779817378.852846, "t_finish_unix": 1779817382.1057513, "t_first_token_unix": 1779817379.3191507, "tpot_s": 0.012061660748995132, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016, 20375498], "trace_timestamp_s": 2869.7350000000006, "ttft_s": 0.4663019119761884, "turn_id": 16} +{"actual_output_tokens": 61, "cached_tokens": 75552, "effective_input_length": 77337, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77337, "latency_s": 1.4974113770294935, "output_length": 61, "proxy_request_id": "1340290:48:2085626:1208", "request_id": "1340290:48:2085626:1208", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1340290", "t_dispatch_unix": 1779817383.8413165, "t_finish_unix": 1779817385.3387275, "t_first_token_unix": 1779817384.8457732, "tpot_s": 0.008211025550068977, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20388781], "trace_timestamp_s": 2874.7270000000008, "ttft_s": 1.0044547410216182, "turn_id": 48} +{"actual_output_tokens": 162, "cached_tokens": 77392, "effective_input_length": 78683, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78683, "latency_s": 2.3067037740256637, "output_length": 162, "proxy_request_id": "1340290:48:2087584:1209", "request_id": "1340290:48:2087584:1209", "request_type": "coder", "requested_output_tokens": 162, "session_id": "1340290", "t_dispatch_unix": 1779817390.4191422, "t_finish_unix": 1779817392.7258456, "t_first_token_unix": 1779817391.279065, "tpot_s": 0.008984352341601451, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20407911, 20407912, 20407913], "trace_timestamp_s": 2881.3010000000004, "ttft_s": 0.8599204870406538, "turn_id": 48} +{"actual_output_tokens": 143, "cached_tokens": 78832, "effective_input_length": 79023, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79023, "latency_s": 1.5421597529784776, "output_length": 143, "proxy_request_id": "1340290:48:2092759:1211", "request_id": "1340290:48:2092759:1211", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1340290", "t_dispatch_unix": 1779817407.7013092, "t_finish_unix": 1779817409.2434685, "t_first_token_unix": 1779817407.9876666, "tpot_s": 0.008841565640849836, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20407911, 20407912, 20407913, 20456176], "trace_timestamp_s": 2898.5790000000006, "ttft_s": 0.2863554820069112, "turn_id": 48} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 114971, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 114971, "latency_s": 43.7387454599957, "output_length": 111, "proxy_request_id": "1382086:2:2082052:1205", "request_id": "1382086:2:2082052:1205", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1382086", "t_dispatch_unix": 1779817371.7444644, "t_finish_unix": 1779817415.4832094, "t_first_token_unix": 1779817414.3322613, "tpot_s": 0.010460571936776185, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756], "trace_timestamp_s": 2862.6050000000005, "ttft_s": 42.58779326698277, "turn_id": 2} +{"actual_output_tokens": 52, "cached_tokens": 115072, "effective_input_length": 115184, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 115184, "latency_s": 0.8065145770087838, "output_length": 52, "proxy_request_id": "1382086:3:2089879:1210", "request_id": "1382086:3:2089879:1210", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1382086", "t_dispatch_unix": 1779817415.4874027, "t_finish_unix": 1779817416.2939172, "t_first_token_unix": 1779817415.8074884, "tpot_s": 0.00953191262783994, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756], "trace_timestamp_s": 2888.9900000000007, "ttft_s": 0.32008313899859786, "turn_id": 3} +{"actual_output_tokens": 626, "cached_tokens": 115232, "effective_input_length": 115246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 115246, "latency_s": 7.246274720004294, "output_length": 626, "proxy_request_id": "1382086:4:2092953:1212", "request_id": "1382086:4:2092953:1212", "request_type": "coder", "requested_output_tokens": 626, "session_id": "1382086", "t_dispatch_unix": 1779817416.2992291, "t_finish_unix": 1779817423.545504, "t_first_token_unix": 1779817416.487519, "tpot_s": 0.011292323545645922, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756, 20458115], "trace_timestamp_s": 2899.327, "ttft_s": 0.1882873079739511, "turn_id": 4} +{"actual_output_tokens": 220, "cached_tokens": 137216, "effective_input_length": 137546, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 137546, "latency_s": 3.3552482899976894, "output_length": 220, "proxy_request_id": "1356885:17:2097011:1213", "request_id": "1356885:17:2097011:1213", "request_type": "coder", "requested_output_tokens": 220, "session_id": "1356885", "t_dispatch_unix": 1779817421.5685794, "t_finish_unix": 1779817424.9238272, "t_first_token_unix": 1779817422.2882903, "tpot_s": 0.012033214077638403, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016, 20494065, 20494066], "trace_timestamp_s": 2912.4530000000004, "ttft_s": 0.7197092809947208, "turn_id": 17} diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/metrics.summary.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/metrics.summary.json new file mode 100644 index 0000000..44cecf9 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/metrics.summary.json @@ -0,0 +1,50 @@ +{ + "actual_output_tokens_stats": { + "count": 1214.0, + "mean": 309.1507413509061, + "p50": 92.0, + "p90": 511.4000000000001, + "p99": 4181.989999999992 + }, + "cache_hit_request_count": 882, + "cached_tokens_stats": { + "count": 1214.0, + "mean": 34370.767710049426, + "p50": 23264.0, + "p90": 92649.6, + "p99": 130699.5199999999 + }, + "error_count": 0, + "external_cache_hit_ratio": 0.0, + "external_cache_hits_tokens": 0, + "external_cache_queries_tokens": 0, + "latency_stats_s": { + "count": 1214.0, + "mean": 8.179940037778339, + "p50": 1.9469290699926205, + "p90": 23.85709141241971, + "p99": 76.447050594399 + }, + "prefix_cache_hit_ratio": 0.0, + "prefix_cache_hits_tokens": 0, + "prefix_cache_queries_tokens": 0, + "request_count": 1214, + "success_count": 1214, + "total_cached_tokens": 41726112, + "total_input_tokens": 53335690, + "tpot_stats_s": { + "count": 1214.0, + "mean": 0.01530483999133096, + "p50": 0.008421713519231216, + "p90": 0.019828541993577534, + "p99": 0.15287945013125698 + }, + "ttft_stats_s": { + "count": 1214.0, + "mean": 4.018204955330434, + "p50": 0.5004960215010215, + "p90": 12.025405208714078, + "p99": 48.026077826277884 + }, + "wall_clock_s": 2915.8219948689803 +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/run_window.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/run_window.json new file mode 100644 index 0000000..5963b98 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/run_window.json @@ -0,0 +1,7 @@ +{ + "policy": "unified", + "trace": "/home/admin/cpfs/wjh/agentic-kv/traces/w600_r0.0015_st30.jsonl", + "t_start_unix": 1779814508.4891112, + "t_end_unix": 1779817425.4834316, + "isolated": true +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/stats.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/stats.json new file mode 100644 index 0000000..a4f5f66 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified/stats.json @@ -0,0 +1 @@ +[{"url":"http://127.0.0.1:8000","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2696},{"url":"http://127.0.0.1:8001","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1797},{"url":"http://127.0.0.1:8002","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645},{"url":"http://127.0.0.1:8003","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1651},{"url":"http://127.0.0.1:8004","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2587},{"url":"http://127.0.0.1:8005","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822},{"url":"http://127.0.0.1:8006","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2801},{"url":"http://127.0.0.1:8007","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1966}] \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/breakdown.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/breakdown.json new file mode 100644 index 0000000..9cae248 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/breakdown.json @@ -0,0 +1 @@ +[{"request_id":"1237198:1:1237198:0","session_id":"1237198","input_length":8228,"t_proxy_recv":386728.764576803,"t_decision_unix":1779817593.7785177,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386729.649954976,"t_first_token_unix":1779817594.663899,"t_done":386729.745674042,"t_done_unix":1779817594.7596204},{"request_id":"1237337:1:1237337:1","session_id":"1237337","input_length":3976,"t_proxy_recv":386729.18566885,"t_decision_unix":1779817594.19961,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3976,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8228,"ongoing_decode_tokens":0,"pending_prefill_tokens":8228,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":8228.0,"score_lmetric":12204},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386729.669562442,"t_first_token_unix":1779817594.683506,"t_done":386730.107774831,"t_done_unix":1779817595.1217182},{"request_id":"1237198:2:1237773:2","session_id":"1237198","input_length":10237,"t_proxy_recv":386730.733116325,"t_decision_unix":1779817595.7470577,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8192,"affinity_cache_ratio":0.8002344436846732,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":2045,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":16,"cache_hit":8192,"new_prefill":2045,"score_linear":-8192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":7,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":386731.01843933,"t_first_token_unix":1779817596.0323834,"t_done":386731.15436037,"t_done_unix":1779817596.168304},{"request_id":"1237877:1:1237877:3","session_id":"1237877","input_length":749,"t_proxy_recv":386731.190886043,"t_decision_unix":1779817596.2048273,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":7,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386731.306109535,"t_first_token_unix":1779817596.320053,"t_done":386731.432241653,"t_done_unix":1779817596.4461849},{"request_id":"1239034:1:1239034:4","session_id":"1239034","input_length":13489,"t_proxy_recv":386734.972415772,"t_decision_unix":1779817599.986357,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13489,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386736.466577329,"t_first_token_unix":1779817601.480521,"t_done":386736.91189495,"t_done_unix":1779817601.9258382},{"request_id":"1237877:2:1239577:6","session_id":"1237877","input_length":1620,"t_proxy_recv":386736.8519548,"t_decision_unix":1779817601.8658962,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":512,"affinity_cache_ratio":0.3160493827160494,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":512,"new_prefill":1108,"score_linear":-512.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13489,"ongoing_decode_tokens":13489,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":13489.0,"score_lmetric":1620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":37165.0,"score_lmetric":38785},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":386736.93148159,"t_first_token_unix":1779817601.9454246,"t_done":386737.375098866,"t_done_unix":1779817602.3890421},{"request_id":"1239704:1:1239704:7","session_id":"1239704","input_length":5194,"t_proxy_recv":386737.295536186,"t_decision_unix":1779817602.3094773,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1620,"ongoing_decode_tokens":1620,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":5194,"score_linear":1620.0,"score_lmetric":5194},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":37165.0,"score_lmetric":42359},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386737.912659593,"t_first_token_unix":1779817602.926603,"t_done":386738.180051469,"t_done_unix":1779817603.1939948},{"request_id":"1240924:1:1240924:11","session_id":"1240924","input_length":7429,"t_proxy_recv":386741.317172371,"t_decision_unix":1779817606.331114,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7429,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":66214.0,"score_lmetric":73643},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30040,"ongoing_decode_tokens":0,"pending_prefill_tokens":30040,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7429,"score_linear":30040.0,"score_lmetric":37469},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7429,"score_linear":18420.0,"score_lmetric":7429},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":37165,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":37165.0,"score_lmetric":7429},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386741.857853071,"t_first_token_unix":1779817606.8717964,"t_done":386742.029594904,"t_done_unix":1779817607.0435379},{"request_id":"1239100:1:1239100:5","session_id":"1239100","input_length":37165,"t_proxy_recv":386735.211087728,"t_decision_unix":1779817600.2250292,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":37165,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13489,"ongoing_decode_tokens":0,"pending_prefill_tokens":13489,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":13489.0,"score_lmetric":50654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386741.210345219,"t_first_token_unix":1779817606.224289,"t_done":386742.451231874,"t_done_unix":1779817607.4651756},{"request_id":"1240198:1:1240198:9","session_id":"1240198","input_length":30040,"t_proxy_recv":386738.830313177,"t_decision_unix":1779817603.8442545,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":30040,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":66214.0,"score_lmetric":96254},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":37165.0,"score_lmetric":67205},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386742.759820366,"t_first_token_unix":1779817607.7737641,"t_done":386743.399336219,"t_done_unix":1779817608.4132798},{"request_id":"1241953:1:1241953:13","session_id":"1241953","input_length":1093,"t_proxy_recv":386744.732600427,"t_decision_unix":1779817609.7465417,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1093,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":34,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":66214.0,"score_lmetric":67307},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1093,"score_linear":18420.0,"score_lmetric":1093},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7587,"ongoing_decode_tokens":0,"pending_prefill_tokens":7587,"num_requests":1,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":1093,"score_linear":7587.0,"score_lmetric":8680},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386744.847148687,"t_first_token_unix":1779817609.8610923,"t_done":386745.359281062,"t_done_unix":1779817610.3732255},{"request_id":"1241942:1:1241942:12","session_id":"1241942","input_length":7587,"t_proxy_recv":386744.687095284,"t_decision_unix":1779817609.7010362,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7587,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":34,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":66214.0,"score_lmetric":73801},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7587,"score_linear":18420.0,"score_lmetric":7587},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386745.219461912,"t_first_token_unix":1779817610.2334065,"t_done":386745.406916614,"t_done_unix":1779817610.4208596},{"request_id":"1237877:3:1242953:15","session_id":"1237877","input_length":2659,"t_proxy_recv":386748.119328952,"t_decision_unix":1779817613.1332703,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.5776607747273411,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":1123,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17157,"ongoing_decode_tokens":0,"pending_prefill_tokens":17157,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":2659,"score_linear":17157.0,"score_lmetric":19816},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":66214.0,"score_lmetric":68873},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":1536,"new_prefill":1123,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":2659,"score_linear":18420.0,"score_lmetric":2659},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":386748.211748927,"t_first_token_unix":1779817613.2256923,"t_done":386748.275024428,"t_done_unix":1779817613.2889674},{"request_id":"1242838:1:1242838:14","session_id":"1242838","input_length":17157,"t_proxy_recv":386747.740830656,"t_decision_unix":1779817612.754772,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":66214.0,"score_lmetric":83371},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17157,"score_linear":18420.0,"score_lmetric":17157},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386749.446118432,"t_first_token_unix":1779817614.460062,"t_done":386750.337858648,"t_done_unix":1779817615.3518023},{"request_id":"1239704:2:1243943:17","session_id":"1239704","input_length":14812,"t_proxy_recv":386751.398254918,"t_decision_unix":1779817616.4121964,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":5120,"affinity_cache_ratio":0.3456656764785309,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":9692,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":43,"cache_hit":5120,"new_prefill":9692,"score_linear":-5120.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":11074,"ongoing_decode_tokens":0,"pending_prefill_tokens":11074,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14812,"score_linear":11074.0,"score_lmetric":25886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":66214.0,"score_lmetric":81026},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":14812,"score_linear":18420.0,"score_lmetric":14812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":386752.502159117,"t_first_token_unix":1779817617.5161037,"t_done":386752.622823631,"t_done_unix":1779817617.636767},{"request_id":"1243831:1:1243831:16","session_id":"1243831","input_length":11074,"t_proxy_recv":386750.996835657,"t_decision_unix":1779817616.010777,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":43,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":66214.0,"score_lmetric":77288},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":11074,"score_linear":18420.0,"score_lmetric":11074},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386751.93013716,"t_first_token_unix":1779817616.9440806,"t_done":386753.373547296,"t_done_unix":1779817618.3874903},{"request_id":"1239034:2:1240558:10","session_id":"1239034","input_length":18420,"t_proxy_recv":386740.066141168,"t_decision_unix":1779817605.0800822,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":13312,"affinity_cache_ratio":0.7226927252985885,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":5108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":66214.0,"score_lmetric":84634},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30040,"ongoing_decode_tokens":0,"pending_prefill_tokens":30040,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":18420,"score_linear":30040.0,"score_lmetric":48460},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":13312,"new_prefill":5108,"score_linear":-13312.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":37165.0,"score_lmetric":55585},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13312.0,"chosen_score_lmetric":0,"t_first_token":386740.767533173,"t_first_token_unix":1779817605.781477,"t_done":386753.98426716,"t_done_unix":1779817618.9982102},{"request_id":"1239755:1:1239755:8","session_id":"1239755","input_length":66214,"t_proxy_recv":386737.504657113,"t_decision_unix":1779817602.5185983,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66214,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5194,"ongoing_decode_tokens":0,"pending_prefill_tokens":5194,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":5194.0,"score_lmetric":71408},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":37165.0,"score_lmetric":103379},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386753.323191449,"t_first_token_unix":1779817618.337138,"t_done":386754.001136448,"t_done_unix":1779817619.0150802},{"request_id":"1244640:1:1244640:18","session_id":"1244640","input_length":8274,"t_proxy_recv":386753.891783158,"t_decision_unix":1779817618.9057248,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8274,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":66214,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":66214.0,"score_lmetric":8274},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":8274,"score_linear":18420.0,"score_lmetric":8274},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386754.485523032,"t_first_token_unix":1779817619.4994664,"t_done":386754.686046049,"t_done_unix":1779817619.6999893},{"request_id":"1245572:1:1245572:19","session_id":"1245572","input_length":6109,"t_proxy_recv":386757.025080489,"t_decision_unix":1779817622.0390217,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6109,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386757.751750622,"t_first_token_unix":1779817622.765694,"t_done":386757.98931238,"t_done_unix":1779817623.0032558},{"request_id":"1241953:2:1245624:20","session_id":"1241953","input_length":10382,"t_proxy_recv":386757.116638547,"t_decision_unix":1779817622.13058,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":1024,"affinity_cache_ratio":0.09863224812174919,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":9358,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":1024,"new_prefill":9358,"score_linear":-1024.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":6109,"ongoing_decode_tokens":0,"pending_prefill_tokens":6109,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10382,"score_linear":6109.0,"score_lmetric":16491}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":386757.887506595,"t_first_token_unix":1779817622.9014497,"t_done":386758.068595225,"t_done_unix":1779817623.0825386},{"request_id":"1245572:2:1246348:22","session_id":"1245572","input_length":6182,"t_proxy_recv":386759.621466467,"t_decision_unix":1779817624.635408,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.9938531219670009,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":38,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":17447,"ongoing_decode_tokens":0,"pending_prefill_tokens":10279,"num_requests":1,"active_p_offloads":0,"cached_blocks":76,"cache_hit":0,"new_prefill":6182,"score_linear":17447.0,"score_lmetric":16461},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":6144,"new_prefill":38,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":386759.653041971,"t_first_token_unix":1779817624.6669853,"t_done":386759.828529546,"t_done_unix":1779817624.8424728},{"request_id":"1240924:2:1246244:21","session_id":"1240924","input_length":17447,"t_proxy_recv":386759.24868641,"t_decision_unix":1779817624.2626276,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7168,"affinity_cache_ratio":0.4108442712214134,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":76,"cache_hit":7168,"new_prefill":10279,"score_linear":-7168.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":386760.464621668,"t_first_token_unix":1779817625.4785652,"t_done":386760.827593759,"t_done_unix":1779817625.841537},{"request_id":"1241942:2:1247111:23","session_id":"1241942","input_length":17975,"t_proxy_recv":386762.296040777,"t_decision_unix":1779817627.309982,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":7168,"affinity_cache_ratio":0.3987760778859527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10807,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":7168,"new_prefill":10807,"score_linear":-7168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":386763.588438122,"t_first_token_unix":1779817628.6023815,"t_done":386763.768430239,"t_done_unix":1779817628.7823734},{"request_id":"1244640:2:1247941:24","session_id":"1244640","input_length":10696,"t_proxy_recv":386765.111726951,"t_decision_unix":1779817630.125668,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8192,"affinity_cache_ratio":0.7658937920718025,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":2504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":8192,"new_prefill":2504,"score_linear":-8192.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":386765.436585854,"t_first_token_unix":1779817630.4505293,"t_done":386765.481596199,"t_done_unix":1779817630.4955392},{"request_id":"1248768:1:1248768:25","session_id":"1248768","input_length":11515,"t_proxy_recv":386767.892293123,"t_decision_unix":1779817632.906234,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11515,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386768.875527559,"t_first_token_unix":1779817633.889471,"t_done":386769.131857325,"t_done_unix":1779817634.1458006},{"request_id":"1249058:1:1249058:26","session_id":"1249058","input_length":4126,"t_proxy_recv":386768.911216552,"t_decision_unix":1779817633.9251578,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4126,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11515,"ongoing_decode_tokens":11515,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":4126,"score_linear":11515.0,"score_lmetric":4126},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386769.175114865,"t_first_token_unix":1779817634.189058,"t_done":386769.339125173,"t_done_unix":1779817634.3530684},{"request_id":"1248768:2:1249765:27","session_id":"1248768","input_length":12188,"t_proxy_recv":386771.175390959,"t_decision_unix":1779817636.1893322,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.924187725631769,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":924,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":83,"cache_hit":11264,"new_prefill":924,"score_linear":-11264.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":45,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":386771.317567369,"t_first_token_unix":1779817636.3315105,"t_done":386771.777921716,"t_done_unix":1779817636.7918649},{"request_id":"1249058:2:1249872:28","session_id":"1249058","input_length":7482,"t_proxy_recv":386771.56631627,"t_decision_unix":1779817636.580258,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4096,"affinity_cache_ratio":0.5474472066292435,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":3386,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12188,"ongoing_decode_tokens":12188,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":83,"cache_hit":0,"new_prefill":7482,"score_linear":12188.0,"score_lmetric":7482},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":45,"cache_hit":4096,"new_prefill":3386,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":386771.888998495,"t_first_token_unix":1779817636.9029496,"t_done":386772.014529188,"t_done_unix":1779817637.028472},{"request_id":"1242838:2:1250503:29","session_id":"1242838","input_length":21578,"t_proxy_recv":386773.842843613,"t_decision_unix":1779817638.8567848,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.783019742330151,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":4682,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":16896,"new_prefill":4682,"score_linear":-16896.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":386774.571446831,"t_first_token_unix":1779817639.5853906,"t_done":386775.057968589,"t_done_unix":1779817640.071912},{"request_id":"1250772:1:1250772:30","session_id":"1250772","input_length":6829,"t_proxy_recv":386774.702706835,"t_decision_unix":1779817639.7166476,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6829,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21578,"ongoing_decode_tokens":21578,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6829,"score_linear":21578.0,"score_lmetric":6829},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386775.723153021,"t_first_token_unix":1779817640.7370963,"t_done":386777.288680246,"t_done_unix":1779817642.3026235},{"request_id":"1251059:1:1251059:32","session_id":"1251059","input_length":16512,"t_proxy_recv":386775.883779597,"t_decision_unix":1779817640.8977208,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":6829,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":16512,"score_linear":6829.0,"score_lmetric":16512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":0,"pending_prefill_tokens":20086,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":16512,"score_linear":20086.0,"score_lmetric":36598},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386777.438940726,"t_first_token_unix":1779817642.4528844,"t_done":386777.440574269,"t_done_unix":1779817642.4545176},{"request_id":"1248768:3:1251261:33","session_id":"1248768","input_length":16989,"t_proxy_recv":386776.457563356,"t_decision_unix":1779817641.4715047,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11776,"affinity_cache_ratio":0.6931543940196597,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":5213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":11776,"new_prefill":5213,"score_linear":-11776.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16512,"ongoing_decode_tokens":0,"pending_prefill_tokens":16512,"num_requests":1,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":16989,"score_linear":16512.0,"score_lmetric":33501},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":6829,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":16989,"score_linear":6829.0,"score_lmetric":16989},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":0,"pending_prefill_tokens":20086,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":16989,"score_linear":20086.0,"score_lmetric":37075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":386777.13836989,"t_first_token_unix":1779817642.1523132,"t_done":386778.099066721,"t_done_unix":1779817643.11301},{"request_id":"1251828:1:1251828:35","session_id":"1251828","input_length":1090,"t_proxy_recv":386778.388257594,"t_decision_unix":1779817643.4021993,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1090,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":20086,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":1090,"score_linear":20086.0,"score_lmetric":1090},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13780,"ongoing_decode_tokens":0,"pending_prefill_tokens":7636,"num_requests":1,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":1090,"score_linear":13780.0,"score_lmetric":8726}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386778.475783996,"t_first_token_unix":1779817643.4897273,"t_done":386778.581742243,"t_done_unix":1779817643.5956857},{"request_id":"1250935:1:1250935:31","session_id":"1250935","input_length":20086,"t_proxy_recv":386775.32710589,"t_decision_unix":1779817640.3410473,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":20086,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":0,"pending_prefill_tokens":6829,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":20086,"score_linear":6829.0,"score_lmetric":26915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386777.411975728,"t_first_token_unix":1779817642.4259193,"t_done":386778.65092706,"t_done_unix":1779817643.6648705},{"request_id":"1245572:3:1251662:34","session_id":"1245572","input_length":13780,"t_proxy_recv":386777.868839668,"t_decision_unix":1779817642.882781,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.4458635703918723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":7636,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16989,"ongoing_decode_tokens":16989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":13780,"score_linear":16989.0,"score_lmetric":13780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":20086,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":13780,"score_linear":20086.0,"score_lmetric":13780},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":6144,"new_prefill":7636,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":386778.666954882,"t_first_token_unix":1779817643.6808982,"t_done":386778.887308986,"t_done_unix":1779817643.9012523},{"request_id":"1252010:1:1252010:36","session_id":"1252010","input_length":9855,"t_proxy_recv":386778.996545942,"t_decision_unix":1779817644.0104876,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9855,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":144,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386779.809655825,"t_first_token_unix":1779817644.8235993,"t_done":386779.977670323,"t_done_unix":1779817644.9916136},{"request_id":"1248768:4:1253385:37","session_id":"1248768","input_length":17309,"t_proxy_recv":386783.771501021,"t_decision_unix":1779817648.785433,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.9761395805650239,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":413,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":16896,"new_prefill":413,"score_linear":-16896.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":386783.856082381,"t_first_token_unix":1779817648.8700264,"t_done":386786.785243196,"t_done_unix":1779817651.7991865},{"request_id":"1251828:2:1254272:41","session_id":"1251828","input_length":3934,"t_proxy_recv":386786.739742617,"t_decision_unix":1779817651.753684,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":4,"affinity_cache_hit":1024,"affinity_cache_ratio":0.2602948652770717,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3934,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":3934,"score_linear":17309.0,"score_lmetric":3934},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":3934,"score_linear":35221.0,"score_lmetric":39155},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":1024,"new_prefill":2910,"score_linear":48600.0,"score_lmetric":52534},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":0,"pending_prefill_tokens":4108,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":3934,"score_linear":10764.0,"score_lmetric":8042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386786.984773355,"t_first_token_unix":1779817651.9987164,"t_done":386787.128091789,"t_done_unix":1779817652.142035},{"request_id":"1254584:1:1254584:42","session_id":"1254584","input_length":748,"t_proxy_recv":386787.872267898,"t_decision_unix":1779817652.8862095,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":748,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":748,"score_linear":35221.0,"score_lmetric":35969},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":748,"score_linear":49624.0,"score_lmetric":50372},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":10764,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":748,"score_linear":10764.0,"score_lmetric":748},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386787.938742305,"t_first_token_unix":1779817652.9526856,"t_done":386788.08917624,"t_done_unix":1779817653.1031194},{"request_id":"1252010:2:1254691:43","session_id":"1252010","input_length":13092,"t_proxy_recv":386788.325848371,"t_decision_unix":1779817653.3397899,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.743049190345249,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":3364,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":13092,"score_linear":35221.0,"score_lmetric":48313},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":13092,"score_linear":49624.0,"score_lmetric":62716},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":10764,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":13092,"score_linear":10764.0,"score_lmetric":13092},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":9728,"new_prefill":3364,"score_linear":-9728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":386788.755719623,"t_first_token_unix":1779817653.7696636,"t_done":386788.920906514,"t_done_unix":1779817653.9348495},{"request_id":"1250772:2:1254198:40","session_id":"1250772","input_length":10764,"t_proxy_recv":386786.468364321,"t_decision_unix":1779817651.4823055,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6656,"affinity_cache_ratio":0.6183574879227053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":4108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":10764,"score_linear":17309.0,"score_lmetric":10764},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":10764,"score_linear":35221.0,"score_lmetric":45985},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":10764,"score_linear":49624.0,"score_lmetric":60388},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":6656,"new_prefill":4108,"score_linear":-6656.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":386786.857300264,"t_first_token_unix":1779817651.8712435,"t_done":386789.08332242,"t_done_unix":1779817654.0972657},{"request_id":"1253804:1:1253804:39","session_id":"1253804","input_length":35221,"t_proxy_recv":386785.362460085,"t_decision_unix":1779817650.3764014,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":35221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":35221,"score_linear":17309.0,"score_lmetric":35221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":35221,"score_linear":49624.0,"score_lmetric":84845},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386790.535859897,"t_first_token_unix":1779817655.5498035,"t_done":386792.717685135,"t_done_unix":1779817657.7316282},{"request_id":"1256273:1:1256273:46","session_id":"1256273","input_length":1694,"t_proxy_recv":386793.555234545,"t_decision_unix":1779817658.5691757,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1694,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":1694,"score_linear":49624.0,"score_lmetric":51318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":0,"pending_prefill_tokens":10618,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":1694,"score_linear":17786.0,"score_lmetric":12312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386793.700252755,"t_first_token_unix":1779817658.714196,"t_done":386793.980396589,"t_done_unix":1779817658.9943395},{"request_id":"1243831:2:1256324:47","session_id":"1243831","input_length":11448,"t_proxy_recv":386793.720733954,"t_decision_unix":1779817658.7346754,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":11264,"affinity_cache_ratio":0.983927323549965,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":11264,"new_prefill":184,"score_linear":-11264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":11448,"score_linear":49624.0,"score_lmetric":61072},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":0,"pending_prefill_tokens":10618,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":11448,"score_linear":17786.0,"score_lmetric":22066},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1694,"ongoing_decode_tokens":1694,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":11448,"score_linear":1694.0,"score_lmetric":11448},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":386793.778599289,"t_first_token_unix":1779817658.7925427,"t_done":386794.210166406,"t_done_unix":1779817659.2241096},{"request_id":"1253743:1:1253743:38","session_id":"1253743","input_length":49624,"t_proxy_recv":386785.116743017,"t_decision_unix":1779817650.1306841,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49624,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":49624,"score_linear":17309.0,"score_lmetric":49624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386794.357533451,"t_first_token_unix":1779817659.371477,"t_done":386794.751226693,"t_done_unix":1779817659.7651699},{"request_id":"1249058:3:1256222:45","session_id":"1249058","input_length":17786,"t_proxy_recv":386793.409340325,"t_decision_unix":1779817658.423281,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7168,"affinity_cache_ratio":0.4030136062071292,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10618,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":17786,"score_linear":49624.0,"score_lmetric":67410},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":7168,"new_prefill":10618,"score_linear":-7168.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":386794.677335986,"t_first_token_unix":1779817659.6912794,"t_done":386794.792200185,"t_done_unix":1779817659.8061435},{"request_id":"1253743:2:1256070:44","session_id":"1253743","input_length":49687,"t_proxy_recv":386794.760671956,"t_decision_unix":1779817659.7746136,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9995371022601486,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":23,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":3584,"new_prefill":46103,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":49664,"new_prefill":23,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":17786,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":49687,"score_linear":17786.0,"score_lmetric":49687},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":386794.848599449,"t_first_token_unix":1779817659.8625429,"t_done":386795.657301619,"t_done_unix":1779817660.671245},{"request_id":"1256273:2:1257769:51","session_id":"1256273","input_length":6170,"t_proxy_recv":386798.538091118,"t_decision_unix":1779817663.5520325,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.24894651539708265,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":4634,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":4434,"ongoing_decode_tokens":4434,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":6170,"score_linear":4434.0,"score_lmetric":6170},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":6170,"score_linear":27387.0,"score_lmetric":33557},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6170,"score_linear":90488.0,"score_lmetric":96658},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":1536,"new_prefill":4634,"score_linear":-1536.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":386798.866821665,"t_first_token_unix":1779817663.8807657,"t_done":386799.160699265,"t_done_unix":1779817664.1746433},{"request_id":"1257572:1:1257572:50","session_id":"1257572","input_length":4434,"t_proxy_recv":386797.905217204,"t_decision_unix":1779817662.9191587,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":4434,"score_linear":27387.0,"score_lmetric":31821},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":4434,"score_linear":90488.0,"score_lmetric":94922},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386798.198381969,"t_first_token_unix":1779817663.2123253,"t_done":386799.418294844,"t_done_unix":1779817664.4322388},{"request_id":"1254584:2:1258039:52","session_id":"1254584","input_length":1257,"t_proxy_recv":386799.559441651,"t_decision_unix":1779817664.5733829,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":512,"affinity_cache_ratio":0.40731901352426414,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":745,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":113,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":1257,"score_linear":27387.0,"score_lmetric":28644},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":512,"new_prefill":745,"score_linear":-512.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":1257,"score_linear":90488.0,"score_lmetric":91745},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":386799.614680518,"t_first_token_unix":1779817664.628624,"t_done":386799.943250397,"t_done_unix":1779817664.9571936},{"request_id":"1242838:3:1258161:53","session_id":"1242838","input_length":22262,"t_proxy_recv":386800.019075252,"t_decision_unix":1779817665.033017,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9659509478034318,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":113,"cache_hit":21504,"new_prefill":758,"score_linear":-21504.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":22262,"score_linear":27387.0,"score_lmetric":49649},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22262,"score_linear":90488.0,"score_lmetric":112750},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":386800.186901374,"t_first_token_unix":1779817665.2008448,"t_done":386800.734963077,"t_done_unix":1779817665.748906},{"request_id":"1256273:3:1258499:55","session_id":"1256273","input_length":7934,"t_proxy_recv":386801.182788442,"t_decision_unix":1779817666.19673,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6144,"affinity_cache_ratio":0.7743887068313587,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":1790,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":0,"pending_prefill_tokens":45037,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":7934,"score_linear":80365.0,"score_lmetric":105942},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":7934,"score_linear":90488.0,"score_lmetric":98422},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":6144,"new_prefill":1790,"score_linear":-6144.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":386801.374463721,"t_first_token_unix":1779817666.3884068,"t_done":386801.976527171,"t_done_unix":1779817666.9904718},{"request_id":"1258908:1:1258908:58","session_id":"1258908","input_length":9250,"t_proxy_recv":386802.636077653,"t_decision_unix":1779817667.6500192,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9250,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":9250,"score_linear":80365.0,"score_lmetric":53800},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":9250,"score_linear":68131.0,"score_lmetric":77381},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":9250,"score_linear":90488.0,"score_lmetric":99738},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9250,"score_linear":112793.0,"score_lmetric":122043},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386803.335588004,"t_first_token_unix":1779817668.3495314,"t_done":386805.300485808,"t_done_unix":1779817670.3144293},{"request_id":"1259178:1:1259178:59","session_id":"1259178","input_length":14291,"t_proxy_recv":386803.597320095,"t_decision_unix":1779817668.6112614,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":14291,"score_linear":80365.0,"score_lmetric":63882},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":14291,"score_linear":68131.0,"score_lmetric":82422},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9250,"ongoing_decode_tokens":9250,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":14291,"score_linear":9250.0,"score_lmetric":14291},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":14291,"score_linear":90488.0,"score_lmetric":104779},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14291,"score_linear":112793.0,"score_lmetric":127084},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386804.846244946,"t_first_token_unix":1779817669.8601885,"t_done":386806.775032608,"t_done_unix":1779817671.7889757},{"request_id":"1257525:1:1257525:49","session_id":"1257525","input_length":27387,"t_proxy_recv":386797.81915448,"t_decision_unix":1779817662.8330958,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":27387,"score_linear":90488.0,"score_lmetric":117875},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386801.279164326,"t_first_token_unix":1779817666.2931077,"t_done":386806.904344402,"t_done_unix":1779817671.9182875},{"request_id":"1253804:2:1258346:54","session_id":"1253804","input_length":52978,"t_proxy_recv":386800.729758926,"t_decision_unix":1779817665.7437003,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":35328,"affinity_cache_ratio":0.6668428404243271,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":17650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":22262,"ongoing_decode_tokens":22262,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":113,"cache_hit":0,"new_prefill":52978,"score_linear":22262.0,"score_lmetric":52978},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":35328,"new_prefill":17650,"score_linear":-7941.0,"score_lmetric":45037},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":3584,"new_prefill":49394,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":52978,"score_linear":90488.0,"score_lmetric":143466},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7941.0,"chosen_score_lmetric":45037,"t_first_token":386806.534992403,"t_first_token_unix":1779817671.548936,"t_done":386807.452290365,"t_done_unix":1779817672.466234},{"request_id":"1260746:1:1260746:62","session_id":"1260746","input_length":9571,"t_proxy_recv":386809.141335412,"t_decision_unix":1779817674.1552768,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9571,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":9571,"score_linear":68131.0,"score_lmetric":77702},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":9571,"score_linear":90488.0,"score_lmetric":100059},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9571,"score_linear":125063.0,"score_lmetric":253908},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9571,"score_linear":30655.0,"score_lmetric":40226}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386809.892986738,"t_first_token_unix":1779817674.9069302,"t_done":386810.278625072,"t_done_unix":1779817675.2925687},{"request_id":"1260792:1:1260792:63","session_id":"1260792","input_length":12522,"t_proxy_recv":386809.25802264,"t_decision_unix":1779817674.2719638,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12522,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9571,"ongoing_decode_tokens":0,"pending_prefill_tokens":9571,"num_requests":1,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":12522,"score_linear":9571.0,"score_lmetric":22093},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":12522,"score_linear":68131.0,"score_lmetric":80653},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":12522,"score_linear":90488.0,"score_lmetric":103010},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12522,"score_linear":125063.0,"score_lmetric":259810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":12522,"score_linear":30655.0,"score_lmetric":43177}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386810.28612162,"t_first_token_unix":1779817675.3000648,"t_done":386810.617430385,"t_done_unix":1779817675.6313736},{"request_id":"1261126:1:1261126:65","session_id":"1261126","input_length":5640,"t_proxy_recv":386810.294727684,"t_decision_unix":1779817675.3086689,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5640,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":132,"cache_hit":0,"new_prefill":5640,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55138,"ongoing_decode_tokens":0,"pending_prefill_tokens":2402,"num_requests":1,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":5640,"score_linear":55138.0,"score_lmetric":8042},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":5640,"score_linear":68131.0,"score_lmetric":73771},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12522,"ongoing_decode_tokens":12522,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5640,"score_linear":12522.0,"score_lmetric":5640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5640,"score_linear":90488.0,"score_lmetric":96128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5640,"score_linear":125063.0,"score_lmetric":246046},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":5640,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":5640,"score_linear":30655.0,"score_lmetric":36295}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386810.664289951,"t_first_token_unix":1779817675.6782331,"t_done":386810.830887841,"t_done_unix":1779817675.8448308},{"request_id":"1253804:3:1260997:64","session_id":"1253804","input_length":55138,"t_proxy_recv":386809.997792309,"t_decision_unix":1779817675.0117338,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9564365773151003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2402,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9571,"ongoing_decode_tokens":9571,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":55138,"score_linear":9571.0,"score_lmetric":55138},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":52736,"new_prefill":2402,"score_linear":-52736.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":55138,"score_linear":68131.0,"score_lmetric":123269},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12522,"ongoing_decode_tokens":0,"pending_prefill_tokens":12522,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":3584,"new_prefill":51554,"score_linear":8938.0,"score_lmetric":64076},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":55138,"score_linear":90488.0,"score_lmetric":145626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":55138,"score_linear":125063.0,"score_lmetric":345042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":55138,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":55138,"score_linear":30655.0,"score_lmetric":85793}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":386810.865276165,"t_first_token_unix":1779817675.8792195,"t_done":386811.448743988,"t_done_unix":1779817676.462687},{"request_id":"1260327:1:1260327:61","session_id":"1260327","input_length":30655,"t_proxy_recv":386807.421517682,"t_decision_unix":1779817672.4354591,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":30655,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":52978,"ongoing_decode_tokens":52978,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":218,"cache_hit":0,"new_prefill":30655,"score_linear":52978.0,"score_lmetric":30655},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":30655,"score_linear":68131.0,"score_lmetric":98786},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":30655,"score_linear":90488.0,"score_lmetric":121143},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":30655,"score_linear":125063.0,"score_lmetric":296076},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386811.479921909,"t_first_token_unix":1779817676.4938653,"t_done":386812.118304151,"t_done_unix":1779817677.1322472},{"request_id":"1257525:2:1262205:67","session_id":"1257525","input_length":29988,"t_proxy_recv":386814.111581063,"t_decision_unix":1779817679.1255224,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9048952914499133,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":2852,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":256,"cache_hit":27136,"new_prefill":2852,"score_linear":-27136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":29988,"score_linear":68131.0,"score_lmetric":98119},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":29988,"score_linear":90488.0,"score_lmetric":120476},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":29988,"score_linear":125063.0,"score_lmetric":294742},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":386814.733671221,"t_first_token_unix":1779817679.7476146,"t_done":386814.765463528,"t_done_unix":1779817679.7794065},{"request_id":"1262757:1:1262757:73","session_id":"1262757","input_length":5465,"t_proxy_recv":386815.991069977,"t_decision_unix":1779817681.0050108,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":5465,"score_linear":55989.0,"score_lmetric":6670},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":5465,"score_linear":68131.0,"score_lmetric":73596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5465,"score_linear":15283.0,"score_lmetric":20748},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5465,"score_linear":113053.0,"score_lmetric":196076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5465,"score_linear":125063.0,"score_lmetric":245696},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":5465,"score_linear":21510.0,"score_lmetric":26975}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386816.348844621,"t_first_token_unix":1779817681.3627875,"t_done":386816.477998106,"t_done_unix":1779817681.4919555},{"request_id":"1261126:2:1262820:74","session_id":"1261126","input_length":6953,"t_proxy_recv":386816.162129174,"t_decision_unix":1779817681.1760705,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":5632,"affinity_cache_ratio":0.8100100675967209,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":1321,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":5632,"new_prefill":1321,"score_linear":-5632.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":6953,"score_linear":55989.0,"score_lmetric":8158},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":6953,"score_linear":68131.0,"score_lmetric":75084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":6953,"score_linear":15283.0,"score_lmetric":22236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6953,"score_linear":113053.0,"score_lmetric":199052},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":6953,"score_linear":125063.0,"score_lmetric":248672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":5465,"ongoing_decode_tokens":0,"pending_prefill_tokens":5465,"num_requests":1,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":6953,"score_linear":5465.0,"score_lmetric":12418},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6953,"score_linear":21510.0,"score_lmetric":28463}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":386816.321189943,"t_first_token_unix":1779817681.335133,"t_done":386816.554672592,"t_done_unix":1779817681.568616},{"request_id":"1262354:1:1262354:69","session_id":"1262354","input_length":21510,"t_proxy_recv":386814.707687301,"t_decision_unix":1779817679.7216287,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":29988,"ongoing_decode_tokens":0,"pending_prefill_tokens":2852,"num_requests":1,"active_p_offloads":0,"cached_blocks":256,"cache_hit":0,"new_prefill":21510,"score_linear":29988.0,"score_lmetric":24362},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":21510,"score_linear":68131.0,"score_lmetric":89641},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":21510,"score_linear":113053.0,"score_lmetric":228166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":21510,"score_linear":125063.0,"score_lmetric":277786},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386817.015655933,"t_first_token_unix":1779817682.0295997,"t_done":386817.60776894,"t_done_unix":1779817682.6217124},{"request_id":"1258611:1:1258611:56","session_id":"1258611","input_length":68131,"t_proxy_recv":386801.578451272,"t_decision_unix":1779817666.5923927,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":68131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":68131,"score_linear":80365.0,"score_lmetric":171562},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68131,"score_linear":90488.0,"score_lmetric":158619},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7934,"ongoing_decode_tokens":7934,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":68131,"score_linear":7934.0,"score_lmetric":68131},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386817.841307466,"t_first_token_unix":1779817682.8552506,"t_done":386818.99707166,"t_done_unix":1779817684.0110152},{"request_id":"1258611:2:1261594:66","session_id":"1258611","input_length":68320,"t_proxy_recv":386819.008538301,"t_decision_unix":1779817684.0224798,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9967213114754099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":224,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":68320,"score_linear":55989.0,"score_lmetric":68320},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":68096,"new_prefill":224,"score_linear":-68096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":68320,"score_linear":15283.0,"score_lmetric":68320},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68320,"score_linear":113053.0,"score_lmetric":321786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":68320,"score_linear":125063.0,"score_lmetric":371406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":386819.15612468,"t_first_token_unix":1779817684.1700687,"t_done":386819.195148321,"t_done_unix":1779817684.2090924},{"request_id":"1258611:3:1262709:71","session_id":"1258611","input_length":68377,"t_proxy_recv":386819.206133401,"t_decision_unix":1779817684.2200747,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9958904309928778,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":0,"pending_prefill_tokens":5990,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":68377,"score_linear":5990.0,"score_lmetric":74367},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":68377,"score_linear":55989.0,"score_lmetric":68377},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":68096,"new_prefill":281,"score_linear":-68096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":68377,"score_linear":15283.0,"score_lmetric":68377},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68377,"score_linear":113053.0,"score_lmetric":321900},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":68377,"score_linear":125063.0,"score_lmetric":371520},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":68377,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":0,"pending_prefill_tokens":605,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":68377,"score_linear":22109.0,"score_lmetric":68982}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":386819.347871193,"t_first_token_unix":1779817684.3618145,"t_done":386819.777360961,"t_done_unix":1779817684.7913043},{"request_id":"1263611:1:1263611:76","session_id":"1263611","input_length":5990,"t_proxy_recv":386819.184983435,"t_decision_unix":1779817684.1989248,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5990,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":5990,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":5990,"score_linear":55989.0,"score_lmetric":5990},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68320,"ongoing_decode_tokens":68320,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":5990,"score_linear":68320.0,"score_lmetric":5990},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5990,"score_linear":15283.0,"score_lmetric":5990},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5990,"score_linear":113053.0,"score_lmetric":197126},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5990,"score_linear":125063.0,"score_lmetric":246746},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5990,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":0,"pending_prefill_tokens":605,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":5990,"score_linear":22109.0,"score_lmetric":6595}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386819.584328555,"t_first_token_unix":1779817684.598272,"t_done":386819.979083372,"t_done_unix":1779817684.993027},{"request_id":"1262354:2:1263593:75","session_id":"1262354","input_length":22109,"t_proxy_recv":386819.070451578,"t_decision_unix":1779817684.084393,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9726355782712922,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":605,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":22109,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":22109,"score_linear":55989.0,"score_lmetric":22109},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68320,"ongoing_decode_tokens":0,"pending_prefill_tokens":224,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":22109,"score_linear":68320.0,"score_lmetric":22333},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22109,"score_linear":15283.0,"score_lmetric":22109},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22109,"score_linear":113053.0,"score_lmetric":229364},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22109,"score_linear":125063.0,"score_lmetric":278984},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":22109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":128,"cache_hit":21504,"new_prefill":605,"score_linear":-21504.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":386819.226725482,"t_first_token_unix":1779817684.2406688,"t_done":386820.437249114,"t_done_unix":1779817685.451193},{"request_id":"1263971:1:1263971:80","session_id":"1263971","input_length":6336,"t_proxy_recv":386820.49310842,"t_decision_unix":1779817685.50705,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":6336,"score_linear":55989.0,"score_lmetric":6336},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":6336,"score_linear":71575.0,"score_lmetric":125256},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6336,"score_linear":113053.0,"score_lmetric":197818},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":6336,"score_linear":125063.0,"score_lmetric":247438},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":6336,"score_linear":50783.0,"score_lmetric":57119},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386820.910909227,"t_first_token_unix":1779817685.924853,"t_done":386821.268403103,"t_done_unix":1779817686.2823472},{"request_id":"1257323:1:1257323:48","session_id":"1257323","input_length":90488,"t_proxy_recv":386797.219351234,"t_decision_unix":1779817662.233292,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":90488,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386824.815867845,"t_first_token_unix":1779817689.8298132,"t_done":386825.228279133,"t_done_unix":1779817690.2422225},{"request_id":"1239034:3:1262346:68","session_id":"1239034","input_length":22565,"t_proxy_recv":386814.676103024,"t_decision_unix":1779817679.6900442,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":20480,"affinity_cache_ratio":0.9076002658985154,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":2085,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":29988,"ongoing_decode_tokens":0,"pending_prefill_tokens":2852,"num_requests":1,"active_p_offloads":0,"cached_blocks":256,"cache_hit":0,"new_prefill":22565,"score_linear":29988.0,"score_lmetric":25417},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22565,"score_linear":68131.0,"score_lmetric":90696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":20480,"new_prefill":2085,"score_linear":70008.0,"score_lmetric":92573},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22565,"score_linear":125063.0,"score_lmetric":279896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":70008.0,"chosen_score_lmetric":92573,"t_first_token":386824.817126528,"t_first_token_unix":1779817689.8310697,"t_done":386825.352598132,"t_done_unix":1779817690.3665414},{"request_id":"1265000:1:1265000:83","session_id":"1265000","input_length":301,"t_proxy_recv":386824.118644394,"t_decision_unix":1779817689.1325853,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":301,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":301,"score_linear":110048.0,"score_lmetric":110349},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":301,"score_linear":55989.0,"score_lmetric":301},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":301,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":301,"score_linear":71575.0,"score_lmetric":113186},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":301,"score_linear":113053.0,"score_lmetric":185748},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":301,"score_linear":125063.0,"score_lmetric":235368},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":301,"score_linear":50783.0,"score_lmetric":51084},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":301,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386824.15942892,"t_first_token_unix":1779817689.1733723,"t_done":386825.669147667,"t_done_unix":1779817690.6830914},{"request_id":"1265128:1:1265128:85","session_id":"1265128","input_length":14028,"t_proxy_recv":386824.446959139,"t_decision_unix":1779817689.4609003,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":14028,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14028,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":14028,"score_linear":110048.0,"score_lmetric":124076},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":14028,"score_linear":55989.0,"score_lmetric":14028},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":301,"ongoing_decode_tokens":301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":14028,"score_linear":301.0,"score_lmetric":14028},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":14028,"score_linear":71575.0,"score_lmetric":140640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":14028,"score_linear":113053.0,"score_lmetric":213202},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14028,"score_linear":125063.0,"score_lmetric":262822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":14028,"score_linear":50783.0,"score_lmetric":64811},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":23540,"ongoing_decode_tokens":0,"pending_prefill_tokens":23540,"num_requests":1,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":14028,"score_linear":23540.0,"score_lmetric":37568}],"chosen_score_linear":301.0,"chosen_score_lmetric":14028,"t_first_token":386825.659505005,"t_first_token_unix":1779817690.673449,"t_done":386826.086023438,"t_done_unix":1779817691.099967},{"request_id":"1266067:1:1266067:91","session_id":"1266067","input_length":579,"t_proxy_recv":386827.669576931,"t_decision_unix":1779817692.6835182,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":579,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":579,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":579,"score_linear":135235.0,"score_lmetric":227596},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":60059,"ongoing_decode_tokens":55989,"pending_prefill_tokens":4070,"num_requests":2,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":579,"score_linear":60059.0,"score_lmetric":9298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":579,"score_linear":13178.0,"score_lmetric":13757},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":579,"score_linear":92560.0,"score_lmetric":196704},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":579,"score_linear":27639.0,"score_lmetric":579},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":579,"score_linear":125063.0,"score_lmetric":235924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":579,"score_linear":50783.0,"score_lmetric":51362},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":579,"score_linear":45884.0,"score_lmetric":1158}],"chosen_score_linear":27639.0,"chosen_score_lmetric":579,"t_first_token":386827.800498281,"t_first_token_unix":1779817692.8144412,"t_done":386827.965398084,"t_done_unix":1779817692.9793413},{"request_id":"1263611:2:1265770:88","session_id":"1263611","input_length":13178,"t_proxy_recv":386826.767344319,"t_decision_unix":1779817691.7812855,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":2,"affinity_cache_hit":5632,"affinity_cache_ratio":0.4273789649415693,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":5632,"new_prefill":7546,"score_linear":129603.0,"score_lmetric":241530},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":13178,"score_linear":55989.0,"score_lmetric":13178},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":13178,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":13178,"score_linear":71575.0,"score_lmetric":138940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":13178,"score_linear":27639.0,"score_lmetric":13178},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":13178,"score_linear":125063.0,"score_lmetric":261122},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":13178,"score_linear":50783.0,"score_lmetric":63961},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":13178,"score_linear":45884.0,"score_lmetric":74092}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386827.871454663,"t_first_token_unix":1779817692.8853974,"t_done":386828.119119006,"t_done_unix":1779817693.1330626},{"request_id":"1250772:3:1265019:84","session_id":"1250772","input_length":23540,"t_proxy_recv":386824.191464161,"t_decision_unix":1779817689.2054057,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.45675446049277824,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":23540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":23540,"score_linear":110048.0,"score_lmetric":133588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":23540,"score_linear":55989.0,"score_lmetric":23540},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":301,"ongoing_decode_tokens":301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":23540,"score_linear":301.0,"score_lmetric":23540},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":23540,"score_linear":71575.0,"score_lmetric":159664},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":23540,"score_linear":113053.0,"score_lmetric":232226},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":10752,"new_prefill":12788,"score_linear":114311.0,"score_lmetric":260342},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":23540,"score_linear":50783.0,"score_lmetric":74323},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":23540,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386826.868525456,"t_first_token_unix":1779817691.8824692,"t_done":386828.469347577,"t_done_unix":1779817693.4832907},{"request_id":"1265942:1:1265942:89","session_id":"1265942","input_length":4070,"t_proxy_recv":386827.396185149,"t_decision_unix":1779817692.4101264,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":4070,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4070,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":4070,"score_linear":135235.0,"score_lmetric":234578},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":4070,"score_linear":55989.0,"score_lmetric":4070},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":4070,"score_linear":13178.0,"score_lmetric":17248},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":4070,"score_linear":71575.0,"score_lmetric":120724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":4070,"score_linear":27639.0,"score_lmetric":4070},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":4070,"score_linear":125063.0,"score_lmetric":242906},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":4070,"score_linear":50783.0,"score_lmetric":54853},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":4070,"score_linear":45884.0,"score_lmetric":8140}],"chosen_score_linear":55989.0,"chosen_score_lmetric":4070,"t_first_token":386827.706839351,"t_first_token_unix":1779817692.7207823,"t_done":386828.545992856,"t_done_unix":1779817693.5599363},{"request_id":"1262354:3:1265178:86","session_id":"1262354","input_length":22344,"t_proxy_recv":386824.556708137,"t_decision_unix":1779817689.5706494,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9853204439670605,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":22344,"score_linear":110048.0,"score_lmetric":132392},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":22344,"score_linear":55989.0,"score_lmetric":22344},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14329,"ongoing_decode_tokens":301,"pending_prefill_tokens":14028,"num_requests":2,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":22344,"score_linear":14329.0,"score_lmetric":72744},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22344,"score_linear":71575.0,"score_lmetric":157272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22344,"score_linear":113053.0,"score_lmetric":229834},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22344,"score_linear":125063.0,"score_lmetric":279454},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":22344,"score_linear":50783.0,"score_lmetric":73127},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":23540,"ongoing_decode_tokens":0,"pending_prefill_tokens":23540,"num_requests":1,"active_p_offloads":0,"cached_blocks":141,"cache_hit":22016,"new_prefill":328,"score_linear":1524.0,"score_lmetric":23868}],"chosen_score_linear":1524.0,"chosen_score_lmetric":23868,"t_first_token":386826.870534446,"t_first_token_unix":1779817691.8844779,"t_done":386829.252949596,"t_done_unix":1779817694.2668931},{"request_id":"1266440:1:1266440:92","session_id":"1266440","input_length":5381,"t_proxy_recv":386828.742127044,"t_decision_unix":1779817693.7560685,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":5381,"score_linear":135235.0,"score_lmetric":237200},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":269,"cache_hit":0,"new_prefill":5381,"score_linear":55989.0,"score_lmetric":5381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":5381,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5381,"score_linear":92560.0,"score_lmetric":211110},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":5381,"score_linear":27639.0,"score_lmetric":5381},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5381,"score_linear":125063.0,"score_lmetric":245528},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5381,"score_linear":50783.0,"score_lmetric":56164},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22344,"ongoing_decode_tokens":22344,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":187,"cache_hit":0,"new_prefill":5381,"score_linear":22344.0,"score_lmetric":5381}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386829.120706712,"t_first_token_unix":1779817694.1346502,"t_done":386829.418484357,"t_done_unix":1779817694.4324274},{"request_id":"1263727:1:1263727:77","session_id":"1263727","input_length":50783,"t_proxy_recv":386819.653665503,"t_decision_unix":1779817684.6676068,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":50783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":5990,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":50783,"score_linear":5990.0,"score_lmetric":50783},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":50783,"score_linear":55989.0,"score_lmetric":50783},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68377,"ongoing_decode_tokens":68377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":50783,"score_linear":68377.0,"score_lmetric":50783},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":50783,"score_linear":15283.0,"score_lmetric":50783},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":50783,"score_linear":113053.0,"score_lmetric":286712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":50783,"score_linear":125063.0,"score_lmetric":336332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":50783,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":50783,"score_linear":22109.0,"score_lmetric":50783}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386829.37822431,"t_first_token_unix":1779817694.3921673,"t_done":386829.559434305,"t_done_unix":1779817694.5733774},{"request_id":"1253804:4:1262690:70","session_id":"1253804","input_length":55989,"t_proxy_recv":386815.808067343,"t_decision_unix":1779817680.8220086,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":54784,"affinity_cache_ratio":0.978477915304792,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":1205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":55989,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":261,"cache_hit":54784,"new_prefill":1205,"score_linear":-54784.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":55989,"score_linear":68131.0,"score_lmetric":124120},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":3584,"new_prefill":52405,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":55989,"score_linear":113053.0,"score_lmetric":297124},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":55989,"score_linear":125063.0,"score_lmetric":346744},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":55989,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":55989,"score_linear":21510.0,"score_lmetric":77499}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":386816.224829351,"t_first_token_unix":1779817681.238773,"t_done":386829.904860392,"t_done_unix":1779817694.9188042},{"request_id":"1263971:2:1266797:94","session_id":"1263971","input_length":9504,"t_proxy_recv":386830.091382916,"t_decision_unix":1779817695.1053243,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.6464646464646465,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":3360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":9504,"score_linear":135235.0,"score_lmetric":245446},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":0,"new_prefill":9504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":9504,"score_linear":92560.0,"score_lmetric":223479},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":9504,"score_linear":27639.0,"score_lmetric":9504},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9504,"score_linear":125063.0,"score_lmetric":253774},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":0,"pending_prefill_tokens":17466,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":9504,"score_linear":17466.0,"score_lmetric":26970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":188,"cache_hit":6144,"new_prefill":3360,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":386830.450312099,"t_first_token_unix":1779817695.4642558,"t_done":386830.598919503,"t_done_unix":1779817695.6128628},{"request_id":"1260792:2:1265951:90","session_id":"1260792","input_length":20985,"t_proxy_recv":386827.423444015,"t_decision_unix":1779817692.4373848,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":12288,"affinity_cache_ratio":0.5855611150822015,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":8697,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":20985,"score_linear":135235.0,"score_lmetric":268408},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":60059,"ongoing_decode_tokens":55989,"pending_prefill_tokens":4070,"num_requests":2,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":20985,"score_linear":60059.0,"score_lmetric":50110},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":20985,"score_linear":13178.0,"score_lmetric":34163},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":12288,"new_prefill":8697,"score_linear":59287.0,"score_lmetric":129978},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":20985,"score_linear":27639.0,"score_lmetric":20985},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":20985,"score_linear":125063.0,"score_lmetric":276736},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":20985,"score_linear":50783.0,"score_lmetric":71768},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":20985,"score_linear":45884.0,"score_lmetric":41970}],"chosen_score_linear":59287.0,"chosen_score_lmetric":129978,"t_first_token":386832.341921945,"t_first_token_unix":1779817697.3558652,"t_done":386832.848298997,"t_done_unix":1779817697.8622422},{"request_id":"1263749:1:1263749:79","session_id":"1263749","input_length":56292,"t_proxy_recv":386819.730509139,"t_decision_unix":1779817684.7444506,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":56292,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":56292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":5990,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":56292,"score_linear":5990.0,"score_lmetric":56292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":56292,"score_linear":55989.0,"score_lmetric":56292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68377,"ongoing_decode_tokens":68377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":56292,"score_linear":68377.0,"score_lmetric":56292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":56292,"score_linear":15283.0,"score_lmetric":56292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":56292,"score_linear":113053.0,"score_lmetric":297730},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":56292,"score_linear":125063.0,"score_lmetric":347350},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":56292,"score_linear":50783.0,"score_lmetric":107075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":56292,"score_linear":22109.0,"score_lmetric":56292}],"chosen_score_linear":15283.0,"chosen_score_lmetric":56292,"t_first_token":386831.169792561,"t_first_token_unix":1779817696.1837358,"t_done":386833.782953462,"t_done_unix":1779817698.7968967},{"request_id":"1266668:1:1266668:93","session_id":"1266668","input_length":17466,"t_proxy_recv":386829.642964952,"t_decision_unix":1779817694.6569066,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17466,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":13370,"score_linear":131139.0,"score_lmetric":253178},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":269,"cache_hit":0,"new_prefill":17466,"score_linear":55989.0,"score_lmetric":17466},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":17466,"score_linear":92560.0,"score_lmetric":247365},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":17466,"score_linear":27639.0,"score_lmetric":17466},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":17466,"score_linear":125063.0,"score_lmetric":269698},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":188,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386831.342528135,"t_first_token_unix":1779817696.3564715,"t_done":386835.194865511,"t_done_unix":1779817700.208809},{"request_id":"1265942:2:1268069:97","session_id":"1265942","input_length":10457,"t_proxy_recv":386834.399537728,"t_decision_unix":1779817699.4134784,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":4096,"affinity_cache_ratio":0.39169934015492014,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":6361,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":10457,"score_linear":135235.0,"score_lmetric":247352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":4096,"new_prefill":6361,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10457,"score_linear":126924.0,"score_lmetric":118437},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10457,"score_linear":15283.0,"score_lmetric":10457},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":10457,"score_linear":27639.0,"score_lmetric":10457},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":10457,"score_linear":125063.0,"score_lmetric":255680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":10457,"score_linear":17466.0,"score_lmetric":10457},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28671,"ongoing_decode_tokens":0,"pending_prefill_tokens":6143,"num_requests":1,"active_p_offloads":0,"cached_blocks":194,"cache_hit":0,"new_prefill":10457,"score_linear":28671.0,"score_lmetric":16600}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":386834.980435212,"t_first_token_unix":1779817699.9943786,"t_done":386835.332739786,"t_done_unix":1779817700.346683},{"request_id":"1262354:4:1267821:95","session_id":"1262354","input_length":28671,"t_proxy_recv":386833.700593609,"t_decision_unix":1779817698.7145348,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22528,"affinity_cache_ratio":0.7857416902096195,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":6143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28671,"score_linear":135235.0,"score_lmetric":283780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":0,"new_prefill":28671,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28671,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":71575,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":248,"cache_hit":0,"new_prefill":28671,"score_linear":71575.0,"score_lmetric":57342},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":28671,"score_linear":27639.0,"score_lmetric":28671},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28671,"score_linear":125063.0,"score_lmetric":292108},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":28671,"score_linear":17466.0,"score_lmetric":28671},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":194,"cache_hit":22528,"new_prefill":6143,"score_linear":-22528.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":386834.899974009,"t_first_token_unix":1779817699.9139175,"t_done":386836.18554714,"t_done_unix":1779817701.1994905},{"request_id":"1268634:1:1268634:99","session_id":"1268634","input_length":2298,"t_proxy_recv":386836.641466183,"t_decision_unix":1779817701.655408,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2298,"score_linear":135235.0,"score_lmetric":231034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":2298,"score_linear":102074.0,"score_lmetric":100788},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2298,"score_linear":126924.0,"score_lmetric":110278},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2298,"score_linear":15283.0,"score_lmetric":2298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":2298,"score_linear":27639.0,"score_lmetric":2298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":2298,"score_linear":125063.0,"score_lmetric":239362},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386836.848717907,"t_first_token_unix":1779817701.8626614,"t_done":386836.961630584,"t_done_unix":1779817701.9755738},{"request_id":"1268649:1:1268649:100","session_id":"1268649","input_length":18638,"t_proxy_recv":386836.650243131,"t_decision_unix":1779817701.6641848,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18638,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":18638,"score_linear":135235.0,"score_lmetric":263714},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":18638,"score_linear":102074.0,"score_lmetric":117128},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18638,"score_linear":126924.0,"score_lmetric":126618},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18638,"score_linear":15283.0,"score_lmetric":18638},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":18638,"score_linear":27639.0,"score_lmetric":18638},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":18638,"score_linear":125063.0,"score_lmetric":272042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":2298,"ongoing_decode_tokens":0,"pending_prefill_tokens":2298,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":18638,"score_linear":2298.0,"score_lmetric":20936},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":18638,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386838.590813512,"t_first_token_unix":1779817703.6047566,"t_done":386839.401037315,"t_done_unix":1779817704.4149804},{"request_id":"1263971:3:1269088:104","session_id":"1263971","input_length":13955,"t_proxy_recv":386838.031233548,"t_decision_unix":1779817703.0451748,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.660408455750627,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":4739,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":13955,"score_linear":135235.0,"score_lmetric":254348},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":13955,"score_linear":102074.0,"score_lmetric":112445},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13955,"score_linear":126924.0,"score_lmetric":121935},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13955,"score_linear":15283.0,"score_lmetric":13955},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":27639,"pending_prefill_tokens":12320,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":13955,"score_linear":39959.0,"score_lmetric":52550},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":13955,"score_linear":125063.0,"score_lmetric":262676},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":345,"cache_hit":0,"new_prefill":13955,"score_linear":12195.0,"score_lmetric":26150},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":42667,"ongoing_decode_tokens":0,"pending_prefill_tokens":19115,"num_requests":2,"active_p_offloads":0,"cached_blocks":206,"cache_hit":9216,"new_prefill":4739,"score_linear":33451.0,"score_lmetric":47708}],"chosen_score_linear":33451.0,"chosen_score_lmetric":47708,"t_first_token":386839.12308578,"t_first_token_unix":1779817704.1370287,"t_done":386839.452019774,"t_done_unix":1779817704.4659631},{"request_id":"1262354:5:1269336:105","session_id":"1262354","input_length":28906,"t_proxy_recv":386838.988162373,"t_decision_unix":1779817704.0021038,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9919047948522798,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":234,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28906,"score_linear":135235.0,"score_lmetric":284250},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":28906,"score_linear":102074.0,"score_lmetric":127396},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28906,"score_linear":126924.0,"score_lmetric":136886},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28906,"score_linear":15283.0,"score_lmetric":28906},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":28906,"score_linear":39959.0,"score_lmetric":57812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28906,"score_linear":125063.0,"score_lmetric":292578},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12195,"ongoing_decode_tokens":12195,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":345,"cache_hit":0,"new_prefill":28906,"score_linear":12195.0,"score_lmetric":28906},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":56622,"ongoing_decode_tokens":18638,"pending_prefill_tokens":5216,"num_requests":3,"active_p_offloads":0,"cached_blocks":206,"cache_hit":28672,"new_prefill":234,"score_linear":27950.0,"score_lmetric":16350}],"chosen_score_linear":27950.0,"chosen_score_lmetric":16350,"t_first_token":386839.155997926,"t_first_token_unix":1779817704.169941,"t_done":386840.070887556,"t_done_unix":1779817705.0848315},{"request_id":"1250772:4:1268869:103","session_id":"1250772","input_length":24029,"t_proxy_recv":386837.291822899,"t_decision_unix":1779817702.3057642,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9801489866411419,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":24029,"score_linear":135235.0,"score_lmetric":274496},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":24029,"score_linear":102074.0,"score_lmetric":122519},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24029,"score_linear":126924.0,"score_lmetric":132009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24029,"score_linear":15283.0,"score_lmetric":24029},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":27639,"pending_prefill_tokens":12320,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":24029,"score_linear":39959.0,"score_lmetric":72698},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":10752,"new_prefill":13277,"score_linear":114311.0,"score_lmetric":261320},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":345,"cache_hit":0,"new_prefill":24029,"score_linear":12195.0,"score_lmetric":36224},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":23552,"new_prefill":477,"score_linear":-4914.0,"score_lmetric":19115}],"chosen_score_linear":-4914.0,"chosen_score_lmetric":19115,"t_first_token":386839.120700584,"t_first_token_unix":1779817704.1346436,"t_done":386840.220048781,"t_done_unix":1779817705.2339923},{"request_id":"1268831:1:1268831:101","session_id":"1268831","input_length":12195,"t_proxy_recv":386837.134883001,"t_decision_unix":1779817702.1488242,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":12195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":12195,"score_linear":135235.0,"score_lmetric":250828},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":12195,"score_linear":102074.0,"score_lmetric":110685},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12195,"score_linear":126924.0,"score_lmetric":120175},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12195,"score_linear":15283.0,"score_lmetric":12195},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":12195,"score_linear":27639.0,"score_lmetric":12195},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12195,"score_linear":125063.0,"score_lmetric":259156},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":345,"cache_hit":0,"new_prefill":12195,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":12195,"score_linear":18638.0,"score_lmetric":30833}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386838.140355465,"t_first_token_unix":1779817703.1542988,"t_done":386840.283640625,"t_done_unix":1779817705.297584},{"request_id":"1269373:1:1269373:106","session_id":"1269373","input_length":14104,"t_proxy_recv":386839.113477132,"t_decision_unix":1779817704.1274183,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":6424,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6424,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":10008,"score_linear":131139.0,"score_lmetric":246454},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":14104,"score_linear":102074.0,"score_lmetric":112594},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14104,"score_linear":126924.0,"score_lmetric":122084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14104,"score_linear":15283.0,"score_lmetric":14104},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":14104,"score_linear":39959.0,"score_lmetric":28208},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14104,"score_linear":125063.0,"score_lmetric":262974},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12195,"ongoing_decode_tokens":12195,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":345,"cache_hit":7680,"new_prefill":6424,"score_linear":4515.0,"score_lmetric":6424},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":85528,"ongoing_decode_tokens":18638,"pending_prefill_tokens":5450,"num_requests":4,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":14104,"score_linear":85528.0,"score_lmetric":78216}],"chosen_score_linear":4515.0,"chosen_score_lmetric":6424,"t_first_token":386839.834464314,"t_first_token_unix":1779817704.8484077,"t_done":386841.232259018,"t_done_unix":1779817706.2462027},{"request_id":"1268861:1:1268861:102","session_id":"1268861","input_length":12320,"t_proxy_recv":386837.254325881,"t_decision_unix":1779817702.268267,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":12320,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":12320,"score_linear":135235.0,"score_lmetric":251078},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":12320,"score_linear":102074.0,"score_lmetric":110810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12320,"score_linear":126924.0,"score_lmetric":120300},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12320,"score_linear":15283.0,"score_lmetric":12320},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":12320,"score_linear":27639.0,"score_lmetric":12320},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12320,"score_linear":125063.0,"score_lmetric":259406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":345,"cache_hit":0,"new_prefill":12320,"score_linear":12195.0,"score_lmetric":24515},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":18638,"ongoing_decode_tokens":0,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":12320,"score_linear":18638.0,"score_lmetric":30958}],"chosen_score_linear":27639.0,"chosen_score_lmetric":12320,"t_first_token":386838.286735957,"t_first_token_unix":1779817703.3006794,"t_done":386841.25255516,"t_done_unix":1779817706.2664986},{"request_id":"1269901:1:1269901:107","session_id":"1269901","input_length":1323,"t_proxy_recv":386840.671013123,"t_decision_unix":1779817705.6849544,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1323,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":1323,"score_linear":135235.0,"score_lmetric":229084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":1323,"score_linear":102074.0,"score_lmetric":99813},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":1323,"score_linear":126924.0,"score_lmetric":109303},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":1323,"score_linear":15283.0,"score_lmetric":1323},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":1323,"score_linear":39959.0,"score_lmetric":2646},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":1323,"score_linear":125063.0,"score_lmetric":237412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14104,"ongoing_decode_tokens":14104,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":369,"cache_hit":0,"new_prefill":1323,"score_linear":14104.0,"score_lmetric":1323},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":1323,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386840.818253452,"t_first_token_unix":1779817705.8321967,"t_done":386841.409246908,"t_done_unix":1779817706.42319},{"request_id":"1260327:2:1270005:108","session_id":"1260327","input_length":30828,"t_proxy_recv":386841.096392671,"t_decision_unix":1779817706.110334,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9964966913195796,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":30828,"score_linear":135235.0,"score_lmetric":288094},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":30828,"score_linear":102074.0,"score_lmetric":129318},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30828,"score_linear":126924.0,"score_lmetric":138808},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30828,"score_linear":15283.0,"score_lmetric":30828},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39959,"ongoing_decode_tokens":39959,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":30828,"score_linear":39959.0,"score_lmetric":61656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":30828,"score_linear":125063.0,"score_lmetric":296422},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14104,"ongoing_decode_tokens":14104,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":369,"cache_hit":0,"new_prefill":30828,"score_linear":14104.0,"score_lmetric":30828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":1323,"ongoing_decode_tokens":1323,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":252,"cache_hit":30720,"new_prefill":108,"score_linear":-29397.0,"score_lmetric":108}],"chosen_score_linear":-29397.0,"chosen_score_lmetric":108,"t_first_token":386841.185430874,"t_first_token_unix":1779817706.1993744,"t_done":386841.562276538,"t_done_unix":1779817706.5762198},{"request_id":"1266440:2:1270501:112","session_id":"1266440","input_length":11128,"t_proxy_recv":386842.86519267,"t_decision_unix":1779817707.879134,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.46010064701653486,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":11128,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11128,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":11128,"score_linear":135235.0,"score_lmetric":248694},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":11128,"score_linear":102074.0,"score_lmetric":109618},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":5120,"new_prefill":6008,"score_linear":121804.0,"score_lmetric":113988},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11128,"score_linear":15283.0,"score_lmetric":11128},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":11128,"score_linear":27639.0,"score_lmetric":11128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":11128,"score_linear":125063.0,"score_lmetric":257022},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":11128,"score_linear":57803.0,"score_lmetric":18243},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":11128,"score_linear":27927.0,"score_lmetric":39055}],"chosen_score_linear":15283.0,"chosen_score_lmetric":11128,"t_first_token":386843.767315761,"t_first_token_unix":1779817708.781259,"t_done":386843.981696009,"t_done_unix":1779817708.9956393},{"request_id":"1256273:4:1259632:60","session_id":"1256273","input_length":12270,"t_proxy_recv":386805.140930094,"t_decision_unix":1779817670.1548715,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":7680,"affinity_cache_ratio":0.6259168704156479,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":4590,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":12270,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":12270,"score_linear":80365.0,"score_lmetric":59840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":12270,"score_linear":68131.0,"score_lmetric":80401},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9250,"ongoing_decode_tokens":9250,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":12270,"score_linear":9250.0,"score_lmetric":12270},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":12270,"score_linear":90488.0,"score_lmetric":102758},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":7680,"new_prefill":4590,"score_linear":105113.0,"score_lmetric":117383},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14291,"ongoing_decode_tokens":14291,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":12270,"score_linear":14291.0,"score_lmetric":12270},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":12270,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":105113.0,"chosen_score_lmetric":117383,"t_first_token":386843.91873686,"t_first_token_unix":1779817708.9326804,"t_done":386844.952097762,"t_done_unix":1779817709.9660413},{"request_id":"1258859:1:1258859:57","session_id":"1258859","input_length":112793,"t_proxy_recv":386802.55098233,"t_decision_unix":1779817667.5649233,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":112793,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":112793,"score_linear":80365.0,"score_lmetric":260886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":112793,"score_linear":68131.0,"score_lmetric":180924},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":112793,"score_linear":90488.0,"score_lmetric":203281},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386843.69305912,"t_first_token_unix":1779817708.7070026,"t_done":386845.06665635,"t_done_unix":1779817710.0806},{"request_id":"1263727:2:1270052:109","session_id":"1263727","input_length":57803,"t_proxy_recv":386841.289850665,"t_decision_unix":1779817706.3037922,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":50688,"affinity_cache_ratio":0.876909502966974,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":7115,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":57803,"score_linear":135235.0,"score_lmetric":342044},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":57803,"score_linear":102074.0,"score_lmetric":156293},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":57803,"score_linear":126924.0,"score_lmetric":165783},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":57803,"score_linear":15283.0,"score_lmetric":57803},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":57803,"score_linear":27639.0,"score_lmetric":57803},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":57803,"score_linear":125063.0,"score_lmetric":350372},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":382,"cache_hit":50688,"new_prefill":7115,"score_linear":-50688.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32151,"ongoing_decode_tokens":32151,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":57803,"score_linear":32151.0,"score_lmetric":115606}],"chosen_score_linear":-50688.0,"chosen_score_lmetric":0,"t_first_token":386843.827154894,"t_first_token_unix":1779817708.8410983,"t_done":386846.954536003,"t_done_unix":1779817711.9684794},{"request_id":"1270340:1:1270340:111","session_id":"1270340","input_length":27927,"t_proxy_recv":386842.299317602,"t_decision_unix":1779817707.3132586,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":27927,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":27927,"score_linear":135235.0,"score_lmetric":282292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":27927,"score_linear":102074.0,"score_lmetric":126417},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27927,"score_linear":126924.0,"score_lmetric":135907},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27927,"score_linear":15283.0,"score_lmetric":27927},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":27927,"score_linear":27639.0,"score_lmetric":27927},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":27927,"score_linear":125063.0,"score_lmetric":290620},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":27927,"score_linear":57803.0,"score_lmetric":35042},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":27927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386846.620312414,"t_first_token_unix":1779817711.634256,"t_done":386847.022414911,"t_done_unix":1779817712.036358},{"request_id":"1271847:1:1271847:123","session_id":"1271847","input_length":2524,"t_proxy_recv":386847.55370282,"t_decision_unix":1779817712.5676441,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":5048,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2524,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2524,"score_linear":135235.0,"score_lmetric":231486},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":2524,"score_linear":102074.0,"score_lmetric":101014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2524,"score_linear":150574.0,"score_lmetric":240660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":16034,"pending_prefill_tokens":21719,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":2524,"score_linear":37753.0,"score_lmetric":72729},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":2524,"score_linear":121069.0,"score_lmetric":191908},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":2524,"score_linear":130878.0,"score_lmetric":40460},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":62237,"ongoing_decode_tokens":62237,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":2524,"score_linear":62237.0,"score_lmetric":7572},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61097,"ongoing_decode_tokens":61097,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":308,"cache_hit":0,"new_prefill":2524,"score_linear":61097.0,"score_lmetric":5048}],"chosen_score_linear":61097.0,"chosen_score_lmetric":5048,"t_first_token":386847.758847232,"t_first_token_unix":1779817712.7727902,"t_done":386848.027013876,"t_done_unix":1779817713.0409577},{"request_id":"1268831:2:1271087:116","session_id":"1268831","input_length":19448,"t_proxy_recv":386845.113172721,"t_decision_unix":1779817710.1271143,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":12288,"affinity_cache_ratio":0.6318387494858083,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":7160,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":19448,"score_linear":135235.0,"score_lmetric":265334},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":19448,"score_linear":102074.0,"score_lmetric":117938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":19448,"score_linear":126924.0,"score_lmetric":127428},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":19448,"score_linear":15283.0,"score_lmetric":19448},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":19448,"score_linear":121069.0,"score_lmetric":225756},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":0,"pending_prefill_tokens":532,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":19448,"score_linear":113172.0,"score_lmetric":19980},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":86188,"ongoing_decode_tokens":57803,"pending_prefill_tokens":10465,"num_requests":2,"active_p_offloads":0,"cached_blocks":382,"cache_hit":12288,"new_prefill":7160,"score_linear":73900.0,"score_lmetric":35250},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":19448,"score_linear":60701.0,"score_lmetric":102954}],"chosen_score_linear":73900.0,"chosen_score_lmetric":35250,"t_first_token":386846.600566388,"t_first_token_unix":1779817711.6145098,"t_done":386848.722597981,"t_done_unix":1779817713.7365413},{"request_id":"1271991:1:1271991:124","session_id":"1271991","input_length":2851,"t_proxy_recv":386848.085720873,"t_decision_unix":1779817713.099662,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":5702,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2851,"score_linear":135235.0,"score_lmetric":232140},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":2851,"score_linear":102074.0,"score_lmetric":101341},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2851,"score_linear":150574.0,"score_lmetric":241314},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":16034,"pending_prefill_tokens":21719,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":2851,"score_linear":37753.0,"score_lmetric":73710},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":2851,"score_linear":121069.0,"score_lmetric":192562},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":130878,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":2851,"score_linear":130878.0,"score_lmetric":5702},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":62237,"ongoing_decode_tokens":62237,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":2851,"score_linear":62237.0,"score_lmetric":8553},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61097,"ongoing_decode_tokens":61097,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":312,"cache_hit":0,"new_prefill":2851,"score_linear":61097.0,"score_lmetric":5702}],"chosen_score_linear":130878.0,"chosen_score_lmetric":5702,"t_first_token":386848.488063926,"t_first_token_unix":1779817713.502007,"t_done":386848.900870717,"t_done_unix":1779817713.9148138},{"request_id":"1271328:1:1271328:117","session_id":"1271328","input_length":17706,"t_proxy_recv":386845.84080312,"t_decision_unix":1779817710.8547444,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":17706,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":17706,"score_linear":135235.0,"score_lmetric":261850},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":17706,"score_linear":102074.0,"score_lmetric":116196},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17706,"score_linear":126924.0,"score_lmetric":125686},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":17706,"score_linear":15283.0,"score_lmetric":17706},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":17706,"score_linear":121069.0,"score_lmetric":222272},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":17706,"score_linear":113172.0,"score_lmetric":17706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":105636,"ongoing_decode_tokens":86188,"pending_prefill_tokens":7160,"num_requests":3,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":17706,"score_linear":105636.0,"score_lmetric":74598},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":17706,"score_linear":60701.0,"score_lmetric":99470}],"chosen_score_linear":113172.0,"chosen_score_lmetric":17706,"t_first_token":386847.689316257,"t_first_token_unix":1779817712.7032597,"t_done":386849.108709928,"t_done_unix":1779817714.1226532},{"request_id":"1272085:1:1272085:125","session_id":"1272085","input_length":5302,"t_proxy_recv":386848.421080026,"t_decision_unix":1779817713.4350216,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":10604,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":5302,"score_linear":135235.0,"score_lmetric":237042},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":5302,"score_linear":102074.0,"score_lmetric":103792},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":5302,"score_linear":150574.0,"score_lmetric":246216},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":16034,"pending_prefill_tokens":21719,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":5302,"score_linear":37753.0,"score_lmetric":81063},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":5302,"score_linear":121069.0,"score_lmetric":197464},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":133729,"ongoing_decode_tokens":130878,"pending_prefill_tokens":2851,"num_requests":3,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":5302,"score_linear":133729.0,"score_lmetric":24459},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":62237,"ongoing_decode_tokens":62237,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":5302,"score_linear":62237.0,"score_lmetric":15906},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61097,"ongoing_decode_tokens":61097,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":312,"cache_hit":0,"new_prefill":5302,"score_linear":61097.0,"score_lmetric":10604}],"chosen_score_linear":61097.0,"chosen_score_lmetric":10604,"t_first_token":386848.772843028,"t_first_token_unix":1779817713.786786,"t_done":386849.512664687,"t_done_unix":1779817714.5266087},{"request_id":"1271459:1:1271459:118","session_id":"1271459","input_length":751,"t_proxy_recv":386846.260962064,"t_decision_unix":1779817711.2749035,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":751,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":751,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":751,"score_linear":135235.0,"score_lmetric":227940},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":751,"score_linear":102074.0,"score_lmetric":99241},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":751,"score_linear":126924.0,"score_lmetric":108731},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":751,"score_linear":15283.0,"score_lmetric":751},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":751,"score_linear":121069.0,"score_lmetric":188362},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":751,"score_linear":130878.0,"score_lmetric":36914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":105636,"ongoing_decode_tokens":86188,"pending_prefill_tokens":7160,"num_requests":3,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":751,"score_linear":105636.0,"score_lmetric":23733},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":751,"score_linear":60701.0,"score_lmetric":65560}],"chosen_score_linear":15283.0,"chosen_score_lmetric":751,"t_first_token":386846.356734621,"t_first_token_unix":1779817711.3706775,"t_done":386849.834854254,"t_done_unix":1779817714.8487973},{"request_id":"1270340:2:1271641:121","session_id":"1270340","input_length":28323,"t_proxy_recv":386847.027808371,"t_decision_unix":1779817712.04175,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9761677788369876,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28323,"score_linear":135235.0,"score_lmetric":283084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":28323,"score_linear":102074.0,"score_lmetric":126813},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28323,"score_linear":150574.0,"score_lmetric":292258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":16034,"pending_prefill_tokens":21719,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":28323,"score_linear":37753.0,"score_lmetric":150126},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":28323,"score_linear":121069.0,"score_lmetric":243506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":28323,"score_linear":130878.0,"score_lmetric":92058},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":62237,"ongoing_decode_tokens":62237,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":395,"cache_hit":0,"new_prefill":28323,"score_linear":62237.0,"score_lmetric":84969},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32774,"ongoing_decode_tokens":32774,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":308,"cache_hit":27648,"new_prefill":675,"score_linear":5126.0,"score_lmetric":675}],"chosen_score_linear":5126.0,"chosen_score_lmetric":675,"t_first_token":386847.205632077,"t_first_token_unix":1779817712.2195754,"t_done":386849.983751814,"t_done_unix":1779817714.997695},{"request_id":"1266668:2:1270661:115","session_id":"1266668","input_length":28385,"t_proxy_recv":386843.481131169,"t_decision_unix":1779817708.4950724,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":17920,"affinity_cache_ratio":0.6313193588162762,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":10465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":24289,"score_linear":131139.0,"score_lmetric":275016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":28385,"score_linear":102074.0,"score_lmetric":126875},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28385,"score_linear":126924.0,"score_lmetric":136365},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26411,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11128,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28385,"score_linear":26411.0,"score_lmetric":79026},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":28385,"score_linear":121069.0,"score_lmetric":243630},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28385,"score_linear":125063.0,"score_lmetric":291536},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":382,"cache_hit":17920,"new_prefill":10465,"score_linear":39883.0,"score_lmetric":17580},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":28385,"score_linear":60701.0,"score_lmetric":120828}],"chosen_score_linear":39883.0,"chosen_score_lmetric":17580,"t_first_token":386845.648648382,"t_first_token_unix":1779817710.6625917,"t_done":386850.325828711,"t_done_unix":1779817715.3397722},{"request_id":"1271486:1:1271486:119","session_id":"1271486","input_length":21719,"t_proxy_recv":386846.354392761,"t_decision_unix":1779817711.3683343,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":44940,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21719,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21719,"score_linear":135235.0,"score_lmetric":269876},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":21719,"score_linear":102074.0,"score_lmetric":120209},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21719,"score_linear":126924.0,"score_lmetric":129699},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16034,"ongoing_decode_tokens":15283,"pending_prefill_tokens":751,"num_requests":2,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":21719,"score_linear":16034.0,"score_lmetric":44940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":21719,"score_linear":121069.0,"score_lmetric":230298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":21719,"score_linear":130878.0,"score_lmetric":78850},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":105636,"ongoing_decode_tokens":86188,"pending_prefill_tokens":7160,"num_requests":3,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":21719,"score_linear":105636.0,"score_lmetric":86637},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":21719,"score_linear":60701.0,"score_lmetric":107496}],"chosen_score_linear":16034.0,"chosen_score_lmetric":44940,"t_first_token":386848.703717466,"t_first_token_unix":1779817713.7176607,"t_done":386850.67726104,"t_done_unix":1779817715.6912043},{"request_id":"1269373:2:1271580:120","session_id":"1269373","input_length":14404,"t_proxy_recv":386846.669477047,"t_decision_unix":1779817711.6834183,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.995279089141905,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":68,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":10308,"score_linear":131139.0,"score_lmetric":247054},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":14404,"score_linear":102074.0,"score_lmetric":112894},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14404,"score_linear":126924.0,"score_lmetric":122384},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":16034,"pending_prefill_tokens":21719,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":14404,"score_linear":37753.0,"score_lmetric":108369},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":14404,"score_linear":121069.0,"score_lmetric":215668},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":14404,"score_linear":130878.0,"score_lmetric":64220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":105636,"ongoing_decode_tokens":105636,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":382,"cache_hit":14336,"new_prefill":68,"score_linear":91300.0,"score_lmetric":204},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":60701,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":14404,"score_linear":60701.0,"score_lmetric":28808}],"chosen_score_linear":91300.0,"chosen_score_lmetric":204,"t_first_token":386846.748058528,"t_first_token_unix":1779817711.7620018,"t_done":386851.173684829,"t_done_unix":1779817716.1876285},{"request_id":"1262354:6:1270643:114","session_id":"1262354","input_length":32774,"t_proxy_recv":386843.401983998,"t_decision_unix":1779817708.4159255,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28672,"affinity_cache_ratio":0.8748398120461341,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":4102,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":32774,"score_linear":135235.0,"score_lmetric":291986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":32774,"score_linear":102074.0,"score_lmetric":131264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32774,"score_linear":126924.0,"score_lmetric":140754},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26411,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11128,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32774,"score_linear":26411.0,"score_lmetric":87804},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":32774,"score_linear":121069.0,"score_lmetric":252408},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":32774,"score_linear":125063.0,"score_lmetric":300314},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":32774,"score_linear":57803.0,"score_lmetric":39889},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":254,"cache_hit":28672,"new_prefill":4102,"score_linear":-745.0,"score_lmetric":32029}],"chosen_score_linear":-745.0,"chosen_score_lmetric":32029,"t_first_token":386846.622674998,"t_first_token_unix":1779817711.636618,"t_done":386852.840975578,"t_done_unix":1779817717.8549187},{"request_id":"1272313:1:1272313:126","session_id":"1272313","input_length":9718,"t_proxy_recv":386849.33410656,"t_decision_unix":1779817714.348048,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":4076,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2038,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":5622,"score_linear":131139.0,"score_lmetric":237682},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":9718,"score_linear":102074.0,"score_lmetric":108208},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9718,"score_linear":150574.0,"score_lmetric":255048},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":37753,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":9718,"score_linear":37753.0,"score_lmetric":29154},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":9718,"score_linear":121069.0,"score_lmetric":206296},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":304,"cache_hit":0,"new_prefill":9718,"score_linear":113172.0,"score_lmetric":9718},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42789,"ongoing_decode_tokens":42789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":409,"cache_hit":7680,"new_prefill":2038,"score_linear":35109.0,"score_lmetric":4076},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":66399,"ongoing_decode_tokens":66399,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":312,"cache_hit":0,"new_prefill":9718,"score_linear":66399.0,"score_lmetric":29154}],"chosen_score_linear":35109.0,"chosen_score_lmetric":4076,"t_first_token":386849.576793914,"t_first_token_unix":1779817714.590737,"t_done":386853.348462559,"t_done_unix":1779817718.3624063},{"request_id":"1272085:2:1273645:130","session_id":"1272085","input_length":8017,"t_proxy_recv":386854.053718946,"t_decision_unix":1779817719.0676603,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":5120,"affinity_cache_ratio":0.6386428838717725,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":2897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":8017,"score_linear":135235.0,"score_lmetric":242472},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":8017,"score_linear":120167.0,"score_lmetric":228720},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8017,"score_linear":150574.0,"score_lmetric":251646},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37246,"ongoing_decode_tokens":37246,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":422,"cache_hit":0,"new_prefill":8017,"score_linear":37246.0,"score_lmetric":16034},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":8017,"score_linear":121069.0,"score_lmetric":202894},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":304,"cache_hit":0,"new_prefill":8017,"score_linear":113172.0,"score_lmetric":8017},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33711,"ongoing_decode_tokens":33711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":435,"cache_hit":0,"new_prefill":8017,"score_linear":33711.0,"score_lmetric":8017},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":332,"cache_hit":5120,"new_prefill":2897,"score_linear":-5120.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":386854.345550667,"t_first_token_unix":1779817719.3594942,"t_done":386854.939465375,"t_done_unix":1779817719.9534092},{"request_id":"1260327:3:1273741:132","session_id":"1260327","input_length":31283,"t_proxy_recv":386854.460939731,"t_decision_unix":1779817719.474881,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9820030048269028,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":563,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":31283,"score_linear":135235.0,"score_lmetric":289004},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":31283,"score_linear":120167.0,"score_lmetric":275252},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31283,"score_linear":150574.0,"score_lmetric":298178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37246,"ongoing_decode_tokens":37246,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":422,"cache_hit":0,"new_prefill":31283,"score_linear":37246.0,"score_lmetric":62566},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":31283,"score_linear":121069.0,"score_lmetric":249426},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138280,"ongoing_decode_tokens":113172,"pending_prefill_tokens":7700,"num_requests":2,"active_p_offloads":0,"cached_blocks":304,"cache_hit":0,"new_prefill":31283,"score_linear":138280.0,"score_lmetric":77966},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33711,"ongoing_decode_tokens":33711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":435,"cache_hit":0,"new_prefill":31283,"score_linear":33711.0,"score_lmetric":31283},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":8017,"ongoing_decode_tokens":8017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":332,"cache_hit":30720,"new_prefill":563,"score_linear":-22703.0,"score_lmetric":563}],"chosen_score_linear":-22703.0,"chosen_score_lmetric":563,"t_first_token":386854.657630457,"t_first_token_unix":1779817719.6715739,"t_done":386855.363738217,"t_done_unix":1779817720.3776817},{"request_id":"1266668:3:1273119:128","session_id":"1266668","input_length":33711,"t_proxy_recv":386852.109336133,"t_decision_unix":1779817717.123277,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28672,"affinity_cache_ratio":0.850523567974845,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":5039,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":29615,"score_linear":131139.0,"score_lmetric":285668},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":33711,"score_linear":120167.0,"score_lmetric":280108},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33711,"score_linear":150574.0,"score_lmetric":303034},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":422,"cache_hit":0,"new_prefill":33711,"score_linear":15283.0,"score_lmetric":33711},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":33711,"score_linear":121069.0,"score_lmetric":254282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":304,"cache_hit":0,"new_prefill":33711,"score_linear":113172.0,"score_lmetric":33711},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":9718,"ongoing_decode_tokens":9718,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":431,"cache_hit":28672,"new_prefill":5039,"score_linear":-18954.0,"score_lmetric":5039},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32774,"ongoing_decode_tokens":32774,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":33711,"score_linear":32774.0,"score_lmetric":33711}],"chosen_score_linear":-18954.0,"chosen_score_lmetric":5039,"t_first_token":386853.250591338,"t_first_token_unix":1779817718.264535,"t_done":386855.820920878,"t_done_unix":1779817720.8348644},{"request_id":"1258859:2:1264639:81","session_id":"1258859","input_length":113172,"t_proxy_recv":386845.084807039,"t_decision_unix":1779817710.0987487,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":112640,"affinity_cache_ratio":0.995299190612519,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":113172,"score_linear":135235.0,"score_lmetric":452782},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":113172,"score_linear":102074.0,"score_lmetric":211662},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":113172,"score_linear":126924.0,"score_lmetric":221152},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":113172,"score_linear":15283.0,"score_lmetric":113172},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":113172,"score_linear":121069.0,"score_lmetric":413204},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":265,"cache_hit":112640,"new_prefill":532,"score_linear":-112640.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":86188,"ongoing_decode_tokens":57803,"pending_prefill_tokens":10465,"num_requests":2,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":113172,"score_linear":86188.0,"score_lmetric":247274},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":0,"pending_prefill_tokens":32029,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":113172,"score_linear":60701.0,"score_lmetric":290402}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":386845.456769232,"t_first_token_unix":1779817710.4707131,"t_done":386856.585614971,"t_done_unix":1779817721.59956},{"request_id":"1262727:1:1262727:72","session_id":"1262727","input_length":15283,"t_proxy_recv":386815.91231764,"t_decision_unix":1779817680.926259,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":15283,"score_linear":55989.0,"score_lmetric":16488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":15283,"score_linear":68131.0,"score_lmetric":83414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":15283,"score_linear":113053.0,"score_lmetric":215712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":15283,"score_linear":125063.0,"score_lmetric":265332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":15283,"score_linear":21510.0,"score_lmetric":36793}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386817.321599379,"t_first_token_unix":1779817682.3355427,"t_done":386857.216438938,"t_done_unix":1779817722.230382},{"request_id":"1274405:1:1274405:134","session_id":"1274405","input_length":6208,"t_proxy_recv":386856.851925557,"t_decision_unix":1779817721.865867,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6208,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":6208,"score_linear":135235.0,"score_lmetric":238854},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":6208,"score_linear":120167.0,"score_lmetric":225102},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":6208,"score_linear":150574.0,"score_lmetric":248028},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37246,"ongoing_decode_tokens":37246,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":422,"cache_hit":0,"new_prefill":6208,"score_linear":37246.0,"score_lmetric":12416},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":6208,"score_linear":121069.0,"score_lmetric":199276},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":25108,"ongoing_decode_tokens":25108,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":6208,"score_linear":25108.0,"score_lmetric":6208},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":6208,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":338,"cache_hit":0,"new_prefill":6208,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386857.262995349,"t_first_token_unix":1779817722.276939,"t_done":386857.731468623,"t_done_unix":1779817722.7454123},{"request_id":"1273203:1:1273203:129","session_id":"1273203","input_length":21963,"t_proxy_recv":386852.411411545,"t_decision_unix":1779817717.4253528,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":9163,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":9163,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21963,"score_linear":135235.0,"score_lmetric":270364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":21963,"score_linear":120167.0,"score_lmetric":256612},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21963,"score_linear":150574.0,"score_lmetric":279538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":422,"cache_hit":12800,"new_prefill":9163,"score_linear":2483.0,"score_lmetric":9163},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":21963,"score_linear":121069.0,"score_lmetric":230786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":304,"cache_hit":0,"new_prefill":21963,"score_linear":113172.0,"score_lmetric":21963},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":43429,"ongoing_decode_tokens":9718,"pending_prefill_tokens":5039,"num_requests":2,"active_p_offloads":0,"cached_blocks":431,"cache_hit":0,"new_prefill":21963,"score_linear":43429.0,"score_lmetric":54004},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32774,"ongoing_decode_tokens":32774,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":21963,"score_linear":32774.0,"score_lmetric":21963}],"chosen_score_linear":2483.0,"chosen_score_lmetric":9163,"t_first_token":386853.80180225,"t_first_token_unix":1779817718.8157463,"t_done":386858.005595729,"t_done_unix":1779817723.019539},{"request_id":"1271328:2:1273711:131","session_id":"1271328","input_length":25108,"t_proxy_recv":386854.315861392,"t_decision_unix":1779817719.3298023,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":17408,"affinity_cache_ratio":0.6933248367054325,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":7700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":25108,"score_linear":135235.0,"score_lmetric":276654},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":25108,"score_linear":120167.0,"score_lmetric":262902},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":25108,"score_linear":150574.0,"score_lmetric":285828},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37246,"ongoing_decode_tokens":37246,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":422,"cache_hit":0,"new_prefill":25108,"score_linear":37246.0,"score_lmetric":50216},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":25108,"score_linear":121069.0,"score_lmetric":237076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":304,"cache_hit":17408,"new_prefill":7700,"score_linear":95764.0,"score_lmetric":7700},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33711,"ongoing_decode_tokens":33711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":435,"cache_hit":0,"new_prefill":25108,"score_linear":33711.0,"score_lmetric":25108},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":8017,"ongoing_decode_tokens":0,"pending_prefill_tokens":2897,"num_requests":1,"active_p_offloads":0,"cached_blocks":332,"cache_hit":0,"new_prefill":25108,"score_linear":8017.0,"score_lmetric":28005}],"chosen_score_linear":95764.0,"chosen_score_lmetric":7700,"t_first_token":386855.574056095,"t_first_token_unix":1779817720.5879996,"t_done":386858.886986635,"t_done_unix":1779817723.9009302},{"request_id":"1274890:1:1274890:135","session_id":"1274890","input_length":10506,"t_proxy_recv":386858.381900254,"t_decision_unix":1779817723.3958414,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10506,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":10506,"score_linear":135235.0,"score_lmetric":247450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":10506,"score_linear":120167.0,"score_lmetric":233698},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10506,"score_linear":150574.0,"score_lmetric":256624},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":10506,"score_linear":121069.0,"score_lmetric":207872},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":25108,"ongoing_decode_tokens":25108,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":10506,"score_linear":25108.0,"score_lmetric":10506},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":350,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386859.200375089,"t_first_token_unix":1779817724.2143185,"t_done":386859.44728955,"t_done_unix":1779817724.4612327},{"request_id":"1275433:1:1275433:137","session_id":"1275433","input_length":7794,"t_proxy_recv":386860.128243581,"t_decision_unix":1779817725.1421847,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7794,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":7794,"score_linear":135235.0,"score_lmetric":242026},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":7794,"score_linear":120167.0,"score_lmetric":228274},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":7794,"score_linear":150574.0,"score_lmetric":251200},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":7794,"score_linear":121069.0,"score_lmetric":202448},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":7794,"score_linear":114612.0,"score_lmetric":122406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386860.67319811,"t_first_token_unix":1779817725.687142,"t_done":386860.722716272,"t_done_unix":1779817725.7366605},{"request_id":"1275433:2:1276027:139","session_id":"1275433","input_length":7463,"t_proxy_recv":386862.399627156,"t_decision_unix":1779817727.4135683,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":7168,"affinity_cache_ratio":0.960471660190272,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":295,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":7463,"score_linear":135235.0,"score_lmetric":241364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":7463,"score_linear":120167.0,"score_lmetric":227612},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":7463,"score_linear":150574.0,"score_lmetric":250538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":7463,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":7463,"score_linear":121069.0,"score_lmetric":201786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":7463,"score_linear":114612.0,"score_lmetric":122075},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":460,"cache_hit":7168,"new_prefill":295,"score_linear":3471.0,"score_lmetric":295},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":7463,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":3471.0,"chosen_score_lmetric":295,"t_first_token":386862.435602537,"t_first_token_unix":1779817727.4495559,"t_done":386862.44916159,"t_done_unix":1779817727.4631045},{"request_id":"1272313:2:1275926:138","session_id":"1272313","input_length":10639,"t_proxy_recv":386862.068542874,"t_decision_unix":1779817727.0824838,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.914371651471003,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":6543,"score_linear":131139.0,"score_lmetric":239524},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":10639,"score_linear":120167.0,"score_lmetric":233964},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10639,"score_linear":150574.0,"score_lmetric":256890},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":10639,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":10639,"score_linear":121069.0,"score_lmetric":208138},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":10639,"score_linear":114612.0,"score_lmetric":125251},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":460,"cache_hit":9728,"new_prefill":911,"score_linear":-9728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":10639,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":386862.228382898,"t_first_token_unix":1779817727.2423267,"t_done":386863.497795924,"t_done_unix":1779817728.5117395},{"request_id":"1264679:1:1264679:82","session_id":"1264679","input_length":110048,"t_proxy_recv":386823.021706329,"t_decision_unix":1779817688.0356472,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":110048,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":110048,"score_linear":55989.0,"score_lmetric":110048},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":110048,"score_linear":71575.0,"score_lmetric":332680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":110048,"score_linear":113053.0,"score_lmetric":405242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":110048,"score_linear":125063.0,"score_lmetric":454862},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":110048,"score_linear":50783.0,"score_lmetric":160831},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386862.708268959,"t_first_token_unix":1779817727.7222123,"t_done":386863.80968547,"t_done_unix":1779817728.8236294},{"request_id":"1276111:1:1276111:140","session_id":"1276111","input_length":15783,"t_proxy_recv":386862.748657216,"t_decision_unix":1779817727.7625988,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":135235,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":15783,"score_linear":135235.0,"score_lmetric":31566},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":15783,"score_linear":120167.0,"score_lmetric":244252},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":15783,"score_linear":150574.0,"score_lmetric":267178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":15783,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":15783,"score_linear":121069.0,"score_lmetric":218426},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":15783,"score_linear":114612.0,"score_lmetric":130395},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":460,"cache_hit":0,"new_prefill":15783,"score_linear":10639.0,"score_lmetric":15783},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":15783,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386864.182900587,"t_first_token_unix":1779817729.196844,"t_done":386864.369706354,"t_done_unix":1779817729.3836498},{"request_id":"1276136:1:1276136:141","session_id":"1276136","input_length":17280,"t_proxy_recv":386862.832828905,"t_decision_unix":1779817727.846768,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":17280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":135235,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":17280,"score_linear":135235.0,"score_lmetric":34560},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":17280,"score_linear":120167.0,"score_lmetric":247246},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17280,"score_linear":150574.0,"score_lmetric":270172},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":17280,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":17280,"score_linear":121069.0,"score_lmetric":221420},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":17280,"score_linear":114612.0,"score_lmetric":131892},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":460,"cache_hit":0,"new_prefill":17280,"score_linear":10639.0,"score_lmetric":17280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":17280,"score_linear":15783.0,"score_lmetric":33063}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386864.494490598,"t_first_token_unix":1779817729.5084405,"t_done":386864.862776243,"t_done_unix":1779817729.87672},{"request_id":"1274405:2:1276717:144","session_id":"1274405","input_length":6360,"t_proxy_recv":386864.863757835,"t_decision_unix":1779817729.8776994,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.9660377358490566,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":6360,"score_linear":25187.0,"score_lmetric":6360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":6360,"score_linear":120167.0,"score_lmetric":225406},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":6360,"score_linear":150574.0,"score_lmetric":248332},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":508,"cache_hit":0,"new_prefill":6360,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":6360,"score_linear":121069.0,"score_lmetric":199580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":6360,"score_linear":114612.0,"score_lmetric":120972},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58084,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15588,"num_requests":2,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":6360,"score_linear":58084.0,"score_lmetric":43896},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":400,"cache_hit":6144,"new_prefill":216,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":386864.90313906,"t_first_token_unix":1779817729.9170823,"t_done":386865.068643148,"t_done_unix":1779817730.082586},{"request_id":"1271991:2:1276999:145","session_id":"1271991","input_length":11292,"t_proxy_recv":386865.848803912,"t_decision_unix":1779817730.862745,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":3,"affinity_cache_hit":2560,"affinity_cache_ratio":0.2267091746369111,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":11292,"score_linear":25187.0,"score_lmetric":11292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":11292,"score_linear":120167.0,"score_lmetric":235270},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11292,"score_linear":150574.0,"score_lmetric":258196},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":508,"cache_hit":0,"new_prefill":11292,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":11292,"score_linear":121069.0,"score_lmetric":209444},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":2560,"new_prefill":8732,"score_linear":112052.0,"score_lmetric":123344},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58084,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15588,"num_requests":2,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":11292,"score_linear":58084.0,"score_lmetric":53760},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":400,"cache_hit":0,"new_prefill":11292,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386866.745552841,"t_first_token_unix":1779817731.7594967,"t_done":386866.903898286,"t_done_unix":1779817731.9178417},{"request_id":"1277533:1:1277533:150","session_id":"1277533","input_length":4729,"t_proxy_recv":386867.881372756,"t_decision_unix":1779817732.8953142,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":4729,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":4729,"score_linear":25187.0,"score_lmetric":4729},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":4729,"score_linear":120167.0,"score_lmetric":222144},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":4729,"score_linear":150574.0,"score_lmetric":245070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":0,"pending_prefill_tokens":9813,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":4729,"score_linear":27221.0,"score_lmetric":14542},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":4729,"score_linear":121069.0,"score_lmetric":196318},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":4729,"score_linear":114612.0,"score_lmetric":119341},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":8704,"pending_prefill_tokens":30029,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":4729,"score_linear":106829.0,"score_lmetric":139032},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33524,"ongoing_decode_tokens":33524,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":400,"cache_hit":0,"new_prefill":4729,"score_linear":33524.0,"score_lmetric":4729}],"chosen_score_linear":33524.0,"chosen_score_lmetric":4729,"t_first_token":386868.188777376,"t_first_token_unix":1779817733.202721,"t_done":386868.402397582,"t_done_unix":1779817733.4163408},{"request_id":"1262354:7:1277104:146","session_id":"1262354","input_length":33524,"t_proxy_recv":386866.25639007,"t_decision_unix":1779817731.2703314,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33280,"affinity_cache_ratio":0.992721632263453,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":33524,"score_linear":25187.0,"score_lmetric":33524},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":33524,"score_linear":120167.0,"score_lmetric":279734},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33524,"score_linear":150574.0,"score_lmetric":302660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11292,"ongoing_decode_tokens":0,"pending_prefill_tokens":11292,"num_requests":1,"active_p_offloads":0,"cached_blocks":508,"cache_hit":0,"new_prefill":33524,"score_linear":11292.0,"score_lmetric":44816},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":33524,"score_linear":121069.0,"score_lmetric":253908},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":33524,"score_linear":114612.0,"score_lmetric":148136},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58084,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15588,"num_requests":2,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":33524,"score_linear":58084.0,"score_lmetric":98224},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":400,"cache_hit":33280,"new_prefill":244,"score_linear":-33280.0,"score_lmetric":0}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":386866.330289369,"t_first_token_unix":1779817731.3442326,"t_done":386869.111830618,"t_done_unix":1779817734.1257741},{"request_id":"1277428:1:1277428:149","session_id":"1277428","input_length":27221,"t_proxy_recv":386867.457348728,"t_decision_unix":1779817732.47129,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":9813,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":27221,"score_linear":25187.0,"score_lmetric":27221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":3584,"new_prefill":23637,"score_linear":116583.0,"score_lmetric":259960},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27221,"score_linear":150574.0,"score_lmetric":290054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":530,"cache_hit":17408,"new_prefill":9813,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":27221,"score_linear":121069.0,"score_lmetric":241302},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":27221,"score_linear":114612.0,"score_lmetric":141833},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":8704,"pending_prefill_tokens":30029,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":27221,"score_linear":106829.0,"score_lmetric":229000},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33524,"ongoing_decode_tokens":33524,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":400,"cache_hit":0,"new_prefill":27221,"score_linear":33524.0,"score_lmetric":27221}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":386869.249264771,"t_first_token_unix":1779817734.2632084,"t_done":386870.070868004,"t_done_unix":1779817735.084811},{"request_id":"1273203:2:1277744:152","session_id":"1273203","input_length":22573,"t_proxy_recv":386868.603511958,"t_decision_unix":1779817733.6174533,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9753245027244939,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":557,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":25187,"pending_prefill_tokens":8884,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":22573,"score_linear":34071.0,"score_lmetric":62914},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":22573,"score_linear":120167.0,"score_lmetric":257832},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":22573,"score_linear":150574.0,"score_lmetric":280758},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":0,"pending_prefill_tokens":9813,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":22016,"new_prefill":557,"score_linear":5205.0,"score_lmetric":10370},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":22573,"score_linear":121069.0,"score_lmetric":232006},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":22573,"score_linear":114612.0,"score_lmetric":137185},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":8704,"pending_prefill_tokens":30029,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":22573,"score_linear":106829.0,"score_lmetric":210408},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33524,"ongoing_decode_tokens":33524,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":409,"cache_hit":0,"new_prefill":22573,"score_linear":33524.0,"score_lmetric":22573}],"chosen_score_linear":5205.0,"chosen_score_lmetric":10370,"t_first_token":386869.28628953,"t_first_token_unix":1779817734.3002343,"t_done":386871.170021247,"t_done_unix":1779817736.1839647},{"request_id":"1271459:2:1277544:151","session_id":"1271459","input_length":8884,"t_proxy_recv":386867.919360695,"t_decision_unix":1779817732.9333022,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":0,"affinity_cache_hit":512,"affinity_cache_ratio":0.05763169743358847,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":8884,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8884,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":8884,"score_linear":25187.0,"score_lmetric":8884},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":8884,"score_linear":120167.0,"score_lmetric":230454},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8884,"score_linear":150574.0,"score_lmetric":253380},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":27221,"ongoing_decode_tokens":0,"pending_prefill_tokens":9813,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":512,"new_prefill":8372,"score_linear":26709.0,"score_lmetric":18185},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":8884,"score_linear":121069.0,"score_lmetric":204628},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":8884,"score_linear":114612.0,"score_lmetric":123496},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":8704,"pending_prefill_tokens":30029,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":8884,"score_linear":106829.0,"score_lmetric":155652},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38253,"ongoing_decode_tokens":33524,"pending_prefill_tokens":4729,"num_requests":2,"active_p_offloads":0,"cached_blocks":400,"cache_hit":0,"new_prefill":8884,"score_linear":38253.0,"score_lmetric":27226}],"chosen_score_linear":25187.0,"chosen_score_lmetric":8884,"t_first_token":386868.608489252,"t_first_token_unix":1779817733.6224325,"t_done":386871.978106421,"t_done_unix":1779817736.9920497},{"request_id":"1276498:1:1276498:142","session_id":"1276498","input_length":8704,"t_proxy_recv":386864.080130089,"t_decision_unix":1779817729.0940711,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8704,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":8704,"score_linear":25187.0,"score_lmetric":8704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":8704,"score_linear":120167.0,"score_lmetric":230094},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8704,"score_linear":150574.0,"score_lmetric":253020},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":17280,"ongoing_decode_tokens":0,"pending_prefill_tokens":17280,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":8704,"score_linear":17280.0,"score_lmetric":25984},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":8704,"score_linear":121069.0,"score_lmetric":204268},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":8704,"score_linear":114612.0,"score_lmetric":123316},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":8704,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":8704,"score_linear":15783.0,"score_lmetric":24487}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386864.727420972,"t_first_token_unix":1779817729.7413652,"t_done":386872.33058238,"t_done_unix":1779817737.3445258},{"request_id":"1265942:3:1272453:127","session_id":"1265942","input_length":18093,"t_proxy_recv":386849.885202508,"t_decision_unix":1779817714.8991437,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10240,"affinity_cache_ratio":0.5659647377438789,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":7853,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":18093,"score_linear":135235.0,"score_lmetric":262624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":10240,"new_prefill":7853,"score_linear":91834.0,"score_lmetric":106343},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18093,"score_linear":150574.0,"score_lmetric":271798},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37002,"ongoing_decode_tokens":37002,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":380,"cache_hit":0,"new_prefill":18093,"score_linear":37002.0,"score_lmetric":36186},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":18093,"score_linear":121069.0,"score_lmetric":223046},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":304,"cache_hit":0,"new_prefill":18093,"score_linear":113172.0,"score_lmetric":18093},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":52507,"ongoing_decode_tokens":52507,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":409,"cache_hit":0,"new_prefill":18093,"score_linear":52507.0,"score_lmetric":54279},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61097,"ongoing_decode_tokens":61097,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":322,"cache_hit":0,"new_prefill":18093,"score_linear":61097.0,"score_lmetric":36186}],"chosen_score_linear":91834.0,"chosen_score_lmetric":106343,"t_first_token":386871.466829597,"t_first_token_unix":1779817736.480773,"t_done":386872.550746186,"t_done_unix":1779817737.5646894},{"request_id":"1260327:4:1277974:154","session_id":"1260327","input_length":31430,"t_proxy_recv":386869.504557979,"t_decision_unix":1779817734.5184996,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9937002863506205,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":198,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":31430,"score_linear":34071.0,"score_lmetric":62860},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":31430,"score_linear":120167.0,"score_lmetric":275546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31430,"score_linear":150574.0,"score_lmetric":298472},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49794,"ongoing_decode_tokens":49794,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":31430,"score_linear":49794.0,"score_lmetric":62860},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":31430,"score_linear":121069.0,"score_lmetric":249720},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":31430,"score_linear":114612.0,"score_lmetric":146042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":58084,"pending_prefill_tokens":14441,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":31430,"score_linear":106829.0,"score_lmetric":183484},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24222,"ongoing_decode_tokens":0,"pending_prefill_tokens":24222,"num_requests":1,"active_p_offloads":0,"cached_blocks":410,"cache_hit":31232,"new_prefill":198,"score_linear":-7010.0,"score_lmetric":24420}],"chosen_score_linear":-7010.0,"chosen_score_lmetric":24420,"t_first_token":386872.126946625,"t_first_token_unix":1779817737.1408901,"t_done":386872.668455561,"t_done_unix":1779817737.6823988},{"request_id":"1265942:4:1274182:133","session_id":"1265942","input_length":21229,"t_proxy_recv":386872.56495617,"t_decision_unix":1779817737.5788975,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":17920,"affinity_cache_ratio":0.8441283150407461,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":3309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":21229,"score_linear":25187.0,"score_lmetric":21229},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":160826,"ongoing_decode_tokens":160826,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":300,"cache_hit":17920,"new_prefill":3309,"score_linear":142906.0,"score_lmetric":6618},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21229,"score_linear":150574.0,"score_lmetric":278070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":21229,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":121069,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":21229,"score_linear":121069.0,"score_lmetric":42458},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":21229,"score_linear":232709.0,"score_lmetric":280548},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":98125,"ongoing_decode_tokens":98125,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":479,"cache_hit":0,"new_prefill":21229,"score_linear":98125.0,"score_lmetric":63687},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55652,"ongoing_decode_tokens":55652,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":21229,"score_linear":55652.0,"score_lmetric":42458}],"chosen_score_linear":142906.0,"chosen_score_lmetric":6618,"t_first_token":386873.127258021,"t_first_token_unix":1779817738.1412015,"t_done":386874.379900993,"t_done_unix":1779817739.3938444},{"request_id":"1276498:2:1278996:157","session_id":"1276498","input_length":16650,"t_proxy_recv":386873.038295696,"t_decision_unix":1779817738.052237,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":8704,"affinity_cache_ratio":0.5227627627627628,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":7946,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":16650,"score_linear":25187.0,"score_lmetric":16650},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":182055,"ongoing_decode_tokens":160826,"pending_prefill_tokens":3309,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":16650,"score_linear":182055.0,"score_lmetric":59877},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":16650,"score_linear":150574.0,"score_lmetric":268912},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":16650,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":121069,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":16650,"score_linear":121069.0,"score_lmetric":33300},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":16650,"score_linear":232709.0,"score_lmetric":271390},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":98125,"ongoing_decode_tokens":98125,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":479,"cache_hit":8704,"new_prefill":7946,"score_linear":89421.0,"score_lmetric":23838},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24222,"ongoing_decode_tokens":24222,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":16650,"score_linear":24222.0,"score_lmetric":16650}],"chosen_score_linear":89421.0,"chosen_score_lmetric":23838,"t_first_token":386874.007576207,"t_first_token_unix":1779817739.02152,"t_done":386874.415035413,"t_done_unix":1779817739.4289787},{"request_id":"1270606:1:1270606:113","session_id":"1270606","input_length":93430,"t_proxy_recv":386843.307757419,"t_decision_unix":1779817708.3216987,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":93430,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":93430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":93430,"score_linear":135235.0,"score_lmetric":413298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":93430,"score_linear":102074.0,"score_lmetric":191920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":93430,"score_linear":126924.0,"score_lmetric":201410},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26411,"ongoing_decode_tokens":15283,"pending_prefill_tokens":11128,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":93430,"score_linear":26411.0,"score_lmetric":209116},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":93430,"score_linear":27639.0,"score_lmetric":93430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":93430,"score_linear":125063.0,"score_lmetric":421626},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57803,"ongoing_decode_tokens":0,"pending_prefill_tokens":7115,"num_requests":1,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":93430,"score_linear":57803.0,"score_lmetric":100545},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":93430,"score_linear":27927.0,"score_lmetric":121357}],"chosen_score_linear":27639.0,"chosen_score_lmetric":93430,"t_first_token":386872.376119314,"t_first_token_unix":1779817737.3900623,"t_done":386874.421361895,"t_done_unix":1779817739.435305},{"request_id":"1268630:1:1268630:98","session_id":"1268630","input_length":102074,"t_proxy_recv":386836.640824637,"t_decision_unix":1779817701.6547656,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":98490,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":102074,"score_linear":135235.0,"score_lmetric":430586},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":285,"cache_hit":3584,"new_prefill":98490,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":102074,"score_linear":126924.0,"score_lmetric":210054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":4608,"new_prefill":97466,"score_linear":10675.0,"score_lmetric":97466},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":102074,"score_linear":27639.0,"score_lmetric":102074},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":102074,"score_linear":125063.0,"score_lmetric":438914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":102074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":102074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":386871.466116428,"t_first_token_unix":1779817736.48006,"t_done":386874.7132823,"t_done_unix":1779817739.7272263},{"request_id":"1268831:3:1277112:147","session_id":"1268831","input_length":31845,"t_proxy_recv":386866.297076321,"t_decision_unix":1779817731.3110178,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":19456,"affinity_cache_ratio":0.6109593342753965,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":12389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":31845,"score_linear":25187.0,"score_lmetric":31845},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":31845,"score_linear":120167.0,"score_lmetric":276376},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31845,"score_linear":150574.0,"score_lmetric":299302},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11292,"ongoing_decode_tokens":0,"pending_prefill_tokens":11292,"num_requests":1,"active_p_offloads":0,"cached_blocks":508,"cache_hit":0,"new_prefill":31845,"score_linear":11292.0,"score_lmetric":43137},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":31845,"score_linear":121069.0,"score_lmetric":250550},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":31845,"score_linear":114612.0,"score_lmetric":146457},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58084,"ongoing_decode_tokens":8704,"pending_prefill_tokens":15588,"num_requests":2,"active_p_offloads":0,"cached_blocks":462,"cache_hit":19456,"new_prefill":12389,"score_linear":38628.0,"score_lmetric":55954},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33524,"ongoing_decode_tokens":0,"pending_prefill_tokens":244,"num_requests":1,"active_p_offloads":0,"cached_blocks":400,"cache_hit":0,"new_prefill":31845,"score_linear":33524.0,"score_lmetric":32089}],"chosen_score_linear":38628.0,"chosen_score_lmetric":55954,"t_first_token":386871.614658787,"t_first_token_unix":1779817736.6286023,"t_done":386875.530191428,"t_done_unix":1779817740.5441346},{"request_id":"1272313:3:1279208:159","session_id":"1272313","input_length":11549,"t_proxy_recv":386873.697071417,"t_decision_unix":1779817738.7110126,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":3,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9309896960775825,"affinity_num_requests":4,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11549,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":7453,"score_linear":21091.0,"score_lmetric":7453},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":182055,"ongoing_decode_tokens":182055,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":11549,"score_linear":182055.0,"score_lmetric":34647},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11549,"score_linear":150574.0,"score_lmetric":258710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":11549,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":121069,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":11549,"score_linear":121069.0,"score_lmetric":23098},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":11549,"score_linear":232709.0,"score_lmetric":261188},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114775,"ongoing_decode_tokens":98125,"pending_prefill_tokens":7946,"num_requests":4,"active_p_offloads":0,"cached_blocks":479,"cache_hit":10752,"new_prefill":797,"score_linear":104023.0,"score_lmetric":34972},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24222,"ongoing_decode_tokens":24222,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":11549,"score_linear":24222.0,"score_lmetric":11549}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386874.652924401,"t_first_token_unix":1779817739.666868,"t_done":386875.81895111,"t_done_unix":1779817740.8328946},{"request_id":"1279412:1:1279412:160","session_id":"1279412","input_length":20136,"t_proxy_recv":386874.502453441,"t_decision_unix":1779817739.516395,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":7336,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":7336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":20136,"score_linear":25187.0,"score_lmetric":20136},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":160826,"ongoing_decode_tokens":160826,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":20136,"score_linear":160826.0,"score_lmetric":40272},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":20136,"score_linear":150574.0,"score_lmetric":275884},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11549,"ongoing_decode_tokens":0,"pending_prefill_tokens":11549,"num_requests":1,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":20136,"score_linear":11549.0,"score_lmetric":31685},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":20136,"score_linear":27639.0,"score_lmetric":20136},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":20136,"score_linear":232709.0,"score_lmetric":278362},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":98125,"ongoing_decode_tokens":98125,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":494,"cache_hit":0,"new_prefill":20136,"score_linear":98125.0,"score_lmetric":60408},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24222,"ongoing_decode_tokens":24222,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":410,"cache_hit":12800,"new_prefill":7336,"score_linear":11422.0,"score_lmetric":7336}],"chosen_score_linear":11422.0,"chosen_score_lmetric":7336,"t_first_token":386875.541953149,"t_first_token_unix":1779817740.555896,"t_done":386877.472686118,"t_done_unix":1779817742.4866297},{"request_id":"1253804:5:1278488:156","session_id":"1253804","input_length":58752,"t_proxy_recv":386871.184289654,"t_decision_unix":1779817736.1982307,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9760348583877996,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":1408,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":58752,"score_linear":34071.0,"score_lmetric":117504},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":57344,"new_prefill":1408,"score_linear":62823.0,"score_lmetric":215502},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":58752,"score_linear":150574.0,"score_lmetric":353116},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":3584,"new_prefill":55168,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":58752,"score_linear":121069.0,"score_lmetric":304364},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":58752,"score_linear":232709.0,"score_lmetric":355594},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":58084,"pending_prefill_tokens":14441,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":58752,"score_linear":106829.0,"score_lmetric":292772},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55652,"ongoing_decode_tokens":0,"pending_prefill_tokens":24420,"num_requests":2,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":58752,"score_linear":55652.0,"score_lmetric":166344}],"chosen_score_linear":62823.0,"chosen_score_lmetric":215502,"t_first_token":386871.934555169,"t_first_token_unix":1779817736.9484994,"t_done":386877.662955745,"t_done_unix":1779817742.676899},{"request_id":"1268831:4:1279168:158","session_id":"1268831","input_length":32346,"t_proxy_recv":386875.537919449,"t_decision_unix":1779817740.551861,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9813887343102702,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":602,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":32346,"score_linear":25187.0,"score_lmetric":32346},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":498,"cache_hit":0,"new_prefill":32346,"score_linear":58752.0,"score_lmetric":32346},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32346,"score_linear":150574.0,"score_lmetric":300304},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":11549,"ongoing_decode_tokens":11549,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":32346,"score_linear":11549.0,"score_lmetric":32346},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":32346,"score_linear":27639.0,"score_lmetric":32346},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":32346,"score_linear":232709.0,"score_lmetric":302782},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":518,"cache_hit":31744,"new_prefill":602,"score_linear":34536.0,"score_lmetric":1204},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44358,"ongoing_decode_tokens":24222,"pending_prefill_tokens":7336,"num_requests":2,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":32346,"score_linear":44358.0,"score_lmetric":79364}],"chosen_score_linear":34536.0,"chosen_score_lmetric":1204,"t_first_token":386875.709584223,"t_first_token_unix":1779817740.7235277,"t_done":386877.722221476,"t_done_unix":1779817742.7361646},{"request_id":"1277909:1:1277909:153","session_id":"1277909","input_length":24222,"t_proxy_recv":386869.311690452,"t_decision_unix":1779817734.3256183,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":24222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":20126,"score_linear":29975.0,"score_lmetric":40252},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":24222,"score_linear":120167.0,"score_lmetric":261130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24222,"score_linear":150574.0,"score_lmetric":284056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49794,"ongoing_decode_tokens":49794,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":24222,"score_linear":49794.0,"score_lmetric":48444},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":24222,"score_linear":121069.0,"score_lmetric":235304},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":24222,"score_linear":114612.0,"score_lmetric":138834},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":58084,"pending_prefill_tokens":14441,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":7680,"new_prefill":16542,"score_linear":99149.0,"score_lmetric":123932},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":24222,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386872.125015269,"t_first_token_unix":1779817737.1389587,"t_done":386877.844340181,"t_done_unix":1779817742.858283},{"request_id":"1262354:8:1280463:163","session_id":"1262354","input_length":33928,"t_proxy_recv":386877.816036951,"t_decision_unix":1779817742.8299787,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9959915114359821,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":33928,"score_linear":25187.0,"score_lmetric":33928},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":33928,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33928,"score_linear":150574.0,"score_lmetric":303468},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":33928,"score_linear":112836.0,"score_lmetric":259736},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":33928,"score_linear":27639.0,"score_lmetric":33928},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":33928,"score_linear":232709.0,"score_lmetric":305946},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":33928,"score_linear":66280.0,"score_lmetric":67856},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24222,"ongoing_decode_tokens":24222,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":33792,"new_prefill":136,"score_linear":-9570.0,"score_lmetric":136}],"chosen_score_linear":-9570.0,"chosen_score_lmetric":136,"t_first_token":386877.892046878,"t_first_token_unix":1779817742.9059901,"t_done":386878.26915423,"t_done_unix":1779817743.2830973},{"request_id":"1266668:4:1276519:143","session_id":"1266668","input_length":49380,"t_proxy_recv":386864.145077589,"t_decision_unix":1779817729.1590188,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":33792,"affinity_cache_ratio":0.684325637910085,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":15588,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":45284,"score_linear":21091.0,"score_lmetric":45284},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":49380,"score_linear":120167.0,"score_lmetric":311446},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":49380,"score_linear":150574.0,"score_lmetric":334372},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":17280,"ongoing_decode_tokens":0,"pending_prefill_tokens":17280,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":49380,"score_linear":17280.0,"score_lmetric":66660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":49380,"score_linear":121069.0,"score_lmetric":285620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":49380,"score_linear":114612.0,"score_lmetric":163992},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":8704,"ongoing_decode_tokens":0,"pending_prefill_tokens":8704,"num_requests":1,"active_p_offloads":0,"cached_blocks":462,"cache_hit":33792,"new_prefill":15588,"score_linear":-25088.0,"score_lmetric":24292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":49380,"score_linear":15783.0,"score_lmetric":65163}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":24292,"t_first_token":386869.013144242,"t_first_token_unix":1779817734.0270884,"t_done":386878.743174125,"t_done_unix":1779817743.757118},{"request_id":"1269373:3:1277365:148","session_id":"1269373","input_length":16900,"t_proxy_recv":386867.173144331,"t_decision_unix":1779817732.1870859,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14848,"affinity_cache_ratio":0.8785798816568048,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":2052,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":12804,"score_linear":21091.0,"score_lmetric":12804},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":16900,"score_linear":120167.0,"score_lmetric":246486},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":16900,"score_linear":150574.0,"score_lmetric":269412},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":16900,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":16900,"score_linear":121069.0,"score_lmetric":220660},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":16900,"score_linear":114612.0,"score_lmetric":131512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":89929,"ongoing_decode_tokens":8704,"pending_prefill_tokens":27977,"num_requests":3,"active_p_offloads":0,"cached_blocks":462,"cache_hit":14848,"new_prefill":2052,"score_linear":75081.0,"score_lmetric":90087},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33524,"ongoing_decode_tokens":33524,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":400,"cache_hit":0,"new_prefill":16900,"score_linear":33524.0,"score_lmetric":16900}],"chosen_score_linear":75081.0,"chosen_score_lmetric":90087,"t_first_token":386871.615366962,"t_first_token_unix":1779817736.6293101,"t_done":386879.189033854,"t_done_unix":1779817744.2029772},{"request_id":"1268861:2:1280530:164","session_id":"1268861","input_length":12765,"t_proxy_recv":386878.029969799,"t_decision_unix":1779817743.0439115,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":12288,"affinity_cache_ratio":0.9626321974148061,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":12765,"score_linear":25187.0,"score_lmetric":12765},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":12765,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12765,"score_linear":150574.0,"score_lmetric":261142},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":12765,"score_linear":112836.0,"score_lmetric":217410},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":12288,"new_prefill":477,"score_linear":15351.0,"score_lmetric":477},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":12765,"score_linear":232709.0,"score_lmetric":263620},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":66280,"ongoing_decode_tokens":66280,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":12765,"score_linear":66280.0,"score_lmetric":25530},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33928,"ongoing_decode_tokens":33928,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":472,"cache_hit":0,"new_prefill":12765,"score_linear":33928.0,"score_lmetric":12765}],"chosen_score_linear":15351.0,"chosen_score_lmetric":477,"t_first_token":386878.096503624,"t_first_token_unix":1779817743.1104472,"t_done":386881.309209019,"t_done_unix":1779817746.323152},{"request_id":"1281887:1:1281887:171","session_id":"1281887","input_length":9370,"t_proxy_recv":386882.6723925,"t_decision_unix":1779817747.686334,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9370,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":9370,"score_linear":25187.0,"score_lmetric":9370},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":9370,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9370,"score_linear":150574.0,"score_lmetric":254352},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":9370,"score_linear":126737.0,"score_lmetric":323841},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":9370,"score_linear":27639.0,"score_lmetric":9370},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":9370,"score_linear":232709.0,"score_lmetric":256830},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88294,"ongoing_decode_tokens":30262,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":555,"cache_hit":0,"new_prefill":9370,"score_linear":88294.0,"score_lmetric":35476},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60454,"ongoing_decode_tokens":60454,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":472,"cache_hit":0,"new_prefill":9370,"score_linear":60454.0,"score_lmetric":18740}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386883.381018582,"t_first_token_unix":1779817748.3949618,"t_done":386883.547409874,"t_done_unix":1779817748.5613532},{"request_id":"1282082:1:1282082:173","session_id":"1282082","input_length":4972,"t_proxy_recv":386883.346946688,"t_decision_unix":1779817748.3608878,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":4972,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4972,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":4972,"score_linear":25187.0,"score_lmetric":4972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":9370,"ongoing_decode_tokens":0,"pending_prefill_tokens":9370,"num_requests":1,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":4972,"score_linear":9370.0,"score_lmetric":14342},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":4972,"score_linear":150574.0,"score_lmetric":245556},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":4972,"score_linear":126737.0,"score_lmetric":310647},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":4972,"score_linear":27639.0,"score_lmetric":4972},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":4972,"score_linear":232709.0,"score_lmetric":248034},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88294,"ongoing_decode_tokens":30262,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":555,"cache_hit":0,"new_prefill":4972,"score_linear":88294.0,"score_lmetric":26680},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":102477,"ongoing_decode_tokens":60454,"pending_prefill_tokens":10791,"num_requests":3,"active_p_offloads":0,"cached_blocks":472,"cache_hit":0,"new_prefill":4972,"score_linear":102477.0,"score_lmetric":47289}],"chosen_score_linear":25187.0,"chosen_score_lmetric":4972,"t_first_token":386883.689677794,"t_first_token_unix":1779817748.7036214,"t_done":386883.931173629,"t_done_unix":1779817748.9451172},{"request_id":"1267915:1:1267915:96","session_id":"1267915","input_length":126924,"t_proxy_recv":386834.029601314,"t_decision_unix":1779817699.0435426,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":107980,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":126924,"score_linear":135235.0,"score_lmetric":480286},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":273,"cache_hit":0,"new_prefill":126924,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":358,"cache_hit":18944,"new_prefill":107980,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":126924,"score_linear":15283.0,"score_lmetric":126924},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":259,"cache_hit":0,"new_prefill":126924,"score_linear":27639.0,"score_lmetric":126924},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":126924,"score_linear":125063.0,"score_lmetric":488614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":126924,"score_linear":17466.0,"score_lmetric":126924},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28671,"ongoing_decode_tokens":0,"pending_prefill_tokens":6143,"num_requests":1,"active_p_offloads":0,"cached_blocks":194,"cache_hit":0,"new_prefill":126924,"score_linear":28671.0,"score_lmetric":133067}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":386884.267845679,"t_first_token_unix":1779817749.2817893,"t_done":386885.579404076,"t_done_unix":1779817750.5933485},{"request_id":"1265128:2:1271655:122","session_id":"1265128","input_length":23650,"t_proxy_recv":386846.866665724,"t_decision_unix":1779817711.880607,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13824,"affinity_cache_ratio":0.5845243128964059,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":9826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":23650,"score_linear":135235.0,"score_lmetric":273738},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":23650,"score_linear":102074.0,"score_lmetric":122140},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":13824,"new_prefill":9826,"score_linear":113100.0,"score_lmetric":117806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":37753,"ongoing_decode_tokens":16034,"pending_prefill_tokens":21719,"num_requests":3,"active_p_offloads":0,"cached_blocks":379,"cache_hit":0,"new_prefill":23650,"score_linear":37753.0,"score_lmetric":136107},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":23650,"score_linear":121069.0,"score_lmetric":234160},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":130878,"ongoing_decode_tokens":113172,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":23650,"score_linear":130878.0,"score_lmetric":82712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":120040,"ongoing_decode_tokens":120040,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":382,"cache_hit":0,"new_prefill":23650,"score_linear":120040.0,"score_lmetric":94600},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60701,"ongoing_decode_tokens":60701,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":254,"cache_hit":0,"new_prefill":23650,"score_linear":60701.0,"score_lmetric":47300}],"chosen_score_linear":113100.0,"chosen_score_lmetric":117806,"t_first_token":386884.768163792,"t_first_token_unix":1779817749.7821074,"t_done":386885.931298887,"t_done_unix":1779817750.9452422},{"request_id":"1260327:5:1281915:172","session_id":"1260327","input_length":42023,"t_proxy_recv":386882.792988509,"t_decision_unix":1779817747.8069293,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.7432120505437498,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":10791,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":42023,"score_linear":25187.0,"score_lmetric":42023},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":9370,"ongoing_decode_tokens":0,"pending_prefill_tokens":9370,"num_requests":1,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":42023,"score_linear":9370.0,"score_lmetric":51393},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":42023,"score_linear":150574.0,"score_lmetric":319658},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":42023,"score_linear":126737.0,"score_lmetric":421800},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":42023,"score_linear":27639.0,"score_lmetric":42023},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":42023,"score_linear":232709.0,"score_lmetric":322136},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88294,"ongoing_decode_tokens":30262,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":555,"cache_hit":0,"new_prefill":42023,"score_linear":88294.0,"score_lmetric":100782},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60454,"ongoing_decode_tokens":60454,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":472,"cache_hit":31232,"new_prefill":10791,"score_linear":29222.0,"score_lmetric":21582}],"chosen_score_linear":29222.0,"chosen_score_lmetric":21582,"t_first_token":386885.555982885,"t_first_token_unix":1779817750.5700061,"t_done":386886.629831687,"t_done_unix":1779817751.6437752},{"request_id":"1262354:9:1281632:169","session_id":"1262354","input_length":34028,"t_proxy_recv":386881.80911308,"t_decision_unix":1779817746.823054,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9930645350887505,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":236,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":34028,"score_linear":25187.0,"score_lmetric":34028},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":34028,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":34028,"score_linear":150574.0,"score_lmetric":303668},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":34028,"score_linear":112836.0,"score_lmetric":259936},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":34028,"score_linear":27639.0,"score_lmetric":34028},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":34028,"score_linear":232709.0,"score_lmetric":306146},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88294,"ongoing_decode_tokens":30262,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":555,"cache_hit":0,"new_prefill":34028,"score_linear":88294.0,"score_lmetric":84792},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":472,"cache_hit":33792,"new_prefill":236,"score_linear":-7366.0,"score_lmetric":236}],"chosen_score_linear":-7366.0,"chosen_score_lmetric":236,"t_first_token":386881.881763535,"t_first_token_unix":1779817746.8957067,"t_done":386886.779884928,"t_done_unix":1779817751.7938287},{"request_id":"1269373:4:1280765:165","session_id":"1269373","input_length":30262,"t_proxy_recv":386879.200515563,"t_decision_unix":1779817744.2144568,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":17408,"affinity_cache_ratio":0.5752428788579736,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":12854,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":26166,"score_linear":21091.0,"score_lmetric":26166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":30262,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30262,"score_linear":150574.0,"score_lmetric":296136},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":22582,"score_linear":105156.0,"score_lmetric":237044},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":30262,"score_linear":40404.0,"score_lmetric":60524},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":30262,"score_linear":232709.0,"score_lmetric":298614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":555,"cache_hit":17408,"new_prefill":12854,"score_linear":-17408.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":472,"cache_hit":7680,"new_prefill":22582,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":386881.632937257,"t_first_token_unix":1779817746.6468816,"t_done":386887.137085754,"t_done_unix":1779817752.1510286},{"request_id":"1277533:2:1282872:175","session_id":"1277533","input_length":16299,"t_proxy_recv":386886.091340062,"t_decision_unix":1779817751.1052814,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":2,"affinity_cache_hit":4608,"affinity_cache_ratio":0.2827167310877968,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16299,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":398,"cache_hit":0,"new_prefill":16299,"score_linear":25187.0,"score_lmetric":16299},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":16299,"score_linear":126737.0,"score_lmetric":344628},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":16299,"score_linear":27639.0,"score_lmetric":16299},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":16299,"score_linear":232709.0,"score_lmetric":270688},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88294,"ongoing_decode_tokens":88294,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":555,"cache_hit":0,"new_prefill":16299,"score_linear":88294.0,"score_lmetric":32598},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":102477,"ongoing_decode_tokens":102477,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":472,"cache_hit":4608,"new_prefill":11691,"score_linear":97869.0,"score_lmetric":35073}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386887.590031326,"t_first_token_unix":1779817752.6039746,"t_done":386887.607084276,"t_done_unix":1779817752.6210272},{"request_id":"1266668:5:1281133:168","session_id":"1266668","input_length":58032,"t_proxy_recv":386880.349008321,"t_decision_unix":1779817745.3629403,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49664,"affinity_cache_ratio":0.8558036945133719,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":8368,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":53936,"score_linear":21091.0,"score_lmetric":53936},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":58032,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":58032,"score_linear":150574.0,"score_lmetric":351676},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":50352,"score_linear":105156.0,"score_lmetric":292584},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":58032,"score_linear":40404.0,"score_lmetric":116064},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":58032,"score_linear":232709.0,"score_lmetric":354154},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30262,"ongoing_decode_tokens":0,"pending_prefill_tokens":12854,"num_requests":1,"active_p_offloads":0,"cached_blocks":555,"cache_hit":49664,"new_prefill":8368,"score_linear":-19402.0,"score_lmetric":21222},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26426,"ongoing_decode_tokens":0,"pending_prefill_tokens":6458,"num_requests":1,"active_p_offloads":0,"cached_blocks":472,"cache_hit":7680,"new_prefill":50352,"score_linear":18746.0,"score_lmetric":56810}],"chosen_score_linear":-19402.0,"chosen_score_lmetric":21222,"t_first_token":386884.413566495,"t_first_token_unix":1779817749.4275103,"t_done":386888.390155241,"t_done_unix":1779817753.404099},{"request_id":"1242838:4:1265709:87","session_id":"1242838","input_length":25187,"t_proxy_recv":386826.49630425,"t_decision_unix":1779817691.5102456,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":22016,"affinity_cache_ratio":0.8741017191408266,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":3171,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":22016,"new_prefill":3171,"score_linear":88032.0,"score_lmetric":113219},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":25187,"score_linear":55989.0,"score_lmetric":25187},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":25187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":25187,"score_linear":71575.0,"score_lmetric":162958},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":25187,"score_linear":27639.0,"score_lmetric":25187},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":25187,"score_linear":125063.0,"score_lmetric":285140},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":25187,"score_linear":50783.0,"score_lmetric":75970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":25187,"score_linear":45884.0,"score_lmetric":98110}],"chosen_score_linear":88032.0,"chosen_score_lmetric":113219,"t_first_token":386862.709796881,"t_first_token_unix":1779817727.7237396,"t_done":386888.976987932,"t_done_unix":1779817753.990931},{"request_id":"1283642:1:1283642:178","session_id":"1283642","input_length":8510,"t_proxy_recv":386888.527278755,"t_decision_unix":1779817753.5412202,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":398,"cache_hit":0,"new_prefill":8510,"score_linear":25187.0,"score_lmetric":8510},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":8510,"score_linear":126737.0,"score_lmetric":321261},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":8510,"score_linear":27639.0,"score_lmetric":8510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":8510,"score_linear":232709.0,"score_lmetric":255110},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30594,"ongoing_decode_tokens":30594,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":8510,"score_linear":30594.0,"score_lmetric":8510},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":8510,"score_linear":26426.0,"score_lmetric":8510}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386889.161819797,"t_first_token_unix":1779817754.1757631,"t_done":386889.468800621,"t_done_unix":1779817754.4827435},{"request_id":"1279412:2:1281113:167","session_id":"1279412","input_length":26426,"t_proxy_recv":386880.29188738,"t_decision_unix":1779817745.3058283,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19968,"affinity_cache_ratio":0.7556194656777416,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":6458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":26426,"score_linear":25187.0,"score_lmetric":26426},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":26426,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":26426,"score_linear":150574.0,"score_lmetric":288464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":26426,"score_linear":112836.0,"score_lmetric":244732},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40404,"ongoing_decode_tokens":40404,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":26426,"score_linear":40404.0,"score_lmetric":52852},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":26426,"score_linear":232709.0,"score_lmetric":290942},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30262,"ongoing_decode_tokens":0,"pending_prefill_tokens":12854,"num_requests":1,"active_p_offloads":0,"cached_blocks":555,"cache_hit":0,"new_prefill":26426,"score_linear":30262.0,"score_lmetric":39280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":472,"cache_hit":19968,"new_prefill":6458,"score_linear":-19968.0,"score_lmetric":0}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":386881.403640524,"t_first_token_unix":1779817746.4175842,"t_done":386890.247459038,"t_done_unix":1779817755.2614086},{"request_id":"1262354:10:1283773:180","session_id":"1262354","input_length":34282,"t_proxy_recv":386888.960208097,"t_decision_unix":1779817753.9741495,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9857067849016977,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":490,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":398,"cache_hit":0,"new_prefill":34282,"score_linear":25187.0,"score_lmetric":34282},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8510,"ongoing_decode_tokens":0,"pending_prefill_tokens":8510,"num_requests":1,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":34282,"score_linear":8510.0,"score_lmetric":42792},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":34282,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":34282,"score_linear":126737.0,"score_lmetric":398577},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":34282,"score_linear":27639.0,"score_lmetric":34282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":34282,"score_linear":232709.0,"score_lmetric":306654},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30594,"ongoing_decode_tokens":30594,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":34282,"score_linear":30594.0,"score_lmetric":34282},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57391,"ongoing_decode_tokens":26426,"pending_prefill_tokens":6389,"num_requests":2,"active_p_offloads":0,"cached_blocks":493,"cache_hit":33792,"new_prefill":490,"score_linear":23599.0,"score_lmetric":13758}],"chosen_score_linear":23599.0,"chosen_score_lmetric":13758,"t_first_token":386889.946391483,"t_first_token_unix":1779817754.9603348,"t_done":386890.573361516,"t_done_unix":1779817755.5873044},{"request_id":"1277909:2:1283679:179","session_id":"1277909","input_length":30965,"t_proxy_recv":386888.63532238,"t_decision_unix":1779817753.6492636,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24576,"affinity_cache_ratio":0.7936702728887454,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":6389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":398,"cache_hit":4096,"new_prefill":26869,"score_linear":21091.0,"score_lmetric":26869},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8510,"ongoing_decode_tokens":0,"pending_prefill_tokens":8510,"num_requests":1,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":30965,"score_linear":8510.0,"score_lmetric":39475},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":30965,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":23285,"score_linear":119057.0,"score_lmetric":365586},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":30965,"score_linear":27639.0,"score_lmetric":30965},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":30965,"score_linear":232709.0,"score_lmetric":300020},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30594,"ongoing_decode_tokens":30594,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":7680,"new_prefill":23285,"score_linear":22914.0,"score_lmetric":23285},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":24576,"new_prefill":6389,"score_linear":1850.0,"score_lmetric":6389}],"chosen_score_linear":1850.0,"chosen_score_lmetric":6389,"t_first_token":386889.911951389,"t_first_token_unix":1779817754.9258947,"t_done":386895.158356959,"t_done_unix":1779817760.1723003},{"request_id":"1279412:3:1285475:187","session_id":"1279412","input_length":27077,"t_proxy_recv":386894.99139811,"t_decision_unix":1779817760.0053394,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9832699338922333,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":453,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":27077,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":27077,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":27077,"score_linear":49619.0,"score_lmetric":76696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":27077,"score_linear":126737.0,"score_lmetric":376962},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":27077,"score_linear":27639.0,"score_lmetric":27077},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":27077,"score_linear":232709.0,"score_lmetric":292244},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":27077,"score_linear":152913.0,"score_lmetric":176316},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":65318,"ongoing_decode_tokens":65318,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":26624,"new_prefill":453,"score_linear":38694.0,"score_lmetric":906}],"chosen_score_linear":38694.0,"chosen_score_lmetric":906,"t_first_token":386895.068162128,"t_first_token_unix":1779817760.0821056,"t_done":386895.191664521,"t_done_unix":1779817760.2056077},{"request_id":"1285800:1:1285800:191","session_id":"1285800","input_length":4510,"t_proxy_recv":386896.102867664,"t_decision_unix":1779817761.116809,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":4510,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11,"ongoing_decode_tokens":11,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":4510,"score_linear":11.0,"score_lmetric":4510},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":14192,"ongoing_decode_tokens":0,"pending_prefill_tokens":6000,"num_requests":1,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":4510,"score_linear":14192.0,"score_lmetric":10510},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":4510,"score_linear":49619.0,"score_lmetric":54129},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":4510,"score_linear":126737.0,"score_lmetric":309261},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":4510,"score_linear":27639.0,"score_lmetric":4510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":4510,"score_linear":232709.0,"score_lmetric":247110},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":4510,"score_linear":152913.0,"score_lmetric":108615},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":520,"cache_hit":0,"new_prefill":4510,"score_linear":34353.0,"score_lmetric":4510}],"chosen_score_linear":27639.0,"chosen_score_lmetric":4510,"t_first_token":386896.39998445,"t_first_token_unix":1779817761.4139278,"t_done":386896.816774139,"t_done_unix":1779817761.830717},{"request_id":"1239034:4:1263738:78","session_id":"1239034","input_length":27639,"t_proxy_recv":386825.360077104,"t_decision_unix":1779817690.374019,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":22528,"affinity_cache_ratio":0.8150801403813452,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":5111,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":27639,"score_linear":110048.0,"score_lmetric":137687},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":27639,"score_linear":55989.0,"score_lmetric":27639},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14329,"ongoing_decode_tokens":301,"pending_prefill_tokens":14028,"num_requests":2,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":27639,"score_linear":14329.0,"score_lmetric":83334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":27639,"score_linear":71575.0,"score_lmetric":167862},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":258,"cache_hit":22528,"new_prefill":5111,"score_linear":-22528.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":27639,"score_linear":125063.0,"score_lmetric":290044},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":27639,"score_linear":50783.0,"score_lmetric":78422},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":27639,"score_linear":45884.0,"score_lmetric":103014}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":386826.37054113,"t_first_token_unix":1779817691.3844857,"t_done":386896.858275148,"t_done_unix":1779817761.8722181},{"request_id":"1283642:2:1285731:190","session_id":"1283642","input_length":14192,"t_proxy_recv":386895.848778148,"t_decision_unix":1779817760.8627195,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8192,"affinity_cache_ratio":0.5772266065388951,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":6000,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11,"ongoing_decode_tokens":11,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":14192,"score_linear":11.0,"score_lmetric":14192},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":8192,"new_prefill":6000,"score_linear":-8192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":14192,"score_linear":49619.0,"score_lmetric":63811},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":14192,"score_linear":126737.0,"score_lmetric":338307},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":14192,"score_linear":27639.0,"score_lmetric":14192},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":14192,"score_linear":232709.0,"score_lmetric":266474},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":14192,"score_linear":152913.0,"score_lmetric":137661},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":520,"cache_hit":0,"new_prefill":14192,"score_linear":34353.0,"score_lmetric":14192}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":386896.505321305,"t_first_token_unix":1779817761.5192645,"t_done":386896.887910771,"t_done_unix":1779817761.9018543},{"request_id":"1285558:1:1285558:188","session_id":"1285558","input_length":11,"t_proxy_recv":386895.195717187,"t_decision_unix":1779817760.2096589,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":11,"score_linear":49619.0,"score_lmetric":49630},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":11,"score_linear":126737.0,"score_lmetric":295764},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":11,"score_linear":27639.0,"score_lmetric":11},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":11,"score_linear":232709.0,"score_lmetric":238112},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":11,"score_linear":152913.0,"score_lmetric":95118},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":520,"cache_hit":0,"new_prefill":11,"score_linear":34353.0,"score_lmetric":11}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386895.216701801,"t_first_token_unix":1779817760.230645,"t_done":386896.894143379,"t_done_unix":1779817761.9080868},{"request_id":"1262354:11:1284987:186","session_id":"1262354","input_length":34353,"t_proxy_recv":386893.449672433,"t_decision_unix":1779817758.4636137,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9985736325793962,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":49,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":34353,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":34353,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":34353,"score_linear":49619.0,"score_lmetric":83972},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":34353,"score_linear":126737.0,"score_lmetric":398790},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":34353,"score_linear":27639.0,"score_lmetric":34353},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":34353,"score_linear":232709.0,"score_lmetric":306796},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":34353,"score_linear":152913.0,"score_lmetric":198144},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":34304,"new_prefill":49,"score_linear":-3339.0,"score_lmetric":49}],"chosen_score_linear":-3339.0,"chosen_score_lmetric":49,"t_first_token":386893.523273302,"t_first_token_unix":1779817758.5372162,"t_done":386898.659588603,"t_done_unix":1779817763.673532},{"request_id":"1286551:1:1286551:194","session_id":"1286551","input_length":1700,"t_proxy_recv":386899.066729228,"t_decision_unix":1779817764.0806704,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":1700,"score_linear":49619.0,"score_lmetric":51319},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":1700,"score_linear":126737.0,"score_lmetric":300831},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":484,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":1700,"score_linear":232709.0,"score_lmetric":241490},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":1700,"score_linear":152913.0,"score_lmetric":100185},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31898,"ongoing_decode_tokens":0,"pending_prefill_tokens":5274,"num_requests":1,"active_p_offloads":0,"cached_blocks":521,"cache_hit":0,"new_prefill":1700,"score_linear":31898.0,"score_lmetric":6974}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386899.233292148,"t_first_token_unix":1779817764.2472355,"t_done":386899.424467201,"t_done_unix":1779817764.4384105},{"request_id":"1279412:4:1286447:193","session_id":"1279412","input_length":31898,"t_proxy_recv":386898.669009683,"t_decision_unix":1779817763.6829407,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8346604802808953,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":5274,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":31898,"score_linear":49619.0,"score_lmetric":81517},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":31898,"score_linear":126737.0,"score_lmetric":391425},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":484,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":31898,"score_linear":232709.0,"score_lmetric":301886},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":31898,"score_linear":152913.0,"score_lmetric":190779},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":521,"cache_hit":26624,"new_prefill":5274,"score_linear":-26624.0,"score_lmetric":0}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":386899.743315922,"t_first_token_unix":1779817764.7572594,"t_done":386901.349444025,"t_done_unix":1779817766.3633876},{"request_id":"1286804:1:1286804:195","session_id":"1286804","input_length":13962,"t_proxy_recv":386899.799015534,"t_decision_unix":1779817764.8129568,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13962,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":13962,"score_linear":49619.0,"score_lmetric":13962},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":13962,"score_linear":126737.0,"score_lmetric":337617},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":13962,"score_linear":232709.0,"score_lmetric":266014},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":30594,"pending_prefill_tokens":31695,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":13962,"score_linear":152913.0,"score_lmetric":136971},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31898,"ongoing_decode_tokens":31898,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":521,"cache_hit":0,"new_prefill":13962,"score_linear":31898.0,"score_lmetric":13962}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386901.002474899,"t_first_token_unix":1779817766.016419,"t_done":386901.696237053,"t_done_unix":1779817766.710183},{"request_id":"1276136:2:1280145:162","session_id":"1276136","input_length":24519,"t_proxy_recv":386876.805769926,"t_decision_unix":1779817741.819711,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":16896,"affinity_cache_ratio":0.6890982503364738,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":7623,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":24519,"score_linear":25187.0,"score_lmetric":24519},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":498,"cache_hit":0,"new_prefill":24519,"score_linear":58752.0,"score_lmetric":24519},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24519,"score_linear":150574.0,"score_lmetric":284650},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":16896,"new_prefill":7623,"score_linear":71421.0,"score_lmetric":95940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":24519,"score_linear":27639.0,"score_lmetric":24519},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":24519,"score_linear":232709.0,"score_lmetric":287128},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":98626,"ongoing_decode_tokens":98626,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":24519,"score_linear":98626.0,"score_lmetric":73557},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44358,"ongoing_decode_tokens":44358,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":24519,"score_linear":44358.0,"score_lmetric":49038}],"chosen_score_linear":71421.0,"chosen_score_lmetric":95940,"t_first_token":386903.686788004,"t_first_token_unix":1779817768.7007318,"t_done":386904.096591845,"t_done_unix":1779817769.1105354},{"request_id":"1287588:1:1287588:198","session_id":"1287588","input_length":9925,"t_proxy_recv":386902.34878632,"t_decision_unix":1779817767.3627279,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9925,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":435,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":9925,"score_linear":77805.0,"score_lmetric":87730},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":9925,"score_linear":49619.0,"score_lmetric":9925},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":9925,"score_linear":126737.0,"score_lmetric":325506},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":114612,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":9925,"score_linear":232709.0,"score_lmetric":28716},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":152913,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":9925,"score_linear":152913.0,"score_lmetric":29775},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386903.11781912,"t_first_token_unix":1779817768.1317625,"t_done":386904.413801651,"t_done_unix":1779817769.4277456},{"request_id":"1269373:5:1282812:174","session_id":"1269373","input_length":30594,"t_proxy_recv":386887.143905096,"t_decision_unix":1779817752.1578467,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":30208,"affinity_cache_ratio":0.9873831470222919,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":30208,"estimated_new_tokens":386,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":398,"cache_hit":4096,"new_prefill":26498,"score_linear":21091.0,"score_lmetric":26498},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":519,"cache_hit":0,"new_prefill":30594,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16299,"ongoing_decode_tokens":0,"pending_prefill_tokens":16299,"num_requests":1,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":30594,"score_linear":16299.0,"score_lmetric":46893},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":22914,"score_linear":119057.0,"score_lmetric":364473},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":30594,"score_linear":27639.0,"score_lmetric":30594},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":30594,"score_linear":232709.0,"score_lmetric":299278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":58032,"ongoing_decode_tokens":58032,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":580,"cache_hit":30208,"new_prefill":386,"score_linear":27824.0,"score_lmetric":386},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26426,"ongoing_decode_tokens":26426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":7680,"new_prefill":22914,"score_linear":18746.0,"score_lmetric":22914}],"chosen_score_linear":27824.0,"chosen_score_lmetric":386,"t_first_token":386887.242037693,"t_first_token_unix":1779817752.2559807,"t_done":386904.568051867,"t_done_unix":1779817769.581995},{"request_id":"1288143:1:1288143:200","session_id":"1288143","input_length":448,"t_proxy_recv":386904.314762143,"t_decision_unix":1779817769.3287034,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":448,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":435,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":448,"score_linear":77805.0,"score_lmetric":78253},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":448,"score_linear":49619.0,"score_lmetric":448},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":128141,"ongoing_decode_tokens":102218,"pending_prefill_tokens":1859,"num_requests":3,"active_p_offloads":0,"cached_blocks":586,"cache_hit":0,"new_prefill":448,"score_linear":128141.0,"score_lmetric":6921},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":114612,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":448,"score_linear":232709.0,"score_lmetric":9762},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":152913,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":448,"score_linear":152913.0,"score_lmetric":1344},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9925,"ongoing_decode_tokens":9925,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":448,"score_linear":9925.0,"score_lmetric":448}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386904.365005469,"t_first_token_unix":1779817769.3789494,"t_done":386904.876928577,"t_done_unix":1779817769.8908718},{"request_id":"1279994:1:1279994:161","session_id":"1279994","input_length":88317,"t_proxy_recv":386876.377930679,"t_decision_unix":1779817741.3918717,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":88317,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":0,"new_prefill":88317,"score_linear":25187.0,"score_lmetric":88317},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":498,"cache_hit":0,"new_prefill":88317,"score_linear":58752.0,"score_lmetric":88317},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":88317,"score_linear":150574.0,"score_lmetric":412246},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":88317,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":465,"cache_hit":0,"new_prefill":88317,"score_linear":27639.0,"score_lmetric":88317},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":88317,"score_linear":232709.0,"score_lmetric":414724},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":98626,"ongoing_decode_tokens":98626,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":88317,"score_linear":98626.0,"score_lmetric":264951},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44358,"ongoing_decode_tokens":44358,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":88317,"score_linear":44358.0,"score_lmetric":176634}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386902.594300272,"t_first_token_unix":1779817767.6082437,"t_done":386905.120755661,"t_done_unix":1779817770.1346993},{"request_id":"1276136:3:1280987:166","session_id":"1276136","input_length":25923,"t_proxy_recv":386904.103221761,"t_decision_unix":1779817769.117163,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9282876210315164,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":1859,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":435,"cache_hit":0,"new_prefill":25923,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":25923,"score_linear":77805.0,"score_lmetric":103728},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":25923,"score_linear":49619.0,"score_lmetric":25923},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":102218,"ongoing_decode_tokens":102218,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":586,"cache_hit":24064,"new_prefill":1859,"score_linear":78154.0,"score_lmetric":3718},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":25923,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":114612,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":25923,"score_linear":232709.0,"score_lmetric":60712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":152913,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":25923,"score_linear":152913.0,"score_lmetric":77769},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9925,"ongoing_decode_tokens":9925,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":25923,"score_linear":9925.0,"score_lmetric":25923}],"chosen_score_linear":78154.0,"chosen_score_lmetric":3718,"t_first_token":386904.451554234,"t_first_token_unix":1779817769.465498,"t_done":386905.799041701,"t_done_unix":1779817770.8129852},{"request_id":"1284132:1:1284132:182","session_id":"1284132","input_length":49619,"t_proxy_recv":386890.319753178,"t_decision_unix":1779817755.3336942,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49619,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":49619,"score_linear":126737.0,"score_lmetric":444588},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":49619,"score_linear":27639.0,"score_lmetric":49619},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":49619,"score_linear":232709.0,"score_lmetric":337328},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":110649,"ongoing_decode_tokens":30594,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":49619,"score_linear":110649.0,"score_lmetric":142612},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":65247,"ongoing_decode_tokens":65247,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":506,"cache_hit":0,"new_prefill":49619,"score_linear":65247.0,"score_lmetric":99238}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386899.572160532,"t_first_token_unix":1779817764.586104,"t_done":386906.21388716,"t_done_unix":1779817771.2278335},{"request_id":"1268831:5:1284640:184","session_id":"1268831","input_length":42264,"t_proxy_recv":386892.043630655,"t_decision_unix":1779817757.0575721,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":32256,"affinity_cache_ratio":0.7632027257240205,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":10008,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":42264,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":42264,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":42264,"score_linear":49619.0,"score_lmetric":91883},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":42264,"score_linear":126737.0,"score_lmetric":422523},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":42264,"score_linear":27639.0,"score_lmetric":42264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":42264,"score_linear":232709.0,"score_lmetric":322618},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":110649,"ongoing_decode_tokens":30594,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":597,"cache_hit":32256,"new_prefill":10008,"score_linear":78393.0,"score_lmetric":63390},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":42264,"score_linear":30965.0,"score_lmetric":42264}],"chosen_score_linear":78393.0,"chosen_score_lmetric":63390,"t_first_token":386901.858197834,"t_first_token_unix":1779817766.872144,"t_done":386906.499945329,"t_done_unix":1779817771.513893},{"request_id":"1279994:2:1283011:177","session_id":"1279994","input_length":88940,"t_proxy_recv":386905.137372982,"t_decision_unix":1779817770.1513145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":88064,"affinity_cache_ratio":0.990150663368563,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":876,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":88940,"score_linear":77805.0,"score_lmetric":166745},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":88940,"score_linear":49619.0,"score_lmetric":88940},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":39824,"ongoing_decode_tokens":39824,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":758,"cache_hit":88064,"new_prefill":876,"score_linear":-48240.0,"score_lmetric":1752},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":88940,"score_linear":232709.0,"score_lmetric":177880},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":161107,"ongoing_decode_tokens":122319,"pending_prefill_tokens":8068,"num_requests":3,"active_p_offloads":0,"cached_blocks":598,"cache_hit":0,"new_prefill":88940,"score_linear":161107.0,"score_lmetric":291024},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48240.0,"chosen_score_lmetric":1752,"t_first_token":386905.651127697,"t_first_token_unix":1779817770.665072,"t_done":386906.545530477,"t_done_unix":1779817771.5594745},{"request_id":"1272313:4:1281720:170","session_id":"1272313","input_length":13901,"t_proxy_recv":386882.106523429,"t_decision_unix":1779817747.1204646,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":11264,"affinity_cache_ratio":0.8103014171642328,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":2637,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":389,"cache_hit":4096,"new_prefill":9805,"score_linear":21091.0,"score_lmetric":9805},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":501,"cache_hit":0,"new_prefill":13901,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13901,"score_linear":150574.0,"score_lmetric":263414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":112836,"ongoing_decode_tokens":0,"pending_prefill_tokens":95940,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":11264,"new_prefill":2637,"score_linear":101572.0,"score_lmetric":197154},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":13901,"score_linear":27639.0,"score_lmetric":13901},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":13901,"score_linear":232709.0,"score_lmetric":265892},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":88294,"ongoing_decode_tokens":30262,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":555,"cache_hit":10752,"new_prefill":3149,"score_linear":77542.0,"score_lmetric":23034},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60454,"ongoing_decode_tokens":60454,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":472,"cache_hit":7680,"new_prefill":6221,"score_linear":52774.0,"score_lmetric":12442}],"chosen_score_linear":101572.0,"chosen_score_lmetric":197154,"t_first_token":386903.689478411,"t_first_token_unix":1779817768.7034228,"t_done":386907.632260597,"t_done_unix":1779817772.6462042},{"request_id":"1286551:2:1289450:202","session_id":"1286551","input_length":9610,"t_proxy_recv":386908.658791751,"t_decision_unix":1779817773.6727328,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":1536,"affinity_cache_ratio":0.1598335067637877,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":8074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":9610,"score_linear":77805.0,"score_lmetric":87415},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":9610,"score_linear":104111.0,"score_lmetric":19220},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":1536,"new_prefill":8074,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":9610,"score_linear":232709.0,"score_lmetric":19220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":9610,"score_linear":118843.0,"score_lmetric":19220},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":386909.287893979,"t_first_token_unix":1779817774.3018372,"t_done":386909.650638793,"t_done_unix":1779817774.6645818},{"request_id":"1266668:6:1284003:181","session_id":"1266668","input_length":80055,"t_proxy_recv":386889.862633806,"t_decision_unix":1779817754.876575,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58368,"affinity_cache_ratio":0.7290987446130786,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":21687,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":408,"cache_hit":4096,"new_prefill":75959,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":80055,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":80055,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":7680,"new_prefill":72375,"score_linear":119057.0,"score_lmetric":512856},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":466,"cache_hit":0,"new_prefill":80055,"score_linear":27639.0,"score_lmetric":80055},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":80055,"score_linear":232709.0,"score_lmetric":398200},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":30594,"ongoing_decode_tokens":30594,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":58368,"new_prefill":21687,"score_linear":-27774.0,"score_lmetric":21687},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91673,"ongoing_decode_tokens":26426,"pending_prefill_tokens":6879,"num_requests":3,"active_p_offloads":0,"cached_blocks":493,"cache_hit":7680,"new_prefill":72375,"score_linear":83993.0,"score_lmetric":237762}],"chosen_score_linear":-27774.0,"chosen_score_lmetric":21687,"t_first_token":386900.121946177,"t_first_token_unix":1779817765.1358898,"t_done":386910.279203335,"t_done_unix":1779817775.293147},{"request_id":"1287588:2:1289701:205","session_id":"1287588","input_length":10195,"t_proxy_recv":386909.574915847,"t_decision_unix":1779817774.5888572,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9728,"affinity_cache_ratio":0.954193231976459,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":10195,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":10195,"score_linear":77805.0,"score_lmetric":88000},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":10195,"score_linear":82014.0,"score_lmetric":92209},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":10195,"score_linear":104111.0,"score_lmetric":20390},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9610,"ongoing_decode_tokens":9610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":10195,"score_linear":9610.0,"score_lmetric":10195},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":10195,"score_linear":232709.0,"score_lmetric":20390},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":10195,"score_linear":118843.0,"score_lmetric":20390},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32191,"ongoing_decode_tokens":0,"pending_prefill_tokens":447,"num_requests":1,"active_p_offloads":0,"cached_blocks":550,"cache_hit":9728,"new_prefill":467,"score_linear":22463.0,"score_lmetric":914}],"chosen_score_linear":22463.0,"chosen_score_lmetric":914,"t_first_token":386911.380829139,"t_first_token_unix":1779817776.3947728,"t_done":386911.498873909,"t_done_unix":1779817776.5128174},{"request_id":"1290442:1:1290442:210","session_id":"1290442","input_length":7261,"t_proxy_recv":386911.928946443,"t_decision_unix":1779817776.942888,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":7261,"score_linear":23228.0,"score_lmetric":30489},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":7261,"score_linear":77805.0,"score_lmetric":85066},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":7261,"score_linear":82014.0,"score_lmetric":89275},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":7261,"score_linear":104111.0,"score_lmetric":14522},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":502,"cache_hit":0,"new_prefill":7261,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":7261,"score_linear":232709.0,"score_lmetric":14522},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":126529,"ongoing_decode_tokens":38788,"pending_prefill_tokens":7357,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":7261,"score_linear":126529.0,"score_lmetric":29236},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45743,"ongoing_decode_tokens":77111,"pending_prefill_tokens":-136,"num_requests":2,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":7261,"score_linear":45743.0,"score_lmetric":14250}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386912.431577979,"t_first_token_unix":1779817777.4455214,"t_done":386912.5733316,"t_done_unix":1779817777.5872748},{"request_id":"1279994:3:1286181:192","session_id":"1279994","input_length":89226,"t_proxy_recv":386906.56459712,"t_decision_unix":1779817771.5785382,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":88576,"affinity_cache_ratio":0.9927151278775245,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88576,"estimated_new_tokens":650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":89226,"score_linear":77805.0,"score_lmetric":167031},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13901,"ongoing_decode_tokens":13901,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":762,"cache_hit":88576,"new_prefill":650,"score_linear":-74675.0,"score_lmetric":650},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":89226,"score_linear":232709.0,"score_lmetric":178452},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":89226,"score_linear":118843.0,"score_lmetric":178452},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74675.0,"chosen_score_lmetric":650,"t_first_token":386906.85131351,"t_first_token_unix":1779817771.8652575,"t_done":386912.583352237,"t_done_unix":1779817777.5972958},{"request_id":"1272313:5:1284744:185","session_id":"1272313","input_length":14885,"t_proxy_recv":386907.636825524,"t_decision_unix":1779817772.6507668,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":13824,"affinity_cache_ratio":0.9287201881088344,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1061,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":4096,"new_prefill":10789,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":14885,"score_linear":77805.0,"score_lmetric":92690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":14885,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89226,"ongoing_decode_tokens":89226,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":767,"cache_hit":13824,"new_prefill":1061,"score_linear":75402.0,"score_lmetric":1061},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":14885,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":14885,"score_linear":232709.0,"score_lmetric":29770},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":10752,"new_prefill":4133,"score_linear":108091.0,"score_lmetric":8266},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":7680,"new_prefill":7205,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":75402.0,"chosen_score_lmetric":1061,"t_first_token":386907.876296998,"t_first_token_unix":1779817772.89024,"t_done":386913.380268499,"t_done_unix":1779817778.3942118},{"request_id":"1290426:1:1290426:209","session_id":"1290426","input_length":13552,"t_proxy_recv":386911.903936946,"t_decision_unix":1779817776.9178784,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":-136,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13552,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":13552,"score_linear":23228.0,"score_lmetric":36780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":13552,"score_linear":77805.0,"score_lmetric":91357},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":13552,"score_linear":82014.0,"score_lmetric":95566},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":13552,"score_linear":104111.0,"score_lmetric":27104},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":502,"cache_hit":1536,"new_prefill":12016,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":13552,"score_linear":232709.0,"score_lmetric":27104},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":126529,"ongoing_decode_tokens":38788,"pending_prefill_tokens":7357,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":13552,"score_linear":126529.0,"score_lmetric":41818},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32191,"ongoing_decode_tokens":77111,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":13552,"score_linear":32191.0,"score_lmetric":-136}],"chosen_score_linear":32191.0,"chosen_score_lmetric":-136,"t_first_token":386913.079336676,"t_first_token_unix":1779817778.0932798,"t_done":386913.858561929,"t_done_unix":1779817778.872505},{"request_id":"1279412:4:1289482:203","session_id":"1279412","input_length":32191,"t_proxy_recv":386908.738531526,"t_decision_unix":1779817773.7524729,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9861141312789289,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":447,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":32191,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":32191,"score_linear":77805.0,"score_lmetric":109996},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":32191,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":32191,"score_linear":104111.0,"score_lmetric":64382},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":8074,"num_requests":1,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":32191,"score_linear":9610.0,"score_lmetric":40265},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":32191,"score_linear":232709.0,"score_lmetric":64382},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":32191,"score_linear":118843.0,"score_lmetric":64382},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":31744,"new_prefill":447,"score_linear":-31744.0,"score_lmetric":0}],"chosen_score_linear":-31744.0,"chosen_score_lmetric":0,"t_first_token":386911.375378975,"t_first_token_unix":1779817776.3893223,"t_done":386914.145907395,"t_done_unix":1779817779.1598504},{"request_id":"1291100:1:1291100:212","session_id":"1291100","input_length":1744,"t_proxy_recv":386914.143762485,"t_decision_unix":1779817779.1577039,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":-11944,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1744,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":1744,"score_linear":23228.0,"score_lmetric":24972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":1744,"score_linear":77805.0,"score_lmetric":79549},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":1744,"score_linear":82014.0,"score_lmetric":83758},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":105296,"ongoing_decode_tokens":105296,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":1744,"score_linear":105296.0,"score_lmetric":3488},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":1744,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":1744,"score_linear":232709.0,"score_lmetric":3488},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":126529,"ongoing_decode_tokens":38788,"pending_prefill_tokens":7357,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":1744,"score_linear":126529.0,"score_lmetric":18202},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32191,"ongoing_decode_tokens":77111,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":576,"cache_hit":0,"new_prefill":1744,"score_linear":32191.0,"score_lmetric":-11944}],"chosen_score_linear":32191.0,"chosen_score_lmetric":-11944,"t_first_token":386914.329632495,"t_first_token_unix":1779817779.3435755,"t_done":386914.997021981,"t_done_unix":1779817780.0109653},{"request_id":"1290365:1:1290365:208","session_id":"1290365","input_length":23228,"t_proxy_recv":386911.723531212,"t_decision_unix":1779817776.7374723,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":23228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":23228,"score_linear":77805.0,"score_lmetric":101033},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":23228,"score_linear":82014.0,"score_lmetric":105242},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":23228,"score_linear":104111.0,"score_lmetric":46456},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":502,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":23228,"score_linear":232709.0,"score_lmetric":46456},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":126529,"ongoing_decode_tokens":38788,"pending_prefill_tokens":7357,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":23228,"score_linear":126529.0,"score_lmetric":61170},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32191,"ongoing_decode_tokens":77111,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":23228,"score_linear":32191.0,"score_lmetric":9540}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386914.302075302,"t_first_token_unix":1779817779.3160183,"t_done":386915.021129365,"t_done_unix":1779817780.0350723},{"request_id":"1279994:4:1290711:211","session_id":"1279994","input_length":89749,"t_proxy_recv":386912.804981367,"t_decision_unix":1779817777.8189228,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9983398143711908,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":149,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":89749,"score_linear":23228.0,"score_lmetric":112977},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":89749,"score_linear":77805.0,"score_lmetric":167554},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":89749,"score_linear":82014.0,"score_lmetric":171763},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":14885,"ongoing_decode_tokens":14885,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":769,"cache_hit":89600,"new_prefill":149,"score_linear":-74715.0,"score_lmetric":149},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":89749,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":89749,"score_linear":232709.0,"score_lmetric":179498},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":126529,"ongoing_decode_tokens":38788,"pending_prefill_tokens":7357,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":89749,"score_linear":126529.0,"score_lmetric":194212},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45743,"ongoing_decode_tokens":77111,"pending_prefill_tokens":-136,"num_requests":2,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":89749,"score_linear":45743.0,"score_lmetric":179226}],"chosen_score_linear":-74715.0,"chosen_score_lmetric":149,"t_first_token":386912.987268486,"t_first_token_unix":1779817778.0012116,"t_done":386915.357953875,"t_done_unix":1779817780.3718975},{"request_id":"1269373:6:1285668:189","session_id":"1269373","input_length":38788,"t_proxy_recv":386904.579984964,"t_decision_unix":1779817769.5939264,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":30720,"affinity_cache_ratio":0.7919975250077343,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":8068,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":448,"ongoing_decode_tokens":448,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":435,"cache_hit":4096,"new_prefill":34692,"score_linear":-3648.0,"score_lmetric":34692},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":38788,"score_linear":77805.0,"score_lmetric":116593},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":38788,"score_linear":49619.0,"score_lmetric":38788},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":128141,"ongoing_decode_tokens":128141,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":586,"cache_hit":7680,"new_prefill":31108,"score_linear":120461.0,"score_lmetric":93324},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":38788,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":114612,"pending_prefill_tokens":4433,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":38788,"score_linear":232709.0,"score_lmetric":86442},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":122319,"ongoing_decode_tokens":122319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":598,"cache_hit":30720,"new_prefill":8068,"score_linear":91599.0,"score_lmetric":16136},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":7680,"new_prefill":31108,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":91599.0,"chosen_score_lmetric":16136,"t_first_token":386906.497689303,"t_first_token_unix":1779817771.5116334,"t_done":386915.701204142,"t_done_unix":1779817780.7151475},{"request_id":"1272313:6:1287745:199","session_id":"1272313","input_length":15547,"t_proxy_recv":386913.384587841,"t_decision_unix":1779817778.3985293,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":15360,"affinity_cache_ratio":0.9879719560043738,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":436,"cache_hit":4096,"new_prefill":11451,"score_linear":19132.0,"score_lmetric":34679},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":15547,"score_linear":77805.0,"score_lmetric":93352},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":15547,"score_linear":82014.0,"score_lmetric":97561},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89749,"ongoing_decode_tokens":89749,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":15360,"new_prefill":187,"score_linear":74389.0,"score_lmetric":187},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":15547,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":15547,"score_linear":232709.0,"score_lmetric":31094},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":126529,"ongoing_decode_tokens":38788,"pending_prefill_tokens":7357,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":10752,"new_prefill":4795,"score_linear":115777.0,"score_lmetric":24304},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45743,"ongoing_decode_tokens":90663,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":550,"cache_hit":7680,"new_prefill":7867,"score_linear":38063.0,"score_lmetric":-11642}],"chosen_score_linear":74389.0,"chosen_score_lmetric":187,"t_first_token":386913.473570363,"t_first_token_unix":1779817778.4875133,"t_done":386915.976282638,"t_done_unix":1779817780.9902256},{"request_id":"1258859:3:1278118:155","session_id":"1258859","input_length":118097,"t_proxy_recv":386870.025377658,"t_decision_unix":1779817735.039319,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":113664,"affinity_cache_ratio":0.962463060026927,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":113664,"estimated_new_tokens":4433,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34071,"ongoing_decode_tokens":34071,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":118097,"score_linear":34071.0,"score_lmetric":236194},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":118097,"score_linear":120167.0,"score_lmetric":448880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":118097,"score_linear":150574.0,"score_lmetric":471806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49794,"ongoing_decode_tokens":49794,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":118097,"score_linear":49794.0,"score_lmetric":236194},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":118097,"score_linear":121069.0,"score_lmetric":423054},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":321,"cache_hit":113664,"new_prefill":4433,"score_linear":948.0,"score_lmetric":119045},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106829,"ongoing_decode_tokens":58084,"pending_prefill_tokens":14441,"num_requests":4,"active_p_offloads":0,"cached_blocks":462,"cache_hit":0,"new_prefill":118097,"score_linear":106829.0,"score_lmetric":530152},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55652,"ongoing_decode_tokens":0,"pending_prefill_tokens":24420,"num_requests":2,"active_p_offloads":0,"cached_blocks":410,"cache_hit":0,"new_prefill":118097,"score_linear":55652.0,"score_lmetric":285034}],"chosen_score_linear":948.0,"chosen_score_lmetric":119045,"t_first_token":386904.865144184,"t_first_token_unix":1779817769.879088,"t_done":386916.180941739,"t_done_unix":1779817781.1948848},{"request_id":"1262354:12:1291548:213","session_id":"1262354","input_length":35099,"t_proxy_recv":386915.784279388,"t_decision_unix":1779817780.7982209,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9919370922248497,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":35099,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":35099,"score_linear":77805.0,"score_lmetric":112904},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":35099,"score_linear":82014.0,"score_lmetric":117113},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15547,"ongoing_decode_tokens":15547,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":35099,"score_linear":15547.0,"score_lmetric":35099},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":35099,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":35099,"score_linear":232709.0,"score_lmetric":70198},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":87741,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":35099,"score_linear":130486.0,"score_lmetric":77864},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":34816,"new_prefill":283,"score_linear":-34816.0,"score_lmetric":0}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":386915.868061948,"t_first_token_unix":1779817780.882005,"t_done":386917.022056389,"t_done_unix":1779817782.0359995},{"request_id":"1290365:2:1292000:217","session_id":"1290365","input_length":23414,"t_proxy_recv":386917.321753311,"t_decision_unix":1779817782.3356946,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9840266507217904,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":374,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":23040,"new_prefill":374,"score_linear":-23040.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":23414,"score_linear":77805.0,"score_lmetric":101219},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":23414,"score_linear":82014.0,"score_lmetric":105428},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":23414,"score_linear":15969.0,"score_lmetric":23414},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":23414,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":23414,"score_linear":233348.0,"score_lmetric":46828},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":130486,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":23414,"score_linear":130486.0,"score_lmetric":46828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":82656,"ongoing_decode_tokens":119432,"pending_prefill_tokens":-5544,"num_requests":3,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":23414,"score_linear":82656.0,"score_lmetric":53610}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":386917.4004097,"t_first_token_unix":1779817782.414353,"t_done":386917.714344636,"t_done_unix":1779817782.7282877},{"request_id":"1272313:7:1290281:206","session_id":"1272313","input_length":15969,"t_proxy_recv":386915.980645924,"t_decision_unix":1779817780.9945877,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":15360,"affinity_cache_ratio":0.96186361074582,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":4096,"new_prefill":11873,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":15969,"score_linear":77805.0,"score_lmetric":93774},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":15969,"score_linear":82014.0,"score_lmetric":97983},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":772,"cache_hit":15360,"new_prefill":609,"score_linear":-15360.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":15969,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":15969,"score_linear":232709.0,"score_lmetric":31938},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":87741,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":10752,"new_prefill":5217,"score_linear":119734.0,"score_lmetric":18100},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35099,"ongoing_decode_tokens":80019,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":580,"cache_hit":7680,"new_prefill":8289,"score_linear":27419.0,"score_lmetric":-5399}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":386916.056759267,"t_first_token_unix":1779817781.070703,"t_done":386918.018233521,"t_done_unix":1779817783.0321772},{"request_id":"1279412:5:1291651:214","session_id":"1279412","input_length":32359,"t_proxy_recv":386916.07065362,"t_decision_unix":1779817781.0845952,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":32256,"affinity_cache_ratio":0.9968169597329954,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":32359,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":32359,"score_linear":77805.0,"score_lmetric":110164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":32359,"score_linear":82014.0,"score_lmetric":114373},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":32359,"score_linear":15969.0,"score_lmetric":32359},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":32359,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":32359,"score_linear":232709.0,"score_lmetric":64718},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":87741,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":32359,"score_linear":130486.0,"score_lmetric":72384},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35099,"ongoing_decode_tokens":80019,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":580,"cache_hit":32256,"new_prefill":103,"score_linear":2843.0,"score_lmetric":-13585}],"chosen_score_linear":2843.0,"chosen_score_lmetric":-13585,"t_first_token":386916.145704193,"t_first_token_unix":1779817781.159648,"t_done":386918.052036274,"t_done_unix":1779817783.0659797},{"request_id":"1291944:1:1291944:216","session_id":"1291944","input_length":8144,"t_proxy_recv":386917.124704373,"t_decision_unix":1779817782.1386456,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-11088,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":8144,"score_linear":77805.0,"score_lmetric":85949},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":8144,"score_linear":82014.0,"score_lmetric":90158},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":8144,"score_linear":15969.0,"score_lmetric":8144},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":8144,"score_linear":233348.0,"score_lmetric":16288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":130486,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":8144,"score_linear":130486.0,"score_lmetric":16288},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74512,"ongoing_decode_tokens":119432,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":8144,"score_linear":74512.0,"score_lmetric":-11088}],"chosen_score_linear":74512.0,"chosen_score_lmetric":-11088,"t_first_token":386917.72142177,"t_first_token_unix":1779817782.7353654,"t_done":386918.109509733,"t_done_unix":1779817783.123453},{"request_id":"1260327:6:1291827:215","session_id":"1260327","input_length":42153,"t_proxy_recv":386916.755499804,"t_decision_unix":1779817781.7694328,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9959907954356748,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":169,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":42153,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":42153,"score_linear":77805.0,"score_lmetric":119958},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":42153,"score_linear":82014.0,"score_lmetric":124167},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":42153,"score_linear":15969.0,"score_lmetric":42153},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":42153,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":42153,"score_linear":233348.0,"score_lmetric":84306},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":87741,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":42153,"score_linear":130486.0,"score_lmetric":91972},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":67458,"ongoing_decode_tokens":112378,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":580,"cache_hit":41984,"new_prefill":169,"score_linear":25474.0,"score_lmetric":-27038}],"chosen_score_linear":25474.0,"chosen_score_lmetric":-27038,"t_first_token":386916.882156108,"t_first_token_unix":1779817781.8961,"t_done":386918.273125857,"t_done_unix":1779817783.287069},{"request_id":"1286551:3:1292589:219","session_id":"1286551","input_length":16914,"t_proxy_recv":386918.991111315,"t_decision_unix":1779817784.0050526,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":9216,"affinity_cache_ratio":0.54487406881873,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":7698,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":16914,"score_linear":77805.0,"score_lmetric":94719},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":16914,"score_linear":82014.0,"score_lmetric":98928},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":9216,"new_prefill":7698,"score_linear":-9216.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":16914,"score_linear":233348.0,"score_lmetric":33828},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":130486,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":16914,"score_linear":130486.0,"score_lmetric":33828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":1536,"new_prefill":15378,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":386919.893542773,"t_first_token_unix":1779817784.9074862,"t_done":386920.073516733,"t_done_unix":1779817785.0874608},{"request_id":"1292750:1:1292750:220","session_id":"1292750","input_length":4684,"t_proxy_recv":386919.62605108,"t_decision_unix":1779817784.6399925,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":4684,"score_linear":77805.0,"score_lmetric":82489},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":4684,"score_linear":82014.0,"score_lmetric":86698},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":16914,"ongoing_decode_tokens":0,"pending_prefill_tokens":7698,"num_requests":1,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":4684,"score_linear":16914.0,"score_lmetric":12382},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":4684,"score_linear":233348.0,"score_lmetric":9368},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":130486,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":4684,"score_linear":130486.0,"score_lmetric":9368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386919.923596832,"t_first_token_unix":1779817784.9375405,"t_done":386920.360230629,"t_done_unix":1779817785.3741744},{"request_id":"1266668:7:1287468:197","session_id":"1266668","input_length":87741,"t_proxy_recv":386910.297198977,"t_decision_unix":1779817775.3111405,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":80384,"affinity_cache_ratio":0.916150944256391,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":80384,"estimated_new_tokens":7357,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":4096,"new_prefill":83645,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":87741,"score_linear":77805.0,"score_lmetric":165546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":87741,"score_linear":82014.0,"score_lmetric":169755},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":7680,"new_prefill":80061,"score_linear":96431.0,"score_lmetric":160122},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":502,"cache_hit":0,"new_prefill":87741,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":87741,"score_linear":232709.0,"score_lmetric":175482},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":38788,"ongoing_decode_tokens":38788,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":660,"cache_hit":80384,"new_prefill":7357,"score_linear":-41596.0,"score_lmetric":7357},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":42386,"ongoing_decode_tokens":0,"pending_prefill_tokens":914,"num_requests":2,"active_p_offloads":0,"cached_blocks":550,"cache_hit":7680,"new_prefill":80061,"score_linear":34706.0,"score_lmetric":161950}],"chosen_score_linear":-41596.0,"chosen_score_lmetric":7357,"t_first_token":386914.176403976,"t_first_token_unix":1779817779.1903472,"t_done":386920.385285223,"t_done_unix":1779817785.3992286},{"request_id":"1262354:13:1293000:221","session_id":"1262354","input_length":35210,"t_proxy_recv":386920.470614274,"t_decision_unix":1779817785.4845555,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9888099971598977,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":394,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":35210,"score_linear":77805.0,"score_lmetric":113015},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":35210,"score_linear":82014.0,"score_lmetric":117224},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":35210,"score_linear":233348.0,"score_lmetric":70420},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":35210,"score_linear":138850.0,"score_lmetric":86502},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":34816,"new_prefill":394,"score_linear":-34816.0,"score_lmetric":0}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":386920.560969916,"t_first_token_unix":1779817785.5749135,"t_done":386921.440217179,"t_done_unix":1779817786.4541602},{"request_id":"1287100:1:1287100:196","session_id":"1287100","input_length":77805,"t_proxy_recv":386900.777581246,"t_decision_unix":1779817765.7915223,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":77805,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13962,"ongoing_decode_tokens":0,"pending_prefill_tokens":13962,"num_requests":1,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":77805,"score_linear":13962.0,"score_lmetric":91767},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":77805,"score_linear":49619.0,"score_lmetric":77805},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126737,"ongoing_decode_tokens":0,"pending_prefill_tokens":98577,"num_requests":3,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":77805,"score_linear":126737.0,"score_lmetric":529146},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":0,"pending_prefill_tokens":119045,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":77805,"score_linear":232709.0,"score_lmetric":393700},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":152913,"ongoing_decode_tokens":110649,"pending_prefill_tokens":10008,"num_requests":3,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":77805,"score_linear":152913.0,"score_lmetric":263439},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31898,"ongoing_decode_tokens":31898,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":521,"cache_hit":0,"new_prefill":77805,"score_linear":31898.0,"score_lmetric":77805}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386921.485140327,"t_first_token_unix":1779817786.4990838,"t_done":386922.018315932,"t_done_unix":1779817787.0322592},{"request_id":"1258859:4:1282900:176","session_id":"1258859","input_length":118736,"t_proxy_recv":386916.203781467,"t_decision_unix":1779817781.2177231,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":118272,"affinity_cache_ratio":0.9960921708664601,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":118272,"estimated_new_tokens":464,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":0,"new_prefill":118736,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":118736,"score_linear":77805.0,"score_lmetric":196541},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":118736,"score_linear":82014.0,"score_lmetric":200750},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":118736,"score_linear":15969.0,"score_lmetric":118736},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":118736,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":330,"cache_hit":118272,"new_prefill":464,"score_linear":-3660.0,"score_lmetric":464},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130486,"ongoing_decode_tokens":87741,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":676,"cache_hit":0,"new_prefill":118736,"score_linear":130486.0,"score_lmetric":245138},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":67458,"ongoing_decode_tokens":112378,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":118736,"score_linear":67458.0,"score_lmetric":210096}],"chosen_score_linear":-3660.0,"chosen_score_lmetric":464,"t_first_token":386916.44491278,"t_first_token_unix":1779817781.4588563,"t_done":386922.925885292,"t_done_unix":1779817787.9398286},{"request_id":"1290365:3:1293216:222","session_id":"1290365","input_length":24482,"t_proxy_recv":386921.256045117,"t_decision_unix":1779817786.2699864,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":23040,"affinity_cache_ratio":0.941099583367372,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1442,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":490,"cache_hit":23040,"new_prefill":1442,"score_linear":-23040.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":24482,"score_linear":77805.0,"score_lmetric":102287},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":24482,"score_linear":82014.0,"score_lmetric":106496},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":24482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":24482,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":24482,"score_linear":233348.0,"score_lmetric":48964},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":24482,"score_linear":138850.0,"score_lmetric":65046},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35210,"ongoing_decode_tokens":80130,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":24482,"score_linear":35210.0,"score_lmetric":10794}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":386921.525659549,"t_first_token_unix":1779817786.5396035,"t_done":386923.56269724,"t_done_unix":1779817788.5766406},{"request_id":"1293507:1:1293507:224","session_id":"1293507","input_length":6460,"t_proxy_recv":386922.301305843,"t_decision_unix":1779817787.315247,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-6192,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":6460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":6460,"score_linear":24482.0,"score_lmetric":6460},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":6460,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":6460,"score_linear":82014.0,"score_lmetric":88474},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":6460,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":6460,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":6460,"score_linear":233348.0,"score_lmetric":12920},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":6460,"score_linear":138850.0,"score_lmetric":29002},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2572,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-12652,"num_requests":1,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":6460,"score_linear":2572.0,"score_lmetric":-6192}],"chosen_score_linear":2572.0,"chosen_score_lmetric":-6192,"t_first_token":386922.740666013,"t_first_token_unix":1779817787.7546098,"t_done":386925.494792291,"t_done_unix":1779817790.5087352},{"request_id":"1291100:2:1293458:223","session_id":"1291100","input_length":2572,"t_proxy_recv":386922.114902953,"t_decision_unix":1779817787.128844,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":1536,"affinity_cache_ratio":0.5972006220839814,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":1036,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":2572,"score_linear":24482.0,"score_lmetric":2572},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":2572,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":2572,"score_linear":82014.0,"score_lmetric":84586},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":2572,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":2572,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":2572,"score_linear":233348.0,"score_lmetric":5144},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":2572,"score_linear":138850.0,"score_lmetric":21226},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":1536,"new_prefill":1036,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":386922.317028235,"t_first_token_unix":1779817787.3309715,"t_done":386925.5407856,"t_done_unix":1779817790.5547287},{"request_id":"1266668:8:1292408:218","session_id":"1266668","input_length":96105,"t_proxy_recv":386920.404863441,"t_decision_unix":1779817785.4188046,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":88064,"affinity_cache_ratio":0.916331096196868,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":8041,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":490,"cache_hit":4096,"new_prefill":92009,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":96105,"score_linear":77805.0,"score_lmetric":173910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":96105,"score_linear":82014.0,"score_lmetric":178119},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":7680,"new_prefill":88425,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":96105,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":96105,"score_linear":233348.0,"score_lmetric":192210},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42745,"ongoing_decode_tokens":42745,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":691,"cache_hit":88064,"new_prefill":8041,"score_linear":-45319.0,"score_lmetric":8041},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":7680,"new_prefill":88425,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-45319.0,"chosen_score_lmetric":8041,"t_first_token":386924.984838655,"t_first_token_unix":1779817789.9987822,"t_done":386926.195383449,"t_done_unix":1779817791.2093267},{"request_id":"1291944:2:1293798:227","session_id":"1291944","input_length":12388,"t_proxy_recv":386923.38657917,"t_decision_unix":1779817788.40052,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":7680,"affinity_cache_ratio":0.6199547949628673,"affinity_num_requests":3,"avg_num_requests":1.125,"fallback_score":-2874,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":4708,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":12388,"score_linear":24482.0,"score_lmetric":12388},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":12388,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":12388,"score_linear":82014.0,"score_lmetric":94402},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28796,"ongoing_decode_tokens":0,"pending_prefill_tokens":12924,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":12388,"score_linear":28796.0,"score_lmetric":25312},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":12388,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":12388,"score_linear":114612.0,"score_lmetric":12388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":12388,"score_linear":138850.0,"score_lmetric":40858},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":49310,"ongoing_decode_tokens":53952,"pending_prefill_tokens":-5666,"num_requests":3,"active_p_offloads":0,"cached_blocks":595,"cache_hit":7680,"new_prefill":4708,"score_linear":41630.0,"score_lmetric":-2874}],"chosen_score_linear":41630.0,"chosen_score_lmetric":-2874,"t_first_token":386925.457313772,"t_first_token_unix":1779817790.471257,"t_done":386926.280375387,"t_done_unix":1779817791.2943187},{"request_id":"1272313:8:1293738:226","session_id":"1272313","input_length":28796,"t_proxy_recv":386923.23905498,"t_decision_unix":1779817788.2529957,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":15872,"affinity_cache_ratio":0.5511876649534657,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":12924,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":4096,"new_prefill":24700,"score_linear":20386.0,"score_lmetric":24700},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":28796,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":28796,"score_linear":82014.0,"score_lmetric":110810},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":15872,"new_prefill":12924,"score_linear":-15872.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":28796,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":28796,"score_linear":114612.0,"score_lmetric":28796},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":10752,"new_prefill":18044,"score_linear":128098.0,"score_lmetric":52170},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":49310,"ongoing_decode_tokens":53952,"pending_prefill_tokens":-5666,"num_requests":3,"active_p_offloads":0,"cached_blocks":595,"cache_hit":7680,"new_prefill":21116,"score_linear":41630.0,"score_lmetric":46350}],"chosen_score_linear":-15872.0,"chosen_score_lmetric":0,"t_first_token":386925.427134104,"t_first_token_unix":1779817790.4410777,"t_done":386927.216565958,"t_done_unix":1779817792.2305093},{"request_id":"1269373:7:1290314:207","session_id":"1269373","input_length":42745,"t_proxy_recv":386915.711156561,"t_decision_unix":1779817780.725098,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":38912,"affinity_cache_ratio":0.9103286934144345,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38912,"estimated_new_tokens":3833,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":481,"cache_hit":4096,"new_prefill":38649,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":42745,"score_linear":77805.0,"score_lmetric":120550},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":42745,"score_linear":82014.0,"score_lmetric":124759},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15547,"ongoing_decode_tokens":15547,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":7680,"new_prefill":35065,"score_linear":7867.0,"score_lmetric":35065},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":516,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":42745,"score_linear":232709.0,"score_lmetric":85490},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":87741,"ongoing_decode_tokens":87741,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":676,"cache_hit":38912,"new_prefill":3833,"score_linear":48829.0,"score_lmetric":3833},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":7680,"new_prefill":35065,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":48829.0,"chosen_score_lmetric":3833,"t_first_token":386916.784703419,"t_first_token_unix":1779817781.7986474,"t_done":386927.447128023,"t_done_unix":1779817792.4610713},{"request_id":"1262354:14:1294243:228","session_id":"1262354","input_length":35435,"t_proxy_recv":386924.555078043,"t_decision_unix":1779817789.569019,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9825313955129109,"affinity_num_requests":4,"avg_num_requests":1.125,"fallback_score":-1356,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":619,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":35435,"score_linear":82014.0,"score_lmetric":117449},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28796,"ongoing_decode_tokens":0,"pending_prefill_tokens":12924,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":35435,"score_linear":28796.0,"score_lmetric":48359},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":35435,"score_linear":114612.0,"score_lmetric":35435},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":35435,"score_linear":138850.0,"score_lmetric":86952},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61698,"ongoing_decode_tokens":53952,"pending_prefill_tokens":-958,"num_requests":4,"active_p_offloads":0,"cached_blocks":595,"cache_hit":34816,"new_prefill":619,"score_linear":26882.0,"score_lmetric":-1356}],"chosen_score_linear":26882.0,"chosen_score_lmetric":-1356,"t_first_token":386925.459108217,"t_first_token_unix":1779817790.4730513,"t_done":386928.027479251,"t_done_unix":1779817793.0414228},{"request_id":"1294611:1:1294611:229","session_id":"1294611","input_length":21947,"t_proxy_recv":386925.848756792,"t_decision_unix":1779817790.8626983,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21947,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":21947,"score_linear":82014.0,"score_lmetric":103961},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28796,"ongoing_decode_tokens":28796,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":12800,"new_prefill":9147,"score_linear":15996.0,"score_lmetric":9147},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":21947,"score_linear":114612.0,"score_lmetric":21947},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":138850,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":21947,"score_linear":138850.0,"score_lmetric":43894},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":88101,"ongoing_decode_tokens":133021,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":21947,"score_linear":88101.0,"score_lmetric":24777}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386928.21771058,"t_first_token_unix":1779817793.2316546,"t_done":386928.875327493,"t_done_unix":1779817793.8892708},{"request_id":"1266668:9:1295576:231","session_id":"1266668","input_length":96717,"t_proxy_recv":386929.417439273,"t_decision_unix":1779817794.4313807,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9899397210418024,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":973,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":4096,"new_prefill":92621,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":96717,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":96717,"score_linear":82014.0,"score_lmetric":178731},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":7680,"new_prefill":89037,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":96717,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":96717,"score_linear":114612.0,"score_lmetric":96717},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":0,"pending_prefill_tokens":7672,"num_requests":1,"active_p_offloads":0,"cached_blocks":714,"cache_hit":95744,"new_prefill":973,"score_linear":-45064.0,"score_lmetric":8645},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":40278,"ongoing_decode_tokens":85198,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":619,"cache_hit":7680,"new_prefill":89037,"score_linear":32598.0,"score_lmetric":75349}],"chosen_score_linear":-45064.0,"chosen_score_lmetric":8645,"t_first_token":386931.146101602,"t_first_token_unix":1779817796.160045,"t_done":386931.566723531,"t_done_unix":1779817796.580668},{"request_id":"1295690:1:1295690:232","session_id":"1295690","input_length":10857,"t_proxy_recv":386929.750848563,"t_decision_unix":1779817794.76479,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-2831,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":10857,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":10857,"score_linear":82014.0,"score_lmetric":92871},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":10857,"score_linear":114612.0,"score_lmetric":10857},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":147397,"ongoing_decode_tokens":0,"pending_prefill_tokens":8645,"num_requests":2,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":10857,"score_linear":147397.0,"score_lmetric":39004},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":40278,"ongoing_decode_tokens":85198,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":619,"cache_hit":0,"new_prefill":10857,"score_linear":40278.0,"score_lmetric":-2831}],"chosen_score_linear":40278.0,"chosen_score_lmetric":-2831,"t_first_token":386930.637847456,"t_first_token_unix":1779817795.6517913,"t_done":386931.806701817,"t_done_unix":1779817796.8206449},{"request_id":"1294611:2:1295852:233","session_id":"1294611","input_length":23610,"t_proxy_recv":386930.255504078,"t_decision_unix":1779817795.2694457,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9324862346463363,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":1594,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":23610,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":22016,"new_prefill":1594,"score_linear":-22016.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":23610,"score_linear":82014.0,"score_lmetric":105624},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":12800,"new_prefill":10810,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":23610,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":23610,"score_linear":114612.0,"score_lmetric":23610},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":147397,"ongoing_decode_tokens":0,"pending_prefill_tokens":8645,"num_requests":2,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":23610,"score_linear":147397.0,"score_lmetric":64510},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":51135,"ongoing_decode_tokens":85198,"pending_prefill_tokens":-2831,"num_requests":2,"active_p_offloads":0,"cached_blocks":619,"cache_hit":0,"new_prefill":23610,"score_linear":51135.0,"score_lmetric":41558}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":386930.650327267,"t_first_token_unix":1779817795.6642706,"t_done":386932.00108418,"t_done_unix":1779817797.0150275},{"request_id":"1279412:6:1293655:225","session_id":"1279412","input_length":40278,"t_proxy_recv":386922.882186027,"t_decision_unix":1779817787.8961272,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":32256,"affinity_cache_ratio":0.8008342022940563,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":8022,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":40278,"score_linear":24482.0,"score_lmetric":40278},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":40278,"score_linear":82014.0,"score_lmetric":122292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":233348,"ongoing_decode_tokens":233348,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":330,"cache_hit":0,"new_prefill":40278,"score_linear":233348.0,"score_lmetric":80556},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":138850,"ongoing_decode_tokens":42745,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":40278,"score_linear":138850.0,"score_lmetric":96638},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9032,"ongoing_decode_tokens":53952,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":595,"cache_hit":32256,"new_prefill":8022,"score_linear":-23224.0,"score_lmetric":-11332}],"chosen_score_linear":-23224.0,"chosen_score_lmetric":-11332,"t_first_token":386924.905444308,"t_first_token_unix":1779817789.9193878,"t_done":386932.217036997,"t_done_unix":1779817797.2309804},{"request_id":"1289570:1:1289570:204","session_id":"1289570","input_length":82014,"t_proxy_recv":386909.095170873,"t_decision_unix":1779817774.109112,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":82014,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":0,"new_prefill":82014,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":82014,"score_linear":77805.0,"score_lmetric":159819},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":82014,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":104111,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":0,"new_prefill":82014,"score_linear":104111.0,"score_lmetric":164028},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":8074,"num_requests":1,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":82014,"score_linear":9610.0,"score_lmetric":90088},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":82014,"score_linear":232709.0,"score_lmetric":164028},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":0,"new_prefill":82014,"score_linear":118843.0,"score_lmetric":164028},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32191,"ongoing_decode_tokens":0,"pending_prefill_tokens":447,"num_requests":1,"active_p_offloads":0,"cached_blocks":550,"cache_hit":0,"new_prefill":82014,"score_linear":32191.0,"score_lmetric":82461}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386931.786598206,"t_first_token_unix":1779817796.8005419,"t_done":386932.303221154,"t_done_unix":1779817797.317165},{"request_id":"1275274:1:1275274:136","session_id":"1275274","input_length":114612,"t_proxy_recv":386859.628587515,"t_decision_unix":1779817724.642529,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":114612,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":114612,"score_linear":135235.0,"score_lmetric":455662},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":120167,"ongoing_decode_tokens":0,"pending_prefill_tokens":106343,"num_requests":2,"active_p_offloads":0,"cached_blocks":285,"cache_hit":0,"new_prefill":114612,"score_linear":120167.0,"score_lmetric":441910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":114612,"score_linear":150574.0,"score_lmetric":464836},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121069,"ongoing_decode_tokens":27639,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":283,"cache_hit":0,"new_prefill":114612,"score_linear":121069.0,"score_lmetric":416084},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":370,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386901.945314098,"t_first_token_unix":1779817766.9592576,"t_done":386933.401163872,"t_done_unix":1779817798.4151127},{"request_id":"1296872:1:1296872:235","session_id":"1296872","input_length":624,"t_proxy_recv":386933.814533035,"t_decision_unix":1779817798.8284743,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-13064,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":624,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":624,"score_linear":50680.0,"score_lmetric":624},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":80589,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":656,"cache_hit":0,"new_prefill":624,"score_linear":35669.0,"score_lmetric":-13064}],"chosen_score_linear":35669.0,"chosen_score_lmetric":-13064,"t_first_token":386933.970774731,"t_first_token_unix":1779817798.9847183,"t_done":386934.202405555,"t_done_unix":1779817799.2163496},{"request_id":"1296983:1:1296983:236","session_id":"1296983","input_length":1791,"t_proxy_recv":386934.249344797,"t_decision_unix":1779817799.2632859,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-11897,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1791,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":1791,"score_linear":50680.0,"score_lmetric":1791},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":80589,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":657,"cache_hit":0,"new_prefill":1791,"score_linear":35669.0,"score_lmetric":-11897}],"chosen_score_linear":35669.0,"chosen_score_lmetric":-11897,"t_first_token":386934.44765428,"t_first_token_unix":1779817799.4615977,"t_done":386934.942323654,"t_done_unix":1779817799.9562666},{"request_id":"1269373:8:1295332:230","session_id":"1269373","input_length":50680,"t_proxy_recv":386928.400162226,"t_decision_unix":1779817793.414103,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":43008,"affinity_cache_ratio":0.8486187845303867,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43008,"estimated_new_tokens":7672,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":4096,"new_prefill":46584,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":21947,"ongoing_decode_tokens":21947,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":698,"cache_hit":0,"new_prefill":50680,"score_linear":21947.0,"score_lmetric":50680},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":50680,"score_linear":82014.0,"score_lmetric":132694},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":7680,"new_prefill":43000,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":50680,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":50680,"score_linear":114612.0,"score_lmetric":50680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":714,"cache_hit":43008,"new_prefill":7672,"score_linear":-43008.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":40278,"ongoing_decode_tokens":85198,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":619,"cache_hit":7680,"new_prefill":43000,"score_linear":32598.0,"score_lmetric":29312}],"chosen_score_linear":-43008.0,"chosen_score_lmetric":0,"t_first_token":386930.736750177,"t_first_token_unix":1779817795.7506933,"t_done":386935.265180869,"t_done_unix":1779817800.2791243},{"request_id":"1272313:9:1297810:243","session_id":"1272313","input_length":29149,"t_proxy_recv":386936.920146662,"t_decision_unix":1779817801.9340885,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9836358022573674,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":12456,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":4096,"new_prefill":25053,"score_linear":9896.0,"score_lmetric":37509},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":29149,"score_linear":23863.0,"score_lmetric":29149},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":29149,"score_linear":62414.0,"score_lmetric":72619},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":28672,"new_prefill":477,"score_linear":-28672.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":29149,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":29149,"score_linear":59507.0,"score_lmetric":88656},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":730,"cache_hit":10752,"new_prefill":18397,"score_linear":86393.0,"score_lmetric":18397},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":7680,"new_prefill":21469,"score_linear":130545.0,"score_lmetric":83715}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":386937.012109466,"t_first_token_unix":1779817802.026053,"t_done":386937.925170273,"t_done_unix":1779817802.9391134},{"request_id":"1294611:3:1297534:240","session_id":"1294611","input_length":23863,"t_proxy_recv":386936.092925482,"t_decision_unix":1779817801.1068666,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9869672715081926,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":23863,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":23552,"new_prefill":311,"score_linear":-23552.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":23863,"score_linear":62414.0,"score_lmetric":67333},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":12800,"new_prefill":11063,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":23863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":23863,"score_linear":59507.0,"score_lmetric":83370},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":23863,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":95862,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6057,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":23863,"score_linear":95862.0,"score_lmetric":59840}],"chosen_score_linear":-23552.0,"chosen_score_lmetric":0,"t_first_token":386936.155562122,"t_first_token_unix":1779817801.1695054,"t_done":386939.1907068,"t_done_unix":1779817804.2046504},{"request_id":"1297811:1:1297811:244","session_id":"1297811","input_length":13992,"t_proxy_recv":386936.916904794,"t_decision_unix":1779817801.9308462,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":12456,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":1536,"new_prefill":12456,"score_linear":-1536.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":13992,"score_linear":23863.0,"score_lmetric":13992},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":13992,"score_linear":62414.0,"score_lmetric":57462},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":13992,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":13992,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":13992,"score_linear":59507.0,"score_lmetric":73499},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":13992,"score_linear":97145.0,"score_lmetric":13992},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":13992,"score_linear":138225.0,"score_lmetric":61284}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":386938.06395082,"t_first_token_unix":1779817803.0778942,"t_done":386939.338029085,"t_done_unix":1779817804.3519726},{"request_id":"1266668:10:1297641:241","session_id":"1266668","input_length":97145,"t_proxy_recv":386936.366299356,"t_decision_unix":1779817801.3802385,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":96256,"affinity_cache_ratio":0.9908487312779866,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":96256,"estimated_new_tokens":889,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":4096,"new_prefill":93049,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":97145,"score_linear":23863.0,"score_lmetric":97145},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":97145,"score_linear":62414.0,"score_lmetric":140615},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":7680,"new_prefill":89465,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":97145,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":97145,"score_linear":59507.0,"score_lmetric":156652},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":730,"cache_hit":96256,"new_prefill":889,"score_linear":-96256.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":95862,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6057,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":7680,"new_prefill":89465,"score_linear":88182.0,"score_lmetric":191044}],"chosen_score_linear":-96256.0,"chosen_score_lmetric":0,"t_first_token":386936.857849288,"t_first_token_unix":1779817801.8717933,"t_done":386939.575888094,"t_done_unix":1779817804.5898316},{"request_id":"1290442:2:1298058:246","session_id":"1290442","input_length":11994,"t_proxy_recv":386937.786710945,"t_decision_unix":1779817802.8006523,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7168,"affinity_cache_ratio":0.5976321494080373,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":4826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":12456,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":11994,"score_linear":13992.0,"score_lmetric":24450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":11994,"score_linear":23863.0,"score_lmetric":11994},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":11994,"score_linear":62414.0,"score_lmetric":55464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29149,"ongoing_decode_tokens":29149,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":11994,"score_linear":29149.0,"score_lmetric":11994},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21630,"ongoing_decode_tokens":0,"pending_prefill_tokens":8830,"num_requests":1,"active_p_offloads":0,"cached_blocks":531,"cache_hit":7168,"new_prefill":4826,"score_linear":14462.0,"score_lmetric":13656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":11994,"score_linear":59507.0,"score_lmetric":71501},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":11994,"score_linear":97145.0,"score_lmetric":11994},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":11994,"score_linear":138225.0,"score_lmetric":55290}],"chosen_score_linear":14462.0,"chosen_score_lmetric":13656,"t_first_token":386939.490331497,"t_first_token_unix":1779817804.5042744,"t_done":386939.59068278,"t_done_unix":1779817804.604626},{"request_id":"1290365:4:1298540:247","session_id":"1290365","input_length":25103,"t_proxy_recv":386939.493031791,"t_decision_unix":1779817804.5069735,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24576,"affinity_cache_ratio":0.979006493247819,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":527,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":517,"cache_hit":24576,"new_prefill":527,"score_linear":-24576.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":745,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":25103,"score_linear":62414.0,"score_lmetric":68573},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":33624,"ongoing_decode_tokens":33624,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":25103,"score_linear":33624.0,"score_lmetric":50206},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":25103,"score_linear":59507.0,"score_lmetric":84610},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":25103,"score_linear":97145.0,"score_lmetric":25103},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":25103,"score_linear":138225.0,"score_lmetric":94617}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":386939.613142015,"t_first_token_unix":1779817804.627085,"t_done":386940.661104137,"t_done_unix":1779817805.6750474},{"request_id":"1268861:3:1298057:245","session_id":"1268861","input_length":21630,"t_proxy_recv":386937.772430782,"t_decision_unix":1779817802.7863722,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":12800,"affinity_cache_ratio":0.5917706888580675,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":8830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":12456,"num_requests":1,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":21630,"score_linear":13992.0,"score_lmetric":34086},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":21630,"score_linear":23863.0,"score_lmetric":21630},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":21630,"score_linear":62414.0,"score_lmetric":65100},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29149,"ongoing_decode_tokens":29149,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":21630,"score_linear":29149.0,"score_lmetric":21630},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":12800,"new_prefill":8830,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":21630,"score_linear":59507.0,"score_lmetric":81137},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":21630,"score_linear":97145.0,"score_lmetric":21630},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":21630,"score_linear":138225.0,"score_lmetric":84198}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":386939.488349362,"t_first_token_unix":1779817804.502293,"t_done":386941.638962636,"t_done_unix":1779817806.652906},{"request_id":"1298970:1:1298970:248","session_id":"1298970","input_length":9530,"t_proxy_recv":386941.055048529,"t_decision_unix":1779817806.06899,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":745,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":9530,"score_linear":62414.0,"score_lmetric":53000},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21630,"ongoing_decode_tokens":21630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":9530,"score_linear":21630.0,"score_lmetric":9530},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":9530,"score_linear":59507.0,"score_lmetric":69037},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":9530,"score_linear":138225.0,"score_lmetric":47898}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386941.815835371,"t_first_token_unix":1779817806.829779,"t_done":386941.997776345,"t_done_unix":1779817807.01172},{"request_id":"1262354:15:1296106:234","session_id":"1262354","input_length":35669,"t_proxy_recv":386931.208761706,"t_decision_unix":1779817796.2227027,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9904398777650061,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":341,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23610,"ongoing_decode_tokens":23610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":35669,"score_linear":23610.0,"score_lmetric":35669},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":35669,"score_linear":82014.0,"score_lmetric":117683},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":331,"cache_hit":0,"new_prefill":35669,"score_linear":114612.0,"score_lmetric":35669},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":147397,"ongoing_decode_tokens":147397,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":714,"cache_hit":0,"new_prefill":35669,"score_linear":147397.0,"score_lmetric":71338},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":51135,"ongoing_decode_tokens":96055,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":619,"cache_hit":35328,"new_prefill":341,"score_linear":15807.0,"score_lmetric":-26694}],"chosen_score_linear":15807.0,"chosen_score_lmetric":-26694,"t_first_token":386931.30215198,"t_first_token_unix":1779817796.316096,"t_done":386942.165968817,"t_done_unix":1779817807.179912},{"request_id":"1299073:1:1299073:249","session_id":"1299073","input_length":881,"t_proxy_recv":386941.413727922,"t_decision_unix":1779817806.4276693,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":881,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":745,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":881,"score_linear":62414.0,"score_lmetric":44351},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9530,"ongoing_decode_tokens":0,"pending_prefill_tokens":9530,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":881,"score_linear":9530.0,"score_lmetric":10411},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21630,"ongoing_decode_tokens":21630,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":881,"score_linear":21630.0,"score_lmetric":881},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":881,"score_linear":59507.0,"score_lmetric":60388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":138225,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6436,"num_requests":3,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":881,"score_linear":138225.0,"score_lmetric":21951}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386941.496455033,"t_first_token_unix":1779817806.5103984,"t_done":386942.605403304,"t_done_unix":1779817807.6193466},{"request_id":"1260327:7:1297673:242","session_id":"1260327","input_length":42363,"t_proxy_recv":386936.455266614,"t_decision_unix":1779817801.469208,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.99105351367939,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":379,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":42363,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":42363,"score_linear":23863.0,"score_lmetric":42363},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":42363,"score_linear":62414.0,"score_lmetric":85833},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":42363,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":42363,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":42363,"score_linear":59507.0,"score_lmetric":101870},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":0,"pending_prefill_tokens":889,"num_requests":1,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":42363,"score_linear":97145.0,"score_lmetric":43252},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":95862,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6057,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":41984,"new_prefill":379,"score_linear":53878.0,"score_lmetric":12872}],"chosen_score_linear":53878.0,"chosen_score_lmetric":12872,"t_first_token":386941.834692436,"t_first_token_unix":1779817806.8486357,"t_done":386942.914931771,"t_done_unix":1779817807.9288752},{"request_id":"1296872:2:1299394:251","session_id":"1296872","input_length":8352,"t_proxy_recv":386942.352680144,"t_decision_unix":1779817807.3666217,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":0,"affinity_cache_hit":512,"affinity_cache_ratio":0.06130268199233716,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8352,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":745,"cache_hit":0,"new_prefill":8352,"score_linear":881.0,"score_lmetric":8352},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":8352,"score_linear":62414.0,"score_lmetric":51822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":8352,"score_linear":59507.0,"score_lmetric":67859},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":110519,"ongoing_decode_tokens":147476,"pending_prefill_tokens":-7261,"num_requests":3,"active_p_offloads":0,"cached_blocks":661,"cache_hit":512,"new_prefill":7840,"score_linear":110007.0,"score_lmetric":1737}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386942.968427392,"t_first_token_unix":1779817807.9823718,"t_done":386943.094518225,"t_done_unix":1779817808.1084616},{"request_id":"1296983:2:1299368:250","session_id":"1296983","input_length":7963,"t_proxy_recv":386942.239568218,"t_decision_unix":1779817807.25351,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":1536,"affinity_cache_ratio":0.1928921260831345,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":-14522,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":6427,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":745,"cache_hit":0,"new_prefill":7963,"score_linear":881.0,"score_lmetric":7963},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":7963,"score_linear":62414.0,"score_lmetric":51433},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":7963,"score_linear":59507.0,"score_lmetric":67470},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":102556,"ongoing_decode_tokens":147476,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":661,"cache_hit":1536,"new_prefill":6427,"score_linear":101020.0,"score_lmetric":-14522}],"chosen_score_linear":101020.0,"chosen_score_lmetric":-14522,"t_first_token":386942.733240596,"t_first_token_unix":1779817807.7471843,"t_done":386943.336635176,"t_done_unix":1779817808.350579},{"request_id":"1292750:2:1299406:252","session_id":"1292750","input_length":19157,"t_proxy_recv":386942.392615342,"t_decision_unix":1779817807.4065566,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":3,"affinity_cache_hit":4608,"affinity_cache_ratio":0.24053870647804979,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":8352,"num_requests":1,"active_p_offloads":0,"cached_blocks":518,"cache_hit":4608,"new_prefill":14549,"score_linear":3744.0,"score_lmetric":22901},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":745,"cache_hit":0,"new_prefill":19157,"score_linear":881.0,"score_lmetric":19157},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":19157,"score_linear":62414.0,"score_lmetric":62627},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":19157,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":19157,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":19157,"score_linear":59507.0,"score_lmetric":78664},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":19157,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":110519,"ongoing_decode_tokens":147476,"pending_prefill_tokens":-7261,"num_requests":3,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":19157,"score_linear":110519.0,"score_lmetric":35688}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386944.321532413,"t_first_token_unix":1779817809.3354764,"t_done":386944.517115281,"t_done_unix":1779817809.5310588},{"request_id":"1279412:7:1297236:238","session_id":"1279412","input_length":60193,"t_proxy_recv":386935.25176607,"t_decision_unix":1779817800.2657073,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40448,"affinity_cache_ratio":0.6719718239662419,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":19745,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":60193,"score_linear":59507.0,"score_lmetric":119700},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":60193,"score_linear":50680.0,"score_lmetric":60193},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":35669,"ongoing_decode_tokens":80589,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":660,"cache_hit":40448,"new_prefill":19745,"score_linear":-4779.0,"score_lmetric":6057}],"chosen_score_linear":-4779.0,"chosen_score_lmetric":6057,"t_first_token":386941.829586684,"t_first_token_unix":1779817806.84353,"t_done":386945.265995994,"t_done_unix":1779817810.2799394},{"request_id":"1272313:10:1299814:254","session_id":"1272313","input_length":29486,"t_proxy_recv":386943.772328208,"t_decision_unix":1779817808.7862694,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9897578511836126,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":534,"cache_hit":4096,"new_prefill":25390,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":29486,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":29486,"score_linear":62414.0,"score_lmetric":72956},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":29184,"new_prefill":302,"score_linear":-10027.0,"score_lmetric":19459},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":29486,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":29486,"score_linear":59507.0,"score_lmetric":88993},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":0,"pending_prefill_tokens":7117,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":10752,"new_prefill":18734,"score_linear":8141.0,"score_lmetric":25851},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60193,"ongoing_decode_tokens":105113,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":673,"cache_hit":7680,"new_prefill":21806,"score_linear":52513.0,"score_lmetric":8118}],"chosen_score_linear":-10027.0,"chosen_score_lmetric":19459,"t_first_token":386944.398824667,"t_first_token_unix":1779817809.4127688,"t_done":386945.874213319,"t_done_unix":1779817810.888157},{"request_id":"1286804:2:1300234:256","session_id":"1286804","input_length":14213,"t_proxy_recv":386945.21979415,"t_decision_unix":1779817810.2337353,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":13824,"affinity_cache_ratio":0.9726306902131852,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":534,"cache_hit":13824,"new_prefill":389,"score_linear":-13824.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":14213,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":14213,"score_linear":62414.0,"score_lmetric":57683},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29486,"ongoing_decode_tokens":29486,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":854,"cache_hit":0,"new_prefill":14213,"score_linear":29486.0,"score_lmetric":14213},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":14213,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":14213,"score_linear":59507.0,"score_lmetric":73720},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":14213,"score_linear":18893.0,"score_lmetric":14213},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60193,"ongoing_decode_tokens":105113,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":673,"cache_hit":0,"new_prefill":14213,"score_linear":60193.0,"score_lmetric":525}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":386945.287475446,"t_first_token_unix":1779817810.3014188,"t_done":386945.915428894,"t_done_unix":1779817810.929372},{"request_id":"1294611:4:1300505:257","session_id":"1294611","input_length":24384,"t_proxy_recv":386946.23861209,"t_decision_unix":1779817811.2525454,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9868766404199475,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":24384,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":24064,"new_prefill":320,"score_linear":-24064.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":24384,"score_linear":62414.0,"score_lmetric":67854},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":12800,"new_prefill":11584,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":24384,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":24384,"score_linear":59507.0,"score_lmetric":83891},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":24384,"score_linear":18893.0,"score_lmetric":24384},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60678,"ongoing_decode_tokens":105598,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":24384,"score_linear":60678.0,"score_lmetric":10696}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":386946.296480396,"t_first_token_unix":1779817811.3104236,"t_done":386946.655483105,"t_done_unix":1779817811.6694267},{"request_id":"1279412:8:1300001:255","session_id":"1279412","input_length":60678,"t_proxy_recv":386945.277459659,"t_decision_unix":1779817810.2913997,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60416,"affinity_cache_ratio":0.9956821253172484,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":262,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14213,"ongoing_decode_tokens":0,"pending_prefill_tokens":389,"num_requests":1,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":60678,"score_linear":14213.0,"score_lmetric":61067},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":60678,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":60678,"score_linear":62414.0,"score_lmetric":104148},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29486,"ongoing_decode_tokens":29486,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":854,"cache_hit":0,"new_prefill":60678,"score_linear":29486.0,"score_lmetric":60678},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":60678,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":60678,"score_linear":59507.0,"score_lmetric":120185},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":60678,"score_linear":18893.0,"score_lmetric":60678},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":712,"cache_hit":60416,"new_prefill":262,"score_linear":-60416.0,"score_lmetric":0}],"chosen_score_linear":-60416.0,"chosen_score_lmetric":0,"t_first_token":386945.485803557,"t_first_token_unix":1779817810.499747,"t_done":386947.937601409,"t_done_unix":1779817812.9515448},{"request_id":"1297473:1:1297473:239","session_id":"1297473","input_length":62414,"t_proxy_recv":386935.991378946,"t_decision_unix":1779817801.0053205,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":43470,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":18944,"new_prefill":43470,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":62414,"score_linear":59507.0,"score_lmetric":121921},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":730,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":95862,"ongoing_decode_tokens":80589,"pending_prefill_tokens":6057,"num_requests":2,"active_p_offloads":0,"cached_blocks":660,"cache_hit":0,"new_prefill":62414,"score_linear":95862.0,"score_lmetric":136942}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":386948.06937891,"t_first_token_unix":1779817813.083322,"t_done":386948.393535382,"t_done_unix":1779817813.4074788},{"request_id":"1297117:1:1297117:237","session_id":"1297117","input_length":59507,"t_proxy_recv":386934.72813667,"t_decision_unix":1779817799.7420776,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":59507,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":744,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":531,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50680,"ongoing_decode_tokens":50680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":715,"cache_hit":0,"new_prefill":59507,"score_linear":50680.0,"score_lmetric":59507},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37460,"ongoing_decode_tokens":82380,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":657,"cache_hit":0,"new_prefill":59507,"score_linear":37460.0,"score_lmetric":91638}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386947.367048088,"t_first_token_unix":1779817812.3809917,"t_done":386949.137310279,"t_done_unix":1779817814.1512582},{"request_id":"1294611:5:1301356:262","session_id":"1294611","input_length":25650,"t_proxy_recv":386949.059428473,"t_decision_unix":1779817814.0733693,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9381676413255361,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":1586,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":25650,"score_linear":69555.0,"score_lmetric":112586},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":24064,"new_prefill":1586,"score_linear":-24064.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":25650,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":12800,"new_prefill":12850,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":25650,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":59507,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":25650,"score_linear":59507.0,"score_lmetric":25650},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":116704,"pending_prefill_tokens":3763,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":25650,"score_linear":171155.0,"score_lmetric":88239},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":25650,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":386949.350379198,"t_first_token_unix":1779817814.3643234,"t_done":386949.650978129,"t_done_unix":1779817814.6649213},{"request_id":"1302071:1:1302071:267","session_id":"1302071","input_length":6527,"t_proxy_recv":386951.789720246,"t_decision_unix":1779817816.803662,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-7161,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":6527,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":6527,"score_linear":69555.0,"score_lmetric":74340},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":6527,"score_linear":26441.0,"score_lmetric":32968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":6527,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":6527,"score_linear":28972.0,"score_lmetric":35499},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":6527,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":6527,"score_linear":34706.0,"score_lmetric":41233},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":6527,"score_linear":171155.0,"score_lmetric":19581},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":88101,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":6527,"score_linear":43181.0,"score_lmetric":-7161}],"chosen_score_linear":43181.0,"chosen_score_lmetric":-7161,"t_first_token":386952.238700697,"t_first_token_unix":1779817817.252644,"t_done":386952.817035335,"t_done_unix":1779817817.8309789},{"request_id":"1277909:3:1289205:201","session_id":"1277909","input_length":44920,"t_proxy_recv":386907.797337223,"t_decision_unix":1779817772.8112774,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.6952804986642921,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":13688,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":436,"cache_hit":4096,"new_prefill":40824,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":546,"cache_hit":0,"new_prefill":44920,"score_linear":77805.0,"score_lmetric":122725},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":695,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":104111,"ongoing_decode_tokens":89226,"pending_prefill_tokens":1061,"num_requests":2,"active_p_offloads":0,"cached_blocks":767,"cache_hit":7680,"new_prefill":37240,"score_linear":96431.0,"score_lmetric":76602},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":232709,"ongoing_decode_tokens":232709,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":321,"cache_hit":0,"new_prefill":44920,"score_linear":232709.0,"score_lmetric":89840},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":118843,"ongoing_decode_tokens":118843,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":617,"cache_hit":7680,"new_prefill":37240,"score_linear":111163.0,"score_lmetric":74480},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":550,"cache_hit":31232,"new_prefill":13688,"score_linear":-31232.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":386911.343091966,"t_first_token_unix":1779817776.357036,"t_done":386952.96340445,"t_done_unix":1779817817.9773479},{"request_id":"1302449:1:1302449:269","session_id":"1302449","input_length":1105,"t_proxy_recv":386953.314140134,"t_decision_unix":1779817818.3280816,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1105,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":1105,"score_linear":69555.0,"score_lmetric":2210},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":1105,"score_linear":26441.0,"score_lmetric":27546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":1105,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":78827,"ongoing_decode_tokens":0,"pending_prefill_tokens":29163,"num_requests":2,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":1105,"score_linear":78827.0,"score_lmetric":60536},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":1105,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":1105,"score_linear":34706.0,"score_lmetric":35811},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":1105,"score_linear":171155.0,"score_lmetric":3315},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":752,"cache_hit":0,"new_prefill":1105,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386953.436106298,"t_first_token_unix":1779817818.45005,"t_done":386953.87185263,"t_done_unix":1779817818.8857956},{"request_id":"1266668:11:1300918:260","session_id":"1266668","input_length":97811,"t_proxy_recv":386947.772332976,"t_decision_unix":1779817812.7862742,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9945711627526557,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":4096,"new_prefill":93715,"score_linear":65459.0,"score_lmetric":248716},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":97811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":97811,"score_linear":62414.0,"score_lmetric":141281},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":7680,"new_prefill":90131,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":97811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":59507,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":97811,"score_linear":59507.0,"score_lmetric":97811},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":97280,"new_prefill":531,"score_linear":-78387.0,"score_lmetric":531},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60678,"ongoing_decode_tokens":105598,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":7680,"new_prefill":90131,"score_linear":52998.0,"score_lmetric":76443}],"chosen_score_linear":-78387.0,"chosen_score_lmetric":531,"t_first_token":386948.269483018,"t_first_token_unix":1779817813.2834265,"t_done":386955.477665788,"t_done_unix":1779817820.4916096},{"request_id":"1290365:5:1300807:259","session_id":"1290365","input_length":25948,"t_proxy_recv":386947.415775048,"t_decision_unix":1779817812.429716,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9668567905040851,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":860,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":29783,"num_requests":1,"active_p_offloads":0,"cached_blocks":534,"cache_hit":25088,"new_prefill":860,"score_linear":18519.0,"score_lmetric":30643},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":25948,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":25948,"score_linear":62414.0,"score_lmetric":69418},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":25948,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":25948,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":59507,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":25948,"score_linear":59507.0,"score_lmetric":25948},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":25948,"score_linear":18893.0,"score_lmetric":25948},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60678,"ongoing_decode_tokens":105598,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":25948,"score_linear":60678.0,"score_lmetric":12260}],"chosen_score_linear":18519.0,"chosen_score_lmetric":30643,"t_first_token":386952.875623297,"t_first_token_unix":1779817817.8895662,"t_done":386955.896853213,"t_done_unix":1779817820.9107966},{"request_id":"1299507:1:1299507:253","session_id":"1299507","input_length":18893,"t_proxy_recv":386942.65339559,"t_decision_unix":1779817807.6673372,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":7117,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":8352,"num_requests":1,"active_p_offloads":0,"cached_blocks":518,"cache_hit":0,"new_prefill":18893,"score_linear":8352.0,"score_lmetric":27245},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":18893,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":18893,"score_linear":62414.0,"score_lmetric":62363},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":817,"cache_hit":0,"new_prefill":18893,"score_linear":19157.0,"score_lmetric":38050},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":18893,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":18893,"score_linear":59507.0,"score_lmetric":78400},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":732,"cache_hit":11776,"new_prefill":7117,"score_linear":-11776.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":110519,"ongoing_decode_tokens":147476,"pending_prefill_tokens":-7261,"num_requests":3,"active_p_offloads":0,"cached_blocks":661,"cache_hit":0,"new_prefill":18893,"score_linear":110519.0,"score_lmetric":34896}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":386944.571316795,"t_first_token_unix":1779817809.5852604,"t_done":386956.249627764,"t_done_unix":1779817821.263571},{"request_id":"1302063:1:1302063:266","session_id":"1302063","input_length":26441,"t_proxy_recv":386951.78675403,"t_decision_unix":1779817816.8006952,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":26441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":26441,"score_linear":69555.0,"score_lmetric":114168},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":26441,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":26441,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":26441,"score_linear":28972.0,"score_lmetric":55413},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":26441,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":26441,"score_linear":34706.0,"score_lmetric":61147},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":26441,"score_linear":171155.0,"score_lmetric":79323},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":88101,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":26441,"score_linear":43181.0,"score_lmetric":12753}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386955.044752042,"t_first_token_unix":1779817820.0586958,"t_done":386956.341868864,"t_done_unix":1779817821.3558118},{"request_id":"1302907:1:1302907:272","session_id":"1302907","input_length":15958,"t_proxy_recv":386954.681587525,"t_decision_unix":1779817819.695529,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15958,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":15958,"score_linear":69555.0,"score_lmetric":31916},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":57086,"ongoing_decode_tokens":0,"pending_prefill_tokens":31486,"num_requests":2,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":15958,"score_linear":57086.0,"score_lmetric":94888},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":15958,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":15958,"score_linear":108775.0,"score_lmetric":49203},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":559,"cache_hit":0,"new_prefill":15958,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":15958,"score_linear":34706.0,"score_lmetric":50664},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":15958,"score_linear":171155.0,"score_lmetric":47874},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":752,"cache_hit":0,"new_prefill":15958,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":-1739.0,"chosen_score_lmetric":0,"t_first_token":386956.152933532,"t_first_token_unix":1779817821.166877,"t_done":386956.456146436,"t_done_unix":1779817821.4700897},{"request_id":"1302449:2:1303563:277","session_id":"1302449","input_length":3709,"t_proxy_recv":386957.008094099,"t_decision_unix":1779817822.0220354,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":7,"affinity_cache_hit":1024,"affinity_cache_ratio":0.27608519816662175,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3709,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":3709,"score_linear":43607.0,"score_lmetric":3709},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":3709,"score_linear":30645.0,"score_lmetric":3709},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":3709,"score_linear":14944.0,"score_lmetric":18653},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":3709,"score_linear":108775.0,"score_lmetric":12456},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":559,"cache_hit":1024,"new_prefill":2685,"score_linear":14057.0,"score_lmetric":17766},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":3709,"score_linear":34706.0,"score_lmetric":3709},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":3709,"score_linear":176419.0,"score_lmetric":55770},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":783,"cache_hit":0,"new_prefill":3709,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":-1739.0,"chosen_score_lmetric":0,"t_first_token":386957.275695843,"t_first_token_unix":1779817822.2896392,"t_done":386957.896153884,"t_done_unix":1779817822.9100974},{"request_id":"1303651:1:1303651:278","session_id":"1303651","input_length":3065,"t_proxy_recv":386957.312058085,"t_decision_unix":1779817822.3259993,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":-10623,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3065,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":3065,"score_linear":43607.0,"score_lmetric":3065},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":3065,"score_linear":30645.0,"score_lmetric":3065},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":3065,"score_linear":14944.0,"score_lmetric":18009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":3065,"score_linear":108775.0,"score_lmetric":10524},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":559,"cache_hit":0,"new_prefill":3065,"score_linear":15081.0,"score_lmetric":18146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":3065,"score_linear":34706.0,"score_lmetric":3065},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":3065,"score_linear":176419.0,"score_lmetric":54482},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":1970,"ongoing_decode_tokens":46890,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":783,"cache_hit":0,"new_prefill":3065,"score_linear":1970.0,"score_lmetric":-10623}],"chosen_score_linear":1970.0,"chosen_score_lmetric":-10623,"t_first_token":386957.553680499,"t_first_token_unix":1779817822.567624,"t_done":386957.972149167,"t_done_unix":1779817822.986093},{"request_id":"1303462:1:1303462:274","session_id":"1303462","input_length":14944,"t_proxy_recv":386956.712450094,"t_decision_unix":1779817821.7263916,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":14944,"score_linear":43607.0,"score_lmetric":14944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":14944,"score_linear":30645.0,"score_lmetric":14944},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":14944,"score_linear":108775.0,"score_lmetric":46161},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":559,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":14944,"score_linear":34706.0,"score_lmetric":14944},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":14944,"score_linear":54451.0,"score_lmetric":14944},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":783,"cache_hit":0,"new_prefill":14944,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386958.037756177,"t_first_token_unix":1779817823.0516994,"t_done":386958.329908842,"t_done_unix":1779817823.3438532},{"request_id":"1260327:8:1301686:263","session_id":"1260327","input_length":43181,"t_proxy_recv":386950.260814114,"t_decision_unix":1779817815.2747552,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9722794747689957,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":1197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":43181,"score_linear":69555.0,"score_lmetric":147648},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":43181,"score_linear":171155.0,"score_lmetric":129543},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":712,"cache_hit":41984,"new_prefill":1197,"score_linear":-41984.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":386950.598566691,"t_first_token_unix":1779817815.61251,"t_done":386958.492146255,"t_done_unix":1779817823.506091},{"request_id":"1303517:1:1303517:275","session_id":"1303517","input_length":15081,"t_proxy_recv":386956.877520713,"t_decision_unix":1779817821.8914618,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15081,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":15081,"score_linear":43607.0,"score_lmetric":15081},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":15081,"score_linear":30645.0,"score_lmetric":15081},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":15081,"score_linear":14944.0,"score_lmetric":30025},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":15081,"score_linear":108775.0,"score_lmetric":46572},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":559,"cache_hit":0,"new_prefill":15081,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":15081,"score_linear":34706.0,"score_lmetric":15081},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":15081,"score_linear":54451.0,"score_lmetric":15081},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":783,"cache_hit":0,"new_prefill":15081,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386958.221502001,"t_first_token_unix":1779817823.2354453,"t_done":386958.552960408,"t_done_unix":1779817823.5669036},{"request_id":"1294611:6:1302460:270","session_id":"1294611","input_length":30645,"t_proxy_recv":386953.338887694,"t_decision_unix":1779817818.3528292,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":25600,"affinity_cache_ratio":0.8353728177516724,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":25600,"estimated_new_tokens":5045,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":30645,"score_linear":69555.0,"score_lmetric":61290},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":25600,"new_prefill":5045,"score_linear":841.0,"score_lmetric":31486},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":30645,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":78827,"ongoing_decode_tokens":0,"pending_prefill_tokens":29163,"num_requests":2,"active_p_offloads":0,"cached_blocks":855,"cache_hit":12800,"new_prefill":17845,"score_linear":66027.0,"score_lmetric":94016},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":1105,"ongoing_decode_tokens":0,"pending_prefill_tokens":1105,"num_requests":1,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":30645,"score_linear":1105.0,"score_lmetric":31750},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":30645,"score_linear":34706.0,"score_lmetric":65351},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":30645,"score_linear":171155.0,"score_lmetric":91935},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":752,"cache_hit":0,"new_prefill":30645,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":841.0,"chosen_score_lmetric":31486,"t_first_token":386956.001739328,"t_first_token_unix":1779817821.0156825,"t_done":386959.033897726,"t_done_unix":1779817824.047841},{"request_id":"1302063:2:1303816:279","session_id":"1302063","input_length":30248,"t_proxy_recv":386957.986154342,"t_decision_unix":1779817823.000096,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":26112,"affinity_cache_ratio":0.8632636868553293,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":4136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":30248,"score_linear":43607.0,"score_lmetric":30248},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":26112,"new_prefill":4136,"score_linear":4533.0,"score_lmetric":4136},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":30248,"score_linear":14944.0,"score_lmetric":45192},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":30248,"score_linear":108775.0,"score_lmetric":92073},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":559,"cache_hit":0,"new_prefill":30248,"score_linear":15081.0,"score_lmetric":45329},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":30248,"score_linear":34706.0,"score_lmetric":30248},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":30248,"score_linear":176419.0,"score_lmetric":108848},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":796,"cache_hit":0,"new_prefill":30248,"score_linear":-1739.0,"score_lmetric":0}],"chosen_score_linear":4533.0,"chosen_score_lmetric":4136,"t_first_token":386958.85080846,"t_first_token_unix":1779817823.8647523,"t_done":386959.217228315,"t_done_unix":1779817824.2311716},{"request_id":"1304239:1:1304239:280","session_id":"1304239","input_length":1300,"t_proxy_recv":386959.51181142,"t_decision_unix":1779817824.5257525,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1300,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":1300,"score_linear":43607.0,"score_lmetric":1300},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":1300,"score_linear":108775.0,"score_lmetric":5229},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":588,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":1300,"score_linear":34706.0,"score_lmetric":1300},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":1300,"score_linear":176419.0,"score_lmetric":50952},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":1300,"score_linear":-44920.0,"score_lmetric":12388}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386959.615194614,"t_first_token_unix":1779817824.6291382,"t_done":386959.755306027,"t_done_unix":1779817824.7692494},{"request_id":"1295690:2:1301706:264","session_id":"1295690","input_length":28972,"t_proxy_recv":386950.346920101,"t_decision_unix":1779817815.3608615,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":3,"affinity_cache_hit":10752,"affinity_cache_ratio":0.37111694049427035,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":28972,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":28972,"score_linear":69555.0,"score_lmetric":119230},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":28972,"score_linear":171155.0,"score_lmetric":86916},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":44920,"pending_prefill_tokens":-12491,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":10752,"new_prefill":18220,"score_linear":32429.0,"score_lmetric":5729}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386954.068146002,"t_first_token_unix":1779817819.0820925,"t_done":386962.164083005,"t_done_unix":1779817827.178027},{"request_id":"1304239:2:1304866:281","session_id":"1304239","input_length":7798,"t_proxy_recv":386961.660923106,"t_decision_unix":1779817826.674864,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":1024,"affinity_cache_ratio":0.13131572197999486,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":6774,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":7798,"score_linear":43607.0,"score_lmetric":7798},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":7798,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":7798,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":7798,"score_linear":108775.0,"score_lmetric":24723},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":590,"cache_hit":1024,"new_prefill":6774,"score_linear":-1024.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":7798,"score_linear":34706.0,"score_lmetric":7798},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":7798,"score_linear":176419.0,"score_lmetric":63948},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":7798,"score_linear":-44920.0,"score_lmetric":5890}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":386962.148009361,"t_first_token_unix":1779817827.1619534,"t_done":386962.293058321,"t_done_unix":1779817827.307002},{"request_id":"1304943:1:1304943:283","session_id":"1304943","input_length":2772,"t_proxy_recv":386961.91314348,"t_decision_unix":1779817826.9270844,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2772,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":2772,"score_linear":43607.0,"score_lmetric":2772},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":2772,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":2772,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":108775,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":2772,"score_linear":108775.0,"score_lmetric":8316},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":7798,"ongoing_decode_tokens":0,"pending_prefill_tokens":6774,"num_requests":1,"active_p_offloads":0,"cached_blocks":590,"cache_hit":0,"new_prefill":2772,"score_linear":7798.0,"score_lmetric":9546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":2772,"score_linear":34706.0,"score_lmetric":2772},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":2772,"score_linear":176419.0,"score_lmetric":53896},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":2772,"score_linear":-44920.0,"score_lmetric":10916}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386962.092136942,"t_first_token_unix":1779817827.1060812,"t_done":386962.387446195,"t_done_unix":1779817827.4013903},{"request_id":"1253743:3:1302294:268","session_id":"1253743","input_length":49855,"t_proxy_recv":386952.699348699,"t_decision_unix":1779817817.71329,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.996168889780363,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":191,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":49855,"score_linear":69555.0,"score_lmetric":160996},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":4608,"new_prefill":45247,"score_linear":21833.0,"score_lmetric":71688},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":49855,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":49664,"new_prefill":191,"score_linear":-20692.0,"score_lmetric":29163},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":49855,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":49855,"score_linear":34706.0,"score_lmetric":84561},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":49855,"score_linear":171155.0,"score_lmetric":149565},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":49708,"ongoing_decode_tokens":94628,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":49855,"score_linear":49708.0,"score_lmetric":72334}],"chosen_score_linear":-20692.0,"chosen_score_lmetric":29163,"t_first_token":386961.719363113,"t_first_token_unix":1779817826.7333066,"t_done":386962.565243499,"t_done_unix":1779817827.5791874},{"request_id":"1294611:6:1305080:284","session_id":"1294611","input_length":30995,"t_proxy_recv":386962.425509724,"t_decision_unix":1779817827.4394512,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9911276012260042,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":275,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":30995,"score_linear":43607.0,"score_lmetric":30995},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":30720,"new_prefill":275,"score_linear":-30720.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":30995,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":79803,"ongoing_decode_tokens":79803,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":12800,"new_prefill":18195,"score_linear":67003.0,"score_lmetric":36390},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":30995,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":30995,"score_linear":34706.0,"score_lmetric":30995},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":30995,"score_linear":176419.0,"score_lmetric":110342},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":30995,"score_linear":-44920.0,"score_lmetric":-17307}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":386962.492546623,"t_first_token_unix":1779817827.506491,"t_done":386963.794027208,"t_done_unix":1779817828.807971},{"request_id":"1303651:2:1305707:287","session_id":"1303651","input_length":12795,"t_proxy_recv":386964.860887657,"t_decision_unix":1779817829.8748286,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":2,"affinity_cache_hit":3072,"affinity_cache_ratio":0.24009378663540445,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12795,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":12795,"score_linear":43607.0,"score_lmetric":12795},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":12795,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":12795,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":12795,"score_linear":29948.0,"score_lmetric":12795},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":12795,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":12795,"score_linear":34706.0,"score_lmetric":12795},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":12795,"score_linear":176419.0,"score_lmetric":73942},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":3072,"new_prefill":9723,"score_linear":89125.0,"score_lmetric":72736}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386965.933268131,"t_first_token_unix":1779817830.947212,"t_done":386966.046426989,"t_done_unix":1779817831.06037},{"request_id":"1303462:2:1306126:290","session_id":"1303462","input_length":18631,"t_proxy_recv":386966.082287737,"t_decision_unix":1779817831.096229,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.7969513176963126,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":3783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":18631,"score_linear":43607.0,"score_lmetric":18631},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":14027,"ongoing_decode_tokens":0,"pending_prefill_tokens":14027,"num_requests":1,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":18631,"score_linear":14027.0,"score_lmetric":32658},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":993,"cache_hit":14848,"new_prefill":3783,"score_linear":-14848.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":18631,"score_linear":29948.0,"score_lmetric":18631},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":18631,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":18631,"score_linear":34706.0,"score_lmetric":18631},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":18631,"score_linear":195334.0,"score_lmetric":129870},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":18631,"score_linear":92197.0,"score_lmetric":81644}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":386966.633864572,"t_first_token_unix":1779817831.6478078,"t_done":386966.666434198,"t_done_unix":1779817831.6803772},{"request_id":"1306347:1:1306347:291","session_id":"1306347","input_length":897,"t_proxy_recv":386966.869891464,"t_decision_unix":1779817831.8838332,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":897,"score_linear":43607.0,"score_lmetric":897},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":897,"score_linear":14027.0,"score_lmetric":897},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":897,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":897,"score_linear":29948.0,"score_lmetric":897},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":897,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":897,"score_linear":34706.0,"score_lmetric":897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":897,"score_linear":195334.0,"score_lmetric":76668},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":897,"score_linear":92197.0,"score_lmetric":63910}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386966.951787382,"t_first_token_unix":1779817831.9657307,"t_done":386967.313236043,"t_done_unix":1779817832.3271797},{"request_id":"1305906:1:1305906:289","session_id":"1305906","input_length":14027,"t_proxy_recv":386965.465723446,"t_decision_unix":1779817830.4796648,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14027,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":14027,"score_linear":43607.0,"score_lmetric":14027},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":14027,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":12795,"ongoing_decode_tokens":0,"pending_prefill_tokens":12795,"num_requests":1,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":14027,"score_linear":12795.0,"score_lmetric":26822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":14027,"score_linear":29948.0,"score_lmetric":14027},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":14027,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":14027,"score_linear":34706.0,"score_lmetric":14027},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":14027,"score_linear":195334.0,"score_lmetric":116058},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":14027,"score_linear":92197.0,"score_lmetric":77040}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386966.680593851,"t_first_token_unix":1779817831.6945372,"t_done":386967.711251452,"t_done_unix":1779817832.7251947},{"request_id":"1304239:3:1307007:294","session_id":"1304239","input_length":13840,"t_proxy_recv":386969.223707578,"t_decision_unix":1779817834.2376487,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7680,"affinity_cache_ratio":0.5549132947976878,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6160,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":13840,"score_linear":43607.0,"score_lmetric":13840},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43378,"ongoing_decode_tokens":0,"pending_prefill_tokens":12658,"num_requests":1,"active_p_offloads":0,"cached_blocks":851,"cache_hit":0,"new_prefill":13840,"score_linear":43378.0,"score_lmetric":26498},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":13840,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":61006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":13840,"score_linear":61006.0,"score_lmetric":27680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":604,"cache_hit":7680,"new_prefill":6160,"score_linear":-7680.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":13840,"score_linear":34706.0,"score_lmetric":13840},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":13840,"score_linear":195334.0,"score_lmetric":115497},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":13840,"score_linear":92197.0,"score_lmetric":76853}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":386969.898397888,"t_first_token_unix":1779817834.9123414,"t_done":386970.054151226,"t_done_unix":1779817835.0680945},{"request_id":"1253743:4:1307058:295","session_id":"1253743","input_length":49975,"t_proxy_recv":386969.423708918,"t_decision_unix":1779817834.43765,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9937768884442221,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":49975,"score_linear":43607.0,"score_lmetric":49975},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43378,"ongoing_decode_tokens":0,"pending_prefill_tokens":12658,"num_requests":1,"active_p_offloads":0,"cached_blocks":851,"cache_hit":4608,"new_prefill":45367,"score_linear":38770.0,"score_lmetric":58025},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":49975,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":61006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":49664,"new_prefill":311,"score_linear":11342.0,"score_lmetric":622},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13840,"ongoing_decode_tokens":0,"pending_prefill_tokens":6160,"num_requests":1,"active_p_offloads":0,"cached_blocks":604,"cache_hit":0,"new_prefill":49975,"score_linear":13840.0,"score_lmetric":56135},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":49975,"score_linear":34706.0,"score_lmetric":49975},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":49975,"score_linear":195334.0,"score_lmetric":223902},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":49975,"score_linear":92197.0,"score_lmetric":112988}],"chosen_score_linear":11342.0,"chosen_score_lmetric":622,"t_first_token":386969.547331442,"t_first_token_unix":1779817834.561276,"t_done":386970.301361401,"t_done_unix":1779817835.3153052},{"request_id":"1294611:7:1306822:293","session_id":"1294611","input_length":43378,"t_proxy_recv":386968.695071342,"t_decision_unix":1779817833.709012,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":30720,"affinity_cache_ratio":0.7081930932730878,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":12658,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":43378,"score_linear":43607.0,"score_lmetric":43378},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":851,"cache_hit":30720,"new_prefill":12658,"score_linear":-30720.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":43378,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":29948,"pending_prefill_tokens":3922,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":12800,"new_prefill":30578,"score_linear":48206.0,"score_lmetric":69000},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":604,"cache_hit":0,"new_prefill":43378,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":43378,"score_linear":34706.0,"score_lmetric":43378},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":43378,"score_linear":195334.0,"score_lmetric":204111},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":43378,"score_linear":92197.0,"score_lmetric":106391}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":386971.869508294,"t_first_token_unix":1779817836.883452,"t_done":386972.98447354,"t_done_unix":1779817837.9984174},{"request_id":"1269373:9:1300958:261","session_id":"1269373","input_length":54451,"t_proxy_recv":386947.914270284,"t_decision_unix":1779817812.9282103,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":50688,"affinity_cache_ratio":0.9308919946373804,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":3763,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":4096,"new_prefill":50355,"score_linear":65459.0,"score_lmetric":161996},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":54451,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":54451,"score_linear":62414.0,"score_lmetric":97921},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":7680,"new_prefill":46771,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":54451,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":59507,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":54451,"score_linear":59507.0,"score_lmetric":54451},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":116704,"ongoing_decode_tokens":18893,"pending_prefill_tokens":531,"num_requests":2,"active_p_offloads":0,"cached_blocks":732,"cache_hit":50688,"new_prefill":3763,"score_linear":66016.0,"score_lmetric":8588},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60678,"ongoing_decode_tokens":105598,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":7680,"new_prefill":46771,"score_linear":52998.0,"score_lmetric":33083}],"chosen_score_linear":66016.0,"chosen_score_lmetric":8588,"t_first_token":386949.479899479,"t_first_token_unix":1779817814.4938433,"t_done":386973.030587488,"t_done_unix":1779817838.0445306},{"request_id":"1303517:2:1307703:297","session_id":"1303517","input_length":23131,"t_proxy_recv":386971.753836748,"t_decision_unix":1779817836.7677777,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":14848,"affinity_cache_ratio":0.6419091262807488,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":8283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":23131,"score_linear":43607.0,"score_lmetric":23131},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43378,"ongoing_decode_tokens":0,"pending_prefill_tokens":12658,"num_requests":1,"active_p_offloads":0,"cached_blocks":851,"cache_hit":0,"new_prefill":23131,"score_linear":43378.0,"score_lmetric":35789},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":23131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":61006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":23131,"score_linear":61006.0,"score_lmetric":46262},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":616,"cache_hit":14848,"new_prefill":8283,"score_linear":-14848.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":23131,"score_linear":34706.0,"score_lmetric":23131},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":23131,"score_linear":195334.0,"score_lmetric":143370},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":23131,"score_linear":92197.0,"score_lmetric":86144}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":386973.006152097,"t_first_token_unix":1779817838.0200958,"t_done":386973.388227009,"t_done_unix":1779817838.4021707},{"request_id":"1277428:2:1306373:292","session_id":"1277428","input_length":31058,"t_proxy_recv":386966.981915637,"t_decision_unix":1779817831.9958565,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":27136,"affinity_cache_ratio":0.8737201365187713,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":3922,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":31058,"score_linear":43607.0,"score_lmetric":31058},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":824,"cache_hit":4608,"new_prefill":26450,"score_linear":9419.0,"score_lmetric":26450},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":31058,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":27136,"new_prefill":3922,"score_linear":2812.0,"score_lmetric":3922},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":897,"ongoing_decode_tokens":897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":31058,"score_linear":897.0,"score_lmetric":31058},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":31058,"score_linear":34706.0,"score_lmetric":31058},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195334,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24659,"num_requests":3,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":31058,"score_linear":195334.0,"score_lmetric":167151},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":31058,"score_linear":92197.0,"score_lmetric":94071}],"chosen_score_linear":2812.0,"chosen_score_lmetric":3922,"t_first_token":386968.927065499,"t_first_token_unix":1779817833.9410095,"t_done":386973.880994618,"t_done_unix":1779817838.8949382},{"request_id":"1302449:3:1308121:299","session_id":"1302449","input_length":8729,"t_proxy_recv":386973.162502404,"t_decision_unix":1779817838.1764436,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":1,"affinity_cache_hit":3584,"affinity_cache_ratio":0.41058540497193263,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":8729,"score_linear":43607.0,"score_lmetric":8729},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":876,"cache_hit":0,"new_prefill":8729,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":8729,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":61006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":8729,"score_linear":61006.0,"score_lmetric":17458},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23131,"ongoing_decode_tokens":23131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":616,"cache_hit":1024,"new_prefill":7705,"score_linear":22107.0,"score_lmetric":7705},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":8729,"score_linear":34706.0,"score_lmetric":8729},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":200029,"ongoing_decode_tokens":140883,"pending_prefill_tokens":4362,"num_requests":3,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":8729,"score_linear":200029.0,"score_lmetric":39273},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":3584,"new_prefill":5145,"score_linear":88613.0,"score_lmetric":68158}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386973.814543791,"t_first_token_unix":1779817838.8284876,"t_done":386973.897953004,"t_done_unix":1779817838.911896},{"request_id":"1301929:1:1301929:265","session_id":"1301929","input_length":34706,"t_proxy_recv":386951.215423971,"t_decision_unix":1779817816.2293653,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":34706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":30643,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":3584,"new_prefill":31122,"score_linear":65971.0,"score_lmetric":123530},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":28972,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":34706,"score_linear":28972.0,"score_lmetric":63678},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":34706,"score_linear":171155.0,"score_lmetric":104118},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":88101,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":34706,"score_linear":43181.0,"score_lmetric":21018}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386956.244142855,"t_first_token_unix":1779817821.2580862,"t_done":386974.779626297,"t_done_unix":1779817839.7935696},{"request_id":"1303651:3:1308202:300","session_id":"1303651","input_length":22896,"t_proxy_recv":386973.414020829,"t_decision_unix":1779817838.4279623,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":12800,"affinity_cache_ratio":0.5590496156533893,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":10096,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":22896,"score_linear":43607.0,"score_lmetric":22896},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8729,"ongoing_decode_tokens":0,"pending_prefill_tokens":8729,"num_requests":1,"active_p_offloads":0,"cached_blocks":876,"cache_hit":0,"new_prefill":22896,"score_linear":8729.0,"score_lmetric":31625},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":12800,"new_prefill":10096,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":61006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":22896,"score_linear":61006.0,"score_lmetric":45792},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":22896,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":22896,"score_linear":34706.0,"score_lmetric":22896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":200029,"ongoing_decode_tokens":140883,"pending_prefill_tokens":4362,"num_requests":3,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":22896,"score_linear":200029.0,"score_lmetric":81774},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":3072,"new_prefill":19824,"score_linear":89125.0,"score_lmetric":82837}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":386974.956525347,"t_first_token_unix":1779817839.9704688,"t_done":386975.03355987,"t_done_unix":1779817840.047504},{"request_id":"1303517:3:1309213:303","session_id":"1303517","input_length":23259,"t_proxy_recv":386977.157315477,"t_decision_unix":1779817842.1712565,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9905842899522765,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":23259,"score_linear":43607.0,"score_lmetric":23259},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43710,"ongoing_decode_tokens":43710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":23259,"score_linear":43710.0,"score_lmetric":23259},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1019,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":919,"cache_hit":0,"new_prefill":23259,"score_linear":29948.0,"score_lmetric":23259},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":23040,"new_prefill":219,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4679,"ongoing_decode_tokens":4679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":23259,"score_linear":4679.0,"score_lmetric":23259},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":200029,"ongoing_decode_tokens":200029,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":23259,"score_linear":200029.0,"score_lmetric":69777},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":23259,"score_linear":92197.0,"score_lmetric":86272}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":386977.231849368,"t_first_token_unix":1779817842.2457926,"t_done":386977.283641718,"t_done_unix":1779817842.2975852},{"request_id":"1309040:1:1309040:302","session_id":"1309040","input_length":4679,"t_proxy_recv":386976.529597597,"t_decision_unix":1779817841.543539,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4679,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":4679,"score_linear":43607.0,"score_lmetric":4679},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43710,"ongoing_decode_tokens":43710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":4679,"score_linear":43710.0,"score_lmetric":4679},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1019,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":919,"cache_hit":0,"new_prefill":4679,"score_linear":29948.0,"score_lmetric":4679},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":200029,"ongoing_decode_tokens":200029,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":4679,"score_linear":200029.0,"score_lmetric":14037},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":4679,"score_linear":92197.0,"score_lmetric":67692}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386976.828738117,"t_first_token_unix":1779817841.8426821,"t_done":386977.317743312,"t_done_unix":1779817842.3316863},{"request_id":"1272313:11:1302571:271","session_id":"1272313","input_length":29948,"t_proxy_recv":386953.640029072,"t_decision_unix":1779817818.6539702,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29696,"affinity_cache_ratio":0.991585414718846,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":534,"cache_hit":4096,"new_prefill":25852,"score_linear":65459.0,"score_lmetric":51704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":57086,"ongoing_decode_tokens":0,"pending_prefill_tokens":31486,"num_requests":2,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":29948,"score_linear":57086.0,"score_lmetric":122868},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":29948,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":78827,"ongoing_decode_tokens":0,"pending_prefill_tokens":29163,"num_requests":2,"active_p_offloads":0,"cached_blocks":855,"cache_hit":29696,"new_prefill":252,"score_linear":49131.0,"score_lmetric":58830},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":1105,"ongoing_decode_tokens":1105,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":29948,"score_linear":1105.0,"score_lmetric":29948},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":29948,"score_linear":34706.0,"score_lmetric":64654},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":171155,"ongoing_decode_tokens":171155,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":732,"cache_hit":10752,"new_prefill":19196,"score_linear":160403.0,"score_lmetric":57588},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":752,"cache_hit":7680,"new_prefill":22268,"score_linear":-9419.0,"score_lmetric":0}],"chosen_score_linear":49131.0,"chosen_score_lmetric":58830,"t_first_token":386961.72425514,"t_first_token_unix":1779817826.7381983,"t_done":386977.611216755,"t_done_unix":1779817842.625164},{"request_id":"1294611:8:1308970:301","session_id":"1294611","input_length":43710,"t_proxy_recv":386976.199853184,"t_decision_unix":1779817841.213794,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9956531686113017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":43710,"score_linear":43607.0,"score_lmetric":43710},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":43520,"new_prefill":190,"score_linear":-43520.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1019,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":919,"cache_hit":12800,"new_prefill":30910,"score_linear":17148.0,"score_lmetric":30910},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":200029,"ongoing_decode_tokens":200029,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":43710,"score_linear":200029.0,"score_lmetric":131130},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":43710,"score_linear":92197.0,"score_lmetric":106723}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":386976.358275317,"t_first_token_unix":1779817841.372219,"t_done":386977.617480413,"t_done_unix":1779817842.631424},{"request_id":"1299507:2:1305770:288","session_id":"1299507","input_length":18915,"t_proxy_recv":386965.057051706,"t_decision_unix":1779817830.0709927,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9744647105471848,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":18915,"score_linear":43607.0,"score_lmetric":18915},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":18915,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":12795,"ongoing_decode_tokens":0,"pending_prefill_tokens":12795,"num_requests":1,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":18915,"score_linear":12795.0,"score_lmetric":31710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":18915,"score_linear":29948.0,"score_lmetric":18915},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":18915,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":18915,"score_linear":34706.0,"score_lmetric":18915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":18432,"new_prefill":483,"score_linear":157987.0,"score_lmetric":49318},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":18915,"score_linear":92197.0,"score_lmetric":81928}],"chosen_score_linear":157987.0,"chosen_score_lmetric":49318,"t_first_token":386973.026559443,"t_first_token_unix":1779817838.040503,"t_done":386978.391177227,"t_done_unix":1779817843.4051208},{"request_id":"1269373:10:1304899:282","session_id":"1269373","input_length":59146,"t_proxy_recv":386973.048587724,"t_decision_unix":1779817838.062529,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9262502958779968,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":4362,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":4096,"new_prefill":55050,"score_linear":39511.0,"score_lmetric":55050},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":876,"cache_hit":0,"new_prefill":59146,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":59146,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61006,"ongoing_decode_tokens":61006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":911,"cache_hit":7680,"new_prefill":51466,"score_linear":53326.0,"score_lmetric":102932},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":23131,"ongoing_decode_tokens":23131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":616,"cache_hit":0,"new_prefill":59146,"score_linear":23131.0,"score_lmetric":59146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":59146,"score_linear":34706.0,"score_lmetric":59146},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":140883,"ongoing_decode_tokens":140883,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":756,"cache_hit":54784,"new_prefill":4362,"score_linear":86099.0,"score_lmetric":8724},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":7680,"new_prefill":51466,"score_linear":84517.0,"score_lmetric":114479}],"chosen_score_linear":86099.0,"chosen_score_lmetric":8724,"t_first_token":386974.695171807,"t_first_token_unix":1779817839.7091155,"t_done":386978.810482876,"t_done_unix":1779817843.8244267},{"request_id":"1309252:1:1309252:304","session_id":"1309252","input_length":24545,"t_proxy_recv":386977.359631951,"t_decision_unix":1779817842.3735733,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24545,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":24545,"score_linear":43607.0,"score_lmetric":24545},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43710,"ongoing_decode_tokens":43710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":24545,"score_linear":43710.0,"score_lmetric":24545},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1019,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":919,"cache_hit":0,"new_prefill":24545,"score_linear":29948.0,"score_lmetric":24545},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":200029,"ongoing_decode_tokens":200029,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":756,"cache_hit":0,"new_prefill":24545,"score_linear":200029.0,"score_lmetric":73635},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":24545,"score_linear":92197.0,"score_lmetric":87558}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386980.184619596,"t_first_token_unix":1779817845.1985636,"t_done":386982.035901513,"t_done_unix":1779817847.0498476},{"request_id":"1310590:1:1310590:306","session_id":"1310590","input_length":18089,"t_proxy_recv":386981.943942215,"t_decision_unix":1779817846.9578831,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18089,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":18089,"score_linear":43607.0,"score_lmetric":18089},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24545,"ongoing_decode_tokens":24545,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1019,"cache_hit":0,"new_prefill":18089,"score_linear":24545.0,"score_lmetric":18089},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":921,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":18089,"score_linear":181414.0,"score_lmetric":36178},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":18089,"score_linear":92197.0,"score_lmetric":81102}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386983.729793524,"t_first_token_unix":1779817848.743737,"t_done":386984.218262437,"t_done_unix":1779817849.2322059},{"request_id":"1297811:2:1300578:258","session_id":"1297811","input_length":43607,"t_proxy_recv":386946.559338962,"t_decision_unix":1779817811.57328,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":13824,"affinity_cache_ratio":0.3170133235489715,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":29783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":534,"cache_hit":13824,"new_prefill":29783,"score_linear":-13824.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24384,"ongoing_decode_tokens":24384,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":747,"cache_hit":0,"new_prefill":43607,"score_linear":24384.0,"score_lmetric":43607},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":43607,"score_linear":62414.0,"score_lmetric":87077},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":557,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":43607,"score_linear":59507.0,"score_lmetric":103114},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":732,"cache_hit":0,"new_prefill":43607,"score_linear":18893.0,"score_lmetric":43607},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":60678,"ongoing_decode_tokens":105598,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":712,"cache_hit":0,"new_prefill":43607,"score_linear":60678.0,"score_lmetric":29919}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":386952.87129031,"t_first_token_unix":1779817817.8852358,"t_done":386984.825048778,"t_done_unix":1779817849.8389924},{"request_id":"1303517:4:1311293:308","session_id":"1303517","input_length":24638,"t_proxy_recv":386984.391050502,"t_decision_unix":1779817849.4049916,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9351408393538436,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1598,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":24638,"score_linear":43607.0,"score_lmetric":24638},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":23040,"new_prefill":1598,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":24638,"score_linear":181414.0,"score_lmetric":49276},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105361,"ongoing_decode_tokens":137117,"pending_prefill_tokens":-524,"num_requests":2,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":24638,"score_linear":105361.0,"score_lmetric":48228}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":386984.71765127,"t_first_token_unix":1779817849.7315948,"t_done":386984.887366046,"t_done_unix":1779817849.9013095},{"request_id":"1304943:2:1311189:307","session_id":"1304943","input_length":13164,"t_proxy_recv":386984.076373659,"t_decision_unix":1779817849.090315,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":7,"affinity_cache_hit":2560,"affinity_cache_ratio":0.19446976602856275,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":-524,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":13164,"score_linear":43607.0,"score_lmetric":13164},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":2560,"new_prefill":10604,"score_linear":-2560.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18089,"ongoing_decode_tokens":18089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":921,"cache_hit":0,"new_prefill":13164,"score_linear":18089.0,"score_lmetric":13164},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":13164,"score_linear":181414.0,"score_lmetric":26328},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":137117,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":13164,"score_linear":92197.0,"score_lmetric":-524}],"chosen_score_linear":92197.0,"chosen_score_lmetric":-524,"t_first_token":386985.214349721,"t_first_token_unix":1779817850.2282937,"t_done":386985.367567181,"t_done_unix":1779817850.381511},{"request_id":"1305420:1:1305420:285","session_id":"1305420","input_length":75826,"t_proxy_recv":386963.676445716,"t_decision_unix":1779817828.6903865,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-62138,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":75826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":75826,"score_linear":43607.0,"score_lmetric":75826},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30995,"ongoing_decode_tokens":30995,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":75826,"score_linear":30995.0,"score_lmetric":75826},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":75826,"score_linear":29948.0,"score_lmetric":75826},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":75826,"score_linear":34706.0,"score_lmetric":75826},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":75826,"score_linear":176419.0,"score_lmetric":200004},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":75826,"score_linear":-44920.0,"score_lmetric":-62138}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-62138,"t_first_token":386983.565772141,"t_first_token_unix":1779817848.5797164,"t_done":386985.574922106,"t_done_unix":1779817850.5888653},{"request_id":"1279412:9:1305633:286","session_id":"1279412","input_length":61291,"t_proxy_recv":386964.591022343,"t_decision_unix":1779817829.604963,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60416,"affinity_cache_ratio":0.985723841999641,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":875,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":0,"new_prefill":61291,"score_linear":43607.0,"score_lmetric":61291},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":61291,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":968,"cache_hit":0,"new_prefill":61291,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":61291,"score_linear":29948.0,"score_lmetric":61291},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":61291,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":61291,"score_linear":34706.0,"score_lmetric":61291},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176419,"ongoing_decode_tokens":54451,"pending_prefill_tokens":24176,"num_requests":2,"active_p_offloads":0,"cached_blocks":748,"cache_hit":0,"new_prefill":61291,"score_linear":176419.0,"score_lmetric":170934},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30906,"ongoing_decode_tokens":0,"pending_prefill_tokens":62138,"num_requests":0,"active_p_offloads":0,"cached_blocks":799,"cache_hit":60416,"new_prefill":875,"score_linear":-29510.0,"score_lmetric":0}],"chosen_score_linear":-29510.0,"chosen_score_lmetric":0,"t_first_token":386983.573473005,"t_first_token_unix":1779817848.587417,"t_done":386985.852155529,"t_done_unix":1779817850.8660989},{"request_id":"1277428:3:1311644:311","session_id":"1277428","input_length":31611,"t_proxy_recv":386985.697925534,"t_decision_unix":1779817850.7118666,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9880105026731201,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":379,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":4608,"new_prefill":27003,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":31611,"score_linear":44792.0,"score_lmetric":51827},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8996,"ongoing_decode_tokens":0,"pending_prefill_tokens":292,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":31232,"new_prefill":379,"score_linear":-22236.0,"score_lmetric":671},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":31611,"score_linear":181414.0,"score_lmetric":63222},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":16371,"ongoing_decode_tokens":61291,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":972,"cache_hit":0,"new_prefill":31611,"score_linear":16371.0,"score_lmetric":0}],"chosen_score_linear":-22236.0,"chosen_score_lmetric":671,"t_first_token":386986.237216029,"t_first_token_unix":1779817851.251159,"t_done":386986.635850184,"t_done_unix":1779817851.6497939},{"request_id":"1279412:10:1308091:298","session_id":"1279412","input_length":61505,"t_proxy_recv":386985.862337114,"t_decision_unix":1779817850.8762786,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9906186488903341,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":577,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":61505,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":61505,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":61505,"score_linear":44792.0,"score_lmetric":81721},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40607,"ongoing_decode_tokens":0,"pending_prefill_tokens":671,"num_requests":2,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":61505,"score_linear":40607.0,"score_lmetric":124352},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":61505,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":61505,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":61505,"score_linear":181414.0,"score_lmetric":123010},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":973,"cache_hit":60928,"new_prefill":577,"score_linear":-105848.0,"score_lmetric":13111}],"chosen_score_linear":-105848.0,"chosen_score_lmetric":13111,"t_first_token":386986.026971618,"t_first_token_unix":1779817851.0409153,"t_done":386986.79404021,"t_done_unix":1779817851.8079836},{"request_id":"1269373:11:1307381:296","session_id":"1269373","input_length":59446,"t_proxy_recv":386978.823222155,"t_decision_unix":1779817843.8371637,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9904787538270027,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":4096,"new_prefill":55350,"score_linear":39511.0,"score_lmetric":55350},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":59446,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24545,"ongoing_decode_tokens":0,"pending_prefill_tokens":24545,"num_requests":1,"active_p_offloads":0,"cached_blocks":1019,"cache_hit":0,"new_prefill":59446,"score_linear":24545.0,"score_lmetric":83991},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":921,"cache_hit":7680,"new_prefill":51766,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":632,"cache_hit":0,"new_prefill":59446,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":59446,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":58880,"new_prefill":566,"score_linear":63088.0,"score_lmetric":566},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":0,"pending_prefill_tokens":63013,"num_requests":1,"active_p_offloads":0,"cached_blocks":799,"cache_hit":7680,"new_prefill":51766,"score_linear":84517.0,"score_lmetric":114779}],"chosen_score_linear":63088.0,"chosen_score_lmetric":566,"t_first_token":386978.985481356,"t_first_token_unix":1779817843.9994252,"t_done":386986.843205405,"t_done_unix":1779817851.8571486},{"request_id":"1258908:2:1311606:310","session_id":"1258908","input_length":8996,"t_proxy_recv":386985.517738424,"t_decision_unix":1779817850.5316794,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9675411293908404,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":8996,"score_linear":44792.0,"score_lmetric":29212},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":8704,"new_prefill":292,"score_linear":-8704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":8996,"score_linear":181414.0,"score_lmetric":17992},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92197,"ongoing_decode_tokens":137117,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":824,"cache_hit":0,"new_prefill":8996,"score_linear":92197.0,"score_lmetric":-4692}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":386986.19352446,"t_first_token_unix":1779817851.207468,"t_done":386988.221901125,"t_done_unix":1779817853.2358441},{"request_id":"1311753:1:1311753:312","session_id":"1311753","input_length":20175,"t_proxy_recv":386986.090895293,"t_decision_unix":1779817851.1048365,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":20175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":20175,"score_linear":44792.0,"score_lmetric":40391},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40607,"ongoing_decode_tokens":0,"pending_prefill_tokens":671,"num_requests":2,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":20175,"score_linear":40607.0,"score_lmetric":41692},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":20175,"score_linear":181414.0,"score_lmetric":40350},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":16585,"ongoing_decode_tokens":61505,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":973,"cache_hit":0,"new_prefill":20175,"score_linear":16585.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386988.198624139,"t_first_token_unix":1779817853.2125678,"t_done":386988.380825577,"t_done_unix":1779817853.394769},{"request_id":"1279412:11:1310014:305","session_id":"1279412","input_length":64558,"t_proxy_recv":386986.806757945,"t_decision_unix":1779817851.8206995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9517023451779795,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":3118,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":64558,"score_linear":44792.0,"score_lmetric":84774},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8996,"ongoing_decode_tokens":8996,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":64558,"score_linear":8996.0,"score_lmetric":64558},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":20175,"ongoing_decode_tokens":0,"pending_prefill_tokens":20175,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":64558,"score_linear":20175.0,"score_lmetric":84733},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":64558,"score_linear":181414.0,"score_lmetric":129116},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":974,"cache_hit":61440,"new_prefill":3118,"score_linear":-106360.0,"score_lmetric":10570}],"chosen_score_linear":-106360.0,"chosen_score_lmetric":10570,"t_first_token":386988.119231669,"t_first_token_unix":1779817853.1331756,"t_done":386989.491811483,"t_done_unix":1779817854.505755},{"request_id":"1294611:9:1312398:313","session_id":"1294611","input_length":44335,"t_proxy_recv":386988.37547211,"t_decision_unix":1779817853.389413,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9816172324348709,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":815,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":43520,"new_prefill":815,"score_linear":-43520.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":44335,"score_linear":44792.0,"score_lmetric":64551},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":12800,"new_prefill":31535,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":20175,"ongoing_decode_tokens":20175,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":44335,"score_linear":20175.0,"score_lmetric":44335},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":44335,"score_linear":121968.0,"score_lmetric":44335},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19638,"ongoing_decode_tokens":64558,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":44335,"score_linear":19638.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":386988.633735056,"t_first_token_unix":1779817853.6476781,"t_done":386989.91403642,"t_done_unix":1779817854.92798},{"request_id":"1309252:2:1311531:309","session_id":"1309252","input_length":44792,"t_proxy_recv":386985.292556182,"t_decision_unix":1779817850.306497,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24576,"affinity_cache_ratio":0.5486694052509377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":20216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":24576,"new_prefill":20216,"score_linear":-24576.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":181414,"ongoing_decode_tokens":181414,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":44792,"score_linear":181414.0,"score_lmetric":89584},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105361,"ongoing_decode_tokens":150281,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":799,"cache_hit":0,"new_prefill":44792,"score_linear":105361.0,"score_lmetric":62208}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":386990.231048093,"t_first_token_unix":1779817855.2449918,"t_done":386990.905234637,"t_done_unix":1779817855.9191787},{"request_id":"1303517:5:1313040:317","session_id":"1303517","input_length":25637,"t_proxy_recv":386990.437965977,"t_decision_unix":1779817855.4519072,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9586145024768888,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":1061,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":44792,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":25637,"score_linear":44792.0,"score_lmetric":25637},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40245,"ongoing_decode_tokens":13360,"pending_prefill_tokens":5381,"num_requests":2,"active_p_offloads":0,"cached_blocks":635,"cache_hit":24576,"new_prefill":1061,"score_linear":15669.0,"score_lmetric":12884},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":184808,"ongoing_decode_tokens":121968,"pending_prefill_tokens":2936,"num_requests":2,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":25637,"score_linear":184808.0,"score_lmetric":57146},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":25637,"score_linear":-44920.0,"score_lmetric":-11949}],"chosen_score_linear":15669.0,"chosen_score_lmetric":12884,"t_first_token":386991.502032445,"t_first_token_unix":1779817856.5159762,"t_done":386991.568070131,"t_done_unix":1779817856.5820136},{"request_id":"1306347:2:1312642:314","session_id":"1306347","input_length":13360,"t_proxy_recv":386989.271159942,"t_decision_unix":1779817854.2851007,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":512,"affinity_cache_ratio":0.03832335329341317,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":12848,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":13360,"score_linear":44335.0,"score_lmetric":13360},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":13360,"score_linear":44792.0,"score_lmetric":33576},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":635,"cache_hit":512,"new_prefill":12848,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":13360,"score_linear":121968.0,"score_lmetric":13360},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19638,"ongoing_decode_tokens":64558,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":13360,"score_linear":19638.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":386990.360802128,"t_first_token_unix":1779817855.3747454,"t_done":386992.26133509,"t_done_unix":1779817857.2752786},{"request_id":"1268861:4:1312689:315","session_id":"1268861","input_length":26885,"t_proxy_recv":386989.433404893,"t_decision_unix":1779817854.4473464,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":21504,"affinity_cache_ratio":0.7998512181513855,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":5381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":26885,"score_linear":44335.0,"score_lmetric":26885},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":26885,"score_linear":44792.0,"score_lmetric":47101},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13360,"ongoing_decode_tokens":0,"pending_prefill_tokens":12848,"num_requests":1,"active_p_offloads":0,"cached_blocks":635,"cache_hit":21504,"new_prefill":5381,"score_linear":-8144.0,"score_lmetric":18229},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":26885,"score_linear":121968.0,"score_lmetric":26885},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19638,"ongoing_decode_tokens":64558,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":26885,"score_linear":19638.0,"score_lmetric":0}],"chosen_score_linear":-8144.0,"chosen_score_lmetric":18229,"t_first_token":386991.269409784,"t_first_token_unix":1779817856.283353,"t_done":386992.897834875,"t_done_unix":1779817857.9117785},{"request_id":"1279412:12:1313518:319","session_id":"1279412","input_length":64755,"t_proxy_recv":386992.182659238,"t_decision_unix":1779817857.1966007,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9962473940236275,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":243,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40245,"ongoing_decode_tokens":40245,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":64755,"score_linear":40245.0,"score_lmetric":129510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":22686,"ongoing_decode_tokens":0,"pending_prefill_tokens":22686,"num_requests":1,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":64755,"score_linear":22686.0,"score_lmetric":87441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":184808,"ongoing_decode_tokens":184808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":64755,"score_linear":184808.0,"score_lmetric":129510},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":64512,"new_prefill":243,"score_linear":-109432.0,"score_lmetric":13445}],"chosen_score_linear":-109432.0,"chosen_score_lmetric":13445,"t_first_token":386992.296078259,"t_first_token_unix":1779817857.3100216,"t_done":386993.598326172,"t_done_unix":1779817858.61227},{"request_id":"1313181:1:1313181:318","session_id":"1313181","input_length":22686,"t_proxy_recv":386991.053028801,"t_decision_unix":1779817856.0669703,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":22686,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65882,"ongoing_decode_tokens":13360,"pending_prefill_tokens":6442,"num_requests":3,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":22686,"score_linear":65882.0,"score_lmetric":87384},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":184808,"ongoing_decode_tokens":121968,"pending_prefill_tokens":2936,"num_requests":2,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":22686,"score_linear":184808.0,"score_lmetric":51244},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":12800,"new_prefill":9886,"score_linear":-57720.0,"score_lmetric":3802}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386993.556126534,"t_first_token_unix":1779817858.57007,"t_done":386994.215461121,"t_done_unix":1779817859.2294044},{"request_id":"1269373:12:1312836:316","session_id":"1269373","input_length":62840,"t_proxy_recv":386989.806175446,"t_decision_unix":1779817854.8201165,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":59904,"affinity_cache_ratio":0.9532781667727562,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59904,"estimated_new_tokens":2936,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":4096,"new_prefill":58744,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":62840,"score_linear":44335.0,"score_lmetric":62840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1067,"cache_hit":0,"new_prefill":62840,"score_linear":44792.0,"score_lmetric":83056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":7680,"new_prefill":55160,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40245,"ongoing_decode_tokens":0,"pending_prefill_tokens":18229,"num_requests":2,"active_p_offloads":0,"cached_blocks":635,"cache_hit":0,"new_prefill":62840,"score_linear":40245.0,"score_lmetric":162138},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":789,"cache_hit":0,"new_prefill":62840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":766,"cache_hit":59904,"new_prefill":2936,"score_linear":62064.0,"score_lmetric":2936},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":7680,"new_prefill":55160,"score_linear":-52600.0,"score_lmetric":-41472}],"chosen_score_linear":62064.0,"chosen_score_lmetric":2936,"t_first_token":386991.086520421,"t_first_token_unix":1779817856.1004636,"t_done":386996.914138023,"t_done_unix":1779817861.9280818},{"request_id":"1294611:10:1314495:322","session_id":"1294611","input_length":45362,"t_proxy_recv":386995.835663811,"t_decision_unix":1779817860.849605,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":44032,"affinity_cache_ratio":0.970680305101186,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":44032,"new_prefill":1330,"score_linear":-44032.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":12800,"new_prefill":32562,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":184808,"ongoing_decode_tokens":184808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":45362,"score_linear":184808.0,"score_lmetric":90724},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12131,"ongoing_decode_tokens":0,"pending_prefill_tokens":43363,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":45362,"score_linear":12131.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":386996.187920506,"t_first_token_unix":1779817861.2018642,"t_done":386997.643841989,"t_done_unix":1779817862.6577854},{"request_id":"1313181:2:1314940:323","session_id":"1313181","input_length":24306,"t_proxy_recv":386997.244820584,"t_decision_unix":1779817862.258761,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":22528,"affinity_cache_ratio":0.9268493376121122,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":1778,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":45362,"ongoing_decode_tokens":45362,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":24306,"score_linear":45362.0,"score_lmetric":24306},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":833,"cache_hit":22528,"new_prefill":1778,"score_linear":-22528.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":24306,"score_linear":121968.0,"score_lmetric":24306},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12131,"ongoing_decode_tokens":0,"pending_prefill_tokens":43363,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":12800,"new_prefill":11506,"score_linear":-669.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":386997.577705802,"t_first_token_unix":1779817862.5916495,"t_done":386998.172724814,"t_done_unix":1779817863.1866677},{"request_id":"1315313:1:1315313:325","session_id":"1315313","input_length":7,"t_proxy_recv":386998.474317069,"t_decision_unix":1779817863.4882584,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":7,"score_linear":32440.0,"score_lmetric":14527},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":836,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":7,"score_linear":121968.0,"score_lmetric":7},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12131,"ongoing_decode_tokens":0,"pending_prefill_tokens":43363,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":7,"score_linear":12131.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":386998.49672241,"t_first_token_unix":1779817863.5106657,"t_done":386998.500851253,"t_done_unix":1779817863.5147939},{"request_id":"1310590:2:1315212:324","session_id":"1310590","input_length":32440,"t_proxy_recv":386998.123149345,"t_decision_unix":1779817863.1370912,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":17920,"affinity_cache_ratio":0.5524044389642416,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":14520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":17920,"new_prefill":14520,"score_linear":-17920.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":24306,"ongoing_decode_tokens":24306,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":32440,"score_linear":24306.0,"score_lmetric":32440},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":32440,"score_linear":121968.0,"score_lmetric":32440},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12131,"ongoing_decode_tokens":0,"pending_prefill_tokens":43363,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":32440,"score_linear":12131.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":387000.839063923,"t_first_token_unix":1779817865.8530076,"t_done":387000.98423878,"t_done_unix":1779817865.9981823},{"request_id":"1309040:2:1315488:326","session_id":"1309040","input_length":23097,"t_proxy_recv":386999.194863437,"t_decision_unix":1779817864.2088048,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.1995064294064164,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":18489,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":23097,"score_linear":32440.0,"score_lmetric":37617},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":836,"cache_hit":4608,"new_prefill":18489,"score_linear":-4608.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":23097,"score_linear":121968.0,"score_lmetric":23097},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12131,"ongoing_decode_tokens":0,"pending_prefill_tokens":43363,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":23097,"score_linear":12131.0,"score_lmetric":0}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":387001.513534459,"t_first_token_unix":1779817866.5274785,"t_done":387001.871368868,"t_done_unix":1779817866.8853123},{"request_id":"1316848:1:1316848:331","session_id":"1316848","input_length":5985,"t_proxy_recv":387003.817529494,"t_decision_unix":1779817868.8314703,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":4961,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24487,"ongoing_decode_tokens":0,"pending_prefill_tokens":24487,"num_requests":1,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":5985,"score_linear":24487.0,"score_lmetric":30472},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":1024,"new_prefill":4961,"score_linear":-1024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":5985,"score_linear":121968.0,"score_lmetric":5985},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":0,"pending_prefill_tokens":53080,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":5985,"score_linear":94040.0,"score_lmetric":118130}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":387004.171388459,"t_first_token_unix":1779817869.1853323,"t_done":387004.352694978,"t_done_unix":1779817869.366639},{"request_id":"1316201:1:1316201:329","session_id":"1316201","input_length":24487,"t_proxy_recv":387001.727439148,"t_decision_unix":1779817866.7413805,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24487,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":23097,"ongoing_decode_tokens":23097,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":836,"cache_hit":0,"new_prefill":24487,"score_linear":23097.0,"score_lmetric":24487},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":24487,"score_linear":121968.0,"score_lmetric":24487},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":0,"pending_prefill_tokens":53080,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":24487,"score_linear":94040.0,"score_lmetric":155134}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387004.533123072,"t_first_token_unix":1779817869.547067,"t_done":387004.819815983,"t_done_unix":1779817869.8337598},{"request_id":"1317160:1:1317160:332","session_id":"1317160","input_length":3441,"t_proxy_recv":387004.970020204,"t_decision_unix":1779817869.983961,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":3441,"score_linear":121968.0,"score_lmetric":3441},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":0,"pending_prefill_tokens":53080,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":3441,"score_linear":94040.0,"score_lmetric":113042}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387005.189463022,"t_first_token_unix":1779817870.2034063,"t_done":387005.343590752,"t_done_unix":1779817870.3575344},{"request_id":"1316848:2:1317438:333","session_id":"1316848","input_length":6040,"t_proxy_recv":387006.052016864,"t_decision_unix":1779817871.0659578,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5632,"affinity_cache_ratio":0.9324503311258279,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":408,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":5632,"new_prefill":408,"score_linear":-5632.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":6040,"score_linear":121968.0,"score_lmetric":6040},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":0,"pending_prefill_tokens":53080,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":6040,"score_linear":94040.0,"score_lmetric":118240}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":387006.082435493,"t_first_token_unix":1779817871.0963788,"t_done":387006.488276504,"t_done_unix":1779817871.5022194},{"request_id":"1317160:2:1317773:336","session_id":"1317160","input_length":7440,"t_proxy_recv":387007.369854622,"t_decision_unix":1779817872.3837955,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":3072,"affinity_cache_ratio":0.4129032258064516,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":4368,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":3072,"new_prefill":4368,"score_linear":-3072.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":7440,"score_linear":79663.0,"score_lmetric":86591},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":121968,"pending_prefill_tokens":3159,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":7440,"score_linear":188103.0,"score_lmetric":21198},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":57051,"pending_prefill_tokens":-3971,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":7440,"score_linear":94040.0,"score_lmetric":6938}],"chosen_score_linear":-3072.0,"chosen_score_lmetric":0,"t_first_token":387007.70791149,"t_first_token_unix":1779817872.7218544,"t_done":387007.832043213,"t_done_unix":1779817872.8459866},{"request_id":"1316201:2:1317776:337","session_id":"1316201","input_length":24768,"t_proxy_recv":387007.38924928,"t_decision_unix":1779817872.403191,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9715762273901809,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":704,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":7440,"ongoing_decode_tokens":0,"pending_prefill_tokens":4368,"num_requests":1,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":24768,"score_linear":7440.0,"score_lmetric":29136},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":24064,"new_prefill":704,"score_linear":-24064.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":24768,"score_linear":79663.0,"score_lmetric":103919},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":121968,"pending_prefill_tokens":3159,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":24768,"score_linear":188103.0,"score_lmetric":55854},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":57051,"pending_prefill_tokens":-3971,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":24768,"score_linear":94040.0,"score_lmetric":41594}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":387007.496934294,"t_first_token_unix":1779817872.5108776,"t_done":387008.035340378,"t_done_unix":1779817873.0492837},{"request_id":"1318031:1:1318031:338","session_id":"1318031","input_length":5219,"t_proxy_recv":387008.031922488,"t_decision_unix":1779817873.0458634,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":611,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24768,"ongoing_decode_tokens":24768,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":5219,"score_linear":24768.0,"score_lmetric":5219},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":5219,"score_linear":79663.0,"score_lmetric":84370},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":5219,"score_linear":188103.0,"score_lmetric":10438},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":57051,"pending_prefill_tokens":-3971,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":5219,"score_linear":94040.0,"score_lmetric":2496}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387008.367769778,"t_first_token_unix":1779817873.3817134,"t_done":387008.586059837,"t_done_unix":1779817873.600003},{"request_id":"1318036:1:1318036:339","session_id":"1318036","input_length":2696,"t_proxy_recv":387008.036709007,"t_decision_unix":1779817873.0506506,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-2550,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2696,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":611,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":2696,"score_linear":79663.0,"score_lmetric":81847},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5219,"ongoing_decode_tokens":0,"pending_prefill_tokens":5219,"num_requests":1,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":2696,"score_linear":5219.0,"score_lmetric":7915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":2696,"score_linear":188103.0,"score_lmetric":5392},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":57051,"pending_prefill_tokens":-3971,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":2696,"score_linear":94040.0,"score_lmetric":-2550}],"chosen_score_linear":94040.0,"chosen_score_lmetric":-2550,"t_first_token":387008.85277074,"t_first_token_unix":1779817873.8667138,"t_done":387010.765101965,"t_done_unix":1779817875.7790456},{"request_id":"1318604:1:1318604:341","session_id":"1318604","input_length":14412,"t_proxy_recv":387010.079738159,"t_decision_unix":1779817875.0936794,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":611,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":0,"pending_prefill_tokens":3738,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14412,"score_linear":62618.0,"score_lmetric":18150},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":14412,"score_linear":79663.0,"score_lmetric":93563},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":14412,"score_linear":188103.0,"score_lmetric":28824},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":96736,"ongoing_decode_tokens":141656,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":14412,"score_linear":96736.0,"score_lmetric":2172}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387011.331211844,"t_first_token_unix":1779817876.3451552,"t_done":387011.514511108,"t_done_unix":1779817876.5284545},{"request_id":"1316848:3:1318975:343","session_id":"1316848","input_length":6298,"t_proxy_recv":387011.452147909,"t_decision_unix":1779817876.4660892,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5632,"affinity_cache_ratio":0.8942521435376309,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":666,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14412,"ongoing_decode_tokens":14412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":611,"cache_hit":0,"new_prefill":6298,"score_linear":14412.0,"score_lmetric":6298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":0,"pending_prefill_tokens":3738,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":6298,"score_linear":62618.0,"score_lmetric":10036},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":5632,"new_prefill":666,"score_linear":-5632.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":6298,"score_linear":79663.0,"score_lmetric":85449},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":6298,"score_linear":188103.0,"score_lmetric":12596},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":138960,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":6298,"score_linear":94040.0,"score_lmetric":-14780}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":387011.508516148,"t_first_token_unix":1779817876.5224602,"t_done":387011.778566681,"t_done_unix":1779817876.7925103},{"request_id":"1314357:1:1314357:321","session_id":"1314357","input_length":57051,"t_proxy_recv":386995.370338577,"t_decision_unix":1779817860.3842797,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-43363,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":57051,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":3584,"new_prefill":53467,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":894,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":184808,"ongoing_decode_tokens":184808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":766,"cache_hit":0,"new_prefill":57051,"score_linear":184808.0,"score_lmetric":114102},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":-13688,"num_requests":-1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":57051,"score_linear":-44920.0,"score_lmetric":-43363}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-43363,"t_first_token":387007.137850334,"t_first_token_unix":1779817872.1517956,"t_done":387013.507982045,"t_done_unix":1779817878.5219254},{"request_id":"1279412:13:1315780:328","session_id":"1279412","input_length":64949,"t_proxy_recv":387000.263775506,"t_decision_unix":1779817865.2777164,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9932716439052179,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":64949,"score_linear":32440.0,"score_lmetric":79469},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":18489,"num_requests":1,"active_p_offloads":0,"cached_blocks":836,"cache_hit":12800,"new_prefill":52149,"score_linear":10297.0,"score_lmetric":70638},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":64949,"score_linear":121968.0,"score_lmetric":64949},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29091,"ongoing_decode_tokens":0,"pending_prefill_tokens":52643,"num_requests":1,"active_p_offloads":0,"cached_blocks":980,"cache_hit":64512,"new_prefill":437,"score_linear":-35421.0,"score_lmetric":53080}],"chosen_score_linear":-35421.0,"chosen_score_lmetric":53080,"t_first_token":387008.631349584,"t_first_token_unix":1779817873.6452928,"t_done":387014.217553262,"t_done_unix":1779817879.231497},{"request_id":"1318604:2:1319895:347","session_id":"1318604","input_length":15745,"t_proxy_recv":387014.570019105,"t_decision_unix":1779817879.5839603,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9105112734201334,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":1409,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":639,"cache_hit":14336,"new_prefill":1409,"score_linear":-14336.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":15745,"score_linear":62618.0,"score_lmetric":15745},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":15745,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21140,"ongoing_decode_tokens":0,"pending_prefill_tokens":14996,"num_requests":1,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":15745,"score_linear":21140.0,"score_lmetric":30741},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":15745,"score_linear":79663.0,"score_lmetric":94896},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":15745,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":15745,"score_linear":188103.0,"score_lmetric":31490},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43894,"ongoing_decode_tokens":16960,"pending_prefill_tokens":-6858,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":15745,"score_linear":43894.0,"score_lmetric":8887}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":387014.807058317,"t_first_token_unix":1779817879.821002,"t_done":387014.98955717,"t_done_unix":1779817880.0035007},{"request_id":"1269373:13:1317516:334","session_id":"1269373","input_length":66135,"t_proxy_recv":387006.31583284,"t_decision_unix":1779817871.329774,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9522340666817872,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":3159,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":4096,"new_prefill":62039,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":6040,"ongoing_decode_tokens":6040,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":994,"cache_hit":7680,"new_prefill":58455,"score_linear":-1640.0,"score_lmetric":58455},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":62976,"new_prefill":3159,"score_linear":58992.0,"score_lmetric":3159},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":0,"pending_prefill_tokens":53080,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":7680,"new_prefill":58455,"score_linear":86360.0,"score_lmetric":223070}],"chosen_score_linear":58992.0,"chosen_score_lmetric":3159,"t_first_token":387007.675612575,"t_first_token_unix":1779817872.6895561,"t_done":387015.071765373,"t_done_unix":1779817880.0857089},{"request_id":"1316848:4:1319820:345","session_id":"1316848","input_length":21140,"t_proxy_recv":387014.359428862,"t_decision_unix":1779817879.3733702,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":6144,"affinity_cache_ratio":0.29063386944181646,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":14996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":639,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21140,"score_linear":62618.0,"score_lmetric":21140},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":995,"cache_hit":6144,"new_prefill":14996,"score_linear":-6144.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":21140,"score_linear":79663.0,"score_lmetric":100291},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":21140,"score_linear":188103.0,"score_lmetric":42280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43894,"ongoing_decode_tokens":16960,"pending_prefill_tokens":-6858,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":21140,"score_linear":43894.0,"score_lmetric":14282}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":387016.206577304,"t_first_token_unix":1779817881.2205215,"t_done":387018.032831403,"t_done_unix":1779817883.0467749},{"request_id":"1320630:1:1320630:348","session_id":"1320630","input_length":3099,"t_proxy_recv":387017.372011169,"t_decision_unix":1779817882.385941,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-10589,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3099,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":641,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":3099,"score_linear":62618.0,"score_lmetric":3099},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21140,"ongoing_decode_tokens":21140,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":3099,"score_linear":21140.0,"score_lmetric":3099},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":3099,"score_linear":79663.0,"score_lmetric":82250},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":3099,"score_linear":121968.0,"score_lmetric":3099},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43894,"ongoing_decode_tokens":88814,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":3099,"score_linear":43894.0,"score_lmetric":-10589}],"chosen_score_linear":43894.0,"chosen_score_lmetric":-10589,"t_first_token":387017.663403509,"t_first_token_unix":1779817882.6773465,"t_done":387018.100329675,"t_done_unix":1779817883.1142733},{"request_id":"1318604:3:1320865:350","session_id":"1318604","input_length":17883,"t_proxy_recv":387018.21458778,"t_decision_unix":1779817883.2285292,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":15360,"affinity_cache_ratio":0.8589162892132193,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":2523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":641,"cache_hit":15360,"new_prefill":2523,"score_linear":-15360.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":17883,"score_linear":62618.0,"score_lmetric":17883},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1024,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":17883,"score_linear":79663.0,"score_lmetric":97034},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":17883,"score_linear":121968.0,"score_lmetric":17883},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43894,"ongoing_decode_tokens":88814,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":17883,"score_linear":43894.0,"score_lmetric":4195}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":387018.608645754,"t_first_token_unix":1779817883.6225896,"t_done":387018.829233631,"t_done_unix":1779817883.8431766},{"request_id":"1318036:2:1321282:353","session_id":"1318036","input_length":2677,"t_proxy_recv":387019.679868454,"t_decision_unix":1779817884.69381,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":2560,"affinity_cache_ratio":0.9562943593574897,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":117,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":2677,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":2677,"score_linear":62618.0,"score_lmetric":2677},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":2677,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":33906,"ongoing_decode_tokens":0,"pending_prefill_tokens":2674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1024,"cache_hit":0,"new_prefill":2677,"score_linear":33906.0,"score_lmetric":5351},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":2677,"score_linear":79663.0,"score_lmetric":81828},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":2677,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":2677,"score_linear":121968.0,"score_lmetric":2677},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":51989,"ongoing_decode_tokens":96909,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":2560,"new_prefill":117,"score_linear":49429.0,"score_lmetric":-27142}],"chosen_score_linear":49429.0,"chosen_score_lmetric":-27142,"t_first_token":387019.718532573,"t_first_token_unix":1779817884.7324758,"t_done":387019.742184555,"t_done_unix":1779817884.756128},{"request_id":"1321042:1:1321042:351","session_id":"1321042","input_length":8095,"t_proxy_recv":387018.86472277,"t_decision_unix":1779817883.878664,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-5593,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8095,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":8095,"score_linear":62618.0,"score_lmetric":8095},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1024,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":8095,"score_linear":79663.0,"score_lmetric":87246},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":8095,"score_linear":121968.0,"score_lmetric":8095},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43894,"ongoing_decode_tokens":88814,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":8095,"score_linear":43894.0,"score_lmetric":-5593}],"chosen_score_linear":43894.0,"chosen_score_lmetric":-5593,"t_first_token":387019.44598029,"t_first_token_unix":1779817884.4599235,"t_done":387020.15437296,"t_done_unix":1779817885.1683161},{"request_id":"1315567:1:1315567:327","session_id":"1315567","input_length":16960,"t_proxy_recv":386999.464053871,"t_decision_unix":1779817864.477995,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":9280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":597,"cache_hit":4096,"new_prefill":12864,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":896,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":957,"cache_hit":7680,"new_prefill":9280,"score_linear":24760.0,"score_lmetric":23800},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":18489,"num_requests":1,"active_p_offloads":0,"cached_blocks":836,"cache_hit":0,"new_prefill":16960,"score_linear":23097.0,"score_lmetric":35449},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":772,"cache_hit":7680,"new_prefill":9280,"score_linear":114288.0,"score_lmetric":9280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12131,"ongoing_decode_tokens":0,"pending_prefill_tokens":43363,"num_requests":0,"active_p_offloads":0,"cached_blocks":980,"cache_hit":7680,"new_prefill":9280,"score_linear":4451.0,"score_lmetric":0}],"chosen_score_linear":4451.0,"chosen_score_lmetric":0,"t_first_token":387008.629189082,"t_first_token_unix":1779817873.643133,"t_done":387020.256111542,"t_done_unix":1779817885.2700548},{"request_id":"1277428:4:1321259:352","session_id":"1277428","input_length":33906,"t_proxy_recv":387019.622722576,"t_decision_unix":1779817884.636664,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9211349023771603,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":2674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":4608,"new_prefill":29298,"score_linear":58010.0,"score_lmetric":29298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1024,"cache_hit":31232,"new_prefill":2674,"score_linear":-31232.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":33906,"score_linear":79663.0,"score_lmetric":113057},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":33906,"score_linear":121968.0,"score_lmetric":33906},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":51989,"ongoing_decode_tokens":96909,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":33906,"score_linear":51989.0,"score_lmetric":40436}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":387020.241426831,"t_first_token_unix":1779817885.2553701,"t_done":387020.877740039,"t_done_unix":1779817885.891683},{"request_id":"1318604:4:1321889:356","session_id":"1318604","input_length":21033,"t_proxy_recv":387021.805798243,"t_decision_unix":1779817886.8197393,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":17920,"affinity_cache_ratio":0.8519944848571293,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":3113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":17920,"new_prefill":3113,"score_linear":-17920.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21033,"score_linear":62618.0,"score_lmetric":21033},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":21033,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":0,"new_prefill":21033,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":21033,"score_linear":79663.0,"score_lmetric":100184},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":21033,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188808,"ongoing_decode_tokens":188808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":21033,"score_linear":188808.0,"score_lmetric":42066},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":21033,"score_linear":81480.0,"score_lmetric":44483}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":387022.331408244,"t_first_token_unix":1779817887.3453517,"t_done":387022.566734209,"t_done_unix":1779817887.580678},{"request_id":"1316848:5:1322192:357","session_id":"1316848","input_length":21471,"t_proxy_recv":387022.983130724,"t_decision_unix":1779817887.9970722,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9776908388058311,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":479,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21471,"score_linear":62618.0,"score_lmetric":21471},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":20992,"new_prefill":479,"score_linear":-20992.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":21471,"score_linear":79663.0,"score_lmetric":100622},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188808,"ongoing_decode_tokens":188808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":21471,"score_linear":188808.0,"score_lmetric":42942},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":21471,"score_linear":81480.0,"score_lmetric":44921}],"chosen_score_linear":-20992.0,"chosen_score_lmetric":0,"t_first_token":387023.036967843,"t_first_token_unix":1779817888.0509112,"t_done":387023.564108592,"t_done_unix":1779817888.578052},{"request_id":"1269373:14:1321512:354","session_id":"1269373","input_length":66840,"t_proxy_recv":387020.463500977,"t_decision_unix":1779817885.477442,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":66560,"affinity_cache_ratio":0.9958108916816277,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66560,"estimated_new_tokens":280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":4096,"new_prefill":62744,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":66840,"score_linear":62618.0,"score_lmetric":66840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":66840,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":33906,"ongoing_decode_tokens":33906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1024,"cache_hit":7680,"new_prefill":59160,"score_linear":26226.0,"score_lmetric":59160},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":66840,"score_linear":79663.0,"score_lmetric":145991},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":66840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":66560,"new_prefill":280,"score_linear":55408.0,"score_lmetric":280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":7680,"new_prefill":59160,"score_linear":73800.0,"score_lmetric":82610}],"chosen_score_linear":55408.0,"chosen_score_lmetric":280,"t_first_token":387020.693886317,"t_first_token_unix":1779817885.7078304,"t_done":387024.673799476,"t_done_unix":1779817889.6877427},{"request_id":"1318031:2:1322552:360","session_id":"1318031","input_length":11145,"t_proxy_recv":387024.319475793,"t_decision_unix":1779817889.3334172,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.45939883355764916,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":6025,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":11145,"score_linear":33182.0,"score_lmetric":44327},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":11145,"score_linear":62618.0,"score_lmetric":11145},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":11145,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8939,"ongoing_decode_tokens":0,"pending_prefill_tokens":8939,"num_requests":1,"active_p_offloads":0,"cached_blocks":1030,"cache_hit":0,"new_prefill":11145,"score_linear":8939.0,"score_lmetric":20084},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":11145,"score_linear":79663.0,"score_lmetric":90296},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":5120,"new_prefill":6025,"score_linear":-5120.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188808,"ongoing_decode_tokens":188808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":11145,"score_linear":188808.0,"score_lmetric":22290},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":11145,"score_linear":81480.0,"score_lmetric":34595}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":387024.888746288,"t_first_token_unix":1779817889.90269,"t_done":387024.937549033,"t_done_unix":1779817889.951492},{"request_id":"1322540:1:1322540:359","session_id":"1322540","input_length":8939,"t_proxy_recv":387024.266411027,"t_decision_unix":1779817889.2803524,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8939,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":8939,"score_linear":33182.0,"score_lmetric":42121},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":8939,"score_linear":62618.0,"score_lmetric":8939},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1030,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":8939,"score_linear":79663.0,"score_lmetric":88090},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188808,"ongoing_decode_tokens":188808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":8939,"score_linear":188808.0,"score_lmetric":17878},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":8939,"score_linear":81480.0,"score_lmetric":32389}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387024.936632181,"t_first_token_unix":1779817889.9505756,"t_done":387025.194257888,"t_done_unix":1779817890.208201},{"request_id":"1322540:2:1323519:362","session_id":"1322540","input_length":9016,"t_proxy_recv":387027.561829288,"t_decision_unix":1779817892.5757706,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9653948535936113,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":312,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":9016,"score_linear":33182.0,"score_lmetric":42198},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9016,"score_linear":62618.0,"score_lmetric":9016},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":9016,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1047,"cache_hit":8704,"new_prefill":312,"score_linear":-8704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":9016,"score_linear":79663.0,"score_lmetric":88167},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":9016,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":9016,"score_linear":121968.0,"score_lmetric":9016},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94488,"ongoing_decode_tokens":71854,"pending_prefill_tokens":28778,"num_requests":2,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":9016,"score_linear":94488.0,"score_lmetric":75588}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":387027.598399763,"t_first_token_unix":1779817892.6123428,"t_done":387028.279250364,"t_done_unix":1779817893.293194},{"request_id":"1316848:6:1323535:363","session_id":"1316848","input_length":24395,"t_proxy_recv":387027.612499216,"t_decision_unix":1779817892.6264334,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":21504,"affinity_cache_ratio":0.8814921090387374,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":2891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":24395,"score_linear":33182.0,"score_lmetric":57577},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":24395,"score_linear":62618.0,"score_lmetric":24395},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":24395,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9016,"ongoing_decode_tokens":9016,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1047,"cache_hit":21504,"new_prefill":2891,"score_linear":-12488.0,"score_lmetric":2891},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":24395,"score_linear":79663.0,"score_lmetric":103546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":24395,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":24395,"score_linear":121968.0,"score_lmetric":24395},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94488,"ongoing_decode_tokens":71854,"pending_prefill_tokens":28778,"num_requests":2,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":24395,"score_linear":94488.0,"score_lmetric":106346}],"chosen_score_linear":-12488.0,"chosen_score_lmetric":2891,"t_first_token":387028.18534416,"t_first_token_unix":1779817893.1992884,"t_done":387028.790319298,"t_done_unix":1779817893.8042629},{"request_id":"1320630:2:1323748:364","session_id":"1320630","input_length":11298,"t_proxy_recv":387028.334082782,"t_decision_unix":1779817893.3480241,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":5,"affinity_cache_hit":3072,"affinity_cache_ratio":0.27190653212958044,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":11298,"score_linear":33182.0,"score_lmetric":11298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":11298,"score_linear":62618.0,"score_lmetric":11298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":11298,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24395,"ongoing_decode_tokens":24395,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1047,"cache_hit":0,"new_prefill":11298,"score_linear":24395.0,"score_lmetric":11298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":11298,"score_linear":79663.0,"score_lmetric":11298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":11298,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":11298,"score_linear":121968.0,"score_lmetric":11298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94488,"ongoing_decode_tokens":71854,"pending_prefill_tokens":28778,"num_requests":2,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":3072,"new_prefill":8226,"score_linear":91416.0,"score_lmetric":74008}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387029.259162478,"t_first_token_unix":1779817894.2731056,"t_done":387029.534718701,"t_done_unix":1779817894.5486617},{"request_id":"1321042:2:1323492:361","session_id":"1321042","input_length":13008,"t_proxy_recv":387027.494133707,"t_decision_unix":1779817892.5080748,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":7680,"affinity_cache_ratio":0.5904059040590406,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":5328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":0,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":13008,"score_linear":33182.0,"score_lmetric":46190},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":13008,"score_linear":62618.0,"score_lmetric":13008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1047,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":13008,"score_linear":79663.0,"score_lmetric":92159},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":893,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":13008,"score_linear":121968.0,"score_lmetric":13008},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":7680,"new_prefill":5328,"score_linear":73800.0,"score_lmetric":28778}],"chosen_score_linear":73800.0,"chosen_score_lmetric":28778,"t_first_token":387029.948807429,"t_first_token_unix":1779817894.9627507,"t_done":387030.943021602,"t_done_unix":1779817895.9569652},{"request_id":"1279412:14:1319059:344","session_id":"1279412","input_length":71854,"t_proxy_recv":387014.233199239,"t_decision_unix":1779817879.2471404,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9049461407854816,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":6830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":639,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":71854,"score_linear":62618.0,"score_lmetric":71854},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":71854,"score_linear":79663.0,"score_lmetric":151005},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":12800,"new_prefill":59054,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":71854,"score_linear":188103.0,"score_lmetric":143708},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27960,"ongoing_decode_tokens":16960,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":65024,"new_prefill":6830,"score_linear":-92984.0,"score_lmetric":0}],"chosen_score_linear":-92984.0,"chosen_score_lmetric":0,"t_first_token":387017.198558666,"t_first_token_unix":1779817882.2125041,"t_done":387031.335901202,"t_done_unix":1779817896.349861},{"request_id":"1324227:1:1324227:367","session_id":"1324227","input_length":14863,"t_proxy_recv":387030.124341599,"t_decision_unix":1779817895.138283,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14863,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":14863,"score_linear":33182.0,"score_lmetric":14863},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14863,"score_linear":62618.0,"score_lmetric":14863},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1052,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":14863,"score_linear":79663.0,"score_lmetric":14863},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":14863,"score_linear":121968.0,"score_lmetric":14863},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94488,"ongoing_decode_tokens":139408,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":14863,"score_linear":94488.0,"score_lmetric":2350}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387031.445408964,"t_first_token_unix":1779817896.4593523,"t_done":387031.691350168,"t_done_unix":1779817896.7052937},{"request_id":"1316848:7:1325031:371","session_id":"1316848","input_length":26994,"t_proxy_recv":387032.786934572,"t_decision_unix":1779817897.8008757,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24064,"affinity_cache_ratio":0.8914573608950137,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":2930,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":26994,"score_linear":33182.0,"score_lmetric":26994},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":26994,"score_linear":62618.0,"score_lmetric":26994},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":26994,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1052,"cache_hit":24064,"new_prefill":2930,"score_linear":-24064.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":26994,"score_linear":79663.0,"score_lmetric":26994},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":26994,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":26994,"score_linear":121968.0,"score_lmetric":26994},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":86340,"ongoing_decode_tokens":126948,"pending_prefill_tokens":-9376,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":26994,"score_linear":86340.0,"score_lmetric":35236}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":387033.350870789,"t_first_token_unix":1779817898.3648143,"t_done":387033.98273273,"t_done_unix":1779817898.9966764},{"request_id":"1322540:3:1325410:373","session_id":"1322540","input_length":12118,"t_proxy_recv":387034.158889316,"t_decision_unix":1779817899.1728306,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.7182703416405347,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":3414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":12118,"score_linear":33182.0,"score_lmetric":12118},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":12118,"score_linear":62618.0,"score_lmetric":12118},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":12118,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1057,"cache_hit":8704,"new_prefill":3414,"score_linear":-8704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":12118,"score_linear":79663.0,"score_lmetric":12118},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":12118,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":12118,"score_linear":121968.0,"score_lmetric":12118},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":86340,"ongoing_decode_tokens":131260,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":12118,"score_linear":86340.0,"score_lmetric":-3140}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":387034.519257138,"t_first_token_unix":1779817899.5332031,"t_done":387034.642234185,"t_done_unix":1779817899.6561775},{"request_id":"1315567:2:1319894:346","session_id":"1315567","input_length":54546,"t_proxy_recv":387020.28009582,"t_decision_unix":1779817885.2940373,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":17408,"affinity_cache_ratio":0.31914347523191433,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":37138,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":4096,"new_prefill":50450,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":54546,"score_linear":62618.0,"score_lmetric":54546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":54546,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":33906,"ongoing_decode_tokens":33906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1024,"cache_hit":7680,"new_prefill":46866,"score_linear":26226.0,"score_lmetric":46866},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":54546,"score_linear":79663.0,"score_lmetric":133697},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":54546,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":779,"cache_hit":7680,"new_prefill":46866,"score_linear":114288.0,"score_lmetric":46866},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26934,"ongoing_decode_tokens":71854,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":17408,"new_prefill":37138,"score_linear":9526.0,"score_lmetric":0}],"chosen_score_linear":9526.0,"chosen_score_lmetric":0,"t_first_token":387029.439470927,"t_first_token_unix":1779817894.453421,"t_done":387035.067695102,"t_done_unix":1779817900.0816383},{"request_id":"1279412:15:1321613:355","session_id":"1279412","input_length":72402,"t_proxy_recv":387031.351799351,"t_decision_unix":1779817896.365741,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":71680,"affinity_cache_ratio":0.990027899781774,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":722,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":72402,"score_linear":33182.0,"score_lmetric":72402},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":72402,"score_linear":62618.0,"score_lmetric":72402},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14863,"ongoing_decode_tokens":0,"pending_prefill_tokens":14863,"num_requests":1,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":72402,"score_linear":14863.0,"score_lmetric":87265},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1052,"cache_hit":0,"new_prefill":72402,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":72402,"score_linear":79663.0,"score_lmetric":72402},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":12800,"new_prefill":59602,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":72402,"score_linear":121968.0,"score_lmetric":72402},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9626,"ongoing_decode_tokens":54546,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":71680,"new_prefill":722,"score_linear":-62054.0,"score_lmetric":0}],"chosen_score_linear":-62054.0,"chosen_score_lmetric":0,"t_first_token":387031.593375878,"t_first_token_unix":1779817896.6073198,"t_done":387035.307588525,"t_done_unix":1779817900.321532},{"request_id":"1317598:1:1317598:335","session_id":"1317598","input_length":79663,"t_proxy_recv":387006.63198304,"t_decision_unix":1779817871.6459243,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":79151,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":603,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":672,"cache_hit":512,"new_prefill":79151,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":872,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":121968,"pending_prefill_tokens":3159,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":79663,"score_linear":188103.0,"score_lmetric":165644},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94040,"ongoing_decode_tokens":0,"pending_prefill_tokens":53080,"num_requests":2,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":79663,"score_linear":94040.0,"score_lmetric":265486}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":387028.1439292,"t_first_token_unix":1779817893.1578727,"t_done":387035.312927178,"t_done_unix":1779817900.3268702},{"request_id":"1325987:1:1325987:376","session_id":"1325987","input_length":1823,"t_proxy_recv":387036.252525015,"t_decision_unix":1779817901.2664654,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-16866,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1823,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":1823,"score_linear":33182.0,"score_lmetric":1823},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":1823,"score_linear":62618.0,"score_lmetric":1823},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":1823,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":1823,"score_linear":66703.0,"score_lmetric":68526},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":828,"cache_hit":0,"new_prefill":1823,"score_linear":81220.0,"score_lmetric":1823},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":1823,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":1823,"score_linear":191009.0,"score_lmetric":3646},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90146,"ongoing_decode_tokens":59442,"pending_prefill_tokens":-10256,"num_requests":2,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":1823,"score_linear":90146.0,"score_lmetric":-16866}],"chosen_score_linear":90146.0,"chosen_score_lmetric":-16866,"t_first_token":387037.061287989,"t_first_token_unix":1779817902.0752318,"t_done":387038.373091988,"t_done_unix":1779817903.387035},{"request_id":"1317598:2:1324364:368","session_id":"1317598","input_length":81220,"t_proxy_recv":387035.346362216,"t_decision_unix":1779817900.3603039,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":80384,"affinity_cache_ratio":0.9897069687269145,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":80384,"estimated_new_tokens":836,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":81220,"score_linear":33182.0,"score_lmetric":81220},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":81220,"score_linear":62618.0,"score_lmetric":81220},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":81220,"score_linear":66703.0,"score_lmetric":147923},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":828,"cache_hit":80384,"new_prefill":836,"score_linear":-80384.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":121968,"pending_prefill_tokens":1969,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":81220,"score_linear":191009.0,"score_lmetric":166378},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90146,"ongoing_decode_tokens":59442,"pending_prefill_tokens":-10256,"num_requests":2,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":81220,"score_linear":90146.0,"score_lmetric":141928}],"chosen_score_linear":-80384.0,"chosen_score_lmetric":0,"t_first_token":387035.924947641,"t_first_token_unix":1779817900.938891,"t_done":387038.765331511,"t_done_unix":1779817903.779275},{"request_id":"1326192:1:1326192:378","session_id":"1326192","input_length":9513,"t_proxy_recv":387037.138642202,"t_decision_unix":1779817902.1525834,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-12525,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9513,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":9513,"score_linear":33182.0,"score_lmetric":9513},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9513,"score_linear":62618.0,"score_lmetric":9513},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":9513,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":9513,"score_linear":66703.0,"score_lmetric":76216},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":828,"cache_hit":0,"new_prefill":9513,"score_linear":81220.0,"score_lmetric":9513},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":9513,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":9513,"score_linear":191009.0,"score_lmetric":19026},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91969,"ongoing_decode_tokens":136889,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":9513,"score_linear":91969.0,"score_lmetric":-12525}],"chosen_score_linear":91969.0,"chosen_score_lmetric":-12525,"t_first_token":387037.935897948,"t_first_token_unix":1779817902.9498413,"t_done":387039.552732471,"t_done_unix":1779817904.5666761},{"request_id":"1324964:1:1324964:370","session_id":"1324964","input_length":4312,"t_proxy_recv":387032.544042556,"t_decision_unix":1779817897.5579832,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-9376,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4312,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":4312,"score_linear":33182.0,"score_lmetric":4312},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":4312,"score_linear":62618.0,"score_lmetric":4312},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1052,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":4312,"score_linear":79663.0,"score_lmetric":4312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":4312,"score_linear":121968.0,"score_lmetric":4312},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":82028,"ongoing_decode_tokens":126948,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":4312,"score_linear":82028.0,"score_lmetric":-9376}],"chosen_score_linear":82028.0,"chosen_score_lmetric":-9376,"t_first_token":387032.893300973,"t_first_token_unix":1779817897.9072447,"t_done":387039.80239659,"t_done_unix":1779817904.81634},{"request_id":"1326192:2:1327234:381","session_id":"1326192","input_length":15253,"t_proxy_recv":387040.692411033,"t_decision_unix":1779817905.7063525,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.6042090080639874,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":6037,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":15253,"score_linear":33182.0,"score_lmetric":15253},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":15253,"score_linear":62618.0,"score_lmetric":15253},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":15253,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":15253,"score_linear":108072.0,"score_lmetric":254775},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":15253,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":15253,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":15253,"score_linear":191009.0,"score_lmetric":30506},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":85834,"ongoing_decode_tokens":130754,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1264,"cache_hit":9216,"new_prefill":6037,"score_linear":76618.0,"score_lmetric":-7651}],"chosen_score_linear":76618.0,"chosen_score_lmetric":-7651,"t_first_token":387041.393571219,"t_first_token_unix":1779817906.4075143,"t_done":387042.534050528,"t_done_unix":1779817907.5479941},{"request_id":"1279412:16:1323780:365","session_id":"1279412","input_length":75624,"t_proxy_recv":387035.335290905,"t_decision_unix":1779817900.3492327,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9546175817200888,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":3432,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":75624,"score_linear":33182.0,"score_lmetric":75624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":75624,"score_linear":62618.0,"score_lmetric":75624},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":75624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":75624,"score_linear":66703.0,"score_lmetric":142327},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":828,"cache_hit":0,"new_prefill":75624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":12800,"new_prefill":62824,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":121968,"pending_prefill_tokens":1969,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":75624,"score_linear":191009.0,"score_lmetric":155186},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":14522,"ongoing_decode_tokens":59442,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":72192,"new_prefill":3432,"score_linear":-57670.0,"score_lmetric":-10256}],"chosen_score_linear":-57670.0,"chosen_score_lmetric":-10256,"t_first_token":387036.842231166,"t_first_token_unix":1779817901.8561747,"t_done":387042.63388165,"t_done_unix":1779817907.6478252},{"request_id":"1266668:12:1303535:276","session_id":"1266668","input_length":121968,"t_proxy_recv":386956.963107572,"t_decision_unix":1779817821.9770489,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":97792,"affinity_cache_ratio":0.8017840745113473,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":24176,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":536,"cache_hit":4096,"new_prefill":117872,"score_linear":39511.0,"score_lmetric":117872},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":121968,"score_linear":30645.0,"score_lmetric":121968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":121968,"score_linear":14944.0,"score_lmetric":136912},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108775,"ongoing_decode_tokens":28972,"pending_prefill_tokens":443,"num_requests":3,"active_p_offloads":0,"cached_blocks":855,"cache_hit":7680,"new_prefill":114288,"score_linear":101095.0,"score_lmetric":344193},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":559,"cache_hit":0,"new_prefill":121968,"score_linear":15081.0,"score_lmetric":137049},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":121968,"score_linear":34706.0,"score_lmetric":121968},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":748,"cache_hit":97792,"new_prefill":24176,"score_linear":-43341.0,"score_lmetric":24176},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-1739,"ongoing_decode_tokens":43181,"pending_prefill_tokens":-13688,"num_requests":0,"active_p_offloads":0,"cached_blocks":783,"cache_hit":7680,"new_prefill":114288,"score_linear":-9419.0,"score_lmetric":0}],"chosen_score_linear":-43341.0,"chosen_score_lmetric":24176,"t_first_token":386972.940864408,"t_first_token_unix":1779817837.9548147,"t_done":387042.9098342,"t_done_unix":1779817907.9237778},{"request_id":"1269373:15:1325630:375","session_id":"1269373","input_length":69041,"t_proxy_recv":387035.014248912,"t_decision_unix":1779817900.0281904,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":67072,"affinity_cache_ratio":0.971480714358135,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":67072,"estimated_new_tokens":1969,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":4096,"new_prefill":64945,"score_linear":29086.0,"score_lmetric":64945},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":69041,"score_linear":62618.0,"score_lmetric":69041},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":69041,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":7680,"new_prefill":61361,"score_linear":59023.0,"score_lmetric":128064},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":69041,"score_linear":79663.0,"score_lmetric":69041},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":69041,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":67072,"new_prefill":1969,"score_linear":54896.0,"score_lmetric":1969},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":86340,"ongoing_decode_tokens":131260,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":7680,"new_prefill":61361,"score_linear":78660.0,"score_lmetric":95346}],"chosen_score_linear":54896.0,"chosen_score_lmetric":1969,"t_first_token":387036.027015777,"t_first_token_unix":1779817901.0409596,"t_done":387043.964103996,"t_done_unix":1779817908.9780474},{"request_id":"1324964:2:1327382:382","session_id":"1324964","input_length":5146,"t_proxy_recv":387041.296245158,"t_decision_unix":1779817906.3101864,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.895452778857365,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":538,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":5146,"score_linear":33182.0,"score_lmetric":5146},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":5146,"score_linear":62618.0,"score_lmetric":5146},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":5146,"score_linear":108072.0,"score_lmetric":224454},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":5146,"score_linear":191009.0,"score_lmetric":10292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":101087,"ongoing_decode_tokens":130754,"pending_prefill_tokens":-7651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1264,"cache_hit":4608,"new_prefill":538,"score_linear":96479.0,"score_lmetric":-14226}],"chosen_score_linear":96479.0,"chosen_score_lmetric":-14226,"t_first_token":387041.575927864,"t_first_token_unix":1779817906.5898714,"t_done":387045.294572092,"t_done_unix":1779817910.308515},{"request_id":"1324964:3:1328499:384","session_id":"1324964","input_length":5234,"t_proxy_recv":387045.31316664,"t_decision_unix":1779817910.3271074,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":5120,"affinity_cache_ratio":0.9782193351165457,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":114,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":5234,"score_linear":33182.0,"score_lmetric":5234},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":5234,"score_linear":62618.0,"score_lmetric":5234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":5234,"score_linear":108072.0,"score_lmetric":224718},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":5234,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":5120,"new_prefill":114,"score_linear":86098.0,"score_lmetric":-13574}],"chosen_score_linear":86098.0,"chosen_score_lmetric":-13574,"t_first_token":387045.363014814,"t_first_token_unix":1779817910.3769586,"t_done":387045.936145143,"t_done_unix":1779817910.9500892},{"request_id":"1322225:1:1322225:358","session_id":"1322225","input_length":33182,"t_proxy_recv":387023.087548011,"t_decision_unix":1779817888.1014893,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":33182,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":33182,"score_linear":62618.0,"score_lmetric":33182},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21471,"ongoing_decode_tokens":21471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1029,"cache_hit":0,"new_prefill":33182,"score_linear":21471.0,"score_lmetric":33182},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":33182,"score_linear":79663.0,"score_lmetric":112333},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188808,"ongoing_decode_tokens":188808,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":33182,"score_linear":188808.0,"score_lmetric":66364},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81480,"ongoing_decode_tokens":71854,"pending_prefill_tokens":23450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":33182,"score_linear":81480.0,"score_lmetric":56632}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387027.767025428,"t_first_token_unix":1779817892.7809684,"t_done":387047.534960452,"t_done_unix":1779817912.5489037},{"request_id":"1325987:2:1329336:391","session_id":"1325987","input_length":7423,"t_proxy_recv":387048.371632922,"t_decision_unix":1779817913.3855743,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":1536,"affinity_cache_ratio":0.20692442408729625,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":-23403,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":5887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":7423,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":7423,"score_linear":62618.0,"score_lmetric":7423},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":7423,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":7423,"score_linear":108072.0,"score_lmetric":231285},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":7423,"score_linear":116091.0,"score_lmetric":30126},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":7423,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":7423,"score_linear":36880.0,"score_lmetric":44303},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105924,"ongoing_decode_tokens":150844,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":1536,"new_prefill":5887,"score_linear":104388.0,"score_lmetric":-23403}],"chosen_score_linear":104388.0,"chosen_score_lmetric":-23403,"t_first_token":387048.823884959,"t_first_token_unix":1779817913.8378282,"t_done":387050.35919853,"t_done_unix":1779817915.3731415},{"request_id":"1329110:1:1329110:389","session_id":"1329110","input_length":9292,"t_proxy_recv":387047.524625996,"t_decision_unix":1779817912.5385675,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-4396,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":9292,"score_linear":33182.0,"score_lmetric":9292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9292,"score_linear":62618.0,"score_lmetric":9292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":9292,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":9292,"score_linear":108072.0,"score_lmetric":236892},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":9292,"score_linear":116091.0,"score_lmetric":33864},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":9292,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":9292,"score_linear":36880.0,"score_lmetric":46172},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":0,"new_prefill":9292,"score_linear":91218.0,"score_lmetric":-4396}],"chosen_score_linear":91218.0,"chosen_score_lmetric":-4396,"t_first_token":387048.32767755,"t_first_token_unix":1779817913.341621,"t_done":387050.608132048,"t_done_unix":1779817915.622075},{"request_id":"1322540:4:1326861:380","session_id":"1322540","input_length":13249,"t_proxy_recv":387039.408937745,"t_decision_unix":1779817904.422879,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":11776,"affinity_cache_ratio":0.8888217978715375,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":1473,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":13249,"score_linear":33182.0,"score_lmetric":13249},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":13249,"score_linear":62618.0,"score_lmetric":13249},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":13249,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94823,"ongoing_decode_tokens":0,"pending_prefill_tokens":68199,"num_requests":2,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":11776,"new_prefill":1473,"score_linear":83047.0,"score_lmetric":139344},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":13249,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":13249,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":13249,"score_linear":191009.0,"score_lmetric":26498},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":99659,"ongoing_decode_tokens":144579,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":1237,"cache_hit":0,"new_prefill":13249,"score_linear":99659.0,"score_lmetric":-1317}],"chosen_score_linear":83047.0,"chosen_score_lmetric":139344,"t_first_token":387050.679228558,"t_first_token_unix":1779817915.6931715,"t_done":387050.914053437,"t_done_unix":1779817915.9279964},{"request_id":"1324964:4:1329201:390","session_id":"1324964","input_length":5414,"t_proxy_recv":387047.833990724,"t_decision_unix":1779817912.8479323,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":5120,"affinity_cache_ratio":0.9456963428149243,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":294,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":5414,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":5414,"score_linear":62618.0,"score_lmetric":5414},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":5414,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":5414,"score_linear":108072.0,"score_lmetric":225258},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":5414,"score_linear":116091.0,"score_lmetric":26108},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":5414,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":5414,"score_linear":36880.0,"score_lmetric":42294},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":100510,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-4396,"num_requests":2,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":5120,"new_prefill":294,"score_linear":95390.0,"score_lmetric":-8204}],"chosen_score_linear":95390.0,"chosen_score_lmetric":-8204,"t_first_token":387048.361581059,"t_first_token_unix":1779817913.375524,"t_done":387050.924083069,"t_done_unix":1779817915.938026},{"request_id":"1325541:1:1325541:374","session_id":"1325541","input_length":66703,"t_proxy_recv":387034.749657788,"t_decision_unix":1779817899.7635992,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66703,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":66703,"score_linear":33182.0,"score_lmetric":66703},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":66703,"score_linear":62618.0,"score_lmetric":66703},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":66703,"score_linear":79663.0,"score_lmetric":66703},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":66703,"score_linear":121968.0,"score_lmetric":66703},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":86340,"ongoing_decode_tokens":131260,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":66703,"score_linear":86340.0,"score_lmetric":106030}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387050.672681556,"t_first_token_unix":1779817915.6866248,"t_done":387051.034542938,"t_done_unix":1779817916.0484862},{"request_id":"1328753:1:1328753:387","session_id":"1328753","input_length":36880,"t_proxy_recv":387046.260035228,"t_decision_unix":1779817911.2739768,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":36880,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":36880,"score_linear":33182.0,"score_lmetric":36880},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":36880,"score_linear":62618.0,"score_lmetric":36880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":36880,"score_linear":108072.0,"score_lmetric":319656},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81827,"ongoing_decode_tokens":0,"pending_prefill_tokens":419,"num_requests":1,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":36880,"score_linear":81827.0,"score_lmetric":37299},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":0,"new_prefill":36880,"score_linear":91218.0,"score_lmetric":23192}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387051.830662659,"t_first_token_unix":1779817916.844606,"t_done":387052.203307361,"t_done_unix":1779817917.2172506},{"request_id":"1316848:8:1326380:379","session_id":"1316848","input_length":28120,"t_proxy_recv":387037.746095641,"t_decision_unix":1779817902.7600372,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9467994310099573,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":1496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":28120,"score_linear":33182.0,"score_lmetric":28120},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":28120,"score_linear":62618.0,"score_lmetric":28120},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":28120,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":26624,"new_prefill":1496,"score_linear":40079.0,"score_lmetric":68199},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":828,"cache_hit":0,"new_prefill":28120,"score_linear":81220.0,"score_lmetric":28120},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":28120,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":28120,"score_linear":191009.0,"score_lmetric":56240},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":101482,"ongoing_decode_tokens":136889,"pending_prefill_tokens":-4175,"num_requests":4,"active_p_offloads":0,"cached_blocks":1234,"cache_hit":0,"new_prefill":28120,"score_linear":101482.0,"score_lmetric":95780}],"chosen_score_linear":40079.0,"chosen_score_lmetric":68199,"t_first_token":387050.674194746,"t_first_token_unix":1779817915.6881378,"t_done":387052.742536855,"t_done_unix":1779817917.7564802},{"request_id":"1328753:2:1330033:395","session_id":"1328753","input_length":37007,"t_proxy_recv":387052.211268199,"t_decision_unix":1779817917.22521,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9961358661874781,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":37007,"score_linear":62618.0,"score_lmetric":37007},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28120,"ongoing_decode_tokens":28120,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":37007,"score_linear":28120.0,"score_lmetric":37007},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":37007,"score_linear":206696.0,"score_lmetric":112500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":905,"cache_hit":36864,"new_prefill":143,"score_linear":-36864.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":120481,"ongoing_decode_tokens":158710,"pending_prefill_tokens":-12117,"num_requests":4,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":0,"new_prefill":37007,"score_linear":120481.0,"score_lmetric":99560}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":387052.312702273,"t_first_token_unix":1779817917.3266451,"t_done":387052.76373116,"t_done_unix":1779817917.777674},{"request_id":"1324964:5:1330169:397","session_id":"1324964","input_length":6691,"t_proxy_recv":387051.228719488,"t_decision_unix":1779817916.2426608,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":5120,"affinity_cache_ratio":0.7652069944701838,"affinity_num_requests":3,"avg_num_requests":1.125,"fallback_score":-1176,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":1571,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":6691,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":6691,"score_linear":62618.0,"score_lmetric":6691},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":6691,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28120,"ongoing_decode_tokens":28120,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":6691,"score_linear":28120.0,"score_lmetric":6691},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":6691,"score_linear":206696.0,"score_lmetric":21552},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":6691,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":6691,"score_linear":36880.0,"score_lmetric":43571},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":113790,"ongoing_decode_tokens":146985,"pending_prefill_tokens":-1963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":5120,"new_prefill":1571,"score_linear":108670.0,"score_lmetric":-1176}],"chosen_score_linear":108670.0,"chosen_score_lmetric":-1176,"t_first_token":387052.305709996,"t_first_token_unix":1779817917.3196528,"t_done":387054.326651661,"t_done_unix":1779817919.340595},{"request_id":"1330881:1:1330881:400","session_id":"1330881","input_length":3866,"t_proxy_recv":387053.887326656,"t_decision_unix":1779817918.9012678,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3866,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":3866,"score_linear":62618.0,"score_lmetric":3866},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28615,"ongoing_decode_tokens":28615,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":0,"new_prefill":3866,"score_linear":28615.0,"score_lmetric":3866},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":3866,"score_linear":206696.0,"score_lmetric":13077},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":905,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146169,"ongoing_decode_tokens":165401,"pending_prefill_tokens":-2848,"num_requests":5,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":0,"new_prefill":3866,"score_linear":146169.0,"score_lmetric":5090}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387054.134173358,"t_first_token_unix":1779817919.148116,"t_done":387054.488980192,"t_done_unix":1779817919.5029233},{"request_id":"1316848:9:1328693:386","session_id":"1316848","input_length":28615,"t_proxy_recv":387052.748812453,"t_decision_unix":1779817917.762754,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9840992486458151,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":455,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":28615,"score_linear":62618.0,"score_lmetric":28615},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":28160,"new_prefill":455,"score_linear":-28160.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":28615,"score_linear":206696.0,"score_lmetric":87324},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37007,"ongoing_decode_tokens":37007,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":905,"cache_hit":0,"new_prefill":28615,"score_linear":37007.0,"score_lmetric":28615},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":120481,"ongoing_decode_tokens":165401,"pending_prefill_tokens":-13688,"num_requests":4,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":0,"new_prefill":28615,"score_linear":120481.0,"score_lmetric":59708}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":387052.863601647,"t_first_token_unix":1779817917.8775449,"t_done":387054.528785581,"t_done_unix":1779817919.5427287},{"request_id":"1330130:1:1330130:396","session_id":"1330130","input_length":11725,"t_proxy_recv":387051.127470498,"t_decision_unix":1779817916.141412,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-3926,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11725,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":11725,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":11725,"score_linear":62618.0,"score_lmetric":11725},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":11725,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28120,"ongoing_decode_tokens":28120,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":11725,"score_linear":28120.0,"score_lmetric":11725},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":11725,"score_linear":206696.0,"score_lmetric":36654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":11725,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":11725,"score_linear":36880.0,"score_lmetric":48605},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":102065,"ongoing_decode_tokens":146985,"pending_prefill_tokens":-13688,"num_requests":2,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":0,"new_prefill":11725,"score_linear":102065.0,"score_lmetric":-3926}],"chosen_score_linear":102065.0,"chosen_score_lmetric":-3926,"t_first_token":387052.140268588,"t_first_token_unix":1779817917.1542118,"t_done":387055.643244483,"t_done_unix":1779817920.657188},{"request_id":"1326192:3:1330643:399","session_id":"1326192","input_length":25688,"t_proxy_recv":387053.028391631,"t_decision_unix":1779817918.042333,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14848,"affinity_cache_ratio":0.5780130800373715,"affinity_num_requests":4,"avg_num_requests":1.125,"fallback_score":-11392,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":10840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":25688,"score_linear":62618.0,"score_lmetric":25688},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28615,"ongoing_decode_tokens":28615,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1198,"cache_hit":0,"new_prefill":25688,"score_linear":28615.0,"score_lmetric":25688},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":25688,"score_linear":206696.0,"score_lmetric":78543},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":905,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":120481,"ongoing_decode_tokens":165401,"pending_prefill_tokens":-13688,"num_requests":4,"active_p_offloads":0,"cached_blocks":1312,"cache_hit":14848,"new_prefill":10840,"score_linear":105633.0,"score_lmetric":-11392}],"chosen_score_linear":105633.0,"chosen_score_lmetric":-11392,"t_first_token":387054.787101374,"t_first_token_unix":1779817919.8010447,"t_done":387055.811647678,"t_done_unix":1779817920.825591},{"request_id":"1330130:2:1331784:403","session_id":"1330130","input_length":14067,"t_proxy_recv":387056.933038923,"t_decision_unix":1779817921.9469802,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":11776,"affinity_cache_ratio":0.8371365607450061,"affinity_num_requests":4,"avg_num_requests":1.125,"fallback_score":-45588,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":2291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14067,"score_linear":62618.0,"score_lmetric":14067},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":0,"new_prefill":14067,"score_linear":28977.0,"score_lmetric":14067},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":14067,"score_linear":206696.0,"score_lmetric":43680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":141895,"ongoing_decode_tokens":186815,"pending_prefill_tokens":-13688,"num_requests":4,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":11776,"new_prefill":2291,"score_linear":130119.0,"score_lmetric":-45588}],"chosen_score_linear":130119.0,"chosen_score_lmetric":-45588,"t_first_token":387057.300385114,"t_first_token_unix":1779817922.3143287,"t_done":387058.841456587,"t_done_unix":1779817923.8553996},{"request_id":"1326192:4:1331370:401","session_id":"1326192","input_length":27049,"t_proxy_recv":387055.827955966,"t_decision_unix":1779817920.8418975,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":25600,"affinity_cache_ratio":0.9464305519612555,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":-26022,"tie_break_used":false,"cache_hit":25600,"estimated_new_tokens":1449,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":27049,"score_linear":62618.0,"score_lmetric":27049},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":0,"new_prefill":27049,"score_linear":28977.0,"score_lmetric":27049},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":27049,"score_linear":206696.0,"score_lmetric":82626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114846,"ongoing_decode_tokens":146985,"pending_prefill_tokens":-10123,"num_requests":3,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":25600,"new_prefill":1449,"score_linear":89246.0,"score_lmetric":-26022}],"chosen_score_linear":89246.0,"chosen_score_lmetric":-26022,"t_first_token":387056.517950521,"t_first_token_unix":1779817921.5318947,"t_done":387058.98325781,"t_done_unix":1779817923.9972012},{"request_id":"1329110:2:1331399:402","session_id":"1329110","input_length":12781,"t_proxy_recv":387055.737996053,"t_decision_unix":1779817920.7519374,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.7210703387841327,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":-30369,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":3565,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":12781,"score_linear":62618.0,"score_lmetric":12781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":0,"new_prefill":12781,"score_linear":28977.0,"score_lmetric":12781},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":12781,"score_linear":206696.0,"score_lmetric":39822},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127753,"ongoing_decode_tokens":172673,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":1338,"cache_hit":9216,"new_prefill":3565,"score_linear":118537.0,"score_lmetric":-30369}],"chosen_score_linear":118537.0,"chosen_score_lmetric":-30369,"t_first_token":387056.188753416,"t_first_token_unix":1779817921.2026973,"t_done":387059.155513698,"t_done_unix":1779817924.169457},{"request_id":"1332021:1:1332021:407","session_id":"1332021","input_length":12421,"t_proxy_recv":387057.731641093,"t_decision_unix":1779817922.7455823,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":-6335,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":12421,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":12421,"score_linear":62618.0,"score_lmetric":12421},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":21680,"num_requests":1,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":12421,"score_linear":21680.0,"score_lmetric":34101},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":102211,"ongoing_decode_tokens":28977,"pending_prefill_tokens":6674,"num_requests":2,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":0,"new_prefill":12421,"score_linear":102211.0,"score_lmetric":38190},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":12421,"score_linear":206696.0,"score_lmetric":38742},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":0,"pending_prefill_tokens":2657,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":12421,"score_linear":71777.0,"score_lmetric":15078},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":155962,"ongoing_decode_tokens":200882,"pending_prefill_tokens":-13688,"num_requests":5,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":12421,"score_linear":155962.0,"score_lmetric":-6335}],"chosen_score_linear":155962.0,"chosen_score_lmetric":-6335,"t_first_token":387058.806119555,"t_first_token_unix":1779817923.8200629,"t_done":387060.076023633,"t_done_unix":1779817925.0899673},{"request_id":"1325541:2:1331846:404","session_id":"1325541","input_length":73234,"t_proxy_recv":387057.136885859,"t_decision_unix":1779817922.1508272,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":66560,"affinity_cache_ratio":0.9088674659311249,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":66560,"estimated_new_tokens":6674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":73234,"score_linear":62618.0,"score_lmetric":73234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":66560,"new_prefill":6674,"score_linear":-37583.0,"score_lmetric":6674},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":73234,"score_linear":206696.0,"score_lmetric":221181},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":155962,"ongoing_decode_tokens":186815,"pending_prefill_tokens":-11397,"num_requests":5,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":73234,"score_linear":155962.0,"score_lmetric":309185}],"chosen_score_linear":-37583.0,"chosen_score_lmetric":6674,"t_first_token":387060.050221202,"t_first_token_unix":1779817925.0641649,"t_done":387060.143124456,"t_done_unix":1779817925.1570685},{"request_id":"1329470:1:1329470:392","session_id":"1329470","input_length":10847,"t_proxy_recv":387048.859239178,"t_decision_unix":1779817913.8731806,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":-11364,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":10847,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":10847,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":10847,"score_linear":62618.0,"score_lmetric":10847},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":10847,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":10847,"score_linear":108072.0,"score_lmetric":241557},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":81827,"pending_prefill_tokens":7640,"num_requests":2,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":10847,"score_linear":116091.0,"score_lmetric":36974},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":10847,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":10847,"score_linear":36880.0,"score_lmetric":47727},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":113347,"ongoing_decode_tokens":158267,"pending_prefill_tokens":-13688,"num_requests":4,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":0,"new_prefill":10847,"score_linear":113347.0,"score_lmetric":-11364}],"chosen_score_linear":113347.0,"chosen_score_lmetric":-11364,"t_first_token":387049.760649247,"t_first_token_unix":1779817914.774593,"t_done":387060.14505637,"t_done_unix":1779817925.1590002},{"request_id":"1316848:10:1330509:398","session_id":"1316848","input_length":28977,"t_proxy_recv":387054.535951355,"t_decision_unix":1779817919.549893,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9894744107395521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":305,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":28977,"score_linear":62618.0,"score_lmetric":28977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":28672,"new_prefill":305,"score_linear":-28672.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":28977,"score_linear":206696.0,"score_lmetric":88410},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139478,"ongoing_decode_tokens":158710,"pending_prefill_tokens":-2848,"num_requests":4,"active_p_offloads":0,"cached_blocks":1315,"cache_hit":0,"new_prefill":28977,"score_linear":139478.0,"score_lmetric":104516}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":387054.632694661,"t_first_token_unix":1779817919.6466382,"t_done":387060.539069939,"t_done_unix":1779817925.5530145},{"request_id":"1329470:2:1332133:409","session_id":"1329470","input_length":11766,"t_proxy_recv":387060.149412341,"t_decision_unix":1779817925.1633537,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9138194798572157,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":-34221,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":1014,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":11766,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":11766,"score_linear":62618.0,"score_lmetric":11766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":21680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":11766,"score_linear":21680.0,"score_lmetric":11766},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1212,"cache_hit":0,"new_prefill":11766,"score_linear":28977.0,"score_lmetric":11766},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":11766,"score_linear":206696.0,"score_lmetric":36777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":11766,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":11766,"score_linear":71777.0,"score_lmetric":11766},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":106507,"ongoing_decode_tokens":151427,"pending_prefill_tokens":-12421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":10752,"new_prefill":1014,"score_linear":95755.0,"score_lmetric":-34221}],"chosen_score_linear":95755.0,"chosen_score_lmetric":-34221,"t_first_token":387060.386347896,"t_first_token_unix":1779817925.4002917,"t_done":387060.600105491,"t_done_unix":1779817925.614049},{"request_id":"1329110:3:1332476:411","session_id":"1329110","input_length":13479,"t_proxy_recv":387059.413527823,"t_decision_unix":1779817924.4274693,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":12800,"affinity_cache_ratio":0.9496253431263447,"affinity_num_requests":4,"avg_num_requests":1.5,"fallback_score":-39728,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":679,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":13479,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":13479,"score_linear":62618.0,"score_lmetric":13479},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":21680,"num_requests":1,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":13479,"score_linear":21680.0,"score_lmetric":35159},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":102211,"ongoing_decode_tokens":28977,"pending_prefill_tokens":6674,"num_requests":2,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":0,"new_prefill":13479,"score_linear":102211.0,"score_lmetric":40306},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":13479,"score_linear":206696.0,"score_lmetric":41916},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":13479,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":13479,"score_linear":71777.0,"score_lmetric":13479},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":116296,"ongoing_decode_tokens":159406,"pending_prefill_tokens":-10611,"num_requests":4,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":12800,"new_prefill":679,"score_linear":103496.0,"score_lmetric":-39728}],"chosen_score_linear":103496.0,"chosen_score_lmetric":-39728,"t_first_token":387059.846666088,"t_first_token_unix":1779817924.86061,"t_done":387061.101905184,"t_done_unix":1779817926.1158493},{"request_id":"1269373:16:1331896:405","session_id":"1269373","input_length":71777,"t_proxy_recv":387057.357089034,"t_decision_unix":1779817922.3710306,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9629825710185714,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":2657,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":4096,"new_prefill":67681,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":71777,"score_linear":62618.0,"score_lmetric":71777},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":71777,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":102211,"ongoing_decode_tokens":28977,"pending_prefill_tokens":6674,"num_requests":2,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":7680,"new_prefill":64097,"score_linear":94531.0,"score_lmetric":141542},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":71777,"score_linear":206696.0,"score_lmetric":216810},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":71777,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":69120,"new_prefill":2657,"score_linear":-69120.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":155962,"ongoing_decode_tokens":200882,"pending_prefill_tokens":-13688,"num_requests":5,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":7680,"new_prefill":64097,"score_linear":148282.0,"score_lmetric":252045}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":387058.53145542,"t_first_token_unix":1779817923.5453987,"t_done":387061.154997413,"t_done_unix":1779817926.1689522},{"request_id":"1332013:1:1332013:406","session_id":"1332013","input_length":21680,"t_proxy_recv":387057.715882758,"t_decision_unix":1779817922.729824,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21680,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":12800,"new_prefill":8880,"score_linear":49818.0,"score_lmetric":8880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":102211,"ongoing_decode_tokens":28977,"pending_prefill_tokens":6674,"num_requests":2,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":12800,"new_prefill":8880,"score_linear":89411.0,"score_lmetric":31108},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":21680,"score_linear":206696.0,"score_lmetric":66519},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":0,"pending_prefill_tokens":2657,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":21680,"score_linear":71777.0,"score_lmetric":24337},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":155962,"ongoing_decode_tokens":200882,"pending_prefill_tokens":-13688,"num_requests":5,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":21680,"score_linear":155962.0,"score_lmetric":39960}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387060.057335497,"t_first_token_unix":1779817925.071279,"t_done":387061.174624779,"t_done_unix":1779817926.188568},{"request_id":"1332472:1:1332472:410","session_id":"1332472","input_length":1810,"t_proxy_recv":387059.388863887,"t_decision_unix":1779817924.4028053,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":-31833,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1810,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":1810,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":1810,"score_linear":62618.0,"score_lmetric":1810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":21680,"num_requests":1,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":1810,"score_linear":21680.0,"score_lmetric":23490},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":102211,"ongoing_decode_tokens":28977,"pending_prefill_tokens":6674,"num_requests":2,"active_p_offloads":0,"cached_blocks":1199,"cache_hit":0,"new_prefill":1810,"score_linear":102211.0,"score_lmetric":16968},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":1810,"score_linear":206696.0,"score_lmetric":6909},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":1810,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":1810,"score_linear":71777.0,"score_lmetric":1810},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114486,"ongoing_decode_tokens":159406,"pending_prefill_tokens":-12421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1372,"cache_hit":0,"new_prefill":1810,"score_linear":114486.0,"score_lmetric":-31833}],"chosen_score_linear":114486.0,"chosen_score_lmetric":-31833,"t_first_token":387059.65633161,"t_first_token_unix":1779817924.6702747,"t_done":387062.138431967,"t_done_unix":1779817927.1523757},{"request_id":"1332754:1:1332754:412","session_id":"1332754","input_length":19766,"t_proxy_recv":387060.416233218,"t_decision_unix":1779817925.4301744,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19766,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":19766,"score_linear":62618.0,"score_lmetric":19766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":21680,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":19766,"score_linear":21680.0,"score_lmetric":19766},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1212,"cache_hit":0,"new_prefill":19766,"score_linear":28977.0,"score_lmetric":19766},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":19766,"score_linear":206696.0,"score_lmetric":60777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":19766,"score_linear":71777.0,"score_lmetric":19766},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":118273,"ongoing_decode_tokens":163193,"pending_prefill_tokens":-12421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1417,"cache_hit":0,"new_prefill":19766,"score_linear":118273.0,"score_lmetric":29380}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387062.436229136,"t_first_token_unix":1779817927.4501724,"t_done":387062.913253647,"t_done_unix":1779817927.9271975},{"request_id":"1316848:11:1333994:416","session_id":"1316848","input_length":29656,"t_proxy_recv":387064.793167836,"t_decision_unix":1779817929.8071086,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9840841650930672,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":472,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":29656,"score_linear":62618.0,"score_lmetric":29656},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":29184,"new_prefill":472,"score_linear":-29184.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":29656,"score_linear":206696.0,"score_lmetric":90447},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":917,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1423,"cache_hit":0,"new_prefill":29656,"score_linear":91218.0,"score_lmetric":17235}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":387064.914695508,"t_first_token_unix":1779817929.9286423,"t_done":387065.199315591,"t_done_unix":1779817930.213259},{"request_id":"1279412:17:1326166:377","session_id":"1279412","input_length":81008,"t_proxy_recv":387042.65066326,"t_decision_unix":1779817907.6646047,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9354137862927119,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":5232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":81008,"score_linear":33182.0,"score_lmetric":81008},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":81008,"score_linear":62618.0,"score_lmetric":81008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":81008,"score_linear":108072.0,"score_lmetric":452040},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":12800,"new_prefill":68208,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":191009,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":0,"new_prefill":81008,"score_linear":191009.0,"score_lmetric":162016},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15356,"ongoing_decode_tokens":60276,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1282,"cache_hit":75776,"new_prefill":5232,"score_linear":-60420.0,"score_lmetric":-8456}],"chosen_score_linear":-60420.0,"chosen_score_lmetric":-8456,"t_first_token":387045.245368482,"t_first_token_unix":1779817910.2593122,"t_done":387066.195807512,"t_done_unix":1779817931.209755},{"request_id":"1334223:1:1334223:417","session_id":"1334223","input_length":23689,"t_proxy_recv":387065.662532813,"t_decision_unix":1779817930.6764743,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":23689,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":23689,"score_linear":62618.0,"score_lmetric":23689},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1214,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":23689,"score_linear":206696.0,"score_lmetric":72546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":917,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1423,"cache_hit":0,"new_prefill":23689,"score_linear":91218.0,"score_lmetric":11268}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387068.331996414,"t_first_token_unix":1779817933.3459399,"t_done":387068.917155646,"t_done_unix":1779817933.9310992},{"request_id":"1309252:2:1334746:419","session_id":"1309252","input_length":45601,"t_proxy_recv":387067.632065345,"t_decision_unix":1779817932.6460068,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":44544,"affinity_cache_ratio":0.9768206837569352,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":1057,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":45601,"score_linear":62618.0,"score_lmetric":45601},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":44544,"new_prefill":1057,"score_linear":-44544.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1214,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":45601,"score_linear":206696.0,"score_lmetric":138282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":23689,"ongoing_decode_tokens":0,"pending_prefill_tokens":23689,"num_requests":1,"active_p_offloads":0,"cached_blocks":917,"cache_hit":0,"new_prefill":45601,"score_linear":23689.0,"score_lmetric":69290},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92698,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":45601,"score_linear":92698.0,"score_lmetric":33180}],"chosen_score_linear":-44544.0,"chosen_score_lmetric":0,"t_first_token":387068.043281184,"t_first_token_unix":1779817933.0572248,"t_done":387069.643164671,"t_done_unix":1779817934.657108},{"request_id":"1316848:12:1334743:418","session_id":"1316848","input_length":44664,"t_proxy_recv":387067.638779948,"t_decision_unix":1779817932.6527214,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29696,"affinity_cache_ratio":0.6648755149561167,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":14968,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":44664,"score_linear":62618.0,"score_lmetric":44664},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45601,"ongoing_decode_tokens":0,"pending_prefill_tokens":1057,"num_requests":1,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":44664,"score_linear":45601.0,"score_lmetric":45721},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1214,"cache_hit":29696,"new_prefill":14968,"score_linear":-29696.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":44664,"score_linear":206696.0,"score_lmetric":135471},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":23689,"ongoing_decode_tokens":0,"pending_prefill_tokens":23689,"num_requests":1,"active_p_offloads":0,"cached_blocks":917,"cache_hit":0,"new_prefill":44664,"score_linear":23689.0,"score_lmetric":68353},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92698,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":44664,"score_linear":92698.0,"score_lmetric":32243}],"chosen_score_linear":-29696.0,"chosen_score_lmetric":0,"t_first_token":387071.484892051,"t_first_token_unix":1779817936.4988356,"t_done":387072.411926965,"t_done_unix":1779817937.4258723},{"request_id":"1330881:2:1336222:422","session_id":"1330881","input_length":11989,"t_proxy_recv":387072.747335062,"t_decision_unix":1779817937.7612765,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":3584,"affinity_cache_ratio":0.29894069563766784,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":8405,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":11989,"score_linear":62618.0,"score_lmetric":11989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":11989,"score_linear":206696.0,"score_lmetric":37446},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":963,"cache_hit":3584,"new_prefill":8405,"score_linear":-3584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":153927,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-8024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":11989,"score_linear":153927.0,"score_lmetric":7930}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":387073.491798557,"t_first_token_unix":1779817938.505742,"t_done":387073.648450377,"t_done_unix":1779817938.6623936},{"request_id":"1317598:3:1328678:385","session_id":"1317598","input_length":81827,"t_proxy_recv":387045.988409764,"t_decision_unix":1779817911.0023508,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9948794407713836,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":419,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":81827,"score_linear":33182.0,"score_lmetric":81827},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":81827,"score_linear":62618.0,"score_lmetric":81827},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":81827,"score_linear":108072.0,"score_lmetric":454497},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":830,"cache_hit":81408,"new_prefill":419,"score_linear":-81408.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":0,"new_prefill":81827,"score_linear":91218.0,"score_lmetric":68139}],"chosen_score_linear":-81408.0,"chosen_score_lmetric":0,"t_first_token":387046.401335026,"t_first_token_unix":1779817911.415279,"t_done":387076.867068298,"t_done_unix":1779817941.881012},{"request_id":"1259178:2:1336768:424","session_id":"1259178","input_length":20009,"t_proxy_recv":387074.514545013,"t_decision_unix":1779817939.5284865,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.716477585086711,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":5673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":20009,"score_linear":62618.0,"score_lmetric":20009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":20009,"score_linear":206696.0,"score_lmetric":61506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":979,"cache_hit":14336,"new_prefill":5673,"score_linear":-14336.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":20009,"score_linear":168593.0,"score_lmetric":56913}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":387076.57869441,"t_first_token_unix":1779817941.592638,"t_done":387077.37499663,"t_done_unix":1779817942.3889403},{"request_id":"1257323:2:1329541:393","session_id":"1257323","input_length":90605,"t_proxy_recv":387049.307474796,"t_decision_unix":1779817914.321416,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":90112,"affinity_cache_ratio":0.9945587991832681,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":90112,"estimated_new_tokens":493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":90605,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":90605,"score_linear":62618.0,"score_lmetric":90605},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":90605,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":90605,"score_linear":108072.0,"score_lmetric":480831},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116091,"ongoing_decode_tokens":116091,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":830,"cache_hit":90112,"new_prefill":493,"score_linear":25979.0,"score_lmetric":986},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":90605,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":90605,"score_linear":36880.0,"score_lmetric":127485},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":124194,"ongoing_decode_tokens":158267,"pending_prefill_tokens":-2841,"num_requests":5,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":0,"new_prefill":90605,"score_linear":124194.0,"score_lmetric":438820}],"chosen_score_linear":25979.0,"chosen_score_lmetric":986,"t_first_token":387076.787621881,"t_first_token_unix":1779817941.8015652,"t_done":387077.58135963,"t_done_unix":1779817942.5953035},{"request_id":"1316848:13:1337519:427","session_id":"1316848","input_length":45005,"t_proxy_recv":387077.380179547,"t_decision_unix":1779817942.3941212,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":44544,"affinity_cache_ratio":0.9897566937007,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":461,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":45005,"score_linear":62618.0,"score_lmetric":45005},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":44544,"new_prefill":461,"score_linear":-44544.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":207011,"ongoing_decode_tokens":207011,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":45005,"score_linear":207011.0,"score_lmetric":135015},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49162,"ongoing_decode_tokens":12644,"pending_prefill_tokens":16550,"num_requests":2,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":45005,"score_linear":49162.0,"score_lmetric":123110},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":45005,"score_linear":168593.0,"score_lmetric":131901}],"chosen_score_linear":-44544.0,"chosen_score_lmetric":0,"t_first_token":387077.55683564,"t_first_token_unix":1779817942.5707796,"t_done":387077.853923131,"t_done_unix":1779817942.8678663},{"request_id":"1259178:3:1337653:429","session_id":"1259178","input_length":22398,"t_proxy_recv":387077.823824342,"t_decision_unix":1779817942.8377655,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":19968,"affinity_cache_ratio":0.8915081703723546,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":2430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":22398,"score_linear":62618.0,"score_lmetric":22398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45005,"ongoing_decode_tokens":45005,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":22398,"score_linear":45005.0,"score_lmetric":22398},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":22398,"score_linear":116406.0,"score_lmetric":44796},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49162,"ongoing_decode_tokens":12644,"pending_prefill_tokens":16550,"num_requests":2,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":22398,"score_linear":49162.0,"score_lmetric":77896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":990,"cache_hit":19968,"new_prefill":2430,"score_linear":-19968.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":22398,"score_linear":168593.0,"score_lmetric":64080}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":387078.264628353,"t_first_token_unix":1779817943.278572,"t_done":387079.107446365,"t_done_unix":1779817944.1213899},{"request_id":"1337035:1:1337035:425","session_id":"1337035","input_length":12644,"t_proxy_recv":387075.540945951,"t_decision_unix":1779817940.554887,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":12644,"score_linear":62618.0,"score_lmetric":12644},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":12644,"score_linear":206696.0,"score_lmetric":39411},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":0,"pending_prefill_tokens":5673,"num_requests":1,"active_p_offloads":0,"cached_blocks":979,"cache_hit":0,"new_prefill":12644,"score_linear":20009.0,"score_lmetric":18317},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":12644,"score_linear":168593.0,"score_lmetric":34818}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387076.598354685,"t_first_token_unix":1779817941.6122978,"t_done":387080.190052356,"t_done_unix":1779817945.203996},{"request_id":"1311753:2:1337278:426","session_id":"1311753","input_length":36518,"t_proxy_recv":387076.403745528,"t_decision_unix":1779817941.4176867,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":19968,"affinity_cache_ratio":0.5467988389287475,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":16550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":36518,"score_linear":62618.0,"score_lmetric":36518},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":36518,"score_linear":206696.0,"score_lmetric":111033},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":12644,"ongoing_decode_tokens":0,"pending_prefill_tokens":12644,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":19968,"new_prefill":16550,"score_linear":-7324.0,"score_lmetric":29194},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":0,"pending_prefill_tokens":5673,"num_requests":1,"active_p_offloads":0,"cached_blocks":979,"cache_hit":0,"new_prefill":36518,"score_linear":20009.0,"score_lmetric":42191},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":36518,"score_linear":168593.0,"score_lmetric":106440}],"chosen_score_linear":-7324.0,"chosen_score_lmetric":29194,"t_first_token":387079.957130521,"t_first_token_unix":1779817944.971074,"t_done":387080.210638339,"t_done_unix":1779817945.224582},{"request_id":"1338292:1:1338292:432","session_id":"1338292","input_length":9325,"t_proxy_recv":387080.028363344,"t_decision_unix":1779817945.0423048,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-9288,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9325,"score_linear":62618.0,"score_lmetric":9325},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":9325,"score_linear":116406.0,"score_lmetric":18650},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49162,"ongoing_decode_tokens":49162,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":9325,"score_linear":49162.0,"score_lmetric":18650},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":0,"pending_prefill_tokens":1393,"num_requests":1,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":9325,"score_linear":73073.0,"score_lmetric":10718},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":213513,"pending_prefill_tokens":-12421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":9325,"score_linear":168593.0,"score_lmetric":-9288}],"chosen_score_linear":168593.0,"chosen_score_lmetric":-9288,"t_first_token":387080.850390046,"t_first_token_unix":1779817945.8643336,"t_done":387081.399536103,"t_done_unix":1779817946.4134793},{"request_id":"1268861:5:1329060:388","session_id":"1268861","input_length":34264,"t_proxy_recv":387047.403583394,"t_decision_unix":1779817912.4175246,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":26624,"affinity_cache_ratio":0.7770254494513191,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":7640,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":0,"new_prefill":34264,"score_linear":33182.0,"score_lmetric":34264},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":34264,"score_linear":62618.0,"score_lmetric":34264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":34264,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108072,"ongoing_decode_tokens":0,"pending_prefill_tokens":69672,"num_requests":3,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":0,"new_prefill":34264,"score_linear":108072.0,"score_lmetric":311808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81827,"ongoing_decode_tokens":81827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":830,"cache_hit":26624,"new_prefill":7640,"score_linear":55203.0,"score_lmetric":7640},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":34264,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":34264,"score_linear":36880.0,"score_lmetric":71144},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":91218,"ongoing_decode_tokens":136138,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1283,"cache_hit":0,"new_prefill":34264,"score_linear":91218.0,"score_lmetric":20576}],"chosen_score_linear":55203.0,"chosen_score_lmetric":7640,"t_first_token":387049.045234471,"t_first_token_unix":1779817914.0591776,"t_done":387081.469697914,"t_done_unix":1779817946.4836411},{"request_id":"1279412:18:1332945:413","session_id":"1279412","input_length":82488,"t_proxy_recv":387066.209597701,"t_decision_unix":1779817931.2235372,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9869071864998545,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":1080,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":82488,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":82488,"score_linear":62618.0,"score_lmetric":82488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":82488,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1214,"cache_hit":0,"new_prefill":82488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":82488,"score_linear":206696.0,"score_lmetric":248943},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":12800,"new_prefill":69688,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":23689,"ongoing_decode_tokens":0,"pending_prefill_tokens":23689,"num_requests":1,"active_p_offloads":0,"cached_blocks":917,"cache_hit":0,"new_prefill":82488,"score_linear":23689.0,"score_lmetric":106177},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":10210,"ongoing_decode_tokens":55130,"pending_prefill_tokens":-12421,"num_requests":0,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":81408,"new_prefill":1080,"score_linear":-71198.0,"score_lmetric":0}],"chosen_score_linear":-71198.0,"chosen_score_lmetric":0,"t_first_token":387066.636183748,"t_first_token_unix":1779817931.6501274,"t_done":387082.398246106,"t_done_unix":1779817947.4121897},{"request_id":"1269373:17:1338104:431","session_id":"1269373","input_length":73073,"t_proxy_recv":387079.487620862,"t_decision_unix":1779817944.5015616,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9809368713478303,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":1393,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":4096,"new_prefill":68977,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":73073,"score_linear":62618.0,"score_lmetric":73073},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":73073,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":7680,"new_prefill":65393,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":73073,"score_linear":116406.0,"score_lmetric":146146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49162,"ongoing_decode_tokens":12644,"pending_prefill_tokens":16550,"num_requests":2,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":73073,"score_linear":49162.0,"score_lmetric":179246},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":995,"cache_hit":71680,"new_prefill":1393,"score_linear":-71680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":7680,"new_prefill":65393,"score_linear":160913.0,"score_lmetric":193065}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":387080.144911688,"t_first_token_unix":1779817945.1588554,"t_done":387082.507286085,"t_done_unix":1779817947.5212295},{"request_id":"1317598:4:1332127:408","session_id":"1317598","input_length":82142,"t_proxy_recv":387076.880326614,"t_decision_unix":1779817941.8942683,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81920,"affinity_cache_ratio":0.9972973631029194,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":81920,"estimated_new_tokens":222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":82142,"score_linear":62618.0,"score_lmetric":82142},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":124869,"ongoing_decode_tokens":124869,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":831,"cache_hit":81920,"new_prefill":222,"score_linear":42949.0,"score_lmetric":444},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49162,"ongoing_decode_tokens":12644,"pending_prefill_tokens":16550,"num_requests":2,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":82142,"score_linear":49162.0,"score_lmetric":197384},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":20009,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":979,"cache_hit":0,"new_prefill":82142,"score_linear":20009.0,"score_lmetric":82142},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168593,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-1038,"num_requests":3,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":82142,"score_linear":168593.0,"score_lmetric":243312}],"chosen_score_linear":42949.0,"chosen_score_lmetric":444,"t_first_token":387077.141386044,"t_first_token_unix":1779817942.1553292,"t_done":387082.791101726,"t_done_unix":1779817947.8050454},{"request_id":"1317598:5:1337780:430","session_id":"1317598","input_length":83088,"t_proxy_recv":387082.806312751,"t_decision_unix":1779817947.8202543,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82432,"affinity_cache_ratio":0.99210475640285,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82432,"estimated_new_tokens":656,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":83088,"score_linear":62618.0,"score_lmetric":83088},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":99903,"ongoing_decode_tokens":99903,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":83088,"score_linear":99903.0,"score_lmetric":166176},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":848,"cache_hit":82432,"new_prefill":656,"score_linear":-82432.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":998,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180434,"ongoing_decode_tokens":131025,"pending_prefill_tokens":-524,"num_requests":4,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":83088,"score_linear":180434.0,"score_lmetric":330256}],"chosen_score_linear":-82432.0,"chosen_score_lmetric":0,"t_first_token":387083.23344494,"t_first_token_unix":1779817948.2473881,"t_done":387083.799103897,"t_done_unix":1779817948.813048},{"request_id":"1253743:5:1338406:433","session_id":"1253743","input_length":50215,"t_proxy_recv":387080.350181551,"t_decision_unix":1779817945.3641226,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9890271831126157,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":551,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":50215,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":4608,"new_prefill":45607,"score_linear":58010.0,"score_lmetric":45607},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":50215,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":49664,"new_prefill":551,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":50215,"score_linear":116406.0,"score_lmetric":100430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":50215,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":50215,"score_linear":73073.0,"score_lmetric":50215},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177918,"ongoing_decode_tokens":213513,"pending_prefill_tokens":-3096,"num_requests":4,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":50215,"score_linear":177918.0,"score_lmetric":188476}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":387080.527042718,"t_first_token_unix":1779817945.5409863,"t_done":387085.922547683,"t_done_unix":1779817950.9364915},{"request_id":"1336620:1:1336620:423","session_id":"1336620","input_length":14666,"t_proxy_recv":387074.047856711,"t_decision_unix":1779817939.061798,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-2076,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6986,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":4096,"new_prefill":10570,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14666,"score_linear":62618.0,"score_lmetric":14666},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":14666,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":7680,"new_prefill":6986,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":14666,"score_linear":206696.0,"score_lmetric":45477},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":14666,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":979,"cache_hit":7680,"new_prefill":6986,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":153927,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-8024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":7680,"new_prefill":6986,"score_linear":146247.0,"score_lmetric":-2076}],"chosen_score_linear":146247.0,"chosen_score_lmetric":-2076,"t_first_token":387079.622772033,"t_first_token_unix":1779817944.6367154,"t_done":387086.635597071,"t_done_unix":1779817951.6495407},{"request_id":"1339977:1:1339977:442","session_id":"1339977","input_length":13816,"t_proxy_recv":387086.08366955,"t_decision_unix":1779817951.097611,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":13816,"score_linear":62618.0,"score_lmetric":13816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":13816,"score_linear":45994.0,"score_lmetric":13816},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49688,"ongoing_decode_tokens":49688,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1244,"cache_hit":0,"new_prefill":13816,"score_linear":49688.0,"score_lmetric":13816},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24462,"ongoing_decode_tokens":24462,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":998,"cache_hit":0,"new_prefill":13816,"score_linear":24462.0,"score_lmetric":13816},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180434,"ongoing_decode_tokens":225354,"pending_prefill_tokens":-12421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":13816,"score_linear":180434.0,"score_lmetric":5580}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387087.279583673,"t_first_token_unix":1779817952.293527,"t_done":387087.474520975,"t_done_unix":1779817952.488464},{"request_id":"1316848:14:1338658:435","session_id":"1316848","input_length":49688,"t_proxy_recv":387081.266995378,"t_decision_unix":1779817946.280936,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":44544,"affinity_cache_ratio":0.8964739977459346,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":5144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":49688,"score_linear":62618.0,"score_lmetric":49688},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":50215,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":44544,"new_prefill":5144,"score_linear":5671.0,"score_lmetric":5144},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":116406,"ongoing_decode_tokens":116406,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":832,"cache_hit":0,"new_prefill":49688,"score_linear":116406.0,"score_lmetric":99376},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":49688,"score_linear":73073.0,"score_lmetric":49688},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177918,"ongoing_decode_tokens":222838,"pending_prefill_tokens":-12421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":0,"new_prefill":49688,"score_linear":177918.0,"score_lmetric":149068}],"chosen_score_linear":5671.0,"chosen_score_lmetric":5144,"t_first_token":387082.78399626,"t_first_token_unix":1779817947.79794,"t_done":387087.88950841,"t_done_unix":1779817952.903452},{"request_id":"1259178:4:1339295:439","session_id":"1259178","input_length":24462,"t_proxy_recv":387083.500973356,"t_decision_unix":1779817948.5149145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":22528,"affinity_cache_ratio":0.9209385986427929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":1934,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":24462,"score_linear":62618.0,"score_lmetric":24462},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":99903,"ongoing_decode_tokens":99903,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":24462,"score_linear":99903.0,"score_lmetric":48924},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83088,"ongoing_decode_tokens":83088,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":848,"cache_hit":0,"new_prefill":24462,"score_linear":83088.0,"score_lmetric":24462},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":998,"cache_hit":22528,"new_prefill":1934,"score_linear":-22528.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180434,"ongoing_decode_tokens":131025,"pending_prefill_tokens":-524,"num_requests":4,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":24462,"score_linear":180434.0,"score_lmetric":95752}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":387083.925507044,"t_first_token_unix":1779817948.9394507,"t_done":387088.184817883,"t_done_unix":1779817953.1987615},{"request_id":"1314357:2:1335184:420","session_id":"1314357","input_length":61229,"t_proxy_recv":387068.99615937,"t_decision_unix":1779817934.010101,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9281876235117347,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":4397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":3584,"new_prefill":57645,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":61229,"score_linear":62618.0,"score_lmetric":61229},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45601,"ongoing_decode_tokens":45601,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":61229,"score_linear":45601.0,"score_lmetric":61229},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":44664,"ongoing_decode_tokens":0,"pending_prefill_tokens":14968,"num_requests":1,"active_p_offloads":0,"cached_blocks":1214,"cache_hit":0,"new_prefill":61229,"score_linear":44664.0,"score_lmetric":76197},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":206696,"ongoing_decode_tokens":116091,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":830,"cache_hit":0,"new_prefill":61229,"score_linear":206696.0,"score_lmetric":185166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":963,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":92698,"ongoing_decode_tokens":137618,"pending_prefill_tokens":-12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":1434,"cache_hit":56832,"new_prefill":4397,"score_linear":35866.0,"score_lmetric":-8024}],"chosen_score_linear":35866.0,"chosen_score_lmetric":-8024,"t_first_token":387079.621778316,"t_first_token_unix":1779817944.6357217,"t_done":387088.32695951,"t_done_unix":1779817953.3409033},{"request_id":"1309252:3:1339771:441","session_id":"1309252","input_length":45994,"t_proxy_recv":387085.325073634,"t_decision_unix":1779817950.3390148,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":45568,"affinity_cache_ratio":0.9907379223376962,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45568,"estimated_new_tokens":426,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":45994,"score_linear":62618.0,"score_lmetric":45994},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":45568,"new_prefill":426,"score_linear":-45568.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":99903,"ongoing_decode_tokens":99903,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":45994,"score_linear":99903.0,"score_lmetric":91988},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24462,"ongoing_decode_tokens":24462,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":998,"cache_hit":0,"new_prefill":45994,"score_linear":24462.0,"score_lmetric":45994},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180434,"ongoing_decode_tokens":218289,"pending_prefill_tokens":-5356,"num_requests":4,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":45994,"score_linear":180434.0,"score_lmetric":162552}],"chosen_score_linear":-45568.0,"chosen_score_lmetric":0,"t_first_token":387085.498831285,"t_first_token_unix":1779817950.5127747,"t_done":387088.898366961,"t_done_unix":1779817953.9123104},{"request_id":"1279412:19:1335444:421","session_id":"1279412","input_length":87264,"t_proxy_recv":387082.414461628,"t_decision_unix":1779817947.428403,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":82432,"affinity_cache_ratio":0.9446277961129447,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82432,"estimated_new_tokens":4832,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":87264,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":87264,"score_linear":62618.0,"score_lmetric":87264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":87264,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":99903,"ongoing_decode_tokens":50215,"pending_prefill_tokens":5144,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":87264,"score_linear":99903.0,"score_lmetric":184816},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":82142,"ongoing_decode_tokens":82142,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":847,"cache_hit":0,"new_prefill":87264,"score_linear":82142.0,"score_lmetric":87264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":12800,"new_prefill":74464,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":995,"cache_hit":0,"new_prefill":87264,"score_linear":73073.0,"score_lmetric":87264},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":86105,"ongoing_decode_tokens":131025,"pending_prefill_tokens":-12421,"num_requests":2,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":82432,"new_prefill":4832,"score_linear":3673.0,"score_lmetric":-15178}],"chosen_score_linear":3673.0,"chosen_score_lmetric":-15178,"t_first_token":387084.897774216,"t_first_token_unix":1779817949.9117177,"t_done":387089.694452673,"t_done_unix":1779817954.7083964},{"request_id":"1341005:1:1341005:447","session_id":"1341005","input_length":5280,"t_proxy_recv":387089.554239646,"t_decision_unix":1779817954.5681808,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21221,"ongoing_decode_tokens":21221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":5280,"score_linear":21221.0,"score_lmetric":5280},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":5280,"score_linear":62618.0,"score_lmetric":5280},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":5280,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":5280,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":5280,"score_linear":48381.0,"score_lmetric":53661},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":5280,"score_linear":66152.0,"score_lmetric":71432},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":2279,"ongoing_decode_tokens":2279,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":5280,"score_linear":2279.0,"score_lmetric":5280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":119457,"ongoing_decode_tokens":164377,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":5280,"score_linear":119457.0,"score_lmetric":15840}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387089.900270687,"t_first_token_unix":1779817954.9142144,"t_done":387090.255650161,"t_done_unix":1779817955.269594},{"request_id":"1340903:1:1340903:446","session_id":"1340903","input_length":2279,"t_proxy_recv":387089.213560743,"t_decision_unix":1779817954.2275019,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":21221,"num_requests":1,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":2279,"score_linear":21221.0,"score_lmetric":23500},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":2279,"score_linear":62618.0,"score_lmetric":2279},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":2279,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":2279,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":2279,"score_linear":48381.0,"score_lmetric":50660},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":2279,"score_linear":66152.0,"score_lmetric":68431},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":2279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":119457,"ongoing_decode_tokens":164377,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":2279,"score_linear":119457.0,"score_lmetric":6837}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387089.361218005,"t_first_token_unix":1779817954.3751614,"t_done":387090.358214068,"t_done_unix":1779817955.372158},{"request_id":"1340290:1:1340290:445","session_id":"1340290","input_length":21221,"t_proxy_recv":387087.212332752,"t_decision_unix":1779817952.2262743,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":21221,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21221,"score_linear":62618.0,"score_lmetric":21221},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":21221,"score_linear":45994.0,"score_lmetric":21221},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49688,"ongoing_decode_tokens":49688,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1244,"cache_hit":0,"new_prefill":21221,"score_linear":49688.0,"score_lmetric":21221},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":21221,"score_linear":48381.0,"score_lmetric":69602},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":21221,"score_linear":13816.0,"score_lmetric":35037},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24462,"ongoing_decode_tokens":24462,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":998,"cache_hit":1024,"new_prefill":20197,"score_linear":23438.0,"score_lmetric":20197},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180686,"ongoing_decode_tokens":225606,"pending_prefill_tokens":-12421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":0,"new_prefill":21221,"score_linear":180686.0,"score_lmetric":35200}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387089.478243896,"t_first_token_unix":1779817954.492187,"t_done":387091.250385945,"t_done_unix":1779817956.2643301},{"request_id":"1341912:1:1341912:449","session_id":"1341912","input_length":9909,"t_proxy_recv":387092.591518309,"t_decision_unix":1779817957.6054595,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9909,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":760,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9909,"score_linear":62618.0,"score_lmetric":9909},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1190,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":9909,"score_linear":48381.0,"score_lmetric":58290},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":9909,"score_linear":66152.0,"score_lmetric":76061},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":0,"pending_prefill_tokens":13975,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":9909,"score_linear":37527.0,"score_lmetric":23884},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127576,"ongoing_decode_tokens":77113,"pending_prefill_tokens":8343,"num_requests":3,"active_p_offloads":0,"cached_blocks":1485,"cache_hit":0,"new_prefill":9909,"score_linear":127576.0,"score_lmetric":54756}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387093.400624458,"t_first_token_unix":1779817958.4145687,"t_done":387093.890753905,"t_done_unix":1779817958.9046974},{"request_id":"1336620:2:1338440:434","session_id":"1336620","input_length":14918,"t_proxy_recv":387086.639331984,"t_decision_unix":1779817951.6532736,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14336,"affinity_cache_ratio":0.960986727443357,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":-35517,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":582,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":4096,"new_prefill":10822,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14918,"score_linear":62618.0,"score_lmetric":14918},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":14918,"score_linear":45994.0,"score_lmetric":14918},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49688,"ongoing_decode_tokens":49688,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1244,"cache_hit":7680,"new_prefill":7238,"score_linear":42008.0,"score_lmetric":7238},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":14918,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":14918,"score_linear":13816.0,"score_lmetric":28734},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24462,"ongoing_decode_tokens":24462,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":998,"cache_hit":7680,"new_prefill":7238,"score_linear":16782.0,"score_lmetric":7238},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":165768,"ongoing_decode_tokens":210688,"pending_prefill_tokens":-12421,"num_requests":3,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":14336,"new_prefill":582,"score_linear":151432.0,"score_lmetric":-35517}],"chosen_score_linear":151432.0,"chosen_score_lmetric":-35517,"t_first_token":387086.760220802,"t_first_token_unix":1779817951.774164,"t_done":387094.260217632,"t_done_unix":1779817959.2741613},{"request_id":"1342327:1:1342327:452","session_id":"1342327","input_length":6180,"t_proxy_recv":387094.013481746,"t_decision_unix":1779817959.0274227,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6180,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":41267,"ongoing_decode_tokens":0,"pending_prefill_tokens":20275,"num_requests":2,"active_p_offloads":0,"cached_blocks":760,"cache_hit":0,"new_prefill":6180,"score_linear":41267.0,"score_lmetric":52910},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":6180,"score_linear":62618.0,"score_lmetric":6180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":6180,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":6180,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":6180,"score_linear":48381.0,"score_lmetric":54561},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":6180,"score_linear":66152.0,"score_lmetric":72332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":0,"pending_prefill_tokens":13975,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":6180,"score_linear":37527.0,"score_lmetric":20155},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127576,"ongoing_decode_tokens":77113,"pending_prefill_tokens":8343,"num_requests":3,"active_p_offloads":0,"cached_blocks":1485,"cache_hit":0,"new_prefill":6180,"score_linear":127576.0,"score_lmetric":43569}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387094.42291874,"t_first_token_unix":1779817959.4368625,"t_done":387094.719031451,"t_done_unix":1779817959.7329748},{"request_id":"1341948:1:1341948:450","session_id":"1341948","input_length":19887,"t_proxy_recv":387092.715580681,"t_decision_unix":1779817957.729522,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":760,"cache_hit":0,"new_prefill":19887,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":19887,"score_linear":62618.0,"score_lmetric":19887},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":9909,"ongoing_decode_tokens":0,"pending_prefill_tokens":9909,"num_requests":1,"active_p_offloads":0,"cached_blocks":1190,"cache_hit":0,"new_prefill":19887,"score_linear":9909.0,"score_lmetric":29796},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":19887,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":19887,"score_linear":48381.0,"score_lmetric":68268},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":19887,"score_linear":66152.0,"score_lmetric":86039},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":0,"pending_prefill_tokens":13975,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":19887,"score_linear":37527.0,"score_lmetric":33862},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127576,"ongoing_decode_tokens":77113,"pending_prefill_tokens":8343,"num_requests":3,"active_p_offloads":0,"cached_blocks":1485,"cache_hit":0,"new_prefill":19887,"score_linear":127576.0,"score_lmetric":84690}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387094.792068286,"t_first_token_unix":1779817959.8060124,"t_done":387095.123645691,"t_done_unix":1779817960.1375895},{"request_id":"1340903:2:1342632:453","session_id":"1340903","input_length":2129,"t_proxy_recv":387095.051160734,"t_decision_unix":1779817960.0651019,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":2048,"affinity_cache_ratio":0.9619539689995303,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":2048,"estimated_new_tokens":81,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":41267,"ongoing_decode_tokens":41267,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":760,"cache_hit":0,"new_prefill":2129,"score_linear":41267.0,"score_lmetric":4258},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":2129,"score_linear":62618.0,"score_lmetric":2129},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":2129,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":2129,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":2129,"score_linear":48381.0,"score_lmetric":50510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":2129,"score_linear":66152.0,"score_lmetric":68281},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":0,"pending_prefill_tokens":13975,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":2048,"new_prefill":81,"score_linear":35479.0,"score_lmetric":14056},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":157578,"pending_prefill_tokens":6523,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":2129,"score_linear":134029.0,"score_lmetric":25956}],"chosen_score_linear":35479.0,"chosen_score_lmetric":14056,"t_first_token":387095.199971424,"t_first_token_unix":1779817960.2139144,"t_done":387095.30473932,"t_done_unix":1779817960.3186834},{"request_id":"1340290:2:1342119:451","session_id":"1340290","input_length":21380,"t_proxy_recv":387093.254856237,"t_decision_unix":1779817958.2687974,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9818521983161833,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":388,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":19887,"ongoing_decode_tokens":0,"pending_prefill_tokens":19887,"num_requests":1,"active_p_offloads":0,"cached_blocks":760,"cache_hit":20992,"new_prefill":388,"score_linear":-1105.0,"score_lmetric":20275},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21380,"score_linear":62618.0,"score_lmetric":21380},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":9909,"ongoing_decode_tokens":0,"pending_prefill_tokens":9909,"num_requests":1,"active_p_offloads":0,"cached_blocks":1190,"cache_hit":0,"new_prefill":21380,"score_linear":9909.0,"score_lmetric":31289},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":21380,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":21380,"score_linear":48381.0,"score_lmetric":69761},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":21380,"score_linear":66152.0,"score_lmetric":87532},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":0,"pending_prefill_tokens":13975,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":1024,"new_prefill":20356,"score_linear":36503.0,"score_lmetric":34331},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127576,"ongoing_decode_tokens":77113,"pending_prefill_tokens":8343,"num_requests":3,"active_p_offloads":0,"cached_blocks":1485,"cache_hit":0,"new_prefill":21380,"score_linear":127576.0,"score_lmetric":89169}],"chosen_score_linear":-1105.0,"chosen_score_lmetric":20275,"t_first_token":387094.79379857,"t_first_token_unix":1779817959.8077419,"t_done":387095.544285172,"t_done_unix":1779817960.5582287},{"request_id":"1340278:1:1340278:444","session_id":"1340278","input_length":48381,"t_proxy_recv":387087.183363521,"t_decision_unix":1779817952.1973045,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":48381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":48381,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":48381,"score_linear":62618.0,"score_lmetric":48381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":48381,"score_linear":45994.0,"score_lmetric":48381},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49688,"ongoing_decode_tokens":49688,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1244,"cache_hit":0,"new_prefill":48381,"score_linear":49688.0,"score_lmetric":48381},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":48381,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":48381,"score_linear":13816.0,"score_lmetric":62197},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":24462,"ongoing_decode_tokens":24462,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":998,"cache_hit":0,"new_prefill":48381,"score_linear":24462.0,"score_lmetric":48381},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":180686,"ongoing_decode_tokens":225606,"pending_prefill_tokens":-12421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":0,"new_prefill":48381,"score_linear":180686.0,"score_lmetric":143840}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387096.007527596,"t_first_token_unix":1779817961.021473,"t_done":387096.591042635,"t_done_unix":1779817961.6049871},{"request_id":"1334223:2:1341796:448","session_id":"1334223","input_length":37527,"t_proxy_recv":387092.159740168,"t_decision_unix":1779817957.1736815,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":23552,"affinity_cache_ratio":0.6276014602819303,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":13975,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":760,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":37527,"score_linear":62618.0,"score_lmetric":37527},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1190,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":37527,"score_linear":48381.0,"score_lmetric":85908},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":37527,"score_linear":66152.0,"score_lmetric":103679},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":23552,"new_prefill":13975,"score_linear":-23552.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":127576,"ongoing_decode_tokens":77113,"pending_prefill_tokens":8343,"num_requests":3,"active_p_offloads":0,"cached_blocks":1485,"cache_hit":0,"new_prefill":37527,"score_linear":127576.0,"score_lmetric":137610}],"chosen_score_linear":-23552.0,"chosen_score_lmetric":0,"t_first_token":387095.196507604,"t_first_token_unix":1779817960.2104514,"t_done":387097.081733784,"t_done_unix":1779817962.0956779},{"request_id":"1343191:1:1343191:457","session_id":"1343191","input_length":11912,"t_proxy_recv":387097.122815806,"t_decision_unix":1779817962.1367564,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11912,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":11912,"score_linear":62618.0,"score_lmetric":11912},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68579,"ongoing_decode_tokens":0,"pending_prefill_tokens":63459,"num_requests":2,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":11912,"score_linear":68579.0,"score_lmetric":150742},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":11912,"score_linear":65289.0,"score_lmetric":77201},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":11912,"score_linear":66152.0,"score_lmetric":78064},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1034,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":178949,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":11912,"score_linear":134029.0,"score_lmetric":35736}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387098.091013654,"t_first_token_unix":1779817963.1049573,"t_done":387098.139967259,"t_done_unix":1779817963.1539106},{"request_id":"1279412:20:1337591:428","session_id":"1279412","input_length":95383,"t_proxy_recv":387089.714219072,"t_decision_unix":1779817954.7281609,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":87040,"affinity_cache_ratio":0.912531583196167,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":87040,"estimated_new_tokens":8343,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21221,"ongoing_decode_tokens":21221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":95383,"score_linear":21221.0,"score_lmetric":95383},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":95383,"score_linear":62618.0,"score_lmetric":95383},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":5280,"ongoing_decode_tokens":0,"pending_prefill_tokens":5280,"num_requests":1,"active_p_offloads":0,"cached_blocks":1180,"cache_hit":0,"new_prefill":95383,"score_linear":5280.0,"score_lmetric":100663},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":95383,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":95383,"score_linear":48381.0,"score_lmetric":143764},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":12800,"new_prefill":82583,"score_linear":53352.0,"score_lmetric":148735},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":2279,"ongoing_decode_tokens":2279,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":95383,"score_linear":2279.0,"score_lmetric":95383},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32193,"ongoing_decode_tokens":77113,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1485,"cache_hit":87040,"new_prefill":8343,"score_linear":-54847.0,"score_lmetric":16686}],"chosen_score_linear":-54847.0,"chosen_score_lmetric":16686,"t_first_token":387094.21027747,"t_first_token_unix":1779817959.2242222,"t_done":387098.266044321,"t_done_unix":1779817963.2799885},{"request_id":"1338292:2:1343599:460","session_id":"1338292","input_length":14103,"t_proxy_recv":387098.329083622,"t_decision_unix":1779817963.343025,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.6534779834077856,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":821,"cache_hit":0,"new_prefill":14103,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14103,"score_linear":62618.0,"score_lmetric":14103},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":14103,"score_linear":78811.0,"score_lmetric":234198},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":14103,"score_linear":65289.0,"score_lmetric":79392},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":14103,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":14103,"score_linear":66152.0,"score_lmetric":80255},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21402,"ongoing_decode_tokens":0,"pending_prefill_tokens":21402,"num_requests":1,"active_p_offloads":0,"cached_blocks":1034,"cache_hit":0,"new_prefill":14103,"score_linear":21402.0,"score_lmetric":35505},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134189,"ongoing_decode_tokens":83566,"pending_prefill_tokens":311,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":9216,"new_prefill":4887,"score_linear":124973.0,"score_lmetric":15594}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387099.552739777,"t_first_token_unix":1779817964.5666833,"t_done":387099.612363127,"t_done_unix":1779817964.6263063},{"request_id":"1343312:1:1343312:459","session_id":"1343312","input_length":21402,"t_proxy_recv":387097.490778867,"t_decision_unix":1779817962.50472,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21402,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11912,"ongoing_decode_tokens":0,"pending_prefill_tokens":11912,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":21402,"score_linear":11912.0,"score_lmetric":33314},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21402,"score_linear":62618.0,"score_lmetric":21402},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":21402,"score_linear":78811.0,"score_lmetric":256095},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":21402,"score_linear":65289.0,"score_lmetric":86691},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":21402,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":21402,"score_linear":66152.0,"score_lmetric":87554},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1034,"cache_hit":0,"new_prefill":21402,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":178949,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":21402,"score_linear":134029.0,"score_lmetric":64206}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387099.796942975,"t_first_token_unix":1779817964.8108864,"t_done":387099.853061243,"t_done_unix":1779817964.8670046},{"request_id":"1279412:21:1339581:440","session_id":"1279412","input_length":95543,"t_proxy_recv":387098.283381741,"t_decision_unix":1779817963.2973228,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":95232,"affinity_cache_ratio":0.9967449211349864,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":95232,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":821,"cache_hit":0,"new_prefill":95543,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":95543,"score_linear":62618.0,"score_lmetric":95543},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":95543,"score_linear":78811.0,"score_lmetric":478518},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":95543,"score_linear":65289.0,"score_lmetric":160832},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":95543,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":12800,"new_prefill":82743,"score_linear":53352.0,"score_lmetric":148895},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21402,"ongoing_decode_tokens":0,"pending_prefill_tokens":21402,"num_requests":1,"active_p_offloads":0,"cached_blocks":1034,"cache_hit":0,"new_prefill":95543,"score_linear":21402.0,"score_lmetric":116945},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":95232,"new_prefill":311,"score_linear":-56586.0,"score_lmetric":622}],"chosen_score_linear":-56586.0,"chosen_score_lmetric":622,"t_first_token":387098.450973247,"t_first_token_unix":1779817963.4649167,"t_done":387103.849679054,"t_done_unix":1779817968.8636227},{"request_id":"1345921:1:1345921:469","session_id":"1345921","input_length":505,"t_proxy_recv":387106.251964508,"t_decision_unix":1779817971.2659054,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":32816,"ongoing_decode_tokens":0,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":848,"cache_hit":0,"new_prefill":505,"score_linear":32816.0,"score_lmetric":33321},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":505,"score_linear":62618.0,"score_lmetric":505},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":505,"score_linear":78811.0,"score_lmetric":193404},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":505,"score_linear":125556.0,"score_lmetric":209223},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":505,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":505,"score_linear":66152.0,"score_lmetric":505},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73946,"ongoing_decode_tokens":73946,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":505,"score_linear":73946.0,"score_lmetric":505},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134427,"ongoing_decode_tokens":179347,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":505,"score_linear":134427.0,"score_lmetric":1515}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387106.308408784,"t_first_token_unix":1779817971.3223522,"t_done":387106.630482638,"t_done_unix":1779817971.6444263},{"request_id":"1344773:1:1344773:465","session_id":"1344773","input_length":32816,"t_proxy_recv":387102.355318096,"t_decision_unix":1779817967.3692594,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":32816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":848,"cache_hit":0,"new_prefill":32816,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":32816,"score_linear":62618.0,"score_lmetric":32816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":32816,"score_linear":78811.0,"score_lmetric":290337},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":32816,"score_linear":125556.0,"score_lmetric":306156},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":32816,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":32816,"score_linear":66152.0,"score_lmetric":98968},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":32816,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134189,"ongoing_decode_tokens":179109,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":32816,"score_linear":134189.0,"score_lmetric":98448}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387106.902701337,"t_first_token_unix":1779817971.916645,"t_done":387107.042853063,"t_done_unix":1779817972.0567963},{"request_id":"1344773:2:1346419:473","session_id":"1344773","input_length":33008,"t_proxy_recv":387108.121615104,"t_decision_unix":1779817973.1355555,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":32768,"affinity_cache_ratio":0.9927290353853612,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":32768,"estimated_new_tokens":240,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":32768,"new_prefill":240,"score_linear":-32768.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":33008,"score_linear":62618.0,"score_lmetric":33008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":78811,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":33008,"score_linear":78811.0,"score_lmetric":99024},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":33008,"score_linear":125556.0,"score_lmetric":306732},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37019,"ongoing_decode_tokens":0,"pending_prefill_tokens":2715,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":33008,"score_linear":37019.0,"score_lmetric":35723},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":33008,"score_linear":66152.0,"score_lmetric":33008},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73946,"ongoing_decode_tokens":73946,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":33008,"score_linear":73946.0,"score_lmetric":33008},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134427,"ongoing_decode_tokens":179347,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":33008,"score_linear":134427.0,"score_lmetric":99024}],"chosen_score_linear":-32768.0,"chosen_score_lmetric":0,"t_first_token":387108.252304642,"t_first_token_unix":1779817973.266248,"t_done":387108.425049155,"t_done_unix":1779817973.4389927},{"request_id":"1269373:18:1345570:467","session_id":"1269373","input_length":73946,"t_proxy_recv":387104.925284062,"t_decision_unix":1779817969.9392252,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9901279311930328,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":730,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":32816,"ongoing_decode_tokens":0,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":848,"cache_hit":4096,"new_prefill":69850,"score_linear":28720.0,"score_lmetric":102666},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":73946,"score_linear":62618.0,"score_lmetric":73946},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":73946,"score_linear":78811.0,"score_lmetric":413727},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":7680,"new_prefill":66266,"score_linear":117876.0,"score_lmetric":406506},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":73946,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":73946,"score_linear":66152.0,"score_lmetric":73946},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":73216,"new_prefill":730,"score_linear":-73216.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134427,"ongoing_decode_tokens":179347,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":7680,"new_prefill":66266,"score_linear":126747.0,"score_lmetric":198798}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":387105.327248471,"t_first_token_unix":1779817970.3411922,"t_done":387108.630197907,"t_done_unix":1779817973.644142},{"request_id":"1341005:2:1342961:456","session_id":"1341005","input_length":9360,"t_proxy_recv":387096.217231127,"t_decision_unix":1779817961.231172,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":5120,"affinity_cache_ratio":0.5470085470085471,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":4240,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":9360,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9360,"score_linear":62618.0,"score_lmetric":9360},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":5120,"new_prefill":4240,"score_linear":54099.0,"score_lmetric":63459},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":9360,"score_linear":65289.0,"score_lmetric":74649},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":48381,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":9360,"score_linear":48381.0,"score_lmetric":9360},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":9360,"score_linear":66152.0,"score_lmetric":75512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":37527,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":9360,"score_linear":37527.0,"score_lmetric":9360},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":178949,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":9360,"score_linear":134029.0,"score_lmetric":28080}],"chosen_score_linear":54099.0,"chosen_score_lmetric":63459,"t_first_token":387108.046818353,"t_first_token_unix":1779817973.0607617,"t_done":387108.690952568,"t_done_unix":1779817973.704896},{"request_id":"1279412:22:1344210:462","session_id":"1279412","input_length":95781,"t_proxy_recv":387103.874709108,"t_decision_unix":1779817968.8886504,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9996137020912289,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":37,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":32816,"ongoing_decode_tokens":0,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":848,"cache_hit":0,"new_prefill":95781,"score_linear":32816.0,"score_lmetric":128597},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":95781,"score_linear":62618.0,"score_lmetric":95781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":95781,"score_linear":78811.0,"score_lmetric":479232},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":95781,"score_linear":125556.0,"score_lmetric":495051},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":95781,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":12800,"new_prefill":82981,"score_linear":53352.0,"score_lmetric":82981},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":95781,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":95744,"new_prefill":37,"score_linear":-57098.0,"score_lmetric":74}],"chosen_score_linear":-57098.0,"chosen_score_lmetric":74,"t_first_token":387104.04609461,"t_first_token_unix":1779817969.0600379,"t_done":387109.045266363,"t_done_unix":1779817974.0592098},{"request_id":"1342634:1:1342634:454","session_id":"1342634","input_length":59219,"t_proxy_recv":387095.087813763,"t_decision_unix":1779817960.101755,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":59219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":41267,"ongoing_decode_tokens":41267,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":760,"cache_hit":0,"new_prefill":59219,"score_linear":41267.0,"score_lmetric":118438},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":59219,"score_linear":62618.0,"score_lmetric":59219},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":59219,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":59219,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":59219,"score_linear":48381.0,"score_lmetric":107600},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":59219,"score_linear":66152.0,"score_lmetric":125371},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":39656,"ongoing_decode_tokens":0,"pending_prefill_tokens":14056,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":59219,"score_linear":39656.0,"score_lmetric":146550},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":157578,"pending_prefill_tokens":6523,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":59219,"score_linear":134029.0,"score_lmetric":197226}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387108.043839808,"t_first_token_unix":1779817973.0577836,"t_done":387109.315643011,"t_done_unix":1779817974.329587},{"request_id":"1341912:2:1343220:458","session_id":"1341912","input_length":10232,"t_proxy_recv":387097.199136621,"t_decision_unix":1779817962.213078,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9507427677873339,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11912,"ongoing_decode_tokens":0,"pending_prefill_tokens":11912,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":10232,"score_linear":11912.0,"score_lmetric":22144},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":10232,"score_linear":62618.0,"score_lmetric":10232},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68579,"ongoing_decode_tokens":0,"pending_prefill_tokens":63459,"num_requests":2,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":9728,"new_prefill":504,"score_linear":58851.0,"score_lmetric":127926},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":10232,"score_linear":65289.0,"score_lmetric":75521},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":10232,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":10232,"score_linear":66152.0,"score_lmetric":76384},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1034,"cache_hit":0,"new_prefill":10232,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":178949,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":10232,"score_linear":134029.0,"score_lmetric":30696}],"chosen_score_linear":58851.0,"chosen_score_lmetric":127926,"t_first_token":387108.046093434,"t_first_token_unix":1779817973.060037,"t_done":387109.519568712,"t_done_unix":1779817974.5335119},{"request_id":"1268861:6:1346340:472","session_id":"1268861","input_length":37019,"t_proxy_recv":387107.795762185,"t_decision_unix":1779817972.809703,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9266592830708555,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":2715,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":37019,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":37019,"score_linear":62618.0,"score_lmetric":37019},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":37019,"score_linear":78811.0,"score_lmetric":302946},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":37019,"score_linear":125556.0,"score_lmetric":318765},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":944,"cache_hit":34304,"new_prefill":2715,"score_linear":-34304.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":37019,"score_linear":66152.0,"score_lmetric":37019},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73946,"ongoing_decode_tokens":73946,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":37019,"score_linear":73946.0,"score_lmetric":37019},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134427,"ongoing_decode_tokens":179347,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":37019,"score_linear":134427.0,"score_lmetric":111057}],"chosen_score_linear":-34304.0,"chosen_score_lmetric":0,"t_first_token":387108.463699809,"t_first_token_unix":1779817973.4776433,"t_done":387110.286182429,"t_done_unix":1779817975.3001258},{"request_id":"1345921:2:1347089:474","session_id":"1345921","input_length":773,"t_proxy_recv":387110.4387782,"t_decision_unix":1779817975.4527197,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":512,"affinity_cache_ratio":0.6623544631306598,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":773,"score_linear":62618.0,"score_lmetric":773},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":0,"pending_prefill_tokens":69236,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":773,"score_linear":125556.0,"score_lmetric":210027},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":512,"new_prefill":261,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":773,"score_linear":66152.0,"score_lmetric":773},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":773,"score_linear":38646.0,"score_lmetric":1546}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":387110.476564018,"t_first_token_unix":1779817975.4905076,"t_done":387110.725165126,"t_done_unix":1779817975.7391083},{"request_id":"1342327:2:1343857:461","session_id":"1342327","input_length":9820,"t_proxy_recv":387099.150806541,"t_decision_unix":1779817964.1647477,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":6144,"affinity_cache_ratio":0.6256619144602852,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":3676,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14103,"ongoing_decode_tokens":0,"pending_prefill_tokens":14103,"num_requests":1,"active_p_offloads":0,"cached_blocks":821,"cache_hit":0,"new_prefill":9820,"score_linear":14103.0,"score_lmetric":23923},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9820,"score_linear":62618.0,"score_lmetric":9820},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":9820,"score_linear":78811.0,"score_lmetric":221349},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":6144,"new_prefill":3676,"score_linear":59145.0,"score_lmetric":68965},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":9820,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":9820,"score_linear":66152.0,"score_lmetric":75972},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21402,"ongoing_decode_tokens":0,"pending_prefill_tokens":21402,"num_requests":1,"active_p_offloads":0,"cached_blocks":1034,"cache_hit":0,"new_prefill":9820,"score_linear":21402.0,"score_lmetric":31222},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134189,"ongoing_decode_tokens":179109,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":9820,"score_linear":134189.0,"score_lmetric":29460}],"chosen_score_linear":59145.0,"chosen_score_lmetric":68965,"t_first_token":387111.509219181,"t_first_token_unix":1779817976.5231626,"t_done":387112.226490219,"t_done_unix":1779817977.2404432},{"request_id":"1316848:15:1344261:463","session_id":"1316848","input_length":50447,"t_proxy_recv":387100.561722982,"t_decision_unix":1779817965.5756643,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":50176,"affinity_cache_ratio":0.9946280254524551,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":271,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":848,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":50447,"score_linear":62618.0,"score_lmetric":50447},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":78811,"ongoing_decode_tokens":0,"pending_prefill_tokens":63963,"num_requests":3,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":50447,"score_linear":78811.0,"score_lmetric":343230},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75109,"ongoing_decode_tokens":0,"pending_prefill_tokens":68965,"num_requests":2,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":50176,"new_prefill":271,"score_linear":24933.0,"score_lmetric":138472},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":943,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":50447,"score_linear":66152.0,"score_lmetric":116599},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1075,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134189,"ongoing_decode_tokens":179109,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":50447,"score_linear":134189.0,"score_lmetric":151341}],"chosen_score_linear":24933.0,"chosen_score_lmetric":138472,"t_first_token":387111.507854934,"t_first_token_unix":1779817976.521799,"t_done":387112.254536872,"t_done_unix":1779817977.268481},{"request_id":"1341948:2:1347296:475","session_id":"1341948","input_length":25661,"t_proxy_recv":387111.155247944,"t_decision_unix":1779817976.1691892,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":19456,"affinity_cache_ratio":0.7581933673668212,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":6205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":912,"cache_hit":19456,"new_prefill":6205,"score_linear":-19456.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":25661,"score_linear":62618.0,"score_lmetric":25661},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":125556,"ongoing_decode_tokens":65289,"pending_prefill_tokens":3947,"num_requests":3,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":25661,"score_linear":125556.0,"score_lmetric":88824},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":25661,"score_linear":66152.0,"score_lmetric":25661},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":25661,"score_linear":38646.0,"score_lmetric":51322}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":387112.206195846,"t_first_token_unix":1779817977.2201395,"t_done":387112.494187953,"t_done_unix":1779817977.5081315},{"request_id":"1347763:1:1347763:476","session_id":"1347763","input_length":5465,"t_proxy_recv":387112.763998258,"t_decision_unix":1779817977.7779396,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":5465,"score_linear":62618.0,"score_lmetric":5465},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136502,"ongoing_decode_tokens":77687,"pending_prefill_tokens":8639,"num_requests":3,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":5465,"score_linear":136502.0,"score_lmetric":42312},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":5465,"score_linear":66152.0,"score_lmetric":5465},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":5465,"score_linear":38646.0,"score_lmetric":10930}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387113.120692045,"t_first_token_unix":1779817978.134636,"t_done":387113.245086316,"t_done_unix":1779817978.2590303},{"request_id":"1316848:16:1345678:468","session_id":"1316848","input_length":58815,"t_proxy_recv":387112.267704816,"t_decision_unix":1779817977.2816465,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":50176,"affinity_cache_ratio":0.8531157017767577,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":8639,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25661,"ongoing_decode_tokens":25661,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":58815,"score_linear":25661.0,"score_lmetric":58815},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":58815,"score_linear":62618.0,"score_lmetric":58815},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":58815,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":77687,"ongoing_decode_tokens":65289,"pending_prefill_tokens":2670,"num_requests":2,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":50176,"new_prefill":8639,"score_linear":27511.0,"score_lmetric":22618},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":58815,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":58815,"score_linear":66152.0,"score_lmetric":58815},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":58815,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":58815,"score_linear":38646.0,"score_lmetric":117630}],"chosen_score_linear":27511.0,"chosen_score_lmetric":22618,"t_first_token":387115.646168364,"t_first_token_unix":1779817980.6601121,"t_done":387115.869853309,"t_done_unix":1779817980.8837972},{"request_id":"1342327:3:1344788:466","session_id":"1342327","input_length":12398,"t_proxy_recv":387112.231991925,"t_decision_unix":1779817977.245933,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9728,"affinity_cache_ratio":0.78464268430392,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":2670,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25661,"ongoing_decode_tokens":25661,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":12398,"score_linear":25661.0,"score_lmetric":12398},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":12398,"score_linear":62618.0,"score_lmetric":12398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":115736,"ongoing_decode_tokens":115736,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":9728,"new_prefill":2670,"score_linear":106008.0,"score_lmetric":5340},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":12398,"score_linear":66152.0,"score_lmetric":12398},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":12398,"score_linear":38646.0,"score_lmetric":24796}],"chosen_score_linear":106008.0,"chosen_score_lmetric":5340,"t_first_token":387112.614624083,"t_first_token_unix":1779817977.6285675,"t_done":387115.927766889,"t_done_unix":1779817980.9417107},{"request_id":"1342327:4:1346218:471","session_id":"1342327","input_length":14842,"t_proxy_recv":387115.932811432,"t_decision_unix":1779817980.9467528,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":12288,"affinity_cache_ratio":0.8279207653954993,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":2554,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":14842,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14842,"score_linear":62618.0,"score_lmetric":14842},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":14842,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1295,"cache_hit":12288,"new_prefill":2554,"score_linear":53001.0,"score_lmetric":2554},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":959,"cache_hit":0,"new_prefill":14842,"score_linear":17217.0,"score_lmetric":32059},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105788,"ongoing_decode_tokens":66152,"pending_prefill_tokens":3284,"num_requests":2,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":14842,"score_linear":105788.0,"score_lmetric":36252},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":14842,"score_linear":41202.0,"score_lmetric":14842},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":14842,"score_linear":134672.0,"score_lmetric":44526}],"chosen_score_linear":53001.0,"chosen_score_lmetric":2554,"t_first_token":387116.285290489,"t_first_token_unix":1779817981.2992342,"t_done":387116.374667669,"t_done_unix":1779817981.3886108},{"request_id":"1311753:3:1348389:480","session_id":"1311753","input_length":39636,"t_proxy_recv":387115.24444498,"t_decision_unix":1779817980.2583861,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9171460288626501,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":3284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":39636,"score_linear":62618.0,"score_lmetric":39636},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136502,"ongoing_decode_tokens":77687,"pending_prefill_tokens":8639,"num_requests":3,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":39636,"score_linear":136502.0,"score_lmetric":144825},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":959,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":36352,"new_prefill":3284,"score_linear":29800.0,"score_lmetric":3284},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41202,"ongoing_decode_tokens":0,"pending_prefill_tokens":3826,"num_requests":1,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":39636,"score_linear":41202.0,"score_lmetric":43462},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":39636,"score_linear":134672.0,"score_lmetric":118908}],"chosen_score_linear":29800.0,"chosen_score_lmetric":3284,"t_first_token":387116.168476907,"t_first_token_unix":1779817981.1824205,"t_done":387116.645328737,"t_done_unix":1779817981.6592717},{"request_id":"1345921:3:1348784:483","session_id":"1345921","input_length":1397,"t_proxy_recv":387116.436982127,"t_decision_unix":1779817981.4509234,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":512,"affinity_cache_ratio":0.36649964209019326,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12701,"ongoing_decode_tokens":0,"pending_prefill_tokens":12701,"num_requests":1,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":1397,"score_linear":12701.0,"score_lmetric":14098},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":1397,"score_linear":62618.0,"score_lmetric":1397},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":1397,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1300,"cache_hit":0,"new_prefill":1397,"score_linear":65289.0,"score_lmetric":1397},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":959,"cache_hit":512,"new_prefill":885,"score_linear":16705.0,"score_lmetric":18102},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105788,"ongoing_decode_tokens":105788,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":1397,"score_linear":105788.0,"score_lmetric":2794},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":1397,"score_linear":41202.0,"score_lmetric":1397},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":1397,"score_linear":134672.0,"score_lmetric":4191}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387116.544213433,"t_first_token_unix":1779817981.5581567,"t_done":387116.660507454,"t_done_unix":1779817981.6744509},{"request_id":"1314357:3:1338999:437","session_id":"1314357","input_length":66152,"t_proxy_recv":387088.341074553,"t_decision_unix":1779817953.3550162,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":5,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9287701052122385,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21221,"ongoing_decode_tokens":0,"pending_prefill_tokens":21221,"num_requests":1,"active_p_offloads":0,"cached_blocks":718,"cache_hit":3584,"new_prefill":62568,"score_linear":17637.0,"score_lmetric":83789},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":66152,"score_linear":62618.0,"score_lmetric":66152},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":66152,"score_linear":45994.0,"score_lmetric":66152},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":66152,"score_linear":48381.0,"score_lmetric":114533},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1003,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":119457,"ongoing_decode_tokens":164377,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":61440,"new_prefill":4712,"score_linear":58017.0,"score_lmetric":14136}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387103.672095273,"t_first_token_unix":1779817968.6860387,"t_done":387116.760336763,"t_done_unix":1779817981.7742808},{"request_id":"1348394:1:1348394:481","session_id":"1348394","input_length":17217,"t_proxy_recv":387115.275038492,"t_decision_unix":1779817980.2889795,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17217,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":17217,"score_linear":62618.0,"score_lmetric":17217},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136502,"ongoing_decode_tokens":77687,"pending_prefill_tokens":8639,"num_requests":3,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":17217,"score_linear":136502.0,"score_lmetric":77568},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":959,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105788,"ongoing_decode_tokens":66152,"pending_prefill_tokens":3284,"num_requests":2,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":17217,"score_linear":105788.0,"score_lmetric":41002},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41202,"ongoing_decode_tokens":0,"pending_prefill_tokens":3826,"num_requests":1,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":17217,"score_linear":41202.0,"score_lmetric":21043},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":17217,"score_linear":134672.0,"score_lmetric":51651}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387116.944058605,"t_first_token_unix":1779817981.9580028,"t_done":387117.318410116,"t_done_unix":1779817982.3323536},{"request_id":"1348691:1:1348691:482","session_id":"1348691","input_length":12701,"t_proxy_recv":387116.136084558,"t_decision_unix":1779817981.150026,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12701,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":12701,"score_linear":62618.0,"score_lmetric":12701},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80131,"ongoing_decode_tokens":65289,"pending_prefill_tokens":2554,"num_requests":2,"active_p_offloads":0,"cached_blocks":1295,"cache_hit":0,"new_prefill":12701,"score_linear":80131.0,"score_lmetric":30510},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":959,"cache_hit":0,"new_prefill":12701,"score_linear":17217.0,"score_lmetric":29918},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105788,"ongoing_decode_tokens":66152,"pending_prefill_tokens":3284,"num_requests":2,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":12701,"score_linear":105788.0,"score_lmetric":31970},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":12701,"score_linear":41202.0,"score_lmetric":12701},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":12701,"score_linear":134672.0,"score_lmetric":38103}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387117.195123911,"t_first_token_unix":1779817982.2090676,"t_done":387117.548371312,"t_done_unix":1779817982.5623147},{"request_id":"1342921:1:1342921:455","session_id":"1342921","input_length":65289,"t_proxy_recv":387096.127398093,"t_decision_unix":1779817961.141339,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":65289,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":65289,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":65289,"score_linear":62618.0,"score_lmetric":65289},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":65289,"score_linear":59219.0,"score_lmetric":124508},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1267,"cache_hit":0,"new_prefill":65289,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":48381,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":65289,"score_linear":48381.0,"score_lmetric":65289},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":65289,"score_linear":66152.0,"score_lmetric":131441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":37527,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":65289,"score_linear":37527.0,"score_lmetric":65289},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134029,"ongoing_decode_tokens":178949,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":0,"new_prefill":65289,"score_linear":134029.0,"score_lmetric":195867}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387111.121690709,"t_first_token_unix":1779817976.1356347,"t_done":387118.998583737,"t_done_unix":1779817984.0125277},{"request_id":"1344773:3:1349525:486","session_id":"1344773","input_length":33334,"t_proxy_recv":387119.071936151,"t_decision_unix":1779817984.0858774,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":32768,"affinity_cache_ratio":0.9830203395932081,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32768,"estimated_new_tokens":566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":948,"cache_hit":32768,"new_prefill":566,"score_linear":-32768.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":33334,"score_linear":62618.0,"score_lmetric":33334},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1335,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1173,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117695,"ongoing_decode_tokens":41202,"pending_prefill_tokens":2253,"num_requests":2,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":33334,"score_linear":117695.0,"score_lmetric":71174},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":33334,"score_linear":134672.0,"score_lmetric":100002}],"chosen_score_linear":-32768.0,"chosen_score_lmetric":0,"t_first_token":387119.266310654,"t_first_token_unix":1779817984.2802541,"t_done":387120.697537109,"t_done_unix":1779817985.7114809},{"request_id":"1349975:1:1349975:487","session_id":"1349975","input_length":4988,"t_proxy_recv":387120.660152251,"t_decision_unix":1779817985.6740935,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4988,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33334,"ongoing_decode_tokens":33334,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":948,"cache_hit":0,"new_prefill":4988,"score_linear":33334.0,"score_lmetric":4988},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":4988,"score_linear":62618.0,"score_lmetric":4988},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1335,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1173,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117695,"ongoing_decode_tokens":117695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":4988,"score_linear":117695.0,"score_lmetric":9976},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":4988,"score_linear":134672.0,"score_lmetric":14964}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387120.980045912,"t_first_token_unix":1779817985.9939897,"t_done":387121.298364637,"t_done_unix":1779817986.3123083},{"request_id":"1350162:1:1350162:488","session_id":"1350162","input_length":4594,"t_proxy_recv":387121.345983414,"t_decision_unix":1779817986.359925,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4594,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":4594,"score_linear":62618.0,"score_lmetric":4594},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1335,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1173,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117695,"ongoing_decode_tokens":117695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":4594,"score_linear":117695.0,"score_lmetric":9188},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":4594,"score_linear":134672.0,"score_lmetric":13782}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387121.637777961,"t_first_token_unix":1779817986.651722,"t_done":387121.752566188,"t_done_unix":1779817986.7665098},{"request_id":"1350896:1:1350896:489","session_id":"1350896","input_length":1471,"t_proxy_recv":387123.792216317,"t_decision_unix":1779817988.8061576,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":1471,"score_linear":62618.0,"score_lmetric":1471},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1335,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117695,"ongoing_decode_tokens":117695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":1471,"score_linear":117695.0,"score_lmetric":2942},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":1471,"score_linear":134672.0,"score_lmetric":4413}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387123.897167004,"t_first_token_unix":1779817988.9111102,"t_done":387124.259935599,"t_done_unix":1779817989.2738793},{"request_id":"1269373:19:1349406:485","session_id":"1269373","input_length":76493,"t_proxy_recv":387118.724438759,"t_decision_unix":1779817983.7383797,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":74240,"affinity_cache_ratio":0.9705463245002811,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74240,"estimated_new_tokens":2253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":948,"cache_hit":4096,"new_prefill":72397,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":76493,"score_linear":62618.0,"score_lmetric":76493},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1335,"cache_hit":0,"new_prefill":76493,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1300,"cache_hit":7680,"new_prefill":68813,"score_linear":57609.0,"score_lmetric":68813},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":76493,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1173,"cache_hit":0,"new_prefill":76493,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":74240,"new_prefill":2253,"score_linear":-33038.0,"score_lmetric":2253},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":7680,"new_prefill":68813,"score_linear":126992.0,"score_lmetric":206439}],"chosen_score_linear":-33038.0,"chosen_score_lmetric":2253,"t_first_token":387119.967991439,"t_first_token_unix":1779817984.9819348,"t_done":387124.392420299,"t_done_unix":1779817989.4063642},{"request_id":"1350980:1:1350980:490","session_id":"1350980","input_length":15313,"t_proxy_recv":387124.04385729,"t_decision_unix":1779817989.0577986,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15313,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":1471,"ongoing_decode_tokens":1471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":949,"cache_hit":0,"new_prefill":15313,"score_linear":1471.0,"score_lmetric":15313},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":15313,"score_linear":62618.0,"score_lmetric":15313},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1335,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117695,"ongoing_decode_tokens":117695,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":15313,"score_linear":117695.0,"score_lmetric":30626},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":15313,"score_linear":134672.0,"score_lmetric":45939}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387125.417100711,"t_first_token_unix":1779817990.431044,"t_done":387125.456854737,"t_done_unix":1779817990.470798},{"request_id":"1334223:3:1348241:479","session_id":"1334223","input_length":41202,"t_proxy_recv":387114.676512022,"t_decision_unix":1779817979.690453,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9071404300762099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":3826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":41202,"score_linear":62618.0,"score_lmetric":41202},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136502,"ongoing_decode_tokens":77687,"pending_prefill_tokens":8639,"num_requests":3,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":41202,"score_linear":136502.0,"score_lmetric":149523},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":959,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":41202,"score_linear":66152.0,"score_lmetric":41202},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":37376,"new_prefill":3826,"score_linear":-37376.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":41202,"score_linear":134672.0,"score_lmetric":123606}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":387115.654524177,"t_first_token_unix":1779817980.6684675,"t_done":387126.495477304,"t_done_unix":1779817991.5094209},{"request_id":"1253743:5:1351907:492","session_id":"1253743","input_length":51340,"t_proxy_recv":387127.575744917,"t_decision_unix":1779817992.589686,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":50176,"affinity_cache_ratio":0.9773276197896377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":1164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":4608,"new_prefill":46732,"score_linear":58010.0,"score_lmetric":46732},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":50176,"new_prefill":1164,"score_linear":-50176.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":51340,"score_linear":134672.0,"score_lmetric":154020}],"chosen_score_linear":-50176.0,"chosen_score_lmetric":0,"t_first_token":387127.956887542,"t_first_token_unix":1779817992.9708312,"t_done":387128.382854883,"t_done_unix":1779817993.3967984},{"request_id":"1344773:4:1352462:494","session_id":"1344773","input_length":33579,"t_proxy_recv":387129.370881956,"t_decision_unix":1779817994.3848233,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9910956252419667,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":299,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":952,"cache_hit":33280,"new_prefill":299,"score_linear":-11844.0,"score_lmetric":9447},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":33579,"score_linear":62618.0,"score_lmetric":33579},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":33579,"score_linear":134672.0,"score_lmetric":100737}],"chosen_score_linear":-11844.0,"chosen_score_lmetric":9447,"t_first_token":387130.080990168,"t_first_token_unix":1779817995.094934,"t_done":387130.29994446,"t_done_unix":1779817995.3138878},{"request_id":"1348691:2:1352277:493","session_id":"1348691","input_length":21436,"t_proxy_recv":387128.759869822,"t_decision_unix":1779817993.7738109,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":12288,"affinity_cache_ratio":0.5732412763575294,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":9148,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":12288,"new_prefill":9148,"score_linear":-12288.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21436,"score_linear":62618.0,"score_lmetric":21436},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":21436,"score_linear":134672.0,"score_lmetric":64308}],"chosen_score_linear":-12288.0,"chosen_score_lmetric":0,"t_first_token":387130.05231358,"t_first_token_unix":1779817995.0662572,"t_done":387130.36022832,"t_done_unix":1779817995.3741717},{"request_id":"1350162:2:1352468:495","session_id":"1350162","input_length":10575,"t_proxy_recv":387129.384085419,"t_decision_unix":1779817994.398027,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.4357446808510638,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":5967,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":55015,"ongoing_decode_tokens":0,"pending_prefill_tokens":9447,"num_requests":2,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":10575,"score_linear":55015.0,"score_lmetric":40044},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":10575,"score_linear":62618.0,"score_lmetric":10575},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":4608,"new_prefill":5967,"score_linear":-4608.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":10575,"score_linear":134672.0,"score_lmetric":31725}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":387129.934887816,"t_first_token_unix":1779817994.9488316,"t_done":387130.524769592,"t_done_unix":1779817995.5387125},{"request_id":"1345921:4:1353010:501","session_id":"1345921","input_length":6935,"t_proxy_recv":387131.368556417,"t_decision_unix":1779817996.382498,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":1024,"affinity_cache_ratio":0.14765681326604183,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":5911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":14239,"ongoing_decode_tokens":0,"pending_prefill_tokens":14239,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":6935,"score_linear":14239.0,"score_lmetric":21174},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":6935,"score_linear":62618.0,"score_lmetric":6935},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":1024,"new_prefill":5911,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":6935,"score_linear":18840.0,"score_lmetric":25775},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83326,"ongoing_decode_tokens":0,"pending_prefill_tokens":382,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":512,"new_prefill":6423,"score_linear":82814.0,"score_lmetric":6805},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":6935,"score_linear":68259.0,"score_lmetric":6935},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":77790,"ongoing_decode_tokens":77790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":6935,"score_linear":77790.0,"score_lmetric":6935},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":6935,"score_linear":134672.0,"score_lmetric":20805}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":387131.776954926,"t_first_token_unix":1779817996.7908988,"t_done":387131.779220212,"t_done_unix":1779817996.793164},{"request_id":"1352606:1:1352606:496","session_id":"1352606","input_length":18840,"t_proxy_recv":387129.952738434,"t_decision_unix":1779817994.9666793,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":55015,"ongoing_decode_tokens":0,"pending_prefill_tokens":9447,"num_requests":2,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":18840,"score_linear":55015.0,"score_lmetric":56574},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":18840,"score_linear":62618.0,"score_lmetric":18840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10575,"ongoing_decode_tokens":10575,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":0,"new_prefill":18840,"score_linear":10575.0,"score_lmetric":18840},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":18840,"score_linear":134672.0,"score_lmetric":56520}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387131.83284954,"t_first_token_unix":1779817996.846803,"t_done":387132.273553805,"t_done_unix":1779817997.2874973},{"request_id":"1317598:6:1352957:499","session_id":"1317598","input_length":83326,"t_proxy_recv":387131.222536866,"t_decision_unix":1779817996.2364786,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82944,"affinity_cache_ratio":0.9954155965724983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82944,"estimated_new_tokens":382,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":83326,"score_linear":62618.0,"score_lmetric":83326},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":83326,"score_linear":18840.0,"score_lmetric":102166},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":82944,"new_prefill":382,"score_linear":-82944.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":83326,"score_linear":68259.0,"score_lmetric":83326},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":77790,"ongoing_decode_tokens":77790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":83326,"score_linear":77790.0,"score_lmetric":83326},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":83326,"score_linear":134672.0,"score_lmetric":249978}],"chosen_score_linear":-82944.0,"chosen_score_lmetric":0,"t_first_token":387131.494895792,"t_first_token_unix":1779817996.5088391,"t_done":387132.536401213,"t_done_unix":1779817997.5503447},{"request_id":"1349975:2:1352986:500","session_id":"1349975","input_length":14239,"t_proxy_recv":387131.325278662,"t_decision_unix":1779817996.3392198,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":0,"affinity_cache_hit":4608,"affinity_cache_ratio":0.32361823161738884,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14239,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14239,"score_linear":62618.0,"score_lmetric":14239},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":4608,"new_prefill":9631,"score_linear":14232.0,"score_lmetric":28471},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83326,"ongoing_decode_tokens":0,"pending_prefill_tokens":382,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":14239,"score_linear":83326.0,"score_lmetric":14621},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":14239,"score_linear":68259.0,"score_lmetric":14239},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":77790,"ongoing_decode_tokens":77790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":14239,"score_linear":77790.0,"score_lmetric":14239},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":14239,"score_linear":134672.0,"score_lmetric":42717}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387132.562174153,"t_first_token_unix":1779817997.5761175,"t_done":387132.750280566,"t_done_unix":1779817997.7642243},{"request_id":"1269373:20:1352797:498","session_id":"1269373","input_length":77790,"t_proxy_recv":387130.626284509,"t_decision_unix":1779817995.640226,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9872734284612418,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":990,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":969,"cache_hit":4096,"new_prefill":73694,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":77790,"score_linear":62618.0,"score_lmetric":77790},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":77790,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":7680,"new_prefill":70110,"score_linear":11160.0,"score_lmetric":88950},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":77790,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":77790,"score_linear":68259.0,"score_lmetric":77790},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":76800,"new_prefill":990,"score_linear":-76800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":7680,"new_prefill":70110,"score_linear":126992.0,"score_lmetric":210330}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":387131.180969542,"t_first_token_unix":1779817996.194913,"t_done":387133.263365677,"t_done_unix":1779817998.27731},{"request_id":"1344773:5:1353365:502","session_id":"1344773","input_length":33875,"t_proxy_recv":387132.829632414,"t_decision_unix":1779817997.8435733,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9824354243542436,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":595,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":996,"cache_hit":33280,"new_prefill":595,"score_linear":-33280.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":33875,"score_linear":62618.0,"score_lmetric":33875},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":33875,"score_linear":68259.0,"score_lmetric":33875},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":77790,"ongoing_decode_tokens":77790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":33875,"score_linear":77790.0,"score_lmetric":33875},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":33875,"score_linear":134672.0,"score_lmetric":101625}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":387132.966271354,"t_first_token_unix":1779817997.9802148,"t_done":387134.792332994,"t_done_unix":1779817999.8062768},{"request_id":"1253743:6:1354346:505","session_id":"1253743","input_length":51436,"t_proxy_recv":387136.078288517,"t_decision_unix":1779818001.0922294,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9954117738548877,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":236,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":4608,"new_prefill":46828,"score_linear":58010.0,"score_lmetric":46828},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":51200,"new_prefill":236,"score_linear":-51200.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":51436,"score_linear":83526.0,"score_lmetric":134962},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":51436,"score_linear":68259.0,"score_lmetric":51436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":27651,"ongoing_decode_tokens":0,"pending_prefill_tokens":27651,"num_requests":1,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":51436,"score_linear":27651.0,"score_lmetric":79087},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":51436,"score_linear":134672.0,"score_lmetric":154308}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":387136.175670096,"t_first_token_unix":1779818001.1896138,"t_done":387136.600445116,"t_done_unix":1779818001.6143887},{"request_id":"1353821:1:1353821:503","session_id":"1353821","input_length":27651,"t_proxy_recv":387134.247138524,"t_decision_unix":1779817999.2610798,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27651,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33875,"ongoing_decode_tokens":33875,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":996,"cache_hit":0,"new_prefill":27651,"score_linear":33875.0,"score_lmetric":27651},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":27651,"score_linear":62618.0,"score_lmetric":27651},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":27651,"score_linear":68259.0,"score_lmetric":27651},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":27651,"score_linear":134672.0,"score_lmetric":82953}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387137.688645888,"t_first_token_unix":1779818002.7025895,"t_done":387138.484941507,"t_done_unix":1779818003.498885},{"request_id":"1253804:6:1318560:340","session_id":"1253804","input_length":62618,"t_proxy_recv":387009.869124152,"t_decision_unix":1779817874.8830657,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9403047047174934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":3738,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":611,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":944,"cache_hit":58880,"new_prefill":3738,"score_linear":-58880.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1106,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":3584,"new_prefill":59034,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":62618,"score_linear":79663.0,"score_lmetric":141769},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":188103,"ongoing_decode_tokens":188103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":62618,"score_linear":188103.0,"score_lmetric":125236},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":96736,"ongoing_decode_tokens":141656,"pending_prefill_tokens":-13688,"num_requests":3,"active_p_offloads":0,"cached_blocks":980,"cache_hit":0,"new_prefill":62618,"score_linear":96736.0,"score_lmetric":146790}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":387013.871860388,"t_first_token_unix":1779817878.8858042,"t_done":387139.16023985,"t_done_unix":1779818004.1741834},{"request_id":"1286804:3:1354910:506","session_id":"1286804","input_length":15519,"t_proxy_recv":387138.049813369,"t_decision_unix":1779818003.0637546,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8907790450415619,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1695,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":997,"cache_hit":13824,"new_prefill":1695,"score_linear":-13824.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":15519,"score_linear":62618.0,"score_lmetric":15519},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":15519,"score_linear":83526.0,"score_lmetric":99045},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":15519,"score_linear":68259.0,"score_lmetric":15519},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":27651,"ongoing_decode_tokens":27651,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":15519,"score_linear":27651.0,"score_lmetric":15519},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":15519,"score_linear":134672.0,"score_lmetric":46557}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":387139.38167083,"t_first_token_unix":1779818004.3956144,"t_done":387140.958639675,"t_done_unix":1779818005.9725835},{"request_id":"1355325:1:1355325:507","session_id":"1355325","input_length":24503,"t_proxy_recv":387139.523517263,"t_decision_unix":1779818004.5374584,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24503,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":24503,"score_linear":15519.0,"score_lmetric":24503},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":24503,"score_linear":83526.0,"score_lmetric":108029},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":24503,"score_linear":68259.0,"score_lmetric":24503},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":24503,"score_linear":134672.0,"score_lmetric":73509}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387142.347100972,"t_first_token_unix":1779818007.3610442,"t_done":387142.393427612,"t_done_unix":1779818007.407371},{"request_id":"1355484:1:1355484:508","session_id":"1355484","input_length":19366,"t_proxy_recv":387139.953381916,"t_decision_unix":1779818004.967323,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19366,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":19366,"score_linear":15519.0,"score_lmetric":19366},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":19366,"score_linear":24503.0,"score_lmetric":43869},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":19366,"score_linear":83526.0,"score_lmetric":102892},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":12800,"new_prefill":6566,"score_linear":55459.0,"score_lmetric":6566},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":12800,"new_prefill":6566,"score_linear":121872.0,"score_lmetric":19698}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387141.92096924,"t_first_token_unix":1779818006.9349124,"t_done":387142.511978531,"t_done_unix":1779818007.5259218},{"request_id":"1269373:21:1355702:509","session_id":"1269373","input_length":78089,"t_proxy_recv":387140.640414132,"t_decision_unix":1779818005.6543553,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":77824,"affinity_cache_ratio":0.9966064362458221,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77824,"estimated_new_tokens":265,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":4096,"new_prefill":73993,"score_linear":11423.0,"score_lmetric":73993},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":78089,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":78089,"score_linear":24503.0,"score_lmetric":102592},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19366,"ongoing_decode_tokens":0,"pending_prefill_tokens":19366,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":7680,"new_prefill":70409,"score_linear":11686.0,"score_lmetric":89775},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":78089,"score_linear":83526.0,"score_lmetric":161615},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":78089,"score_linear":68259.0,"score_lmetric":78089},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":77824,"new_prefill":265,"score_linear":-77824.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":7680,"new_prefill":70409,"score_linear":126992.0,"score_lmetric":211227}],"chosen_score_linear":-77824.0,"chosen_score_lmetric":0,"t_first_token":387140.816752699,"t_first_token_unix":1779818005.8306963,"t_done":387144.527178301,"t_done_unix":1779818009.5411227},{"request_id":"1356948:1:1356948:515","session_id":"1356948","input_length":6711,"t_proxy_recv":387145.238307105,"t_decision_unix":1779818010.2522483,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6711,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69506,"ongoing_decode_tokens":0,"pending_prefill_tokens":35714,"num_requests":2,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":6711,"score_linear":69506.0,"score_lmetric":84850},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":6711,"score_linear":48193.0,"score_lmetric":6711},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1422,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":6711,"score_linear":122597.0,"score_lmetric":122652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":6711,"score_linear":132503.0,"score_lmetric":182172},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":6711,"score_linear":68259.0,"score_lmetric":6711},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1148,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":6711,"score_linear":134672.0,"score_lmetric":20133}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387145.691237533,"t_first_token_unix":1779818010.705181,"t_done":387145.959882232,"t_done_unix":1779818010.9738255},{"request_id":"1344773:6:1356097:513","session_id":"1344773","input_length":34198,"t_proxy_recv":387142.211434118,"t_decision_unix":1779818007.2253752,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9881279606994561,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":406,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":33792,"new_prefill":406,"score_linear":1516.0,"score_lmetric":35714},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":34198,"score_linear":48193.0,"score_lmetric":34198},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":34198,"score_linear":24503.0,"score_lmetric":58701},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19366,"ongoing_decode_tokens":19366,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":34198,"score_linear":19366.0,"score_lmetric":34198},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":34198,"score_linear":132503.0,"score_lmetric":237146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":34198,"score_linear":68259.0,"score_lmetric":34198},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":78089,"ongoing_decode_tokens":78089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":0,"new_prefill":34198,"score_linear":78089.0,"score_lmetric":34198},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":34198,"score_linear":134672.0,"score_lmetric":102594}],"chosen_score_linear":1516.0,"chosen_score_lmetric":35714,"t_first_token":387146.787927457,"t_first_token_unix":1779818011.8018708,"t_done":387146.984919438,"t_done_unix":1779818011.9988627},{"request_id":"1355951:1:1355951:511","session_id":"1355951","input_length":35308,"t_proxy_recv":387141.548012119,"t_decision_unix":1779818006.561953,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":35308,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":35308,"score_linear":48193.0,"score_lmetric":38445},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":35308,"score_linear":24503.0,"score_lmetric":59811},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19366,"ongoing_decode_tokens":0,"pending_prefill_tokens":19366,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":35308,"score_linear":19366.0,"score_lmetric":54674},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":35308,"score_linear":83526.0,"score_lmetric":118834},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":35308,"score_linear":68259.0,"score_lmetric":35308},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":78089,"ongoing_decode_tokens":78089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":0,"new_prefill":35308,"score_linear":78089.0,"score_lmetric":35308},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":35308,"score_linear":134672.0,"score_lmetric":105924}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387146.784581085,"t_first_token_unix":1779818011.7985244,"t_done":387147.223308166,"t_done_unix":1779818012.2372515},{"request_id":"1353821:2:1357420:517","session_id":"1353821","input_length":27805,"t_proxy_recv":387146.631471093,"t_decision_unix":1779818011.6454124,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9943535335371336,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69506,"ongoing_decode_tokens":0,"pending_prefill_tokens":35714,"num_requests":2,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":27805,"score_linear":69506.0,"score_lmetric":127038},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":27805,"score_linear":48193.0,"score_lmetric":27805},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13520,"ongoing_decode_tokens":0,"pending_prefill_tokens":13520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1422,"cache_hit":0,"new_prefill":27805,"score_linear":13520.0,"score_lmetric":41325},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":27805,"score_linear":122597.0,"score_lmetric":143746},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":27805,"score_linear":132503.0,"score_lmetric":224360},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":27805,"score_linear":68259.0,"score_lmetric":27805},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":27648,"new_prefill":157,"score_linear":-27648.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":27805,"score_linear":134672.0,"score_lmetric":83415}],"chosen_score_linear":-27648.0,"chosen_score_lmetric":0,"t_first_token":387146.695344196,"t_first_token_unix":1779818011.7092876,"t_done":387147.442940821,"t_done_unix":1779818012.4568841},{"request_id":"1357132:1:1357132:516","session_id":"1357132","input_length":13520,"t_proxy_recv":387145.784030614,"t_decision_unix":1779818010.797972,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69506,"ongoing_decode_tokens":0,"pending_prefill_tokens":35714,"num_requests":2,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":13520,"score_linear":69506.0,"score_lmetric":98468},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":13520,"score_linear":48193.0,"score_lmetric":13520},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1422,"cache_hit":0,"new_prefill":13520,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":13520,"score_linear":122597.0,"score_lmetric":129461},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":13520,"score_linear":132503.0,"score_lmetric":195790},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":13520,"score_linear":68259.0,"score_lmetric":13520},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6711,"ongoing_decode_tokens":6711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1148,"cache_hit":0,"new_prefill":13520,"score_linear":6711.0,"score_lmetric":13520},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":13520,"score_linear":134672.0,"score_lmetric":40560}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387146.941225378,"t_first_token_unix":1779818011.9551692,"t_done":387147.547546391,"t_done_unix":1779818012.5614896},{"request_id":"1344773:7:1357714:518","session_id":"1344773","input_length":34351,"t_proxy_recv":387147.713697708,"t_decision_unix":1779818012.727639,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9837268201799074,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1069,"cache_hit":33792,"new_prefill":559,"score_linear":-33792.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":34351,"score_linear":48193.0,"score_lmetric":34351},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":34351,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":34351,"score_linear":122597.0,"score_lmetric":150292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":34351,"score_linear":132503.0,"score_lmetric":237452},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":34351,"score_linear":68259.0,"score_lmetric":34351},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":34351,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":34351,"score_linear":134672.0,"score_lmetric":103053}],"chosen_score_linear":-33792.0,"chosen_score_lmetric":0,"t_first_token":387147.835614935,"t_first_token_unix":1779818012.8495588,"t_done":387148.216169505,"t_done_unix":1779818013.2301128},{"request_id":"1294611:11:1355750:510","session_id":"1294611","input_length":48193,"t_proxy_recv":387140.739554523,"t_decision_unix":1779818005.7534955,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9349075591890939,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":3137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15519,"ongoing_decode_tokens":15519,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":48193,"score_linear":15519.0,"score_lmetric":48193},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":955,"cache_hit":45056,"new_prefill":3137,"score_linear":-45056.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":12800,"new_prefill":35393,"score_linear":11703.0,"score_lmetric":59896},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19366,"ongoing_decode_tokens":0,"pending_prefill_tokens":19366,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":12800,"new_prefill":35393,"score_linear":6566.0,"score_lmetric":54759},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":48193,"score_linear":83526.0,"score_lmetric":131719},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":48193,"score_linear":68259.0,"score_lmetric":48193},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":78089,"ongoing_decode_tokens":0,"pending_prefill_tokens":265,"num_requests":1,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":0,"new_prefill":48193,"score_linear":78089.0,"score_lmetric":48458},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":48193,"score_linear":134672.0,"score_lmetric":144579}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":387141.665444525,"t_first_token_unix":1779818006.679388,"t_done":387149.060948702,"t_done_unix":1779818014.074892},{"request_id":"1340278:2:1356079:512","session_id":"1340278","input_length":48977,"t_proxy_recv":387142.146653868,"t_decision_unix":1779818007.160595,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9826653327071891,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":849,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":48977,"score_linear":35308.0,"score_lmetric":84285},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":48977,"score_linear":48193.0,"score_lmetric":48977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":48977,"score_linear":24503.0,"score_lmetric":73480},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19366,"ongoing_decode_tokens":19366,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":48977,"score_linear":19366.0,"score_lmetric":48977},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":48128,"new_prefill":849,"score_linear":35398.0,"score_lmetric":84375},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":48977,"score_linear":68259.0,"score_lmetric":48977},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":78089,"ongoing_decode_tokens":78089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1147,"cache_hit":0,"new_prefill":48977,"score_linear":78089.0,"score_lmetric":48977},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":48977,"score_linear":134672.0,"score_lmetric":146931}],"chosen_score_linear":35398.0,"chosen_score_lmetric":84375,"t_first_token":387158.594458348,"t_first_token_unix":1779818023.6084018,"t_done":387159.656956547,"t_done_unix":1779818024.6708996},{"request_id":"1353821:3:1360898:529","session_id":"1353821","input_length":27933,"t_proxy_recv":387159.04906434,"t_decision_unix":1779818024.0630054,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27648,"affinity_cache_ratio":0.98979701428418,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":285,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":27933,"score_linear":93310.0,"score_lmetric":173878},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":27933,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":27933,"score_linear":117888.0,"score_lmetric":145821},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":193599,"ongoing_decode_tokens":0,"pending_prefill_tokens":116287,"num_requests":3,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":27933,"score_linear":193599.0,"score_lmetric":432660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":132503,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":27933,"score_linear":132503.0,"score_lmetric":55866},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":27933,"score_linear":68259.0,"score_lmetric":27933},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":27648,"new_prefill":285,"score_linear":52598.0,"score_lmetric":285},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":27933,"score_linear":168150.0,"score_lmetric":133004}],"chosen_score_linear":52598.0,"chosen_score_lmetric":285,"t_first_token":387159.121155548,"t_first_token_unix":1779818024.1350992,"t_done":387159.867989233,"t_done_unix":1779818024.8819325},{"request_id":"1353951:1:1353951:504","session_id":"1353951","input_length":83526,"t_proxy_recv":387134.742907751,"t_decision_unix":1779817999.7568486,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":83526,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33875,"ongoing_decode_tokens":33875,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":996,"cache_hit":0,"new_prefill":83526,"score_linear":33875.0,"score_lmetric":83526},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":83526,"score_linear":62618.0,"score_lmetric":83526},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":83526,"score_linear":68259.0,"score_lmetric":83526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":27651,"ongoing_decode_tokens":0,"pending_prefill_tokens":27651,"num_requests":1,"active_p_offloads":0,"cached_blocks":1093,"cache_hit":0,"new_prefill":83526,"score_linear":27651.0,"score_lmetric":111177},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":83526,"score_linear":134672.0,"score_lmetric":250578}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387158.592049777,"t_first_token_unix":1779818023.6059933,"t_done":387160.218097879,"t_done_unix":1779818025.2320418},{"request_id":"1353951:2:1358300:520","session_id":"1353951","input_length":83905,"t_proxy_recv":387160.232031259,"t_decision_unix":1779818025.2459726,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9946487098504261,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":449,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":83905,"score_linear":93310.0,"score_lmetric":285822},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":83905,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":83905,"score_linear":117888.0,"score_lmetric":201793},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":83905,"score_linear":259631.0,"score_lmetric":802752},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":83456,"new_prefill":449,"score_linear":-83456.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":83905,"score_linear":68259.0,"score_lmetric":83905},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":83905,"score_linear":80246.0,"score_lmetric":83905},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":83905,"score_linear":168150.0,"score_lmetric":356892}],"chosen_score_linear":-83456.0,"chosen_score_lmetric":0,"t_first_token":387160.506128204,"t_first_token_unix":1779818025.5200717,"t_done":387160.655574707,"t_done_unix":1779818025.6695182},{"request_id":"1344773:8:1358989:523","session_id":"1344773","input_length":34552,"t_proxy_recv":387152.240780695,"t_decision_unix":1779818017.2547219,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9928224125955082,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":248,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":0,"pending_prefill_tokens":58758,"num_requests":1,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":34304,"new_prefill":248,"score_linear":24454.0,"score_lmetric":59006},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":34552,"score_linear":122597.0,"score_lmetric":150493},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":34552,"score_linear":132503.0,"score_lmetric":237854},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":34552,"score_linear":68259.0,"score_lmetric":34552},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":0,"pending_prefill_tokens":1910,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":34552,"score_linear":80246.0,"score_lmetric":36462},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":34552,"score_linear":134672.0,"score_lmetric":103656}],"chosen_score_linear":24454.0,"chosen_score_lmetric":59006,"t_first_token":387161.433989857,"t_first_token_unix":1779818026.4479332,"t_done":387161.803315029,"t_done_unix":1779818026.8172584},{"request_id":"1356948:2:1361262:532","session_id":"1356948","input_length":16480,"t_proxy_recv":387160.533501299,"t_decision_unix":1779818025.5474343,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":1,"affinity_cache_hit":6656,"affinity_cache_ratio":0.40388349514563104,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":16480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":16480,"score_linear":93310.0,"score_lmetric":150972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":16480,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":16480,"score_linear":117888.0,"score_lmetric":134368},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":16480,"score_linear":259631.0,"score_lmetric":533052},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83905,"ongoing_decode_tokens":83905,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":16480,"score_linear":83905.0,"score_lmetric":16480},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":16480,"score_linear":68259.0,"score_lmetric":16480},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":6656,"new_prefill":9824,"score_linear":73590.0,"score_lmetric":9824},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":16480,"score_linear":168150.0,"score_lmetric":87192}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387162.08848847,"t_first_token_unix":1779818027.1024318,"t_done":387162.239435753,"t_done_unix":1779818027.2533798},{"request_id":"1344773:9:1360064:526","session_id":"1344773","input_length":34611,"t_proxy_recv":387161.811155209,"t_decision_unix":1779818026.8250966,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9911299875762041,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":307,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":58758,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":34304,"new_prefill":307,"score_linear":24454.0,"score_lmetric":307},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16480,"ongoing_decode_tokens":0,"pending_prefill_tokens":16480,"num_requests":1,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":34611,"score_linear":16480.0,"score_lmetric":51091},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":34611,"score_linear":117888.0,"score_lmetric":152499},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":34611,"score_linear":259631.0,"score_lmetric":605576},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":34611,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":34611,"score_linear":68259.0,"score_lmetric":34611},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":34611,"score_linear":80246.0,"score_lmetric":34611},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":34611,"score_linear":168150.0,"score_lmetric":159716}],"chosen_score_linear":24454.0,"chosen_score_lmetric":307,"t_first_token":387161.888950256,"t_first_token_unix":1779818026.9028935,"t_done":387162.504146754,"t_done_unix":1779818027.51809},{"request_id":"1279412:23:1348089:477","session_id":"1279412","input_length":96026,"t_proxy_recv":387114.063948047,"t_decision_unix":1779817979.077889,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9970632953575074,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":282,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":924,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":96026,"score_linear":62618.0,"score_lmetric":96026},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1333,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":136502,"ongoing_decode_tokens":77687,"pending_prefill_tokens":8639,"num_requests":3,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":96026,"score_linear":136502.0,"score_lmetric":313995},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":959,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":12800,"new_prefill":83226,"score_linear":53352.0,"score_lmetric":83226},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1077,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":95744,"new_prefill":282,"score_linear":-57098.0,"score_lmetric":564}],"chosen_score_linear":-57098.0,"chosen_score_lmetric":564,"t_first_token":387114.248825177,"t_first_token_unix":1779817979.262769,"t_done":387163.165221486,"t_done_unix":1779818028.1791697},{"request_id":"1361992:1:1361992:535","session_id":"1361992","input_length":8113,"t_proxy_recv":387163.101217337,"t_decision_unix":1779818028.1151588,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93437,"ongoing_decode_tokens":93437,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":8113,"score_linear":93437.0,"score_lmetric":16226},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":8113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":8113,"score_linear":117888.0,"score_lmetric":126001},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":8113,"score_linear":259631.0,"score_lmetric":499584},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":8113,"score_linear":76969.0,"score_lmetric":85082},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":8113,"score_linear":68259.0,"score_lmetric":8113},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":8113,"score_linear":80246.0,"score_lmetric":8113},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":8113,"score_linear":168150.0,"score_lmetric":53724}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387163.674031073,"t_first_token_unix":1779818028.6879747,"t_done":387163.807232502,"t_done_unix":1779818028.8211756},{"request_id":"1270340:3:1360716:528","session_id":"1270340","input_length":33478,"t_proxy_recv":387158.385318817,"t_decision_unix":1779818023.3992598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28160,"affinity_cache_ratio":0.8411494115538563,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":5318,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":33478,"score_linear":93310.0,"score_lmetric":184968},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":33478,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":33478,"score_linear":117888.0,"score_lmetric":151366},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":193599,"ongoing_decode_tokens":0,"pending_prefill_tokens":116287,"num_requests":3,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":33478,"score_linear":193599.0,"score_lmetric":449295},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":1536,"new_prefill":31942,"score_linear":130967.0,"score_lmetric":232634},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":33478,"score_linear":68259.0,"score_lmetric":33478},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":33478,"score_linear":80246.0,"score_lmetric":33478},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":28160,"new_prefill":5318,"score_linear":106512.0,"score_lmetric":15954}],"chosen_score_linear":106512.0,"chosen_score_lmetric":15954,"t_first_token":387163.158681745,"t_first_token_unix":1779818028.172625,"t_done":387164.60433376,"t_done_unix":1779818029.6182778},{"request_id":"1362265:1:1362265:536","session_id":"1362265","input_length":8825,"t_proxy_recv":387163.947863742,"t_decision_unix":1779818028.9618049,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8825,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93437,"ongoing_decode_tokens":93437,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":8825,"score_linear":93437.0,"score_lmetric":17650},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":8825,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":8825,"score_linear":117888.0,"score_lmetric":126713},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":8825,"score_linear":259631.0,"score_lmetric":502432},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":8825,"score_linear":76969.0,"score_lmetric":85794},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":8825,"score_linear":68259.0,"score_lmetric":8825},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":8825,"score_linear":80246.0,"score_lmetric":8825},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":72124,"ongoing_decode_tokens":117044,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1507,"cache_hit":0,"new_prefill":8825,"score_linear":72124.0,"score_lmetric":26475}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387164.623316209,"t_first_token_unix":1779818029.6372595,"t_done":387165.67451186,"t_done_unix":1779818030.6884556},{"request_id":"1344773:10:1361326:533","session_id":"1344773","input_length":34679,"t_proxy_recv":387162.511101931,"t_decision_unix":1779818027.5250435,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9891865394042504,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":375,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":58758,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":34304,"new_prefill":375,"score_linear":24454.0,"score_lmetric":375},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":994,"cache_hit":0,"new_prefill":34679,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":34679,"score_linear":117888.0,"score_lmetric":152567},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":34679,"score_linear":259631.0,"score_lmetric":605848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":34679,"score_linear":76969.0,"score_lmetric":111648},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":34679,"score_linear":68259.0,"score_lmetric":34679},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":34679,"score_linear":80246.0,"score_lmetric":34679},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":34679,"score_linear":168150.0,"score_lmetric":159988}],"chosen_score_linear":24454.0,"chosen_score_lmetric":375,"t_first_token":387162.582246653,"t_first_token_unix":1779818027.5961905,"t_done":387166.366954123,"t_done_unix":1779818031.3808975},{"request_id":"1361992:2:1362904:537","session_id":"1361992","input_length":10347,"t_proxy_recv":387166.195417448,"t_decision_unix":1779818031.2093587,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7680,"affinity_cache_ratio":0.7422441287329661,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2667,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93437,"ongoing_decode_tokens":93437,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":10347,"score_linear":93437.0,"score_lmetric":20694},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":7680,"new_prefill":2667,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":10347,"score_linear":117888.0,"score_lmetric":128235},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":10347,"score_linear":259631.0,"score_lmetric":508520},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":10347,"score_linear":76969.0,"score_lmetric":87316},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":10347,"score_linear":68259.0,"score_lmetric":10347},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":10347,"score_linear":80246.0,"score_lmetric":10347},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":10347,"score_linear":38646.0,"score_lmetric":20694}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":387166.461803442,"t_first_token_unix":1779818031.4757564,"t_done":387166.604047524,"t_done_unix":1779818031.6179912},{"request_id":"1353821:4:1363399:541","session_id":"1353821","input_length":28093,"t_proxy_recv":387167.973359101,"t_decision_unix":1779818032.9873004,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27648,"affinity_cache_ratio":0.984159755099135,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":445,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":95990,"ongoing_decode_tokens":58758,"pending_prefill_tokens":1904,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":28093,"score_linear":95990.0,"score_lmetric":59994},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":28093,"score_linear":78742.0,"score_lmetric":186022},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":28093,"score_linear":117888.0,"score_lmetric":145981},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":28093,"score_linear":259631.0,"score_lmetric":579504},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":28093,"score_linear":76969.0,"score_lmetric":105062},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":28093,"score_linear":68259.0,"score_lmetric":28093},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":27648,"new_prefill":445,"score_linear":52598.0,"score_lmetric":445},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":28093,"score_linear":38646.0,"score_lmetric":56186}],"chosen_score_linear":52598.0,"chosen_score_lmetric":445,"t_first_token":387168.087079052,"t_first_token_unix":1779818033.1010222,"t_done":387168.387061554,"t_done_unix":1779818033.4010053},{"request_id":"1363440:1:1363440:542","session_id":"1363440","input_length":543,"t_proxy_recv":387168.14210806,"t_decision_unix":1779818033.1560495,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":543,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":95990,"ongoing_decode_tokens":58758,"pending_prefill_tokens":1904,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":543,"score_linear":95990.0,"score_lmetric":4894},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":543,"score_linear":78742.0,"score_lmetric":130922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":543,"score_linear":117888.0,"score_lmetric":118431},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":543,"score_linear":259631.0,"score_lmetric":469304},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":543,"score_linear":76969.0,"score_lmetric":77512},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":543,"score_linear":68259.0,"score_lmetric":543},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108339,"ongoing_decode_tokens":108339,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":543,"score_linear":108339.0,"score_lmetric":1086},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":543,"score_linear":38646.0,"score_lmetric":1086}],"chosen_score_linear":68259.0,"chosen_score_lmetric":543,"t_first_token":387168.336486005,"t_first_token_unix":1779818033.3504293,"t_done":387168.695237915,"t_done_unix":1779818033.7091818},{"request_id":"1313181:2:1358046:519","session_id":"1313181","input_length":58758,"t_proxy_recv":387148.915538079,"t_decision_unix":1779818013.9294791,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":0,"affinity_cache_hit":24064,"affinity_cache_ratio":0.40954423227475406,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":58758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":58758,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":58758,"score_linear":48193.0,"score_lmetric":58758},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":58758,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":45958,"score_linear":109797.0,"score_lmetric":161899},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":58758,"score_linear":132503.0,"score_lmetric":286266},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":24064,"new_prefill":34694,"score_linear":44195.0,"score_lmetric":34694},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":58758,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":12800,"new_prefill":45958,"score_linear":121872.0,"score_lmetric":137874}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387161.425809084,"t_first_token_unix":1779818026.4397528,"t_done":387169.197385172,"t_done_unix":1779818034.2113287},{"request_id":"1355951:2:1363365:540","session_id":"1355951","input_length":37232,"t_proxy_recv":387167.852063525,"t_decision_unix":1779818032.8660047,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9488611946712505,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":1904,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":58758,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":35328,"new_prefill":1904,"score_linear":23430.0,"score_lmetric":1904},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":37232,"score_linear":78742.0,"score_lmetric":204300},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":37232,"score_linear":117888.0,"score_lmetric":155120},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":37232,"score_linear":259631.0,"score_lmetric":616060},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":37232,"score_linear":76969.0,"score_lmetric":114201},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":37232,"score_linear":68259.0,"score_lmetric":37232},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":37232,"score_linear":80246.0,"score_lmetric":37232},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":37232,"score_linear":38646.0,"score_lmetric":74464}],"chosen_score_linear":23430.0,"chosen_score_lmetric":1904,"t_first_token":387168.445505181,"t_first_token_unix":1779818033.4594486,"t_done":387169.409768641,"t_done_unix":1779818034.4237125},{"request_id":"1313181:3:1316742:330","session_id":"1313181","input_length":24451,"t_proxy_recv":387169.201420064,"t_decision_unix":1779818034.2153618,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9841724264856243,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":37232,"ongoing_decode_tokens":37232,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":24064,"new_prefill":387,"score_linear":13168.0,"score_lmetric":387},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":24451,"score_linear":78742.0,"score_lmetric":178738},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":24451,"score_linear":117888.0,"score_lmetric":142339},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":11651,"score_linear":246831.0,"score_lmetric":513736},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":24451,"score_linear":76969.0,"score_lmetric":101420},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1194,"cache_hit":24064,"new_prefill":387,"score_linear":44195.0,"score_lmetric":387},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":24451,"score_linear":80246.0,"score_lmetric":24451},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":12800,"new_prefill":11651,"score_linear":25846.0,"score_lmetric":23302}],"chosen_score_linear":13168.0,"chosen_score_lmetric":387,"t_first_token":387169.254872037,"t_first_token_unix":1779818034.2688153,"t_done":387170.915286222,"t_done_unix":1779818035.9292293},{"request_id":"1364128:1:1364128:545","session_id":"1364128","input_length":8706,"t_proxy_recv":387170.31067035,"t_decision_unix":1779818035.3246117,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":8706,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":37087,"ongoing_decode_tokens":24451,"pending_prefill_tokens":3932,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":8706,"score_linear":37087.0,"score_lmetric":25276},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":6656,"new_prefill":2050,"score_linear":72086.0,"score_lmetric":133936},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":8706,"score_linear":117888.0,"score_lmetric":126594},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":8706,"score_linear":259631.0,"score_lmetric":501956},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":8706,"score_linear":76969.0,"score_lmetric":85675},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1194,"cache_hit":0,"new_prefill":8706,"score_linear":68259.0,"score_lmetric":8706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":80246,"pending_prefill_tokens":2633,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":8706,"score_linear":94143.0,"score_lmetric":22678},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":8706,"score_linear":38646.0,"score_lmetric":17412}],"chosen_score_linear":68259.0,"chosen_score_lmetric":8706,"t_first_token":387171.066234074,"t_first_token_unix":1779818036.0801775,"t_done":387172.521340674,"t_done_unix":1779818037.535284},{"request_id":"1364960:1:1364960:549","session_id":"1364960","input_length":2019,"t_proxy_recv":387173.23465696,"t_decision_unix":1779818038.2485983,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":2019,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2019,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":2019,"score_linear":72150.0,"score_lmetric":74938},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":2019,"score_linear":78742.0,"score_lmetric":133874},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":2019,"score_linear":117888.0,"score_lmetric":119907},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":2019,"score_linear":259631.0,"score_lmetric":475208},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":2019,"score_linear":76969.0,"score_lmetric":78988},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1211,"cache_hit":0,"new_prefill":2019,"score_linear":68259.0,"score_lmetric":2019},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":94143,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":2019,"score_linear":94143.0,"score_lmetric":4038},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136684,"ongoing_decode_tokens":181604,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":2019,"score_linear":136684.0,"score_lmetric":6057}],"chosen_score_linear":68259.0,"chosen_score_lmetric":2019,"t_first_token":387173.480819968,"t_first_token_unix":1779818038.4947634,"t_done":387173.887309043,"t_done_unix":1779818038.9012523},{"request_id":"1279412:24:1364169:546","session_id":"1279412","input_length":98038,"t_proxy_recv":387170.452208277,"t_decision_unix":1779818035.4661498,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9974907688855342,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":37087,"ongoing_decode_tokens":24451,"pending_prefill_tokens":3932,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":12800,"new_prefill":85238,"score_linear":24287.0,"score_lmetric":178340},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":98038,"score_linear":78742.0,"score_lmetric":325912},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":98038,"score_linear":117888.0,"score_lmetric":215926},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":85238,"score_linear":246831.0,"score_lmetric":808084},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":98038,"score_linear":76969.0,"score_lmetric":175007},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":76965,"ongoing_decode_tokens":68259,"pending_prefill_tokens":8706,"num_requests":2,"active_p_offloads":0,"cached_blocks":1194,"cache_hit":12800,"new_prefill":85238,"score_linear":64165.0,"score_lmetric":187888},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":80246,"pending_prefill_tokens":2633,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":98038,"score_linear":94143.0,"score_lmetric":201342},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":97792,"new_prefill":246,"score_linear":-59146.0,"score_lmetric":492}],"chosen_score_linear":-59146.0,"chosen_score_lmetric":492,"t_first_token":387170.642097092,"t_first_token_unix":1779818035.6560404,"t_done":387174.088940275,"t_done_unix":1779818039.1028838},{"request_id":"1363440:2:1365095:551","session_id":"1363440","input_length":3866,"t_proxy_recv":387173.819905791,"t_decision_unix":1779818038.8338473,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":512,"affinity_cache_ratio":0.13243662700465597,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":6708,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":3354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":3866,"score_linear":72150.0,"score_lmetric":78632},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":3866,"score_linear":78742.0,"score_lmetric":137568},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":3866,"score_linear":132609.0,"score_lmetric":246326},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":3866,"score_linear":259631.0,"score_lmetric":482596},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":3866,"score_linear":76969.0,"score_lmetric":80835},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":70278,"ongoing_decode_tokens":70278,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1211,"cache_hit":512,"new_prefill":3354,"score_linear":69766.0,"score_lmetric":6708},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":94143,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":3866,"score_linear":94143.0,"score_lmetric":7732},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136684,"ongoing_decode_tokens":181604,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":3866,"score_linear":136684.0,"score_lmetric":11598}],"chosen_score_linear":69766.0,"chosen_score_lmetric":6708,"t_first_token":387174.129900694,"t_first_token_unix":1779818039.1438437,"t_done":387174.618267657,"t_done_unix":1779818039.632211},{"request_id":"1365440:1:1365440:552","session_id":"1365440","input_length":9913,"t_proxy_recv":387175.037208434,"t_decision_unix":1779818040.0511498,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":9913,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9913,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":9913,"score_linear":72150.0,"score_lmetric":90726},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":9913,"score_linear":78742.0,"score_lmetric":149662},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":9913,"score_linear":132609.0,"score_lmetric":258420},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":9913,"score_linear":259631.0,"score_lmetric":506784},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":9913,"score_linear":76969.0,"score_lmetric":86882},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1221,"cache_hit":0,"new_prefill":9913,"score_linear":68259.0,"score_lmetric":9913},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":94143,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":9913,"score_linear":94143.0,"score_lmetric":19826},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":9913,"score_linear":38646.0,"score_lmetric":19826}],"chosen_score_linear":68259.0,"chosen_score_lmetric":9913,"t_first_token":387175.831699294,"t_first_token_unix":1779818040.8456426,"t_done":387176.046106237,"t_done_unix":1779818041.0600498},{"request_id":"1364090:1:1364090:544","session_id":"1364090","input_length":13897,"t_proxy_recv":387170.203546653,"t_decision_unix":1779818035.2174876,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":2633,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":2633,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":37087,"ongoing_decode_tokens":24451,"pending_prefill_tokens":3932,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":4096,"new_prefill":9801,"score_linear":32991.0,"score_lmetric":27466},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":13897,"score_linear":78742.0,"score_lmetric":157630},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":13897,"score_linear":117888.0,"score_lmetric":131785},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":7680,"new_prefill":6217,"score_linear":251951.0,"score_lmetric":492000},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":13897,"score_linear":76969.0,"score_lmetric":90866},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1194,"cache_hit":0,"new_prefill":13897,"score_linear":68259.0,"score_lmetric":13897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":11264,"new_prefill":2633,"score_linear":68982.0,"score_lmetric":2633},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":7680,"new_prefill":6217,"score_linear":30966.0,"score_lmetric":12434}],"chosen_score_linear":68982.0,"chosen_score_lmetric":2633,"t_first_token":387170.564781838,"t_first_token_unix":1779818035.578725,"t_done":387176.976452655,"t_done_unix":1779818041.990396},{"request_id":"1314357:4:1352612:497","session_id":"1314357","input_length":68259,"t_proxy_recv":387129.997190904,"t_decision_unix":1779817995.0111318,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":67072,"affinity_cache_ratio":0.9826103517484874,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":67072,"estimated_new_tokens":1187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":55015,"ongoing_decode_tokens":0,"pending_prefill_tokens":9447,"num_requests":2,"active_p_offloads":0,"cached_blocks":952,"cache_hit":3584,"new_prefill":64675,"score_linear":51431.0,"score_lmetric":148244},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":68259,"score_linear":62618.0,"score_lmetric":68259},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":68259,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":1,"active_p_offloads":0,"cached_blocks":1439,"cache_hit":0,"new_prefill":68259,"score_linear":18840.0,"score_lmetric":87099},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":68259,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10575,"ongoing_decode_tokens":10575,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1182,"cache_hit":67072,"new_prefill":1187,"score_linear":-56497.0,"score_lmetric":1187},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1091,"cache_hit":0,"new_prefill":68259,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":61440,"new_prefill":6819,"score_linear":73232.0,"score_lmetric":20457}],"chosen_score_linear":-56497.0,"chosen_score_lmetric":1187,"t_first_token":387130.489267796,"t_first_token_unix":1779817995.503211,"t_done":387178.416634501,"t_done_unix":1779818043.430579},{"request_id":"1366128:1:1366128:553","session_id":"1366128","input_length":11154,"t_proxy_recv":387177.331428324,"t_decision_unix":1779818042.3453696,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":11154,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11154,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":11154,"score_linear":72150.0,"score_lmetric":93208},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":11154,"score_linear":78742.0,"score_lmetric":152144},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":11154,"score_linear":132609.0,"score_lmetric":260902},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":11154,"score_linear":259631.0,"score_lmetric":511748},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":11154,"score_linear":76969.0,"score_lmetric":88123},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1240,"cache_hit":0,"new_prefill":11154,"score_linear":68259.0,"score_lmetric":11154},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":11154,"score_linear":80246.0,"score_lmetric":11154},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":11154,"score_linear":38646.0,"score_lmetric":22308}],"chosen_score_linear":68259.0,"chosen_score_lmetric":11154,"t_first_token":387178.227508329,"t_first_token_unix":1779818043.2414517,"t_done":387178.814355041,"t_done_unix":1779818043.828298},{"request_id":"1363093:1:1363093:538","session_id":"1363093","input_length":62685,"t_proxy_recv":387166.828680981,"t_decision_unix":1779818031.8426225,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":62685,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":58758,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":62685,"score_linear":58758.0,"score_lmetric":62685},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":62685,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":62685,"score_linear":117888.0,"score_lmetric":180573},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":62685,"score_linear":259631.0,"score_lmetric":717872},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":62685,"score_linear":76969.0,"score_lmetric":139654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":62685,"score_linear":68259.0,"score_lmetric":62685},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":62685,"score_linear":80246.0,"score_lmetric":62685},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":62685,"score_linear":38646.0,"score_lmetric":125370}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387180.989161447,"t_first_token_unix":1779818046.0031047,"t_done":387181.589779343,"t_done_unix":1779818046.6037233},{"request_id":"1344773:11:1366387:555","session_id":"1344773","input_length":35071,"t_proxy_recv":387178.312990367,"t_decision_unix":1779818043.3269317,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9927290353853612,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":34816,"new_prefill":255,"score_linear":37334.0,"score_lmetric":71410},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":35071,"score_linear":78742.0,"score_lmetric":199978},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":35071,"score_linear":132609.0,"score_lmetric":308736},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":35071,"score_linear":259631.0,"score_lmetric":607416},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":35071,"score_linear":76969.0,"score_lmetric":112040},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":79413,"ongoing_decode_tokens":79413,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1240,"cache_hit":0,"new_prefill":35071,"score_linear":79413.0,"score_lmetric":70142},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":35071,"score_linear":80246.0,"score_lmetric":35071},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":35071,"score_linear":136913.0,"score_lmetric":105213}],"chosen_score_linear":37334.0,"chosen_score_lmetric":71410,"t_first_token":387181.004473468,"t_first_token_unix":1779818046.0184164,"t_done":387182.357647524,"t_done_unix":1779818047.3715909},{"request_id":"1367424:1:1367424:569","session_id":"1367424","input_length":3392,"t_proxy_recv":387182.067336735,"t_decision_unix":1779818047.0812778,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":3.0,"fallback_score":10176,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":3392,"score_linear":107221.0,"score_lmetric":10176},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":3392,"score_linear":53028.0,"score_lmetric":94977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":3392,"score_linear":132609.0,"score_lmetric":245378},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":3392,"score_linear":295932.0,"score_lmetric":613420},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":0,"pending_prefill_tokens":77812,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":3392,"score_linear":126452.0,"score_lmetric":162408},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":0,"pending_prefill_tokens":23865,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":3392,"score_linear":43321.0,"score_lmetric":81771},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":93995,"ongoing_decode_tokens":80246,"pending_prefill_tokens":13749,"num_requests":2,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":3392,"score_linear":93995.0,"score_lmetric":34282},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":3392,"score_linear":177930.0,"score_lmetric":13568}],"chosen_score_linear":107221.0,"chosen_score_lmetric":10176,"t_first_token":387182.358078632,"t_first_token_unix":1779818047.3720214,"t_done":387182.486444909,"t_done_unix":1779818047.5003881},{"request_id":"1367312:1:1367312:566","session_id":"1367312","input_length":13749,"t_proxy_recv":387181.664697681,"t_decision_unix":1779818046.678639,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":13749,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":13749,"score_linear":107221.0,"score_lmetric":41247},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16057,"ongoing_decode_tokens":16057,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":13749,"score_linear":16057.0,"score_lmetric":13749},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":13749,"score_linear":132609.0,"score_lmetric":266092},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":13749,"score_linear":295932.0,"score_lmetric":665205},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":0,"pending_prefill_tokens":77812,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":13749,"score_linear":126452.0,"score_lmetric":183122},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":0,"pending_prefill_tokens":23865,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":13749,"score_linear":43321.0,"score_lmetric":112842},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":13749,"score_linear":80246.0,"score_lmetric":13749},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":13749,"score_linear":177930.0,"score_lmetric":54996}],"chosen_score_linear":80246.0,"chosen_score_lmetric":13749,"t_first_token":387182.861887141,"t_first_token_unix":1779818047.8758314,"t_done":387183.494542145,"t_done_unix":1779818048.5084858},{"request_id":"1363943:1:1363943:543","session_id":"1363943","input_length":12636,"t_proxy_recv":387169.82489556,"t_decision_unix":1779818034.8388367,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":3932,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":3932,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24451,"ongoing_decode_tokens":24451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":8704,"new_prefill":3932,"score_linear":15747.0,"score_lmetric":3932},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":12636,"score_linear":78742.0,"score_lmetric":155108},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":12636,"score_linear":117888.0,"score_lmetric":130524},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":4096,"new_prefill":8540,"score_linear":255535.0,"score_lmetric":501292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":12636,"score_linear":76969.0,"score_lmetric":89605},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1194,"cache_hit":0,"new_prefill":12636,"score_linear":68259.0,"score_lmetric":12636},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":4096,"new_prefill":8540,"score_linear":76150.0,"score_lmetric":8540},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":4096,"new_prefill":8540,"score_linear":34550.0,"score_lmetric":17080}],"chosen_score_linear":15747.0,"chosen_score_lmetric":3932,"t_first_token":387170.889289254,"t_first_token_unix":1779818035.9032328,"t_done":387183.73393267,"t_done_unix":1779818048.747876},{"request_id":"1364128:2:1367249:565","session_id":"1364128","input_length":9095,"t_proxy_recv":387181.460922007,"t_decision_unix":1779818046.474863,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9570093457943926,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":391,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":9095,"score_linear":107221.0,"score_lmetric":27285},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":78742,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":6656,"new_prefill":2439,"score_linear":72086.0,"score_lmetric":4878},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":9095,"score_linear":132609.0,"score_lmetric":256784},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":9095,"score_linear":295932.0,"score_lmetric":641935},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":0,"pending_prefill_tokens":77812,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":9095,"score_linear":126452.0,"score_lmetric":173814},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34226,"ongoing_decode_tokens":0,"pending_prefill_tokens":23474,"num_requests":2,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":8704,"new_prefill":391,"score_linear":25522.0,"score_lmetric":47730},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":9095,"score_linear":80246.0,"score_lmetric":9095},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":9095,"score_linear":177930.0,"score_lmetric":36380}],"chosen_score_linear":25522.0,"chosen_score_lmetric":47730,"t_first_token":387183.588862455,"t_first_token_unix":1779818048.6028051,"t_done":387184.063189763,"t_done_unix":1779818049.077133},{"request_id":"1361694:1:1361694:534","session_id":"1361694","input_length":76969,"t_proxy_recv":387162.07940894,"t_decision_unix":1779818027.0933495,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":76969,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93369,"ongoing_decode_tokens":93369,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":76969,"score_linear":93369.0,"score_lmetric":153938},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16480,"ongoing_decode_tokens":0,"pending_prefill_tokens":16480,"num_requests":1,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":76969,"score_linear":16480.0,"score_lmetric":93449},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":76969,"score_linear":117888.0,"score_lmetric":194857},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":76969,"score_linear":259631.0,"score_lmetric":775008},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":76969,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":76969,"score_linear":68259.0,"score_lmetric":76969},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":3584,"new_prefill":73385,"score_linear":76662.0,"score_lmetric":73385},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":76969,"score_linear":168150.0,"score_lmetric":329148}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387182.511337336,"t_first_token_unix":1779818047.525284,"t_done":387184.127455758,"t_done_unix":1779818049.1413994},{"request_id":"1366128:2:1367220:563","session_id":"1366128","input_length":15411,"t_proxy_recv":387181.369140411,"t_decision_unix":1779818046.3830817,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":10752,"affinity_cache_ratio":0.6976834728440724,"affinity_num_requests":1,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":4659,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":15411,"score_linear":107221.0,"score_lmetric":46233},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":78742,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":15411,"score_linear":78742.0,"score_lmetric":30822},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":15411,"score_linear":132609.0,"score_lmetric":269416},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":15411,"score_linear":295932.0,"score_lmetric":673515},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":15411,"score_linear":76969.0,"score_lmetric":92380},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":18815,"num_requests":1,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":10752,"new_prefill":4659,"score_linear":8063.0,"score_lmetric":23474},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":15411,"score_linear":80246.0,"score_lmetric":15411},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":15411,"score_linear":177930.0,"score_lmetric":61644}],"chosen_score_linear":8063.0,"chosen_score_lmetric":23474,"t_first_token":387183.588201934,"t_first_token_unix":1779818048.602145,"t_done":387184.256870721,"t_done_unix":1779818049.270814},{"request_id":"1362265:2:1367373:568","session_id":"1362265","input_length":10134,"t_proxy_recv":387181.868712854,"t_decision_unix":1779818046.8826544,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8704,"affinity_cache_ratio":0.8588908624432603,"affinity_num_requests":2,"avg_num_requests":2.875,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":1430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":10134,"score_linear":107221.0,"score_lmetric":30402},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":42894,"ongoing_decode_tokens":16057,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":8704,"new_prefill":1430,"score_linear":34190.0,"score_lmetric":56534},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":10134,"score_linear":132609.0,"score_lmetric":258862},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":10134,"score_linear":295932.0,"score_lmetric":647130},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":0,"pending_prefill_tokens":77812,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":10134,"score_linear":126452.0,"score_lmetric":175892},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":0,"pending_prefill_tokens":23865,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":6656,"new_prefill":3478,"score_linear":36665.0,"score_lmetric":82029},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":93995,"ongoing_decode_tokens":80246,"pending_prefill_tokens":13749,"num_requests":2,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":10134,"score_linear":93995.0,"score_lmetric":47766},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":10134,"score_linear":177930.0,"score_lmetric":40536}],"chosen_score_linear":34190.0,"chosen_score_lmetric":56534,"t_first_token":387185.162425689,"t_first_token_unix":1779818050.176371,"t_done":387185.466351105,"t_done_unix":1779818050.4802942},{"request_id":"1270340:4:1366608:558","session_id":"1270340","input_length":41017,"t_proxy_recv":387179.061043848,"t_decision_unix":1779818044.0749853,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33280,"affinity_cache_ratio":0.8113708949947582,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":7737,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":41017,"score_linear":107221.0,"score_lmetric":230166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":41017,"score_linear":78742.0,"score_lmetric":211870},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":41017,"score_linear":132609.0,"score_lmetric":320628},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":41017,"score_linear":259631.0,"score_lmetric":631200},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":1536,"new_prefill":39481,"score_linear":75433.0,"score_lmetric":116450},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":41017,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":41017,"score_linear":80246.0,"score_lmetric":41017},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":33280,"new_prefill":7737,"score_linear":103633.0,"score_lmetric":23211}],"chosen_score_linear":103633.0,"chosen_score_lmetric":23211,"t_first_token":387181.038574431,"t_first_token_unix":1779818046.0525177,"t_done":387185.532941601,"t_done_unix":1779818050.546885},{"request_id":"1364960:2:1368239:578","session_id":"1364960","input_length":7048,"t_proxy_recv":387184.958955608,"t_decision_unix":1779818049.972897,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":2048,"affinity_cache_ratio":0.2905788876276958,"affinity_num_requests":2,"avg_num_requests":3.0,"fallback_score":10000,"tie_break_used":false,"cache_hit":2048,"estimated_new_tokens":5000,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107692,"ongoing_decode_tokens":107692,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":7048,"score_linear":107692.0,"score_lmetric":21144},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":7048,"score_linear":53028.0,"score_lmetric":105945},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":7048,"score_linear":132609.0,"score_lmetric":252690},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":7048,"score_linear":295932.0,"score_lmetric":631700},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71256,"ongoing_decode_tokens":49483,"pending_prefill_tokens":21773,"num_requests":2,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":7048,"score_linear":71256.0,"score_lmetric":57642},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":27660,"ongoing_decode_tokens":27660,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":2048,"new_prefill":5000,"score_linear":25612.0,"score_lmetric":10000},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":7048,"score_linear":168666.0,"score_lmetric":246468},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":7048,"score_linear":177930.0,"score_lmetric":28192}],"chosen_score_linear":25612.0,"chosen_score_lmetric":10000,"t_first_token":387185.346793836,"t_first_token_unix":1779818050.3607368,"t_done":387185.809269601,"t_done_unix":1779818050.8232129},{"request_id":"1367169:1:1367169:562","session_id":"1367169","input_length":18815,"t_proxy_recv":387181.179664628,"t_decision_unix":1779818046.1936061,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18815,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":18815,"score_linear":107221.0,"score_lmetric":56445},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":78742,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":18815,"score_linear":78742.0,"score_lmetric":37630},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":18815,"score_linear":132609.0,"score_lmetric":276224},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":18815,"score_linear":295932.0,"score_lmetric":690535},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":18815,"score_linear":76969.0,"score_lmetric":95784},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":18815,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":11776,"new_prefill":7039,"score_linear":68470.0,"score_lmetric":7039},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":18815,"score_linear":177930.0,"score_lmetric":75260}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387183.586298209,"t_first_token_unix":1779818048.6002417,"t_done":387185.978211339,"t_done_unix":1779818050.9921544},{"request_id":"1367329:1:1367329:567","session_id":"1367329","input_length":26837,"t_proxy_recv":387181.755532181,"t_decision_unix":1779818046.7694738,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.75,"fallback_score":26837,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":26837,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":26837,"score_linear":107221.0,"score_lmetric":80511},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16057,"ongoing_decode_tokens":16057,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":26837,"score_linear":16057.0,"score_lmetric":26837},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":26837,"score_linear":132609.0,"score_lmetric":292268},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":26837,"score_linear":295932.0,"score_lmetric":730645},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":0,"pending_prefill_tokens":77812,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":26837,"score_linear":126452.0,"score_lmetric":209298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":0,"pending_prefill_tokens":23865,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":26837,"score_linear":43321.0,"score_lmetric":152106},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":93995,"ongoing_decode_tokens":80246,"pending_prefill_tokens":13749,"num_requests":2,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":26837,"score_linear":93995.0,"score_lmetric":81172},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":26837,"score_linear":177930.0,"score_lmetric":107348}],"chosen_score_linear":16057.0,"chosen_score_lmetric":26837,"t_first_token":387185.158071265,"t_first_token_unix":1779818050.1720145,"t_done":387185.987707029,"t_done_unix":1779818051.0016506},{"request_id":"1344773:12:1367864:571","session_id":"1344773","input_length":35194,"t_proxy_recv":387183.563382848,"t_decision_unix":1779818048.5773244,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9892595328749219,"affinity_num_requests":2,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":378,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":72150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":34816,"new_prefill":378,"score_linear":37334.0,"score_lmetric":756},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":35194,"score_linear":53028.0,"score_lmetric":190383},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":35194,"score_linear":132609.0,"score_lmetric":308982},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":35194,"score_linear":295932.0,"score_lmetric":772430},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":126452,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":35194,"score_linear":126452.0,"score_lmetric":70388},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":0,"pending_prefill_tokens":23865,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":35194,"score_linear":43321.0,"score_lmetric":177177},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":35194,"score_linear":80246.0,"score_lmetric":35194},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":35194,"score_linear":177930.0,"score_lmetric":140776}],"chosen_score_linear":37334.0,"chosen_score_lmetric":756,"t_first_token":387183.65472256,"t_first_token_unix":1779818048.6686654,"t_done":387186.016446602,"t_done_unix":1779818051.0303898},{"request_id":"1313181:3:1364311:547","session_id":"1313181","input_length":59514,"t_proxy_recv":387170.92762226,"t_decision_unix":1779818035.9415634,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24064,"affinity_cache_ratio":0.4043418355344961,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":35450,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":35450,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12636,"ongoing_decode_tokens":12636,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":24064,"new_prefill":35450,"score_linear":-11428.0,"score_lmetric":35450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":59514,"score_linear":78742.0,"score_lmetric":248864},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":59514,"score_linear":117888.0,"score_lmetric":177402},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":46714,"score_linear":246831.0,"score_lmetric":653988},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":59514,"score_linear":76969.0,"score_lmetric":136483},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":76965,"ongoing_decode_tokens":68259,"pending_prefill_tokens":8706,"num_requests":2,"active_p_offloads":0,"cached_blocks":1194,"cache_hit":24064,"new_prefill":35450,"score_linear":52901.0,"score_lmetric":88312},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":94143,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":59514,"score_linear":94143.0,"score_lmetric":119028},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136684,"ongoing_decode_tokens":181604,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":12800,"new_prefill":46714,"score_linear":123884.0,"score_lmetric":140142}],"chosen_score_linear":-11428.0,"chosen_score_lmetric":35450,"t_first_token":387180.983853288,"t_first_token_unix":1779818045.997797,"t_done":387186.518314518,"t_done_unix":1779818051.532262},{"request_id":"1368070:1:1368070:575","session_id":"1368070","input_length":21773,"t_proxy_recv":387184.391206652,"t_decision_unix":1779818049.4051485,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.75,"fallback_score":21773,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21773,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107692,"ongoing_decode_tokens":107692,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":21773,"score_linear":107692.0,"score_lmetric":65319},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":21773,"score_linear":53028.0,"score_lmetric":150120},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":21773,"score_linear":132609.0,"score_lmetric":282140},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":21773,"score_linear":295932.0,"score_lmetric":705325},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":21773,"score_linear":49483.0,"score_lmetric":21773},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":21773,"score_linear":18815.0,"score_lmetric":21773},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":21773,"score_linear":168666.0,"score_lmetric":290643},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":21773,"score_linear":177930.0,"score_lmetric":87092}],"chosen_score_linear":49483.0,"chosen_score_lmetric":21773,"t_first_token":387186.77075247,"t_first_token_unix":1779818051.7846956,"t_done":387186.987958662,"t_done_unix":1779818052.0019019},{"request_id":"1368132:1:1368132:577","session_id":"1368132","input_length":8845,"t_proxy_recv":387184.632805657,"t_decision_unix":1779818049.6467469,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.875,"fallback_score":2189,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":2189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107692,"ongoing_decode_tokens":107692,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":8845,"score_linear":107692.0,"score_lmetric":26535},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":6656,"new_prefill":2189,"score_linear":46372.0,"score_lmetric":91368},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":8845,"score_linear":132609.0,"score_lmetric":256284},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":8845,"score_linear":295932.0,"score_lmetric":640685},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71256,"ongoing_decode_tokens":49483,"pending_prefill_tokens":21773,"num_requests":2,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":8845,"score_linear":71256.0,"score_lmetric":61236},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":6656,"new_prefill":2189,"score_linear":12159.0,"score_lmetric":2189},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":8845,"score_linear":168666.0,"score_lmetric":251859},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":8845,"score_linear":177930.0,"score_lmetric":35380}],"chosen_score_linear":12159.0,"chosen_score_lmetric":2189,"t_first_token":387184.875479299,"t_first_token_unix":1779818049.8894227,"t_done":387187.253853845,"t_done_unix":1779818052.267797},{"request_id":"1363943:2:1366428:556","session_id":"1363943","input_length":12984,"t_proxy_recv":387183.737808713,"t_decision_unix":1779818048.7517505,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":12800,"affinity_cache_ratio":0.9858287122612446,"affinity_num_requests":2,"avg_num_requests":2.75,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":94708,"ongoing_decode_tokens":94708,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":12800,"new_prefill":184,"score_linear":81908.0,"score_lmetric":368},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":12984,"score_linear":53028.0,"score_lmetric":123753},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":12984,"score_linear":132609.0,"score_lmetric":264562},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":4096,"new_prefill":8888,"score_linear":291836.0,"score_lmetric":640900},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":126452,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":12984,"score_linear":126452.0,"score_lmetric":25968},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":43321,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":12984,"score_linear":43321.0,"score_lmetric":38952},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":4096,"new_prefill":8888,"score_linear":76150.0,"score_lmetric":8888},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":4096,"new_prefill":8888,"score_linear":173834.0,"score_lmetric":35552}],"chosen_score_linear":81908.0,"chosen_score_lmetric":368,"t_first_token":387183.817420004,"t_first_token_unix":1779818048.8313637,"t_done":387187.314769275,"t_done_unix":1779818052.3287153},{"request_id":"1313181:4:1318843:342","session_id":"1313181","input_length":42704,"t_proxy_recv":387186.554120244,"t_decision_unix":1779818051.5680616,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":42496,"affinity_cache_ratio":0.9951292618958412,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":208,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12984,"ongoing_decode_tokens":12984,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":42496,"new_prefill":208,"score_linear":-29512.0,"score_lmetric":208},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16057,"ongoing_decode_tokens":16057,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":42704,"score_linear":16057.0,"score_lmetric":42704},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":42704,"score_linear":132609.0,"score_lmetric":324002},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":29904,"score_linear":283132.0,"score_lmetric":745980},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71256,"ongoing_decode_tokens":49483,"pending_prefill_tokens":21773,"num_requests":2,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":42704,"score_linear":71256.0,"score_lmetric":128954},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":8845,"ongoing_decode_tokens":8845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1320,"cache_hit":24064,"new_prefill":18640,"score_linear":-15219.0,"score_lmetric":18640},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":42704,"score_linear":168666.0,"score_lmetric":353436},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":12800,"new_prefill":29904,"score_linear":124113.0,"score_lmetric":89712}],"chosen_score_linear":-29512.0,"chosen_score_lmetric":208,"t_first_token":387186.654591506,"t_first_token_unix":1779818051.668535,"t_done":387187.453425679,"t_done_unix":1779818052.4673688},{"request_id":"1340278:2:1367225:564","session_id":"1340278","input_length":49483,"t_proxy_recv":387181.414501849,"t_decision_unix":1779818046.4284427,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9829638461693915,"affinity_num_requests":1,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":843,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":107221,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":49483,"score_linear":107221.0,"score_lmetric":148449},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":78742,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":49483,"score_linear":78742.0,"score_lmetric":98966},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":49483,"score_linear":132609.0,"score_lmetric":337560},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":49483,"score_linear":295932.0,"score_lmetric":843875},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":48640,"new_prefill":843,"score_linear":28329.0,"score_lmetric":77812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":34226,"ongoing_decode_tokens":0,"pending_prefill_tokens":23474,"num_requests":2,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":49483,"score_linear":34226.0,"score_lmetric":145914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":49483,"score_linear":80246.0,"score_lmetric":49483},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":49483,"score_linear":177930.0,"score_lmetric":197932}],"chosen_score_linear":28329.0,"chosen_score_lmetric":77812,"t_first_token":387182.72321918,"t_first_token_unix":1779818047.7371626,"t_done":387188.457914798,"t_done_unix":1779818053.4718587},{"request_id":"1363093:2:1368700:580","session_id":"1363093","input_length":63235,"t_proxy_recv":387186.56331204,"t_decision_unix":1779818051.5772536,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":62464,"affinity_cache_ratio":0.9878073851506286,"affinity_num_requests":1,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":55688,"ongoing_decode_tokens":12984,"pending_prefill_tokens":208,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":63235,"score_linear":55688.0,"score_lmetric":126886},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16057,"ongoing_decode_tokens":16057,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":62464,"new_prefill":771,"score_linear":-46407.0,"score_lmetric":771},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":63235,"score_linear":132609.0,"score_lmetric":365064},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":63235,"score_linear":295932.0,"score_lmetric":912635},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71256,"ongoing_decode_tokens":49483,"pending_prefill_tokens":21773,"num_requests":2,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":63235,"score_linear":71256.0,"score_lmetric":170016},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":8845,"ongoing_decode_tokens":8845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1320,"cache_hit":0,"new_prefill":63235,"score_linear":8845.0,"score_lmetric":63235},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":63235,"score_linear":168666.0,"score_lmetric":415029},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":63235,"score_linear":136913.0,"score_lmetric":189705}],"chosen_score_linear":-46407.0,"chosen_score_lmetric":771,"t_first_token":387186.903276755,"t_first_token_unix":1779818051.9172204,"t_done":387188.488480851,"t_done_unix":1779818053.502424},{"request_id":"1340278:3:1368072:576","session_id":"1340278","input_length":50124,"t_proxy_recv":387188.482400845,"t_decision_unix":1779818053.4963422,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9908227595563004,"affinity_num_requests":0,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":0,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":50124,"score_linear":60004.0,"score_lmetric":67632},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79292,"ongoing_decode_tokens":79292,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":50124,"score_linear":79292.0,"score_lmetric":100248},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":50124,"score_linear":132609.0,"score_lmetric":338842},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":50124,"score_linear":295932.0,"score_lmetric":847080},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":49664,"new_prefill":460,"score_linear":-49664.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6345,"ongoing_decode_tokens":0,"pending_prefill_tokens":6345,"num_requests":1,"active_p_offloads":0,"cached_blocks":1324,"cache_hit":0,"new_prefill":50124,"score_linear":6345.0,"score_lmetric":56469},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":50124,"score_linear":168666.0,"score_lmetric":375696},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":50124,"score_linear":136913.0,"score_lmetric":150372}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":387188.666662591,"t_first_token_unix":1779818053.6806054,"t_done":387188.6939845,"t_done_unix":1779818053.7079282},{"request_id":"1369172:1:1369172:581","session_id":"1369172","input_length":6345,"t_proxy_recv":387188.227507414,"t_decision_unix":1779818053.2414486,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":6345,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":0,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":6345,"score_linear":60004.0,"score_lmetric":23853},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79292,"ongoing_decode_tokens":79292,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":6345,"score_linear":79292.0,"score_lmetric":12690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":6345,"score_linear":132609.0,"score_lmetric":251284},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":6345,"score_linear":295932.0,"score_lmetric":628185},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":0,"new_prefill":6345,"score_linear":49483.0,"score_lmetric":6345},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1324,"cache_hit":0,"new_prefill":6345,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":6345,"score_linear":168666.0,"score_lmetric":244359},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":6345,"score_linear":136913.0,"score_lmetric":19035}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387188.652167542,"t_first_token_unix":1779818053.6661105,"t_done":387188.891388396,"t_done_unix":1779818053.9053323},{"request_id":"1305906:2:1363233:539","session_id":"1305906","input_length":16057,"t_proxy_recv":387167.309751845,"t_decision_unix":1779818032.323693,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8609329264495236,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":2233,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":58758,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":16057,"score_linear":58758.0,"score_lmetric":16057},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62685,"ongoing_decode_tokens":0,"pending_prefill_tokens":62685,"num_requests":1,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":13824,"new_prefill":2233,"score_linear":48861.0,"score_lmetric":64918},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":16057,"score_linear":117888.0,"score_lmetric":133945},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":16057,"score_linear":259631.0,"score_lmetric":531360},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":16057,"score_linear":76969.0,"score_lmetric":93026},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":16057,"score_linear":68259.0,"score_lmetric":16057},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":16057,"score_linear":80246.0,"score_lmetric":16057},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":16057,"score_linear":38646.0,"score_lmetric":32114}],"chosen_score_linear":48861.0,"chosen_score_lmetric":64918,"t_first_token":387180.989326884,"t_first_token_unix":1779818046.0032697,"t_done":387189.659120556,"t_done_unix":1779818054.673064},{"request_id":"1369768:1:1369768:584","session_id":"1369768","input_length":7712,"t_proxy_recv":387190.23081655,"t_decision_unix":1779818055.2447577,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7712,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":0,"pending_prefill_tokens":22868,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":7712,"score_linear":78164.0,"score_lmetric":61160},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":7712,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":7712,"score_linear":132609.0,"score_lmetric":254018},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":7712,"score_linear":295932.0,"score_lmetric":635020},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":7712,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":7712,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":7712,"score_linear":168666.0,"score_lmetric":248460},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":7712,"score_linear":136913.0,"score_lmetric":23136}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387190.768785108,"t_first_token_unix":1779818055.7827287,"t_done":387192.127434358,"t_done_unix":1779818057.1413777},{"request_id":"1366128:3:1369902:585","session_id":"1366128","input_length":23307,"t_proxy_recv":387190.697279599,"t_decision_unix":1779818055.711221,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":15360,"affinity_cache_ratio":0.6590294761230532,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":7947,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":0,"pending_prefill_tokens":22868,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":23307,"score_linear":78164.0,"score_lmetric":92350},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":23307,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":23307,"score_linear":132609.0,"score_lmetric":285208},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":23307,"score_linear":295932.0,"score_lmetric":712995},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":23307,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7712,"ongoing_decode_tokens":0,"pending_prefill_tokens":7712,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":15360,"new_prefill":7947,"score_linear":-7648.0,"score_lmetric":15659},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":23307,"score_linear":168666.0,"score_lmetric":295245},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":23307,"score_linear":136913.0,"score_lmetric":69921}],"chosen_score_linear":-7648.0,"chosen_score_lmetric":15659,"t_first_token":387191.986937684,"t_first_token_unix":1779818057.000881,"t_done":387192.251683761,"t_done_unix":1779818057.2656271},{"request_id":"1370466:1:1370466:592","session_id":"1370466","input_length":7710,"t_proxy_recv":387192.753884435,"t_decision_unix":1779818057.7678254,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113577,"ongoing_decode_tokens":0,"pending_prefill_tokens":22953,"num_requests":3,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":7710,"score_linear":113577.0,"score_lmetric":91989},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":18301,"num_requests":1,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":7710,"score_linear":18301.0,"score_lmetric":26011},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":7710,"score_linear":197140.0,"score_lmetric":397974},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":7710,"score_linear":295932.0,"score_lmetric":635010},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40634,"ongoing_decode_tokens":0,"pending_prefill_tokens":19130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":7710,"score_linear":40634.0,"score_lmetric":53680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1366,"cache_hit":0,"new_prefill":7710,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":7710,"score_linear":168666.0,"score_lmetric":248454},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":139294,"ongoing_decode_tokens":184214,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":7710,"score_linear":139294.0,"score_lmetric":30840}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387193.287334074,"t_first_token_unix":1779818058.3012774,"t_done":387193.402794511,"t_done_unix":1779818058.4167378},{"request_id":"1367424:2:1370211:588","session_id":"1367424","input_length":11133,"t_proxy_recv":387191.705882505,"t_decision_unix":1779818056.7198234,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":4,"affinity_cache_hit":3072,"affinity_cache_ratio":0.27593640528159524,"affinity_num_requests":2,"avg_num_requests":2.375,"fallback_score":19130,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11133,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":0,"pending_prefill_tokens":22868,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":3072,"new_prefill":8061,"score_linear":75092.0,"score_lmetric":61858},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":18301,"num_requests":1,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":11133,"score_linear":18301.0,"score_lmetric":29434},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":11133,"score_linear":132609.0,"score_lmetric":260860},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":11133,"score_linear":295932.0,"score_lmetric":652125},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":11133,"score_linear":29501.0,"score_lmetric":19130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31019,"ongoing_decode_tokens":7712,"pending_prefill_tokens":7947,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":11133,"score_linear":31019.0,"score_lmetric":38160},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":11133,"score_linear":168666.0,"score_lmetric":258723},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":11133,"score_linear":136913.0,"score_lmetric":33399}],"chosen_score_linear":29501.0,"chosen_score_lmetric":19130,"t_first_token":387193.809647258,"t_first_token_unix":1779818058.8235908,"t_done":387193.904470717,"t_done_unix":1779818058.918414},{"request_id":"1368070:2:1370108:586","session_id":"1368070","input_length":29501,"t_proxy_recv":387191.431601791,"t_decision_unix":1779818056.445543,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":21504,"affinity_cache_ratio":0.7289244432392122,"affinity_num_requests":0,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":7997,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":0,"pending_prefill_tokens":22868,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":29501,"score_linear":78164.0,"score_lmetric":104738},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":29501,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":29501,"score_linear":132609.0,"score_lmetric":297596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":29501,"score_linear":295932.0,"score_lmetric":743965},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":21504,"new_prefill":7997,"score_linear":-21504.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31019,"ongoing_decode_tokens":7712,"pending_prefill_tokens":7947,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":29501,"score_linear":31019.0,"score_lmetric":74896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":29501,"score_linear":168666.0,"score_lmetric":313827},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":29501,"score_linear":136913.0,"score_lmetric":88503}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":387192.946679121,"t_first_token_unix":1779818057.9606316,"t_done":387193.964168051,"t_done_unix":1779818058.9781115},{"request_id":"1344773:13:1370257:589","session_id":"1344773","input_length":35413,"t_proxy_recv":387191.901028832,"t_decision_unix":1779818056.9149702,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9975997515036851,"affinity_num_requests":2,"avg_num_requests":2.5,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":85,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":0,"pending_prefill_tokens":22868,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":35328,"new_prefill":85,"score_linear":42836.0,"score_lmetric":45906},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":18301,"num_requests":1,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":35413,"score_linear":18301.0,"score_lmetric":53714},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":35413,"score_linear":132609.0,"score_lmetric":309420},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":35413,"score_linear":295932.0,"score_lmetric":773525},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40634,"ongoing_decode_tokens":0,"pending_prefill_tokens":19130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":35413,"score_linear":40634.0,"score_lmetric":109086},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31019,"ongoing_decode_tokens":7712,"pending_prefill_tokens":7947,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":35413,"score_linear":31019.0,"score_lmetric":86720},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":35413,"score_linear":168666.0,"score_lmetric":331563},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":35413,"score_linear":136913.0,"score_lmetric":106239}],"chosen_score_linear":42836.0,"chosen_score_lmetric":45906,"t_first_token":387194.009441209,"t_first_token_unix":1779818059.0233846,"t_done":387194.052304464,"t_done_unix":1779818059.066248},{"request_id":"1370269:1:1370269:591","session_id":"1370269","input_length":2381,"t_proxy_recv":387191.963078127,"t_decision_unix":1779818056.9770198,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.75,"fallback_score":7143,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113577,"ongoing_decode_tokens":0,"pending_prefill_tokens":22953,"num_requests":3,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":2381,"score_linear":113577.0,"score_lmetric":76002},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":18301,"num_requests":1,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":2381,"score_linear":18301.0,"score_lmetric":20682},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":2381,"score_linear":197140.0,"score_lmetric":381987},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":2381,"score_linear":295932.0,"score_lmetric":608365},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40634,"ongoing_decode_tokens":0,"pending_prefill_tokens":19130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":2381,"score_linear":40634.0,"score_lmetric":43022},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31019,"ongoing_decode_tokens":7712,"pending_prefill_tokens":7947,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":2381,"score_linear":31019.0,"score_lmetric":20656},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":2381,"score_linear":168666.0,"score_lmetric":232467},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":2381,"score_linear":136913.0,"score_lmetric":7143}],"chosen_score_linear":136913.0,"chosen_score_lmetric":7143,"t_first_token":387192.291528765,"t_first_token_unix":1779818057.3054724,"t_done":387194.471996697,"t_done_unix":1779818059.4859402},{"request_id":"1363943:3:1369535:582","session_id":"1363943","input_length":18160,"t_proxy_recv":387189.408778171,"t_decision_unix":1779818054.4227195,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":12800,"affinity_cache_ratio":0.7048458149779736,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":5360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":0,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":12800,"new_prefill":5360,"score_linear":47204.0,"score_lmetric":22868},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":16057,"ongoing_decode_tokens":16057,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":18160,"score_linear":16057.0,"score_lmetric":18160},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":18160,"score_linear":132609.0,"score_lmetric":274914},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":4096,"new_prefill":14064,"score_linear":291836.0,"score_lmetric":666780},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":18160,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":18160,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":4096,"new_prefill":14064,"score_linear":164570.0,"score_lmetric":267516},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":4096,"new_prefill":14064,"score_linear":132817.0,"score_lmetric":42192}],"chosen_score_linear":47204.0,"chosen_score_lmetric":22868,"t_first_token":387193.984946317,"t_first_token_unix":1779818058.9988892,"t_done":387196.315756151,"t_done_unix":1779818061.3296993},{"request_id":"1315567:3:1325346:372","session_id":"1315567","input_length":55130,"t_proxy_recv":387035.077896794,"t_decision_unix":1779817900.0918384,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9937239252675494,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":346,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":652,"cache_hit":4096,"new_prefill":51034,"score_linear":29086.0,"score_lmetric":51034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":55130,"score_linear":62618.0,"score_lmetric":55130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":55130,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":1063,"cache_hit":7680,"new_prefill":47450,"score_linear":59023.0,"score_lmetric":114153},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":672,"cache_hit":0,"new_prefill":55130,"score_linear":79663.0,"score_lmetric":55130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":915,"cache_hit":0,"new_prefill":55130,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":191009,"ongoing_decode_tokens":121968,"pending_prefill_tokens":1969,"num_requests":2,"active_p_offloads":0,"cached_blocks":780,"cache_hit":7680,"new_prefill":47450,"score_linear":183329.0,"score_lmetric":98838},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31794,"ongoing_decode_tokens":76714,"pending_prefill_tokens":-13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":54784,"new_prefill":346,"score_linear":-22990.0,"score_lmetric":-13342}],"chosen_score_linear":-22990.0,"chosen_score_lmetric":-13342,"t_first_token":387035.271790925,"t_first_token_unix":1779817900.2857347,"t_done":387196.689796633,"t_done_unix":1779818061.70374},{"request_id":"1371337:1:1371337:597","session_id":"1371337","input_length":9399,"t_proxy_recv":387195.624059528,"t_decision_unix":1779818060.638001,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":78164,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":9399,"score_linear":78164.0,"score_lmetric":18798},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":51115,"ongoing_decode_tokens":18301,"pending_prefill_tokens":6190,"num_requests":2,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":9399,"score_linear":51115.0,"score_lmetric":31178},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":9399,"score_linear":197140.0,"score_lmetric":403041},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":259631,"pending_prefill_tokens":2509,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":9399,"score_linear":295932.0,"score_lmetric":59540},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1386,"cache_hit":0,"new_prefill":9399,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":9399,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":9399,"score_linear":168666.0,"score_lmetric":253521},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":9399,"score_linear":136913.0,"score_lmetric":28197}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387196.342312256,"t_first_token_unix":1779818061.3562555,"t_done":387196.867519335,"t_done_unix":1779818061.8814626},{"request_id":"1367329:2:1371226:595","session_id":"1367329","input_length":32814,"t_proxy_recv":387195.194429246,"t_decision_unix":1779818060.2083704,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8113610044493205,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":6190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":78164,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":32814,"score_linear":78164.0,"score_lmetric":65628},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":26624,"new_prefill":6190,"score_linear":-8323.0,"score_lmetric":6190},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":32814,"score_linear":197140.0,"score_lmetric":473286},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":259631,"pending_prefill_tokens":2509,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":32814,"score_linear":295932.0,"score_lmetric":176615},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1386,"cache_hit":0,"new_prefill":32814,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":32814,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":32814,"score_linear":168666.0,"score_lmetric":323766},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":32814,"score_linear":136913.0,"score_lmetric":98442}],"chosen_score_linear":-8323.0,"chosen_score_lmetric":6190,"t_first_token":387196.493745344,"t_first_token_unix":1779818061.5076888,"t_done":387197.418685063,"t_done_unix":1779818062.4326282},{"request_id":"1370129:1:1370129:587","session_id":"1370129","input_length":18301,"t_proxy_recv":387191.484180866,"t_decision_unix":1779818056.4981225,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18301,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78164,"ongoing_decode_tokens":0,"pending_prefill_tokens":22868,"num_requests":2,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":4096,"new_prefill":14205,"score_linear":74068.0,"score_lmetric":74146},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":18301,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":18301,"score_linear":132609.0,"score_lmetric":275196},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":7680,"new_prefill":10621,"score_linear":288252.0,"score_lmetric":649565},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":18301,"score_linear":29501.0,"score_lmetric":26298},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31019,"ongoing_decode_tokens":7712,"pending_prefill_tokens":7947,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":18301,"score_linear":31019.0,"score_lmetric":52496},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":7680,"new_prefill":10621,"score_linear":160986.0,"score_lmetric":257187},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":7680,"new_prefill":10621,"score_linear":129233.0,"score_lmetric":31863}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387193.313355522,"t_first_token_unix":1779818058.3272989,"t_done":387197.908635728,"t_done_unix":1779818062.922579},{"request_id":"1339070:1:1339070:438","session_id":"1339070","input_length":7065,"t_proxy_recv":387082.673804092,"t_decision_unix":1779817947.6877456,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-1572,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7065,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":718,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":7065,"score_linear":62618.0,"score_lmetric":7065},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1179,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":99903,"ongoing_decode_tokens":50215,"pending_prefill_tokens":5144,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":7065,"score_linear":99903.0,"score_lmetric":24418},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":82142,"ongoing_decode_tokens":82142,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":847,"cache_hit":0,"new_prefill":7065,"score_linear":82142.0,"score_lmetric":7065},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1009,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":998,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":173369,"ongoing_decode_tokens":131025,"pending_prefill_tokens":-7589,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":7065,"score_linear":173369.0,"score_lmetric":-1572}],"chosen_score_linear":173369.0,"chosen_score_lmetric":-1572,"t_first_token":387085.339347375,"t_first_token_unix":1779817950.3532903,"t_done":387197.922557644,"t_done_unix":1779818062.9365008},{"request_id":"1253743:7:1359251:524","session_id":"1253743","input_length":51509,"t_proxy_recv":387153.274755881,"t_decision_unix":1779818018.288697,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9940010483604806,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":51509,"score_linear":93310.0,"score_lmetric":221030},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":4608,"new_prefill":46901,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":51509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":51200,"new_prefill":309,"score_linear":71397.0,"score_lmetric":116250},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":51509,"score_linear":132503.0,"score_lmetric":271768},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":51509,"score_linear":68259.0,"score_lmetric":51509},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":51509,"score_linear":80246.0,"score_lmetric":51509},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":51509,"score_linear":134672.0,"score_lmetric":154527}],"chosen_score_linear":71397.0,"chosen_score_lmetric":116250,"t_first_token":387193.318062948,"t_first_token_unix":1779818058.3320062,"t_done":387198.05271204,"t_done_unix":1779818063.0666554},{"request_id":"1342921:2:1361022:530","session_id":"1342921","input_length":66032,"t_proxy_recv":387159.514407365,"t_decision_unix":1779818024.5283484,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65536,"affinity_cache_ratio":0.992488490428883,"affinity_num_requests":3,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":66032,"score_linear":93310.0,"score_lmetric":250076},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":66032,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":66032,"score_linear":117888.0,"score_lmetric":183920},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":193599,"ongoing_decode_tokens":0,"pending_prefill_tokens":116287,"num_requests":3,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":65536,"new_prefill":496,"score_linear":128063.0,"score_lmetric":350349},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":132503,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":66032,"score_linear":132503.0,"score_lmetric":132064},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":66032,"score_linear":68259.0,"score_lmetric":66032},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108179,"ongoing_decode_tokens":108179,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":66032,"score_linear":108179.0,"score_lmetric":132064},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":168150,"ongoing_decode_tokens":179592,"pending_prefill_tokens":5318,"num_requests":4,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":66032,"score_linear":168150.0,"score_lmetric":285400}],"chosen_score_linear":128063.0,"chosen_score_lmetric":350349,"t_first_token":387194.937314207,"t_first_token_unix":1779818059.951265,"t_done":387198.498092356,"t_done_unix":1779818063.5120358},{"request_id":"1277428:5:1366630:559","session_id":"1277428","input_length":36301,"t_proxy_recv":387179.128838328,"t_decision_unix":1779818044.1427796,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9308834467370045,"affinity_num_requests":4,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":2509,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107221,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":36301,"score_linear":107221.0,"score_lmetric":216018},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":4608,"new_prefill":31693,"score_linear":74134.0,"score_lmetric":193222},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":36301,"score_linear":132609.0,"score_lmetric":311196},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":33792,"new_prefill":2509,"score_linear":225839.0,"score_lmetric":477168},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":36301,"score_linear":76969.0,"score_lmetric":113270},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":36301,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":36301,"score_linear":80246.0,"score_lmetric":36301},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":181833,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":36301,"score_linear":177930.0,"score_lmetric":176152}],"chosen_score_linear":225839.0,"chosen_score_lmetric":477168,"t_first_token":387197.392023473,"t_first_token_unix":1779818062.4059668,"t_done":387199.823212159,"t_done_unix":1779818064.8371558},{"request_id":"1363943:4:1372250:603","session_id":"1363943","input_length":18396,"t_proxy_recv":387198.970193447,"t_decision_unix":1779818063.9841347,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":17920,"affinity_cache_ratio":0.974124809741248,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":476,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1218,"cache_hit":17920,"new_prefill":476,"score_linear":42084.0,"score_lmetric":476},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":4096,"new_prefill":14300,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":18396,"score_linear":197140.0,"score_lmetric":430032},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":178391,"ongoing_decode_tokens":178391,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":4096,"new_prefill":14300,"score_linear":174295.0,"score_lmetric":42900},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17407,"ongoing_decode_tokens":0,"pending_prefill_tokens":17407,"num_requests":1,"active_p_offloads":0,"cached_blocks":1404,"cache_hit":0,"new_prefill":18396,"score_linear":17407.0,"score_lmetric":35803},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":48653,"ongoing_decode_tokens":13616,"pending_prefill_tokens":11997,"num_requests":2,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":18396,"score_linear":48653.0,"score_lmetric":60786},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":4096,"new_prefill":14300,"score_linear":191275.0,"score_lmetric":407108},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":4096,"new_prefill":14300,"score_linear":70622.0,"score_lmetric":14300}],"chosen_score_linear":42084.0,"chosen_score_lmetric":476,"t_first_token":387199.026213248,"t_first_token_unix":1779818064.0401564,"t_done":387199.864443431,"t_done_unix":1779818064.8783865},{"request_id":"1371929:1:1371929:601","session_id":"1371929","input_length":17407,"t_proxy_recv":387197.732698121,"t_decision_unix":1779818062.7466393,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":17407,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1218,"cache_hit":0,"new_prefill":17407,"score_linear":60004.0,"score_lmetric":17407},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1225,"cache_hit":0,"new_prefill":17407,"score_linear":18301.0,"score_lmetric":17407},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":17407,"score_linear":197140.0,"score_lmetric":427065},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":295932,"pending_prefill_tokens":0,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":17407,"score_linear":295932.0,"score_lmetric":87035},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1404,"cache_hit":0,"new_prefill":17407,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":48653,"ongoing_decode_tokens":0,"pending_prefill_tokens":25613,"num_requests":2,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":17407,"score_linear":48653.0,"score_lmetric":86040},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":17407,"score_linear":195371.0,"score_lmetric":419536},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81783,"ongoing_decode_tokens":126703,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1538,"cache_hit":0,"new_prefill":17407,"score_linear":81783.0,"score_lmetric":34814}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387199.442379657,"t_first_token_unix":1779818064.4563231,"t_done":387199.899110479,"t_done_unix":1779818064.9130538},{"request_id":"1366128:4:1371629:599","session_id":"1366128","input_length":35037,"t_proxy_recv":387196.649421694,"t_decision_unix":1779818061.6633632,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":23040,"affinity_cache_ratio":0.6575905471358849,"affinity_num_requests":1,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":11997,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1218,"cache_hit":0,"new_prefill":35037,"score_linear":60004.0,"score_lmetric":35037},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":51115,"ongoing_decode_tokens":51115,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":35037,"score_linear":51115.0,"score_lmetric":70074},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":35037,"score_linear":197140.0,"score_lmetric":479955},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":259631,"pending_prefill_tokens":2509,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":35037,"score_linear":295932.0,"score_lmetric":187730},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9399,"ongoing_decode_tokens":9399,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1386,"cache_hit":0,"new_prefill":35037,"score_linear":9399.0,"score_lmetric":35037},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13616,"ongoing_decode_tokens":0,"pending_prefill_tokens":13616,"num_requests":1,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":23040,"new_prefill":11997,"score_linear":-9424.0,"score_lmetric":25613},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":35037,"score_linear":168666.0,"score_lmetric":330435},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":35037,"score_linear":136913.0,"score_lmetric":105111}],"chosen_score_linear":-9424.0,"chosen_score_lmetric":25613,"t_first_token":387200.310240085,"t_first_token_unix":1779818065.3241837,"t_done":387200.632650587,"t_done_unix":1779818065.6465943},{"request_id":"1277428:6:1371101:593","session_id":"1277428","input_length":36583,"t_proxy_recv":387199.832470322,"t_decision_unix":1779818064.846412,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9936855916682612,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":231,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":78400,"ongoing_decode_tokens":78400,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1218,"cache_hit":0,"new_prefill":36583,"score_linear":78400.0,"score_lmetric":73166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":4608,"new_prefill":31975,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":36583,"score_linear":197140.0,"score_lmetric":484593},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142090,"ongoing_decode_tokens":142090,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1519,"cache_hit":36352,"new_prefill":231,"score_linear":105738.0,"score_lmetric":462},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17407,"ongoing_decode_tokens":17407,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1404,"cache_hit":0,"new_prefill":36583,"score_linear":17407.0,"score_lmetric":36583},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":48653,"ongoing_decode_tokens":13616,"pending_prefill_tokens":11997,"num_requests":2,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":36583,"score_linear":48653.0,"score_lmetric":97160},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":36583,"score_linear":195371.0,"score_lmetric":496240},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":36583,"score_linear":74718.0,"score_lmetric":36583}],"chosen_score_linear":105738.0,"chosen_score_lmetric":462,"t_first_token":387199.97208085,"t_first_token_unix":1779818064.986024,"t_done":387200.763982072,"t_done_unix":1779818065.777925},{"request_id":"1371622:1:1371622:598","session_id":"1371622","input_length":13616,"t_proxy_recv":387196.625880477,"t_decision_unix":1779818061.6398218,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13616,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1218,"cache_hit":0,"new_prefill":13616,"score_linear":60004.0,"score_lmetric":13616},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":51115,"ongoing_decode_tokens":51115,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":13616,"score_linear":51115.0,"score_lmetric":27232},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":13616,"score_linear":197140.0,"score_lmetric":415692},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":259631,"pending_prefill_tokens":2509,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":13616,"score_linear":295932.0,"score_lmetric":80625},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9399,"ongoing_decode_tokens":9399,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1386,"cache_hit":11264,"new_prefill":2352,"score_linear":-1865.0,"score_lmetric":2352},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":13616,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":13616,"score_linear":168666.0,"score_lmetric":266172},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":13616,"score_linear":136913.0,"score_lmetric":40848}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387198.287421562,"t_first_token_unix":1779818063.3013647,"t_done":387201.128964095,"t_done_unix":1779818066.1429071},{"request_id":"1372791:1:1372791:604","session_id":"1372791","input_length":4811,"t_proxy_recv":387200.741673564,"t_decision_unix":1779818065.755615,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4811,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1219,"cache_hit":0,"new_prefill":4811,"score_linear":60004.0,"score_lmetric":4811},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":4811,"score_linear":197140.0,"score_lmetric":389277},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":178673,"ongoing_decode_tokens":178673,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1519,"cache_hit":0,"new_prefill":4811,"score_linear":178673.0,"score_lmetric":14433},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1438,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13616,"ongoing_decode_tokens":13616,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1404,"cache_hit":0,"new_prefill":4811,"score_linear":13616.0,"score_lmetric":4811},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":4811,"score_linear":195371.0,"score_lmetric":369152},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":4811,"score_linear":74718.0,"score_lmetric":4811}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387201.050717926,"t_first_token_unix":1779818066.0646613,"t_done":387201.227656807,"t_done_unix":1779818066.2416003},{"request_id":"1355484:2:1359370:525","session_id":"1355484","input_length":19493,"t_proxy_recv":387153.730613805,"t_decision_unix":1779818018.7445545,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9981018827271328,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":37,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":19493,"score_linear":93310.0,"score_lmetric":156998},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":19493,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":19493,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174106,"ongoing_decode_tokens":0,"pending_prefill_tokens":116250,"num_requests":2,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":19456,"new_prefill":37,"score_linear":154650.0,"score_lmetric":232574},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":19493,"score_linear":132503.0,"score_lmetric":207736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":12800,"new_prefill":6693,"score_linear":55459.0,"score_lmetric":6693},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":19493,"score_linear":80246.0,"score_lmetric":19493},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":12800,"new_prefill":6693,"score_linear":121872.0,"score_lmetric":20079}],"chosen_score_linear":154650.0,"chosen_score_lmetric":232574,"t_first_token":387193.319474122,"t_first_token_unix":1779818058.333417,"t_done":387201.314861763,"t_done_unix":1779818066.328805},{"request_id":"1356885:1:1356885:514","session_id":"1356885","input_length":122597,"t_proxy_recv":387144.995619558,"t_decision_unix":1779818010.0095606,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":115941,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":69506,"ongoing_decode_tokens":0,"pending_prefill_tokens":35714,"num_requests":2,"active_p_offloads":0,"cached_blocks":1000,"cache_hit":0,"new_prefill":122597,"score_linear":69506.0,"score_lmetric":316622},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":955,"cache_hit":0,"new_prefill":122597,"score_linear":48193.0,"score_lmetric":122597},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1422,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":6656,"new_prefill":115941,"score_linear":-6656.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":122597,"score_linear":132503.0,"score_lmetric":413944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":122597,"score_linear":68259.0,"score_lmetric":122597},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1148,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":122597,"score_linear":134672.0,"score_lmetric":367791}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":387193.315292419,"t_first_token_unix":1779818058.3292358,"t_done":387201.32436843,"t_done_unix":1779818066.338312},{"request_id":"1313181:4:1368020:573","session_id":"1313181","input_length":60004,"t_proxy_recv":387187.465172925,"t_decision_unix":1779818052.4791145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":42496,"affinity_cache_ratio":0.7082194520365309,"affinity_num_requests":0,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":17508,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":42496,"new_prefill":17508,"score_linear":-42496.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79292,"ongoing_decode_tokens":79292,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":60004,"score_linear":79292.0,"score_lmetric":120008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":60004,"score_linear":132609.0,"score_lmetric":358602},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":47204,"score_linear":283132.0,"score_lmetric":832480},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":0,"new_prefill":60004,"score_linear":49483.0,"score_lmetric":60004},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1324,"cache_hit":24064,"new_prefill":35940,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":60004,"score_linear":168666.0,"score_lmetric":405336},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":12800,"new_prefill":47204,"score_linear":124113.0,"score_lmetric":141612}],"chosen_score_linear":-42496.0,"chosen_score_lmetric":0,"t_first_token":387193.983786466,"t_first_token_unix":1779818058.9977298,"t_done":387201.358602772,"t_done_unix":1779818066.37256},{"request_id":"1355484:3:1361065:531","session_id":"1355484","input_length":19714,"t_proxy_recv":387201.327396703,"t_decision_unix":1779818066.3413384,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9869128538094755,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":258,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1219,"cache_hit":12800,"new_prefill":6914,"score_linear":47204.0,"score_lmetric":6914},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":19714,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":19714,"score_linear":197140.0,"score_lmetric":433986},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":38252,"ongoing_decode_tokens":38252,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":19456,"new_prefill":258,"score_linear":18796.0,"score_lmetric":258},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":19714,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":6914,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":19714,"score_linear":195371.0,"score_lmetric":428764},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":12800,"new_prefill":6914,"score_linear":61918.0,"score_lmetric":6914}],"chosen_score_linear":18796.0,"chosen_score_lmetric":258,"t_first_token":387201.385154438,"t_first_token_unix":1779818066.3990977,"t_done":387201.957588109,"t_done_unix":1779818066.9715316},{"request_id":"1362265:3:1373357:605","session_id":"1362265","input_length":10284,"t_proxy_recv":387202.741030626,"t_decision_unix":1779818067.7549722,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9459354336833917,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":556,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":10284,"score_linear":105902.0,"score_lmetric":55770},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":9728,"new_prefill":556,"score_linear":-9728.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":10284,"score_linear":197140.0,"score_lmetric":405696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":58058,"ongoing_decode_tokens":58058,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":0,"new_prefill":10284,"score_linear":58058.0,"score_lmetric":20568},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":10284,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":6656,"new_prefill":3628,"score_linear":-6656.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":153165,"pending_prefill_tokens":14558,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":10284,"score_linear":195371.0,"score_lmetric":99368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":10284,"score_linear":74718.0,"score_lmetric":10284}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":387202.798354941,"t_first_token_unix":1779818067.8122983,"t_done":387202.899718022,"t_done_unix":1779818067.9136615},{"request_id":"1355484:4:1364784:548","session_id":"1355484","input_length":19806,"t_proxy_recv":387201.964651478,"t_decision_unix":1779818066.9785929,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9823285872967787,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":350,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":7006,"score_linear":93102.0,"score_lmetric":52492},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":19806,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":19806,"score_linear":197140.0,"score_lmetric":434262},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":38252,"ongoing_decode_tokens":38252,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":19456,"new_prefill":350,"score_linear":18796.0,"score_lmetric":350},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":19806,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":7006,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":19806,"score_linear":195371.0,"score_lmetric":429132},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":12800,"new_prefill":7006,"score_linear":61918.0,"score_lmetric":7006}],"chosen_score_linear":18796.0,"chosen_score_lmetric":350,"t_first_token":387202.018374959,"t_first_token_unix":1779818067.0323184,"t_done":387203.680235084,"t_done_unix":1779818068.694178},{"request_id":"1355484:5:1366753:560","session_id":"1355484","input_length":20026,"t_proxy_recv":387203.688353482,"t_decision_unix":1779818068.702295,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19968,"affinity_cache_ratio":0.997103765105363,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":58,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":7226,"score_linear":93102.0,"score_lmetric":52712},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":20026,"score_linear":56286.0,"score_lmetric":57880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":20026,"score_linear":197140.0,"score_lmetric":434922},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":38252,"ongoing_decode_tokens":38252,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":19968,"new_prefill":58,"score_linear":18284.0,"score_lmetric":58},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":20026,"score_linear":126340.0,"score_lmetric":145342},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":79495,"num_requests":1,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":7226,"score_linear":66695.0,"score_lmetric":86721},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":168666,"pending_prefill_tokens":12369,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":20026,"score_linear":195371.0,"score_lmetric":129580},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":12800,"new_prefill":7226,"score_linear":61918.0,"score_lmetric":7226}],"chosen_score_linear":18284.0,"chosen_score_lmetric":58,"t_first_token":387203.757247673,"t_first_token_unix":1779818068.7711914,"t_done":387204.274524141,"t_done_unix":1779818069.288468},{"request_id":"1355484:6:1369697:583","session_id":"1355484","input_length":20158,"t_proxy_recv":387204.279719788,"t_decision_unix":1779818069.293661,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9905744617521579,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":7358,"score_linear":111778.0,"score_lmetric":106176},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":20158,"score_linear":56286.0,"score_lmetric":58012},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":20158,"score_linear":197140.0,"score_lmetric":435318},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":38252,"ongoing_decode_tokens":38252,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":19968,"new_prefill":190,"score_linear":18284.0,"score_lmetric":190},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":20158,"score_linear":126340.0,"score_lmetric":145474},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":79495,"num_requests":1,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":7358,"score_linear":66695.0,"score_lmetric":86853},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":168666,"pending_prefill_tokens":12369,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":20158,"score_linear":195371.0,"score_lmetric":130108},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":12800,"new_prefill":7358,"score_linear":61918.0,"score_lmetric":7358}],"chosen_score_linear":18284.0,"chosen_score_lmetric":190,"t_first_token":387204.356679257,"t_first_token_unix":1779818069.3706229,"t_done":387205.160128566,"t_done_unix":1779818070.1740718},{"request_id":"1367312:2:1368064:574","session_id":"1367312","input_length":15501,"t_proxy_recv":387184.361872389,"t_decision_unix":1779818049.375814,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":13312,"affinity_cache_ratio":0.8587833043029482,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":2189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107692,"ongoing_decode_tokens":107692,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":15501,"score_linear":107692.0,"score_lmetric":46503},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":15501,"score_linear":53028.0,"score_lmetric":131304},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":15501,"score_linear":132609.0,"score_lmetric":269596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":15501,"score_linear":295932.0,"score_lmetric":673965},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1306,"cache_hit":0,"new_prefill":15501,"score_linear":49483.0,"score_lmetric":15501},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1274,"cache_hit":0,"new_prefill":15501,"score_linear":18815.0,"score_lmetric":15501},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":153165,"ongoing_decode_tokens":80246,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":13312,"new_prefill":2189,"score_linear":139853.0,"score_lmetric":150216},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":15501,"score_linear":177930.0,"score_lmetric":62004}],"chosen_score_linear":139853.0,"chosen_score_lmetric":150216,"t_first_token":387203.544404694,"t_first_token_unix":1779818068.558348,"t_done":387205.710460296,"t_done_unix":1779818070.7244036},{"request_id":"1367957:1:1367957:572","session_id":"1367957","input_length":72919,"t_proxy_recv":387183.949511567,"t_decision_unix":1779818048.9634528,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.875,"fallback_score":72919,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":72919,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107692,"ongoing_decode_tokens":107692,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":72919,"score_linear":107692.0,"score_lmetric":218757},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":53028,"ongoing_decode_tokens":16057,"pending_prefill_tokens":28267,"num_requests":3,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":72919,"score_linear":53028.0,"score_lmetric":303558},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":18944,"new_prefill":53975,"score_linear":113665.0,"score_lmetric":346544},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":72919,"score_linear":295932.0,"score_lmetric":961055},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126452,"ongoing_decode_tokens":126452,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":72919,"score_linear":126452.0,"score_lmetric":145838},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":43321,"ongoing_decode_tokens":43321,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1265,"cache_hit":0,"new_prefill":72919,"score_linear":43321.0,"score_lmetric":218757},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":72919,"score_linear":80246.0,"score_lmetric":72919},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":177930,"ongoing_decode_tokens":222850,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":72919,"score_linear":177930.0,"score_lmetric":291676}],"chosen_score_linear":80246.0,"chosen_score_lmetric":72919,"t_first_token":387202.354211426,"t_first_token_unix":1779818067.3681548,"t_done":387206.261082,"t_done_unix":1779818071.2750254},{"request_id":"1277428:7:1372183:602","session_id":"1277428","input_length":38252,"t_proxy_recv":387200.775734927,"t_decision_unix":1779818065.7896764,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9503293945414619,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":1900,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1219,"cache_hit":0,"new_prefill":38252,"score_linear":60004.0,"score_lmetric":38252},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":4608,"new_prefill":33644,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":38252,"score_linear":197140.0,"score_lmetric":489600},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":142090,"ongoing_decode_tokens":142090,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1519,"cache_hit":36352,"new_prefill":1900,"score_linear":105738.0,"score_lmetric":3800},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":4811,"ongoing_decode_tokens":0,"pending_prefill_tokens":4811,"num_requests":1,"active_p_offloads":0,"cached_blocks":1438,"cache_hit":0,"new_prefill":38252,"score_linear":4811.0,"score_lmetric":43063},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13616,"ongoing_decode_tokens":13616,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1404,"cache_hit":0,"new_prefill":38252,"score_linear":13616.0,"score_lmetric":38252},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":38252,"score_linear":195371.0,"score_lmetric":502916},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":38252,"score_linear":74718.0,"score_lmetric":38252}],"chosen_score_linear":105738.0,"chosen_score_lmetric":3800,"t_first_token":387201.313015537,"t_first_token_unix":1779818066.3269587,"t_done":387206.481172876,"t_done_unix":1779818071.4951165},{"request_id":"1342634:2:1370263:590","session_id":"1342634","input_length":64531,"t_proxy_recv":387191.945847763,"t_decision_unix":1779818056.9597893,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9124296849576172,"affinity_num_requests":2,"avg_num_requests":2.625,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":5651,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113577,"ongoing_decode_tokens":0,"pending_prefill_tokens":22953,"num_requests":3,"active_p_offloads":0,"cached_blocks":1208,"cache_hit":0,"new_prefill":64531,"score_linear":113577.0,"score_lmetric":262452},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":18301,"num_requests":1,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":64531,"score_linear":18301.0,"score_lmetric":82832},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":58880,"new_prefill":5651,"score_linear":73729.0,"score_lmetric":249896},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":0,"pending_prefill_tokens":119292,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":64531,"score_linear":295932.0,"score_lmetric":919115},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40634,"ongoing_decode_tokens":0,"pending_prefill_tokens":19130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":64531,"score_linear":40634.0,"score_lmetric":167322},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31019,"ongoing_decode_tokens":7712,"pending_prefill_tokens":7947,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":64531,"score_linear":31019.0,"score_lmetric":144956},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":64531,"score_linear":168666.0,"score_lmetric":418917},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136913,"ongoing_decode_tokens":181833,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1532,"cache_hit":0,"new_prefill":64531,"score_linear":136913.0,"score_lmetric":193593}],"chosen_score_linear":73729.0,"chosen_score_lmetric":249896,"t_first_token":387205.085556449,"t_first_token_unix":1779818070.0995047,"t_done":387206.776534647,"t_done_unix":1779818071.790478},{"request_id":"1357132:2:1364990:550","session_id":"1357132","input_length":14721,"t_proxy_recv":387173.311051305,"t_decision_unix":1779818038.3249927,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13312,"affinity_cache_ratio":0.9042863935873922,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":1409,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":14721,"score_linear":72150.0,"score_lmetric":100342},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":14721,"score_linear":78742.0,"score_lmetric":159278},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":13312,"new_prefill":1409,"score_linear":104576.0,"score_lmetric":119297},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":14721,"score_linear":259631.0,"score_lmetric":526016},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":14721,"score_linear":76969.0,"score_lmetric":91690},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":70278,"ongoing_decode_tokens":68259,"pending_prefill_tokens":2019,"num_requests":2,"active_p_offloads":0,"cached_blocks":1211,"cache_hit":0,"new_prefill":14721,"score_linear":70278.0,"score_lmetric":33480},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":94143,"ongoing_decode_tokens":94143,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":14721,"score_linear":94143.0,"score_lmetric":29442},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":136684,"ongoing_decode_tokens":181604,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":14721,"score_linear":136684.0,"score_lmetric":44163}],"chosen_score_linear":104576.0,"chosen_score_lmetric":119297,"t_first_token":387204.542484413,"t_first_token_unix":1779818069.5564275,"t_done":387207.397440671,"t_done_unix":1779818072.4113839},{"request_id":"1357132:3:1366582:557","session_id":"1357132","input_length":14816,"t_proxy_recv":387207.401549482,"t_decision_unix":1779818072.415491,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9676025917926566,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":14816,"score_linear":124578.0,"score_lmetric":121092},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":14816,"score_linear":119822.0,"score_lmetric":106460},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1462,"cache_hit":14336,"new_prefill":480,"score_linear":103552.0,"score_lmetric":480},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41489,"ongoing_decode_tokens":22992,"pending_prefill_tokens":18497,"num_requests":2,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":14816,"score_linear":41489.0,"score_lmetric":66626},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":14816,"score_linear":167848.0,"score_lmetric":289552},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":14816,"score_linear":126259.0,"score_lmetric":212518},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":14816,"score_linear":106951.0,"score_lmetric":29632},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":119638,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":14816,"score_linear":94580.0,"score_lmetric":69356}],"chosen_score_linear":103552.0,"chosen_score_lmetric":480,"t_first_token":387207.463220698,"t_first_token_unix":1779818072.4771645,"t_done":387207.78902296,"t_done_unix":1779818072.8029666},{"request_id":"1357132:4:1367654:570","session_id":"1357132","input_length":14949,"t_proxy_recv":387207.793736304,"t_decision_unix":1779818072.8076777,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9589939126362967,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":613,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":14949,"score_linear":124578.0,"score_lmetric":121358},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":14949,"score_linear":119822.0,"score_lmetric":106726},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1462,"cache_hit":14336,"new_prefill":613,"score_linear":103552.0,"score_lmetric":613},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41489,"ongoing_decode_tokens":22992,"pending_prefill_tokens":18497,"num_requests":2,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":14949,"score_linear":41489.0,"score_lmetric":66892},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":14949,"score_linear":167848.0,"score_lmetric":289818},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":14949,"score_linear":126259.0,"score_lmetric":212784},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":14949,"score_linear":106951.0,"score_lmetric":29898},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":119638,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":14949,"score_linear":94580.0,"score_lmetric":69622}],"chosen_score_linear":103552.0,"chosen_score_lmetric":613,"t_first_token":387207.877430299,"t_first_token_unix":1779818072.8913736,"t_done":387208.285120853,"t_done_unix":1779818073.2990642},{"request_id":"1374465:1:1374465:613","session_id":"1374465","input_length":18497,"t_proxy_recv":387206.690140385,"t_decision_unix":1779818071.704082,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":18497,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18497,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":18497,"score_linear":124578.0,"score_lmetric":128454},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":18497,"score_linear":119822.0,"score_lmetric":113822},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":197140,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":18497,"score_linear":197140.0,"score_lmetric":55491},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":22992,"ongoing_decode_tokens":22992,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":18497,"score_linear":22992.0,"score_lmetric":18497},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":18497,"score_linear":126340.0,"score_lmetric":143813},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":18497,"score_linear":126259.0,"score_lmetric":219880},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":18497,"score_linear":106951.0,"score_lmetric":36994},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":119638,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":18497,"score_linear":94580.0,"score_lmetric":76718}],"chosen_score_linear":22992.0,"chosen_score_lmetric":18497,"t_first_token":387208.527618172,"t_first_token_unix":1779818073.5415614,"t_done":387208.815677759,"t_done_unix":1779818073.8296218},{"request_id":"1357132:5:1368445:579","session_id":"1357132","input_length":15871,"t_proxy_recv":387208.290756725,"t_decision_unix":1779818073.3046982,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.93554281393737,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":1023,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":15871,"score_linear":124578.0,"score_lmetric":123202},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":15871,"score_linear":119822.0,"score_lmetric":108570},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1463,"cache_hit":14848,"new_prefill":1023,"score_linear":103040.0,"score_lmetric":1023},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41489,"ongoing_decode_tokens":22992,"pending_prefill_tokens":18497,"num_requests":2,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":15871,"score_linear":41489.0,"score_lmetric":68736},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":15871,"score_linear":167848.0,"score_lmetric":291662},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":15871,"score_linear":126259.0,"score_lmetric":214628},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":15871,"score_linear":106951.0,"score_lmetric":31742},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":119638,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":15871,"score_linear":94580.0,"score_lmetric":71466}],"chosen_score_linear":103040.0,"chosen_score_lmetric":1023,"t_first_token":387208.593136725,"t_first_token_unix":1779818073.6070802,"t_done":387208.982867244,"t_done_unix":1779818073.996811},{"request_id":"1374347:1:1374347:611","session_id":"1374347","input_length":19862,"t_proxy_recv":387206.250120964,"t_decision_unix":1779818071.2640622,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":19862,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":19862,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":19862,"score_linear":124578.0,"score_lmetric":131184},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":19862,"score_linear":56286.0,"score_lmetric":57716},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":197140,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":19862,"score_linear":197140.0,"score_lmetric":59586},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61244,"ongoing_decode_tokens":61244,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":19862,"score_linear":61244.0,"score_lmetric":39724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":19862,"score_linear":126340.0,"score_lmetric":145178},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":19862,"score_linear":126259.0,"score_lmetric":222610},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":179870,"ongoing_decode_tokens":179870,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1197,"cache_hit":0,"new_prefill":19862,"score_linear":179870.0,"score_lmetric":59586},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":19862,"score_linear":74718.0,"score_lmetric":19862}],"chosen_score_linear":74718.0,"chosen_score_lmetric":19862,"t_first_token":387208.315105652,"t_first_token_unix":1779818073.3290498,"t_done":387209.275920809,"t_done_unix":1779818074.2898643},{"request_id":"1355484:7:1371284:596","session_id":"1355484","input_length":22992,"t_proxy_recv":387205.169392918,"t_decision_unix":1779818070.1833344,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19968,"affinity_cache_ratio":0.8684759916492694,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":3024,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":10192,"score_linear":111778.0,"score_lmetric":111844},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":22992,"score_linear":56286.0,"score_lmetric":60846},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":197140,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":22992,"score_linear":197140.0,"score_lmetric":68976},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":38252,"ongoing_decode_tokens":38252,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":19968,"new_prefill":3024,"score_linear":18284.0,"score_lmetric":3024},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":22992,"score_linear":126340.0,"score_lmetric":148308},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":10192,"score_linear":113459.0,"score_lmetric":203270},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":195371,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":22992,"score_linear":195371.0,"score_lmetric":91968},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":12800,"new_prefill":10192,"score_linear":61918.0,"score_lmetric":10192}],"chosen_score_linear":18284.0,"chosen_score_lmetric":3024,"t_first_token":387205.68139878,"t_first_token_unix":1779818070.6953425,"t_done":387209.577372417,"t_done_unix":1779818074.5913165},{"request_id":"1360649:1:1360649:527","session_id":"1360649","input_length":117888,"t_proxy_recv":387158.264877926,"t_decision_unix":1779818023.2788188,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":117888,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93310,"ongoing_decode_tokens":0,"pending_prefill_tokens":59006,"num_requests":2,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":117888,"score_linear":93310.0,"score_lmetric":353788},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":193599,"ongoing_decode_tokens":0,"pending_prefill_tokens":116287,"num_requests":3,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":117888,"score_linear":193599.0,"score_lmetric":702525},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":117888,"score_linear":132503.0,"score_lmetric":404526},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":117888,"score_linear":68259.0,"score_lmetric":117888},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":117888,"score_linear":80246.0,"score_lmetric":117888},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":117888,"score_linear":134672.0,"score_lmetric":353664}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387204.540404805,"t_first_token_unix":1779818069.554349,"t_done":387213.133101453,"t_done_unix":1779818078.1470456},{"request_id":"1360649:2:1367022:561","session_id":"1360649","input_length":119052,"t_proxy_recv":387213.174629072,"t_decision_unix":1779818078.18857,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":118272,"affinity_cache_ratio":0.9934482411047273,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":118272,"estimated_new_tokens":780,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":119052,"score_linear":162619.0,"score_lmetric":331918},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":119052,"score_linear":119822.0,"score_lmetric":238104},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":118272,"new_prefill":780,"score_linear":-118272.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21588,"ongoing_decode_tokens":0,"pending_prefill_tokens":3156,"num_requests":1,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":0,"new_prefill":119052,"score_linear":21588.0,"score_lmetric":122208},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":4096,"new_prefill":114956,"score_linear":163752.0,"score_lmetric":489832},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":119052,"score_linear":162147.0,"score_lmetric":631629},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":119052,"score_linear":106951.0,"score_lmetric":238104},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":119052,"score_linear":74718.0,"score_lmetric":119052}],"chosen_score_linear":-118272.0,"chosen_score_lmetric":0,"t_first_token":387213.771339047,"t_first_token_unix":1779818078.7852821,"t_done":387215.069786045,"t_done_unix":1779818080.0837302},{"request_id":"1279412:25:1366203:554","session_id":"1279412","input_length":98267,"t_proxy_recv":387177.624630121,"t_decision_unix":1779818042.6385713,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9951662307794071,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":475,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72150,"ongoing_decode_tokens":12636,"pending_prefill_tokens":35450,"num_requests":2,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":12800,"new_prefill":85467,"score_linear":59350.0,"score_lmetric":241834},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":78742,"ongoing_decode_tokens":0,"pending_prefill_tokens":64918,"num_requests":2,"active_p_offloads":0,"cached_blocks":1031,"cache_hit":0,"new_prefill":98267,"score_linear":78742.0,"score_lmetric":326370},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":0,"pending_prefill_tokens":119297,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":98267,"score_linear":132609.0,"score_lmetric":435128},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":259631,"ongoing_decode_tokens":0,"pending_prefill_tokens":116783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":12800,"new_prefill":85467,"score_linear":246831.0,"score_lmetric":809000},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1156,"cache_hit":0,"new_prefill":98267,"score_linear":76969.0,"score_lmetric":175236},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":79413,"ongoing_decode_tokens":68259,"pending_prefill_tokens":11154,"num_requests":2,"active_p_offloads":0,"cached_blocks":1240,"cache_hit":12800,"new_prefill":85467,"score_linear":66613.0,"score_lmetric":193242},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1167,"cache_hit":0,"new_prefill":98267,"score_linear":80246.0,"score_lmetric":98267},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":38646,"ongoing_decode_tokens":83566,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":97792,"new_prefill":475,"score_linear":-59146.0,"score_lmetric":950}],"chosen_score_linear":-59146.0,"chosen_score_lmetric":950,"t_first_token":387177.811321195,"t_first_token_unix":1779818042.825265,"t_done":387216.120698094,"t_done_unix":1779818081.134642},{"request_id":"1364090:2:1371798:600","session_id":"1364090","input_length":26705,"t_proxy_recv":387197.26914965,"t_decision_unix":1779818062.2830906,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.5368283093053735,"affinity_num_requests":3,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":12369,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60004,"ongoing_decode_tokens":60004,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1218,"cache_hit":4096,"new_prefill":22609,"score_linear":55908.0,"score_lmetric":22609},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":51115,"ongoing_decode_tokens":51115,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1213,"cache_hit":0,"new_prefill":26705,"score_linear":51115.0,"score_lmetric":53410},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":26705,"score_linear":197140.0,"score_lmetric":454959},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":295932,"ongoing_decode_tokens":259631,"pending_prefill_tokens":2509,"num_requests":5,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":7680,"new_prefill":19025,"score_linear":288252.0,"score_lmetric":107670},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1404,"cache_hit":0,"new_prefill":26705,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":48653,"ongoing_decode_tokens":0,"pending_prefill_tokens":25613,"num_requests":2,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":26705,"score_linear":48653.0,"score_lmetric":104636},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":168666,"ongoing_decode_tokens":80246,"pending_prefill_tokens":75108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":14336,"new_prefill":12369,"score_linear":154330.0,"score_lmetric":262431},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81783,"ongoing_decode_tokens":126703,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1538,"cache_hit":7680,"new_prefill":19025,"score_linear":74103.0,"score_lmetric":38050}],"chosen_score_linear":154330.0,"chosen_score_lmetric":262431,"t_first_token":387204.470369138,"t_first_token_unix":1779818069.484312,"t_done":387216.155900183,"t_done_unix":1779818081.1698434},{"request_id":"1374465:2:1376358:620","session_id":"1374465","input_length":21588,"t_proxy_recv":387213.099058747,"t_decision_unix":1779818078.113,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":18432,"affinity_cache_ratio":0.8538076709282935,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":3156,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":21588,"score_linear":162619.0,"score_lmetric":136990},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":21588,"score_linear":119822.0,"score_lmetric":43176},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1465,"cache_hit":0,"new_prefill":21588,"score_linear":117888.0,"score_lmetric":21588},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":18432,"new_prefill":3156,"score_linear":-18432.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":21588,"score_linear":167848.0,"score_lmetric":303096},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":21588,"score_linear":162147.0,"score_lmetric":339237},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":21588,"score_linear":106951.0,"score_lmetric":43176},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":21588,"score_linear":74718.0,"score_lmetric":21588}],"chosen_score_linear":-18432.0,"chosen_score_lmetric":0,"t_first_token":387213.629770242,"t_first_token_unix":1779818078.643714,"t_done":387216.728069099,"t_done_unix":1779818081.7420125},{"request_id":"1371337:2:1376534:621","session_id":"1371337","input_length":24323,"t_proxy_recv":387213.757936118,"t_decision_unix":1779818078.7718775,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.3789006290342474,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":24323,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24323,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":24323,"score_linear":162619.0,"score_lmetric":142460},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":24323,"score_linear":119822.0,"score_lmetric":48646},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":119052,"ongoing_decode_tokens":0,"pending_prefill_tokens":780,"num_requests":1,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":24323,"score_linear":119052.0,"score_lmetric":25103},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21588,"ongoing_decode_tokens":21588,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":0,"new_prefill":24323,"score_linear":21588.0,"score_lmetric":24323},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":9216,"new_prefill":15107,"score_linear":158632.0,"score_lmetric":290134},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":24323,"score_linear":162147.0,"score_lmetric":347442},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":24323,"score_linear":106951.0,"score_lmetric":48646},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":24323,"score_linear":74718.0,"score_lmetric":24323}],"chosen_score_linear":21588.0,"chosen_score_lmetric":24323,"t_first_token":387216.547314985,"t_first_token_unix":1779818081.5612583,"t_done":387217.18338262,"t_done_unix":1779818082.1973257},{"request_id":"1377061:1:1377061:622","session_id":"1377061","input_length":16241,"t_proxy_recv":387215.720683425,"t_decision_unix":1779818080.7346246,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":16241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":16241,"score_linear":162619.0,"score_lmetric":126296},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":16241,"score_linear":119822.0,"score_lmetric":32482},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":16241,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45911,"ongoing_decode_tokens":21588,"pending_prefill_tokens":24323,"num_requests":2,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":0,"new_prefill":16241,"score_linear":45911.0,"score_lmetric":81128},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":16241,"score_linear":167848.0,"score_lmetric":292402},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":16241,"score_linear":162147.0,"score_lmetric":323196},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":16241,"score_linear":106951.0,"score_lmetric":32482},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":16241,"score_linear":74718.0,"score_lmetric":16241}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387217.21205151,"t_first_token_unix":1779818082.2259948,"t_done":387217.357428354,"t_done_unix":1779818082.3713722},{"request_id":"1372791:2:1377698:624","session_id":"1372791","input_length":14851,"t_proxy_recv":387217.961109202,"t_decision_unix":1779818082.9750507,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":4608,"affinity_cache_ratio":0.3102821358831055,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":14851,"score_linear":162619.0,"score_lmetric":123516},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":14851,"score_linear":119822.0,"score_lmetric":29702},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":4608,"new_prefill":10243,"score_linear":163240.0,"score_lmetric":280406},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":14851,"score_linear":162147.0,"score_lmetric":319026},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":14851,"score_linear":80246.0,"score_lmetric":14851},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":14851,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387219.278186645,"t_first_token_unix":1779818084.2921307,"t_done":387219.47136566,"t_done_unix":1779818084.4853086},{"request_id":"1370129:2:1373467:607","session_id":"1370129","input_length":56286,"t_proxy_recv":387203.220541601,"t_decision_unix":1779818068.234483,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":18432,"affinity_cache_ratio":0.3274704189318836,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":37854,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":4096,"new_prefill":52190,"score_linear":101806.0,"score_lmetric":97676},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":18432,"new_prefill":37854,"score_linear":-18432.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":56286,"score_linear":197140.0,"score_lmetric":543702},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":58058,"ongoing_decode_tokens":58058,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":7680,"new_prefill":48606,"score_linear":50378.0,"score_lmetric":97212},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":56286,"score_linear":126340.0,"score_lmetric":181602},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":56286,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":153165,"pending_prefill_tokens":14558,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":7680,"new_prefill":48606,"score_linear":187691.0,"score_lmetric":252656},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":7680,"new_prefill":48606,"score_linear":67038.0,"score_lmetric":48606}],"chosen_score_linear":-18432.0,"chosen_score_lmetric":0,"t_first_token":387213.027418934,"t_first_token_unix":1779818078.0413668,"t_done":387219.804801369,"t_done_unix":1779818084.818745},{"request_id":"1355484:8:1377993:625","session_id":"1355484","input_length":23457,"t_proxy_recv":387218.941907574,"t_decision_unix":1779818083.955848,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9822227906381891,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":417,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":10657,"score_linear":149819.0,"score_lmetric":115128},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":23457,"score_linear":119822.0,"score_lmetric":46914},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14851,"ongoing_decode_tokens":0,"pending_prefill_tokens":14851,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":23457,"score_linear":14851.0,"score_lmetric":38308},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":23040,"new_prefill":417,"score_linear":-23040.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":23457,"score_linear":167848.0,"score_lmetric":306834},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":10657,"score_linear":149347.0,"score_lmetric":306444},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":23457,"score_linear":80246.0,"score_lmetric":23457},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":12800,"new_prefill":10657,"score_linear":-36349.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":387219.044293518,"t_first_token_unix":1779818084.058238,"t_done":387220.444136082,"t_done_unix":1779818085.4580796},{"request_id":"1377061:2:1378590:631","session_id":"1377061","input_length":16515,"t_proxy_recv":387220.994864574,"t_decision_unix":1779818086.0088055,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":15872,"affinity_cache_ratio":0.961065697850439,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":643,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":16515,"score_linear":184751.0,"score_lmetric":210582},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":16515,"score_linear":63536.0,"score_lmetric":16515},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":5458,"ongoing_decode_tokens":0,"pending_prefill_tokens":5458,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":15872,"new_prefill":643,"score_linear":-10414.0,"score_lmetric":6101},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1846,"cache_hit":0,"new_prefill":16515,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":16515,"score_linear":167848.0,"score_lmetric":292950},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":16515,"score_linear":162147.0,"score_lmetric":324018},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":16515,"score_linear":80246.0,"score_lmetric":16515},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76791,"ongoing_decode_tokens":121711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":16515,"score_linear":76791.0,"score_lmetric":16515}],"chosen_score_linear":-10414.0,"chosen_score_lmetric":6101,"t_first_token":387221.258611427,"t_first_token_unix":1779818086.2725563,"t_done":387221.342739277,"t_done_unix":1779818086.3566825},{"request_id":"1279412:26:1378269:628","session_id":"1279412","input_length":100340,"t_proxy_recv":387219.885826503,"t_decision_unix":1779818084.8997679,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":99840,"affinity_cache_ratio":0.9950169423958541,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":99840,"estimated_new_tokens":500,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":87540,"score_linear":171951.0,"score_lmetric":423657},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":100340,"score_linear":63536.0,"score_lmetric":100340},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":100340,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23457,"ongoing_decode_tokens":23457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":12800,"new_prefill":87540,"score_linear":10657.0,"score_lmetric":87540},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":100340,"score_linear":167848.0,"score_lmetric":460600},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":87540,"score_linear":149347.0,"score_lmetric":537093},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":100340,"score_linear":80246.0,"score_lmetric":100340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":99840,"new_prefill":500,"score_linear":-123389.0,"score_lmetric":0}],"chosen_score_linear":-123389.0,"chosen_score_lmetric":0,"t_first_token":387220.106616241,"t_first_token_unix":1779818085.120561,"t_done":387221.801403158,"t_done_unix":1779818086.8153496},{"request_id":"1378684:1:1378684:632","session_id":"1378684","input_length":7810,"t_proxy_recv":387221.325509999,"t_decision_unix":1779818086.339451,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7810,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":7810,"score_linear":184751.0,"score_lmetric":184467},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":7810,"score_linear":63536.0,"score_lmetric":7810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21973,"ongoing_decode_tokens":21973,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":7810,"score_linear":21973.0,"score_lmetric":15620},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1846,"cache_hit":0,"new_prefill":7810,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":7810,"score_linear":167848.0,"score_lmetric":275540},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":7810,"score_linear":162147.0,"score_lmetric":297903},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":7810,"score_linear":80246.0,"score_lmetric":7810},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76791,"ongoing_decode_tokens":121711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":7810,"score_linear":76791.0,"score_lmetric":7810}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387221.869756911,"t_first_token_unix":1779818086.8837001,"t_done":387222.133875359,"t_done_unix":1779818087.1478188},{"request_id":"1378543:1:1378543:630","session_id":"1378543","input_length":5458,"t_proxy_recv":387220.833649464,"t_decision_unix":1779818085.8475907,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":5458,"score_linear":184751.0,"score_lmetric":177411},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":5458,"score_linear":63536.0,"score_lmetric":5458},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":5458,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1846,"cache_hit":0,"new_prefill":5458,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":5458,"score_linear":167848.0,"score_lmetric":270836},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":5458,"score_linear":162147.0,"score_lmetric":290847},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":5458,"score_linear":80246.0,"score_lmetric":5458},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76791,"ongoing_decode_tokens":121711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":5458,"score_linear":76791.0,"score_lmetric":5458}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387221.190876674,"t_first_token_unix":1779818086.2048197,"t_done":387222.32773615,"t_done_unix":1779818087.3416793},{"request_id":"1379185:1:1379185:634","session_id":"1379185","input_length":1422,"t_proxy_recv":387223.044644827,"t_decision_unix":1779818088.0585861,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1422,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":1422,"score_linear":184751.0,"score_lmetric":165303},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":1422,"score_linear":63536.0,"score_lmetric":1422},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":435,"num_requests":1,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":1422,"score_linear":15283.0,"score_lmetric":1857},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":1422,"score_linear":167848.0,"score_lmetric":262764},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":1422,"score_linear":162147.0,"score_lmetric":278739},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":1422,"score_linear":80246.0,"score_lmetric":1422},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":1422,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-23549.0,"chosen_score_lmetric":0,"t_first_token":387223.190764063,"t_first_token_unix":1779818088.2047074,"t_done":387223.471849692,"t_done_unix":1779818088.485793},{"request_id":"1379569:1:1379569:638","session_id":"1379569","input_length":2632,"t_proxy_recv":387224.274235532,"t_decision_unix":1779818089.2881773,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2632,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":2632,"score_linear":184751.0,"score_lmetric":168933},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":63536,"pending_prefill_tokens":4625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":2632,"score_linear":124993.0,"score_lmetric":14514},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":2632,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":2632,"score_linear":72939.0,"score_lmetric":7936},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":2632,"score_linear":167848.0,"score_lmetric":265184},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":2632,"score_linear":162147.0,"score_lmetric":282369},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":2632,"score_linear":80246.0,"score_lmetric":2632},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":2632,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387224.444133796,"t_first_token_unix":1779818089.4580772,"t_done":387224.877943039,"t_done_unix":1779818089.8918862},{"request_id":"1377061:3:1380174:641","session_id":"1377061","input_length":17368,"t_proxy_recv":387226.39571454,"t_decision_unix":1779818091.4096558,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":16384,"affinity_cache_ratio":0.943344081068632,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":984,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":184751,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":17368,"score_linear":184751.0,"score_lmetric":52104},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":17368,"score_linear":124993.0,"score_lmetric":34736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1774,"cache_hit":16384,"new_prefill":984,"score_linear":-16384.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96656,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1501,"num_requests":3,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":17368,"score_linear":96656.0,"score_lmetric":56607},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":17368,"score_linear":167848.0,"score_lmetric":294656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":79495,"pending_prefill_tokens":11996,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":17368,"score_linear":162147.0,"score_lmetric":88092},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":17368,"score_linear":80246.0,"score_lmetric":17368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":17368,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-16384.0,"chosen_score_lmetric":0,"t_first_token":387226.573519143,"t_first_token_unix":1779818091.5874624,"t_done":387226.669869998,"t_done_unix":1779818091.683813},{"request_id":"1355951:3:1375866:619","session_id":"1355951","input_length":38041,"t_proxy_recv":387211.635245528,"t_decision_unix":1779818076.6491868,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9690596987460898,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":1177,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":36864,"new_prefill":1177,"score_linear":87714.0,"score_lmetric":46907},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":38041,"score_linear":119822.0,"score_lmetric":152910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1465,"cache_hit":0,"new_prefill":38041,"score_linear":117888.0,"score_lmetric":38041},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":0,"new_prefill":38041,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":38041,"score_linear":167848.0,"score_lmetric":336002},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":38041,"score_linear":162147.0,"score_lmetric":388596},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":38041,"score_linear":106951.0,"score_lmetric":76082},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":38041,"score_linear":74718.0,"score_lmetric":38041}],"chosen_score_linear":87714.0,"chosen_score_lmetric":46907,"t_first_token":387225.157562735,"t_first_token_unix":1779818090.1715057,"t_done":387227.133758061,"t_done_unix":1779818092.1477017},{"request_id":"1378543:2:1380447:644","session_id":"1378543","input_length":5314,"t_proxy_recv":387227.311565669,"t_decision_unix":1779818092.3255072,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":5120,"affinity_cache_ratio":0.963492660895747,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146710,"ongoing_decode_tokens":146710,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":5314,"score_linear":146710.0,"score_lmetric":10628},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":5314,"score_linear":124993.0,"score_lmetric":10628},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":5120,"new_prefill":194,"score_linear":-5120.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":5314,"score_linear":127563.0,"score_lmetric":64872},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":5314,"score_linear":167848.0,"score_lmetric":270548},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":79495,"pending_prefill_tokens":11996,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":5314,"score_linear":162147.0,"score_lmetric":51930},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":5314,"score_linear":80246.0,"score_lmetric":5314},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":5314,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":387227.33806814,"t_first_token_unix":1779818092.352011,"t_done":387227.338588618,"t_done_unix":1779818092.3525314},{"request_id":"1379569:2:1380473:645","session_id":"1379569","input_length":6767,"t_proxy_recv":387227.458928682,"t_decision_unix":1779818092.4728696,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":2560,"affinity_cache_ratio":0.37830648736515443,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":4207,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146710,"ongoing_decode_tokens":146710,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":6767,"score_linear":146710.0,"score_lmetric":13534},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":6767,"score_linear":124993.0,"score_lmetric":13534},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":2560,"new_prefill":4207,"score_linear":-2560.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":6767,"score_linear":127563.0,"score_lmetric":70684},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":6767,"score_linear":167848.0,"score_lmetric":273454},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":79495,"pending_prefill_tokens":11996,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":6767,"score_linear":162147.0,"score_lmetric":56289},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":6767,"score_linear":80246.0,"score_lmetric":6767},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":6767,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":387227.779838713,"t_first_token_unix":1779818092.7937818,"t_done":387228.390512075,"t_done_unix":1779818093.4044552},{"request_id":"1269373:22:1358956:522","session_id":"1269373","input_length":80246,"t_proxy_recv":387152.146523169,"t_decision_unix":1779818017.1604626,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9761981905640157,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":1910,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":58758,"ongoing_decode_tokens":0,"pending_prefill_tokens":58758,"num_requests":1,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":4096,"new_prefill":76150,"score_linear":54662.0,"score_lmetric":134908},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":962,"cache_hit":0,"new_prefill":80246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":80246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":7680,"new_prefill":72566,"score_linear":114917.0,"score_lmetric":188507},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":80246,"score_linear":132503.0,"score_lmetric":329242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":80246,"score_linear":68259.0,"score_lmetric":80246},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":78336,"new_prefill":1910,"score_linear":-78336.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":134672,"ongoing_decode_tokens":179592,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":7680,"new_prefill":72566,"score_linear":126992.0,"score_lmetric":217698}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":387153.197043843,"t_first_token_unix":1779818018.2109876,"t_done":387228.767154723,"t_done_unix":1779818093.7810981},{"request_id":"1363943:5:1373637:609","session_id":"1363943","input_length":18676,"t_proxy_recv":387203.806473578,"t_decision_unix":1779818068.8204153,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9869351038766331,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":18432,"new_prefill":244,"score_linear":87470.0,"score_lmetric":45730},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":4096,"new_prefill":14580,"score_linear":52190.0,"score_lmetric":52434},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":18676,"score_linear":197140.0,"score_lmetric":430872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":58278,"ongoing_decode_tokens":58278,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":4096,"new_prefill":14580,"score_linear":54182.0,"score_lmetric":29160},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":18676,"score_linear":126340.0,"score_lmetric":143992},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":79495,"num_requests":1,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":18676,"score_linear":79495.0,"score_lmetric":98171},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":168666,"pending_prefill_tokens":12369,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":4096,"new_prefill":14580,"score_linear":191275.0,"score_lmetric":107796},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":4096,"new_prefill":14580,"score_linear":70622.0,"score_lmetric":14580}],"chosen_score_linear":87470.0,"chosen_score_lmetric":45730,"t_first_token":387225.154842832,"t_first_token_unix":1779818090.1687863,"t_done":387228.952181924,"t_done_unix":1779818093.966125},{"request_id":"1286804:4:1378156:627","session_id":"1286804","input_length":22132,"t_proxy_recv":387219.466782874,"t_decision_unix":1779818084.4807239,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":15360,"affinity_cache_ratio":0.694017711910356,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":6772,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162619,"ongoing_decode_tokens":0,"pending_prefill_tokens":46907,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":15360,"new_prefill":6772,"score_linear":147259.0,"score_lmetric":107358},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":119822,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":22132,"score_linear":119822.0,"score_lmetric":44264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14851,"ongoing_decode_tokens":14851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":22132,"score_linear":14851.0,"score_lmetric":22132},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23457,"ongoing_decode_tokens":23457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":22132,"score_linear":23457.0,"score_lmetric":22132},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":22132,"score_linear":167848.0,"score_lmetric":304184},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":22132,"score_linear":162147.0,"score_lmetric":340869},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":22132,"score_linear":80246.0,"score_lmetric":22132},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1592,"cache_hit":0,"new_prefill":22132,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":147259.0,"chosen_score_lmetric":107358,"t_first_token":387226.006556546,"t_first_token_unix":1779818091.020501,"t_done":387230.78969049,"t_done_unix":1779818095.8036337},{"request_id":"1279412:27:1380696:646","session_id":"1279412","input_length":100538,"t_proxy_recv":387228.336935681,"t_decision_unix":1779818093.3508766,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":100352,"affinity_cache_ratio":0.9981499532515069,"affinity_num_requests":0,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":100352,"estimated_new_tokens":186,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146710,"ongoing_decode_tokens":146710,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":12800,"new_prefill":87738,"score_linear":133910.0,"score_lmetric":175476},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":100538,"score_linear":124993.0,"score_lmetric":201076},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":6767,"ongoing_decode_tokens":6767,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":0,"new_prefill":100538,"score_linear":6767.0,"score_lmetric":100538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":12800,"new_prefill":87738,"score_linear":114763.0,"score_lmetric":394568},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":100538,"score_linear":167848.0,"score_lmetric":460996},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":79495,"pending_prefill_tokens":11996,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":87738,"score_linear":149347.0,"score_lmetric":299202},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":100538,"score_linear":80246.0,"score_lmetric":100538},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":100352,"new_prefill":186,"score_linear":-123901.0,"score_lmetric":0}],"chosen_score_linear":-123901.0,"chosen_score_lmetric":0,"t_first_token":387228.557155075,"t_first_token_unix":1779818093.5710998,"t_done":387231.025477129,"t_done_unix":1779818096.039421},{"request_id":"1363943:6:1375416:618","session_id":"1363943","input_length":19116,"t_proxy_recv":387228.95756527,"t_decision_unix":1779818093.9715068,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9642184557438794,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":128034,"ongoing_decode_tokens":128034,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":18432,"new_prefill":684,"score_linear":109602.0,"score_lmetric":684},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":4096,"new_prefill":15020,"score_linear":120897.0,"score_lmetric":30040},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":19116,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":4096,"new_prefill":15020,"score_linear":123467.0,"score_lmetric":103696},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":19116,"score_linear":167848.0,"score_lmetric":298152},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":19116,"score_linear":162147.0,"score_lmetric":57492},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":4096,"new_prefill":15020,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76989,"ongoing_decode_tokens":121909,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":4096,"new_prefill":15020,"score_linear":72893.0,"score_lmetric":15020}],"chosen_score_linear":109602.0,"chosen_score_lmetric":684,"t_first_token":387229.093923636,"t_first_token_unix":1779818094.1078675,"t_done":387231.308218018,"t_done_unix":1779818096.3221633},{"request_id":"1379569:3:1381510:649","session_id":"1379569","input_length":7620,"t_proxy_recv":387231.086865356,"t_decision_unix":1779818096.100807,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":6656,"affinity_cache_ratio":0.873490813648294,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":964,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":125018,"ongoing_decode_tokens":125018,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1237,"cache_hit":0,"new_prefill":7620,"score_linear":125018.0,"score_lmetric":7620},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":7620,"score_linear":124993.0,"score_lmetric":15240},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":6656,"new_prefill":964,"score_linear":-6656.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":7620,"score_linear":127563.0,"score_lmetric":74096},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":7620,"score_linear":167848.0,"score_lmetric":275160},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":7620,"score_linear":162147.0,"score_lmetric":23004},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13989,"ongoing_decode_tokens":0,"pending_prefill_tokens":13989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":7620,"score_linear":13989.0,"score_lmetric":21609},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":7620,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":387231.19862229,"t_first_token_unix":1779818096.2125654,"t_done":387231.699035738,"t_done_unix":1779818096.7129788},{"request_id":"1313181:5:1320817:349","session_id":"1313181","input_length":105902,"t_proxy_recv":387201.439601915,"t_decision_unix":1779818066.4535434,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":60416,"affinity_cache_ratio":0.5704896980227002,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":45486,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":60416,"new_prefill":45486,"score_linear":-60416.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":105902,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":105902,"score_linear":197140.0,"score_lmetric":692550},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":57966,"ongoing_decode_tokens":57966,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":12800,"new_prefill":93102,"score_linear":45166.0,"score_lmetric":186204},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":105902,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":24064,"new_prefill":81838,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":80246,"pending_prefill_tokens":87477,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":105902,"score_linear":195371.0,"score_lmetric":773516},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":12800,"new_prefill":93102,"score_linear":61918.0,"score_lmetric":93102}],"chosen_score_linear":-60416.0,"chosen_score_lmetric":0,"t_first_token":387225.153509166,"t_first_token_unix":1779818090.1674526,"t_done":387231.889057836,"t_done_unix":1779818096.903001},{"request_id":"1381728:1:1381728:651","session_id":"1381728","input_length":1391,"t_proxy_recv":387231.992220368,"t_decision_unix":1779818097.0061617,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1391,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81585,"ongoing_decode_tokens":20727,"pending_prefill_tokens":442,"num_requests":1,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":0,"new_prefill":1391,"score_linear":81585.0,"score_lmetric":1833},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":135638,"ongoing_decode_tokens":135638,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":1391,"score_linear":135638.0,"score_lmetric":4173},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":1391,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":1391,"score_linear":127563.0,"score_lmetric":49180},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":1391,"score_linear":167848.0,"score_lmetric":262702},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":1391,"score_linear":162147.0,"score_lmetric":4317},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":1391,"score_linear":13989.0,"score_lmetric":1391},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":1391,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387232.095772391,"t_first_token_unix":1779818097.1097155,"t_done":387232.240217595,"t_done_unix":1779818097.254161},{"request_id":"1362265:4:1381673:650","session_id":"1362265","input_length":10645,"t_proxy_recv":387231.77076329,"t_decision_unix":1779818096.7847047,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10240,"affinity_cache_ratio":0.9619539689995303,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":405,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":126629,"ongoing_decode_tokens":126629,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1238,"cache_hit":0,"new_prefill":10645,"score_linear":126629.0,"score_lmetric":10645},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":10240,"new_prefill":405,"score_linear":114753.0,"score_lmetric":810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":10645,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":10645,"score_linear":127563.0,"score_lmetric":86196},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":10645,"score_linear":167848.0,"score_lmetric":281210},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":6656,"new_prefill":3989,"score_linear":155491.0,"score_lmetric":12111},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13989,"ongoing_decode_tokens":0,"pending_prefill_tokens":13989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":10645,"score_linear":13989.0,"score_lmetric":24634},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":10645,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":114753.0,"chosen_score_lmetric":810,"t_first_token":387231.878384295,"t_first_token_unix":1779818096.8923278,"t_done":387232.462851527,"t_done_unix":1779818097.4767945},{"request_id":"1363943:7:1377305:623","session_id":"1363943","input_length":20727,"t_proxy_recv":387231.313846583,"t_decision_unix":1779818096.3277884,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9139769382930477,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":1783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":105902,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1238,"cache_hit":18944,"new_prefill":1783,"score_linear":86958.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":4096,"new_prefill":16631,"score_linear":120897.0,"score_lmetric":33262},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7620,"ongoing_decode_tokens":7620,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":20727,"score_linear":7620.0,"score_lmetric":20727},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":4096,"new_prefill":16631,"score_linear":123467.0,"score_lmetric":110140},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":20727,"score_linear":167848.0,"score_lmetric":301374},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":20727,"score_linear":162147.0,"score_lmetric":62325},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13989,"ongoing_decode_tokens":0,"pending_prefill_tokens":13989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":4096,"new_prefill":16631,"score_linear":9893.0,"score_lmetric":30620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":4096,"new_prefill":16631,"score_linear":-27645.0,"score_lmetric":0}],"chosen_score_linear":86958.0,"chosen_score_lmetric":0,"t_first_token":387231.618148829,"t_first_token_unix":1779818096.6320922,"t_done":387233.645979617,"t_done_unix":1779818098.6599233},{"request_id":"1366128:5:1373829:610","session_id":"1366128","input_length":46764,"t_proxy_recv":387204.462961047,"t_decision_unix":1779818069.4769025,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34816,"affinity_cache_ratio":0.7445043195620563,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":11948,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":46764,"score_linear":124578.0,"score_lmetric":184988},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":46764,"score_linear":56286.0,"score_lmetric":84618},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":46764,"score_linear":197140.0,"score_lmetric":515136},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":58410,"ongoing_decode_tokens":58410,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":46764,"score_linear":58410.0,"score_lmetric":93528},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":46764,"score_linear":126340.0,"score_lmetric":172080},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":79495,"num_requests":1,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":34816,"new_prefill":11948,"score_linear":44679.0,"score_lmetric":91443},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":168666,"pending_prefill_tokens":12369,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":46764,"score_linear":195371.0,"score_lmetric":236532},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":46764,"score_linear":74718.0,"score_lmetric":46764}],"chosen_score_linear":44679.0,"chosen_score_lmetric":91443,"t_first_token":387228.628948417,"t_first_token_unix":1779818093.6428921,"t_done":387233.792198534,"t_done_unix":1779818098.8061416},{"request_id":"1370129:3:1379538:637","session_id":"1370129","input_length":61457,"t_proxy_recv":387224.168511732,"t_decision_unix":1779818089.182453,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9247441300421433,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":4625,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":4096,"new_prefill":57361,"score_linear":180655.0,"score_lmetric":333120},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":56832,"new_prefill":4625,"score_linear":6704.0,"score_lmetric":4625},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":61457,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":7680,"new_prefill":53777,"score_linear":65259.0,"score_lmetric":110226},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":61457,"score_linear":167848.0,"score_lmetric":382834},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":61457,"score_linear":162147.0,"score_lmetric":458844},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":7680,"new_prefill":53777,"score_linear":72566.0,"score_lmetric":53777},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":7680,"new_prefill":53777,"score_linear":-31229.0,"score_lmetric":0}],"chosen_score_linear":6704.0,"chosen_score_lmetric":4625,"t_first_token":387225.976299785,"t_first_token_unix":1779818090.9902434,"t_done":387234.063747262,"t_done_unix":1779818099.0776908},{"request_id":"1382294:1:1382294:656","session_id":"1382294","input_length":3034,"t_proxy_recv":387233.995899825,"t_decision_unix":1779818099.0098414,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":3034,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3034,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":0,"new_prefill":3034,"score_linear":81806.0,"score_lmetric":3034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":3034,"score_linear":124993.0,"score_lmetric":6068},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":3034,"score_linear":38111.0,"score_lmetric":41145},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":3034,"score_linear":127563.0,"score_lmetric":55752},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":3034,"score_linear":167848.0,"score_lmetric":265988},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":3034,"score_linear":173894.0,"score_lmetric":44859},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":3034,"score_linear":61390.0,"score_lmetric":45574},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30463,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54012,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":3034,"score_linear":30463.0,"score_lmetric":57046}],"chosen_score_linear":81806.0,"chosen_score_lmetric":3034,"t_first_token":387234.270099044,"t_first_token_unix":1779818099.284042,"t_done":387234.639882228,"t_done_unix":1779818099.6538255},{"request_id":"1363093:3:1374394:612","session_id":"1363093","input_length":63536,"t_proxy_recv":387206.403029268,"t_decision_unix":1779818071.4169707,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9911860992193402,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":560,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":63536,"score_linear":124578.0,"score_lmetric":218532},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":62976,"new_prefill":560,"score_linear":-6690.0,"score_lmetric":38414},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":197140,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":63536,"score_linear":197140.0,"score_lmetric":190608},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":61244,"ongoing_decode_tokens":61244,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":63536,"score_linear":61244.0,"score_lmetric":127072},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":63536,"score_linear":126340.0,"score_lmetric":188852},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":63536,"score_linear":126259.0,"score_lmetric":309958},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":63536,"score_linear":106951.0,"score_lmetric":127072},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":119638,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":63536,"score_linear":94580.0,"score_lmetric":166796}],"chosen_score_linear":-6690.0,"chosen_score_lmetric":38414,"t_first_token":387213.034363781,"t_first_token_unix":1779818078.0483074,"t_done":387235.275483823,"t_done_unix":1779818100.2894275},{"request_id":"1382667:1:1382667:658","session_id":"1382667","input_length":1955,"t_proxy_recv":387235.411453549,"t_decision_unix":1779818100.4253953,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1955,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1334,"cache_hit":0,"new_prefill":1955,"score_linear":81806.0,"score_lmetric":1955},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":1955,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":1955,"score_linear":38111.0,"score_lmetric":40066},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":1955,"score_linear":127563.0,"score_lmetric":51436},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":1955,"score_linear":167848.0,"score_lmetric":263830},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":1955,"score_linear":173894.0,"score_lmetric":41622},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":1955,"score_linear":61390.0,"score_lmetric":43416},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":1955,"score_linear":131229.0,"score_lmetric":112762}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387235.538490611,"t_first_token_unix":1779818100.5524335,"t_done":387235.81602588,"t_done_unix":1779818100.829969},{"request_id":"1382804:1:1382804:660","session_id":"1382804","input_length":627,"t_proxy_recv":387235.739786435,"t_decision_unix":1779818100.7537277,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":627,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":627,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":84996,"ongoing_decode_tokens":81806,"pending_prefill_tokens":3190,"num_requests":2,"active_p_offloads":0,"cached_blocks":1334,"cache_hit":0,"new_prefill":627,"score_linear":84996.0,"score_lmetric":7634},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":1955,"ongoing_decode_tokens":1955,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":627,"score_linear":1955.0,"score_lmetric":627},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":627,"score_linear":38111.0,"score_lmetric":38738},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":627,"score_linear":127563.0,"score_lmetric":46124},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":627,"score_linear":167848.0,"score_lmetric":261174},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":627,"score_linear":173894.0,"score_lmetric":37638},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":627,"score_linear":61390.0,"score_lmetric":40760},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":627,"score_linear":131229.0,"score_lmetric":110106}],"chosen_score_linear":1955.0,"chosen_score_lmetric":627,"t_first_token":387235.805433031,"t_first_token_unix":1779818100.8193762,"t_done":387235.97151535,"t_done_unix":1779818100.9854581},{"request_id":"1382710:1:1382710:659","session_id":"1382710","input_length":3190,"t_proxy_recv":387235.511055455,"t_decision_unix":1779818100.5249972,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":3190,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1334,"cache_hit":0,"new_prefill":3190,"score_linear":81806.0,"score_lmetric":3190},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":1955,"ongoing_decode_tokens":0,"pending_prefill_tokens":1955,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":3190,"score_linear":1955.0,"score_lmetric":5145},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":3190,"score_linear":38111.0,"score_lmetric":41301},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":3190,"score_linear":127563.0,"score_lmetric":56376},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":3190,"score_linear":167848.0,"score_lmetric":266300},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":3190,"score_linear":173894.0,"score_lmetric":45327},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":3190,"score_linear":61390.0,"score_lmetric":45886},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":3190,"score_linear":131229.0,"score_lmetric":115232}],"chosen_score_linear":81806.0,"chosen_score_lmetric":3190,"t_first_token":387235.791038197,"t_first_token_unix":1779818100.8049815,"t_done":387236.09009272,"t_done_unix":1779818101.1040356},{"request_id":"1382294:2:1383073:664","session_id":"1382294","input_length":5164,"t_proxy_recv":387236.607249166,"t_decision_unix":1779818101.6211905,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":2560,"affinity_cache_ratio":0.4957397366382649,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":2604,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":2604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":2560,"new_prefill":2604,"score_linear":79246.0,"score_lmetric":2604},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5135,"ongoing_decode_tokens":0,"pending_prefill_tokens":5135,"num_requests":1,"active_p_offloads":0,"cached_blocks":1353,"cache_hit":0,"new_prefill":5164,"score_linear":5135.0,"score_lmetric":10299},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":5164,"score_linear":38111.0,"score_lmetric":43275},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":5164,"score_linear":127563.0,"score_lmetric":64272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":5164,"score_linear":167848.0,"score_lmetric":270248},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":5164,"score_linear":173894.0,"score_lmetric":51249},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":5164,"score_linear":61390.0,"score_lmetric":49834},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":5164,"score_linear":131229.0,"score_lmetric":119180}],"chosen_score_linear":79246.0,"chosen_score_lmetric":2604,"t_first_token":387236.88779891,"t_first_token_unix":1779818101.901742,"t_done":387237.462570838,"t_done_unix":1779818102.4765139},{"request_id":"1383090:1:1383090:665","session_id":"1383090","input_length":9305,"t_proxy_recv":387236.648731874,"t_decision_unix":1779818101.6626735,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":14440,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9305,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":86970,"ongoing_decode_tokens":81806,"pending_prefill_tokens":2604,"num_requests":2,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":9305,"score_linear":86970.0,"score_lmetric":23818},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5135,"ongoing_decode_tokens":0,"pending_prefill_tokens":5135,"num_requests":1,"active_p_offloads":0,"cached_blocks":1353,"cache_hit":0,"new_prefill":9305,"score_linear":5135.0,"score_lmetric":14440},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":9305,"score_linear":38111.0,"score_lmetric":47416},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":9305,"score_linear":127563.0,"score_lmetric":80836},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":9305,"score_linear":167848.0,"score_lmetric":278530},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":9305,"score_linear":173894.0,"score_lmetric":63672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":9305,"score_linear":61390.0,"score_lmetric":58116},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":9305,"score_linear":131229.0,"score_lmetric":127462}],"chosen_score_linear":5135.0,"chosen_score_lmetric":14440,"t_first_token":387237.397094667,"t_first_token_unix":1779818102.4110377,"t_done":387237.667985268,"t_done_unix":1779818102.6819284},{"request_id":"1383009:1:1383009:663","session_id":"1383009","input_length":5135,"t_proxy_recv":387236.382900851,"t_decision_unix":1779818101.3968422,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5135,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":5135,"score_linear":81806.0,"score_lmetric":5135},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1353,"cache_hit":0,"new_prefill":5135,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":5135,"score_linear":38111.0,"score_lmetric":43246},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":5135,"score_linear":127563.0,"score_lmetric":64156},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":5135,"score_linear":167848.0,"score_lmetric":270190},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":5135,"score_linear":173894.0,"score_lmetric":51162},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":5135,"score_linear":61390.0,"score_lmetric":49776},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":5135,"score_linear":131229.0,"score_lmetric":119122}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387236.713563577,"t_first_token_unix":1779818101.7275066,"t_done":387237.687033243,"t_done_unix":1779818102.7009761},{"request_id":"1263749:2:1379302:636","session_id":"1263749","input_length":57656,"t_proxy_recv":387223.524119649,"t_decision_unix":1779818088.5380611,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":56320,"affinity_cache_ratio":0.9768280838074095,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":1336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":57656,"score_linear":184751.0,"score_lmetric":334005},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":57656,"score_linear":63536.0,"score_lmetric":57656},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":435,"num_requests":1,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":56320,"new_prefill":1336,"score_linear":-41037.0,"score_lmetric":1771},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":57656,"score_linear":167848.0,"score_lmetric":375232},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":57656,"score_linear":162147.0,"score_lmetric":447441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":57656,"score_linear":80246.0,"score_lmetric":57656},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":57656,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-41037.0,"chosen_score_lmetric":1771,"t_first_token":387237.112012599,"t_first_token_unix":1779818102.1259558,"t_done":387238.394257805,"t_done_unix":1779818103.4082012},{"request_id":"1381387:1:1381387:648","session_id":"1381387","input_length":13989,"t_proxy_recv":387230.678678665,"t_decision_unix":1779818095.6926196,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":147150,"ongoing_decode_tokens":147150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":13989,"score_linear":147150.0,"score_lmetric":27978},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":13989,"score_linear":124993.0,"score_lmetric":27978},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":13989,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":13989,"score_linear":127563.0,"score_lmetric":99572},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":13989,"score_linear":167848.0,"score_lmetric":287898},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":13989,"score_linear":162147.0,"score_lmetric":42111},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":13989,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":76989,"ongoing_decode_tokens":121909,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":13989,"score_linear":76989.0,"score_lmetric":13989}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387231.889815038,"t_first_token_unix":1779818096.9037578,"t_done":387238.817934918,"t_done_unix":1779818103.831878},{"request_id":"1374465:3:1380413:642","session_id":"1374465","input_length":30907,"t_proxy_recv":387227.188165721,"t_decision_unix":1779818092.202107,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":21504,"affinity_cache_ratio":0.6957647134953246,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":9403,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146710,"ongoing_decode_tokens":146710,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":30907,"score_linear":146710.0,"score_lmetric":61814},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":30907,"score_linear":124993.0,"score_lmetric":61814},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":0,"new_prefill":30907,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":96656,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1501,"num_requests":3,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":21504,"new_prefill":9403,"score_linear":75152.0,"score_lmetric":32712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":30907,"score_linear":167848.0,"score_lmetric":321734},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":79495,"pending_prefill_tokens":11996,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":30907,"score_linear":162147.0,"score_lmetric":128709},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":30907,"score_linear":80246.0,"score_lmetric":30907},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":30907,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":75152.0,"chosen_score_lmetric":32712,"t_first_token":387237.428748246,"t_first_token_unix":1779818102.4426918,"t_done":387238.843404499,"t_done_unix":1779818103.8573477},{"request_id":"1383625:1:1383625:668","session_id":"1383625","input_length":3186,"t_proxy_recv":387238.585672466,"t_decision_unix":1779818103.5996141,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3186,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1345,"cache_hit":0,"new_prefill":3186,"score_linear":81806.0,"score_lmetric":3186},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":3186,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":48328,"ongoing_decode_tokens":0,"pending_prefill_tokens":40648,"num_requests":2,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":3186,"score_linear":48328.0,"score_lmetric":87668},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":69907,"ongoing_decode_tokens":69907,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1863,"cache_hit":0,"new_prefill":3186,"score_linear":69907.0,"score_lmetric":9558},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":3186,"score_linear":167848.0,"score_lmetric":266292},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":3186,"score_linear":173894.0,"score_lmetric":9558},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":61390,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":3186,"score_linear":61390.0,"score_lmetric":6372},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":3186,"score_linear":131229.0,"score_lmetric":115224}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387238.784990606,"t_first_token_unix":1779818103.798934,"t_done":387238.912976116,"t_done_unix":1779818103.9269195},{"request_id":"1355484:9:1379722:640","session_id":"1355484","input_length":23717,"t_proxy_recv":387224.793805716,"t_decision_unix":1779818089.8077471,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9930429649618417,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":165,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":12800,"new_prefill":10917,"score_linear":171951.0,"score_lmetric":193788},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":63536,"pending_prefill_tokens":4625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":23717,"score_linear":124993.0,"score_lmetric":56684},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":2632,"ongoing_decode_tokens":2632,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":23717,"score_linear":2632.0,"score_lmetric":23717},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":72939,"ongoing_decode_tokens":15283,"pending_prefill_tokens":1336,"num_requests":2,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":23552,"new_prefill":165,"score_linear":49387.0,"score_lmetric":3002},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":23717,"score_linear":167848.0,"score_lmetric":307354},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":12800,"new_prefill":10917,"score_linear":149347.0,"score_lmetric":307224},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":23717,"score_linear":80246.0,"score_lmetric":23717},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":12800,"new_prefill":10917,"score_linear":-36349.0,"score_lmetric":0}],"chosen_score_linear":49387.0,"chosen_score_lmetric":3002,"t_first_token":387237.113222586,"t_first_token_unix":1779818102.1271658,"t_done":387239.081266582,"t_done_unix":1779818104.09521},{"request_id":"1382089:1:1382089:655","session_id":"1382089","input_length":38111,"t_proxy_recv":387233.296782786,"t_decision_unix":1779818098.310724,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":38111,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81585,"ongoing_decode_tokens":81585,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":34816,"new_prefill":3295,"score_linear":46769.0,"score_lmetric":3295},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":38111,"score_linear":124993.0,"score_lmetric":76222},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":38111,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":38111,"score_linear":127563.0,"score_lmetric":196060},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":38111,"score_linear":167848.0,"score_lmetric":336142},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":38111,"score_linear":162147.0,"score_lmetric":114477},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":38111,"score_linear":61390.0,"score_lmetric":115728},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30463,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54012,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":38111,"score_linear":30463.0,"score_lmetric":92123}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387239.159389257,"t_first_token_unix":1779818104.1733327,"t_done":387239.594662051,"t_done_unix":1779818104.6086082},{"request_id":"1379569:4:1383116:666","session_id":"1379569","input_length":10217,"t_proxy_recv":387236.740658461,"t_decision_unix":1779818101.7546,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":7680,"affinity_cache_ratio":0.7516883625330332,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2537,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":86970,"ongoing_decode_tokens":81806,"pending_prefill_tokens":2604,"num_requests":2,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":10217,"score_linear":86970.0,"score_lmetric":25642},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":14440,"ongoing_decode_tokens":5135,"pending_prefill_tokens":9305,"num_requests":2,"active_p_offloads":0,"cached_blocks":1353,"cache_hit":0,"new_prefill":10217,"score_linear":14440.0,"score_lmetric":39044},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":7680,"new_prefill":2537,"score_linear":30431.0,"score_lmetric":40648},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":10217,"score_linear":127563.0,"score_lmetric":84484},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":10217,"score_linear":167848.0,"score_lmetric":280354},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":10217,"score_linear":173894.0,"score_lmetric":66408},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":10217,"score_linear":61390.0,"score_lmetric":59940},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":10217,"score_linear":131229.0,"score_lmetric":129286}],"chosen_score_linear":30431.0,"chosen_score_lmetric":40648,"t_first_token":387239.40494866,"t_first_token_unix":1779818104.4188921,"t_done":387239.771538072,"t_done_unix":1779818104.7854812},{"request_id":"1313181:5:1374956:615","session_id":"1313181","input_length":60858,"t_proxy_recv":387231.899841097,"t_decision_unix":1779818096.9137828,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":60416,"affinity_cache_ratio":0.9927371914949554,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":442,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":20727,"ongoing_decode_tokens":20727,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":60416,"new_prefill":442,"score_linear":-39689.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":135638,"ongoing_decode_tokens":135638,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":60858,"score_linear":135638.0,"score_lmetric":182574},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":60858,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":12800,"new_prefill":48058,"score_linear":114763.0,"score_lmetric":235848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":60858,"score_linear":167848.0,"score_lmetric":381636},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":24064,"new_prefill":36794,"score_linear":138083.0,"score_lmetric":110526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":60858,"score_linear":13989.0,"score_lmetric":60858},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":12800,"new_prefill":48058,"score_linear":-36349.0,"score_lmetric":0}],"chosen_score_linear":-39689.0,"chosen_score_lmetric":0,"t_first_token":387232.01279491,"t_first_token_unix":1779818097.0267382,"t_done":387239.830721275,"t_done_unix":1779818104.8446646},{"request_id":"1383625:2:1384279:673","session_id":"1383625","input_length":4150,"t_proxy_recv":387241.003074883,"t_decision_unix":1779818106.0170164,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":3072,"affinity_cache_ratio":0.7402409638554217,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":1078,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":4150,"score_linear":148474.0,"score_lmetric":98488},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1387,"cache_hit":3072,"new_prefill":1078,"score_linear":-3072.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":4150,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84748,"ongoing_decode_tokens":15283,"pending_prefill_tokens":3417,"num_requests":2,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":4150,"score_linear":84748.0,"score_lmetric":15134},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":4150,"score_linear":167848.0,"score_lmetric":268220},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":4150,"score_linear":173894.0,"score_lmetric":12450},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":47401,"pending_prefill_tokens":14559,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":4150,"score_linear":75784.0,"score_lmetric":37418},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":4150,"score_linear":131229.0,"score_lmetric":117152}],"chosen_score_linear":-3072.0,"chosen_score_lmetric":0,"t_first_token":387241.109307216,"t_first_token_unix":1779818106.1232507,"t_done":387241.239040548,"t_done_unix":1779818106.2529836},{"request_id":"1366128:6:1375094:616","session_id":"1366128","input_length":58511,"t_proxy_recv":387233.806465094,"t_decision_unix":1779818098.8204067,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":46592,"affinity_cache_ratio":0.7962947138144965,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":11919,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":0,"new_prefill":58511,"score_linear":81806.0,"score_lmetric":58511},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":58511,"score_linear":124993.0,"score_lmetric":117022},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":58511,"score_linear":38111.0,"score_lmetric":96622},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":58511,"score_linear":127563.0,"score_lmetric":277660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":58511,"score_linear":167848.0,"score_lmetric":376942},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115383,"ongoing_decode_tokens":115383,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":46592,"new_prefill":11919,"score_linear":68791.0,"score_lmetric":23838},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":58511,"score_linear":61390.0,"score_lmetric":156528},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30463,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54012,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":58511,"score_linear":30463.0,"score_lmetric":112523}],"chosen_score_linear":68791.0,"chosen_score_lmetric":23838,"t_first_token":387237.892685488,"t_first_token_unix":1779818102.9066288,"t_done":387241.302704122,"t_done_unix":1779818106.3166475},{"request_id":"1382667:2:1384299:674","session_id":"1382667","input_length":5989,"t_proxy_recv":387241.063694758,"t_decision_unix":1779818106.0776362,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":2,"affinity_cache_hit":1536,"affinity_cache_ratio":0.2564701953581566,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":5989,"score_linear":148474.0,"score_lmetric":102166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":4150,"ongoing_decode_tokens":0,"pending_prefill_tokens":1078,"num_requests":1,"active_p_offloads":0,"cached_blocks":1387,"cache_hit":1536,"new_prefill":4453,"score_linear":2614.0,"score_lmetric":5531},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":5989,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84748,"ongoing_decode_tokens":15283,"pending_prefill_tokens":3417,"num_requests":2,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":5989,"score_linear":84748.0,"score_lmetric":18812},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":5989,"score_linear":167848.0,"score_lmetric":271898},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":5989,"score_linear":173894.0,"score_lmetric":17967},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":47401,"pending_prefill_tokens":14559,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":5989,"score_linear":75784.0,"score_lmetric":41096},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":5989,"score_linear":131229.0,"score_lmetric":120830}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387241.460044489,"t_first_token_unix":1779818106.4739876,"t_done":387241.760730406,"t_done_unix":1779818106.774676},{"request_id":"1366128:7:1378071:626","session_id":"1366128","input_length":59007,"t_proxy_recv":387241.314206147,"t_decision_unix":1779818106.3281476,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9891707763485688,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":639,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":59007,"score_linear":148474.0,"score_lmetric":208202},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":59007,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":5989,"ongoing_decode_tokens":0,"pending_prefill_tokens":5989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":59007,"score_linear":5989.0,"score_lmetric":64996},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84748,"ongoing_decode_tokens":15283,"pending_prefill_tokens":3417,"num_requests":2,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":59007,"score_linear":84748.0,"score_lmetric":124848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":59007,"score_linear":167848.0,"score_lmetric":377934},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115383,"ongoing_decode_tokens":115383,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":58368,"new_prefill":639,"score_linear":57015.0,"score_lmetric":1278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":59007,"score_linear":75784.0,"score_lmetric":118014},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":59007,"score_linear":131229.0,"score_lmetric":226866}],"chosen_score_linear":57015.0,"chosen_score_lmetric":1278,"t_first_token":387241.587347856,"t_first_token_unix":1779818106.6012912,"t_done":387243.164839652,"t_done_unix":1779818108.1787832},{"request_id":"1373577:1:1373577:608","session_id":"1373577","input_length":79495,"t_proxy_recv":387203.64141972,"t_decision_unix":1779818068.6553612,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":79495,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":79495,"score_linear":105902.0,"score_lmetric":124981},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":37854,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":79495,"score_linear":56286.0,"score_lmetric":117349},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":2560,"new_prefill":76935,"score_linear":194580.0,"score_lmetric":605649},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":58058,"ongoing_decode_tokens":58058,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":0,"new_prefill":79495,"score_linear":58058.0,"score_lmetric":158990},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":79495,"score_linear":126340.0,"score_lmetric":204811},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":79495,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":168666,"pending_prefill_tokens":12369,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":79495,"score_linear":195371.0,"score_lmetric":367456},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":79495,"score_linear":74718.0,"score_lmetric":79495}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387225.58378424,"t_first_token_unix":1779818090.5977278,"t_done":387243.771211418,"t_done_unix":1779818108.7851553},{"request_id":"1381387:2:1383735:669","session_id":"1381387","input_length":28383,"t_proxy_recv":387238.895688547,"t_decision_unix":1779818103.90963,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":13824,"affinity_cache_ratio":0.4870521086565902,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":14559,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":14559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1345,"cache_hit":0,"new_prefill":28383,"score_linear":81806.0,"score_lmetric":28383},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":3186,"ongoing_decode_tokens":3186,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":28383,"score_linear":3186.0,"score_lmetric":28383},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":48328,"ongoing_decode_tokens":0,"pending_prefill_tokens":40648,"num_requests":2,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":28383,"score_linear":48328.0,"score_lmetric":138062},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":39000,"ongoing_decode_tokens":39000,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":28383,"score_linear":39000.0,"score_lmetric":56766},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":28383,"score_linear":167848.0,"score_lmetric":316686},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":28383,"score_linear":173894.0,"score_lmetric":85149},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":13824,"new_prefill":14559,"score_linear":33577.0,"score_lmetric":14559},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":28383,"score_linear":131229.0,"score_lmetric":165618}],"chosen_score_linear":33577.0,"chosen_score_lmetric":14559,"t_first_token":387241.291455174,"t_first_token_unix":1779818106.3053985,"t_done":387243.944377101,"t_done_unix":1779818108.9583201},{"request_id":"1366128:8:1380438:643","session_id":"1366128","input_length":59230,"t_proxy_recv":387243.175498684,"t_decision_unix":1779818108.1894326,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9940908323484721,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":350,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":59230,"score_linear":148474.0,"score_lmetric":208648},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":59230,"score_linear":89874.0,"score_lmetric":164924},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":30147,"ongoing_decode_tokens":0,"pending_prefill_tokens":30147,"num_requests":2,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":59230,"score_linear":30147.0,"score_lmetric":178754},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":59230,"score_linear":109974.0,"score_lmetric":192963},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":59230,"score_linear":217713.0,"score_lmetric":568173},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115383,"ongoing_decode_tokens":115383,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1477,"cache_hit":58880,"new_prefill":350,"score_linear":56503.0,"score_lmetric":700},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":59230,"score_linear":75784.0,"score_lmetric":118460},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":59230,"score_linear":131229.0,"score_lmetric":227312}],"chosen_score_linear":56503.0,"chosen_score_lmetric":700,"t_first_token":387243.351543639,"t_first_token_unix":1779818108.3654873,"t_done":387245.385865829,"t_done_unix":1779818110.3998096},{"request_id":"1383009:2:1384930:679","session_id":"1383009","input_length":11113,"t_proxy_recv":387243.035980057,"t_decision_unix":1779818108.049921,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":2,"affinity_cache_hit":5120,"affinity_cache_ratio":0.46072167731485647,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":11113,"score_linear":148474.0,"score_lmetric":112414},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":5120,"new_prefill":5993,"score_linear":84754.0,"score_lmetric":58450},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":11113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":11113,"score_linear":109974.0,"score_lmetric":48612},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":11113,"score_linear":217713.0,"score_lmetric":423822},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":174390,"ongoing_decode_tokens":174390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":11113,"score_linear":174390.0,"score_lmetric":33339},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":11113,"score_linear":75784.0,"score_lmetric":22226},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":11113,"score_linear":131229.0,"score_lmetric":131078}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387243.924130728,"t_first_token_unix":1779818108.938074,"t_done":387246.003946218,"t_done_unix":1779818111.0178893},{"request_id":"1384947:1:1384947:680","session_id":"1384947","input_length":19034,"t_proxy_recv":387243.098743816,"t_decision_unix":1779818108.112685,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":30147,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":19034,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":19034,"score_linear":148474.0,"score_lmetric":128256},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":19034,"score_linear":89874.0,"score_lmetric":84532},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":11113,"ongoing_decode_tokens":0,"pending_prefill_tokens":11113,"num_requests":1,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":19034,"score_linear":11113.0,"score_lmetric":30147},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":19034,"score_linear":109974.0,"score_lmetric":72375},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":19034,"score_linear":217713.0,"score_lmetric":447585},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":174390,"ongoing_decode_tokens":174390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":19034,"score_linear":174390.0,"score_lmetric":57102},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":19034,"score_linear":75784.0,"score_lmetric":38068},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":19034,"score_linear":131229.0,"score_lmetric":146920}],"chosen_score_linear":11113.0,"chosen_score_lmetric":30147,"t_first_token":387245.816585597,"t_first_token_unix":1779818110.8305302,"t_done":387246.11054137,"t_done_unix":1779818111.1244845},{"request_id":"1366128:9:1381799:652","session_id":"1366128","input_length":59374,"t_proxy_recv":387245.397545985,"t_decision_unix":1779818110.4114878,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9916798598713241,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":494,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":59374,"score_linear":148474.0,"score_lmetric":208936},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":59374,"score_linear":106608.0,"score_lmetric":270372},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":30147,"ongoing_decode_tokens":11113,"pending_prefill_tokens":19034,"num_requests":2,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":59374,"score_linear":30147.0,"score_lmetric":156816},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":59374,"score_linear":109974.0,"score_lmetric":193395},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":59374,"score_linear":217713.0,"score_lmetric":568605},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117035,"ongoing_decode_tokens":117035,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":58880,"new_prefill":494,"score_linear":58155.0,"score_lmetric":988},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":59374,"score_linear":47401.0,"score_lmetric":59374},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":176149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":59374,"score_linear":131229.0,"score_lmetric":118748}],"chosen_score_linear":58155.0,"chosen_score_lmetric":988,"t_first_token":387245.550878856,"t_first_token_unix":1779818110.5648222,"t_done":387246.327317593,"t_done_unix":1779818111.3412611},{"request_id":"1382086:1:1382086:654","session_id":"1382086","input_length":54012,"t_proxy_recv":387233.293958338,"t_decision_unix":1779818098.3078997,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":54012,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81585,"ongoing_decode_tokens":81585,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":0,"new_prefill":54012,"score_linear":81585.0,"score_lmetric":54012},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":54012,"score_linear":124993.0,"score_lmetric":108024},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":54012,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":54012,"score_linear":127563.0,"score_lmetric":259664},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":54012,"score_linear":167848.0,"score_lmetric":367944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":54012,"score_linear":162147.0,"score_lmetric":162180},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":54012,"score_linear":61390.0,"score_lmetric":147530},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":54012,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-23549.0,"chosen_score_lmetric":0,"t_first_token":387244.048436708,"t_first_token_unix":1779818109.06238,"t_done":387246.510726046,"t_done_unix":1779818111.5246694},{"request_id":"1364090:3:1381959:653","session_id":"1364090","input_length":47401,"t_proxy_recv":387232.777164494,"t_decision_unix":1779818097.7911057,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":27648,"affinity_cache_ratio":0.5832788337798781,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":19753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81585,"ongoing_decode_tokens":81585,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1326,"cache_hit":4096,"new_prefill":43305,"score_linear":77489.0,"score_lmetric":43305},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":7680,"new_prefill":39721,"score_linear":117313.0,"score_lmetric":79442},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":47401,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":7680,"new_prefill":39721,"score_linear":119883.0,"score_lmetric":202500},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":47401,"score_linear":167848.0,"score_lmetric":354722},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":126259,"pending_prefill_tokens":48,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":47401,"score_linear":162147.0,"score_lmetric":142347},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":27648,"new_prefill":19753,"score_linear":-13659.0,"score_lmetric":19753},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":7680,"new_prefill":39721,"score_linear":-31229.0,"score_lmetric":0}],"chosen_score_linear":-13659.0,"chosen_score_lmetric":19753,"t_first_token":387237.917061565,"t_first_token_unix":1779818102.9310048,"t_done":387247.17725227,"t_done_unix":1779818112.1911962},{"request_id":"1279412:28:1382526:657","session_id":"1279412","input_length":100766,"t_proxy_recv":387234.915186404,"t_decision_unix":1779818099.9291275,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":100352,"affinity_cache_ratio":0.9958914713296152,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":100352,"estimated_new_tokens":414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":81806,"ongoing_decode_tokens":81806,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1334,"cache_hit":12800,"new_prefill":87966,"score_linear":69006.0,"score_lmetric":87966},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1346,"cache_hit":0,"new_prefill":100766,"score_linear":63536.0,"score_lmetric":100766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":100766,"score_linear":38111.0,"score_lmetric":138877},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":12800,"new_prefill":87966,"score_linear":114763.0,"score_lmetric":395480},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":100766,"score_linear":167848.0,"score_lmetric":461452},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":115383,"pending_prefill_tokens":11919,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":12800,"new_prefill":87966,"score_linear":161094.0,"score_lmetric":299655},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":0,"new_prefill":100766,"score_linear":61390.0,"score_lmetric":241038},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30463,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54012,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":100352,"new_prefill":414,"score_linear":-69889.0,"score_lmetric":54426}],"chosen_score_linear":-69889.0,"chosen_score_lmetric":54426,"t_first_token":387244.053539797,"t_first_token_unix":1779818109.0674832,"t_done":387247.184316188,"t_done_unix":1779818112.1982598},{"request_id":"1366128:10:1382843:661","session_id":"1366128","input_length":59506,"t_proxy_recv":387246.339631715,"t_decision_unix":1779818111.353573,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":59392,"affinity_cache_ratio":0.9980842268006588,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":114,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":59506,"score_linear":148474.0,"score_lmetric":209200},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":59506,"score_linear":106608.0,"score_lmetric":270768},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1935,"cache_hit":0,"new_prefill":59506,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":59506,"score_linear":109974.0,"score_lmetric":193791},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":59506,"score_linear":217713.0,"score_lmetric":569001},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117035,"ongoing_decode_tokens":117035,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":59392,"new_prefill":114,"score_linear":57643.0,"score_lmetric":228},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":59506,"score_linear":47401.0,"score_lmetric":59506},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":176149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":59506,"score_linear":131229.0,"score_lmetric":119012}],"chosen_score_linear":57643.0,"chosen_score_lmetric":228,"t_first_token":387246.503503732,"t_first_token_unix":1779818111.5174475,"t_done":387247.517925351,"t_done_unix":1779818112.5318692},{"request_id":"1279412:29:1385688:685","session_id":"1279412","input_length":101200,"t_proxy_recv":387247.201358205,"t_decision_unix":1779818112.2152998,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":100864,"affinity_cache_ratio":0.9966798418972332,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":100864,"estimated_new_tokens":336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":12800,"new_prefill":88400,"score_linear":135674.0,"score_lmetric":266988},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":101200,"score_linear":106608.0,"score_lmetric":395850},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1935,"cache_hit":0,"new_prefill":101200,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":12800,"new_prefill":88400,"score_linear":97174.0,"score_lmetric":280473},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":101200,"score_linear":217713.0,"score_lmetric":694083},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":176541,"ongoing_decode_tokens":176541,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":12800,"new_prefill":88400,"score_linear":163741.0,"score_lmetric":265200},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":101200,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":100864,"new_prefill":336,"score_linear":-124413.0,"score_lmetric":0}],"chosen_score_linear":-124413.0,"chosen_score_lmetric":0,"t_first_token":387247.518911385,"t_first_token_unix":1779818112.5328548,"t_done":387248.403163282,"t_done_unix":1779818113.417107},{"request_id":"1336620:3:1339999:443","session_id":"1336620","input_length":21371,"t_proxy_recv":387094.268930895,"t_decision_unix":1779817959.2828724,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14848,"affinity_cache_ratio":0.6947732909082401,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":6523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":41267,"ongoing_decode_tokens":0,"pending_prefill_tokens":20275,"num_requests":2,"active_p_offloads":0,"cached_blocks":760,"cache_hit":4096,"new_prefill":17275,"score_linear":37171.0,"score_lmetric":75100},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":21371,"score_linear":62618.0,"score_lmetric":21371},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1209,"cache_hit":0,"new_prefill":21371,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":6180,"ongoing_decode_tokens":0,"pending_prefill_tokens":6180,"num_requests":1,"active_p_offloads":0,"cached_blocks":1255,"cache_hit":7680,"new_prefill":13691,"score_linear":-1500.0,"score_lmetric":19871},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":849,"cache_hit":0,"new_prefill":21371,"score_linear":48381.0,"score_lmetric":69752},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66152,"ongoing_decode_tokens":0,"pending_prefill_tokens":66152,"num_requests":1,"active_p_offloads":0,"cached_blocks":1036,"cache_hit":0,"new_prefill":21371,"score_linear":66152.0,"score_lmetric":87523},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37527,"ongoing_decode_tokens":0,"pending_prefill_tokens":13975,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":7680,"new_prefill":13691,"score_linear":29847.0,"score_lmetric":27666},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":112658,"ongoing_decode_tokens":157578,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1486,"cache_hit":14848,"new_prefill":6523,"score_linear":97810.0,"score_lmetric":13046}],"chosen_score_linear":97810.0,"chosen_score_lmetric":13046,"t_first_token":387095.26928335,"t_first_token_unix":1779817960.283227,"t_done":387250.933139449,"t_done_unix":1779818115.947083},{"request_id":"1381728:2:1387040:690","session_id":"1381728","input_length":12399,"t_proxy_recv":387250.315473108,"t_decision_unix":1779818115.3294144,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":1024,"affinity_cache_ratio":0.08258730542785708,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":11375,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":12399,"score_linear":148474.0,"score_lmetric":114986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":12399,"score_linear":106608.0,"score_lmetric":129447},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1935,"cache_hit":1024,"new_prefill":11375,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":12399,"score_linear":109974.0,"score_lmetric":52470},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":12399,"score_linear":217713.0,"score_lmetric":427680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":188289,"ongoing_decode_tokens":117035,"pending_prefill_tokens":11862,"num_requests":3,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":0,"new_prefill":12399,"score_linear":188289.0,"score_lmetric":72783},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":12399,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":12399,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":387251.272237207,"t_first_token_unix":1779818116.2861805,"t_done":387251.356951388,"t_done_unix":1779818116.3708944},{"request_id":"1279412:30:1387344:694","session_id":"1279412","input_length":101396,"t_proxy_recv":387251.446355103,"t_decision_unix":1779818116.4602964,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":100864,"affinity_cache_ratio":0.9947532447039331,"affinity_num_requests":-1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":100864,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":12800,"new_prefill":88596,"score_linear":135674.0,"score_lmetric":267380},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":101396,"score_linear":106608.0,"score_lmetric":396438},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":101396,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":12800,"new_prefill":88596,"score_linear":97174.0,"score_lmetric":281061},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":101396,"score_linear":217713.0,"score_lmetric":694671},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":188289,"ongoing_decode_tokens":117035,"pending_prefill_tokens":11862,"num_requests":3,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":12800,"new_prefill":88596,"score_linear":175489.0,"score_lmetric":301374},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":101396,"score_linear":50793.0,"score_lmetric":124029},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":100864,"new_prefill":532,"score_linear":-145784.0,"score_lmetric":-532}],"chosen_score_linear":-145784.0,"chosen_score_lmetric":-532,"t_first_token":387251.672343443,"t_first_token_unix":1779818116.6862872,"t_done":387252.458440537,"t_done_unix":1779818117.4723845},{"request_id":"1384772:1:1384772:677","session_id":"1384772","input_length":4690,"t_proxy_recv":387242.52737793,"t_decision_unix":1779818107.5413191,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4690,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":4690,"score_linear":148474.0,"score_lmetric":99568},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":4690,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":4690,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":4690,"score_linear":109974.0,"score_lmetric":29343},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":4690,"score_linear":217713.0,"score_lmetric":404553},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":174390,"ongoing_decode_tokens":174390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":4690,"score_linear":174390.0,"score_lmetric":14070},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":4690,"score_linear":75784.0,"score_lmetric":9380},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":4690,"score_linear":131229.0,"score_lmetric":118232}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387242.827671155,"t_first_token_unix":1779818107.8416145,"t_done":387254.46775957,"t_done_unix":1779818119.4817028},{"request_id":"1383090:2:1385262:682","session_id":"1383090","input_length":16734,"t_proxy_recv":387244.287477707,"t_decision_unix":1779818109.301419,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":9216,"affinity_cache_ratio":0.5507350304768734,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":7518,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":16734,"score_linear":148474.0,"score_lmetric":123656},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":9216,"new_prefill":7518,"score_linear":80658.0,"score_lmetric":61500},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":30147,"ongoing_decode_tokens":11113,"pending_prefill_tokens":19034,"num_requests":2,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":16734,"score_linear":30147.0,"score_lmetric":71536},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":16734,"score_linear":109974.0,"score_lmetric":65475},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":16734,"score_linear":217713.0,"score_lmetric":440685},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":176265,"ongoing_decode_tokens":95118,"pending_prefill_tokens":1275,"num_requests":3,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":0,"new_prefill":16734,"score_linear":176265.0,"score_lmetric":54027},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":16734,"score_linear":47401.0,"score_lmetric":16734},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":176149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":16734,"score_linear":131229.0,"score_lmetric":33468}],"chosen_score_linear":80658.0,"chosen_score_lmetric":61500,"t_first_token":387254.272383759,"t_first_token_unix":1779818119.2863271,"t_done":387254.772729306,"t_done_unix":1779818119.7866724},{"request_id":"1373577:2:1380740:647","session_id":"1373577","input_length":81147,"t_proxy_recv":387243.785542719,"t_decision_unix":1779818108.7994843,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9842877740397057,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":1275,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":81147,"score_linear":148474.0,"score_lmetric":252482},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":81147,"score_linear":89874.0,"score_lmetric":208758},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":30147,"ongoing_decode_tokens":0,"pending_prefill_tokens":30147,"num_requests":2,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":2560,"new_prefill":78587,"score_linear":27587.0,"score_lmetric":217468},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":81147,"score_linear":109974.0,"score_lmetric":258714},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":81147,"score_linear":217713.0,"score_lmetric":633924},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95118,"ongoing_decode_tokens":95118,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1633,"cache_hit":79872,"new_prefill":1275,"score_linear":15246.0,"score_lmetric":2550},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":81147,"score_linear":75784.0,"score_lmetric":162294},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":81147,"score_linear":131229.0,"score_lmetric":271146}],"chosen_score_linear":15246.0,"chosen_score_lmetric":2550,"t_first_token":387244.640232755,"t_first_token_unix":1779818109.6541772,"t_done":387255.008033335,"t_done_unix":1779818120.0219848},{"request_id":"1366128:11:1384044:671","session_id":"1366128","input_length":71254,"t_proxy_recv":387247.536209143,"t_decision_unix":1779818112.5501506,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":59392,"affinity_cache_ratio":0.8335251354309934,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":11862,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":71254,"score_linear":148474.0,"score_lmetric":232696},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":71254,"score_linear":106608.0,"score_lmetric":306012},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1935,"cache_hit":0,"new_prefill":71254,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":71254,"score_linear":109974.0,"score_lmetric":229035},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":71254,"score_linear":217713.0,"score_lmetric":604245},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117035,"ongoing_decode_tokens":117035,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":59392,"new_prefill":11862,"score_linear":57643.0,"score_lmetric":23724},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":71254,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77651,"ongoing_decode_tokens":122571,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":71254,"score_linear":77651.0,"score_lmetric":71254}],"chosen_score_linear":57643.0,"chosen_score_lmetric":23724,"t_first_token":387252.478207969,"t_first_token_unix":1779818117.4921515,"t_done":387255.121012212,"t_done_unix":1779818120.1349568},{"request_id":"1384772:2:1387335:693","session_id":"1384772","input_length":11530,"t_proxy_recv":387254.483435899,"t_decision_unix":1779818119.4973776,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.39965307892454466,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":-11530,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":11530,"score_linear":148474.0,"score_lmetric":113248},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":101918,"ongoing_decode_tokens":101918,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1398,"cache_hit":4608,"new_prefill":6922,"score_linear":97310.0,"score_lmetric":13844},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":11530,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":11530,"score_linear":109974.0,"score_lmetric":49863},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":11530,"score_linear":217713.0,"score_lmetric":49125},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":188289,"ongoing_decode_tokens":188289,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":0,"new_prefill":11530,"score_linear":188289.0,"score_lmetric":34590},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":11530,"score_linear":50793.0,"score_lmetric":34163},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":11530,"score_linear":-44920.0,"score_lmetric":-11530}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-11530,"t_first_token":387255.401904162,"t_first_token_unix":1779818120.4158478,"t_done":387255.459289409,"t_done_unix":1779818120.4732327},{"request_id":"1366128:12:1386045:687","session_id":"1366128","input_length":71578,"t_proxy_recv":387255.134873068,"t_decision_unix":1779818120.1488147,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9942719830115399,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":410,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":71578,"score_linear":148474.0,"score_lmetric":233344},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":71578,"score_linear":85184.0,"score_lmetric":71578},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":71578,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":71578,"score_linear":109974.0,"score_lmetric":230007},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":71578,"score_linear":217713.0,"score_lmetric":229269},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":71168,"new_prefill":410,"score_linear":-35280.0,"score_lmetric":410},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":71578,"score_linear":50793.0,"score_lmetric":94211},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-33390,"ongoing_decode_tokens":0,"pending_prefill_tokens":11530,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":71578,"score_linear":-33390.0,"score_lmetric":0}],"chosen_score_linear":-35280.0,"chosen_score_lmetric":410,"t_first_token":387255.373964583,"t_first_token_unix":1779818120.3879085,"t_done":387255.989414759,"t_done_unix":1779818121.0033584},{"request_id":"1366128:13:1387308:692","session_id":"1366128","input_length":71708,"t_proxy_recv":387256.002501262,"t_decision_unix":1779818121.0164423,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9924694594745356,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":71708,"score_linear":148474.0,"score_lmetric":233604},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":71708,"score_linear":85184.0,"score_lmetric":71708},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":71708,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":71708,"score_linear":109974.0,"score_lmetric":230397},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":71708,"score_linear":217713.0,"score_lmetric":229659},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":71168,"new_prefill":540,"score_linear":-35280.0,"score_lmetric":540},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":71708,"score_linear":50793.0,"score_lmetric":94341},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26979,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":71708,"score_linear":26979.0,"score_lmetric":0}],"chosen_score_linear":-35280.0,"chosen_score_lmetric":540,"t_first_token":387256.169783008,"t_first_token_unix":1779818121.1837263,"t_done":387256.664134741,"t_done_unix":1779818121.6780791},{"request_id":"1384947:2:1388842:700","session_id":"1384947","input_length":20183,"t_proxy_recv":387256.785344714,"t_decision_unix":1779818121.7992861,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9386117029182975,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":1239,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":20183,"score_linear":148474.0,"score_lmetric":130554},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":20183,"score_linear":85184.0,"score_lmetric":20183},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":18944,"new_prefill":1239,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":20183,"score_linear":109974.0,"score_lmetric":75822},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":20183,"score_linear":217713.0,"score_lmetric":75084},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":20183,"score_linear":35888.0,"score_lmetric":20183},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":50793,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":20183,"score_linear":50793.0,"score_lmetric":20183},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":20183,"score_linear":30657.0,"score_lmetric":95760}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":387257.024359175,"t_first_token_unix":1779818122.0383024,"t_done":387258.078536284,"t_done_unix":1779818123.0924795},{"request_id":"1381387:3:1387093:691","session_id":"1381387","input_length":50793,"t_proxy_recv":387250.529480798,"t_decision_unix":1779818115.5434225,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28160,"affinity_cache_ratio":0.5544071033410115,"affinity_num_requests":0,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":22633,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":50793,"score_linear":148474.0,"score_lmetric":191774},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106608,"ongoing_decode_tokens":4690,"pending_prefill_tokens":30750,"num_requests":3,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":50793,"score_linear":106608.0,"score_lmetric":244629},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":12399,"ongoing_decode_tokens":0,"pending_prefill_tokens":11375,"num_requests":1,"active_p_offloads":0,"cached_blocks":1935,"cache_hit":0,"new_prefill":50793,"score_linear":12399.0,"score_lmetric":62168},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":50793,"score_linear":109974.0,"score_lmetric":167652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":50793,"score_linear":217713.0,"score_lmetric":542862},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":188289,"ongoing_decode_tokens":117035,"pending_prefill_tokens":11862,"num_requests":3,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":0,"new_prefill":50793,"score_linear":188289.0,"score_lmetric":187965},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":28160,"new_prefill":22633,"score_linear":-28160.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":50793,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":387256.555617872,"t_first_token_unix":1779818121.5695615,"t_done":387258.57418006,"t_done_unix":1779818123.5881236},{"request_id":"1342921:3:1384020:670","session_id":"1342921","input_length":69465,"t_proxy_recv":387239.956830198,"t_decision_unix":1779818104.9707718,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":66048,"affinity_cache_ratio":0.950809760310948,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":66048,"estimated_new_tokens":3417,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":127253,"ongoing_decode_tokens":20948,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":69465,"score_linear":127253.0,"score_lmetric":114330},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1387,"cache_hit":0,"new_prefill":69465,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":69465,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":66048,"new_prefill":3417,"score_linear":-50765.0,"score_lmetric":3417},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":69465,"score_linear":167848.0,"score_lmetric":398850},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":69465,"score_linear":173894.0,"score_lmetric":208395},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":47401,"pending_prefill_tokens":14559,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":69465,"score_linear":75784.0,"score_lmetric":168048},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":69465,"score_linear":131229.0,"score_lmetric":247782}],"chosen_score_linear":-50765.0,"chosen_score_lmetric":3417,"t_first_token":387256.959047789,"t_first_token_unix":1779818121.972991,"t_done":387258.825702285,"t_done_unix":1779818123.8396456},{"request_id":"1370129:4:1384856:678","session_id":"1370129","input_length":85184,"t_proxy_recv":387242.804208358,"t_decision_unix":1779818107.818149,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":61952,"affinity_cache_ratio":0.7272727272727273,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":23232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":4096,"new_prefill":81088,"score_linear":144378.0,"score_lmetric":252364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":4690,"ongoing_decode_tokens":0,"pending_prefill_tokens":4690,"num_requests":1,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":61952,"new_prefill":23232,"score_linear":-57262.0,"score_lmetric":27922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":85184,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":7680,"new_prefill":77504,"score_linear":102294.0,"score_lmetric":247785},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":0,"pending_prefill_tokens":130161,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":85184,"score_linear":217713.0,"score_lmetric":646035},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":174390,"ongoing_decode_tokens":174390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":85184,"score_linear":174390.0,"score_lmetric":255552},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":7680,"new_prefill":77504,"score_linear":68104.0,"score_lmetric":155008},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":7680,"new_prefill":77504,"score_linear":123549.0,"score_lmetric":263860}],"chosen_score_linear":-57262.0,"chosen_score_lmetric":27922,"t_first_token":387253.558855804,"t_first_token_unix":1779818118.5727992,"t_done":387259.952806814,"t_done_unix":1779818124.9667506},{"request_id":"1355484:10:1384484:675","session_id":"1355484","input_length":25226,"t_proxy_recv":387241.674103759,"t_decision_unix":1779818106.688045,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9336398953460715,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":1674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":12800,"new_prefill":12426,"score_linear":135674.0,"score_lmetric":115040},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":25226,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":5989,"ongoing_decode_tokens":5989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":25226,"score_linear":5989.0,"score_lmetric":25226},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84748,"ongoing_decode_tokens":15283,"pending_prefill_tokens":3417,"num_requests":2,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":23552,"new_prefill":1674,"score_linear":61196.0,"score_lmetric":10182},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":25226,"score_linear":167848.0,"score_lmetric":310372},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":174390,"ongoing_decode_tokens":174390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":12800,"new_prefill":12426,"score_linear":161590.0,"score_lmetric":37278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":25226,"score_linear":75784.0,"score_lmetric":50452},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":12800,"new_prefill":12426,"score_linear":118429.0,"score_lmetric":133704}],"chosen_score_linear":61196.0,"chosen_score_lmetric":10182,"t_first_token":387256.960282154,"t_first_token_unix":1779818121.9742248,"t_done":387260.917848593,"t_done_unix":1779818125.9317918},{"request_id":"1390240:1:1390240:705","session_id":"1390240","input_length":5110,"t_proxy_recv":387261.961503164,"t_decision_unix":1779818126.9754446,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5110,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45448,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":5110,"score_linear":186716.0,"score_lmetric":151674},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":68187,"ongoing_decode_tokens":0,"pending_prefill_tokens":3163,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":5110,"score_linear":68187.0,"score_lmetric":8273},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1959,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":113110,"ongoing_decode_tokens":113110,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":5110,"score_linear":113110.0,"score_lmetric":15330},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":5110,"score_linear":217713.0,"score_lmetric":29865},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":5110,"score_linear":119292.0,"score_lmetric":33668},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":5110,"score_linear":30657.0,"score_lmetric":80687}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387262.295688393,"t_first_token_unix":1779818127.309632,"t_done":387262.566652628,"t_done_unix":1779818127.580596},{"request_id":"1342921:4:1389290:702","session_id":"1342921","input_length":70990,"t_proxy_recv":387258.839158249,"t_decision_unix":1779818123.8530998,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9736582617270038,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":1870,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":70990,"score_linear":148474.0,"score_lmetric":232168},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":70990,"score_linear":85184.0,"score_lmetric":70990},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1959,"cache_hit":0,"new_prefill":70990,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40509,"ongoing_decode_tokens":40509,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1887,"cache_hit":69120,"new_prefill":1870,"score_linear":-28611.0,"score_lmetric":3740},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":70990,"score_linear":217713.0,"score_lmetric":227505},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":70990,"score_linear":119292.0,"score_lmetric":165428},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":0,"new_prefill":70990,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":70990,"score_linear":30657.0,"score_lmetric":146567}],"chosen_score_linear":-28611.0,"chosen_score_lmetric":3740,"t_first_token":387259.636521288,"t_first_token_unix":1779818124.6504648,"t_done":387263.349135001,"t_done_unix":1779818128.3630793},{"request_id":"1355484:11:1388276:696","session_id":"1355484","input_length":26837,"t_proxy_recv":387260.926807045,"t_decision_unix":1779818125.9407485,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9348287811603383,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45448,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":12800,"new_prefill":14037,"score_linear":173916.0,"score_lmetric":178455},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":26837,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1959,"cache_hit":0,"new_prefill":26837,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":86273,"ongoing_decode_tokens":86273,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":25088,"new_prefill":1749,"score_linear":61185.0,"score_lmetric":3498},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":26837,"score_linear":217713.0,"score_lmetric":95046},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":12800,"new_prefill":14037,"score_linear":106492.0,"score_lmetric":51522},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":0,"new_prefill":26837,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":12800,"new_prefill":14037,"score_linear":17857.0,"score_lmetric":89614}],"chosen_score_linear":61185.0,"chosen_score_lmetric":3498,"t_first_token":387261.278336529,"t_first_token_unix":1779818126.2922804,"t_done":387263.353412664,"t_done_unix":1779818128.3673563},{"request_id":"1390356:1:1390356:706","session_id":"1390356","input_length":1349,"t_proxy_recv":387262.408885547,"t_decision_unix":1779818127.4228268,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1349,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45448,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":1349,"score_linear":186716.0,"score_lmetric":140391},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":68187,"ongoing_decode_tokens":0,"pending_prefill_tokens":3163,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":1349,"score_linear":68187.0,"score_lmetric":4512},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":5110,"ongoing_decode_tokens":5110,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1959,"cache_hit":0,"new_prefill":1349,"score_linear":5110.0,"score_lmetric":1349},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":113110,"ongoing_decode_tokens":113110,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":1349,"score_linear":113110.0,"score_lmetric":4047},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":167848,"pending_prefill_tokens":201,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":1349,"score_linear":217713.0,"score_lmetric":4650},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":1349,"score_linear":119292.0,"score_lmetric":26146},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":0,"new_prefill":1349,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":1349,"score_linear":30657.0,"score_lmetric":76926}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387262.510830549,"t_first_token_unix":1779818127.5247746,"t_done":387264.157094614,"t_done_unix":1779818129.1710384},{"request_id":"1366128:14:1389156:701","session_id":"1366128","input_length":83404,"t_proxy_recv":387258.015743466,"t_decision_unix":1779818123.0296845,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.8594312023404154,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":11724,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":83404,"score_linear":148474.0,"score_lmetric":256996},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":83404,"score_linear":85184.0,"score_lmetric":83404},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":20183,"ongoing_decode_tokens":20183,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":83404,"score_linear":20183.0,"score_lmetric":83404},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":109974,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":83404,"score_linear":109974.0,"score_lmetric":250212},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":83404,"score_linear":217713.0,"score_lmetric":264747},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":71680,"new_prefill":11724,"score_linear":-35792.0,"score_lmetric":11724},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":50793,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":83404,"score_linear":50793.0,"score_lmetric":83404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":83404,"score_linear":30657.0,"score_lmetric":158981}],"chosen_score_linear":-35792.0,"chosen_score_lmetric":11724,"t_first_token":387263.772391973,"t_first_token_unix":1779818128.7863362,"t_done":387264.940623288,"t_done_unix":1779818129.9545672},{"request_id":"1384947:3:1390898:710","session_id":"1384947","input_length":20683,"t_proxy_recv":387264.61236854,"t_decision_unix":1779818129.6263096,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9654305468258957,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":715,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":127253,"pending_prefill_tokens":583,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":20683,"score_linear":186716.0,"score_lmetric":63798},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":20683,"score_linear":155874.0,"score_lmetric":41366},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":19968,"new_prefill":715,"score_linear":-19968.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":20683,"score_linear":15283.0,"score_lmetric":20683},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":217713,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":20683,"score_linear":217713.0,"score_lmetric":62049},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":119292,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":20683,"score_linear":119292.0,"score_lmetric":41366},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":20683,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":20683,"score_linear":30657.0,"score_lmetric":96260}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":387264.750336883,"t_first_token_unix":1779818129.76428,"t_done":387265.918532343,"t_done_unix":1779818130.9324758},{"request_id":"1366128:15:1390663:709","session_id":"1366128","input_length":83622,"t_proxy_recv":387264.953921615,"t_decision_unix":1779818129.9678628,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9980148764679151,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":127253,"pending_prefill_tokens":583,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":83622,"score_linear":186716.0,"score_lmetric":252615},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":83622,"score_linear":155874.0,"score_lmetric":167244},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":20683,"ongoing_decode_tokens":20683,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":83622,"score_linear":20683.0,"score_lmetric":83622},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":83622,"score_linear":15283.0,"score_lmetric":83622},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":217713,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":83622,"score_linear":217713.0,"score_lmetric":250866},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":83456,"new_prefill":166,"score_linear":-47568.0,"score_lmetric":166},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":83622,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":83622,"score_linear":30657.0,"score_lmetric":159199}],"chosen_score_linear":-47568.0,"chosen_score_lmetric":166,"t_first_token":387265.182361762,"t_first_token_unix":1779818130.196306,"t_done":387266.527638416,"t_done_unix":1779818131.541582},{"request_id":"1355951:4:1389858:703","session_id":"1355951","input_length":38242,"t_proxy_recv":387260.56709175,"t_decision_unix":1779818125.5810332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9907431619685163,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":37888,"new_prefill":354,"score_linear":110586.0,"score_lmetric":90896},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":38242,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1959,"cache_hit":34816,"new_prefill":3426,"score_linear":-34816.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":111499,"ongoing_decode_tokens":111499,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1887,"cache_hit":0,"new_prefill":38242,"score_linear":111499.0,"score_lmetric":114726},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":38242,"score_linear":217713.0,"score_lmetric":129261},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":38242,"score_linear":119292.0,"score_lmetric":99932},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":0,"new_prefill":38242,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":38242,"score_linear":30657.0,"score_lmetric":113819}],"chosen_score_linear":110586.0,"chosen_score_lmetric":90896,"t_first_token":387265.6598961,"t_first_token_unix":1779818130.6738398,"t_done":387266.676342991,"t_done_unix":1779818131.6902866},{"request_id":"1340278:3:1384549:676","session_id":"1340278","input_length":49865,"t_proxy_recv":387241.815660249,"t_decision_unix":1779818106.8296018,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9959691166148601,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":201,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":49865,"score_linear":148474.0,"score_lmetric":189918},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":49865,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1877,"cache_hit":0,"new_prefill":49865,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":49865,"score_linear":109974.0,"score_lmetric":164868},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":49664,"new_prefill":201,"score_linear":118184.0,"score_lmetric":260322},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":174390,"ongoing_decode_tokens":174390,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1476,"cache_hit":0,"new_prefill":49865,"score_linear":174390.0,"score_lmetric":149595},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":75784,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":49865,"score_linear":75784.0,"score_lmetric":99730},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":49865,"score_linear":131229.0,"score_lmetric":208582}],"chosen_score_linear":118184.0,"chosen_score_lmetric":260322,"t_first_token":387263.508145883,"t_first_token_unix":1779818128.5220902,"t_done":387267.177172175,"t_done_unix":1779818132.1911163},{"request_id":"1340278:3:1385417:683","session_id":"1340278","input_length":50272,"t_proxy_recv":387267.203423786,"t_decision_unix":1779818132.2173653,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9879057924888606,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":608,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":148474,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":50272,"score_linear":148474.0,"score_lmetric":100544},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":50272,"score_linear":155874.0,"score_lmetric":100544},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":15302,"ongoing_decode_tokens":0,"pending_prefill_tokens":15302,"num_requests":1,"active_p_offloads":0,"cached_blocks":1970,"cache_hit":0,"new_prefill":50272,"score_linear":15302.0,"score_lmetric":65574},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":50272,"score_linear":15283.0,"score_lmetric":50272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":167848,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":49664,"new_prefill":608,"score_linear":118184.0,"score_lmetric":1216},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":50272,"score_linear":35888.0,"score_lmetric":50272},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":28307,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":50272,"score_linear":28307.0,"score_lmetric":78579},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":50272,"score_linear":132650.0,"score_lmetric":252932}],"chosen_score_linear":118184.0,"chosen_score_lmetric":1216,"t_first_token":387267.481446773,"t_first_token_unix":1779818132.49539,"t_done":387267.54587431,"t_done_unix":1779818132.559818},{"request_id":"1391584:1:1391584:713","session_id":"1391584","input_length":15302,"t_proxy_recv":387266.482404879,"t_decision_unix":1779818131.4963458,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":15302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":186716,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":15302,"score_linear":186716.0,"score_lmetric":45906},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":15302,"score_linear":155874.0,"score_lmetric":30604},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1970,"cache_hit":0,"new_prefill":15302,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":15302,"score_linear":15283.0,"score_lmetric":15302},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":217713,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":15302,"score_linear":217713.0,"score_lmetric":45906},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119510,"ongoing_decode_tokens":119510,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":15302,"score_linear":119510.0,"score_lmetric":30604},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":28307,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":15302,"score_linear":28307.0,"score_lmetric":43609},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":15302,"score_linear":132650.0,"score_lmetric":182992}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387267.858367801,"t_first_token_unix":1779818132.8723114,"t_done":387268.070779757,"t_done_unix":1779818133.084723},{"request_id":"1268861:7:1374579:614","session_id":"1268861","input_length":41508,"t_proxy_recv":387207.156600987,"t_decision_unix":1779818072.1705422,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":36864,"affinity_cache_ratio":0.8881179531656548,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":4644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":2,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":41508,"score_linear":124578.0,"score_lmetric":174476},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":41508,"score_linear":119822.0,"score_lmetric":159844},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":132609,"ongoing_decode_tokens":132609,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":41508,"score_linear":132609.0,"score_lmetric":83016},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41489,"ongoing_decode_tokens":22992,"pending_prefill_tokens":18497,"num_requests":2,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":41508,"score_linear":41489.0,"score_lmetric":120010},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":125316,"num_requests":1,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":36864,"new_prefill":4644,"score_linear":89476.0,"score_lmetric":129960},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":41508,"score_linear":126259.0,"score_lmetric":265902},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":41508,"score_linear":106951.0,"score_lmetric":83016},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":119638,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":41508,"score_linear":94580.0,"score_lmetric":122740}],"chosen_score_linear":89476.0,"chosen_score_lmetric":129960,"t_first_token":387262.332827748,"t_first_token_unix":1779818127.3467715,"t_done":387268.351303332,"t_done_unix":1779818133.365247},{"request_id":"1313181:6:1324908:369","session_id":"1313181","input_length":106305,"t_proxy_recv":387239.848322056,"t_decision_unix":1779818104.8622634,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":61440,"affinity_cache_ratio":0.5779596444193594,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":44865,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":61440,"new_prefill":44865,"score_linear":-40492.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1387,"cache_hit":0,"new_prefill":106305,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":106305,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":12800,"new_prefill":93505,"score_linear":2483.0,"score_lmetric":93505},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":106305,"score_linear":167848.0,"score_lmetric":472530},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":24064,"new_prefill":82241,"score_linear":149830.0,"score_lmetric":246723},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":47401,"pending_prefill_tokens":14559,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":106305,"score_linear":75784.0,"score_lmetric":241728},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":12800,"new_prefill":93505,"score_linear":118429.0,"score_lmetric":295862}],"chosen_score_linear":-40492.0,"chosen_score_lmetric":0,"t_first_token":387263.545386678,"t_first_token_unix":1779818128.5593305,"t_done":387268.673986113,"t_done_unix":1779818133.6879299},{"request_id":"1340290:3:1384149:672","session_id":"1340290","input_length":21221,"t_proxy_recv":387240.522562988,"t_decision_unix":1779818105.536504,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9892088026011969,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":229,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":127253,"ongoing_decode_tokens":20948,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":20992,"new_prefill":229,"score_linear":106261.0,"score_lmetric":45094},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1387,"cache_hit":0,"new_prefill":21221,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":21221,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84748,"ongoing_decode_tokens":15283,"pending_prefill_tokens":3417,"num_requests":2,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":21221,"score_linear":84748.0,"score_lmetric":49276},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":21221,"score_linear":167848.0,"score_lmetric":302362},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":173894,"ongoing_decode_tokens":173894,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":21221,"score_linear":173894.0,"score_lmetric":63663},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75784,"ongoing_decode_tokens":47401,"pending_prefill_tokens":14559,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":1024,"new_prefill":20197,"score_linear":74760.0,"score_lmetric":69512},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":131229,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54426,"num_requests":2,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":21221,"score_linear":131229.0,"score_lmetric":151294}],"chosen_score_linear":106261.0,"chosen_score_lmetric":45094,"t_first_token":387265.65611087,"t_first_token_unix":1779818130.670055,"t_done":387268.838398163,"t_done_unix":1779818133.8523412},{"request_id":"1363093:4:1390050:704","session_id":"1363093","input_length":68187,"t_proxy_recv":387261.197975764,"t_decision_unix":1779818126.2119167,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9536128587560678,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":3163,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45448,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":68187,"score_linear":186716.0,"score_lmetric":340905},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":65024,"new_prefill":3163,"score_linear":-65024.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1959,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":113110,"ongoing_decode_tokens":86273,"pending_prefill_tokens":1749,"num_requests":3,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":68187,"score_linear":113110.0,"score_lmetric":209808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":68187,"score_linear":217713.0,"score_lmetric":219096},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":68187,"score_linear":119292.0,"score_lmetric":159822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":68187,"score_linear":30657.0,"score_lmetric":143764}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":387262.456584889,"t_first_token_unix":1779818127.4705288,"t_done":387269.372737531,"t_done_unix":1779818134.386681},{"request_id":"1355484:12:1391879:714","session_id":"1355484","input_length":28382,"t_proxy_recv":387267.613069405,"t_decision_unix":1779818132.627011,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9380593333803114,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":1758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":148474,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":12800,"new_prefill":15582,"score_linear":135674.0,"score_lmetric":31164},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":28382,"score_linear":155874.0,"score_lmetric":56764},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":15302,"ongoing_decode_tokens":0,"pending_prefill_tokens":15302,"num_requests":1,"active_p_offloads":0,"cached_blocks":1970,"cache_hit":0,"new_prefill":28382,"score_linear":15302.0,"score_lmetric":43684},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":26624,"new_prefill":1758,"score_linear":-11341.0,"score_lmetric":1758},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":167848,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":28382,"score_linear":167848.0,"score_lmetric":56764},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":12800,"new_prefill":15582,"score_linear":23088.0,"score_lmetric":15582},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":28307,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":28382,"score_linear":28307.0,"score_lmetric":56689},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":12800,"new_prefill":15582,"score_linear":119850.0,"score_lmetric":183552}],"chosen_score_linear":-11341.0,"chosen_score_lmetric":1758,"t_first_token":387267.973558985,"t_first_token_unix":1779818132.987502,"t_done":387269.962359181,"t_done_unix":1779818134.9763026},{"request_id":"1370129:5:1390477:708","session_id":"1370129","input_length":87687,"t_proxy_recv":387262.934804009,"t_decision_unix":1779818127.9487448,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9751046335260642,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":2183,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45448,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":4096,"new_prefill":83591,"score_linear":182620.0,"score_lmetric":387117},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":68187,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":85504,"new_prefill":2183,"score_linear":-17317.0,"score_lmetric":2183},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":87687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":113110,"ongoing_decode_tokens":113110,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":7680,"new_prefill":80007,"score_linear":105430.0,"score_lmetric":240021},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":167848,"pending_prefill_tokens":201,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":87687,"score_linear":217713.0,"score_lmetric":263664},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119292,"ongoing_decode_tokens":35888,"pending_prefill_tokens":11724,"num_requests":2,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":87687,"score_linear":119292.0,"score_lmetric":198822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":1349,"ongoing_decode_tokens":1349,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1508,"cache_hit":7680,"new_prefill":80007,"score_linear":-6331.0,"score_lmetric":80007},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":7680,"new_prefill":80007,"score_linear":22977.0,"score_lmetric":155584}],"chosen_score_linear":-17317.0,"chosen_score_lmetric":2183,"t_first_token":387264.187735316,"t_first_token_unix":1779818129.201679,"t_done":387270.214185553,"t_done_unix":1779818135.228132},{"request_id":"1391584:2:1392466:715","session_id":"1391584","input_length":15483,"t_proxy_recv":387269.793811711,"t_decision_unix":1779818134.8077526,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.958987276367629,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":635,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108637,"ongoing_decode_tokens":108637,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":15483,"score_linear":108637.0,"score_lmetric":30966},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1465,"cache_hit":0,"new_prefill":15483,"score_linear":87687.0,"score_lmetric":15483},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":14848,"new_prefill":635,"score_linear":-14848.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43665,"ongoing_decode_tokens":43665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":15483,"score_linear":43665.0,"score_lmetric":30966},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":15483,"score_linear":126340.0,"score_lmetric":15483},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":15483,"score_linear":35888.0,"score_lmetric":15483},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":28307,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":15483,"score_linear":28307.0,"score_lmetric":15483},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":15483,"score_linear":132650.0,"score_lmetric":183354}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":387269.871337985,"t_first_token_unix":1779818134.8852813,"t_done":387270.255510517,"t_done_unix":1779818135.2694538},{"request_id":"1340290:4:1385568:684","session_id":"1340290","input_length":26146,"t_proxy_recv":387268.84682281,"t_decision_unix":1779818133.8607643,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":20992,"affinity_cache_ratio":0.8028761569647365,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":5154,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82491,"ongoing_decode_tokens":82491,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":20992,"new_prefill":5154,"score_linear":61499.0,"score_lmetric":5154},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":26146,"score_linear":155874.0,"score_lmetric":52292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":26146,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43665,"ongoing_decode_tokens":43665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":26146,"score_linear":43665.0,"score_lmetric":52292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":26146,"score_linear":126340.0,"score_lmetric":26146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":26146,"score_linear":35888.0,"score_lmetric":26146},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":28307,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":1024,"new_prefill":25122,"score_linear":27283.0,"score_lmetric":53429},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":26146,"score_linear":132650.0,"score_lmetric":204680}],"chosen_score_linear":61499.0,"chosen_score_lmetric":5154,"t_first_token":387269.773665645,"t_first_token_unix":1779818134.7876096,"t_done":387270.464127852,"t_done_unix":1779818135.4780715},{"request_id":"1391404:1:1391404:712","session_id":"1391404","input_length":28307,"t_proxy_recv":387265.960164763,"t_decision_unix":1779818130.9741063,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":28307,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":186716,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":2560,"new_prefill":25747,"score_linear":184156.0,"score_lmetric":77241},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":28307,"score_linear":155874.0,"score_lmetric":56614},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1970,"cache_hit":0,"new_prefill":28307,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":0,"new_prefill":28307,"score_linear":15283.0,"score_lmetric":28307},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":217713,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":28307,"score_linear":217713.0,"score_lmetric":84921},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119510,"ongoing_decode_tokens":119510,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":28307,"score_linear":119510.0,"score_lmetric":56614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":28307,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":28307,"score_linear":132650.0,"score_lmetric":209002}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387269.52105994,"t_first_token_unix":1779818134.5350037,"t_done":387270.82695912,"t_done_unix":1779818135.8409026},{"request_id":"1340290:5:1386504:688","session_id":"1340290","input_length":27220,"t_proxy_recv":387270.474038867,"t_decision_unix":1779818135.4879806,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9592946362968405,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82491,"ongoing_decode_tokens":82491,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":26112,"new_prefill":1108,"score_linear":56379.0,"score_lmetric":1108},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":27220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2000,"cache_hit":0,"new_prefill":27220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":27220,"score_linear":15283.0,"score_lmetric":27220},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":27220,"score_linear":126340.0,"score_lmetric":27220},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":27220,"score_linear":35888.0,"score_lmetric":27220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":28307,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":1024,"new_prefill":26196,"score_linear":27283.0,"score_lmetric":26196},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":27220,"score_linear":132650.0,"score_lmetric":206828}],"chosen_score_linear":56379.0,"chosen_score_lmetric":1108,"t_first_token":387270.767175522,"t_first_token_unix":1779818135.7811198,"t_done":387271.222167523,"t_done_unix":1779818136.236111},{"request_id":"1390240:2:1392954:717","session_id":"1390240","input_length":7440,"t_proxy_recv":387271.508746586,"t_decision_unix":1779818136.522688,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":5120,"affinity_cache_ratio":0.6881720430107527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":2320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":109776,"ongoing_decode_tokens":109776,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1361,"cache_hit":0,"new_prefill":7440,"score_linear":109776.0,"score_lmetric":14880},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2000,"cache_hit":5120,"new_prefill":2320,"score_linear":-5120.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":7440,"score_linear":15283.0,"score_lmetric":7440},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":7440,"score_linear":126340.0,"score_lmetric":7440},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120785,"ongoing_decode_tokens":120785,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":7440,"score_linear":120785.0,"score_lmetric":14880},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":7440,"score_linear":132650.0,"score_lmetric":167268}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":387271.737338741,"t_first_token_unix":1779818136.7512822,"t_done":387271.959100004,"t_done_unix":1779818136.973043},{"request_id":"1373431:1:1373431:606","session_id":"1373431","input_length":126340,"t_proxy_recv":387203.13888472,"t_decision_unix":1779818068.1528256,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":125316,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":105902,"ongoing_decode_tokens":0,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":126340,"score_linear":105902.0,"score_lmetric":171826},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":126340,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":197140,"ongoing_decode_tokens":0,"pending_prefill_tokens":124948,"num_requests":3,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":126340,"score_linear":197140.0,"score_lmetric":753864},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":58058,"ongoing_decode_tokens":58058,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":0,"new_prefill":126340,"score_linear":58058.0,"score_lmetric":252680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":1024,"new_prefill":125316,"score_linear":-1024.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":126340,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":195371,"ongoing_decode_tokens":153165,"pending_prefill_tokens":14558,"num_requests":4,"active_p_offloads":0,"cached_blocks":1193,"cache_hit":0,"new_prefill":126340,"score_linear":195371.0,"score_lmetric":563592},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74718,"ongoing_decode_tokens":119638,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":126340,"score_linear":74718.0,"score_lmetric":126340}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":387254.453439955,"t_first_token_unix":1779818119.4673834,"t_done":387272.163362262,"t_done_unix":1779818137.1773057},{"request_id":"1340290:6:1387365:695","session_id":"1340290","input_length":27285,"t_proxy_recv":387271.228376961,"t_decision_unix":1779818136.2423182,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9945391240608393,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":149,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82491,"ongoing_decode_tokens":82491,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1361,"cache_hit":27136,"new_prefill":149,"score_linear":55355.0,"score_lmetric":149},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":27285,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2000,"cache_hit":0,"new_prefill":27285,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":27285,"score_linear":15283.0,"score_lmetric":27285},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":27285,"score_linear":126340.0,"score_lmetric":27285},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120785,"ongoing_decode_tokens":35888,"pending_prefill_tokens":1441,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":27285,"score_linear":120785.0,"score_lmetric":57452},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":1024,"new_prefill":26261,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":27285,"score_linear":132650.0,"score_lmetric":206958}],"chosen_score_linear":55355.0,"chosen_score_lmetric":149,"t_first_token":387271.305623289,"t_first_token_unix":1779818136.3195672,"t_done":387273.585446258,"t_done_unix":1779818138.59939},{"request_id":"1301929:2:1375154:617","session_id":"1301929","input_length":35888,"t_proxy_recv":387209.143770859,"t_decision_unix":1779818074.1577122,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35840,"affinity_cache_ratio":0.9986625055728935,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":48,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":124578,"ongoing_decode_tokens":0,"pending_prefill_tokens":45730,"num_requests":1,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":3584,"new_prefill":32304,"score_linear":120994.0,"score_lmetric":78034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":119822,"ongoing_decode_tokens":0,"pending_prefill_tokens":38414,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":35888,"score_linear":119822.0,"score_lmetric":148604},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1465,"cache_hit":0,"new_prefill":35888,"score_linear":117888.0,"score_lmetric":35888},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":22992,"ongoing_decode_tokens":22992,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1786,"cache_hit":0,"new_prefill":35888,"score_linear":22992.0,"score_lmetric":35888},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":35888,"score_linear":167848.0,"score_lmetric":331696},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126259,"ongoing_decode_tokens":0,"pending_prefill_tokens":91443,"num_requests":2,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":35840,"new_prefill":48,"score_linear":90419.0,"score_lmetric":182982},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":106951,"ongoing_decode_tokens":106951,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":35888,"score_linear":106951.0,"score_lmetric":71776},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94580,"ongoing_decode_tokens":139500,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1553,"cache_hit":0,"new_prefill":35888,"score_linear":94580.0,"score_lmetric":71776}],"chosen_score_linear":90419.0,"chosen_score_lmetric":182982,"t_first_token":387233.376228631,"t_first_token_unix":1779818098.3901722,"t_done":387273.833510014,"t_done_unix":1779818138.8474534},{"request_id":"1366128:16:1392704:716","session_id":"1366128","input_length":84897,"t_proxy_recv":387270.693288683,"t_decision_unix":1779818135.70723,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9830264909242965,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":1441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":109711,"ongoing_decode_tokens":82491,"pending_prefill_tokens":1108,"num_requests":2,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":84897,"score_linear":109711.0,"score_lmetric":172010},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":84897,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2000,"cache_hit":0,"new_prefill":84897,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":84897,"score_linear":15283.0,"score_lmetric":84897},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":84897,"score_linear":126340.0,"score_lmetric":84897},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":83456,"new_prefill":1441,"score_linear":-47568.0,"score_lmetric":1441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":28307,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":84897,"score_linear":28307.0,"score_lmetric":84897},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":84897,"score_linear":132650.0,"score_lmetric":322182}],"chosen_score_linear":-47568.0,"chosen_score_lmetric":1441,"t_first_token":387271.44357283,"t_first_token_unix":1779818136.4575176,"t_done":387273.860651841,"t_done_unix":1779818138.8745956},{"request_id":"1382804:2:1388620:698","session_id":"1382804","input_length":3678,"t_proxy_recv":387256.03650547,"t_decision_unix":1779818121.0504467,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":7,"affinity_cache_hit":512,"affinity_cache_ratio":0.13920609026644915,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3678,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":3678,"score_linear":148474.0,"score_lmetric":97544},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":512,"new_prefill":3166,"score_linear":84672.0,"score_lmetric":3166},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":3678,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":3678,"score_linear":109974.0,"score_lmetric":26307},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":3678,"score_linear":217713.0,"score_lmetric":25569},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":107596,"ongoing_decode_tokens":35888,"pending_prefill_tokens":540,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":3678,"score_linear":107596.0,"score_lmetric":8436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":3678,"score_linear":50793.0,"score_lmetric":26311},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26979,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":3678,"score_linear":26979.0,"score_lmetric":0}],"chosen_score_linear":26979.0,"chosen_score_lmetric":0,"t_first_token":387273.837050864,"t_first_token_unix":1779818138.8509939,"t_done":387273.98927215,"t_done_unix":1779818139.0032153},{"request_id":"1363943:8:1379215:635","session_id":"1363943","input_length":20948,"t_proxy_recv":387233.651620056,"t_decision_unix":1779818098.6655617,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":20480,"affinity_cache_ratio":0.97765896505633,"affinity_num_requests":0,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":468,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":60858,"ongoing_decode_tokens":60858,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":20480,"new_prefill":468,"score_linear":40378.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":124993,"ongoing_decode_tokens":124993,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":4096,"new_prefill":16852,"score_linear":120897.0,"score_lmetric":33704},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":20948,"score_linear":38111.0,"score_lmetric":59059},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":127563,"ongoing_decode_tokens":15283,"pending_prefill_tokens":10904,"num_requests":4,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":4096,"new_prefill":16852,"score_linear":123467.0,"score_lmetric":111024},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":20948,"score_linear":167848.0,"score_lmetric":301816},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":162147,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":20948,"score_linear":162147.0,"score_lmetric":62844},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61390,"ongoing_decode_tokens":13989,"pending_prefill_tokens":19753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1369,"cache_hit":4096,"new_prefill":16852,"score_linear":57294.0,"score_lmetric":73210},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30463,"ongoing_decode_tokens":21371,"pending_prefill_tokens":54012,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":4096,"new_prefill":16852,"score_linear":26367.0,"score_lmetric":70864}],"chosen_score_linear":40378.0,"chosen_score_lmetric":0,"t_first_token":387233.715899886,"t_first_token_unix":1779818098.7298431,"t_done":387274.385865776,"t_done_unix":1779818139.3998094},{"request_id":"1373431:2:1378320:629","session_id":"1373431","input_length":127267,"t_proxy_recv":387272.183447116,"t_decision_unix":1779818137.197389,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":126464,"affinity_cache_ratio":0.9936904303550803,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":126464,"estimated_new_tokens":803,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":109776,"ongoing_decode_tokens":109776,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1361,"cache_hit":0,"new_prefill":127267,"score_linear":109776.0,"score_lmetric":254534},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":127267,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":1024,"new_prefill":126243,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":127267,"score_linear":15283.0,"score_lmetric":127267},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1702,"cache_hit":126464,"new_prefill":803,"score_linear":-126464.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120785,"ongoing_decode_tokens":120785,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":127267,"score_linear":120785.0,"score_lmetric":254534},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":127267,"score_linear":48944.0,"score_lmetric":127267},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":127267,"score_linear":132650.0,"score_lmetric":406922}],"chosen_score_linear":-126464.0,"chosen_score_lmetric":0,"t_first_token":387272.803561186,"t_first_token_unix":1779818137.8175054,"t_done":387274.408448878,"t_done_unix":1779818139.4223921},{"request_id":"1388507:1:1388507:697","session_id":"1388507","input_length":71899,"t_proxy_recv":387255.569745985,"t_decision_unix":1779818120.5836873,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":-71899,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":71899,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":148474,"ongoing_decode_tokens":20948,"pending_prefill_tokens":45094,"num_requests":2,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":0,"new_prefill":71899,"score_linear":148474.0,"score_lmetric":233986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":71899,"score_linear":85184.0,"score_lmetric":71899},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":71899,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109974,"ongoing_decode_tokens":15283,"pending_prefill_tokens":5091,"num_requests":3,"active_p_offloads":0,"cached_blocks":1881,"cache_hit":0,"new_prefill":71899,"score_linear":109974.0,"score_lmetric":230970},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":126340,"pending_prefill_tokens":4845,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":71899,"score_linear":217713.0,"score_lmetric":230232},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":107466,"ongoing_decode_tokens":107466,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":71899,"score_linear":107466.0,"score_lmetric":143798},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50793,"ongoing_decode_tokens":0,"pending_prefill_tokens":22633,"num_requests":1,"active_p_offloads":0,"cached_blocks":1464,"cache_hit":0,"new_prefill":71899,"score_linear":50793.0,"score_lmetric":94532},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":71899,"score_linear":-44920.0,"score_lmetric":-71899}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-71899,"t_first_token":387273.326956788,"t_first_token_unix":1779818138.3409004,"t_done":387274.472212243,"t_done_unix":1779818139.4861555},{"request_id":"1313181:6:1379623:639","session_id":"1313181","input_length":61543,"t_proxy_recv":387268.685016725,"t_decision_unix":1779818133.6989584,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9983263734299596,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":42169,"ongoing_decode_tokens":42169,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":61440,"new_prefill":103,"score_linear":-19271.0,"score_lmetric":103},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":61543,"score_linear":155874.0,"score_lmetric":123086},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1999,"cache_hit":0,"new_prefill":61543,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43665,"ongoing_decode_tokens":43665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":12800,"new_prefill":48743,"score_linear":30865.0,"score_lmetric":97486},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":61543,"score_linear":126340.0,"score_lmetric":61543},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":24064,"new_prefill":37479,"score_linear":11824.0,"score_lmetric":37479},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":28307,"num_requests":1,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":61543,"score_linear":28307.0,"score_lmetric":89850},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":12800,"new_prefill":48743,"score_linear":119850.0,"score_lmetric":249874}],"chosen_score_linear":-19271.0,"chosen_score_lmetric":103,"t_first_token":387268.799031204,"t_first_token_unix":1779818133.8129745,"t_done":387275.617033227,"t_done_unix":1779818140.630977},{"request_id":"1373431:3:1383388:667","session_id":"1373431","input_length":128201,"t_proxy_recv":387274.432374108,"t_decision_unix":1779818139.4463158,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":126976,"affinity_cache_ratio":0.9904446923190927,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":126976,"estimated_new_tokens":1225,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85184,"ongoing_decode_tokens":61543,"pending_prefill_tokens":2137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1363,"cache_hit":0,"new_prefill":128201,"score_linear":85184.0,"score_lmetric":130338},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":128201,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":1024,"new_prefill":127177,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":128201,"score_linear":15283.0,"score_lmetric":128201},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":126976,"new_prefill":1225,"score_linear":-126976.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":128201,"score_linear":101803.0,"score_lmetric":156788},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":128201,"score_linear":48944.0,"score_lmetric":128201},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":128972,"ongoing_decode_tokens":173892,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":0,"new_prefill":128201,"score_linear":128972.0,"score_lmetric":128201}],"chosen_score_linear":-126976.0,"chosen_score_lmetric":0,"t_first_token":387275.31590419,"t_first_token_unix":1779818140.329848,"t_done":387276.30262521,"t_done_unix":1779818141.316569},{"request_id":"1394428:1:1394428:724","session_id":"1394428","input_length":982,"t_proxy_recv":387276.661465259,"t_decision_unix":1779818141.675407,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":982,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":982,"score_linear":145452.0,"score_lmetric":60841},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":512,"new_prefill":470,"score_linear":105631.0,"score_lmetric":18549},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":982,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43948,"ongoing_decode_tokens":43948,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":982,"score_linear":43948.0,"score_lmetric":1964},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":982,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":982,"score_linear":101803.0,"score_lmetric":29569},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":982,"score_linear":82265.0,"score_lmetric":1964},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61748,"ongoing_decode_tokens":106668,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":982,"score_linear":61748.0,"score_lmetric":982}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387276.742804477,"t_first_token_unix":1779818141.7567472,"t_done":387276.746675279,"t_done_unix":1779818141.760618},{"request_id":"1394167:1:1394167:721","session_id":"1394167","input_length":4675,"t_proxy_recv":387275.772614923,"t_decision_unix":1779818140.7865448,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":4675,"score_linear":145452.0,"score_lmetric":64534},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":4675,"score_linear":15283.0,"score_lmetric":4675},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":128201,"ongoing_decode_tokens":128201,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":4675,"score_linear":128201.0,"score_lmetric":4675},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":4675,"score_linear":101803.0,"score_lmetric":33262},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":48944,"pending_prefill_tokens":5161,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":4675,"score_linear":82265.0,"score_lmetric":19672},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57073,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":4675,"score_linear":57073.0,"score_lmetric":0}],"chosen_score_linear":57073.0,"chosen_score_lmetric":0,"t_first_token":387276.187121658,"t_first_token_unix":1779818141.2010655,"t_done":387277.030308506,"t_done_unix":1779818142.044252},{"request_id":"1355484:13:1394384:723","session_id":"1355484","input_length":28665,"t_proxy_recv":387276.528542505,"t_decision_unix":1779818141.5424836,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9823826966684109,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":12800,"new_prefill":15865,"score_linear":132652.0,"score_lmetric":75724},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":28665,"score_linear":106143.0,"score_lmetric":46744},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":28665,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":28160,"new_prefill":505,"score_linear":-12877.0,"score_lmetric":505},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":28665,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":12800,"new_prefill":15865,"score_linear":89003.0,"score_lmetric":44452},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":28665,"score_linear":82265.0,"score_lmetric":57330},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61748,"ongoing_decode_tokens":106668,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":12800,"new_prefill":15865,"score_linear":48948.0,"score_lmetric":15865}],"chosen_score_linear":-12877.0,"chosen_score_lmetric":505,"t_first_token":387276.596553305,"t_first_token_unix":1779818141.6105008,"t_done":387277.146172257,"t_done_unix":1779818142.1601152},{"request_id":"1394432:1:1394432:725","session_id":"1394432","input_length":4736,"t_proxy_recv":387276.679193488,"t_decision_unix":1779818141.693135,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4736,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":4736,"score_linear":145452.0,"score_lmetric":64595},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":4736,"score_linear":106143.0,"score_lmetric":22815},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":4736,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43948,"ongoing_decode_tokens":43948,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":4736,"score_linear":43948.0,"score_lmetric":9472},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":982,"ongoing_decode_tokens":0,"pending_prefill_tokens":982,"num_requests":1,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":4736,"score_linear":982.0,"score_lmetric":5718},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":4736,"score_linear":101803.0,"score_lmetric":33323},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":4736,"score_linear":82265.0,"score_lmetric":9472},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61748,"ongoing_decode_tokens":106668,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":4736,"score_linear":61748.0,"score_lmetric":4736}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387276.981649791,"t_first_token_unix":1779818141.995593,"t_done":387277.236590569,"t_done_unix":1779818142.250534},{"request_id":"1279412:31:1391216:711","session_id":"1279412","input_length":101993,"t_proxy_recv":387265.510183258,"t_decision_unix":1779818130.524124,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":101376,"affinity_cache_ratio":0.993950565234869,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":617,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":186716,"ongoing_decode_tokens":127253,"pending_prefill_tokens":583,"num_requests":3,"active_p_offloads":0,"cached_blocks":1347,"cache_hit":12800,"new_prefill":89193,"score_linear":173916.0,"score_lmetric":269328},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":155874,"ongoing_decode_tokens":155874,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1458,"cache_hit":0,"new_prefill":101993,"score_linear":155874.0,"score_lmetric":203986},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":20683,"ongoing_decode_tokens":20683,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":101993,"score_linear":20683.0,"score_lmetric":101993},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1897,"cache_hit":12800,"new_prefill":89193,"score_linear":2483.0,"score_lmetric":89193},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":217713,"ongoing_decode_tokens":217713,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":101993,"score_linear":217713.0,"score_lmetric":305979},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":119510,"ongoing_decode_tokens":119510,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":12800,"new_prefill":89193,"score_linear":106710.0,"score_lmetric":178386},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":101993,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30657,"ongoing_decode_tokens":0,"pending_prefill_tokens":75577,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":101376,"new_prefill":617,"score_linear":-70719.0,"score_lmetric":76194}],"chosen_score_linear":-70719.0,"chosen_score_lmetric":76194,"t_first_token":387273.835949905,"t_first_token_unix":1779818138.849893,"t_done":387277.266354337,"t_done_unix":1779818142.2802975},{"request_id":"1394482:1:1394482:726","session_id":"1394482","input_length":4428,"t_proxy_recv":387276.932668812,"t_decision_unix":1779818141.9466102,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4428,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":4428,"score_linear":145452.0,"score_lmetric":64287},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":4428,"score_linear":106143.0,"score_lmetric":22507},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":4736,"ongoing_decode_tokens":0,"pending_prefill_tokens":4736,"num_requests":1,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":4428,"score_linear":4736.0,"score_lmetric":9164},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43948,"ongoing_decode_tokens":43948,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":4428,"score_linear":43948.0,"score_lmetric":8856},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":4428,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":4428,"score_linear":101803.0,"score_lmetric":33015},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":4428,"score_linear":82265.0,"score_lmetric":8856},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61748,"ongoing_decode_tokens":106668,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":4428,"score_linear":61748.0,"score_lmetric":4428}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387277.213669383,"t_first_token_unix":1779818142.2276134,"t_done":387277.301806839,"t_done_unix":1779818142.3157504},{"request_id":"1364090:4:1392998:718","session_id":"1364090","input_length":48944,"t_proxy_recv":387271.617811823,"t_decision_unix":1779818136.631753,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9833278849297156,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":109776,"ongoing_decode_tokens":109776,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1361,"cache_hit":4096,"new_prefill":44848,"score_linear":105680.0,"score_lmetric":89696},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":7680,"new_prefill":41264,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7440,"ongoing_decode_tokens":0,"pending_prefill_tokens":2320,"num_requests":1,"active_p_offloads":0,"cached_blocks":2000,"cache_hit":0,"new_prefill":48944,"score_linear":7440.0,"score_lmetric":51264},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":7680,"new_prefill":41264,"score_linear":7603.0,"score_lmetric":41264},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":126340,"ongoing_decode_tokens":126340,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1457,"cache_hit":0,"new_prefill":48944,"score_linear":126340.0,"score_lmetric":48944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120785,"ongoing_decode_tokens":120785,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":0,"new_prefill":48944,"score_linear":120785.0,"score_lmetric":97888},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":48128,"new_prefill":816,"score_linear":-48128.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":0,"pending_prefill_tokens":76194,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":7680,"new_prefill":41264,"score_linear":124970.0,"score_lmetric":234916}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":387271.995183389,"t_first_token_unix":1779818137.0091264,"t_done":387278.341718689,"t_done_unix":1779818143.355662},{"request_id":"1378979:1:1378979:633","session_id":"1378979","input_length":15283,"t_proxy_recv":387222.310094555,"t_decision_unix":1779818087.3240361,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":184751,"ongoing_decode_tokens":0,"pending_prefill_tokens":53679,"num_requests":3,"active_p_offloads":0,"cached_blocks":1222,"cache_hit":0,"new_prefill":15283,"score_linear":184751.0,"score_lmetric":206886},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":15283,"score_linear":63536.0,"score_lmetric":15283},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":5458,"ongoing_decode_tokens":5458,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1758,"cache_hit":0,"new_prefill":15283,"score_linear":5458.0,"score_lmetric":15283},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":14848,"new_prefill":435,"score_linear":-14848.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":167848,"ongoing_decode_tokens":0,"pending_prefill_tokens":129960,"num_requests":2,"active_p_offloads":0,"cached_blocks":1447,"cache_hit":0,"new_prefill":15283,"score_linear":167848.0,"score_lmetric":290486},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":162147,"ongoing_decode_tokens":0,"pending_prefill_tokens":91491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1430,"cache_hit":0,"new_prefill":15283,"score_linear":162147.0,"score_lmetric":320322},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":15283,"score_linear":80246.0,"score_lmetric":15283},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23549,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1593,"cache_hit":0,"new_prefill":15283,"score_linear":-23549.0,"score_lmetric":0}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":387223.678242578,"t_first_token_unix":1779818088.6921859,"t_done":387278.576448552,"t_done_unix":1779818143.5903916},{"request_id":"1394432:2:1395186:729","session_id":"1394432","input_length":6892,"t_proxy_recv":387279.267891211,"t_decision_unix":1779818144.2818327,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":4608,"affinity_cache_ratio":0.6686012768427162,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":2284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":6892,"score_linear":145452.0,"score_lmetric":66751},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":6892,"score_linear":106143.0,"score_lmetric":24971},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2013,"cache_hit":4608,"new_prefill":2284,"score_linear":-4608.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1903,"cache_hit":0,"new_prefill":6892,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":6892,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":6892,"score_linear":101803.0,"score_lmetric":35479},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":6892,"score_linear":33321.0,"score_lmetric":6892},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-4607,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":6892,"score_linear":-4607.0,"score_lmetric":42597}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":387279.471796996,"t_first_token_unix":1779818144.4857407,"t_done":387279.721265825,"t_done_unix":1779818144.7352095},{"request_id":"1390240:3:1395387:730","session_id":"1390240","input_length":10890,"t_proxy_recv":387280.063558353,"t_decision_unix":1779818145.0774994,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":7168,"affinity_cache_ratio":0.65821854912764,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":3722,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":10890,"score_linear":145452.0,"score_lmetric":70749},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":10890,"score_linear":106143.0,"score_lmetric":28969},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":7168,"new_prefill":3722,"score_linear":-7168.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1903,"cache_hit":0,"new_prefill":10890,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":10890,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":10890,"score_linear":101803.0,"score_lmetric":39477},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":10890,"score_linear":33321.0,"score_lmetric":10890},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-4607,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":10890,"score_linear":-4607.0,"score_lmetric":46595}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":387280.428779111,"t_first_token_unix":1779818145.442723,"t_done":387281.000974726,"t_done_unix":1779818146.014918},{"request_id":"1394696:1:1394696:727","session_id":"1394696","input_length":35450,"t_proxy_recv":387277.709746485,"t_decision_unix":1779818142.723688,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-35450,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":35450,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":35450,"score_linear":145452.0,"score_lmetric":95309},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":35450,"score_linear":106143.0,"score_lmetric":53529},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2013,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":35450,"score_linear":15283.0,"score_lmetric":35450},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":35450,"score_linear":101803.0,"score_lmetric":64037},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":35450,"score_linear":82265.0,"score_lmetric":70900},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":35450,"score_linear":-44920.0,"score_lmetric":-35450}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-35450,"t_first_token":387282.859106428,"t_first_token_unix":1779818147.8730507,"t_done":387283.324924723,"t_done_unix":1779818148.3388681},{"request_id":"1394167:2:1395165:728","session_id":"1394167","input_length":4863,"t_proxy_recv":387279.20431316,"t_decision_unix":1779818144.2182543,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.9475632325724861,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":4863,"score_linear":145452.0,"score_lmetric":64722},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":4863,"score_linear":106143.0,"score_lmetric":22942},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2013,"cache_hit":0,"new_prefill":4863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1903,"cache_hit":0,"new_prefill":4863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":4863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":4863,"score_linear":101803.0,"score_lmetric":33450},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":4863,"score_linear":33321.0,"score_lmetric":4863},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-9470,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":4608,"new_prefill":255,"score_linear":-14078.0,"score_lmetric":0}],"chosen_score_linear":-14078.0,"chosen_score_lmetric":0,"t_first_token":387282.862796545,"t_first_token_unix":1779818147.87674,"t_done":387283.596315416,"t_done_unix":1779818148.6102593},{"request_id":"1395933:1:1395933:732","session_id":"1395933","input_length":21241,"t_proxy_recv":387282.005387209,"t_decision_unix":1779818147.0193286,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":21241,"score_linear":145452.0,"score_lmetric":81100},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":21241,"score_linear":106143.0,"score_lmetric":39320},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":21241,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1903,"cache_hit":0,"new_prefill":21241,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":21241,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":11776,"new_prefill":9465,"score_linear":175303.0,"score_lmetric":76672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":11776,"new_prefill":9465,"score_linear":21545.0,"score_lmetric":9465},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-4607,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":21241,"score_linear":-4607.0,"score_lmetric":56946}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387284.259352359,"t_first_token_unix":1779818149.2732964,"t_done":387285.5425329,"t_done_unix":1779818150.5564764},{"request_id":"1305906:3:1396717:733","session_id":"1305906","input_length":17047,"t_proxy_recv":387284.591957408,"t_decision_unix":1779818149.6058984,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":16384,"affinity_cache_ratio":0.9611075262509532,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":663,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":17047,"score_linear":145452.0,"score_lmetric":76906},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":16384,"new_prefill":663,"score_linear":89759.0,"score_lmetric":18742},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":17047,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21241,"ongoing_decode_tokens":21241,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1903,"cache_hit":0,"new_prefill":17047,"score_linear":21241.0,"score_lmetric":17047},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":17047,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":17047,"score_linear":187079.0,"score_lmetric":91836},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":17047,"score_linear":33321.0,"score_lmetric":17047},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":17047,"score_linear":-44920.0,"score_lmetric":-17047}],"chosen_score_linear":89759.0,"chosen_score_lmetric":18742,"t_first_token":387286.853389107,"t_first_token_unix":1779818151.8673332,"t_done":387288.401801202,"t_done_unix":1779818153.4157462},{"request_id":"1398145:1:1398145:739","session_id":"1398145","input_length":3213,"t_proxy_recv":387289.75731825,"t_decision_unix":1779818154.7712593,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":3213,"score_linear":145452.0,"score_lmetric":63072},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1471,"cache_hit":0,"new_prefill":3213,"score_linear":106143.0,"score_lmetric":3213},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":3213,"score_linear":16550.0,"score_lmetric":19763},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":3213,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":3213,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":3213,"score_linear":187079.0,"score_lmetric":64168},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":3213,"score_linear":33321.0,"score_lmetric":3213},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":3213,"score_linear":61254.0,"score_lmetric":96253}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387289.959161055,"t_first_token_unix":1779818154.9731042,"t_done":387290.061456961,"t_done_unix":1779818155.0754006},{"request_id":"1362265:5:1398180:741","session_id":"1362265","input_length":10736,"t_proxy_recv":387289.841458648,"t_decision_unix":1779818154.8554,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10240,"affinity_cache_ratio":0.9538002980625931,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":10736,"score_linear":145452.0,"score_lmetric":70595},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1471,"cache_hit":10240,"new_prefill":496,"score_linear":95903.0,"score_lmetric":496},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":10736,"score_linear":16550.0,"score_lmetric":27286},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31224,"ongoing_decode_tokens":0,"pending_prefill_tokens":2552,"num_requests":1,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":10736,"score_linear":31224.0,"score_lmetric":13288},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":3213,"ongoing_decode_tokens":0,"pending_prefill_tokens":3213,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":10736,"score_linear":3213.0,"score_lmetric":13949},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":6656,"new_prefill":4080,"score_linear":180423.0,"score_lmetric":65902},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":10736,"score_linear":33321.0,"score_lmetric":10736},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":10736,"score_linear":61254.0,"score_lmetric":103776}],"chosen_score_linear":95903.0,"chosen_score_lmetric":496,"t_first_token":387289.914339947,"t_first_token_unix":1779818154.928283,"t_done":387290.308680665,"t_done_unix":1779818155.3226242},{"request_id":"1397840:1:1397840:737","session_id":"1397840","input_length":16550,"t_proxy_recv":387288.683639223,"t_decision_unix":1779818153.6975806,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":16550,"score_linear":145452.0,"score_lmetric":76409},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1471,"cache_hit":0,"new_prefill":16550,"score_linear":106143.0,"score_lmetric":16550},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":16550,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":16550,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":16550,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":16550,"score_linear":187079.0,"score_lmetric":90842},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":16550,"score_linear":33321.0,"score_lmetric":16550},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":16550,"score_linear":61254.0,"score_lmetric":109590}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387290.248255098,"t_first_token_unix":1779818155.2621987,"t_done":387290.487796443,"t_done_unix":1779818155.5017402},{"request_id":"1398213:1:1398213:742","session_id":"1398213","input_length":3891,"t_proxy_recv":387289.91376281,"t_decision_unix":1779818154.927704,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":3891,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":3891,"score_linear":145452.0,"score_lmetric":63750},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":116879,"ongoing_decode_tokens":106143,"pending_prefill_tokens":496,"num_requests":2,"active_p_offloads":0,"cached_blocks":1471,"cache_hit":0,"new_prefill":3891,"score_linear":116879.0,"score_lmetric":8774},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":3891,"score_linear":16550.0,"score_lmetric":20441},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31224,"ongoing_decode_tokens":0,"pending_prefill_tokens":2552,"num_requests":1,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":3891,"score_linear":31224.0,"score_lmetric":6443},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":3213,"ongoing_decode_tokens":0,"pending_prefill_tokens":3213,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":3891,"score_linear":3213.0,"score_lmetric":7104},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":3891,"score_linear":187079.0,"score_lmetric":65524},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":3891,"score_linear":33321.0,"score_lmetric":3891},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":3891,"score_linear":61254.0,"score_lmetric":96931}],"chosen_score_linear":33321.0,"chosen_score_lmetric":3891,"t_first_token":387290.179268661,"t_first_token_unix":1779818155.1932118,"t_done":387290.666798006,"t_done_unix":1779818155.6807413},{"request_id":"1398594:1:1398594:744","session_id":"1398594","input_length":7877,"t_proxy_recv":387291.122171675,"t_decision_unix":1779818156.136113,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7877,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":7877,"score_linear":145452.0,"score_lmetric":67736},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":7877,"score_linear":106143.0,"score_lmetric":7877},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2056,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":7877,"score_linear":94482.0,"score_lmetric":39870},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":7877,"score_linear":187079.0,"score_lmetric":73496},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1575,"cache_hit":0,"new_prefill":7877,"score_linear":33321.0,"score_lmetric":7877},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":7877,"score_linear":61254.0,"score_lmetric":100917}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387291.669156429,"t_first_token_unix":1779818156.6831002,"t_done":387291.784711999,"t_done_unix":1779818156.7986555},{"request_id":"1391404:2:1393919:720","session_id":"1391404","input_length":33321,"t_proxy_recv":387274.819449442,"t_decision_unix":1779818139.833391,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28160,"affinity_cache_ratio":0.8451126916959275,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":5161,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1363,"cache_hit":2560,"new_prefill":30761,"score_linear":82624.0,"score_lmetric":30761},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":33321,"score_linear":15283.0,"score_lmetric":33321},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":128201,"ongoing_decode_tokens":0,"pending_prefill_tokens":1225,"num_requests":1,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":33321,"score_linear":128201.0,"score_lmetric":34546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":33321,"score_linear":101803.0,"score_lmetric":61908},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":28160,"new_prefill":5161,"score_linear":20784.0,"score_lmetric":5161},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57073,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":0,"new_prefill":33321,"score_linear":57073.0,"score_lmetric":0}],"chosen_score_linear":20784.0,"chosen_score_lmetric":5161,"t_first_token":387275.945024719,"t_first_token_unix":1779818140.9589684,"t_done":387295.116354939,"t_done_unix":1779818160.1302986},{"request_id":"1362265:6:1399937:747","session_id":"1362265","input_length":10816,"t_proxy_recv":387295.901782976,"t_decision_unix":1779818160.9157243,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9940828402366864,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":64,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":10816,"score_linear":145452.0,"score_lmetric":70675},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":10752,"new_prefill":64,"score_linear":95391.0,"score_lmetric":64},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":10816,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":10816,"score_linear":94482.0,"score_lmetric":45748},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":10816,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":6656,"new_prefill":4160,"score_linear":180423.0,"score_lmetric":66062},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":10816,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":10816,"score_linear":61254.0,"score_lmetric":103856}],"chosen_score_linear":95391.0,"chosen_score_lmetric":64,"t_first_token":387295.972916962,"t_first_token_unix":1779818160.9868603,"t_done":387296.497857271,"t_done_unix":1779818161.5118005},{"request_id":"1400379:1:1400379:751","session_id":"1400379","input_length":3707,"t_proxy_recv":387297.248618158,"t_decision_unix":1779818162.2625594,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3707,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":3707,"score_linear":145452.0,"score_lmetric":63566},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":3707,"score_linear":106143.0,"score_lmetric":3707},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":3707,"score_linear":31431.0,"score_lmetric":27526},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":3707,"score_linear":94482.0,"score_lmetric":31530},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":3707,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":3707,"score_linear":187079.0,"score_lmetric":65156},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":3707,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":3707,"score_linear":61254.0,"score_lmetric":96747}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387297.499057864,"t_first_token_unix":1779818162.5130017,"t_done":387297.776574677,"t_done_unix":1779818162.7905183},{"request_id":"1399948:1:1399948:748","session_id":"1399948","input_length":4991,"t_proxy_recv":387295.932408898,"t_decision_unix":1779818160.9463506,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4991,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":4991,"score_linear":145452.0,"score_lmetric":64850},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":116959,"ongoing_decode_tokens":106143,"pending_prefill_tokens":64,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":4991,"score_linear":116959.0,"score_lmetric":10110},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":4991,"score_linear":94482.0,"score_lmetric":34098},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":4991,"score_linear":187079.0,"score_lmetric":67724},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":4991,"score_linear":61254.0,"score_lmetric":98031}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387296.252661949,"t_first_token_unix":1779818161.2666056,"t_done":387298.64804084,"t_done_unix":1779818163.6619842},{"request_id":"1397840:2:1400216:749","session_id":"1397840","input_length":26440,"t_proxy_recv":387296.732261697,"t_decision_unix":1779818161.746203,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":16384,"affinity_cache_ratio":0.6196671709531013,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":10056,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":26440,"score_linear":145452.0,"score_lmetric":86299},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":26440,"score_linear":106143.0,"score_lmetric":26440},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":4991,"ongoing_decode_tokens":4991,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":16384,"new_prefill":10056,"score_linear":-11393.0,"score_lmetric":10056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":26440,"score_linear":94482.0,"score_lmetric":76996},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":26440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":26440,"score_linear":187079.0,"score_lmetric":110622},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":26440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":26440,"score_linear":61254.0,"score_lmetric":119480}],"chosen_score_linear":-11393.0,"chosen_score_lmetric":10056,"t_first_token":387298.448159437,"t_first_token_unix":1779818163.4621034,"t_done":387298.660164468,"t_done_unix":1779818163.6741076},{"request_id":"1400379:2:1401201:757","session_id":"1400379","input_length":3863,"t_proxy_recv":387300.366726895,"t_decision_unix":1779818165.3806682,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":3584,"affinity_cache_ratio":0.92777633963241,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":3863,"score_linear":145452.0,"score_lmetric":63722},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":3863,"score_linear":106143.0,"score_lmetric":3863},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2099,"cache_hit":0,"new_prefill":3863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":3863,"score_linear":94482.0,"score_lmetric":31842},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":3584,"new_prefill":279,"score_linear":-3584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":3863,"score_linear":187079.0,"score_lmetric":65468},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":11414,"pending_prefill_tokens":30899,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":3863,"score_linear":142153.0,"score_lmetric":104286},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":3863,"score_linear":61254.0,"score_lmetric":96903}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":387300.404361307,"t_first_token_unix":1779818165.4183047,"t_done":387300.737353655,"t_done_unix":1779818165.751297},{"request_id":"1253743:8:1398344:743","session_id":"1253743","input_length":63258,"t_proxy_recv":387290.340753774,"t_decision_unix":1779818155.3546948,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51200,"affinity_cache_ratio":0.8093837933542003,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":12058,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":63258,"score_linear":145452.0,"score_lmetric":123117},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":4608,"new_prefill":58650,"score_linear":101535.0,"score_lmetric":58650},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16550,"ongoing_decode_tokens":16550,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":63258,"score_linear":16550.0,"score_lmetric":63258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31224,"ongoing_decode_tokens":0,"pending_prefill_tokens":2552,"num_requests":1,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":51200,"new_prefill":12058,"score_linear":-19976.0,"score_lmetric":14610},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":63258,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":63258,"score_linear":187079.0,"score_lmetric":184258},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37212,"ongoing_decode_tokens":37212,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":63258,"score_linear":37212.0,"score_lmetric":126516},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":63258,"score_linear":61254.0,"score_lmetric":156298}],"chosen_score_linear":-19976.0,"chosen_score_lmetric":14610,"t_first_token":387302.935427501,"t_first_token_unix":1779818167.9493713,"t_done":387304.362205467,"t_done_unix":1779818169.376149},{"request_id":"1355484:14:1398178:740","session_id":"1355484","input_length":31224,"t_proxy_recv":387289.834015928,"t_decision_unix":1779818154.8479567,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9182679989751473,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":2552,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":12800,"new_prefill":18424,"score_linear":132652.0,"score_lmetric":78283},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1471,"cache_hit":0,"new_prefill":31224,"score_linear":106143.0,"score_lmetric":31224},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":31224,"score_linear":16550.0,"score_lmetric":47774},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":28672,"new_prefill":2552,"score_linear":-28672.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":3213,"ongoing_decode_tokens":0,"pending_prefill_tokens":3213,"num_requests":1,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":31224,"score_linear":3213.0,"score_lmetric":34437},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":12800,"new_prefill":18424,"score_linear":174279.0,"score_lmetric":94590},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":31224,"score_linear":33321.0,"score_lmetric":31224},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":12800,"new_prefill":18424,"score_linear":48454.0,"score_lmetric":111464}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":387290.475861208,"t_first_token_unix":1779818155.4898052,"t_done":387304.84790757,"t_done_unix":1779818169.8618512},{"request_id":"1355484:15:1400281:750","session_id":"1355484","input_length":31469,"t_proxy_recv":387304.854857706,"t_decision_unix":1779818169.8687992,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9924687787981823,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":237,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":12800,"new_prefill":18669,"score_linear":132652.0,"score_lmetric":78528},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":31469,"score_linear":106143.0,"score_lmetric":31469},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2099,"cache_hit":0,"new_prefill":31469,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":31232,"new_prefill":237,"score_linear":-31232.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":31469,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":12800,"new_prefill":18669,"score_linear":174279.0,"score_lmetric":95080},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":11414,"pending_prefill_tokens":30899,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":31469,"score_linear":142153.0,"score_lmetric":187104},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":12800,"new_prefill":18669,"score_linear":48454.0,"score_lmetric":111709}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":387304.926218931,"t_first_token_unix":1779818169.9401634,"t_done":387305.423025602,"t_done_unix":1779818170.4369693},{"request_id":"1397840:3:1402568:761","session_id":"1397840","input_length":28603,"t_proxy_recv":387305.078514176,"t_decision_unix":1779818170.0924551,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9129112330874384,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":2491,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":28603,"score_linear":145452.0,"score_lmetric":88462},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":28603,"score_linear":106143.0,"score_lmetric":28603},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2099,"cache_hit":26112,"new_prefill":2491,"score_linear":-26112.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":31469,"ongoing_decode_tokens":31469,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":0,"new_prefill":28603,"score_linear":31469.0,"score_lmetric":28603},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":28603,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":28603,"score_linear":187079.0,"score_lmetric":114948},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":11414,"pending_prefill_tokens":30899,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":28603,"score_linear":142153.0,"score_lmetric":178506},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":28603,"score_linear":61254.0,"score_lmetric":121643}],"chosen_score_linear":-26112.0,"chosen_score_lmetric":0,"t_first_token":387305.624657018,"t_first_token_unix":1779818170.638601,"t_done":387305.773981068,"t_done_unix":1779818170.787924},{"request_id":"1400379:3:1402972:763","session_id":"1400379","input_length":11216,"t_proxy_recv":387306.576378153,"t_decision_unix":1779818171.5903194,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":3584,"affinity_cache_ratio":0.3195435092724679,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":7632,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":11216,"score_linear":145452.0,"score_lmetric":71075},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":11216,"score_linear":106143.0,"score_lmetric":11216},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2103,"cache_hit":0,"new_prefill":11216,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32332,"ongoing_decode_tokens":32332,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":0,"new_prefill":11216,"score_linear":32332.0,"score_lmetric":11216},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":3584,"new_prefill":7632,"score_linear":-3584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":11216,"score_linear":187079.0,"score_lmetric":80174},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":11414,"pending_prefill_tokens":30899,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":11216,"score_linear":142153.0,"score_lmetric":126345},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":11216,"score_linear":61254.0,"score_lmetric":104256}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":387307.243634816,"t_first_token_unix":1779818172.2575788,"t_done":387307.481691933,"t_done_unix":1779818172.4956353},{"request_id":"1403188:1:1403188:764","session_id":"1403188","input_length":8848,"t_proxy_recv":387307.47676946,"t_decision_unix":1779818172.4907103,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8848,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":8848,"score_linear":145452.0,"score_lmetric":68707},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":8848,"score_linear":106143.0,"score_lmetric":8848},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2103,"cache_hit":0,"new_prefill":8848,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32332,"ongoing_decode_tokens":32332,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":0,"new_prefill":8848,"score_linear":32332.0,"score_lmetric":8848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":11216,"ongoing_decode_tokens":11216,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":8848,"score_linear":11216.0,"score_lmetric":8848},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":187079,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":8848,"score_linear":187079.0,"score_lmetric":17696},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":11414,"pending_prefill_tokens":30899,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":8848,"score_linear":142153.0,"score_lmetric":119241},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":8848,"score_linear":61254.0,"score_lmetric":101888}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387308.155377351,"t_first_token_unix":1779818173.169321,"t_done":387308.724933721,"t_done_unix":1779818173.7388775},{"request_id":"1366128:17:1395596:731","session_id":"1366128","input_length":85276,"t_proxy_recv":387280.818457614,"t_decision_unix":1779818145.8323987,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9966696374126366,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":85276,"score_linear":145452.0,"score_lmetric":145135},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":0,"pending_prefill_tokens":18079,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":85276,"score_linear":106143.0,"score_lmetric":103355},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":10890,"ongoing_decode_tokens":10890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":85276,"score_linear":10890.0,"score_lmetric":85276},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1903,"cache_hit":0,"new_prefill":85276,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":85276,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":84992,"new_prefill":284,"score_linear":16811.0,"score_lmetric":28871},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":85276,"score_linear":33321.0,"score_lmetric":85276},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-4607,"ongoing_decode_tokens":0,"pending_prefill_tokens":35705,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":85276,"score_linear":-4607.0,"score_lmetric":120981}],"chosen_score_linear":16811.0,"chosen_score_lmetric":28871,"t_first_token":387307.418704898,"t_first_token_unix":1779818172.4326482,"t_done":387308.82897314,"t_done_unix":1779818173.8429172},{"request_id":"1355484:16:1401320:758","session_id":"1355484","input_length":32332,"t_proxy_recv":387305.431963971,"t_decision_unix":1779818170.4459054,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9659779784733391,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":1100,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":12800,"new_prefill":19532,"score_linear":132652.0,"score_lmetric":79391},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":32332,"score_linear":106143.0,"score_lmetric":32332},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":28603,"ongoing_decode_tokens":0,"pending_prefill_tokens":2491,"num_requests":1,"active_p_offloads":0,"cached_blocks":2099,"cache_hit":0,"new_prefill":32332,"score_linear":28603.0,"score_lmetric":34823},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":31232,"new_prefill":1100,"score_linear":-31232.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":32332,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":12800,"new_prefill":19532,"score_linear":174279.0,"score_lmetric":96806},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":11414,"pending_prefill_tokens":30899,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":32332,"score_linear":142153.0,"score_lmetric":189693},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":12800,"new_prefill":19532,"score_linear":48454.0,"score_lmetric":112572}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":387305.699142545,"t_first_token_unix":1779818170.7130861,"t_done":387309.521091892,"t_done_unix":1779818174.5350356},{"request_id":"1366128:18:1397382:735","session_id":"1366128","input_length":85504,"t_proxy_recv":387308.843081639,"t_decision_unix":1779818173.8570232,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9940119760479041,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":85504,"score_linear":145452.0,"score_lmetric":145363},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":85504,"score_linear":106143.0,"score_lmetric":85504},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":85504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32332,"ongoing_decode_tokens":32332,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":0,"new_prefill":85504,"score_linear":32332.0,"score_lmetric":85504},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":85504,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":84992,"new_prefill":512,"score_linear":16811.0,"score_lmetric":512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":79523,"pending_prefill_tokens":13478,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":85504,"score_linear":142153.0,"score_lmetric":296946},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":85504,"score_linear":61254.0,"score_lmetric":178544}],"chosen_score_linear":16811.0,"chosen_score_lmetric":512,"t_first_token":387309.100526958,"t_first_token_unix":1779818174.1144705,"t_done":387310.388530152,"t_done_unix":1779818175.402474},{"request_id":"1403989:1:1403989:767","session_id":"1403989","input_length":1954,"t_proxy_recv":387309.971861814,"t_decision_unix":1779818174.9858034,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1954,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":145452,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":1954,"score_linear":145452.0,"score_lmetric":1954},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":1954,"score_linear":106143.0,"score_lmetric":1954},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":1954,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":1954,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":1954,"score_linear":44148.0,"score_lmetric":4630},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187307,"ongoing_decode_tokens":187307,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":1954,"score_linear":187307.0,"score_lmetric":3908},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":79523,"pending_prefill_tokens":13478,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":1954,"score_linear":142153.0,"score_lmetric":46296},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":1954,"score_linear":61254.0,"score_lmetric":94994}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387310.101537351,"t_first_token_unix":1779818175.115481,"t_done":387310.446190874,"t_done_unix":1779818175.4601345},{"request_id":"1398213:2:1400590:753","session_id":"1398213","input_length":11414,"t_proxy_recv":387298.03781687,"t_decision_unix":1779818163.051758,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":3584,"affinity_cache_ratio":0.3140003504468197,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":7830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":11414,"score_linear":145452.0,"score_lmetric":71273},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":11414,"score_linear":106143.0,"score_lmetric":11414},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":11414,"score_linear":31431.0,"score_lmetric":42940},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":11414,"score_linear":94482.0,"score_lmetric":46944},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":11414,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":11414,"score_linear":187079.0,"score_lmetric":80570},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":3584,"new_prefill":7830,"score_linear":-3584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":11414,"score_linear":61254.0,"score_lmetric":104454}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":387298.722466589,"t_first_token_unix":1779818163.7364101,"t_done":387310.870335754,"t_done_unix":1779818175.8842883},{"request_id":"1366128:19:1398824:745","session_id":"1366128","input_length":85663,"t_proxy_recv":387310.404096446,"t_decision_unix":1779818175.418035,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9981438894271739,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":159,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":145452,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":85663,"score_linear":145452.0,"score_lmetric":85663},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":85663,"score_linear":106143.0,"score_lmetric":85663},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":85663,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1954,"ongoing_decode_tokens":1954,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":85663,"score_linear":1954.0,"score_lmetric":85663},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":44148,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":85663,"score_linear":44148.0,"score_lmetric":85663},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":85504,"new_prefill":159,"score_linear":16299.0,"score_lmetric":159},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":142153,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":85663,"score_linear":142153.0,"score_lmetric":256989},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":85663,"score_linear":61254.0,"score_lmetric":178703}],"chosen_score_linear":16299.0,"chosen_score_lmetric":159,"t_first_token":387310.573211595,"t_first_token_unix":1779818175.5871553,"t_done":387310.89732345,"t_done_unix":1779818175.911267},{"request_id":"1313181:7:1327489:383","session_id":"1313181","input_length":121811,"t_proxy_recv":387275.644411263,"t_decision_unix":1779818140.6583529,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":61952,"affinity_cache_ratio":0.5085911781366215,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":59859,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":61952,"new_prefill":59859,"score_linear":-38311.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":121811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":121811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":12800,"new_prefill":109011,"score_linear":2483.0,"score_lmetric":109011},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":128201,"ongoing_decode_tokens":128201,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":121811,"score_linear":128201.0,"score_lmetric":121811},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":24064,"new_prefill":97747,"score_linear":77739.0,"score_lmetric":126334},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":48944,"pending_prefill_tokens":5161,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":121811,"score_linear":82265.0,"score_lmetric":253944},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57073,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":12800,"new_prefill":109011,"score_linear":44273.0,"score_lmetric":0}],"chosen_score_linear":-38311.0,"chosen_score_lmetric":0,"t_first_token":387309.638511141,"t_first_token_unix":1779818174.6524549,"t_done":387311.127376593,"t_done_unix":1779818176.14132},{"request_id":"1253743:8:1404284:769","session_id":"1253743","input_length":63643,"t_proxy_recv":387310.99868376,"t_decision_unix":1779818176.0126252,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9895196643778578,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":667,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":145452,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":63643,"score_linear":145452.0,"score_lmetric":63643},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":4608,"new_prefill":59035,"score_linear":101535.0,"score_lmetric":59035},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":63643,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":62976,"new_prefill":667,"score_linear":-62976.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":44148,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":63643,"score_linear":44148.0,"score_lmetric":63643},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":199460,"ongoing_decode_tokens":101803,"pending_prefill_tokens":12153,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":63643,"score_linear":199460.0,"score_lmetric":151592},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":130739,"pending_prefill_tokens":1646,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":63643,"score_linear":143649.0,"score_lmetric":195867},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":63643,"score_linear":61254.0,"score_lmetric":156683}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":387311.218858448,"t_first_token_unix":1779818176.2328017,"t_done":387311.854081,"t_done_unix":1779818176.8680248},{"request_id":"1268861:8:1403753:765","session_id":"1268861","input_length":44148,"t_proxy_recv":387309.231818909,"t_decision_unix":1779818174.24576,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":41472,"affinity_cache_ratio":0.939385702636586,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":41472,"estimated_new_tokens":2676,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":44148,"score_linear":145452.0,"score_lmetric":104007},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":44148,"score_linear":106143.0,"score_lmetric":44148},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":44148,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":32332,"ongoing_decode_tokens":32332,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1972,"cache_hit":0,"new_prefill":44148,"score_linear":32332.0,"score_lmetric":44148},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":41472,"new_prefill":2676,"score_linear":-41472.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187307,"ongoing_decode_tokens":187307,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":44148,"score_linear":187307.0,"score_lmetric":88296},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":142153,"ongoing_decode_tokens":79523,"pending_prefill_tokens":13478,"num_requests":3,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":44148,"score_linear":142153.0,"score_lmetric":172878},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":44148,"score_linear":61254.0,"score_lmetric":137188}],"chosen_score_linear":-41472.0,"chosen_score_lmetric":0,"t_first_token":387310.012680055,"t_first_token_unix":1779818175.0266235,"t_done":387311.941052561,"t_done_unix":1779818176.954998},{"request_id":"1381387:4:1400724:754","session_id":"1381387","input_length":68109,"t_proxy_recv":387298.617089987,"t_decision_unix":1779818163.6310313,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":50688,"affinity_cache_ratio":0.7442188257058538,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":17421,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":68109,"score_linear":145452.0,"score_lmetric":127968},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":68109,"score_linear":106143.0,"score_lmetric":68109},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31431,"ongoing_decode_tokens":31431,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2071,"cache_hit":0,"new_prefill":68109,"score_linear":31431.0,"score_lmetric":136218},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":68109,"score_linear":94482.0,"score_lmetric":160334},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":68109,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":68109,"score_linear":187079.0,"score_lmetric":193960},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":11414,"ongoing_decode_tokens":0,"pending_prefill_tokens":7830,"num_requests":1,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":50688,"new_prefill":17421,"score_linear":-39274.0,"score_lmetric":25251},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":68109,"score_linear":61254.0,"score_lmetric":161149}],"chosen_score_linear":-39274.0,"chosen_score_lmetric":25251,"t_first_token":387307.939111155,"t_first_token_unix":1779818172.953055,"t_done":387314.074123165,"t_done_unix":1779818179.0880668},{"request_id":"1382089:2:1404847:773","session_id":"1382089","input_length":39203,"t_proxy_recv":387312.990763769,"t_decision_unix":1779818178.0047047,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9664566487258628,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":34816,"new_prefill":4387,"score_linear":50843.0,"score_lmetric":4387},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":39203,"score_linear":106143.0,"score_lmetric":39203},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":37888,"new_prefill":1315,"score_linear":-16204.0,"score_lmetric":22999},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":39203,"score_linear":21009.0,"score_lmetric":60212},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":39203,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":199460,"ongoing_decode_tokens":101803,"pending_prefill_tokens":12153,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":39203,"score_linear":199460.0,"score_lmetric":102712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":143649,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":39203,"score_linear":143649.0,"score_lmetric":117609},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":39203,"score_linear":61254.0,"score_lmetric":132243}],"chosen_score_linear":-16204.0,"chosen_score_lmetric":22999,"t_first_token":387314.111732176,"t_first_token_unix":1779818179.1256754,"t_done":387314.608448339,"t_done_unix":1779818179.6223917},{"request_id":"1399948:2:1405276:778","session_id":"1399948","input_length":6149,"t_proxy_recv":387314.443227968,"t_decision_unix":1779818179.4571698,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":4608,"affinity_cache_ratio":0.7493901447389819,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":1541,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":6149,"score_linear":198917.0,"score_lmetric":18654},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117646,"ongoing_decode_tokens":106143,"pending_prefill_tokens":11503,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":6149,"score_linear":117646.0,"score_lmetric":35304},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60887,"ongoing_decode_tokens":60887,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":4608,"new_prefill":1541,"score_linear":56279.0,"score_lmetric":3082},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":6149,"score_linear":21009.0,"score_lmetric":27158},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":0,"pending_prefill_tokens":32944,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":6149,"score_linear":32944.0,"score_lmetric":39093},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":6149,"score_linear":284898.0,"score_lmetric":66996},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":75540,"pending_prefill_tokens":1412,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":6149,"score_linear":145048.0,"score_lmetric":22683},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":6149,"score_linear":61254.0,"score_lmetric":99189}],"chosen_score_linear":56279.0,"chosen_score_lmetric":3082,"t_first_token":387314.607304337,"t_first_token_unix":1779818179.6212478,"t_done":387314.689836641,"t_done_unix":1779818179.70378},{"request_id":"1398594:2:1404702:771","session_id":"1398594","input_length":21009,"t_proxy_recv":387312.484359457,"t_decision_unix":1779818177.498301,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.3655576181636441,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21009,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":21009,"score_linear":85659.0,"score_lmetric":21009},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":21009,"score_linear":106143.0,"score_lmetric":21009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":7680,"new_prefill":13329,"score_linear":14004.0,"score_lmetric":35013},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":21009,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":21009,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":199460,"ongoing_decode_tokens":101803,"pending_prefill_tokens":12153,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":21009,"score_linear":199460.0,"score_lmetric":66324},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":143649,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":21009,"score_linear":143649.0,"score_lmetric":63027},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":21009,"score_linear":61254.0,"score_lmetric":114049}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387314.702283662,"t_first_token_unix":1779818179.7162273,"t_done":387314.883278081,"t_done_unix":1779818179.8972213},{"request_id":"1405199:1:1405199:776","session_id":"1405199","input_length":11503,"t_proxy_recv":387314.221722775,"t_decision_unix":1779818179.2356637,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":11503,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11503,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":11503,"score_linear":85659.0,"score_lmetric":11503},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":11503,"score_linear":106143.0,"score_lmetric":11503},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60887,"ongoing_decode_tokens":60887,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":11503,"score_linear":60887.0,"score_lmetric":23006},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":11503,"score_linear":21009.0,"score_lmetric":32512},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":0,"pending_prefill_tokens":32944,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":11503,"score_linear":32944.0,"score_lmetric":44447},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":11503,"score_linear":284898.0,"score_lmetric":83058},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":75540,"pending_prefill_tokens":1412,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":11503,"score_linear":145048.0,"score_lmetric":38745},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":11503,"score_linear":61254.0,"score_lmetric":104543}],"chosen_score_linear":106143.0,"chosen_score_lmetric":11503,"t_first_token":387315.175886623,"t_first_token_unix":1779818180.1898298,"t_done":387315.743486448,"t_done_unix":1779818180.7574303},{"request_id":"1381387:5:1404170:768","session_id":"1381387","input_length":69508,"t_proxy_recv":387314.105237605,"t_decision_unix":1779818179.119179,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9796857915635611,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":1412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":69508,"score_linear":85659.0,"score_lmetric":69508},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":69508,"score_linear":106143.0,"score_lmetric":69508},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60887,"ongoing_decode_tokens":21684,"pending_prefill_tokens":1315,"num_requests":2,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":69508,"score_linear":60887.0,"score_lmetric":141646},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":69508,"score_linear":21009.0,"score_lmetric":90517},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":69508,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":69508,"score_linear":284898.0,"score_lmetric":257073},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75540,"ongoing_decode_tokens":75540,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":68096,"new_prefill":1412,"score_linear":7444.0,"score_lmetric":2824},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":69508,"score_linear":61254.0,"score_lmetric":162548}],"chosen_score_linear":7444.0,"chosen_score_lmetric":2824,"t_first_token":387314.749315587,"t_first_token_unix":1779818179.763259,"t_done":387317.376558342,"t_done_unix":1779818182.3905022},{"request_id":"1399948:3:1405988:782","session_id":"1399948","input_length":7995,"t_proxy_recv":387317.06392392,"t_decision_unix":1779818182.0778646,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":6144,"affinity_cache_ratio":0.7684803001876173,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":1851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":7995,"score_linear":198917.0,"score_lmetric":22346},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":7995,"score_linear":106143.0,"score_lmetric":7995},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2125,"cache_hit":6144,"new_prefill":1851,"score_linear":15540.0,"score_lmetric":1851},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":7995,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":52910,"ongoing_decode_tokens":0,"pending_prefill_tokens":42158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":7995,"score_linear":52910.0,"score_lmetric":100306},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":101803,"pending_prefill_tokens":19936,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":7995,"score_linear":404875.0,"score_lmetric":111724},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":145048,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":7995,"score_linear":145048.0,"score_lmetric":23985},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":106174,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":7995,"score_linear":61254.0,"score_lmetric":7995}],"chosen_score_linear":15540.0,"chosen_score_lmetric":1851,"t_first_token":387317.273129869,"t_first_token_unix":1779818182.2870743,"t_done":387317.686701703,"t_done_unix":1779818182.700645},{"request_id":"1398213:3:1401507:759","session_id":"1398213","input_length":12910,"t_proxy_recv":387310.874195924,"t_decision_unix":1779818175.8881376,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":11264,"affinity_cache_ratio":0.8725019364833463,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":1646,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":145452,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":12910,"score_linear":145452.0,"score_lmetric":12910},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":12910,"score_linear":106143.0,"score_lmetric":12910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":12910,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":12910,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":44148,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":12910,"score_linear":44148.0,"score_lmetric":12910},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187466,"ongoing_decode_tokens":187466,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":12910,"score_linear":187466.0,"score_lmetric":25820},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":130739,"ongoing_decode_tokens":130739,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":11264,"new_prefill":1646,"score_linear":119475.0,"score_lmetric":3292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":12910,"score_linear":61254.0,"score_lmetric":105950}],"chosen_score_linear":119475.0,"chosen_score_lmetric":3292,"t_first_token":387311.127886726,"t_first_token_unix":1779818176.14183,"t_done":387317.82988838,"t_done_unix":1779818182.8438315},{"request_id":"1397515:1:1397515:736","session_id":"1397515","input_length":93040,"t_proxy_recv":387287.341231293,"t_decision_unix":1779818152.3551726,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":93040,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":93040,"score_linear":145452.0,"score_lmetric":152899},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":123190,"ongoing_decode_tokens":123190,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":512,"new_prefill":92528,"score_linear":122678.0,"score_lmetric":185056},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":93040,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":93040,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":93040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":93040,"score_linear":187079.0,"score_lmetric":243822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":93040,"score_linear":33321.0,"score_lmetric":93040},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-31786,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":93040,"score_linear":-31786.0,"score_lmetric":0}],"chosen_score_linear":-31786.0,"chosen_score_lmetric":0,"t_first_token":387315.776692711,"t_first_token_unix":1779818180.7906368,"t_done":387317.895333744,"t_done_unix":1779818182.9092772},{"request_id":"1364090:5:1401054:756","session_id":"1364090","input_length":62630,"t_proxy_recv":387299.881863668,"t_decision_unix":1779818164.8958046,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49152,"affinity_cache_ratio":0.7847996167970621,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":13478,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":4096,"new_prefill":58534,"score_linear":141356.0,"score_lmetric":118393},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":7680,"new_prefill":54950,"score_linear":98463.0,"score_lmetric":54950},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2099,"cache_hit":0,"new_prefill":62630,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":94482,"ongoing_decode_tokens":31224,"pending_prefill_tokens":12058,"num_requests":2,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":7680,"new_prefill":54950,"score_linear":86802.0,"score_lmetric":134016},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":62630,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":62630,"score_linear":187079.0,"score_lmetric":183002},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79523,"ongoing_decode_tokens":11414,"pending_prefill_tokens":17421,"num_requests":2,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":49152,"new_prefill":13478,"score_linear":30371.0,"score_lmetric":61798},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":7680,"new_prefill":54950,"score_linear":53574.0,"score_lmetric":147990}],"chosen_score_linear":30371.0,"chosen_score_lmetric":61798,"t_first_token":387309.985169489,"t_first_token_unix":1779818174.9991128,"t_done":387318.0596789,"t_done_unix":1779818183.0736222},{"request_id":"1397223:1:1397223:734","session_id":"1397223","input_length":13134,"t_proxy_recv":387286.237785464,"t_decision_unix":1779818151.251727,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-13134,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13134,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":13134,"score_linear":145452.0,"score_lmetric":72993},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":123190,"ongoing_decode_tokens":0,"pending_prefill_tokens":18742,"num_requests":2,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":13134,"score_linear":123190.0,"score_lmetric":63752},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1944,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187079,"ongoing_decode_tokens":0,"pending_prefill_tokens":28871,"num_requests":2,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":13134,"score_linear":187079.0,"score_lmetric":84010},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1568,"cache_hit":0,"new_prefill":13134,"score_linear":33321.0,"score_lmetric":13134},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":13134,"score_linear":-44920.0,"score_lmetric":-13134}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-13134,"t_first_token":387287.33231821,"t_first_token_unix":1779818152.346262,"t_done":387319.651379882,"t_done_unix":1779818184.6653237},{"request_id":"1400379:4:1405483:779","session_id":"1400379","input_length":19966,"t_proxy_recv":387315.105550557,"t_decision_unix":1779818180.1194918,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":10752,"affinity_cache_ratio":0.5385154763097265,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":9214,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":19966,"score_linear":198917.0,"score_lmetric":46288},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117646,"ongoing_decode_tokens":106143,"pending_prefill_tokens":11503,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":19966,"score_linear":117646.0,"score_lmetric":62938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2125,"cache_hit":0,"new_prefill":19966,"score_linear":21684.0,"score_lmetric":19966},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":19966,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":0,"pending_prefill_tokens":32944,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":10752,"new_prefill":9214,"score_linear":22192.0,"score_lmetric":42158},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":19966,"score_linear":284898.0,"score_lmetric":108447},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":145048,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":19966,"score_linear":145048.0,"score_lmetric":59898},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":19966,"score_linear":61254.0,"score_lmetric":113006}],"chosen_score_linear":22192.0,"chosen_score_lmetric":42158,"t_first_token":387319.913760885,"t_first_token_unix":1779818184.9277048,"t_done":387320.301804889,"t_done_unix":1779818185.3157487},{"request_id":"1406966:1:1406966:785","session_id":"1406966","input_length":2115,"t_proxy_recv":387320.471833093,"t_decision_unix":1779818185.4857743,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-2115,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2115,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":2115,"score_linear":198917.0,"score_lmetric":10586},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":2115,"score_linear":106143.0,"score_lmetric":2115},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2128,"cache_hit":0,"new_prefill":2115,"score_linear":21684.0,"score_lmetric":2115},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":2115,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":54953,"ongoing_decode_tokens":32944,"pending_prefill_tokens":2041,"num_requests":2,"active_p_offloads":0,"cached_blocks":1764,"cache_hit":0,"new_prefill":2115,"score_linear":54953.0,"score_lmetric":8312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":2115,"score_linear":404875.0,"score_lmetric":39592},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":2115,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2177,"cache_hit":0,"new_prefill":2115,"score_linear":-44920.0,"score_lmetric":-2115}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-2115,"t_first_token":387320.611960626,"t_first_token_unix":1779818185.6259038,"t_done":387320.838012628,"t_done_unix":1779818185.8519561},{"request_id":"1399948:4:1407140:786","session_id":"1399948","input_length":8540,"t_proxy_recv":387321.011553541,"t_decision_unix":1779818186.0254948,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":7680,"affinity_cache_ratio":0.8992974238875878,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":860,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":8540,"score_linear":198917.0,"score_lmetric":23436},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":8540,"score_linear":106143.0,"score_lmetric":8540},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2128,"cache_hit":7680,"new_prefill":860,"score_linear":14004.0,"score_lmetric":860},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":8540,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":54953,"ongoing_decode_tokens":54953,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1764,"cache_hit":0,"new_prefill":8540,"score_linear":54953.0,"score_lmetric":17080},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":8540,"score_linear":404875.0,"score_lmetric":65292},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":8540,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2181,"cache_hit":0,"new_prefill":8540,"score_linear":-44920.0,"score_lmetric":-8540}],"chosen_score_linear":14004.0,"chosen_score_lmetric":860,"t_first_token":387321.106306577,"t_first_token_unix":1779818186.1202502,"t_done":387321.259936937,"t_done_unix":1779818186.2738802},{"request_id":"1400379:5:1406380:784","session_id":"1400379","input_length":22009,"t_proxy_recv":387320.312384863,"t_decision_unix":1779818185.3263261,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9072652096869462,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":2041,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":22009,"score_linear":198917.0,"score_lmetric":50374},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":22009,"score_linear":106143.0,"score_lmetric":22009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2128,"cache_hit":0,"new_prefill":22009,"score_linear":21684.0,"score_lmetric":22009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":22009,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1764,"cache_hit":19968,"new_prefill":2041,"score_linear":12976.0,"score_lmetric":2041},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":22009,"score_linear":404875.0,"score_lmetric":119168},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":22009,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2177,"cache_hit":0,"new_prefill":22009,"score_linear":-44920.0,"score_lmetric":-22009}],"chosen_score_linear":12976.0,"chosen_score_lmetric":2041,"t_first_token":387320.71119434,"t_first_token_unix":1779818185.7251377,"t_done":387321.261792299,"t_done_unix":1779818186.2757354},{"request_id":"1404395:1:1404395:770","session_id":"1404395","input_length":21684,"t_proxy_recv":387311.392883789,"t_decision_unix":1779818176.4068253,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":512,"new_prefill":21172,"score_linear":85147.0,"score_lmetric":21172},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":21684,"score_linear":106143.0,"score_lmetric":21684},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":21684,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63643,"ongoing_decode_tokens":63643,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":21684,"score_linear":63643.0,"score_lmetric":21684},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":44148,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":21684,"score_linear":44148.0,"score_lmetric":21684},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":199460,"ongoing_decode_tokens":101803,"pending_prefill_tokens":12153,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":21684,"score_linear":199460.0,"score_lmetric":67674},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":143649,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":512,"new_prefill":21172,"score_linear":143137.0,"score_lmetric":63516},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":21684,"score_linear":61254.0,"score_lmetric":114724}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387313.742362156,"t_first_token_unix":1779818178.756306,"t_done":387322.091078609,"t_done_unix":1779818187.105022},{"request_id":"1407494:1:1407494:787","session_id":"1407494","input_length":1531,"t_proxy_recv":387322.267960642,"t_decision_unix":1779818187.2819018,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-1531,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":1531,"score_linear":198917.0,"score_lmetric":9418},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":1531,"score_linear":106143.0,"score_lmetric":1531},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2173,"cache_hit":0,"new_prefill":1531,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":1531,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":1531,"score_linear":32944.0,"score_lmetric":1531},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":1531,"score_linear":404875.0,"score_lmetric":37256},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":1531,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2181,"cache_hit":0,"new_prefill":1531,"score_linear":-44920.0,"score_lmetric":-1531}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-1531,"t_first_token":387322.378487217,"t_first_token_unix":1779818187.3924303,"t_done":387322.642857659,"t_done_unix":1779818187.6568007},{"request_id":"1406966:2:1407710:789","session_id":"1406966","input_length":4789,"t_proxy_recv":387322.950197507,"t_decision_unix":1779818187.9641387,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":2048,"affinity_cache_ratio":0.42764669033201086,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":-2741,"tie_break_used":false,"cache_hit":2048,"estimated_new_tokens":2741,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":4789,"score_linear":198917.0,"score_lmetric":15934},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":4789,"score_linear":106143.0,"score_lmetric":4789},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1501,"ongoing_decode_tokens":1501,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2173,"cache_hit":0,"new_prefill":4789,"score_linear":1501.0,"score_lmetric":4789},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":4789,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":4789,"score_linear":32944.0,"score_lmetric":4789},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":4789,"score_linear":404875.0,"score_lmetric":50288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":4789,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2184,"cache_hit":2048,"new_prefill":2741,"score_linear":-46968.0,"score_lmetric":-2741}],"chosen_score_linear":-46968.0,"chosen_score_lmetric":-2741,"t_first_token":387323.154050119,"t_first_token_unix":1779818188.1679938,"t_done":387323.372425778,"t_done_unix":1779818188.3863695},{"request_id":"1407599:1:1407599:788","session_id":"1407599","input_length":1501,"t_proxy_recv":387322.616692506,"t_decision_unix":1779818187.630634,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1501,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":1501,"score_linear":198917.0,"score_lmetric":9358},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":1501,"score_linear":106143.0,"score_lmetric":1501},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2173,"cache_hit":0,"new_prefill":1501,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":1501,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":1501,"score_linear":32944.0,"score_lmetric":1501},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":1501,"score_linear":404875.0,"score_lmetric":37136},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":1501,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-43389,"ongoing_decode_tokens":1531,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2181,"cache_hit":0,"new_prefill":1501,"score_linear":-43389.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387322.723120506,"t_first_token_unix":1779818187.7370641,"t_done":387323.670266345,"t_done_unix":1779818188.6842105},{"request_id":"1399948:5:1407922:791","session_id":"1399948","input_length":8612,"t_proxy_recv":387323.78974791,"t_decision_unix":1779818188.8036892,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8192,"affinity_cache_ratio":0.9512308406874129,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":8612,"score_linear":198917.0,"score_lmetric":23580},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":106143,"pending_prefill_tokens":4580,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":8612,"score_linear":179331.0,"score_lmetric":26384},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2176,"cache_hit":8192,"new_prefill":420,"score_linear":-8192.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":8612,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":8612,"score_linear":32944.0,"score_lmetric":8612},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":8612,"score_linear":404875.0,"score_lmetric":65580},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":8612,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2189,"cache_hit":0,"new_prefill":8612,"score_linear":-44920.0,"score_lmetric":-8612}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":387323.833974929,"t_first_token_unix":1779818188.8479185,"t_done":387323.948746103,"t_done_unix":1779818188.9626896},{"request_id":"1407995:1:1407995:793","session_id":"1407995","input_length":2944,"t_proxy_recv":387324.105134381,"t_decision_unix":1779818189.1190758,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":-2944,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":2944,"score_linear":226593.0,"score_lmetric":35346},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":106143,"pending_prefill_tokens":4580,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":2944,"score_linear":179331.0,"score_lmetric":15048},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2176,"cache_hit":0,"new_prefill":2944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":2944,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":2944,"score_linear":32944.0,"score_lmetric":2944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":2944,"score_linear":404875.0,"score_lmetric":42908},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":2944,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2189,"cache_hit":0,"new_prefill":2944,"score_linear":-44920.0,"score_lmetric":-2944}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-2944,"t_first_token":387324.291227504,"t_first_token_unix":1779818189.3051713,"t_done":387324.668236009,"t_done_unix":1779818189.6821792},{"request_id":"1405155:1:1405155:775","session_id":"1405155","input_length":32944,"t_proxy_recv":387314.114247448,"t_decision_unix":1779818179.128189,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":32944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":32944,"score_linear":85659.0,"score_lmetric":32944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":32944,"score_linear":106143.0,"score_lmetric":32944},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60887,"ongoing_decode_tokens":60887,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":32944,"score_linear":60887.0,"score_lmetric":65888},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":32944,"score_linear":21009.0,"score_lmetric":53953},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":32944,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":32944,"score_linear":284898.0,"score_lmetric":147381},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":75540,"pending_prefill_tokens":1412,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":512,"new_prefill":32432,"score_linear":144536.0,"score_lmetric":101532},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":32944,"score_linear":61254.0,"score_lmetric":125984}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387319.808938676,"t_first_token_unix":1779818184.8228824,"t_done":387325.527779514,"t_done_unix":1779818190.5417228},{"request_id":"1403188:2:1408249:796","session_id":"1403188","input_length":14728,"t_proxy_recv":387325.032294994,"t_decision_unix":1779818190.0462365,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8704,"affinity_cache_ratio":0.5909831613253667,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":6024,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":14728,"score_linear":226593.0,"score_lmetric":70698},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":106143,"pending_prefill_tokens":4580,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":14728,"score_linear":179331.0,"score_lmetric":38616},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2176,"cache_hit":8704,"new_prefill":6024,"score_linear":-8704.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":14728,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":14728,"score_linear":32944.0,"score_lmetric":14728},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":14728,"score_linear":404875.0,"score_lmetric":90044},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":14728,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-17134,"ongoing_decode_tokens":0,"pending_prefill_tokens":27786,"num_requests":0,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":14728,"score_linear":-17134.0,"score_lmetric":0}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":387325.716212076,"t_first_token_unix":1779818190.7301557,"t_done":387325.99770675,"t_done_unix":1779818191.01165},{"request_id":"1408430:1:1408430:797","session_id":"1408430","input_length":7553,"t_proxy_recv":387325.616978479,"t_decision_unix":1779818190.63092,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":7553,"score_linear":226593.0,"score_lmetric":49173},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":179331,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":7553,"score_linear":179331.0,"score_lmetric":15106},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14728,"ongoing_decode_tokens":0,"pending_prefill_tokens":6024,"num_requests":1,"active_p_offloads":0,"cached_blocks":2176,"cache_hit":0,"new_prefill":7553,"score_linear":14728.0,"score_lmetric":13577},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":7553,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":7553,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":7553,"score_linear":404875.0,"score_lmetric":61344},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":7553,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-17134,"ongoing_decode_tokens":0,"pending_prefill_tokens":27786,"num_requests":0,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":7553,"score_linear":-17134.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387326.139758448,"t_first_token_unix":1779818191.1537023,"t_done":387326.335865228,"t_done_unix":1779818191.349809},{"request_id":"1363093:5:1407810:790","session_id":"1363093","input_length":73188,"t_proxy_recv":387323.403370119,"t_decision_unix":1779818188.417311,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":68608,"affinity_cache_ratio":0.9374214352079576,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68608,"estimated_new_tokens":4580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":73188,"score_linear":198917.0,"score_lmetric":152732},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":68608,"new_prefill":4580,"score_linear":37535.0,"score_lmetric":4580},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1501,"ongoing_decode_tokens":1501,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2173,"cache_hit":0,"new_prefill":73188,"score_linear":1501.0,"score_lmetric":73188},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":73188,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":73188,"score_linear":32944.0,"score_lmetric":73188},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":73188,"score_linear":404875.0,"score_lmetric":323884},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":73188,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2189,"cache_hit":0,"new_prefill":73188,"score_linear":-44920.0,"score_lmetric":-73188}],"chosen_score_linear":37535.0,"chosen_score_lmetric":4580,"t_first_token":387325.518423173,"t_first_token_unix":1779818190.5323665,"t_done":387326.477390246,"t_done_unix":1779818191.4913337},{"request_id":"1408889:1:1408889:804","session_id":"1408889","input_length":3230,"t_proxy_recv":387327.08347144,"t_decision_unix":1779818192.0974128,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3230,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":3230,"score_linear":226593.0,"score_lmetric":36204},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117213,"ongoing_decode_tokens":117213,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":3230,"score_linear":117213.0,"score_lmetric":6460},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2187,"cache_hit":0,"new_prefill":3230,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":3230,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":3230,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":3230,"score_linear":404875.0,"score_lmetric":44052},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79769,"ongoing_decode_tokens":6377,"pending_prefill_tokens":10416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":3230,"score_linear":79769.0,"score_lmetric":27292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-15333,"ongoing_decode_tokens":0,"pending_prefill_tokens":29587,"num_requests":1,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":3230,"score_linear":-15333.0,"score_lmetric":32817}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387327.284239784,"t_first_token_unix":1779818192.2981834,"t_done":387327.407703873,"t_done_unix":1779818192.4216473},{"request_id":"1362265:7:1408772:800","session_id":"1362265","input_length":11070,"t_proxy_recv":387326.697207088,"t_decision_unix":1779818191.711148,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9712737127371274,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":318,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":11070,"score_linear":226593.0,"score_lmetric":59724},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":10752,"new_prefill":318,"score_linear":95391.0,"score_lmetric":318},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2187,"cache_hit":0,"new_prefill":11070,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":11070,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":11070,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":6656,"new_prefill":4414,"score_linear":398219.0,"score_lmetric":48788},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6377,"ongoing_decode_tokens":6377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":11070,"score_linear":6377.0,"score_lmetric":11070},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-17134,"ongoing_decode_tokens":0,"pending_prefill_tokens":27786,"num_requests":0,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":11070,"score_linear":-17134.0,"score_lmetric":0}],"chosen_score_linear":95391.0,"chosen_score_lmetric":318,"t_first_token":387326.794597698,"t_first_token_unix":1779818191.8085408,"t_done":387327.906396905,"t_done_unix":1779818192.9203405},{"request_id":"1408779:1:1408779:802","session_id":"1408779","input_length":1801,"t_proxy_recv":387326.723708343,"t_decision_unix":1779818191.73765,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1801,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":1801,"score_linear":226593.0,"score_lmetric":31917},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117213,"ongoing_decode_tokens":106143,"pending_prefill_tokens":318,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":1801,"score_linear":117213.0,"score_lmetric":4238},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2187,"cache_hit":0,"new_prefill":1801,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":1801,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":1801,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":1801,"score_linear":404875.0,"score_lmetric":38336},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6377,"ongoing_decode_tokens":6377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":1801,"score_linear":6377.0,"score_lmetric":1801},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-17134,"ongoing_decode_tokens":0,"pending_prefill_tokens":27786,"num_requests":0,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":1801,"score_linear":-17134.0,"score_lmetric":0}],"chosen_score_linear":-17134.0,"chosen_score_lmetric":0,"t_first_token":387328.365463912,"t_first_token_unix":1779818193.3794072,"t_done":387328.687274943,"t_done_unix":1779818193.7012184},{"request_id":"1370129:6:1394177:722","session_id":"1370129","input_length":106143,"t_proxy_recv":387275.82289574,"t_decision_unix":1779818140.836837,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88064,"affinity_cache_ratio":0.8296731767521174,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":18079,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":23641,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":4096,"new_prefill":102047,"score_linear":141356.0,"score_lmetric":161906},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":88064,"new_prefill":18079,"score_linear":-88064.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":106143,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":7680,"new_prefill":98463,"score_linear":7603.0,"score_lmetric":98463},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":128201,"ongoing_decode_tokens":128201,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":106143,"score_linear":128201.0,"score_lmetric":106143},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":106143,"score_linear":101803.0,"score_lmetric":134730},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":82265,"ongoing_decode_tokens":48944,"pending_prefill_tokens":5161,"num_requests":2,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":7680,"new_prefill":98463,"score_linear":74585.0,"score_lmetric":207248},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61748,"ongoing_decode_tokens":101993,"pending_prefill_tokens":4675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1890,"cache_hit":7680,"new_prefill":98463,"score_linear":54068.0,"score_lmetric":103138}],"chosen_score_linear":-88064.0,"chosen_score_lmetric":0,"t_first_token":387286.790761072,"t_first_token_unix":1779818151.8047054,"t_done":387328.921700947,"t_done_unix":1779818193.9356444},{"request_id":"1340290:7:1408176:795","session_id":"1340290","input_length":27786,"t_proxy_recv":387324.771214297,"t_decision_unix":1779818189.7851555,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":7,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9766069243503923,"affinity_num_requests":3,"avg_num_requests":1.125,"fallback_score":-27786,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":27786,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":27136,"new_prefill":650,"score_linear":199457.0,"score_lmetric":28464},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":106143,"pending_prefill_tokens":4580,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":27786,"score_linear":179331.0,"score_lmetric":64732},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2176,"cache_hit":0,"new_prefill":27786,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":27786,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":27786,"score_linear":32944.0,"score_lmetric":27786},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":27786,"score_linear":404875.0,"score_lmetric":142276},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":1024,"new_prefill":26762,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":27786,"score_linear":-44920.0,"score_lmetric":-27786}],"chosen_score_linear":-44920.0,"chosen_score_lmetric":-27786,"t_first_token":387328.229811478,"t_first_token_unix":1779818193.2437556,"t_done":387329.088178639,"t_done_unix":1779818194.102122},{"request_id":"1340290:8:1409129:805","session_id":"1340290","input_length":29730,"t_proxy_recv":387329.09655199,"t_decision_unix":1779818194.1104932,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9299697275479314,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":2082,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":27136,"new_prefill":2594,"score_linear":199457.0,"score_lmetric":34296},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":29730,"score_linear":404875.0,"score_lmetric":150052},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":6377,"pending_prefill_tokens":12354,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":1024,"new_prefill":28706,"score_linear":150315.0,"score_lmetric":82120},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2251,"cache_hit":27648,"new_prefill":2082,"score_linear":-55434.0,"score_lmetric":-2082}],"chosen_score_linear":-55434.0,"chosen_score_lmetric":-2082,"t_first_token":387329.532748719,"t_first_token_unix":1779818194.5466924,"t_done":387330.799243229,"t_done_unix":1779818195.8131871},{"request_id":"1366128:20:1400446:752","session_id":"1366128","input_length":97657,"t_proxy_recv":387310.917952792,"t_decision_unix":1779818175.9318943,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":85504,"affinity_cache_ratio":0.8755542357434695,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":12153,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":145452,"ongoing_decode_tokens":145452,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1364,"cache_hit":0,"new_prefill":97657,"score_linear":145452.0,"score_lmetric":97657},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":97657,"score_linear":106143.0,"score_lmetric":97657},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":97657,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":97657,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":44148,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":97657,"score_linear":44148.0,"score_lmetric":97657},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":85504,"new_prefill":12153,"score_linear":16299.0,"score_lmetric":12153},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":130739,"pending_prefill_tokens":1646,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":97657,"score_linear":143649.0,"score_lmetric":297909},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":97657,"score_linear":61254.0,"score_lmetric":190697}],"chosen_score_linear":16299.0,"chosen_score_lmetric":12153,"t_first_token":387317.794061241,"t_first_token_unix":1779818182.8080046,"t_done":387331.540719375,"t_done_unix":1779818196.5546634},{"request_id":"1408779:2:1410032:807","session_id":"1408779","input_length":5001,"t_proxy_recv":387331.234486022,"t_decision_unix":1779818196.248427,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":1536,"affinity_cache_ratio":0.30713857228554287,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":-3465,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":3465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":5001,"score_linear":226593.0,"score_lmetric":41517},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":5001,"score_linear":404875.0,"score_lmetric":51136},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":6377,"pending_prefill_tokens":12354,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":5001,"score_linear":151339.0,"score_lmetric":34710},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2255,"cache_hit":1536,"new_prefill":3465,"score_linear":-29322.0,"score_lmetric":-3465}],"chosen_score_linear":-29322.0,"chosen_score_lmetric":-3465,"t_first_token":387331.465956973,"t_first_token_unix":1779818196.4799004,"t_done":387331.886199084,"t_done_unix":1779818196.9001422},{"request_id":"1406966:3:1410097:808","session_id":"1406966","input_length":7893,"t_proxy_recv":387331.468636416,"t_decision_unix":1779818196.482578,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.5838084378563284,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":3285,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":7893,"score_linear":226593.0,"score_lmetric":50193},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":7893,"score_linear":404875.0,"score_lmetric":62704},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":79769,"pending_prefill_tokens":1938,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":7893,"score_linear":151339.0,"score_lmetric":19662},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-22785,"ongoing_decode_tokens":5001,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2255,"cache_hit":4608,"new_prefill":3285,"score_linear":-27393.0,"score_lmetric":0}],"chosen_score_linear":-27393.0,"chosen_score_lmetric":0,"t_first_token":387331.746597744,"t_first_token_unix":1779818196.7605412,"t_done":387331.959577648,"t_done_unix":1779818196.9735212},{"request_id":"1407494:2:1410400:809","session_id":"1407494","input_length":4728,"t_proxy_recv":387332.332223615,"t_decision_unix":1779818197.346165,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":1536,"affinity_cache_ratio":0.3248730964467005,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":-3192,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":3192,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":4728,"score_linear":226593.0,"score_lmetric":40698},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":97814,"ongoing_decode_tokens":0,"pending_prefill_tokens":97814,"num_requests":1,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":4728,"score_linear":97814.0,"score_lmetric":102542},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":4728,"score_linear":307218.0,"score_lmetric":37533},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":151339,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":4728,"score_linear":151339.0,"score_lmetric":9456},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2267,"cache_hit":1536,"new_prefill":3192,"score_linear":-29322.0,"score_lmetric":-3192}],"chosen_score_linear":-29322.0,"chosen_score_lmetric":-3192,"t_first_token":387332.556339817,"t_first_token_unix":1779818197.5702827,"t_done":387332.691418808,"t_done_unix":1779818197.7053616},{"request_id":"1340290:9:1410595:811","session_id":"1340290","input_length":29958,"t_proxy_recv":387332.891113713,"t_decision_unix":1779818197.905055,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":29696,"affinity_cache_ratio":0.9912544228586688,"affinity_num_requests":-1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":262,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":27136,"new_prefill":2822,"score_linear":199457.0,"score_lmetric":34980},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":29958,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":102639,"ongoing_decode_tokens":0,"pending_prefill_tokens":99567,"num_requests":2,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":29958,"score_linear":102639.0,"score_lmetric":259050},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":29958,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":29958,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":29958,"score_linear":307218.0,"score_lmetric":113223},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":151339,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":1024,"new_prefill":28934,"score_linear":150315.0,"score_lmetric":57868},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":29696,"new_prefill":262,"score_linear":-57482.0,"score_lmetric":-262}],"chosen_score_linear":-57482.0,"chosen_score_lmetric":-262,"t_first_token":387332.95844481,"t_first_token_unix":1779818197.9723902,"t_done":387333.255192012,"t_done_unix":1779818198.2691355},{"request_id":"1381387:6:1409195:806","session_id":"1381387","input_length":71570,"t_proxy_recv":387328.35714495,"t_decision_unix":1779818193.3710864,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":69632,"affinity_cache_ratio":0.9729216152019002,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":1938,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":71570,"score_linear":226593.0,"score_lmetric":241224},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":0,"new_prefill":71570,"score_linear":106143.0,"score_lmetric":71570},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":71570,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":71570,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":512,"new_prefill":71058,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":71570,"score_linear":404875.0,"score_lmetric":317412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79769,"ongoing_decode_tokens":6377,"pending_prefill_tokens":10416,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":69632,"new_prefill":1938,"score_linear":10137.0,"score_lmetric":24708},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-15333,"ongoing_decode_tokens":27786,"pending_prefill_tokens":1801,"num_requests":1,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":71570,"score_linear":-15333.0,"score_lmetric":73371}],"chosen_score_linear":10137.0,"chosen_score_lmetric":24708,"t_first_token":387332.233889178,"t_first_token_unix":1779818197.2478325,"t_done":387333.801046373,"t_done_unix":1779818198.81499},{"request_id":"1408578:1:1408578:798","session_id":"1408578","input_length":6377,"t_proxy_recv":387326.038018007,"t_decision_unix":1779818191.0519595,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":6377,"score_linear":226593.0,"score_lmetric":45645},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":179331,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":6377,"score_linear":179331.0,"score_lmetric":12754},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2187,"cache_hit":0,"new_prefill":6377,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":6377,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":7553,"ongoing_decode_tokens":0,"pending_prefill_tokens":7553,"num_requests":1,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":0,"new_prefill":6377,"score_linear":7553.0,"score_lmetric":13930},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":6377,"score_linear":404875.0,"score_lmetric":56640},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":6377,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-17134,"ongoing_decode_tokens":0,"pending_prefill_tokens":27786,"num_requests":0,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":0,"new_prefill":6377,"score_linear":-17134.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387326.465482941,"t_first_token_unix":1779818191.4794266,"t_done":387334.172340403,"t_done_unix":1779818199.1862836},{"request_id":"1408779:3:1411249:815","session_id":"1408779","input_length":7110,"t_proxy_recv":387335.248780944,"t_decision_unix":1779818200.2627223,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.6481012658227848,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":2502,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":7110,"score_linear":226593.0,"score_lmetric":47844},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":7110,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":7110,"score_linear":114020.0,"score_lmetric":329598},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":7110,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":7110,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":7110,"score_linear":307218.0,"score_lmetric":44679},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73392,"ongoing_decode_tokens":73392,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1686,"cache_hit":0,"new_prefill":7110,"score_linear":73392.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":4608,"new_prefill":2502,"score_linear":-32394.0,"score_lmetric":-2502}],"chosen_score_linear":-32394.0,"chosen_score_lmetric":-2502,"t_first_token":387335.452171808,"t_first_token_unix":1779818200.4661148,"t_done":387335.604961342,"t_done_unix":1779818200.6189046},{"request_id":"1364090:6:1408777:801","session_id":"1364090","input_length":73392,"t_proxy_recv":387326.728823551,"t_decision_unix":1779818191.742765,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":62976,"affinity_cache_ratio":0.8580771746239372,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":10416,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":4096,"new_prefill":69296,"score_linear":222497.0,"score_lmetric":234402},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117213,"ongoing_decode_tokens":106143,"pending_prefill_tokens":318,"num_requests":2,"active_p_offloads":0,"cached_blocks":1503,"cache_hit":7680,"new_prefill":65712,"score_linear":109533.0,"score_lmetric":132060},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2187,"cache_hit":0,"new_prefill":73392,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":7680,"new_prefill":65712,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":73392,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":73392,"score_linear":404875.0,"score_lmetric":324700},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6377,"ongoing_decode_tokens":6377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":62976,"new_prefill":10416,"score_linear":-56599.0,"score_lmetric":10416},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-15333,"ongoing_decode_tokens":0,"pending_prefill_tokens":29587,"num_requests":1,"active_p_offloads":0,"cached_blocks":2194,"cache_hit":7680,"new_prefill":65712,"score_linear":-23013.0,"score_lmetric":95299}],"chosen_score_linear":-56599.0,"chosen_score_lmetric":10416,"t_first_token":387331.271847433,"t_first_token_unix":1779818196.285791,"t_done":387336.608642622,"t_done_unix":1779818201.6225863},{"request_id":"1340290:10:1411397:816","session_id":"1340290","input_length":30154,"t_proxy_recv":387335.876473183,"t_decision_unix":1779818200.8904145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":29696,"affinity_cache_ratio":0.9848113019831531,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":27136,"new_prefill":3018,"score_linear":199457.0,"score_lmetric":35568},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":30154,"score_linear":114020.0,"score_lmetric":398730},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":30154,"score_linear":307218.0,"score_lmetric":113811},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":73392,"ongoing_decode_tokens":73392,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1686,"cache_hit":1024,"new_prefill":29130,"score_linear":72368.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2277,"cache_hit":29696,"new_prefill":458,"score_linear":-57482.0,"score_lmetric":-458}],"chosen_score_linear":-57482.0,"chosen_score_lmetric":-458,"t_first_token":387335.994951203,"t_first_token_unix":1779818201.0088944,"t_done":387337.820641969,"t_done_unix":1779818202.8345852},{"request_id":"1407494:3:1413526:825","session_id":"1407494","input_length":9801,"t_proxy_recv":387343.283517931,"t_decision_unix":1779818208.297459,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.4701561065197429,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":5193,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":9801,"score_linear":226593.0,"score_lmetric":55917},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":9801,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":9801,"score_linear":114020.0,"score_lmetric":337671},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40273,"ongoing_decode_tokens":0,"pending_prefill_tokens":1873,"num_requests":1,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":9801,"score_linear":40273.0,"score_lmetric":11674},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":9801,"score_linear":107292.0,"score_lmetric":23909},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":9801,"score_linear":307218.0,"score_lmetric":40662},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":158801,"ongoing_decode_tokens":72608,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":0,"new_prefill":9801,"score_linear":158801.0,"score_lmetric":22266},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":7236,"ongoing_decode_tokens":35022,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2278,"cache_hit":4608,"new_prefill":5193,"score_linear":2628.0,"score_lmetric":0}],"chosen_score_linear":2628.0,"chosen_score_lmetric":0,"t_first_token":387343.755903051,"t_first_token_unix":1779818208.7698464,"t_done":387344.268894846,"t_done_unix":1779818209.2828383},{"request_id":"1340290:11:1413050:822","session_id":"1340290","input_length":35022,"t_proxy_recv":387341.492592062,"t_decision_unix":1779818206.506533,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30208,"affinity_cache_ratio":0.8625435440580207,"affinity_num_requests":-1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":30208,"estimated_new_tokens":4814,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":27136,"new_prefill":7886,"score_linear":199457.0,"score_lmetric":50172},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":35022,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":35022,"score_linear":114020.0,"score_lmetric":413334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40273,"ongoing_decode_tokens":0,"pending_prefill_tokens":1873,"num_requests":1,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":35022,"score_linear":40273.0,"score_lmetric":36895},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":35022,"score_linear":107292.0,"score_lmetric":49130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":35022,"score_linear":307218.0,"score_lmetric":116325},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":158801,"ongoing_decode_tokens":72608,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":1024,"new_prefill":33998,"score_linear":157777.0,"score_lmetric":46463},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2278,"cache_hit":30208,"new_prefill":4814,"score_linear":-57994.0,"score_lmetric":-4814}],"chosen_score_linear":-57994.0,"chosen_score_lmetric":-4814,"t_first_token":387342.600821939,"t_first_token_unix":1779818207.6147661,"t_done":387344.82019649,"t_done_unix":1779818209.8341398},{"request_id":"1277428:8:1412675:821","session_id":"1277428","input_length":40273,"t_proxy_recv":387340.21112666,"t_decision_unix":1779818205.2250679,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9534924142725896,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":1873,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":40273,"score_linear":226593.0,"score_lmetric":147333},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":4608,"new_prefill":35665,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":40273,"score_linear":114020.0,"score_lmetric":429087},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":38400,"new_prefill":1873,"score_linear":-38400.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":40273,"score_linear":107292.0,"score_lmetric":54381},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":40273,"score_linear":307218.0,"score_lmetric":132078},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":158801,"ongoing_decode_tokens":72608,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":0,"new_prefill":40273,"score_linear":158801.0,"score_lmetric":52738},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2278,"cache_hit":0,"new_prefill":40273,"score_linear":-27786.0,"score_lmetric":-40273}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":387344.989850309,"t_first_token_unix":1779818210.0037937,"t_done":387346.333887489,"t_done_unix":1779818211.347831},{"request_id":"1407995:2:1413725:826","session_id":"1407995","input_length":22392,"t_proxy_recv":387343.915767912,"t_decision_unix":1779818208.9297092,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":1,"affinity_cache_hit":2560,"affinity_cache_ratio":0.1143265451947124,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":22392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":22392,"score_linear":226593.0,"score_lmetric":93690},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":22392,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":22392,"score_linear":114020.0,"score_lmetric":375444},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40273,"ongoing_decode_tokens":0,"pending_prefill_tokens":1873,"num_requests":1,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":22392,"score_linear":40273.0,"score_lmetric":24265},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":22392,"score_linear":107292.0,"score_lmetric":36500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":22392,"score_linear":307218.0,"score_lmetric":78435},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":158801,"ongoing_decode_tokens":72608,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":0,"new_prefill":22392,"score_linear":158801.0,"score_lmetric":34857},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":17037,"ongoing_decode_tokens":44823,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2278,"cache_hit":2560,"new_prefill":19832,"score_linear":14477.0,"score_lmetric":19832}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387346.36367115,"t_first_token_unix":1779818211.3776143,"t_done":387346.792693578,"t_done_unix":1779818211.8066366},{"request_id":"1364090:7:1412644:820","session_id":"1364090","input_length":86193,"t_proxy_recv":387340.112136505,"t_decision_unix":1779818205.1260774,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":73728,"affinity_cache_ratio":0.8553826876892555,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":12465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":4096,"new_prefill":82097,"score_linear":222497.0,"score_lmetric":272805},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":7680,"new_prefill":78513,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":86193,"score_linear":114020.0,"score_lmetric":566847},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":7680,"new_prefill":78513,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":86193,"score_linear":107292.0,"score_lmetric":100301},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":86193,"score_linear":307218.0,"score_lmetric":269838},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":73728,"new_prefill":12465,"score_linear":-1120.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2278,"cache_hit":7680,"new_prefill":78513,"score_linear":-35466.0,"score_lmetric":-78513}],"chosen_score_linear":-1120.0,"chosen_score_lmetric":0,"t_first_token":387346.401458495,"t_first_token_unix":1779818211.415402,"t_done":387353.67511411,"t_done_unix":1779818218.6890578},{"request_id":"1313181:7:1382851:662","session_id":"1313181","input_length":62018,"t_proxy_recv":387311.134805298,"t_decision_unix":1779818176.148747,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9989357928343384,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":66,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":61952,"new_prefill":66,"score_linear":-38311.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":62018,"score_linear":106143.0,"score_lmetric":62018},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":62018,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63643,"ongoing_decode_tokens":0,"pending_prefill_tokens":667,"num_requests":1,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":12800,"new_prefill":49218,"score_linear":50843.0,"score_lmetric":49885},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44148,"ongoing_decode_tokens":44148,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":62018,"score_linear":44148.0,"score_lmetric":62018},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":199460,"ongoing_decode_tokens":101803,"pending_prefill_tokens":12153,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":24064,"new_prefill":37954,"score_linear":175396.0,"score_lmetric":100214},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":143649,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":62018,"score_linear":143649.0,"score_lmetric":186054},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":12800,"new_prefill":49218,"score_linear":48454.0,"score_lmetric":142258}],"chosen_score_linear":-38311.0,"chosen_score_lmetric":0,"t_first_token":387311.228460847,"t_first_token_unix":1779818176.2424045,"t_done":387360.734447735,"t_done_unix":1779818225.7483914},{"request_id":"1363943:9:1390468:707","session_id":"1363943","input_length":23641,"t_proxy_recv":387274.393555056,"t_decision_unix":1779818139.4074967,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9096061926314454,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":2137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":61543,"ongoing_decode_tokens":61543,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1363,"cache_hit":21504,"new_prefill":2137,"score_linear":40039.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":4096,"new_prefill":19545,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":23641,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":4096,"new_prefill":19545,"score_linear":11187.0,"score_lmetric":19545},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":127267,"ongoing_decode_tokens":127267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1702,"cache_hit":0,"new_prefill":23641,"score_linear":127267.0,"score_lmetric":23641},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":0,"pending_prefill_tokens":28587,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":23641,"score_linear":101803.0,"score_lmetric":52228},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":4096,"new_prefill":19545,"score_linear":44848.0,"score_lmetric":19545},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":128972,"ongoing_decode_tokens":173892,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":4096,"new_prefill":19545,"score_linear":124876.0,"score_lmetric":19545}],"chosen_score_linear":40039.0,"chosen_score_lmetric":0,"t_first_token":387274.764023706,"t_first_token_unix":1779818139.7779675,"t_done":387362.720758285,"t_done_unix":1779818227.734702},{"request_id":"1286804:5:1407989:792","session_id":"1286804","input_length":27676,"t_proxy_recv":387324.058887024,"t_decision_unix":1779818189.0728288,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":22016,"affinity_cache_ratio":0.795490677843619,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":5660,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":22016,"new_prefill":5660,"score_linear":176901.0,"score_lmetric":17676},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":179331,"ongoing_decode_tokens":106143,"pending_prefill_tokens":4580,"num_requests":2,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":27676,"score_linear":179331.0,"score_lmetric":64512},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2176,"cache_hit":512,"new_prefill":27164,"score_linear":-512.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":27676,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":32944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1768,"cache_hit":0,"new_prefill":27676,"score_linear":32944.0,"score_lmetric":27676},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":404875,"ongoing_decode_tokens":199460,"pending_prefill_tokens":7783,"num_requests":4,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":27676,"score_linear":404875.0,"score_lmetric":141836},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":2560,"new_prefill":25116,"score_linear":-2560.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2189,"cache_hit":0,"new_prefill":27676,"score_linear":-44920.0,"score_lmetric":-27676}],"chosen_score_linear":176901.0,"chosen_score_lmetric":17676,"t_first_token":387359.372407578,"t_first_token_unix":1779818224.386351,"t_done":387362.975375791,"t_done_unix":1779818227.9893193},{"request_id":"1399948:6:1410696:812","session_id":"1399948","input_length":11381,"t_proxy_recv":387333.220584997,"t_decision_unix":1779818198.2345264,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8192,"affinity_cache_ratio":0.7197961514805378,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":3189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":11381,"score_linear":226593.0,"score_lmetric":60657},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":102639,"ongoing_decode_tokens":0,"pending_prefill_tokens":99567,"num_requests":2,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":8192,"new_prefill":3189,"score_linear":94447.0,"score_lmetric":205512},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":11381,"score_linear":307218.0,"score_lmetric":57492},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":151339,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":11381,"score_linear":151339.0,"score_lmetric":22762},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2172,"ongoing_decode_tokens":29958,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":11381,"score_linear":2172.0,"score_lmetric":0}],"chosen_score_linear":94447.0,"chosen_score_lmetric":205512,"t_first_token":387363.286895967,"t_first_token_unix":1779818228.3008392,"t_done":387363.480785068,"t_done_unix":1779818228.494728},{"request_id":"1366128:21:1402408:760","session_id":"1366128","input_length":97814,"t_proxy_recv":387331.555662767,"t_decision_unix":1779818196.5696044,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":2,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9945406588013985,"affinity_num_requests":3,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":97814,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":97814,"score_linear":226593.0,"score_lmetric":319956},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":97814,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":97814,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":97814,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":97814,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":97280,"new_prefill":534,"score_linear":209938.0,"score_lmetric":24951},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":79769,"pending_prefill_tokens":1938,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":97814,"score_linear":151339.0,"score_lmetric":199504},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-14892,"ongoing_decode_tokens":5001,"pending_prefill_tokens":3285,"num_requests":1,"active_p_offloads":0,"cached_blocks":2255,"cache_hit":0,"new_prefill":97814,"score_linear":-14892.0,"score_lmetric":101099}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387362.932671686,"t_first_token_unix":1779818227.9466155,"t_done":387363.834712617,"t_done_unix":1779818228.8486574},{"request_id":"1408889:2:1410453:810","session_id":"1408889","input_length":4825,"t_proxy_recv":387332.470361309,"t_decision_unix":1779818197.4843028,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":3072,"affinity_cache_ratio":0.6366839378238341,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":1753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":4825,"score_linear":226593.0,"score_lmetric":40989},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":4825,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":97814,"ongoing_decode_tokens":0,"pending_prefill_tokens":97814,"num_requests":1,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":3072,"new_prefill":1753,"score_linear":94742.0,"score_lmetric":99567},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":4825,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":4825,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":101803,"pending_prefill_tokens":7783,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":4825,"score_linear":307218.0,"score_lmetric":37824},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":151339,"ongoing_decode_tokens":151339,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":4825,"score_linear":151339.0,"score_lmetric":9650},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-23058,"ongoing_decode_tokens":0,"pending_prefill_tokens":3192,"num_requests":0,"active_p_offloads":0,"cached_blocks":2267,"cache_hit":0,"new_prefill":4825,"score_linear":-23058.0,"score_lmetric":0}],"chosen_score_linear":94742.0,"chosen_score_lmetric":99567,"t_first_token":387363.28833455,"t_first_token_unix":1779818228.3022776,"t_done":387364.055292738,"t_done_unix":1779818229.0692365},{"request_id":"1399948:7:1413205:824","session_id":"1399948","input_length":11537,"t_proxy_recv":387363.48522267,"t_decision_unix":1779818228.499164,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9763370026870071,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":273,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":11537,"score_linear":137700.0,"score_lmetric":11537},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":11537,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":102639,"ongoing_decode_tokens":102639,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2199,"cache_hit":11264,"new_prefill":273,"score_linear":91375.0,"score_lmetric":546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":11537,"score_linear":124090.0,"score_lmetric":122827},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":11537,"score_linear":147622.0,"score_lmetric":65390},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":11537,"score_linear":344616.0,"score_lmetric":61248},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":11537,"score_linear":169457.0,"score_lmetric":11537},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":11537,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":91375.0,"chosen_score_lmetric":546,"t_first_token":387363.56462943,"t_first_token_unix":1779818228.578573,"t_done":387364.141392385,"t_done_unix":1779818229.1553357},{"request_id":"1366128:22:1403837:766","session_id":"1366128","input_length":97917,"t_proxy_recv":387363.852463364,"t_decision_unix":1779818228.8664045,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9987234086011622,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":125,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":97917,"score_linear":137700.0,"score_lmetric":97917},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":97917,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16362,"ongoing_decode_tokens":16362,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2390,"cache_hit":97792,"new_prefill":125,"score_linear":-81430.0,"score_lmetric":250},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":97917,"score_linear":124090.0,"score_lmetric":209207},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":97917,"score_linear":147622.0,"score_lmetric":238150},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":97280,"new_prefill":637,"score_linear":247336.0,"score_lmetric":17648},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":97917,"score_linear":169457.0,"score_lmetric":97917},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":97917,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":-81430.0,"chosen_score_lmetric":250,"t_first_token":387364.052454486,"t_first_token_unix":1779818229.0663981,"t_done":387364.143783149,"t_done_unix":1779818229.1577272},{"request_id":"1373577:3:1404917:774","session_id":"1373577","input_length":85438,"t_proxy_recv":387313.285121581,"t_decision_unix":1779818178.2990623,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9528312928673424,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":4030,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":85438,"score_linear":85659.0,"score_lmetric":85438},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":85438,"score_linear":106143.0,"score_lmetric":85438},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60887,"ongoing_decode_tokens":0,"pending_prefill_tokens":22999,"num_requests":2,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":2560,"new_prefill":82878,"score_linear":58327.0,"score_lmetric":211754},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":85438,"score_linear":21009.0,"score_lmetric":106447},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":85438,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":199460,"ongoing_decode_tokens":101803,"pending_prefill_tokens":12153,"num_requests":2,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":81408,"new_prefill":4030,"score_linear":118052.0,"score_lmetric":32366},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":143649,"ongoing_decode_tokens":143649,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":85438,"score_linear":143649.0,"score_lmetric":256314},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":85438,"score_linear":61254.0,"score_lmetric":178478}],"chosen_score_linear":118052.0,"chosen_score_lmetric":32366,"t_first_token":387336.587714472,"t_first_token_unix":1779818201.601658,"t_done":387365.913904144,"t_done_unix":1779818230.9278479},{"request_id":"1408889:3:1414177:827","session_id":"1408889","input_length":10633,"t_proxy_recv":387364.065840777,"t_decision_unix":1779818229.0797825,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.43336781717295214,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10633,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":10633,"score_linear":137700.0,"score_lmetric":10633},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":10633,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109454,"ongoing_decode_tokens":109454,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":4608,"new_prefill":6025,"score_linear":104846.0,"score_lmetric":12050},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":10633,"score_linear":124090.0,"score_lmetric":121923},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":10633,"score_linear":147622.0,"score_lmetric":63582},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":10633,"score_linear":344616.0,"score_lmetric":57632},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":10633,"score_linear":169457.0,"score_lmetric":10633},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":10633,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":15977.0,"chosen_score_lmetric":0,"t_first_token":387364.912515094,"t_first_token_unix":1779818229.9264593,"t_done":387366.592050635,"t_done_unix":1779818231.6059942},{"request_id":"1362265:8:1419710:834","session_id":"1362265","input_length":11132,"t_proxy_recv":387364.998769568,"t_decision_unix":1779818230.0127106,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9658641753503413,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":380,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":11132,"score_linear":137700.0,"score_lmetric":11132},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":0,"pending_prefill_tokens":25523,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":10752,"new_prefill":380,"score_linear":21427.0,"score_lmetric":25903},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109574,"ongoing_decode_tokens":0,"pending_prefill_tokens":11782,"num_requests":1,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":0,"new_prefill":11132,"score_linear":109574.0,"score_lmetric":22914},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":11132,"score_linear":124090.0,"score_lmetric":122422},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":11132,"score_linear":147622.0,"score_lmetric":64580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":6656,"new_prefill":4476,"score_linear":337960.0,"score_lmetric":33004},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":11132,"score_linear":169457.0,"score_lmetric":11132},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26610,"ongoing_decode_tokens":54396,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":11132,"score_linear":26610.0,"score_lmetric":11132}],"chosen_score_linear":21427.0,"chosen_score_lmetric":25903,"t_first_token":387368.828375,"t_first_token_unix":1779818233.842318,"t_done":387369.157128168,"t_done_unix":1779818234.1710722},{"request_id":"1364090:8:1417347:830","session_id":"1364090","input_length":96849,"t_proxy_recv":387356.766755166,"t_decision_unix":1779818221.7806964,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":86528,"affinity_cache_ratio":0.893432043696889,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":86528,"estimated_new_tokens":10321,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":198917,"pending_prefill_tokens":5660,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":4096,"new_prefill":92753,"score_linear":222497.0,"score_lmetric":295239},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":7680,"new_prefill":89169,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":96849,"score_linear":114020.0,"score_lmetric":598815},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":7680,"new_prefill":89169,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":96849,"score_linear":147622.0,"score_lmetric":236014},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":96849,"score_linear":307218.0,"score_lmetric":301806},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":86528,"new_prefill":10321,"score_linear":-13920.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":0,"pending_prefill_tokens":2803,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":7680,"new_prefill":89169,"score_linear":8297.0,"score_lmetric":0}],"chosen_score_linear":-13920.0,"chosen_score_lmetric":0,"t_first_token":387362.732172257,"t_first_token_unix":1779818227.746116,"t_done":387369.509019597,"t_done_unix":1779818234.5229638},{"request_id":"1363943:10:1401002:755","session_id":"1363943","input_length":24442,"t_proxy_recv":387362.727767209,"t_decision_unix":1779818227.7417088,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9845348171180754,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":378,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":140934,"ongoing_decode_tokens":140934,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1401,"cache_hit":24064,"new_prefill":378,"score_linear":116870.0,"score_lmetric":378},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":4096,"new_prefill":20346,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":24442,"score_linear":114020.0,"score_lmetric":381594},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":4096,"new_prefill":20346,"score_linear":119994.0,"score_lmetric":131636},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":24442,"score_linear":147622.0,"score_lmetric":91200},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":24442,"score_linear":344616.0,"score_lmetric":112868},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":72608,"pending_prefill_tokens":10321,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":4096,"new_prefill":20346,"score_linear":165361.0,"score_lmetric":30667},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":0,"pending_prefill_tokens":2803,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":4096,"new_prefill":20346,"score_linear":11881.0,"score_lmetric":0}],"chosen_score_linear":116870.0,"chosen_score_lmetric":378,"t_first_token":387362.831342118,"t_first_token_unix":1779818227.8452864,"t_done":387371.269426532,"t_done_unix":1779818236.2833707},{"request_id":"1340290:12:1421294:835","session_id":"1340290","input_length":35303,"t_proxy_recv":387370.648439138,"t_decision_unix":1779818235.6623802,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9862051383735093,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":487,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":27136,"new_prefill":8167,"score_linear":110564.0,"score_lmetric":8167},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":35303,"score_linear":32179.0,"score_lmetric":35303},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109574,"ongoing_decode_tokens":0,"pending_prefill_tokens":11782,"num_requests":1,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":0,"new_prefill":35303,"score_linear":109574.0,"score_lmetric":47085},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":35303,"score_linear":124090.0,"score_lmetric":146593},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":35303,"score_linear":147622.0,"score_lmetric":112922},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":35303,"score_linear":349996.0,"score_lmetric":177568},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":1024,"new_prefill":34279,"score_linear":71584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":34816,"new_prefill":487,"score_linear":-18839.0,"score_lmetric":0}],"chosen_score_linear":-18839.0,"chosen_score_lmetric":0,"t_first_token":387370.740272852,"t_first_token_unix":1779818235.7542162,"t_done":387372.80397398,"t_done_unix":1779818237.817917},{"request_id":"1366128:23:1405900:781","session_id":"1366128","input_length":109574,"t_proxy_recv":387364.167164563,"t_decision_unix":1779818229.1811059,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":97792,"affinity_cache_ratio":0.8924744921240441,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":11782,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":109574,"score_linear":137700.0,"score_lmetric":109574},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":109574,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":97792,"new_prefill":11782,"score_linear":-97792.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":109574,"score_linear":124090.0,"score_lmetric":220864},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":109574,"score_linear":147622.0,"score_lmetric":261464},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":97280,"new_prefill":12294,"score_linear":247336.0,"score_lmetric":64276},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":109574,"score_linear":169457.0,"score_lmetric":109574},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26610,"ongoing_decode_tokens":43763,"pending_prefill_tokens":10633,"num_requests":1,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":109574,"score_linear":26610.0,"score_lmetric":120207}],"chosen_score_linear":-97792.0,"chosen_score_lmetric":0,"t_first_token":387371.748081528,"t_first_token_unix":1779818236.762025,"t_done":387372.869925908,"t_done_unix":1779818237.88387},{"request_id":"1366128:24:1407996:794","session_id":"1366128","input_length":109775,"t_proxy_recv":387372.887931946,"t_decision_unix":1779818237.9018734,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":109568,"affinity_cache_ratio":0.998114324755181,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":109568,"estimated_new_tokens":207,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113258,"ongoing_decode_tokens":113258,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1413,"cache_hit":0,"new_prefill":109775,"score_linear":113258.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":109775,"score_linear":32179.0,"score_lmetric":109775},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2416,"cache_hit":109568,"new_prefill":207,"score_linear":-109568.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":109775,"score_linear":124090.0,"score_lmetric":221065},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":196930,"ongoing_decode_tokens":0,"pending_prefill_tokens":26434,"num_requests":3,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":109775,"score_linear":196930.0,"score_lmetric":408627},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":97280,"new_prefill":12495,"score_linear":252716.0,"score_lmetric":86336},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":109775,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2319,"cache_hit":0,"new_prefill":109775,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":-109568.0,"chosen_score_lmetric":0,"t_first_token":387373.101359678,"t_first_token_unix":1779818238.1153033,"t_done":387373.453129502,"t_done_unix":1779818238.4670732},{"request_id":"1362265:9:1422050:838","session_id":"1362265","input_length":11879,"t_proxy_recv":387373.471600373,"t_decision_unix":1779818238.4855418,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9051266941661756,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":1127,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113258,"ongoing_decode_tokens":113258,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1413,"cache_hit":0,"new_prefill":11879,"score_linear":113258.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":10752,"new_prefill":1127,"score_linear":21427.0,"score_lmetric":1127},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2416,"cache_hit":0,"new_prefill":11879,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":11879,"score_linear":124090.0,"score_lmetric":123169},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":196930,"ongoing_decode_tokens":0,"pending_prefill_tokens":26434,"num_requests":3,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":11879,"score_linear":196930.0,"score_lmetric":114939},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":6656,"new_prefill":5223,"score_linear":343340.0,"score_lmetric":57248},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":11879,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2319,"cache_hit":0,"new_prefill":11879,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":21427.0,"chosen_score_lmetric":1127,"t_first_token":387373.634110951,"t_first_token_unix":1779818238.6480546,"t_done":387373.899817265,"t_done_unix":1779818238.9137611},{"request_id":"1264679:2:1405259:777","session_id":"1264679","input_length":113258,"t_proxy_recv":387314.418469891,"t_decision_unix":1779818179.4324112,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":110080,"affinity_cache_ratio":0.9719401719966801,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":110080,"estimated_new_tokens":3178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":85659,"ongoing_decode_tokens":85659,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":110080,"new_prefill":3178,"score_linear":-24421.0,"score_lmetric":3178},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117646,"ongoing_decode_tokens":106143,"pending_prefill_tokens":11503,"num_requests":2,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":113258,"score_linear":117646.0,"score_lmetric":249522},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60887,"ongoing_decode_tokens":60887,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2120,"cache_hit":0,"new_prefill":113258,"score_linear":60887.0,"score_lmetric":226516},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21009,"ongoing_decode_tokens":0,"pending_prefill_tokens":21009,"num_requests":1,"active_p_offloads":0,"cached_blocks":1979,"cache_hit":0,"new_prefill":113258,"score_linear":21009.0,"score_lmetric":134267},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32944,"ongoing_decode_tokens":0,"pending_prefill_tokens":32944,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":113258,"score_linear":32944.0,"score_lmetric":146202},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":113258,"score_linear":284898.0,"score_lmetric":388323},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":75540,"pending_prefill_tokens":1412,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":113258,"score_linear":145048.0,"score_lmetric":344010},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":13134,"pending_prefill_tokens":93040,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":113258,"score_linear":61254.0,"score_lmetric":206298}],"chosen_score_linear":-24421.0,"chosen_score_lmetric":3178,"t_first_token":387356.008402403,"t_first_token_unix":1779818221.0223458,"t_done":387374.437992819,"t_done_unix":1779818239.4519365},{"request_id":"1270340:5:1417075:829","session_id":"1270340","input_length":43763,"t_proxy_recv":387355.964617035,"t_decision_unix":1779818220.9785583,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40960,"affinity_cache_ratio":0.9359504604346137,"affinity_num_requests":-1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":40960,"estimated_new_tokens":2803,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":43763,"score_linear":226593.0,"score_lmetric":157803},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":43763,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":43763,"score_linear":114020.0,"score_lmetric":439557},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":43763,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":1536,"new_prefill":42227,"score_linear":146086.0,"score_lmetric":126770},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":43763,"score_linear":307218.0,"score_lmetric":142548},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":43763,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":40960,"new_prefill":2803,"score_linear":-68746.0,"score_lmetric":-2803}],"chosen_score_linear":-68746.0,"chosen_score_lmetric":-2803,"t_first_token":387363.412824397,"t_first_token_unix":1779818228.4267676,"t_done":387375.904862799,"t_done_unix":1779818240.9188068},{"request_id":"1366128:25:1411126:813","session_id":"1366128","input_length":117746,"t_proxy_recv":387373.480384609,"t_decision_unix":1779818238.4943259,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":109568,"affinity_cache_ratio":0.9305454113090891,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":109568,"estimated_new_tokens":8178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113258,"ongoing_decode_tokens":113258,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1413,"cache_hit":0,"new_prefill":117746,"score_linear":113258.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44058,"ongoing_decode_tokens":32179,"pending_prefill_tokens":1127,"num_requests":2,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":117746,"score_linear":44058.0,"score_lmetric":237746},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2416,"cache_hit":109568,"new_prefill":8178,"score_linear":-109568.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":117746,"score_linear":124090.0,"score_lmetric":229036},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":196930,"ongoing_decode_tokens":0,"pending_prefill_tokens":26434,"num_requests":3,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":117746,"score_linear":196930.0,"score_lmetric":432540},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":97280,"new_prefill":20466,"score_linear":252716.0,"score_lmetric":118220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":117746,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2319,"cache_hit":0,"new_prefill":117746,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":-109568.0,"chosen_score_lmetric":0,"t_first_token":387379.034508495,"t_first_token_unix":1779818244.0484524,"t_done":387379.487136469,"t_done_unix":1779818244.5010805},{"request_id":"1364128:3:1419644:833","session_id":"1364128","input_length":32179,"t_proxy_recv":387364.775960193,"t_decision_unix":1779818229.7899015,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":1,"affinity_cache_hit":8704,"affinity_cache_ratio":0.2704869635476553,"affinity_num_requests":4,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":25523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":32179,"score_linear":137700.0,"score_lmetric":32179},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":6656,"new_prefill":25523,"score_linear":-6656.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109574,"ongoing_decode_tokens":0,"pending_prefill_tokens":11782,"num_requests":1,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":0,"new_prefill":32179,"score_linear":109574.0,"score_lmetric":43961},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":32179,"score_linear":124090.0,"score_lmetric":143469},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":32179,"score_linear":147622.0,"score_lmetric":106674},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":8704,"new_prefill":23475,"score_linear":335912.0,"score_lmetric":109000},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":32179,"score_linear":169457.0,"score_lmetric":32179},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26610,"ongoing_decode_tokens":43763,"pending_prefill_tokens":10633,"num_requests":1,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":32179,"score_linear":26610.0,"score_lmetric":42812}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":387368.824979955,"t_first_token_unix":1779818233.8389235,"t_done":387379.600072137,"t_done_unix":1779818244.6140153},{"request_id":"1270606:2:1411654:817","session_id":"1270606","input_length":107292,"t_proxy_recv":387336.896316055,"t_decision_unix":1779818201.9102576,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":93184,"affinity_cache_ratio":0.8685083696827349,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":14108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":107292,"score_linear":226593.0,"score_lmetric":348390},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":107292,"score_linear":114020.0,"score_lmetric":630144},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":93184,"new_prefill":14108,"score_linear":-93184.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":107292,"score_linear":307218.0,"score_lmetric":333135},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":-107292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2368,"ongoing_decode_tokens":30154,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2277,"cache_hit":1536,"new_prefill":105756,"score_linear":832.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":387376.164090192,"t_first_token_unix":1779818241.1780336,"t_done":387379.798693508,"t_done_unix":1779818244.812637},{"request_id":"1268861:9:1421319:836","session_id":"1268861","input_length":49308,"t_proxy_recv":387370.730937499,"t_decision_unix":1779818235.7448788,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":44032,"affinity_cache_ratio":0.8929991076498742,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":5276,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":49308,"score_linear":137700.0,"score_lmetric":49308},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":49308,"score_linear":32179.0,"score_lmetric":49308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109574,"ongoing_decode_tokens":0,"pending_prefill_tokens":11782,"num_requests":1,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":0,"new_prefill":49308,"score_linear":109574.0,"score_lmetric":61090},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":49308,"score_linear":124090.0,"score_lmetric":160598},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":44032,"new_prefill":5276,"score_linear":103590.0,"score_lmetric":52868},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":49308,"score_linear":349996.0,"score_lmetric":233588},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":49308,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":51280,"ongoing_decode_tokens":43763,"pending_prefill_tokens":487,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":49308,"score_linear":51280.0,"score_lmetric":49795}],"chosen_score_linear":103590.0,"chosen_score_lmetric":52868,"t_first_token":387377.668038765,"t_first_token_unix":1779818242.6819828,"t_done":387380.802077793,"t_done_unix":1779818245.816022},{"request_id":"1405155:2:1414214:828","session_id":"1405155","input_length":40330,"t_proxy_recv":387345.56389919,"t_decision_unix":1779818210.5778403,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33280,"affinity_cache_ratio":0.825192164641706,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":7050,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":40330,"score_linear":226593.0,"score_lmetric":147504},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":22392,"ongoing_decode_tokens":0,"pending_prefill_tokens":22392,"num_requests":1,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":40330,"score_linear":22392.0,"score_lmetric":62722},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":40330,"score_linear":114020.0,"score_lmetric":429258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":40273,"ongoing_decode_tokens":40273,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":40330,"score_linear":40273.0,"score_lmetric":40330},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":33280,"new_prefill":7050,"score_linear":74012.0,"score_lmetric":21158},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":40330,"score_linear":307218.0,"score_lmetric":132249},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":158801,"ongoing_decode_tokens":72608,"pending_prefill_tokens":12465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":512,"new_prefill":39818,"score_linear":158289.0,"score_lmetric":52283},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":40330,"score_linear":-27786.0,"score_lmetric":-40330}],"chosen_score_linear":74012.0,"chosen_score_lmetric":21158,"t_first_token":387376.166340831,"t_first_token_unix":1779818241.1802845,"t_done":387382.997042036,"t_done_unix":1779818248.010986},{"request_id":"1364090:9:1423736:840","session_id":"1364090","input_length":101432,"t_proxy_recv":387379.583433096,"t_decision_unix":1779818244.5973744,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9590661724110734,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":4152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":4096,"new_prefill":97336,"score_linear":-4096.0,"score_lmetric":-97336},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1586,"cache_hit":7680,"new_prefill":93752,"score_linear":24499.0,"score_lmetric":93752},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":10229,"num_requests":1,"active_p_offloads":0,"cached_blocks":2432,"cache_hit":0,"new_prefill":101432,"score_linear":127989.0,"score_lmetric":111661},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":7680,"new_prefill":93752,"score_linear":116410.0,"score_lmetric":205042},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":196930,"ongoing_decode_tokens":196930,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":101432,"score_linear":196930.0,"score_lmetric":304296},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":101432,"score_linear":349996.0,"score_lmetric":442084},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":97280,"new_prefill":4152,"score_linear":-24672.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":7680,"new_prefill":93752,"score_linear":-35466.0,"score_lmetric":-93752}],"chosen_score_linear":-24672.0,"chosen_score_lmetric":0,"t_first_token":387382.284473563,"t_first_token_unix":1779818247.2984173,"t_done":387387.337135647,"t_done_unix":1779818252.3510792},{"request_id":"1399948:8:1425345:844","session_id":"1399948","input_length":11736,"t_proxy_recv":387385.229973116,"t_decision_unix":1779818250.2439141,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9597818677573279,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":472,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65014,"ongoing_decode_tokens":25225,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":11736,"score_linear":65014.0,"score_lmetric":13637},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":10229,"num_requests":1,"active_p_offloads":0,"cached_blocks":2432,"cache_hit":11264,"new_prefill":472,"score_linear":116725.0,"score_lmetric":10701},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":11736,"score_linear":124090.0,"score_lmetric":123026},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":11736,"score_linear":349996.0,"score_lmetric":83300},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":174040,"ongoing_decode_tokens":174040,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":11736,"score_linear":174040.0,"score_lmetric":11736},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":11736,"score_linear":-27786.0,"score_lmetric":-11736}],"chosen_score_linear":116725.0,"chosen_score_lmetric":10701,"t_first_token":387387.349697028,"t_first_token_unix":1779818252.3636405,"t_done":387387.57303445,"t_done_unix":1779818252.586978},{"request_id":"1366128:26:1413108:823","session_id":"1366128","input_length":127989,"t_proxy_recv":387379.509374136,"t_decision_unix":1779818244.5233154,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9200790692950176,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":10229,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":-127989},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1586,"cache_hit":0,"new_prefill":127989,"score_linear":32179.0,"score_lmetric":127989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2432,"cache_hit":117760,"new_prefill":10229,"score_linear":-117760.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":127989,"score_linear":124090.0,"score_lmetric":239279},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":196930,"ongoing_decode_tokens":196930,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":127989,"score_linear":196930.0,"score_lmetric":383967},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":97280,"new_prefill":30709,"score_linear":252716.0,"score_lmetric":159192},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":127989,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":127989,"score_linear":-27786.0,"score_lmetric":-127989}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":387387.276566998,"t_first_token_unix":1779818252.2905107,"t_done":387390.15970743,"t_done_unix":1779818255.1736512},{"request_id":"1355951:5:1425005:843","session_id":"1355951","input_length":39789,"t_proxy_recv":387383.959200636,"t_decision_unix":1779818248.9731414,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9522229761994521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1901,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25225,"ongoing_decode_tokens":25225,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":37888,"new_prefill":1901,"score_linear":-12663.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":39789,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":10229,"num_requests":1,"active_p_offloads":0,"cached_blocks":2432,"cache_hit":34816,"new_prefill":4973,"score_linear":93173.0,"score_lmetric":15202},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":39789,"score_linear":124090.0,"score_lmetric":151079},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":39789,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":39789,"score_linear":349996.0,"score_lmetric":195512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":174040,"ongoing_decode_tokens":174040,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":39789,"score_linear":174040.0,"score_lmetric":39789},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":39789,"score_linear":-27786.0,"score_lmetric":-39789}],"chosen_score_linear":-12663.0,"chosen_score_lmetric":0,"t_first_token":387390.278784623,"t_first_token_unix":1779818255.2927284,"t_done":387390.463319226,"t_done_unix":1779818255.4772625},{"request_id":"1363943:11:1424840:842","session_id":"1363943","input_length":25225,"t_proxy_recv":387383.309433251,"t_decision_unix":1779818248.323374,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9742715559960357,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":649,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":24576,"new_prefill":649,"score_linear":-24576.0,"score_lmetric":-649},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127989,"ongoing_decode_tokens":0,"pending_prefill_tokens":10229,"num_requests":1,"active_p_offloads":0,"cached_blocks":2432,"cache_hit":0,"new_prefill":25225,"score_linear":127989.0,"score_lmetric":35454},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":4096,"new_prefill":21129,"score_linear":119994.0,"score_lmetric":132419},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":25225,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":101803,"pending_prefill_tokens":9089,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":25225,"score_linear":349996.0,"score_lmetric":137256},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":174040,"ongoing_decode_tokens":174040,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":4096,"new_prefill":21129,"score_linear":169944.0,"score_lmetric":21129},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":-27786,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":21129,"score_linear":-31882.0,"score_lmetric":-21129}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":-649,"t_first_token":387383.4167243,"t_first_token_unix":1779818248.430668,"t_done":387390.685601157,"t_done_unix":1779818255.6995447},{"request_id":"1366128:27:1417788:831","session_id":"1366128","input_length":128433,"t_proxy_recv":387390.181149177,"t_decision_unix":1779818255.1950908,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":128000,"affinity_cache_ratio":0.9966285923399749,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":128000,"estimated_new_tokens":433,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65014,"ongoing_decode_tokens":25225,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":128433,"score_linear":65014.0,"score_lmetric":130334},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2452,"cache_hit":128000,"new_prefill":433,"score_linear":-128000.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":128433,"score_linear":166432.0,"score_lmetric":483234},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":221780,"pending_prefill_tokens":5336,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":97280,"new_prefill":31153,"score_linear":252716.0,"score_lmetric":145956},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":128433,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-128000.0,"chosen_score_lmetric":0,"t_first_token":387390.571441263,"t_first_token_unix":1779818255.5853848,"t_done":387391.566633834,"t_done_unix":1779818256.5805779},{"request_id":"1366128:28:1421998:837","session_id":"1366128","input_length":128642,"t_proxy_recv":387391.588547045,"t_decision_unix":1779818256.6024883,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":128512,"affinity_cache_ratio":0.9989894435720837,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":128512,"estimated_new_tokens":130,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":128642,"score_linear":26923.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":128642,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":128512,"new_prefill":130,"score_linear":-128512.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":128642,"score_linear":166432.0,"score_lmetric":483652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":128642,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":259178,"pending_prefill_tokens":5314,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":97280,"new_prefill":31362,"score_linear":252716.0,"score_lmetric":146704},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":180628,"ongoing_decode_tokens":72608,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":128642,"score_linear":180628.0,"score_lmetric":135286},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":128642,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-128512.0,"chosen_score_lmetric":0,"t_first_token":387391.87527846,"t_first_token_unix":1779818256.8892224,"t_done":387392.377701954,"t_done_unix":1779818257.3916461},{"request_id":"1270606:3:1427164:848","session_id":"1270606","input_length":108318,"t_proxy_recv":387391.630745307,"t_decision_unix":1779818256.6446867,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":107008,"affinity_cache_ratio":0.987905980538784,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1310,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":108318,"score_linear":26923.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":108318,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128642,"ongoing_decode_tokens":0,"pending_prefill_tokens":130,"num_requests":1,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":0,"new_prefill":108318,"score_linear":128642.0,"score_lmetric":108448},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":108318,"score_linear":166432.0,"score_lmetric":443004},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":107008,"new_prefill":1310,"score_linear":-107008.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":259178,"pending_prefill_tokens":5314,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":108318,"score_linear":349996.0,"score_lmetric":454528},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":180628,"ongoing_decode_tokens":72608,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":108318,"score_linear":180628.0,"score_lmetric":114962},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":1536,"new_prefill":106782,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":387392.381372452,"t_first_token_unix":1779818257.3953156,"t_done":387392.665676577,"t_done_unix":1779818257.679621},{"request_id":"1275274:2:1405679:780","session_id":"1275274","input_length":119977,"t_proxy_recv":387315.895734472,"t_decision_unix":1779818180.9096756,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9687190044758579,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":3753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":198917,"ongoing_decode_tokens":85659,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":119977,"score_linear":198917.0,"score_lmetric":246310},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1494,"cache_hit":0,"new_prefill":119977,"score_linear":106143.0,"score_lmetric":119977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2125,"cache_hit":0,"new_prefill":119977,"score_linear":21684.0,"score_lmetric":119977},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":119977,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":52910,"ongoing_decode_tokens":0,"pending_prefill_tokens":42158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":119977,"score_linear":52910.0,"score_lmetric":324270},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":284898,"ongoing_decode_tokens":101803,"pending_prefill_tokens":16183,"num_requests":3,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":116224,"new_prefill":3753,"score_linear":168674.0,"score_lmetric":59808},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":145048,"ongoing_decode_tokens":145048,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":119977,"score_linear":145048.0,"score_lmetric":359931},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61254,"ongoing_decode_tokens":106174,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1969,"cache_hit":0,"new_prefill":119977,"score_linear":61254.0,"score_lmetric":119977}],"chosen_score_linear":168674.0,"chosen_score_lmetric":59808,"t_first_token":387385.478202602,"t_first_token_unix":1779818250.4921465,"t_done":387393.135094776,"t_done_unix":1779818258.149039},{"request_id":"1363943:12:1426646:845","session_id":"1363943","input_length":26923,"t_proxy_recv":387390.692199283,"t_decision_unix":1779818255.706141,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9318426624076068,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1835,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":25088,"new_prefill":1835,"score_linear":-25088.0,"score_lmetric":-1835},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128433,"ongoing_decode_tokens":128433,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2452,"cache_hit":0,"new_prefill":26923,"score_linear":128433.0,"score_lmetric":26923},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":4096,"new_prefill":22827,"score_linear":162336.0,"score_lmetric":272022},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":26923,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":221780,"pending_prefill_tokens":5336,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":26923,"score_linear":349996.0,"score_lmetric":129036},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":180628,"ongoing_decode_tokens":72608,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":4096,"new_prefill":22827,"score_linear":176532.0,"score_lmetric":29471},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":-1835,"t_first_token":387391.050880474,"t_first_token_unix":1779818256.0648239,"t_done":387394.898505361,"t_done_unix":1779818259.912449},{"request_id":"1362265:10:1427606:850","session_id":"1362265","input_length":12596,"t_proxy_recv":387392.886165402,"t_decision_unix":1779818257.9001067,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":11776,"affinity_cache_ratio":0.934899968243887,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":820,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":12596,"score_linear":26923.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":11776,"new_prefill":820,"score_linear":-11776.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126198,"ongoing_decode_tokens":126198,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":0,"new_prefill":12596,"score_linear":126198.0,"score_lmetric":12596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":12596,"score_linear":166432.0,"score_lmetric":251560},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":12596,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":259178,"pending_prefill_tokens":5314,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":6656,"new_prefill":5940,"score_linear":343340.0,"score_lmetric":45016},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":180628,"ongoing_decode_tokens":72608,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":12596,"score_linear":180628.0,"score_lmetric":19240},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":12596,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":387393.033177942,"t_first_token_unix":1779818258.0471215,"t_done":387394.914388375,"t_done_unix":1779818259.9283316},{"request_id":"1366128:29:1424316:841","session_id":"1366128","input_length":126198,"t_proxy_recv":387392.450400588,"t_decision_unix":1779818257.464342,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":125952,"affinity_cache_ratio":0.9980506822612085,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":125952,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1424,"cache_hit":0,"new_prefill":126198,"score_linear":26923.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2453,"cache_hit":125952,"new_prefill":246,"score_linear":-125952.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":126198,"score_linear":166432.0,"score_lmetric":478764},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":108318,"ongoing_decode_tokens":108318,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":126198,"score_linear":108318.0,"score_lmetric":126198},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":259178,"pending_prefill_tokens":5314,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":97280,"new_prefill":28918,"score_linear":252716.0,"score_lmetric":136928},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":180628,"ongoing_decode_tokens":72608,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":126198,"score_linear":180628.0,"score_lmetric":132842},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-125952.0,"chosen_score_lmetric":0,"t_first_token":387392.610020958,"t_first_token_unix":1779818257.6239643,"t_done":387399.913806227,"t_done_unix":1779818264.9277506},{"request_id":"1381387:7:1411928:819","session_id":"1381387","input_length":72608,"t_proxy_recv":387337.718310411,"t_decision_unix":1779818202.7322516,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9872190392243279,"affinity_num_requests":-1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":928,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":85659,"pending_prefill_tokens":8838,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":0,"new_prefill":72608,"score_linear":226593.0,"score_lmetric":244338},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1541,"cache_hit":0,"new_prefill":72608,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":72608,"score_linear":114020.0,"score_lmetric":526092},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2020,"cache_hit":0,"new_prefill":72608,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":512,"new_prefill":72096,"score_linear":106780.0,"score_lmetric":86204},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":72608,"score_linear":307218.0,"score_lmetric":229083},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1707,"cache_hit":71680,"new_prefill":928,"score_linear":-71680.0,"score_lmetric":-928},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2368,"ongoing_decode_tokens":30154,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2277,"cache_hit":0,"new_prefill":72608,"score_linear":2368.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":-928,"t_first_token":387338.378059566,"t_first_token_unix":1779818203.3920028,"t_done":387402.168039796,"t_done_unix":1779818267.1819837},{"request_id":"1313181:8:1329951:394","session_id":"1313181","input_length":124090,"t_proxy_recv":387360.757007715,"t_decision_unix":1779818225.770949,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":3,"affinity_cache_hit":61952,"affinity_cache_ratio":0.499250543960029,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":12800,"estimated_new_tokens":111290,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164575,"ongoing_decode_tokens":164575,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":61952,"new_prefill":62138,"score_linear":102623.0,"score_lmetric":124276},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":124090,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":124090,"score_linear":114020.0,"score_lmetric":680538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":12800,"new_prefill":111290,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":124090,"score_linear":147622.0,"score_lmetric":290496},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":344616,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3775,"num_requests":4,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":24064,"new_prefill":100026,"score_linear":320552.0,"score_lmetric":415204},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":72608,"pending_prefill_tokens":10321,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":124090,"score_linear":169457.0,"score_lmetric":134411},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":0,"pending_prefill_tokens":2803,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":12800,"new_prefill":111290,"score_linear":3177.0,"score_lmetric":0}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":387409.207505565,"t_first_token_unix":1779818274.2214508,"t_done":387410.118962295,"t_done_unix":1779818275.1329062},{"request_id":"1313181:8:1385690:686","session_id":"1313181","input_length":62444,"t_proxy_recv":387410.127536167,"t_decision_unix":1779818275.1414776,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9921209403625648,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":492,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":125947,"ongoing_decode_tokens":0,"pending_prefill_tokens":11771,"num_requests":0,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":61952,"new_prefill":492,"score_linear":63995.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":0,"new_prefill":62444,"score_linear":1840.0,"score_lmetric":62444},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":61952,"new_prefill":492,"score_linear":-19610.0,"score_lmetric":492},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":24064,"new_prefill":38380,"score_linear":205955.0,"score_lmetric":131082},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":62444,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":49644,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-19610.0,"chosen_score_lmetric":492,"t_first_token":387410.226261263,"t_first_token_unix":1779818275.2402053,"t_done":387410.925527422,"t_done_unix":1779818275.939472},{"request_id":"1399948:9:1433544:857","session_id":"1399948","input_length":11993,"t_proxy_recv":387414.079480854,"t_decision_unix":1779818279.0934222,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9392145418160593,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":0,"pending_prefill_tokens":79492,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":11993,"score_linear":255620.0,"score_lmetric":91485},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":42407,"ongoing_decode_tokens":42407,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":11264,"new_prefill":729,"score_linear":31143.0,"score_lmetric":1458},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":11993,"score_linear":116220.0,"score_lmetric":29406},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":11993,"score_linear":230019.0,"score_lmetric":51921},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":11993,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":31143.0,"chosen_score_lmetric":1458,"t_first_token":387414.161376572,"t_first_token_unix":1779818279.1753206,"t_done":387414.281199902,"t_done_unix":1779818279.2951431},{"request_id":"1407599:2:1430593:852","session_id":"1407599","input_length":1840,"t_proxy_recv":387403.615762625,"t_decision_unix":1779818268.6297035,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":1536,"affinity_cache_ratio":0.8347826086956521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":304,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":-1840},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":1536,"new_prefill":304,"score_linear":-1536.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":1840,"score_linear":166432.0,"score_lmetric":230048},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":1840,"score_linear":230019.0,"score_lmetric":21462},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":1840,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":387403.656816909,"t_first_token_unix":1779818268.6707606,"t_done":387415.780247488,"t_done_unix":1779818280.794191},{"request_id":"1382089:3:1433211:856","session_id":"1382089","input_length":40567,"t_proxy_recv":387412.868573877,"t_decision_unix":1779818277.8825154,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":38912,"affinity_cache_ratio":0.9592032933172283,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38912,"estimated_new_tokens":1655,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":0,"pending_prefill_tokens":79492,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":34816,"new_prefill":5751,"score_linear":220804.0,"score_lmetric":85243},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":38912,"new_prefill":1655,"score_linear":-37072.0,"score_lmetric":1655},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":40567,"score_linear":116220.0,"score_lmetric":86554},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":40567,"score_linear":230019.0,"score_lmetric":137643},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":40567,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37072.0,"chosen_score_lmetric":1655,"t_first_token":387413.347592784,"t_first_token_unix":1779818278.361536,"t_done":387415.861020838,"t_done_unix":1779818280.8749645},{"request_id":"1399948:10:1434418:858","session_id":"1399948","input_length":12032,"t_proxy_recv":387417.091887702,"t_decision_unix":1779818282.1058288,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9787234042553191,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":256,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":12032,"score_linear":255620.0,"score_lmetric":79753},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":11776,"new_prefill":256,"score_linear":-11776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":12032,"score_linear":116220.0,"score_lmetric":29484},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":12032,"score_linear":230019.0,"score_lmetric":52038},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":12032,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":387417.131213526,"t_first_token_unix":1779818282.1451576,"t_done":387417.339876748,"t_done_unix":1779818282.35382},{"request_id":"1399948:11:1435163:860","session_id":"1399948","input_length":12106,"t_proxy_recv":387419.794620286,"t_decision_unix":1779818284.8085613,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9727407896910623,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":12106,"score_linear":255620.0,"score_lmetric":79827},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":11776,"new_prefill":330,"score_linear":-11776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":12106,"score_linear":116220.0,"score_lmetric":29632},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":230019,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":12106,"score_linear":230019.0,"score_lmetric":36318},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":12106,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45269,"ongoing_decode_tokens":45269,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":12106,"score_linear":45269.0,"score_lmetric":12106}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":387419.836464779,"t_first_token_unix":1779818284.8504078,"t_done":387419.883325433,"t_done_unix":1779818284.8972685},{"request_id":"1270340:6:1434904:859","session_id":"1270340","input_length":45269,"t_proxy_recv":387418.734769146,"t_decision_unix":1779818283.7487104,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9952947933464402,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":45269,"score_linear":255620.0,"score_lmetric":112990},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":45269,"score_linear":116220.0,"score_lmetric":95958},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":1536,"new_prefill":43733,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":230019,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":45269,"score_linear":230019.0,"score_lmetric":135807},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":45269,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":45056,"new_prefill":213,"score_linear":-45056.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":387418.844828251,"t_first_token_unix":1779818283.8587723,"t_done":387420.304992582,"t_done_unix":1779818285.318936},{"request_id":"1373577:4:1408642:799","session_id":"1373577","input_length":90818,"t_proxy_recv":387365.937882866,"t_decision_unix":1779818230.9518244,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9414873703450858,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":5314,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":137700,"ongoing_decode_tokens":137700,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":90818,"score_linear":137700.0,"score_lmetric":90818},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43311,"ongoing_decode_tokens":0,"pending_prefill_tokens":25903,"num_requests":2,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":90818,"score_linear":43311.0,"score_lmetric":233442},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109574,"ongoing_decode_tokens":0,"pending_prefill_tokens":11782,"num_requests":1,"active_p_offloads":0,"cached_blocks":2393,"cache_hit":2560,"new_prefill":88258,"score_linear":107014.0,"score_lmetric":100040},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":90818,"score_linear":124090.0,"score_lmetric":202108},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":90818,"score_linear":147622.0,"score_lmetric":223952},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":259178,"ongoing_decode_tokens":101803,"pending_prefill_tokens":3775,"num_requests":3,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":85504,"new_prefill":5314,"score_linear":173674.0,"score_lmetric":27267},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":169457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":90818,"score_linear":169457.0,"score_lmetric":90818},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":26610,"ongoing_decode_tokens":54396,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":90818,"score_linear":26610.0,"score_lmetric":90818}],"chosen_score_linear":173674.0,"chosen_score_lmetric":27267,"t_first_token":387418.027296718,"t_first_token_unix":1779818283.0412407,"t_done":387421.648380544,"t_done_unix":1779818286.6623275},{"request_id":"1399948:12:1436179:863","session_id":"1399948","input_length":12164,"t_proxy_recv":387423.220356118,"t_decision_unix":1779818288.2342973,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9681025978296613,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":388,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":12164,"score_linear":255620.0,"score_lmetric":79885},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29412,"ongoing_decode_tokens":0,"pending_prefill_tokens":6884,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":11776,"new_prefill":388,"score_linear":17636.0,"score_lmetric":7272},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":12164,"score_linear":116220.0,"score_lmetric":29748},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139201,"ongoing_decode_tokens":139201,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":12164,"score_linear":139201.0,"score_lmetric":24328},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":12164,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":17636.0,"chosen_score_lmetric":7272,"t_first_token":387423.68683575,"t_first_token_unix":1779818288.700779,"t_done":387423.88056079,"t_done_unix":1779818288.8945043},{"request_id":"1268861:10:1439325:866","session_id":"1268861","input_length":52920,"t_proxy_recv":387433.751838929,"t_decision_unix":1779818298.7657804,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9287981859410431,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":3768,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":284331,"ongoing_decode_tokens":125947,"pending_prefill_tokens":69296,"num_requests":2,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":52920,"score_linear":284331.0,"score_lmetric":244432},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":52920,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":0,"new_prefill":52920,"score_linear":29412.0,"score_lmetric":52920},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":52920,"score_linear":243708.0,"score_lmetric":174120},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":49152,"new_prefill":3768,"score_linear":-49152.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139201,"ongoing_decode_tokens":139201,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":52920,"score_linear":139201.0,"score_lmetric":105840},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":52920,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":52920,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":387434.954240146,"t_first_token_unix":1779818299.9681835,"t_done":387436.052227733,"t_done_unix":1779818301.066171},{"request_id":"1404395:2:1435941:862","session_id":"1404395","input_length":29412,"t_proxy_recv":387422.379043339,"t_decision_unix":1779818287.3929846,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":22528,"affinity_cache_ratio":0.7659458724330205,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":6884,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":512,"new_prefill":28900,"score_linear":255108.0,"score_lmetric":96621},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":22528,"new_prefill":6884,"score_linear":-22528.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":29412,"score_linear":116220.0,"score_lmetric":64244},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139201,"ongoing_decode_tokens":139201,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":29412,"score_linear":139201.0,"score_lmetric":58824},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":512,"new_prefill":28900,"score_linear":107508.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":387423.674143101,"t_first_token_unix":1779818288.6880867,"t_done":387441.531249199,"t_done_unix":1779818306.545193},{"request_id":"1301929:3:1417873:832","session_id":"1301929","input_length":37398,"t_proxy_recv":387358.603519023,"t_decision_unix":1779818223.6174593,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9994117332477672,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":22,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":226593,"ongoing_decode_tokens":198917,"pending_prefill_tokens":5660,"num_requests":3,"active_p_offloads":0,"cached_blocks":1396,"cache_hit":3584,"new_prefill":33814,"score_linear":223009.0,"score_lmetric":118422},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":37398,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":114020,"ongoing_decode_tokens":0,"pending_prefill_tokens":102756,"num_requests":3,"active_p_offloads":0,"cached_blocks":2193,"cache_hit":0,"new_prefill":37398,"score_linear":114020.0,"score_lmetric":420462},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":37398,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":147622,"ongoing_decode_tokens":0,"pending_prefill_tokens":21158,"num_requests":2,"active_p_offloads":0,"cached_blocks":1847,"cache_hit":0,"new_prefill":37398,"score_linear":147622.0,"score_lmetric":117112},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":307218,"ongoing_decode_tokens":187241,"pending_prefill_tokens":3753,"num_requests":3,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":37376,"new_prefill":22,"score_linear":269842.0,"score_lmetric":11325},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":169457,"ongoing_decode_tokens":72608,"pending_prefill_tokens":10321,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":37398,"score_linear":169457.0,"score_lmetric":47719},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15977,"ongoing_decode_tokens":0,"pending_prefill_tokens":2803,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":37398,"score_linear":15977.0,"score_lmetric":0}],"chosen_score_linear":269842.0,"chosen_score_lmetric":11325,"t_first_token":387390.95354767,"t_first_token_unix":1779818255.9674914,"t_done":387442.472709503,"t_done_unix":1779818307.486653},{"request_id":"1371622:2:1442319:869","session_id":"1371622","input_length":19056,"t_proxy_recv":387443.597904672,"t_decision_unix":1779818308.6118455,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13312,"affinity_cache_ratio":0.6985726280436608,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":5744,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":284331,"ongoing_decode_tokens":125947,"pending_prefill_tokens":69296,"num_requests":2,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":19056,"score_linear":284331.0,"score_lmetric":176704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63153,"ongoing_decode_tokens":0,"pending_prefill_tokens":14001,"num_requests":1,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":19056,"score_linear":63153.0,"score_lmetric":33057},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":19056,"score_linear":243708.0,"score_lmetric":72528},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":11264,"new_prefill":7792,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":13312,"new_prefill":5744,"score_linear":88491.0,"score_lmetric":5744},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":19056,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":88491.0,"chosen_score_lmetric":5744,"t_first_token":387445.529665999,"t_first_token_unix":1779818310.54361,"t_done":387446.634247233,"t_done_unix":1779818311.648191},{"request_id":"1364090:10:1426859:847","session_id":"1364090","input_length":108020,"t_proxy_recv":387390.604574418,"t_decision_unix":1779818255.618516,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9384928716904277,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":6644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25225,"ongoing_decode_tokens":25225,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1423,"cache_hit":4096,"new_prefill":103924,"score_linear":21129.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":7680,"new_prefill":100340,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128433,"ongoing_decode_tokens":128433,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2452,"cache_hit":0,"new_prefill":108020,"score_linear":128433.0,"score_lmetric":108020},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":7680,"new_prefill":100340,"score_linear":158752.0,"score_lmetric":427048},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":108020,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":221780,"pending_prefill_tokens":5336,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":108020,"score_linear":349996.0,"score_lmetric":453424},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":101376,"new_prefill":6644,"score_linear":-28768.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":7680,"new_prefill":100340,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-28768.0,"chosen_score_lmetric":0,"t_first_token":387394.806193344,"t_first_token_unix":1779818259.820137,"t_done":387447.021733016,"t_done_unix":1779818312.0356772},{"request_id":"1294611:12:1441557:868","session_id":"1294611","input_length":63153,"t_proxy_recv":387440.864991738,"t_decision_unix":1779818305.8789327,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":49152,"affinity_cache_ratio":0.7783003182746663,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":14001,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":284331,"ongoing_decode_tokens":125947,"pending_prefill_tokens":69296,"num_requests":2,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":63153,"score_linear":284331.0,"score_lmetric":264898},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":49152,"new_prefill":14001,"score_linear":-49152.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":12800,"new_prefill":50353,"score_linear":16612.0,"score_lmetric":50353},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":12800,"new_prefill":50353,"score_linear":230908.0,"score_lmetric":166419},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139201,"ongoing_decode_tokens":139201,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":63153,"score_linear":139201.0,"score_lmetric":126306},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":63153,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":387454.998983388,"t_first_token_unix":1779818320.0129287,"t_done":387457.497525751,"t_done_unix":1779818322.5114696},{"request_id":"1313181:9:1333349:415","session_id":"1313181","input_length":129673,"t_proxy_recv":387410.949617314,"t_decision_unix":1779818275.963558,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":0,"affinity_cache_hit":62464,"affinity_cache_ratio":0.481703978468918,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":67721,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":125947,"ongoing_decode_tokens":0,"pending_prefill_tokens":11771,"num_requests":0,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":61952,"new_prefill":67721,"score_linear":63995.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":0,"new_prefill":129673,"score_linear":1840.0,"score_lmetric":129673},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":62464,"new_prefill":67209,"score_linear":-20122.0,"score_lmetric":67209},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":24064,"new_prefill":105609,"score_linear":205955.0,"score_lmetric":332769},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":129673,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":116873,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":63995.0,"chosen_score_lmetric":0,"t_first_token":387455.627982708,"t_first_token_unix":1779818320.6419263,"t_done":387458.545393176,"t_done_unix":1779818323.559337},{"request_id":"1294611:13:1446349:872","session_id":"1294611","input_length":63488,"t_proxy_recv":387457.50958103,"t_decision_unix":1779818322.5235226,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9919354838709677,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":284331,"ongoing_decode_tokens":255620,"pending_prefill_tokens":1575,"num_requests":2,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":63488,"score_linear":284331.0,"score_lmetric":130126},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":62976,"new_prefill":512,"score_linear":-62976.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":12800,"new_prefill":50688,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":12800,"new_prefill":50688,"score_linear":230908.0,"score_lmetric":167424},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":121095,"ongoing_decode_tokens":121095,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":0,"new_prefill":63488,"score_linear":121095.0,"score_lmetric":126976},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":387457.618664605,"t_first_token_unix":1779818322.632608,"t_done":387458.6105917,"t_done_unix":1779818323.6245353},{"request_id":"1314357:5:1393659:719","session_id":"1314357","input_length":101803,"t_proxy_recv":387273.886711804,"t_decision_unix":1779818138.9006534,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73216,"affinity_cache_ratio":0.7191929510918146,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":28587,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82491,"ongoing_decode_tokens":82491,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1361,"cache_hit":3584,"new_prefill":98219,"score_linear":78907.0,"score_lmetric":98219},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2004,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":101803,"score_linear":15283.0,"score_lmetric":101803},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":127267,"ongoing_decode_tokens":127267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1702,"cache_hit":0,"new_prefill":101803,"score_linear":127267.0,"score_lmetric":101803},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":73216,"new_prefill":28587,"score_linear":-73216.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1566,"cache_hit":0,"new_prefill":101803,"score_linear":48944.0,"score_lmetric":101803},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":132650,"ongoing_decode_tokens":177570,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":61440,"new_prefill":40363,"score_linear":71210.0,"score_lmetric":80726}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":387307.408533313,"t_first_token_unix":1779818172.4224775,"t_done":387461.808400731,"t_done_unix":1779818326.8223448},{"request_id":"1371622:3:1443876:871","session_id":"1371622","input_length":19292,"t_proxy_recv":387448.705851681,"t_decision_unix":1779818313.7197924,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9819614347916235,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":284331,"ongoing_decode_tokens":125947,"pending_prefill_tokens":69296,"num_requests":2,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":19292,"score_linear":284331.0,"score_lmetric":177176},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63153,"ongoing_decode_tokens":0,"pending_prefill_tokens":14001,"num_requests":1,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":19292,"score_linear":63153.0,"score_lmetric":33293},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":19292,"score_linear":243708.0,"score_lmetric":73236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":11264,"new_prefill":8028,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":18944,"new_prefill":348,"score_linear":82859.0,"score_lmetric":348},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":-19292},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":82859.0,"chosen_score_lmetric":348,"t_first_token":387448.805565548,"t_first_token_unix":1779818313.8195095,"t_done":387462.175800731,"t_done_unix":1779818327.1897445},{"request_id":"1314357:6:1422517:839","session_id":"1314357","input_length":105709,"t_proxy_recv":387461.827837914,"t_decision_unix":1779818326.8417795,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9977579960079085,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":237,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":217171,"ongoing_decode_tokens":217171,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1446,"cache_hit":3584,"new_prefill":102125,"score_linear":213587.0,"score_lmetric":204250},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":105709,"score_linear":243708.0,"score_lmetric":332487},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":19292,"ongoing_decode_tokens":19292,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1803,"cache_hit":105472,"new_prefill":237,"score_linear":-86180.0,"score_lmetric":237},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":44269,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-86180.0,"chosen_score_lmetric":237,"t_first_token":387462.007802958,"t_first_token_unix":1779818327.0217462,"t_done":387467.614645985,"t_done_unix":1779818332.6285896},{"request_id":"1294611:14:1449074:877","session_id":"1294611","input_length":63616,"t_proxy_recv":387466.163421213,"t_decision_unix":1779818331.1773624,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":63488,"affinity_cache_ratio":0.9979879275653923,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":63488,"estimated_new_tokens":128,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":217171,"ongoing_decode_tokens":217171,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1446,"cache_hit":0,"new_prefill":63616,"score_linear":217171.0,"score_lmetric":127232},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":63488,"new_prefill":128,"score_linear":-63488.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":12800,"new_prefill":50816,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":12800,"new_prefill":50816,"score_linear":230908.0,"score_lmetric":167808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":105709,"ongoing_decode_tokens":105709,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1805,"cache_hit":0,"new_prefill":63616,"score_linear":105709.0,"score_lmetric":63616},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-63488.0,"chosen_score_lmetric":0,"t_first_token":387466.259079329,"t_first_token_unix":1779818331.2730227,"t_done":387471.064904287,"t_done_unix":1779818336.078848},{"request_id":"1363943:13:1438562:865","session_id":"1363943","input_length":28711,"t_proxy_recv":387431.191960857,"t_decision_unix":1779818296.205902,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9451429765595069,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":1575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":27136,"new_prefill":1575,"score_linear":228484.0,"score_lmetric":69296},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":0,"new_prefill":28711,"score_linear":29412.0,"score_lmetric":28711},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":42342,"pending_prefill_tokens":7830,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":4096,"new_prefill":24615,"score_linear":239612.0,"score_lmetric":97335},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":28711,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139201,"ongoing_decode_tokens":139201,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":28711,"score_linear":139201.0,"score_lmetric":57422},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":4096,"new_prefill":24615,"score_linear":103924.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":228484.0,"chosen_score_lmetric":69296,"t_first_token":387459.2360721,"t_first_token_unix":1779818324.2500157,"t_done":387472.691531262,"t_done_unix":1779818337.7054749},{"request_id":"1314357:7:1427957:851","session_id":"1314357","input_length":106279,"t_proxy_recv":387467.635130256,"t_decision_unix":1779818332.6490717,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9972242870181315,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":295,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":217171,"ongoing_decode_tokens":217171,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1446,"cache_hit":3584,"new_prefill":102695,"score_linear":213587.0,"score_lmetric":205390},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63616,"ongoing_decode_tokens":63616,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":106279,"score_linear":63616.0,"score_lmetric":106279},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":106279,"score_linear":243708.0,"score_lmetric":334197},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1806,"cache_hit":105984,"new_prefill":295,"score_linear":-105984.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":44839,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":387467.840108525,"t_first_token_unix":1779818332.8540518,"t_done":387473.016396256,"t_done_unix":1779818338.0303395},{"request_id":"1314357:8:1431749:854","session_id":"1314357","input_length":106805,"t_proxy_recv":387473.034126023,"t_decision_unix":1779818338.0480676,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":106496,"affinity_cache_ratio":0.9971068770188661,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":103221,"score_linear":184876.0,"score_lmetric":103221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":106805,"score_linear":243708.0,"score_lmetric":335775},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":106496,"new_prefill":309,"score_linear":-106496.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":45365,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-106496.0,"chosen_score_lmetric":0,"t_first_token":387473.240651937,"t_first_token_unix":1779818338.2545955,"t_done":387474.488351901,"t_done_unix":1779818339.5022953},{"request_id":"1314357:9:1435219:861","session_id":"1314357","input_length":106959,"t_proxy_recv":387474.509180453,"t_decision_unix":1779818339.5231218,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":106496,"affinity_cache_ratio":0.9956712385119532,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":463,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":103375,"score_linear":184876.0,"score_lmetric":103375},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":106959,"score_linear":243708.0,"score_lmetric":336237},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":106496,"new_prefill":463,"score_linear":-106496.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":45519,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-106496.0,"chosen_score_lmetric":0,"t_first_token":387474.676821501,"t_first_token_unix":1779818339.6907651,"t_done":387477.372708178,"t_done_unix":1779818342.3866522},{"request_id":"1371622:4:1452210:881","session_id":"1371622","input_length":20439,"t_proxy_recv":387476.584969849,"t_decision_unix":1779818341.5989115,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9769558197563482,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":0,"new_prefill":20439,"score_linear":188460.0,"score_lmetric":20439},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":20439,"score_linear":243708.0,"score_lmetric":76677},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":55050,"ongoing_decode_tokens":0,"pending_prefill_tokens":2314,"num_requests":1,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":11264,"new_prefill":9175,"score_linear":43786.0,"score_lmetric":11489},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":106959,"ongoing_decode_tokens":106959,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":19968,"new_prefill":471,"score_linear":86991.0,"score_lmetric":471},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":86991.0,"chosen_score_lmetric":471,"t_first_token":387476.674652407,"t_first_token_unix":1779818341.688596,"t_done":387477.765035296,"t_done_unix":1779818342.7789788},{"request_id":"1268861:11:1452208:880","session_id":"1268861","input_length":55050,"t_proxy_recv":387476.5770675,"t_decision_unix":1779818341.5910091,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9579654859218892,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2314,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":0,"new_prefill":55050,"score_linear":188460.0,"score_lmetric":55050},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":55050,"score_linear":243708.0,"score_lmetric":180510},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":52736,"new_prefill":2314,"score_linear":-52736.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":106959,"ongoing_decode_tokens":106959,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":55050,"score_linear":106959.0,"score_lmetric":55050},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":387477.409871861,"t_first_token_unix":1779818342.4238155,"t_done":387477.881186431,"t_done_unix":1779818342.8951302},{"request_id":"1314357:10:1439373:867","session_id":"1314357","input_length":107228,"t_proxy_recv":387477.393102345,"t_decision_unix":1779818342.4070437,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":107008,"affinity_cache_ratio":0.9979482970865818,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":220,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":103644,"score_linear":184876.0,"score_lmetric":103644},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":107228,"score_linear":243708.0,"score_lmetric":337044},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":55050,"ongoing_decode_tokens":0,"pending_prefill_tokens":2314,"num_requests":1,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":107228,"score_linear":55050.0,"score_lmetric":109542},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":20439,"ongoing_decode_tokens":20439,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1808,"cache_hit":107008,"new_prefill":220,"score_linear":-86569.0,"score_lmetric":220},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":45788,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-86569.0,"chosen_score_lmetric":220,"t_first_token":387477.565350113,"t_first_token_unix":1779818342.5792937,"t_done":387477.885352054,"t_done_unix":1779818342.8992953},{"request_id":"1314357:11:1442554:870","session_id":"1314357","input_length":108166,"t_proxy_recv":387477.905012885,"t_decision_unix":1779818342.9189546,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":107008,"affinity_cache_ratio":0.9892942329382616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1158,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":104582,"score_linear":184876.0,"score_lmetric":104582},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":108166,"score_linear":243708.0,"score_lmetric":339858},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1809,"cache_hit":107008,"new_prefill":1158,"score_linear":-107008.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":46726,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":387478.643733879,"t_first_token_unix":1779818343.6576777,"t_done":387480.66054683,"t_done_unix":1779818345.6744912},{"request_id":"1314357:12:1446681:873","session_id":"1314357","input_length":108409,"t_proxy_recv":387480.678422175,"t_decision_unix":1779818345.6923635,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":108032,"affinity_cache_ratio":0.996522428949626,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":104825,"score_linear":184876.0,"score_lmetric":104825},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":108409,"score_linear":243708.0,"score_lmetric":340587},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":108032,"new_prefill":377,"score_linear":-108032.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":46969,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":387480.890076535,"t_first_token_unix":1779818345.90402,"t_done":387481.484933833,"t_done_unix":1779818346.4988775},{"request_id":"1314357:13:1448346:875","session_id":"1314357","input_length":108791,"t_proxy_recv":387481.504976797,"t_decision_unix":1779818346.518918,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9930233199437454,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":759,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":105207,"score_linear":184876.0,"score_lmetric":105207},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":108791,"score_linear":243708.0,"score_lmetric":341733},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":108032,"new_prefill":759,"score_linear":-108032.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":47351,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":387482.026195852,"t_first_token_unix":1779818347.0401397,"t_done":387483.803226464,"t_done_unix":1779818348.81717},{"request_id":"1314357:14:1450740:878","session_id":"1314357","input_length":109010,"t_proxy_recv":387483.822683847,"t_decision_unix":1779818348.836625,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":108544,"affinity_cache_ratio":0.9957251628290983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108544,"estimated_new_tokens":466,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":105426,"score_linear":184876.0,"score_lmetric":105426},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":243708,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":109010,"score_linear":243708.0,"score_lmetric":327030},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":108544,"new_prefill":466,"score_linear":-108544.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":47570,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-108544.0,"chosen_score_lmetric":0,"t_first_token":387484.056928053,"t_first_token_unix":1779818349.0708718,"t_done":387485.320739342,"t_done_unix":1779818350.3346834},{"request_id":"1342921:5:1433192:855","session_id":"1342921","input_length":73878,"t_proxy_recv":387412.79813188,"t_decision_unix":1779818277.8120732,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9633179024878854,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":2710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":0,"pending_prefill_tokens":79492,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":73878,"score_linear":255620.0,"score_lmetric":153370},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":0,"new_prefill":73878,"score_linear":1840.0,"score_lmetric":73878},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":42342,"ongoing_decode_tokens":42342,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":71168,"new_prefill":2710,"score_linear":-28826.0,"score_lmetric":2710},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":73878,"score_linear":230019.0,"score_lmetric":237576},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":73878,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-28826.0,"chosen_score_lmetric":2710,"t_first_token":387431.456338407,"t_first_token_unix":1779818296.4702818,"t_done":387485.7391371,"t_done_unix":1779818350.7530808},{"request_id":"1356885:2:1438037:864","session_id":"1356885","input_length":127488,"t_proxy_recv":387429.48557665,"t_decision_unix":1779818294.4995177,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":122368,"affinity_cache_ratio":0.9598393574297188,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":122368,"estimated_new_tokens":5120,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255620,"ongoing_decode_tokens":125947,"pending_prefill_tokens":67721,"num_requests":1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":0,"new_prefill":127488,"score_linear":255620.0,"score_lmetric":195209},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2462,"cache_hit":0,"new_prefill":127488,"score_linear":29412.0,"score_lmetric":127488},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":116220,"ongoing_decode_tokens":42342,"pending_prefill_tokens":2710,"num_requests":2,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":122368,"new_prefill":5120,"score_linear":-6148.0,"score_lmetric":15660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139201,"ongoing_decode_tokens":139201,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":127488,"score_linear":139201.0,"score_lmetric":254976},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":127488,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6148.0,"chosen_score_lmetric":15660,"t_first_token":387482.46859084,"t_first_token_unix":1779818347.4825358,"t_done":387487.324817583,"t_done_unix":1779818352.3387616},{"request_id":"1277428:8:1426669:846","session_id":"1277428","input_length":42342,"t_proxy_recv":387389.865567699,"t_decision_unix":1779818254.8795087,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9552690000472345,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":1894,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65014,"ongoing_decode_tokens":25225,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":42342,"score_linear":65014.0,"score_lmetric":44243},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":4608,"new_prefill":37734,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127989,"ongoing_decode_tokens":127989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2432,"cache_hit":0,"new_prefill":42342,"score_linear":127989.0,"score_lmetric":42342},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":124090,"ongoing_decode_tokens":0,"pending_prefill_tokens":111290,"num_requests":1,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":40448,"new_prefill":1894,"score_linear":83642.0,"score_lmetric":113184},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1898,"cache_hit":0,"new_prefill":42342,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":349996,"ongoing_decode_tokens":221780,"pending_prefill_tokens":5336,"num_requests":4,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":42342,"score_linear":349996.0,"score_lmetric":190712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":42342,"score_linear":72608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":42342,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":83642.0,"chosen_score_lmetric":113184,"t_first_token":387409.20924999,"t_first_token_unix":1779818274.2231934,"t_done":387488.702537348,"t_done_unix":1779818353.7164807},{"request_id":"1342921:6:1448548:876","session_id":"1342921","input_length":75761,"t_proxy_recv":387485.752830196,"t_decision_unix":1779818350.7667718,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9731656129142963,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":2033,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":0,"new_prefill":75761,"score_linear":188460.0,"score_lmetric":75761},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":169830,"ongoing_decode_tokens":169830,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2246,"cache_hit":73728,"new_prefill":2033,"score_linear":96102.0,"score_lmetric":4066},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":109164,"ongoing_decode_tokens":109164,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":0,"new_prefill":75761,"score_linear":109164.0,"score_lmetric":75761},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":96102.0,"chosen_score_lmetric":4066,"t_first_token":387486.707209967,"t_first_token_unix":1779818351.721153,"t_done":387488.750654987,"t_done_unix":1779818353.7645986},{"request_id":"1371622:5:1455608:884","session_id":"1371622","input_length":21518,"t_proxy_recv":387488.364280379,"t_decision_unix":1779818353.3782218,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":20480,"affinity_cache_ratio":0.951761316107445,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":1038,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":0,"new_prefill":21518,"score_linear":188460.0,"score_lmetric":21518},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":246666,"ongoing_decode_tokens":118103,"pending_prefill_tokens":1075,"num_requests":3,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":21518,"score_linear":246666.0,"score_lmetric":67779},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":11264,"new_prefill":10254,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":109164,"ongoing_decode_tokens":109164,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":20480,"new_prefill":1038,"score_linear":88684.0,"score_lmetric":1038},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":88684.0,"chosen_score_lmetric":1038,"t_first_token":387488.650169256,"t_first_token_unix":1779818353.6641126,"t_done":387489.602677901,"t_done_unix":1779818354.6166213},{"request_id":"1314357:15:1452292:882","session_id":"1314357","input_length":109164,"t_proxy_recv":387485.341551626,"t_decision_unix":1779818350.355493,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9990106628558866,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":3584,"new_prefill":105580,"score_linear":184876.0,"score_lmetric":105580},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":243708,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":109164,"score_linear":243708.0,"score_lmetric":327492},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":109056,"new_prefill":108,"score_linear":-109056.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":61440,"new_prefill":47724,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":387485.508024911,"t_first_token_unix":1779818350.5219681,"t_done":387489.813895458,"t_done_unix":1779818354.827839},{"request_id":"1313181:9:1386945:689","session_id":"1313181","input_length":62513,"t_proxy_recv":387458.55340486,"t_decision_unix":1779818323.5673463,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":62464,"affinity_cache_ratio":0.999216163038088,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":49,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":154658,"ongoing_decode_tokens":125947,"pending_prefill_tokens":1575,"num_requests":1,"active_p_offloads":0,"cached_blocks":1446,"cache_hit":62464,"new_prefill":49,"score_linear":92194.0,"score_lmetric":1624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":63488,"ongoing_decode_tokens":63488,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1665,"cache_hit":0,"new_prefill":62513,"score_linear":63488.0,"score_lmetric":62513},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":243708,"ongoing_decode_tokens":116220,"pending_prefill_tokens":5120,"num_requests":3,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":62464,"new_prefill":49,"score_linear":181244.0,"score_lmetric":15507},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1907,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":121095,"ongoing_decode_tokens":121095,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":24064,"new_prefill":38449,"score_linear":97031.0,"score_lmetric":76898},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":49713,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":92194.0,"chosen_score_lmetric":1624,"t_first_token":387459.288157025,"t_first_token_unix":1779818324.3021007,"t_done":387498.042930007,"t_done_unix":1779818363.0568736},{"request_id":"1356885:3:1451307:879","session_id":"1356885","input_length":128563,"t_proxy_recv":387487.345238898,"t_decision_unix":1779818352.3591805,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":127488,"affinity_cache_ratio":0.9916383407356705,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":127488,"estimated_new_tokens":1075,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":188460,"ongoing_decode_tokens":188460,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1450,"cache_hit":0,"new_prefill":128563,"score_linear":188460.0,"score_lmetric":128563},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":118103,"ongoing_decode_tokens":118103,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":127488,"new_prefill":1075,"score_linear":-9385.0,"score_lmetric":2150},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":109164,"ongoing_decode_tokens":109164,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":0,"new_prefill":128563,"score_linear":109164.0,"score_lmetric":128563},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9385.0,"chosen_score_lmetric":2150,"t_first_token":387488.425280902,"t_first_token_unix":1779818353.4392242,"t_done":387505.038034935,"t_done_unix":1779818370.0519783},{"request_id":"1404395:3:1460072:887","session_id":"1404395","input_length":34392,"t_proxy_recv":387502.954526517,"t_decision_unix":1779818367.9684675,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9230053500814143,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":2648,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":512,"new_prefill":33880,"score_linear":310948.0,"score_lmetric":298755},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":31744,"new_prefill":2648,"score_linear":-31744.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2264,"cache_hit":0,"new_prefill":34392,"score_linear":128563.0,"score_lmetric":34392},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":33880,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31744.0,"chosen_score_lmetric":0,"t_first_token":387503.583016865,"t_first_token_unix":1779818368.5969608,"t_done":387506.0014042,"t_done_unix":1779818371.0153477},{"request_id":"1268861:12:1463977:891","session_id":"1268861","input_length":56147,"t_proxy_recv":387515.9899243,"t_decision_unix":1779818381.0038652,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9757244376369174,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":1363,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":56147,"score_linear":311460.0,"score_lmetric":365556},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":81299,"ongoing_decode_tokens":0,"pending_prefill_tokens":8083,"num_requests":1,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":56147,"score_linear":81299.0,"score_lmetric":64230},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2482,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":54784,"new_prefill":1363,"score_linear":-54784.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":387516.507542286,"t_first_token_unix":1779818381.521486,"t_done":387517.397099799,"t_done_unix":1779818382.4110434},{"request_id":"1363093:6:1460799:888","session_id":"1363093","input_length":81299,"t_proxy_recv":387505.377126586,"t_decision_unix":1779818370.3910677,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9005768828644879,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":8083,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":81299,"score_linear":311460.0,"score_lmetric":441012},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":73216,"new_prefill":8083,"score_linear":-73216.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":34392,"ongoing_decode_tokens":34392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":81299,"score_linear":34392.0,"score_lmetric":81299},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":387520.082233452,"t_first_token_unix":1779818385.0961769,"t_done":387520.69063981,"t_done_unix":1779818385.7045834},{"request_id":"1371622:6:1465333:892","session_id":"1371622","input_length":23079,"t_proxy_recv":387520.244663987,"t_decision_unix":1779818385.258605,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9317561419472248,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":1575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":23079,"score_linear":311460.0,"score_lmetric":266352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":81299,"ongoing_decode_tokens":81299,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":23079,"score_linear":81299.0,"score_lmetric":23079},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2482,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1913,"cache_hit":11264,"new_prefill":11815,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":21504,"new_prefill":1575,"score_linear":-21504.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":387520.561342166,"t_first_token_unix":1779818385.5752857,"t_done":387521.075231825,"t_done_unix":1779818386.089175},{"request_id":"1404395:4:1467473:894","session_id":"1404395","input_length":34863,"t_proxy_recv":387527.700997364,"t_decision_unix":1779818392.7149384,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9839658090238935,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":512,"new_prefill":34351,"score_linear":310948.0,"score_lmetric":300168},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2482,"cache_hit":34304,"new_prefill":559,"score_linear":-34304.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1913,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":34351,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-34304.0,"chosen_score_lmetric":0,"t_first_token":387527.810873306,"t_first_token_unix":1779818392.8248167,"t_done":387529.046110979,"t_done_unix":1779818394.0600543},{"request_id":"1371622:7:1468305:895","session_id":"1371622","input_length":24036,"t_proxy_recv":387530.47039082,"t_decision_unix":1779818395.484332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9585621567648527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":24036,"score_linear":311460.0,"score_lmetric":269223},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1913,"cache_hit":11264,"new_prefill":12772,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":23040,"new_prefill":996,"score_linear":-23040.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":387530.69474701,"t_first_token_unix":1779818395.7086904,"t_done":387531.5295983,"t_done_unix":1779818396.5435414},{"request_id":"1313181:10:1338837:436","session_id":"1313181","input_length":129839,"t_proxy_recv":387498.069701796,"t_decision_unix":1779818363.0836432,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":64512,"affinity_cache_ratio":0.4968614977009989,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":65327,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":125947,"ongoing_decode_tokens":125947,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":64512,"new_prefill":65327,"score_linear":61435.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2264,"cache_hit":62464,"new_prefill":67375,"score_linear":66099.0,"score_lmetric":67375},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":24064,"new_prefill":105775,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":117039,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":61435.0,"chosen_score_lmetric":0,"t_first_token":387537.084028069,"t_first_token_unix":1779818402.097972,"t_done":387538.589698782,"t_done_unix":1779818403.6036427},{"request_id":"1405155:3:1469167:897","session_id":"1405155","input_length":66246,"t_proxy_recv":387533.368192386,"t_decision_unix":1779818398.3821337,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":40448,"affinity_cache_ratio":0.610572713824231,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":25798,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":311460,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65705,"num_requests":3,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":0,"new_prefill":66246,"score_linear":311460.0,"score_lmetric":395853},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1913,"cache_hit":40448,"new_prefill":25798,"score_linear":-40448.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":65734,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":387542.281505948,"t_first_token_unix":1779818407.2954502,"t_done":387544.086487675,"t_done_unix":1779818409.100431},{"request_id":"1363943:14:1458616:885","session_id":"1363943","input_length":29268,"t_proxy_recv":387498.310314374,"t_decision_unix":1779818363.324256,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29184,"affinity_cache_ratio":0.997129971299713,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":84,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":255786,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":29184,"new_prefill":84,"score_linear":226602.0,"score_lmetric":65411},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":29268,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2264,"cache_hit":4096,"new_prefill":25172,"score_linear":124467.0,"score_lmetric":25172},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":29268,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":29268,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":226602.0,"chosen_score_lmetric":65411,"t_first_token":387539.884501365,"t_first_token_unix":1779818404.8984454,"t_done":387545.58804423,"t_done_unix":1779818410.6019876},{"request_id":"1399948:13:1472968:898","session_id":"1399948","input_length":12247,"t_proxy_recv":387545.819133633,"t_decision_unix":1779818410.833075,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9615416020249857,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":246728,"ongoing_decode_tokens":246728,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":12247,"score_linear":246728.0,"score_lmetric":36741},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":11776,"new_prefill":471,"score_linear":-11776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":387545.871439293,"t_first_token_unix":1779818410.8853827,"t_done":387546.008340635,"t_done_unix":1779818411.022284},{"request_id":"1342921:7:1473812:900","session_id":"1342921","input_length":76600,"t_proxy_recv":387548.783747645,"t_decision_unix":1779818413.7976887,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9892428198433421,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":824,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":246728,"ongoing_decode_tokens":246728,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":76600,"score_linear":246728.0,"score_lmetric":229800},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":75776,"new_prefill":824,"score_linear":-75776.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":24569,"ongoing_decode_tokens":24569,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":0,"new_prefill":76600,"score_linear":24569.0,"score_lmetric":76600},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":387549.327915891,"t_first_token_unix":1779818414.341859,"t_done":387550.652026411,"t_done_unix":1779818415.6659698},{"request_id":"1371622:8:1473416:899","session_id":"1371622","input_length":24569,"t_proxy_recv":387547.489112988,"t_decision_unix":1779818412.5030544,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9794456428833083,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":246728,"ongoing_decode_tokens":246728,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":24569,"score_linear":246728.0,"score_lmetric":73707},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":11264,"new_prefill":13305,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":24064,"new_prefill":505,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":387547.649868655,"t_first_token_unix":1779818412.6638122,"t_done":387550.767630981,"t_done_unix":1779818415.7815742},{"request_id":"1363943:15:1461716:889","session_id":"1363943","input_length":29651,"t_proxy_recv":387545.595505066,"t_decision_unix":1779818410.6094468,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29184,"affinity_cache_ratio":0.984250109608445,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":217077,"ongoing_decode_tokens":217077,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":29184,"new_prefill":467,"score_linear":187893.0,"score_lmetric":934},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":29651,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":29651,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":0,"new_prefill":29651,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":187893.0,"chosen_score_lmetric":934,"t_first_token":387545.786538476,"t_first_token_unix":1779818410.8004818,"t_done":387551.380378497,"t_done_unix":1779818416.394322},{"request_id":"1242838:5:1460026:886","session_id":"1242838","input_length":26406,"t_proxy_recv":387502.796993343,"t_decision_unix":1779818367.8109343,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9888661667802772,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":294,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":285054,"ongoing_decode_tokens":125947,"pending_prefill_tokens":65411,"num_requests":2,"active_p_offloads":0,"cached_blocks":1454,"cache_hit":26112,"new_prefill":294,"score_linear":258942.0,"score_lmetric":131410},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2477,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2264,"cache_hit":0,"new_prefill":26406,"score_linear":128563.0,"score_lmetric":26406},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1911,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":3584,"new_prefill":22822,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":258942.0,"chosen_score_lmetric":131410,"t_first_token":387543.071580977,"t_first_token_unix":1779818408.085525,"t_done":387552.592814336,"t_done_unix":1779818417.6067574},{"request_id":"1264679:3:1431512:853","session_id":"1264679","input_length":125947,"t_proxy_recv":387406.610311571,"t_decision_unix":1779818271.6242533,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":114176,"affinity_cache_ratio":0.9065400525617918,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":114176,"estimated_new_tokens":11771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1428,"cache_hit":114176,"new_prefill":11771,"score_linear":-114176.0,"score_lmetric":-11771},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2454,"cache_hit":0,"new_prefill":125947,"score_linear":1840.0,"score_lmetric":125947},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":166432,"ongoing_decode_tokens":0,"pending_prefill_tokens":113184,"num_requests":2,"active_p_offloads":0,"cached_blocks":2024,"cache_hit":0,"new_prefill":125947,"score_linear":166432.0,"score_lmetric":478262},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1900,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230019,"ongoing_decode_tokens":139201,"pending_prefill_tokens":5314,"num_requests":3,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":125947,"score_linear":230019.0,"score_lmetric":393783},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1766,"cache_hit":0,"new_prefill":125947,"score_linear":108020.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-114176.0,"chosen_score_lmetric":-11771,"t_first_token":387415.126265446,"t_first_token_unix":1779818280.1402092,"t_done":387552.893470483,"t_done_unix":1779818417.9074144},{"request_id":"1313181:10:1399867:746","session_id":"1313181","input_length":64724,"t_proxy_recv":387538.602633887,"t_decision_unix":1779818403.6165752,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9967245534886595,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":212,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":181621,"ongoing_decode_tokens":125947,"pending_prefill_tokens":378,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":64512,"new_prefill":212,"score_linear":117109.0,"score_lmetric":1180},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":62464,"new_prefill":2260,"score_linear":-62464.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":66246,"ongoing_decode_tokens":0,"pending_prefill_tokens":25798,"num_requests":1,"active_p_offloads":0,"cached_blocks":1913,"cache_hit":0,"new_prefill":64724,"score_linear":66246.0,"score_lmetric":90522},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":24064,"new_prefill":40660,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":51924,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":117109.0,"chosen_score_lmetric":1180,"t_first_token":387543.074387967,"t_first_token_unix":1779818408.0883315,"t_done":387553.415397156,"t_done_unix":1779818418.429341},{"request_id":"1305906:4:1476757:902","session_id":"1305906","input_length":44949,"t_proxy_recv":387558.85333586,"t_decision_unix":1779818423.8672771,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":16896,"affinity_cache_ratio":0.375892678368818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":28053,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":34671,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":44949,"score_linear":164602.0,"score_lmetric":109856},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":16896,"new_prefill":28053,"score_linear":-16896.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":387566.6149843,"t_first_token_unix":1779818431.6289277,"t_done":387567.934382536,"t_done_unix":1779818432.9483259},{"request_id":"1371622:9:1479535:905","session_id":"1371622","input_length":25286,"t_proxy_recv":387568.16634137,"t_decision_unix":1779818433.1802828,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9719212212291386,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":34671,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":25286,"score_linear":164602.0,"score_lmetric":90193},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":11264,"new_prefill":14022,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":24576,"new_prefill":710,"score_linear":14251.0,"score_lmetric":710},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":14251.0,"chosen_score_lmetric":710,"t_first_token":387568.274596117,"t_first_token_unix":1779818433.2885396,"t_done":387569.076659831,"t_done_unix":1779818434.0906034},{"request_id":"1404395:5:1480170:906","session_id":"1404395","input_length":36988,"t_proxy_recv":387570.407265983,"t_decision_unix":1779818435.4212072,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9412782524061858,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":2172,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":34671,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":512,"new_prefill":36476,"score_linear":164090.0,"score_lmetric":101383},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":34816,"new_prefill":2172,"score_linear":-34816.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":36988,"score_linear":38827.0,"score_lmetric":36988},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":36476,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":387570.996996814,"t_first_token_unix":1779818436.0109403,"t_done":387573.635546758,"t_done_unix":1779818438.6494904},{"request_id":"1268861:13:1481831:907","session_id":"1268861","input_length":57130,"t_proxy_recv":387575.999846093,"t_decision_unix":1779818441.0137877,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":55808,"affinity_cache_ratio":0.976859793453527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":1322,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":34671,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":57130,"score_linear":164602.0,"score_lmetric":122037},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2487,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":55808,"new_prefill":1322,"score_linear":-55808.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57130,"score_linear":38827.0,"score_lmetric":57130},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":387576.44972501,"t_first_token_unix":1779818441.4636688,"t_done":387577.70477066,"t_done_unix":1779818442.7187138},{"request_id":"1301929:4:1479037:904","session_id":"1301929","input_length":38827,"t_proxy_recv":387566.425941417,"t_decision_unix":1779818431.4398825,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9890024982615191,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":427,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":34671,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":3584,"new_prefill":35243,"score_linear":161018.0,"score_lmetric":100150},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":44949,"ongoing_decode_tokens":0,"pending_prefill_tokens":28053,"num_requests":1,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":38827,"score_linear":44949.0,"score_lmetric":66880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":38400,"new_prefill":427,"score_linear":-38400.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":387566.494879761,"t_first_token_unix":1779818431.5088232,"t_done":387578.19490352,"t_done_unix":1779818443.2088468},{"request_id":"1404395:6:1483967:909","session_id":"1404395","input_length":37689,"t_proxy_recv":387583.252641813,"t_decision_unix":1779818448.266583,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9781103239672053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":825,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":34671,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":512,"new_prefill":37177,"score_linear":164090.0,"score_lmetric":102084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2487,"cache_hit":36864,"new_prefill":825,"score_linear":-36864.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":37177,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":387583.466973084,"t_first_token_unix":1779818448.4809165,"t_done":387585.966421896,"t_done_unix":1779818450.9803655},{"request_id":"1313181:11:1344301:464","session_id":"1313181","input_length":129931,"t_proxy_recv":387553.444735266,"t_decision_unix":1779818418.4586768,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.5004502389729933,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":64907,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":34671,"ongoing_decode_tokens":34671,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":65024,"new_prefill":64907,"score_linear":-30353.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":62464,"new_prefill":67467,"score_linear":-62464.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":24064,"new_prefill":105867,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":117131,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-30353.0,"chosen_score_lmetric":0,"t_first_token":387592.398439,"t_first_token_unix":1779818457.4123824,"t_done":387597.405033045,"t_done_unix":1779818462.4189773},{"request_id":"1313181:11:1402841:762","session_id":"1313181","input_length":65123,"t_proxy_recv":387597.418953696,"t_decision_unix":1779818462.432895,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9984797997635244,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":99,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64574,"ongoing_decode_tokens":64574,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1482,"cache_hit":65024,"new_prefill":99,"score_linear":-450.0,"score_lmetric":99},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":62464,"new_prefill":2659,"score_linear":-62464.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":41059,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":52323,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-450.0,"chosen_score_lmetric":99,"t_first_token":387597.520282568,"t_first_token_unix":1779818462.5342264,"t_done":387598.176195262,"t_done_unix":1779818463.1901388},{"request_id":"1363943:16:1463626:890","session_id":"1363943","input_length":34671,"t_proxy_recv":387551.389779425,"t_decision_unix":1779818416.4037209,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29696,"affinity_cache_ratio":0.8565083210752502,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":4975,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":217077,"ongoing_decode_tokens":217077,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1456,"cache_hit":29696,"new_prefill":4975,"score_linear":187381.0,"score_lmetric":9950},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1682,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2483,"cache_hit":0,"new_prefill":34671,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":34671,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":0,"new_prefill":34671,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":187381.0,"chosen_score_lmetric":9950,"t_first_token":387552.591145347,"t_first_token_unix":1779818417.6050892,"t_done":387598.177401288,"t_done_unix":1779818463.1913457},{"request_id":"1242838:6:1486863:911","session_id":"1242838","input_length":29903,"t_proxy_recv":387593.002643369,"t_decision_unix":1779818458.0165846,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8903454502892686,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":3279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":164602,"ongoing_decode_tokens":164602,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":26624,"new_prefill":3279,"score_linear":137978.0,"score_lmetric":3279},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":3584,"new_prefill":26319,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":137978.0,"chosen_score_lmetric":3279,"t_first_token":387596.999110425,"t_first_token_unix":1779818462.013054,"t_done":387599.617929258,"t_done_unix":1779818464.6318724},{"request_id":"1363943:17:1466811:893","session_id":"1363943","input_length":35991,"t_proxy_recv":387598.199368467,"t_decision_unix":1779818463.2133102,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9673529493484482,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":1175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":29903,"ongoing_decode_tokens":29903,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":34816,"new_prefill":1175,"score_linear":-4913.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":0,"new_prefill":35991,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":35991,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":35991,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-4913.0,"chosen_score_lmetric":0,"t_first_token":387598.585114095,"t_first_token_unix":1779818463.5990582,"t_done":387599.990015346,"t_done_unix":1779818465.0039587},{"request_id":"1363943:18:1469143:896","session_id":"1363943","input_length":47303,"t_proxy_recv":387600.004641193,"t_decision_unix":1779818465.0185826,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":35840,"affinity_cache_ratio":0.7576686468088705,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":11463,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1500,"cache_hit":35840,"new_prefill":11463,"score_linear":-35840.0,"score_lmetric":-11463},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":0,"new_prefill":47303,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":43207,"score_linear":126383.0,"score_lmetric":111222},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":47303,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":47303,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":-11463,"t_first_token":387603.238151979,"t_first_token_unix":1779818468.2520957,"t_done":387605.968036592,"t_done_unix":1779818470.98198},{"request_id":"1404395:7:1491186:914","session_id":"1404395","input_length":39569,"t_proxy_recv":387607.794177157,"t_decision_unix":1779818472.8081183,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9575172483509818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1681,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":56056,"ongoing_decode_tokens":0,"pending_prefill_tokens":8440,"num_requests":0,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":512,"new_prefill":39057,"score_linear":55544.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":37888,"new_prefill":1681,"score_linear":-37888.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":39569,"score_linear":130479.0,"score_lmetric":107584},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":39057,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37888.0,"chosen_score_lmetric":0,"t_first_token":387608.276667026,"t_first_token_unix":1779818473.2906108,"t_done":387608.56621084,"t_done_unix":1779818473.5801542},{"request_id":"1363943:19:1473899:901","session_id":"1363943","input_length":56056,"t_proxy_recv":387605.982860907,"t_decision_unix":1779818470.9968023,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":47616,"affinity_cache_ratio":0.8494362780077066,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47616,"estimated_new_tokens":8440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1523,"cache_hit":47616,"new_prefill":8440,"score_linear":-47616.0,"score_lmetric":-8440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":0,"new_prefill":56056,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":51960,"score_linear":126383.0,"score_lmetric":119975},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":56056,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":56056,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-47616.0,"chosen_score_lmetric":-8440,"t_first_token":387608.941924387,"t_first_token_unix":1779818473.9558682,"t_done":387610.797537059,"t_done_unix":1779818475.8114805},{"request_id":"1363943:20:1476805:903","session_id":"1363943","input_length":60761,"t_proxy_recv":387610.811405314,"t_decision_unix":1779818475.8253467,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9184838959200803,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":4953,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1539,"cache_hit":55808,"new_prefill":4953,"score_linear":-55808.0,"score_lmetric":-4953},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2492,"cache_hit":0,"new_prefill":60761,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":56665,"score_linear":126383.0,"score_lmetric":124680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":60761,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":60761,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":-4953,"t_first_token":387612.608835605,"t_first_token_unix":1779818477.6227796,"t_done":387616.053312551,"t_done_unix":1779818481.0672562},{"request_id":"1363943:21:1482184:908","session_id":"1363943","input_length":65658,"t_proxy_recv":387616.068537967,"t_decision_unix":1779818481.0824795,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9279600353346127,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":4730,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":60928,"new_prefill":4730,"score_linear":-60928.0,"score_lmetric":-4730},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2492,"cache_hit":0,"new_prefill":65658,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":61562,"score_linear":126383.0,"score_lmetric":129577},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":65658,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":65658,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":-4730,"t_first_token":387617.998071696,"t_first_token_unix":1779818483.012015,"t_done":387621.127114447,"t_done_unix":1779818486.1410604},{"request_id":"1404395:8:1494219:916","session_id":"1404395","input_length":39820,"t_proxy_recv":387617.905722031,"t_decision_unix":1779818482.9196634,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":39424,"affinity_cache_ratio":0.9900552486187846,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39424,"estimated_new_tokens":396,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65658,"ongoing_decode_tokens":0,"pending_prefill_tokens":4730,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":512,"new_prefill":39308,"score_linear":65146.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2492,"cache_hit":39424,"new_prefill":396,"score_linear":-39424.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":39820,"score_linear":130479.0,"score_lmetric":107835},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":512,"new_prefill":39308,"score_linear":-512.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39424.0,"chosen_score_lmetric":0,"t_first_token":387618.053377737,"t_first_token_unix":1779818483.0673208,"t_done":387621.640206372,"t_done_unix":1779818486.6541498},{"request_id":"1363943:22:1485341:910","session_id":"1363943","input_length":70238,"t_proxy_recv":387621.142186397,"t_decision_unix":1779818486.156128,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65536,"affinity_cache_ratio":0.9330561804151599,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":4702,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":65536,"new_prefill":4702,"score_linear":-65536.0,"score_lmetric":-4702},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":39820,"ongoing_decode_tokens":39820,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2492,"cache_hit":0,"new_prefill":70238,"score_linear":39820.0,"score_lmetric":70238},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":66142,"score_linear":126383.0,"score_lmetric":134157},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":70238,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70238,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-65536.0,"chosen_score_lmetric":-4702,"t_first_token":387623.070775378,"t_first_token_unix":1779818488.0847192,"t_done":387626.537960259,"t_done_unix":1779818491.551904},{"request_id":"1363943:23:1488713:912","session_id":"1363943","input_length":72516,"t_proxy_recv":387626.552224836,"t_decision_unix":1779818491.5661666,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9672899773843014,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":2372,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":70144,"new_prefill":2372,"score_linear":-70144.0,"score_lmetric":-2372},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":72516,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":68420,"score_linear":126383.0,"score_lmetric":136435},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":72516,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72516,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":68420,"score_linear":71664.0,"score_lmetric":72500}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":-2372,"t_first_token":387627.601060002,"t_first_token_unix":1779818492.6150038,"t_done":387629.576939721,"t_done_unix":1779818494.590883},{"request_id":"1363943:24:1491020:913","session_id":"1363943","input_length":74939,"t_proxy_recv":387629.593568625,"t_decision_unix":1779818494.60751,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9701757429375892,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":2235,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1572,"cache_hit":72704,"new_prefill":2235,"score_linear":-72704.0,"score_lmetric":-2235},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":74939,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":70843,"score_linear":126383.0,"score_lmetric":138858},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":74939,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74939,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":70843,"score_linear":71664.0,"score_lmetric":74923}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":-2235,"t_first_token":387630.81106583,"t_first_token_unix":1779818495.8250093,"t_done":387632.408890598,"t_done_unix":1779818497.4228342},{"request_id":"1268861:14:1498281:920","session_id":"1268861","input_length":61910,"t_proxy_recv":387631.393140053,"t_decision_unix":1779818496.4070811,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9179777095784203,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":5078,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":74939,"ongoing_decode_tokens":74939,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1572,"cache_hit":0,"new_prefill":61910,"score_linear":74939.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":61910,"score_linear":130479.0,"score_lmetric":129925},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":56832,"new_prefill":5078,"score_linear":-56832.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":61910,"score_linear":75760.0,"score_lmetric":65990}],"chosen_score_linear":-56832.0,"chosen_score_lmetric":0,"t_first_token":387633.221248192,"t_first_token_unix":1779818498.2351918,"t_done":387633.786104432,"t_done_unix":1779818498.800048},{"request_id":"1363943:25:1493325:915","session_id":"1363943","input_length":75711,"t_proxy_recv":387632.422826565,"t_decision_unix":1779818497.436768,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9873334125820554,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":959,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1576,"cache_hit":74752,"new_prefill":959,"score_linear":-74752.0,"score_lmetric":-959},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":75711,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":71615,"score_linear":126383.0,"score_lmetric":139630},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61910,"ongoing_decode_tokens":0,"pending_prefill_tokens":5078,"num_requests":1,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":75711,"score_linear":61910.0,"score_lmetric":80789},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75711,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":71615,"score_linear":71664.0,"score_lmetric":75695}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":-959,"t_first_token":387632.832374437,"t_first_token_unix":1779818497.846319,"t_done":387635.013052905,"t_done_unix":1779818500.0269969},{"request_id":"1363943:26:1495648:917","session_id":"1363943","input_length":83861,"t_proxy_recv":387635.031482143,"t_decision_unix":1779818500.0454235,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":75776,"affinity_cache_ratio":0.903590465174515,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":8085,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1578,"cache_hit":75776,"new_prefill":8085,"score_linear":-75776.0,"score_lmetric":-8085},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":83861,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":79765,"score_linear":126383.0,"score_lmetric":147780},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":83861,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":83861,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":79765,"score_linear":71664.0,"score_lmetric":83845}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":-8085,"t_first_token":387639.074344607,"t_first_token_unix":1779818504.088288,"t_done":387642.158586203,"t_done_unix":1779818507.1725297},{"request_id":"1242838:7:1499476:921","session_id":"1242838","input_length":33352,"t_proxy_recv":387635.223225583,"t_decision_unix":1779818500.2371671,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29696,"affinity_cache_ratio":0.8903813864236028,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":3656,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83861,"ongoing_decode_tokens":0,"pending_prefill_tokens":8085,"num_requests":0,"active_p_offloads":0,"cached_blocks":1578,"cache_hit":29696,"new_prefill":3656,"score_linear":54165.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":33352,"score_linear":130479.0,"score_lmetric":101367},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":3584,"new_prefill":29768,"score_linear":-3584.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":33352,"score_linear":75760.0,"score_lmetric":37432}],"chosen_score_linear":54165.0,"chosen_score_lmetric":0,"t_first_token":387639.812332479,"t_first_token_unix":1779818504.8262765,"t_done":387643.445190447,"t_done_unix":1779818508.4591339},{"request_id":"1363943:27:1497882:919","session_id":"1363943","input_length":84090,"t_proxy_recv":387642.174186395,"t_decision_unix":1779818507.1881278,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":83968,"affinity_cache_ratio":0.9985491735045784,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83968,"estimated_new_tokens":122,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33352,"ongoing_decode_tokens":33352,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":83968,"new_prefill":122,"score_linear":-50616.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":84090,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":79994,"score_linear":126383.0,"score_lmetric":148009},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":84090,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":84090,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":79994,"score_linear":71664.0,"score_lmetric":84074}],"chosen_score_linear":-50616.0,"chosen_score_lmetric":0,"t_first_token":387642.343022539,"t_first_token_unix":1779818507.3569663,"t_done":387646.147859269,"t_done_unix":1779818511.1618032},{"request_id":"1313181:12:1346194:470","session_id":"1313181","input_length":130479,"t_proxy_recv":387598.21225712,"t_decision_unix":1779818463.2261984,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":3,"affinity_cache_hit":65024,"affinity_cache_ratio":0.49834839322802904,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":68015,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65894,"ongoing_decode_tokens":29903,"pending_prefill_tokens":1175,"num_requests":1,"active_p_offloads":0,"cached_blocks":1492,"cache_hit":65024,"new_prefill":65455,"score_linear":870.0,"score_lmetric":66630},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2489,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":62464,"new_prefill":68015,"score_linear":-62464.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":106415,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":117679,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-62464.0,"chosen_score_lmetric":0,"t_first_token":387647.921980613,"t_first_token_unix":1779818512.9359243,"t_done":387648.816310866,"t_done_unix":1779818513.8302546},{"request_id":"1363943:28:1500984:922","session_id":"1363943","input_length":86984,"t_proxy_recv":387646.169881386,"t_decision_unix":1779818511.1838229,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":83968,"affinity_cache_ratio":0.9653269566816886,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83968,"estimated_new_tokens":3016,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":83968,"new_prefill":3016,"score_linear":-83968.0,"score_lmetric":-3016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":86984,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":4096,"new_prefill":82888,"score_linear":126383.0,"score_lmetric":150903},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":86984,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":86984,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":82888,"score_linear":175557.0,"score_lmetric":187194}],"chosen_score_linear":-83968.0,"chosen_score_lmetric":-3016,"t_first_token":387647.727122938,"t_first_token_unix":1779818512.7410672,"t_done":387649.896778848,"t_done_unix":1779818514.9107227},{"request_id":"1342921:8:1503584:925","session_id":"1342921","input_length":78722,"t_proxy_recv":387649.084482462,"t_decision_unix":1779818514.0984232,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":76288,"affinity_cache_ratio":0.9690810700947639,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76288,"estimated_new_tokens":2434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":86984,"ongoing_decode_tokens":86984,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":78722,"score_linear":86984.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65179,"ongoing_decode_tokens":65179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":76288,"new_prefill":2434,"score_linear":-11109.0,"score_lmetric":2434},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":78722,"score_linear":179653.0,"score_lmetric":178862}],"chosen_score_linear":-11109.0,"chosen_score_lmetric":2434,"t_first_token":387650.218749595,"t_first_token_unix":1779818515.2326932,"t_done":387650.503254589,"t_done_unix":1779818515.5171983},{"request_id":"1313181:12:1404813:772","session_id":"1313181","input_length":65179,"t_proxy_recv":387648.831518226,"t_decision_unix":1779818513.8454595,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9976219334448212,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":155,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":86984,"ongoing_decode_tokens":86984,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":65024,"new_prefill":155,"score_linear":21960.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":65024,"new_prefill":155,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":41115,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":52379,"score_linear":166853.0,"score_lmetric":126176}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":387648.926873699,"t_first_token_unix":1779818513.9408174,"t_done":387650.640783231,"t_done_unix":1779818515.6547272},{"request_id":"1399948:14:1504493:926","session_id":"1399948","input_length":14189,"t_proxy_recv":387651.862278995,"t_decision_unix":1779818516.8762202,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.829938684896751,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":2413,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":221168,"ongoing_decode_tokens":89469,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":14189,"score_linear":221168.0,"score_lmetric":80864},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":11776,"new_prefill":2413,"score_linear":-11776.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":0,"new_prefill":14189,"score_linear":179653.0,"score_lmetric":49796}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":387652.153373336,"t_first_token_unix":1779818517.1673164,"t_done":387652.442680405,"t_done_unix":1779818517.4566236},{"request_id":"1388507:2:1496686:918","session_id":"1388507","input_length":75760,"t_proxy_recv":387626.008651371,"t_decision_unix":1779818491.0225925,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9461457233368532,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":4080,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":70238,"ongoing_decode_tokens":70238,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1558,"cache_hit":0,"new_prefill":75760,"score_linear":70238.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":75760,"score_linear":130479.0,"score_lmetric":143775},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1965,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":71680,"new_prefill":4080,"score_linear":-71680.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":387645.699310558,"t_first_token_unix":1779818510.7132542,"t_done":387665.482618023,"t_done_unix":1779818530.496562},{"request_id":"1397515:2:1502033:923","session_id":"1397515","input_length":103893,"t_proxy_recv":387643.785934004,"t_decision_unix":1779818508.7998753,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":93184,"affinity_cache_ratio":0.8969227955685176,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":10709,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":84090,"ongoing_decode_tokens":84090,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1601,"cache_hit":0,"new_prefill":103893,"score_linear":84090.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":512,"new_prefill":103381,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130479,"ongoing_decode_tokens":0,"pending_prefill_tokens":68015,"num_requests":1,"active_p_offloads":0,"cached_blocks":2269,"cache_hit":0,"new_prefill":103893,"score_linear":130479.0,"score_lmetric":171908},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":93184,"new_prefill":10709,"score_linear":-17424.0,"score_lmetric":14789}],"chosen_score_linear":-17424.0,"chosen_score_lmetric":14789,"t_first_token":387662.869559241,"t_first_token_unix":1779818527.8835032,"t_done":387667.358075513,"t_done_unix":1779818532.3720193},{"request_id":"1268861:15:1508874:928","session_id":"1268861","input_length":63035,"t_proxy_recv":387666.716618884,"t_decision_unix":1779818531.7305598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9828190687713175,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":1083,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":221168,"ongoing_decode_tokens":89469,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":63035,"score_linear":221168.0,"score_lmetric":129710},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2497,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":61952,"new_prefill":1083,"score_linear":-61952.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":103893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":63035,"score_linear":103893.0,"score_lmetric":63035}],"chosen_score_linear":-61952.0,"chosen_score_lmetric":0,"t_first_token":387667.291391807,"t_first_token_unix":1779818532.3053353,"t_done":387668.710566437,"t_done_unix":1779818533.7245104},{"request_id":"1399948:15:1512300:930","session_id":"1399948","input_length":15669,"t_proxy_recv":387678.18333905,"t_decision_unix":1779818543.19728,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8822515795519816,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":221168,"ongoing_decode_tokens":89469,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":15669,"score_linear":221168.0,"score_lmetric":82344},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2497,"cache_hit":13824,"new_prefill":1845,"score_linear":-13824.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":387678.426961001,"t_first_token_unix":1779818543.4409046,"t_done":387678.67413778,"t_done_unix":1779818543.6880813},{"request_id":"1399948:16:1513839:933","session_id":"1399948","input_length":15913,"t_proxy_recv":387683.371715958,"t_decision_unix":1779818548.3856573,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":15360,"affinity_cache_ratio":0.9652485389304343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":221168,"ongoing_decode_tokens":89469,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":15913,"score_linear":221168.0,"score_lmetric":82588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2500,"cache_hit":15360,"new_prefill":553,"score_linear":-15360.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":0,"pending_prefill_tokens":2864,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":15913,"score_linear":174896.0,"score_lmetric":37554},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":387683.454122099,"t_first_token_unix":1779818548.4680655,"t_done":387683.88136098,"t_done_unix":1779818548.8953044},{"request_id":"1313181:13:1349104:484","session_id":"1313181","input_length":131699,"t_proxy_recv":387650.663236054,"t_decision_unix":1779818515.6771777,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.49373191899710706,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":65024,"estimated_new_tokens":66675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89469,"ongoing_decode_tokens":0,"pending_prefill_tokens":2429,"num_requests":0,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":65024,"new_prefill":66675,"score_linear":24445.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":65024,"new_prefill":66675,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":107635,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":12800,"new_prefill":118899,"score_linear":166853.0,"score_lmetric":259216}],"chosen_score_linear":24445.0,"chosen_score_lmetric":0,"t_first_token":387691.477721058,"t_first_token_unix":1779818556.4916646,"t_done":387693.885738747,"t_done_unix":1779818558.8996825},{"request_id":"1363943:29:1503515:924","session_id":"1363943","input_length":89469,"t_proxy_recv":387649.913279019,"t_decision_unix":1779818514.9272206,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":87040,"affinity_cache_ratio":0.972850931607596,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":87040,"estimated_new_tokens":2429,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":87040,"new_prefill":2429,"score_linear":-87040.0,"score_lmetric":-2429},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2493,"cache_hit":0,"new_prefill":89469,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":143901,"ongoing_decode_tokens":65179,"pending_prefill_tokens":2434,"num_requests":2,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":4096,"new_prefill":85373,"score_linear":139805.0,"score_lmetric":175614},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1975,"cache_hit":0,"new_prefill":89469,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":89469,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":179653,"ongoing_decode_tokens":75760,"pending_prefill_tokens":10709,"num_requests":2,"active_p_offloads":0,"cached_blocks":2326,"cache_hit":4096,"new_prefill":85373,"score_linear":175557.0,"score_lmetric":192164}],"chosen_score_linear":-87040.0,"chosen_score_lmetric":-2429,"t_first_token":387651.351690537,"t_first_token_unix":1779818516.365634,"t_done":387694.720057058,"t_done_unix":1779818559.7340007},{"request_id":"1363943:30:1506171:927","session_id":"1363943","input_length":89713,"t_proxy_recv":387694.73799815,"t_decision_unix":1779818559.7519395,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9987404278086788,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65279,"ongoing_decode_tokens":65279,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":89600,"new_prefill":113,"score_linear":-24321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2501,"cache_hit":0,"new_prefill":89713,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":0,"pending_prefill_tokens":2864,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":4096,"new_prefill":85617,"score_linear":170800.0,"score_lmetric":176962},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":89713,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":89713,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-24321.0,"chosen_score_lmetric":0,"t_first_token":387694.890511741,"t_first_token_unix":1779818559.904455,"t_done":387695.853703791,"t_done_unix":1779818560.8676474},{"request_id":"1313181:13:1406095:783","session_id":"1313181","input_length":65279,"t_proxy_recv":387693.898502715,"t_decision_unix":1779818558.912444,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9960936901606948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89469,"ongoing_decode_tokens":89469,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":65024,"new_prefill":255,"score_linear":24445.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2501,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":0,"pending_prefill_tokens":2864,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":65024,"new_prefill":255,"score_linear":109872.0,"score_lmetric":6238},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":41215,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":12800,"new_prefill":52479,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":24445.0,"chosen_score_lmetric":0,"t_first_token":387694.007882677,"t_first_token_unix":1779818559.0218258,"t_done":387697.571029711,"t_done_unix":1779818562.584973},{"request_id":"1399948:17:1518102:936","session_id":"1399948","input_length":16604,"t_proxy_recv":387697.47552542,"t_decision_unix":1779818562.4894667,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":15872,"affinity_cache_ratio":0.9559142375331245,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":732,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":155069,"ongoing_decode_tokens":155069,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":0,"new_prefill":16604,"score_linear":155069.0,"score_lmetric":16604},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2501,"cache_hit":15872,"new_prefill":732,"score_linear":-15872.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":0,"pending_prefill_tokens":2864,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":16604,"score_linear":174896.0,"score_lmetric":38936},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-15872.0,"chosen_score_lmetric":0,"t_first_token":387697.617221309,"t_first_token_unix":1779818562.6311648,"t_done":387697.969377246,"t_done_unix":1779818562.9833202},{"request_id":"1399948:18:1524432:938","session_id":"1399948","input_length":17276,"t_proxy_recv":387718.524115187,"t_decision_unix":1779818583.538056,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":16384,"affinity_cache_ratio":0.948367677703172,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":892,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":17276,"score_linear":229147.0,"score_lmetric":25049},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2502,"cache_hit":16384,"new_prefill":892,"score_linear":-16384.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":130532,"pending_prefill_tokens":1868,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":17276,"score_linear":174896.0,"score_lmetric":38288},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16384.0,"chosen_score_lmetric":0,"t_first_token":387718.660942146,"t_first_token_unix":1779818583.6748862,"t_done":387719.012190147,"t_done_unix":1779818584.0261338},{"request_id":"1399948:19:1526739:941","session_id":"1399948","input_length":18091,"t_proxy_recv":387726.444456875,"t_decision_unix":1779818591.4583976,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":16896,"affinity_cache_ratio":0.9339450555524846,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":1195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":18091,"score_linear":229147.0,"score_lmetric":25864},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":18091,"score_linear":87576.0,"score_lmetric":28867},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2503,"cache_hit":16896,"new_prefill":1195,"score_linear":-16896.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":18091,"score_linear":253982.0,"score_lmetric":56523},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":387726.621084977,"t_first_token_unix":1779818591.6350284,"t_done":387726.908636295,"t_done_unix":1779818591.9225795},{"request_id":"1399948:20:1527857:942","session_id":"1399948","input_length":18164,"t_proxy_recv":387729.942331771,"t_decision_unix":1779818594.9562728,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":17920,"affinity_cache_ratio":0.9865668354987888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":18164,"score_linear":229147.0,"score_lmetric":25937},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":18164,"score_linear":87576.0,"score_lmetric":28940},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2505,"cache_hit":17920,"new_prefill":244,"score_linear":-17920.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":18164,"score_linear":253982.0,"score_lmetric":56742},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":387729.992911572,"t_first_token_unix":1779818595.0068552,"t_done":387730.525563543,"t_done_unix":1779818595.5395067},{"request_id":"1399948:21:1528978:944","session_id":"1399948","input_length":18388,"t_proxy_recv":387733.890054321,"t_decision_unix":1779818598.9039953,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":17920,"affinity_cache_ratio":0.9745486186643463,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":468,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":18388,"score_linear":229147.0,"score_lmetric":26161},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":18388,"score_linear":87576.0,"score_lmetric":29164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36568,"ongoing_decode_tokens":0,"pending_prefill_tokens":36568,"num_requests":1,"active_p_offloads":0,"cached_blocks":2505,"cache_hit":17920,"new_prefill":468,"score_linear":18648.0,"score_lmetric":37036},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":18388,"score_linear":253982.0,"score_lmetric":57414},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":18648.0,"chosen_score_lmetric":37036,"t_first_token":387736.68718197,"t_first_token_unix":1779818601.7011251,"t_done":387737.501174095,"t_done_unix":1779818602.5151174},{"request_id":"1399948:22:1530122:947","session_id":"1399948","input_length":18563,"t_proxy_recv":387737.71765503,"t_decision_unix":1779818602.7315962,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":18432,"affinity_cache_ratio":0.992942951031622,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":18563,"score_linear":229147.0,"score_lmetric":26336},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":18563,"score_linear":87576.0,"score_lmetric":29339},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36568,"ongoing_decode_tokens":36568,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2506,"cache_hit":18432,"new_prefill":131,"score_linear":18136.0,"score_lmetric":131},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":18563,"score_linear":253982.0,"score_lmetric":57939},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71192,"ongoing_decode_tokens":0,"pending_prefill_tokens":8216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":18563,"score_linear":71192.0,"score_lmetric":26779},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":18136.0,"chosen_score_lmetric":131,"t_first_token":387737.786544626,"t_first_token_unix":1779818602.800488,"t_done":387738.154949134,"t_done_unix":1779818603.1688926},{"request_id":"1342921:9:1525898:939","session_id":"1342921","input_length":79086,"t_proxy_recv":387723.565844886,"t_decision_unix":1779818588.5797863,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9905166527577574,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":750,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":79086,"score_linear":229147.0,"score_lmetric":86859},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2503,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":130532,"pending_prefill_tokens":1868,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":78336,"new_prefill":750,"score_linear":96560.0,"score_lmetric":5236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":96560.0,"chosen_score_lmetric":5236,"t_first_token":387738.221539241,"t_first_token_unix":1779818603.235483,"t_done":387738.607402033,"t_done_unix":1779818603.6213455},{"request_id":"1277428:9:1513231:932","session_id":"1277428","input_length":44364,"t_proxy_recv":387681.203585116,"t_decision_unix":1779818546.2175262,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":42496,"affinity_cache_ratio":0.9578937877558381,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":1868,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":221168,"ongoing_decode_tokens":89469,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":44364,"score_linear":221168.0,"score_lmetric":111039},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4608,"new_prefill":39756,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2500,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130532,"ongoing_decode_tokens":0,"pending_prefill_tokens":996,"num_requests":1,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":42496,"new_prefill":1868,"score_linear":88036.0,"score_lmetric":2864},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":88036.0,"chosen_score_lmetric":2864,"t_first_token":387723.614212704,"t_first_token_unix":1779818588.6281557,"t_done":387738.953487504,"t_done_unix":1779818603.967431},{"request_id":"1243831:2:1528168:943","session_id":"1243831","input_length":36568,"t_proxy_recv":387731.149745785,"t_decision_unix":1779818596.163687,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.30802887770728504,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":36568,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":36568,"score_linear":229147.0,"score_lmetric":44341},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":25304,"score_linear":76312.0,"score_lmetric":36080},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2505,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":36568,"score_linear":253982.0,"score_lmetric":111954},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":387736.683188471,"t_first_token_unix":1779818601.6971323,"t_done":387741.178424785,"t_done_unix":1779818606.1923683},{"request_id":"1268861:16:1529894:946","session_id":"1268861","input_length":71192,"t_proxy_recv":387736.911301244,"t_decision_unix":1779818601.9252427,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":62976,"affinity_cache_ratio":0.8845937745814136,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":8216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":71192,"score_linear":229147.0,"score_lmetric":78965},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":71192,"score_linear":87576.0,"score_lmetric":81968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":54956,"ongoing_decode_tokens":54956,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2505,"cache_hit":0,"new_prefill":71192,"score_linear":54956.0,"score_lmetric":142384},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":71192,"score_linear":253982.0,"score_lmetric":215826},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":62976,"new_prefill":8216,"score_linear":-62976.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":387740.347320148,"t_first_token_unix":1779818605.3612635,"t_done":387741.466057402,"t_done_unix":1779818606.4800029},{"request_id":"1243831:3:1270336:110","session_id":"1243831","input_length":11584,"t_proxy_recv":387741.181893133,"t_decision_unix":1779818606.1958346,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9723756906077348,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":11584,"score_linear":229147.0,"score_lmetric":19357},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":320,"score_linear":76312.0,"score_lmetric":11096},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2578,"cache_hit":11264,"new_prefill":320,"score_linear":-11264.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":176383,"ongoing_decode_tokens":176383,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":11584,"score_linear":176383.0,"score_lmetric":23168},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71192,"ongoing_decode_tokens":71192,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":11584,"score_linear":71192.0,"score_lmetric":11584},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":387741.216506957,"t_first_token_unix":1779818606.2304502,"t_done":387742.047721637,"t_done_unix":1779818607.0616658},{"request_id":"1243831:4:1284306:183","session_id":"1243831","input_length":14515,"t_proxy_recv":387742.053300947,"t_decision_unix":1779818607.0672424,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.7760248019290389,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":3251,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":14515,"score_linear":229147.0,"score_lmetric":22288},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":3251,"score_linear":76312.0,"score_lmetric":14027},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2578,"cache_hit":11264,"new_prefill":3251,"score_linear":-11264.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":176383,"ongoing_decode_tokens":176383,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":14515,"score_linear":176383.0,"score_lmetric":29030},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":387742.427517288,"t_first_token_unix":1779818607.4414608,"t_done":387742.852112607,"t_done_unix":1779818607.8660564},{"request_id":"1356885:4:1512902:931","session_id":"1356885","input_length":130532,"t_proxy_recv":387680.074029036,"t_decision_unix":1779818545.0879703,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":129536,"affinity_cache_ratio":0.9923696871265284,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":129536,"estimated_new_tokens":996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":221168,"ongoing_decode_tokens":89469,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":0,"new_prefill":130532,"score_linear":221168.0,"score_lmetric":197207},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2500,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":129536,"new_prefill":996,"score_linear":-129536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-129536.0,"chosen_score_lmetric":0,"t_first_token":387716.630106334,"t_first_token_unix":1779818581.64405,"t_done":387743.000804616,"t_done_unix":1779818608.0147486},{"request_id":"1243831:5:1303288:273","session_id":"1243831","input_length":14627,"t_proxy_recv":387742.856524696,"t_decision_unix":1779818607.8704662,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.980105284747385,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":14627,"score_linear":229147.0,"score_lmetric":22400},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":3363,"score_linear":76312.0,"score_lmetric":14139},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2584,"cache_hit":14336,"new_prefill":291,"score_linear":-14336.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":176383,"ongoing_decode_tokens":176383,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":14627,"score_linear":176383.0,"score_lmetric":29254},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":387742.909165699,"t_first_token_unix":1779818607.9231093,"t_done":387743.36093714,"t_done_unix":1779818608.374881},{"request_id":"1277428:10:1517408:935","session_id":"1277428","input_length":45851,"t_proxy_recv":387738.963101023,"t_decision_unix":1779818603.9770427,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9603280190181239,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1819,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":45851,"score_linear":229147.0,"score_lmetric":53624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4608,"new_prefill":41243,"score_linear":82968.0,"score_lmetric":52019},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36568,"ongoing_decode_tokens":36568,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2506,"cache_hit":0,"new_prefill":45851,"score_linear":36568.0,"score_lmetric":45851},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130532,"ongoing_decode_tokens":130532,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":44032,"new_prefill":1819,"score_linear":86500.0,"score_lmetric":1819},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71192,"ongoing_decode_tokens":0,"pending_prefill_tokens":8216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":45851,"score_linear":71192.0,"score_lmetric":54067},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":86500.0,"chosen_score_lmetric":1819,"t_first_token":387739.497082873,"t_first_token_unix":1779818604.5110261,"t_done":387743.371318773,"t_done_unix":1779818608.385262},{"request_id":"1277428:11:1520449:937","session_id":"1277428","input_length":46361,"t_proxy_recv":387743.379815906,"t_decision_unix":1779818608.3937573,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":46080,"affinity_cache_ratio":0.9939388710338432,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":46361,"score_linear":229147.0,"score_lmetric":54134},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4608,"new_prefill":41753,"score_linear":82968.0,"score_lmetric":52529},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":17410,"ongoing_decode_tokens":0,"pending_prefill_tokens":3074,"num_requests":1,"active_p_offloads":0,"cached_blocks":2584,"cache_hit":0,"new_prefill":46361,"score_linear":17410.0,"score_lmetric":49435},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":46080,"new_prefill":281,"score_linear":-46080.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":387743.546041586,"t_first_token_unix":1779818608.5599852,"t_done":387743.938595484,"t_done_unix":1779818608.952539},{"request_id":"1243831:6:1313694:320","session_id":"1243831","input_length":17410,"t_proxy_recv":387743.367307028,"t_decision_unix":1779818608.3812485,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.8234348075818495,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":3074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":17410,"score_linear":229147.0,"score_lmetric":25183},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":6146,"score_linear":76312.0,"score_lmetric":16922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2584,"cache_hit":14336,"new_prefill":3074,"score_linear":-14336.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45851,"ongoing_decode_tokens":45851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2298,"cache_hit":0,"new_prefill":17410,"score_linear":45851.0,"score_lmetric":17410},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":387743.782141124,"t_first_token_unix":1779818608.7960846,"t_done":387744.235534743,"t_done_unix":1779818609.249478},{"request_id":"1243831:7:1323865:366","session_id":"1243831","input_length":19460,"t_proxy_recv":387744.253804038,"t_decision_unix":1779818609.267733,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":17408,"affinity_cache_ratio":0.8945529290853032,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":2052,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":19460,"score_linear":229147.0,"score_lmetric":19460},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":8196,"score_linear":76312.0,"score_lmetric":18972},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2590,"cache_hit":17408,"new_prefill":2052,"score_linear":-17408.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":387744.620145069,"t_first_token_unix":1779818609.6340885,"t_done":387745.220297289,"t_done_unix":1779818610.2342405},{"request_id":"1243831:8:1333049:414","session_id":"1243831","input_length":24512,"t_proxy_recv":387745.228096773,"t_decision_unix":1779818610.2420382,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":19456,"affinity_cache_ratio":0.793733681462141,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":5056,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":24512,"score_linear":229147.0,"score_lmetric":24512},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":13248,"score_linear":76312.0,"score_lmetric":24024},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2594,"cache_hit":19456,"new_prefill":5056,"score_linear":-19456.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":387746.100053799,"t_first_token_unix":1779818611.1139972,"t_done":387746.773843662,"t_done_unix":1779818611.7877872},{"request_id":"1243831:9:1348240:478","session_id":"1243831","input_length":25075,"t_proxy_recv":387746.780443241,"t_decision_unix":1779818611.794385,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24576,"affinity_cache_ratio":0.980099700897308,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":499,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":25075,"score_linear":229147.0,"score_lmetric":25075},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":13811,"score_linear":76312.0,"score_lmetric":24587},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2604,"cache_hit":24576,"new_prefill":499,"score_linear":-24576.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":387746.943371013,"t_first_token_unix":1779818611.9573145,"t_done":387747.347752103,"t_done_unix":1779818612.3616955},{"request_id":"1243831:10:1358921:521","session_id":"1243831","input_length":26343,"t_proxy_recv":387747.354192595,"t_decision_unix":1779818612.3681345,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9523592605246175,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":26343,"score_linear":229147.0,"score_lmetric":26343},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":15079,"score_linear":76312.0,"score_lmetric":25855},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2605,"cache_hit":25088,"new_prefill":1255,"score_linear":-25088.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":0,"t_first_token":387747.642130206,"t_first_token_unix":1779818612.6560738,"t_done":387748.333953159,"t_done_unix":1779818613.3478966},{"request_id":"1243831:11:1371191:594","session_id":"1243831","input_length":26818,"t_proxy_recv":387748.340579844,"t_decision_unix":1779818613.3545215,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9736743977925274,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":26818,"score_linear":229147.0,"score_lmetric":26818},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":15554,"score_linear":76312.0,"score_lmetric":26330},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2607,"cache_hit":26112,"new_prefill":706,"score_linear":-26112.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26112.0,"chosen_score_lmetric":0,"t_first_token":387748.506832037,"t_first_token_unix":1779818613.5207758,"t_done":387748.960820344,"t_done_unix":1779818613.974764},{"request_id":"1243831:12:1385174:681","session_id":"1243831","input_length":27164,"t_proxy_recv":387748.967533003,"t_decision_unix":1779818613.9814746,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9801207480488883,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":27164,"score_linear":229147.0,"score_lmetric":27164},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":15900,"score_linear":76312.0,"score_lmetric":26676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2608,"cache_hit":26624,"new_prefill":540,"score_linear":-26624.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":387749.08664918,"t_first_token_unix":1779818614.1005926,"t_done":387749.490107353,"t_done_unix":1779818614.5040507},{"request_id":"1243831:13:1398072:738","session_id":"1243831","input_length":27286,"t_proxy_recv":387749.496142938,"t_decision_unix":1779818614.5100844,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9945026753646559,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":150,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":27286,"score_linear":229147.0,"score_lmetric":27286},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":16022,"score_linear":76312.0,"score_lmetric":26798},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2609,"cache_hit":27136,"new_prefill":150,"score_linear":-27136.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":387749.574973904,"t_first_token_unix":1779818614.588917,"t_done":387750.100232057,"t_done_unix":1779818615.1141753},{"request_id":"1243831:14:1411189:814","session_id":"1243831","input_length":28085,"t_proxy_recv":387750.106150705,"t_decision_unix":1779818615.1200922,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9662097204913654,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":28085,"score_linear":229147.0,"score_lmetric":28085},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":0,"pending_prefill_tokens":18763,"num_requests":2,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":16821,"score_linear":148299.0,"score_lmetric":71168},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2609,"cache_hit":27136,"new_prefill":949,"score_linear":-27136.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130906,"ongoing_decode_tokens":130906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":28085,"score_linear":130906.0,"score_lmetric":28085},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":387750.339919637,"t_first_token_unix":1779818615.3538632,"t_done":387750.867653944,"t_done_unix":1779818615.8815975},{"request_id":"1356885:5:1533696:948","session_id":"1356885","input_length":130906,"t_proxy_recv":387749.563022266,"t_decision_unix":1779818614.576964,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":130560,"affinity_cache_ratio":0.9973568820374925,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":130560,"estimated_new_tokens":346,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":130906,"score_linear":229147.0,"score_lmetric":130906},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":130906,"score_linear":87576.0,"score_lmetric":141682},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":27286,"ongoing_decode_tokens":0,"pending_prefill_tokens":150,"num_requests":1,"active_p_offloads":0,"cached_blocks":2609,"cache_hit":0,"new_prefill":130906,"score_linear":27286.0,"score_lmetric":131056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":130560,"new_prefill":346,"score_linear":-130560.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-130560.0,"chosen_score_lmetric":0,"t_first_token":387749.808040455,"t_first_token_unix":1779818614.8219845,"t_done":387751.990926672,"t_done_unix":1779818617.004871},{"request_id":"1243831:15:1427593:849","session_id":"1243831","input_length":29382,"t_proxy_recv":387750.874448063,"t_decision_unix":1779818615.8883898,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9584099108297597,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":1222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":29382,"score_linear":229147.0,"score_lmetric":29382},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":0,"pending_prefill_tokens":18763,"num_requests":2,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":18118,"score_linear":148299.0,"score_lmetric":73762},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2611,"cache_hit":28160,"new_prefill":1222,"score_linear":-28160.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130906,"ongoing_decode_tokens":130906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":29382,"score_linear":130906.0,"score_lmetric":29382},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":387751.187923666,"t_first_token_unix":1779818616.2018676,"t_done":387752.040869245,"t_done_unix":1779818617.0548124},{"request_id":"1243831:16:1446717:874","session_id":"1243831","input_length":29571,"t_proxy_recv":387752.047258379,"t_decision_unix":1779818617.0612,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9869128538094755,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":29571,"score_linear":229147.0,"score_lmetric":29571},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":87576,"pending_prefill_tokens":7987,"num_requests":2,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":18307,"score_linear":148299.0,"score_lmetric":52588},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":29184,"new_prefill":387,"score_linear":-29184.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":387752.130835039,"t_first_token_unix":1779818617.1447783,"t_done":387752.554972509,"t_done_unix":1779818617.5689166},{"request_id":"1313181:14:1351342:491","session_id":"1313181","input_length":139357,"t_proxy_recv":387697.597996029,"t_decision_unix":1779818562.611937,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9442223928471479,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":7773,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":131584,"new_prefill":7773,"score_linear":-41794.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16604,"ongoing_decode_tokens":0,"pending_prefill_tokens":732,"num_requests":1,"active_p_offloads":0,"cached_blocks":2501,"cache_hit":0,"new_prefill":139357,"score_linear":16604.0,"score_lmetric":140089},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":0,"pending_prefill_tokens":2864,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":65024,"new_prefill":74333,"score_linear":109872.0,"score_lmetric":154394},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":115293,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":12800,"new_prefill":126557,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-41794.0,"chosen_score_lmetric":0,"t_first_token":387743.800877453,"t_first_token_unix":1779818608.8148205,"t_done":387755.853530765,"t_done_unix":1779818620.8674753},{"request_id":"1294611:15:1533841:949","session_id":"1294611","input_length":71987,"t_proxy_recv":387750.02312484,"t_decision_unix":1779818615.0370662,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":64000,"affinity_cache_ratio":0.8890494116993346,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64000,"estimated_new_tokens":7987,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":71987,"score_linear":229147.0,"score_lmetric":71987},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":64000,"new_prefill":7987,"score_linear":23576.0,"score_lmetric":18763},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":27286,"ongoing_decode_tokens":27286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2609,"cache_hit":12800,"new_prefill":59187,"score_linear":14486.0,"score_lmetric":59187},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":130906,"ongoing_decode_tokens":130906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":12800,"new_prefill":59187,"score_linear":118106.0,"score_lmetric":59187},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":23576.0,"chosen_score_lmetric":18763,"t_first_token":387755.099614036,"t_first_token_unix":1779818620.1135583,"t_done":387759.589988259,"t_done_unix":1779818624.603932},{"request_id":"1313181:14:1408792:803","session_id":"1313181","input_length":65876,"t_proxy_recv":387755.864050753,"t_decision_unix":1779818620.8779922,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65536,"affinity_cache_ratio":0.9948387880259882,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1634,"cache_hit":65536,"new_prefill":340,"score_linear":24254.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":159563,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":65876,"score_linear":159563.0,"score_lmetric":131752},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":0,"new_prefill":65876,"score_linear":31161.0,"score_lmetric":65876},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":65024,"new_prefill":852,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":41812,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":12800,"new_prefill":53076,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":24254.0,"chosen_score_lmetric":0,"t_first_token":387755.970739357,"t_first_token_unix":1779818620.9846826,"t_done":387760.888127432,"t_done_unix":1779818625.902071},{"request_id":"1313181:15:1411723:818","session_id":"1313181","input_length":66259,"t_proxy_recv":387760.90066023,"t_decision_unix":1779818625.9146018,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":66048,"affinity_cache_ratio":0.9968155269472826,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66048,"estimated_new_tokens":211,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1635,"cache_hit":66048,"new_prefill":211,"score_linear":23742.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":66259,"score_linear":87576.0,"score_lmetric":66259},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":0,"new_prefill":66259,"score_linear":31161.0,"score_lmetric":66259},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":65024,"new_prefill":1235,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":24064,"new_prefill":42195,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":12800,"new_prefill":53459,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":23742.0,"chosen_score_lmetric":0,"t_first_token":387761.055704429,"t_first_token_unix":1779818626.0696476,"t_done":387766.429401293,"t_done_unix":1779818631.4433455},{"request_id":"1253804:7:1526643:940","session_id":"1253804","input_length":87576,"t_proxy_recv":387726.009284428,"t_decision_unix":1779818591.0232258,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":76800,"affinity_cache_ratio":0.8769525897506166,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":10776,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":89790,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":87576,"score_linear":229147.0,"score_lmetric":95349},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":76800,"new_prefill":10776,"score_linear":-76800.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2503,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":253982,"ongoing_decode_tokens":174896,"pending_prefill_tokens":750,"num_requests":3,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":3584,"new_prefill":83992,"score_linear":250398.0,"score_lmetric":254226},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":387751.694708213,"t_first_token_unix":1779818616.708652,"t_done":387771.206112375,"t_done_unix":1779818636.2200563},{"request_id":"1253804:8:1541192:953","session_id":"1253804","input_length":89116,"t_proxy_recv":387774.4961989,"t_decision_unix":1779818639.51014,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88576,"affinity_cache_ratio":0.9939404820683154,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88576,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":89116,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":88576,"new_prefill":540,"score_linear":-88576.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":0,"new_prefill":89116,"score_linear":31161.0,"score_lmetric":89116},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":3584,"new_prefill":85532,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75693,"ongoing_decode_tokens":75693,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":89116,"score_linear":75693.0,"score_lmetric":89116},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-88576.0,"chosen_score_lmetric":0,"t_first_token":387774.640813625,"t_first_token_unix":1779818639.6547573,"t_done":387775.051709941,"t_done_unix":1779818640.0656538},{"request_id":"1268861:17:1540278:951","session_id":"1268861","input_length":75693,"t_proxy_recv":387771.434652441,"t_decision_unix":1779818636.4485934,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9402190427120077,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":4525,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":75693,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1776,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":0,"new_prefill":75693,"score_linear":31161.0,"score_lmetric":75693},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":71168,"new_prefill":4525,"score_linear":-71168.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":387773.621324196,"t_first_token_unix":1779818638.6352684,"t_done":387775.058937228,"t_done_unix":1779818640.0728812},{"request_id":"1399948:23:1544108:954","session_id":"1399948","input_length":20031,"t_proxy_recv":387783.941235985,"t_decision_unix":1779818648.955177,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9201737307173881,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":1599,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1636,"cache_hit":0,"new_prefill":20031,"score_linear":89790.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":18432,"new_prefill":1599,"score_linear":12729.0,"score_lmetric":1599},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":12729.0,"chosen_score_lmetric":1599,"t_first_token":387784.234591794,"t_first_token_unix":1779818649.2485356,"t_done":387784.859394745,"t_done_unix":1779818649.8733387},{"request_id":"1363943:31:1509815:929","session_id":"1363943","input_length":89790,"t_proxy_recv":387695.869813811,"t_decision_unix":1779818560.883755,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9978839514422542,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":65279,"ongoing_decode_tokens":65279,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1617,"cache_hit":89600,"new_prefill":190,"score_linear":-24321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2501,"cache_hit":0,"new_prefill":89790,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":174896,"ongoing_decode_tokens":0,"pending_prefill_tokens":2864,"num_requests":2,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":4096,"new_prefill":85694,"score_linear":170800.0,"score_lmetric":177116},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1977,"cache_hit":0,"new_prefill":89790,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":89790,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-24321.0,"chosen_score_lmetric":0,"t_first_token":387696.002878071,"t_first_token_unix":1779818561.0168211,"t_done":387786.292632237,"t_done_unix":1779818651.3065765},{"request_id":"1363943:32:1537767:950","session_id":"1363943","input_length":93368,"t_proxy_recv":387786.312047932,"t_decision_unix":1779818651.3259888,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9980293034015937,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":93184,"new_prefill":184,"score_linear":-93184.0,"score_lmetric":-184},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2616,"cache_hit":0,"new_prefill":93368,"score_linear":31161.0,"score_lmetric":93368},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":93368,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":93368,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":-184,"t_first_token":387786.52188873,"t_first_token_unix":1779818651.5358322,"t_done":387788.43372424,"t_done_unix":1779818653.4476686},{"request_id":"1399948:24:1546940:955","session_id":"1399948","input_length":21809,"t_proxy_recv":387793.387545381,"t_decision_unix":1779818658.4014864,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9155853088174607,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":1841,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":93596,"ongoing_decode_tokens":93596,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":21809,"score_linear":93596.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2616,"cache_hit":19968,"new_prefill":1841,"score_linear":11193.0,"score_lmetric":1841},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":11193.0,"chosen_score_lmetric":1841,"t_first_token":387793.735985343,"t_first_token_unix":1779818658.749929,"t_done":387794.112909678,"t_done_unix":1779818659.1268528},{"request_id":"1363943:33:1541065:952","session_id":"1363943","input_length":93596,"t_proxy_recv":387788.449805103,"t_decision_unix":1779818653.4637465,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9955981024830121,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":93184,"new_prefill":412,"score_linear":-93184.0,"score_lmetric":-412},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2616,"cache_hit":0,"new_prefill":93596,"score_linear":31161.0,"score_lmetric":93596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":93596,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":93596,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":-412,"t_first_token":387788.60190477,"t_first_token_unix":1779818653.6158485,"t_done":387795.03338235,"t_done_unix":1779818660.0473263},{"request_id":"1243831:17:1453633:883","session_id":"1243831","input_length":31161,"t_proxy_recv":387752.562019924,"t_decision_unix":1779818617.5759614,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9365553095215173,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":1977,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":229147,"ongoing_decode_tokens":229147,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1618,"cache_hit":0,"new_prefill":31161,"score_linear":229147.0,"score_lmetric":31161},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":159563,"ongoing_decode_tokens":87576,"pending_prefill_tokens":7987,"num_requests":2,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":11264,"new_prefill":19897,"score_linear":148299.0,"score_lmetric":55768},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2613,"cache_hit":29184,"new_prefill":1977,"score_linear":-29184.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1993,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":387752.955484552,"t_first_token_unix":1779818617.9694302,"t_done":387805.58099151,"t_done_unix":1779818670.5949357},{"request_id":"1399948:25:1553234:957","session_id":"1399948","input_length":22250,"t_proxy_recv":387813.921743694,"t_decision_unix":1779818678.935685,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9664719101123596,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":746,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2624,"cache_hit":21504,"new_prefill":746,"score_linear":-21504.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":76017,"ongoing_decode_tokens":76017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":22250,"score_linear":76017.0,"score_lmetric":22250},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":387814.071871298,"t_first_token_unix":1779818679.0858147,"t_done":387814.613474586,"t_done_unix":1779818679.6274178},{"request_id":"1268861:18:1553083:956","session_id":"1268861","input_length":76017,"t_proxy_recv":387813.488445494,"t_decision_unix":1779818678.502386,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9968296565241985,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2624,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":75776,"new_prefill":241,"score_linear":-75776.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":387813.736228899,"t_first_token_unix":1779818678.7501724,"t_done":387814.75606921,"t_done_unix":1779818679.7700129},{"request_id":"1399948:26:1557859:959","session_id":"1399948","input_length":23042,"t_proxy_recv":387829.87889933,"t_decision_unix":1779818694.8928404,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9554726152243729,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":1026,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2625,"cache_hit":22016,"new_prefill":1026,"score_linear":-22016.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":387830.084419347,"t_first_token_unix":1779818695.098363,"t_done":387830.367853215,"t_done_unix":1779818695.3817968},{"request_id":"1399948:27:1559017:960","session_id":"1399948","input_length":24139,"t_proxy_recv":387833.547405256,"t_decision_unix":1779818698.5613463,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9544720162392808,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1099,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2627,"cache_hit":23040,"new_prefill":1099,"score_linear":-23040.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":387833.811955775,"t_first_token_unix":1779818698.8258996,"t_done":387834.764911088,"t_done_unix":1779818699.7788546},{"request_id":"1399948:28:1560859:961","session_id":"1399948","input_length":24386,"t_proxy_recv":387839.674590598,"t_decision_unix":1779818704.6885314,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9867957024522267,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":322,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2629,"cache_hit":24064,"new_prefill":322,"score_linear":-24064.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":387839.760801765,"t_first_token_unix":1779818704.7747452,"t_done":387841.018355023,"t_done_unix":1779818706.0322986},{"request_id":"1399948:29:1571125:963","session_id":"1399948","input_length":28781,"t_proxy_recv":387873.544110951,"t_decision_unix":1779818738.558052,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24576,"affinity_cache_ratio":0.8538966679406553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":4205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2630,"cache_hit":24576,"new_prefill":4205,"score_linear":-24576.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":131413,"ongoing_decode_tokens":131413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":0,"new_prefill":28781,"score_linear":131413.0,"score_lmetric":28781},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":387874.427893946,"t_first_token_unix":1779818739.441838,"t_done":387874.694106738,"t_done_unix":1779818739.7080503},{"request_id":"1356885:6:1570780:962","session_id":"1356885","input_length":131413,"t_proxy_recv":387872.515319852,"t_decision_unix":1779818737.529261,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":131072,"affinity_cache_ratio":0.9974051273466096,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131072,"estimated_new_tokens":341,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2630,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":131072,"new_prefill":341,"score_linear":-131072.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131072.0,"chosen_score_lmetric":0,"t_first_token":387873.151278696,"t_first_token_unix":1779818738.1652226,"t_done":387875.318245256,"t_done_unix":1779818740.332189},{"request_id":"1270606:4:1578042:965","session_id":"1270606","input_length":109083,"t_proxy_recv":387897.164199353,"t_decision_unix":1779818762.17814,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9903651348056067,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":1051,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":108032,"new_prefill":1051,"score_linear":-108032.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":1536,"new_prefill":107547,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":387897.910450826,"t_first_token_unix":1779818762.9243946,"t_done":387898.966625846,"t_done_unix":1779818763.9805696},{"request_id":"1268861:19:1578134:966","session_id":"1268861","input_length":76963,"t_proxy_recv":387897.397277433,"t_decision_unix":1779818762.4112184,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9845770045346465,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":1187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":75776,"new_prefill":1187,"score_linear":33307.0,"score_lmetric":2238},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":33307.0,"chosen_score_lmetric":2238,"t_first_token":387898.374519045,"t_first_token_unix":1779818763.388463,"t_done":387899.376891594,"t_done_unix":1779818764.3908355},{"request_id":"1399948:30:1578524:967","session_id":"1399948","input_length":30773,"t_proxy_recv":387898.730381678,"t_decision_unix":1779818763.7443228,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9317258635817113,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":2101,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2638,"cache_hit":28672,"new_prefill":2101,"score_linear":-28672.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":186046,"ongoing_decode_tokens":186046,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":30773,"score_linear":186046.0,"score_lmetric":61546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":387899.242400289,"t_first_token_unix":1779818764.2563438,"t_done":387899.540829518,"t_done_unix":1779818764.5547729},{"request_id":"1399948:31:1579418:968","session_id":"1399948","input_length":30925,"t_proxy_recv":387901.956237478,"t_decision_unix":1779818766.9701788,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9933710590137429,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2642,"cache_hit":30720,"new_prefill":205,"score_linear":-30720.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2006,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":387902.055673672,"t_first_token_unix":1779818767.0696175,"t_done":387903.379878329,"t_done_unix":1779818768.3938217},{"request_id":"1356885:7:1580925:969","session_id":"1356885","input_length":131775,"t_proxy_recv":387907.270079305,"t_decision_unix":1779818772.2840204,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9985505596660975,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":191,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2642,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":131584,"new_prefill":191,"score_linear":-131584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2006,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131584.0,"chosen_score_lmetric":0,"t_first_token":387907.673456524,"t_first_token_unix":1779818772.6874,"t_done":387909.67399122,"t_done_unix":1779818774.6879346},{"request_id":"1399948:32:1581424:970","session_id":"1399948","input_length":31231,"t_proxy_recv":387908.707122369,"t_decision_unix":1779818773.7210639,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9836380519355769,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":511,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2642,"cache_hit":30720,"new_prefill":511,"score_linear":-30720.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":131775,"ongoing_decode_tokens":131775,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":31231,"score_linear":131775.0,"score_lmetric":31231},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2006,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":387908.809476526,"t_first_token_unix":1779818773.82342,"t_done":387909.807502818,"t_done_unix":1779818774.8214464},{"request_id":"1270606:5:1581455:971","session_id":"1270606","input_length":111387,"t_proxy_recv":387908.868501185,"t_decision_unix":1779818773.8824422,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9790729618357618,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":2331,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31231,"ongoing_decode_tokens":31231,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2642,"cache_hit":0,"new_prefill":111387,"score_linear":31231.0,"score_lmetric":111387},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":131775,"ongoing_decode_tokens":131775,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":111387,"score_linear":131775.0,"score_lmetric":111387},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2006,"cache_hit":109056,"new_prefill":2331,"score_linear":-109056.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":1536,"new_prefill":109851,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":387910.621107385,"t_first_token_unix":1779818775.6350548,"t_done":387913.433372229,"t_done_unix":1779818778.4473166},{"request_id":"1399948:33:1583165:972","session_id":"1399948","input_length":31445,"t_proxy_recv":387914.613858974,"t_decision_unix":1779818779.6278,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9932262680871363,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2643,"cache_hit":31232,"new_prefill":213,"score_linear":-31232.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":387914.705809659,"t_first_token_unix":1779818779.7197533,"t_done":387915.356513235,"t_done_unix":1779818780.370457},{"request_id":"1277428:12:1586139:973","session_id":"1277428","input_length":47660,"t_proxy_recv":387924.755895353,"t_decision_unix":1779818789.7698364,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":46080,"affinity_cache_ratio":0.9668485102811583,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":1580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":4608,"new_prefill":43052,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2643,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":46080,"new_prefill":1580,"score_linear":-46080.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":387925.224311621,"t_first_token_unix":1779818790.2382555,"t_done":387925.823319823,"t_done_unix":1779818790.837263},{"request_id":"1399948:34:1586232:974","session_id":"1399948","input_length":32143,"t_proxy_recv":387925.106585912,"t_decision_unix":1779818790.1205266,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":31232,"affinity_cache_ratio":0.97165790374265,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2643,"cache_hit":31232,"new_prefill":911,"score_linear":-31232.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":47660,"ongoing_decode_tokens":0,"pending_prefill_tokens":1580,"num_requests":1,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":0,"new_prefill":32143,"score_linear":47660.0,"score_lmetric":33723},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":387925.318899691,"t_first_token_unix":1779818790.3328433,"t_done":387926.211133707,"t_done_unix":1779818791.2250772},{"request_id":"1294611:15:1590202:975","session_id":"1294611","input_length":75249,"t_proxy_recv":387938.302149374,"t_decision_unix":1779818803.31609,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9593748754136268,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":3057,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":72192,"new_prefill":3057,"score_linear":-72192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2307,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72192.0,"chosen_score_lmetric":0,"t_first_token":387939.828945826,"t_first_token_unix":1779818804.8428895,"t_done":387942.519045026,"t_done_unix":1779818807.5329888},{"request_id":"1277428:13:1593499:976","session_id":"1277428","input_length":49316,"t_proxy_recv":387949.937128619,"t_decision_unix":1779818814.95107,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":47616,"affinity_cache_ratio":0.9655284289074539,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47616,"estimated_new_tokens":1700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":4608,"new_prefill":44708,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2307,"cache_hit":47616,"new_prefill":1700,"score_linear":-47616.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47616.0,"chosen_score_lmetric":0,"t_first_token":387950.590091267,"t_first_token_unix":1779818815.604035,"t_done":387952.097404965,"t_done_unix":1779818817.1113482},{"request_id":"1294611:15:1594038:977","session_id":"1294611","input_length":75584,"t_proxy_recv":387951.658187659,"t_decision_unix":1779818816.6721287,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":75264,"affinity_cache_ratio":0.995766299745978,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":75264,"new_prefill":320,"score_linear":-75264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":12800,"new_prefill":62784,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49316,"ongoing_decode_tokens":49316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2307,"cache_hit":12800,"new_prefill":62784,"score_linear":36516.0,"score_lmetric":62784},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":387951.786291971,"t_first_token_unix":1779818816.8002353,"t_done":387952.890721875,"t_done_unix":1779818817.9046657},{"request_id":"1268861:20:1595141:978","session_id":"1268861","input_length":77218,"t_proxy_recv":387955.636525434,"t_decision_unix":1779818820.6504664,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9945867543836929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":76800,"new_prefill":418,"score_linear":-76800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":387955.8890124,"t_first_token_unix":1779818820.9029562,"t_done":387956.411791396,"t_done_unix":1779818821.4257348},{"request_id":"1399948:35:1602048:980","session_id":"1399948","input_length":33533,"t_proxy_recv":387979.011127845,"t_decision_unix":1779818844.025069,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":32256,"affinity_cache_ratio":0.9619181105179972,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":1277,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75716,"ongoing_decode_tokens":75716,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":0,"new_prefill":33533,"score_linear":75716.0,"score_lmetric":33533},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":32256,"new_prefill":1277,"score_linear":-32256.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-32256.0,"chosen_score_lmetric":0,"t_first_token":387979.420257133,"t_first_token_unix":1779818844.4342005,"t_done":387980.438111343,"t_done_unix":1779818845.4520547},{"request_id":"1253804:9:1605110:981","session_id":"1253804","input_length":90656,"t_proxy_recv":387988.999766857,"t_decision_unix":1779818854.013708,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":89088,"affinity_cache_ratio":0.9827038475114719,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89088,"estimated_new_tokens":1568,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":75716,"ongoing_decode_tokens":75716,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":89088,"new_prefill":1568,"score_linear":-13372.0,"score_lmetric":1568},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2647,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":87072,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13372.0,"chosen_score_lmetric":1568,"t_first_token":387989.966311558,"t_first_token_unix":1779818854.980255,"t_done":387995.222925718,"t_done_unix":1779818860.236869},{"request_id":"1294611:15:1596163:979","session_id":"1294611","input_length":75716,"t_proxy_recv":387958.821865929,"t_decision_unix":1779818823.835807,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9940303238417243,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":452,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":75264,"new_prefill":452,"score_linear":-75264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2645,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":387958.940576863,"t_first_token_unix":1779818823.95452,"t_done":387999.761369491,"t_done_unix":1779818864.7753134},{"request_id":"1268861:21:1609831:982","session_id":"1268861","input_length":77293,"t_proxy_recv":388004.744231688,"t_decision_unix":1779818869.7581728,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9936216733727504,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2647,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2011,"cache_hit":76800,"new_prefill":493,"score_linear":-76800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":388004.856636153,"t_first_token_unix":1779818869.8705804,"t_done":388006.438887815,"t_done_unix":1779818871.4528317},{"request_id":"1253804:10:1611505:983","session_id":"1253804","input_length":91103,"t_proxy_recv":388010.223828168,"t_decision_unix":1779818875.2377694,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":90624,"affinity_cache_ratio":0.9947422148557128,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":90624,"estimated_new_tokens":479,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":90624,"new_prefill":479,"score_linear":-90624.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2647,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":87519,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-90624.0,"chosen_score_lmetric":0,"t_first_token":388010.403407634,"t_first_token_unix":1779818875.417351,"t_done":388010.531057567,"t_done_unix":1779818875.5450013},{"request_id":"1399948:36:1612467:984","session_id":"1399948","input_length":34773,"t_proxy_recv":388013.334578864,"t_decision_unix":1779818878.34852,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9570643890374716,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":1493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2647,"cache_hit":33280,"new_prefill":1493,"score_linear":-33280.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":388013.687861341,"t_first_token_unix":1779818878.7018049,"t_done":388014.231543538,"t_done_unix":1779818879.2454867},{"request_id":"1253804:11:1613030:985","session_id":"1253804","input_length":91131,"t_proxy_recv":388015.557892601,"t_decision_unix":1779818880.5718338,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":90624,"affinity_cache_ratio":0.9944365803074695,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":90624,"estimated_new_tokens":507,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":90624,"new_prefill":507,"score_linear":-90624.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2650,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":87547,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-90624.0,"chosen_score_lmetric":0,"t_first_token":388015.681826106,"t_first_token_unix":1779818880.6957693,"t_done":388017.737187897,"t_done_unix":1779818882.7511344},{"request_id":"1399948:37:1613628:986","session_id":"1399948","input_length":35308,"t_proxy_recv":388017.403975222,"t_decision_unix":1779818882.4179144,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9860654809108418,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":492,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":91131,"ongoing_decode_tokens":91131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":0,"new_prefill":35308,"score_linear":91131.0,"score_lmetric":35308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2650,"cache_hit":34816,"new_prefill":492,"score_linear":-34816.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":388017.620931049,"t_first_token_unix":1779818882.6348746,"t_done":388018.75337216,"t_done_unix":1779818883.7673173},{"request_id":"1399948:38:1616890:987","session_id":"1399948","input_length":35581,"t_proxy_recv":388028.590800822,"t_decision_unix":1779818893.6047418,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9928894634776988,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2651,"cache_hit":35328,"new_prefill":253,"score_linear":-35328.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":388028.700563973,"t_first_token_unix":1779818893.7145073,"t_done":388029.217398031,"t_done_unix":1779818894.2313414},{"request_id":"1399948:39:1618250:989","session_id":"1399948","input_length":35682,"t_proxy_recv":388033.283304753,"t_decision_unix":1779818898.297246,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9900790314444258,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2651,"cache_hit":35328,"new_prefill":354,"score_linear":-35328.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":388033.357993401,"t_first_token_unix":1779818898.3719368,"t_done":388033.796901869,"t_done_unix":1779818898.8108451},{"request_id":"1399948:40:1620970:991","session_id":"1399948","input_length":35958,"t_proxy_recv":388042.26928733,"t_decision_unix":1779818907.2832284,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9824795594860671,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":630,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2651,"cache_hit":35328,"new_prefill":630,"score_linear":-35328.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78439,"ongoing_decode_tokens":0,"pending_prefill_tokens":1127,"num_requests":1,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":0,"new_prefill":35958,"score_linear":78439.0,"score_lmetric":37085},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":388042.410423807,"t_first_token_unix":1779818907.4243677,"t_done":388042.772789796,"t_done_unix":1779818907.7867334},{"request_id":"1268861:22:1620830:990","session_id":"1268861","input_length":78439,"t_proxy_recv":388041.810599011,"t_decision_unix":1779818906.8245404,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":77312,"affinity_cache_ratio":0.9856321472736777,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77312,"estimated_new_tokens":1127,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2651,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":77312,"new_prefill":1127,"score_linear":-77312.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-77312.0,"chosen_score_lmetric":0,"t_first_token":388042.504301712,"t_first_token_unix":1779818907.5182455,"t_done":388043.763154162,"t_done_unix":1779818908.777098},{"request_id":"1253804:12:1621957:992","session_id":"1253804","input_length":91389,"t_proxy_recv":388045.715948354,"t_decision_unix":1779818910.7298894,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9972316143080677,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":91136,"new_prefill":253,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2652,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":87805,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":388045.900817535,"t_first_token_unix":1779818910.914761,"t_done":388046.189808084,"t_done_unix":1779818911.2037513},{"request_id":"1399948:41:1624143:993","session_id":"1399948","input_length":36168,"t_proxy_recv":388053.081205154,"t_decision_unix":1779818918.0951464,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35840,"affinity_cache_ratio":0.990931209909312,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2652,"cache_hit":35840,"new_prefill":328,"score_linear":-35840.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":388053.217563027,"t_first_token_unix":1779818918.2315063,"t_done":388053.883861605,"t_done_unix":1779818918.8978047},{"request_id":"1253804:13:1624613:994","session_id":"1253804","input_length":91440,"t_proxy_recv":388054.655886765,"t_decision_unix":1779818919.669828,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9966754155730534,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":304,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":91136,"new_prefill":304,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2652,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":87856,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":388054.790636149,"t_first_token_unix":1779818919.8045797,"t_done":388055.781160045,"t_done_unix":1779818920.7951035},{"request_id":"1253804:14:1626575:995","session_id":"1253804","input_length":92367,"t_proxy_recv":388061.170508967,"t_decision_unix":1779818926.1844501,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9866727294380028,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":1231,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":91136,"new_prefill":1231,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2652,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":88783,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":388061.814455919,"t_first_token_unix":1779818926.8284001,"t_done":388062.614688811,"t_done_unix":1779818927.6286325},{"request_id":"1253804:15:1628485:997","session_id":"1253804","input_length":92701,"t_proxy_recv":388067.494347933,"t_decision_unix":1779818932.508289,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92160,"affinity_cache_ratio":0.9941640327504557,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92160,"estimated_new_tokens":541,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1791,"cache_hit":92160,"new_prefill":541,"score_linear":-92160.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36984,"ongoing_decode_tokens":0,"pending_prefill_tokens":1144,"num_requests":1,"active_p_offloads":0,"cached_blocks":2652,"cache_hit":0,"new_prefill":92701,"score_linear":36984.0,"score_lmetric":93845},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":89117,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-92160.0,"chosen_score_lmetric":0,"t_first_token":388067.785758423,"t_first_token_unix":1779818932.7997017,"t_done":388068.161918016,"t_done_unix":1779818933.1758616},{"request_id":"1399948:42:1628429:996","session_id":"1399948","input_length":36984,"t_proxy_recv":388067.270867283,"t_decision_unix":1779818932.284808,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35840,"affinity_cache_ratio":0.9690677049534934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":1144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1791,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2652,"cache_hit":35840,"new_prefill":1144,"score_linear":-35840.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":388067.57881283,"t_first_token_unix":1779818932.5927563,"t_done":388068.767102296,"t_done_unix":1779818933.7810457},{"request_id":"1388507:3:1629072:998","session_id":"1388507","input_length":79074,"t_proxy_recv":388069.583634265,"t_decision_unix":1779818934.5975754,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9582922325922554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":3298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":75776,"new_prefill":3298,"score_linear":-75776.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":388071.290729575,"t_first_token_unix":1779818936.304673,"t_done":388071.839253098,"t_done_unix":1779818936.8531969},{"request_id":"1253804:16:1629713:999","session_id":"1253804","input_length":92953,"t_proxy_recv":388071.543683433,"t_decision_unix":1779818936.5576248,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92672,"affinity_cache_ratio":0.9969769668542167,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92672,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":92672,"new_prefill":281,"score_linear":-92672.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":89369,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79074,"ongoing_decode_tokens":79074,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":92953,"score_linear":79074.0,"score_lmetric":92953}],"chosen_score_linear":-92672.0,"chosen_score_lmetric":0,"t_first_token":388071.851120019,"t_first_token_unix":1779818936.8650634,"t_done":388072.81291097,"t_done_unix":1779818937.8268547},{"request_id":"1268861:23:1631587:1001","session_id":"1268861","input_length":79693,"t_proxy_recv":388077.542561777,"t_decision_unix":1779818942.556503,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9829721556472965,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":1357,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":0,"new_prefill":79693,"score_linear":79890.0,"score_lmetric":79693},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":78336,"new_prefill":1357,"score_linear":-78336.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":388078.249815677,"t_first_token_unix":1779818943.2637594,"t_done":388078.881249416,"t_done_unix":1779818943.895193},{"request_id":"1253804:17:1631602:1002","session_id":"1253804","input_length":93219,"t_proxy_recv":388077.616885165,"t_decision_unix":1779818942.6308267,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92672,"affinity_cache_ratio":0.9941320975337645,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92672,"estimated_new_tokens":547,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":92672,"new_prefill":547,"score_linear":-12782.0,"score_lmetric":547},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":89635,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79693,"ongoing_decode_tokens":0,"pending_prefill_tokens":1357,"num_requests":1,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":93219,"score_linear":79693.0,"score_lmetric":94576},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12782.0,"chosen_score_lmetric":547,"t_first_token":388077.911688851,"t_first_token_unix":1779818942.925632,"t_done":388079.050653312,"t_done_unix":1779818944.064597},{"request_id":"1294611:15:1631116:1000","session_id":"1294611","input_length":79890,"t_proxy_recv":388076.126293746,"t_decision_unix":1779818941.1402347,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":79360,"affinity_cache_ratio":0.9933658780823632,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79360,"estimated_new_tokens":530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1792,"cache_hit":79360,"new_prefill":530,"score_linear":-79360.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2014,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79360.0,"chosen_score_lmetric":0,"t_first_token":388076.309276566,"t_first_token_unix":1779818941.3232203,"t_done":388079.668840684,"t_done_unix":1779818944.682784},{"request_id":"1253804:18:1633257:1003","session_id":"1253804","input_length":93509,"t_proxy_recv":388083.072466433,"t_decision_unix":1779818948.0864072,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9965243987209788,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1794,"cache_hit":93184,"new_prefill":325,"score_linear":-93184.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":89925,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":388083.367589931,"t_first_token_unix":1779818948.3815336,"t_done":388084.247987024,"t_done_unix":1779818949.2619302},{"request_id":"1294611:15:1634779:1004","session_id":"1294611","input_length":80221,"t_proxy_recv":388088.240332204,"t_decision_unix":1779818953.254273,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":79872,"affinity_cache_ratio":0.995649518205956,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":349,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1794,"cache_hit":79872,"new_prefill":349,"score_linear":-79872.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":388088.376336307,"t_first_token_unix":1779818953.39028,"t_done":388089.176223582,"t_done_unix":1779818954.190167},{"request_id":"1253804:19:1634903:1005","session_id":"1253804","input_length":93664,"t_proxy_recv":388088.612450099,"t_decision_unix":1779818953.6263914,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9948752989408951,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80221,"ongoing_decode_tokens":80221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1794,"cache_hit":93184,"new_prefill":480,"score_linear":-12963.0,"score_lmetric":480},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":90080,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12963.0,"chosen_score_lmetric":480,"t_first_token":388088.80928545,"t_first_token_unix":1779818953.8232288,"t_done":388092.930964081,"t_done_unix":1779818957.9449077},{"request_id":"1253804:20:1638889:1007","session_id":"1253804","input_length":94111,"t_proxy_recv":388101.788941605,"t_decision_unix":1779818966.8028827,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93696,"affinity_cache_ratio":0.9955903135658956,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93696,"estimated_new_tokens":415,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":93696,"new_prefill":415,"score_linear":-12979.0,"score_lmetric":415},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":3584,"new_prefill":90527,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12979.0,"chosen_score_lmetric":415,"t_first_token":388101.993209772,"t_first_token_unix":1779818967.0071535,"t_done":388103.218994291,"t_done_unix":1779818968.2329378},{"request_id":"1258908:2:1639411:1008","session_id":"1258908","input_length":9804,"t_proxy_recv":388103.589570716,"t_decision_unix":1779818968.6035123,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9400244798041616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":588,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":9804,"score_linear":80717.0,"score_lmetric":9804},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":9216,"new_prefill":588,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":388104.349632021,"t_first_token_unix":1779818969.3635757,"t_done":388105.898942796,"t_done_unix":1779818970.9128864},{"request_id":"1268861:24:1643502:1011","session_id":"1268861","input_length":80019,"t_proxy_recv":388117.416187908,"t_decision_unix":1779818982.430129,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":79360,"affinity_cache_ratio":0.9917644559417138,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79360,"estimated_new_tokens":659,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":174986,"ongoing_decode_tokens":174986,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":80019,"score_linear":174986.0,"score_lmetric":160038},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":38102,"ongoing_decode_tokens":0,"pending_prefill_tokens":1238,"num_requests":1,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":80019,"score_linear":38102.0,"score_lmetric":81257},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":79360,"new_prefill":659,"score_linear":-79360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79360.0,"chosen_score_lmetric":0,"t_first_token":388117.680288659,"t_first_token_unix":1779818982.694232,"t_done":388118.134417613,"t_done_unix":1779818983.148361},{"request_id":"1399948:43:1643413:1010","session_id":"1399948","input_length":38102,"t_proxy_recv":388117.067323577,"t_decision_unix":1779818982.081265,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9675082672825573,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":1238,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":174986,"ongoing_decode_tokens":174986,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":38102,"score_linear":174986.0,"score_lmetric":76204},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":36864,"new_prefill":1238,"score_linear":-36864.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":388117.458090125,"t_first_token_unix":1779818982.4720333,"t_done":388118.228117143,"t_done_unix":1779818983.2420602},{"request_id":"1399948:44:1644970:1012","session_id":"1399948","input_length":38308,"t_proxy_recv":388122.19210303,"t_decision_unix":1779818987.2060442,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9890362326407017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":174986,"ongoing_decode_tokens":174986,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":0,"new_prefill":38308,"score_linear":174986.0,"score_lmetric":76616},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2656,"cache_hit":37888,"new_prefill":420,"score_linear":-37888.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37888.0,"chosen_score_lmetric":0,"t_first_token":388122.30984328,"t_first_token_unix":1779818987.3237867,"t_done":388123.822489066,"t_done_unix":1779818988.8364325},{"request_id":"1294611:15:1636645:1006","session_id":"1294611","input_length":80717,"t_proxy_recv":388094.279787718,"t_decision_unix":1779818959.2937286,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9895313254952488,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":79872,"new_prefill":845,"score_linear":-79872.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":388094.699894177,"t_first_token_unix":1779818959.7138379,"t_done":388124.798849194,"t_done_unix":1779818989.812793},{"request_id":"1253804:21:1640487:1009","session_id":"1253804","input_length":94269,"t_proxy_recv":388107.07718848,"t_decision_unix":1779818972.0911295,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93696,"affinity_cache_ratio":0.9939216497470006,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93696,"estimated_new_tokens":573,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1795,"cache_hit":93696,"new_prefill":573,"score_linear":-12979.0,"score_lmetric":573},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2654,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":3584,"new_prefill":90685,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2016,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-12979.0,"chosen_score_lmetric":573,"t_first_token":388107.284808862,"t_first_token_unix":1779818972.2987523,"t_done":388127.122024066,"t_done_unix":1779818992.1359677},{"request_id":"1253804:22:1650001:1013","session_id":"1253804","input_length":95715,"t_proxy_recv":388138.785078175,"t_decision_unix":1779819003.7990193,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":95232,"affinity_cache_ratio":0.9949537690017238,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95232,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1799,"cache_hit":95232,"new_prefill":483,"score_linear":-95232.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":3584,"new_prefill":92131,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-95232.0,"chosen_score_lmetric":0,"t_first_token":388138.973946936,"t_first_token_unix":1779819003.9878902,"t_done":388139.46446387,"t_done_unix":1779819004.4784074},{"request_id":"1399948:45:1650679:1014","session_id":"1399948","input_length":38758,"t_proxy_recv":388141.23321141,"t_decision_unix":1779819006.2471526,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9907631972754012,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":358,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1800,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":38400,"new_prefill":358,"score_linear":-38400.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":388141.380938077,"t_first_token_unix":1779819006.3948815,"t_done":388141.971762155,"t_done_unix":1779819006.9857054},{"request_id":"1253804:23:1651448:1015","session_id":"1253804","input_length":96944,"t_proxy_recv":388143.532216574,"t_decision_unix":1779819008.5461576,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9876217197557353,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":1200,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1800,"cache_hit":95744,"new_prefill":1200,"score_linear":-95744.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":3584,"new_prefill":93360,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":388144.379908183,"t_first_token_unix":1779819009.3938522,"t_done":388144.774729506,"t_done_unix":1779819009.788673},{"request_id":"1399948:46:1658183:1018","session_id":"1399948","input_length":39837,"t_proxy_recv":388166.367718514,"t_decision_unix":1779819031.3816597,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9639280066270051,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":1437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1802,"cache_hit":0,"new_prefill":39837,"score_linear":83204.0,"score_lmetric":39837},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":38400,"new_prefill":1437,"score_linear":-38400.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":39837,"score_linear":80406.0,"score_lmetric":39837},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":388166.75844691,"t_first_token_unix":1779819031.7723906,"t_done":388167.608713539,"t_done_unix":1779819032.6226568},{"request_id":"1253804:24:1659020:1019","session_id":"1253804","input_length":97769,"t_proxy_recv":388169.26601236,"t_decision_unix":1779819034.2799535,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":96768,"affinity_cache_ratio":0.9897615808691916,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":96768,"estimated_new_tokens":1001,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1802,"cache_hit":96768,"new_prefill":1001,"score_linear":-13564.0,"score_lmetric":1001},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2660,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":3584,"new_prefill":94185,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":97769,"score_linear":80406.0,"score_lmetric":97769},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13564.0,"chosen_score_lmetric":1001,"t_first_token":388169.937019434,"t_first_token_unix":1779819034.9509633,"t_done":388170.557146081,"t_done_unix":1779819035.5710897},{"request_id":"1268861:25:1653400:1016","session_id":"1268861","input_length":80406,"t_proxy_recv":388149.970066457,"t_decision_unix":1779819014.9840071,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9933587045742855,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":534,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1802,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":79872,"new_prefill":534,"score_linear":-79872.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":388150.377060874,"t_first_token_unix":1779819015.3910046,"t_done":388174.465899587,"t_done_unix":1779819039.4798434},{"request_id":"1253804:25:1662273:1020","session_id":"1253804","input_length":98187,"t_proxy_recv":388180.130582822,"t_decision_unix":1779819045.144524,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9959770641734649,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":395,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1804,"cache_hit":97792,"new_prefill":395,"score_linear":-14588.0,"score_lmetric":395},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2660,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":3584,"new_prefill":94603,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14588.0,"chosen_score_lmetric":395,"t_first_token":388180.617808472,"t_first_token_unix":1779819045.6317523,"t_done":388181.229159219,"t_done_unix":1779819046.2431028},{"request_id":"1399948:47:1664702:1022","session_id":"1399948","input_length":40261,"t_proxy_recv":388188.73014579,"t_decision_unix":1779819053.744087,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9919276719405876,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":181458,"ongoing_decode_tokens":181458,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1804,"cache_hit":0,"new_prefill":40261,"score_linear":181458.0,"score_lmetric":80522},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2660,"cache_hit":39936,"new_prefill":325,"score_linear":-39936.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":388188.957951934,"t_first_token_unix":1779819053.9718952,"t_done":388189.377168536,"t_done_unix":1779819054.3911119},{"request_id":"1294611:15:1657992:1017","session_id":"1294611","input_length":83204,"t_proxy_recv":388165.891527533,"t_decision_unix":1779819030.9054687,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":82944,"affinity_cache_ratio":0.9968751502331619,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82944,"estimated_new_tokens":260,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1802,"cache_hit":82944,"new_prefill":260,"score_linear":-82944.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2657,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2017,"cache_hit":0,"new_prefill":83204,"score_linear":80406.0,"score_lmetric":83204},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-82944.0,"chosen_score_lmetric":0,"t_first_token":388166.082672628,"t_first_token_unix":1779819031.096616,"t_done":388192.023547281,"t_done_unix":1779819057.0374906},{"request_id":"1356885:8:1665690:1023","session_id":"1356885","input_length":132537,"t_proxy_recv":388191.946526594,"t_decision_unix":1779819056.960468,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9928095550676415,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":953,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":181458,"ongoing_decode_tokens":181458,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1804,"cache_hit":0,"new_prefill":132537,"score_linear":181458.0,"score_lmetric":265074},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2660,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":131584,"new_prefill":953,"score_linear":-131584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131584.0,"chosen_score_lmetric":0,"t_first_token":388192.605864552,"t_first_token_unix":1779819057.619808,"t_done":388194.384015007,"t_done_unix":1779819059.397958},{"request_id":"1399948:48:1666394:1024","session_id":"1399948","input_length":40343,"t_proxy_recv":388194.360997161,"t_decision_unix":1779819059.3749387,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9899115088119377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":407,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1805,"cache_hit":0,"new_prefill":40343,"score_linear":98254.0,"score_lmetric":40343},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2660,"cache_hit":39936,"new_prefill":407,"score_linear":-39936.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":132537,"ongoing_decode_tokens":132537,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":0,"new_prefill":40343,"score_linear":132537.0,"score_lmetric":40343},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":388194.436503889,"t_first_token_unix":1779819059.450447,"t_done":388195.820177147,"t_done_unix":1779819060.8341208},{"request_id":"1399948:49:1668825:1025","session_id":"1399948","input_length":40642,"t_proxy_recv":388202.922972296,"t_decision_unix":1779819067.9369135,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9952266128635402,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1805,"cache_hit":0,"new_prefill":40642,"score_linear":98254.0,"score_lmetric":40642},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":40448,"new_prefill":194,"score_linear":-40448.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":388203.048861533,"t_first_token_unix":1779819068.062805,"t_done":388204.120632572,"t_done_unix":1779819069.134576},{"request_id":"1294611:15:1673197:1026","session_id":"1294611","input_length":85542,"t_proxy_recv":388218.140358434,"t_decision_unix":1779819083.1542997,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9935704098571462,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1805,"cache_hit":84992,"new_prefill":550,"score_linear":13262.0,"score_lmetric":550},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":13262.0,"chosen_score_lmetric":550,"t_first_token":388218.307152029,"t_first_token_unix":1779819083.321096,"t_done":388220.893757421,"t_done_unix":1779819085.9077013},{"request_id":"1253804:26:1663639:1021","session_id":"1253804","input_length":98254,"t_proxy_recv":388184.964439233,"t_decision_unix":1779819049.9783804,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9952979013577056,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":462,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1804,"cache_hit":97792,"new_prefill":462,"score_linear":-14588.0,"score_lmetric":462},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2660,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2311,"cache_hit":3584,"new_prefill":94670,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14588.0,"chosen_score_lmetric":462,"t_first_token":388185.137190759,"t_first_token_unix":1779819050.151135,"t_done":388224.328256964,"t_done_unix":1779819089.342206},{"request_id":"1294611:15:1676489:1027","session_id":"1294611","input_length":85722,"t_proxy_recv":388229.525808737,"t_decision_unix":1779819094.5397496,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9974568955460675,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":218,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":85504,"new_prefill":218,"score_linear":-85504.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":388229.656721221,"t_first_token_unix":1779819094.6706648,"t_done":388232.225738856,"t_done_unix":1779819097.2396822},{"request_id":"1399948:50:1677482:1028","session_id":"1399948","input_length":42648,"t_proxy_recv":388232.778827496,"t_decision_unix":1779819097.7927687,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9484149315325455,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":2200,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2661,"cache_hit":40448,"new_prefill":2200,"score_linear":-40448.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":388233.375545586,"t_first_token_unix":1779819098.38949,"t_done":388237.016798558,"t_done_unix":1779819102.0307422},{"request_id":"1294611:15:1679070:1029","session_id":"1294611","input_length":86602,"t_proxy_recv":388238.206074401,"t_decision_unix":1779819103.2200158,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":85504,"affinity_cache_ratio":0.987321308976698,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":1098,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1807,"cache_hit":85504,"new_prefill":1098,"score_linear":-85504.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2666,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":388238.651633316,"t_first_token_unix":1779819103.6655772,"t_done":388241.410277829,"t_done_unix":1779819106.4242213},{"request_id":"1253804:27:1683133:1031","session_id":"1253804","input_length":101743,"t_proxy_recv":388251.835833033,"t_decision_unix":1779819116.8497744,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9963928722369106,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":367,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":86925,"ongoing_decode_tokens":86925,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1809,"cache_hit":101376,"new_prefill":367,"score_linear":-14451.0,"score_lmetric":367},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2666,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":98159,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14451.0,"chosen_score_lmetric":367,"t_first_token":388252.044343157,"t_first_token_unix":1779819117.0582867,"t_done":388252.523665027,"t_done_unix":1779819117.5376089},{"request_id":"1294611:15:1682649:1030","session_id":"1294611","input_length":86925,"t_proxy_recv":388250.116718423,"t_decision_unix":1779819115.1306598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":86528,"affinity_cache_ratio":0.9954328444060973,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":86528,"estimated_new_tokens":397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1809,"cache_hit":86528,"new_prefill":397,"score_linear":-86528.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2666,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-86528.0,"chosen_score_lmetric":0,"t_first_token":388250.259323108,"t_first_token_unix":1779819115.273267,"t_done":388254.508594737,"t_done_unix":1779819119.5225387},{"request_id":"1253804:28:1685257:1032","session_id":"1253804","input_length":101794,"t_proxy_recv":388258.835369844,"t_decision_unix":1779819123.8493109,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9958936676031986,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1810,"cache_hit":101376,"new_prefill":418,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2666,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":98210,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":388258.982365492,"t_first_token_unix":1779819123.996309,"t_done":388259.692241232,"t_done_unix":1779819124.7061846},{"request_id":"1399948:51:1686626:1033","session_id":"1399948","input_length":43407,"t_proxy_recv":388263.76870485,"t_decision_unix":1779819128.7826457,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":43008,"affinity_cache_ratio":0.9908079342041606,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43008,"estimated_new_tokens":399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1810,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2666,"cache_hit":43008,"new_prefill":399,"score_linear":-43008.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43008.0,"chosen_score_lmetric":0,"t_first_token":388263.930671198,"t_first_token_unix":1779819128.944615,"t_done":388265.36316347,"t_done_unix":1779819130.377107},{"request_id":"1253804:29:1688398:1034","session_id":"1253804","input_length":102067,"t_proxy_recv":388269.823628186,"t_decision_unix":1779819134.837569,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9932299371981149,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":691,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1810,"cache_hit":101376,"new_prefill":691,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":98483,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":388270.138392524,"t_first_token_unix":1779819135.1523361,"t_done":388271.146236172,"t_done_unix":1779819136.1601796},{"request_id":"1399948:52:1689144:1035","session_id":"1399948","input_length":43673,"t_proxy_recv":388272.403540347,"t_decision_unix":1779819137.4174814,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9964966913195796,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":153,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":43520,"new_prefill":153,"score_linear":-43520.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":388272.518259104,"t_first_token_unix":1779819137.5322025,"t_done":388273.249202029,"t_done_unix":1779819138.2631452},{"request_id":"1356885:9:1689871:1036","session_id":"1356885","input_length":132823,"t_proxy_recv":388274.781952676,"t_decision_unix":1779819139.7958937,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":132608,"affinity_cache_ratio":0.9983813044427546,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":132608,"estimated_new_tokens":215,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":132608,"new_prefill":215,"score_linear":-132608.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-132608.0,"chosen_score_lmetric":0,"t_first_token":388275.084688641,"t_first_token_unix":1779819140.098632,"t_done":388276.761042018,"t_done_unix":1779819141.7749858},{"request_id":"1253804:30:1690362:1037","session_id":"1253804","input_length":102214,"t_proxy_recv":388276.433829621,"t_decision_unix":1779819141.4477708,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9968106130275696,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":326,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":101888,"new_prefill":326,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":132823,"ongoing_decode_tokens":132823,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":98630,"score_linear":129239.0,"score_lmetric":98630},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":388276.633596904,"t_first_token_unix":1779819141.6475403,"t_done":388277.384086512,"t_done_unix":1779819142.39803},{"request_id":"1253804:31:1691981:1038","session_id":"1253804","input_length":102322,"t_proxy_recv":388282.01402219,"t_decision_unix":1779819147.0279632,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9957584879107132,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":101888,"new_prefill":434,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":98738,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":388282.174357416,"t_first_token_unix":1779819147.1883016,"t_done":388282.55370164,"t_done_unix":1779819147.5676455},{"request_id":"1399948:53:1692115:1039","session_id":"1399948","input_length":43938,"t_proxy_recv":388282.529519717,"t_decision_unix":1779819147.543461,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9904865947471437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102322,"ongoing_decode_tokens":102322,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":0,"new_prefill":43938,"score_linear":102322.0,"score_lmetric":43938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2667,"cache_hit":43520,"new_prefill":418,"score_linear":-43520.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":388282.687878689,"t_first_token_unix":1779819147.701822,"t_done":388284.056792761,"t_done_unix":1779819149.0707362},{"request_id":"1253804:32:1693715:1040","session_id":"1253804","input_length":102509,"t_proxy_recv":388288.091220508,"t_decision_unix":1779819153.1051614,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9939419953369948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":621,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":101888,"new_prefill":621,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":98925,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":388288.407071639,"t_first_token_unix":1779819153.421021,"t_done":388289.182904548,"t_done_unix":1779819154.196848},{"request_id":"1399948:54:1694570:1041","session_id":"1399948","input_length":44182,"t_proxy_recv":388291.183951417,"t_decision_unix":1779819156.197893,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9966049522429948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":150,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":44032,"new_prefill":150,"score_linear":-44032.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":388291.296461053,"t_first_token_unix":1779819156.3104045,"t_done":388291.572914776,"t_done_unix":1779819156.5868585},{"request_id":"1253804:33:1695393:1042","session_id":"1253804","input_length":102632,"t_proxy_recv":388293.849444748,"t_decision_unix":1779819158.8633857,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102400,"affinity_cache_ratio":0.9977394964533479,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102400,"estimated_new_tokens":232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":102400,"new_prefill":232,"score_linear":-102400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":99048,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102400.0,"chosen_score_lmetric":0,"t_first_token":388294.049340705,"t_first_token_unix":1779819159.0632849,"t_done":388294.550519155,"t_done_unix":1779819159.5644631},{"request_id":"1253804:34:1697569:1043","session_id":"1253804","input_length":102792,"t_proxy_recv":388301.686347758,"t_decision_unix":1779819166.700289,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102400,"affinity_cache_ratio":0.9961864736555374,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102400,"estimated_new_tokens":392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":102400,"new_prefill":392,"score_linear":-102400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":99208,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102400.0,"chosen_score_lmetric":0,"t_first_token":388301.938031088,"t_first_token_unix":1779819166.9519744,"t_done":388305.317980058,"t_done_unix":1779819170.3319235},{"request_id":"1253804:35:1701250:1044","session_id":"1253804","input_length":103349,"t_proxy_recv":388314.222865655,"t_decision_unix":1779819179.2368069,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102912,"affinity_cache_ratio":0.9957716088205981,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102912,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":102912,"new_prefill":437,"score_linear":-102912.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":99765,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102912.0,"chosen_score_lmetric":0,"t_first_token":388314.553045498,"t_first_token_unix":1779819179.566989,"t_done":388314.855449489,"t_done_unix":1779819179.8693929},{"request_id":"1253804:36:1702697:1045","session_id":"1253804","input_length":103400,"t_proxy_recv":388319.380329578,"t_decision_unix":1779819184.3942704,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102912,"affinity_cache_ratio":0.9952804642166344,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102912,"estimated_new_tokens":488,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":102912,"new_prefill":488,"score_linear":-102912.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":99816,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102912.0,"chosen_score_lmetric":0,"t_first_token":388319.541041763,"t_first_token_unix":1779819184.5549855,"t_done":388319.973144697,"t_done_unix":1779819184.9870884},{"request_id":"1399948:55:1704272:1047","session_id":"1399948","input_length":45284,"t_proxy_recv":388324.663814219,"t_decision_unix":1779819189.6777554,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9723522657009098,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":45284,"score_linear":103471.0,"score_lmetric":45284},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":44032,"new_prefill":1252,"score_linear":-44032.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":388325.106786509,"t_first_token_unix":1779819190.1207304,"t_done":388326.767205949,"t_done_unix":1779819191.7811499},{"request_id":"1356885:10:1706624:1048","session_id":"1356885","input_length":133014,"t_proxy_recv":388332.97472093,"t_decision_unix":1779819197.9886622,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":132608,"affinity_cache_ratio":0.9969476897168719,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":132608,"estimated_new_tokens":406,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":133014,"score_linear":103471.0,"score_lmetric":133014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2670,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":132608,"new_prefill":406,"score_linear":-132608.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-132608.0,"chosen_score_lmetric":0,"t_first_token":388333.234243575,"t_first_token_unix":1779819198.2481868,"t_done":388334.690957643,"t_done_unix":1779819199.7049012},{"request_id":"1253804:37:1704071:1046","session_id":"1253804","input_length":103471,"t_proxy_recv":388323.853760032,"t_decision_unix":1779819188.8677013,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":103424,"affinity_cache_ratio":0.9995457664466372,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":103424,"estimated_new_tokens":47,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":103424,"new_prefill":47,"score_linear":-103424.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2668,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":99887,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-103424.0,"chosen_score_lmetric":0,"t_first_token":388324.010327356,"t_first_token_unix":1779819189.0242705,"t_done":388339.376859175,"t_done_unix":1779819204.3908026},{"request_id":"1399948:56:1708284:1049","session_id":"1399948","input_length":45571,"t_proxy_recv":388338.685041435,"t_decision_unix":1779819203.6989827,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9886989532816923,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":515,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":0,"new_prefill":45571,"score_linear":103471.0,"score_lmetric":45571},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2670,"cache_hit":45056,"new_prefill":515,"score_linear":-45056.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":388338.800889474,"t_first_token_unix":1779819203.814833,"t_done":388339.694538217,"t_done_unix":1779819204.7084818},{"request_id":"1399948:57:1711464:1050","session_id":"1399948","input_length":45756,"t_proxy_recv":388349.481456109,"t_decision_unix":1779819214.495397,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":45568,"affinity_cache_ratio":0.995891249235073,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45568,"estimated_new_tokens":188,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2671,"cache_hit":45568,"new_prefill":188,"score_linear":-45568.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45568.0,"chosen_score_lmetric":0,"t_first_token":388349.598219695,"t_first_token_unix":1779819214.612163,"t_done":388352.060928401,"t_done_unix":1779819217.0748718},{"request_id":"1253804:38:1712824:1051","session_id":"1253804","input_length":104953,"t_proxy_recv":388354.30766925,"t_decision_unix":1779819219.3216105,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104448,"affinity_cache_ratio":0.9951883223919278,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104448,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":104448,"new_prefill":505,"score_linear":-104448.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":101369,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104448.0,"chosen_score_lmetric":0,"t_first_token":388354.51325677,"t_first_token_unix":1779819219.5272002,"t_done":388354.823706973,"t_done_unix":1779819219.8376508},{"request_id":"1253804:39:1714767:1052","session_id":"1253804","input_length":105004,"t_proxy_recv":388360.891692035,"t_decision_unix":1779819225.9056332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104960,"affinity_cache_ratio":0.9995809683440631,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104960,"estimated_new_tokens":44,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1816,"cache_hit":104960,"new_prefill":44,"score_linear":-104960.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":101420,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104960.0,"chosen_score_lmetric":0,"t_first_token":388361.042978069,"t_first_token_unix":1779819226.0569212,"t_done":388361.61272785,"t_done_unix":1779819226.6266723},{"request_id":"1253804:40:1716790:1053","session_id":"1253804","input_length":105156,"t_proxy_recv":388367.597094744,"t_decision_unix":1779819232.611036,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104960,"affinity_cache_ratio":0.9981361025523984,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104960,"estimated_new_tokens":196,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1816,"cache_hit":104960,"new_prefill":196,"score_linear":-104960.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":101572,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104960.0,"chosen_score_lmetric":0,"t_first_token":388367.854977612,"t_first_token_unix":1779819232.868921,"t_done":388373.439664579,"t_done_unix":1779819238.4536088},{"request_id":"1305906:4:1718131:1054","session_id":"1305906","input_length":47861,"t_proxy_recv":388372.04934561,"t_decision_unix":1779819237.0632865,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9413927832682142,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":2805,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":105156,"ongoing_decode_tokens":105156,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1816,"cache_hit":45056,"new_prefill":2805,"score_linear":60100.0,"score_lmetric":2805},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":60100.0,"chosen_score_lmetric":2805,"t_first_token":388372.974888609,"t_first_token_unix":1779819237.988832,"t_done":388375.254275623,"t_done_unix":1779819240.2682195},{"request_id":"1305906:5:1514292:934","session_id":"1305906","input_length":49817,"t_proxy_recv":388375.26634592,"t_decision_unix":1779819240.2802875,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9660959110343859,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":1689,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1823,"cache_hit":48128,"new_prefill":1689,"score_linear":-48128.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37173,"ongoing_decode_tokens":37173,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":0,"new_prefill":49817,"score_linear":37173.0,"score_lmetric":49817}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":388375.928285282,"t_first_token_unix":1779819240.9422288,"t_done":388376.592456261,"t_done_unix":1779819241.6063998},{"request_id":"1340290:13:1718889:1055","session_id":"1340290","input_length":37173,"t_proxy_recv":388374.683634402,"t_decision_unix":1779819239.6975756,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9503672020014526,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":1845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":10037,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":47861,"ongoing_decode_tokens":47861,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":0,"new_prefill":37173,"score_linear":47861.0,"score_lmetric":37173},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":36149,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2361,"cache_hit":35328,"new_prefill":1845,"score_linear":-35328.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":388375.207436106,"t_first_token_unix":1779819240.2213795,"t_done":388376.811904149,"t_done_unix":1779819241.8258471},{"request_id":"1253804:41:1721979:1057","session_id":"1253804","input_length":105638,"t_proxy_recv":388385.277531094,"t_decision_unix":1779819250.2914724,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9984285957704614,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":105472,"new_prefill":166,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":102054,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37438,"ongoing_decode_tokens":37438,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":105638,"score_linear":37438.0,"score_lmetric":105638}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":388385.483345607,"t_first_token_unix":1779819250.4972892,"t_done":388386.128233307,"t_done_unix":1779819251.1421788},{"request_id":"1340290:14:1721731:1056","session_id":"1340290","input_length":37438,"t_proxy_recv":388384.403401009,"t_decision_unix":1779819249.4173422,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":37376,"affinity_cache_ratio":0.998343928628666,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":62,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":10302,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":36414,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":37376,"new_prefill":62,"score_linear":-37376.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":388384.482441114,"t_first_token_unix":1779819249.4963849,"t_done":388386.237285486,"t_done_unix":1779819251.2512286},{"request_id":"1253804:42:1724453:1058","session_id":"1253804","input_length":105715,"t_proxy_recv":388393.776526399,"t_decision_unix":1779819258.790467,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9977013668826562,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":243,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":105472,"new_prefill":243,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":102131,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":388393.927587904,"t_first_token_unix":1779819258.9415314,"t_done":388394.706256878,"t_done_unix":1779819259.7202003},{"request_id":"1253804:43:1726322:1060","session_id":"1253804","input_length":105845,"t_proxy_recv":388399.852441878,"t_decision_unix":1779819264.866383,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9964759790259341,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":373,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":105472,"new_prefill":373,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":102261,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":105845,"score_linear":37724.0,"score_lmetric":105845}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":388400.058777531,"t_first_token_unix":1779819265.0727212,"t_done":388400.746712172,"t_done_unix":1779819265.7606556},{"request_id":"1399948:58:1726693:1061","session_id":"1399948","input_length":46886,"t_proxy_recv":388401.070477978,"t_decision_unix":1779819266.084419,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":46080,"affinity_cache_ratio":0.982809367401783,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":806,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":46080,"new_prefill":806,"score_linear":-46080.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":46886,"score_linear":37724.0,"score_lmetric":46886}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":388401.43040429,"t_first_token_unix":1779819266.4443479,"t_done":388401.559528839,"t_done_unix":1779819266.5734723},{"request_id":"1399948:59:1728305:1062","session_id":"1399948","input_length":46927,"t_proxy_recv":388406.363555322,"t_decision_unix":1779819271.3774965,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":46592,"affinity_cache_ratio":0.9928612525838004,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":335,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2673,"cache_hit":46592,"new_prefill":335,"score_linear":-46592.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":46927,"score_linear":37724.0,"score_lmetric":46927}],"chosen_score_linear":-46592.0,"chosen_score_lmetric":0,"t_first_token":388406.448581462,"t_first_token_unix":1779819271.4625247,"t_done":388406.593299289,"t_done_unix":1779819271.6072428},{"request_id":"1253804:44:1728625:1063","session_id":"1253804","input_length":106070,"t_proxy_recv":388407.555731093,"t_decision_unix":1779819272.569672,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9943622136325069,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":598,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":105472,"new_prefill":598,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2673,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":102486,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":106070,"score_linear":37724.0,"score_lmetric":106070}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":388407.878904647,"t_first_token_unix":1779819272.892848,"t_done":388408.915553934,"t_done_unix":1779819273.929498},{"request_id":"1340290:15:1725612:1059","session_id":"1340290","input_length":37724,"t_proxy_recv":388397.588052071,"t_decision_unix":1779819262.6019933,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9907751033824621,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":10588,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1826,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2672,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":36700,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":37376,"new_prefill":348,"score_linear":-37376.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":388397.66752526,"t_first_token_unix":1779819262.6814682,"t_done":388415.03562724,"t_done_unix":1779819280.0495706},{"request_id":"1253804:45:1732408:1064","session_id":"1253804","input_length":106394,"t_proxy_recv":388420.522267795,"t_decision_unix":1779819285.5362089,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9961463992330395,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":410,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1827,"cache_hit":105984,"new_prefill":410,"score_linear":-105984.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2673,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":102810,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":388420.851994834,"t_first_token_unix":1779819285.865939,"t_done":388421.219434089,"t_done_unix":1779819286.2333775},{"request_id":"1399948:60:1732843:1065","session_id":"1399948","input_length":47074,"t_proxy_recv":388422.115064448,"t_decision_unix":1779819287.1290052,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":46592,"affinity_cache_ratio":0.9897608021413095,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":482,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1827,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2673,"cache_hit":46592,"new_prefill":482,"score_linear":-46592.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46592.0,"chosen_score_lmetric":0,"t_first_token":388422.23994922,"t_first_token_unix":1779819287.2538927,"t_done":388422.611185976,"t_done_unix":1779819287.6251292},{"request_id":"1253804:46:1733935:1066","session_id":"1253804","input_length":106443,"t_proxy_recv":388425.614280683,"t_decision_unix":1779819290.628222,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9956878329246639,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":459,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1827,"cache_hit":105984,"new_prefill":459,"score_linear":-105984.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":102859,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":388425.757380867,"t_first_token_unix":1779819290.7713244,"t_done":388426.46598449,"t_done_unix":1779819291.4799278},{"request_id":"1399948:61:1735933:1067","session_id":"1399948","input_length":47205,"t_proxy_recv":388432.309634262,"t_decision_unix":1779819297.3235753,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":47104,"affinity_cache_ratio":0.9978603961444762,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47104,"estimated_new_tokens":101,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1828,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":47104,"new_prefill":101,"score_linear":-47104.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47104.0,"chosen_score_lmetric":0,"t_first_token":388432.41581883,"t_first_token_unix":1779819297.4297624,"t_done":388433.949403812,"t_done_unix":1779819298.963347},{"request_id":"1253804:47:1736337:1068","session_id":"1253804","input_length":107137,"t_proxy_recv":388433.592225524,"t_decision_unix":1779819298.606167,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":106496,"affinity_cache_ratio":0.994017006263009,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":641,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1828,"cache_hit":106496,"new_prefill":641,"score_linear":-106496.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":47205,"ongoing_decode_tokens":47205,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":107137,"score_linear":47205.0,"score_lmetric":107137},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":103553,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-106496.0,"chosen_score_lmetric":0,"t_first_token":388434.325247898,"t_first_token_unix":1779819299.339192,"t_done":388434.731308525,"t_done_unix":1779819299.7452524},{"request_id":"1253804:48:1737694:1069","session_id":"1253804","input_length":108145,"t_proxy_recv":388438.025308606,"t_decision_unix":1779819303.03925,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":107008,"affinity_cache_ratio":0.98948633778723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1829,"cache_hit":107008,"new_prefill":1137,"score_linear":-107008.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":104561,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":388438.960761869,"t_first_token_unix":1779819303.9747055,"t_done":388439.378124857,"t_done_unix":1779819304.3920684},{"request_id":"1253804:49:1739030:1070","session_id":"1253804","input_length":109454,"t_proxy_recv":388442.412970083,"t_decision_unix":1779819307.426911,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9870082409048551,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":1422,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1831,"cache_hit":108032,"new_prefill":1422,"score_linear":-108032.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":105870,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":388443.551069044,"t_first_token_unix":1779819308.5650132,"t_done":388443.976064526,"t_done_unix":1779819308.990008},{"request_id":"1253804:50:1741670:1071","session_id":"1253804","input_length":110854,"t_proxy_recv":388451.396014971,"t_decision_unix":1779819316.409956,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9837804680029588,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":1798,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1833,"cache_hit":109056,"new_prefill":1798,"score_linear":-109056.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":107270,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":388452.553757326,"t_first_token_unix":1779819317.5677013,"t_done":388452.982381531,"t_done_unix":1779819317.996326},{"request_id":"1253804:51:1744514:1072","session_id":"1253804","input_length":111661,"t_proxy_recv":388460.81931855,"t_decision_unix":1779819325.8332598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":110592,"affinity_cache_ratio":0.9904263798461415,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":110592,"estimated_new_tokens":1069,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1836,"cache_hit":110592,"new_prefill":1069,"score_linear":-110592.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":108077,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-110592.0,"chosen_score_lmetric":0,"t_first_token":388461.577571915,"t_first_token_unix":1779819326.5915155,"t_done":388462.005836878,"t_done_unix":1779819327.0197804},{"request_id":"1340290:16:1745847:1073","session_id":"1340290","input_length":40200,"t_proxy_recv":388465.42226592,"t_decision_unix":1779819330.4362068,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9934328358208955,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":264,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":13064,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1838,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":39176,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":39936,"new_prefill":264,"score_linear":-39936.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":388465.504652846,"t_first_token_unix":1779819330.5185962,"t_done":388466.22346758,"t_done_unix":1779819331.2374108},{"request_id":"1253804:52:1746191:1074","session_id":"1253804","input_length":111724,"t_proxy_recv":388466.457454148,"t_decision_unix":1779819331.4713953,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9990333321399162,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1838,"cache_hit":111616,"new_prefill":108,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":108140,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":388466.618790718,"t_first_token_unix":1779819331.6327343,"t_done":388467.39543816,"t_done_unix":1779819332.4093819},{"request_id":"1253804:53:1748377:1075","session_id":"1253804","input_length":111811,"t_proxy_recv":388473.797359961,"t_decision_unix":1779819338.8113012,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9982559855470392,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1838,"cache_hit":111616,"new_prefill":195,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":108227,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":388473.955548604,"t_first_token_unix":1779819338.969492,"t_done":388474.441639459,"t_done_unix":1779819339.4555833},{"request_id":"1399948:62:1749028:1076","session_id":"1399948","input_length":48212,"t_proxy_recv":388475.954144741,"t_decision_unix":1779819340.9680855,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":47104,"affinity_cache_ratio":0.9770181697502697,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47104,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1838,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2674,"cache_hit":47104,"new_prefill":1108,"score_linear":-47104.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47104.0,"chosen_score_lmetric":0,"t_first_token":388476.321593467,"t_first_token_unix":1779819341.3355372,"t_done":388476.873902525,"t_done_unix":1779819341.887846},{"request_id":"1253804:54:1750056:1077","session_id":"1253804","input_length":112074,"t_proxy_recv":388479.388228876,"t_decision_unix":1779819344.4021702,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9959134143512323,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1838,"cache_hit":111616,"new_prefill":458,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2676,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":3584,"new_prefill":108490,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":388479.73259719,"t_first_token_unix":1779819344.7465408,"t_done":388485.635260882,"t_done_unix":1779819350.649205},{"request_id":"1399948:63:1753316:1079","session_id":"1399948","input_length":48636,"t_proxy_recv":388490.252287679,"t_decision_unix":1779819355.266229,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9895550620939222,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":508,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2676,"cache_hit":48128,"new_prefill":508,"score_linear":-48128.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":133552,"ongoing_decode_tokens":0,"pending_prefill_tokens":432,"num_requests":1,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":48636,"score_linear":133552.0,"score_lmetric":49068},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":388490.516555749,"t_first_token_unix":1779819355.5304992,"t_done":388490.625443286,"t_done_unix":1779819355.639387},{"request_id":"1399948:64:1754453:1080","session_id":"1399948","input_length":48693,"t_proxy_recv":388494.163774567,"t_decision_unix":1779819359.1777153,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9989115478610888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":53,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2677,"cache_hit":48640,"new_prefill":53,"score_linear":-48640.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":133552,"ongoing_decode_tokens":133552,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":0,"new_prefill":48693,"score_linear":133552.0,"score_lmetric":48693},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48640.0,"chosen_score_lmetric":0,"t_first_token":388494.278376952,"t_first_token_unix":1779819359.2923203,"t_done":388495.557118158,"t_done_unix":1779819360.5710616},{"request_id":"1356885:11:1753167:1078","session_id":"1356885","input_length":133552,"t_proxy_recv":388489.827488732,"t_decision_unix":1779819354.8414297,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":133120,"affinity_cache_ratio":0.9967653048999641,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":133120,"estimated_new_tokens":432,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2676,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2314,"cache_hit":133120,"new_prefill":432,"score_linear":-133120.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-133120.0,"chosen_score_lmetric":0,"t_first_token":388490.479096935,"t_first_token_unix":1779819355.4930403,"t_done":388507.644480528,"t_done_unix":1779819372.6584241},{"request_id":"1399948:65:1759200:1081","session_id":"1399948","input_length":49220,"t_proxy_recv":388510.660068093,"t_decision_unix":1779819375.6740088,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9882161722876879,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2677,"cache_hit":48640,"new_prefill":580,"score_linear":-48640.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48640.0,"chosen_score_lmetric":0,"t_first_token":388510.929913653,"t_first_token_unix":1779819375.9438574,"t_done":388516.482169702,"t_done_unix":1779819381.496113},{"request_id":"1277428:14:1767578:1082","session_id":"1277428","input_length":49716,"t_proxy_recv":388539.511276713,"t_decision_unix":1779819404.5252178,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9886555636012552,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":564,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":4608,"new_prefill":45108,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2679,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":49152,"new_prefill":564,"score_linear":-49152.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":388539.692156781,"t_first_token_unix":1779819404.7061005,"t_done":388540.72502544,"t_done_unix":1779819405.7389688},{"request_id":"1277428:14:1770237:1083","session_id":"1277428","input_length":49925,"t_proxy_recv":388548.869121425,"t_decision_unix":1779819413.8830626,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.994772158237356,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":4608,"new_prefill":45317,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2679,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":49664,"new_prefill":261,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":388548.981521331,"t_first_token_unix":1779819413.9954648,"t_done":388549.291875936,"t_done_unix":1779819414.3058193},{"request_id":"1277428:15:1771467:1084","session_id":"1277428","input_length":51398,"t_proxy_recv":388552.936310418,"t_decision_unix":1779819417.9502516,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9662632787267987,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":1734,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":4608,"new_prefill":46790,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2679,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":49664,"new_prefill":1734,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":388553.520290572,"t_first_token_unix":1779819418.5342343,"t_done":388556.987420977,"t_done_unix":1779819422.0013647},{"request_id":"1399948:66:1772336:1085","session_id":"1399948","input_length":51012,"t_proxy_recv":388555.894283362,"t_decision_unix":1779819420.9082246,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9735748451344781,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":1348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2679,"cache_hit":49664,"new_prefill":1348,"score_linear":-49664.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":51398,"ongoing_decode_tokens":51398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":51012,"score_linear":51398.0,"score_lmetric":51012},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":388556.375847442,"t_first_token_unix":1779819421.3897915,"t_done":388559.329142307,"t_done_unix":1779819424.343086},{"request_id":"1399948:67:1777074:1086","session_id":"1399948","input_length":52331,"t_proxy_recv":388571.959230488,"t_decision_unix":1779819436.9731717,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9783875714203818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":1131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2682,"cache_hit":51200,"new_prefill":1131,"score_linear":-51200.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2321,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":388572.44611661,"t_first_token_unix":1779819437.4600601,"t_done":388576.749325589,"t_done_unix":1779819441.7632694},{"request_id":"1399948:68:1784799:1087","session_id":"1399948","input_length":53289,"t_proxy_recv":388598.453217965,"t_decision_unix":1779819463.4671588,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9896226238060387,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2685,"cache_hit":52736,"new_prefill":553,"score_linear":-52736.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2321,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":388598.745650048,"t_first_token_unix":1779819463.7595932,"t_done":388603.037662998,"t_done_unix":1779819468.051607},{"request_id":"1277428:16:1787662:1088","session_id":"1277428","input_length":52754,"t_proxy_recv":388608.89081312,"t_decision_unix":1779819473.9047542,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51712,"affinity_cache_ratio":0.9802479432839216,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51712,"estimated_new_tokens":1042,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":4608,"new_prefill":48146,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2687,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2321,"cache_hit":51712,"new_prefill":1042,"score_linear":-51712.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51712.0,"chosen_score_lmetric":0,"t_first_token":388609.29076733,"t_first_token_unix":1779819474.304711,"t_done":388609.880795413,"t_done_unix":1779819474.894739},{"request_id":"1305906:5:1788459:1089","session_id":"1305906","input_length":52461,"t_proxy_recv":388611.425969058,"t_decision_unix":1779819476.4399102,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":49664,"affinity_cache_ratio":0.946684203503555,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":2797,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1839,"cache_hit":49664,"new_prefill":2797,"score_linear":-49664.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2687,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":388612.425722178,"t_first_token_unix":1779819477.439666,"t_done":388612.929033616,"t_done_unix":1779819477.9429774},{"request_id":"1399948:69:1790968:1090","session_id":"1399948","input_length":54141,"t_proxy_recv":388620.021233945,"t_decision_unix":1779819485.0351748,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9929628193051476,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":51255,"ongoing_decode_tokens":51255,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1844,"cache_hit":0,"new_prefill":54141,"score_linear":51255.0,"score_lmetric":54141},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2687,"cache_hit":53760,"new_prefill":381,"score_linear":-53760.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":388620.307620266,"t_first_token_unix":1779819485.3215637,"t_done":388624.183819783,"t_done_unix":1779819489.197764},{"request_id":"1305906:6:1529600:945","session_id":"1305906","input_length":51255,"t_proxy_recv":388612.940337858,"t_decision_unix":1779819477.9542792,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9989269339576626,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":55,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1844,"cache_hit":51200,"new_prefill":55,"score_linear":-51200.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2687,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":388613.017183237,"t_first_token_unix":1779819478.0311265,"t_done":388627.925596596,"t_done_unix":1779819492.9395404},{"request_id":"1277428:17:1793546:1091","session_id":"1277428","input_length":53574,"t_proxy_recv":388629.023908954,"t_decision_unix":1779819494.03785,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9843580841452944,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":838,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":4608,"new_prefill":48966,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2688,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":52736,"new_prefill":838,"score_linear":-52736.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":388629.418872585,"t_first_token_unix":1779819494.4328163,"t_done":388630.726918889,"t_done_unix":1779819495.7408626},{"request_id":"1399948:70:1795589:1092","session_id":"1399948","input_length":54654,"t_proxy_recv":388636.345595353,"t_decision_unix":1779819501.3595362,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9930105756211806,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":382,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2688,"cache_hit":54272,"new_prefill":382,"score_linear":-54272.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2324,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":388636.438133818,"t_first_token_unix":1779819501.4520772,"t_done":388637.367175583,"t_done_unix":1779819502.381119},{"request_id":"1277428:18:1796824:1093","session_id":"1277428","input_length":53805,"t_proxy_recv":388640.941327165,"t_decision_unix":1779819505.9552684,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":53248,"affinity_cache_ratio":0.9896478022488616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53248,"estimated_new_tokens":557,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":4608,"new_prefill":49197,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2688,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2324,"cache_hit":53248,"new_prefill":557,"score_linear":-53248.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53248.0,"chosen_score_lmetric":0,"t_first_token":388641.073940277,"t_first_token_unix":1779819506.0878835,"t_done":388641.445289886,"t_done_unix":1779819506.459233},{"request_id":"1399948:71:1800797:1094","session_id":"1399948","input_length":54920,"t_proxy_recv":388654.51917274,"t_decision_unix":1779819519.5331142,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9882010196649672,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":648,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2688,"cache_hit":54272,"new_prefill":648,"score_linear":-54272.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":388654.703016034,"t_first_token_unix":1779819519.7169595,"t_done":388656.77060056,"t_done_unix":1779819521.7845445},{"request_id":"1399948:72:1804699:1097","session_id":"1399948","input_length":55246,"t_proxy_recv":388667.982174728,"t_decision_unix":1779819532.996116,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9916374036129313,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":462,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":55246,"score_linear":112634.0,"score_lmetric":55246},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2689,"cache_hit":54784,"new_prefill":462,"score_linear":-54784.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":55246,"score_linear":111736.0,"score_lmetric":55246},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":388668.106301747,"t_first_token_unix":1779819533.120246,"t_done":388668.496589703,"t_done_unix":1779819533.5105336},{"request_id":"1399948:73:1805981:1098","session_id":"1399948","input_length":55559,"t_proxy_recv":388672.164022203,"t_decision_unix":1779819537.177963,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9952662934898037,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":263,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":55559,"score_linear":112634.0,"score_lmetric":55559},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":55296,"new_prefill":263,"score_linear":-55296.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":55559,"score_linear":111736.0,"score_lmetric":55559},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":388672.360552392,"t_first_token_unix":1779819537.374496,"t_done":388673.648220898,"t_done_unix":1779819538.6621644},{"request_id":"1305906:6:1806419:1099","session_id":"1305906","input_length":52932,"t_proxy_recv":388673.676914682,"t_decision_unix":1779819538.6908557,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9962971359480087,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":196,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":52736,"new_prefill":196,"score_linear":59898.0,"score_lmetric":196},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":52932,"score_linear":111736.0,"score_lmetric":52932},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":59898.0,"chosen_score_lmetric":196,"t_first_token":388673.76831474,"t_first_token_unix":1779819538.7822587,"t_done":388675.093919753,"t_done_unix":1779819540.1078637},{"request_id":"1305906:7:1572780:964","session_id":"1305906","input_length":54789,"t_proxy_recv":388675.105611047,"t_decision_unix":1779819540.1195447,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9625289747942105,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2053,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":52736,"new_prefill":2053,"score_linear":59898.0,"score_lmetric":2053},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":54789,"score_linear":111736.0,"score_lmetric":54789},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":59898.0,"chosen_score_lmetric":2053,"t_first_token":388675.831060051,"t_first_token_unix":1779819540.845004,"t_done":388676.431423042,"t_done_unix":1779819541.4453666},{"request_id":"1399948:74:1808473:1100","session_id":"1399948","input_length":55791,"t_proxy_recv":388680.86609415,"t_decision_unix":1779819545.8800352,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9911276012260042,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":495,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":0,"new_prefill":55791,"score_linear":112634.0,"score_lmetric":55791},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2690,"cache_hit":55296,"new_prefill":495,"score_linear":-55296.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":55791,"score_linear":111736.0,"score_lmetric":55791},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":388681.003324726,"t_first_token_unix":1779819546.0172682,"t_done":388682.871167013,"t_done_unix":1779819547.8851104},{"request_id":"1270606:6:1804345:1096","session_id":"1270606","input_length":111736,"t_proxy_recv":388666.817212993,"t_decision_unix":1779819531.831154,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9989260399513138,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":120,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":0,"new_prefill":111736,"score_linear":112634.0,"score_lmetric":111736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2689,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":111616,"new_prefill":120,"score_linear":-111616.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":110200,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":388667.098909597,"t_first_token_unix":1779819532.112853,"t_done":388709.327741802,"t_done_unix":1779819574.3416855},{"request_id":"1399948:75:1817312:1101","session_id":"1399948","input_length":57308,"t_proxy_recv":388709.400396604,"t_decision_unix":1779819574.414338,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9738256438891604,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":1500,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":0,"new_prefill":57308,"score_linear":112634.0,"score_lmetric":57308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2691,"cache_hit":55808,"new_prefill":1500,"score_linear":-55808.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2025,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":388710.036522162,"t_first_token_unix":1779819575.050466,"t_done":388710.86918978,"t_done_unix":1779819575.8831332},{"request_id":"1399948:76:1821495:1102","session_id":"1399948","input_length":57659,"t_proxy_recv":388723.058824382,"t_decision_unix":1779819588.0727654,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9945368459390554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":0,"new_prefill":57659,"score_linear":112634.0,"score_lmetric":57659},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":57344,"new_prefill":315,"score_linear":-57344.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2025,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":388723.259886695,"t_first_token_unix":1779819588.27383,"t_done":388723.915273623,"t_done_unix":1779819588.929217},{"request_id":"1270606:6:1822681:1103","session_id":"1270606","input_length":112180,"t_proxy_recv":388726.900430754,"t_decision_unix":1779819591.9143715,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9995364592619005,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":52,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":0,"new_prefill":112180,"score_linear":112634.0,"score_lmetric":112180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2025,"cache_hit":112128,"new_prefill":52,"score_linear":-112128.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":110644,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":388727.047708723,"t_first_token_unix":1779819592.061653,"t_done":388727.93146214,"t_done_unix":1779819592.9454062},{"request_id":"1270606:7:1825806:1104","session_id":"1270606","input_length":112645,"t_proxy_recv":388737.520168329,"t_decision_unix":1779819602.5341096,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9954103599804697,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":517,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":0,"new_prefill":112645,"score_linear":112634.0,"score_lmetric":112645},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2025,"cache_hit":112128,"new_prefill":517,"score_linear":-112128.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":111109,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":388738.082480689,"t_first_token_unix":1779819603.0964243,"t_done":388742.095261267,"t_done_unix":1779819607.109205},{"request_id":"1277428:19:1834491:1105","session_id":"1277428","input_length":58474,"t_proxy_recv":388766.785599159,"t_decision_unix":1779819631.7995405,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9193829736293053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":4714,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":4608,"new_prefill":53866,"score_linear":108026.0,"score_lmetric":53866},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":53760,"new_prefill":4714,"score_linear":-53760.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2026,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":388768.522325252,"t_first_token_unix":1779819633.5362687,"t_done":388768.853149223,"t_done_unix":1779819633.8670921},{"request_id":"1270606:8:1837578:1106","session_id":"1270606","input_length":113482,"t_proxy_recv":388777.622241173,"t_decision_unix":1779819642.6361823,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":112640,"affinity_cache_ratio":0.9925803211081934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":842,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1849,"cache_hit":0,"new_prefill":113482,"score_linear":112634.0,"score_lmetric":113482},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2026,"cache_hit":112640,"new_prefill":842,"score_linear":-112640.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":111946,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":388778.193158434,"t_first_token_unix":1779819643.2071028,"t_done":388778.616562938,"t_done_unix":1779819643.6305068},{"request_id":"1253804:55:1803044:1095","session_id":"1253804","input_length":112634,"t_proxy_recv":388662.407764433,"t_decision_unix":1779819527.4217055,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9955075732016976,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":506,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1845,"cache_hit":112128,"new_prefill":506,"score_linear":-112128.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2689,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":3584,"new_prefill":109050,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2023,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":388662.579707073,"t_first_token_unix":1779819527.593651,"t_done":388787.475466516,"t_done_unix":1779819652.4894102},{"request_id":"1270606:9:1847569:1107","session_id":"1270606","input_length":116467,"t_proxy_recv":388811.520283464,"t_decision_unix":1779819676.5342243,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":113152,"affinity_cache_ratio":0.9715370018975332,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":113152,"estimated_new_tokens":3315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1851,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2027,"cache_hit":113152,"new_prefill":3315,"score_linear":-113152.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":114931,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-113152.0,"chosen_score_lmetric":0,"t_first_token":388813.778174552,"t_first_token_unix":1779819678.7921178,"t_done":388815.294594241,"t_done_unix":1779819680.308538},{"request_id":"1270606:10:1851128:1108","session_id":"1270606","input_length":116659,"t_proxy_recv":388823.604811128,"t_decision_unix":1779819688.618752,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9962711835349181,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1851,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2033,"cache_hit":116224,"new_prefill":435,"score_linear":-116224.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":115123,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-116224.0,"chosen_score_lmetric":0,"t_first_token":388823.858022009,"t_first_token_unix":1779819688.8719656,"t_done":388824.607905188,"t_done_unix":1779819689.6218493},{"request_id":"1305906:7:1851943:1109","session_id":"1305906","input_length":58042,"t_proxy_recv":388826.14975671,"t_decision_unix":1779819691.163698,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9438682333482651,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":3258,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1851,"cache_hit":54784,"new_prefill":3258,"score_linear":-54784.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2033,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":388827.446310403,"t_first_token_unix":1779819692.4602542,"t_done":388829.687035749,"t_done_unix":1779819694.7009792},{"request_id":"1305906:8:1866131:1110","session_id":"1305906","input_length":58687,"t_proxy_recv":388874.614275899,"t_decision_unix":1779819739.6282165,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9858401349532264,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":831,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1857,"cache_hit":57856,"new_prefill":831,"score_linear":-57856.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2033,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":388874.934587768,"t_first_token_unix":1779819739.9485312,"t_done":388876.80875735,"t_done_unix":1779819741.8227007},{"request_id":"1270606:11:1868274:1111","session_id":"1270606","input_length":117828,"t_proxy_recv":388881.889635696,"t_decision_unix":1779819746.903577,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9863869368910615,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":1604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2033,"cache_hit":116224,"new_prefill":1604,"score_linear":-116224.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":116292,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-116224.0,"chosen_score_lmetric":0,"t_first_token":388882.899728642,"t_first_token_unix":1779819747.9136722,"t_done":388884.624221141,"t_done_unix":1779819749.6381655},{"request_id":"1270606:11:1870810:1113","session_id":"1270606","input_length":118012,"t_proxy_recv":388890.384881584,"t_decision_unix":1779819755.3988225,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9978646239365488,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":118012,"score_linear":112926.0,"score_lmetric":118012},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2036,"cache_hit":117760,"new_prefill":252,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":1536,"new_prefill":116476,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":388890.560624148,"t_first_token_unix":1779819755.5745678,"t_done":388891.067740938,"t_done_unix":1779819756.0816848},{"request_id":"1356885:12:1874205:1114","session_id":"1356885","input_length":135435,"t_proxy_recv":388901.857253208,"t_decision_unix":1779819766.8711946,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":134656,"affinity_cache_ratio":0.9942481633255805,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":134656,"estimated_new_tokens":779,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":135435,"score_linear":112926.0,"score_lmetric":135435},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":134656,"new_prefill":779,"score_linear":-134656.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2036,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-134656.0,"chosen_score_lmetric":0,"t_first_token":388902.519055136,"t_first_token_unix":1779819767.5329986,"t_done":388905.047096983,"t_done_unix":1779819770.0610406},{"request_id":"1340290:17:1875101:1115","session_id":"1340290","input_length":40328,"t_proxy_recv":388904.780045677,"t_decision_unix":1779819769.7939868,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9902797064074589,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":13192,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":40328,"score_linear":112926.0,"score_lmetric":40328},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":135435,"ongoing_decode_tokens":135435,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":0,"new_prefill":40328,"score_linear":135435.0,"score_lmetric":40328},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2036,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":39304,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":39936,"new_prefill":392,"score_linear":-39936.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":388904.858807007,"t_first_token_unix":1779819769.87275,"t_done":388907.945585703,"t_done_unix":1779819772.9595292},{"request_id":"1270606:12:1876851:1116","session_id":"1270606","input_length":118600,"t_proxy_recv":388910.747032054,"t_decision_unix":1779819775.760973,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9929173693086003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":118600,"score_linear":112926.0,"score_lmetric":118600},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2036,"cache_hit":117760,"new_prefill":840,"score_linear":-117760.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2368,"cache_hit":1536,"new_prefill":117064,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":388911.340013195,"t_first_token_unix":1779819776.353957,"t_done":388913.489532006,"t_done_unix":1779819778.5034757},{"request_id":"1340290:18:1878955:1117","session_id":"1340290","input_length":40583,"t_proxy_recv":388918.458222552,"t_decision_unix":1779819783.4721634,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9966734839711209,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":135,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":13447,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":40583,"score_linear":112926.0,"score_lmetric":40583},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":39559,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2368,"cache_hit":40448,"new_prefill":135,"score_linear":-40448.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":388918.526148699,"t_first_token_unix":1779819783.540092,"t_done":388918.737280811,"t_done_unix":1779819783.751224},{"request_id":"1340290:19:1880565:1118","session_id":"1340290","input_length":40676,"t_proxy_recv":388923.729814394,"t_decision_unix":1779819788.7437556,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9943947290785722,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":13540,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":40676,"score_linear":112926.0,"score_lmetric":40676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":39652,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2368,"cache_hit":40448,"new_prefill":228,"score_linear":-40448.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":388923.835402287,"t_first_token_unix":1779819788.8493457,"t_done":388924.389253509,"t_done_unix":1779819789.4031973},{"request_id":"1340290:20:1882251:1120","session_id":"1340290","input_length":40883,"t_proxy_recv":388929.544500131,"t_decision_unix":1779819794.558441,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9893598806349827,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":13747,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":40883,"score_linear":112926.0,"score_lmetric":40883},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119030,"ongoing_decode_tokens":119030,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":40883,"score_linear":119030.0,"score_lmetric":40883},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":39859,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2368,"cache_hit":40448,"new_prefill":435,"score_linear":-40448.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":388929.655567568,"t_first_token_unix":1779819794.6695108,"t_done":388929.979281109,"t_done_unix":1779819794.9932244},{"request_id":"1270606:12:1881189:1119","session_id":"1270606","input_length":119030,"t_proxy_recv":388926.135450286,"t_decision_unix":1779819791.1493917,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":118784,"affinity_cache_ratio":0.9979332941275308,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":118784,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":119030,"score_linear":112926.0,"score_lmetric":119030},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":118784,"new_prefill":246,"score_linear":-118784.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2368,"cache_hit":1536,"new_prefill":117494,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-118784.0,"chosen_score_lmetric":0,"t_first_token":388926.505102112,"t_first_token_unix":1779819791.5190456,"t_done":388930.508087979,"t_done_unix":1779819795.5220318},{"request_id":"1340290:21:1883855:1121","session_id":"1340290","input_length":41002,"t_proxy_recv":388935.007178848,"t_decision_unix":1779819800.0211203,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40448,"affinity_cache_ratio":0.986488463977367,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":554,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":13866,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":41002,"score_linear":112926.0,"score_lmetric":41002},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":39978,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2368,"cache_hit":40448,"new_prefill":554,"score_linear":-40448.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":388935.117767748,"t_first_token_unix":1779819800.131711,"t_done":388935.369457927,"t_done_unix":1779819800.3834014},{"request_id":"1340290:22:1884847:1122","session_id":"1340290","input_length":41909,"t_proxy_recv":388938.480704546,"t_decision_unix":1779819803.4946458,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40960,"affinity_cache_ratio":0.9773556992531437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40960,"estimated_new_tokens":949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":14773,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":41909,"score_linear":112926.0,"score_lmetric":41909},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":40885,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2369,"cache_hit":40960,"new_prefill":949,"score_linear":-40960.0,"score_lmetric":0}],"chosen_score_linear":-40960.0,"chosen_score_lmetric":0,"t_first_token":388938.812581928,"t_first_token_unix":1779819803.826526,"t_done":388939.150707748,"t_done_unix":1779819804.1646512},{"request_id":"1253804:55:1869941:1112","session_id":"1253804","input_length":112926,"t_proxy_recv":388887.519758584,"t_decision_unix":1779819752.5336995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":112640,"affinity_cache_ratio":0.9974673680109098,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":286,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":112640,"new_prefill":286,"score_linear":-112640.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2334,"cache_hit":3584,"new_prefill":109342,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2036,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2367,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":388887.666223033,"t_first_token_unix":1779819752.6801667,"t_done":388940.205908358,"t_done_unix":1779819805.219852},{"request_id":"1340290:23:1886013:1124","session_id":"1340290","input_length":42086,"t_proxy_recv":388942.510515925,"t_decision_unix":1779819807.5244572,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41472,"affinity_cache_ratio":0.9854108254526446,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41472,"estimated_new_tokens":614,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":14950,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":0,"pending_prefill_tokens":5477,"num_requests":1,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":42086,"score_linear":63845.0,"score_lmetric":47563},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":41062,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2370,"cache_hit":41472,"new_prefill":614,"score_linear":-41472.0,"score_lmetric":0}],"chosen_score_linear":-41472.0,"chosen_score_lmetric":0,"t_first_token":388942.62565612,"t_first_token_unix":1779819807.6395996,"t_done":388942.918020835,"t_done_unix":1779819807.9319642},{"request_id":"1270606:12:1886765:1125","session_id":"1270606","input_length":119440,"t_proxy_recv":388945.253701501,"t_decision_unix":1779819810.267643,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9987943737441393,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":119440,"score_linear":63845.0,"score_lmetric":119440},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":119296,"new_prefill":144,"score_linear":-119296.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2371,"cache_hit":1536,"new_prefill":117904,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":388945.492342163,"t_first_token_unix":1779819810.5062857,"t_done":388946.535873301,"t_done_unix":1779819811.5498166},{"request_id":"1340290:24:1887125:1126","session_id":"1340290","input_length":42199,"t_proxy_recv":388946.28718205,"t_decision_unix":1779819811.3011236,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9949050925377378,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":215,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":15063,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":42199,"score_linear":63845.0,"score_lmetric":42199},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119440,"ongoing_decode_tokens":119440,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":42199,"score_linear":119440.0,"score_lmetric":42199},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":41175,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2371,"cache_hit":41984,"new_prefill":215,"score_linear":-41984.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":388946.399909835,"t_first_token_unix":1779819811.4138534,"t_done":388946.567944868,"t_done_unix":1779819811.581888},{"request_id":"1340290:25:1888447:1127","session_id":"1340290","input_length":42444,"t_proxy_recv":388950.680120809,"t_decision_unix":1779819815.694062,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9891621901800018,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":15308,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":0,"new_prefill":42444,"score_linear":63845.0,"score_lmetric":42444},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":41420,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2371,"cache_hit":41984,"new_prefill":460,"score_linear":-41984.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":388950.837444,"t_first_token_unix":1779819815.8513877,"t_done":388951.139891052,"t_done_unix":1779819816.1538343},{"request_id":"1277428:20:1885419:1123","session_id":"1277428","input_length":63845,"t_proxy_recv":388940.397178747,"t_decision_unix":1779819805.4111195,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9142141123032343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":5477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":4608,"new_prefill":59237,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2335,"cache_hit":58368,"new_prefill":5477,"score_linear":-58368.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2370,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":388942.605456842,"t_first_token_unix":1779819807.6194007,"t_done":388952.647944855,"t_done_unix":1779819817.661891},{"request_id":"1340290:26:1889402:1128","session_id":"1340290","input_length":48504,"t_proxy_recv":388953.999909492,"t_decision_unix":1779819819.0138507,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.8655780966518225,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":6520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":21368,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":47480,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2371,"cache_hit":41984,"new_prefill":6520,"score_linear":-41984.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":388955.889739616,"t_first_token_unix":1779819820.9036832,"t_done":388956.095683909,"t_done_unix":1779819821.1096272},{"request_id":"1270606:13:1890252:1129","session_id":"1270606","input_length":119686,"t_proxy_recv":388956.981641741,"t_decision_unix":1779819821.995583,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9967414735223836,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":390,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":119296,"new_prefill":390,"score_linear":-119296.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":1536,"new_prefill":118150,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":388957.346358672,"t_first_token_unix":1779819822.3603024,"t_done":388958.264782571,"t_done_unix":1779819823.278726},{"request_id":"1340290:27:1892591:1131","session_id":"1340290","input_length":49361,"t_proxy_recv":388964.586920879,"t_decision_unix":1779819829.6008618,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9750207653815766,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":1233,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":22225,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":119828,"ongoing_decode_tokens":119828,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":0,"new_prefill":49361,"score_linear":119828.0,"score_lmetric":49361},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":48337,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":48128,"new_prefill":1233,"score_linear":-48128.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":388964.965585582,"t_first_token_unix":1779819829.9795291,"t_done":388965.287126756,"t_done_unix":1779819830.30107},{"request_id":"1270606:14:1892412:1130","session_id":"1270606","input_length":119828,"t_proxy_recv":388963.924726959,"t_decision_unix":1779819828.9386675,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9955603031011115,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2039,"cache_hit":119296,"new_prefill":532,"score_linear":-119296.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":1536,"new_prefill":118292,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":388964.197802563,"t_first_token_unix":1779819829.2117465,"t_done":388966.138870661,"t_done_unix":1779819831.1528141},{"request_id":"1340290:28:1893837:1132","session_id":"1340290","input_length":49454,"t_proxy_recv":388968.89429202,"t_decision_unix":1779819833.9082332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9938933149997978,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":22318,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":48430,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":49152,"new_prefill":302,"score_linear":-49152.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":388969.007671469,"t_first_token_unix":1779819834.0216146,"t_done":388969.259030368,"t_done_unix":1779819834.2729738},{"request_id":"1305906:9:1893880:1133","session_id":"1305906","input_length":59265,"t_proxy_recv":388969.061876883,"t_decision_unix":1779819834.0758183,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9935037543237999,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":385,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":58880,"new_prefill":385,"score_linear":-58880.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":49454,"ongoing_decode_tokens":49454,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":0,"new_prefill":59265,"score_linear":49454.0,"score_lmetric":59265}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":388969.402789983,"t_first_token_unix":1779819834.4167333,"t_done":388969.992536571,"t_done_unix":1779819835.00648},{"request_id":"1270606:15:1895310:1134","session_id":"1270606","input_length":120058,"t_proxy_recv":388973.730553675,"t_decision_unix":1779819838.7444947,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119808,"affinity_cache_ratio":0.9979176731246564,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119808,"estimated_new_tokens":250,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":119808,"new_prefill":250,"score_linear":-119808.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":1536,"new_prefill":118522,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119808.0,"chosen_score_lmetric":0,"t_first_token":388973.990216074,"t_first_token_unix":1779819839.0041592,"t_done":388974.96650865,"t_done_unix":1779819839.9804525},{"request_id":"1340290:29:1896119:1136","session_id":"1340290","input_length":49576,"t_proxy_recv":388976.219799677,"t_decision_unix":1779819841.2337408,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9914474745844764,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":424,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":22440,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":135905,"ongoing_decode_tokens":135905,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":0,"new_prefill":49576,"score_linear":135905.0,"score_lmetric":49576},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":48552,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":49152,"new_prefill":424,"score_linear":-49152.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":388976.33164156,"t_first_token_unix":1779819841.3455853,"t_done":388976.57637147,"t_done_unix":1779819841.5903153},{"request_id":"1356885:13:1895311:1135","session_id":"1356885","input_length":135905,"t_proxy_recv":388973.742444598,"t_decision_unix":1779819838.7563858,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":135168,"affinity_cache_ratio":0.9945770942938081,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":135168,"estimated_new_tokens":737,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2347,"cache_hit":135168,"new_prefill":737,"score_linear":-135168.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":120058,"ongoing_decode_tokens":0,"pending_prefill_tokens":250,"num_requests":1,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":135905,"score_linear":120058.0,"score_lmetric":136155},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-135168.0,"chosen_score_lmetric":0,"t_first_token":388974.172249949,"t_first_token_unix":1779819839.1861935,"t_done":388976.58601502,"t_done_unix":1779819841.599959},{"request_id":"1340290:30:1896991:1137","session_id":"1340290","input_length":49695,"t_proxy_recv":388979.192314429,"t_decision_unix":1779819844.2062552,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9890733474192575,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":22559,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":48671,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":49152,"new_prefill":543,"score_linear":-49152.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":388979.313329632,"t_first_token_unix":1779819844.3272731,"t_done":388980.800589193,"t_done_unix":1779819845.8145323},{"request_id":"1340290:31:1899492:1138","session_id":"1340290","input_length":49927,"t_proxy_recv":388987.577832496,"t_decision_unix":1779819852.5917737,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9947323091713902,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":263,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":22791,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":48903,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2386,"cache_hit":49664,"new_prefill":263,"score_linear":-49664.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":388987.672545749,"t_first_token_unix":1779819852.6864896,"t_done":388988.327178837,"t_done_unix":1779819853.341123},{"request_id":"1270606:16:1902252:1140","session_id":"1270606","input_length":120572,"t_proxy_recv":388996.2220249,"t_decision_unix":1779819861.2359662,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":119808,"affinity_cache_ratio":0.9936635371396344,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119808,"estimated_new_tokens":764,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":119808,"new_prefill":764,"score_linear":-119808.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":50078,"ongoing_decode_tokens":50078,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2386,"cache_hit":1536,"new_prefill":119036,"score_linear":48542.0,"score_lmetric":119036}],"chosen_score_linear":-119808.0,"chosen_score_lmetric":0,"t_first_token":388996.811200125,"t_first_token_unix":1779819861.8251436,"t_done":388997.764655354,"t_done_unix":1779819862.778599},{"request_id":"1270606:17:1908800:1141","session_id":"1270606","input_length":121006,"t_proxy_recv":389017.674905157,"t_decision_unix":1779819882.688845,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":120320,"affinity_cache_ratio":0.9943308596267953,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":120320,"estimated_new_tokens":686,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2041,"cache_hit":120320,"new_prefill":686,"score_linear":-120320.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":50078,"ongoing_decode_tokens":50078,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2386,"cache_hit":1536,"new_prefill":119470,"score_linear":48542.0,"score_lmetric":119470}],"chosen_score_linear":-120320.0,"chosen_score_lmetric":0,"t_first_token":389018.266630377,"t_first_token_unix":1779819883.2805736,"t_done":389018.879766189,"t_done_unix":1779819883.8937106},{"request_id":"1340290:32:1901260:1139","session_id":"1340290","input_length":50078,"t_proxy_recv":388992.988183068,"t_decision_unix":1779819858.0021243,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9917328966811774,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":22942,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2040,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":49054,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2386,"cache_hit":49664,"new_prefill":414,"score_linear":-49664.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":388993.113195152,"t_first_token_unix":1779819858.1271386,"t_done":389023.442715957,"t_done_unix":1779819888.4566598},{"request_id":"1270606:18:1915824:1142","session_id":"1270606","input_length":121288,"t_proxy_recv":389040.64210573,"t_decision_unix":1779819905.6560469,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":120832,"affinity_cache_ratio":0.9962403535386848,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":120832,"estimated_new_tokens":456,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2042,"cache_hit":120832,"new_prefill":456,"score_linear":-120832.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2387,"cache_hit":1536,"new_prefill":119752,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-120832.0,"chosen_score_lmetric":0,"t_first_token":389041.024096934,"t_first_token_unix":1779819906.0380406,"t_done":389041.890349021,"t_done_unix":1779819906.9042928},{"request_id":"1270606:19:1920499:1143","session_id":"1270606","input_length":121560,"t_proxy_recv":389055.811893716,"t_decision_unix":1779819920.825834,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":121344,"affinity_cache_ratio":0.9982230997038499,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":121344,"estimated_new_tokens":216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":121344,"new_prefill":216,"score_linear":-121344.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2387,"cache_hit":1536,"new_prefill":120024,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-121344.0,"chosen_score_lmetric":0,"t_first_token":389056.187645474,"t_first_token_unix":1779819921.2015896,"t_done":389057.160271948,"t_done_unix":1779819922.1742163},{"request_id":"1270606:20:1922639:1144","session_id":"1270606","input_length":121704,"t_proxy_recv":389063.241071322,"t_decision_unix":1779819928.255012,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":121344,"affinity_cache_ratio":0.9970420035495957,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":121344,"estimated_new_tokens":360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":121344,"new_prefill":360,"score_linear":-121344.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2387,"cache_hit":1536,"new_prefill":120168,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-121344.0,"chosen_score_lmetric":0,"t_first_token":389063.480084098,"t_first_token_unix":1779819928.494028,"t_done":389064.792386898,"t_done_unix":1779819929.806331},{"request_id":"1305906:10:1928316:1145","session_id":"1305906","input_length":61801,"t_proxy_recv":389081.810459396,"t_decision_unix":1779819946.8244002,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9527353926311872,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":2921,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1859,"cache_hit":58880,"new_prefill":2921,"score_linear":-58880.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2387,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":389082.856378481,"t_first_token_unix":1779819947.8703225,"t_done":389083.209623421,"t_done_unix":1779819948.223567},{"request_id":"1340290:33:1939781:1146","session_id":"1340290","input_length":53990,"t_proxy_recv":389119.569187509,"t_decision_unix":1779819984.5831287,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9957399518429338,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":230,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":26854,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":52966,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2387,"cache_hit":53760,"new_prefill":230,"score_linear":-53760.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":389119.672223201,"t_first_token_unix":1779819984.6861665,"t_done":389120.755812888,"t_done_unix":1779819985.769756},{"request_id":"1340290:34:1942249:1147","session_id":"1340290","input_length":54164,"t_proxy_recv":389127.409871779,"t_decision_unix":1779819992.423813,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":53760,"affinity_cache_ratio":0.992541171257662,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":404,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":27028,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":53140,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2387,"cache_hit":53760,"new_prefill":404,"score_linear":-53760.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":389127.51390839,"t_first_token_unix":1779819992.5278518,"t_done":389129.968505843,"t_done_unix":1779819994.9824498},{"request_id":"1356885:14:1948151:1148","session_id":"1356885","input_length":136210,"t_proxy_recv":389147.177789393,"t_decision_unix":1779820012.1917307,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":135680,"affinity_cache_ratio":0.9961089494163424,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":135680,"estimated_new_tokens":530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2348,"cache_hit":135680,"new_prefill":530,"score_linear":-135680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2388,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-135680.0,"chosen_score_lmetric":0,"t_first_token":389147.516487943,"t_first_token_unix":1779820012.5304313,"t_done":389149.202969758,"t_done_unix":1779820014.2169137},{"request_id":"1340290:35:1964727:1149","session_id":"1340290","input_length":54498,"t_proxy_recv":389201.890889034,"t_decision_unix":1779820066.9048302,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9958530588278469,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":226,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":27362,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":53474,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2388,"cache_hit":54272,"new_prefill":226,"score_linear":-54272.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":389201.995982843,"t_first_token_unix":1779820067.0099266,"t_done":389205.755212564,"t_done_unix":1779820070.7691557},{"request_id":"1340290:36:1969509:1150","session_id":"1340290","input_length":54811,"t_proxy_recv":389217.643309611,"t_decision_unix":1779820082.657251,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9995073981500063,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":27,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":27675,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":53787,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2389,"cache_hit":54784,"new_prefill":27,"score_linear":-54784.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":389217.72762656,"t_first_token_unix":1779820082.74157,"t_done":389218.178321538,"t_done_unix":1779820083.1922653},{"request_id":"1340290:37:1971106:1151","session_id":"1340290","input_length":55358,"t_proxy_recv":389222.788230178,"t_decision_unix":1779820087.802172,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9896311282922071,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":574,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":28222,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":54334,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2389,"cache_hit":54784,"new_prefill":574,"score_linear":-54784.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":389223.088946531,"t_first_token_unix":1779820088.1028903,"t_done":389223.546188219,"t_done_unix":1779820088.5601313},{"request_id":"1340290:38:1972289:1152","session_id":"1340290","input_length":56006,"t_proxy_recv":389226.715680488,"t_decision_unix":1779820091.7296216,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9873227868442667,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":28870,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":54982,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2390,"cache_hit":55296,"new_prefill":710,"score_linear":-55296.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":389227.025391726,"t_first_token_unix":1779820092.0393357,"t_done":389227.684668691,"t_done_unix":1779820092.6986122},{"request_id":"1340290:39:1973889:1153","session_id":"1340290","input_length":56242,"t_proxy_recv":389232.14165424,"t_decision_unix":1779820097.1555955,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9922833469649017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":29106,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":55218,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2391,"cache_hit":55808,"new_prefill":434,"score_linear":-55808.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":389232.33225052,"t_first_token_unix":1779820097.346194,"t_done":389232.990525825,"t_done_unix":1779820098.0044694},{"request_id":"1340290:40:1975278:1154","session_id":"1340290","input_length":56416,"t_proxy_recv":389236.704306023,"t_decision_unix":1779820101.7182472,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":56320,"affinity_cache_ratio":0.998298355076574,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":96,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":29280,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":55392,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2392,"cache_hit":56320,"new_prefill":96,"score_linear":-56320.0,"score_lmetric":0}],"chosen_score_linear":-56320.0,"chosen_score_lmetric":0,"t_first_token":389236.824446382,"t_first_token_unix":1779820101.8383899,"t_done":389237.305967277,"t_done_unix":1779820102.319911},{"request_id":"1340290:41:1977055:1156","session_id":"1340290","input_length":57181,"t_proxy_recv":389242.639506951,"t_decision_unix":1779820107.6534483,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":56320,"affinity_cache_ratio":0.9849425508473094,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":861,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":30045,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":67793,"ongoing_decode_tokens":0,"pending_prefill_tokens":2769,"num_requests":1,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":0,"new_prefill":57181,"score_linear":67793.0,"score_lmetric":59950},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":56157,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2392,"cache_hit":56320,"new_prefill":861,"score_linear":-56320.0,"score_lmetric":0}],"chosen_score_linear":-56320.0,"chosen_score_lmetric":0,"t_first_token":389243.060665681,"t_first_token_unix":1779820108.0746088,"t_done":389245.033227172,"t_done_unix":1779820110.0471706},{"request_id":"1277428:21:1976968:1155","session_id":"1277428","input_length":67793,"t_proxy_recv":389242.355517339,"t_decision_unix":1779820107.3694584,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9591550750077442,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":2769,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":4608,"new_prefill":63185,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2349,"cache_hit":65024,"new_prefill":2769,"score_linear":-65024.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2392,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":389243.612687601,"t_first_token_unix":1779820108.6266305,"t_done":389249.444283278,"t_done_unix":1779820114.4582267},{"request_id":"1340290:42:1982198:1157","session_id":"1340290","input_length":57463,"t_proxy_recv":389259.544796735,"t_decision_unix":1779820124.5587378,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9979291022048971,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":119,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":30327,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":56439,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2394,"cache_hit":57344,"new_prefill":119,"score_linear":-57344.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":389259.646585422,"t_first_token_unix":1779820124.6605287,"t_done":389260.135830863,"t_done_unix":1779820125.1497743},{"request_id":"1340290:43:1983901:1158","session_id":"1340290","input_length":57640,"t_proxy_recv":389264.939581027,"t_decision_unix":1779820129.953522,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9948646773074254,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":296,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":30504,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":56616,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2394,"cache_hit":57344,"new_prefill":296,"score_linear":-57344.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":389265.096320429,"t_first_token_unix":1779820130.1102638,"t_done":389265.610720733,"t_done_unix":1779820130.6246643},{"request_id":"1340290:44:1986230:1159","session_id":"1340290","input_length":57809,"t_proxy_recv":389273.020966185,"t_decision_unix":1779820138.0349073,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9919562697849815,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":30673,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":56785,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2394,"cache_hit":57344,"new_prefill":465,"score_linear":-57344.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":389273.199204718,"t_first_token_unix":1779820138.213148,"t_done":389273.891680912,"t_done_unix":1779820138.9056244},{"request_id":"1277428:21:1989132:1160","session_id":"1277428","input_length":69987,"t_proxy_recv":389282.441588412,"t_decision_unix":1779820147.4555297,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9729806964150485,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":1891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":4608,"new_prefill":65379,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2355,"cache_hit":68096,"new_prefill":1891,"score_linear":-68096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":389283.218679598,"t_first_token_unix":1779820148.2326238,"t_done":389283.561820708,"t_done_unix":1779820148.5757642},{"request_id":"1277428:22:1990436:1161","session_id":"1277428","input_length":70055,"t_proxy_recv":389286.982474981,"t_decision_unix":1779820151.9964144,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":69632,"affinity_cache_ratio":0.993961887088716,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":423,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":4608,"new_prefill":65447,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2358,"cache_hit":69632,"new_prefill":423,"score_linear":-69632.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":389287.103560355,"t_first_token_unix":1779820152.117504,"t_done":389287.51035015,"t_done_unix":1779820152.5242937},{"request_id":"1340290:45:1991694:1162","session_id":"1340290","input_length":58053,"t_proxy_recv":389290.993976734,"t_decision_unix":1779820156.0079176,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9966065491878111,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":30917,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2358,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57029,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":57856,"new_prefill":197,"score_linear":-57856.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":389291.188185798,"t_first_token_unix":1779820156.2021294,"t_done":389291.440523497,"t_done_unix":1779820156.4544675},{"request_id":"1340290:46:1992980:1163","session_id":"1340290","input_length":58122,"t_proxy_recv":389295.219216026,"t_decision_unix":1779820160.2331572,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9954234197033826,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":266,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":30986,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2358,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57098,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":57856,"new_prefill":266,"score_linear":-57856.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":389295.32393756,"t_first_token_unix":1779820160.337881,"t_done":389295.739294429,"t_done_unix":1779820160.7532377},{"request_id":"1340290:47:1995358:1164","session_id":"1340290","input_length":58307,"t_proxy_recv":389303.081539502,"t_decision_unix":1779820168.0954802,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9922650796645343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":451,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":31171,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2358,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57283,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":57856,"new_prefill":451,"score_linear":-57856.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":389303.225904875,"t_first_token_unix":1779820168.2398486,"t_done":389303.477278686,"t_done_unix":1779820168.4912224},{"request_id":"1340290:48:1996945:1165","session_id":"1340290","input_length":58339,"t_proxy_recv":389308.387017702,"t_decision_unix":1779820173.400959,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9917208042647285,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":31203,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2358,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57315,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2395,"cache_hit":57856,"new_prefill":483,"score_linear":-57856.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":389308.470658775,"t_first_token_unix":1779820173.4846022,"t_done":389310.481790557,"t_done_unix":1779820175.495734},{"request_id":"1356885:15:1998292:1166","session_id":"1356885","input_length":136653,"t_proxy_recv":389312.857159074,"t_decision_unix":1779820177.8711002,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":136192,"affinity_cache_ratio":0.9966264919174844,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":136192,"estimated_new_tokens":461,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2358,"cache_hit":136192,"new_prefill":461,"score_linear":-136192.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2396,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-136192.0,"chosen_score_lmetric":0,"t_first_token":389313.51273307,"t_first_token_unix":1779820178.5266767,"t_done":389315.177099294,"t_done_unix":1779820180.1910431},{"request_id":"1340290:48:1999591:1167","session_id":"1340290","input_length":58622,"t_proxy_recv":389317.401584974,"t_decision_unix":1779820182.415526,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9956671556753437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":254,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":31486,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57598,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2396,"cache_hit":58368,"new_prefill":254,"score_linear":-58368.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":389317.50397111,"t_first_token_unix":1779820182.5179143,"t_done":389318.103652608,"t_done_unix":1779820183.117596},{"request_id":"1340290:48:2001313:1168","session_id":"1340290","input_length":58808,"t_proxy_recv":389322.871284737,"t_decision_unix":1779820187.8852262,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9925180247585362,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":31672,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57784,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2396,"cache_hit":58368,"new_prefill":440,"score_linear":-58368.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":389323.030097034,"t_first_token_unix":1779820188.0440404,"t_done":389323.543625455,"t_done_unix":1779820188.557569},{"request_id":"1340290:48:2003195:1169","session_id":"1340290","input_length":58977,"t_proxy_recv":389329.193750862,"t_decision_unix":1779820194.2076921,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":58368,"affinity_cache_ratio":0.989673940688743,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":31841,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":57953,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2396,"cache_hit":58368,"new_prefill":609,"score_linear":-58368.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":389329.356053073,"t_first_token_unix":1779820194.3699965,"t_done":389330.236574883,"t_done_unix":1779820195.2505186},{"request_id":"1340290:48:2005449:1170","session_id":"1340290","input_length":59220,"t_proxy_recv":389336.583731154,"t_decision_unix":1779820201.5976722,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":58880,"affinity_cache_ratio":0.994258696386356,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":32084,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":58196,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":58880,"new_prefill":340,"score_linear":-58880.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":389336.729066024,"t_first_token_unix":1779820201.7430096,"t_done":389337.5686556,"t_done_unix":1779820202.5825992},{"request_id":"1340290:48:2007287:1171","session_id":"1340290","input_length":59487,"t_proxy_recv":389342.708428343,"t_decision_unix":1779820207.72237,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9897960899019954,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":607,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":32351,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":58463,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2397,"cache_hit":58880,"new_prefill":607,"score_linear":-58880.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":389342.908878007,"t_first_token_unix":1779820207.9228215,"t_done":389343.289370166,"t_done_unix":1779820208.3033135},{"request_id":"1340290:48:2008380:1173","session_id":"1340290","input_length":60935,"t_proxy_recv":389346.809879823,"t_decision_unix":1779820211.823821,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":59392,"affinity_cache_ratio":0.9746779355050463,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":1543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":33799,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":66506,"ongoing_decode_tokens":0,"pending_prefill_tokens":5066,"num_requests":1,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":60935,"score_linear":66506.0,"score_lmetric":66001},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":59911,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2398,"cache_hit":59392,"new_prefill":1543,"score_linear":-59392.0,"score_lmetric":0}],"chosen_score_linear":-59392.0,"chosen_score_lmetric":0,"t_first_token":389347.481966212,"t_first_token_unix":1779820212.49591,"t_done":389348.167711681,"t_done_unix":1779820213.1816554},{"request_id":"1305906:11:2008110:1172","session_id":"1305906","input_length":66506,"t_proxy_recv":389345.799315554,"t_decision_unix":1779820210.8132565,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9238264216762397,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":5066,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":61440,"new_prefill":5066,"score_linear":-61440.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2398,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":389347.770642211,"t_first_token_unix":1779820212.7845857,"t_done":389350.110158393,"t_done_unix":1779820215.124102},{"request_id":"1340290:48:2010180:1174","session_id":"1340290","input_length":61080,"t_proxy_recv":389352.666715411,"t_decision_unix":1779820217.6806564,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9975114603798297,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":33944,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":60056,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2401,"cache_hit":60928,"new_prefill":152,"score_linear":-60928.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":389352.811666135,"t_first_token_unix":1779820217.8256097,"t_done":389353.827695936,"t_done_unix":1779820218.8416398},{"request_id":"1340290:48:2012871:1175","session_id":"1340290","input_length":61365,"t_proxy_recv":389361.347281602,"t_decision_unix":1779820226.3612227,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9928786767701459,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":34229,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":60341,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2401,"cache_hit":60928,"new_prefill":437,"score_linear":-60928.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":389361.54975308,"t_first_token_unix":1779820226.5636969,"t_done":389362.071557534,"t_done_unix":1779820227.0855012},{"request_id":"1340290:48:2014153:1176","session_id":"1340290","input_length":61518,"t_proxy_recv":389365.743903614,"t_decision_unix":1779820230.7578447,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9904093110959394,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":590,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":34382,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":60494,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2401,"cache_hit":60928,"new_prefill":590,"score_linear":-60928.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":389365.874104596,"t_first_token_unix":1779820230.8880477,"t_done":389366.370318948,"t_done_unix":1779820231.3842623},{"request_id":"1340290:48:2015982:1177","session_id":"1340290","input_length":69113,"t_proxy_recv":389371.844583215,"t_decision_unix":1779820236.8585243,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":61440,"affinity_cache_ratio":0.8889789185826111,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":7673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":41977,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":68089,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2402,"cache_hit":61440,"new_prefill":7673,"score_linear":-61440.0,"score_lmetric":0}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":389375.063828162,"t_first_token_unix":1779820240.0777721,"t_done":389377.492148714,"t_done_unix":1779820242.5060952},{"request_id":"1340290:48:2018973:1178","session_id":"1340290","input_length":69426,"t_proxy_recv":389381.626582903,"t_decision_unix":1779820246.6405234,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9955924293492352,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":306,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":42290,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":68402,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":69120,"new_prefill":306,"score_linear":-69120.0,"score_lmetric":0}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":389381.744541334,"t_first_token_unix":1779820246.758485,"t_done":389382.331951152,"t_done_unix":1779820247.345895},{"request_id":"1340290:48:2020779:1179","session_id":"1340290","input_length":69601,"t_proxy_recv":389387.683390777,"t_decision_unix":1779820252.697332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9930891797531645,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":481,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":42465,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":68577,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2417,"cache_hit":69120,"new_prefill":481,"score_linear":-69120.0,"score_lmetric":0}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":389387.866109572,"t_first_token_unix":1779820252.8800533,"t_done":389388.436583004,"t_done_unix":1779820253.4505265},{"request_id":"1340290:48:2023753:1180","session_id":"1340290","input_length":69951,"t_proxy_recv":389397.307428361,"t_decision_unix":1779820262.3213696,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":69632,"affinity_cache_ratio":0.9954396649082929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":319,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":42815,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":68927,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":69632,"new_prefill":319,"score_linear":-69632.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":389397.541938419,"t_first_token_unix":1779820262.5558817,"t_done":389398.430316083,"t_done_unix":1779820263.44426},{"request_id":"1340290:48:2026751:1181","session_id":"1340290","input_length":70342,"t_proxy_recv":389407.580966556,"t_decision_unix":1779820272.5949068,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":69632,"affinity_cache_ratio":0.989906457024253,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":43206,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":69318,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2418,"cache_hit":69632,"new_prefill":710,"score_linear":-69632.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":389407.818436385,"t_first_token_unix":1779820272.8323798,"t_done":389408.343702845,"t_done_unix":1779820273.3576467},{"request_id":"1340290:48:2028652:1182","session_id":"1340290","input_length":70503,"t_proxy_recv":389413.832137798,"t_decision_unix":1779820278.8460789,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9949080180985206,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":359,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":43367,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":69479,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":70144,"new_prefill":359,"score_linear":-70144.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":389414.01477662,"t_first_token_unix":1779820279.0287201,"t_done":389414.911883687,"t_done_unix":1779820279.9258277},{"request_id":"1340290:48:2033065:1183","session_id":"1340290","input_length":70851,"t_proxy_recv":389428.557527607,"t_decision_unix":1779820293.5714686,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9900213123315126,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":707,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":43715,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":69827,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2419,"cache_hit":70144,"new_prefill":707,"score_linear":-70144.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":389428.792817677,"t_first_token_unix":1779820293.8067615,"t_done":389429.435552624,"t_done_unix":1779820294.449496},{"request_id":"1340290:48:2034908:1184","session_id":"1340290","input_length":71067,"t_proxy_recv":389434.780019346,"t_decision_unix":1779820299.7939603,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":70656,"affinity_cache_ratio":0.9942167250622652,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70656,"estimated_new_tokens":411,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":43931,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":70043,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":70656,"new_prefill":411,"score_linear":-70656.0,"score_lmetric":0}],"chosen_score_linear":-70656.0,"chosen_score_lmetric":0,"t_first_token":389434.947902339,"t_first_token_unix":1779820299.9618454,"t_done":389435.463530721,"t_done_unix":1779820300.4774742},{"request_id":"1258908:2:2035438:1185","session_id":"1258908","input_length":7844,"t_proxy_recv":389436.589924657,"t_decision_unix":1779820301.6038659,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.9790922998470168,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":7680,"new_prefill":164,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":389436.624868941,"t_first_token_unix":1779820301.638812,"t_done":389437.64263624,"t_done_unix":1779820302.6565797},{"request_id":"1258908:3:1388683:699","session_id":"1258908","input_length":9120,"t_proxy_recv":389437.646458146,"t_decision_unix":1779820302.6604,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.8421052631578947,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":1440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2359,"cache_hit":7680,"new_prefill":1440,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":389437.7944391,"t_first_token_unix":1779820302.8083825,"t_done":389438.465769667,"t_done_unix":1779820303.479713},{"request_id":"1340290:48:2036994:1186","session_id":"1340290","input_length":71240,"t_proxy_recv":389441.723242857,"t_decision_unix":1779820306.737184,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":70656,"affinity_cache_ratio":0.9918023582257159,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70656,"estimated_new_tokens":584,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":44104,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":70216,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2420,"cache_hit":70656,"new_prefill":584,"score_linear":-70656.0,"score_lmetric":0}],"chosen_score_linear":-70656.0,"chosen_score_lmetric":0,"t_first_token":389441.908456395,"t_first_token_unix":1779820306.9223998,"t_done":389442.627639675,"t_done_unix":1779820307.6415832},{"request_id":"1340290:48:2040473:1187","session_id":"1340290","input_length":71545,"t_proxy_recv":389453.24330027,"t_decision_unix":1779820318.2572415,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9947305891397022,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":44409,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":70521,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":71168,"new_prefill":377,"score_linear":-71168.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":389453.479506526,"t_first_token_unix":1779820318.4934502,"t_done":389454.619839092,"t_done_unix":1779820319.6337826},{"request_id":"1340290:48:2043771:1188","session_id":"1340290","input_length":71867,"t_proxy_recv":389464.269304169,"t_decision_unix":1779820329.2832453,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9902737000292207,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":699,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":44731,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":70843,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2421,"cache_hit":71168,"new_prefill":699,"score_linear":-71168.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":389464.506849218,"t_first_token_unix":1779820329.5207932,"t_done":389465.080576659,"t_done_unix":1779820330.0945199},{"request_id":"1340290:48:2045403:1189","session_id":"1340290","input_length":72025,"t_proxy_recv":389469.780044572,"t_decision_unix":1779820334.7939858,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":71680,"affinity_cache_ratio":0.995209996528983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":345,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":44889,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":71001,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2422,"cache_hit":71680,"new_prefill":345,"score_linear":-71680.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":389469.92420008,"t_first_token_unix":1779820334.9381437,"t_done":389470.608943206,"t_done_unix":1779820335.622887},{"request_id":"1340290:48:2047167:1190","session_id":"1340290","input_length":72211,"t_proxy_recv":389475.544836324,"t_decision_unix":1779820340.5587773,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9926465496946448,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":45075,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":71187,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2422,"cache_hit":71680,"new_prefill":531,"score_linear":-71680.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":389475.733177912,"t_first_token_unix":1779820340.7471213,"t_done":389476.283207676,"t_done_unix":1779820341.2971516},{"request_id":"1340290:48:2048793:1191","session_id":"1340290","input_length":72777,"t_proxy_recv":389480.978181177,"t_decision_unix":1779820345.9921224,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9919617461560658,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":585,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":45641,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":71753,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2423,"cache_hit":72192,"new_prefill":585,"score_linear":-72192.0,"score_lmetric":0}],"chosen_score_linear":-72192.0,"chosen_score_lmetric":0,"t_first_token":389481.355532409,"t_first_token_unix":1779820346.3694758,"t_done":389481.878094823,"t_done_unix":1779820346.892038},{"request_id":"1340290:48:2050838:1192","session_id":"1340290","input_length":72952,"t_proxy_recv":389488.200299029,"t_decision_unix":1779820353.21424,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9966005044412765,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":248,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":45816,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":71928,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":72704,"new_prefill":248,"score_linear":-72704.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":389488.395053021,"t_first_token_unix":1779820353.4089966,"t_done":389488.753168006,"t_done_unix":1779820353.7671115},{"request_id":"1340290:48:2052523:1193","session_id":"1340290","input_length":73208,"t_proxy_recv":389493.767414849,"t_decision_unix":1779820358.7813559,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9931155065020216,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":46072,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":72184,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2424,"cache_hit":72704,"new_prefill":504,"score_linear":-72704.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":389494.003647905,"t_first_token_unix":1779820359.0175915,"t_done":389494.786078777,"t_done_unix":1779820359.8000226},{"request_id":"1340290:48:2055365:1194","session_id":"1340290","input_length":73454,"t_proxy_recv":389503.481748694,"t_decision_unix":1779820368.4956894,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9967598769297792,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":238,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":46318,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":72430,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":73216,"new_prefill":238,"score_linear":-73216.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":389503.716790161,"t_first_token_unix":1779820368.7307336,"t_done":389504.140316591,"t_done_unix":1779820369.1542597},{"request_id":"1340290:48:2057042:1195","session_id":"1340290","input_length":73636,"t_proxy_recv":389508.856780857,"t_decision_unix":1779820373.870722,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9942962681297192,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":46500,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":72612,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":73216,"new_prefill":420,"score_linear":-73216.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":389509.026825074,"t_first_token_unix":1779820374.0407686,"t_done":389509.298406097,"t_done_unix":1779820374.312349},{"request_id":"1340290:48:2058614:1196","session_id":"1340290","input_length":73653,"t_proxy_recv":389513.995200323,"t_decision_unix":1779820379.0091412,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9940667725686666,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":46517,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":72629,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2425,"cache_hit":73216,"new_prefill":437,"score_linear":-73216.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":389514.095489118,"t_first_token_unix":1779820379.1094334,"t_done":389515.841583305,"t_done_unix":1779820380.855527},{"request_id":"1340290:48:2061834:1197","session_id":"1340290","input_length":73858,"t_proxy_recv":389524.145679581,"t_decision_unix":1779820389.1596203,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9982398656882125,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":130,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":46722,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":72834,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":73728,"new_prefill":130,"score_linear":-73728.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":389524.263624522,"t_first_token_unix":1779820389.2775676,"t_done":389524.812846114,"t_done_unix":1779820389.8267894},{"request_id":"1258908:3:2063441:1198","session_id":"1258908","input_length":9359,"t_proxy_recv":389529.184594617,"t_decision_unix":1779820394.1985357,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9847205898066033,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":9216,"new_prefill":143,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":389529.245752189,"t_first_token_unix":1779820394.2596955,"t_done":389530.312672964,"t_done_unix":1779820395.3266163},{"request_id":"1340290:48:2063837:1199","session_id":"1340290","input_length":74011,"t_proxy_recv":389530.539481643,"t_decision_unix":1779820395.553423,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9961762440718271,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":46875,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9740,"ongoing_decode_tokens":9740,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":0,"new_prefill":74011,"score_linear":9740.0,"score_lmetric":74011},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":72987,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":73728,"new_prefill":283,"score_linear":-73728.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":389530.689941512,"t_first_token_unix":1779820395.7038853,"t_done":389531.265450032,"t_done_unix":1779820396.2793934},{"request_id":"1258908:4:1553508:958","session_id":"1258908","input_length":9740,"t_proxy_recv":389530.31666786,"t_decision_unix":1779820395.3306093,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9462012320328542,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":524,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2362,"cache_hit":9216,"new_prefill":524,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":389530.378940203,"t_first_token_unix":1779820395.3928838,"t_done":389532.274848861,"t_done_unix":1779820397.2887921},{"request_id":"1258908:5:1617181:988","session_id":"1258908","input_length":10201,"t_proxy_recv":389532.27906787,"t_decision_unix":1779820397.2930095,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9536319968630527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":473,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2363,"cache_hit":9728,"new_prefill":473,"score_linear":-9728.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":389532.332623161,"t_first_token_unix":1779820397.346567,"t_done":389534.383044699,"t_done_unix":1779820399.396988},{"request_id":"1340290:48:2066647:1200","session_id":"1340290","input_length":74557,"t_proxy_recv":389539.977322662,"t_decision_unix":1779820404.9912636,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9888809903831968,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":829,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":47421,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":73533,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2426,"cache_hit":73728,"new_prefill":829,"score_linear":-73728.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":389540.362721587,"t_first_token_unix":1779820405.3766654,"t_done":389541.598547876,"t_done_unix":1779820406.6124918},{"request_id":"1340290:48:2071598:1201","session_id":"1340290","input_length":74863,"t_proxy_recv":389556.634359393,"t_decision_unix":1779820421.6483006,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":74240,"affinity_cache_ratio":0.991678132054553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74240,"estimated_new_tokens":623,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":47727,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":73839,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2427,"cache_hit":74240,"new_prefill":623,"score_linear":-74240.0,"score_lmetric":0}],"chosen_score_linear":-74240.0,"chosen_score_lmetric":0,"t_first_token":389556.873572865,"t_first_token_unix":1779820421.8875163,"t_done":389557.684277603,"t_done_unix":1779820422.6982212},{"request_id":"1340290:48:2076822:1202","session_id":"1340290","input_length":75113,"t_proxy_recv":389574.150432619,"t_decision_unix":1779820439.1643739,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9951939078455128,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":361,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":47977,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":74089,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2428,"cache_hit":74752,"new_prefill":361,"score_linear":-74752.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":389574.391855984,"t_first_token_unix":1779820439.4057992,"t_done":389574.829925218,"t_done_unix":1779820439.843869},{"request_id":"1340290:48:2078461:1203","session_id":"1340290","input_length":75299,"t_proxy_recv":389579.439470002,"t_decision_unix":1779820444.453411,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9927356272991673,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":547,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":48163,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":74275,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2428,"cache_hit":74752,"new_prefill":547,"score_linear":-74752.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":389579.677985561,"t_first_token_unix":1779820444.6919289,"t_done":389579.961996644,"t_done_unix":1779820444.97594},{"request_id":"1340290:48:2080016:1204","session_id":"1340290","input_length":75338,"t_proxy_recv":389584.728362378,"t_decision_unix":1779820449.7423031,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9990177599617723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":74,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":48202,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":74314,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2429,"cache_hit":75264,"new_prefill":74,"score_linear":-75264.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":389584.834454427,"t_first_token_unix":1779820449.848398,"t_done":389585.209130077,"t_done_unix":1779820450.2230737},{"request_id":"1356885:16:2084239:1207","session_id":"1356885","input_length":136991,"t_proxy_recv":389598.501274963,"t_decision_unix":1779820463.515216,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":136704,"affinity_cache_ratio":0.9979049718594653,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":136704,"estimated_new_tokens":287,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":136704,"new_prefill":287,"score_linear":-136704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":190410,"ongoing_decode_tokens":0,"pending_prefill_tokens":61386,"num_requests":2,"active_p_offloads":0,"cached_blocks":2429,"cache_hit":0,"new_prefill":136991,"score_linear":190410.0,"score_lmetric":396754}],"chosen_score_linear":-136704.0,"chosen_score_lmetric":0,"t_first_token":389598.916716449,"t_first_token_unix":1779820463.9306598,"t_done":389601.733401465,"t_done_unix":1779820466.7473452},{"request_id":"1382086:2:2082052:1205","session_id":"1382086","input_length":114971,"t_proxy_recv":389591.391599285,"t_decision_unix":1779820456.4055407,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":53760,"affinity_cache_ratio":0.467596176427099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":61211,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2429,"cache_hit":53760,"new_prefill":61211,"score_linear":-53760.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":389634.031866925,"t_first_token_unix":1779820499.0458105,"t_done":389635.698432957,"t_done_unix":1779820500.7123766},{"request_id":"1340290:48:2082644:1206","session_id":"1340290","input_length":75439,"t_proxy_recv":389593.4060316,"t_decision_unix":1779820458.419973,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9976802449661316,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":48303,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2364,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":74415,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":2429,"cache_hit":75264,"new_prefill":175,"score_linear":39707.0,"score_lmetric":61386}],"chosen_score_linear":39707.0,"chosen_score_lmetric":61386,"t_first_token":389634.03493978,"t_first_token_unix":1779820499.048883,"t_done":389635.729753059,"t_done_unix":1779820500.7436965},{"request_id":"1382086:3:2089879:1210","session_id":"1382086","input_length":115184,"t_proxy_recv":389635.717587537,"t_decision_unix":1779820500.731529,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":114688,"affinity_cache_ratio":0.9956938463675511,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":114688,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":75439,"ongoing_decode_tokens":75439,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2548,"cache_hit":114688,"new_prefill":496,"score_linear":-39249.0,"score_lmetric":496}],"chosen_score_linear":-39249.0,"chosen_score_lmetric":496,"t_first_token":389636.106114467,"t_first_token_unix":1779820501.120058,"t_done":389637.665814293,"t_done_unix":1779820502.6797585},{"request_id":"1340290:48:2085626:1208","session_id":"1340290","input_length":77337,"t_proxy_recv":389635.744256003,"t_decision_unix":1779820500.7581975,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9731952364327553,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":2073,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":50201,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":76313,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":115184,"ongoing_decode_tokens":0,"pending_prefill_tokens":496,"num_requests":1,"active_p_offloads":0,"cached_blocks":2548,"cache_hit":75264,"new_prefill":2073,"score_linear":39920.0,"score_lmetric":2569}],"chosen_score_linear":39920.0,"chosen_score_lmetric":2569,"t_first_token":389636.939367457,"t_first_token_unix":1779820501.953311,"t_done":389637.913820232,"t_done_unix":1779820502.9277637},{"request_id":"1340290:48:2087584:1209","session_id":"1340290","input_length":78683,"t_proxy_recv":389637.935242728,"t_decision_unix":1779820502.949184,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":77312,"affinity_cache_ratio":0.9825756516655441,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77312,"estimated_new_tokens":1371,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":51547,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":77659,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":115246,"ongoing_decode_tokens":115246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2553,"cache_hit":77312,"new_prefill":1371,"score_linear":37934.0,"score_lmetric":1371}],"chosen_score_linear":37934.0,"chosen_score_lmetric":1371,"t_first_token":389638.77387292,"t_first_token_unix":1779820503.7878168,"t_done":389641.297653988,"t_done_unix":1779820506.3115976},{"request_id":"1340290:48:2092759:1211","session_id":"1340290","input_length":79023,"t_proxy_recv":389641.312555335,"t_decision_unix":1779820506.326497,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9913063285372613,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":687,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":27136,"new_prefill":51887,"score_linear":-27136.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":137546,"ongoing_decode_tokens":0,"pending_prefill_tokens":330,"num_requests":1,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":79023,"score_linear":137546.0,"score_lmetric":79353},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":1024,"new_prefill":77999,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":115246,"ongoing_decode_tokens":115246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2555,"cache_hit":78336,"new_prefill":687,"score_linear":36910.0,"score_lmetric":687}],"chosen_score_linear":36910.0,"chosen_score_lmetric":687,"t_first_token":389641.564828586,"t_first_token_unix":1779820506.578772,"t_done":389643.798048071,"t_done_unix":1779820508.8119917},{"request_id":"1356885:17:2097011:1213","session_id":"1356885","input_length":137546,"t_proxy_recv":389641.215504376,"t_decision_unix":1779820506.229446,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":137216,"affinity_cache_ratio":0.9976008026405712,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":137216,"estimated_new_tokens":330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":137216,"new_prefill":330,"score_linear":-137216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":193929,"ongoing_decode_tokens":193929,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2553,"cache_hit":0,"new_prefill":137546,"score_linear":193929.0,"score_lmetric":275092}],"chosen_score_linear":-137216.0,"chosen_score_lmetric":0,"t_first_token":389641.87419333,"t_first_token_unix":1779820506.8881366,"t_done":389644.540515201,"t_done_unix":1779820509.5544589},{"request_id":"1382086:4:2092953:1212","session_id":"1382086","input_length":115246,"t_proxy_recv":389637.685234623,"t_decision_unix":1779820502.6991758,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":115200,"affinity_cache_ratio":0.9996008538257293,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":115200,"estimated_new_tokens":46,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2365,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77337,"ongoing_decode_tokens":77337,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2549,"cache_hit":115200,"new_prefill":46,"score_linear":-37863.0,"score_lmetric":46}],"chosen_score_linear":-37863.0,"chosen_score_lmetric":46,"t_first_token":389637.85048806,"t_first_token_unix":1779820502.8644319,"t_done":389647.187213252,"t_done_unix":1779820512.2011569}] \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/metrics.jsonl b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/metrics.jsonl new file mode 100644 index 0000000..80bfaa7 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/metrics.jsonl @@ -0,0 +1,1214 @@ +{"actual_output_tokens": 21, "cached_tokens": 0, "effective_input_length": 8228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8228, "latency_s": 0.9853806210448965, "output_length": 21, "proxy_request_id": "1237198:1:1237198:0", "request_id": "1237198:1:1237198:0", "request_type": "coder", "requested_output_tokens": 21, "session_id": "1237198", "t_dispatch_unix": 1779817593.7743533, "t_finish_unix": 1779817594.7597337, "t_first_token_unix": 1779817594.6651714, "tpot_s": 0.004710916249314323, "trace_hash_ids": [12292995, 12292996, 12292997, 12304212, 12304213, 12304214, 12304215, 12304216, 12304217, 12311566, 12311567, 12311568, 12311569, 12311570, 12318563, 12318564, 12318565], "trace_timestamp_s": 0.0, "ttft_s": 0.8908147860202007, "turn_id": 1} +{"actual_output_tokens": 78, "cached_tokens": 0, "effective_input_length": 3976, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3976, "latency_s": 0.9245377740007825, "output_length": 78, "proxy_request_id": "1237337:1:1237337:1", "request_id": "1237337:1:1237337:1", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1237337", "t_dispatch_unix": 1779817594.197403, "t_finish_unix": 1779817595.1219409, "t_first_token_unix": 1779817594.6839864, "tpot_s": 0.005683841714454065, "trace_hash_ids": [12309322, 12309323, 12309324, 12319949, 12319950, 12319951, 12319952, 12319953], "trace_timestamp_s": 0.4420000000000073, "ttft_s": 0.4865812640055083, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 8240, "effective_input_length": 10237, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10237, "latency_s": 0.4240027269697748, "output_length": 27, "proxy_request_id": "1237198:2:1237773:2", "request_id": "1237198:2:1237773:2", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1237198", "t_dispatch_unix": 1779817595.7441797, "t_finish_unix": 1779817596.1681824, "t_first_token_unix": 1779817596.033711, "tpot_s": 0.0051611146549336035, "trace_hash_ids": [12292995, 12292996, 12292997, 12304212, 12304213, 12304214, 12304215, 12304216, 12304217, 12311566, 12311567, 12311568, 12311569, 12311570, 12318563, 12318564, 12323845, 12323846, 12323847, 12323848], "trace_timestamp_s": 1.9920000000001892, "ttft_s": 0.2895290679880418, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 749, "latency_s": 0.2432598840096034, "output_length": 27, "proxy_request_id": "1237877:1:1237877:3", "request_id": "1237877:1:1237877:3", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1237877", "t_dispatch_unix": 1779817596.2031703, "t_finish_unix": 1779817596.4464302, "t_first_token_unix": 1779817596.3204064, "tpot_s": 0.004837240038726192, "trace_hash_ids": [12325182, 12325183], "trace_timestamp_s": 2.4520000000002256, "ttft_s": 0.11723483499372378, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 13489, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13489, "latency_s": 1.942791637033224, "output_length": 83, "proxy_request_id": "1239034:1:1239034:4", "request_id": "1239034:1:1239034:4", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1239034", "t_dispatch_unix": 1779817599.9831197, "t_finish_unix": 1779817601.925911, "t_first_token_unix": 1779817601.4829614, "tpot_s": 0.0053987589142308005, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12336730], "trace_timestamp_s": 6.222000000000662, "ttft_s": 1.4998398090247065, "turn_id": 1} +{"actual_output_tokens": 91, "cached_tokens": 768, "effective_input_length": 1620, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1620, "latency_s": 0.5252079489873722, "output_length": 91, "proxy_request_id": "1237877:2:1239577:6", "request_id": "1237877:2:1239577:6", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1237877", "t_dispatch_unix": 1779817601.864052, "t_finish_unix": 1779817602.3892598, "t_first_token_unix": 1779817601.9457746, "tpot_s": 0.004924765899906763, "trace_hash_ids": [12325182, 12342035, 12342036, 12342037], "trace_timestamp_s": 8.113000000000284, "ttft_s": 0.08172149199526757, "turn_id": 2} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 5194, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5194, "latency_s": 0.886762484034989, "output_length": 54, "proxy_request_id": "1239704:1:1239704:7", "request_id": "1239704:1:1239704:7", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1239704", "t_dispatch_unix": 1779817602.3074462, "t_finish_unix": 1779817603.194209, "t_first_token_unix": 1779817602.9273632, "tpot_s": 0.005028955000320906, "trace_hash_ids": [12325298, 12325299, 12325300, 12325301, 12325302, 12325303, 12325304, 12335875, 12343073, 12343074, 12343075], "trace_timestamp_s": 8.554000000000087, "ttft_s": 0.6199149719905108, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 7429, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7429, "latency_s": 0.7157323929714039, "output_length": 35, "proxy_request_id": "1240924:1:1240924:11", "request_id": "1240924:1:1240924:11", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1240924", "t_dispatch_unix": 1779817606.3280177, "t_finish_unix": 1779817607.04375, "t_first_token_unix": 1779817606.8727136, "tpot_s": 0.005021010354325613, "trace_hash_ids": [12342008, 12342009, 12342010, 12342011, 12342012, 12342013, 12342014, 12342015, 12342016, 12342017, 12342018, 12342019, 12354472, 12354473, 12354474], "trace_timestamp_s": 12.574000000000524, "ttft_s": 0.5446944079594687, "turn_id": 1} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 37165, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37165, "latency_s": 7.247455379983876, "output_length": 183, "proxy_request_id": "1239100:1:1239100:5", "request_id": "1239100:1:1239100:5", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1239100", "t_dispatch_unix": 1779817600.2175133, "t_finish_unix": 1779817607.4649682, "t_first_token_unix": 1779817606.2305186, "tpot_s": 0.006780972032984309, "trace_hash_ids": [44767, 44768, 44769, 44770, 44771, 44772, 44773, 127444, 75740, 127445, 127446, 127447, 127448, 127449, 127450, 127451, 127452, 127453, 127454, 127455, 127456, 127457, 127458, 127459, 127460, 127461, 127462, 127463, 127464, 127465, 127466, 127467, 127468, 127469, 8983871, 8983872, 8983873, 8983874, 12337377, 12337378, 12337379, 12337380, 12337381, 12337382, 12337383, 12337384, 12337385, 12337386, 12337386, 12337387, 1738555, 1738555, 12337388, 12337389, 12337390, 12337391, 12337392, 12337393, 12337394, 12337395, 12337396, 12337397, 12337398, 12337399, 12337400, 12337401, 12337402, 12337403, 12337404, 12337405, 12337406, 12337407, 12337408], "trace_timestamp_s": 6.451000000000022, "ttft_s": 6.013003134983592, "turn_id": 1} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 30040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30040, "latency_s": 4.5770310669904575, "output_length": 101, "proxy_request_id": "1240198:1:1240198:9", "request_id": "1240198:1:1240198:9", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1240198", "t_dispatch_unix": 1779817603.836178, "t_finish_unix": 1779817608.4132087, "t_first_token_unix": 1779817607.7782488, "tpot_s": 0.006346539920195937, "trace_hash_ids": [156827, 156828, 156829, 156830, 156831, 156832, 156833, 156834, 156835, 156836, 156837, 5767151, 5767152, 5767153, 5767154, 5767155, 5767156, 5767157, 5767158, 5767159, 5767160, 5767161, 5767162, 5767163, 5767164, 5767165, 5767166, 5767167, 5767168, 5767169, 5767170, 5767171, 8388251, 8388252, 8388253, 8388254, 8388255, 8388256, 8388257, 8388258, 8388259, 8388260, 8388261, 8388262, 8388263, 8388264, 8388265, 8388266, 8388267, 8388268, 8388269, 8388270, 8388271, 8388272, 12328522, 12348124, 12348125, 12348126, 12328526], "trace_timestamp_s": 10.07300000000032, "ttft_s": 3.942068564996589, "turn_id": 1} +{"actual_output_tokens": 105, "cached_tokens": 0, "effective_input_length": 1093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1093, "latency_s": 0.6283946000039577, "output_length": 105, "proxy_request_id": "1241953:1:1241953:13", "request_id": "1241953:1:1241953:13", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1241953", "t_dispatch_unix": 1779817609.7449143, "t_finish_unix": 1779817610.3733084, "t_first_token_unix": 1779817609.8613904, "tpot_s": 0.0049196143747674516, "trace_hash_ids": [12364240, 12364241, 12364242], "trace_timestamp_s": 15.994000000000597, "ttft_s": 0.11647492501651868, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 7587, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7587, "latency_s": 0.7224984409986064, "output_length": 38, "proxy_request_id": "1241942:1:1241942:12", "request_id": "1241942:1:1241942:12", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1241942", "t_dispatch_unix": 1779817609.6984932, "t_finish_unix": 1779817610.4209914, "t_first_token_unix": 1779817610.234165, "tpot_s": 0.005042151837433512, "trace_hash_ids": [12364172, 12364173, 12364174, 12364175, 12364176, 12364177, 12364178, 12364179, 12364180, 12364181, 12364182, 12364183, 12364184, 12364185, 12364186], "trace_timestamp_s": 15.945000000000618, "ttft_s": 0.535670192039106, "turn_id": 1} +{"actual_output_tokens": 14, "cached_tokens": 1696, "effective_input_length": 2659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2659, "latency_s": 0.15908574097556993, "output_length": 14, "proxy_request_id": "1237877:3:1242953:15", "request_id": "1237877:3:1242953:15", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1237877", "t_dispatch_unix": 1779817613.130076, "t_finish_unix": 1779817613.2891612, "t_first_token_unix": 1779817613.2260609, "tpot_s": 0.0048325557682591565, "trace_hash_ids": [12325182, 12342035, 12342036, 12357464, 12373319, 12373320], "trace_timestamp_s": 19.379000000000815, "ttft_s": 0.09598387399455532, "turn_id": 3} +{"actual_output_tokens": 155, "cached_tokens": 0, "effective_input_length": 17157, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17157, "latency_s": 2.6012668990297243, "output_length": 155, "proxy_request_id": "1242838:1:1242838:14", "request_id": "1242838:1:1242838:14", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1242838", "t_dispatch_unix": 1779817612.7505577, "t_finish_unix": 1779817615.3518245, "t_first_token_unix": 1779817614.4623747, "tpot_s": 0.00577376367540897, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275], "trace_timestamp_s": 18.993000000000393, "ttft_s": 1.711815482005477, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 5232, "effective_input_length": 14812, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14812, "latency_s": 1.228052998019848, "output_length": 23, "proxy_request_id": "1239704:2:1243943:17", "request_id": "1239704:2:1243943:17", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1239704", "t_dispatch_unix": 1779817616.4088128, "t_finish_unix": 1779817617.636866, "t_first_token_unix": 1779817617.5252132, "tpot_s": 0.005058738180774857, "trace_hash_ids": [12325298, 12325299, 12325300, 12325301, 12325302, 12325303, 12325304, 12335875, 12343073, 12343074, 12353398, 12353399, 12353400, 12353401, 12353402, 12362248, 12362249, 12362250, 12362251, 12362252, 12362253, 12374360, 12374361, 12374362, 12374363, 12374364, 12382332, 12382333, 12382334], "trace_timestamp_s": 22.65400000000045, "ttft_s": 1.116398181009572, "turn_id": 2} +{"actual_output_tokens": 264, "cached_tokens": 0, "effective_input_length": 11074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11074, "latency_s": 2.3799974209978245, "output_length": 264, "proxy_request_id": "1243831:1:1243831:16", "request_id": "1243831:1:1243831:16", "request_type": "coder", "requested_output_tokens": 264, "session_id": "1243831", "t_dispatch_unix": 1779817616.0074916, "t_finish_unix": 1779817618.3874886, "t_first_token_unix": 1779817616.9457982, "tpot_s": 0.0054806462509430125, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12381653], "trace_timestamp_s": 22.252000000000407, "ttft_s": 0.9383049099706113, "turn_id": 1} +{"actual_output_tokens": 2204, "cached_tokens": 13568, "effective_input_length": 18420, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18420, "latency_s": 13.922403485979885, "output_length": 2204, "proxy_request_id": "1239034:2:1240558:10", "request_id": "1239034:2:1240558:10", "request_type": "coder", "requested_output_tokens": 2204, "session_id": "1239034", "t_dispatch_unix": 1779817605.0756202, "t_finish_unix": 1779817618.9980233, "t_first_token_unix": 1779817605.7851756, "tpot_s": 0.0059975472705502565, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445], "trace_timestamp_s": 11.321000000000822, "ttft_s": 0.7095526699558832, "turn_id": 2} +{"actual_output_tokens": 86, "cached_tokens": 0, "effective_input_length": 66214, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66214, "latency_s": 16.505676631990355, "output_length": 86, "proxy_request_id": "1239755:1:1239755:8", "request_id": "1239755:1:1239755:8", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1239755", "t_dispatch_unix": 1779817602.5082822, "t_finish_unix": 1779817619.0139587, "t_first_token_unix": 1779817618.351321, "tpot_s": 0.007792781000299489, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12343455, 6866241, 2853774, 6866242, 7163, 7164, 7165, 7166, 7167, 7168, 7169, 7170, 7171, 7172, 7173, 7174, 7175, 7176, 7177, 7178, 7179, 7180, 7181, 7182, 7183, 7184, 6866243, 6866244, 6866245, 6866246, 6866247, 6866248, 6866249, 6866250, 6866251, 6866252, 6866253, 6866254, 6866255, 6866256, 6866257, 8545375, 8556763, 8697639, 8697640, 8697641, 8697642, 8697643, 8697644, 8801955, 9096778, 9096779, 9096780, 9096781, 9096782, 9096783, 9096784, 9096785, 9096786, 9149397, 9149398, 9362937, 9625264, 9969708, 9969709, 9969710, 9969711, 9969712, 10041460, 11312552, 11312553, 11312554, 11312555, 11312556, 11738834, 11738835, 11738836, 11738837, 11817307, 11870242, 11870243, 12068422, 12068423, 12068424, 12068425, 12068426, 12068427, 12068428, 12068429, 12180426, 12180427, 12343456, 12343457], "trace_timestamp_s": 8.731000000000677, "ttft_s": 15.84303611901123, "turn_id": 1} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 8274, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8274, "latency_s": 0.7971407910226844, "output_length": 40, "proxy_request_id": "1244640:1:1244640:18", "request_id": "1244640:1:1244640:18", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1244640", "t_dispatch_unix": 1779817618.9030218, "t_finish_unix": 1779817619.700163, "t_first_token_unix": 1779817619.50045, "tpot_s": 0.005113250461036865, "trace_hash_ids": [12346349, 12346350, 12346351, 12346352, 12346353, 12346354, 12346355, 12353250, 12363902, 12363903, 12363904, 12370522, 12389149, 12389150, 12389151, 12389152, 12389153], "trace_timestamp_s": 25.149000000000342, "ttft_s": 0.5974257260095328, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 0, "effective_input_length": 6109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6109, "latency_s": 0.9668569469940849, "output_length": 49, "proxy_request_id": "1245572:1:1245572:19", "request_id": "1245572:1:1245572:19", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1245572", "t_dispatch_unix": 1779817622.0365634, "t_finish_unix": 1779817623.00342, "t_first_token_unix": 1779817622.7664578, "tpot_s": 0.004930900290977054, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667], "trace_timestamp_s": 28.282000000000153, "ttft_s": 0.7298930590040982, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 1184, "effective_input_length": 10382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10382, "latency_s": 0.9549249419942498, "output_length": 36, "proxy_request_id": "1241953:2:1245624:20", "request_id": "1241953:2:1245624:20", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1241953", "t_dispatch_unix": 1779817622.127804, "t_finish_unix": 1779817623.082729, "t_first_token_unix": 1779817622.9022236, "tpot_s": 0.005148842085951141, "trace_hash_ids": [12364240, 12364241, 12380769, 12380770, 12380771, 12380772, 12380773, 12380774, 12380775, 12380776, 12380777, 12380778, 12398115, 12398116, 12398117, 12398118, 12398119, 12398120, 12398121, 12398122, 12398123], "trace_timestamp_s": 28.373000000000502, "ttft_s": 0.7744181249872781, "turn_id": 2} +{"actual_output_tokens": 36, "cached_tokens": 6144, "effective_input_length": 6182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6182, "latency_s": 0.20958376600174233, "output_length": 36, "proxy_request_id": "1245572:2:1246348:22", "request_id": "1245572:2:1246348:22", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1245572", "t_dispatch_unix": 1779817624.633062, "t_finish_unix": 1779817624.8426454, "t_first_token_unix": 1779817624.6676528, "tpot_s": 0.004991473972664348, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667, 12405800], "trace_timestamp_s": 30.882000000000517, "ttft_s": 0.034589405986480415, "turn_id": 2} +{"actual_output_tokens": 66, "cached_tokens": 7456, "effective_input_length": 17447, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17447, "latency_s": 1.582704188011121, "output_length": 66, "proxy_request_id": "1240924:2:1246244:21", "request_id": "1240924:2:1246244:21", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1240924", "t_dispatch_unix": 1779817624.2588253, "t_finish_unix": 1779817625.8415291, "t_first_token_unix": 1779817625.4812982, "tpot_s": 0.005537842984239642, "trace_hash_ids": [12342008, 12342009, 12342010, 12342011, 12342012, 12342013, 12342014, 12342015, 12342016, 12342017, 12342018, 12342019, 12354472, 12354473, 12365097, 12370962, 12370963, 12370964, 12370965, 12378987, 12378988, 12378989, 12378990, 12384895, 12384896, 12384897, 12384898, 12393889, 12393890, 12393891, 12404797, 12404798, 12404799, 12404800, 12404801], "trace_timestamp_s": 30.502000000000407, "ttft_s": 1.2224713420146145, "turn_id": 2} +{"actual_output_tokens": 35, "cached_tokens": 7616, "effective_input_length": 17975, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17975, "latency_s": 1.4764139039907604, "output_length": 35, "proxy_request_id": "1241942:2:1247111:23", "request_id": "1241942:2:1247111:23", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1241942", "t_dispatch_unix": 1779817627.3061104, "t_finish_unix": 1779817628.7825243, "t_first_token_unix": 1779817628.6050587, "tpot_s": 0.005210603999918984, "trace_hash_ids": [12364172, 12364173, 12364174, 12364175, 12364176, 12364177, 12364178, 12364179, 12364180, 12364181, 12364182, 12364183, 12364184, 12364185, 12370891, 12379261, 12379262, 12379263, 12379264, 12386129, 12386130, 12386131, 12386132, 12386133, 12391712, 12391713, 12391714, 12391715, 12398819, 12398820, 12398821, 12398822, 12412294, 12412295, 12412296, 12412297], "trace_timestamp_s": 33.54899999999998, "ttft_s": 1.298945549002383, "turn_id": 2} +{"actual_output_tokens": 11, "cached_tokens": 8304, "effective_input_length": 10696, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10696, "latency_s": 0.3730016189510934, "output_length": 11, "proxy_request_id": "1244640:2:1247941:24", "request_id": "1244640:2:1247941:24", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1244640", "t_dispatch_unix": 1779817630.1226633, "t_finish_unix": 1779817630.4956648, "t_first_token_unix": 1779817630.4523075, "tpot_s": 0.004307801398681477, "trace_hash_ids": [12421739, 12421740, 12421741, 12421742, 12421743, 12421744, 12421745, 12421746, 12421747, 12421748, 12421749, 12421750, 12421751, 12421752, 12421753, 12421754, 12421755, 12421756, 12421757, 12421758, 12421759], "trace_timestamp_s": 36.365999999999985, "ttft_s": 0.32964236196130514, "turn_id": 2} +{"actual_output_tokens": 49, "cached_tokens": 0, "effective_input_length": 11515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11515, "latency_s": 1.2427924649673514, "output_length": 49, "proxy_request_id": "1248768:1:1248768:25", "request_id": "1248768:1:1248768:25", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1248768", "t_dispatch_unix": 1779817632.9030888, "t_finish_unix": 1779817634.1458812, "t_first_token_unix": 1779817633.8913453, "tpot_s": 0.005297512687927035, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12429472], "trace_timestamp_s": 39.14500000000044, "ttft_s": 0.9882539379759692, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 4126, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4126, "latency_s": 0.4299769889912568, "output_length": 34, "proxy_request_id": "1249058:1:1249058:26", "request_id": "1249058:1:1249058:26", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1249058", "t_dispatch_unix": 1779817633.9232635, "t_finish_unix": 1779817634.3532405, "t_first_token_unix": 1779817634.1896124, "tpot_s": 0.004950868999444399, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12432334], "trace_timestamp_s": 40.17100000000028, "ttft_s": 0.26634706498589367, "turn_id": 1} +{"actual_output_tokens": 85, "cached_tokens": 11552, "effective_input_length": 12188, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12188, "latency_s": 0.6057004979811609, "output_length": 85, "proxy_request_id": "1248768:2:1249765:27", "request_id": "1248768:2:1249765:27", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1248768", "t_dispatch_unix": 1779817636.1862183, "t_finish_unix": 1779817636.7919185, "t_first_token_unix": 1779817636.3333328, "tpot_s": 0.005456417785137005, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396], "trace_timestamp_s": 42.43299999999999, "ttft_s": 0.14711302903015167, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 4144, "effective_input_length": 7482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7482, "latency_s": 0.45080248499289155, "output_length": 26, "proxy_request_id": "1249058:2:1249872:28", "request_id": "1249058:2:1249872:28", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1249058", "t_dispatch_unix": 1779817636.5778198, "t_finish_unix": 1779817637.0286222, "t_first_token_unix": 1779817636.9036894, "tpot_s": 0.004986247799824923, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12440459, 12440460, 12440461, 12440462, 12440463, 12440464, 12440465], "trace_timestamp_s": 42.82600000000002, "ttft_s": 0.32586809794884175, "turn_id": 2} +{"actual_output_tokens": 83, "cached_tokens": 17296, "effective_input_length": 21578, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21578, "latency_s": 1.2195179229602218, "output_length": 83, "proxy_request_id": "1242838:2:1250503:29", "request_id": "1242838:2:1250503:29", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1242838", "t_dispatch_unix": 1779817638.85237, "t_finish_unix": 1779817640.0718873, "t_first_token_unix": 1779817639.5888329, "tpot_s": 0.005887387597950448, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12446387], "trace_timestamp_s": 45.09700000000066, "ttft_s": 0.7364606859628111, "turn_id": 2} +{"actual_output_tokens": 297, "cached_tokens": 0, "effective_input_length": 6829, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6829, "latency_s": 2.5888931050430983, "output_length": 297, "proxy_request_id": "1250772:1:1250772:30", "request_id": "1250772:1:1250772:30", "request_type": "coder", "requested_output_tokens": 297, "session_id": "1250772", "t_dispatch_unix": 1779817639.7138793, "t_finish_unix": 1779817642.3027723, "t_first_token_unix": 1779817640.7380164, "tpot_s": 0.005285401989838008, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12449313], "trace_timestamp_s": 45.960000000000036, "ttft_s": 1.0241354970494285, "turn_id": 1} +{"actual_output_tokens": 1, "cached_tokens": 0, "effective_input_length": 16512, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16512, "latency_s": 1.5612959360005334, "output_length": 1, "proxy_request_id": "1251059:1:1251059:32", "request_id": "1251059:1:1251059:32", "request_type": "coder", "requested_output_tokens": 1, "session_id": "1251059", "t_dispatch_unix": 1779817640.8942297, "t_finish_unix": 1779817642.4555254, "t_first_token_unix": 1779817642.4550006, "tpot_s": 0.0, "trace_hash_ids": [7062, 7063, 7064, 7065, 7066, 7067, 7068, 7069, 7070, 7071, 7072, 7073, 7074, 7075, 7076, 7077, 7078, 7079, 7080, 7081, 7082, 7083, 7084, 7085, 490787, 490788, 490789, 585565, 585566, 8073040, 572419, 572420, 572421], "trace_timestamp_s": 47.137000000000626, "ttft_s": 1.5607692059711553, "turn_id": 1} +{"actual_output_tokens": 167, "cached_tokens": 12272, "effective_input_length": 16989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16989, "latency_s": 1.6451651210081764, "output_length": 167, "proxy_request_id": "1248768:3:1251261:33", "request_id": "1248768:3:1251261:33", "request_type": "coder", "requested_output_tokens": 167, "session_id": "1248768", "t_dispatch_unix": 1779817641.4678643, "t_finish_unix": 1779817643.1130297, "t_first_token_unix": 1779817642.154935, "tpot_s": 0.005770091427467674, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396, 12454154, 12454155, 12454156, 12454157, 12454158, 12454159, 12454160, 12454161, 12454162, 12454163], "trace_timestamp_s": 47.715000000000146, "ttft_s": 0.6870688010239974, "turn_id": 3} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 1090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1090, "latency_s": 0.19533596700057387, "output_length": 23, "proxy_request_id": "1251828:1:1251828:35", "request_id": "1251828:1:1251828:35", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1251828", "t_dispatch_unix": 1779817643.4005737, "t_finish_unix": 1779817643.5959096, "t_first_token_unix": 1779817643.4899702, "tpot_s": 0.004803773089820011, "trace_hash_ids": [12459863, 12459864, 12459865], "trace_timestamp_s": 49.64900000000034, "ttft_s": 0.08939494501100853, "turn_id": 1} +{"actual_output_tokens": 211, "cached_tokens": 0, "effective_input_length": 20086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20086, "latency_s": 3.329247161047533, "output_length": 211, "proxy_request_id": "1250935:1:1250935:31", "request_id": "1250935:1:1250935:31", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1250935", "t_dispatch_unix": 1779817640.3355148, "t_finish_unix": 1779817643.664762, "t_first_token_unix": 1779817642.4288104, "tpot_s": 0.005884307690541304, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 59796, 4849633, 12365971, 12450880, 12450881, 12450882, 12450883, 12450884, 12450885, 12450886, 12450887, 12450888, 12450889, 12450890, 12450891, 12450892, 603588], "trace_timestamp_s": 46.577000000000226, "ttft_s": 2.0932933060103096, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 6208, "effective_input_length": 13780, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13780, "latency_s": 1.022027428029105, "output_length": 42, "proxy_request_id": "1245572:3:1251662:34", "request_id": "1245572:3:1251662:34", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1245572", "t_dispatch_unix": 1779817642.8793337, "t_finish_unix": 1779817643.9013612, "t_first_token_unix": 1779817643.682925, "tpot_s": 0.005321299731049959, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667, 12411607, 12411608, 12419790, 12419791, 12419792, 12419793, 12419794, 12438738, 12438739, 12438740, 12447608, 12447609, 12458533, 12458534, 12458535], "trace_timestamp_s": 49.126000000000204, "ttft_s": 0.8035899880342185, "turn_id": 3} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 9855, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9855, "latency_s": 0.9838664830313064, "output_length": 34, "proxy_request_id": "1252010:1:1252010:36", "request_id": "1252010:1:1252010:36", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1252010", "t_dispatch_unix": 1779817644.0078564, "t_finish_unix": 1779817644.991723, "t_first_token_unix": 1779817644.8247385, "tpot_s": 0.005051809454788313, "trace_hash_ids": [12424913, 12432715, 12432716, 12432717, 12440818, 12440819, 12440820, 12440821, 12452285, 12452286, 12452287, 12452288, 12452289, 12452290, 12452291, 12461892, 12461893, 12461894, 12461895, 12461896], "trace_timestamp_s": 50.25300000000061, "ttft_s": 0.8168798820115626, "turn_id": 1} +{"actual_output_tokens": 501, "cached_tokens": 17152, "effective_input_length": 17309, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17309, "latency_s": 3.017348256020341, "output_length": 501, "proxy_request_id": "1248768:4:1253385:37", "request_id": "1248768:4:1253385:37", "request_type": "coder", "requested_output_tokens": 501, "session_id": "1248768", "t_dispatch_unix": 1779817648.7816465, "t_finish_unix": 1779817651.7989948, "t_first_token_unix": 1779817648.8725767, "tpot_s": 0.005852312207920477, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396, 12454154, 12454155, 12454156, 12454157, 12454158, 12454159, 12454160, 12454161, 12454162, 12475383], "trace_timestamp_s": 55.02600000000075, "ttft_s": 0.0909281560452655, "turn_id": 4} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 3934, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3934, "latency_s": 0.3904874880099669, "output_length": 30, "proxy_request_id": "1251828:2:1254272:41", "request_id": "1251828:2:1254272:41", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1251828", "t_dispatch_unix": 1779817651.7517517, "t_finish_unix": 1779817652.1422393, "t_first_token_unix": 1779817651.9992502, "tpot_s": 0.004921359654339352, "trace_hash_ids": [12459863, 12459864, 12467072, 12467073, 12467074, 12467075, 12477189, 12485024], "trace_timestamp_s": 58.0, "ttft_s": 0.24749727302696556, "turn_id": 2} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 748, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 748, "latency_s": 0.21866079297615215, "output_length": 32, "proxy_request_id": "1254584:1:1254584:42", "request_id": "1254584:1:1254584:42", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1254584", "t_dispatch_unix": 1779817652.8846924, "t_finish_unix": 1779817653.103353, "t_first_token_unix": 1779817652.9528592, "tpot_s": 0.004845979871348508, "trace_hash_ids": [12480388, 12487633], "trace_timestamp_s": 59.134000000000015, "ttft_s": 0.06816591299138963, "turn_id": 1} +{"actual_output_tokens": 33, "cached_tokens": 9888, "effective_input_length": 13092, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13092, "latency_s": 0.5982678119908087, "output_length": 33, "proxy_request_id": "1252010:2:1254691:43", "request_id": "1252010:2:1254691:43", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1252010", "t_dispatch_unix": 1779817653.336659, "t_finish_unix": 1779817653.9349267, "t_first_token_unix": 1779817653.771609, "tpot_s": 0.005095142905702232, "trace_hash_ids": [12424913, 12432715, 12432716, 12432717, 12440818, 12440819, 12440820, 12440821, 12452285, 12452286, 12452287, 12452288, 12452289, 12452290, 12452291, 12461892, 12461893, 12461894, 12461895, 12469281, 12469282, 12480858, 12480859, 12488817, 12488818, 12488819], "trace_timestamp_s": 59.58400000000074, "ttft_s": 0.43494839099003, "turn_id": 2} +{"actual_output_tokens": 410, "cached_tokens": 7120, "effective_input_length": 10764, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10764, "latency_s": 2.617997094988823, "output_length": 410, "proxy_request_id": "1250772:2:1254198:40", "request_id": "1250772:2:1254198:40", "request_type": "coder", "requested_output_tokens": 410, "session_id": "1250772", "t_dispatch_unix": 1779817651.4792686, "t_finish_unix": 1779817654.0972655, "t_first_token_unix": 1779817651.872957, "tpot_s": 0.005437789312939554, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12484460], "trace_timestamp_s": 57.72600000000057, "ttft_s": 0.3936870050383732, "turn_id": 2} +{"actual_output_tokens": 321, "cached_tokens": 0, "effective_input_length": 35221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35221, "latency_s": 7.363742624002043, "output_length": 321, "proxy_request_id": "1253804:1:1253804:39", "request_id": "1253804:1:1253804:39", "request_type": "coder", "requested_output_tokens": 321, "session_id": "1253804", "t_dispatch_unix": 1779817650.3674724, "t_finish_unix": 1779817657.7312148, "t_first_token_unix": 1779817655.5552766, "tpot_s": 0.006798890943719016, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114], "trace_timestamp_s": 56.60400000000027, "ttft_s": 5.187800752988551, "turn_id": 1} +{"actual_output_tokens": 58, "cached_tokens": 0, "effective_input_length": 1694, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1694, "latency_s": 0.4309290960081853, "output_length": 58, "proxy_request_id": "1256273:1:1256273:46", "request_id": "1256273:1:1256273:46", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1256273", "t_dispatch_unix": 1779817658.5672803, "t_finish_unix": 1779817658.9982095, "t_first_token_unix": 1779817658.7146852, "tpot_s": 0.004969645034227716, "trace_hash_ids": [12492922, 12504484, 12504485, 12504486], "trace_timestamp_s": 64.81600000000071, "ttft_s": 0.14740315702510998, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 11328, "effective_input_length": 11448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11448, "latency_s": 0.4923370030010119, "output_length": 80, "proxy_request_id": "1243831:2:1256324:47", "request_id": "1243831:2:1256324:47", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1243831", "t_dispatch_unix": 1779817658.7318623, "t_finish_unix": 1779817659.224199, "t_first_token_unix": 1779817658.7941008, "tpot_s": 0.005440900785276737, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12504841], "trace_timestamp_s": 64.98000000000047, "ttft_s": 0.06223679595859721, "turn_id": 2} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 49624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49624, "latency_s": 9.641549899999518, "output_length": 57, "proxy_request_id": "1253743:1:1253743:38", "request_id": "1253743:1:1253743:38", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1253743", "t_dispatch_unix": 1779817650.1226394, "t_finish_unix": 1779817659.764189, "t_first_token_unix": 1779817659.3798926, "tpot_s": 0.006855985661137051, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411], "trace_timestamp_s": 56.35200000000077, "ttft_s": 9.257250293972902, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 7504, "effective_input_length": 17786, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17786, "latency_s": 1.3870312800281681, "output_length": 23, "proxy_request_id": "1249058:3:1256222:45", "request_id": "1249058:3:1256222:45", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1249058", "t_dispatch_unix": 1779817658.4191883, "t_finish_unix": 1779817659.806219, "t_first_token_unix": 1779817659.694194, "tpot_s": 0.0050799948618408634, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12440459, 12440460, 12440461, 12440462, 12440463, 12440464, 12464529, 12464530, 12464531, 12464532, 12474164, 12474165, 12474166, 12481572, 12481573, 12481574, 12481575, 12481576, 12481577, 12481578, 12494816, 12494817, 12494818, 12494819, 12504084, 12504085, 12504086], "trace_timestamp_s": 64.66300000000047, "ttft_s": 1.2750039010425098, "turn_id": 3} +{"actual_output_tokens": 112, "cached_tokens": 49680, "effective_input_length": 49687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49687, "latency_s": 0.9044578259927221, "output_length": 112, "proxy_request_id": "1253743:2:1256070:44", "request_id": "1253743:2:1256070:44", "request_type": "coder", "requested_output_tokens": 112, "session_id": "1253743", "t_dispatch_unix": 1779817659.7664304, "t_finish_unix": 1779817660.6708884, "t_first_token_unix": 1779817659.8716695, "tpot_s": 0.00719771406304947, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12502790], "trace_timestamp_s": 64.15700000000015, "ttft_s": 0.10523680900223553, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 1744, "effective_input_length": 6170, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6170, "latency_s": 0.6248738329741172, "output_length": 59, "proxy_request_id": "1256273:2:1257769:51", "request_id": "1256273:2:1257769:51", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1256273", "t_dispatch_unix": 1779817663.5498602, "t_finish_unix": 1779817664.174734, "t_first_token_unix": 1779817663.8814662, "tpot_s": 0.005051918534545934, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12519481], "trace_timestamp_s": 69.79700000000048, "ttft_s": 0.3316043349914253, "turn_id": 2} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 4434, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4434, "latency_s": 1.515292207011953, "output_length": 237, "proxy_request_id": "1257572:1:1257572:50", "request_id": "1257572:1:1257572:50", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1257572", "t_dispatch_unix": 1779817662.9172828, "t_finish_unix": 1779817664.432575, "t_first_token_unix": 1779817663.213048, "tpot_s": 0.005166021779710348, "trace_hash_ids": [12494641, 12494642, 12494643, 12494644, 12494645, 12494646, 12494647, 12516925, 12516926], "trace_timestamp_s": 69.16400000000067, "ttft_s": 0.29576370399445295, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 768, "effective_input_length": 1257, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1257, "latency_s": 0.38567962701199576, "output_length": 68, "proxy_request_id": "1254584:2:1258039:52", "request_id": "1254584:2:1258039:52", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1254584", "t_dispatch_unix": 1779817664.571746, "t_finish_unix": 1779817664.9574258, "t_first_token_unix": 1779817664.6290474, "tpot_s": 0.004896923447889623, "trace_hash_ids": [12480388, 12511291, 12522116], "trace_timestamp_s": 70.82000000000062, "ttft_s": 0.057298432977404445, "turn_id": 2} +{"actual_output_tokens": 92, "cached_tokens": 21648, "effective_input_length": 22262, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22262, "latency_s": 0.7204281979938969, "output_length": 92, "proxy_request_id": "1242838:3:1258161:53", "request_id": "1242838:3:1258161:53", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1242838", "t_dispatch_unix": 1779817665.0288618, "t_finish_unix": 1779817665.749289, "t_first_token_unix": 1779817665.2045672, "tpot_s": 0.005977892242039421, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892], "trace_timestamp_s": 71.27700000000004, "ttft_s": 0.175703294982668, "turn_id": 3} +{"actual_output_tokens": 116, "cached_tokens": 6224, "effective_input_length": 7934, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7934, "latency_s": 0.7962434359942563, "output_length": 116, "proxy_request_id": "1256273:3:1258499:55", "request_id": "1256273:3:1258499:55", "request_type": "coder", "requested_output_tokens": 116, "session_id": "1256273", "t_dispatch_unix": 1779817666.194247, "t_finish_unix": 1779817666.9904902, "t_first_token_unix": 1779817666.3892121, "tpot_s": 0.005226244408961224, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12526397, 12526398, 12526399, 12526400], "trace_timestamp_s": 72.44200000000001, "ttft_s": 0.1949640449602157, "turn_id": 3} +{"actual_output_tokens": 362, "cached_tokens": 0, "effective_input_length": 9250, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9250, "latency_s": 2.667328364972491, "output_length": 362, "proxy_request_id": "1258908:1:1258908:58", "request_id": "1258908:1:1258908:58", "request_type": "coder", "requested_output_tokens": 362, "session_id": "1258908", "t_dispatch_unix": 1779817667.6473997, "t_finish_unix": 1779817670.314728, "t_first_token_unix": 1779817668.3506622, "tpot_s": 0.005439508304682269, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 12530208, 12530209, 12530210, 12530211], "trace_timestamp_s": 73.89300000000003, "ttft_s": 0.7032601989922114, "turn_id": 1} +{"actual_output_tokens": 341, "cached_tokens": 0, "effective_input_length": 14291, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14291, "latency_s": 3.1810131180100143, "output_length": 341, "proxy_request_id": "1259178:1:1259178:59", "request_id": "1259178:1:1259178:59", "request_type": "coder", "requested_output_tokens": 341, "session_id": "1259178", "t_dispatch_unix": 1779817668.6079628, "t_finish_unix": 1779817671.788976, "t_first_token_unix": 1779817669.8635123, "tpot_s": 0.005662422635256971, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319], "trace_timestamp_s": 74.85200000000077, "ttft_s": 1.255547266046051, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 27387, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27387, "latency_s": 9.089760221017059, "output_length": 45, "proxy_request_id": "1257525:1:1257525:49", "request_id": "1257525:1:1257525:49", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1257525", "t_dispatch_unix": 1779817662.8282583, "t_finish_unix": 1779817671.918018, "t_first_token_unix": 1779817666.2972753, "tpot_s": 0.12773682388598734, "trace_hash_ids": [12479517, 12479518, 12479519, 12479520, 12479521, 12479522, 12479523, 12479524, 12479525, 12479526, 12479527, 12479528, 12479529, 12479530, 12479531, 12479532, 12479533, 12479534, 12479535, 12479536, 12479537, 12479538, 12479539, 12479540, 12479541, 12479542, 12479543, 12479544, 12479545, 12479546, 12479547, 12479548, 12479549, 12479550, 12479551, 12479552, 12479553, 12479554, 12479555, 12479556, 12479557, 12479558, 12479559, 12479560, 12479561, 12479562, 12479563, 12499990, 12499991, 12509015, 12516559, 12516560, 12516561, 12516562], "trace_timestamp_s": 69.06500000000051, "ttft_s": 3.469015146023594, "turn_id": 1} +{"actual_output_tokens": 110, "cached_tokens": 35536, "effective_input_length": 52978, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52978, "latency_s": 6.729788233991712, "output_length": 110, "proxy_request_id": "1253804:2:1258346:54", "request_id": "1253804:2:1258346:54", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1253804", "t_dispatch_unix": 1779817665.735372, "t_finish_unix": 1779817672.4651597, "t_first_token_unix": 1779817671.5580606, "tpot_s": 0.00831985844079183, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968], "trace_timestamp_s": 71.97700000000077, "ttft_s": 5.822686362953391, "turn_id": 2} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 9571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9571, "latency_s": 1.1399090750492178, "output_length": 73, "proxy_request_id": "1260746:1:1260746:62", "request_id": "1260746:1:1260746:62", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1260746", "t_dispatch_unix": 1779817674.1527522, "t_finish_unix": 1779817675.292661, "t_first_token_unix": 1779817674.908181, "tpot_s": 0.005336345374720016, "trace_hash_ids": [12532255, 12532256, 12532257, 12532258, 12532259, 12532260, 12538543, 12538544, 12538545, 12547747, 12547748, 12547749, 12547750, 12547751, 12547752, 12547753, 12547754, 12547755, 12547756], "trace_timestamp_s": 80.39699999999993, "ttft_s": 0.7554273850400932, "turn_id": 1} +{"actual_output_tokens": 62, "cached_tokens": 0, "effective_input_length": 12522, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12522, "latency_s": 1.3621566240326501, "output_length": 62, "proxy_request_id": "1260792:1:1260792:63", "request_id": "1260792:1:1260792:63", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1260792", "t_dispatch_unix": 1779817674.2692559, "t_finish_unix": 1779817675.6314125, "t_first_token_unix": 1779817675.301916, "tpot_s": 0.005397893246034252, "trace_hash_ids": [12518548, 12518549, 12518550, 12528577, 12528578, 12528579, 12538129, 12538130, 12538131, 12538132, 12538133, 12538134, 12538135, 12538136, 12538137, 12538138, 12548530, 12548531, 12548532, 12548533, 12548534, 12548535, 12548536, 12548537, 12548538], "trace_timestamp_s": 80.51299999999992, "ttft_s": 1.03265820001252, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 5640, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5640, "latency_s": 0.5385475280345418, "output_length": 34, "proxy_request_id": "1261126:1:1261126:65", "request_id": "1261126:1:1261126:65", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1261126", "t_dispatch_unix": 1779817675.3065298, "t_finish_unix": 1779817675.8450778, "t_first_token_unix": 1779817675.6790352, "tpot_s": 0.00502104606041967, "trace_hash_ids": [12523217, 12523218, 12542338, 12542339, 12542340, 12542341, 12550806, 12550807, 12550808, 12550809, 12550810, 12550811], "trace_timestamp_s": 81.5530000000008, "ttft_s": 0.3725032260408625, "turn_id": 1} +{"actual_output_tokens": 79, "cached_tokens": 53072, "effective_input_length": 55138, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55138, "latency_s": 1.4589420720003545, "output_length": 79, "proxy_request_id": "1253804:3:1260997:64", "request_id": "1253804:3:1260997:64", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1253804", "t_dispatch_unix": 1779817675.003127, "t_finish_unix": 1779817676.462069, "t_first_token_unix": 1779817675.8900633, "tpot_s": 0.007330394833563612, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987], "trace_timestamp_s": 81.2490000000007, "ttft_s": 0.886933884001337, "turn_id": 3} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 30655, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30655, "latency_s": 4.701715912029613, "output_length": 101, "proxy_request_id": "1260327:1:1260327:61", "request_id": "1260327:1:1260327:61", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1260327", "t_dispatch_unix": 1779817672.4303696, "t_finish_unix": 1779817677.1320858, "t_first_token_unix": 1779817676.4981072, "tpot_s": 0.006336814280366525, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103], "trace_timestamp_s": 78.66800000000057, "ttft_s": 4.067735409014858, "turn_id": 1} +{"actual_output_tokens": 9, "cached_tokens": 27424, "effective_input_length": 29988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29988, "latency_s": 0.6592132889782079, "output_length": 9, "proxy_request_id": "1257525:2:1262205:67", "request_id": "1257525:2:1262205:67", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1257525", "t_dispatch_unix": 1779817679.120175, "t_finish_unix": 1779817679.7793875, "t_first_token_unix": 1779817679.753487, "tpot_s": 0.003201002000423614, "trace_hash_ids": [12560509, 12560510, 12560511, 12560512, 12560513, 12560514, 12560515, 12560516, 12560517, 12560518, 12560519, 12560520, 12560521, 12560522, 12560523, 12560524, 12560525, 12560526, 12560527, 12560528, 12560529, 12560530, 12560531, 12560532, 12560533, 12560534, 12560535, 12560536, 12560537, 12560538, 12560539, 12560540, 12560541, 12560542, 12560543, 12560544, 12560545, 12560546, 12560547, 12560548, 12560549, 12560550, 12560551, 12560552, 12560553, 12560554, 12560555, 12560556, 12560557, 12560558, 12560559, 12560560, 12560561, 12560562, 12560563, 12560564, 12560565, 12560566, 12560567], "trace_timestamp_s": 85.35500000000047, "ttft_s": 0.6333097629831173, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 5465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5465, "latency_s": 0.489260885049589, "output_length": 27, "proxy_request_id": "1262757:1:1262757:73", "request_id": "1262757:1:1262757:73", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1262757", "t_dispatch_unix": 1779817681.0029025, "t_finish_unix": 1779817681.492164, "t_first_token_unix": 1779817681.363418, "tpot_s": 0.004939023537400107, "trace_hash_ids": [12513740, 12528866, 12528867, 12537233, 12537234, 12537235, 12547253, 12557610, 12557611, 12557612, 12566807], "trace_timestamp_s": 87.2490000000007, "ttft_s": 0.3605141350417398, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 5664, "effective_input_length": 6953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6953, "latency_s": 0.39519590995041654, "output_length": 46, "proxy_request_id": "1261126:2:1262820:74", "request_id": "1261126:2:1262820:74", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1261126", "t_dispatch_unix": 1779817681.173683, "t_finish_unix": 1779817681.5688787, "t_first_token_unix": 1779817681.3357222, "tpot_s": 0.0051748564440964, "trace_hash_ids": [12523217, 12523218, 12542338, 12542339, 12542340, 12542341, 12550806, 12550807, 12550808, 12550809, 12550810, 12557298, 12567376, 12567377], "trace_timestamp_s": 87.42200000000048, "ttft_s": 0.16203860798850656, "turn_id": 2} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 21510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21510, "latency_s": 2.9040170410298742, "output_length": 101, "proxy_request_id": "1262354:1:1262354:69", "request_id": "1262354:1:1262354:69", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1262354", "t_dispatch_unix": 1779817679.717661, "t_finish_unix": 1779817682.6216779, "t_first_token_unix": 1779817682.0324109, "tpot_s": 0.005890005039982498, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12562242], "trace_timestamp_s": 85.95800000000054, "ttft_s": 2.3147485040244646, "turn_id": 1} +{"actual_output_tokens": 139, "cached_tokens": 0, "effective_input_length": 68131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68131, "latency_s": 17.42726348899305, "output_length": 139, "proxy_request_id": "1258611:1:1258611:56", "request_id": "1258611:1:1258611:56", "request_type": "coder", "requested_output_tokens": 139, "session_id": "1258611", "t_dispatch_unix": 1779817666.582149, "t_finish_unix": 1779817684.0094125, "t_first_token_unix": 1779817682.8673012, "tpot_s": 0.008274443710367937, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 72.80500000000029, "ttft_s": 16.285149467992596, "turn_id": 1} +{"actual_output_tokens": 10, "cached_tokens": 68256, "effective_input_length": 68320, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68320, "latency_s": 0.19491206901147962, "output_length": 10, "proxy_request_id": "1258611:2:1261594:66", "request_id": "1258611:2:1261594:66", "request_type": "coder", "requested_output_tokens": 10, "session_id": "1258611", "t_dispatch_unix": 1779817684.0126147, "t_finish_unix": 1779817684.2075264, "t_first_token_unix": 1779817684.1829236, "tpot_s": 0.0027086562218351495, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 83.19100000000071, "ttft_s": 0.17030658101430163, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 68320, "effective_input_length": 68377, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68377, "latency_s": 0.5802358179935254, "output_length": 55, "proxy_request_id": "1258611:3:1262709:71", "request_id": "1258611:3:1262709:71", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1258611", "t_dispatch_unix": 1779817684.2103033, "t_finish_unix": 1779817684.790539, "t_first_token_unix": 1779817684.373124, "tpot_s": 0.007725278852309135, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 87.12800000000061, "ttft_s": 0.1628179629915394, "turn_id": 3} +{"actual_output_tokens": 76, "cached_tokens": 0, "effective_input_length": 5990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5990, "latency_s": 0.799066492007114, "output_length": 76, "proxy_request_id": "1263611:1:1263611:76", "request_id": "1263611:1:1263611:76", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1263611", "t_dispatch_unix": 1779817684.1941211, "t_finish_unix": 1779817684.9931884, "t_first_token_unix": 1779817684.5988104, "tpot_s": 0.00525436250725761, "trace_hash_ids": [12565267, 12565268, 12565269, 12565270, 12574728, 12574729, 12574730, 12574731, 12574732, 12574733, 12574734, 12574735], "trace_timestamp_s": 90.44100000000071, "ttft_s": 0.4046872449689545, "turn_id": 1} +{"actual_output_tokens": 202, "cached_tokens": 21600, "effective_input_length": 22109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22109, "latency_s": 1.370594174019061, "output_length": 202, "proxy_request_id": "1262354:2:1263593:75", "request_id": "1262354:2:1263593:75", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1262354", "t_dispatch_unix": 1779817684.0804932, "t_finish_unix": 1779817685.451088, "t_first_token_unix": 1779817684.2437844, "tpot_s": 0.0060050932586827865, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12574479], "trace_timestamp_s": 90.32900000000063, "ttft_s": 0.1632886590086855, "turn_id": 2} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 6336, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6336, "latency_s": 0.7778284100349993, "output_length": 71, "proxy_request_id": "1263971:1:1263971:80", "request_id": "1263971:1:1263971:80", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1263971", "t_dispatch_unix": 1779817685.5046637, "t_finish_unix": 1779817686.2824924, "t_first_token_unix": 1779817685.925591, "tpot_s": 0.005094362471884648, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12579286], "trace_timestamp_s": 91.7510000000002, "ttft_s": 0.4209256889880635, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 0, "effective_input_length": 90488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90488, "latency_s": 28.01956392498687, "output_length": 42, "proxy_request_id": "1257323:1:1257323:48", "request_id": "1257323:1:1257323:48", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1257323", "t_dispatch_unix": 1779817662.220621, "t_finish_unix": 1779817690.2401845, "t_first_token_unix": 1779817689.8499124, "tpot_s": 0.009510148609079784, "trace_hash_ids": [2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518, 46994, 46995, 46996, 46997, 46998, 46999, 47000, 47001, 47002, 47003, 47004, 47005, 47006, 47007, 47008, 47009, 47010, 47011, 47012, 4751454, 2379937, 2379938, 2379939, 2379940, 2379941, 4751455, 4751456, 4751457, 4751458, 4751459, 4751460, 4751461, 4751462, 4751463, 4751464, 4751465, 4751466, 4751467, 4751468, 4751469, 4751470, 4751471, 4751472, 4751473, 4751474, 4751475, 4751476, 4751477, 4751478, 4751479, 4751480, 4751481, 4751482, 4751483, 4751484, 4751485, 10670236, 10670237, 10670238, 10670239, 10670240, 10670241, 10670242, 10670243, 10670244, 10670245, 10670246, 10670247, 10670248, 10670249, 10670250, 10670251, 10670252, 10670253, 10670254, 10670255, 10670256, 10670257, 10670258, 10670259, 10670260, 10670261, 10994656, 10994657, 10994658, 10994659, 10994660, 10994661, 10994662, 10994663, 10994664, 10994665, 10994666, 10994667, 10994668, 10994669, 10994670, 10994671, 10994672, 10994673, 10994674, 10994675, 10994676, 10994677, 10994678, 10994679, 10994680, 10994681, 10994682, 10994683, 10994684, 10994685, 10994686, 10994687, 10994688, 10994689, 10994690, 10994691, 10994692, 10994693, 10994694, 10994695, 10994696, 10994697, 10994698, 10994699, 10994700, 10994701, 10994702, 10994703, 10994704, 10994705, 10994706, 10994707, 10994708, 10994709, 10994710, 10994711, 10994712, 10994713, 10994714, 10994715, 10994716, 10994717, 10994718, 10994719, 10994720, 10994721, 10994722, 10994723, 10994724, 10994725, 10994726, 10994727, 11134572, 11161915, 11261064, 11282181, 11360636, 11420052, 11420053, 11446131, 11701929, 12264742, 12297965, 12385798, 12385799, 12514819, 12514820], "trace_timestamp_s": 68.43299999999999, "ttft_s": 27.629289375036024, "turn_id": 1} +{"actual_output_tokens": 63, "cached_tokens": 20608, "effective_input_length": 22565, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22565, "latency_s": 10.680745196004864, "output_length": 63, "proxy_request_id": "1239034:3:1262346:68", "request_id": "1239034:3:1262346:68", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1239034", "t_dispatch_unix": 1779817679.685561, "t_finish_unix": 1779817690.3663056, "t_first_token_unix": 1779817689.8362248, "tpot_s": 0.008544735548522083, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445, 12562130, 12562131, 12562132, 12562133, 12562134, 12562135, 12562136, 12562137, 12562138], "trace_timestamp_s": 85.9320000000007, "ttft_s": 10.150661895982921, "turn_id": 3} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 301, "latency_s": 1.5524388549965806, "output_length": 68, "proxy_request_id": "1265000:1:1265000:83", "request_id": "1265000:1:1265000:83", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1265000", "t_dispatch_unix": 1779817689.1309566, "t_finish_unix": 1779817690.6833951, "t_first_token_unix": 1779817689.173634, "tpot_s": 0.022528667089793442, "trace_hash_ids": [12589398], "trace_timestamp_s": 95.38000000000011, "ttft_s": 0.04267629497917369, "turn_id": 1} +{"actual_output_tokens": 77, "cached_tokens": 0, "effective_input_length": 14028, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14028, "latency_s": 1.6426839919877239, "output_length": 77, "proxy_request_id": "1265128:1:1265128:85", "request_id": "1265128:1:1265128:85", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1265128", "t_dispatch_unix": 1779817689.4573107, "t_finish_unix": 1779817691.099995, "t_first_token_unix": 1779817690.675574, "tpot_s": 0.005581104407993783, "trace_hash_ids": [12531602, 12531603, 12531604, 12531605, 12531606, 12531607, 12531608, 12531609, 12531610, 12531611, 12531612, 12531613, 12531614, 12531615, 12531616, 12531617, 12544382, 12544383, 12544384, 12557454, 12557455, 12557456, 12557457, 12557458, 12590524, 12590525, 12590526, 12590527], "trace_timestamp_s": 95.70100000000002, "ttft_s": 1.2182615119963884, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 579, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 579, "latency_s": 0.29858853202313185, "output_length": 23, "proxy_request_id": "1266067:1:1266067:91", "request_id": "1266067:1:1266067:91", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1266067", "t_dispatch_unix": 1779817692.6810732, "t_finish_unix": 1779817692.9796612, "t_first_token_unix": 1779817692.8146653, "tpot_s": 0.00748050722706301, "trace_hash_ids": [12599495, 12599496], "trace_timestamp_s": 98.93000000000029, "ttft_s": 0.1335913770017214, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 13178, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13178, "latency_s": 1.354978813964408, "output_length": 47, "proxy_request_id": "1263611:2:1265770:88", "request_id": "1263611:2:1265770:88", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1263611", "t_dispatch_unix": 1779817691.7782466, "t_finish_unix": 1779817693.1332254, "t_first_token_unix": 1779817692.887599, "tpot_s": 0.0053318797170346524, "trace_hash_ids": [12565267, 12565268, 12565269, 12565270, 12574728, 12574729, 12574730, 12574731, 12574732, 12574733, 12574734, 12587940, 12587941, 12587942, 12587943, 12587944, 12587945, 12587946, 12587947, 12596811, 12596812, 12596813, 12596814, 12596815, 12596816, 12596817], "trace_timestamp_s": 98.02400000000034, "ttft_s": 1.109350460988935, "turn_id": 2} +{"actual_output_tokens": 203, "cached_tokens": 0, "effective_input_length": 23540, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23540, "latency_s": 4.285600571020041, "output_length": 203, "proxy_request_id": "1250772:3:1265019:84", "request_id": "1250772:3:1265019:84", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1250772", "t_dispatch_unix": 1779817689.1974435, "t_finish_unix": 1779817693.483044, "t_first_token_unix": 1779817691.8857172, "tpot_s": 0.007905953252540515, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12546417, 12546418, 12546419, 12546420, 12546421, 12546422, 12546423, 12546424, 12546425, 12546426, 12546427, 12546428, 12546429, 12546430, 12546431, 12546432, 12546433, 12546434, 12589516, 12589517, 12589518, 12589519, 12589520, 12589521, 12589522], "trace_timestamp_s": 95.44100000000071, "ttft_s": 2.688271644990891, "turn_id": 3} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 4070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4070, "latency_s": 1.1540964790037833, "output_length": 92, "proxy_request_id": "1265942:1:1265942:89", "request_id": "1265942:1:1265942:89", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1265942", "t_dispatch_unix": 1779817692.4060638, "t_finish_unix": 1779817693.5601602, "t_first_token_unix": 1779817692.7213519, "tpot_s": 0.009214966703758954, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596], "trace_timestamp_s": 98.65400000000045, "ttft_s": 0.3152869479963556, "turn_id": 1} +{"actual_output_tokens": 331, "cached_tokens": 22304, "effective_input_length": 22344, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22344, "latency_s": 4.701902920030989, "output_length": 331, "proxy_request_id": "1262354:3:1265178:86", "request_id": "1262354:3:1265178:86", "request_type": "coder", "requested_output_tokens": 331, "session_id": "1262354", "t_dispatch_unix": 1779817689.564846, "t_finish_unix": 1779817694.2667491, "t_first_token_unix": 1779817691.8880394, "tpot_s": 0.007207449345503736, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12591121], "trace_timestamp_s": 95.8130000000001, "ttft_s": 2.3231919549871236, "turn_id": 3} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 5381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5381, "latency_s": 0.6790624129935168, "output_length": 59, "proxy_request_id": "1266440:1:1266440:92", "request_id": "1266440:1:1266440:92", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1266440", "t_dispatch_unix": 1779817693.7536983, "t_finish_unix": 1779817694.4327605, "t_first_token_unix": 1779817694.1351938, "tpot_s": 0.00512356213735545, "trace_hash_ids": [12582173, 12582174, 12582175, 12603412, 12603413, 12603414, 12603415, 12603416, 12603417, 12603418, 12603419], "trace_timestamp_s": 100.0010000000002, "ttft_s": 0.3814943280303851, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 50783, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50783, "latency_s": 9.913578573032282, "output_length": 29, "proxy_request_id": "1263727:1:1263727:77", "request_id": "1263727:1:1263727:77", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1263727", "t_dispatch_unix": 1779817684.659308, "t_finish_unix": 1779817694.5728865, "t_first_token_unix": 1779817694.4028409, "tpot_s": 0.006064993786692087, "trace_hash_ids": [12556738, 12556739, 12556740, 12556741, 12556742, 12556743, 12556744, 12556745, 12556746, 12556747, 12556748, 12556749, 12556750, 12556751, 12556752, 12556753, 12556754, 12556755, 12556756, 12556757, 12556758, 12556759, 12556760, 12556761, 12556762, 12556763, 12556764, 12556765, 12556766, 12556767, 12556768, 12556769, 12556770, 12556771, 12556772, 12556773, 12556774, 12556775, 12556776, 12556777, 12556778, 12556779, 12556780, 12556781, 12556782, 12556783, 12556784, 12556785, 12556786, 12556787, 12556788, 12556789, 12556790, 12556791, 12556792, 12556793, 12556794, 12556795, 12556796, 12556797, 12556798, 12556799, 12556800, 12556801, 12556802, 12556803, 12556804, 12556805, 12556806, 12556807, 12556808, 12556809, 12556810, 12556811, 12556812, 12556813, 12556814, 12556815, 12556816, 12556817, 12556818, 12556819, 12556820, 12556821, 12556822, 12556823, 12556824, 12556825, 12556826, 12556827, 12556828, 12556829, 12556830, 12556831, 12556832, 12556833, 12556834, 12556835, 12575902, 12575903], "trace_timestamp_s": 90.88900000000012, "ttft_s": 9.743529893981759, "turn_id": 1} +{"actual_output_tokens": 1649, "cached_tokens": 55216, "effective_input_length": 55989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55989, "latency_s": 14.107472117000725, "output_length": 1649, "proxy_request_id": "1253804:4:1262690:70", "request_id": "1253804:4:1262690:70", "request_type": "coder", "requested_output_tokens": 1649, "session_id": "1253804", "t_dispatch_unix": 1779817680.8106453, "t_finish_unix": 1779817694.9181166, "t_first_token_unix": 1779817681.2478957, "tpot_s": 0.008294876376240407, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12566184], "trace_timestamp_s": 87.0560000000005, "ttft_s": 0.43724773300345987, "turn_id": 4} +{"actual_output_tokens": 30, "cached_tokens": 6400, "effective_input_length": 9504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9504, "latency_s": 0.5104088759981096, "output_length": 30, "proxy_request_id": "1263971:2:1266797:94", "request_id": "1263971:2:1266797:94", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1263971", "t_dispatch_unix": 1779817695.1025026, "t_finish_unix": 1779817695.6129117, "t_first_token_unix": 1779817695.4651337, "tpot_s": 0.0050875641714685175, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12597530, 12597531, 12597532, 12606764, 12606765, 12606766, 12606767], "trace_timestamp_s": 101.35000000000036, "ttft_s": 0.3626293659908697, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 12576, "effective_input_length": 20985, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20985, "latency_s": 5.429897040012293, "output_length": 46, "proxy_request_id": "1260792:2:1265951:90", "request_id": "1260792:2:1265951:90", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1260792", "t_dispatch_unix": 1779817692.432495, "t_finish_unix": 1779817697.8623917, "t_first_token_unix": 1779817697.3592792, "tpot_s": 0.011174851733570298, "trace_hash_ids": [12598651, 12598652, 12598653, 12598654, 12598655, 12598656, 12598657, 12598658, 12598659, 12598660, 12598661, 12598662, 12598663, 12598664, 12598665, 12598666, 12598667, 12598668, 12598669, 12598670, 12598671, 12598672, 12598673, 12598674, 12598675, 12598676, 12598677, 12598678, 12598679, 12598680, 12598681, 12598682, 12598683, 12598684, 12598685, 12598686, 12598687, 12598688, 12598689, 12598690, 12598691], "trace_timestamp_s": 98.67300000000068, "ttft_s": 4.9267822279944085, "turn_id": 2} +{"actual_output_tokens": 143, "cached_tokens": 0, "effective_input_length": 56292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56292, "latency_s": 14.064990637998562, "output_length": 143, "proxy_request_id": "1263749:1:1263749:79", "request_id": "1263749:1:1263749:79", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1263749", "t_dispatch_unix": 1779817684.731339, "t_finish_unix": 1779817698.7963295, "t_first_token_unix": 1779817696.1934059, "tpot_s": 0.018328384683191985, "trace_hash_ids": [51262, 61305, 61306, 637504, 637505, 637506, 637507, 637508, 637509, 637510, 637511, 637512, 637513, 637514, 637515, 637516, 637517, 637518, 637519, 637520, 637521, 637522, 637523, 637524, 637525, 637526, 584014, 637527, 637528, 1022562, 637530, 1022563, 637532, 637533, 248930, 1022564, 4415649, 4415650, 4415651, 12449838, 12449839, 12449840, 12449841, 12449842, 12449843, 12449844, 12449845, 12449846, 12449847, 12449848, 12449849, 12449850, 12449851, 12449852, 12449853, 12449854, 12449855, 12449856, 12449857, 12449858, 12449859, 12449860, 12449861, 12449862, 12449863, 12449864, 12449865, 12449866, 12449867, 12449868, 12449869, 12449870, 12449871, 12449872, 12449873, 12449874, 12449875, 12449876, 12449877, 12449878, 12449879, 12449880, 12449881, 12449882, 12449883, 12449884, 12449885, 12449886, 12449887, 12449888, 12449889, 12449890, 12449891, 12449892, 12449893, 12449894, 12449895, 12449896, 12449897, 12553020, 12553021, 12553022, 12553023, 12553024, 12553025, 12553026, 12553027, 12553028, 12553029, 12553030], "trace_timestamp_s": 90.95900000000074, "ttft_s": 11.462063548970036, "turn_id": 1} +{"actual_output_tokens": 662, "cached_tokens": 0, "effective_input_length": 17466, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17466, "latency_s": 5.555625000037253, "output_length": 662, "proxy_request_id": "1266668:1:1266668:93", "request_id": "1266668:1:1266668:93", "request_type": "coder", "requested_output_tokens": 662, "session_id": "1266668", "t_dispatch_unix": 1779817694.6529937, "t_finish_unix": 1779817700.208619, "t_first_token_unix": 1779817696.359077, "tpot_s": 0.005823361862337417, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12605179], "trace_timestamp_s": 100.89699999999993, "ttft_s": 1.7060811599949375, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 4160, "effective_input_length": 10457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10457, "latency_s": 0.9367813959834166, "output_length": 67, "proxy_request_id": "1265942:2:1268069:97", "request_id": "1265942:2:1268069:97", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1265942", "t_dispatch_unix": 1779817699.4099727, "t_finish_unix": 1779817700.3467538, "t_first_token_unix": 1779817699.996215, "tpot_s": 0.005307557212125341, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596, 12609655, 12609656, 12609657, 12609658, 12618768, 12618769, 12618770, 12618771, 12618772, 12618773, 12618774, 12618775, 12618776], "trace_timestamp_s": 105.65700000000015, "ttft_s": 0.58624112396501, "turn_id": 2} +{"actual_output_tokens": 202, "cached_tokens": 22672, "effective_input_length": 28671, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28671, "latency_s": 2.490526948007755, "output_length": 202, "proxy_request_id": "1262354:4:1267821:95", "request_id": "1262354:4:1267821:95", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1262354", "t_dispatch_unix": 1779817698.7084987, "t_finish_unix": 1779817701.1990256, "t_first_token_unix": 1779817699.9185615, "tpot_s": 0.0063692320002687736, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939], "trace_timestamp_s": 104.95499999999993, "ttft_s": 1.2100595739902928, "turn_id": 4} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 2298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2298, "latency_s": 0.3607927019475028, "output_length": 24, "proxy_request_id": "1268634:1:1268634:99", "request_id": "1268634:1:1268634:99", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1268634", "t_dispatch_unix": 1779817701.6150258, "t_finish_unix": 1779817701.9758182, "t_first_token_unix": 1779817701.8630044, "tpot_s": 0.004893085304343992, "trace_hash_ids": [12598584, 12598585, 12598586, 12612307, 12624657], "trace_timestamp_s": 107.82400000000052, "ttft_s": 0.24797760997898877, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 18638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18638, "latency_s": 2.791958532005083, "output_length": 27, "proxy_request_id": "1268649:1:1268649:100", "request_id": "1268649:1:1268649:100", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1268649", "t_dispatch_unix": 1779817701.6231267, "t_finish_unix": 1779817704.4150853, "t_first_token_unix": 1779817703.607503, "tpot_s": 0.031048747847447745, "trace_hash_ids": [12606450, 12606451, 12606452, 12606453, 12606454, 12606455, 12606456, 12606457, 12606458, 12606459, 12606460, 12606461, 12606462, 12606463, 12606464, 12606465, 12606466, 12606467, 12606468, 12606469, 12606470, 12606471, 12606472, 12606473, 12606474, 12606475, 12606476, 12606477, 12606478, 12606479, 12606480, 12606481, 12606482, 12606483, 12624720, 12624721, 12624722], "trace_timestamp_s": 107.86400000000049, "ttft_s": 1.9843739999923855, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 9520, "effective_input_length": 13955, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13955, "latency_s": 1.4242755000013858, "output_length": 31, "proxy_request_id": "1263971:3:1269088:104", "request_id": "1263971:3:1269088:104", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1263971", "t_dispatch_unix": 1779817703.041941, "t_finish_unix": 1779817704.4662166, "t_first_token_unix": 1779817704.1401606, "tpot_s": 0.010853500299466154, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12597530, 12597531, 12597532, 12606764, 12606765, 12606766, 12613478, 12613479, 12622426, 12622427, 12622428, 12622429, 12622430, 12622431, 12629103, 12629104], "trace_timestamp_s": 109.28900000000067, "ttft_s": 1.0982184650492854, "turn_id": 3} +{"actual_output_tokens": 102, "cached_tokens": 28864, "effective_input_length": 28906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28906, "latency_s": 1.0879807859892026, "output_length": 102, "proxy_request_id": "1262354:5:1269336:105", "request_id": "1262354:5:1269336:105", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1262354", "t_dispatch_unix": 1779817703.9967268, "t_finish_unix": 1779817705.0847077, "t_first_token_unix": 1779817704.1742222, "tpot_s": 0.00901137089119339, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12632148], "trace_timestamp_s": 110.2450000000008, "ttft_s": 0.1774938249727711, "turn_id": 5} +{"actual_output_tokens": 128, "cached_tokens": 23728, "effective_input_length": 24029, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24029, "latency_s": 2.932442998047918, "output_length": 128, "proxy_request_id": "1250772:4:1268869:103", "request_id": "1250772:4:1268869:103", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1250772", "t_dispatch_unix": 1779817702.301411, "t_finish_unix": 1779817705.2338543, "t_first_token_unix": 1779817704.1385283, "tpot_s": 0.00862247303153909, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12546417, 12546418, 12546419, 12546420, 12546421, 12546422, 12546423, 12546424, 12546425, 12546426, 12546427, 12546428, 12546429, 12546430, 12546431, 12546432, 12546433, 12546434, 12589516, 12589517, 12589518, 12589519, 12589520, 12589521, 12589522, 12627093], "trace_timestamp_s": 108.55000000000018, "ttft_s": 1.8371153280022554, "turn_id": 4} +{"actual_output_tokens": 248, "cached_tokens": 0, "effective_input_length": 12195, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12195, "latency_s": 3.1518758939928375, "output_length": 248, "proxy_request_id": "1268831:1:1268831:101", "request_id": "1268831:1:1268831:101", "request_type": "coder", "requested_output_tokens": 248, "session_id": "1268831", "t_dispatch_unix": 1779817702.1457691, "t_finish_unix": 1779817705.2976453, "t_first_token_unix": 1779817703.1563323, "tpot_s": 0.008668306291429515, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771], "trace_timestamp_s": 108.39000000000033, "ttft_s": 1.010561179020442, "turn_id": 1} +{"actual_output_tokens": 234, "cached_tokens": 7680, "effective_input_length": 14104, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14104, "latency_s": 2.122337946027983, "output_length": 234, "proxy_request_id": "1269373:1:1269373:106", "request_id": "1269373:1:1269373:106", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1269373", "t_dispatch_unix": 1779817704.1237526, "t_finish_unix": 1779817706.2460904, "t_first_token_unix": 1779817704.8506274, "tpot_s": 0.005988063012917282, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12632634], "trace_timestamp_s": 110.3700000000008, "ttft_s": 0.726873035018798, "turn_id": 1} +{"actual_output_tokens": 383, "cached_tokens": 0, "effective_input_length": 12320, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12320, "latency_s": 4.002122302015778, "output_length": 383, "proxy_request_id": "1268861:1:1268861:102", "request_id": "1268861:1:1268861:102", "request_type": "coder", "requested_output_tokens": 383, "session_id": "1268861", "t_dispatch_unix": 1779817702.2643464, "t_finish_unix": 1779817706.2664685, "t_first_token_unix": 1779817703.30249, "tpot_s": 0.007758402510476665, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12627028], "trace_timestamp_s": 108.50900000000001, "ttft_s": 1.0381422460195608, "turn_id": 1} +{"actual_output_tokens": 94, "cached_tokens": 0, "effective_input_length": 1323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1323, "latency_s": 0.7403409199905582, "output_length": 94, "proxy_request_id": "1269901:1:1269901:107", "request_id": "1269901:1:1269901:107", "request_type": "coder", "requested_output_tokens": 94, "session_id": "1269901", "t_dispatch_unix": 1779817705.6830878, "t_finish_unix": 1779817706.4234285, "t_first_token_unix": 1779817705.8325427, "tpot_s": 0.006351137376685817, "trace_hash_ids": [12637519, 12637520, 12637521], "trace_timestamp_s": 111.9320000000007, "ttft_s": 0.1494533609948121, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 30752, "effective_input_length": 30828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30828, "latency_s": 0.4712112150155008, "output_length": 55, "proxy_request_id": "1260327:2:1270005:108", "request_id": "1260327:2:1270005:108", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1260327", "t_dispatch_unix": 1779817706.1048002, "t_finish_unix": 1779817706.5760114, "t_first_token_unix": 1779817706.2037606, "tpot_s": 0.006888022129984434, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12638441], "trace_timestamp_s": 112.35300000000007, "ttft_s": 0.0989585790084675, "turn_id": 2} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 11128, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11128, "latency_s": 1.1194733490119688, "output_length": 32, "proxy_request_id": "1266440:2:1270501:112", "request_id": "1266440:2:1270501:112", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1266440", "t_dispatch_unix": 1779817707.8763282, "t_finish_unix": 1779817708.9958014, "t_first_token_unix": 1779817708.7832558, "tpot_s": 0.006847052515724734, "trace_hash_ids": [12582173, 12582174, 12582175, 12603412, 12603413, 12603414, 12603415, 12603416, 12603417, 12603418, 12611059, 12611060, 12611061, 12618733, 12618734, 12618735, 12618736, 12629763, 12642862, 12642863, 12642864, 12642865], "trace_timestamp_s": 114.1230000000005, "ttft_s": 0.9069263260462321, "turn_id": 2} +{"actual_output_tokens": 86, "cached_tokens": 8048, "effective_input_length": 12270, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12270, "latency_s": 39.81524409598205, "output_length": 86, "proxy_request_id": "1256273:4:1259632:60", "request_id": "1256273:4:1259632:60", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1256273", "t_dispatch_unix": 1779817670.1508496, "t_finish_unix": 1779817709.9660935, "t_first_token_unix": 1779817708.9343026, "tpot_s": 0.012135513858897063, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12526397, 12526398, 12526399, 12536749, 12536750, 12536751, 12536752, 12536753, 12536754, 12536755, 12536756, 12536757], "trace_timestamp_s": 76.39800000000014, "ttft_s": 38.7834516739822, "turn_id": 4} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 112793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112793, "latency_s": 42.529789386026096, "output_length": 97, "proxy_request_id": "1258859:1:1258859:57", "request_id": "1258859:1:1258859:57", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1258859", "t_dispatch_unix": 1779817667.5479727, "t_finish_unix": 1779817710.077762, "t_first_token_unix": 1779817708.7304432, "tpot_s": 0.014031811031600228, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503], "trace_timestamp_s": 73.75200000000041, "ttft_s": 41.18246761598857, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 50800, "effective_input_length": 57803, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57803, "latency_s": 5.672444568015635, "output_length": 29, "proxy_request_id": "1263727:2:1270052:109", "request_id": "1263727:2:1270052:109", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1263727", "t_dispatch_unix": 1779817706.2955413, "t_finish_unix": 1779817711.9679852, "t_first_token_unix": 1779817708.8501427, "tpot_s": 0.11134263607216001, "trace_hash_ids": [12556738, 12556739, 12556740, 12556741, 12556742, 12556743, 12556744, 12556745, 12556746, 12556747, 12556748, 12556749, 12556750, 12556751, 12556752, 12556753, 12556754, 12556755, 12556756, 12556757, 12556758, 12556759, 12556760, 12556761, 12556762, 12556763, 12556764, 12556765, 12556766, 12556767, 12556768, 12556769, 12556770, 12556771, 12556772, 12556773, 12556774, 12556775, 12556776, 12556777, 12556778, 12556779, 12556780, 12556781, 12556782, 12556783, 12556784, 12556785, 12556786, 12556787, 12556788, 12556789, 12556790, 12556791, 12556792, 12556793, 12556794, 12556795, 12556796, 12556797, 12556798, 12556799, 12556800, 12556801, 12556802, 12556803, 12556804, 12556805, 12556806, 12556807, 12556808, 12556809, 12556810, 12556811, 12556812, 12556813, 12556814, 12556815, 12556816, 12556817, 12556818, 12556819, 12556820, 12556821, 12556822, 12556823, 12556824, 12556825, 12556826, 12556827, 12556828, 12556829, 12556830, 12556831, 12556832, 12556833, 12556834, 12556835, 12575902, 12585534, 12585535, 12585536, 12585537, 12600891, 12600892, 12600893, 12600894, 12600895, 12638702, 12638703, 12638704, 12638705, 12638706], "trace_timestamp_s": 112.54100000000017, "ttft_s": 2.5545990690006875, "turn_id": 2} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 27927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27927, "latency_s": 4.728636464977171, "output_length": 50, "proxy_request_id": "1270340:1:1270340:111", "request_id": "1270340:1:1270340:111", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1270340", "t_dispatch_unix": 1779817707.3074312, "t_finish_unix": 1779817712.0360672, "t_first_token_unix": 1779817711.6379728, "tpot_s": 0.008119453469348349, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646], "trace_timestamp_s": 113.54500000000007, "ttft_s": 4.3305402339901775, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 2524, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2524, "latency_s": 0.47568899497855455, "output_length": 27, "proxy_request_id": "1271847:1:1271847:123", "request_id": "1271847:1:1271847:123", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1271847", "t_dispatch_unix": 1779817712.5657628, "t_finish_unix": 1779817713.0414515, "t_first_token_unix": 1779817712.7732246, "tpot_s": 0.010297246615384491, "trace_hash_ids": [12630061, 12635974, 12658850, 12658851, 12658852], "trace_timestamp_s": 118.8140000000003, "ttft_s": 0.2074611179996282, "turn_id": 1} +{"actual_output_tokens": 204, "cached_tokens": 12432, "effective_input_length": 19448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19448, "latency_s": 3.6131968930130824, "output_length": 204, "proxy_request_id": "1268831:2:1271087:116", "request_id": "1268831:2:1271087:116", "request_type": "coder", "requested_output_tokens": 204, "session_id": "1268831", "t_dispatch_unix": 1779817710.1232924, "t_finish_unix": 1779817713.7364893, "t_first_token_unix": 1779817711.6180453, "tpot_s": 0.01043438156143409, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753], "trace_timestamp_s": 116.3690000000006, "ttft_s": 1.4947516100364737, "turn_id": 2} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 2851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2851, "latency_s": 0.8178806680371054, "output_length": 30, "proxy_request_id": "1271991:1:1271991:124", "request_id": "1271991:1:1271991:124", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1271991", "t_dispatch_unix": 1779817713.097215, "t_finish_unix": 1779817713.9150953, "t_first_token_unix": 1779817713.5024498, "tpot_s": 0.014219920863477706, "trace_hash_ids": [12652320, 12652321, 12652322, 12652323, 12652324, 12659858], "trace_timestamp_s": 119.34500000000025, "ttft_s": 0.4052340060006827, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 17706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17706, "latency_s": 3.2715414189733565, "output_length": 81, "proxy_request_id": "1271328:1:1271328:117", "request_id": "1271328:1:1271328:117", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1271328", "t_dispatch_unix": 1779817710.851001, "t_finish_unix": 1779817714.1225424, "t_first_token_unix": 1779817712.705914, "tpot_s": 0.017703625537251355, "trace_hash_ids": [12623302, 12623303, 12623304, 12623305, 12623306, 12623307, 12623308, 12623309, 12623310, 12623311, 12623312, 12623313, 12623314, 12623315, 12623316, 12637741, 12637742, 12637743, 12637744, 12637745, 12652577, 12652578, 12652579, 12652580, 12652581, 12652582, 12652583, 12652584, 12652585, 12652586, 12652587, 12652588, 12652589, 12652590, 12652591], "trace_timestamp_s": 117.09300000000076, "ttft_s": 1.8549117890070193, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 5302, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5302, "latency_s": 1.0938659099629149, "output_length": 73, "proxy_request_id": "1272085:1:1272085:125", "request_id": "1272085:1:1272085:125", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1272085", "t_dispatch_unix": 1779817713.4330199, "t_finish_unix": 1779817714.5268862, "t_first_token_unix": 1779817713.787306, "tpot_s": 0.010266604611792395, "trace_hash_ids": [12650221, 12650222, 12660755, 12660756, 12660757, 12660758, 12660759, 12660760, 12660761, 12660762, 12660763], "trace_timestamp_s": 119.68000000000029, "ttft_s": 0.3542852999526076, "turn_id": 1} +{"actual_output_tokens": 138, "cached_tokens": 0, "effective_input_length": 751, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 751, "latency_s": 3.5788534019957297, "output_length": 138, "proxy_request_id": "1271459:1:1271459:118", "request_id": "1271459:1:1271459:118", "request_type": "coder", "requested_output_tokens": 138, "session_id": "1271459", "t_dispatch_unix": 1779817711.2703438, "t_finish_unix": 1779817714.8491974, "t_first_token_unix": 1779817711.3710742, "tpot_s": 0.02538571345244269, "trace_hash_ids": [12654275, 12654276], "trace_timestamp_s": 117.51900000000023, "ttft_s": 0.10072976700030267, "turn_id": 1} +{"actual_output_tokens": 239, "cached_tokens": 27968, "effective_input_length": 28323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28323, "latency_s": 2.9604907850152813, "output_length": 239, "proxy_request_id": "1270340:2:1271641:121", "request_id": "1270340:2:1271641:121", "request_type": "coder", "requested_output_tokens": 239, "session_id": "1270340", "t_dispatch_unix": 1779817712.0370684, "t_finish_unix": 1779817714.9975593, "t_first_token_unix": 1779817712.223882, "tpot_s": 0.011653030172338662, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 12656113], "trace_timestamp_s": 118.08300000000054, "ttft_s": 0.18681147298775613, "turn_id": 2} +{"actual_output_tokens": 374, "cached_tokens": 18112, "effective_input_length": 28385, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28385, "latency_s": 6.849177149008028, "output_length": 374, "proxy_request_id": "1266668:2:1270661:115", "request_id": "1266668:2:1270661:115", "request_type": "coder", "requested_output_tokens": 374, "session_id": "1266668", "t_dispatch_unix": 1779817708.4900625, "t_finish_unix": 1779817715.3392398, "t_first_token_unix": 1779817710.6663954, "tpot_s": 0.012526978375315266, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12644244], "trace_timestamp_s": 114.73400000000038, "ttft_s": 2.176330465998035, "turn_id": 2} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 21719, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21719, "latency_s": 4.326371471979655, "output_length": 237, "proxy_request_id": "1271486:1:1271486:119", "request_id": "1271486:1:1271486:119", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1271486", "t_dispatch_unix": 1779817711.364667, "t_finish_unix": 1779817715.6910384, "t_first_token_unix": 1779817713.720787, "tpot_s": 0.008347444398322742, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 41451, 41452, 41453, 41454, 41455, 41456, 41457, 41458, 41459, 41460, 12602726, 12602727, 12602728, 9026439, 12602729, 12602730, 12654424, 12654425], "trace_timestamp_s": 117.60600000000068, "ttft_s": 2.3561182179837488, "turn_id": 1} +{"actual_output_tokens": 490, "cached_tokens": 14336, "effective_input_length": 14404, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14404, "latency_s": 4.507529032009188, "output_length": 490, "proxy_request_id": "1269373:2:1271580:120", "request_id": "1269373:2:1271580:120", "request_type": "coder", "requested_output_tokens": 490, "session_id": "1269373", "t_dispatch_unix": 1779817711.6800327, "t_finish_unix": 1779817716.1875622, "t_first_token_unix": 1779817711.7645838, "tpot_s": 0.00904409421687843, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12655307], "trace_timestamp_s": 117.92900000000009, "ttft_s": 0.08454869396518916, "turn_id": 2} +{"actual_output_tokens": 717, "cached_tokens": 28992, "effective_input_length": 32774, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32774, "latency_s": 9.44496056000935, "output_length": 717, "proxy_request_id": "1262354:6:1270643:114", "request_id": "1262354:6:1270643:114", "request_type": "coder", "requested_output_tokens": 717, "session_id": "1262354", "t_dispatch_unix": 1779817708.4093168, "t_finish_unix": 1779817717.8542774, "t_first_token_unix": 1779817711.640805, "tpot_s": 0.008677652687115293, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12644066], "trace_timestamp_s": 114.65599999999995, "ttft_s": 3.231486658041831, "turn_id": 6} +{"actual_output_tokens": 408, "cached_tokens": 7680, "effective_input_length": 9718, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9718, "latency_s": 4.0176612680079415, "output_length": 408, "proxy_request_id": "1272313:1:1272313:126", "request_id": "1272313:1:1272313:126", "request_type": "coder", "requested_output_tokens": 408, "session_id": "1272313", "t_dispatch_unix": 1779817714.3448176, "t_finish_unix": 1779817718.3624787, "t_first_token_unix": 1779817714.5916634, "tpot_s": 0.00926417208843606, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675], "trace_timestamp_s": 120.59300000000076, "ttft_s": 0.24684490996878594, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 5360, "effective_input_length": 8017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8017, "latency_s": 0.888462939998135, "output_length": 67, "proxy_request_id": "1272085:2:1273645:130", "request_id": "1272085:2:1273645:130", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1272085", "t_dispatch_unix": 1779817719.0650456, "t_finish_unix": 1779817719.9535086, "t_first_token_unix": 1779817719.3602169, "tpot_s": 0.008983729408955145, "trace_hash_ids": [12650221, 12650222, 12660755, 12660756, 12660757, 12660758, 12660759, 12660760, 12660761, 12660762, 12676216, 12676217, 12676218, 12676219, 12676220, 12676221], "trace_timestamp_s": 125.3130000000001, "ttft_s": 0.2951699969707988, "turn_id": 2} +{"actual_output_tokens": 103, "cached_tokens": 30880, "effective_input_length": 31283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31283, "latency_s": 0.9135984649765305, "output_length": 103, "proxy_request_id": "1260327:3:1273741:132", "request_id": "1260327:3:1273741:132", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1260327", "t_dispatch_unix": 1779817719.46387, "t_finish_unix": 1779817720.377468, "t_first_token_unix": 1779817719.6770303, "tpot_s": 0.006864462705790156, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12677039], "trace_timestamp_s": 125.71200000000044, "ttft_s": 0.21315835800487548, "turn_id": 3} +{"actual_output_tokens": 380, "cached_tokens": 28752, "effective_input_length": 33711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33711, "latency_s": 3.7178892249939963, "output_length": 380, "proxy_request_id": "1266668:3:1273119:128", "request_id": "1266668:3:1273119:128", "request_type": "coder", "requested_output_tokens": 380, "session_id": "1266668", "t_dispatch_unix": 1779817717.1167152, "t_finish_unix": 1779817720.834604, "t_first_token_unix": 1779817718.2702563, "tpot_s": 0.006765304385170852, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12670179], "trace_timestamp_s": 123.36300000000028, "ttft_s": 1.153539011022076, "turn_id": 3} +{"actual_output_tokens": 670, "cached_tokens": 112880, "effective_input_length": 113172, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113172, "latency_s": 11.513041255995631, "output_length": 670, "proxy_request_id": "1258859:2:1264639:81", "request_id": "1258859:2:1264639:81", "request_type": "coder", "requested_output_tokens": 670, "session_id": "1258859", "t_dispatch_unix": 1779817710.0837786, "t_finish_unix": 1779817721.5968199, "t_first_token_unix": 1779817710.490718, "tpot_s": 0.016600596406570148, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12585542], "trace_timestamp_s": 94.09700000000066, "ttft_s": 0.4069367880001664, "turn_id": 2} +{"actual_output_tokens": 3514, "cached_tokens": 0, "effective_input_length": 15283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15283, "latency_s": 41.3072389580193, "output_length": 3514, "proxy_request_id": "1262727:1:1262727:72", "request_id": "1262727:1:1262727:72", "request_type": "coder", "requested_output_tokens": 3514, "session_id": "1262727", "t_dispatch_unix": 1779817680.922893, "t_finish_unix": 1779817722.2301319, "t_first_token_unix": 1779817682.3376334, "tpot_s": 0.01135558227241228, "trace_hash_ids": [1978, 1979, 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007], "trace_timestamp_s": 87.16600000000017, "ttft_s": 1.4147389000281692, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 6208, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6208, "latency_s": 0.8819624910247512, "output_length": 92, "proxy_request_id": "1274405:1:1274405:134", "request_id": "1274405:1:1274405:134", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1274405", "t_dispatch_unix": 1779817721.863401, "t_finish_unix": 1779817722.745364, "t_first_token_unix": 1779817722.2776918, "tpot_s": 0.005136177846317558, "trace_hash_ids": [12683425, 12683426, 12683427, 12683428, 12683429, 12683430, 12683431, 12683432, 12683433, 12683434, 12683435, 12683436, 12683437], "trace_timestamp_s": 128.11000000000058, "ttft_s": 0.41428991698194295, "turn_id": 1} +{"actual_output_tokens": 553, "cached_tokens": 12800, "effective_input_length": 21963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21963, "latency_s": 5.598484514048323, "output_length": 553, "proxy_request_id": "1273203:1:1273203:129", "request_id": "1273203:1:1273203:129", "request_type": "coder", "requested_output_tokens": 553, "session_id": "1273203", "t_dispatch_unix": 1779817717.4210207, "t_finish_unix": 1779817723.0195053, "t_first_token_unix": 1779817718.819707, "tpot_s": 0.007607820059765008, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 788374, 12645257, 12645258, 109688, 109689, 109690, 109691, 109692, 109693, 12645259, 12645260, 2777791, 2777792, 12645261, 12645262, 12671102, 12671103, 12671104], "trace_timestamp_s": 123.66700000000037, "ttft_s": 1.3986841890146025, "turn_id": 1} +{"actual_output_tokens": 439, "cached_tokens": 17776, "effective_input_length": 25108, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25108, "latency_s": 4.575806265056599, "output_length": 439, "proxy_request_id": "1271328:2:1273711:131", "request_id": "1271328:2:1273711:131", "request_type": "coder", "requested_output_tokens": 439, "session_id": "1271328", "t_dispatch_unix": 1779817719.3249092, "t_finish_unix": 1779817723.9007158, "t_first_token_unix": 1779817720.5914826, "tpot_s": 0.007554580390396992, "trace_hash_ids": [12623302, 12623303, 12623304, 12623305, 12623306, 12623307, 12623308, 12623309, 12623310, 12623311, 12623312, 12623313, 12623314, 12623315, 12623316, 12637741, 12637742, 12637743, 12637744, 12637745, 12652577, 12652578, 12652579, 12652580, 12652581, 12652582, 12652583, 12652584, 12652585, 12652586, 12652587, 12652588, 12652589, 12652590, 12668017, 12668018, 12668019, 12668020, 12668021, 12668022, 12668023, 12668024, 12668025, 12668026, 12676731, 12676732, 12676733, 12676734, 12676735, 12676736], "trace_timestamp_s": 125.57100000000082, "ttft_s": 1.2665712290327065, "turn_id": 2} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 10506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10506, "latency_s": 1.0691521190456115, "output_length": 48, "proxy_request_id": "1274890:1:1274890:135", "request_id": "1274890:1:1274890:135", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1274890", "t_dispatch_unix": 1779817723.392174, "t_finish_unix": 1779817724.4613261, "t_first_token_unix": 1779817724.2161617, "tpot_s": 0.0052107893403599715, "trace_hash_ids": [12642876, 12642877, 12654445, 12654446, 12654447, 12654448, 12654449, 12668949, 12668950, 12668951, 12668952, 12668953, 12679551, 12679552, 12679553, 12679554, 12679555, 12687863, 12687864, 12687865, 12687866], "trace_timestamp_s": 129.63300000000072, "ttft_s": 0.8239851810503751, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 7794, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7794, "latency_s": 0.5971285619889386, "output_length": 12, "proxy_request_id": "1275433:1:1275433:137", "request_id": "1275433:1:1275433:137", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1275433", "t_dispatch_unix": 1779817725.139626, "t_finish_unix": 1779817725.7367544, "t_first_token_unix": 1779817725.6881926, "tpot_s": 0.004389736087019132, "trace_hash_ids": [12648375, 12648376, 12656103, 12660867, 12660868, 12660869, 12660870, 12681196, 12681197, 12681198, 12681199, 12681200, 12692620, 12692621, 12692622, 12692623], "trace_timestamp_s": 131.38500000000022, "ttft_s": 0.5485646540182643, "turn_id": 1} +{"actual_output_tokens": 4, "cached_tokens": 7456, "effective_input_length": 7463, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7463, "latency_s": 0.052371628989931196, "output_length": 4, "proxy_request_id": "1275433:2:1276027:139", "request_id": "1275433:2:1276027:139", "request_type": "coder", "requested_output_tokens": 4, "session_id": "1275433", "t_dispatch_unix": 1779817727.411099, "t_finish_unix": 1779817727.4634702, "t_first_token_unix": 1779817727.4503016, "tpot_s": 0.004267053329385817, "trace_hash_ids": [12698576, 12698577, 12698578, 12698579, 12698580, 12698581, 12698582, 12698583, 12698584, 12698585, 12698586, 12698587, 12698588, 12698589, 12698590], "trace_timestamp_s": 133.65700000000015, "ttft_s": 0.03920137998647988, "turn_id": 2} +{"actual_output_tokens": 235, "cached_tokens": 10112, "effective_input_length": 10639, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10639, "latency_s": 1.4321446429821663, "output_length": 235, "proxy_request_id": "1272313:2:1275926:138", "request_id": "1272313:2:1275926:138", "request_type": "coder", "requested_output_tokens": 235, "session_id": "1272313", "t_dispatch_unix": 1779817727.079567, "t_finish_unix": 1779817728.5117116, "t_first_token_unix": 1779817727.2440212, "tpot_s": 0.005416154264946046, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12697306], "trace_timestamp_s": 133.32700000000023, "ttft_s": 0.16445285396184772, "turn_id": 2} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 110048, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 110048, "latency_s": 40.80017747700913, "output_length": 93, "proxy_request_id": "1264679:1:1264679:82", "request_id": "1264679:1:1264679:82", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1264679", "t_dispatch_unix": 1779817688.0198853, "t_finish_unix": 1779817728.8200624, "t_first_token_unix": 1779817727.7445896, "tpot_s": 0.01168564895709531, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281], "trace_timestamp_s": 94.22100000000046, "ttft_s": 39.724702762963716, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 15783, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15783, "latency_s": 1.6244819010025822, "output_length": 35, "proxy_request_id": "1276111:1:1276111:140", "request_id": "1276111:1:1276111:140", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1276111", "t_dispatch_unix": 1779817727.759214, "t_finish_unix": 1779817729.383696, "t_first_token_unix": 1779817729.1995308, "tpot_s": 0.005407689998665934, "trace_hash_ids": [12617937, 12617938, 12617939, 12617940, 12617941, 12617942, 12617943, 12617944, 12617945, 12617946, 12637526, 12637527, 12637528, 12637529, 12637530, 12637531, 12637532, 12637533, 12643664, 12659893, 12659894, 12659895, 12659896, 12659897, 12676458, 12676459, 12682485, 12682486, 12682487, 12682488, 12699285], "trace_timestamp_s": 134.0020000000004, "ttft_s": 1.4403151780134067, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 17280, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17280, "latency_s": 2.034235574014019, "output_length": 67, "proxy_request_id": "1276136:1:1276136:141", "request_id": "1276136:1:1276136:141", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1276136", "t_dispatch_unix": 1779817727.8426692, "t_finish_unix": 1779817729.8769047, "t_first_token_unix": 1779817729.5115945, "tpot_s": 0.0055305929395906405, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12699544], "trace_timestamp_s": 134.08500000000004, "ttft_s": 1.668921276985202, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 6288, "effective_input_length": 6360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6360, "latency_s": 0.20842011302011088, "output_length": 34, "proxy_request_id": "1274405:2:1276717:144", "request_id": "1274405:2:1276717:144", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1274405", "t_dispatch_unix": 1779817729.8742728, "t_finish_unix": 1779817730.0826926, "t_first_token_unix": 1779817729.9176404, "tpot_s": 0.0049943948485606324, "trace_hash_ids": [12683425, 12683426, 12683427, 12683428, 12683429, 12683430, 12683431, 12683432, 12683433, 12683434, 12683435, 12683436, 12705637], "trace_timestamp_s": 136.1230000000005, "ttft_s": 0.043366505997255445, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 11292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11292, "latency_s": 1.058001630997751, "output_length": 31, "proxy_request_id": "1271991:2:1276999:145", "request_id": "1271991:2:1276999:145", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1271991", "t_dispatch_unix": 1779817730.8599837, "t_finish_unix": 1779817731.917985, "t_first_token_unix": 1779817731.7612152, "tpot_s": 0.005215849366504699, "trace_hash_ids": [12652320, 12652321, 12652322, 12652323, 12652324, 12677010, 12677011, 12677012, 12677013, 12686644, 12686645, 12686646, 12686647, 12686648, 12693874, 12700012, 12700013, 12700014, 12708525, 12708526, 12708527, 12708528, 12708529], "trace_timestamp_s": 137.10600000000068, "ttft_s": 0.9012298380257562, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 4729, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4729, "latency_s": 0.5236134000006132, "output_length": 29, "proxy_request_id": "1277533:1:1277533:150", "request_id": "1277533:1:1277533:150", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1277533", "t_dispatch_unix": 1779817732.8929844, "t_finish_unix": 1779817733.4165978, "t_first_token_unix": 1779817733.2035208, "tpot_s": 0.007598839429972161, "trace_hash_ids": [12707525, 12707526, 12707527, 12707528, 12707529, 12707530, 12707531, 12707532, 12714414, 12714415], "trace_timestamp_s": 139.14000000000033, "ttft_s": 0.3105351259582676, "turn_id": 1} +{"actual_output_tokens": 371, "cached_tokens": 33488, "effective_input_length": 33524, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33524, "latency_s": 2.8604125260026194, "output_length": 371, "proxy_request_id": "1262354:7:1277104:146", "request_id": "1262354:7:1277104:146", "request_type": "coder", "requested_output_tokens": 371, "session_id": "1262354", "t_dispatch_unix": 1779817731.2651067, "t_finish_unix": 1779817734.125519, "t_first_token_unix": 1779817731.34984, "tpot_s": 0.007501015051368725, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12709527], "trace_timestamp_s": 137.51299999999992, "ttft_s": 0.08473130100173876, "turn_id": 7} +{"actual_output_tokens": 97, "cached_tokens": 17408, "effective_input_length": 27221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27221, "latency_s": 2.620122443011496, "output_length": 97, "proxy_request_id": "1277428:1:1277428:149", "request_id": "1277428:1:1277428:149", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1277428", "t_dispatch_unix": 1779817732.4647512, "t_finish_unix": 1779817735.0848732, "t_first_token_unix": 1779817734.2673917, "tpot_s": 0.008511211000344096, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12713186], "trace_timestamp_s": 138.70600000000013, "ttft_s": 1.8026387779973447, "turn_id": 1} +{"actual_output_tokens": 272, "cached_tokens": 22512, "effective_input_length": 22573, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22573, "latency_s": 2.570222945010755, "output_length": 272, "proxy_request_id": "1273203:2:1277744:152", "request_id": "1273203:2:1277744:152", "request_type": "coder", "requested_output_tokens": 272, "session_id": "1273203", "t_dispatch_unix": 1779817733.6134229, "t_finish_unix": 1779817736.183646, "t_first_token_unix": 1779817734.3085778, "tpot_s": 0.006917906778596506, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 788374, 12645257, 12645258, 109688, 109689, 109690, 109691, 109692, 109693, 12645259, 12645260, 2777791, 2777792, 12645261, 12645262, 12671102, 12671103, 12671104, 12717031, 12717032], "trace_timestamp_s": 139.86200000000008, "ttft_s": 0.6951525319600478, "turn_id": 2} +{"actual_output_tokens": 437, "cached_tokens": 0, "effective_input_length": 8884, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8884, "latency_s": 4.062238365993835, "output_length": 437, "proxy_request_id": "1271459:2:1277544:151", "request_id": "1271459:2:1277544:151", "request_type": "coder", "requested_output_tokens": 437, "session_id": "1271459", "t_dispatch_unix": 1779817732.929909, "t_finish_unix": 1779817736.9921474, "t_first_token_unix": 1779817733.6232204, "tpot_s": 0.00772611625463736, "trace_hash_ids": [12654275, 12668550, 12668551, 12668552, 12668553, 12668554, 12668555, 12668556, 12681215, 12681216, 12703400, 12703401, 12703402, 12703403, 12714450, 12714451, 12714452, 12714453], "trace_timestamp_s": 139.17600000000039, "ttft_s": 0.6933102839975618, "turn_id": 2} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 8704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8704, "latency_s": 8.253552277979907, "output_length": 50, "proxy_request_id": "1276498:1:1276498:142", "request_id": "1276498:1:1276498:142", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1276498", "t_dispatch_unix": 1779817729.090994, "t_finish_unix": 1779817737.344551, "t_first_token_unix": 1779817729.7425103, "tpot_s": 0.15513860091818876, "trace_hash_ids": [12669649, 12669650, 12669651, 12669652, 12669653, 12669654, 12669655, 12669656, 12680491, 12680492, 12689566, 12689567, 12695712, 12695713, 12695714, 12695715, 12703411], "trace_timestamp_s": 135.33700000000044, "ttft_s": 0.6515147649915889, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 10512, "effective_input_length": 18093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18093, "latency_s": 22.669702245970257, "output_length": 44, "proxy_request_id": "1265942:3:1272453:127", "request_id": "1265942:3:1272453:127", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1265942", "t_dispatch_unix": 1779817714.894876, "t_finish_unix": 1779817737.5645785, "t_first_token_unix": 1779817736.483811, "tpot_s": 0.025126972953182492, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596, 12609655, 12609656, 12609657, 12609658, 12618768, 12618769, 12618770, 12618771, 12618772, 12618773, 12618774, 12618775, 12635330, 12635331, 12635332, 12635333, 12643363, 12643364, 12643365, 12643366, 12643367, 12654593, 12654594, 12663906, 12663907, 12663908, 12663909, 12663910], "trace_timestamp_s": 121.14100000000053, "ttft_s": 21.58893338101916, "turn_id": 3} +{"actual_output_tokens": 66, "cached_tokens": 31376, "effective_input_length": 31430, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31430, "latency_s": 3.168894029047806, "output_length": 66, "proxy_request_id": "1260327:4:1277974:154", "request_id": "1260327:4:1277974:154", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1260327", "t_dispatch_unix": 1779817734.5130672, "t_finish_unix": 1779817737.68196, "t_first_token_unix": 1779817737.145204, "tpot_s": 0.008254049722857487, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041], "trace_timestamp_s": 140.76100000000042, "ttft_s": 2.6321357110282406, "turn_id": 4} +{"actual_output_tokens": 77, "cached_tokens": 18128, "effective_input_length": 21229, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21229, "latency_s": 1.820143279968761, "output_length": 77, "proxy_request_id": "1265942:4:1274182:133", "request_id": "1265942:4:1274182:133", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1265942", "t_dispatch_unix": 1779817737.5737278, "t_finish_unix": 1779817739.3938708, "t_first_token_unix": 1779817738.1441755, "tpot_s": 0.016437621250301356, "trace_hash_ids": [12681319, 12681320, 12681321, 12681322, 12681323, 12681324, 12681325, 12681326, 12681327, 12681328, 12681329, 12681330, 12681331, 12681332, 12681333, 12681334, 12681335, 12681336, 12681337, 12681338, 12681339, 12681340, 12681341, 12681342, 12681343, 12681344, 12681345, 12681346, 12681347, 12681348, 12681349, 12681350, 12681351, 12681352, 12681353, 12681354, 12681355, 12681356, 12681357, 12681358, 12681359, 12681360], "trace_timestamp_s": 127.1860000000006, "ttft_s": 0.5704464049777016, "turn_id": 4} +{"actual_output_tokens": 34, "cached_tokens": 8752, "effective_input_length": 16650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16650, "latency_s": 1.3817438800469972, "output_length": 34, "proxy_request_id": "1276498:2:1278996:157", "request_id": "1276498:2:1278996:157", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1276498", "t_dispatch_unix": 1779817738.0473304, "t_finish_unix": 1779817739.4290743, "t_first_token_unix": 1779817739.0249248, "tpot_s": 0.012239573424625578, "trace_hash_ids": [12669649, 12669650, 12669651, 12669652, 12669653, 12669654, 12669655, 12669656, 12680491, 12680492, 12689566, 12689567, 12695712, 12695713, 12695714, 12695715, 12703411, 12712744, 12712745, 12712746, 12712747, 12712748, 12721667, 12721668, 12721669, 12721670, 12728508, 12728509, 12728510, 12728511, 12728512, 12728513, 12728514], "trace_timestamp_s": 144.28999999999996, "ttft_s": 0.9775926700094715, "turn_id": 2} +{"actual_output_tokens": 170, "cached_tokens": 0, "effective_input_length": 93430, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93430, "latency_s": 31.130369350954425, "output_length": 170, "proxy_request_id": "1270606:1:1270606:113", "request_id": "1270606:1:1270606:113", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1270606", "t_dispatch_unix": 1779817708.302696, "t_finish_unix": 1779817739.433065, "t_first_token_unix": 1779817737.4047568, "tpot_s": 0.012000165934834255, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 12643740, 12643741, 12643742, 12643743, 12643744, 12643745, 12643746, 12643747, 12643748, 12643749, 12643750, 12643751, 12643752, 12643753, 12643754, 12643755, 12643756, 12643757, 12643758, 12643759, 12643760, 12643761, 12643762, 12643763, 12643764, 12643765, 12643766, 12643767, 12643768, 12643769, 12643770, 12643771, 12643772, 12643773, 12643774, 12643775, 12643776, 12643777, 12643778, 12643779, 12643780, 12643781, 12643782, 12643783, 12643784, 12643785, 12643786, 12643787, 12643788, 12643789, 12643790, 12643791, 12643792, 12643793, 12643794, 12643795, 12643796, 12643797, 12643798, 12643799, 12643800, 12643801, 12643802, 12643803, 12643804, 12643805, 12643806, 12643807, 12643808, 12643809, 12643810, 12643811, 12643812, 12643813, 12643814, 12643815, 12643816, 12643817, 12643818, 12643819, 12643820, 12643821, 12643822, 12643823, 12643824, 12643825, 12643826, 12643827], "trace_timestamp_s": 114.51500000000033, "ttft_s": 29.10205877898261, "turn_id": 1} +{"actual_output_tokens": 147, "cached_tokens": 3584, "effective_input_length": 102074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102074, "latency_s": 38.11839136801427, "output_length": 147, "proxy_request_id": "1268630:1:1268630:98", "request_id": "1268630:1:1268630:98", "request_type": "coder", "requested_output_tokens": 147, "session_id": "1268630", "t_dispatch_unix": 1779817701.6064541, "t_finish_unix": 1779817739.7248454, "t_first_token_unix": 1779817736.4998896, "tpot_s": 0.022086566369916783, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 5771, 5772, 5773, 5774, 5775, 5776, 5777, 5778, 5779, 5780, 5781, 5782, 5783, 317795, 317796, 317797, 3750293, 3750294, 3750295, 1646386, 11179983, 11179984, 270680, 270681, 11179985, 470650, 11179986, 11179987, 11179988, 11179989, 11179990, 11179991, 11179992, 11179993, 11179994, 11179995, 11179996, 11179997, 11179998, 11179999, 11180000, 11180001, 11180002, 11180003, 11180004, 11180005, 11180006, 11180007, 11180008, 11180009, 11180010, 395622, 395623, 282458, 2459748, 11180011, 419587, 419588, 419589, 427120, 11180012, 11180013, 11180014, 11180015, 11180016, 11180017, 11180018, 11180019, 11180020, 11180021, 11180022, 11180023, 11180024, 11180025, 11180026, 11180027, 11180028, 11180029, 11180030, 11180031, 11180032, 11180033, 11180034, 11180035, 11180036, 11180037, 12624518, 12624519, 12624520, 12624521, 12624522, 12624523, 12624524, 12624525, 12624526, 12624527, 12624528, 12624529, 12624530, 12624531, 12624532, 12624533, 12624534, 12624535, 12624536, 12624537, 12624538, 12624539, 12624540, 12624541, 12624542, 12624543, 12624544, 12624545, 12624546, 12624547, 12624548, 12624549, 12624550, 12624551, 12624552, 12624553, 12624554, 12624555, 12624556, 12624557, 12624558, 12624559, 12624560, 12624561, 12624562, 12624563, 12624564, 12624565, 12624566, 12624567, 12624568, 12624569, 12624570, 12624571, 12624572, 12624573, 12624574, 12624575, 12624576, 12624577, 12624578, 12624579, 12624580, 12624581, 12624582, 12624583, 12624584, 12624585, 12624586, 12624587, 12624588, 12624589, 12624590, 12624591, 12624592, 12624593, 12624594, 12624595, 12624596, 12624597, 12624598, 12624599, 12624600, 12624601, 12624602, 12624603, 12624604, 12624605, 12624606, 12624607, 12624608, 12624609, 12624610, 12624611, 12624612, 12624613, 12624614, 12624615, 12624616, 12624617, 12624618, 12624619, 12624620, 12624621, 12624622], "trace_timestamp_s": 107.81600000000071, "ttft_s": 34.89343378902413, "turn_id": 1} +{"actual_output_tokens": 237, "cached_tokens": 19648, "effective_input_length": 31845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31845, "latency_s": 9.23881402501138, "output_length": 237, "proxy_request_id": "1268831:3:1277112:147", "request_id": "1268831:3:1277112:147", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1268831", "t_dispatch_unix": 1779817731.3047512, "t_finish_unix": 1779817740.543565, "t_first_token_unix": 1779817736.6343777, "tpot_s": 0.01656293503814811, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12709565], "trace_timestamp_s": 137.54899999999998, "ttft_s": 5.3296248280094005, "turn_id": 3} +{"actual_output_tokens": 210, "cached_tokens": 0, "effective_input_length": 11549, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11549, "latency_s": 2.1251147930161096, "output_length": 210, "proxy_request_id": "1272313:3:1279208:159", "request_id": "1272313:3:1279208:159", "request_type": "coder", "requested_output_tokens": 210, "session_id": "1272313", "t_dispatch_unix": 1779817738.7077272, "t_finish_unix": 1779817740.8328416, "t_first_token_unix": 1779817739.6684272, "tpot_s": 0.005570224492697036, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12730483], "trace_timestamp_s": 144.95600000000013, "ttft_s": 0.9606990120373666, "turn_id": 3} +{"actual_output_tokens": 237, "cached_tokens": 12800, "effective_input_length": 20136, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20136, "latency_s": 2.974837462999858, "output_length": 237, "proxy_request_id": "1279412:1:1279412:160", "request_id": "1279412:1:1279412:160", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1279412", "t_dispatch_unix": 1779817739.5115657, "t_finish_unix": 1779817742.486403, "t_first_token_unix": 1779817740.5593262, "tpot_s": 0.008164549220286279, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12732189], "trace_timestamp_s": 145.75700000000052, "ttft_s": 1.0477589970105328, "turn_id": 1} +{"actual_output_tokens": 504, "cached_tokens": 57632, "effective_input_length": 58752, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58752, "latency_s": 6.487098434998188, "output_length": 504, "proxy_request_id": "1253804:5:1278488:156", "request_id": "1253804:5:1278488:156", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1253804", "t_dispatch_unix": 1779817736.1886451, "t_finish_unix": 1779817742.6757426, "t_first_token_unix": 1779817736.958033, "tpot_s": 0.011366528634210608, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261], "trace_timestamp_s": 142.4350000000004, "ttft_s": 0.7693861029692926, "turn_id": 5} +{"actual_output_tokens": 177, "cached_tokens": 32080, "effective_input_length": 32346, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32346, "latency_s": 2.190339923952706, "output_length": 177, "proxy_request_id": "1268831:4:1279168:158", "request_id": "1268831:4:1279168:158", "request_type": "coder", "requested_output_tokens": 177, "session_id": "1268831", "t_dispatch_unix": 1779817740.5456572, "t_finish_unix": 1779817742.7359972, "t_first_token_unix": 1779817740.728586, "tpot_s": 0.011404487437341066, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12730103, 12730104], "trace_timestamp_s": 144.77600000000075, "ttft_s": 0.1829266999848187, "turn_id": 4} +{"actual_output_tokens": 659, "cached_tokens": 0, "effective_input_length": 24222, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24222, "latency_s": 8.542414130992256, "output_length": 659, "proxy_request_id": "1277909:1:1277909:153", "request_id": "1277909:1:1277909:153", "request_type": "coder", "requested_output_tokens": 659, "session_id": "1277909", "t_dispatch_unix": 1779817734.315541, "t_finish_unix": 1779817742.857955, "t_first_token_unix": 1779817737.14214, "tpot_s": 0.008686329445293553, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12718539], "trace_timestamp_s": 140.558, "ttft_s": 2.8265969709609635, "turn_id": 1} +{"actual_output_tokens": 59, "cached_tokens": 33888, "effective_input_length": 33928, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33928, "latency_s": 0.45860474300570786, "output_length": 59, "proxy_request_id": "1262354:8:1280463:163", "request_id": "1262354:8:1280463:163", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1262354", "t_dispatch_unix": 1779817742.8242145, "t_finish_unix": 1779817743.282819, "t_first_token_unix": 1779817742.9109051, "tpot_s": 0.0064083753627371684, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12742762], "trace_timestamp_s": 149.07100000000082, "ttft_s": 0.08668841095641255, "turn_id": 8} +{"actual_output_tokens": 531, "cached_tokens": 34080, "effective_input_length": 49380, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49380, "latency_s": 14.609488695045002, "output_length": 531, "proxy_request_id": "1266668:4:1276519:143", "request_id": "1266668:4:1276519:143", "request_type": "coder", "requested_output_tokens": 531, "session_id": "1266668", "t_dispatch_unix": 1779817729.1467957, "t_finish_unix": 1779817743.7562842, "t_first_token_unix": 1779817734.0356102, "tpot_s": 0.018340434167942666, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12703762], "trace_timestamp_s": 135.38799999999992, "ttft_s": 4.8888112240238115, "turn_id": 4} +{"actual_output_tokens": 606, "cached_tokens": 14880, "effective_input_length": 16900, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16900, "latency_s": 12.020442562992685, "output_length": 606, "proxy_request_id": "1269373:3:1277365:148", "request_id": "1269373:3:1277365:148", "request_type": "coder", "requested_output_tokens": 606, "session_id": "1269373", "t_dispatch_unix": 1779817732.1824281, "t_finish_unix": 1779817744.2028708, "t_first_token_unix": 1779817736.6354678, "tpot_s": 0.012507680940445636, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12712211], "trace_timestamp_s": 138.4300000000003, "ttft_s": 4.453038079023827, "turn_id": 3} +{"actual_output_tokens": 409, "cached_tokens": 12688, "effective_input_length": 12765, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12765, "latency_s": 3.2823725640191697, "output_length": 409, "proxy_request_id": "1268861:2:1280530:164", "request_id": "1268861:2:1280530:164", "request_type": "coder", "requested_output_tokens": 409, "session_id": "1268861", "t_dispatch_unix": 1779817743.0409067, "t_finish_unix": 1779817746.3232796, "t_first_token_unix": 1779817743.11228, "tpot_s": 0.007869309225426667, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481], "trace_timestamp_s": 149.28999999999996, "ttft_s": 0.07137134904041886, "turn_id": 2} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 9370, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9370, "latency_s": 0.8779857890331186, "output_length": 33, "proxy_request_id": "1281887:1:1281887:171", "request_id": "1281887:1:1281887:171", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1281887", "t_dispatch_unix": 1779817747.6836083, "t_finish_unix": 1779817748.5615935, "t_first_token_unix": 1779817748.3957558, "tpot_s": 0.005171376064026845, "trace_hash_ids": [12732193, 12732194, 12749330, 12749331, 12749332, 12749333, 12749334, 12749335, 12749336, 12749337, 12749338, 12749339, 12749340, 12749341, 12754932, 12754933, 12754934, 12754935, 12754936], "trace_timestamp_s": 153.9290000000001, "ttft_s": 0.7121466639800929, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 4972, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4972, "latency_s": 0.5868062499794178, "output_length": 34, "proxy_request_id": "1282082:1:1282082:173", "request_id": "1282082:1:1282082:173", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1282082", "t_dispatch_unix": 1779817748.358588, "t_finish_unix": 1779817748.9453943, "t_first_token_unix": 1779817748.7040923, "tpot_s": 0.007300809364427219, "trace_hash_ids": [12740904, 12740905, 12740906, 12740907, 12757070, 12757071, 12757072, 12757073, 12757074, 12757075], "trace_timestamp_s": 154.60600000000068, "ttft_s": 0.34550315799424425, "turn_id": 1} +{"actual_output_tokens": 63, "cached_tokens": 18944, "effective_input_length": 126924, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126924, "latency_s": 51.56575610797154, "output_length": 63, "proxy_request_id": "1267915:1:1267915:96", "request_id": "1267915:1:1267915:96", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1267915", "t_dispatch_unix": 1779817699.024015, "t_finish_unix": 1779817750.5897708, "t_first_token_unix": 1779817749.3087263, "tpot_s": 0.020655495903244423, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12617736, 8430096, 227717, 2410525, 7163, 7164, 7165, 7166, 7167, 7168, 7169, 7170, 7171, 7172, 7173, 7174, 7175, 7176, 7177, 7178, 7179, 7180, 7181, 7182, 7183, 7184, 8430097, 8430098, 8430099, 8430100, 18464, 18465, 8430101, 8430102, 8546028, 9019404, 9169593, 9266923, 9266924, 9266925, 9266926, 9266927, 9266928, 9266929, 9266930, 9266931, 9266932, 9266933, 9266934, 9266935, 9266936, 9266937, 9266938, 9266939, 9341348, 9533636, 9533637, 9533638, 9533639, 9533640, 9533641, 9533642, 9533643, 9533644, 9533645, 9533646, 9533647, 9533648, 9533649, 9533650, 9533651, 9533652, 9533653, 9533654, 9706094, 9706095, 9865188, 9865189, 9865190, 9970890, 10129168, 10129169, 10129170, 10129171, 10129172, 10129173, 10129174, 10129175, 10129176, 10129177, 10129178, 10129179, 10129180, 10129181, 10129182, 10129183, 10129184, 10209871, 10209872, 10209873, 10209874, 10209875, 10209876, 10209877, 10209878, 10209879, 10209880, 10209881, 10209882, 10209883, 10209884, 10209885, 10209886, 10209887, 10274360, 10274361, 10377876, 10377877, 10562058, 10646138, 10646139, 10646140, 10826772, 10826773, 10961137, 10961138, 10961139, 10961140, 10961141, 10961142, 10961143, 11025646, 11025647, 11025648, 11025649, 11025650, 11025651, 11207611, 11207612, 11207613, 11207614, 11207615, 11207616, 11207617, 11395719, 11395720, 11395721, 11395722, 11395723, 11395724, 11395725, 11395726, 11395727, 11395728, 11395729, 11395730, 11395731, 11497760, 11742899, 11895597, 12087820, 12087821, 12087822, 12087823, 12087824, 12087825, 12087826, 12087827, 12087828, 12087829, 12087830, 12087831, 12134161, 12292796, 12292797, 12239354, 12239355, 12239356, 12239357, 12239358, 12239359, 12239360, 12239361, 12239362, 12292798, 12292799, 12292800, 12292801, 12292802, 12292803, 12292804, 12292805, 12292806, 12292807, 12292808, 12292809, 12395930, 12395931, 12395932, 12395933, 12395934, 12395935, 12395936, 12395937, 12395938, 12395939, 12395940, 12395941, 12395942, 12455493, 12617737], "trace_timestamp_s": 105.23199999999997, "ttft_s": 50.284709134022705, "turn_id": 1} +{"actual_output_tokens": 120, "cached_tokens": 14096, "effective_input_length": 23650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23650, "latency_s": 39.07013146899408, "output_length": 120, "proxy_request_id": "1265128:2:1271655:122", "request_id": "1265128:2:1271655:122", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1265128", "t_dispatch_unix": 1779817711.8749516, "t_finish_unix": 1779817750.9450836, "t_first_token_unix": 1779817749.788094, "tpot_s": 0.009719353949381117, "trace_hash_ids": [12656235, 12656236, 12656237, 12656238, 12656239, 12656240, 12656241, 12656242, 12656243, 12656244, 12656245, 12656246, 12656247, 12656248, 12656249, 12656250, 12656251, 12656252, 12656253, 12656254, 12656255, 12656256, 12656257, 12656258, 12656259, 12656260, 12656261, 12656262, 12656263, 12656264, 12656265, 12656266, 12656267, 12656268, 12656269, 12656270, 12656271, 12656272, 12656273, 12656274, 12656275, 12656276, 12656277, 12656278, 12656279, 12656280, 12656281], "trace_timestamp_s": 118.11500000000069, "ttft_s": 37.91313959000399, "turn_id": 2} +{"actual_output_tokens": 93, "cached_tokens": 31488, "effective_input_length": 42023, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42023, "latency_s": 3.845238187990617, "output_length": 93, "proxy_request_id": "1260327:5:1281915:172", "request_id": "1260327:5:1281915:172", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1260327", "t_dispatch_unix": 1779817747.7978334, "t_finish_unix": 1779817751.6430712, "t_first_token_unix": 1779817750.5768452, "tpot_s": 0.011586784705919537, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12755397], "trace_timestamp_s": 154.04100000000017, "ttft_s": 2.7789963200339116, "turn_id": 5} +{"actual_output_tokens": 221, "cached_tokens": 33984, "effective_input_length": 34028, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34028, "latency_s": 4.975876855023671, "output_length": 221, "proxy_request_id": "1262354:9:1281632:169", "request_id": "1262354:9:1281632:169", "request_type": "coder", "requested_output_tokens": 221, "session_id": "1262354", "t_dispatch_unix": 1779817746.8173292, "t_finish_unix": 1779817751.793206, "t_first_token_unix": 1779817746.901339, "tpot_s": 0.022234287222752093, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12752803], "trace_timestamp_s": 153.0650000000005, "ttft_s": 0.08400802197866142, "turn_id": 9} +{"actual_output_tokens": 266, "cached_tokens": 17504, "effective_input_length": 30262, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30262, "latency_s": 7.941296265053097, "output_length": 266, "proxy_request_id": "1269373:4:1280765:165", "request_id": "1269373:4:1280765:165", "request_type": "coder", "requested_output_tokens": 266, "session_id": "1269373", "t_dispatch_unix": 1779817744.2091117, "t_finish_unix": 1779817752.1504085, "t_first_token_unix": 1779817746.651731, "tpot_s": 0.02074836943395225, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12745691], "trace_timestamp_s": 150.16900000000078, "ttft_s": 2.442616390006151, "turn_id": 4} +{"actual_output_tokens": 6, "cached_tokens": 0, "effective_input_length": 16299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16299, "latency_s": 1.5199537560110912, "output_length": 6, "proxy_request_id": "1277533:2:1282872:175", "request_id": "1277533:2:1282872:175", "request_type": "coder", "requested_output_tokens": 6, "session_id": "1277533", "t_dispatch_unix": 1779817751.1011398, "t_finish_unix": 1779817752.6210928, "t_first_token_unix": 1779817752.6062055, "tpot_s": 0.0029170903959311544, "trace_hash_ids": [12764556, 12764557, 12764558, 12764559, 12764560, 12764561, 12764562, 12764563, 12764564, 12764565, 12764566, 12764567, 12764568, 12764569, 12764570, 12764571, 12764572, 12764573, 12764574, 12764575, 12764576, 12764577, 12764578, 12764579, 12764580, 12764581, 12764582, 12764583, 12764584, 12764585, 12764586, 12764587], "trace_timestamp_s": 157.34400000000005, "ttft_s": 1.5050644000293687, "turn_id": 2} +{"actual_output_tokens": 380, "cached_tokens": 49904, "effective_input_length": 58032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58032, "latency_s": 8.048618271015584, "output_length": 380, "proxy_request_id": "1266668:5:1281133:168", "request_id": "1266668:5:1281133:168", "request_type": "coder", "requested_output_tokens": 380, "session_id": "1266668", "t_dispatch_unix": 1779817745.3544953, "t_finish_unix": 1779817753.4031138, "t_first_token_unix": 1779817749.4372213, "tpot_s": 0.010463064237427714, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12748644], "trace_timestamp_s": 151.59799999999996, "ttft_s": 4.082723786996212, "turn_id": 5} +{"actual_output_tokens": 3746, "cached_tokens": 22352, "effective_input_length": 25187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25187, "latency_s": 62.48468257300556, "output_length": 3746, "proxy_request_id": "1242838:4:1265709:87", "request_id": "1242838:4:1265709:87", "request_type": "coder", "requested_output_tokens": 3746, "session_id": "1242838", "t_dispatch_unix": 1779817691.5057511, "t_finish_unix": 1779817753.9904418, "t_first_token_unix": 1779817727.7280939, "tpot_s": 0.007012564056610144, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 12596375], "trace_timestamp_s": 97.75300000000061, "ttft_s": 36.22234095603926, "turn_id": 4} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 8510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8510, "latency_s": 0.9444689860101789, "output_length": 60, "proxy_request_id": "1283642:1:1283642:178", "request_id": "1283642:1:1283642:178", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1283642", "t_dispatch_unix": 1779817753.538568, "t_finish_unix": 1779817754.483037, "t_first_token_unix": 1779817754.1768832, "tpot_s": 0.005183191829897716, "trace_hash_ids": [12764037, 12764038, 12764039, 12764040, 12764041, 12764042, 12764043, 12764044, 12764045, 12772097, 12772098, 12772099, 12772100, 12772101, 12772102, 12772103, 12772104], "trace_timestamp_s": 159.78400000000056, "ttft_s": 0.6383136980002746, "turn_id": 1} +{"actual_output_tokens": 618, "cached_tokens": 20368, "effective_input_length": 26426, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26426, "latency_s": 9.960316954995506, "output_length": 618, "proxy_request_id": "1279412:2:1281113:167", "request_id": "1279412:2:1281113:167", "request_type": "coder", "requested_output_tokens": 618, "session_id": "1279412", "t_dispatch_unix": 1779817745.3007727, "t_finish_unix": 1779817755.2610896, "t_first_token_unix": 1779817746.4225655, "tpot_s": 0.014324594431140156, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12748544], "trace_timestamp_s": 151.54700000000048, "ttft_s": 1.1217904950026423, "turn_id": 2} +{"actual_output_tokens": 66, "cached_tokens": 34240, "effective_input_length": 34282, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34282, "latency_s": 1.6186965880333446, "output_length": 66, "proxy_request_id": "1262354:10:1283773:180", "request_id": "1262354:10:1283773:180", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1262354", "t_dispatch_unix": 1779817753.9684665, "t_finish_unix": 1779817755.5871632, "t_first_token_unix": 1779817754.965003, "tpot_s": 0.00956609575346542, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490], "trace_timestamp_s": 160.21700000000055, "ttft_s": 0.9965348110417835, "turn_id": 10} +{"actual_output_tokens": 681, "cached_tokens": 24880, "effective_input_length": 30965, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30965, "latency_s": 6.528620493016206, "output_length": 681, "proxy_request_id": "1277909:2:1283679:179", "request_id": "1277909:2:1283679:179", "request_type": "coder", "requested_output_tokens": 681, "session_id": "1277909", "t_dispatch_unix": 1779817753.6435618, "t_finish_unix": 1779817760.172182, "t_first_token_unix": 1779817754.9302013, "tpot_s": 0.007708418894103755, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12772584, 12772585, 12772586, 12772587, 12772588, 12772589, 12772590, 12772591, 12772592, 12772593, 12772594, 12772595, 12772596, 12772597], "trace_timestamp_s": 159.88799999999992, "ttft_s": 1.2866379210026935, "turn_id": 2} +{"actual_output_tokens": 14, "cached_tokens": 27040, "effective_input_length": 27077, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27077, "latency_s": 0.20489071600604802, "output_length": 14, "proxy_request_id": "1279412:3:1285475:187", "request_id": "1279412:3:1285475:187", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1279412", "t_dispatch_unix": 1779817760.0005841, "t_finish_unix": 1779817760.2054749, "t_first_token_unix": 1779817760.0871491, "tpot_s": 0.009078107232478662, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281], "trace_timestamp_s": 166.2490000000007, "ttft_s": 0.08656283398158848, "turn_id": 3} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 4510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4510, "latency_s": 0.7160174070158973, "output_length": 55, "proxy_request_id": "1285800:1:1285800:191", "request_id": "1285800:1:1285800:191", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1285800", "t_dispatch_unix": 1779817761.114857, "t_finish_unix": 1779817761.8308744, "t_first_token_unix": 1779817761.415369, "tpot_s": 0.007688865889105256, "trace_hash_ids": [12776768, 12784744, 12784745, 12784746, 12793479, 12793480, 12793481, 12793482, 12793483], "trace_timestamp_s": 167.36200000000008, "ttft_s": 0.3005109090008773, "turn_id": 1} +{"actual_output_tokens": 5747, "cached_tokens": 22624, "effective_input_length": 27639, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27639, "latency_s": 71.50256263802294, "output_length": 5747, "proxy_request_id": "1239034:4:1263738:78", "request_id": "1239034:4:1263738:78", "request_type": "coder", "requested_output_tokens": 5747, "session_id": "1239034", "t_dispatch_unix": 1779817690.3692296, "t_finish_unix": 1779817761.871792, "t_first_token_unix": 1779817691.3882096, "tpot_s": 0.012266498265749546, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445, 12562130, 12562131, 12562132, 12562133, 12562134, 12562135, 12562136, 12562137, 12576042, 12576043, 12576044, 12576045, 12576046, 12576047, 12576048, 12576049, 12576050, 12576051], "trace_timestamp_s": 90.9380000000001, "ttft_s": 1.018977781990543, "turn_id": 4} +{"actual_output_tokens": 70, "cached_tokens": 8560, "effective_input_length": 14192, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14192, "latency_s": 1.0423747259774245, "output_length": 70, "proxy_request_id": "1283642:2:1285731:190", "request_id": "1283642:2:1285731:190", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1283642", "t_dispatch_unix": 1779817760.859485, "t_finish_unix": 1779817761.9018598, "t_first_token_unix": 1779817761.521202, "tpot_s": 0.005513900102190403, "trace_hash_ids": [12764037, 12764038, 12764039, 12764040, 12764041, 12764042, 12764043, 12764044, 12764045, 12772097, 12772098, 12772099, 12772100, 12772101, 12772102, 12772103, 12782108, 12782109, 12782110, 12782111, 12782112, 12782113, 12782114, 12792906, 12792907, 12792908, 12792909, 12792910], "trace_timestamp_s": 167.10600000000068, "ttft_s": 0.6617152629769407, "turn_id": 2} +{"actual_output_tokens": 347, "cached_tokens": 0, "effective_input_length": 11, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11, "latency_s": 1.6999064880074002, "output_length": 347, "proxy_request_id": "1285558:1:1285558:188", "request_id": "1285558:1:1285558:188", "request_type": "coder", "requested_output_tokens": 347, "session_id": "1285558", "t_dispatch_unix": 1779817760.2084272, "t_finish_unix": 1779817761.9083335, "t_first_token_unix": 1779817760.2308524, "tpot_s": 0.004847567049198315, "trace_hash_ids": [26603], "trace_timestamp_s": 166.45700000000033, "ttft_s": 0.022423526970669627, "turn_id": 1} +{"actual_output_tokens": 683, "cached_tokens": 34336, "effective_input_length": 34353, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34353, "latency_s": 5.225118862988893, "output_length": 683, "proxy_request_id": "1262354:11:1284987:186", "request_id": "1262354:11:1284987:186", "request_type": "coder", "requested_output_tokens": 683, "session_id": "1262354", "t_dispatch_unix": 1779817758.4526405, "t_finish_unix": 1779817763.6777594, "t_first_token_unix": 1779817758.5429256, "tpot_s": 0.0075286831011172235, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12786017], "trace_timestamp_s": 164.70100000000002, "ttft_s": 0.09028306300751865, "turn_id": 11} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 1700, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1700, "latency_s": 0.35995884699514136, "output_length": 40, "proxy_request_id": "1286551:1:1286551:194", "request_id": "1286551:1:1286551:194", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1286551", "t_dispatch_unix": 1779817764.0787873, "t_finish_unix": 1779817764.4387462, "t_first_token_unix": 1779817764.2478848, "tpot_s": 0.004886402948520696, "trace_hash_ids": [12800256, 12800257, 12800258, 12800259], "trace_timestamp_s": 170.32600000000002, "ttft_s": 0.16909619100624695, "turn_id": 1} +{"actual_output_tokens": 242, "cached_tokens": 27088, "effective_input_length": 31898, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31898, "latency_s": 2.6880595160182565, "output_length": 242, "proxy_request_id": "1279412:4:1286447:193", "request_id": "1279412:4:1286447:193", "request_type": "coder", "requested_output_tokens": 242, "session_id": "1279412", "t_dispatch_unix": 1779817763.6744163, "t_finish_unix": 1779817766.3624759, "t_first_token_unix": 1779817764.7618773, "tpot_s": 0.006640258838115376, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12799351], "trace_timestamp_s": 169.92000000000007, "ttft_s": 1.0874585210112855, "turn_id": 4} +{"actual_output_tokens": 124, "cached_tokens": 0, "effective_input_length": 13962, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13962, "latency_s": 1.8996239060070366, "output_length": 124, "proxy_request_id": "1286804:1:1286804:195", "request_id": "1286804:1:1286804:195", "request_type": "coder", "requested_output_tokens": 124, "session_id": "1286804", "t_dispatch_unix": 1779817764.8096905, "t_finish_unix": 1779817766.7093148, "t_first_token_unix": 1779817766.0185764, "tpot_s": 0.005613554276173889, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12802941], "trace_timestamp_s": 171.0530000000008, "ttft_s": 1.20888415601803, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 17344, "effective_input_length": 24519, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24519, "latency_s": 27.2953482879675, "output_length": 36, "proxy_request_id": "1276136:2:1280145:162", "request_id": "1276136:2:1280145:162", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1276136", "t_dispatch_unix": 1779817741.815029, "t_finish_unix": 1779817769.1103773, "t_first_token_unix": 1779817768.705605, "tpot_s": 0.011553602629075094, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12713815, 12713816, 12713817, 12713818, 12713819, 12713820, 12725899, 12725900, 12725901, 12725902, 12725903, 12725904, 12739099, 12739100, 12739101], "trace_timestamp_s": 148.0610000000006, "ttft_s": 26.89057419297751, "turn_id": 2} +{"actual_output_tokens": 240, "cached_tokens": 0, "effective_input_length": 9925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9925, "latency_s": 2.068237780011259, "output_length": 240, "proxy_request_id": "1287588:1:1287588:198", "request_id": "1287588:1:1287588:198", "request_type": "coder", "requested_output_tokens": 240, "session_id": "1287588", "t_dispatch_unix": 1779817767.3599796, "t_finish_unix": 1779817769.4282176, "t_first_token_unix": 1779817768.1328433, "tpot_s": 0.005418346669460612, "trace_hash_ids": [12755829, 12755830, 12755831, 12755832, 12755833, 12755834, 12768457, 12768458, 12768459, 12768460, 12768461, 12768462, 12768463, 12768464, 12768465, 12768466, 12768467, 12810245, 12810246, 12810247], "trace_timestamp_s": 173.60500000000047, "ttft_s": 0.7728618180262856, "turn_id": 1} +{"actual_output_tokens": 523, "cached_tokens": 30512, "effective_input_length": 30594, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30594, "latency_s": 17.42939301300794, "output_length": 523, "proxy_request_id": "1269373:5:1282812:174", "request_id": "1269373:5:1282812:174", "request_type": "coder", "requested_output_tokens": 523, "session_id": "1269373", "t_dispatch_unix": 1779817752.1520796, "t_finish_unix": 1779817769.5814724, "t_first_token_unix": 1779817752.2603815, "tpot_s": 0.03318163586396392, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12764050], "trace_timestamp_s": 157.13600000000042, "ttft_s": 0.1082990420400165, "turn_id": 5} +{"actual_output_tokens": 106, "cached_tokens": 0, "effective_input_length": 448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 448, "latency_s": 0.571357115986757, "output_length": 106, "proxy_request_id": "1288143:1:1288143:200", "request_id": "1288143:1:1288143:200", "request_type": "coder", "requested_output_tokens": 106, "session_id": "1288143", "t_dispatch_unix": 1779817769.3265796, "t_finish_unix": 1779817769.8979359, "t_first_token_unix": 1779817769.3791847, "tpot_s": 0.004935329781091284, "trace_hash_ids": [12815534], "trace_timestamp_s": 175.57500000000073, "ttft_s": 0.05260415602242574, "turn_id": 1} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 88317, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 88317, "latency_s": 28.755331046995707, "output_length": 93, "proxy_request_id": "1279994:1:1279994:161", "request_id": "1279994:1:1279994:161", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1279994", "t_dispatch_unix": 1779817741.3773382, "t_finish_unix": 1779817770.1326687, "t_first_token_unix": 1779817767.6231747, "tpot_s": 0.027274196988994092, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12737958, 12737959, 12737960, 12737961, 12737962, 12737963, 12737964, 12737965, 12737966, 12737967, 12737968], "trace_timestamp_s": 147.59200000000055, "ttft_s": 26.245834265020676, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 24544, "effective_input_length": 25923, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25923, "latency_s": 1.7005580450058915, "output_length": 81, "proxy_request_id": "1276136:3:1280987:166", "request_id": "1276136:3:1280987:166", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1276136", "t_dispatch_unix": 1779817769.1121693, "t_finish_unix": 1779817770.8127275, "t_first_token_unix": 1779817769.4694195, "tpot_s": 0.016787491449940718, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12713815, 12713816, 12713817, 12713818, 12713819, 12713820, 12725899, 12725900, 12725901, 12725902, 12725903, 12725904, 12739099, 12739100, 12747337, 12747338, 12747339, 12747340], "trace_timestamp_s": 151.01400000000012, "ttft_s": 0.35724851401755586, "turn_id": 3} +{"actual_output_tokens": 869, "cached_tokens": 0, "effective_input_length": 49619, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49619, "latency_s": 15.901157343003433, "output_length": 869, "proxy_request_id": "1284132:1:1284132:182", "request_id": "1284132:1:1284132:182", "request_type": "coder", "requested_output_tokens": 869, "session_id": "1284132", "t_dispatch_unix": 1779817755.3253672, "t_finish_unix": 1779817771.2265244, "t_first_token_unix": 1779817764.5935717, "tpot_s": 0.0076413374112662535, "trace_hash_ids": [12776618, 12776619, 12776620, 12776621, 12776622, 12776623, 12776624, 12776625, 12776626, 12776627, 12776628, 12776629, 12776630, 12776631, 12776632, 12776633, 12776634, 12776635, 12776636, 12776637, 12776638, 12776639, 12776640, 12776641, 12776642, 12776643, 12776644, 12776645, 12776646, 12776647, 12776648, 12776649, 12776650, 12776651, 12776652, 12776653, 12776654, 12776655, 12776656, 12776657, 12776658, 12776659, 12776660, 12776661, 12776662, 12776663, 12776664, 12776665, 12776666, 12776667, 12776668, 12776669, 12776670, 12776671, 12776672, 12776673, 12776674, 12776675, 12776676, 12776677, 12776678, 12776679, 12776680, 12776681, 12776682, 12776683, 12776684, 12776685, 12776686, 12776687, 12776688, 12776689, 12776690, 12776691, 12776692, 12776693, 12776694, 12776695, 12776696, 12776697, 12776698, 12776699, 12776700, 12776701, 12776702, 12776703, 12776704, 12776705, 12776706, 12776707, 12776708, 12776709, 12776710, 12776711, 12776712, 12776713, 12776714], "trace_timestamp_s": 161.5550000000003, "ttft_s": 9.268202558974735, "turn_id": 1} +{"actual_output_tokens": 186, "cached_tokens": 32512, "effective_input_length": 42264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42264, "latency_s": 14.462721151998267, "output_length": 186, "proxy_request_id": "1268831:5:1284640:184", "request_id": "1268831:5:1284640:184", "request_type": "coder", "requested_output_tokens": 186, "session_id": "1268831", "t_dispatch_unix": 1779817757.0507228, "t_finish_unix": 1779817771.513444, "t_first_token_unix": 1779817766.8796535, "tpot_s": 0.025044712027207622, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12730103, 12782348, 12782349, 12782350, 12782351, 12782352, 12782353, 12782354, 12782355, 12782356, 12782357, 12782358, 12782359, 12782360, 12782361, 12782362, 12782363, 12782364, 12782365, 12782366, 12782367], "trace_timestamp_s": 163.29400000000078, "ttft_s": 9.828928335977253, "turn_id": 5} +{"actual_output_tokens": 87, "cached_tokens": 88400, "effective_input_length": 88940, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 88940, "latency_s": 1.4190972020151094, "output_length": 87, "proxy_request_id": "1279994:2:1283011:177", "request_id": "1279994:2:1283011:177", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1279994", "t_dispatch_unix": 1779817770.1390219, "t_finish_unix": 1779817771.5581186, "t_first_token_unix": 1779817770.679096, "tpot_s": 0.010218054232821084, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 303055, 12766561, 12766562, 12766563, 12766564, 12766565, 12766566, 12766567, 12766568, 12766569], "trace_timestamp_s": 157.82100000000082, "ttft_s": 0.5400721249752678, "turn_id": 2} +{"actual_output_tokens": 273, "cached_tokens": 11744, "effective_input_length": 13901, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13901, "latency_s": 25.529201609024312, "output_length": 273, "proxy_request_id": "1272313:4:1281720:170", "request_id": "1272313:4:1281720:170", "request_type": "coder", "requested_output_tokens": 273, "session_id": "1272313", "t_dispatch_unix": 1779817747.1171248, "t_finish_unix": 1779817772.6463265, "t_first_token_unix": 1779817768.706832, "tpot_s": 0.01448254414336749, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12753629], "trace_timestamp_s": 153.3650000000007, "ttft_s": 21.58970600797329, "turn_id": 4} +{"actual_output_tokens": 69, "cached_tokens": 1728, "effective_input_length": 9610, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9610, "latency_s": 0.9947655800497159, "output_length": 69, "proxy_request_id": "1286551:2:1289450:202", "request_id": "1286551:2:1289450:202", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1286551", "t_dispatch_unix": 1779817773.6700683, "t_finish_unix": 1779817774.6648338, "t_first_token_unix": 1779817774.3025682, "tpot_s": 0.005321289764491238, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12827808], "trace_timestamp_s": 179.91600000000017, "ttft_s": 0.6324986810213886, "turn_id": 2} +{"actual_output_tokens": 492, "cached_tokens": 58400, "effective_input_length": 80055, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80055, "latency_s": 20.426704619952943, "output_length": 492, "proxy_request_id": "1266668:6:1284003:181", "request_id": "1266668:6:1284003:181", "request_type": "coder", "requested_output_tokens": 492, "session_id": "1266668", "t_dispatch_unix": 1779817754.8647482, "t_finish_unix": 1779817775.2914522, "t_first_token_unix": 1779817765.1487625, "tpot_s": 0.020656533983736177, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12775718], "trace_timestamp_s": 161.10300000000007, "ttft_s": 10.284011662995908, "turn_id": 6} +{"actual_output_tokens": 13, "cached_tokens": 10160, "effective_input_length": 10195, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10195, "latency_s": 1.9270810799789615, "output_length": 13, "proxy_request_id": "1287588:2:1289701:205", "request_id": "1287588:2:1289701:205", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1287588", "t_dispatch_unix": 1779817774.5858567, "t_finish_unix": 1779817776.5129378, "t_first_token_unix": 1779817776.3978357, "tpot_s": 0.00956857783118418, "trace_hash_ids": [12755829, 12755830, 12755831, 12755832, 12755833, 12755834, 12768457, 12768458, 12768459, 12768460, 12768461, 12768462, 12768463, 12768464, 12768465, 12768466, 12768467, 12810245, 12810246, 12830253], "trace_timestamp_s": 180.83500000000004, "ttft_s": 1.8119776099920273, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 7261, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7261, "latency_s": 0.646607208007481, "output_length": 29, "proxy_request_id": "1290442:1:1290442:210", "request_id": "1290442:1:1290442:210", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1290442", "t_dispatch_unix": 1779817776.9408019, "t_finish_unix": 1779817777.5874095, "t_first_token_unix": 1779817777.4461856, "tpot_s": 0.0050346231437288225, "trace_hash_ids": [12815773, 12815774, 12815775, 12824652, 12824653, 12824654, 12824655, 12824656, 12824657, 12836855, 12836856, 12836857, 12836858, 12836859, 12836860], "trace_timestamp_s": 183.1870000000008, "ttft_s": 0.5053820220055059, "turn_id": 1} +{"actual_output_tokens": 481, "cached_tokens": 89024, "effective_input_length": 89226, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89226, "latency_s": 6.0301215459476225, "output_length": 481, "proxy_request_id": "1279994:3:1286181:192", "request_id": "1279994:3:1286181:192", "request_type": "coder", "requested_output_tokens": 481, "session_id": "1279994", "t_dispatch_unix": 1779817771.5651608, "t_finish_unix": 1779817777.5952816, "t_first_token_unix": 1779817771.8782458, "tpot_s": 0.011910130262428235, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 12796644, 12796645, 12796646, 12796647, 12796648, 12796649, 12796650, 12796651, 12796652, 12796653, 12796654], "trace_timestamp_s": 168.88300000000072, "ttft_s": 0.3130830799927935, "turn_id": 3} +{"actual_output_tokens": 486, "cached_tokens": 14160, "effective_input_length": 14885, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14885, "latency_s": 5.746298329031561, "output_length": 486, "proxy_request_id": "1272313:5:1284744:185", "request_id": "1272313:5:1284744:185", "request_type": "coder", "requested_output_tokens": 486, "session_id": "1272313", "t_dispatch_unix": 1779817772.6476054, "t_finish_unix": 1779817778.3939042, "t_first_token_unix": 1779817772.8973465, "tpot_s": 0.011332355888642025, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12783550], "trace_timestamp_s": 163.7400000000007, "ttft_s": 0.24973970500286669, "turn_id": 5} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 13552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13552, "latency_s": 1.9577003580052406, "output_length": 68, "proxy_request_id": "1290426:1:1290426:209", "request_id": "1290426:1:1290426:209", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1290426", "t_dispatch_unix": 1779817776.9150655, "t_finish_unix": 1779817778.872766, "t_first_token_unix": 1779817778.0953596, "tpot_s": 0.011597886642462004, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12836762, 12836763, 12836764, 12836765, 12836766, 12836767, 12836768, 12836769, 12836770], "trace_timestamp_s": 183.16300000000047, "ttft_s": 1.180292869976256, "turn_id": 1} +{"actual_output_tokens": 155, "cached_tokens": 32128, "effective_input_length": 32191, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32191, "latency_s": 5.412306732963771, "output_length": 155, "proxy_request_id": "1279412:4:1289482:203", "request_id": "1279412:4:1289482:203", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1279412", "t_dispatch_unix": 1779817773.7471411, "t_finish_unix": 1779817779.1594472, "t_first_token_unix": 1779817776.3966215, "tpot_s": 0.017939109675353393, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932], "trace_timestamp_s": 179.9950000000008, "ttft_s": 2.6494778859778307, "turn_id": 4} +{"actual_output_tokens": 80, "cached_tokens": 0, "effective_input_length": 1744, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1744, "latency_s": 0.8550872970372438, "output_length": 80, "proxy_request_id": "1291100:1:1291100:212", "request_id": "1291100:1:1291100:212", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1291100", "t_dispatch_unix": 1779817779.1560946, "t_finish_unix": 1779817780.0111818, "t_first_token_unix": 1779817779.3439577, "tpot_s": 0.008442667088194314, "trace_hash_ids": [12831468, 12842817, 12842818, 12842819], "trace_timestamp_s": 185.40500000000065, "ttft_s": 0.18786240502959117, "turn_id": 1} +{"actual_output_tokens": 119, "cached_tokens": 0, "effective_input_length": 23228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23228, "latency_s": 3.3022898199851625, "output_length": 119, "proxy_request_id": "1290365:1:1290365:208", "request_id": "1290365:1:1290365:208", "request_type": "coder", "requested_output_tokens": 119, "session_id": "1290365", "t_dispatch_unix": 1779817776.7326865, "t_finish_unix": 1779817780.0349762, "t_first_token_unix": 1779817779.3195238, "tpot_s": 0.006060912491363015, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12836049], "trace_timestamp_s": 182.97400000000016, "ttft_s": 2.58683560899226, "turn_id": 1} +{"actual_output_tokens": 207, "cached_tokens": 89696, "effective_input_length": 89749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89749, "latency_s": 2.563470189983491, "output_length": 207, "proxy_request_id": "1279994:4:1290711:211", "request_id": "1279994:4:1290711:211", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1279994", "t_dispatch_unix": 1779817777.8067582, "t_finish_unix": 1779817780.3702283, "t_first_token_unix": 1779817778.0170903, "tpot_s": 0.011421782233033475, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 12839503, 12839504, 12839505, 12839506, 12839507, 12839508, 12839509, 12839510, 12839511, 12839512, 12839513, 12839514], "trace_timestamp_s": 184.05000000000018, "ttft_s": 0.21032993297558278, "turn_id": 4} +{"actual_output_tokens": 444, "cached_tokens": 31104, "effective_input_length": 38788, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38788, "latency_s": 11.128082565031946, "output_length": 444, "proxy_request_id": "1269373:6:1285668:189", "request_id": "1269373:6:1285668:189", "request_type": "coder", "requested_output_tokens": 444, "session_id": "1269373", "t_dispatch_unix": 1779817769.5863163, "t_finish_unix": 1779817780.7143989, "t_first_token_unix": 1779817771.5199258, "tpot_s": 0.02075450700005037, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12792393], "trace_timestamp_s": 166.90500000000065, "ttft_s": 1.9336076600011438, "turn_id": 6} +{"actual_output_tokens": 273, "cached_tokens": 15360, "effective_input_length": 15547, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15547, "latency_s": 2.5950740610132925, "output_length": 273, "proxy_request_id": "1272313:6:1287745:199", "request_id": "1272313:6:1287745:199", "request_type": "coder", "requested_output_tokens": 273, "session_id": "1272313", "t_dispatch_unix": 1779817778.3950708, "t_finish_unix": 1779817780.990145, "t_first_token_unix": 1779817778.4896138, "tpot_s": 0.009192236143409152, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12811862], "trace_timestamp_s": 174.15700000000015, "ttft_s": 0.09454161999747157, "turn_id": 6} +{"actual_output_tokens": 607, "cached_tokens": 113840, "effective_input_length": 118097, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118097, "latency_s": 46.169611043995246, "output_length": 607, "proxy_request_id": "1258859:3:1278118:155", "request_id": "1258859:3:1278118:155", "request_type": "coder", "requested_output_tokens": 607, "session_id": "1258859", "t_dispatch_unix": 1779817735.0224268, "t_finish_unix": 1779817781.1920373, "t_first_token_unix": 1779817769.8970695, "tpot_s": 0.018638081202958172, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12719963, 12719964, 12719965, 12719966, 12719967, 12719968, 12719969, 12719970, 12719971, 12719972], "trace_timestamp_s": 141.26500000000033, "ttft_s": 34.87464057496982, "turn_id": 3} +{"actual_output_tokens": 80, "cached_tokens": 35024, "effective_input_length": 35099, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35099, "latency_s": 1.24321519699879, "output_length": 80, "proxy_request_id": "1262354:12:1291548:213", "request_id": "1262354:12:1291548:213", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1262354", "t_dispatch_unix": 1779817780.7926526, "t_finish_unix": 1779817782.0358677, "t_first_token_unix": 1779817780.886868, "tpot_s": 0.014540887823110282, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12846191], "trace_timestamp_s": 187.04100000000017, "ttft_s": 0.09421346196904778, "turn_id": 12} +{"actual_output_tokens": 54, "cached_tokens": 23344, "effective_input_length": 23414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23414, "latency_s": 0.3977178399800323, "output_length": 54, "proxy_request_id": "1290365:2:1292000:217", "request_id": "1290365:2:1292000:217", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1290365", "t_dispatch_unix": 1779817782.3305285, "t_finish_unix": 1779817782.7282465, "t_first_token_unix": 1779817782.417457, "tpot_s": 0.005858658584502508, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942], "trace_timestamp_s": 188.57900000000063, "ttft_s": 0.08692703500855714, "turn_id": 2} +{"actual_output_tokens": 338, "cached_tokens": 15808, "effective_input_length": 15969, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15969, "latency_s": 2.0410070860525593, "output_length": 338, "proxy_request_id": "1272313:7:1290281:206", "request_id": "1272313:7:1290281:206", "request_type": "coder", "requested_output_tokens": 338, "session_id": "1272313", "t_dispatch_unix": 1779817780.9911256, "t_finish_unix": 1779817783.032133, "t_first_token_unix": 1779817781.072785, "tpot_s": 0.005813268097932796, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12835696], "trace_timestamp_s": 182.72299999999996, "ttft_s": 0.08165770600317046, "turn_id": 7} +{"actual_output_tokens": 89, "cached_tokens": 32336, "effective_input_length": 32359, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32359, "latency_s": 1.987767179030925, "output_length": 89, "proxy_request_id": "1279412:5:1291651:214", "request_id": "1279412:5:1291651:214", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1279412", "t_dispatch_unix": 1779817781.0779936, "t_finish_unix": 1779817783.0657609, "t_first_token_unix": 1779817781.1657073, "tpot_s": 0.02158885370458434, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12846974], "trace_timestamp_s": 187.32600000000002, "ttft_s": 0.08771187101956457, "turn_id": 5} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 8144, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8144, "latency_s": 0.9879372909781523, "output_length": 29, "proxy_request_id": "1291944:1:1291944:216", "request_id": "1291944:1:1291944:216", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1291944", "t_dispatch_unix": 1779817782.135776, "t_finish_unix": 1779817783.123713, "t_first_token_unix": 1779817782.7364008, "tpot_s": 0.01382378549897112, "trace_hash_ids": [12831732, 12831733, 12831734, 12831735, 12831736, 12831737, 12831738, 12844495, 12844496, 12844497, 12844498, 12850497, 12850498, 12850499, 12850500, 12850501], "trace_timestamp_s": 188.38200000000052, "ttft_s": 0.6006239359849133, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 42112, "effective_input_length": 42153, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42153, "latency_s": 1.5243450250127353, "output_length": 68, "proxy_request_id": "1260327:6:1291827:215", "request_id": "1260327:6:1291827:215", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1260327", "t_dispatch_unix": 1779817781.762475, "t_finish_unix": 1779817783.2868197, "t_first_token_unix": 1779817781.902427, "tpot_s": 0.0206583580592953, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182], "trace_timestamp_s": 188.01000000000022, "ttft_s": 0.1399498350219801, "turn_id": 6} +{"actual_output_tokens": 34, "cached_tokens": 9664, "effective_input_length": 16914, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16914, "latency_s": 1.0861035130219534, "output_length": 34, "proxy_request_id": "1286551:3:1292589:219", "request_id": "1286551:3:1292589:219", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1286551", "t_dispatch_unix": 1779817784.001235, "t_finish_unix": 1779817785.0873384, "t_first_token_unix": 1779817784.909939, "tpot_s": 0.0053683946360692835, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12836762, 12836763, 12836764, 12836765, 12836766, 12836767, 12836768, 12836769, 12845101, 12845102, 12857466, 12857467, 12857468, 12857469, 12857470, 12857471], "trace_timestamp_s": 190.2490000000007, "ttft_s": 0.9087025180342607, "turn_id": 3} +{"actual_output_tokens": 86, "cached_tokens": 0, "effective_input_length": 4684, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4684, "latency_s": 0.736439312051516, "output_length": 86, "proxy_request_id": "1292750:1:1292750:220", "request_id": "1292750:1:1292750:220", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1292750", "t_dispatch_unix": 1779817784.6379833, "t_finish_unix": 1779817785.3744226, "t_first_token_unix": 1779817784.9379745, "tpot_s": 0.005131451447275193, "trace_hash_ids": [12851054, 12851055, 12851056, 12851057, 12851058, 12851059, 12851060, 12858884, 12858885, 12858886], "trace_timestamp_s": 190.88500000000022, "ttft_s": 0.2999903000309132, "turn_id": 1} +{"actual_output_tokens": 406, "cached_tokens": 80544, "effective_input_length": 87741, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87741, "latency_s": 10.098689337959513, "output_length": 406, "proxy_request_id": "1266668:7:1287468:197", "request_id": "1266668:7:1287468:197", "request_type": "coder", "requested_output_tokens": 406, "session_id": "1266668", "t_dispatch_unix": 1779817775.298559, "t_finish_unix": 1779817785.3972483, "t_first_token_unix": 1779817779.2038424, "tpot_s": 0.015291506839473444, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12809031], "trace_timestamp_s": 173.22299999999996, "ttft_s": 3.9052811569999903, "turn_id": 7} +{"actual_output_tokens": 91, "cached_tokens": 35168, "effective_input_length": 35210, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35210, "latency_s": 0.9751077419496141, "output_length": 91, "proxy_request_id": "1262354:13:1293000:221", "request_id": "1262354:13:1293000:221", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1262354", "t_dispatch_unix": 1779817785.4788525, "t_finish_unix": 1779817786.4539607, "t_first_token_unix": 1779817785.579994, "tpot_s": 0.009707716578203771, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540], "trace_timestamp_s": 191.72700000000077, "ttft_s": 0.10113912896485999, "turn_id": 13} +{"actual_output_tokens": 64, "cached_tokens": 0, "effective_input_length": 77805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77805, "latency_s": 21.254210047016386, "output_length": 64, "proxy_request_id": "1287100:1:1287100:196", "request_id": "1287100:1:1287100:196", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1287100", "t_dispatch_unix": 1779817765.7756388, "t_finish_unix": 1779817787.029848, "t_first_token_unix": 1779817786.511328, "tpot_s": 0.00822662049257714, "trace_hash_ids": [61256, 776286, 192478, 776287, 776288, 776289, 776290, 776291, 776292, 776293, 776294, 776295, 776296, 776297, 776298, 776299, 776300, 776301, 776302, 776303, 776304, 776305, 776306, 776307, 776308, 776309, 776310, 776311, 776312, 776313, 776314, 776315, 776316, 12805558, 167529, 167530, 1729741, 1729742, 1729743, 527276, 527277, 611084, 611085, 6750692, 6750693, 6750694, 6750695, 6750696, 6750697, 6750698, 6750699, 6750700, 6750701, 6750702, 6750703, 6750704, 9671050, 9671051, 9671052, 9671053, 9671054, 9671055, 9671056, 2149400, 2149401, 2149402, 9671057, 7270289, 173464, 9671058, 9671059, 9671060, 9671061, 9671062, 9671063, 9671064, 9671065, 9671066, 9671067, 9671068, 9671069, 9739253, 9739254, 9739255, 9739256, 10166701, 10457216, 10457217, 10457218, 10457219, 10457220, 10457221, 10457222, 10457223, 10457224, 10457225, 10457226, 10457227, 10457228, 10457229, 10457230, 10457231, 10457232, 10457233, 10457234, 10457235, 10642319, 10642320, 10642321, 10642322, 10642323, 10642324, 10642325, 10642326, 10843616, 10843617, 10843618, 10843619, 11736040, 11736041, 11736042, 11736043, 11736044, 11736045, 11736046, 11736047, 11736048, 11736049, 11736050, 11736051, 11736052, 11736053, 11736054, 11736055, 11736056, 11736057, 11736058, 11736059, 12076230, 12076231, 12076232, 12076233, 12179754, 12179755, 12408409, 12408410, 12408411, 12442683, 12643996, 12643997, 12805559, 12805560], "trace_timestamp_s": 171.99099999999999, "ttft_s": 20.735687494976446, "turn_id": 1} +{"actual_output_tokens": 347, "cached_tokens": 118688, "effective_input_length": 118736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118736, "latency_s": 6.740284633007832, "output_length": 347, "proxy_request_id": "1258859:4:1282900:176", "request_id": "1258859:4:1282900:176", "request_type": "coder", "requested_output_tokens": 347, "session_id": "1258859", "t_dispatch_unix": 1779817781.198348, "t_finish_unix": 1779817787.9386327, "t_first_token_unix": 1779817781.479542, "tpot_s": 0.01866662258960608, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12719963, 12719964, 12719965, 12719966, 12719967, 12719968, 12719969, 12719970, 12719971, 12719972, 12765270], "trace_timestamp_s": 157.40900000000056, "ttft_s": 0.28119165397947654, "turn_id": 4} +{"actual_output_tokens": 329, "cached_tokens": 23456, "effective_input_length": 24482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24482, "latency_s": 2.311457263014745, "output_length": 329, "proxy_request_id": "1290365:3:1293216:222", "request_id": "1290365:3:1293216:222", "request_type": "coder", "requested_output_tokens": 329, "session_id": "1290365", "t_dispatch_unix": 1779817786.2649932, "t_finish_unix": 1779817788.57645, "t_first_token_unix": 1779817786.543255, "tpot_s": 0.006197938664671511, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486], "trace_timestamp_s": 192.51299999999992, "ttft_s": 0.2782604999956675, "turn_id": 3} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 6460, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6460, "latency_s": 3.1960756079643033, "output_length": 25, "proxy_request_id": "1293507:1:1293507:224", "request_id": "1293507:1:1293507:224", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1293507", "t_dispatch_unix": 1779817787.3129349, "t_finish_unix": 1779817790.50901, "t_first_token_unix": 1779817787.755173, "tpot_s": 0.1147280612931354, "trace_hash_ids": [12835633, 12835634, 12835635, 12835636, 12835637, 12835638, 12835639, 12835640, 12843654, 12851154, 12851155, 12866668, 12866669], "trace_timestamp_s": 193.5600000000004, "ttft_s": 0.4422369239619002, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 1808, "effective_input_length": 2572, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2572, "latency_s": 3.4277010160149075, "output_length": 31, "proxy_request_id": "1291100:2:1293458:223", "request_id": "1291100:2:1293458:223", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1291100", "t_dispatch_unix": 1779817787.1272023, "t_finish_unix": 1779817790.5549033, "t_first_token_unix": 1779817787.3313773, "tpot_s": 0.10744142583183323, "trace_hash_ids": [12831468, 12842817, 12842818, 12852078, 12865966, 12865967], "trace_timestamp_s": 193.3760000000002, "ttft_s": 0.20417381002334878, "turn_id": 2} +{"actual_output_tokens": 96, "cached_tokens": 88144, "effective_input_length": 96105, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96105, "latency_s": 5.8033814069931395, "output_length": 96, "proxy_request_id": "1266668:8:1292408:218", "request_id": "1266668:8:1292408:218", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1266668", "t_dispatch_unix": 1779817785.4046638, "t_finish_unix": 1779817791.208045, "t_first_token_unix": 1779817790.0134647, "tpot_s": 0.012571865536493101, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12855425], "trace_timestamp_s": 189.6910000000007, "ttft_s": 4.608798326982651, "turn_id": 8} +{"actual_output_tokens": 63, "cached_tokens": 8160, "effective_input_length": 12388, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12388, "latency_s": 2.896954129973892, "output_length": 63, "proxy_request_id": "1291944:2:1293798:227", "request_id": "1291944:2:1293798:227", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1291944", "t_dispatch_unix": 1779817788.3974557, "t_finish_unix": 1779817791.2944098, "t_first_token_unix": 1779817790.4729252, "tpot_s": 0.013244642338137172, "trace_hash_ids": [12831732, 12831733, 12831734, 12831735, 12831736, 12831737, 12831738, 12844495, 12844496, 12844497, 12844498, 12850497, 12850498, 12850499, 12850500, 12861564, 12861565, 12861566, 12861567, 12861568, 12861569, 12869790, 12869791, 12869792, 12869793], "trace_timestamp_s": 194.64500000000044, "ttft_s": 2.0754680190002546, "turn_id": 2} +{"actual_output_tokens": 279, "cached_tokens": 16304, "effective_input_length": 28796, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28796, "latency_s": 3.9828534349799156, "output_length": 279, "proxy_request_id": "1272313:8:1293738:226", "request_id": "1272313:8:1293738:226", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1272313", "t_dispatch_unix": 1779817788.2474763, "t_finish_unix": 1779817792.2303293, "t_first_token_unix": 1779817790.4459295, "tpot_s": 0.006417807251911798, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12868987], "trace_timestamp_s": 194.49099999999999, "ttft_s": 2.198450543975923, "turn_id": 8} +{"actual_output_tokens": 546, "cached_tokens": 39216, "effective_input_length": 42745, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42745, "latency_s": 11.742399068025406, "output_length": 546, "proxy_request_id": "1269373:7:1290314:207", "request_id": "1269373:7:1290314:207", "request_type": "coder", "requested_output_tokens": 546, "session_id": "1269373", "t_dispatch_unix": 1779817780.7180347, "t_finish_unix": 1779817792.4604416, "t_first_token_unix": 1779817781.8049743, "tpot_s": 0.019550885102784243, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12835840], "trace_timestamp_s": 182.8120000000008, "ttft_s": 1.086937059997581, "turn_id": 7} +{"actual_output_tokens": 201, "cached_tokens": 35296, "effective_input_length": 35435, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35435, "latency_s": 3.478509002015926, "output_length": 201, "proxy_request_id": "1262354:14:1294243:228", "request_id": "1262354:14:1294243:228", "request_type": "coder", "requested_output_tokens": 201, "session_id": "1262354", "t_dispatch_unix": 1779817789.5628161, "t_finish_unix": 1779817793.0413253, "t_first_token_unix": 1779817790.4783072, "tpot_s": 0.012813421305036172, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540, 12873922], "trace_timestamp_s": 195.8110000000006, "ttft_s": 0.9154895700048655, "turn_id": 14} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 21947, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21947, "latency_s": 3.031278933980502, "output_length": 111, "proxy_request_id": "1294611:1:1294611:229", "request_id": "1294611:1:1294611:229", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1294611", "t_dispatch_unix": 1779817790.8577251, "t_finish_unix": 1779817793.889004, "t_first_token_unix": 1779817793.2352607, "tpot_s": 0.005940800954439593, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479], "trace_timestamp_s": 197.10300000000007, "ttft_s": 2.3775334560195915, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 96192, "effective_input_length": 96717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96717, "latency_s": 2.1629785610130057, "output_length": 35, "proxy_request_id": "1266668:9:1295576:231", "request_id": "1266668:9:1295576:231", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1266668", "t_dispatch_unix": 1779817794.4165184, "t_finish_unix": 1779817796.5794969, "t_first_token_unix": 1779817796.1753657, "tpot_s": 0.011865412588710622, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825], "trace_timestamp_s": 200.66200000000026, "ttft_s": 1.7588450979674235, "turn_id": 9} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 10857, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10857, "latency_s": 2.0587527109892108, "output_length": 82, "proxy_request_id": "1295690:1:1295690:232", "request_id": "1295690:1:1295690:232", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1295690", "t_dispatch_unix": 1779817794.762006, "t_finish_unix": 1779817796.8207588, "t_first_token_unix": 1779817795.654615, "tpot_s": 0.01439399490158798, "trace_hash_ids": [12865131, 12865132, 12865133, 12865134, 12865135, 12865136, 12865137, 12877451, 12877452, 12877453, 12877454, 12877455, 12888257, 12888258, 12888259, 12888260, 12888261, 12888262, 12888263, 12888264, 12888265, 12888266], "trace_timestamp_s": 201.00700000000052, "ttft_s": 0.8926070059533231, "turn_id": 1} +{"actual_output_tokens": 220, "cached_tokens": 22048, "effective_input_length": 23610, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23610, "latency_s": 1.7496843780390918, "output_length": 220, "proxy_request_id": "1294611:2:1295852:233", "request_id": "1294611:2:1295852:233", "request_type": "coder", "requested_output_tokens": 220, "session_id": "1294611", "t_dispatch_unix": 1779817795.2652018, "t_finish_unix": 1779817797.0148861, "t_first_token_unix": 1779817795.6762407, "tpot_s": 0.006111600269355118, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12890138], "trace_timestamp_s": 201.51299999999992, "ttft_s": 0.41103666101116687, "turn_id": 2} +{"actual_output_tokens": 491, "cached_tokens": 32432, "effective_input_length": 40278, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40278, "latency_s": 9.341026713023894, "output_length": 491, "proxy_request_id": "1279412:6:1293655:225", "request_id": "1279412:6:1293655:225", "request_type": "coder", "requested_output_tokens": 491, "session_id": "1279412", "t_dispatch_unix": 1779817787.8892844, "t_finish_unix": 1779817797.2303107, "t_first_token_unix": 1779817789.926673, "tpot_s": 0.014904953720409194, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278], "trace_timestamp_s": 194.13400000000001, "ttft_s": 2.0373861250118352, "turn_id": 6} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 82014, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82014, "latency_s": 23.221674587053712, "output_length": 61, "proxy_request_id": "1289570:1:1289570:204", "request_id": "1289570:1:1289570:204", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1289570", "t_dispatch_unix": 1779817774.093884, "t_finish_unix": 1779817797.3155584, "t_first_token_unix": 1779817796.813831, "tpot_s": 0.008357342050294392, "trace_hash_ids": [44148, 44149, 44150, 44151, 44152, 44153, 326399, 326400, 326401, 192485, 192486, 326402, 326403, 326404, 326405, 186604, 326406, 326407, 326408, 326409, 326410, 326411, 8410093, 8410094, 8410095, 8410096, 334886, 8410097, 8410098, 8410099, 8410100, 8410101, 8410102, 8410103, 8410104, 8410105, 8410106, 8410107, 8410108, 12828955, 127129, 127130, 127131, 127132, 9195123, 124871, 124872, 2501130, 2501131, 9195124, 9195125, 9195126, 9195127, 9195128, 9195129, 9195130, 9195131, 9195132, 9195133, 9195134, 9195135, 9195136, 9195137, 9195138, 9195139, 9195140, 9195141, 9195142, 9932953, 9932954, 9932955, 9932956, 9798604, 10563697, 10563698, 10563699, 10563700, 10563701, 10563702, 10563703, 10563704, 10563705, 10563706, 10563707, 10563708, 10563709, 10563710, 10563711, 10563712, 10563713, 11618308, 11618309, 11618310, 11618311, 11922778, 11922779, 11922780, 11922781, 11922782, 11922783, 11922784, 11922785, 11922786, 11922787, 11922788, 11922789, 11922790, 11922791, 11922792, 11922793, 11922794, 11922795, 11922796, 11922797, 11922798, 11922799, 11922800, 11922801, 11922802, 11922803, 11922804, 11922805, 11922806, 11922807, 11922808, 11922809, 11922810, 11922811, 11922812, 11922813, 11922814, 11922815, 11922816, 11922817, 11922818, 11922819, 11922820, 11922821, 11922822, 11922823, 11922824, 11922825, 11922826, 11922827, 11922828, 11922829, 11922830, 11922831, 11922832, 11922833, 12148250, 12148251, 12148252, 12442632, 12442633, 12442634, 12542377, 12828956, 12828957, 12828958, 12828959], "trace_timestamp_s": 180.3120000000008, "ttft_s": 22.719945193035528, "turn_id": 1} +{"actual_output_tokens": 1887, "cached_tokens": 0, "effective_input_length": 114612, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 114612, "latency_s": 73.78447859600419, "output_length": 1887, "proxy_request_id": "1275274:1:1275274:136", "request_id": "1275274:1:1275274:136", "request_type": "coder", "requested_output_tokens": 1887, "session_id": "1275274", "t_dispatch_unix": 1779817724.6280267, "t_finish_unix": 1779817798.4125054, "t_first_token_unix": 1779817766.9792564, "tpot_s": 0.016666461109746178, "trace_hash_ids": [9491467, 195037, 195038, 195039, 195040, 195041, 195042, 195043, 195044, 10319406, 10319407, 10319408, 10319409, 10319410, 10319411, 10319412, 10319413, 10319414, 5374859, 10319415, 10319416, 816846, 10319417, 10319418, 10319419, 10319420, 194680, 194681, 10319421, 10319422, 10319423, 10319424, 10319425, 10319426, 10319427, 10319428, 10319429, 10319430, 10319431, 10319432, 10319433, 10319434, 10319435, 10319436, 10319437, 10319438, 10319439, 10319440, 10319441, 10319442, 10319443, 10319444, 10319445, 10319446, 10319447, 10319448, 10319449, 10319450, 10319451, 10319452, 10319453, 10319454, 10319455, 10319456, 10319457, 10319458, 10319459, 10319460, 10319461, 10319462, 10319463, 10319464, 10319465, 10319466, 10319467, 10319468, 10319469, 10319470, 10319471, 10319472, 10319473, 10319474, 10319475, 10319476, 10319477, 10319478, 10319479, 10319480, 10319481, 10319482, 10319483, 10319484, 10319485, 10319486, 10319487, 10319488, 10319489, 10319490, 10319491, 10319492, 10319493, 10319494, 10319495, 10319496, 10319497, 10319498, 10319499, 10319500, 10319501, 10319502, 10319503, 10319504, 10319505, 10319506, 10319507, 10319508, 10319509, 10319510, 10319511, 10319512, 10319513, 10319514, 10319515, 10319516, 10319517, 10319518, 10319519, 10319520, 10319521, 10319522, 10319523, 10319524, 10319525, 10319526, 10319527, 10319528, 10319529, 10319530, 10319531, 10319532, 10319533, 10319534, 10319535, 10319536, 10319537, 10319538, 10319539, 10319540, 10319541, 10319542, 10319543, 10319544, 10319545, 10319546, 10319547, 10319548, 10319549, 10319550, 10319551, 10319552, 10319553, 10319554, 10319555, 10319556, 10319557, 10319558, 10319559, 10319560, 10319561, 10319562, 10319563, 10319564, 10319565, 10319566, 10319567, 10319568, 10319569, 10319570, 10319571, 10319572, 10319573, 10451843, 10538212, 10538213, 10590028, 10695557, 10848849, 10848850, 10848851, 10949071, 11065667, 11650526, 11650527, 11650528, 11717015, 11717016, 11717017, 11717018, 11717019, 11717020, 11796353, 11796354, 11796355, 11796356, 11895285, 12041647, 12041648, 12041649, 12041650, 12193888, 12247657, 12247658, 12247659, 12247660, 12374859, 12374860, 12374861, 12437166, 12437167, 12596754, 12596755, 12690937, 12690938, 12690939], "trace_timestamp_s": 130.82999999999993, "ttft_s": 42.35122695600148, "turn_id": 1} +{"actual_output_tokens": 22, "cached_tokens": 0, "effective_input_length": 624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 624, "latency_s": 0.38993802497861907, "output_length": 22, "proxy_request_id": "1296872:1:1296872:235", "request_id": "1296872:1:1296872:235", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1296872", "t_dispatch_unix": 1779817798.826773, "t_finish_unix": 1779817799.2167113, "t_first_token_unix": 1779817798.9851246, "tpot_s": 0.011013409333480965, "trace_hash_ids": [12899223, 12899224], "trace_timestamp_s": 205.07600000000002, "ttft_s": 0.15835047798464075, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 1791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1791, "latency_s": 0.6955954870209098, "output_length": 46, "proxy_request_id": "1296983:1:1296983:236", "request_id": "1296983:1:1296983:236", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1296983", "t_dispatch_unix": 1779817799.2611747, "t_finish_unix": 1779817799.9567704, "t_first_token_unix": 1779817799.4621742, "tpot_s": 0.010984950666574555, "trace_hash_ids": [12890444, 12900454, 12900455, 12900456], "trace_timestamp_s": 205.50900000000001, "ttft_s": 0.20099852001294494, "turn_id": 1} +{"actual_output_tokens": 513, "cached_tokens": 43280, "effective_input_length": 50680, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50680, "latency_s": 6.873005889996421, "output_length": 513, "proxy_request_id": "1269373:8:1295332:230", "request_id": "1269373:8:1295332:230", "request_type": "coder", "requested_output_tokens": 513, "session_id": "1269373", "t_dispatch_unix": 1779817793.4055238, "t_finish_unix": 1779817800.2785287, "t_first_token_unix": 1779817795.758378, "tpot_s": 0.008827932628946655, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629], "trace_timestamp_s": 199.65000000000055, "ttft_s": 2.352852518961299, "turn_id": 8} +{"actual_output_tokens": 144, "cached_tokens": 29072, "effective_input_length": 29149, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29149, "latency_s": 1.0217013779911213, "output_length": 144, "proxy_request_id": "1272313:9:1297810:243", "request_id": "1272313:9:1297810:243", "request_type": "coder", "requested_output_tokens": 144, "session_id": "1272313", "t_dispatch_unix": 1779817801.9172611, "t_finish_unix": 1779817802.9389625, "t_first_token_unix": 1779817802.0304735, "tpot_s": 0.006351377944041929, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593], "trace_timestamp_s": 208.16499999999996, "ttft_s": 0.11321033298736438, "turn_id": 9} +{"actual_output_tokens": 488, "cached_tokens": 23824, "effective_input_length": 23863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23863, "latency_s": 3.1014772880007513, "output_length": 488, "proxy_request_id": "1294611:3:1297534:240", "request_id": "1294611:3:1297534:240", "request_type": "coder", "requested_output_tokens": 488, "session_id": "1294611", "t_dispatch_unix": 1779817801.1027718, "t_finish_unix": 1779817804.2042494, "t_first_token_unix": 1779817801.1730547, "tpot_s": 0.006223634669334423, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12905263], "trace_timestamp_s": 207.35100000000057, "ttft_s": 0.07028109801467508, "turn_id": 3} +{"actual_output_tokens": 226, "cached_tokens": 1536, "effective_input_length": 13992, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13992, "latency_s": 2.427125280024484, "output_length": 226, "proxy_request_id": "1297811:1:1297811:244", "request_id": "1297811:1:1297811:244", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1297811", "t_dispatch_unix": 1779817801.9248564, "t_finish_unix": 1779817804.3519814, "t_first_token_unix": 1779817803.0798328, "tpot_s": 0.005652902373371439, "trace_hash_ids": [3411, 3412, 3413, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 2642723, 18908, 18909, 18910, 2642724, 1369412, 12886430, 12886431, 12907594, 12907595, 41662, 12907596], "trace_timestamp_s": 208.16600000000017, "ttft_s": 1.1549753750441596, "turn_id": 1} +{"actual_output_tokens": 270, "cached_tokens": 96736, "effective_input_length": 97145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97145, "latency_s": 3.235241005953867, "output_length": 270, "proxy_request_id": "1266668:10:1297641:241", "request_id": "1266668:10:1297641:241", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1266668", "t_dispatch_unix": 1779817801.3533368, "t_finish_unix": 1779817804.5885773, "t_first_token_unix": 1779817801.8880653, "tpot_s": 0.010038166795511035, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12905917], "trace_timestamp_s": 207.59799999999996, "ttft_s": 0.5347260379930958, "turn_id": 10} +{"actual_output_tokens": 18, "cached_tokens": 7280, "effective_input_length": 11994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11994, "latency_s": 1.8082445879699662, "output_length": 18, "proxy_request_id": "1290442:2:1298058:246", "request_id": "1290442:2:1298058:246", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1290442", "t_dispatch_unix": 1779817802.7965987, "t_finish_unix": 1779817804.6048434, "t_first_token_unix": 1779817804.5063875, "tpot_s": 0.005768246822031762, "trace_hash_ids": [12909662, 12909663, 12909664, 12909665, 12909666, 12909667, 12909668, 12909669, 12909670, 12909671, 12909672, 12909673, 12909674, 12909675, 12909676, 12909677, 12909678, 12909679, 12909680, 12909681, 12909682, 12909683, 12909684, 12909685], "trace_timestamp_s": 209.04100000000017, "ttft_s": 1.709787257015705, "turn_id": 2} +{"actual_output_tokens": 169, "cached_tokens": 24800, "effective_input_length": 25103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25103, "latency_s": 1.1742268180241808, "output_length": 169, "proxy_request_id": "1290365:4:1298540:247", "request_id": "1290365:4:1298540:247", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1290365", "t_dispatch_unix": 1779817804.5007396, "t_finish_unix": 1779817805.6749666, "t_first_token_unix": 1779817804.6306608, "tpot_s": 0.006214367738201483, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486, 12914159, 12914160], "trace_timestamp_s": 210.7490000000007, "ttft_s": 0.12991957901977003, "turn_id": 4} +{"actual_output_tokens": 353, "cached_tokens": 13168, "effective_input_length": 21630, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21630, "latency_s": 3.870643357047811, "output_length": 353, "proxy_request_id": "1268861:3:1298057:245", "request_id": "1268861:3:1298057:245", "request_type": "coder", "requested_output_tokens": 353, "session_id": "1268861", "t_dispatch_unix": 1779817802.7821734, "t_finish_unix": 1779817806.652817, "t_first_token_unix": 1779817804.5051734, "tpot_s": 0.006100565082471638, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 12909661], "trace_timestamp_s": 209.02700000000004, "ttft_s": 1.7229981090058573, "turn_id": 3} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 9530, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9530, "latency_s": 0.9458085399819538, "output_length": 36, "proxy_request_id": "1298970:1:1298970:248", "request_id": "1298970:1:1298970:248", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1298970", "t_dispatch_unix": 1779817806.065985, "t_finish_unix": 1779817807.0117931, "t_first_token_unix": 1779817806.8305798, "tpot_s": 0.005171006829810462, "trace_hash_ids": [12901321, 12901322, 12901323, 12901324, 12901325, 12901326, 12901327, 12906384, 12906385, 12911458, 12918873, 12918874, 12918875, 12918876, 12918877, 12918878, 12918879, 12918880, 12918881], "trace_timestamp_s": 212.3110000000006, "ttft_s": 0.7645931079750881, "turn_id": 1} +{"actual_output_tokens": 355, "cached_tokens": 35632, "effective_input_length": 35669, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35669, "latency_s": 10.966383890016004, "output_length": 355, "proxy_request_id": "1262354:15:1296106:234", "request_id": "1262354:15:1296106:234", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1262354", "t_dispatch_unix": 1779817796.213149, "t_finish_unix": 1779817807.1795325, "t_first_token_unix": 1779817796.322841, "tpot_s": 0.030667825452036272, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540, 12892843], "trace_timestamp_s": 202.45900000000074, "ttft_s": 0.10968938999576494, "turn_id": 15} +{"actual_output_tokens": 226, "cached_tokens": 0, "effective_input_length": 881, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 881, "latency_s": 1.193374230992049, "output_length": 226, "proxy_request_id": "1299073:1:1299073:249", "request_id": "1299073:1:1299073:249", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1299073", "t_dispatch_unix": 1779817806.426212, "t_finish_unix": 1779817807.619586, "t_first_token_unix": 1779817806.51064, "tpot_s": 0.004927495911251753, "trace_hash_ids": [7025, 12919848], "trace_timestamp_s": 212.67500000000018, "ttft_s": 0.08442708099028096, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 42208, "effective_input_length": 42363, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42363, "latency_s": 6.484411409008317, "output_length": 36, "proxy_request_id": "1260327:7:1297673:242", "request_id": "1260327:7:1297673:242", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1260327", "t_dispatch_unix": 1779817801.4442236, "t_finish_unix": 1779817807.9286354, "t_first_token_unix": 1779817806.8557057, "tpot_s": 0.030646524629888258, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182], "trace_timestamp_s": 207.692, "ttft_s": 5.411480231967289, "turn_id": 7} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 8352, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8352, "latency_s": 0.7439985229866579, "output_length": 27, "proxy_request_id": "1296872:2:1299394:251", "request_id": "1296872:2:1299394:251", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1296872", "t_dispatch_unix": 1779817807.3643498, "t_finish_unix": 1779817808.1083486, "t_first_token_unix": 1779817807.9832451, "tpot_s": 0.004801376498877429, "trace_hash_ids": [12899223, 12908829, 12908830, 12908831, 12908832, 12915224, 12915225, 12915226, 12915227, 12915228, 12915229, 12915230, 12921915, 12921916, 12921917, 12921918, 12921919], "trace_timestamp_s": 213.61000000000058, "ttft_s": 0.6188927949988283, "turn_id": 2} +{"actual_output_tokens": 38, "cached_tokens": 1824, "effective_input_length": 7963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7963, "latency_s": 1.0998015609802678, "output_length": 38, "proxy_request_id": "1296983:2:1299368:250", "request_id": "1296983:2:1299368:250", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1296983", "t_dispatch_unix": 1779817807.2510087, "t_finish_unix": 1779817808.35081, "t_first_token_unix": 1779817807.7478254, "tpot_s": 0.01628713048616978, "trace_hash_ids": [12890444, 12900454, 12900455, 12907879, 12907880, 12907881, 12907882, 12914282, 12914283, 12914284, 12921804, 12921805, 12921806, 12921807, 12921808, 12921809], "trace_timestamp_s": 213.4970000000003, "ttft_s": 0.4968156410031952, "turn_id": 2} +{"actual_output_tokens": 18, "cached_tokens": 0, "effective_input_length": 19157, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19157, "latency_s": 2.1280820929678157, "output_length": 18, "proxy_request_id": "1292750:2:1299406:252", "request_id": "1292750:2:1299406:252", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1292750", "t_dispatch_unix": 1779817807.4030633, "t_finish_unix": 1779817809.5311458, "t_first_token_unix": 1779817809.3383336, "tpot_s": 0.011318175471387804, "trace_hash_ids": [12922192, 12922193, 12922194, 12922195, 12922196, 12922197, 12922198, 12922199, 12922200, 12922201, 12922202, 12922203, 12922204, 12922205, 12922206, 12922207, 12922208, 12922209, 12922210, 12922211, 12922212, 12922213, 12922214, 12922215, 12922216, 12922217, 12922218, 12922219, 12922220, 12922221, 12922222, 12922223, 12922224, 12922225, 12922226, 12922227, 12922228, 12922229], "trace_timestamp_s": 213.64500000000044, "ttft_s": 1.9352684489567764, "turn_id": 2} +{"actual_output_tokens": 224, "cached_tokens": 40768, "effective_input_length": 60193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60193, "latency_s": 10.022003716032486, "output_length": 224, "proxy_request_id": "1279412:7:1297236:238", "request_id": "1279412:7:1297236:238", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1279412", "t_dispatch_unix": 1779817800.2566857, "t_finish_unix": 1779817810.278689, "t_first_token_unix": 1779817806.851775, "tpot_s": 0.015366092421356671, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12902561], "trace_timestamp_s": 206.4970000000003, "ttft_s": 6.595086728048045, "turn_id": 7} +{"actual_output_tokens": 222, "cached_tokens": 29280, "effective_input_length": 29486, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29486, "latency_s": 2.1067460770136677, "output_length": 222, "proxy_request_id": "1272313:10:1299814:254", "request_id": "1272313:10:1299814:254", "request_type": "coder", "requested_output_tokens": 222, "session_id": "1272313", "t_dispatch_unix": 1779817808.781007, "t_finish_unix": 1779817810.8877532, "t_first_token_unix": 1779817809.4180264, "tpot_s": 0.006649011488723657, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593, 12926791], "trace_timestamp_s": 215.02900000000045, "ttft_s": 0.6370174229959957, "turn_id": 10} +{"actual_output_tokens": 114, "cached_tokens": 14080, "effective_input_length": 14213, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14213, "latency_s": 0.6993467760039493, "output_length": 114, "proxy_request_id": "1286804:2:1300234:256", "request_id": "1286804:2:1300234:256", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1286804", "t_dispatch_unix": 1779817810.2300806, "t_finish_unix": 1779817810.9294271, "t_first_token_unix": 1779817810.3042655, "tpot_s": 0.00553033611504361, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548], "trace_timestamp_s": 216.47900000000027, "ttft_s": 0.07418368698563427, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 24336, "effective_input_length": 24384, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24384, "latency_s": 0.42109397100284696, "output_length": 61, "proxy_request_id": "1294611:4:1300505:257", "request_id": "1294611:4:1300505:257", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1294611", "t_dispatch_unix": 1779817811.2481675, "t_finish_unix": 1779817811.6692612, "t_first_token_unix": 1779817811.3136146, "tpot_s": 0.0059228671171392, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12933072], "trace_timestamp_s": 217.4960000000001, "ttft_s": 0.06544574099825695, "turn_id": 4} +{"actual_output_tokens": 211, "cached_tokens": 60416, "effective_input_length": 60678, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60678, "latency_s": 2.669058390019927, "output_length": 211, "proxy_request_id": "1279412:8:1300001:255", "request_id": "1279412:8:1300001:255", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1279412", "t_dispatch_unix": 1779817810.2816455, "t_finish_unix": 1779817812.950704, "t_first_token_unix": 1779817810.5089335, "tpot_s": 0.011626031728727476, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12928377], "trace_timestamp_s": 215.70900000000074, "ttft_s": 0.22728582698618993, "turn_id": 8} +{"actual_output_tokens": 44, "cached_tokens": 18944, "effective_input_length": 62414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62414, "latency_s": 12.409946460975334, "output_length": 44, "proxy_request_id": "1297473:1:1297473:239", "request_id": "1297473:1:1297473:239", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1297473", "t_dispatch_unix": 1779817800.996195, "t_finish_unix": 1779817813.4061415, "t_first_token_unix": 1779817813.0925841, "tpot_s": 0.007285060162038737, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12904663, 5910591, 5910592, 5910593, 185213, 185214, 185215, 185216, 185217, 185218, 185219, 185220, 185221, 185222, 185223, 185224, 185225, 185226, 185227, 185228, 185229, 185230, 185231, 185232, 185233, 185234, 5910594, 5910595, 5910596, 5910597, 5910598, 5910599, 5910600, 5910601, 5910602, 5910603, 5910604, 5910605, 5910606, 5910607, 5910608, 5910609, 10616321, 10652041, 10652042, 10652043, 10652044, 10652045, 10652046, 10652047, 10652048, 10652049, 10652050, 10652051, 494688, 494689, 494690, 494691, 494692, 494693, 494694, 494695, 494696, 494697, 10806837, 10877108, 10877109, 10877110, 11193681, 11243946, 11449317, 11449318, 11562111, 11620173, 11788107, 11788108, 11788109, 11935542, 11935543, 12633973, 12633974, 12633975, 12904664, 12904665, 12904666], "trace_timestamp_s": 207.22700000000077, "ttft_s": 12.096386727993377, "turn_id": 1} +{"actual_output_tokens": 224, "cached_tokens": 0, "effective_input_length": 59507, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59507, "latency_s": 14.41706686199177, "output_length": 224, "proxy_request_id": "1297117:1:1297117:237", "request_id": "1297117:1:1297117:237", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1297117", "t_dispatch_unix": 1779817799.732869, "t_finish_unix": 1779817814.149936, "t_first_token_unix": 1779817812.3902018, "tpot_s": 0.007889954098646483, "trace_hash_ids": [260868, 260869, 260870, 519720, 519721, 519722, 519723, 519724, 8258402, 8258403, 8258404, 8258405, 8258406, 8258407, 8258408, 8258409, 8258410, 8258411, 8258412, 8258413, 11600903, 407435, 11420699, 11420700, 11600904, 11600905, 11600906, 11600907, 11600908, 11600909, 11600910, 11600911, 11600912, 11600913, 11600914, 11600915, 11600916, 11600917, 11600918, 11600919, 11600920, 11600921, 11600922, 11600923, 11600924, 11600925, 11600926, 11600927, 11600928, 11600929, 11600930, 11600931, 11600932, 11600933, 11600934, 11600935, 11600936, 11600937, 11600938, 11600939, 11600940, 11600941, 11600942, 11600943, 11600944, 11600945, 11600946, 11600947, 11600948, 11600949, 11600950, 11600951, 11600952, 11600953, 11600954, 11600955, 11600956, 11600957, 11600958, 11600959, 11600960, 11600961, 11600962, 11600963, 11600964, 11600965, 11600966, 11600967, 11779968, 11779969, 11779970, 11888331, 11888332, 12280028, 12280029, 12280030, 12280031, 12280032, 12280033, 12280034, 12280035, 12280036, 12386666, 12386667, 12386668, 12386669, 12386670, 12480643, 12480644, 12480645, 12480646, 12480647, 12672549, 12672550, 12901437, 12901438, 12901439], "trace_timestamp_s": 205.96000000000004, "ttft_s": 12.657330335001461, "turn_id": 1} +{"actual_output_tokens": 51, "cached_tokens": 24432, "effective_input_length": 25650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25650, "latency_s": 0.596585260995198, "output_length": 51, "proxy_request_id": "1294611:5:1301356:262", "request_id": "1294611:5:1301356:262", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1294611", "t_dispatch_unix": 1779817814.0682585, "t_finish_unix": 1779817814.6648436, "t_first_token_unix": 1779817814.3681412, "tpot_s": 0.005928358240053058, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 11891732], "trace_timestamp_s": 220.3160000000007, "ttft_s": 0.2998806060058996, "turn_id": 5} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 6527, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6527, "latency_s": 1.0350330070359632, "output_length": 48, "proxy_request_id": "1302071:1:1302071:267", "request_id": "1302071:1:1302071:267", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1302071", "t_dispatch_unix": 1779817816.7962286, "t_finish_unix": 1779817817.8312619, "t_first_token_unix": 1779817817.2533073, "tpot_s": 0.012290283490190321, "trace_hash_ids": [12922724, 12922725, 12922726, 12922727, 12932131, 12932132, 12932133, 12932134, 12932135, 12948308, 12948309, 12948310, 12948311], "trace_timestamp_s": 223.02900000000045, "ttft_s": 0.45707733801100403, "turn_id": 1} +{"actual_output_tokens": 2687, "cached_tokens": 31632, "effective_input_length": 44920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44920, "latency_s": 45.17610723996768, "output_length": 2687, "proxy_request_id": "1277909:3:1289205:201", "request_id": "1277909:3:1289205:201", "request_type": "coder", "requested_output_tokens": 2687, "session_id": "1277909", "t_dispatch_unix": 1779817772.8003786, "t_finish_unix": 1779817817.9764857, "t_first_token_unix": 1779817776.3718224, "tpot_s": 0.015489330674978964, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12772584, 12772585, 12772586, 12772587, 12772588, 12772589, 12772590, 12772591, 12772592, 12772593, 12772594, 12772595, 12772596, 12825757, 12825758, 12825759, 12825760, 12825761, 12825762, 12825763, 12825764, 12825765, 12825766, 12825767, 12825768, 12825769, 12825770, 12825771, 12825772, 12825773, 12825774, 12825775, 12825776, 12825777, 12825778, 12825779, 12825780, 12825781, 12825782, 12825783, 12825784], "trace_timestamp_s": 179.04300000000057, "ttft_s": 3.5714407559717074, "turn_id": 3} +{"actual_output_tokens": 90, "cached_tokens": 0, "effective_input_length": 1105, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1105, "latency_s": 0.5594245750107802, "output_length": 90, "proxy_request_id": "1302449:1:1302449:269", "request_id": "1302449:1:1302449:269", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1302449", "t_dispatch_unix": 1779817818.3266394, "t_finish_unix": 1779817818.8860638, "t_first_token_unix": 1779817818.4502895, "tpot_s": 0.004893295415232398, "trace_hash_ids": [12952117, 12952118, 12952119], "trace_timestamp_s": 224.57500000000073, "ttft_s": 0.12364878604421392, "turn_id": 1} +{"actual_output_tokens": 308, "cached_tokens": 97408, "effective_input_length": 97811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97811, "latency_s": 7.722384334017988, "output_length": 308, "proxy_request_id": "1266668:11:1300918:260", "request_id": "1266668:11:1300918:260", "request_type": "coder", "requested_output_tokens": 308, "session_id": "1266668", "t_dispatch_unix": 1779817812.7674267, "t_finish_unix": 1779817820.489811, "t_first_token_unix": 1779817813.2997344, "tpot_s": 0.02341875042679116, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12937140, 12937141, 1592266], "trace_timestamp_s": 219.01100000000042, "ttft_s": 0.5323049610015005, "turn_id": 11} +{"actual_output_tokens": 330, "cached_tokens": 25264, "effective_input_length": 25948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25948, "latency_s": 8.485289292002562, "output_length": 330, "proxy_request_id": "1290365:5:1300807:259", "request_id": "1290365:5:1300807:259", "request_type": "coder", "requested_output_tokens": 330, "session_id": "1290365", "t_dispatch_unix": 1779817812.4251196, "t_finish_unix": 1779817820.9104092, "t_first_token_unix": 1779817817.8950348, "tpot_s": 0.009164562954505096, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486, 12914159, 12936005, 12936006], "trace_timestamp_s": 218.67300000000068, "ttft_s": 5.469913151988294, "turn_id": 5} +{"actual_output_tokens": 935, "cached_tokens": 0, "effective_input_length": 18893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18893, "latency_s": 13.599479618947953, "output_length": 935, "proxy_request_id": "1299507:1:1299507:253", "request_id": "1299507:1:1299507:253", "request_type": "coder", "requested_output_tokens": 935, "session_id": "1299507", "t_dispatch_unix": 1779817807.6639643, "t_finish_unix": 1779817821.2634435, "t_first_token_unix": 1779817809.5878112, "tpot_s": 0.012500431295509233, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4629805, 12866561, 12923203, 12923204, 12923205, 12923206, 12923207, 12923208, 12923209, 12923210, 12923211, 12923212, 12923213, 12923214], "trace_timestamp_s": 213.91000000000076, "ttft_s": 1.923845122975763, "turn_id": 1} +{"actual_output_tokens": 43, "cached_tokens": 0, "effective_input_length": 26441, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26441, "latency_s": 4.569366383017041, "output_length": 43, "proxy_request_id": "1302063:1:1302063:266", "request_id": "1302063:1:1302063:266", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1302063", "t_dispatch_unix": 1779817816.7863545, "t_finish_unix": 1779817821.3557205, "t_first_token_unix": 1779817820.0628803, "tpot_s": 0.030774693403925215, "trace_hash_ids": [12896607, 12896608, 12896609, 12896610, 12896611, 12896612, 12896613, 12896614, 12896615, 12896616, 12896617, 12896618, 12896619, 12896620, 12896621, 12896622, 12896623, 12896624, 12896625, 12896626, 12896627, 12896628, 12896629, 12905071, 12905072, 12905073, 12905074, 12920854, 12920855, 12920856, 12920857, 12920858, 12920859, 12920860, 12920861, 12920862, 12920863, 12920864, 12928167, 12928168, 12928169, 12928170, 12928171, 12935909, 12935910, 12935911, 12935912, 12948081, 12948082, 12948083, 12948084, 12948085], "trace_timestamp_s": 223.01400000000012, "ttft_s": 3.276523223030381, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 15958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15958, "latency_s": 1.77840897499118, "output_length": 37, "proxy_request_id": "1302907:1:1302907:272", "request_id": "1302907:1:1302907:272", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1302907", "t_dispatch_unix": 1779817819.6916854, "t_finish_unix": 1779817821.4700937, "t_first_token_unix": 1779817821.169041, "tpot_s": 0.008354483473037059, "trace_hash_ids": [12894270, 12894271, 12894272, 12894273, 12894274, 12894275, 12894276, 12894277, 12894278, 12894279, 12894280, 12894281, 12894282, 12894283, 12894284, 12894285, 12894286, 12894287, 12902788, 12902789, 12902790, 12902791, 12911614, 12911615, 12911616, 12911617, 12942345, 12942346, 12942347, 12956121, 12956122, 12956123], "trace_timestamp_s": 225.9340000000002, "ttft_s": 1.4773544839699753, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 3709, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3709, "latency_s": 0.8938740440062247, "output_length": 45, "proxy_request_id": "1302449:2:1303563:277", "request_id": "1302449:2:1303563:277", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1302449", "t_dispatch_unix": 1779817822.0164924, "t_finish_unix": 1779817822.9103668, "t_first_token_unix": 1779817822.2900188, "tpot_s": 0.014093334318286825, "trace_hash_ids": [12952117, 12952118, 12962314, 12962315, 12962316, 12962317, 12962318, 12962319], "trace_timestamp_s": 228.26500000000033, "ttft_s": 0.27352493902435526, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 3065, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3065, "latency_s": 0.6730777519987896, "output_length": 46, "proxy_request_id": "1303651:1:1303651:278", "request_id": "1303651:1:1303651:278", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1303651", "t_dispatch_unix": 1779817822.3241086, "t_finish_unix": 1779817822.997186, "t_first_token_unix": 1779817822.5681112, "tpot_s": 0.009527318599996053, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324], "trace_timestamp_s": 228.57200000000012, "ttft_s": 0.2440009859856218, "turn_id": 1} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 14944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14944, "latency_s": 1.6211230580229312, "output_length": 54, "proxy_request_id": "1303462:1:1303462:274", "request_id": "1303462:1:1303462:274", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1303462", "t_dispatch_unix": 1779817821.722693, "t_finish_unix": 1779817823.3438156, "t_first_token_unix": 1779817823.054053, "tpot_s": 0.005461926283183033, "trace_hash_ids": [12910193, 12910194, 12919198, 12919199, 12919200, 12919201, 12919202, 12919203, 12919204, 12928156, 12928157, 12928158, 12928159, 12928160, 12928161, 12928162, 12945250, 12945251, 12945252, 12945253, 12952336, 12952337, 12952338, 12952339, 12961346, 12961347, 12961348, 12961349, 12961350, 12961351], "trace_timestamp_s": 227.96600000000035, "ttft_s": 1.3313587949960493, "turn_id": 1} +{"actual_output_tokens": 660, "cached_tokens": 42384, "effective_input_length": 43181, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43181, "latency_s": 8.237165746977553, "output_length": 660, "proxy_request_id": "1260327:8:1301686:263", "request_id": "1260327:8:1301686:263", "request_type": "coder", "requested_output_tokens": 660, "session_id": "1260327", "t_dispatch_unix": 1779817815.267966, "t_finish_unix": 1779817823.5051315, "t_first_token_unix": 1779817815.6188557, "tpot_s": 0.011966673667720704, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182, 12944584, 12944585], "trace_timestamp_s": 221.51600000000053, "ttft_s": 0.35088751395232975, "turn_id": 8} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 15081, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15081, "latency_s": 1.6792230479768477, "output_length": 61, "proxy_request_id": "1303517:1:1303517:275", "request_id": "1303517:1:1303517:275", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1303517", "t_dispatch_unix": 1779817821.8874831, "t_finish_unix": 1779817823.566706, "t_first_token_unix": 1779817823.2377334, "tpot_s": 0.005479349700423578, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12961789], "trace_timestamp_s": 228.1310000000003, "ttft_s": 1.3502488929661922, "turn_id": 1} +{"actual_output_tokens": 317, "cached_tokens": 25696, "effective_input_length": 30645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30645, "latency_s": 5.701569413999096, "output_length": 317, "proxy_request_id": "1294611:6:1302460:270", "request_id": "1294611:6:1302460:270", "request_type": "coder", "requested_output_tokens": 317, "session_id": "1294611", "t_dispatch_unix": 1779817818.345733, "t_finish_unix": 1779817824.0473025, "t_first_token_unix": 1779817821.0199583, "tpot_s": 0.009579095053722304, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210], "trace_timestamp_s": 224.59000000000015, "ttft_s": 2.6742237560101785, "turn_id": 6} +{"actual_output_tokens": 52, "cached_tokens": 26480, "effective_input_length": 30248, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30248, "latency_s": 1.2369488530093804, "output_length": 52, "proxy_request_id": "1302063:2:1303816:279", "request_id": "1302063:2:1303816:279", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1302063", "t_dispatch_unix": 1779817822.9938009, "t_finish_unix": 1779817824.2307498, "t_first_token_unix": 1779817823.8697798, "tpot_s": 0.0070723579219524185, "trace_hash_ids": [12965292, 12965293, 12965294, 12965295, 12965296, 12965297, 12965298, 12965299, 12965300, 12965301, 12965302, 12965303, 12965304, 12965305, 12965306, 12965307, 12965308, 12965309, 12965310, 12965311, 12965312, 12965313, 12965314, 12965315, 12965316, 12965317, 12965318, 12965319, 12965320, 12965321, 12965322, 12965323, 12965324, 12965325, 12965326, 12965327, 12965328, 12965329, 12965330, 12965331, 12965332, 12965333, 12965334, 12965335, 12965336, 12965337, 12965338, 12965339, 12965340, 12965341, 12965342, 12965343, 12965344, 12965345, 12965346, 12965347, 12965348, 12965349, 12965350, 12965351], "trace_timestamp_s": 229.23100000000068, "ttft_s": 0.8759765739669092, "turn_id": 2} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 1300, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1300, "latency_s": 0.2456316439784132, "output_length": 30, "proxy_request_id": "1304239:1:1304239:280", "request_id": "1304239:1:1304239:280", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1304239", "t_dispatch_unix": 1779817824.5238402, "t_finish_unix": 1779817824.7694714, "t_first_token_unix": 1779817824.6293957, "tpot_s": 0.004819633517462504, "trace_hash_ids": [12969576, 12969577, 12969578], "trace_timestamp_s": 230.77199999999993, "ttft_s": 0.10555505898082629, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 28972, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28972, "latency_s": 11.821645392978098, "output_length": 45, "proxy_request_id": "1295690:2:1301706:264", "request_id": "1295690:2:1301706:264", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1295690", "t_dispatch_unix": 1779817815.3559294, "t_finish_unix": 1779817827.1775746, "t_first_token_unix": 1779817819.086056, "tpot_s": 0.18388945997734976, "trace_hash_ids": [12944696, 12944697, 12944698, 12944699, 12944700, 12944701, 12944702, 12944703, 12944704, 12944705, 12944706, 12944707, 12944708, 12944709, 12944710, 12944711, 12944712, 12944713, 12944714, 12944715, 12944716, 12944717, 12944718, 12944719, 12944720, 12944721, 12944722, 12944723, 12944724, 12944725, 12944726, 12944727, 12944728, 12944729, 12944730, 12944731, 12944732, 12944733, 12944734, 12944735, 12944736, 12944737, 12944738, 12944739, 12944740, 12944741, 12944742, 12944743, 12944744, 12944745, 12944746, 12944747, 12944748, 12944749, 12944750, 12944751, 12944752], "trace_timestamp_s": 221.59400000000005, "ttft_s": 3.73012426198693, "turn_id": 2} +{"actual_output_tokens": 30, "cached_tokens": 1328, "effective_input_length": 7798, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7798, "latency_s": 0.6349528709542938, "output_length": 30, "proxy_request_id": "1304239:2:1304866:281", "request_id": "1304239:2:1304866:281", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1304239", "t_dispatch_unix": 1779817826.6720107, "t_finish_unix": 1779817827.3069634, "t_first_token_unix": 1779817827.1626382, "tpot_s": 0.004967638102745445, "trace_hash_ids": [12969576, 12969577, 12975186, 12975187, 12975188, 12975189, 12975190, 12975191, 12975192, 12975193, 12975194, 12975195, 12975196, 12975197, 12975198, 12975199], "trace_timestamp_s": 232.91800000000057, "ttft_s": 0.49062630999833345, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 2772, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2772, "latency_s": 0.47776369703933597, "output_length": 60, "proxy_request_id": "1304943:1:1304943:283", "request_id": "1304943:1:1304943:283", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1304943", "t_dispatch_unix": 1779817826.923781, "t_finish_unix": 1779817827.4015443, "t_first_token_unix": 1779817827.106483, "tpot_s": 0.004996498983542798, "trace_hash_ids": [12975642, 12975643, 12975644, 12975645, 12975646, 12975647], "trace_timestamp_s": 233.17200000000048, "ttft_s": 0.18270120699889958, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 17408, "effective_input_length": 49855, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49855, "latency_s": 9.87293703504838, "output_length": 81, "proxy_request_id": "1253743:3:1302294:268", "request_id": "1253743:3:1302294:268", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253743", "t_dispatch_unix": 1779817817.705748, "t_finish_unix": 1779817827.5786853, "t_first_token_unix": 1779817826.7474313, "tpot_s": 0.010380459574662382, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12950606], "trace_timestamp_s": 223.95300000000043, "ttft_s": 9.041678725043312, "turn_id": 3} +{"actual_output_tokens": 200, "cached_tokens": 30960, "effective_input_length": 30995, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30995, "latency_s": 1.3745036579784937, "output_length": 200, "proxy_request_id": "1294611:6:1305080:284", "request_id": "1294611:6:1305080:284", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1294611", "t_dispatch_unix": 1779817827.4331758, "t_finish_unix": 1779817828.8076792, "t_first_token_unix": 1779817827.5110772, "tpot_s": 0.006514100979746848, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12976597], "trace_timestamp_s": 233.6790000000001, "ttft_s": 0.07789994002087042, "turn_id": 6} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 12795, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12795, "latency_s": 1.1950137660023756, "output_length": 24, "proxy_request_id": "1303651:2:1305707:287", "request_id": "1303651:2:1305707:287", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1303651", "t_dispatch_unix": 1779817829.8655152, "t_finish_unix": 1779817831.060529, "t_first_token_unix": 1779817830.9496388, "tpot_s": 0.004808812999449994, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324, 12971828, 12971829, 12971830, 12971831, 12971832, 12971833, 12976416, 12976417, 12976418, 12976419, 12976420, 12976421, 12982240, 12982241, 12982242, 12982243, 12982244, 12982245, 12982246], "trace_timestamp_s": 236.11000000000058, "ttft_s": 1.084121934021823, "turn_id": 2} +{"actual_output_tokens": 9, "cached_tokens": 14992, "effective_input_length": 18631, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18631, "latency_s": 0.5880401940084994, "output_length": 9, "proxy_request_id": "1303462:2:1306126:290", "request_id": "1303462:2:1306126:290", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1303462", "t_dispatch_unix": 1779817831.092298, "t_finish_unix": 1779817831.680338, "t_first_token_unix": 1779817831.6508286, "tpot_s": 0.0036584938716259785, "trace_hash_ids": [12985881, 12985882, 12985883, 12985884, 12985885, 12985886, 12985887, 12985888, 12985889, 12985890, 12985891, 12985892, 12985893, 12985894, 12985895, 12985896, 12985897, 12985898, 12985899, 12985900, 12985901, 12985902, 12985903, 12985904, 12985905, 12985906, 12985907, 12985908, 12985909, 12985910, 12985911, 12985912, 12985913, 12985914, 12985915, 12985916, 12985917], "trace_timestamp_s": 237.33400000000074, "ttft_s": 0.558528378023766, "turn_id": 2} +{"actual_output_tokens": 75, "cached_tokens": 0, "effective_input_length": 897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 897, "latency_s": 0.4451911950018257, "output_length": 75, "proxy_request_id": "1306347:1:1306347:291", "request_id": "1306347:1:1306347:291", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1306347", "t_dispatch_unix": 1779817831.8821826, "t_finish_unix": 1779817832.327374, "t_first_token_unix": 1779817831.965924, "tpot_s": 0.004881000513607334, "trace_hash_ids": [12988101, 12988102], "trace_timestamp_s": 238.1310000000003, "ttft_s": 0.08374050498241559, "turn_id": 1} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 14027, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14027, "latency_s": 2.2491457870346494, "output_length": 183, "proxy_request_id": "1305906:1:1305906:289", "request_id": "1305906:1:1305906:289", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1305906", "t_dispatch_unix": 1779817830.476086, "t_finish_unix": 1779817832.7252316, "t_first_token_unix": 1779817831.6964786, "tpot_s": 0.005651136769102068, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 12984070], "trace_timestamp_s": 236.72000000000025, "ttft_s": 1.2203914790297858, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 7824, "effective_input_length": 13840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13840, "latency_s": 0.8338593579828739, "output_length": 31, "proxy_request_id": "1304239:3:1307007:294", "request_id": "1304239:3:1307007:294", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1304239", "t_dispatch_unix": 1779817834.2342143, "t_finish_unix": 1779817835.0680737, "t_first_token_unix": 1779817834.9145288, "tpot_s": 0.0051100790326017885, "trace_hash_ids": [12969576, 12969577, 12975186, 12975187, 12975188, 12975189, 12975190, 12975191, 12975192, 12975193, 12975194, 12975195, 12975196, 12975197, 12975198, 12980422, 12980423, 12980424, 12980425, 12980426, 12980427, 12980428, 12980429, 12987843, 12994759, 12994760, 12994761, 12994762], "trace_timestamp_s": 240.48100000000068, "ttft_s": 0.6803127049934119, "turn_id": 3} +{"actual_output_tokens": 64, "cached_tokens": 49920, "effective_input_length": 49975, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49975, "latency_s": 0.8851137669989839, "output_length": 64, "proxy_request_id": "1253743:4:1307058:295", "request_id": "1253743:4:1307058:295", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1253743", "t_dispatch_unix": 1779817834.4297779, "t_finish_unix": 1779817835.3148918, "t_first_token_unix": 1779817834.5703747, "tpot_s": 0.011811575794126838, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12995459], "trace_timestamp_s": 240.6780000000008, "ttft_s": 0.140594560012687, "turn_id": 4} +{"actual_output_tokens": 155, "cached_tokens": 31184, "effective_input_length": 43378, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43378, "latency_s": 4.297522329026833, "output_length": 155, "proxy_request_id": "1294611:7:1306822:293", "request_id": "1294611:7:1306822:293", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1294611", "t_dispatch_unix": 1779817833.6992533, "t_finish_unix": 1779817837.996775, "t_first_token_unix": 1779817836.890842, "tpot_s": 0.0071788533895379295, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800], "trace_timestamp_s": 239.9430000000002, "ttft_s": 3.191587422043085, "turn_id": 7} +{"actual_output_tokens": 487, "cached_tokens": 51184, "effective_input_length": 54451, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54451, "latency_s": 25.13145537499804, "output_length": 487, "proxy_request_id": "1269373:9:1300958:261", "request_id": "1269373:9:1300958:261", "request_type": "coder", "requested_output_tokens": 487, "session_id": "1269373", "t_dispatch_unix": 1779817812.9125154, "t_finish_unix": 1779817838.0439708, "t_first_token_unix": 1779817814.5025651, "tpot_s": 0.048438083074092024, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12937628], "trace_timestamp_s": 219.15800000000036, "ttft_s": 1.5900470159831457, "turn_id": 9} +{"actual_output_tokens": 65, "cached_tokens": 15136, "effective_input_length": 23131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23131, "latency_s": 1.642465585959144, "output_length": 65, "proxy_request_id": "1303517:2:1307703:297", "request_id": "1303517:2:1307703:297", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1303517", "t_dispatch_unix": 1779817836.7594156, "t_finish_unix": 1779817838.4018815, "t_first_token_unix": 1779817838.0236967, "tpot_s": 0.005904900265704782, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13001399], "trace_timestamp_s": 243.0050000000001, "ttft_s": 1.2642785299685784, "turn_id": 2} +{"actual_output_tokens": 524, "cached_tokens": 21392, "effective_input_length": 31058, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31058, "latency_s": 6.905708061007317, "output_length": 524, "proxy_request_id": "1277428:2:1306373:292", "request_id": "1277428:2:1306373:292", "request_type": "coder", "requested_output_tokens": 524, "session_id": "1277428", "t_dispatch_unix": 1779817831.9886935, "t_finish_unix": 1779817838.8944016, "t_first_token_unix": 1779817833.9462829, "tpot_s": 0.009460440615702235, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395], "trace_timestamp_s": 238.2360000000008, "ttft_s": 1.95758605300216, "turn_id": 2} +{"actual_output_tokens": 18, "cached_tokens": 0, "effective_input_length": 8729, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8729, "latency_s": 0.7431450709700584, "output_length": 18, "proxy_request_id": "1302449:3:1308121:299", "request_id": "1302449:3:1308121:299", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1302449", "t_dispatch_unix": 1779817838.1689043, "t_finish_unix": 1779817838.912049, "t_first_token_unix": 1779817838.8293195, "tpot_s": 0.004850746235152816, "trace_hash_ids": [13004569, 13004570, 13004571, 13004572, 13004573, 13004574, 13004575, 13004576, 13004577, 13004578, 13004579, 13004580, 13004581, 13004582, 13004583, 13004584, 13004585, 115654], "trace_timestamp_s": 244.41499999999996, "ttft_s": 0.6604138319962658, "turn_id": 3} +{"actual_output_tokens": 2669, "cached_tokens": 0, "effective_input_length": 34706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34706, "latency_s": 23.569389585987665, "output_length": 2669, "proxy_request_id": "1301929:1:1301929:265", "request_id": "1301929:1:1301929:265", "request_type": "coder", "requested_output_tokens": 2669, "session_id": "1301929", "t_dispatch_unix": 1779817816.2232497, "t_finish_unix": 1779817839.792639, "t_first_token_unix": 1779817821.2627313, "tpot_s": 0.006945115853833367, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950], "trace_timestamp_s": 222.46100000000024, "ttft_s": 5.039480037987232, "turn_id": 1} +{"actual_output_tokens": 16, "cached_tokens": 12816, "effective_input_length": 22896, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22896, "latency_s": 1.6244090200052597, "output_length": 16, "proxy_request_id": "1303651:3:1308202:300", "request_id": "1303651:3:1308202:300", "request_type": "coder", "requested_output_tokens": 16, "session_id": "1303651", "t_dispatch_unix": 1779817838.4229798, "t_finish_unix": 1779817840.0473883, "t_first_token_unix": 1779817839.9738083, "tpot_s": 0.004888430932381501, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324, 12971828, 12971829, 12971830, 12971831, 12971832, 12971833, 12976416, 12976417, 12976418, 12976419, 12976420, 12976421, 12982240, 12982241, 12982242, 12982243, 12982244, 12982245, 12982246, 12989553, 12989554, 12989555, 12989556, 12997676, 12997677, 12997678, 12997679, 12997680, 12997681, 12997682, 13005482, 13005483, 13005484, 13005485, 13005486, 13005487, 13005488, 13005489, 13005490], "trace_timestamp_s": 244.66800000000057, "ttft_s": 1.5508271120488644, "turn_id": 3} +{"actual_output_tokens": 12, "cached_tokens": 23184, "effective_input_length": 23259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23259, "latency_s": 0.13156373100355268, "output_length": 12, "proxy_request_id": "1303517:3:1309213:303", "request_id": "1303517:3:1309213:303", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1303517", "t_dispatch_unix": 1779817842.1659045, "t_finish_unix": 1779817842.2974684, "t_first_token_unix": 1779817842.253411, "tpot_s": 0.003978266454809768, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13015129], "trace_timestamp_s": 248.41400000000067, "ttft_s": 0.08750447898637503, "turn_id": 3} +{"actual_output_tokens": 96, "cached_tokens": 0, "effective_input_length": 4679, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4679, "latency_s": 0.7905859450111166, "output_length": 96, "proxy_request_id": "1309040:1:1309040:302", "request_id": "1309040:1:1309040:302", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1309040", "t_dispatch_unix": 1779817841.5412812, "t_finish_unix": 1779817842.331867, "t_first_token_unix": 1779817841.8432126, "tpot_s": 0.00514111878950835, "trace_hash_ids": [13004558, 13004559, 13004560, 13004561, 13004562, 13013455, 13013456, 13013457, 13013458, 13013459], "trace_timestamp_s": 247.78800000000047, "ttft_s": 0.3019300060113892, "turn_id": 1} +{"actual_output_tokens": 1838, "cached_tokens": 29696, "effective_input_length": 29948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29948, "latency_s": 23.97647128702374, "output_length": 1838, "proxy_request_id": "1272313:11:1302571:271", "request_id": "1272313:11:1302571:271", "request_type": "coder", "requested_output_tokens": 1838, "session_id": "1272313", "t_dispatch_unix": 1779817818.6480432, "t_finish_unix": 1779817842.624514, "t_first_token_unix": 1779817826.7502165, "tpot_s": 0.008641287401735795, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593, 12953259, 12953260], "trace_timestamp_s": 224.89600000000064, "ttft_s": 8.10216993902577, "turn_id": 11} +{"actual_output_tokens": 176, "cached_tokens": 43520, "effective_input_length": 43710, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43710, "latency_s": 1.4247419000021182, "output_length": 176, "proxy_request_id": "1294611:8:1308970:301", "request_id": "1294611:8:1308970:301", "request_type": "coder", "requested_output_tokens": 176, "session_id": "1294611", "t_dispatch_unix": 1779817841.2063117, "t_finish_unix": 1779817842.6310527, "t_first_token_unix": 1779817841.378522, "tpot_s": 0.007155704783009632, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13012865], "trace_timestamp_s": 247.45400000000063, "ttft_s": 0.17220755899325013, "turn_id": 8} +{"actual_output_tokens": 224, "cached_tokens": 18912, "effective_input_length": 18915, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18915, "latency_s": 13.345835667976644, "output_length": 224, "proxy_request_id": "1299507:2:1305770:288", "request_id": "1299507:2:1305770:288", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1299507", "t_dispatch_unix": 1779817830.0591476, "t_finish_unix": 1779817843.404983, "t_first_token_unix": 1779817838.0569649, "tpot_s": 0.02398105219738441, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4629805, 12866561, 12923203, 12923204, 12923205, 12923206, 12923207, 12923208, 12923209, 12923210, 12923211, 12923212, 12923213, 12983096], "trace_timestamp_s": 236.3070000000007, "ttft_s": 7.997814545989968, "turn_id": 2} +{"actual_output_tokens": 234, "cached_tokens": 54928, "effective_input_length": 59146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59146, "latency_s": 5.774047897022683, "output_length": 234, "proxy_request_id": "1269373:10:1304899:282", "request_id": "1269373:10:1304899:282", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1269373", "t_dispatch_unix": 1779817838.04962, "t_finish_unix": 1779817843.8236673, "t_first_token_unix": 1779817839.7203364, "tpot_s": 0.017609729085821067, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12975438], "trace_timestamp_s": 233.03900000000067, "ttft_s": 1.6707144299871288, "turn_id": 10} +{"actual_output_tokens": 300, "cached_tokens": 0, "effective_input_length": 24545, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24545, "latency_s": 4.680998304975219, "output_length": 300, "proxy_request_id": "1309252:1:1309252:304", "request_id": "1309252:1:1309252:304", "request_type": "coder", "requested_output_tokens": 300, "session_id": "1309252", "t_dispatch_unix": 1779817842.3687918, "t_finish_unix": 1779817847.04979, "t_first_token_unix": 1779817845.2025383, "tpot_s": 0.0061771514849662534, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13015384, 13015385, 13015386, 13015387, 13015388, 13015389, 13015390, 13015391, 13015392, 13015393, 13015394, 13015395, 13015396, 13015397, 13015398, 13015399, 13015400, 13015401, 13015402, 13015403, 13015404, 13015405, 13015406, 13015407, 13015408, 13015409, 13015410, 13015411], "trace_timestamp_s": 248.60900000000038, "ttft_s": 2.833743968978524, "turn_id": 1} +{"actual_output_tokens": 85, "cached_tokens": 0, "effective_input_length": 18089, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18089, "latency_s": 2.2792111239978112, "output_length": 85, "proxy_request_id": "1310590:1:1310590:306", "request_id": "1310590:1:1310590:306", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1310590", "t_dispatch_unix": 1779817846.952985, "t_finish_unix": 1779817849.2321966, "t_first_token_unix": 1779817848.7462428, "tpot_s": 0.005781913833093962, "trace_hash_ids": [12996713, 12996714, 12996715, 12996716, 12996717, 12996718, 12996719, 12996720, 12996721, 12996722, 12996723, 12996724, 12996725, 12996726, 12996727, 12996728, 12996729, 12996730, 12996731, 12996732, 12996733, 12996734, 12996735, 12996736, 13016155, 13016156, 13016157, 13016158, 13016159, 13016160, 13027764, 13027765, 13027766, 13027767, 13027768, 13027769], "trace_timestamp_s": 253.19500000000062, "ttft_s": 1.7932554259896278, "turn_id": 1} +{"actual_output_tokens": 4192, "cached_tokens": 14208, "effective_input_length": 43607, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43607, "latency_s": 38.27111709699966, "output_length": 4192, "proxy_request_id": "1297811:2:1300578:258", "request_id": "1297811:2:1300578:258", "request_type": "coder", "requested_output_tokens": 4192, "session_id": "1297811", "t_dispatch_unix": 1779817811.5653877, "t_finish_unix": 1779817849.8365042, "t_first_token_unix": 1779817817.892779, "tpot_s": 0.007621911389876443, "trace_hash_ids": [3411, 3412, 3413, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 2642723, 18908, 18909, 18910, 2642724, 1369412, 12886430, 12886431, 12907594, 12907595, 41662, 12933568, 12933569, 12933570, 12933571, 12933572, 12933573, 12933574, 12933575, 12933576, 12933577, 12933578, 12933579, 12933580, 12933581, 12933582, 12933583, 12933584, 12933585, 12933586, 12933587, 12933588, 12933589, 12933590, 12933591, 12933592, 12933593, 12933594, 12933595, 12933596, 12933597, 12933598, 12933599, 12933600, 12933601, 12933602, 12933603, 12933604, 12933605, 12933606, 12933607, 12933608, 12933609, 12933610, 12933611, 12933612, 12933613, 12933614, 12933615, 12933616, 12933617, 12933618, 12933619, 12933620, 12933621, 12933622, 12933623, 12933624, 12933625, 12933626], "trace_timestamp_s": 217.8030000000008, "ttft_s": 6.327389387995936, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 23264, "effective_input_length": 24638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24638, "latency_s": 0.5006878150161356, "output_length": 31, "proxy_request_id": "1303517:4:1311293:308", "request_id": "1303517:4:1311293:308", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1303517", "t_dispatch_unix": 1779817849.4004803, "t_finish_unix": 1779817849.901168, "t_first_token_unix": 1779817849.7349815, "tpot_s": 0.005531551166980838, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13021779, 13021780, 13034659, 13034660], "trace_timestamp_s": 255.64800000000014, "ttft_s": 0.3344986760057509, "turn_id": 4} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 13164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13164, "latency_s": 1.2954100030474365, "output_length": 12, "proxy_request_id": "1304943:2:1311189:307", "request_id": "1304943:2:1311189:307", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1304943", "t_dispatch_unix": 1779817849.0862293, "t_finish_unix": 1779817850.3816388, "t_first_token_unix": 1779817850.232793, "tpot_s": 0.013497226908591321, "trace_hash_ids": [12975642, 12975643, 12975644, 12975645, 12975646, 12982335, 12982336, 12991755, 12991756, 12991757, 12991758, 13001111, 13001112, 13001113, 13001114, 13008530, 13008531, 13008532, 13008533, 13008534, 13008535, 13016603, 13016604, 13016605, 13025488, 13033993], "trace_timestamp_s": 255.32999999999993, "ttft_s": 1.1465627160505392, "turn_id": 2} +{"actual_output_tokens": 75, "cached_tokens": 0, "effective_input_length": 75826, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75826, "latency_s": 21.904901639034506, "output_length": 75, "proxy_request_id": "1305420:1:1305420:285", "request_id": "1305420:1:1305420:285", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1305420", "t_dispatch_unix": 1779817828.6789339, "t_finish_unix": 1779817850.5838351, "t_first_token_unix": 1779817848.593202, "tpot_s": 0.02689493666214214, "trace_hash_ids": [442944, 442945, 442946, 442947, 442948, 442949, 442950, 442951, 442952, 442953, 442954, 442955, 442956, 442957, 442958, 442959, 1172223, 1172224, 1172225, 1172226, 1172227, 1172228, 1172229, 4960061, 8457619, 8457620, 8457621, 8457622, 8457623, 8457624, 8457625, 8457626, 8457627, 8457628, 8457629, 8457630, 8457631, 8457632, 8457633, 8457634, 8457635, 8457636, 8457637, 8457638, 8457639, 8457640, 8457641, 8457642, 8457643, 8457644, 8457645, 8457646, 8457647, 8457648, 8457649, 8457650, 8457651, 8457652, 8457653, 8457654, 8457655, 8457656, 8457657, 8457658, 8457659, 8457660, 8457661, 8457662, 8457663, 8457664, 8457665, 8457666, 8457667, 8457668, 8457669, 8457670, 8457671, 8457672, 8457673, 8457674, 8457675, 8457676, 8457677, 8457678, 8457679, 8457680, 8457681, 8457682, 8457683, 9708906, 9708907, 9708908, 9708909, 9708910, 9708911, 9708912, 9708913, 9708914, 9708915, 9708916, 9708917, 9708918, 9708919, 9708920, 9708921, 9708922, 9708923, 10055928, 10055929, 10055930, 10055931, 10055932, 10055933, 10055934, 10055935, 10055936, 10055937, 10481518, 10481519, 10481520, 10481521, 10481522, 10481523, 10481524, 12979484, 12979485, 12979486, 12979487, 12979488, 12979489, 12979490, 12979491, 12979492, 12979493, 12979494, 12979495, 12979496, 12979497, 12979498, 12979499, 12979500, 12979501, 12979502, 12979503, 12979504, 12979505, 12979506, 12979507, 12979508], "trace_timestamp_s": 234.89900000000034, "ttft_s": 19.914265706029255, "turn_id": 1} +{"actual_output_tokens": 109, "cached_tokens": 60880, "effective_input_length": 61291, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61291, "latency_s": 21.269030545954593, "output_length": 109, "proxy_request_id": "1279412:9:1305633:286", "request_id": "1279412:9:1305633:286", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1279412", "t_dispatch_unix": 1779817829.5951223, "t_finish_unix": 1779817850.8641527, "t_first_token_unix": 1779817848.5988536, "tpot_s": 0.020972655083621956, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330], "trace_timestamp_s": 235.84100000000035, "ttft_s": 19.00372942595277, "turn_id": 9} +{"actual_output_tokens": 55, "cached_tokens": 31568, "effective_input_length": 31611, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31611, "latency_s": 0.9432807639823295, "output_length": 55, "proxy_request_id": "1277428:3:1311644:311", "request_id": "1277428:3:1311644:311", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1277428", "t_dispatch_unix": 1779817850.706365, "t_finish_unix": 1779817851.649646, "t_first_token_unix": 1779817851.2558813, "tpot_s": 0.007286479444398235, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512], "trace_timestamp_s": 256.9549999999999, "ttft_s": 0.5495134210214019, "turn_id": 3} +{"actual_output_tokens": 98, "cached_tokens": 61392, "effective_input_length": 61505, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61505, "latency_s": 0.9398882469977252, "output_length": 98, "proxy_request_id": "1279412:10:1308091:298", "request_id": "1279412:10:1308091:298", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1279412", "t_dispatch_unix": 1779817850.8673003, "t_finish_unix": 1779817851.8071887, "t_first_token_unix": 1779817851.0493724, "tpot_s": 0.0078098833190094795, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13004461], "trace_timestamp_s": 244.3130000000001, "ttft_s": 0.18206973205087706, "turn_id": 10} +{"actual_output_tokens": 504, "cached_tokens": 59376, "effective_input_length": 59446, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59446, "latency_s": 8.02847533498425, "output_length": 504, "proxy_request_id": "1269373:11:1307381:296", "request_id": "1269373:11:1307381:296", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1269373", "t_dispatch_unix": 1779817843.8278131, "t_finish_unix": 1779817851.8562882, "t_first_token_unix": 1779817844.0092921, "tpot_s": 0.015599958532768493, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 12998344], "trace_timestamp_s": 241.84600000000046, "ttft_s": 0.1814755109953694, "turn_id": 11} +{"actual_output_tokens": 346, "cached_tokens": 0, "effective_input_length": 8996, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8996, "latency_s": 2.706692665000446, "output_length": 346, "proxy_request_id": "1258908:2:1311606:310", "request_id": "1258908:2:1311606:310", "request_type": "coder", "requested_output_tokens": 346, "session_id": "1258908", "t_dispatch_unix": 1779817850.529208, "t_finish_unix": 1779817853.2359006, "t_first_token_unix": 1779817851.2082555, "tpot_s": 0.0058765122638272955, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13037147, 13037148], "trace_timestamp_s": 256.77800000000025, "ttft_s": 0.6790459729963914, "turn_id": 2} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 20175, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20175, "latency_s": 2.294339629006572, "output_length": 33, "proxy_request_id": "1311753:1:1311753:312", "request_id": "1311753:1:1311753:312", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1311753", "t_dispatch_unix": 1779817851.1007369, "t_finish_unix": 1779817853.3950758, "t_first_token_unix": 1779817853.21538, "tpot_s": 0.005594421281784889, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13038944], "trace_timestamp_s": 257.34200000000055, "ttft_s": 2.114641266001854, "turn_id": 1} +{"actual_output_tokens": 166, "cached_tokens": 61600, "effective_input_length": 64558, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64558, "latency_s": 2.6935605330509134, "output_length": 166, "proxy_request_id": "1279412:11:1310014:305", "request_id": "1279412:11:1310014:305", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1279412", "t_dispatch_unix": 1779817851.8111506, "t_finish_unix": 1779817854.5047112, "t_first_token_unix": 1779817853.143525, "tpot_s": 0.008248160599914352, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13022377], "trace_timestamp_s": 251.2470000000003, "ttft_s": 1.3323712210403755, "turn_id": 11} +{"actual_output_tokens": 178, "cached_tokens": 43872, "effective_input_length": 44335, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44335, "latency_s": 1.5456399870454334, "output_length": 178, "proxy_request_id": "1294611:9:1312398:313", "request_id": "1294611:9:1312398:313", "request_type": "coder", "requested_output_tokens": 178, "session_id": "1294611", "t_dispatch_unix": 1779817853.3819585, "t_finish_unix": 1779817854.927598, "t_first_token_unix": 1779817853.6542246, "tpot_s": 0.007192630683516526, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13044795], "trace_timestamp_s": 259.6290000000008, "ttft_s": 0.2722640660358593, "turn_id": 9} +{"actual_output_tokens": 96, "cached_tokens": 24832, "effective_input_length": 44792, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44792, "latency_s": 5.620244321005885, "output_length": 96, "proxy_request_id": "1309252:2:1311531:309", "request_id": "1309252:2:1311531:309", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1309252", "t_dispatch_unix": 1779817850.29839, "t_finish_unix": 1779817855.918634, "t_first_token_unix": 1779817855.2515016, "tpot_s": 0.007019365179401479, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13036739, 13036740, 13036741, 13036742, 13036743, 13036744, 13036745, 13036746, 13036747, 13036748, 13036749, 13036750, 13036751, 13036752, 13036753, 13036754, 13036755, 13036756, 13036757, 13036758, 13036759, 13036760, 13036761, 13036762, 13036763, 13036764, 13036765, 13036766, 13036767], "trace_timestamp_s": 256.53099999999995, "ttft_s": 4.953109950991347, "turn_id": 2} +{"actual_output_tokens": 9, "cached_tokens": 24656, "effective_input_length": 25637, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25637, "latency_s": 1.134710103040561, "output_length": 9, "proxy_request_id": "1303517:5:1313040:317", "request_id": "1303517:5:1313040:317", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1303517", "t_dispatch_unix": 1779817855.447187, "t_finish_unix": 1779817856.5818973, "t_first_token_unix": 1779817856.5200806, "tpot_s": 0.0076825386204291135, "trace_hash_ids": [13050284, 13050285, 13050286, 13050287, 13050288, 13050289, 13050290, 13050291, 13050292, 13050293, 13050294, 13050295, 13050296, 13050297, 13050298, 13050299, 13050300, 13050301, 13050302, 13050303, 13050304, 13050305, 13050306, 13050307, 13050308, 13050309, 13050310, 13050311, 13050312, 13050313, 13050314, 13050315, 13050316, 13050317, 13050318, 13050319, 13050320, 13050321, 13050322, 13050323, 13050324, 13050325, 13050326, 13050327, 13050328, 13050329, 13050330, 13050331, 13050332, 13050333, 13050334], "trace_timestamp_s": 261.6860000000006, "ttft_s": 1.0728916940279305, "turn_id": 5} +{"actual_output_tokens": 99, "cached_tokens": 960, "effective_input_length": 13360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13360, "latency_s": 3.0001673620427027, "output_length": 99, "proxy_request_id": "1306347:2:1312642:314", "request_id": "1306347:2:1312642:314", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1306347", "t_dispatch_unix": 1779817854.275757, "t_finish_unix": 1779817857.2759244, "t_first_token_unix": 1779817855.376587, "tpot_s": 0.019372826714748135, "trace_hash_ids": [12988101, 12997381, 12997382, 12997383, 12997384, 13005782, 13011406, 13018410, 13018411, 13018412, 13033270, 13033271, 13033272, 13033273, 13033274, 13033275, 13033276, 13039898, 13046883, 13046884, 13046885, 13046886, 13046887, 13046888, 13046889, 13046890, 13046891], "trace_timestamp_s": 260.52000000000044, "ttft_s": 1.1008288110024296, "turn_id": 2} +{"actual_output_tokens": 198, "cached_tokens": 21968, "effective_input_length": 26885, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26885, "latency_s": 3.469290587992873, "output_length": 198, "proxy_request_id": "1268861:4:1312689:315", "request_id": "1268861:4:1312689:315", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1268861", "t_dispatch_unix": 1779817854.4422984, "t_finish_unix": 1779817857.911589, "t_first_token_unix": 1779817856.2872477, "tpot_s": 0.00824401062425122, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13047223], "trace_timestamp_s": 260.6890000000003, "ttft_s": 1.8449471670319326, "turn_id": 4} +{"actual_output_tokens": 157, "cached_tokens": 64720, "effective_input_length": 64755, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64755, "latency_s": 1.4276673910208046, "output_length": 157, "proxy_request_id": "1279412:12:1313518:319", "request_id": "1279412:12:1313518:319", "request_type": "coder", "requested_output_tokens": 157, "session_id": "1279412", "t_dispatch_unix": 1779817857.1813338, "t_finish_unix": 1779817858.609001, "t_first_token_unix": 1779817857.3212447, "tpot_s": 0.008253060070460495, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13054780], "trace_timestamp_s": 263.4270000000006, "ttft_s": 0.1399081380222924, "turn_id": 12} +{"actual_output_tokens": 109, "cached_tokens": 0, "effective_input_length": 22686, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22686, "latency_s": 3.165831635997165, "output_length": 109, "proxy_request_id": "1313181:1:1313181:318", "request_id": "1313181:1:1313181:318", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1313181", "t_dispatch_unix": 1779817856.0626485, "t_finish_unix": 1779817859.228481, "t_first_token_unix": 1779817858.5734887, "tpot_s": 0.00606139279638969, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13052042], "trace_timestamp_s": 262.308, "ttft_s": 2.51083748601377, "turn_id": 1} +{"actual_output_tokens": 372, "cached_tokens": 59936, "effective_input_length": 62840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62840, "latency_s": 7.116122747014742, "output_length": 372, "proxy_request_id": "1269373:12:1312836:316", "request_id": "1269373:12:1312836:316", "request_type": "coder", "requested_output_tokens": 372, "session_id": "1269373", "t_dispatch_unix": 1779817854.8104532, "t_finish_unix": 1779817861.9265764, "t_first_token_unix": 1779817856.1131737, "tpot_s": 0.015668801811299062, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13048674], "trace_timestamp_s": 261.0560000000005, "ttft_s": 1.3027185090468265, "turn_id": 12} +{"actual_output_tokens": 198, "cached_tokens": 44512, "effective_input_length": 45362, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45362, "latency_s": 1.8176983440062031, "output_length": 198, "proxy_request_id": "1294611:10:1314495:322", "request_id": "1294611:10:1314495:322", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1294611", "t_dispatch_unix": 1779817860.8394697, "t_finish_unix": 1779817862.6571672, "t_first_token_unix": 1779817861.210208, "tpot_s": 0.007343710634472123, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13063311], "trace_timestamp_s": 267.08600000000024, "ttft_s": 0.3707369199837558, "turn_id": 10} +{"actual_output_tokens": 98, "cached_tokens": 22784, "effective_input_length": 24306, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24306, "latency_s": 0.9325726049719378, "output_length": 98, "proxy_request_id": "1313181:2:1314940:323", "request_id": "1313181:2:1314940:323", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1313181", "t_dispatch_unix": 1779817862.253814, "t_finish_unix": 1779817863.1863859, "t_first_token_unix": 1779817862.5951777, "tpot_s": 0.006092675835537465, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13067419], "trace_timestamp_s": 268.5010000000002, "ttft_s": 0.34136251296149567, "turn_id": 2} +{"actual_output_tokens": 2, "cached_tokens": 0, "effective_input_length": 7, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7, "latency_s": 0.028384228004142642, "output_length": 2, "proxy_request_id": "1315313:1:1315313:325", "request_id": "1315313:1:1315313:325", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1315313", "t_dispatch_unix": 1779817863.486611, "t_finish_unix": 1779817863.5149949, "t_first_token_unix": 1779817863.5107737, "tpot_s": 0.00399332499364391, "trace_hash_ids": [37638], "trace_timestamp_s": 269.7360000000008, "ttft_s": 0.024161985027603805, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 18160, "effective_input_length": 32440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32440, "latency_s": 2.866487736988347, "output_length": 26, "proxy_request_id": "1310590:2:1315212:324", "request_id": "1310590:2:1315212:324", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1310590", "t_dispatch_unix": 1779817863.1313636, "t_finish_unix": 1779817865.9978511, "t_first_token_unix": 1779817865.8584778, "tpot_s": 0.005565293440595269, "trace_hash_ids": [12996713, 12996714, 12996715, 12996716, 12996717, 12996718, 12996719, 12996720, 12996721, 12996722, 12996723, 12996724, 12996725, 12996726, 12996727, 12996728, 12996729, 12996730, 12996731, 12996732, 12996733, 12996734, 12996735, 12996736, 13016155, 13016156, 13016157, 13016158, 13016159, 13016160, 13027764, 13027765, 13027766, 13027767, 13027768, 13036928, 13036929, 13036930, 13036931, 13036932, 13036933, 13036934, 13036935, 13048761, 13048762, 13048763, 13048764, 13048765, 13048766, 13048767, 13048768, 13048769, 13048770, 13048771, 13048772, 13048773, 13060483, 13060484, 13060485, 13060486, 13060487, 13060488, 13060489, 13070580], "trace_timestamp_s": 269.3740000000007, "ttft_s": 2.727111395972315, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 4768, "effective_input_length": 23097, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23097, "latency_s": 2.6808811529772356, "output_length": 61, "proxy_request_id": "1309040:2:1315488:326", "request_id": "1309040:2:1315488:326", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1309040", "t_dispatch_unix": 1779817864.2042809, "t_finish_unix": 1779817866.8851624, "t_first_token_unix": 1779817866.5309372, "tpot_s": 0.005899613333167508, "trace_hash_ids": [13072947, 13072948, 13072949, 13072950, 13072951, 13072952, 13072953, 13072954, 13072955, 13072956, 13072957, 13072958, 13072959, 13072960, 13072961, 13072962, 13072963, 13072964, 13072965, 13072966, 13072967, 13072968, 13072969, 13072970, 13072971, 13072972, 13072973, 13072974, 13072975, 13072976, 13072977, 13072978, 13072979, 13072980, 13072981, 13072982, 13072983, 13072984, 13072985, 13072986, 13072987, 13072988, 13072989, 13072990, 13072991, 13072992], "trace_timestamp_s": 270.4440000000004, "ttft_s": 2.3266540709882975, "turn_id": 2} +{"actual_output_tokens": 37, "cached_tokens": 1024, "effective_input_length": 5985, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5985, "latency_s": 0.537629847007338, "output_length": 37, "proxy_request_id": "1316848:1:1316848:331", "request_id": "1316848:1:1316848:331", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1316848", "t_dispatch_unix": 1779817868.82913, "t_finish_unix": 1779817869.36676, "t_first_token_unix": 1779817869.185971, "tpot_s": 0.00501457466776224, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13085635], "trace_timestamp_s": 275.0750000000007, "ttft_s": 0.3568393070017919, "turn_id": 1} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 24487, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24487, "latency_s": 3.0968723710393533, "output_length": 50, "proxy_request_id": "1316201:1:1316201:329", "request_id": "1316201:1:1316201:329", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1316201", "t_dispatch_unix": 1779817866.7366884, "t_finish_unix": 1779817869.833561, "t_first_token_unix": 1779817869.5510046, "tpot_s": 0.005760821101626343, "trace_hash_ids": [79834, 1044525, 1044526, 1044527, 1044528, 1044529, 1044530, 2181165, 2181166, 2181167, 2181168, 2181169, 2181170, 2181171, 2181172, 2181173, 2181174, 2181175, 2181176, 2181177, 2181178, 2181179, 2181180, 2181181, 2181182, 2181183, 2181184, 11014457, 11014458, 9320, 11014459, 79866, 11014460, 13079135, 11014462, 11014463, 11014464, 11014465, 11014466, 11014467, 11014468, 11014469, 11014470, 11014471, 11014472, 11014473, 11014474, 11014475], "trace_timestamp_s": 272.97700000000077, "ttft_s": 2.814313702052459, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 3441, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3441, "latency_s": 0.3756087980000302, "output_length": 32, "proxy_request_id": "1317160:1:1317160:332", "request_id": "1317160:1:1317160:332", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1317160", "t_dispatch_unix": 1779817869.9821253, "t_finish_unix": 1779817870.357734, "t_first_token_unix": 1779817870.2038755, "tpot_s": 0.00495424471052003, "trace_hash_ids": [13073227, 13079093, 13088584, 13088585, 13088586, 13088587, 13088588], "trace_timestamp_s": 276.2300000000005, "ttft_s": 0.22174933401402086, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 6016, "effective_input_length": 6040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6040, "latency_s": 0.43875539500731975, "output_length": 80, "proxy_request_id": "1316848:2:1317438:333", "request_id": "1316848:2:1317438:333", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1316848", "t_dispatch_unix": 1779817871.0636456, "t_finish_unix": 1779817871.502401, "t_first_token_unix": 1779817871.0969691, "tpot_s": 0.0051286224558760845, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13090822], "trace_timestamp_s": 277.3120000000008, "ttft_s": 0.03332226997008547, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 3472, "effective_input_length": 7440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7440, "latency_s": 0.46469584002625197, "output_length": 26, "proxy_request_id": "1317160:2:1317773:336", "request_id": "1317160:2:1317773:336", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1317160", "t_dispatch_unix": 1779817872.381386, "t_finish_unix": 1779817872.8460813, "t_first_token_unix": 1779817872.723676, "tpot_s": 0.004885988761670888, "trace_hash_ids": [13073227, 13079093, 13088584, 13088585, 13088586, 13088587, 13093585, 13093586, 13093587, 13093588, 13093589, 13093590, 13093591, 13093592, 13093593], "trace_timestamp_s": 278.6280000000006, "ttft_s": 0.3422885569743812, "turn_id": 2} +{"actual_output_tokens": 90, "cached_tokens": 24528, "effective_input_length": 24768, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24768, "latency_s": 0.6503820329671726, "output_length": 90, "proxy_request_id": "1316201:2:1317776:337", "request_id": "1316201:2:1317776:337", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1316201", "t_dispatch_unix": 1779817872.3989336, "t_finish_unix": 1779817873.0493152, "t_first_token_unix": 1779817872.5149515, "tpot_s": 0.006000880404438279, "trace_hash_ids": [79834, 1044525, 1044526, 1044527, 1044528, 1044529, 1044530, 2181165, 2181166, 2181167, 2181168, 2181169, 2181170, 2181171, 2181172, 2181173, 2181174, 2181175, 2181176, 2181177, 2181178, 2181179, 2181180, 2181181, 2181182, 2181183, 2181184, 11014457, 11014458, 9320, 11014459, 79866, 11014460, 13079135, 11014462, 11014463, 11014464, 11014465, 11014466, 11014467, 11014468, 11014469, 11014470, 11014471, 11014472, 11014473, 11014474, 11014475, 13093608], "trace_timestamp_s": 278.64600000000064, "ttft_s": 0.11601495399372652, "turn_id": 2} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 5219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5219, "latency_s": 0.5567222379613668, "output_length": 44, "proxy_request_id": "1318031:1:1318031:338", "request_id": "1318031:1:1318031:338", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1318031", "t_dispatch_unix": 1779817873.04342, "t_finish_unix": 1779817873.6001422, "t_first_token_unix": 1779817873.3821876, "tpot_s": 0.005062761489128651, "trace_hash_ids": [13085657, 13085658, 13085659, 13085660, 13085661, 13090893, 13090894, 13090895, 13095689, 13095690, 13095691], "trace_timestamp_s": 279.28999999999996, "ttft_s": 0.3387665139744058, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 2696, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2696, "latency_s": 2.7319080280140042, "output_length": 97, "proxy_request_id": "1318036:1:1318036:339", "request_id": "1318036:1:1318036:339", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1318036", "t_dispatch_unix": 1779817873.047606, "t_finish_unix": 1779817875.7795143, "t_first_token_unix": 1779817873.867046, "tpot_s": 0.019917034031702013, "trace_hash_ids": [13077094, 13085876, 13085877, 13085878, 13085879, 13095707], "trace_timestamp_s": 279.2960000000003, "ttft_s": 0.8194387209950946, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 14412, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14412, "latency_s": 1.438526967947837, "output_length": 35, "proxy_request_id": "1318604:1:1318604:341", "request_id": "1318604:1:1318604:341", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1318604", "t_dispatch_unix": 1779817875.090066, "t_finish_unix": 1779817876.5285926, "t_first_token_unix": 1779817876.34725, "tpot_s": 0.0053237707059666075, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13101221], "trace_timestamp_s": 281.33400000000074, "ttft_s": 1.2571824619662948, "turn_id": 1} +{"actual_output_tokens": 54, "cached_tokens": 6112, "effective_input_length": 6298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6298, "latency_s": 0.32896799698937684, "output_length": 54, "proxy_request_id": "1316848:3:1318975:343", "request_id": "1316848:3:1318975:343", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1316848", "t_dispatch_unix": 1779817876.463597, "t_finish_unix": 1779817876.792565, "t_first_token_unix": 1779817876.5233755, "tpot_s": 0.005072789943232289, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13104212], "trace_timestamp_s": 282.71200000000044, "ttft_s": 0.05977704899851233, "turn_id": 3} +{"actual_output_tokens": 241, "cached_tokens": 0, "effective_input_length": 57051, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57051, "latency_s": 18.145372375031002, "output_length": 241, "proxy_request_id": "1314357:1:1314357:321", "request_id": "1314357:1:1314357:321", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1314357", "t_dispatch_unix": 1779817860.3753057, "t_finish_unix": 1779817878.5206778, "t_first_token_unix": 1779817872.1619763, "tpot_s": 0.026492580541525968, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13062231, 13062232], "trace_timestamp_s": 266.60400000000027, "ttft_s": 11.786668317043222, "turn_id": 1} +{"actual_output_tokens": 307, "cached_tokens": 64896, "effective_input_length": 64949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64949, "latency_s": 13.965815975039732, "output_length": 307, "proxy_request_id": "1279412:13:1315780:328", "request_id": "1279412:13:1315780:328", "request_type": "coder", "requested_output_tokens": 307, "session_id": "1279412", "t_dispatch_unix": 1779817865.2640998, "t_finish_unix": 1779817879.2299154, "t_first_token_unix": 1779817873.6548636, "tpot_s": 0.01821804915675041, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834], "trace_timestamp_s": 271.5110000000004, "ttft_s": 8.39076219103299, "turn_id": 13} +{"actual_output_tokens": 35, "cached_tokens": 14432, "effective_input_length": 15745, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15745, "latency_s": 0.4230980000575073, "output_length": 35, "proxy_request_id": "1318604:2:1319895:347", "request_id": "1318604:2:1319895:347", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1318604", "t_dispatch_unix": 1779817879.5804186, "t_finish_unix": 1779817880.0035164, "t_first_token_unix": 1779817879.8231614, "tpot_s": 0.005296308970119914, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13112541], "trace_timestamp_s": 285.82900000000063, "ttft_s": 0.2427411550306715, "turn_id": 2} +{"actual_output_tokens": 470, "cached_tokens": 63200, "effective_input_length": 66135, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66135, "latency_s": 8.76648913900135, "output_length": 470, "proxy_request_id": "1269373:13:1317516:334", "request_id": "1269373:13:1317516:334", "request_type": "coder", "requested_output_tokens": 470, "session_id": "1269373", "t_dispatch_unix": 1779817871.3181348, "t_finish_unix": 1779817880.0846233, "t_first_token_unix": 1779817872.7014983, "tpot_s": 0.015741703652420332, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13091422], "trace_timestamp_s": 277.5630000000001, "ttft_s": 1.3833616530173458, "turn_id": 13} +{"actual_output_tokens": 302, "cached_tokens": 6336, "effective_input_length": 21140, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21140, "latency_s": 3.677606586017646, "output_length": 302, "proxy_request_id": "1316848:4:1319820:345", "request_id": "1316848:4:1319820:345", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1316848", "t_dispatch_unix": 1779817879.3691013, "t_finish_unix": 1779817883.0467079, "t_first_token_unix": 1779817881.2244124, "tpot_s": 0.006052399242522684, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13111733], "trace_timestamp_s": 285.6120000000001, "ttft_s": 1.8553088970365934, "turn_id": 4} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 3099, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3099, "latency_s": 0.7319507829961367, "output_length": 40, "proxy_request_id": "1320630:1:1320630:348", "request_id": "1320630:1:1320630:348", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1320630", "t_dispatch_unix": 1779817882.382659, "t_finish_unix": 1779817883.1146097, "t_first_token_unix": 1779817882.6780355, "tpot_s": 0.011185166409585433, "trace_hash_ids": [13120494, 13120495, 13120496, 13120497, 13120498, 13120499, 13120500], "trace_timestamp_s": 288.6300000000001, "ttft_s": 0.2953742300160229, "turn_id": 1} +{"actual_output_tokens": 41, "cached_tokens": 15776, "effective_input_length": 17883, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17883, "latency_s": 0.6184915499761701, "output_length": 41, "proxy_request_id": "1318604:3:1320865:350", "request_id": "1318604:3:1320865:350", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1318604", "t_dispatch_unix": 1779817883.2246501, "t_finish_unix": 1779817883.843142, "t_first_token_unix": 1779817883.6259546, "tpot_s": 0.005422523824381642, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13122653, 13122654, 13122655, 13122656, 13122657], "trace_timestamp_s": 289.47200000000066, "ttft_s": 0.40130261302692816, "turn_id": 3} +{"actual_output_tokens": 3, "cached_tokens": 2672, "effective_input_length": 2677, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2677, "latency_s": 0.06783925200579688, "output_length": 3, "proxy_request_id": "1318036:2:1321282:353", "request_id": "1318036:2:1321282:353", "request_type": "coder", "requested_output_tokens": 3, "session_id": "1318036", "t_dispatch_unix": 1779817884.68885, "t_finish_unix": 1779817884.7566879, "t_first_token_unix": 1779817884.7329967, "tpot_s": 0.011593403498409316, "trace_hash_ids": [13126973, 13126974, 13126975, 13126976, 13126977, 13126978], "trace_timestamp_s": 290.9350000000004, "ttft_s": 0.044146088999696076, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 8095, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8095, "latency_s": 1.292845924035646, "output_length": 60, "proxy_request_id": "1321042:1:1321042:351", "request_id": "1321042:1:1321042:351", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1321042", "t_dispatch_unix": 1779817883.876037, "t_finish_unix": 1779817885.1688828, "t_first_token_unix": 1779817884.4610062, "tpot_s": 0.011990840406693772, "trace_hash_ids": [13106720, 13106721, 13114808, 13114809, 13114810, 13114811, 13114812, 13114813, 13114814, 13114815, 13124503, 13124504, 13124505, 13124506, 13124507, 13124508], "trace_timestamp_s": 290.1220000000003, "ttft_s": 0.5849672390031628, "turn_id": 1} +{"actual_output_tokens": 528, "cached_tokens": 3600, "effective_input_length": 16960, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16960, "latency_s": 20.7956431430066, "output_length": 528, "proxy_request_id": "1315567:1:1315567:327", "request_id": "1315567:1:1315567:327", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1315567", "t_dispatch_unix": 1779817864.4742284, "t_finish_unix": 1779817885.2698717, "t_first_token_unix": 1779817873.645577, "tpot_s": 0.02205697089564886, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13073863], "trace_timestamp_s": 270.71900000000005, "ttft_s": 9.17134665400954, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 31664, "effective_input_length": 33906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33906, "latency_s": 1.2606169549981132, "output_length": 97, "proxy_request_id": "1277428:4:1321259:352", "request_id": "1277428:4:1321259:352", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1277428", "t_dispatch_unix": 1779817884.6305723, "t_finish_unix": 1779817885.891189, "t_first_token_unix": 1779817885.2602994, "tpot_s": 0.006568769333171076, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13126544], "trace_timestamp_s": 290.8780000000006, "ttft_s": 0.6297250990173779, "turn_id": 4} +{"actual_output_tokens": 42, "cached_tokens": 17920, "effective_input_length": 21033, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21033, "latency_s": 0.765253972960636, "output_length": 42, "proxy_request_id": "1318604:4:1321889:356", "request_id": "1318604:4:1321889:356", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1318604", "t_dispatch_unix": 1779817886.8152905, "t_finish_unix": 1779817887.5805445, "t_first_token_unix": 1779817887.3483293, "tpot_s": 0.0056573863413820905, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13122653, 13122654, 13122655, 13122656, 13122657, 13132633, 13132634, 13132635, 13132636, 13132637, 13132638, 13132639], "trace_timestamp_s": 293.0630000000001, "ttft_s": 0.5330364899709821, "turn_id": 4} +{"actual_output_tokens": 90, "cached_tokens": 21440, "effective_input_length": 21471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21471, "latency_s": 0.5849718019599095, "output_length": 90, "proxy_request_id": "1316848:5:1322192:357", "request_id": "1316848:5:1322192:357", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1316848", "t_dispatch_unix": 1779817887.993048, "t_finish_unix": 1779817888.5780194, "t_first_token_unix": 1779817888.0538652, "tpot_s": 0.005886004898916888, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116], "trace_timestamp_s": 294.2420000000002, "ttft_s": 0.06081563897896558, "turn_id": 5} +{"actual_output_tokens": 256, "cached_tokens": 66592, "effective_input_length": 66840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66840, "latency_s": 4.221438670007046, "output_length": 256, "proxy_request_id": "1269373:14:1321512:354", "request_id": "1269373:14:1321512:354", "request_type": "coder", "requested_output_tokens": 256, "session_id": "1269373", "t_dispatch_unix": 1779817885.4657614, "t_finish_unix": 1779817889.6872, "t_first_token_unix": 1779817885.7201695, "tpot_s": 0.015555577921480233, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13129270], "trace_timestamp_s": 291.71100000000024, "ttft_s": 0.25440560904098675, "turn_id": 14} +{"actual_output_tokens": 12, "cached_tokens": 5248, "effective_input_length": 11145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11145, "latency_s": 0.6214487159741111, "output_length": 12, "proxy_request_id": "1318031:2:1322552:360", "request_id": "1318031:2:1322552:360", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1318031", "t_dispatch_unix": 1779817889.3306096, "t_finish_unix": 1779817889.9520583, "t_first_token_unix": 1779817889.9045014, "tpot_s": 0.004283366820097647, "trace_hash_ids": [13138691, 13138692, 13138693, 13138694, 13138695, 13138696, 13138697, 13138698, 13138699, 13138700, 13138701, 13138702, 13138703, 13138704, 13138705, 13138706, 13138707, 13138708, 13138709, 13138710, 13138711, 13138712], "trace_timestamp_s": 295.5750000000007, "ttft_s": 0.5738898550043814, "turn_id": 2} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 8939, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8939, "latency_s": 0.9306745679932646, "output_length": 50, "proxy_request_id": "1322540:1:1322540:359", "request_id": "1322540:1:1322540:359", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1322540", "t_dispatch_unix": 1779817889.2774732, "t_finish_unix": 1779817890.2081478, "t_first_token_unix": 1779817889.9514055, "tpot_s": 0.005234141774684647, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13138570], "trace_timestamp_s": 295.52300000000014, "ttft_s": 0.673930975026451, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 8976, "effective_input_length": 9016, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9016, "latency_s": 0.7201732489629649, "output_length": 25, "proxy_request_id": "1322540:2:1323519:362", "request_id": "1322540:2:1323519:362", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1322540", "t_dispatch_unix": 1779817892.573204, "t_finish_unix": 1779817893.293377, "t_first_token_unix": 1779817892.613158, "tpot_s": 0.028327295583342977, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13147526], "trace_timestamp_s": 298.8220000000001, "ttft_s": 0.0399524059612304, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 21552, "effective_input_length": 24395, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24395, "latency_s": 1.182367924018763, "output_length": 98, "proxy_request_id": "1316848:6:1323535:363", "request_id": "1316848:6:1323535:363", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1316848", "t_dispatch_unix": 1779817892.621681, "t_finish_unix": 1779817893.804049, "t_first_token_unix": 1779817893.203618, "tpot_s": 0.006187247113593537, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13147765], "trace_timestamp_s": 298.8690000000006, "ttft_s": 0.5819354809937067, "turn_id": 6} +{"actual_output_tokens": 52, "cached_tokens": 0, "effective_input_length": 11298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11298, "latency_s": 1.203903221001383, "output_length": 52, "proxy_request_id": "1320630:2:1323748:364", "request_id": "1320630:2:1323748:364", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1320630", "t_dispatch_unix": 1779817893.3447502, "t_finish_unix": 1779817894.5486536, "t_first_token_unix": 1779817894.2748735, "tpot_s": 0.00536297517600378, "trace_hash_ids": [13120494, 13120495, 13120496, 13120497, 13120498, 13120499, 13127257, 13127258, 13135970, 13135971, 13135972, 13135973, 13135974, 13135975, 13143084, 13143085, 13143086, 13143087, 13143088, 13149788, 13149789, 13149790, 13149791], "trace_timestamp_s": 299.59100000000035, "ttft_s": 0.9301212640129961, "turn_id": 2} +{"actual_output_tokens": 72, "cached_tokens": 8144, "effective_input_length": 13008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13008, "latency_s": 3.453006735013332, "output_length": 72, "proxy_request_id": "1321042:2:1323492:361", "request_id": "1321042:2:1323492:361", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1321042", "t_dispatch_unix": 1779817892.5042558, "t_finish_unix": 1779817895.9572623, "t_first_token_unix": 1779817894.9655662, "tpot_s": 0.013963807070083444, "trace_hash_ids": [13106720, 13106721, 13114808, 13114809, 13114810, 13114811, 13114812, 13114813, 13114814, 13114815, 13124503, 13124504, 13124505, 13124506, 13124507, 13132187, 13132188, 13132189, 13147309, 13147310, 13147311, 13147312, 13147313, 13147314, 13147315, 13147316], "trace_timestamp_s": 298.7510000000002, "ttft_s": 2.461309008009266, "turn_id": 2} +{"actual_output_tokens": 326, "cached_tokens": 65248, "effective_input_length": 71854, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71854, "latency_s": 17.111530195979867, "output_length": 326, "proxy_request_id": "1279412:14:1319059:344", "request_id": "1279412:14:1319059:344", "request_type": "coder", "requested_output_tokens": 326, "session_id": "1279412", "t_dispatch_unix": 1779817879.2364302, "t_finish_unix": 1779817896.3479605, "t_first_token_unix": 1779817882.226885, "tpot_s": 0.043448180021503226, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13104852], "trace_timestamp_s": 283.058, "ttft_s": 2.990449825010728, "turn_id": 14} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 14863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14863, "latency_s": 1.5708422649768181, "output_length": 46, "proxy_request_id": "1324227:1:1324227:367", "request_id": "1324227:1:1324227:367", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1324227", "t_dispatch_unix": 1779817895.1344278, "t_finish_unix": 1779817896.70527, "t_first_token_unix": 1779817896.4615166, "tpot_s": 0.005410800800503542, "trace_hash_ids": [13121168, 13121169, 13121170, 13121171, 13121172, 13121173, 13121174, 13121175, 13121176, 13121177, 13121178, 13121179, 13129551, 13129552, 13129553, 13129554, 13137620, 13137621, 13146223, 13146224, 13146225, 13146226, 13146227, 13155024, 13155025, 13155026, 13155027, 13155028, 13155029, 13155030], "trace_timestamp_s": 301.3780000000006, "ttft_s": 1.3270873199799098, "turn_id": 1} +{"actual_output_tokens": 103, "cached_tokens": 24480, "effective_input_length": 26994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26994, "latency_s": 1.2010406400077045, "output_length": 103, "proxy_request_id": "1316848:7:1325031:371", "request_id": "1316848:7:1325031:371", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1316848", "t_dispatch_unix": 1779817897.7954772, "t_finish_unix": 1779817898.996518, "t_first_token_unix": 1779817898.3686898, "tpot_s": 0.006150476421644984, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13162818], "trace_timestamp_s": 304.0430000000006, "ttft_s": 0.57321021304233, "turn_id": 7} +{"actual_output_tokens": 25, "cached_tokens": 9040, "effective_input_length": 12118, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12118, "latency_s": 0.48629745800280944, "output_length": 25, "proxy_request_id": "1322540:3:1325410:373", "request_id": "1322540:3:1325410:373", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1322540", "t_dispatch_unix": 1779817899.169776, "t_finish_unix": 1779817899.6560729, "t_first_token_unix": 1779817899.5350444, "tpot_s": 0.0050325346674071625, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13153725, 13153726, 13160450, 13160451, 13167028, 13167029, 13167030], "trace_timestamp_s": 305.41700000000037, "ttft_s": 0.3652672200114466, "turn_id": 3} +{"actual_output_tokens": 355, "cached_tokens": 17472, "effective_input_length": 54546, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54546, "latency_s": 14.79575351497624, "output_length": 355, "proxy_request_id": "1315567:2:1319894:346", "request_id": "1315567:2:1319894:346", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1315567", "t_dispatch_unix": 1779817885.2854269, "t_finish_unix": 1779817900.08118, "t_first_token_unix": 1779817894.4616215, "tpot_s": 0.01587353601701831, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13112465, 13112466, 13112467, 13112468, 13112469, 13112470, 13112471, 13112472, 13112473, 13112474, 13112475, 13112476, 13112477, 13112478, 13112479, 13112480, 13112481, 13112482, 13112483, 13112484, 13112485, 13112486, 13112487, 13112488, 13112489, 13112490, 13112491, 13112492, 13112493, 13112494, 13112495, 13112496, 13112497, 13112498, 13112499, 13112500, 13112501, 13112502, 13112503, 13112504, 13112505, 13112506, 13112507, 13112508, 13112509, 13112510, 13112511, 13112512, 13112513, 13112514, 13112515, 13112516, 13112517, 13112518, 13112519, 13112520, 13112521, 13112522, 13112523, 13112524, 13112525, 13112526, 13112527, 13112528, 13112529, 13112530, 13112531, 13112532, 13112533, 13112534, 13112535, 13112536, 13112537, 13112538], "trace_timestamp_s": 285.82800000000043, "ttft_s": 9.17619249096606, "turn_id": 2} +{"actual_output_tokens": 255, "cached_tokens": 72176, "effective_input_length": 72402, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72402, "latency_s": 3.9683883389807306, "output_length": 255, "proxy_request_id": "1279412:15:1321613:355", "request_id": "1279412:15:1321613:355", "request_type": "coder", "requested_output_tokens": 255, "session_id": "1279412", "t_dispatch_unix": 1779817896.3522804, "t_finish_unix": 1779817900.3206685, "t_first_token_unix": 1779817896.6240516, "tpot_s": 0.014552071369958924, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13129897], "trace_timestamp_s": 292.0450000000001, "ttft_s": 0.2717690920107998, "turn_id": 15} +{"actual_output_tokens": 772, "cached_tokens": 512, "effective_input_length": 79663, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79663, "latency_s": 28.705970803974196, "output_length": 772, "proxy_request_id": "1317598:1:1317598:335", "request_id": "1317598:1:1317598:335", "request_type": "coder", "requested_output_tokens": 772, "session_id": "1317598", "t_dispatch_unix": 1779817871.6264923, "t_finish_unix": 1779817900.3324625, "t_first_token_unix": 1779817893.171338, "tpot_s": 0.009287679771697643, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044], "trace_timestamp_s": 277.83700000000044, "ttft_s": 21.544843601994216, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 1823, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1823, "latency_s": 2.1226370500517078, "output_length": 38, "proxy_request_id": "1325987:1:1325987:376", "request_id": "1325987:1:1325987:376", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1325987", "t_dispatch_unix": 1779817901.2647161, "t_finish_unix": 1779817903.387353, "t_first_token_unix": 1779817902.0761812, "tpot_s": 0.03542970270358932, "trace_hash_ids": [13172375, 13172376, 13172377, 13172378], "trace_timestamp_s": 307.5129999999999, "ttft_s": 0.8114640800049528, "turn_id": 1} +{"actual_output_tokens": 305, "cached_tokens": 80432, "effective_input_length": 81220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81220, "latency_s": 3.43961754697375, "output_length": 305, "proxy_request_id": "1317598:2:1324364:368", "request_id": "1317598:2:1324364:368", "request_type": "coder", "requested_output_tokens": 305, "session_id": "1317598", "t_dispatch_unix": 1779817900.3366868, "t_finish_unix": 1779817903.7763042, "t_first_token_unix": 1779817900.9523573, "tpot_s": 0.009288496161293312, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196], "trace_timestamp_s": 301.8890000000001, "ttft_s": 0.6156676649698056, "turn_id": 2} +{"actual_output_tokens": 100, "cached_tokens": 0, "effective_input_length": 9513, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9513, "latency_s": 2.4235537990462035, "output_length": 100, "proxy_request_id": "1326192:1:1326192:378", "request_id": "1326192:1:1326192:378", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1326192", "t_dispatch_unix": 1779817902.1434035, "t_finish_unix": 1779817904.5669575, "t_first_token_unix": 1779817902.9510198, "tpot_s": 0.01632014151505016, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13174254], "trace_timestamp_s": 308.3890000000001, "ttft_s": 0.8076142530189827, "turn_id": 1} +{"actual_output_tokens": 313, "cached_tokens": 0, "effective_input_length": 4312, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4312, "latency_s": 7.261753736995161, "output_length": 313, "proxy_request_id": "1324964:1:1324964:370", "request_id": "1324964:1:1324964:370", "request_type": "coder", "requested_output_tokens": 313, "session_id": "1324964", "t_dispatch_unix": 1779817897.5551417, "t_finish_unix": 1779817904.8168952, "t_first_token_unix": 1779817897.9083776, "tpot_s": 0.022141647099208336, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13162336], "trace_timestamp_s": 303.8010000000004, "ttft_s": 0.35323467903072014, "turn_id": 1} +{"actual_output_tokens": 69, "cached_tokens": 9600, "effective_input_length": 15253, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15253, "latency_s": 1.8456344589940272, "output_length": 69, "proxy_request_id": "1326192:2:1327234:381", "request_id": "1326192:2:1327234:381", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1326192", "t_dispatch_unix": 1779817905.7025056, "t_finish_unix": 1779817907.5481396, "t_first_token_unix": 1779817906.410183, "tpot_s": 0.016730401735163897, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13183880, 13183881, 13183882, 13183883, 13183884, 13183885, 13183886, 13183887, 13183888, 13183889, 13183890, 13183891], "trace_timestamp_s": 311.9490000000005, "ttft_s": 0.7076748349936679, "turn_id": 2} +{"actual_output_tokens": 282, "cached_tokens": 72656, "effective_input_length": 75624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75624, "latency_s": 7.320325324020814, "output_length": 282, "proxy_request_id": "1279412:16:1323780:365", "request_id": "1279412:16:1323780:365", "request_type": "coder", "requested_output_tokens": 282, "session_id": "1279412", "t_dispatch_unix": 1779817900.3257911, "t_finish_unix": 1779817907.6461163, "t_first_token_unix": 1779817901.8707879, "tpot_s": 0.020551056042645007, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117], "trace_timestamp_s": 299.6800000000003, "ttft_s": 1.5449943830026314, "turn_id": 16} +{"actual_output_tokens": 4682, "cached_tokens": 98112, "effective_input_length": 121968, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121968, "latency_s": 85.95667395897908, "output_length": 4682, "proxy_request_id": "1266668:12:1303535:276", "request_id": "1266668:12:1303535:276", "request_type": "coder", "requested_output_tokens": 4682, "session_id": "1266668", "t_dispatch_unix": 1779817821.9606857, "t_finish_unix": 1779817907.9173598, "t_first_token_unix": 1779817837.9852054, "tpot_s": 0.014939498138004988, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12937140, 12937141, 12961861, 12961862, 12961863, 12961864, 12961865, 12961866, 12961867, 12961868, 12961869, 12961870, 12961871, 12961872, 12961873, 12961874, 12961875, 12961876, 12961877, 12961878, 12961879, 12961880, 12961881, 12961882, 12961883, 12961884, 12961885, 12961886, 12961887, 12961888, 12961889, 12961890, 12961891, 12961892, 12961893, 12961894, 12961895, 12961896, 12961897, 12961898, 12961899, 12961900, 12961901, 12961902, 12961903, 12961904, 12961905, 12961906, 12961907, 12961908], "trace_timestamp_s": 228.19700000000012, "ttft_s": 16.024515988014173, "turn_id": 12} +{"actual_output_tokens": 552, "cached_tokens": 67088, "effective_input_length": 69041, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69041, "latency_s": 8.97014693095116, "output_length": 552, "proxy_request_id": "1269373:15:1325630:375", "request_id": "1269373:15:1325630:375", "request_type": "coder", "requested_output_tokens": 552, "session_id": "1269373", "t_dispatch_unix": 1779817900.0062652, "t_finish_unix": 1779817908.9764118, "t_first_token_unix": 1779817901.0509741, "tpot_s": 0.014383224371952528, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187], "trace_timestamp_s": 306.2520000000004, "ttft_s": 1.0447070240043104, "turn_id": 15} +{"actual_output_tokens": 88, "cached_tokens": 4624, "effective_input_length": 5146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5146, "latency_s": 4.000529247045051, "output_length": 88, "proxy_request_id": "1324964:2:1327382:382", "request_id": "1324964:2:1327382:382", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1324964", "t_dispatch_unix": 1779817906.307866, "t_finish_unix": 1779817910.3083951, "t_first_token_unix": 1779817906.5904427, "tpot_s": 0.04273179393119832, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13184956], "trace_timestamp_s": 312.5560000000005, "ttft_s": 0.2825755270314403, "turn_id": 2} +{"actual_output_tokens": 42, "cached_tokens": 5232, "effective_input_length": 5234, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5234, "latency_s": 0.6273949329624884, "output_length": 42, "proxy_request_id": "1324964:3:1328499:384", "request_id": "1324964:3:1328499:384", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1324964", "t_dispatch_unix": 1779817910.3229678, "t_finish_unix": 1779817910.9503627, "t_first_token_unix": 1779817910.378135, "tpot_s": 0.01394992646414832, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13195781], "trace_timestamp_s": 316.5720000000001, "ttft_s": 0.05516572395572439, "turn_id": 3} +{"actual_output_tokens": 2884, "cached_tokens": 0, "effective_input_length": 33182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33182, "latency_s": 24.452261627011467, "output_length": 2884, "proxy_request_id": "1322225:1:1322225:358", "request_id": "1322225:1:1322225:358", "request_type": "coder", "requested_output_tokens": 2884, "session_id": "1322225", "t_dispatch_unix": 1779817888.0958526, "t_finish_unix": 1779817912.5481138, "t_first_token_unix": 1779817892.7861085, "tpot_s": 0.006854580352404273, "trace_hash_ids": [12158201, 426358, 11990609, 11990610, 5741838, 11990611, 5631170, 426364, 426365, 426366, 426367, 426368, 113957, 113958, 13135430, 9465731, 9465732, 9465733, 9465734, 9465735, 13135431, 13135432, 13135433, 13135434, 13135435, 13135436, 13135437, 13135438, 13135439, 13135440, 13135441, 13135442, 13135443, 13135444, 13135445, 13135446, 13135447, 13135448, 13135449, 13135450, 13135451, 13135452, 13135453, 13135454, 13135455, 13135456, 13135457, 13135458, 13135459, 13135460, 13135461, 13135462, 13135463, 13135464, 13135465, 13135466, 13135467, 13135468, 13135469, 13135470, 13135471, 13135472, 13135473, 13135474, 13135475], "trace_timestamp_s": 294.33300000000054, "ttft_s": 4.69025371002499, "turn_id": 1} +{"actual_output_tokens": 40, "cached_tokens": 1856, "effective_input_length": 7423, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7423, "latency_s": 1.9904630990349688, "output_length": 40, "proxy_request_id": "1325987:2:1329336:391", "request_id": "1325987:2:1329336:391", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1325987", "t_dispatch_unix": 1779817913.382995, "t_finish_unix": 1779817915.3734581, "t_first_token_unix": 1779817913.8391652, "tpot_s": 0.03933070871817808, "trace_hash_ids": [13172375, 13172376, 13172377, 13189325, 13189326, 13189327, 13189328, 13189329, 13189330, 13203552, 13203553, 13203554, 13203555, 13203556, 13203557], "trace_timestamp_s": 319.6300000000001, "ttft_s": 0.4561677100136876, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 9292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9292, "latency_s": 3.086962107976433, "output_length": 59, "proxy_request_id": "1329110:1:1329110:389", "request_id": "1329110:1:1329110:389", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1329110", "t_dispatch_unix": 1779817912.5358088, "t_finish_unix": 1779817915.622771, "t_first_token_unix": 1779817913.3429222, "tpot_s": 0.039299858603546206, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13201495], "trace_timestamp_s": 318.78099999999995, "ttft_s": 0.8071111459867097, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 12128, "effective_input_length": 13249, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13249, "latency_s": 11.508610481978394, "output_length": 26, "proxy_request_id": "1322540:4:1326861:380", "request_id": "1322540:4:1326861:380", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1322540", "t_dispatch_unix": 1779817904.4195065, "t_finish_unix": 1779817915.928117, "t_first_token_unix": 1779817915.7017205, "tpot_s": 0.009044646839611233, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13153725, 13153726, 13160450, 13160451, 13167028, 13167029, 13180706, 13180707, 13180708], "trace_timestamp_s": 310.6680000000006, "ttft_s": 11.282212154997978, "turn_id": 4} +{"actual_output_tokens": 76, "cached_tokens": 5264, "effective_input_length": 5414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5414, "latency_s": 3.09232921799412, "output_length": 76, "proxy_request_id": "1324964:4:1329201:390", "request_id": "1324964:4:1329201:390", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1324964", "t_dispatch_unix": 1779817912.845844, "t_finish_unix": 1779817915.9381728, "t_first_token_unix": 1779817913.3762972, "tpot_s": 0.03415564150704692, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13202375], "trace_timestamp_s": 319.09500000000025, "ttft_s": 0.5304521799553186, "turn_id": 4} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 66703, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66703, "latency_s": 16.29473430896178, "output_length": 37, "proxy_request_id": "1325541:1:1325541:374", "request_id": "1325541:1:1325541:374", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1325541", "t_dispatch_unix": 1779817899.752481, "t_finish_unix": 1779817916.047215, "t_first_token_unix": 1779817915.6978571, "tpot_s": 0.009697450916670883, "trace_hash_ids": [13148586, 13148587, 13148588, 13148589, 13148590, 13148591, 13148592, 13148593, 13148594, 13148595, 13148596, 13148597, 13148598, 13148599, 13148600, 13148601, 13148602, 13148603, 13148604, 13148605, 13148606, 13148607, 13148608, 13148609, 13148610, 13148611, 13148612, 13148613, 13148614, 13148615, 13148616, 13148617, 13148618, 13148619, 13148620, 13148621, 13148622, 13148623, 13148624, 13148625, 13148626, 13148627, 13148628, 13148629, 13148630, 13148631, 13148632, 13148633, 13148634, 13148635, 13148636, 13148637, 13148638, 13148639, 13148640, 13148641, 13148642, 13148643, 13148644, 13148645, 13148646, 13148647, 13148648, 13148649, 13148650, 13148651, 13148652, 13148653, 13148654, 13148655, 13148656, 13148657, 13148658, 13148659, 13148660, 13148661, 13148662, 13148663, 13148664, 13148665, 13148666, 13148667, 13148668, 13148669, 13148670, 13148671, 13148672, 13148673, 13148674, 13148675, 13148676, 13148677, 13148678, 13148679, 13148680, 13148681, 13148682, 13148683, 13148684, 13148685, 13148686, 13148687, 13148688, 13148689, 13148690, 13148691, 13148692, 13148693, 13148694, 13148695, 13148696, 13148697, 13148698, 13148699, 13148700, 13148701, 13148702, 13148703, 13148704, 13148705, 13148706, 13148707, 13148708, 13148709, 13148710, 13148711, 13168103, 13168104, 13168105, 13168106, 13168107], "trace_timestamp_s": 305.97200000000066, "ttft_s": 15.945373152964748, "turn_id": 1} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 36880, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36880, "latency_s": 5.949849794968031, "output_length": 59, "proxy_request_id": "1328753:1:1328753:387", "request_id": "1328753:1:1328753:387", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1328753", "t_dispatch_unix": 1779817911.2670798, "t_finish_unix": 1779817917.2169297, "t_first_token_unix": 1779817916.8497071, "tpot_s": 0.0063264999661096855, "trace_hash_ids": [13155620, 13155621, 13155622, 13155623, 13155624, 13155625, 13155626, 13155627, 13155628, 13155629, 13155630, 13155631, 13155632, 13155633, 13155634, 13155635, 13155636, 13155637, 13155638, 13155639, 13155640, 13155641, 13155642, 13155643, 13155644, 13155645, 13155646, 13155647, 13155648, 13155649, 13155650, 13155651, 13155652, 13155653, 13155654, 13155655, 13155656, 13155657, 13155658, 13155659, 13155660, 13155661, 13155662, 13155663, 13155664, 13155665, 13155666, 13155667, 13155668, 13155669, 13155670, 13155671, 13155672, 13155673, 13155674, 13155675, 13155676, 13155677, 13155678, 13155679, 13155680, 13172041, 13182089, 13182090, 13182091, 13182092, 13182093, 13182094, 13182095, 13198580, 13198581, 13198582, 13198583], "trace_timestamp_s": 317.5010000000002, "ttft_s": 5.582624651957303, "turn_id": 1} +{"actual_output_tokens": 296, "cached_tokens": 27088, "effective_input_length": 28120, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28120, "latency_s": 15.00155749503756, "output_length": 296, "proxy_request_id": "1316848:8:1326380:379", "request_id": "1316848:8:1326380:379", "request_type": "coder", "requested_output_tokens": 296, "session_id": "1316848", "t_dispatch_unix": 1779817902.7547133, "t_finish_unix": 1779817917.7562706, "t_first_token_unix": 1779817915.7003887, "tpot_s": 0.006968265067849119, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273], "trace_timestamp_s": 309.0010000000002, "ttft_s": 12.945673317997716, "turn_id": 8} +{"actual_output_tokens": 69, "cached_tokens": 36928, "effective_input_length": 37007, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37007, "latency_s": 0.5586212250054814, "output_length": 69, "proxy_request_id": "1328753:2:1330033:395", "request_id": "1328753:2:1330033:395", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1328753", "t_dispatch_unix": 1779817917.218749, "t_finish_unix": 1779817917.7773697, "t_first_token_unix": 1779817917.3314261, "tpot_s": 0.006554952206309228, "trace_hash_ids": [13155620, 13155621, 13155622, 13155623, 13155624, 13155625, 13155626, 13155627, 13155628, 13155629, 13155630, 13155631, 13155632, 13155633, 13155634, 13155635, 13155636, 13155637, 13155638, 13155639, 13155640, 13155641, 13155642, 13155643, 13155644, 13155645, 13155646, 13155647, 13155648, 13155649, 13155650, 13155651, 13155652, 13155653, 13155654, 13155655, 13155656, 13155657, 13155658, 13155659, 13155660, 13155661, 13155662, 13155663, 13155664, 13155665, 13155666, 13155667, 13155668, 13155669, 13155670, 13155671, 13155672, 13155673, 13155674, 13155675, 13155676, 13155677, 13155678, 13155679, 13155680, 13172041, 13182089, 13182090, 13182091, 13182092, 13182093, 13182094, 13182095, 13198580, 13198581, 13198582, 13209966], "trace_timestamp_s": 322.0010000000002, "ttft_s": 0.11267539096297696, "turn_id": 2} +{"actual_output_tokens": 41, "cached_tokens": 5488, "effective_input_length": 6691, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6691, "latency_s": 3.1001486069872044, "output_length": 41, "proxy_request_id": "1324964:5:1330169:397", "request_id": "1324964:5:1330169:397", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1324964", "t_dispatch_unix": 1779817916.2406409, "t_finish_unix": 1779817919.34079, "t_first_token_unix": 1779817917.3204315, "tpot_s": 0.0505014688736992, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13211094, 13211095, 13211096, 13211097], "trace_timestamp_s": 322.4890000000005, "ttft_s": 1.0797893260023557, "turn_id": 5} +{"actual_output_tokens": 72, "cached_tokens": 0, "effective_input_length": 3866, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3866, "latency_s": 0.6040576070081443, "output_length": 72, "proxy_request_id": "1330881:1:1330881:400", "request_id": "1330881:1:1330881:400", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1330881", "t_dispatch_unix": 1779817918.899079, "t_finish_unix": 1779817919.5031369, "t_first_token_unix": 1779817919.1487682, "tpot_s": 0.0049871649858738544, "trace_hash_ids": [13217939, 13217940, 13217941, 13217942, 13217943, 13217944, 13217945, 13217946], "trace_timestamp_s": 325.14600000000064, "ttft_s": 0.2496874860371463, "turn_id": 1} +{"actual_output_tokens": 260, "cached_tokens": 28400, "effective_input_length": 28615, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28615, "latency_s": 1.7848294540308416, "output_length": 260, "proxy_request_id": "1316848:9:1328693:386", "request_id": "1316848:9:1328693:386", "request_type": "coder", "requested_output_tokens": 260, "session_id": "1316848", "t_dispatch_unix": 1779817917.7576458, "t_finish_unix": 1779817919.5424752, "t_first_token_unix": 1779817917.881699, "tpot_s": 0.006411248220006745, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13198070], "trace_timestamp_s": 317.28300000000036, "ttft_s": 0.12405098200542852, "turn_id": 9} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 11725, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11725, "latency_s": 4.519144288031384, "output_length": 83, "proxy_request_id": "1330130:1:1330130:396", "request_id": "1330130:1:1330130:396", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1330130", "t_dispatch_unix": 1779817916.13819, "t_finish_unix": 1779817920.6573346, "t_first_token_unix": 1779817917.1564906, "tpot_s": 0.042689848000541465, "trace_hash_ids": [13186800, 13186801, 13186802, 13186803, 13186804, 13186805, 13186806, 13186807, 13186808, 13186809, 13186810, 13186811, 13186812, 13186813, 13197582, 13197583, 13197584, 13197585, 13197586, 13210629, 13210630, 13210631, 13210632], "trace_timestamp_s": 322.3830000000007, "ttft_s": 1.018298799986951, "turn_id": 1} +{"actual_output_tokens": 48, "cached_tokens": 15312, "effective_input_length": 25688, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25688, "latency_s": 2.7883033539983444, "output_length": 48, "proxy_request_id": "1326192:3:1330643:399", "request_id": "1326192:3:1330643:399", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1326192", "t_dispatch_unix": 1779817918.0373204, "t_finish_unix": 1779817920.8256235, "t_first_token_unix": 1779817919.8047762, "tpot_s": 0.021714999851958947, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13183880, 13183881, 13183882, 13183883, 13183884, 13183885, 13183886, 13183887, 13183888, 13183889, 13183890, 13193351, 13193352, 13193353, 13193354, 13193355, 13200805, 13200806, 13200807, 13200808, 13200809, 13200810, 13200811, 13200812, 13200813, 13208998, 13208999, 13209000, 13215467, 13215468, 13215469, 13215470, 13215471], "trace_timestamp_s": 324.28200000000015, "ttft_s": 1.7674533929675817, "turn_id": 3} +{"actual_output_tokens": 27, "cached_tokens": 11792, "effective_input_length": 14067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14067, "latency_s": 1.9123318329802714, "output_length": 27, "proxy_request_id": "1330130:2:1331784:403", "request_id": "1330130:2:1331784:403", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1330130", "t_dispatch_unix": 1779817921.9433208, "t_finish_unix": 1779817923.8556526, "t_first_token_unix": 1779817922.317052, "tpot_s": 0.05916371042258106, "trace_hash_ids": [13186800, 13186801, 13186802, 13186803, 13186804, 13186805, 13186806, 13186807, 13186808, 13186809, 13186810, 13186811, 13186812, 13186813, 13197582, 13197583, 13197584, 13197585, 13197586, 13210629, 13210630, 13210631, 13220514, 13226126, 13226127, 13226128, 13226129, 13226130], "trace_timestamp_s": 328.1910000000007, "ttft_s": 0.37372973799938336, "turn_id": 2} +{"actual_output_tokens": 57, "cached_tokens": 25728, "effective_input_length": 27049, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27049, "latency_s": 3.1602525759954005, "output_length": 57, "proxy_request_id": "1326192:4:1331370:401", "request_id": "1326192:4:1331370:401", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1326192", "t_dispatch_unix": 1779817920.8368628, "t_finish_unix": 1779817923.9971151, "t_first_token_unix": 1779817921.536819, "tpot_s": 0.043929633179297004, "trace_hash_ids": [13222275, 13222276, 13222277, 13222278, 13222279, 13222280, 13222281, 13222282, 13222283, 13222284, 13222285, 13222286, 13222287, 13222288, 13222289, 13222290, 13222291, 13222292, 13222293, 13222294, 13222295, 13222296, 13222297, 13222298, 13222299, 13222300, 13222301, 13222302, 13222303, 13222304, 13222305, 13222306, 13222307, 13222308, 13222309, 13222310, 13222311, 13222312, 13222313, 13222314, 13222315, 13222316, 13222317, 13222318, 13222319, 13222320, 13222321, 13222322, 13222323, 13222324, 13222325, 13222326, 13222327], "trace_timestamp_s": 326.90800000000036, "ttft_s": 0.6999536069924943, "turn_id": 4} +{"actual_output_tokens": 68, "cached_tokens": 9344, "effective_input_length": 12781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12781, "latency_s": 3.4205178180127405, "output_length": 68, "proxy_request_id": "1329110:2:1331399:402", "request_id": "1329110:2:1331399:402", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1329110", "t_dispatch_unix": 1779817920.7489026, "t_finish_unix": 1779817924.1694202, "t_first_token_unix": 1779817921.205457, "tpot_s": 0.044232677716984234, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13211079, 13211080, 13211081, 13211082, 13222555, 13222556, 13222557], "trace_timestamp_s": 326.9970000000003, "ttft_s": 0.45655219396576285, "turn_id": 2} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 12421, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12421, "latency_s": 2.3472023159847595, "output_length": 48, "proxy_request_id": "1332021:1:1332021:407", "request_id": "1332021:1:1332021:407", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1332021", "t_dispatch_unix": 1779817922.7428026, "t_finish_unix": 1779817925.090005, "t_first_token_unix": 1779817923.8224833, "tpot_s": 0.02696329951063393, "trace_hash_ids": [29988, 29989, 29990, 29991, 29992, 29993, 29994, 29995, 29996, 29997, 29998, 29999, 30000, 12895103, 12895104, 12895105, 12895106, 12895107, 13045377, 13061172, 13096182, 13114659, 13149439, 13200204, 13228947], "trace_timestamp_s": 328.9870000000001, "ttft_s": 1.0796790199819952, "turn_id": 1} +{"actual_output_tokens": 13, "cached_tokens": 66736, "effective_input_length": 73234, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73234, "latency_s": 3.0169369879877195, "output_length": 13, "proxy_request_id": "1325541:2:1331846:404", "request_id": "1325541:2:1331846:404", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1325541", "t_dispatch_unix": 1779817922.1391456, "t_finish_unix": 1779817925.1560824, "t_first_token_unix": 1779817925.076218, "tpot_s": 0.006628106998202081, "trace_hash_ids": [13148586, 13148587, 13148588, 13148589, 13148590, 13148591, 13148592, 13148593, 13148594, 13148595, 13148596, 13148597, 13148598, 13148599, 13148600, 13148601, 13148602, 13148603, 13148604, 13148605, 13148606, 13148607, 13148608, 13148609, 13148610, 13148611, 13148612, 13148613, 13148614, 13148615, 13148616, 13148617, 13148618, 13148619, 13148620, 13148621, 13148622, 13148623, 13148624, 13148625, 13148626, 13148627, 13148628, 13148629, 13148630, 13148631, 13148632, 13148633, 13148634, 13148635, 13148636, 13148637, 13148638, 13148639, 13148640, 13148641, 13148642, 13148643, 13148644, 13148645, 13148646, 13148647, 13148648, 13148649, 13148650, 13148651, 13148652, 13148653, 13148654, 13148655, 13148656, 13148657, 13148658, 13148659, 13148660, 13148661, 13148662, 13148663, 13148664, 13148665, 13148666, 13148667, 13148668, 13148669, 13148670, 13148671, 13148672, 13148673, 13148674, 13148675, 13148676, 13148677, 13148678, 13148679, 13148680, 13148681, 13148682, 13148683, 13148684, 13148685, 13148686, 13148687, 13148688, 13148689, 13148690, 13148691, 13148692, 13148693, 13148694, 13148695, 13148696, 13148697, 13148698, 13148699, 13148700, 13148701, 13148702, 13148703, 13148704, 13148705, 13148706, 13148707, 13148708, 13148709, 13148710, 13148711, 13168103, 13168104, 13168105, 13168106, 13183375, 13195564, 13195565, 13195566, 13210778, 13210779, 13210780, 13210781, 13210782, 13210783, 13227100, 13227101, 13227102, 13227103], "trace_timestamp_s": 328.3820000000005, "ttft_s": 2.937069393985439, "turn_id": 2} +{"actual_output_tokens": 274, "cached_tokens": 0, "effective_input_length": 10847, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10847, "latency_s": 11.289688797027338, "output_length": 274, "proxy_request_id": "1329470:1:1329470:392", "request_id": "1329470:1:1329470:392", "request_type": "coder", "requested_output_tokens": 274, "session_id": "1329470", "t_dispatch_unix": 1779817913.8692741, "t_finish_unix": 1779817925.1589622, "t_first_token_unix": 1779817914.777057, "tpot_s": 0.0380273391867923, "trace_hash_ids": [13131336, 13131337, 13131338, 13142097, 13142098, 13142099, 13149758, 13149759, 13149760, 13149761, 13160564, 13160565, 13160566, 13160567, 13181977, 13181978, 13181979, 13181980, 13205182, 13205183, 13205184, 13205185], "trace_timestamp_s": 320.1140000000005, "ttft_s": 0.907781990012154, "turn_id": 1} +{"actual_output_tokens": 468, "cached_tokens": 28864, "effective_input_length": 28977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28977, "latency_s": 6.00770429399563, "output_length": 468, "proxy_request_id": "1316848:10:1330509:398", "request_id": "1316848:10:1330509:398", "request_type": "coder", "requested_output_tokens": 468, "session_id": "1316848", "t_dispatch_unix": 1779817919.5448997, "t_finish_unix": 1779817925.5526035, "t_first_token_unix": 1779817919.652325, "tpot_s": 0.012633815732319906, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13214124], "trace_timestamp_s": 323.7550000000001, "ttft_s": 0.10742315399693325, "turn_id": 10} +{"actual_output_tokens": 14, "cached_tokens": 11120, "effective_input_length": 11766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11766, "latency_s": 0.454073878005147, "output_length": 14, "proxy_request_id": "1329470:2:1332133:409", "request_id": "1329470:2:1332133:409", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1329470", "t_dispatch_unix": 1779817925.1598766, "t_finish_unix": 1779817925.6139507, "t_first_token_unix": 1779817925.4024944, "tpot_s": 0.01624062623327168, "trace_hash_ids": [13131336, 13131337, 13131338, 13142097, 13142098, 13142099, 13149758, 13149759, 13149760, 13149761, 13160564, 13160565, 13160566, 13160567, 13181977, 13181978, 13181979, 13181980, 13205182, 13205183, 13205184, 13229764, 13229765], "trace_timestamp_s": 329.35000000000036, "ttft_s": 0.24261467496398836, "turn_id": 2} +{"actual_output_tokens": 66, "cached_tokens": 12848, "effective_input_length": 13479, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13479, "latency_s": 1.6912315119989216, "output_length": 66, "proxy_request_id": "1329110:3:1332476:411", "request_id": "1329110:3:1332476:411", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1329110", "t_dispatch_unix": 1779817924.4244971, "t_finish_unix": 1779817926.1157289, "t_first_token_unix": 1779817924.8637214, "tpot_s": 0.01925771035379372, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13211079, 13211080, 13211081, 13211082, 13222555, 13222556, 13222557, 13232695, 13232696], "trace_timestamp_s": 330.6730000000007, "ttft_s": 0.4392230180092156, "turn_id": 3} +{"actual_output_tokens": 300, "cached_tokens": 69584, "effective_input_length": 71777, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71777, "latency_s": 3.8337940530036576, "output_length": 300, "proxy_request_id": "1269373:16:1331896:405", "request_id": "1269373:16:1331896:405", "request_type": "coder", "requested_output_tokens": 300, "session_id": "1269373", "t_dispatch_unix": 1779817922.3329992, "t_finish_unix": 1779817926.1667929, "t_first_token_unix": 1779817923.5600615, "tpot_s": 0.008717438411458169, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13227519], "trace_timestamp_s": 328.57800000000043, "ttft_s": 1.2270596210146323, "turn_id": 16} +{"actual_output_tokens": 187, "cached_tokens": 0, "effective_input_length": 21680, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21680, "latency_s": 3.4629079629667103, "output_length": 187, "proxy_request_id": "1332013:1:1332013:406", "request_id": "1332013:1:1332013:406", "request_type": "coder", "requested_output_tokens": 187, "session_id": "1332013", "t_dispatch_unix": 1779817922.7254746, "t_finish_unix": 1779817926.1883829, "t_first_token_unix": 1779817925.0794039, "tpot_s": 0.0059605361558922555, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 52726, 52727, 52728, 52729, 52730, 52731, 52732, 52733, 52734, 13228755, 13228756, 13228757, 13228758, 13228759, 13228760, 13228761, 13228762, 13228763], "trace_timestamp_s": 328.97100000000046, "ttft_s": 2.3539271730114706, "turn_id": 1} +{"actual_output_tokens": 140, "cached_tokens": 0, "effective_input_length": 1810, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1810, "latency_s": 2.751617953006644, "output_length": 140, "proxy_request_id": "1332472:1:1332472:410", "request_id": "1332472:1:1332472:410", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1332472", "t_dispatch_unix": 1779817924.400914, "t_finish_unix": 1779817927.1525319, "t_first_token_unix": 1779817924.6709113, "tpot_s": 0.017851355992736656, "trace_hash_ids": [13232681, 13232682, 13232683, 13232684], "trace_timestamp_s": 330.64900000000034, "ttft_s": 0.269996294984594, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 19766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19766, "latency_s": 2.5014450309681706, "output_length": 83, "proxy_request_id": "1332754:1:1332754:412", "request_id": "1332754:1:1332754:412", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1332754", "t_dispatch_unix": 1779817925.425563, "t_finish_unix": 1779817927.927008, "t_first_token_unix": 1779817927.453243, "tpot_s": 0.005774482572877143, "trace_hash_ids": [13174116, 13174117, 13180993, 13180994, 13180995, 13180996, 13180997, 13180998, 13180999, 13190141, 13190142, 13190143, 13190144, 13190145, 13200026, 13200027, 13200028, 13200029, 13200030, 13200031, 13200032, 13206846, 13206847, 13206848, 13206849, 13206850, 13223085, 13223086, 13223087, 13223088, 13223089, 13223090, 13223091, 13235741, 13235742, 13235743, 13235744, 13235745, 13235746], "trace_timestamp_s": 331.66700000000037, "ttft_s": 2.027675430988893, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 29440, "effective_input_length": 29656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29656, "latency_s": 0.4116058510262519, "output_length": 47, "proxy_request_id": "1316848:11:1333994:416", "request_id": "1316848:11:1333994:416", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779817929.801153, "t_finish_unix": 1779817930.2127583, "t_first_token_unix": 1779817929.9328923, "tpot_s": 0.006078565478041444, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823], "trace_timestamp_s": 336.0480000000007, "ttft_s": 0.1317375100334175, "turn_id": 11} +{"actual_output_tokens": 905, "cached_tokens": 75904, "effective_input_length": 81008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81008, "latency_s": 23.554897035006434, "output_length": 905, "proxy_request_id": "1279412:17:1326166:377", "request_id": "1279412:17:1326166:377", "request_type": "coder", "requested_output_tokens": 905, "session_id": "1279412", "t_dispatch_unix": 1779817907.65261, "t_finish_unix": 1779817931.207507, "t_first_token_unix": 1779817910.2735665, "tpot_s": 0.023156753652669858, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13174094], "trace_timestamp_s": 308.22500000000036, "ttft_s": 2.620953478035517, "turn_id": 17} +{"actual_output_tokens": 98, "cached_tokens": 0, "effective_input_length": 23689, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23689, "latency_s": 3.25940623000497, "output_length": 98, "proxy_request_id": "1334223:1:1334223:417", "request_id": "1334223:1:1334223:417", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1334223", "t_dispatch_unix": 1779817930.6716094, "t_finish_unix": 1779817933.931016, "t_first_token_unix": 1779817933.3498237, "tpot_s": 0.005988692783764996, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13248824, 13248825, 13248826, 13248827, 13248828], "trace_timestamp_s": 336.91200000000026, "ttft_s": 2.6782116789836437, "turn_id": 1} +{"actual_output_tokens": 219, "cached_tokens": 44880, "effective_input_length": 45601, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45601, "latency_s": 2.018100287998095, "output_length": 219, "proxy_request_id": "1309252:2:1334746:419", "request_id": "1309252:2:1334746:419", "request_type": "coder", "requested_output_tokens": 219, "session_id": "1309252", "t_dispatch_unix": 1779817932.6385882, "t_finish_unix": 1779817934.6566887, "t_first_token_unix": 1779817933.0644155, "tpot_s": 0.007302621692694604, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13254144, 13254145, 13254146, 13254147, 13254148, 13254149, 13254150, 13254151, 13254152, 13254153, 13254154, 13254155, 13254156, 13254157, 13254158, 13254159, 13254160, 13254161, 13254162, 13254163, 13254164, 13254165, 13254166, 13254167, 13254168, 13254169, 13254170, 13254171, 13254172, 13254173, 13254174], "trace_timestamp_s": 338.8730000000005, "ttft_s": 0.42582530196523294, "turn_id": 2} +{"actual_output_tokens": 130, "cached_tokens": 29696, "effective_input_length": 44664, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44664, "latency_s": 4.797886304964777, "output_length": 130, "proxy_request_id": "1316848:12:1334743:418", "request_id": "1316848:12:1334743:418", "request_type": "coder", "requested_output_tokens": 130, "session_id": "1316848", "t_dispatch_unix": 1779817932.6275144, "t_finish_unix": 1779817937.4254003, "t_first_token_unix": 1779817936.5054288, "tpot_s": 0.0071275862716246655, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13254136], "trace_timestamp_s": 338.8700000000008, "ttft_s": 3.8779123589629307, "turn_id": 12} +{"actual_output_tokens": 31, "cached_tokens": 3936, "effective_input_length": 11989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11989, "latency_s": 0.9045800910098478, "output_length": 31, "proxy_request_id": "1330881:2:1336222:422", "request_id": "1330881:2:1336222:422", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1330881", "t_dispatch_unix": 1779817937.757908, "t_finish_unix": 1779817938.6624885, "t_first_token_unix": 1779817938.5076811, "tpot_s": 0.005150542400466899, "trace_hash_ids": [13217939, 13217940, 13217941, 13217942, 13217943, 13217944, 13217945, 13226639, 13226640, 13226641, 13226642, 13226643, 13226644, 13238415, 13238416, 13238417, 13247360, 13247361, 13247362, 13258417, 13258418, 13258419, 13258420, 13266737], "trace_timestamp_s": 344.0030000000006, "ttft_s": 0.7497709860326722, "turn_id": 2} +{"actual_output_tokens": 163, "cached_tokens": 81520, "effective_input_length": 81827, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81827, "latency_s": 30.889700526953675, "output_length": 163, "proxy_request_id": "1317598:3:1328678:385", "request_id": "1317598:3:1328678:385", "request_type": "coder", "requested_output_tokens": 163, "session_id": "1317598", "t_dispatch_unix": 1779817910.989334, "t_finish_unix": 1779817941.8790345, "t_first_token_unix": 1779817911.42936, "tpot_s": 0.18795905686429137, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980], "trace_timestamp_s": 317.2350000000006, "ttft_s": 0.44002318795537576, "turn_id": 3} +{"actual_output_tokens": 137, "cached_tokens": 0, "effective_input_length": 20009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20009, "latency_s": 2.8660947749740444, "output_length": 137, "proxy_request_id": "1259178:2:1336768:424", "request_id": "1259178:2:1336768:424", "request_type": "coder", "requested_output_tokens": 137, "session_id": "1259178", "t_dispatch_unix": 1779817939.5241895, "t_finish_unix": 1779817942.3902838, "t_first_token_unix": 1779817941.5962338, "tpot_s": 0.005837014529628076, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13271726], "trace_timestamp_s": 345.77000000000044, "ttft_s": 2.0720420259749517, "turn_id": 2} +{"actual_output_tokens": 40, "cached_tokens": 512, "effective_input_length": 90605, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90605, "latency_s": 28.28761859203223, "output_length": 40, "proxy_request_id": "1257323:2:1329541:393", "request_id": "1257323:2:1329541:393", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1257323", "t_dispatch_unix": 1779817914.3054326, "t_finish_unix": 1779817942.593051, "t_first_token_unix": 1779817941.8188195, "tpot_s": 0.01984587230701716, "trace_hash_ids": [2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518, 46994, 46995, 46996, 46997, 46998, 46999, 47000, 47001, 47002, 47003, 47004, 47005, 47006, 47007, 47008, 47009, 47010, 47011, 47012, 4751454, 2379937, 2379938, 2379939, 2379940, 2379941, 4751455, 4751456, 4751457, 4751458, 4751459, 4751460, 4751461, 4751462, 4751463, 4751464, 4751465, 4751466, 4751467, 4751468, 4751469, 4751470, 4751471, 4751472, 4751473, 4751474, 4751475, 4751476, 4751477, 4751478, 4751479, 4751480, 4751481, 4751482, 4751483, 4751484, 4751485, 10670236, 10670237, 10670238, 10670239, 10670240, 10670241, 10670242, 10670243, 10670244, 10670245, 10670246, 10670247, 10670248, 10670249, 10670250, 10670251, 10670252, 10670253, 10670254, 10670255, 10670256, 10670257, 10670258, 10670259, 10670260, 10670261, 10994656, 10994657, 10994658, 10994659, 10994660, 10994661, 10994662, 10994663, 10994664, 10994665, 10994666, 10994667, 10994668, 10994669, 10994670, 10994671, 10994672, 10994673, 10994674, 10994675, 10994676, 10994677, 10994678, 10994679, 10994680, 10994681, 10994682, 10994683, 10994684, 10994685, 10994686, 10994687, 10994688, 10994689, 10994690, 10994691, 10994692, 10994693, 10994694, 10994695, 10994696, 10994697, 10994698, 10994699, 10994700, 10994701, 10994702, 10994703, 10994704, 10994705, 10994706, 10994707, 10994708, 10994709, 10994710, 10994711, 10994712, 10994713, 10994714, 10994715, 10994716, 10994717, 10994718, 10994719, 10994720, 10994721, 10994722, 10994723, 10994724, 10994725, 10994726, 10994727, 11134572, 11161915, 11261064, 11282181, 11360636, 11420052, 11420053, 11446131, 11701929, 12264742, 12297965, 12385798, 12385799, 12514819, 13206085], "trace_timestamp_s": 320.5510000000004, "ttft_s": 27.513384083053097, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 44784, "effective_input_length": 45005, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45005, "latency_s": 0.4806630880339071, "output_length": 47, "proxy_request_id": "1316848:13:1337519:427", "request_id": "1316848:13:1337519:427", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779817942.386617, "t_finish_unix": 1779817942.8672795, "t_first_token_unix": 1779817942.592138, "tpot_s": 0.005976909979084588, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605], "trace_timestamp_s": 348.6350000000002, "ttft_s": 0.20551835000514984, "turn_id": 13} +{"actual_output_tokens": 142, "cached_tokens": 20144, "effective_input_length": 22398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22398, "latency_s": 1.2876037650275975, "output_length": 142, "proxy_request_id": "1259178:3:1337653:429", "request_id": "1259178:3:1337653:429", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1259178", "t_dispatch_unix": 1779817942.833629, "t_finish_unix": 1779817944.121233, "t_first_token_unix": 1779817943.281704, "tpot_s": 0.005952418418535104, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13280050, 13280051, 13280052, 13280053, 13280054], "trace_timestamp_s": 349.08100000000013, "ttft_s": 0.4480730509967543, "turn_id": 3} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 12644, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12644, "latency_s": 4.65233170799911, "output_length": 34, "proxy_request_id": "1337035:1:1337035:425", "request_id": "1337035:1:1337035:425", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1337035", "t_dispatch_unix": 1779817940.5516212, "t_finish_unix": 1779817945.2039526, "t_first_token_unix": 1779817941.6144273, "tpot_s": 0.10876384681923258, "trace_hash_ids": [13244966, 13244967, 13244968, 13251581, 13251582, 13251583, 13251584, 13251585, 13251586, 13259082, 13259083, 13259084, 13267038, 13267039, 13267040, 13267041, 13267042, 13267043, 13267044, 13267045, 13274119, 13274120, 13274121, 13274122, 13274123], "trace_timestamp_s": 346.7960000000003, "ttft_s": 1.0628050009836443, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 20192, "effective_input_length": 36518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36518, "latency_s": 3.812522075022571, "output_length": 34, "proxy_request_id": "1311753:2:1337278:426", "request_id": "1311753:2:1337278:426", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1311753", "t_dispatch_unix": 1779817941.4115884, "t_finish_unix": 1779817945.2241096, "t_first_token_unix": 1779817944.9773233, "tpot_s": 0.00747063699898056, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13276135, 13276136, 13276137, 13276138, 13276139, 13276140, 13276141, 13276142, 13276143, 13276144, 13276145, 13276146, 13276147, 13276148, 13276149, 13276150, 13276151, 13276152, 13276153, 13276154, 13276155, 13276156, 13276157, 13276158, 13276159, 13276160, 13276161, 13276162, 13276163, 13276164, 13276165, 13276166, 13276167], "trace_timestamp_s": 347.65400000000045, "ttft_s": 3.565733647032175, "turn_id": 2} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 9325, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9325, "latency_s": 1.3745353129925206, "output_length": 24, "proxy_request_id": "1338292:1:1338292:432", "request_id": "1338292:1:1338292:432", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1338292", "t_dispatch_unix": 1779817945.0392294, "t_finish_unix": 1779817946.4137652, "t_first_token_unix": 1779817945.8653195, "tpot_s": 0.023830723131338702, "trace_hash_ids": [13265284, 13265285, 13265286, 13265287, 13265288, 13265289, 13265290, 13265291, 13265292, 13265293, 13265294, 13265295, 13273919, 13273920, 13286188, 13286189, 13286190, 13286191, 13286192], "trace_timestamp_s": 351.28500000000076, "ttft_s": 0.8260883539915085, "turn_id": 1} +{"actual_output_tokens": 403, "cached_tokens": 27072, "effective_input_length": 34264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34264, "latency_s": 34.07854042900726, "output_length": 403, "proxy_request_id": "1268861:5:1329060:388", "request_id": "1268861:5:1329060:388", "request_type": "coder", "requested_output_tokens": 403, "session_id": "1268861", "t_dispatch_unix": 1779817912.4047368, "t_finish_unix": 1779817946.4832768, "t_first_token_unix": 1779817914.0642529, "tpot_s": 0.08064342965169194, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049], "trace_timestamp_s": 318.65000000000055, "ttft_s": 1.6595131140202284, "turn_id": 5} +{"actual_output_tokens": 296, "cached_tokens": 81904, "effective_input_length": 82488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82488, "latency_s": 16.197933901974466, "output_length": 296, "proxy_request_id": "1279412:18:1332945:413", "request_id": "1279412:18:1332945:413", "request_type": "coder", "requested_output_tokens": 296, "session_id": "1279412", "t_dispatch_unix": 1779817931.2120512, "t_finish_unix": 1779817947.4099853, "t_first_token_unix": 1779817931.6638129, "tpot_s": 0.0533755374778362, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13237340], "trace_timestamp_s": 332.5, "ttft_s": 0.45175923901842907, "turn_id": 18} +{"actual_output_tokens": 271, "cached_tokens": 72064, "effective_input_length": 73073, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73073, "latency_s": 3.029346314026043, "output_length": 271, "proxy_request_id": "1269373:17:1338104:431", "request_id": "1269373:17:1338104:431", "request_type": "coder", "requested_output_tokens": 271, "session_id": "1269373", "t_dispatch_unix": 1779817944.4905572, "t_finish_unix": 1779817947.5199027, "t_first_token_unix": 1779817945.1696026, "tpot_s": 0.008703991418695767, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13284368], "trace_timestamp_s": 350.7370000000001, "ttft_s": 0.6790436939918436, "turn_id": 17} +{"actual_output_tokens": 489, "cached_tokens": 81984, "effective_input_length": 82142, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82142, "latency_s": 5.923032935010269, "output_length": 489, "proxy_request_id": "1317598:4:1332127:408", "request_id": "1317598:4:1332127:408", "request_type": "coder", "requested_output_tokens": 489, "session_id": "1317598", "t_dispatch_unix": 1779817941.882557, "t_finish_unix": 1779817947.8055782, "t_first_token_unix": 1779817942.1676173, "tpot_s": 0.011552674481626142, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753], "trace_timestamp_s": 329.33500000000004, "ttft_s": 0.2850692829815671, "turn_id": 4} +{"actual_output_tokens": 65, "cached_tokens": 82624, "effective_input_length": 83088, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83088, "latency_s": 1.0020629840437323, "output_length": 65, "proxy_request_id": "1317598:5:1337780:430", "request_id": "1317598:5:1337780:430", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1317598", "t_dispatch_unix": 1779817947.8091874, "t_finish_unix": 1779817948.8112507, "t_first_token_unix": 1779817948.2601979, "tpot_s": 0.008604568844020832, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753, 13281236, 13281237], "trace_timestamp_s": 349.5450000000001, "ttft_s": 0.4510075710131787, "turn_id": 5} +{"actual_output_tokens": 397, "cached_tokens": 50032, "effective_input_length": 50215, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50215, "latency_s": 5.579182176035829, "output_length": 397, "proxy_request_id": "1253743:5:1338406:433", "request_id": "1253743:5:1338406:433", "request_type": "coder", "requested_output_tokens": 397, "session_id": "1253743", "t_dispatch_unix": 1779817945.356305, "t_finish_unix": 1779817950.9354873, "t_first_token_unix": 1779817945.5498645, "tpot_s": 0.013599407601033836, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13287121, 13287122], "trace_timestamp_s": 351.60400000000027, "ttft_s": 0.19355722999898717, "turn_id": 5} +{"actual_output_tokens": 169, "cached_tokens": 7680, "effective_input_length": 14666, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14666, "latency_s": 12.590340120019391, "output_length": 169, "proxy_request_id": "1336620:1:1336620:423", "request_id": "1336620:1:1336620:423", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1336620", "t_dispatch_unix": 1779817939.058492, "t_finish_unix": 1779817951.6488318, "t_first_token_unix": 1779817944.6391969, "tpot_s": 0.04172201661900284, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13270075], "trace_timestamp_s": 345.3050000000003, "ttft_s": 5.580703716026619, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 13816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13816, "latency_s": 1.394336023950018, "output_length": 37, "proxy_request_id": "1339977:1:1339977:442", "request_id": "1339977:1:1339977:442", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1339977", "t_dispatch_unix": 1779817951.0941918, "t_finish_unix": 1779817952.4885278, "t_first_token_unix": 1779817952.2956889, "tpot_s": 0.005348671471842358, "trace_hash_ids": [13245098, 13245099, 13245100, 13245101, 13253631, 13253632, 13253633, 13253634, 13253635, 13253636, 13266203, 13266204, 13266205, 13266206, 13266207, 13266208, 13273953, 13273954, 13280192, 13280193, 13280194, 13288772, 13288773, 13296702, 13296703, 13296704, 13302390], "trace_timestamp_s": 357.33800000000065, "ttft_s": 1.2014955249615014, "turn_id": 1} +{"actual_output_tokens": 547, "cached_tokens": 45040, "effective_input_length": 49688, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49688, "latency_s": 6.630745745031163, "output_length": 547, "proxy_request_id": "1316848:14:1338658:435", "request_id": "1316848:14:1338658:435", "request_type": "coder", "requested_output_tokens": 547, "session_id": "1316848", "t_dispatch_unix": 1779817946.2720077, "t_finish_unix": 1779817952.9027534, "t_first_token_unix": 1779817947.8051658, "tpot_s": 0.009335549159257779, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13289620], "trace_timestamp_s": 352.51800000000003, "ttft_s": 1.5331567920511588, "turn_id": 14} +{"actual_output_tokens": 684, "cached_tokens": 22528, "effective_input_length": 24462, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24462, "latency_s": 4.688344141992275, "output_length": 684, "proxy_request_id": "1259178:4:1339295:439", "request_id": "1259178:4:1339295:439", "request_type": "coder", "requested_output_tokens": 684, "session_id": "1259178", "t_dispatch_unix": 1779817948.510085, "t_finish_unix": 1779817953.1984293, "t_first_token_unix": 1779817948.9441953, "tpot_s": 0.006228330260651298, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13280050, 13280051, 13280052, 13280053, 13280054, 13295757, 13295758, 13295759, 13295760], "trace_timestamp_s": 354.7580000000007, "ttft_s": 0.4341082919854671, "turn_id": 4} +{"actual_output_tokens": 241, "cached_tokens": 27808, "effective_input_length": 61229, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61229, "latency_s": 19.338522381032817, "output_length": 241, "proxy_request_id": "1314357:2:1335184:420", "request_id": "1314357:2:1335184:420", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1314357", "t_dispatch_unix": 1779817934.0010529, "t_finish_unix": 1779817953.339573, "t_first_token_unix": 1779817944.6460793, "tpot_s": 0.0362214787749205, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13257866], "trace_timestamp_s": 340.2470000000003, "ttft_s": 10.64502698200522, "turn_id": 2} +{"actual_output_tokens": 455, "cached_tokens": 45808, "effective_input_length": 45994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45994, "latency_s": 3.580179067037534, "output_length": 455, "proxy_request_id": "1309252:3:1339771:441", "request_id": "1309252:3:1339771:441", "request_type": "coder", "requested_output_tokens": 455, "session_id": "1309252", "t_dispatch_unix": 1779817950.3312287, "t_finish_unix": 1779817953.9114077, "t_first_token_unix": 1779817950.5190277, "tpot_s": 0.00747167550877151, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13254144, 13254145, 13300607, 13300608, 13300609, 13300610, 13300611, 13300612, 13300613, 13300614, 13300615, 13300616, 13300617, 13300618, 13300619, 13300620, 13300621, 13300622, 13300623, 13300624, 13300625, 13300626, 13300627, 13300628, 13300629, 13300630, 13300631, 13300632, 13300633, 13300634, 13300635], "trace_timestamp_s": 356.5730000000003, "ttft_s": 0.18779751303372905, "turn_id": 3} +{"actual_output_tokens": 209, "cached_tokens": 82768, "effective_input_length": 87264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87264, "latency_s": 7.291212032025214, "output_length": 209, "proxy_request_id": "1279412:19:1335444:421", "request_id": "1279412:19:1335444:421", "request_type": "coder", "requested_output_tokens": 209, "session_id": "1279412", "t_dispatch_unix": 1779817947.4157102, "t_finish_unix": 1779817954.706922, "t_first_token_unix": 1779817949.929912, "tpot_s": 0.022964554745088277, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13260063], "trace_timestamp_s": 341.1690000000008, "ttft_s": 2.5141992639983073, "turn_id": 19} +{"actual_output_tokens": 70, "cached_tokens": 0, "effective_input_length": 5280, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5280, "latency_s": 0.7040827670134604, "output_length": 70, "proxy_request_id": "1341005:1:1341005:447", "request_id": "1341005:1:1341005:447", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1341005", "t_dispatch_unix": 1779817954.5655107, "t_finish_unix": 1779817955.2695932, "t_first_token_unix": 1779817954.914741, "tpot_s": 0.005139012405129177, "trace_hash_ids": [13311826, 13311827, 13311828, 13311829, 13311830, 13311831, 13311832, 13311833, 13311834, 13311835, 13311836], "trace_timestamp_s": 360.8130000000001, "ttft_s": 0.3492294190218672, "turn_id": 1} +{"actual_output_tokens": 200, "cached_tokens": 0, "effective_input_length": 2279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2279, "latency_s": 1.1466314640128985, "output_length": 200, "proxy_request_id": "1340903:1:1340903:446", "request_id": "1340903:1:1340903:446", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1340903", "t_dispatch_unix": 1779817954.225729, "t_finish_unix": 1779817955.3723602, "t_first_token_unix": 1779817954.3754928, "tpot_s": 0.005008134502454207, "trace_hash_ids": [13297157, 13304628, 13304629, 13311075, 13311076], "trace_timestamp_s": 360.47400000000016, "ttft_s": 0.1497628539800644, "turn_id": 1} +{"actual_output_tokens": 293, "cached_tokens": 0, "effective_input_length": 21221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21221, "latency_s": 4.048810134001542, "output_length": 293, "proxy_request_id": "1340290:1:1340290:445", "request_id": "1340290:1:1340290:445", "request_type": "coder", "requested_output_tokens": 293, "session_id": "1340290", "t_dispatch_unix": 1779817952.215192, "t_finish_unix": 1779817956.2640026, "t_first_token_unix": 1779817954.4956157, "tpot_s": 0.006055187959023049, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13305218], "trace_timestamp_s": 358.45600000000013, "ttft_s": 2.2804216659860685, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 9909, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9909, "latency_s": 1.30192909296602, "output_length": 92, "proxy_request_id": "1341912:1:1341912:449", "request_id": "1341912:1:1341912:449", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1341912", "t_dispatch_unix": 1779817957.6027524, "t_finish_unix": 1779817958.904682, "t_first_token_unix": 1779817958.4155772, "tpot_s": 0.005371642900902041, "trace_hash_ids": [13307661, 13307662, 13307663, 13314126, 13314127, 13314128, 13314129, 13314130, 13314131, 13314132, 13314133, 13314134, 13314135, 13314136, 13314137, 13314138, 13319756, 13319757, 13319758, 13319759], "trace_timestamp_s": 363.84799999999996, "ttft_s": 0.8128223799867555, "turn_id": 1} +{"actual_output_tokens": 154, "cached_tokens": 14832, "effective_input_length": 14918, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14918, "latency_s": 7.62500711902976, "output_length": 154, "proxy_request_id": "1336620:2:1338440:434", "request_id": "1336620:2:1338440:434", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1336620", "t_dispatch_unix": 1779817951.6497664, "t_finish_unix": 1779817959.2747736, "t_first_token_unix": 1779817951.7766743, "tpot_s": 0.049003917849440054, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13287309, 13287310], "trace_timestamp_s": 351.6980000000003, "ttft_s": 0.12690634903265163, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 6180, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6180, "latency_s": 0.7078475389862433, "output_length": 59, "proxy_request_id": "1342327:1:1342327:452", "request_id": "1342327:1:1342327:452", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1342327", "t_dispatch_unix": 1779817959.025257, "t_finish_unix": 1779817959.733105, "t_first_token_unix": 1779817959.4375741, "tpot_s": 0.005090905051349245, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13323580], "trace_timestamp_s": 365.27199999999993, "ttft_s": 0.41231491800863296, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 19887, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19887, "latency_s": 2.4164905279758386, "output_length": 45, "proxy_request_id": "1341948:1:1341948:450", "request_id": "1341948:1:1341948:450", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1341948", "t_dispatch_unix": 1779817957.7209022, "t_finish_unix": 1779817960.1373925, "t_first_token_unix": 1779817959.8087661, "tpot_s": 0.007463545113833706, "trace_hash_ids": [13296198, 13296199, 13296200, 13296201, 13296202, 13296203, 13296204, 13296205, 13296206, 13296207, 13296208, 13296209, 13296210, 13296211, 13296212, 13296213, 13296214, 13296215, 13296216, 13296217, 13296218, 13296219, 13296220, 13296221, 13296222, 13296223, 13296224, 13296225, 13296226, 13296227, 13296228, 13296229, 13296230, 13308586, 13308587, 13308588, 13308589, 13320340, 13320341], "trace_timestamp_s": 363.96200000000044, "ttft_s": 2.0878621909650974, "turn_id": 1} +{"actual_output_tokens": 16, "cached_tokens": 2128, "effective_input_length": 2129, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2129, "latency_s": 0.25567330699414015, "output_length": 16, "proxy_request_id": "1340903:2:1342632:453", "request_id": "1340903:2:1342632:453", "request_type": "coder", "requested_output_tokens": 16, "session_id": "1340903", "t_dispatch_unix": 1779817960.0630555, "t_finish_unix": 1779817960.318729, "t_first_token_unix": 1779817960.2169054, "tpot_s": 0.006766166464270403, "trace_hash_ids": [13326527, 13326528, 13326529, 13326530, 13326531], "trace_timestamp_s": 366.3110000000006, "ttft_s": 0.1538486370118335, "turn_id": 2} +{"actual_output_tokens": 114, "cached_tokens": 21376, "effective_input_length": 21380, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21380, "latency_s": 2.3000450460240245, "output_length": 114, "proxy_request_id": "1340290:2:1342119:451", "request_id": "1340290:2:1342119:451", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1340290", "t_dispatch_unix": 1779817958.2577507, "t_finish_unix": 1779817960.5577953, "t_first_token_unix": 1779817959.810956, "tpot_s": 0.0066071884424335, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13321903], "trace_timestamp_s": 364.5060000000003, "ttft_s": 1.5532039200188592, "turn_id": 2} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 48381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48381, "latency_s": 9.415185512974858, "output_length": 81, "proxy_request_id": "1340278:1:1340278:444", "request_id": "1340278:1:1340278:444", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1340278", "t_dispatch_unix": 1779817952.1886957, "t_finish_unix": 1779817961.603881, "t_first_token_unix": 1779817961.029307, "tpot_s": 0.007179173675103812, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13305070, 13305071, 13305072, 13305073, 13305074, 13305075, 13305076, 13305077, 13305078, 13305079, 13305080, 13305081, 13305082, 13305083, 13305084, 13305085, 13305086, 13305087, 13305088, 13305089, 13305090, 13305091, 13305092, 13305093, 13305094, 13305095, 13305096, 13305097, 13305098, 13305099, 13305100, 13305101, 13305102, 13305103, 13305104, 13305105, 13305106, 13305107, 13305108, 13305109, 13305110, 13305111, 13305112, 13305113, 13305114, 13305115, 13305116, 13305117, 13305118, 13305119, 13305120, 13305121, 13305122, 13305123, 13305124, 13305125, 13305126, 13305127, 13305128, 13305129, 13305130, 13305131, 13305132, 13305133, 13305134, 13305135, 13305136, 13305137, 13305138, 13305139, 13305140, 13305141, 13305142, 13305143, 13305144], "trace_timestamp_s": 358.4190000000008, "ttft_s": 8.840609039994888, "turn_id": 1} +{"actual_output_tokens": 272, "cached_tokens": 23776, "effective_input_length": 37527, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37527, "latency_s": 4.92790175502887, "output_length": 272, "proxy_request_id": "1334223:2:1341796:448", "request_id": "1334223:2:1341796:448", "request_type": "coder", "requested_output_tokens": 272, "session_id": "1334223", "t_dispatch_unix": 1779817957.166787, "t_finish_unix": 1779817962.0946884, "t_first_token_unix": 1779817960.2164485, "tpot_s": 0.006929671623816239, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13248824, 13248825, 13248826, 13248827, 13318839, 13318840, 13318841, 13318842, 13318843, 13318844, 13318845, 13318846, 13318847, 13318848, 13318849, 13318850, 13318851, 13318852, 13318853, 13318854, 13318855, 13318856, 13318857, 13318858, 13318859, 13318860, 13318861, 13318862, 13318863, 13318864, 13318865, 13318866], "trace_timestamp_s": 363.41000000000076, "ttft_s": 3.0496592139825225, "turn_id": 2} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 11912, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11912, "latency_s": 1.0202633789740503, "output_length": 12, "proxy_request_id": "1343191:1:1343191:457", "request_id": "1343191:1:1343191:457", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1343191", "t_dispatch_unix": 1779817962.1337032, "t_finish_unix": 1779817963.1539662, "t_first_token_unix": 1779817963.1071925, "tpot_s": 0.004225398091049018, "trace_hash_ids": [13317487, 13317488, 13317489, 13317490, 13317491, 13317492, 13317493, 13317494, 13317495, 13317496, 13317497, 13317498, 13317499, 13317500, 13317501, 13317502, 13317503, 13317504, 13317505, 13317506, 13324213, 13331765, 13331766, 13331767], "trace_timestamp_s": 368.3780000000006, "ttft_s": 0.9734878829913214, "turn_id": 1} +{"actual_output_tokens": 152, "cached_tokens": 87472, "effective_input_length": 95383, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95383, "latency_s": 8.562817375001032, "output_length": 152, "proxy_request_id": "1279412:20:1337591:428", "request_id": "1279412:20:1337591:428", "request_type": "coder", "requested_output_tokens": 152, "session_id": "1279412", "t_dispatch_unix": 1779817954.7146542, "t_finish_unix": 1779817963.2774718, "t_first_token_unix": 1779817959.2421777, "tpot_s": 0.02672203482107093, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13279440], "trace_timestamp_s": 348.8720000000003, "ttft_s": 4.527521075040568, "turn_id": 20} +{"actual_output_tokens": 14, "cached_tokens": 0, "effective_input_length": 14103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14103, "latency_s": 1.2865584130049683, "output_length": 14, "proxy_request_id": "1338292:2:1343599:460", "request_id": "1338292:2:1343599:460", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1338292", "t_dispatch_unix": 1779817963.3397577, "t_finish_unix": 1779817964.6263158, "t_first_token_unix": 1779817964.5686285, "tpot_s": 0.004418796694013649, "trace_hash_ids": [13336050, 13336051, 13336052, 13336053, 13336054, 13336055, 13336056, 13336057, 13336058, 13336059, 13336060, 13336061, 13336062, 13336063, 13336064, 13336065, 13336066, 13336067, 13336068, 13336069, 13336070, 13336071, 13336072, 13336073, 13336074, 13336075, 13336076, 13336077], "trace_timestamp_s": 369.58300000000054, "ttft_s": 1.2288690879940987, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 21402, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21402, "latency_s": 2.370959192980081, "output_length": 13, "proxy_request_id": "1343312:1:1343312:459", "request_id": "1343312:1:1343312:459", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1343312", "t_dispatch_unix": 1779817962.4959412, "t_finish_unix": 1779817964.8669002, "t_first_token_unix": 1779817964.8138568, "tpot_s": 0.0043997479127331944, "trace_hash_ids": [13332570, 13332571, 13332572, 13332573, 13332574, 13332575, 13332576, 13332577, 13332578, 13332579, 13332580, 13332581, 13332582, 13332583, 13332584, 13332585, 13332586, 13332587, 13332588, 13332589, 13332590, 13332591, 13332592, 13332593, 13332594, 13332595, 13332596, 13332597, 13332598, 13332599, 13332600, 13332601, 13332602, 13332603, 13332604, 13332605, 13332606, 13332607, 13332608, 13332609, 13332610, 13332611], "trace_timestamp_s": 368.7370000000001, "ttft_s": 2.3179139900021255, "turn_id": 1} +{"actual_output_tokens": 230, "cached_tokens": 95520, "effective_input_length": 95543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95543, "latency_s": 5.578545118973125, "output_length": 230, "proxy_request_id": "1279412:21:1339581:440", "request_id": "1279412:21:1339581:440", "request_type": "coder", "requested_output_tokens": 230, "session_id": "1279412", "t_dispatch_unix": 1779817963.283258, "t_finish_unix": 1779817968.861803, "t_first_token_unix": 1779817963.4834208, "tpot_s": 0.023485054135399842, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13298376], "trace_timestamp_s": 355.84200000000055, "ttft_s": 0.20016108895651996, "turn_id": 21} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 505, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 505, "latency_s": 0.37954641797114164, "output_length": 67, "proxy_request_id": "1345921:1:1345921:469", "request_id": "1345921:1:1345921:469", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1345921", "t_dispatch_unix": 1779817971.2644334, "t_finish_unix": 1779817971.6439798, "t_first_token_unix": 1779817971.3225815, "tpot_s": 0.004865910318172114, "trace_hash_ids": [13357030], "trace_timestamp_s": 377.5140000000001, "ttft_s": 0.058147232979536057, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 32816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32816, "latency_s": 4.69238663703436, "output_length": 25, "proxy_request_id": "1344773:1:1344773:465", "request_id": "1344773:1:1344773:465", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1344773", "t_dispatch_unix": 1779817967.363302, "t_finish_unix": 1779817972.0556881, "t_first_token_unix": 1779817971.9216132, "tpot_s": 0.00557590345852077, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13346692], "trace_timestamp_s": 373.59900000000016, "ttft_s": 4.55830951401731, "turn_id": 1} +{"actual_output_tokens": 30, "cached_tokens": 32832, "effective_input_length": 33008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33008, "latency_s": 0.30923185200663283, "output_length": 30, "proxy_request_id": "1344773:2:1346419:473", "request_id": "1344773:2:1346419:473", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1344773", "t_dispatch_unix": 1779817973.1296039, "t_finish_unix": 1779817973.4388356, "t_first_token_unix": 1779817973.2709906, "tpot_s": 0.005777056274758973, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13361257], "trace_timestamp_s": 379.3780000000006, "ttft_s": 0.14138391404412687, "turn_id": 2} +{"actual_output_tokens": 371, "cached_tokens": 73328, "effective_input_length": 73946, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73946, "latency_s": 3.714662419981323, "output_length": 371, "proxy_request_id": "1269373:18:1345570:467", "request_id": "1269373:18:1345570:467", "request_type": "coder", "requested_output_tokens": 371, "session_id": "1269373", "t_dispatch_unix": 1779817969.9279954, "t_finish_unix": 1779817973.6426573, "t_first_token_unix": 1779817970.3555055, "tpot_s": 0.008883493570327708, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13353639], "trace_timestamp_s": 376.174, "ttft_s": 0.427507585962303, "turn_id": 18} +{"actual_output_tokens": 55, "cached_tokens": 5344, "effective_input_length": 9360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9360, "latency_s": 12.476193998998497, "output_length": 55, "proxy_request_id": "1341005:2:1342961:456", "request_id": "1341005:2:1342961:456", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1341005", "t_dispatch_unix": 1779817961.2286239, "t_finish_unix": 1779817973.7048182, "t_first_token_unix": 1779817973.0614858, "tpot_s": 0.011903881908101202, "trace_hash_ids": [13311826, 13311827, 13311828, 13311829, 13311830, 13311831, 13311832, 13311833, 13311834, 13311835, 13319583, 13319584, 13319585, 13329855, 13329856, 13329857, 13329858, 13329859, 13329860], "trace_timestamp_s": 367.47600000000057, "ttft_s": 11.832860358990729, "turn_id": 2} +{"actual_output_tokens": 212, "cached_tokens": 95760, "effective_input_length": 95781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95781, "latency_s": 5.187020915967878, "output_length": 212, "proxy_request_id": "1279412:22:1344210:462", "request_id": "1279412:22:1344210:462", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1279412", "t_dispatch_unix": 1779817968.8680522, "t_finish_unix": 1779817974.0550725, "t_first_token_unix": 1779817969.079215, "tpot_s": 0.02358119637441658, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13341145], "trace_timestamp_s": 371.66499999999996, "ttft_s": 0.21115955797722563, "turn_id": 22} +{"actual_output_tokens": 121, "cached_tokens": 0, "effective_input_length": 59219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59219, "latency_s": 14.239555420004763, "output_length": 121, "proxy_request_id": "1342634:1:1342634:454", "request_id": "1342634:1:1342634:454", "request_type": "coder", "requested_output_tokens": 121, "session_id": "1342634", "t_dispatch_unix": 1779817960.0882344, "t_finish_unix": 1779817974.32779, "t_first_token_unix": 1779817973.0701556, "tpot_s": 0.010477534924575593, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 4565053, 4565054, 4565055, 127456, 127457, 127458, 127459, 4565056, 4565057, 61286, 4565058, 4565059, 4565060, 4565061, 4565062, 4565063, 4565064, 4565065, 4565066, 4565067, 4565068, 4565069, 4565070, 4565071, 4565072, 4565073, 4565074, 4565075, 4565076, 4565077, 4565078, 4565079, 4565080, 4565081, 4565082, 4565083, 4565084, 4565085, 4565086, 4565087, 4565088, 4565089, 13036298, 13036299, 13036300, 13036301, 13036302, 13036303, 13036304, 13036305, 13036306, 13036307, 13036308, 13036309, 13036310, 13036311, 13036312, 13036313, 13036314, 13036315, 13036316, 13036317, 13036318, 13036319, 13036320, 13036321, 13036322, 13036323, 13036324, 13036325, 13036326, 13036327, 13036328, 13036329, 13036330, 13036331, 13036332, 13036333, 13036334, 13036335, 13036336, 13036337, 13068093, 13326543, 13326544, 13326545, 13326546, 13326547, 13326548, 13326549, 13326550, 13326551, 13326552, 13326553, 13326554, 13326555, 13326556, 13326557, 13326558, 13326559, 13326560, 13326561, 13326562, 13326563, 13326564, 13326565, 13326566, 13326567, 13326568, 13326569, 13326570], "trace_timestamp_s": 366.3150000000005, "ttft_s": 12.981918711040635, "turn_id": 1} +{"actual_output_tokens": 159, "cached_tokens": 10000, "effective_input_length": 10232, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10232, "latency_s": 12.322908287984319, "output_length": 159, "proxy_request_id": "1341912:2:1343220:458", "request_id": "1341912:2:1343220:458", "request_type": "coder", "requested_output_tokens": 159, "session_id": "1341912", "t_dispatch_unix": 1779817962.210097, "t_finish_unix": 1779817974.5330052, "t_first_token_unix": 1779817973.062301, "tpot_s": 0.009306559746619314, "trace_hash_ids": [13307661, 13307662, 13307663, 13314126, 13314127, 13314128, 13314129, 13314130, 13314131, 13314132, 13314133, 13314134, 13314135, 13314136, 13314137, 13314138, 13319756, 13319757, 13319758, 13331957], "trace_timestamp_s": 368.45900000000074, "ttft_s": 10.852203138987534, "turn_id": 2} +{"actual_output_tokens": 263, "cached_tokens": 34656, "effective_input_length": 37019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37019, "latency_s": 2.4968338070320897, "output_length": 263, "proxy_request_id": "1268861:6:1346340:472", "request_id": "1268861:6:1346340:472", "request_type": "coder", "requested_output_tokens": 263, "session_id": "1268861", "t_dispatch_unix": 1779817972.802963, "t_finish_unix": 1779817975.2997968, "t_first_token_unix": 1779817973.4829113, "tpot_s": 0.006933606946654262, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13360572], "trace_timestamp_s": 379.0500000000002, "ttft_s": 0.6799456690205261, "turn_id": 6} +{"actual_output_tokens": 52, "cached_tokens": 560, "effective_input_length": 773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 773, "latency_s": 0.2881897899787873, "output_length": 52, "proxy_request_id": "1345921:2:1347089:474", "request_id": "1345921:2:1347089:474", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1345921", "t_dispatch_unix": 1779817975.451074, "t_finish_unix": 1779817975.7392635, "t_first_token_unix": 1779817975.4907207, "tpot_s": 0.004868763392818544, "trace_hash_ids": [13357030, 13367292], "trace_timestamp_s": 381.7000000000007, "ttft_s": 0.039646003977395594, "turn_id": 2} +{"actual_output_tokens": 45, "cached_tokens": 6224, "effective_input_length": 9820, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9820, "latency_s": 13.078471501008607, "output_length": 45, "proxy_request_id": "1342327:2:1343857:461", "request_id": "1342327:2:1343857:461", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1342327", "t_dispatch_unix": 1779817964.1617815, "t_finish_unix": 1779817977.2402532, "t_first_token_unix": 1779817976.524722, "tpot_s": 0.016252606660021807, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13338087], "trace_timestamp_s": 370.40900000000056, "ttft_s": 12.362939150014427, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 50224, "effective_input_length": 50447, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50447, "latency_s": 11.699488129990641, "output_length": 47, "proxy_request_id": "1316848:15:1344261:463", "request_id": "1316848:15:1344261:463", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779817965.5672917, "t_finish_unix": 1779817977.2667792, "t_first_token_unix": 1779817976.5304062, "tpot_s": 0.016003015521994752, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13341597, 13341598], "trace_timestamp_s": 371.8140000000003, "ttft_s": 10.963112657947931, "turn_id": 15} +{"actual_output_tokens": 50, "cached_tokens": 19920, "effective_input_length": 25661, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25661, "latency_s": 1.3434987070504576, "output_length": 50, "proxy_request_id": "1341948:2:1347296:475", "request_id": "1341948:2:1347296:475", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1341948", "t_dispatch_unix": 1779817976.1643336, "t_finish_unix": 1779817977.5078325, "t_first_token_unix": 1779817977.2244034, "tpot_s": 0.005777947060592777, "trace_hash_ids": [13296198, 13296199, 13296200, 13296201, 13296202, 13296203, 13296204, 13296205, 13296206, 13296207, 13296208, 13296209, 13296210, 13296211, 13296212, 13296213, 13296214, 13296215, 13296216, 13296217, 13296218, 13296219, 13296220, 13296221, 13296222, 13296223, 13296224, 13296225, 13296226, 13296227, 13296228, 13296229, 13296230, 13308586, 13308587, 13308588, 13308589, 13320340, 13328210, 13335592, 13335593, 13335594, 13351220, 13351221, 13351222, 13360455, 13360456, 13368789, 13368790, 13368791, 13368792], "trace_timestamp_s": 382.41100000000006, "ttft_s": 1.0600675000459887, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 5465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5465, "latency_s": 0.4839911659946665, "output_length": 26, "proxy_request_id": "1347763:1:1347763:476", "request_id": "1347763:1:1347763:476", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1347763", "t_dispatch_unix": 1779817977.775152, "t_finish_unix": 1779817978.2591426, "t_first_token_unix": 1779817978.1351244, "tpot_s": 0.004950680281035602, "trace_hash_ids": [13347549, 13347550, 13358055, 13358056, 13358057, 13358058, 13367259, 13373800, 13373801, 13373802, 13373803], "trace_timestamp_s": 384.02199999999993, "ttft_s": 0.3599717509932816, "turn_id": 1} +{"actual_output_tokens": 20, "cached_tokens": 50480, "effective_input_length": 58815, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58815, "latency_s": 3.610501151997596, "output_length": 20, "proxy_request_id": "1316848:16:1345678:468", "request_id": "1316848:16:1345678:468", "request_type": "coder", "requested_output_tokens": 20, "session_id": "1316848", "t_dispatch_unix": 1779817977.2720048, "t_finish_unix": 1779817980.882506, "t_first_token_unix": 1779817980.6705225, "tpot_s": 0.01114359957864508, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13341597, 13355058, 13355059, 13355060, 13355061, 13355062, 13355063, 13355064, 13355065, 13355066, 13355067, 13355068, 13355069, 13355070, 13355071, 13355072, 13355073, 13355074], "trace_timestamp_s": 376.6190000000006, "ttft_s": 3.398515237029642, "turn_id": 16} +{"actual_output_tokens": 28, "cached_tokens": 9856, "effective_input_length": 12398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12398, "latency_s": 3.6998436899739318, "output_length": 28, "proxy_request_id": "1342327:3:1344788:466", "request_id": "1342327:3:1344788:466", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1342327", "t_dispatch_unix": 1779817977.2418535, "t_finish_unix": 1779817980.9416974, "t_first_token_unix": 1779817977.6307025, "tpot_s": 0.12262047922100734, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13346828, 13346829, 13346830, 13346831, 13346832, 13346833], "trace_timestamp_s": 373.65100000000075, "ttft_s": 0.388847190013621, "turn_id": 3} +{"actual_output_tokens": 11, "cached_tokens": 12416, "effective_input_length": 14842, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14842, "latency_s": 0.4453069170122035, "output_length": 11, "proxy_request_id": "1342327:4:1346218:471", "request_id": "1342327:4:1346218:471", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1342327", "t_dispatch_unix": 1779817980.943282, "t_finish_unix": 1779817981.3885891, "t_first_token_unix": 1779817981.3015044, "tpot_s": 0.008683511201525107, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13346828, 13346829, 13346830, 13346831, 13346832, 13352845, 13352846, 13352847, 13352848, 13359282], "trace_timestamp_s": 378.6120000000001, "ttft_s": 0.3582208410371095, "turn_id": 4} +{"actual_output_tokens": 44, "cached_tokens": 36544, "effective_input_length": 39636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39636, "latency_s": 1.407151045044884, "output_length": 44, "proxy_request_id": "1311753:3:1348389:480", "request_id": "1311753:3:1348389:480", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1311753", "t_dispatch_unix": 1779817980.2517214, "t_finish_unix": 1779817981.6588724, "t_first_token_unix": 1779817981.188913, "tpot_s": 0.010921651255176945, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13276135, 13276136, 13276137, 13276138, 13276139, 13276140, 13276141, 13276142, 13276143, 13276144, 13276145, 13276146, 13276147, 13276148, 13276149, 13276150, 13276151, 13276152, 13276153, 13276154, 13276155, 13276156, 13276157, 13276158, 13276159, 13276160, 13276161, 13276162, 13276163, 13276164, 13276165, 13276166, 13379352, 13379353, 13379354, 13379355, 13379356, 13379357, 13379358], "trace_timestamp_s": 386.4990000000007, "ttft_s": 0.9371896140510216, "turn_id": 3} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 1397, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1397, "latency_s": 0.22535816696472466, "output_length": 25, "proxy_request_id": "1345921:3:1348784:483", "request_id": "1345921:3:1348784:483", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1345921", "t_dispatch_unix": 1779817981.4493318, "t_finish_unix": 1779817981.6746898, "t_first_token_unix": 1779817981.5583906, "tpot_s": 0.004834974167655067, "trace_hash_ids": [13357030, 13375155, 13383042], "trace_timestamp_s": 387.6980000000003, "ttft_s": 0.10905780596658587, "turn_id": 3} +{"actual_output_tokens": 1409, "cached_tokens": 0, "effective_input_length": 66152, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66152, "latency_s": 28.427645732997917, "output_length": 1409, "proxy_request_id": "1314357:3:1338999:437", "request_id": "1314357:3:1338999:437", "request_type": "coder", "requested_output_tokens": 1409, "session_id": "1314357", "t_dispatch_unix": 1779817953.3450875, "t_finish_unix": 1779817981.772733, "t_first_token_unix": 1779817968.6967611, "tpot_s": 0.009286713605103036, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13292862, 13292863], "trace_timestamp_s": 353.71500000000015, "ttft_s": 15.351670522009954, "turn_id": 3} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 17217, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17217, "latency_s": 2.0486129979835823, "output_length": 67, "proxy_request_id": "1348394:1:1348394:481", "request_id": "1348394:1:1348394:481", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1348394", "t_dispatch_unix": 1779817980.2837296, "t_finish_unix": 1779817982.3323426, "t_first_token_unix": 1779817981.9611418, "tpot_s": 0.0056204961817429375, "trace_hash_ids": [13379385, 13379386, 13379387, 13379388, 13379389, 13379390, 13379391, 13379392, 13379393, 13379394, 13379395, 13379396, 13379397, 13379398, 13379399, 13379400, 13379401, 13379402, 13379403, 13379404, 13379405, 13379406, 13379407, 13379408, 13379409, 13379410, 13379411, 13379412, 13379413, 13379414, 13379415, 13379416, 13379417, 13379418], "trace_timestamp_s": 386.52600000000075, "ttft_s": 1.677409951982554, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 0, "effective_input_length": 12701, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12701, "latency_s": 1.4154357939842157, "output_length": 66, "proxy_request_id": "1348691:1:1348691:482", "request_id": "1348691:1:1348691:482", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1348691", "t_dispatch_unix": 1779817981.1467874, "t_finish_unix": 1779817982.5622234, "t_first_token_unix": 1779817982.2110288, "tpot_s": 0.005399229476908938, "trace_hash_ids": [13351879, 13351880, 13351881, 13351882, 13351883, 13351884, 13351885, 13351886, 13351887, 13373772, 13373773, 13373774, 13373775, 13373776, 13373777, 13373778, 13373779, 13373780, 13373781, 13382121, 13382122, 13382123, 13382124, 13382125, 13382126], "trace_timestamp_s": 387.39100000000053, "ttft_s": 1.0642397140036337, "turn_id": 1} +{"actual_output_tokens": 397, "cached_tokens": 0, "effective_input_length": 65289, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65289, "latency_s": 22.879798348993063, "output_length": 397, "proxy_request_id": "1342921:1:1342921:455", "request_id": "1342921:1:1342921:455", "request_type": "coder", "requested_output_tokens": 397, "session_id": "1342921", "t_dispatch_unix": 1779817961.1308532, "t_finish_unix": 1779817984.0106516, "t_first_token_unix": 1779817976.1468976, "tpot_s": 0.019857295838359865, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13329706], "trace_timestamp_s": 367.3550000000005, "ttft_s": 15.016042094037402, "turn_id": 1} +{"actual_output_tokens": 216, "cached_tokens": 33024, "effective_input_length": 33334, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33334, "latency_s": 1.6316766060190275, "output_length": 216, "proxy_request_id": "1344773:3:1349525:486", "request_id": "1344773:3:1349525:486", "request_type": "coder", "requested_output_tokens": 216, "session_id": "1344773", "t_dispatch_unix": 1779817984.0794988, "t_finish_unix": 1779817985.7111752, "t_first_token_unix": 1779817984.2851648, "tpot_s": 0.006631485125602244, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13389569], "trace_timestamp_s": 390.3270000000002, "ttft_s": 0.20566447998862714, "turn_id": 3} +{"actual_output_tokens": 63, "cached_tokens": 0, "effective_input_length": 4988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4988, "latency_s": 0.640623515995685, "output_length": 63, "proxy_request_id": "1349975:1:1349975:487", "request_id": "1349975:1:1349975:487", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1349975", "t_dispatch_unix": 1779817985.6716526, "t_finish_unix": 1779817986.3122761, "t_first_token_unix": 1779817985.994517, "tpot_s": 0.005121352500282228, "trace_hash_ids": [13378687, 13378688, 13378689, 13394474, 13394475, 13394476, 13394477, 13394478, 13394479, 13394480], "trace_timestamp_s": 391.9190000000008, "ttft_s": 0.32286309701157734, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 4594, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4594, "latency_s": 0.4085961559903808, "output_length": 24, "proxy_request_id": "1350162:1:1350162:488", "request_id": "1350162:1:1350162:488", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1350162", "t_dispatch_unix": 1779817986.3579655, "t_finish_unix": 1779817986.7665617, "t_first_token_unix": 1779817986.6522303, "tpot_s": 0.004957911477464697, "trace_hash_ids": [13396122, 13396123, 13396124, 13396125, 13396126, 13396127, 13396128, 13396129, 13396130], "trace_timestamp_s": 392.6050000000005, "ttft_s": 0.2942631670157425, "turn_id": 1} +{"actual_output_tokens": 74, "cached_tokens": 0, "effective_input_length": 1471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1471, "latency_s": 0.4694712059572339, "output_length": 74, "proxy_request_id": "1350896:1:1350896:489", "request_id": "1350896:1:1350896:489", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1350896", "t_dispatch_unix": 1779817988.8045886, "t_finish_unix": 1779817989.2740598, "t_first_token_unix": 1779817988.9113605, "tpot_s": 0.004964975656922397, "trace_hash_ids": [13402641, 13402642, 13402643], "trace_timestamp_s": 395.0530000000008, "ttft_s": 0.10677089600358158, "turn_id": 1} +{"actual_output_tokens": 381, "cached_tokens": 74304, "effective_input_length": 76493, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76493, "latency_s": 5.678835411032196, "output_length": 381, "proxy_request_id": "1269373:19:1349406:485", "request_id": "1269373:19:1349406:485", "request_type": "coder", "requested_output_tokens": 381, "session_id": "1269373", "t_dispatch_unix": 1779817983.72597, "t_finish_unix": 1779817989.4048052, "t_first_token_unix": 1779817984.995728, "tpot_s": 0.01160203207906115, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13388487], "trace_timestamp_s": 389.97200000000066, "ttft_s": 1.26975581998704, "turn_id": 19} +{"actual_output_tokens": 10, "cached_tokens": 0, "effective_input_length": 15313, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15313, "latency_s": 1.4204508700058796, "output_length": 10, "proxy_request_id": "1350980:1:1350980:490", "request_id": "1350980:1:1350980:490", "request_type": "coder", "requested_output_tokens": 10, "session_id": "1350980", "t_dispatch_unix": 1779817989.0500643, "t_finish_unix": 1779817990.4705153, "t_first_token_unix": 1779817990.433798, "tpot_s": 0.004053198221501791, "trace_hash_ids": [13395393, 13395394, 13395395, 13395396, 13395397, 13395398, 13395399, 13395400, 13395401, 13395402, 13395403, 13395404, 13395405, 13395406, 13395407, 13395408, 13395409, 13395410, 13395411, 13395412, 13395413, 13395414, 13395415, 13395416, 13395417, 13395418, 13395419, 13395420, 13403335, 13403336], "trace_timestamp_s": 395.2940000000008, "ttft_s": 1.383731895009987, "turn_id": 1} +{"actual_output_tokens": 1107, "cached_tokens": 37792, "effective_input_length": 41202, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41202, "latency_s": 11.825159370026086, "output_length": 1107, "proxy_request_id": "1334223:3:1348241:479", "request_id": "1334223:3:1348241:479", "request_type": "coder", "requested_output_tokens": 1107, "session_id": "1334223", "t_dispatch_unix": 1779817979.6835284, "t_finish_unix": 1779817991.5086882, "t_first_token_unix": 1779817980.6745186, "tpot_s": 0.009795477416816422, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13377885, 13377886, 13377887, 13377888, 13377889, 13377890, 13377891, 13377892, 13377893, 13377894, 13377895, 13377896, 13377897, 13377898, 13377899, 13377900, 13377901, 13377902, 13377903, 13377904, 13377905, 13377906, 13377907, 13377908, 13377909, 13377910, 13377911, 13377912, 13377913, 13377914, 13377915, 13377916, 13377917, 13377918, 13377919, 13377920, 13377921, 13377922, 13377923], "trace_timestamp_s": 385.924, "ttft_s": 0.9909882890060544, "turn_id": 3} +{"actual_output_tokens": 60, "cached_tokens": 50608, "effective_input_length": 51340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51340, "latency_s": 0.8149753200123087, "output_length": 60, "proxy_request_id": "1253743:5:1351907:492", "request_id": "1253743:5:1351907:492", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1253743", "t_dispatch_unix": 1779817992.58113, "t_finish_unix": 1779817993.3961053, "t_first_token_unix": 1779817992.979475, "tpot_s": 0.007056589187043956, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 971291], "trace_timestamp_s": 398.82800000000043, "ttft_s": 0.3983425300102681, "turn_id": 5} +{"actual_output_tokens": 29, "cached_tokens": 33536, "effective_input_length": 33579, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33579, "latency_s": 0.9345225739525631, "output_length": 29, "proxy_request_id": "1344773:4:1352462:494", "request_id": "1344773:4:1352462:494", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1344773", "t_dispatch_unix": 1779817994.3791637, "t_finish_unix": 1779817995.3136864, "t_first_token_unix": 1779817995.100046, "tpot_s": 0.0076190960701621535, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13417820], "trace_timestamp_s": 400.6270000000004, "ttft_s": 0.7208795479964465, "turn_id": 4} +{"actual_output_tokens": 40, "cached_tokens": 12752, "effective_input_length": 21436, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21436, "latency_s": 1.6044228609534912, "output_length": 40, "proxy_request_id": "1348691:2:1352277:493", "request_id": "1348691:2:1352277:493", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1348691", "t_dispatch_unix": 1779817993.7696593, "t_finish_unix": 1779817995.3740823, "t_first_token_unix": 1779817995.0694048, "tpot_s": 0.007805707103286225, "trace_hash_ids": [13351879, 13351880, 13351881, 13351882, 13351883, 13351884, 13351885, 13351886, 13351887, 13373772, 13373773, 13373774, 13373775, 13373776, 13373777, 13373778, 13373779, 13373780, 13373781, 13382121, 13382122, 13382123, 13382124, 13382125, 13389881, 13389882, 13389883, 13389884, 13389885, 13389886, 13389887, 13389888, 13402829, 13402830, 13402831, 13402832, 13402833, 13415762, 13415763, 13415764, 13415765, 13415766], "trace_timestamp_s": 400.0150000000003, "ttft_s": 1.2997409089584835, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 4608, "effective_input_length": 10575, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10575, "latency_s": 1.143838346004486, "output_length": 25, "proxy_request_id": "1350162:2:1352468:495", "request_id": "1350162:2:1352468:495", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1350162", "t_dispatch_unix": 1779817994.395618, "t_finish_unix": 1779817995.5394564, "t_first_token_unix": 1779817994.9513884, "tpot_s": 0.024465943250106648, "trace_hash_ids": [13396122, 13396123, 13396124, 13396125, 13396126, 13396127, 13396128, 13396129, 13396130, 13407504, 13407505, 13407506, 13407507, 13407508, 13411995, 13411996, 13417843, 13417844, 13417845, 13417846, 13417847], "trace_timestamp_s": 400.64200000000073, "ttft_s": 0.5557688699918799, "turn_id": 2} +{"actual_output_tokens": 2, "cached_tokens": 1408, "effective_input_length": 6935, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6935, "latency_s": 0.4174047429696657, "output_length": 2, "proxy_request_id": "1345921:4:1353010:501", "request_id": "1345921:4:1353010:501", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1345921", "t_dispatch_unix": 1779817996.3757355, "t_finish_unix": 1779817996.7931402, "t_first_token_unix": 1779817996.7916617, "tpot_s": 0.001169236027635634, "trace_hash_ids": [13421944, 13421945, 13421946, 13421947, 13421948, 13421949, 13421950, 13421951, 13421952, 13421953, 13421954, 13421955, 13421956, 13421957], "trace_timestamp_s": 402.6220000000003, "ttft_s": 0.4159247069619596, "turn_id": 4} +{"actual_output_tokens": 77, "cached_tokens": 0, "effective_input_length": 18840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18840, "latency_s": 2.325468155031558, "output_length": 77, "proxy_request_id": "1352606:1:1352606:496", "request_id": "1352606:1:1352606:496", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1352606", "t_dispatch_unix": 1779817994.961786, "t_finish_unix": 1779817997.287255, "t_first_token_unix": 1779817996.8501973, "tpot_s": 0.0057470114077563935, "trace_hash_ids": [13400902, 13400903, 13400904, 13400905, 13400906, 13400907, 13400908, 13400909, 13400910, 13400911, 13409153, 13409154, 13409155, 13409156, 13409157, 13409158, 13409159, 13409160, 13409161, 13418934, 13418935, 13418936, 13418937, 13418938, 13418939, 13418940, 13418941, 13418942, 13418943, 13418944, 13418945, 13418946, 13418947, 13418948, 13418949, 13418950, 13418951], "trace_timestamp_s": 401.20400000000063, "ttft_s": 1.8884091090294532, "turn_id": 1} +{"actual_output_tokens": 115, "cached_tokens": 83152, "effective_input_length": 83326, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83326, "latency_s": 1.3243944449932314, "output_length": 115, "proxy_request_id": "1317598:6:1352957:499", "request_id": "1317598:6:1352957:499", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1317598", "t_dispatch_unix": 1779817996.2246068, "t_finish_unix": 1779817997.549002, "t_first_token_unix": 1779817996.5316796, "tpot_s": 0.008920327745471966, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753, 13281236, 13421614], "trace_timestamp_s": 402.47100000000046, "ttft_s": 0.3070705040008761, "turn_id": 6} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 14239, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14239, "latency_s": 1.4293478099862114, "output_length": 36, "proxy_request_id": "1349975:2:1352986:500", "request_id": "1349975:2:1352986:500", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1349975", "t_dispatch_unix": 1779817996.3348572, "t_finish_unix": 1779817997.7642052, "t_first_token_unix": 1779817997.578436, "tpot_s": 0.005300515599083155, "trace_hash_ids": [13378687, 13378688, 13378689, 13394474, 13394475, 13394476, 13394477, 13394478, 13394479, 13402114, 13402115, 13402116, 13402117, 13402118, 13408855, 13408856, 13408857, 13408858, 13408859, 13408860, 13415611, 13415612, 13415613, 13415614, 13415615, 13421803, 13421804, 13421805], "trace_timestamp_s": 402.5799999999999, "ttft_s": 1.2435765190166421, "turn_id": 2} +{"actual_output_tokens": 233, "cached_tokens": 76864, "effective_input_length": 77790, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77790, "latency_s": 2.6460210380028, "output_length": 233, "proxy_request_id": "1269373:20:1352797:498", "request_id": "1269373:20:1352797:498", "request_type": "coder", "requested_output_tokens": 233, "session_id": "1269373", "t_dispatch_unix": 1779817995.6281376, "t_finish_unix": 1779817998.274158, "t_first_token_unix": 1779817996.207182, "tpot_s": 0.008908156749886733, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385], "trace_timestamp_s": 401.8740000000007, "ttft_s": 0.5790426810272038, "turn_id": 20} +{"actual_output_tokens": 270, "cached_tokens": 33600, "effective_input_length": 33875, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33875, "latency_s": 1.967921240022406, "output_length": 270, "proxy_request_id": "1344773:5:1353365:502", "request_id": "1344773:5:1353365:502", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1344773", "t_dispatch_unix": 1779817997.8377037, "t_finish_unix": 1779817999.8056254, "t_first_token_unix": 1779817997.9854786, "tpot_s": 0.006765178156121665, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13425453], "trace_timestamp_s": 404.08600000000024, "ttft_s": 0.14777285902528092, "turn_id": 5} +{"actual_output_tokens": 59, "cached_tokens": 51392, "effective_input_length": 51436, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51436, "latency_s": 0.5305973120266572, "output_length": 59, "proxy_request_id": "1253743:6:1354346:505", "request_id": "1253743:6:1354346:505", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1253743", "t_dispatch_unix": 1779818001.0831838, "t_finish_unix": 1779818001.6137812, "t_first_token_unix": 1779818001.1985273, "tpot_s": 0.0071544348792140855, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 13433516], "trace_timestamp_s": 407.3299999999999, "ttft_s": 0.11534148204373196, "turn_id": 6} +{"actual_output_tokens": 127, "cached_tokens": 0, "effective_input_length": 27651, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27651, "latency_s": 4.242766573035624, "output_length": 127, "proxy_request_id": "1353821:1:1353821:503", "request_id": "1353821:1:1353821:503", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1353821", "t_dispatch_unix": 1779817999.2554655, "t_finish_unix": 1779818003.4982324, "t_first_token_unix": 1779818002.7066762, "tpot_s": 0.00627989048417288, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13429918], "trace_timestamp_s": 405.4940000000006, "ttft_s": 3.4512080189888366, "turn_id": 1} +{"actual_output_tokens": 14236, "cached_tokens": 52016, "effective_input_length": 62618, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62618, "latency_s": 129.2969909789972, "output_length": 14236, "proxy_request_id": "1253804:6:1318560:340", "request_id": "1253804:6:1318560:340", "request_type": "coder", "requested_output_tokens": 14236, "session_id": "1253804", "t_dispatch_unix": 1779817874.8739882, "t_finish_unix": 1779818004.1709788, "t_first_token_unix": 1779817878.8956666, "tpot_s": 0.008800493565997783, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 13100557], "trace_timestamp_s": 281.1200000000008, "ttft_s": 4.02167633298086, "turn_id": 6} +{"actual_output_tokens": 278, "cached_tokens": 1536, "effective_input_length": 15519, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15519, "latency_s": 2.9128894780296832, "output_length": 278, "proxy_request_id": "1286804:3:1354910:506", "request_id": "1286804:3:1354910:506", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1286804", "t_dispatch_unix": 1779818003.0599344, "t_finish_unix": 1779818005.9728236, "t_first_token_unix": 1779818004.3987508, "tpot_s": 0.005680678371761989, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13438558], "trace_timestamp_s": 409.308, "ttft_s": 1.3388146070064977, "turn_id": 3} +{"actual_output_tokens": 11, "cached_tokens": 0, "effective_input_length": 24503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24503, "latency_s": 2.874591328029055, "output_length": 11, "proxy_request_id": "1355325:1:1355325:507", "request_id": "1355325:1:1355325:507", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1355325", "t_dispatch_unix": 1779818004.5316446, "t_finish_unix": 1779818007.406235, "t_first_token_unix": 1779818007.364995, "tpot_s": 0.004098699596943334, "trace_hash_ids": [2091, 2092, 2093, 41146, 41147, 41148, 41149, 41150, 41151, 41152, 41153, 41154, 41155, 41156, 41157, 41158, 41159, 41160, 41161, 41162, 41163, 41164, 252986, 252987, 252988, 252989, 6349953, 6349954, 6349955, 6349956, 6349957, 6349958, 6349959, 5104499, 10973669, 10973670, 13442398, 496454, 496455, 1203620, 1203621, 13442399, 459358, 459359, 1000032, 57326, 13442400, 13442401], "trace_timestamp_s": 410.77000000000044, "ttft_s": 2.833349814056419, "turn_id": 1} +{"actual_output_tokens": 102, "cached_tokens": 0, "effective_input_length": 19366, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19366, "latency_s": 2.562377092021052, "output_length": 102, "proxy_request_id": "1355484:1:1355484:508", "request_id": "1355484:1:1355484:508", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1355484", "t_dispatch_unix": 1779818004.9631479, "t_finish_unix": 1779818007.5255244, "t_first_token_unix": 1779818006.9374907, "tpot_s": 0.005819884802002718, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13443776], "trace_timestamp_s": 411.21000000000004, "ttft_s": 1.9743412010138854, "turn_id": 1} +{"actual_output_tokens": 408, "cached_tokens": 78016, "effective_input_length": 78089, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78089, "latency_s": 3.9002273760270327, "output_length": 408, "proxy_request_id": "1269373:21:1355702:509", "request_id": "1269373:21:1355702:509", "request_type": "coder", "requested_output_tokens": 408, "session_id": "1269373", "t_dispatch_unix": 1779818005.6396308, "t_finish_unix": 1779818009.539858, "t_first_token_unix": 1779818005.8458645, "tpot_s": 0.009075291061354001, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385, 13446158], "trace_timestamp_s": 411.8860000000004, "ttft_s": 0.20623093604808673, "turn_id": 21} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 6711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6711, "latency_s": 0.724082675005775, "output_length": 54, "proxy_request_id": "1356948:1:1356948:515", "request_id": "1356948:1:1356948:515", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1356948", "t_dispatch_unix": 1779818010.2498379, "t_finish_unix": 1779818010.9739206, "t_first_token_unix": 1779818010.7058873, "tpot_s": 0.005052766679206265, "trace_hash_ids": [13432238, 13432239, 13432240, 13432241, 13442185, 13452093, 13452094, 13452095, 13452096, 13452097, 13457944, 13457945, 13457946, 13457947], "trace_timestamp_s": 416.4960000000001, "ttft_s": 0.4560481730150059, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 34144, "effective_input_length": 34198, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34198, "latency_s": 4.782336665026378, "output_length": 27, "proxy_request_id": "1344773:6:1356097:513", "request_id": "1344773:6:1356097:513", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1344773", "t_dispatch_unix": 1779818007.216308, "t_finish_unix": 1779818011.9986448, "t_first_token_unix": 1779818011.8068056, "tpot_s": 0.007368127499760773, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13450022], "trace_timestamp_s": 413.46500000000015, "ttft_s": 4.590494778007269, "turn_id": 6} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 35308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35308, "latency_s": 5.681976986001246, "output_length": 61, "proxy_request_id": "1355951:1:1355951:511", "request_id": "1355951:1:1355951:511", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1355951", "t_dispatch_unix": 1779818006.5548565, "t_finish_unix": 1779818012.2368329, "t_first_token_unix": 1779818011.8037047, "tpot_s": 0.007214270816378606, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626], "trace_timestamp_s": 412.78999999999996, "ttft_s": 5.248846971022431, "turn_id": 1} +{"actual_output_tokens": 119, "cached_tokens": 27776, "effective_input_length": 27805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27805, "latency_s": 0.8167324379901402, "output_length": 119, "proxy_request_id": "1353821:2:1357420:517", "request_id": "1353821:2:1357420:517", "request_type": "coder", "requested_output_tokens": 119, "session_id": "1353821", "t_dispatch_unix": 1779818011.6398442, "t_finish_unix": 1779818012.456576, "t_first_token_unix": 1779818011.715602, "tpot_s": 0.006277384821984569, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13462486], "trace_timestamp_s": 417.8879999999999, "ttft_s": 0.0757556110038422, "turn_id": 2} +{"actual_output_tokens": 109, "cached_tokens": 0, "effective_input_length": 13520, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13520, "latency_s": 1.7710858960053883, "output_length": 109, "proxy_request_id": "1357132:1:1357132:516", "request_id": "1357132:1:1357132:516", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1357132", "t_dispatch_unix": 1779818010.790297, "t_finish_unix": 1779818012.561383, "t_first_token_unix": 1779818011.9570909, "tpot_s": 0.005593145462895605, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13459305], "trace_timestamp_s": 417.03400000000056, "ttft_s": 1.1667926030349918, "turn_id": 1} +{"actual_output_tokens": 61, "cached_tokens": 34224, "effective_input_length": 34351, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34351, "latency_s": 0.5091314270393923, "output_length": 61, "proxy_request_id": "1344773:7:1357714:518", "request_id": "1344773:7:1357714:518", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1344773", "t_dispatch_unix": 1779818012.720731, "t_finish_unix": 1779818013.229863, "t_first_token_unix": 1779818012.854208, "tpot_s": 0.006255887449757817, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13465009], "trace_timestamp_s": 418.96900000000005, "ttft_s": 0.1334749810048379, "turn_id": 7} +{"actual_output_tokens": 972, "cached_tokens": 45552, "effective_input_length": 48193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48193, "latency_s": 8.333214215002954, "output_length": 972, "proxy_request_id": "1294611:11:1355750:510", "request_id": "1294611:11:1355750:510", "request_type": "coder", "requested_output_tokens": 972, "session_id": "1294611", "t_dispatch_unix": 1779818005.7406774, "t_finish_unix": 1779818014.0738919, "t_first_token_unix": 1779818006.6868896, "tpot_s": 0.007607334640572935, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 13446612], "trace_timestamp_s": 411.9870000000001, "ttft_s": 0.9462102290126495, "turn_id": 11} +{"actual_output_tokens": 92, "cached_tokens": 48448, "effective_input_length": 48977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48977, "latency_s": 17.51714663801249, "output_length": 92, "proxy_request_id": "1340278:2:1356079:512", "request_id": "1340278:2:1356079:512", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1340278", "t_dispatch_unix": 1779818007.1525862, "t_finish_unix": 1779818024.6697328, "t_first_token_unix": 1779818023.626586, "tpot_s": 0.01145967321948834, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13449829, 13449830, 13449831, 13449832, 13449833, 13449834, 13449835, 13449836, 13449837, 13449838, 13449839, 13449840, 13449841, 13449842, 13449843, 13449844, 13449845, 13449846, 13449847, 13449848, 13449849, 13449850, 13449851, 13449852, 13449853, 13449854, 13449855, 13449856, 13449857, 13449858, 13449859, 13449860, 13449861, 13449862, 13449863, 13449864, 13449865, 13449866, 13449867, 13449868, 13449869, 13449870, 13449871, 13449872, 13449873, 13449874, 13449875, 13449876, 13449877, 13449878, 13449879, 13449880, 13449881, 13449882, 13449883, 13449884, 13449885, 13449886, 13449887, 13449888, 13449889, 13449890, 13449891, 13449892, 13449893, 13449894, 13449895, 13449896, 13449897, 13449898, 13449899, 13449900, 13449901, 13449902], "trace_timestamp_s": 413.3860000000004, "ttft_s": 16.473997461027466, "turn_id": 2} +{"actual_output_tokens": 64, "cached_tokens": 27920, "effective_input_length": 27933, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27933, "latency_s": 0.8265661529731005, "output_length": 64, "proxy_request_id": "1353821:3:1360898:529", "request_id": "1353821:3:1360898:529", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1353821", "t_dispatch_unix": 1779818024.055313, "t_finish_unix": 1779818024.8818793, "t_first_token_unix": 1779818024.139775, "tpot_s": 0.011773543618989014, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13496092], "trace_timestamp_s": 430.3040000000001, "ttft_s": 0.08445989299798384, "turn_id": 3} +{"actual_output_tokens": 150, "cached_tokens": 0, "effective_input_length": 83526, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83526, "latency_s": 25.49270201998297, "output_length": 150, "proxy_request_id": "1353951:1:1353951:504", "request_id": "1353951:1:1353951:504", "request_type": "coder", "requested_output_tokens": 150, "session_id": "1353951", "t_dispatch_unix": 1779817999.7359746, "t_finish_unix": 1779818025.2286763, "t_first_token_unix": 1779818023.6222842, "tpot_s": 0.010778920160881524, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 63992, 63993, 63994, 63995, 63996, 63997, 63998, 63999, 64000, 64001, 64002, 64003, 64004, 64005, 64006, 64007, 64008, 64009, 8107570, 8107571, 2409606, 2409607, 8107572, 8107573, 2891280, 8107574, 8107575, 8107576, 8107577, 8107578, 8107579, 8107580, 8107581, 8107582, 9028327, 9028328, 9028329, 10714983, 10714984, 10714985, 10714986, 10714987, 10714988, 10714989, 10714990, 10714991, 10714992, 10714993, 10714994, 10714995, 10714996, 10714997, 10714998, 10714999, 10715000, 10715001, 10715002, 10715003, 10715004, 10715005, 10715006, 10715007, 10715008, 10715009, 10715010, 10715011, 10715012, 10715013, 10715014, 10715015, 10715016, 10715017, 10715018, 10715019, 10715020, 10715021, 10715022, 10715023, 10715024, 10715025, 10715026, 10715027, 10715028, 10715029, 10715030, 10715031, 10715032, 10715033, 10715034, 10715035, 10715036, 10715037, 10715038, 10715039, 10715040, 10715041, 10715042, 10715043, 10715044, 10715045, 10715046, 10715047, 10715048, 10715049, 10715050, 10715051, 10715052, 10715053, 10715054, 10715055, 10715056, 10715057, 10715058, 10715059, 10715060, 10715061, 10715062, 10759522, 10759523, 10759524, 10759525, 10759526, 10759527, 10759528, 10759529, 10759530, 10778264, 10805988, 10825765, 10910663, 10910664, 10910665, 11006287, 11006288, 11333088, 11333089, 11432622, 11432623, 11610384, 11610385, 13198983, 13198984, 13198985, 13198986, 13409591, 13409592, 13409593, 13409594, 13430835, 13430836, 13430837, 13430838, 13430839, 13430840, 13430841, 13430842], "trace_timestamp_s": 405.9470000000001, "ttft_s": 23.88630752201425, "turn_id": 1} +{"actual_output_tokens": 22, "cached_tokens": 83664, "effective_input_length": 83905, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83905, "latency_s": 0.4345446699880995, "output_length": 22, "proxy_request_id": "1353951:2:1358300:520", "request_id": "1353951:2:1358300:520", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1353951", "t_dispatch_unix": 1779818025.2338197, "t_finish_unix": 1779818025.668364, "t_first_token_unix": 1779818025.5440435, "tpot_s": 0.005908127236623494, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 63992, 63993, 63994, 63995, 63996, 63997, 63998, 63999, 64000, 64001, 64002, 64003, 64004, 64005, 64006, 64007, 64008, 64009, 8107570, 8107571, 2409606, 2409607, 8107572, 8107573, 2891280, 8107574, 8107575, 8107576, 8107577, 8107578, 8107579, 8107580, 8107581, 8107582, 9028327, 9028328, 9028329, 10714983, 10714984, 10714985, 10714986, 10714987, 10714988, 10714989, 10714990, 10714991, 10714992, 10714993, 10714994, 10714995, 10714996, 10714997, 10714998, 10714999, 10715000, 10715001, 10715002, 10715003, 10715004, 10715005, 10715006, 10715007, 10715008, 10715009, 10715010, 10715011, 10715012, 10715013, 10715014, 10715015, 10715016, 10715017, 10715018, 10715019, 10715020, 10715021, 10715022, 10715023, 10715024, 10715025, 10715026, 10715027, 10715028, 10715029, 10715030, 10715031, 10715032, 10715033, 10715034, 10715035, 10715036, 10715037, 10715038, 10715039, 10715040, 10715041, 10715042, 10715043, 10715044, 10715045, 10715046, 10715047, 10715048, 10715049, 10715050, 10715051, 10715052, 10715053, 10715054, 10715055, 10715056, 10715057, 10715058, 10715059, 10715060, 10715061, 10715062, 10759522, 10759523, 10759524, 10759525, 10759526, 10759527, 10759528, 10759529, 10759530, 10778264, 10805988, 10825765, 10910663, 10910664, 10910665, 11006287, 11006288, 11333088, 11333089, 11432622, 11432623, 11610384, 11610385, 13198983, 13198984, 13198985, 13198986, 13409591, 13409592, 13409593, 13409594, 13430835, 13471008, 13471009, 13471010, 13471011, 13471012, 13471013, 13471014], "trace_timestamp_s": 420.991, "ttft_s": 0.31022190902149305, "turn_id": 2} +{"actual_output_tokens": 41, "cached_tokens": 34400, "effective_input_length": 34552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34552, "latency_s": 9.570091530971695, "output_length": 41, "proxy_request_id": "1344773:8:1358989:523", "request_id": "1344773:8:1358989:523", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1344773", "t_dispatch_unix": 1779818017.2468288, "t_finish_unix": 1779818026.8169196, "t_first_token_unix": 1779818026.4542851, "tpot_s": 0.009049455799686256, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13477517], "trace_timestamp_s": 423.4950000000008, "ttft_s": 9.20745446701767, "turn_id": 8} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 16480, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16480, "latency_s": 1.7180903389817104, "output_length": 31, "proxy_request_id": "1356948:2:1361262:532", "request_id": "1356948:2:1361262:532", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1356948", "t_dispatch_unix": 1779818025.5352182, "t_finish_unix": 1779818027.253308, "t_first_token_unix": 1779818027.105662, "tpot_s": 0.004913688266727453, "trace_hash_ids": [13499396, 13499397, 13499398, 13499399, 13499400, 13499401, 13499402, 13499403, 13499404, 13499405, 13499406, 13499407, 13499408, 13499409, 13499410, 13499411, 13499412, 13499413, 13499414, 13499415, 13499416, 13499417, 13499418, 13499419, 13499420, 13499421, 13499422, 13499423, 13499424, 13499425, 13499426, 13499427, 13499428], "trace_timestamp_s": 431.77800000000025, "ttft_s": 1.5704428569879383, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 34592, "effective_input_length": 34611, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34611, "latency_s": 0.6994738359935582, "output_length": 61, "proxy_request_id": "1344773:9:1360064:526", "request_id": "1344773:9:1360064:526", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1344773", "t_dispatch_unix": 1779818026.818332, "t_finish_unix": 1779818027.5178056, "t_first_token_unix": 1779818026.9076536, "tpot_s": 0.010163910416304133, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13488056], "trace_timestamp_s": 427.4940000000006, "ttft_s": 0.08931993501028046, "turn_id": 9} +{"actual_output_tokens": 1948, "cached_tokens": 95984, "effective_input_length": 96026, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96026, "latency_s": 49.11737344705034, "output_length": 1948, "proxy_request_id": "1279412:23:1348089:477", "request_id": "1279412:23:1348089:477", "request_type": "coder", "requested_output_tokens": 1948, "session_id": "1279412", "t_dispatch_unix": 1779817979.0614002, "t_finish_unix": 1779818028.178773, "t_first_token_unix": 1779817979.2802982, "tpot_s": 0.025114409447349627, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13376365], "trace_timestamp_s": 385.3070000000007, "ttft_s": 0.21889591205399483, "turn_id": 23} +{"actual_output_tokens": 28, "cached_tokens": 0, "effective_input_length": 8113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8113, "latency_s": 0.7088498969678767, "output_length": 28, "proxy_request_id": "1361992:1:1361992:535", "request_id": "1361992:1:1361992:535", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1361992", "t_dispatch_unix": 1779818028.112383, "t_finish_unix": 1779818028.8212326, "t_first_token_unix": 1779818028.6888165, "tpot_s": 0.004895793815160653, "trace_hash_ids": [13476591, 13499228, 13499229, 13499230, 13499231, 13499232, 13499233, 13499234, 13499235, 13499236, 13506610, 13506611, 13506612, 13506613, 13506614, 13506615], "trace_timestamp_s": 434.3590000000004, "ttft_s": 0.5764321869937703, "turn_id": 1} +{"actual_output_tokens": 78, "cached_tokens": 0, "effective_input_length": 33478, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33478, "latency_s": 6.223868345026858, "output_length": 78, "proxy_request_id": "1270340:3:1360716:528", "request_id": "1270340:3:1360716:528", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1270340", "t_dispatch_unix": 1779818023.393057, "t_finish_unix": 1779818029.6169252, "t_first_token_unix": 1779818028.1777244, "tpot_s": 0.018684576999535178, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13494265], "trace_timestamp_s": 429.6390000000001, "ttft_s": 4.7846608880208805, "turn_id": 3} +{"actual_output_tokens": 197, "cached_tokens": 0, "effective_input_length": 8825, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8825, "latency_s": 1.7292525509838015, "output_length": 197, "proxy_request_id": "1362265:1:1362265:536", "request_id": "1362265:1:1362265:536", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1362265", "t_dispatch_unix": 1779818028.959165, "t_finish_unix": 1779818030.6884181, "t_first_token_unix": 1779818029.6380181, "tpot_s": 0.0053579299030611675, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13509133], "trace_timestamp_s": 435.2049999999999, "ttft_s": 0.6788515170337632, "turn_id": 1} +{"actual_output_tokens": 356, "cached_tokens": 34656, "effective_input_length": 34679, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34679, "latency_s": 3.861313901958056, "output_length": 356, "proxy_request_id": "1344773:10:1361326:533", "request_id": "1344773:10:1361326:533", "request_type": "coder", "requested_output_tokens": 356, "session_id": "1344773", "t_dispatch_unix": 1779818027.519304, "t_finish_unix": 1779818031.3806174, "t_first_token_unix": 1779818027.6011655, "tpot_s": 0.01064528742523103, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13500244], "trace_timestamp_s": 432.02500000000055, "ttft_s": 0.08185886999126524, "turn_id": 10} +{"actual_output_tokens": 29, "cached_tokens": 8128, "effective_input_length": 10347, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10347, "latency_s": 0.4124523280188441, "output_length": 29, "proxy_request_id": "1361992:2:1362904:537", "request_id": "1361992:2:1362904:537", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1361992", "t_dispatch_unix": 1779818031.2055829, "t_finish_unix": 1779818031.6180356, "t_first_token_unix": 1779818031.477133, "tpot_s": 0.005021013465011492, "trace_hash_ids": [13476591, 13499228, 13499229, 13499230, 13499231, 13499232, 13499233, 13499234, 13499235, 13499236, 13506610, 13506611, 13506612, 13506613, 13506614, 13515206, 13515207, 13515208, 13515209, 13515210, 13515211], "trace_timestamp_s": 437.4520000000002, "ttft_s": 0.27154798299307004, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 27984, "effective_input_length": 28093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28093, "latency_s": 0.42385309597011656, "output_length": 28, "proxy_request_id": "1353821:4:1363399:541", "request_id": "1353821:4:1363399:541", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1353821", "t_dispatch_unix": 1779818032.9775069, "t_finish_unix": 1779818033.4013598, "t_first_token_unix": 1779818033.105865, "tpot_s": 0.010918813925753865, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13496092], "trace_timestamp_s": 439.22600000000057, "ttft_s": 0.12835606600856408, "turn_id": 4} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 543, "latency_s": 0.5548735209740698, "output_length": 37, "proxy_request_id": "1363440:1:1363440:542", "request_id": "1363440:1:1363440:542", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1363440", "t_dispatch_unix": 1779818033.1546261, "t_finish_unix": 1779818033.7094996, "t_first_token_unix": 1779818033.3510113, "tpot_s": 0.009947665860333169, "trace_hash_ids": [13519619, 13519620], "trace_timestamp_s": 439.40300000000025, "ttft_s": 0.196383528993465, "turn_id": 1} +{"actual_output_tokens": 723, "cached_tokens": 0, "effective_input_length": 58758, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58758, "latency_s": 20.288178520975634, "output_length": 723, "proxy_request_id": "1313181:2:1358046:519", "request_id": "1313181:2:1358046:519", "request_type": "coder", "requested_output_tokens": 723, "session_id": "1313181", "t_dispatch_unix": 1779818013.9203448, "t_finish_unix": 1779818034.2085233, "t_first_token_unix": 1779818026.45139, "tpot_s": 0.010743417915545657, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720], "trace_timestamp_s": 420.15500000000065, "ttft_s": 12.531042623973917, "turn_id": 2} +{"actual_output_tokens": 96, "cached_tokens": 35360, "effective_input_length": 37232, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37232, "latency_s": 1.5654883629758842, "output_length": 96, "proxy_request_id": "1355951:2:1363365:540", "request_id": "1355951:2:1363365:540", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1355951", "t_dispatch_unix": 1779818032.8578677, "t_finish_unix": 1779818034.4233558, "t_first_token_unix": 1779818033.4647946, "tpot_s": 0.0100870557576663, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978], "trace_timestamp_s": 439.1050000000005, "ttft_s": 0.6069250209839083, "turn_id": 2} +{"actual_output_tokens": 97, "cached_tokens": 24448, "effective_input_length": 24451, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24451, "latency_s": 1.7191638890071772, "output_length": 97, "proxy_request_id": "1313181:3:1316742:330", "request_id": "1313181:3:1316742:330", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1313181", "t_dispatch_unix": 1779818034.2101653, "t_finish_unix": 1779818035.9293292, "t_first_token_unix": 1779818034.273058, "tpot_s": 0.01724871201076894, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713], "trace_timestamp_s": 274.71900000000005, "ttft_s": 0.06289170996751636, "turn_id": 3} +{"actual_output_tokens": 148, "cached_tokens": 0, "effective_input_length": 8706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8706, "latency_s": 2.2133427409571595, "output_length": 148, "proxy_request_id": "1364128:1:1364128:545", "request_id": "1364128:1:1364128:545", "request_type": "coder", "requested_output_tokens": 148, "session_id": "1364128", "t_dispatch_unix": 1779818035.3221989, "t_finish_unix": 1779818037.535542, "t_first_token_unix": 1779818036.0809748, "tpot_s": 0.00989268145596824, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13525789], "trace_timestamp_s": 441.5700000000006, "ttft_s": 0.7587744739721529, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 2019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2019, "latency_s": 0.6549965249723755, "output_length": 37, "proxy_request_id": "1364960:1:1364960:549", "request_id": "1364960:1:1364960:549", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1364960", "t_dispatch_unix": 1779818038.2464714, "t_finish_unix": 1779818038.9014676, "t_first_token_unix": 1779818038.4952521, "tpot_s": 0.011276548637801575, "trace_hash_ids": [13526287, 13526288, 13526289, 13533401], "trace_timestamp_s": 444.4950000000008, "ttft_s": 0.2487794830230996, "turn_id": 1} +{"actual_output_tokens": 196, "cached_tokens": 97968, "effective_input_length": 98038, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98038, "latency_s": 3.648882854031399, "output_length": 196, "proxy_request_id": "1279412:24:1364169:546", "request_id": "1279412:24:1364169:546", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1279412", "t_dispatch_unix": 1779818035.4526196, "t_finish_unix": 1779818039.1015022, "t_first_token_unix": 1779818035.6739535, "tpot_s": 0.017575831389806878, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13526218], "trace_timestamp_s": 441.6970000000001, "ttft_s": 0.22133220999967307, "turn_id": 24} +{"actual_output_tokens": 51, "cached_tokens": 576, "effective_input_length": 3866, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3866, "latency_s": 0.8035643540206365, "output_length": 51, "proxy_request_id": "1363440:2:1365095:551", "request_id": "1363440:2:1365095:551", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1363440", "t_dispatch_unix": 1779818038.828931, "t_finish_unix": 1779818039.6324954, "t_first_token_unix": 1779818039.1443803, "tpot_s": 0.009756851779529825, "trace_hash_ids": [13519619, 13526758, 13526759, 13534597, 13534598, 13534599, 13534600, 13534601], "trace_timestamp_s": 445.0770000000002, "ttft_s": 0.31544825102901086, "turn_id": 2} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 9913, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9913, "latency_s": 1.0121966220322065, "output_length": 23, "proxy_request_id": "1365440:1:1365440:552", "request_id": "1365440:1:1365440:552", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1365440", "t_dispatch_unix": 1779818040.0478857, "t_finish_unix": 1779818041.060082, "t_first_token_unix": 1779818040.8469844, "tpot_s": 0.009674571179361506, "trace_hash_ids": [13493986, 13493987, 13493988, 13493989, 13493990, 13502611, 13502612, 13502613, 13502614, 13502615, 13512497, 13512498, 13521747, 13521748, 13529243, 13529244, 13529245, 13529246, 13537645, 13537646], "trace_timestamp_s": 446.2930000000006, "ttft_s": 0.7990966550423764, "turn_id": 1} +{"actual_output_tokens": 584, "cached_tokens": 11264, "effective_input_length": 13897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13897, "latency_s": 6.7765006279805675, "output_length": 584, "proxy_request_id": "1364090:1:1364090:544", "request_id": "1364090:1:1364090:544", "request_type": "coder", "requested_output_tokens": 584, "session_id": "1364090", "t_dispatch_unix": 1779818035.2136464, "t_finish_unix": 1779818041.990147, "t_first_token_unix": 1779818035.580837, "tpot_s": 0.010992916567769464, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 11789930], "trace_timestamp_s": 441.46200000000044, "ttft_s": 0.36718952999217436, "turn_id": 1} +{"actual_output_tokens": 5049, "cached_tokens": 67552, "effective_input_length": 68259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68259, "latency_s": 48.42980721197091, "output_length": 5049, "proxy_request_id": "1314357:4:1352612:497", "request_id": "1314357:4:1352612:497", "request_type": "coder", "requested_output_tokens": 5049, "session_id": "1314357", "t_dispatch_unix": 1779817994.9976223, "t_finish_unix": 1779818043.4274294, "t_first_token_unix": 1779817995.514356, "tpot_s": 0.00949143954101301, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13419015, 13419016], "trace_timestamp_s": 401.23199999999997, "ttft_s": 0.5167317839805037, "turn_id": 4} +{"actual_output_tokens": 94, "cached_tokens": 0, "effective_input_length": 11154, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11154, "latency_s": 1.4862426350009628, "output_length": 94, "proxy_request_id": "1366128:1:1366128:553", "request_id": "1366128:1:1366128:553", "request_type": "coder", "requested_output_tokens": 94, "session_id": "1366128", "t_dispatch_unix": 1779818042.3423162, "t_finish_unix": 1779818043.8285587, "t_first_token_unix": 1779818043.2430975, "tpot_s": 0.006291704236715031, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2239018, 2239019, 2239020, 2239021, 2239022, 177637, 177638, 177639, 2239023, 2239024, 2239025, 2239026, 2239027], "trace_timestamp_s": 448.58700000000044, "ttft_s": 0.9007803829736076, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 62685, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62685, "latency_s": 14.770370526995976, "output_length": 68, "proxy_request_id": "1363093:1:1363093:538", "request_id": "1363093:1:1363093:538", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1363093", "t_dispatch_unix": 1779818031.8314319, "t_finish_unix": 1779818046.6018019, "t_first_token_unix": 1779818046.0139408, "tpot_s": 0.00876845804446224, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933], "trace_timestamp_s": 438.0560000000005, "ttft_s": 14.182507058023475, "turn_id": 1} +{"actual_output_tokens": 89, "cached_tokens": 35024, "effective_input_length": 35071, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35071, "latency_s": 4.05805136996787, "output_length": 89, "proxy_request_id": "1344773:11:1366387:555", "request_id": "1344773:11:1366387:555", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1344773", "t_dispatch_unix": 1779818043.3133137, "t_finish_unix": 1779818047.371365, "t_first_token_unix": 1779818046.0231593, "tpot_s": 0.01531607645434137, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13545744], "trace_timestamp_s": 449.5610000000006, "ttft_s": 2.7098442299757153, "turn_id": 11} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 3392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3392, "latency_s": 0.4213945349911228, "output_length": 13, "proxy_request_id": "1367424:1:1367424:569", "request_id": "1367424:1:1367424:569", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1367424", "t_dispatch_unix": 1779818047.0793927, "t_finish_unix": 1779818047.5007873, "t_first_token_unix": 1779818047.372605, "tpot_s": 0.010642670919575417, "trace_hash_ids": [13550847, 13550848, 13555750, 13555751, 13555752, 13555753, 13555754], "trace_timestamp_s": 453.3270000000002, "ttft_s": 0.29321150097530335, "turn_id": 1} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 13749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13749, "latency_s": 1.834202672005631, "output_length": 60, "proxy_request_id": "1367312:1:1367312:566", "request_id": "1367312:1:1367312:566", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1367312", "t_dispatch_unix": 1779818046.6743956, "t_finish_unix": 1779818048.5085988, "t_first_token_unix": 1779818047.878247, "tpot_s": 0.010678649609671685, "trace_hash_ids": [13521767, 13521768, 13521769, 13521770, 13521771, 13521772, 13529702, 13529703, 13529704, 13529705, 13529706, 13529707, 13537903, 13537904, 13537905, 13537906, 13537907, 13537908, 13537909, 13537910, 13554581, 13554582, 13554583, 13554584, 13554585, 13554586, 13554587], "trace_timestamp_s": 452.9180000000006, "ttft_s": 1.2038494549924508, "turn_id": 1} +{"actual_output_tokens": 242, "cached_tokens": 0, "effective_input_length": 12636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12636, "latency_s": 13.912488561007194, "output_length": 242, "proxy_request_id": "1363943:1:1363943:543", "request_id": "1363943:1:1363943:543", "request_type": "coder", "requested_output_tokens": 242, "session_id": "1363943", "t_dispatch_unix": 1779818034.8352015, "t_finish_unix": 1779818048.7476897, "t_first_token_unix": 1779818035.9053073, "tpot_s": 0.05328664211609451, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13524052], "trace_timestamp_s": 441.08300000000054, "ttft_s": 1.070104518032167, "turn_id": 1} +{"actual_output_tokens": 65, "cached_tokens": 8848, "effective_input_length": 9095, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9095, "latency_s": 2.605474248994142, "output_length": 65, "proxy_request_id": "1364128:2:1367249:565", "request_id": "1364128:2:1367249:565", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1364128", "t_dispatch_unix": 1779818046.472149, "t_finish_unix": 1779818049.0776234, "t_first_token_unix": 1779818048.6040397, "tpot_s": 0.007390380437755084, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13554127], "trace_timestamp_s": 452.72100000000046, "ttft_s": 2.131888937961776, "turn_id": 2} +{"actual_output_tokens": 120, "cached_tokens": 0, "effective_input_length": 76969, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76969, "latency_s": 22.059423625003546, "output_length": 120, "proxy_request_id": "1361694:1:1361694:534", "request_id": "1361694:1:1361694:534", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1361694", "t_dispatch_unix": 1779818027.0806382, "t_finish_unix": 1779818049.1400614, "t_first_token_unix": 1779818047.5383368, "tpot_s": 0.013457676655507232, "trace_hash_ids": [44767, 44768, 44769, 44770, 44771, 44772, 44773, 44774, 44775, 44776, 44777, 44778, 44779, 44780, 44781, 44782, 44783, 44784, 44785, 44786, 44787, 44788, 44789, 44790, 44791, 44792, 44793, 44794, 44795, 44796, 44797, 44798, 44799, 44800, 3558548, 3558549, 3558550, 3558551, 3558552, 3558553, 13503874, 1011240, 1011241, 1011242, 1011243, 3586252, 74020, 74021, 74022, 74023, 3586253, 3586254, 3586255, 3586256, 3586257, 3586258, 3586259, 3586260, 3586261, 3586262, 3586263, 3586264, 3586265, 3586266, 3586267, 3586268, 3586269, 3586270, 3586271, 3586272, 3586273, 3586274, 3586275, 3586276, 3586277, 3586278, 3663116, 4797128, 4797129, 4797130, 4797131, 4797132, 5846177, 5846178, 5846179, 5846180, 5865004, 8339969, 8339970, 8339971, 8339972, 8339973, 8339974, 10027756, 10027757, 10027758, 10027759, 10027760, 10027761, 10027762, 11077600, 11077601, 11077602, 11077603, 11077604, 11077605, 11077606, 11077607, 11077608, 11077609, 11077610, 11866485, 11866486, 11866487, 11866488, 11866489, 11866490, 11866491, 11866492, 11866493, 11866494, 11866495, 11866496, 11866497, 11866498, 11866499, 11866500, 11866501, 11866502, 11866503, 11866504, 11866505, 11866506, 11986357, 11986358, 12039293, 12039294, 12105265, 12125556, 12125557, 13503875, 13503876, 13503877, 13503878, 13503879, 13503880, 13503881, 13503882, 13503883, 13503884, 13503885], "trace_timestamp_s": 433.3020000000006, "ttft_s": 20.457695241027977, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 11232, "effective_input_length": 15411, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15411, "latency_s": 2.8938402499770746, "output_length": 92, "proxy_request_id": "1366128:2:1367220:563", "request_id": "1366128:2:1367220:563", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1366128", "t_dispatch_unix": 1779818046.3769243, "t_finish_unix": 1779818049.2707646, "t_first_token_unix": 1779818048.6057677, "tpot_s": 0.007304836779699794, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13553898], "trace_timestamp_s": 452.6220000000003, "ttft_s": 2.2288422930287197, "turn_id": 2} +{"actual_output_tokens": 34, "cached_tokens": 9008, "effective_input_length": 10134, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10134, "latency_s": 3.600258626975119, "output_length": 34, "proxy_request_id": "1362265:2:1367373:568", "request_id": "1362265:2:1367373:568", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1362265", "t_dispatch_unix": 1779818046.88006, "t_finish_unix": 1779818050.4803183, "t_first_token_unix": 1779818050.1783707, "tpot_s": 0.009140046332807591, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218], "trace_timestamp_s": 453.1280000000006, "ttft_s": 3.298309170990251, "turn_id": 2} +{"actual_output_tokens": 161, "cached_tokens": 33552, "effective_input_length": 41017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41017, "latency_s": 6.477896596014034, "output_length": 161, "proxy_request_id": "1270340:4:1366608:558", "request_id": "1270340:4:1366608:558", "request_type": "coder", "requested_output_tokens": 161, "session_id": "1270340", "t_dispatch_unix": 1779818044.0680437, "t_finish_unix": 1779818050.5459397, "t_first_token_unix": 1779818046.0581667, "tpot_s": 0.02804596548739937, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 13547874], "trace_timestamp_s": 450.3120000000008, "ttft_s": 1.9901213539997116, "turn_id": 4} +{"actual_output_tokens": 57, "cached_tokens": 2048, "effective_input_length": 7048, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7048, "latency_s": 0.8530920010525733, "output_length": 57, "proxy_request_id": "1364960:2:1368239:578", "request_id": "1364960:2:1368239:578", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1364960", "t_dispatch_unix": 1779818049.9704325, "t_finish_unix": 1779818050.8235242, "t_first_token_unix": 1779818050.3614817, "tpot_s": 0.008245991321538375, "trace_hash_ids": [13526287, 13526288, 13526289, 13533401, 13540695, 13540696, 13540697, 13540698, 13540699, 13549445, 13549446, 13556212, 13562654, 13562655], "trace_timestamp_s": 456.21800000000076, "ttft_s": 0.39104838704224676, "turn_id": 2} +{"actual_output_tokens": 254, "cached_tokens": 0, "effective_input_length": 18815, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18815, "latency_s": 4.802508421998937, "output_length": 254, "proxy_request_id": "1367169:1:1367169:562", "request_id": "1367169:1:1367169:562", "request_type": "coder", "requested_output_tokens": 254, "session_id": "1367169", "t_dispatch_unix": 1779818046.189556, "t_finish_unix": 1779818050.9920642, "t_first_token_unix": 1779818048.603095, "tpot_s": 0.009441087446672467, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 1489202, 13282259, 13553463, 13553464, 3656637, 13553465, 13553466, 13553467, 13424449, 13424450, 13424451, 13424452, 13553468, 13553469], "trace_timestamp_s": 452.4360000000006, "ttft_s": 2.4135378029895946, "turn_id": 1} +{"actual_output_tokens": 95, "cached_tokens": 0, "effective_input_length": 26837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26837, "latency_s": 4.267894051969051, "output_length": 95, "proxy_request_id": "1367329:1:1367329:567", "request_id": "1367329:1:1367329:567", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1367329", "t_dispatch_unix": 1779818046.7332683, "t_finish_unix": 1779818051.001162, "t_first_token_unix": 1779818050.1762471, "tpot_s": 0.008772474659750475, "trace_hash_ids": [13554866, 13554867, 13554868, 13554869, 13554870, 13554871, 13554872, 13554873, 13554874, 13554875, 13554876, 13554877, 13554878, 13554879, 13554880, 13554881, 13554882, 13554883, 13554884, 13554885, 13554886, 13554887, 13554888, 13554889, 13554890, 13554891, 13554892, 13554893, 13554894, 13554895, 13554896, 13554897, 13554898, 13554899, 13554900, 13554901, 13554902, 13554903, 13554904, 13554905, 13554906, 13554907, 13554908, 13554909, 13554910, 13554911, 13554912, 13554913, 13554914, 13554915, 13554916, 13554917, 13554918], "trace_timestamp_s": 452.97200000000066, "ttft_s": 3.442975982965436, "turn_id": 1} +{"actual_output_tokens": 191, "cached_tokens": 35152, "effective_input_length": 35194, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35194, "latency_s": 2.459021941991523, "output_length": 191, "proxy_request_id": "1344773:12:1367864:571", "request_id": "1344773:12:1367864:571", "request_type": "coder", "requested_output_tokens": 191, "session_id": "1344773", "t_dispatch_unix": 1779818048.5707552, "t_finish_unix": 1779818051.0297766, "t_first_token_unix": 1779818048.673637, "tpot_s": 0.012398984673506532, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13559222], "trace_timestamp_s": 454.8190000000004, "ttft_s": 0.10287948901532218, "turn_id": 12} +{"actual_output_tokens": 457, "cached_tokens": 24544, "effective_input_length": 59514, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59514, "latency_s": 15.598516541009303, "output_length": 457, "proxy_request_id": "1313181:3:1364311:547", "request_id": "1313181:3:1364311:547", "request_type": "coder", "requested_output_tokens": 457, "session_id": "1313181", "t_dispatch_unix": 1779818035.931888, "t_finish_unix": 1779818051.5304046, "t_first_token_unix": 1779818046.0062106, "tpot_s": 0.01211351887506776, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13527469], "trace_timestamp_s": 442.174, "ttft_s": 10.074319864972495, "turn_id": 3} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 21773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21773, "latency_s": 2.6019390979781747, "output_length": 26, "proxy_request_id": "1368070:1:1368070:575", "request_id": "1368070:1:1368070:575", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1368070", "t_dispatch_unix": 1779818049.3998756, "t_finish_unix": 1779818052.0018146, "t_first_token_unix": 1779818051.7886622, "tpot_s": 0.008513693001586943, "trace_hash_ids": [13522908, 13522909, 13522910, 13522911, 13529691, 13529692, 13529693, 13529694, 13529695, 13529696, 13529697, 13529698, 13529699, 13537845, 13537846, 13537847, 13537848, 13547043, 13547044, 13547045, 13547046, 13547047, 13547048, 13547049, 13556102, 13556103, 13556104, 13556105, 13556106, 13556107, 13556108, 13556109, 13556110, 13556111, 13556112, 13561206, 13561207, 13561208, 13561209, 13561210, 13561211, 13561212, 13561213], "trace_timestamp_s": 455.634, "ttft_s": 2.3887847889564, "turn_id": 1} +{"actual_output_tokens": 330, "cached_tokens": 6656, "effective_input_length": 8845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8845, "latency_s": 2.6256188660045154, "output_length": 330, "proxy_request_id": "1368132:1:1368132:577", "request_id": "1368132:1:1368132:577", "request_type": "coder", "requested_output_tokens": 330, "session_id": "1368132", "t_dispatch_unix": 1779818049.6422758, "t_finish_unix": 1779818052.2678947, "t_first_token_unix": 1779818049.8907814, "tpot_s": 0.007224361665580863, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13561809, 13561810, 13561811, 8518241, 13561812], "trace_timestamp_s": 455.8890000000001, "ttft_s": 0.24850330402841792, "turn_id": 1} +{"actual_output_tokens": 322, "cached_tokens": 12864, "effective_input_length": 12984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12984, "latency_s": 3.579907634004485, "output_length": 322, "proxy_request_id": "1363943:2:1366428:556", "request_id": "1363943:2:1366428:556", "request_type": "coder", "requested_output_tokens": 322, "session_id": "1363943", "t_dispatch_unix": 1779818048.7486665, "t_finish_unix": 1779818052.3285744, "t_first_token_unix": 1779818048.8336139, "tpot_s": 0.010886754218098704, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13546053], "trace_timestamp_s": 449.7000000000007, "ttft_s": 0.08494577597593889, "turn_id": 2} +{"actual_output_tokens": 97, "cached_tokens": 42688, "effective_input_length": 42704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42704, "latency_s": 0.9200065080076456, "output_length": 97, "proxy_request_id": "1313181:4:1318843:342", "request_id": "1313181:4:1318843:342", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1313181", "t_dispatch_unix": 1779818051.5470943, "t_finish_unix": 1779818052.4671006, "t_first_token_unix": 1779818051.6768808, "tpot_s": 0.008228211572713917, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13103391], "trace_timestamp_s": 282.26900000000023, "ttft_s": 0.12978441402083263, "turn_id": 4} +{"actual_output_tokens": 375, "cached_tokens": 49056, "effective_input_length": 49483, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49483, "latency_s": 7.051671374996658, "output_length": 375, "proxy_request_id": "1340278:2:1367225:564", "request_id": "1340278:2:1367225:564", "request_type": "coder", "requested_output_tokens": 375, "session_id": "1340278", "t_dispatch_unix": 1779818046.4193754, "t_finish_unix": 1779818053.4710467, "t_first_token_unix": 1779818047.7444117, "tpot_s": 0.015310738163030293, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13553910, 13553911, 13553912, 13553913, 13553914, 13553915, 13553916, 13553917, 13553918, 13553919, 13553920, 13553921, 13553922, 13553923, 13553924, 13553925, 13553926, 13553927, 13553928, 13553929, 13553930, 13553931, 13553932, 13553933, 13553934, 13553935, 13553936, 13553937, 13553938, 13553939, 13553940, 13553941, 13553942, 13553943, 13553944, 13553945, 13553946, 13553947, 13553948, 13553949, 13553950, 13553951, 13553952, 13553953, 13553954, 13553955, 13553956, 13553957, 13553958, 13553959, 13553960, 13553961, 13553962, 13553963, 13553964, 13553965, 13553966, 13553967, 13553968, 13553969, 13553970, 13553971, 13553972, 13553973, 13553974, 13553975, 13553976, 13553977, 13553978, 13553979, 13553980, 13553981, 13553982, 13553983, 13553984], "trace_timestamp_s": 452.65300000000025, "ttft_s": 1.3250337940407917, "turn_id": 2} +{"actual_output_tokens": 162, "cached_tokens": 62752, "effective_input_length": 63235, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63235, "latency_s": 1.94538317801198, "output_length": 162, "proxy_request_id": "1363093:2:1368700:580", "request_id": "1363093:2:1368700:580", "request_type": "coder", "requested_output_tokens": 162, "session_id": "1363093", "t_dispatch_unix": 1779818051.5563526, "t_finish_unix": 1779818053.5017352, "t_first_token_unix": 1779818051.9288592, "tpot_s": 0.009767440583713075, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147], "trace_timestamp_s": 457.7940000000008, "ttft_s": 0.3725038850097917, "turn_id": 2} +{"actual_output_tokens": 5, "cached_tokens": 49856, "effective_input_length": 50124, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50124, "latency_s": 0.21990912401815876, "output_length": 5, "proxy_request_id": "1340278:3:1368072:576", "request_id": "1340278:3:1368072:576", "request_type": "coder", "requested_output_tokens": 5, "session_id": "1340278", "t_dispatch_unix": 1779818053.4881608, "t_finish_unix": 1779818053.7080696, "t_first_token_unix": 1779818053.6900902, "tpot_s": 0.004404129256727174, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13561220, 13561221, 13561222, 13561223, 13561224, 13561225, 13561226, 13561227, 13561228, 13561229, 13561230, 13561231, 13561232, 13561233, 13561234, 13561235, 13561236, 13561237, 13561238, 13561239, 13561240, 13561241, 13561242, 13561243, 13561244, 13561245, 13561246, 13561247, 13561248, 13561249, 13561250, 13561251, 13561252, 13561253, 13561254, 13561255, 13561256, 13561257, 13561258, 13561259, 13561260, 13561261, 13561262, 13561263, 13561264, 13561265, 13561266, 13561267, 13561268, 13561269, 13561270, 13561271, 13561272, 13561273, 13561274, 13561275, 13561276, 13561277, 13561278, 13561279, 13561280, 13561281, 13561282, 13561283, 13561284, 13561285, 13561286, 13561287, 13561288, 13561289, 13561290, 13561291, 13561292, 13561293], "trace_timestamp_s": 455.64100000000053, "ttft_s": 0.20192701899213716, "turn_id": 3} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 6345, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6345, "latency_s": 0.6670459299930371, "output_length": 48, "proxy_request_id": "1369172:1:1369172:581", "request_id": "1369172:1:1369172:581", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1369172", "t_dispatch_unix": 1779818053.2386081, "t_finish_unix": 1779818053.9056532, "t_first_token_unix": 1779818053.6669168, "tpot_s": 0.005070581446411682, "trace_hash_ids": [13562302, 13562303, 13562304, 13562305, 13562306, 13562307, 13562308, 13562309, 13571383, 13571384, 13571385, 13571386, 13571387], "trace_timestamp_s": 459.4850000000006, "ttft_s": 0.42830801801756024, "turn_id": 1} +{"actual_output_tokens": 663, "cached_tokens": 14208, "effective_input_length": 16057, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16057, "latency_s": 22.353187524015084, "output_length": 663, "proxy_request_id": "1305906:2:1363233:539", "request_id": "1305906:2:1363233:539", "request_type": "coder", "requested_output_tokens": 663, "session_id": "1305906", "t_dispatch_unix": 1779818032.3196194, "t_finish_unix": 1779818054.6728072, "t_first_token_unix": 1779818046.0081387, "tpot_s": 0.013088150537788047, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13517857, 13517858, 13517859, 13517860, 13517861], "trace_timestamp_s": 438.5680000000002, "ttft_s": 13.688517678005155, "turn_id": 2} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7712, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7712, "latency_s": 1.899335028952919, "output_length": 24, "proxy_request_id": "1369768:1:1369768:584", "request_id": "1369768:1:1369768:584", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1369768", "t_dispatch_unix": 1779818055.2423017, "t_finish_unix": 1779818057.1416366, "t_first_token_unix": 1779818055.7833717, "tpot_s": 0.059038305088229805, "trace_hash_ids": [13550468, 13550469, 13550470, 13550471, 13562017, 13562018, 13562019, 13562020, 13562021, 13562022, 13562023, 13568764, 13568765, 13568766, 13576622, 13576623], "trace_timestamp_s": 461.4880000000003, "ttft_s": 0.5410690579446964, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 15488, "effective_input_length": 23307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23307, "latency_s": 1.5593151270295493, "output_length": 42, "proxy_request_id": "1366128:3:1369902:585", "request_id": "1366128:3:1369902:585", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1366128", "t_dispatch_unix": 1779818055.7061846, "t_finish_unix": 1779818057.2654994, "t_first_token_unix": 1779818057.0054705, "tpot_s": 0.006334179853339021, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13578302], "trace_timestamp_s": 461.9520000000002, "ttft_s": 1.2992842530366033, "turn_id": 3} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7710, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7710, "latency_s": 0.6513820280088112, "output_length": 24, "proxy_request_id": "1370466:1:1370466:592", "request_id": "1370466:1:1370466:592", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1370466", "t_dispatch_unix": 1779818057.7654128, "t_finish_unix": 1779818058.4167945, "t_first_token_unix": 1779818058.301993, "tpot_s": 0.004979632217841951, "trace_hash_ids": [13584429, 13584430, 13584431, 13584432, 13584433, 13584434, 13584435, 13584436, 13584437, 13584438, 13584439, 13584440, 13584441, 13584442, 13584443, 13584444], "trace_timestamp_s": 464.0110000000004, "ttft_s": 0.5365788490162231, "turn_id": 1} +{"actual_output_tokens": 14, "cached_tokens": 0, "effective_input_length": 11133, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11133, "latency_s": 2.2011229430208914, "output_length": 14, "proxy_request_id": "1367424:2:1370211:588", "request_id": "1367424:2:1370211:588", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1367424", "t_dispatch_unix": 1779818056.7172198, "t_finish_unix": 1779818058.9183424, "t_first_token_unix": 1779818058.8254993, "tpot_s": 0.007118200923566922, "trace_hash_ids": [13550847, 13550848, 13555750, 13555751, 13555752, 13555753, 13566763, 13566764, 13566765, 13566766, 13566767, 13571939, 13571940, 13571941, 13571942, 13581578, 13581579, 13581580, 13581581, 13581582, 13581583, 13581584], "trace_timestamp_s": 462.96300000000065, "ttft_s": 2.108278373023495, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 21792, "effective_input_length": 29501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29501, "latency_s": 2.545221642998513, "output_length": 26, "proxy_request_id": "1368070:2:1370108:586", "request_id": "1368070:2:1370108:586", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1368070", "t_dispatch_unix": 1779818056.4325862, "t_finish_unix": 1779818058.977807, "t_first_token_unix": 1779818057.9652612, "tpot_s": 0.040492403921671215, "trace_hash_ids": [13580541, 13580542, 13580543, 13580544, 13580545, 13580546, 13580547, 13580548, 13580549, 13580550, 13580551, 13580552, 13580553, 13580554, 13580555, 13580556, 13580557, 13580558, 13580559, 13580560, 13580561, 13580562, 13580563, 13580564, 13580565, 13580566, 13580567, 13580568, 13580569, 13580570, 13580571, 13580572, 13580573, 13580574, 13580575, 13580576, 13580577, 13580578, 13580579, 13580580, 13580581, 13580582, 13580583, 13580584, 13580585, 13580586, 13580587, 13580588, 13580589, 13580590, 13580591, 13580592, 13580593, 13580594, 13580595, 13580596, 13580597, 13580598], "trace_timestamp_s": 462.65900000000056, "ttft_s": 1.5326734359841794, "turn_id": 2} +{"actual_output_tokens": 7, "cached_tokens": 35376, "effective_input_length": 35413, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35413, "latency_s": 2.156306107994169, "output_length": 7, "proxy_request_id": "1344773:13:1370257:589", "request_id": "1344773:13:1370257:589", "request_type": "coder", "requested_output_tokens": 7, "session_id": "1344773", "t_dispatch_unix": 1779818056.909594, "t_finish_unix": 1779818059.0658996, "t_first_token_unix": 1779818059.028821, "tpot_s": 0.006142778001958504, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13581991, 13581992], "trace_timestamp_s": 463.15700000000015, "ttft_s": 2.119225184957031, "turn_id": 13} +{"actual_output_tokens": 89, "cached_tokens": 0, "effective_input_length": 2381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2381, "latency_s": 2.510629036987666, "output_length": 89, "proxy_request_id": "1370269:1:1370269:591", "request_id": "1370269:1:1370269:591", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1370269", "t_dispatch_unix": 1779818056.9756212, "t_finish_unix": 1779818059.4862502, "t_first_token_unix": 1779818057.3061774, "tpot_s": 0.024769681432437872, "trace_hash_ids": [13582035, 13582036, 13582037, 13582038, 13582039], "trace_timestamp_s": 463.22400000000016, "ttft_s": 0.3305547639611177, "turn_id": 1} +{"actual_output_tokens": 232, "cached_tokens": 13296, "effective_input_length": 18160, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18160, "latency_s": 6.910825778031722, "output_length": 232, "proxy_request_id": "1363943:3:1369535:582", "request_id": "1363943:3:1369535:582", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1363943", "t_dispatch_unix": 1779818054.4187882, "t_finish_unix": 1779818061.3296137, "t_first_token_unix": 1779818059.0058525, "tpot_s": 0.010057597307466148, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13574495], "trace_timestamp_s": 460.66499999999996, "ttft_s": 4.587063173006754, "turn_id": 3} +{"actual_output_tokens": 6362, "cached_tokens": 54896, "effective_input_length": 55130, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55130, "latency_s": 161.61869578401092, "output_length": 6362, "proxy_request_id": "1315567:3:1325346:372", "request_id": "1315567:3:1325346:372", "request_type": "coder", "requested_output_tokens": 6362, "session_id": "1315567", "t_dispatch_unix": 1779817900.0835853, "t_finish_unix": 1779818061.702281, "t_first_token_unix": 1779817900.2956004, "tpot_s": 0.025374370549909854, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13112465, 13112466, 13112467, 13112468, 13112469, 13112470, 13112471, 13112472, 13112473, 13112474, 13112475, 13112476, 13112477, 13112478, 13112479, 13112480, 13112481, 13112482, 13112483, 13112484, 13112485, 13112486, 13112487, 13112488, 13112489, 13112490, 13112491, 13112492, 13112493, 13112494, 13112495, 13112496, 13112497, 13112498, 13112499, 13112500, 13112501, 13112502, 13112503, 13112504, 13112505, 13112506, 13112507, 13112508, 13112509, 13112510, 13112511, 13112512, 13112513, 13112514, 13112515, 13112516, 13112517, 13112518, 13112519, 13112520, 13112521, 13112522, 13112523, 13112524, 13112525, 13112526, 13112527, 13112528, 13112529, 13112530, 13112531, 13112532, 13112533, 13112534, 13112535, 13112536, 13112537, 13166089, 13166090], "trace_timestamp_s": 305.1810000000005, "ttft_s": 0.21201221301453188, "turn_id": 3} +{"actual_output_tokens": 99, "cached_tokens": 0, "effective_input_length": 9399, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9399, "latency_s": 1.2467095609754324, "output_length": 99, "proxy_request_id": "1371337:1:1371337:597", "request_id": "1371337:1:1371337:597", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1371337", "t_dispatch_unix": 1779818060.6348329, "t_finish_unix": 1779818061.881542, "t_first_token_unix": 1779818061.3571064, "tpot_s": 0.005348907663054498, "trace_hash_ids": [13566840, 13566841, 13566842, 13566843, 13566844, 13566845, 13566846, 13566847, 13581073, 13592764, 13592765, 13592766, 13592767, 13592768, 13592769, 13592770, 13592771, 13592772, 13592773], "trace_timestamp_s": 466.8800000000001, "ttft_s": 0.7222724719904363, "turn_id": 1} +{"actual_output_tokens": 109, "cached_tokens": 26928, "effective_input_length": 32814, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32814, "latency_s": 2.2300057169632055, "output_length": 109, "proxy_request_id": "1367329:2:1371226:595", "request_id": "1367329:2:1371226:595", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1367329", "t_dispatch_unix": 1779818060.2023687, "t_finish_unix": 1779818062.432374, "t_first_token_unix": 1779818061.514769, "tpot_s": 0.008493739138766951, "trace_hash_ids": [13554866, 13554867, 13554868, 13554869, 13554870, 13554871, 13554872, 13554873, 13554874, 13554875, 13554876, 13554877, 13554878, 13554879, 13554880, 13554881, 13554882, 13554883, 13554884, 13554885, 13554886, 13554887, 13554888, 13554889, 13554890, 13554891, 13554892, 13554893, 13554894, 13554895, 13554896, 13554897, 13554898, 13554899, 13554900, 13554901, 13554902, 13554903, 13554904, 13554905, 13554906, 13554907, 13554908, 13554909, 13554910, 13554911, 13554912, 13554913, 13554914, 13554915, 13554916, 13554917, 13580089, 13580090, 13580091, 13580092, 13580093, 13580094, 13580095, 13580096, 13591778, 13591779, 13591780, 13591781, 13591782], "trace_timestamp_s": 466.4480000000003, "ttft_s": 1.3123983509722166, "turn_id": 2} +{"actual_output_tokens": 512, "cached_tokens": 0, "effective_input_length": 18301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18301, "latency_s": 6.428272510995157, "output_length": 512, "proxy_request_id": "1370129:1:1370129:587", "request_id": "1370129:1:1370129:587", "request_type": "coder", "requested_output_tokens": 512, "session_id": "1370129", "t_dispatch_unix": 1779818056.4942434, "t_finish_unix": 1779818062.9225156, "t_first_token_unix": 1779818058.3299203, "tpot_s": 0.008986964790604337, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13580719], "trace_timestamp_s": 462.7390000000005, "ttft_s": 1.8356752729741856, "turn_id": 1} +{"actual_output_tokens": 4929, "cached_tokens": 0, "effective_input_length": 7065, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7065, "latency_s": 115.25116053497186, "output_length": 4929, "proxy_request_id": "1339070:1:1339070:438", "request_id": "1339070:1:1339070:438", "request_type": "coder", "requested_output_tokens": 4929, "session_id": "1339070", "t_dispatch_unix": 1779817947.6853182, "t_finish_unix": 1779818062.9364786, "t_first_token_unix": 1779817950.35404, "tpot_s": 0.022845415922890792, "trace_hash_ids": [720115, 720116, 720117, 720118, 720119, 720120, 720121, 720122, 720123, 720124, 13293798, 13293799, 13293800, 13293801], "trace_timestamp_s": 353.9320000000007, "ttft_s": 2.668720592977479, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 51488, "effective_input_length": 51509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51509, "latency_s": 44.784083598991856, "output_length": 27, "proxy_request_id": "1253743:7:1359251:524", "request_id": "1253743:7:1359251:524", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1253743", "t_dispatch_unix": 1779818018.2809854, "t_finish_unix": 1779818063.0650685, "t_first_token_unix": 1779818058.3641849, "tpot_s": 0.1807893296533551, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 13480204], "trace_timestamp_s": 424.52900000000045, "ttft_s": 40.08319771202514, "turn_id": 7} +{"actual_output_tokens": 48, "cached_tokens": 63760, "effective_input_length": 66032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66032, "latency_s": 38.993596906017046, "output_length": 48, "proxy_request_id": "1342921:2:1361022:530", "request_id": "1342921:2:1361022:530", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1342921", "t_dispatch_unix": 1779818024.5179155, "t_finish_unix": 1779818063.5115123, "t_first_token_unix": 1779818059.9637578, "tpot_s": 0.07547785212692032, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390], "trace_timestamp_s": 430.7650000000003, "ttft_s": 35.44584046601085, "turn_id": 2} +{"actual_output_tokens": 127, "cached_tokens": 17408, "effective_input_length": 36301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36301, "latency_s": 20.699687133019324, "output_length": 127, "proxy_request_id": "1277428:5:1366630:559", "request_id": "1277428:5:1366630:559", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1277428", "t_dispatch_unix": 1779818044.1371584, "t_finish_unix": 1779818064.8368459, "t_first_token_unix": 1779818062.4118276, "tpot_s": 0.019243231459912503, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983], "trace_timestamp_s": 450.3850000000002, "ttft_s": 18.274666680023074, "turn_id": 5} +{"actual_output_tokens": 88, "cached_tokens": 18384, "effective_input_length": 18396, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18396, "latency_s": 0.8981928050052375, "output_length": 88, "proxy_request_id": "1363943:4:1372250:603", "request_id": "1363943:4:1372250:603", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1363943", "t_dispatch_unix": 1779818063.9802012, "t_finish_unix": 1779818064.878394, "t_first_token_unix": 1779818064.043, "tpot_s": 0.009598975448505204, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124], "trace_timestamp_s": 470.22900000000027, "ttft_s": 0.06279682996682823, "turn_id": 4} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 17407, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17407, "latency_s": 2.17058354098117, "output_length": 82, "proxy_request_id": "1371929:1:1371929:601", "request_id": "1371929:1:1371929:601", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1371929", "t_dispatch_unix": 1779818062.7424095, "t_finish_unix": 1779818064.9129927, "t_first_token_unix": 1779818064.459036, "tpot_s": 0.005601498135940436, "trace_hash_ids": [13547800, 13547801, 13547802, 13547803, 13547804, 13547805, 13547806, 13558211, 13558212, 13558213, 13558214, 13558215, 13558216, 13558217, 13558218, 13558219, 13558220, 13558221, 13558222, 13558223, 13558224, 13558225, 13558226, 13566670, 13566671, 13566672, 13566673, 13566674, 13566675, 13576731, 13576732, 13590638, 13599021, 13599022], "trace_timestamp_s": 468.9850000000006, "ttft_s": 1.7166246990091167, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 23344, "effective_input_length": 35037, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35037, "latency_s": 3.989826194010675, "output_length": 42, "proxy_request_id": "1366128:4:1371629:599", "request_id": "1366128:4:1371629:599", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1366128", "t_dispatch_unix": 1779818061.656512, "t_finish_unix": 1779818065.6463377, "t_first_token_unix": 1779818065.329847, "tpot_s": 0.007711713829804666, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13595748], "trace_timestamp_s": 467.90000000000055, "ttft_s": 3.6733321989886463, "turn_id": 4} +{"actual_output_tokens": 51, "cached_tokens": 36416, "effective_input_length": 36583, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36583, "latency_s": 0.9390419779811054, "output_length": 51, "proxy_request_id": "1277428:6:1371101:593", "request_id": "1277428:6:1371101:593", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1277428", "t_dispatch_unix": 1779818064.8385766, "t_finish_unix": 1779818065.7776182, "t_first_token_unix": 1779818064.9931192, "tpot_s": 0.01568404263933189, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983, 13590659], "trace_timestamp_s": 466.0430000000006, "ttft_s": 0.1545406780205667, "turn_id": 6} +{"actual_output_tokens": 131, "cached_tokens": 0, "effective_input_length": 13616, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13616, "latency_s": 4.506554071966093, "output_length": 131, "proxy_request_id": "1371622:1:1371622:598", "request_id": "1371622:1:1371622:598", "request_type": "coder", "requested_output_tokens": 131, "session_id": "1371622", "t_dispatch_unix": 1779818061.6364648, "t_finish_unix": 1779818066.143019, "t_first_token_unix": 1779818063.3042738, "tpot_s": 0.02183409471539422, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 13595701], "trace_timestamp_s": 467.8850000000002, "ttft_s": 1.667806682002265, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 4811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4811, "latency_s": 0.48960361699573696, "output_length": 36, "proxy_request_id": "1372791:1:1372791:604", "request_id": "1372791:1:1372791:604", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1372791", "t_dispatch_unix": 1779818065.7522194, "t_finish_unix": 1779818066.241823, "t_first_token_unix": 1779818066.0653348, "tpot_s": 0.005033775457247559, "trace_hash_ids": [13606288, 13606289, 13606290, 13606291, 13606292, 13606293, 13606294, 13606295, 13606296, 13606297], "trace_timestamp_s": 471.9970000000003, "ttft_s": 0.31311389699112624, "turn_id": 1} +{"actual_output_tokens": 189, "cached_tokens": 19456, "effective_input_length": 19493, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19493, "latency_s": 47.58793879800942, "output_length": 189, "proxy_request_id": "1355484:2:1359370:525", "request_id": "1355484:2:1359370:525", "request_type": "coder", "requested_output_tokens": 189, "session_id": "1355484", "t_dispatch_unix": 1779818018.7403982, "t_finish_unix": 1779818066.3283367, "t_first_token_unix": 1779818058.3371758, "tpot_s": 0.0425024559947989, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13481586], "trace_timestamp_s": 424.9890000000005, "ttft_s": 39.59677595400717, "turn_id": 2} +{"actual_output_tokens": 190, "cached_tokens": 1024, "effective_input_length": 122597, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 122597, "latency_s": 56.34900318598375, "output_length": 190, "proxy_request_id": "1356885:1:1356885:514", "request_id": "1356885:1:1356885:514", "request_type": "coder", "requested_output_tokens": 190, "session_id": "1356885", "t_dispatch_unix": 1779818009.9881823, "t_finish_unix": 1779818066.337185, "t_first_token_unix": 1779818058.360354, "tpot_s": 0.04218397297367956, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250], "trace_timestamp_s": 416.1880000000001, "ttft_s": 48.372169585956726, "turn_id": 1} +{"actual_output_tokens": 821, "cached_tokens": 42800, "effective_input_length": 60004, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60004, "latency_s": 13.902121465012897, "output_length": 821, "proxy_request_id": "1313181:4:1368020:573", "request_id": "1313181:4:1368020:573", "request_type": "coder", "requested_output_tokens": 821, "session_id": "1313181", "t_dispatch_unix": 1779818052.4697676, "t_finish_unix": 1779818066.371889, "t_first_token_unix": 1779818059.0103402, "tpot_s": 0.008977153753611918, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13560946], "trace_timestamp_s": 455.47700000000077, "ttft_s": 6.540570628014393, "turn_id": 4} +{"actual_output_tokens": 66, "cached_tokens": 19680, "effective_input_length": 19714, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19714, "latency_s": 0.641973974998109, "output_length": 66, "proxy_request_id": "1355484:3:1361065:531", "request_id": "1355484:3:1361065:531", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1355484", "t_dispatch_unix": 1779818066.3296585, "t_finish_unix": 1779818066.9716332, "t_first_token_unix": 1779818066.4456503, "tpot_s": 0.008084648184908123, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13497881], "trace_timestamp_s": 430.9370000000008, "ttft_s": 0.11598956497618929, "turn_id": 3} +{"actual_output_tokens": 21, "cached_tokens": 10160, "effective_input_length": 10284, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10284, "latency_s": 0.16188877302920446, "output_length": 21, "proxy_request_id": "1362265:3:1373357:605", "request_id": "1362265:3:1373357:605", "request_type": "coder", "requested_output_tokens": 21, "session_id": "1362265", "t_dispatch_unix": 1779818067.7518485, "t_finish_unix": 1779818067.9137363, "t_first_token_unix": 1779818067.8133163, "tpot_s": 0.005008425301639363, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13610624], "trace_timestamp_s": 474.0, "ttft_s": 0.061467010993510485, "turn_id": 3} +{"actual_output_tokens": 188, "cached_tokens": 19776, "effective_input_length": 19806, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19806, "latency_s": 1.7211513170041144, "output_length": 188, "proxy_request_id": "1355484:4:1364784:548", "request_id": "1355484:4:1364784:548", "request_type": "coder", "requested_output_tokens": 188, "session_id": "1355484", "t_dispatch_unix": 1779818066.9729333, "t_finish_unix": 1779818068.6940846, "t_first_token_unix": 1779818067.03596, "tpot_s": 0.008865164486718747, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13531652], "trace_timestamp_s": 443.8810000000003, "ttft_s": 0.06302454700926319, "turn_id": 4} +{"actual_output_tokens": 60, "cached_tokens": 19984, "effective_input_length": 20026, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20026, "latency_s": 0.5932892450364307, "output_length": 60, "proxy_request_id": "1355484:5:1366753:560", "request_id": "1355484:5:1366753:560", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1355484", "t_dispatch_unix": 1779818068.6952214, "t_finish_unix": 1779818069.2885108, "t_first_token_unix": 1779818068.7746418, "tpot_s": 0.008702786932344216, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13549316], "trace_timestamp_s": 450.7640000000001, "ttft_s": 0.07941674499306828, "turn_id": 5} +{"actual_output_tokens": 92, "cached_tokens": 20080, "effective_input_length": 20158, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20158, "latency_s": 0.8846366960206069, "output_length": 92, "proxy_request_id": "1355484:6:1369697:583", "request_id": "1355484:6:1369697:583", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1355484", "t_dispatch_unix": 1779818069.2894075, "t_finish_unix": 1779818070.1740446, "t_first_token_unix": 1779818069.375492, "tpot_s": 0.00877022704398669, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13576108], "trace_timestamp_s": 461.26800000000003, "ttft_s": 0.08608253998681903, "turn_id": 6} +{"actual_output_tokens": 58, "cached_tokens": 13808, "effective_input_length": 15501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15501, "latency_s": 21.353039854031522, "output_length": 58, "proxy_request_id": "1367312:2:1368064:574", "request_id": "1367312:2:1368064:574", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1367312", "t_dispatch_unix": 1779818049.37145, "t_finish_unix": 1779818070.7244897, "t_first_token_unix": 1779818068.5618172, "tpot_s": 0.037935089631406425, "trace_hash_ids": [13521767, 13521768, 13521769, 13521770, 13521771, 13521772, 13529702, 13529703, 13529704, 13529705, 13529706, 13529707, 13537903, 13537904, 13537905, 13537906, 13537907, 13537908, 13537909, 13537910, 13554581, 13554582, 13554583, 13554584, 13554585, 13554586, 13561194, 13561195, 13561196, 13561197, 13561198], "trace_timestamp_s": 455.6180000000004, "ttft_s": 19.190365905000363, "turn_id": 2} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 72919, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72919, "latency_s": 22.3228284700308, "output_length": 82, "proxy_request_id": "1367957:1:1367957:572", "request_id": "1367957:1:1367957:572", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1367957", "t_dispatch_unix": 1779818048.9507651, "t_finish_unix": 1779818071.2735934, "t_first_token_unix": 1779818067.381248, "tpot_s": 0.04804960127207048, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 13560201, 5631592, 280979, 5631593, 1028, 1029, 1030, 1031, 1032, 1033, 1034, 1035, 1036, 1037, 1038, 1039, 1040, 1041, 1042, 1043, 1044, 1045, 1046, 1047, 1048, 1049, 5631594, 5631595, 5631596, 5631597, 5631598, 5631599, 706016, 706017, 1656985, 1656986, 1656987, 1656988, 1656989, 5631600, 10791724, 10856701, 11045334, 11180683, 11180684, 11180685, 11180686, 11180687, 11180688, 11180689, 11180690, 11180691, 11180692, 11180693, 11180694, 11395208, 11395209, 11395210, 11395211, 11395212, 11395213, 11395214, 11395215, 11395216, 11395217, 11395218, 11395219, 11416612, 11498725, 11563787, 11669770, 11900719, 11900720, 11900721, 11900722, 11900723, 11900724, 11900725, 11900726, 11900727, 11900728, 11900729, 11900730, 11900731, 12056875, 12056876, 12056877, 12056878, 12719496, 12719497, 12719498, 12719499, 12719500, 12719501, 12752184, 12786713, 12836975, 12926110, 12926111, 12926112, 12955719, 13336475, 13382319, 13469603, 13469604, 13560202], "trace_timestamp_s": 455.1790000000001, "ttft_s": 18.430479953996837, "turn_id": 1} +{"actual_output_tokens": 520, "cached_tokens": 36624, "effective_input_length": 38252, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38252, "latency_s": 5.712907289969735, "output_length": 520, "proxy_request_id": "1277428:7:1372183:602", "request_id": "1277428:7:1372183:602", "request_type": "coder", "requested_output_tokens": 520, "session_id": "1277428", "t_dispatch_unix": 1779818065.7810555, "t_finish_unix": 1779818071.4939628, "t_first_token_unix": 1779818066.336983, "tpot_s": 0.009935931294756315, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983, 13601623, 13601624, 13601625, 13601626], "trace_timestamp_s": 469.9549999999999, "ttft_s": 0.55592486000387, "turn_id": 7} +{"actual_output_tokens": 104, "cached_tokens": 59328, "effective_input_length": 64531, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64531, "latency_s": 14.840050595987123, "output_length": 104, "proxy_request_id": "1342634:2:1370263:590", "request_id": "1342634:2:1370263:590", "request_type": "coder", "requested_output_tokens": 104, "session_id": "1342634", "t_dispatch_unix": 1779818056.9492393, "t_finish_unix": 1779818071.7892897, "t_first_token_unix": 1779818070.111843, "tpot_s": 0.016282344738233978, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 4565053, 4565054, 4565055, 127456, 127457, 127458, 127459, 4565056, 4565057, 61286, 4565058, 4565059, 4565060, 4565061, 4565062, 4565063, 4565064, 4565065, 4565066, 4565067, 4565068, 4565069, 4565070, 4565071, 4565072, 4565073, 4565074, 4565075, 4565076, 4565077, 4565078, 4565079, 4565080, 4565081, 4565082, 4565083, 4565084, 4565085, 4565086, 4565087, 4565088, 4565089, 13036298, 13036299, 13036300, 13036301, 13036302, 13036303, 13036304, 13036305, 13036306, 13036307, 13036308, 13036309, 13036310, 13036311, 13036312, 13036313, 13036314, 13036315, 13036316, 13036317, 13036318, 13036319, 13036320, 13036321, 13036322, 13036323, 13036324, 13036325, 13036326, 13036327, 13036328, 13036329, 13036330, 13036331, 13036332, 13036333, 13036334, 13036335, 13036336, 13036337, 13068093, 13326543, 13326544, 13326545, 13326546, 13326547, 13326548, 13326549, 13326550, 13326551, 13326552, 13326553, 13326554, 13326555, 13326556, 13326557, 13326558, 13326559, 13326560, 13326561, 13326562, 13326563, 13326564, 13326565, 13326566, 13326567, 13326568, 13326569, 13326570, 13582003, 13582004, 13582005, 13582006, 13582007, 13582008, 13582009, 13582010, 13582011, 13582012, 13582013], "trace_timestamp_s": 463.1940000000004, "ttft_s": 13.162600263953209, "turn_id": 2} +{"actual_output_tokens": 153, "cached_tokens": 13616, "effective_input_length": 14721, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14721, "latency_s": 34.08979973301757, "output_length": 153, "proxy_request_id": "1357132:2:1364990:550", "request_id": "1357132:2:1364990:550", "request_type": "coder", "requested_output_tokens": 153, "session_id": "1357132", "t_dispatch_unix": 1779818038.3216796, "t_finish_unix": 1779818072.4114792, "t_first_token_unix": 1779818069.5599182, "tpot_s": 0.018757621598763905, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13533536], "trace_timestamp_s": 444.5690000000004, "ttft_s": 31.238236938021146, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 14800, "effective_input_length": 14816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14816, "latency_s": 0.39070270798401907, "output_length": 27, "proxy_request_id": "1357132:3:1366582:557", "request_id": "1357132:3:1366582:557", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1357132", "t_dispatch_unix": 1779818072.4122705, "t_finish_unix": 1779818072.8029735, "t_first_token_unix": 1779818072.4799278, "tpot_s": 0.012411926078269832, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710], "trace_timestamp_s": 450.241, "ttft_s": 0.06765532097779214, "turn_id": 3} +{"actual_output_tokens": 33, "cached_tokens": 14832, "effective_input_length": 14949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14949, "latency_s": 0.49535542802186683, "output_length": 33, "proxy_request_id": "1357132:4:1367654:570", "request_id": "1357132:4:1367654:570", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1357132", "t_dispatch_unix": 1779818072.8037293, "t_finish_unix": 1779818073.2990854, "t_first_token_unix": 1779818072.894218, "tpot_s": 0.012640404595003929, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710, 13557420], "trace_timestamp_s": 454.02500000000055, "ttft_s": 0.09048721101135015, "turn_id": 4} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 18497, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18497, "latency_s": 2.1300002450007014, "output_length": 38, "proxy_request_id": "1374465:1:1374465:613", "request_id": "1374465:1:1374465:613", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1374465", "t_dispatch_unix": 1779818071.6996655, "t_finish_unix": 1779818073.8296661, "t_first_token_unix": 1779818073.5441926, "tpot_s": 0.00770331486411443, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867], "trace_timestamp_s": 477.942, "ttft_s": 1.8445246430346742, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 14976, "effective_input_length": 15871, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15871, "latency_s": 0.6967484799679369, "output_length": 32, "proxy_request_id": "1357132:5:1368445:579", "request_id": "1357132:5:1368445:579", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1357132", "t_dispatch_unix": 1779818073.3001795, "t_finish_unix": 1779818073.996928, "t_first_token_unix": 1779818073.609356, "tpot_s": 0.012489459387237025, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710, 13564577, 13564578], "trace_timestamp_s": 457.0070000000005, "ttft_s": 0.30917434295406565, "turn_id": 5} +{"actual_output_tokens": 65, "cached_tokens": 0, "effective_input_length": 19862, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19862, "latency_s": 3.031406774010975, "output_length": 65, "proxy_request_id": "1374347:1:1374347:611", "request_id": "1374347:1:1374347:611", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1374347", "t_dispatch_unix": 1779818071.2587495, "t_finish_unix": 1779818074.2901561, "t_first_token_unix": 1779818073.3323393, "tpot_s": 0.01496105671958503, "trace_hash_ids": [13586651, 13586652, 13586653, 13586654, 13586655, 13586656, 13586657, 13586658, 13586659, 13586660, 13586661, 13586662, 13586663, 13586664, 13586665, 13586666, 13586667, 13586668, 13586669, 13586670, 13586671, 13598853, 13598854, 13598855, 13598856, 13598857, 13598858, 13598859, 13598860, 13608483, 13608484, 13608485, 13608486, 13608487, 13619670, 13619671, 13619672, 13619673, 13619674], "trace_timestamp_s": 477.5, "ttft_s": 2.0735881949658506, "turn_id": 1} +{"actual_output_tokens": 288, "cached_tokens": 20240, "effective_input_length": 22992, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22992, "latency_s": 4.41328183200676, "output_length": 288, "proxy_request_id": "1355484:7:1371284:596", "request_id": "1355484:7:1371284:596", "request_type": "coder", "requested_output_tokens": 288, "session_id": "1355484", "t_dispatch_unix": 1779818070.1777027, "t_finish_unix": 1779818074.5909839, "t_first_token_unix": 1779818070.69967, "tpot_s": 0.013557518745581084, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13592323], "trace_timestamp_s": 466.6750000000002, "ttft_s": 0.5219651689985767, "turn_id": 7} +{"actual_output_tokens": 614, "cached_tokens": 0, "effective_input_length": 117888, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117888, "latency_s": 54.88263495004503, "output_length": 614, "proxy_request_id": "1360649:1:1360649:527", "request_id": "1360649:1:1360649:527", "request_type": "coder", "requested_output_tokens": 614, "session_id": "1360649", "t_dispatch_unix": 1779818023.2607505, "t_finish_unix": 1779818078.1433852, "t_first_token_unix": 1779818069.6372278, "tpot_s": 0.013875861000041758, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 102342, 102343, 102344, 102345, 102346, 102347, 102348, 102349, 102350, 102351, 1097540, 1097541, 1097542, 1097543, 1097544, 1097545, 1097546, 1097547, 1097548, 1097549, 1097550, 1097551, 1097552, 2097078, 2097079, 2097080, 6400718, 6400719, 6400720, 6400721, 6400722, 6400723, 6400724, 6400725, 6400726, 6400727, 6400728, 6400729, 6400730, 6400731, 6400732, 6400733, 6400734, 6400735, 6400736, 6400737, 6400738, 6400739, 6400740, 6400741, 6400742, 6400743, 6400744, 6400745, 6400746, 6400747, 6400748, 6400749, 6400750, 6400751, 6400752, 6400753, 6400754, 6400755, 6400756, 6400757, 8009133, 8009134, 8009135, 8009136, 8009137, 8009138, 8009139, 8009140, 8009141, 8009142, 8009143, 8009144, 8009145, 8009146, 8009147, 8009148, 8009149, 8009150, 8009151, 8348761, 8348762, 9534642, 9534643, 9534644, 9534645, 9534646, 9534647, 9534648, 9534649, 9534650, 9534651, 9534652, 9534653, 9534654, 9868654, 9868655, 9868656, 10214275, 10214276, 10214277, 10237087, 10237088, 10237089, 10271265, 10271266, 10765786, 10765787, 10765788, 10765789, 10765790, 10765791, 10765792, 10795530, 10795531, 10795532, 10876221, 10876222, 10876223, 11181494, 11232572, 11232573, 11277307, 11277308, 11298127, 11298128, 11298129, 11490882, 11490883, 11490884, 11490885, 12220320, 12220321, 12220322, 12220323, 12220324, 12220325, 12220326, 12220327, 12241076, 12241077, 12241078, 12241079, 12241080, 12241081, 12703418, 12703419, 12703420, 12703421, 12703422, 12703423, 12703424, 12703425, 12703426, 12703427, 12703428, 12703429, 12773085, 12833183, 12857953, 12905536, 12905537, 12905538, 12948771, 12948772, 13065333, 13065334, 13102786, 13102787, 13102788, 13102789, 13121628, 13174865, 13174866, 13240785, 13240786, 13240787, 13311934, 13311935, 13311936, 13468170, 13468171, 13493539, 13493540, 13493541, 13493542, 13493543, 13493544, 13493545, 13493546, 13493547, 13493548, 13493549, 13493550, 13493551, 13493552, 13493553, 13493554, 13493555, 13493556, 13493557, 13493558, 13493559, 13493560, 13493561, 13493562, 13493563, 13493564, 13493565, 13493566, 13493567, 13493568, 13493569, 13493570, 13493571, 13493572, 13493573, 13493574], "trace_timestamp_s": 429.46200000000044, "ttft_s": 46.3764750030241, "turn_id": 1} +{"actual_output_tokens": 120, "cached_tokens": 118496, "effective_input_length": 119052, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119052, "latency_s": 1.9161327389883809, "output_length": 120, "proxy_request_id": "1360649:2:1367022:561", "request_id": "1360649:2:1367022:561", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1360649", "t_dispatch_unix": 1779818078.1660595, "t_finish_unix": 1779818080.082192, "t_first_token_unix": 1779818078.806366, "tpot_s": 0.010718559378175018, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 102342, 102343, 102344, 102345, 102346, 102347, 102348, 102349, 102350, 102351, 1097540, 1097541, 1097542, 1097543, 1097544, 1097545, 1097546, 1097547, 1097548, 1097549, 1097550, 1097551, 1097552, 2097078, 2097079, 2097080, 6400718, 6400719, 6400720, 6400721, 6400722, 6400723, 6400724, 6400725, 6400726, 6400727, 6400728, 6400729, 6400730, 6400731, 6400732, 6400733, 6400734, 6400735, 6400736, 6400737, 6400738, 6400739, 6400740, 6400741, 6400742, 6400743, 6400744, 6400745, 6400746, 6400747, 6400748, 6400749, 6400750, 6400751, 6400752, 6400753, 6400754, 6400755, 6400756, 6400757, 8009133, 8009134, 8009135, 8009136, 8009137, 8009138, 8009139, 8009140, 8009141, 8009142, 8009143, 8009144, 8009145, 8009146, 8009147, 8009148, 8009149, 8009150, 8009151, 8348761, 8348762, 9534642, 9534643, 9534644, 9534645, 9534646, 9534647, 9534648, 9534649, 9534650, 9534651, 9534652, 9534653, 9534654, 9868654, 9868655, 9868656, 10214275, 10214276, 10214277, 10237087, 10237088, 10237089, 10271265, 10271266, 10765786, 10765787, 10765788, 10765789, 10765790, 10765791, 10765792, 10795530, 10795531, 10795532, 10876221, 10876222, 10876223, 11181494, 11232572, 11232573, 11277307, 11277308, 11298127, 11298128, 11298129, 11490882, 11490883, 11490884, 11490885, 12220320, 12220321, 12220322, 12220323, 12220324, 12220325, 12220326, 12220327, 12241076, 12241077, 12241078, 12241079, 12241080, 12241081, 12703418, 12703419, 12703420, 12703421, 12703422, 12703423, 12703424, 12703425, 12703426, 12703427, 12703428, 12703429, 12773085, 12833183, 12857953, 12905536, 12905537, 12905538, 12948771, 12948772, 13065333, 13065334, 13102786, 13102787, 13102788, 13102789, 13121628, 13174865, 13174866, 13240785, 13240786, 13240787, 13311934, 13311935, 13311936, 13468170, 13468171, 13493539, 13551893, 13551894, 13551895, 13551896, 13551897, 13551898, 13551899, 13551900, 13551901, 13551902, 13551903, 13551904, 13551905, 13551906, 13551907, 13551908, 13551909, 13551910, 13551911, 13551912, 13551913, 13551914, 13551915, 13551916, 13551917, 13551918, 13551919, 13551920, 13551921, 13551922, 13551923, 13551924, 13551925, 13551926, 13551927, 13551928, 13551929], "trace_timestamp_s": 451.77600000000075, "ttft_s": 0.6403048950014636, "turn_id": 2} +{"actual_output_tokens": 2009, "cached_tokens": 98224, "effective_input_length": 98267, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98267, "latency_s": 38.507241627026815, "output_length": 2009, "proxy_request_id": "1279412:25:1366203:554", "request_id": "1279412:25:1366203:554", "request_type": "coder", "requested_output_tokens": 2009, "session_id": "1279412", "t_dispatch_unix": 1779818042.6250765, "t_finish_unix": 1779818081.132318, "t_first_token_unix": 1779818042.846379, "tpot_s": 0.019066554354103718, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104], "trace_timestamp_s": 448.8700000000008, "ttft_s": 0.22129937499994412, "turn_id": 25} +{"actual_output_tokens": 956, "cached_tokens": 14480, "effective_input_length": 26705, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26705, "latency_s": 18.89219411695376, "output_length": 956, "proxy_request_id": "1364090:2:1371798:600", "request_id": "1364090:2:1371798:600", "request_type": "coder", "requested_output_tokens": 956, "session_id": "1364090", "t_dispatch_unix": 1779818062.2772653, "t_finish_unix": 1779818081.1694593, "t_first_token_unix": 1779818069.4891393, "tpot_s": 0.012230334136115767, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13597497], "trace_timestamp_s": 468.52000000000044, "ttft_s": 7.2118717129924335, "turn_id": 2} +{"actual_output_tokens": 56, "cached_tokens": 18528, "effective_input_length": 21588, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21588, "latency_s": 3.639884698030073, "output_length": 56, "proxy_request_id": "1374465:2:1376358:620", "request_id": "1374465:2:1376358:620", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1374465", "t_dispatch_unix": 1779818078.1021745, "t_finish_unix": 1779818081.742059, "t_first_token_unix": 1779818078.6467047, "tpot_s": 0.056274476781783794, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867, 13637304, 5578065, 5578066, 5578067, 5578068, 5578069], "trace_timestamp_s": 484.35000000000036, "ttft_s": 0.5445279860286973, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 0, "effective_input_length": 24323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24323, "latency_s": 3.430208649020642, "output_length": 98, "proxy_request_id": "1371337:2:1376534:621", "request_id": "1371337:2:1376534:621", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1371337", "t_dispatch_unix": 1779818078.767071, "t_finish_unix": 1779818082.19728, "t_first_token_unix": 1779818081.5652764, "tpot_s": 0.006512344752428765, "trace_hash_ids": [13566840, 13566841, 13566842, 13566843, 13566844, 13566845, 13566846, 13566847, 13581073, 13592764, 13592765, 13592766, 13592767, 13592768, 13592769, 13592770, 13592771, 13592772, 13602976, 13602977, 13602978, 13602979, 13602980, 13602981, 13602982, 13602983, 13602984, 13611256, 13611257, 13611258, 13611259, 13611260, 13611261, 13611262, 13621634, 13621635, 13621636, 13621637, 13621638, 13621639, 13621640, 13630722, 13630723, 13630724, 13639093, 13639094, 13639095, 13639096], "trace_timestamp_s": 485.0100000000002, "ttft_s": 2.798202832986135, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 0, "effective_input_length": 16241, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16241, "latency_s": 1.6409777009976096, "output_length": 28, "proxy_request_id": "1377061:1:1377061:622", "request_id": "1377061:1:1377061:622", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1377061", "t_dispatch_unix": 1779818080.7304323, "t_finish_unix": 1779818082.37141, "t_first_token_unix": 1779818082.228526, "tpot_s": 0.005282615408456574, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13643801], "trace_timestamp_s": 486.97299999999996, "ttft_s": 1.4980919159715995, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 14851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14851, "latency_s": 1.51480523502687, "output_length": 37, "proxy_request_id": "1372791:2:1377698:624", "request_id": "1372791:2:1377698:624", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1372791", "t_dispatch_unix": 1779818082.9705963, "t_finish_unix": 1779818084.4854007, "t_first_token_unix": 1779818084.295108, "tpot_s": 0.00527938411202437, "trace_hash_ids": [13606288, 13606289, 13606290, 13606291, 13606292, 13606293, 13606294, 13606295, 13606296, 13634971, 13634972, 13634973, 13634974, 13634975, 13634976, 13634977, 13642781, 13642782, 13642783, 13642784, 13642785, 13642786, 13650522, 13650523, 13650524, 13650525, 13650526, 13650527, 13650528, 13650529], "trace_timestamp_s": 489.21500000000015, "ttft_s": 1.3245086270035245, "turn_id": 2} +{"actual_output_tokens": 567, "cached_tokens": 18800, "effective_input_length": 56286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56286, "latency_s": 16.59193466202123, "output_length": 567, "proxy_request_id": "1370129:2:1373467:607", "request_id": "1370129:2:1373467:607", "request_type": "coder", "requested_output_tokens": 567, "session_id": "1370129", "t_dispatch_unix": 1779818068.225713, "t_finish_unix": 1779818084.8176477, "t_first_token_unix": 1779818078.0517638, "tpot_s": 0.011953314764950878, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500], "trace_timestamp_s": 474.45900000000074, "ttft_s": 9.826048317016102, "turn_id": 2} +{"actual_output_tokens": 228, "cached_tokens": 23264, "effective_input_length": 23457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23457, "latency_s": 1.5073397500091232, "output_length": 228, "proxy_request_id": "1355484:8:1377993:625", "request_id": "1355484:8:1377993:625", "request_type": "coder", "requested_output_tokens": 228, "session_id": "1355484", "t_dispatch_unix": 1779818083.9504986, "t_finish_unix": 1779818085.457838, "t_first_token_unix": 1779818084.0617692, "tpot_s": 0.006148988299486166, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13653201], "trace_timestamp_s": 490.1980000000003, "ttft_s": 0.11126896901987493, "turn_id": 8} +{"actual_output_tokens": 15, "cached_tokens": 16256, "effective_input_length": 16515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16515, "latency_s": 0.35675632604397833, "output_length": 15, "proxy_request_id": "1377061:2:1378590:631", "request_id": "1377061:2:1378590:631", "request_type": "coder", "requested_output_tokens": 15, "session_id": "1377061", "t_dispatch_unix": 1779818086.0000105, "t_finish_unix": 1779818086.3567665, "t_first_token_unix": 1779818086.2752464, "tpot_s": 0.005804882214371381, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13658414, 13658415], "trace_timestamp_s": 492.2480000000005, "ttft_s": 0.2752345080371015, "turn_id": 2} +{"actual_output_tokens": 135, "cached_tokens": 100272, "effective_input_length": 100340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100340, "latency_s": 1.9278962090029381, "output_length": 135, "proxy_request_id": "1279412:26:1378269:628", "request_id": "1279412:26:1378269:628", "request_type": "coder", "requested_output_tokens": 135, "session_id": "1279412", "t_dispatch_unix": 1779818084.8854725, "t_finish_unix": 1779818086.8133686, "t_first_token_unix": 1779818085.137529, "tpot_s": 0.012503623074518322, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367], "trace_timestamp_s": 491.1310000000003, "ttft_s": 0.25205376400845125, "turn_id": 26} +{"actual_output_tokens": 52, "cached_tokens": 0, "effective_input_length": 7810, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7810, "latency_s": 0.8111675049876794, "output_length": 52, "proxy_request_id": "1378684:1:1378684:632", "request_id": "1378684:1:1378684:632", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1378684", "t_dispatch_unix": 1779818086.336709, "t_finish_unix": 1779818087.147877, "t_first_token_unix": 1779818086.8844323, "tpot_s": 0.005160041195660026, "trace_hash_ids": [13630792, 13630793, 13630794, 13630795, 13645188, 13645189, 13645190, 13645191, 13659421, 13659422, 13659423, 13659424, 13659425, 13659426, 13659427, 13659428], "trace_timestamp_s": 492.58300000000054, "ttft_s": 0.5477221250184812, "turn_id": 1} +{"actual_output_tokens": 206, "cached_tokens": 0, "effective_input_length": 5458, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5458, "latency_s": 1.4971149389748462, "output_length": 206, "proxy_request_id": "1378543:1:1378543:630", "request_id": "1378543:1:1378543:630", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1378543", "t_dispatch_unix": 1779818085.844649, "t_finish_unix": 1779818087.3417635, "t_first_token_unix": 1779818086.2053585, "tpot_s": 0.005542149165895109, "trace_hash_ids": [13642933, 13642934, 13642935, 13642936, 13652140, 13652141, 13657982, 13657983, 13657984, 13657985, 13657986], "trace_timestamp_s": 492.09200000000055, "ttft_s": 0.3607084109680727, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 1422, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1422, "latency_s": 0.4294059830135666, "output_length": 38, "proxy_request_id": "1379185:1:1379185:634", "request_id": "1379185:1:1379185:634", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1379185", "t_dispatch_unix": 1779818088.0566957, "t_finish_unix": 1779818088.4861019, "t_first_token_unix": 1779818088.205141, "tpot_s": 0.007585479918791837, "trace_hash_ids": [13664231, 13664232, 13664233], "trace_timestamp_s": 494.3050000000003, "ttft_s": 0.1484443570370786, "turn_id": 1} +{"actual_output_tokens": 87, "cached_tokens": 0, "effective_input_length": 2632, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2632, "latency_s": 0.6058235510136001, "output_length": 87, "proxy_request_id": "1379569:1:1379569:638", "request_id": "1379569:1:1379569:638", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1379569", "t_dispatch_unix": 1779818089.2863157, "t_finish_unix": 1779818089.8921394, "t_first_token_unix": 1779818089.4584513, "tpot_s": 0.005039309546741289, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13667379], "trace_timestamp_s": 495.53400000000056, "ttft_s": 0.17213380697648972, "turn_id": 1} +{"actual_output_tokens": 20, "cached_tokens": 16528, "effective_input_length": 17368, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17368, "latency_s": 0.2785000670119189, "output_length": 20, "proxy_request_id": "1377061:3:1380174:641", "request_id": "1377061:3:1380174:641", "request_type": "coder", "requested_output_tokens": 20, "session_id": "1377061", "t_dispatch_unix": 1779818091.4053385, "t_finish_unix": 1779818091.6838386, "t_first_token_unix": 1779818091.5898068, "tpot_s": 0.004934450262226164, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13658414, 13666839, 13672311], "trace_timestamp_s": 497.65400000000045, "ttft_s": 0.18446648702956736, "turn_id": 3} +{"actual_output_tokens": 55, "cached_tokens": 37312, "effective_input_length": 38041, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38041, "latency_s": 15.504678424971644, "output_length": 55, "proxy_request_id": "1355951:3:1375866:619", "request_id": "1355951:3:1375866:619", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1355951", "t_dispatch_unix": 1779818076.6421459, "t_finish_unix": 1779818092.1468234, "t_first_token_unix": 1779818090.1786163, "tpot_s": 0.03644337772210646, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 482.8890000000001, "ttft_s": 13.536469565995503, "turn_id": 3} +{"actual_output_tokens": 2, "cached_tokens": 5312, "effective_input_length": 5314, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5314, "latency_s": 0.029337547020986676, "output_length": 2, "proxy_request_id": "1378543:2:1380447:644", "request_id": "1378543:2:1380447:644", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1378543", "t_dispatch_unix": 1779818092.3234944, "t_finish_unix": 1779818092.3528318, "t_first_token_unix": 1779818092.3524864, "tpot_s": 0.00012103200424462557, "trace_hash_ids": [13674795, 13674796, 13674797, 13674798, 13674799, 13674800, 13674801, 13674802, 13674803, 13674804, 13674805], "trace_timestamp_s": 498.5710000000008, "ttft_s": 0.028990704042371362, "turn_id": 2} +{"actual_output_tokens": 117, "cached_tokens": 2704, "effective_input_length": 6767, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6767, "latency_s": 0.9339230100158602, "output_length": 117, "proxy_request_id": "1379569:2:1380473:645", "request_id": "1379569:2:1380473:645", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1379569", "t_dispatch_unix": 1779818092.4706094, "t_finish_unix": 1779818093.4045324, "t_first_token_unix": 1779818092.7944098, "tpot_s": 0.005257629603247865, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13674978], "trace_timestamp_s": 498.71800000000076, "ttft_s": 0.323798515019007, "turn_id": 2} +{"actual_output_tokens": 5258, "cached_tokens": 78496, "effective_input_length": 80246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80246, "latency_s": 76.62994067498948, "output_length": 5258, "proxy_request_id": "1269373:22:1358956:522", "request_id": "1269373:22:1358956:522", "request_type": "coder", "requested_output_tokens": 5258, "session_id": "1269373", "t_dispatch_unix": 1779818017.1477354, "t_finish_unix": 1779818093.7776752, "t_first_token_unix": 1779818018.2263148, "tpot_s": 0.01437152315294595, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385, 13476943, 13476944, 13476945, 13476946, 13476947], "trace_timestamp_s": 423.39200000000073, "ttft_s": 1.0785772759700194, "turn_id": 22} +{"actual_output_tokens": 181, "cached_tokens": 18480, "effective_input_length": 18676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18676, "latency_s": 25.149462778004818, "output_length": 181, "proxy_request_id": "1363943:5:1373637:609", "request_id": "1363943:5:1373637:609", "request_type": "coder", "requested_output_tokens": 181, "session_id": "1363943", "t_dispatch_unix": 1779818068.8166192, "t_finish_unix": 1779818093.9660814, "t_first_token_unix": 1779818090.171682, "tpot_s": 0.021077799427762833, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13613147], "trace_timestamp_s": 475.0650000000005, "ttft_s": 21.355061202018987, "turn_id": 5} +{"actual_output_tokens": 302, "cached_tokens": 15792, "effective_input_length": 22132, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22132, "latency_s": 11.328243530006148, "output_length": 302, "proxy_request_id": "1286804:4:1378156:627", "request_id": "1286804:4:1378156:627", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1286804", "t_dispatch_unix": 1779818084.4753306, "t_finish_unix": 1779818095.8035736, "t_first_token_unix": 1779818091.024992, "tpot_s": 0.01587459366119612, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13654392, 13654393, 13654394, 13654395, 13654396, 13654397, 13654398, 13654399, 13654400, 13654401, 13654402, 13654403, 13654404, 13654405], "trace_timestamp_s": 490.72100000000046, "ttft_s": 6.5496600570040755, "turn_id": 4} +{"actual_output_tokens": 195, "cached_tokens": 100464, "effective_input_length": 100538, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100538, "latency_s": 2.700988001015503, "output_length": 195, "proxy_request_id": "1279412:27:1380696:646", "request_id": "1279412:27:1380696:646", "request_type": "coder", "requested_output_tokens": 195, "session_id": "1279412", "t_dispatch_unix": 1779818093.3363075, "t_finish_unix": 1779818096.0372949, "t_first_token_unix": 1779818093.5876071, "tpot_s": 0.012626041025739432, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13677275], "trace_timestamp_s": 499.58100000000013, "ttft_s": 0.25129800505237654, "turn_id": 27} +{"actual_output_tokens": 160, "cached_tokens": 18848, "effective_input_length": 19116, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19116, "latency_s": 2.354491508041974, "output_length": 160, "proxy_request_id": "1363943:6:1375416:618", "request_id": "1363943:6:1375416:618", "request_type": "coder", "requested_output_tokens": 160, "session_id": "1363943", "t_dispatch_unix": 1779818093.967307, "t_finish_unix": 1779818096.3217986, "t_first_token_unix": 1779818094.1113582, "tpot_s": 0.013899088773507415, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13629311], "trace_timestamp_s": 481.2580000000007, "ttft_s": 0.14404886501142755, "turn_id": 6} +{"actual_output_tokens": 96, "cached_tokens": 6880, "effective_input_length": 7620, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7620, "latency_s": 0.6149810289498419, "output_length": 96, "proxy_request_id": "1379569:3:1381510:649", "request_id": "1379569:3:1381510:649", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1379569", "t_dispatch_unix": 1779818096.098318, "t_finish_unix": 1779818096.7132995, "t_first_token_unix": 1779818096.2131956, "tpot_s": 0.005261011178433699, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13685191, 13685192], "trace_timestamp_s": 502.34700000000066, "ttft_s": 0.11487613100325689, "turn_id": 3} +{"actual_output_tokens": 370, "cached_tokens": 60816, "effective_input_length": 105902, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105902, "latency_s": 30.469771280011628, "output_length": 370, "proxy_request_id": "1313181:5:1320817:349", "request_id": "1313181:5:1320817:349", "request_type": "coder", "requested_output_tokens": 370, "session_id": "1313181", "t_dispatch_unix": 1779818066.4306078, "t_finish_unix": 1779818096.9003787, "t_first_token_unix": 1779818090.1908884, "tpot_s": 0.018182255585298072, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275], "trace_timestamp_s": 289.299, "ttft_s": 23.76027868402889, "turn_id": 5} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 1391, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1391, "latency_s": 0.24966299900552258, "output_length": 31, "proxy_request_id": "1381728:1:1381728:651", "request_id": "1381728:1:1381728:651", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1381728", "t_dispatch_unix": 1779818097.004701, "t_finish_unix": 1779818097.2543643, "t_first_token_unix": 1779818097.1099508, "tpot_s": 0.004805505333933979, "trace_hash_ids": [13687007, 13687008, 13687009], "trace_timestamp_s": 503.2530000000006, "ttft_s": 0.10524845798499882, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 10304, "effective_input_length": 10645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10645, "latency_s": 0.6953735479619354, "output_length": 42, "proxy_request_id": "1362265:4:1381673:650", "request_id": "1362265:4:1381673:650", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1362265", "t_dispatch_unix": 1779818096.7815824, "t_finish_unix": 1779818097.4769554, "t_first_token_unix": 1779818096.8941422, "tpot_s": 0.014206195805255869, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588], "trace_timestamp_s": 503.03000000000065, "ttft_s": 0.11255887796869501, "turn_id": 4} +{"actual_output_tokens": 189, "cached_tokens": 19264, "effective_input_length": 20727, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20727, "latency_s": 2.3364269390003756, "output_length": 189, "proxy_request_id": "1363943:7:1377305:623", "request_id": "1363943:7:1377305:623", "request_type": "coder", "requested_output_tokens": 189, "session_id": "1363943", "t_dispatch_unix": 1779818096.3233385, "t_finish_unix": 1779818098.6597655, "t_first_token_unix": 1779818096.6350331, "tpot_s": 0.010767975760477675, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13646868], "trace_timestamp_s": 487.90300000000025, "ttft_s": 0.31169201200827956, "turn_id": 7} +{"actual_output_tokens": 33, "cached_tokens": 35072, "effective_input_length": 46764, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46764, "latency_s": 29.33742707199417, "output_length": 33, "proxy_request_id": "1366128:5:1373829:610", "request_id": "1366128:5:1373829:610", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1366128", "t_dispatch_unix": 1779818069.4680295, "t_finish_unix": 1779818098.805456, "t_first_token_unix": 1779818093.6493294, "tpot_s": 0.16112173756300763, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13614741], "trace_timestamp_s": 475.71100000000024, "ttft_s": 24.1812986729783, "turn_id": 5} +{"actual_output_tokens": 633, "cached_tokens": 56848, "effective_input_length": 61457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61457, "latency_s": 9.903326530009508, "output_length": 633, "proxy_request_id": "1370129:3:1379538:637", "request_id": "1370129:3:1379538:637", "request_type": "coder", "requested_output_tokens": 633, "session_id": "1370129", "t_dispatch_unix": 1779818089.1729379, "t_finish_unix": 1779818099.076264, "t_first_token_unix": 1779818090.9998066, "tpot_s": 0.012778582666168738, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13667066], "trace_timestamp_s": 495.41600000000017, "ttft_s": 1.8268666110234335, "turn_id": 3} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 3034, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3034, "latency_s": 0.6464167840313166, "output_length": 32, "proxy_request_id": "1382294:1:1382294:656", "request_id": "1382294:1:1382294:656", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1382294", "t_dispatch_unix": 1779818099.0077603, "t_finish_unix": 1779818099.6541774, "t_first_token_unix": 1779818099.2847161, "tpot_s": 0.011905286613205869, "trace_hash_ids": [13692603, 13692604, 13692605, 13692606, 13692607, 13692608], "trace_timestamp_s": 505.2550000000001, "ttft_s": 0.2769544629845768, "turn_id": 1} +{"actual_output_tokens": 1861, "cached_tokens": 63392, "effective_input_length": 63536, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63536, "latency_s": 28.88055948197143, "output_length": 1861, "proxy_request_id": "1363093:3:1374394:612", "request_id": "1363093:3:1374394:612", "request_type": "coder", "requested_output_tokens": 1861, "session_id": "1363093", "t_dispatch_unix": 1779818071.4077973, "t_finish_unix": 1779818100.2883568, "t_first_token_unix": 1779818078.0588725, "tpot_s": 0.011951177413963402, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062], "trace_timestamp_s": 477.65500000000065, "ttft_s": 6.651072454988025, "turn_id": 3} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 1955, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1955, "latency_s": 0.4066289709880948, "output_length": 47, "proxy_request_id": "1382667:1:1382667:658", "request_id": "1382667:1:1382667:658", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1382667", "t_dispatch_unix": 1779818100.423753, "t_finish_unix": 1779818100.8303816, "t_first_token_unix": 1779818100.552806, "tpot_s": 0.006028048695399142, "trace_hash_ids": [13695912, 13695913, 13695914, 13695915], "trace_timestamp_s": 506.6720000000005, "ttft_s": 0.1290513729909435, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 627, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 627, "latency_s": 0.23351906397147104, "output_length": 35, "proxy_request_id": "1382804:1:1382804:660", "request_id": "1382804:1:1382804:660", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1382804", "t_dispatch_unix": 1779818100.7521951, "t_finish_unix": 1779818100.9857142, "t_first_token_unix": 1779818100.819635, "tpot_s": 0.004875472616678213, "trace_hash_ids": [13696917, 13696918], "trace_timestamp_s": 507.0010000000002, "ttft_s": 0.06743917899439111, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 3190, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3190, "latency_s": 0.5812801640131511, "output_length": 26, "proxy_request_id": "1382710:1:1382710:659", "request_id": "1382710:1:1382710:659", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1382710", "t_dispatch_unix": 1779818100.5231473, "t_finish_unix": 1779818101.1044276, "t_first_token_unix": 1779818100.805557, "tpot_s": 0.011943534039892257, "trace_hash_ids": [13684985, 13690307, 13696041, 13696042, 13696043, 13696044, 13696045], "trace_timestamp_s": 506.77000000000044, "ttft_s": 0.28240850201109424, "turn_id": 1} +{"actual_output_tokens": 48, "cached_tokens": 3056, "effective_input_length": 5164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5164, "latency_s": 0.8579595689661801, "output_length": 48, "proxy_request_id": "1382294:2:1383073:664", "request_id": "1382294:2:1383073:664", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1382294", "t_dispatch_unix": 1779818101.6190279, "t_finish_unix": 1779818102.4769871, "t_first_token_unix": 1779818101.9024174, "tpot_s": 0.012218239616870167, "trace_hash_ids": [13692603, 13692604, 13692605, 13692606, 13692607, 13692608, 13699684, 13699685, 13699686, 13699687, 13699688], "trace_timestamp_s": 507.8670000000002, "ttft_s": 0.2833883799612522, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 9305, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9305, "latency_s": 1.0219319490133785, "output_length": 46, "proxy_request_id": "1383090:1:1383090:665", "request_id": "1383090:1:1383090:665", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1383090", "t_dispatch_unix": 1779818101.6600826, "t_finish_unix": 1779818102.6820147, "t_first_token_unix": 1779818102.4121296, "tpot_s": 0.005988135556172993, "trace_hash_ids": [13676594, 13676595, 13676596, 13676597, 13676598, 13676599, 13676600, 13684524, 13684525, 13684526, 13684527, 13693279, 13693280, 13693281, 13693282, 13693283, 13699848, 13699849, 13699850], "trace_timestamp_s": 507.90599999999995, "ttft_s": 0.7520448829745874, "turn_id": 1} +{"actual_output_tokens": 53, "cached_tokens": 0, "effective_input_length": 5135, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5135, "latency_s": 1.3066026319866069, "output_length": 53, "proxy_request_id": "1383009:1:1383009:663", "request_id": "1383009:1:1383009:663", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1383009", "t_dispatch_unix": 1779818101.3946903, "t_finish_unix": 1779818102.7012928, "t_first_token_unix": 1779818101.7279863, "tpot_s": 0.018712182018834237, "trace_hash_ids": [13680021, 13680022, 13690856, 13690857, 13690858, 13690859, 13690860, 13690861, 13690862, 13698936, 13698937], "trace_timestamp_s": 507.64200000000073, "ttft_s": 0.33329517900710925, "turn_id": 1} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 57656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57656, "latency_s": 14.8785807149834, "output_length": 57, "proxy_request_id": "1263749:2:1379302:636", "request_id": "1263749:2:1379302:636", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1263749", "t_dispatch_unix": 1779818088.5289586, "t_finish_unix": 1779818103.4075391, "t_first_token_unix": 1779818102.136044, "tpot_s": 0.02269729378583309, "trace_hash_ids": [51262, 61305, 61306, 637504, 637505, 637506, 637507, 637508, 637509, 637510, 637511, 637512, 637513, 637514, 637515, 637516, 637517, 637518, 637519, 637520, 637521, 637522, 637523, 637524, 637525, 637526, 584014, 637527, 637528, 1022562, 637530, 1022563, 637532, 637533, 248930, 1022564, 4415649, 4415650, 4415651, 12449838, 12449839, 12449840, 12449841, 12449842, 12449843, 12449844, 12449845, 12449846, 12449847, 12449848, 12449849, 12449850, 12449851, 12449852, 12449853, 12449854, 12449855, 12449856, 12449857, 12449858, 12449859, 12449860, 12449861, 12449862, 12449863, 12449864, 12449865, 12449866, 12449867, 12449868, 12449869, 12449870, 12449871, 12449872, 12449873, 12449874, 12449875, 12449876, 12449877, 12449878, 12449879, 12449880, 12449881, 12449882, 12449883, 12449884, 12449885, 12449886, 12449887, 12449888, 12449889, 12449890, 12449891, 12449892, 12449893, 12449894, 12449895, 12449896, 12449897, 12553020, 12553021, 12553022, 12553023, 12553024, 12553025, 12553026, 12553027, 12553028, 12553029, 12553030, 12911454, 13469821, 13639785], "trace_timestamp_s": 494.77500000000055, "ttft_s": 13.607082833943423, "turn_id": 2} +{"actual_output_tokens": 267, "cached_tokens": 0, "effective_input_length": 13989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13989, "latency_s": 8.147215556004085, "output_length": 267, "proxy_request_id": "1381387:1:1381387:648", "request_id": "1381387:1:1381387:648", "request_type": "coder", "requested_output_tokens": 267, "session_id": "1381387", "t_dispatch_unix": 1779818095.6851814, "t_finish_unix": 1779818103.832397, "t_first_token_unix": 1779818096.909212, "tpot_s": 0.026024270541458287, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13684112], "trace_timestamp_s": 501.9280000000008, "ttft_s": 1.224029671982862, "turn_id": 1} +{"actual_output_tokens": 99, "cached_tokens": 21632, "effective_input_length": 30907, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30907, "latency_s": 11.660933103994466, "output_length": 99, "proxy_request_id": "1374465:3:1380413:642", "request_id": "1374465:3:1380413:642", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1374465", "t_dispatch_unix": 1779818092.1961505, "t_finish_unix": 1779818103.8570833, "t_first_token_unix": 1779818102.4486089, "tpot_s": 0.014369878173705988, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867, 13637304, 5578065, 5578066, 5578067, 5578068, 5578069, 13674597, 13674598, 2474295, 13674599, 13674600, 13674601, 13674602, 13674603, 13674604, 13674605, 13674606, 13674607, 13674608, 13674609, 13674610, 13674611, 13674612, 13674613], "trace_timestamp_s": 498.4410000000007, "ttft_s": 10.252456483023707, "turn_id": 3} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 3186, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3186, "latency_s": 0.3321069029625505, "output_length": 27, "proxy_request_id": "1383625:1:1383625:668", "request_id": "1383625:1:1383625:668", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1383625", "t_dispatch_unix": 1779818103.5950425, "t_finish_unix": 1779818103.9271417, "t_first_token_unix": 1779818103.7994468, "tpot_s": 0.004900598806741003, "trace_hash_ids": [13696954, 13704618, 13704619, 13704620, 13704621, 13704622, 13704623], "trace_timestamp_s": 509.84100000000035, "ttft_s": 0.20441012299852446, "turn_id": 1} +{"actual_output_tokens": 131, "cached_tokens": 23680, "effective_input_length": 23717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23717, "latency_s": 14.296335975988768, "output_length": 131, "proxy_request_id": "1355484:9:1379722:640", "request_id": "1355484:9:1379722:640", "request_type": "coder", "requested_output_tokens": 131, "session_id": "1355484", "t_dispatch_unix": 1779818089.7989786, "t_finish_unix": 1779818104.0953164, "t_first_token_unix": 1779818102.1384003, "tpot_s": 0.015051016284493157, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13668401], "trace_timestamp_s": 496.0470000000005, "ttft_s": 12.339420392992906, "turn_id": 9} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 38111, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38111, "latency_s": 6.306489760987461, "output_length": 25, "proxy_request_id": "1382089:1:1382089:655", "request_id": "1382089:1:1382089:655", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1382089", "t_dispatch_unix": 1779818098.3002503, "t_finish_unix": 1779818104.6067402, "t_first_token_unix": 1779818104.17907, "tpot_s": 0.017804254249009926, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 504.5050000000001, "ttft_s": 5.878817128017545, "turn_id": 1} +{"actual_output_tokens": 57, "cached_tokens": 7712, "effective_input_length": 10217, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10217, "latency_s": 3.0338813249836676, "output_length": 57, "proxy_request_id": "1379569:4:1383116:666", "request_id": "1379569:4:1383116:666", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1379569", "t_dispatch_unix": 1779818101.7515326, "t_finish_unix": 1779818104.785414, "t_first_token_unix": 1779818104.4197335, "tpot_s": 0.006525147875696088, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13685191, 13692448, 13692449, 13699991, 13699992, 13699993, 13699994], "trace_timestamp_s": 507.9990000000007, "ttft_s": 2.6681999039719813, "turn_id": 4} +{"actual_output_tokens": 652, "cached_tokens": 60848, "effective_input_length": 60858, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60858, "latency_s": 7.939780943037476, "output_length": 652, "proxy_request_id": "1313181:5:1374956:615", "request_id": "1313181:5:1374956:615", "request_type": "coder", "requested_output_tokens": 652, "session_id": "1313181", "t_dispatch_unix": 1779818096.9033644, "t_finish_unix": 1779818104.8431454, "t_first_token_unix": 1779818097.0357823, "tpot_s": 0.011992498021554946, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981], "trace_timestamp_s": 479.66400000000067, "ttft_s": 0.13241569400997832, "turn_id": 5} +{"actual_output_tokens": 27, "cached_tokens": 3200, "effective_input_length": 4150, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4150, "latency_s": 0.24135289003606886, "output_length": 27, "proxy_request_id": "1383625:2:1384279:673", "request_id": "1383625:2:1384279:673", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1383625", "t_dispatch_unix": 1779818106.0118544, "t_finish_unix": 1779818106.253207, "t_first_token_unix": 1779818106.1237154, "tpot_s": 0.004968416921866055, "trace_hash_ids": [13696954, 13704618, 13704619, 13704620, 13704621, 13704622, 13709928, 13709929, 13709930], "trace_timestamp_s": 512.2600000000002, "ttft_s": 0.11186012002872303, "turn_id": 2} +{"actual_output_tokens": 212, "cached_tokens": 46784, "effective_input_length": 58511, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58511, "latency_s": 7.503969551005866, "output_length": 212, "proxy_request_id": "1366128:6:1375094:616", "request_id": "1366128:6:1375094:616", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1366128", "t_dispatch_unix": 1779818098.8118227, "t_finish_unix": 1779818106.315792, "t_first_token_unix": 1779818102.9156394, "tpot_s": 0.016113144772621622, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13626307], "trace_timestamp_s": 480.20400000000063, "ttft_s": 4.103814442991279, "turn_id": 6} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 5989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5989, "latency_s": 0.6993516499642283, "output_length": 60, "proxy_request_id": "1382667:2:1384299:674", "request_id": "1382667:2:1384299:674", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1382667", "t_dispatch_unix": 1779818106.075473, "t_finish_unix": 1779818106.7748246, "t_first_token_unix": 1779818106.4745858, "tpot_s": 0.0050843967957485275, "trace_hash_ids": [13695912, 13695913, 13695914, 13703943, 13703944, 13703945, 13703946, 13710107, 13710108, 13710109, 13710110, 13710111], "trace_timestamp_s": 512.3230000000003, "ttft_s": 0.3991112830117345, "turn_id": 2} +{"actual_output_tokens": 99, "cached_tokens": 58720, "effective_input_length": 59007, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59007, "latency_s": 1.8595926989801228, "output_length": 99, "proxy_request_id": "1366128:7:1378071:626", "request_id": "1366128:7:1378071:626", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1366128", "t_dispatch_unix": 1779818106.3187568, "t_finish_unix": 1779818108.1783495, "t_first_token_unix": 1779818106.6105735, "tpot_s": 0.015995354336990536, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13653793], "trace_timestamp_s": 490.46300000000065, "ttft_s": 0.29181375895859674, "turn_id": 7} +{"actual_output_tokens": 387, "cached_tokens": 0, "effective_input_length": 79495, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79495, "latency_s": 40.139796308008954, "output_length": 387, "proxy_request_id": "1373577:1:1373577:608", "request_id": "1373577:1:1373577:608", "request_type": "coder", "requested_output_tokens": 387, "session_id": "1373577", "t_dispatch_unix": 1779818068.6437054, "t_finish_unix": 1779818108.7835011, "t_first_token_unix": 1779818090.610386, "tpot_s": 0.04707965360100289, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13612453], "trace_timestamp_s": 474.8630000000003, "ttft_s": 21.966677817050368, "turn_id": 1} +{"actual_output_tokens": 279, "cached_tokens": 14240, "effective_input_length": 28383, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28383, "latency_s": 5.055996244016569, "output_length": 279, "proxy_request_id": "1381387:2:1383735:669", "request_id": "1381387:2:1383735:669", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1381387", "t_dispatch_unix": 1779818103.9025316, "t_finish_unix": 1779818108.9585276, "t_first_token_unix": 1779818106.3095942, "tpot_s": 0.009526657514490201, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13705337], "trace_timestamp_s": 510.14500000000044, "ttft_s": 2.4070611729985103, "turn_id": 2} +{"actual_output_tokens": 82, "cached_tokens": 59104, "effective_input_length": 59230, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59230, "latency_s": 2.2184755239868537, "output_length": 82, "proxy_request_id": "1366128:8:1380438:643", "request_id": "1366128:8:1380438:643", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1366128", "t_dispatch_unix": 1779818108.1809807, "t_finish_unix": 1779818110.3994565, "t_first_token_unix": 1779818108.3759074, "tpot_s": 0.024978230271149243, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13674751], "trace_timestamp_s": 498.52500000000055, "ttft_s": 0.1949243069975637, "turn_id": 8} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 11113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11113, "latency_s": 2.97159043897409, "output_length": 32, "proxy_request_id": "1383009:2:1384930:679", "request_id": "1383009:2:1384930:679", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1383009", "t_dispatch_unix": 1779818108.0464258, "t_finish_unix": 1779818111.0180168, "t_first_token_unix": 1779818108.9396627, "tpot_s": 0.06703383041988878, "trace_hash_ids": [13680021, 13680022, 13690856, 13690857, 13690858, 13690859, 13690860, 13690861, 13690862, 13698936, 13705525, 13705526, 13705527, 13705528, 13705529, 13705530, 13705531, 13716553, 13716554, 13716555, 13716556, 13716557], "trace_timestamp_s": 514.2930000000006, "ttft_s": 0.8932349889655598, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 19034, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19034, "latency_s": 3.0169713590294123, "output_length": 47, "proxy_request_id": "1384947:1:1384947:680", "request_id": "1384947:1:1384947:680", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1384947", "t_dispatch_unix": 1779818108.1075146, "t_finish_unix": 1779818111.1244862, "t_first_token_unix": 1779818110.8333054, "tpot_s": 0.006323934087286825, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13716768, 13716769, 13716770, 13716771, 13716772, 13716773, 13716774, 13716775, 13716776, 13716777], "trace_timestamp_s": 514.3460000000005, "ttft_s": 2.7257888030144386, "turn_id": 1} +{"actual_output_tokens": 51, "cached_tokens": 59296, "effective_input_length": 59374, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59374, "latency_s": 0.938554166990798, "output_length": 51, "proxy_request_id": "1366128:9:1381799:652", "request_id": "1366128:9:1381799:652", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1366128", "t_dispatch_unix": 1779818110.4022465, "t_finish_unix": 1779818111.3408008, "t_first_token_unix": 1779818110.5734503, "tpot_s": 0.015340749679598958, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389], "trace_timestamp_s": 503.5010000000002, "ttft_s": 0.17120178398909047, "turn_id": 9} +{"actual_output_tokens": 151, "cached_tokens": 0, "effective_input_length": 54012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54012, "latency_s": 13.224937200022396, "output_length": 151, "proxy_request_id": "1382086:1:1382086:654", "request_id": "1382086:1:1382086:654", "request_type": "coder", "requested_output_tokens": 151, "session_id": "1382086", "t_dispatch_unix": 1779818098.294848, "t_finish_unix": 1779818111.519785, "t_first_token_unix": 1779818109.0717275, "tpot_s": 0.016316531133294728, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977], "trace_timestamp_s": 504.4960000000001, "ttft_s": 10.776876766001806, "turn_id": 1} +{"actual_output_tokens": 824, "cached_tokens": 27648, "effective_input_length": 47401, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47401, "latency_s": 14.407668094034307, "output_length": 824, "proxy_request_id": "1364090:3:1381959:653", "request_id": "1364090:3:1381959:653", "request_type": "coder", "requested_output_tokens": 824, "session_id": "1364090", "t_dispatch_unix": 1779818097.782425, "t_finish_unix": 1779818112.1900933, "t_first_token_unix": 1779818102.9376009, "tpot_s": 0.011242035054615874, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13688849], "trace_timestamp_s": 504.02300000000014, "ttft_s": 5.155173636041582, "turn_id": 3} +{"actual_output_tokens": 203, "cached_tokens": 100720, "effective_input_length": 100766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100766, "latency_s": 12.281604460033122, "output_length": 203, "proxy_request_id": "1279412:28:1382526:657", "request_id": "1279412:28:1382526:657", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1279412", "t_dispatch_unix": 1779818099.9143004, "t_finish_unix": 1779818112.1959045, "t_first_token_unix": 1779818109.0842223, "tpot_s": 0.01540299016339151, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899], "trace_timestamp_s": 506.16000000000076, "ttft_s": 9.169918989995494, "turn_id": 28} +{"actual_output_tokens": 66, "cached_tokens": 59424, "effective_input_length": 59506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59506, "latency_s": 1.187671986001078, "output_length": 66, "proxy_request_id": "1366128:10:1382843:661", "request_id": "1366128:10:1382843:661", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1366128", "t_dispatch_unix": 1779818111.343754, "t_finish_unix": 1779818112.5314267, "t_first_token_unix": 1779818111.5271246, "tpot_s": 0.015446425799746066, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13697230], "trace_timestamp_s": 507.1170000000002, "ttft_s": 0.18336775503121316, "turn_id": 10} +{"actual_output_tokens": 73, "cached_tokens": 100960, "effective_input_length": 101200, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101200, "latency_s": 1.2140582220163196, "output_length": 73, "proxy_request_id": "1279412:29:1385688:685", "request_id": "1279412:29:1385688:685", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1279412", "t_dispatch_unix": 1779818112.201182, "t_finish_unix": 1779818113.4152403, "t_first_token_unix": 1779818112.5531504, "tpot_s": 0.011967683096978968, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276], "trace_timestamp_s": 517.1180000000004, "ttft_s": 0.35196655202889815, "turn_id": 29} +{"actual_output_tokens": 8887, "cached_tokens": 15056, "effective_input_length": 21371, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21371, "latency_s": 156.66772527399007, "output_length": 8887, "proxy_request_id": "1336620:3:1339999:443", "request_id": "1336620:3:1339999:443", "request_type": "coder", "requested_output_tokens": 8887, "session_id": "1336620", "t_dispatch_unix": 1779817959.2779899, "t_finish_unix": 1779818115.9457152, "t_first_token_unix": 1779817960.2869616, "tpot_s": 0.01751726584087504, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13287309, 13302600, 13302601, 13302602, 13302603, 13302604, 13302605, 13302606, 13302607, 13302608, 13302609, 13302610, 13302611, 13302612], "trace_timestamp_s": 357.3890000000001, "ttft_s": 1.0089702569530345, "turn_id": 3} +{"actual_output_tokens": 18, "cached_tokens": 1408, "effective_input_length": 12399, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12399, "latency_s": 1.0446009580045938, "output_length": 18, "proxy_request_id": "1381728:2:1387040:690", "request_id": "1381728:2:1387040:690", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1381728", "t_dispatch_unix": 1779818115.3261728, "t_finish_unix": 1779818116.3707736, "t_first_token_unix": 1779818116.289198, "tpot_s": 0.004780791354064336, "trace_hash_ids": [13687007, 13687008, 13696180, 13696181, 13696182, 13696183, 13696184, 13703126, 13703127, 13703128, 13711511, 13711512, 13711513, 13711514, 13721898, 13721899, 13721900, 13721901, 13721902, 13729312, 13729313, 13729314, 13729315, 13735232, 13735233], "trace_timestamp_s": 521.5710000000008, "ttft_s": 0.9630228449823335, "turn_id": 2} +{"actual_output_tokens": 81, "cached_tokens": 101264, "effective_input_length": 101396, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101396, "latency_s": 1.0254504390177317, "output_length": 81, "proxy_request_id": "1279412:30:1387344:694", "request_id": "1279412:30:1387344:694", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1279412", "t_dispatch_unix": 1779818116.4453063, "t_finish_unix": 1779818117.470757, "t_first_token_unix": 1779818116.7041054, "tpot_s": 0.009579005850537215, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276, 13738467], "trace_timestamp_s": 522.6910000000007, "ttft_s": 0.25879500596784055, "turn_id": 30} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 4690, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4690, "latency_s": 11.952207526017446, "output_length": 27, "proxy_request_id": "1384772:1:1384772:677", "request_id": "1384772:1:1384772:677", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1384772", "t_dispatch_unix": 1779818107.5386834, "t_finish_unix": 1779818119.4908903, "t_first_token_unix": 1779818107.8422217, "tpot_s": 0.4480103513834855, "trace_hash_ids": [13696008, 13696009, 13702186, 13702187, 13702188, 13702189, 13702190, 13707543, 13707544, 13714402], "trace_timestamp_s": 513.7860000000001, "ttft_s": 0.3035377580090426, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 9344, "effective_input_length": 16734, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16734, "latency_s": 10.4903467479744, "output_length": 46, "proxy_request_id": "1383090:2:1385262:682", "request_id": "1383090:2:1385262:682", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1383090", "t_dispatch_unix": 1779818109.2961817, "t_finish_unix": 1779818119.7865286, "t_first_token_unix": 1779818119.2890916, "tpot_s": 0.01104586604439343, "trace_hash_ids": [13676594, 13676595, 13676596, 13676597, 13676598, 13676599, 13676600, 13684524, 13684525, 13684526, 13684527, 13693279, 13693280, 13693281, 13693282, 13693283, 13699848, 13699849, 13706451, 13706452, 13706453, 13706454, 13706455, 13711662, 13711663, 13711664, 13711665, 13711666, 13711667, 13711668, 13711669, 13719432, 13719433], "trace_timestamp_s": 515.5390000000007, "ttft_s": 9.992907272011507, "turn_id": 2} +{"actual_output_tokens": 338, "cached_tokens": 79872, "effective_input_length": 81147, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81147, "latency_s": 11.232529330009129, "output_length": 338, "proxy_request_id": "1373577:2:1380740:647", "request_id": "1373577:2:1380740:647", "request_type": "coder", "requested_output_tokens": 338, "session_id": "1373577", "t_dispatch_unix": 1779818108.7877135, "t_finish_unix": 1779818120.0202432, "t_first_token_unix": 1779818109.6668363, "tpot_s": 0.030721424664619437, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13677773], "trace_timestamp_s": 499.7430000000004, "ttft_s": 0.8791204100125469, "turn_id": 2} +{"actual_output_tokens": 168, "cached_tokens": 59568, "effective_input_length": 71254, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71254, "latency_s": 7.594579244963825, "output_length": 168, "proxy_request_id": "1366128:11:1384044:671", "request_id": "1366128:11:1384044:671", "request_type": "coder", "requested_output_tokens": 168, "session_id": "1366128", "t_dispatch_unix": 1779818112.5390348, "t_finish_unix": 1779818120.1336136, "t_first_token_unix": 1779818117.507345, "tpot_s": 0.015724393203826677, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13708083], "trace_timestamp_s": 511.3190000000004, "ttft_s": 4.968307585979346, "turn_id": 11} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 11530, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11530, "latency_s": 0.9792524439981207, "output_length": 13, "proxy_request_id": "1384772:2:1387335:693", "request_id": "1384772:2:1387335:693", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1384772", "t_dispatch_unix": 1779818119.4940841, "t_finish_unix": 1779818120.4733365, "t_first_token_unix": 1779818120.4175136, "tpot_s": 0.004627971085331713, "trace_hash_ids": [13696008, 13696009, 13702186, 13702187, 13702188, 13702189, 13702190, 13707543, 13707544, 13719995, 13719996, 13719997, 13719998, 13725304, 13732414, 13732415, 13732416, 13732417, 13732418, 13738419, 13738420, 13738421, 13738422], "trace_timestamp_s": 522.6730000000007, "ttft_s": 0.9234278749790974, "turn_id": 2} +{"actual_output_tokens": 58, "cached_tokens": 71408, "effective_input_length": 71578, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71578, "latency_s": 0.8646451600361615, "output_length": 58, "proxy_request_id": "1366128:12:1386045:687", "request_id": "1366128:12:1386045:687", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1366128", "t_dispatch_unix": 1779818120.1377203, "t_finish_unix": 1779818121.0023654, "t_first_token_unix": 1779818120.4004765, "tpot_s": 0.010553944579186734, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175], "trace_timestamp_s": 518.5060000000003, "ttft_s": 0.26275296602398157, "turn_id": 12} +{"actual_output_tokens": 46, "cached_tokens": 71632, "effective_input_length": 71708, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71708, "latency_s": 0.6714675970142707, "output_length": 46, "proxy_request_id": "1366128:13:1387308:692", "request_id": "1366128:13:1387308:692", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1366128", "t_dispatch_unix": 1779818121.0055585, "t_finish_unix": 1779818121.6770132, "t_first_token_unix": 1779818121.1941943, "tpot_s": 0.010722958089576826, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13738057], "trace_timestamp_s": 522.5910000000003, "ttft_s": 0.18864595098420978, "turn_id": 13} +{"actual_output_tokens": 179, "cached_tokens": 19072, "effective_input_length": 20183, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20183, "latency_s": 1.297440308961086, "output_length": 179, "proxy_request_id": "1384947:2:1388842:700", "request_id": "1384947:2:1388842:700", "request_type": "coder", "requested_output_tokens": 179, "session_id": "1384947", "t_dispatch_unix": 1779818121.794978, "t_finish_unix": 1779818123.0924177, "t_first_token_unix": 1779818122.041241, "tpot_s": 0.005904175185145852, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13753560, 13753561, 13753562, 13753563, 13753564, 13753565, 13753566, 13753567, 13753568, 13753569, 13753570, 13753571], "trace_timestamp_s": 528.0410000000002, "ttft_s": 0.2462612150120549, "turn_id": 2} +{"actual_output_tokens": 265, "cached_tokens": 28656, "effective_input_length": 50793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50793, "latency_s": 8.053121255012229, "output_length": 265, "proxy_request_id": "1381387:3:1387093:691", "request_id": "1381387:3:1387093:691", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1381387", "t_dispatch_unix": 1779818115.534333, "t_finish_unix": 1779818123.5874536, "t_first_token_unix": 1779818121.5765588, "tpot_s": 0.0076159922991240765, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13736168], "trace_timestamp_s": 521.7730000000001, "ttft_s": 6.042223865049891, "turn_id": 3} +{"actual_output_tokens": 117, "cached_tokens": 0, "effective_input_length": 69465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69465, "latency_s": 18.87799518601969, "output_length": 117, "proxy_request_id": "1342921:3:1384020:670", "request_id": "1342921:3:1384020:670", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1342921", "t_dispatch_unix": 1779818104.9602416, "t_finish_unix": 1779818123.8382366, "t_first_token_unix": 1779818121.9879756, "tpot_s": 0.015948593526163363, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13707851], "trace_timestamp_s": 511.20600000000013, "ttft_s": 17.02773209096631, "turn_id": 3} +{"actual_output_tokens": 582, "cached_tokens": 62080, "effective_input_length": 85184, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85184, "latency_s": 17.161527817021124, "output_length": 582, "proxy_request_id": "1370129:4:1384856:678", "request_id": "1370129:4:1384856:678", "request_type": "coder", "requested_output_tokens": 582, "session_id": "1370129", "t_dispatch_unix": 1779818107.8034987, "t_finish_unix": 1779818124.9650264, "t_first_token_unix": 1779818118.5888488, "tpot_s": 0.0109738715507151, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13715535], "trace_timestamp_s": 514.0410000000002, "ttft_s": 10.7853478770121, "turn_id": 4} +{"actual_output_tokens": 232, "cached_tokens": 23840, "effective_input_length": 25226, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25226, "latency_s": 19.254005788010545, "output_length": 232, "proxy_request_id": "1355484:10:1384484:675", "request_id": "1355484:10:1384484:675", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1355484", "t_dispatch_unix": 1779818106.677785, "t_finish_unix": 1779818125.9317899, "t_first_token_unix": 1779818121.9834282, "tpot_s": 0.01709012089179248, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13711657], "trace_timestamp_s": 512.9250000000002, "ttft_s": 15.305642322986387, "turn_id": 10} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 5110, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5110, "latency_s": 0.6076027129893191, "output_length": 54, "proxy_request_id": "1390240:1:1390240:705", "request_id": "1390240:1:1390240:705", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1390240", "t_dispatch_unix": 1779818126.9731288, "t_finish_unix": 1779818127.5807314, "t_first_token_unix": 1779818127.310486, "tpot_s": 0.005094024302209464, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529], "trace_timestamp_s": 533.2200000000003, "ttft_s": 0.33735480898758397, "turn_id": 1} +{"actual_output_tokens": 277, "cached_tokens": 69568, "effective_input_length": 70990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70990, "latency_s": 4.518613953026943, "output_length": 277, "proxy_request_id": "1342921:4:1389290:702", "request_id": "1342921:4:1389290:702", "request_type": "coder", "requested_output_tokens": 277, "session_id": "1342921", "t_dispatch_unix": 1779818123.8423219, "t_finish_unix": 1779818128.360936, "t_first_token_unix": 1779818124.6612027, "tpot_s": 0.013403940250113457, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 13758038], "trace_timestamp_s": 529.6910000000007, "ttft_s": 0.8188778740004636, "turn_id": 4} +{"actual_output_tokens": 166, "cached_tokens": 25456, "effective_input_length": 26837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26837, "latency_s": 2.4327545310370624, "output_length": 166, "proxy_request_id": "1355484:11:1388276:696", "request_id": "1355484:11:1388276:696", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1355484", "t_dispatch_unix": 1779818125.9341393, "t_finish_unix": 1779818128.3668933, "t_first_token_unix": 1779818126.2969382, "tpot_s": 0.012544018248533548, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13748329], "trace_timestamp_s": 525.906, "ttft_s": 0.3627970140078105, "turn_id": 11} +{"actual_output_tokens": 337, "cached_tokens": 0, "effective_input_length": 1349, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1349, "latency_s": 1.7568310929927975, "output_length": 337, "proxy_request_id": "1390356:1:1390356:706", "request_id": "1390356:1:1390356:706", "request_type": "coder", "requested_output_tokens": 337, "session_id": "1390356", "t_dispatch_unix": 1779818127.4143527, "t_finish_unix": 1779818129.171184, "t_first_token_unix": 1779818127.525005, "tpot_s": 0.004898530366127878, "trace_hash_ids": [498451, 7523068, 6847035], "trace_timestamp_s": 533.6630000000005, "ttft_s": 0.11065116000827402, "turn_id": 1} +{"actual_output_tokens": 103, "cached_tokens": 71744, "effective_input_length": 83404, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83404, "latency_s": 6.937635568960104, "output_length": 103, "proxy_request_id": "1366128:14:1389156:701", "request_id": "1366128:14:1389156:701", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1366128", "t_dispatch_unix": 1779818123.01397, "t_finish_unix": 1779818129.9516056, "t_first_token_unix": 1779818128.806634, "tpot_s": 0.0112226136078985, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710], "trace_timestamp_s": 529.2550000000001, "ttft_s": 5.792661445972044, "turn_id": 14} +{"actual_output_tokens": 194, "cached_tokens": 20352, "effective_input_length": 20683, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20683, "latency_s": 1.3103628680109978, "output_length": 194, "proxy_request_id": "1384947:3:1390898:710", "request_id": "1384947:3:1390898:710", "request_type": "coder", "requested_output_tokens": 194, "session_id": "1384947", "t_dispatch_unix": 1779818129.621962, "t_finish_unix": 1779818130.932325, "t_first_token_unix": 1779818129.7679405, "tpot_s": 0.00603182284448566, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13753560, 13753561, 13753562, 13772382, 13772383, 13772384, 13772385, 13772386, 13772387, 13772388, 13772389, 13772390, 13772391], "trace_timestamp_s": 535.8690000000006, "ttft_s": 0.14597664203029126, "turn_id": 3} +{"actual_output_tokens": 118, "cached_tokens": 83504, "effective_input_length": 83622, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83622, "latency_s": 1.583693722030148, "output_length": 118, "proxy_request_id": "1366128:15:1390663:709", "request_id": "1366128:15:1390663:709", "request_type": "coder", "requested_output_tokens": 118, "session_id": "1366128", "t_dispatch_unix": 1779818129.9549346, "t_finish_unix": 1779818131.5386286, "t_first_token_unix": 1779818130.2095296, "tpot_s": 0.011357318453239994, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13769857], "trace_timestamp_s": 534.7930000000006, "ttft_s": 0.25459273101296276, "turn_id": 15} +{"actual_output_tokens": 46, "cached_tokens": 38080, "effective_input_length": 38242, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38242, "latency_s": 6.115421979979146, "output_length": 46, "proxy_request_id": "1355951:4:1389858:703", "request_id": "1355951:4:1389858:703", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1355951", "t_dispatch_unix": 1779818125.5742629, "t_finish_unix": 1779818131.6896842, "t_first_token_unix": 1779818130.6825001, "tpot_s": 0.02237570215559875, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 531.8220000000001, "ttft_s": 5.108236145984847, "turn_id": 4} +{"actual_output_tokens": 141, "cached_tokens": 41024, "effective_input_length": 49865, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49865, "latency_s": 25.3689980339841, "output_length": 141, "proxy_request_id": "1340278:3:1384549:676", "request_id": "1340278:3:1384549:676", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1340278", "t_dispatch_unix": 1779818106.8214684, "t_finish_unix": 1779818132.1904666, "t_first_token_unix": 1779818128.530394, "tpot_s": 0.026139515150238626, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13712170, 13712171, 13712172, 13712173, 13712174, 13712175, 13712176, 13712177, 13712178, 13712179, 13712180, 13712181, 13712182, 13712183, 13712184, 13712185, 13712186, 13712187, 13712188, 13712189, 13712190, 13712191, 13712192, 13712193, 13712194, 13712195, 13712196, 13712197, 13712198, 13712199, 13712200, 13712201, 13712202, 13712203, 13712204, 13712205, 13712206, 13712207, 13712208, 13712209, 13712210, 13712211, 13712212, 13712213, 13712214, 13712215, 13712216, 13712217, 13712218, 13712219, 13712220, 13712221, 13712222, 13712223, 13712224, 13712225, 13712226, 13712227, 13712228, 13712229, 13712230, 13712231, 13712232, 13712233, 13712234, 13712235, 13712236, 13712237, 13712238, 13712239, 13712240, 13712241, 13712242, 13712243], "trace_timestamp_s": 513.0550000000003, "ttft_s": 21.70892342197476, "turn_id": 3} +{"actual_output_tokens": 5, "cached_tokens": 50000, "effective_input_length": 50272, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50272, "latency_s": 0.351278044981882, "output_length": 5, "proxy_request_id": "1340278:3:1385417:683", "request_id": "1340278:3:1385417:683", "request_type": "coder", "requested_output_tokens": 5, "session_id": "1340278", "t_dispatch_unix": 1779818132.2080553, "t_finish_unix": 1779818132.559333, "t_first_token_unix": 1779818132.503365, "tpot_s": 0.013876408003852703, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13720652, 1600817, 13720653, 13720654, 13720655, 13720656, 13720657, 13720658, 13720659, 13720660, 13720661, 13720662, 13720663, 13720664, 13720665, 13720666, 13720667, 13720668, 13720669, 13720670, 13720671, 13720672, 13720673, 13720674, 13720675, 13720676, 13720677, 13720678, 13720679, 13720680, 13720681, 13720682, 13720683, 13720684, 13720685, 13720686, 13720687, 13720688, 13720689, 13720690, 13720691, 13720692, 13720693, 13720694, 13720695, 13720696, 13720697, 13720698, 13720699, 13720700, 13720701, 13720702, 13720703, 13720704, 13720705, 13720706, 13720707, 13720708, 13720709, 13720710, 13720711, 13720712, 13720713, 13720714, 13720715, 13720716, 13720717, 13720718, 13720719, 13720720, 13720721, 13720722, 13720723, 13720724, 13720725], "trace_timestamp_s": 516.067, "ttft_s": 0.2953078110003844, "turn_id": 3} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 15302, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15302, "latency_s": 1.5995618990273215, "output_length": 40, "proxy_request_id": "1391584:1:1391584:713", "request_id": "1391584:1:1391584:713", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1391584", "t_dispatch_unix": 1779818131.485121, "t_finish_unix": 1779818133.0846825, "t_first_token_unix": 1779818132.8750923, "tpot_s": 0.005367170667084746, "trace_hash_ids": [13707702, 13707703, 13720726, 13720727, 13720728, 13720729, 13733320, 13733321, 13733322, 13733323, 13733324, 13733325, 13733326, 13746256, 13746257, 13746258, 13746259, 13754848, 13763119, 13763120, 13763121, 13763122, 13763123, 13770106, 13770107, 13770108, 13770109, 13779081, 13779082, 13779083], "trace_timestamp_s": 537.7290000000003, "ttft_s": 1.389970077027101, "turn_id": 1} +{"actual_output_tokens": 206, "cached_tokens": 0, "effective_input_length": 41508, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41508, "latency_s": 61.200978167005815, "output_length": 206, "proxy_request_id": "1268861:7:1374579:614", "request_id": "1268861:7:1374579:614", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1268861", "t_dispatch_unix": 1779818072.163602, "t_finish_unix": 1779818133.364579, "t_first_token_unix": 1779818127.3533595, "tpot_s": 0.029321564448622578, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13621774], "trace_timestamp_s": 478.40900000000056, "ttft_s": 55.18975601904094, "turn_id": 7} +{"actual_output_tokens": 185, "cached_tokens": 61504, "effective_input_length": 106305, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106305, "latency_s": 28.838627633987926, "output_length": 185, "proxy_request_id": "1313181:6:1324908:369", "request_id": "1313181:6:1324908:369", "request_type": "coder", "requested_output_tokens": 185, "session_id": "1313181", "t_dispatch_unix": 1779818104.8468301, "t_finish_unix": 1779818133.6854577, "t_first_token_unix": 1779818128.5798948, "tpot_s": 0.02774457758705071, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13161676], "trace_timestamp_s": 303.64200000000073, "ttft_s": 23.73306172399316, "turn_id": 6} +{"actual_output_tokens": 197, "cached_tokens": 0, "effective_input_length": 21221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21221, "latency_s": 28.320336461008992, "output_length": 197, "proxy_request_id": "1340290:3:1384149:672", "request_id": "1340290:3:1384149:672", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1340290", "t_dispatch_unix": 1779818105.53211, "t_finish_unix": 1779818133.8524456, "t_first_token_unix": 1779818130.674765, "tpot_s": 0.016211343663376374, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13305218], "trace_timestamp_s": 511.78099999999995, "ttft_s": 25.142653843970038, "turn_id": 3} +{"actual_output_tokens": 438, "cached_tokens": 65392, "effective_input_length": 68187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68187, "latency_s": 8.183670654019807, "output_length": 438, "proxy_request_id": "1363093:4:1390050:704", "request_id": "1363093:4:1390050:704", "request_type": "coder", "requested_output_tokens": 438, "session_id": "1363093", "t_dispatch_unix": 1779818126.20194, "t_finish_unix": 1779818134.3856103, "t_first_token_unix": 1779818127.4810746, "tpot_s": 0.015798701226468318, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678], "trace_timestamp_s": 532.4470000000001, "ttft_s": 1.2791333590284921, "turn_id": 4} +{"actual_output_tokens": 251, "cached_tokens": 26992, "effective_input_length": 28382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28382, "latency_s": 2.3535929569625296, "output_length": 251, "proxy_request_id": "1355484:12:1391879:714", "request_id": "1355484:12:1391879:714", "request_type": "coder", "requested_output_tokens": 251, "session_id": "1355484", "t_dispatch_unix": 1779818132.6216884, "t_finish_unix": 1779818134.9752812, "t_first_token_unix": 1779818132.992728, "tpot_s": 0.007928694556001575, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13781560], "trace_timestamp_s": 538.8690000000006, "ttft_s": 0.37103784998180345, "turn_id": 12} +{"actual_output_tokens": 457, "cached_tokens": 85760, "effective_input_length": 87687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87687, "latency_s": 7.289986111049075, "output_length": 457, "proxy_request_id": "1370129:5:1390477:708", "request_id": "1370129:5:1390477:708", "request_type": "coder", "requested_output_tokens": 457, "session_id": "1370129", "t_dispatch_unix": 1779818127.9360824, "t_finish_unix": 1779818135.2260687, "t_first_token_unix": 1779818129.217125, "tpot_s": 0.013176842677670433, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13768317, 13768318, 13768319, 13768320, 13768321, 13768322], "trace_timestamp_s": 534.1800000000003, "ttft_s": 1.2810398390283808, "turn_id": 5} +{"actual_output_tokens": 70, "cached_tokens": 15328, "effective_input_length": 15483, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15483, "latency_s": 0.46650092501658946, "output_length": 70, "proxy_request_id": "1391584:2:1392466:715", "request_id": "1391584:2:1392466:715", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1391584", "t_dispatch_unix": 1779818134.8030627, "t_finish_unix": 1779818135.2695632, "t_first_token_unix": 1779818134.8874, "tpot_s": 0.005534004623347057, "trace_hash_ids": [13786395, 13786396, 13786397, 13786398, 13786399, 13786400, 13786401, 13786402, 13786403, 13786404, 13786405, 13786406, 13786407, 13786408, 13786409, 13786410, 13786411, 13786412, 13786413, 13786414, 13786415, 13786416, 13786417, 13786418, 13786419, 13786420, 13786421, 13786422, 13786423, 13786424, 13786425], "trace_timestamp_s": 541.0450000000001, "ttft_s": 0.08433597098337486, "turn_id": 2} +{"actual_output_tokens": 53, "cached_tokens": 21408, "effective_input_length": 26146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26146, "latency_s": 1.6230167800094932, "output_length": 53, "proxy_request_id": "1340290:4:1385568:684", "request_id": "1340290:4:1385568:684", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1340290", "t_dispatch_unix": 1779818133.8554502, "t_finish_unix": 1779818135.478467, "t_first_token_unix": 1779818134.7922015, "tpot_s": 0.013189990192096537, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13722203], "trace_timestamp_s": 516.6480000000001, "ttft_s": 0.9367484379909001, "turn_id": 4} +{"actual_output_tokens": 204, "cached_tokens": 0, "effective_input_length": 28307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28307, "latency_s": 4.872420118015725, "output_length": 204, "proxy_request_id": "1391404:1:1391404:712", "request_id": "1391404:1:1391404:712", "request_type": "coder", "requested_output_tokens": 204, "session_id": "1391404", "t_dispatch_unix": 1779818130.9683492, "t_finish_unix": 1779818135.8407693, "t_first_token_unix": 1779818134.5390275, "tpot_s": 0.0064107237436482915, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 94557, 94558, 94559, 94560, 94561, 94562, 94563, 94564, 94565, 238090, 238091, 3841644, 3841645, 3841646, 3841647, 3841648, 3841649, 13750192, 3809872, 13750193, 13750194, 13777397, 13777398, 13777399, 13777400, 13777401, 13777402, 13777403, 13777404, 13777405, 13777406, 13777407, 13777408, 13777409, 13777410, 13777411, 13777412, 13777413, 13777414, 13777415, 13777416, 13777417, 13777418, 13777419, 13777420, 13777421, 13777422, 13777423, 13777424, 13777425, 13777426], "trace_timestamp_s": 537.2080000000005, "ttft_s": 3.570676399045624, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 26192, "effective_input_length": 27220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27220, "latency_s": 0.7549987899838015, "output_length": 36, "proxy_request_id": "1340290:5:1386504:688", "request_id": "1340290:5:1386504:688", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779818135.4809682, "t_finish_unix": 1779818136.235967, "t_first_token_unix": 1779818135.7861109, "tpot_s": 0.01284315979906491, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13730728], "trace_timestamp_s": 519.7940000000008, "ttft_s": 0.3051409170147963, "turn_id": 5} +{"actual_output_tokens": 44, "cached_tokens": 5152, "effective_input_length": 7440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7440, "latency_s": 0.4534862200380303, "output_length": 44, "proxy_request_id": "1390240:2:1392954:717", "request_id": "1390240:2:1392954:717", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1390240", "t_dispatch_unix": 1779818136.5197194, "t_finish_unix": 1779818136.9732058, "t_first_token_unix": 1779818136.752094, "tpot_s": 0.005135127256602742, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529, 13772017, 13790409, 13790410, 13790411, 13790412], "trace_timestamp_s": 542.768, "ttft_s": 0.23237307800445706, "turn_id": 2} +{"actual_output_tokens": 528, "cached_tokens": 1024, "effective_input_length": 126340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126340, "latency_s": 69.05000830598874, "output_length": 528, "proxy_request_id": "1373431:1:1373431:606", "request_id": "1373431:1:1373431:606", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1373431", "t_dispatch_unix": 1779818068.1247926, "t_finish_unix": 1779818137.1748, "t_first_token_unix": 1779818119.4898582, "tpot_s": 0.033556790045591554, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13611159], "trace_timestamp_s": 474.3240000000005, "ttft_s": 51.36506379797356, "turn_id": 1} +{"actual_output_tokens": 175, "cached_tokens": 27248, "effective_input_length": 27285, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27285, "latency_s": 2.3621156589942984, "output_length": 175, "proxy_request_id": "1340290:6:1387365:695", "request_id": "1340290:6:1387365:695", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1340290", "t_dispatch_unix": 1779818136.2371175, "t_finish_unix": 1779818138.5992334, "t_first_token_unix": 1779818136.3253293, "tpot_s": 0.013066547948214087, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13738577], "trace_timestamp_s": 522.7670000000007, "ttft_s": 0.08820996701251715, "turn_id": 6} +{"actual_output_tokens": 2085, "cached_tokens": 0, "effective_input_length": 35888, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35888, "latency_s": 64.69667781004682, "output_length": 2085, "proxy_request_id": "1301929:2:1375154:617", "request_id": "1301929:2:1375154:617", "request_type": "coder", "requested_output_tokens": 2085, "session_id": "1301929", "t_dispatch_unix": 1779818074.1502373, "t_finish_unix": 1779818138.8469152, "t_first_token_unix": 1779818098.3956928, "tpot_s": 0.01941024059214251, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 5975800], "trace_timestamp_s": 480.39800000000014, "ttft_s": 24.245453589013778, "turn_id": 2} +{"actual_output_tokens": 206, "cached_tokens": 83728, "effective_input_length": 84897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 84897, "latency_s": 3.2017459500348195, "output_length": 206, "proxy_request_id": "1366128:16:1392704:716", "request_id": "1366128:16:1392704:716", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1366128", "t_dispatch_unix": 1779818135.6908689, "t_finish_unix": 1779818138.8926141, "t_first_token_unix": 1779818136.4772406, "tpot_s": 0.011778583443757693, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167], "trace_timestamp_s": 541.9360000000006, "ttft_s": 0.7863686210475862, "turn_id": 16} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 3678, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3678, "latency_s": 17.966194098989945, "output_length": 12, "proxy_request_id": "1382804:2:1388620:698", "request_id": "1382804:2:1388620:698", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1382804", "t_dispatch_unix": 1779818121.036699, "t_finish_unix": 1779818139.0028932, "t_first_token_unix": 1779818138.852533, "tpot_s": 0.013649351820773021, "trace_hash_ids": [13696917, 13723655, 13723656, 13723657, 13723658, 13736021, 13736022, 13751607], "trace_timestamp_s": 527.2850000000008, "ttft_s": 17.815831556974445, "turn_id": 2} +{"actual_output_tokens": 1054, "cached_tokens": 20912, "effective_input_length": 20948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20948, "latency_s": 40.73868800001219, "output_length": 1054, "proxy_request_id": "1363943:8:1379215:635", "request_id": "1363943:8:1379215:635", "request_type": "coder", "requested_output_tokens": 1054, "session_id": "1363943", "t_dispatch_unix": 1779818098.6608043, "t_finish_unix": 1779818139.399493, "t_first_token_unix": 1779818098.733637, "tpot_s": 0.03861867172079929, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416], "trace_timestamp_s": 494.45700000000033, "ttft_s": 0.07283094601007178, "turn_id": 8} +{"actual_output_tokens": 140, "cached_tokens": 126864, "effective_input_length": 127267, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127267, "latency_s": 2.2404420180246234, "output_length": 140, "proxy_request_id": "1373431:2:1378320:629", "request_id": "1373431:2:1378320:629", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1373431", "t_dispatch_unix": 1779818137.1800585, "t_finish_unix": 1779818139.4205005, "t_first_token_unix": 1779818137.8412037, "tpot_s": 0.011359994302222358, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13655780, 13655781, 13655782], "trace_timestamp_s": 491.299, "ttft_s": 0.6611427280004136, "turn_id": 2} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 71899, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71899, "latency_s": 18.91184906702256, "output_length": 45, "proxy_request_id": "1388507:1:1388507:697", "request_id": "1388507:1:1388507:697", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1388507", "t_dispatch_unix": 1779818120.5727732, "t_finish_unix": 1779818139.4846215, "t_first_token_unix": 1779818138.3511343, "tpot_s": 0.025753381136878903, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728], "trace_timestamp_s": 526.7930000000006, "ttft_s": 17.77835891803261, "turn_id": 1} +{"actual_output_tokens": 442, "cached_tokens": 61536, "effective_input_length": 61543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61543, "latency_s": 6.9406593379681, "output_length": 442, "proxy_request_id": "1313181:6:1379623:639", "request_id": "1313181:6:1379623:639", "request_type": "coder", "requested_output_tokens": 442, "session_id": "1313181", "t_dispatch_unix": 1779818133.688914, "t_finish_unix": 1779818140.6295733, "t_first_token_unix": 1779818133.8233328, "tpot_s": 0.015433068170086555, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13667684], "trace_timestamp_s": 495.71700000000055, "ttft_s": 0.13441614498151466, "turn_id": 6} +{"actual_output_tokens": 90, "cached_tokens": 127392, "effective_input_length": 128201, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128201, "latency_s": 1.8850935710361227, "output_length": 90, "proxy_request_id": "1373431:3:1383388:667", "request_id": "1373431:3:1383388:667", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1373431", "t_dispatch_unix": 1779818139.4282277, "t_finish_unix": 1779818141.3133206, "t_first_token_unix": 1779818140.3602748, "tpot_s": 0.010703364618023167, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13655780, 13655781, 13702464, 13702465, 13702466], "trace_timestamp_s": 508.9840000000004, "ttft_s": 0.9320444490294904, "turn_id": 3} +{"actual_output_tokens": 2, "cached_tokens": 0, "effective_input_length": 982, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 982, "latency_s": 0.08673930400982499, "output_length": 2, "proxy_request_id": "1394428:1:1394428:724", "request_id": "1394428:1:1394428:724", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1394428", "t_dispatch_unix": 1779818141.674094, "t_finish_unix": 1779818141.760833, "t_first_token_unix": 1779818141.7569375, "tpot_s": 0.003625481971539557, "trace_hash_ids": [7025, 13804096], "trace_timestamp_s": 547.9230000000007, "ttft_s": 0.08284221601206809, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 4675, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4675, "latency_s": 1.259826396999415, "output_length": 73, "proxy_request_id": "1394167:1:1394167:721", "request_id": "1394167:1:1394167:721", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1394167", "t_dispatch_unix": 1779818140.784619, "t_finish_unix": 1779818142.0444453, "t_first_token_unix": 1779818141.2017233, "tpot_s": 0.011701283208417913, "trace_hash_ids": [13801402, 13801403, 13801404, 13801405, 13801406, 13801407, 13801408, 13801409, 13801410, 13801411], "trace_timestamp_s": 547.0320000000002, "ttft_s": 0.4171032849699259, "turn_id": 1} +{"actual_output_tokens": 71, "cached_tokens": 28624, "effective_input_length": 28665, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28665, "latency_s": 0.6319518479867838, "output_length": 71, "proxy_request_id": "1355484:13:1394384:723", "request_id": "1355484:13:1394384:723", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1355484", "t_dispatch_unix": 1779818141.527963, "t_finish_unix": 1779818142.1599143, "t_first_token_unix": 1779818141.6146357, "tpot_s": 0.007786020772099229, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562], "trace_timestamp_s": 547.7760000000007, "ttft_s": 0.08667146496009082, "turn_id": 13} +{"actual_output_tokens": 51, "cached_tokens": 0, "effective_input_length": 4736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4736, "latency_s": 0.5597014119848609, "output_length": 51, "proxy_request_id": "1394432:1:1394432:725", "request_id": "1394432:1:1394432:725", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1394432", "t_dispatch_unix": 1779818141.690923, "t_finish_unix": 1779818142.2506244, "t_first_token_unix": 1779818141.9960117, "tpot_s": 0.005087737339781597, "trace_hash_ids": [13788220, 13788221, 13788222, 13788223, 13788224, 13804106, 13804107, 13804108, 13804109, 13804110], "trace_timestamp_s": 547.9380000000001, "ttft_s": 0.3050877589848824, "turn_id": 1} +{"actual_output_tokens": 265, "cached_tokens": 101472, "effective_input_length": 101993, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101993, "latency_s": 11.773497900983784, "output_length": 265, "proxy_request_id": "1279412:31:1391216:711", "request_id": "1279412:31:1391216:711", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1279412", "t_dispatch_unix": 1779818130.5046687, "t_finish_unix": 1779818142.2781663, "t_first_token_unix": 1779818138.8677545, "tpot_s": 0.012916945852339268, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276, 13775473, 13775474], "trace_timestamp_s": 536.75, "ttft_s": 8.363083829986863, "turn_id": 31} +{"actual_output_tokens": 19, "cached_tokens": 0, "effective_input_length": 4428, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4428, "latency_s": 0.3711566159618087, "output_length": 19, "proxy_request_id": "1394482:1:1394482:726", "request_id": "1394482:1:1394482:726", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1394482", "t_dispatch_unix": 1779818141.9447463, "t_finish_unix": 1779818142.3159032, "t_first_token_unix": 1779818142.2280238, "tpot_s": 0.0048677531659551375, "trace_hash_ids": [13785573, 13792906, 13792907, 13792908, 13792909, 13798843, 13804481, 13804482, 13804483], "trace_timestamp_s": 548.192, "ttft_s": 0.2832762619946152, "turn_id": 1} +{"actual_output_tokens": 613, "cached_tokens": 48224, "effective_input_length": 48944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48944, "latency_s": 6.731788786011748, "output_length": 613, "proxy_request_id": "1364090:4:1392998:718", "request_id": "1364090:4:1392998:718", "request_type": "coder", "requested_output_tokens": 613, "session_id": "1364090", "t_dispatch_unix": 1779818136.6229906, "t_finish_unix": 1779818143.3547795, "t_first_token_unix": 1779818137.016264, "tpot_s": 0.010356573511433964, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13790837], "trace_timestamp_s": 542.8680000000004, "ttft_s": 0.393271197041031, "turn_id": 4} +{"actual_output_tokens": 3119, "cached_tokens": 0, "effective_input_length": 15283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15283, "latency_s": 56.27002754597925, "output_length": 3119, "proxy_request_id": "1378979:1:1378979:633", "request_id": "1378979:1:1378979:633", "request_type": "coder", "requested_output_tokens": 3119, "session_id": "1378979", "t_dispatch_unix": 1779818087.320168, "t_finish_unix": 1779818143.590195, "t_first_token_unix": 1779818088.6944218, "tpot_s": 0.01760600131239373, "trace_hash_ids": [1978, 1979, 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007], "trace_timestamp_s": 493.5690000000004, "ttft_s": 1.374252980982419, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 4784, "effective_input_length": 6892, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6892, "latency_s": 0.4558048999751918, "output_length": 49, "proxy_request_id": "1394432:2:1395186:729", "request_id": "1394432:2:1395186:729", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1394432", "t_dispatch_unix": 1779818144.27967, "t_finish_unix": 1779818144.7354755, "t_first_token_unix": 1779818144.4865587, "tpot_s": 0.005178912500317286, "trace_hash_ids": [13788220, 13788221, 13788222, 13788223, 13788224, 13804106, 13804107, 13804108, 13804109, 13810289, 13810290, 13810291, 13810292, 13810293], "trace_timestamp_s": 550.527, "ttft_s": 0.20688709896057844, "turn_id": 2} +{"actual_output_tokens": 107, "cached_tokens": 7472, "effective_input_length": 10890, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10890, "latency_s": 0.9407489930163138, "output_length": 107, "proxy_request_id": "1390240:3:1395387:730", "request_id": "1390240:3:1395387:730", "request_type": "coder", "requested_output_tokens": 107, "session_id": "1390240", "t_dispatch_unix": 1779818145.074178, "t_finish_unix": 1779818146.0149264, "t_first_token_unix": 1779818145.444513, "tpot_s": 0.00537910640573586, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529, 13772017, 13790409, 13790410, 13790411, 13798738, 13798739, 13805950, 13805951, 13805952, 13812101, 13812102, 13812103], "trace_timestamp_s": 551.3200000000006, "ttft_s": 0.37033372500445694, "turn_id": 3} +{"actual_output_tokens": 65, "cached_tokens": 0, "effective_input_length": 35450, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35450, "latency_s": 5.621492500009481, "output_length": 65, "proxy_request_id": "1394696:1:1394696:727", "request_id": "1394696:1:1394696:727", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1394696", "t_dispatch_unix": 1779818142.7169945, "t_finish_unix": 1779818148.3384867, "t_first_token_unix": 1779818147.8794446, "tpot_s": 0.007167762109929754, "trace_hash_ids": [13806090, 13806091, 13806092, 13806093, 13806094, 13806095, 13806096, 13806097, 13806098, 13806099, 13806100, 13806101, 13806102, 13806103, 13806104, 13806105, 13806106, 13806107, 13806108, 13806109, 13806110, 13806111, 13806112, 13806113, 13806114, 13806115, 13806116, 9511238, 9511239, 9511240, 9511241, 13806117, 13806118, 13806119, 13806120, 13806121, 13806122, 13806123, 13806124, 13806125, 13806126, 13806127, 13806128, 13806129, 13806130, 13806131, 13806132, 13806133, 13806134, 13806135, 13806136, 13806137, 13806138, 13806139, 13806140, 13806141, 13806142, 13806143, 13806144, 13806145, 13806146, 13806147, 13806148, 13806149, 13806150, 13806151, 13806152, 13806153, 13806154, 13806155], "trace_timestamp_s": 548.9520000000002, "ttft_s": 5.162437648978084, "turn_id": 1} +{"actual_output_tokens": 117, "cached_tokens": 4736, "effective_input_length": 4863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4863, "latency_s": 4.394439598021563, "output_length": 117, "proxy_request_id": "1394167:2:1395165:728", "request_id": "1394167:2:1395165:728", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1394167", "t_dispatch_unix": 1779818144.2160597, "t_finish_unix": 1779818148.610499, "t_first_token_unix": 1779818147.8800027, "tpot_s": 0.00629502490508081, "trace_hash_ids": [13801402, 13801403, 13801404, 13801405, 13801406, 13801407, 13801408, 13801409, 13801410, 13810026], "trace_timestamp_s": 550.4650000000001, "ttft_s": 3.663942796003539, "turn_id": 2} +{"actual_output_tokens": 213, "cached_tokens": 0, "effective_input_length": 21241, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21241, "latency_s": 3.5448824880295433, "output_length": 213, "proxy_request_id": "1395933:1:1395933:732", "request_id": "1395933:1:1395933:732", "request_type": "coder", "requested_output_tokens": 213, "session_id": "1395933", "t_dispatch_unix": 1779818147.011332, "t_finish_unix": 1779818150.5562146, "t_first_token_unix": 1779818149.2769756, "tpot_s": 0.006033014065974814, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4820695, 12527506, 12667198, 12747031, 12878182, 12930465, 13027097, 13219058, 13256881, 13445564, 13599228, 13718544, 13817211, 13817212, 13817213, 13817214, 13817215, 13817216, 13817217], "trace_timestamp_s": 553.2570000000005, "ttft_s": 2.2656408810289577, "turn_id": 1} +{"actual_output_tokens": 132, "cached_tokens": 16704, "effective_input_length": 17047, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17047, "latency_s": 3.813353529025335, "output_length": 132, "proxy_request_id": "1305906:3:1396717:733", "request_id": "1305906:3:1396717:733", "request_type": "coder", "requested_output_tokens": 132, "session_id": "1305906", "t_dispatch_unix": 1779818149.602122, "t_finish_unix": 1779818153.4154754, "t_first_token_unix": 1779818151.8703735, "tpot_s": 0.011792245969702382, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 13824632], "trace_timestamp_s": 555.8500000000004, "ttft_s": 2.268249435001053, "turn_id": 3} +{"actual_output_tokens": 22, "cached_tokens": 0, "effective_input_length": 3213, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3213, "latency_s": 0.3099724469939247, "output_length": 22, "proxy_request_id": "1398145:1:1398145:739", "request_id": "1398145:1:1398145:739", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1398145", "t_dispatch_unix": 1779818154.7656384, "t_finish_unix": 1779818155.0756109, "t_first_token_unix": 1779818154.9734914, "tpot_s": 0.004847935143126441, "trace_hash_ids": [13836943, 13836944, 13836945, 13836946, 13836947, 13836948, 13836949], "trace_timestamp_s": 561.0129999999999, "ttft_s": 0.20785193500341848, "turn_id": 1} +{"actual_output_tokens": 33, "cached_tokens": 10672, "effective_input_length": 10736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10736, "latency_s": 0.5012908750213683, "output_length": 33, "proxy_request_id": "1362265:5:1398180:741", "request_id": "1362265:5:1398180:741", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1362265", "t_dispatch_unix": 1779818154.8446681, "t_finish_unix": 1779818155.345959, "t_first_token_unix": 1779818154.9322665, "tpot_s": 0.012900727624582942, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588], "trace_timestamp_s": 561.094, "ttft_s": 0.08759743900736794, "turn_id": 5} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 16550, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16550, "latency_s": 1.808114444022067, "output_length": 44, "proxy_request_id": "1397840:1:1397840:737", "request_id": "1397840:1:1397840:737", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1397840", "t_dispatch_unix": 1779818153.693756, "t_finish_unix": 1779818155.5018704, "t_first_token_unix": 1779818155.3483179, "tpot_s": 0.0035631994183478485, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13834593], "trace_timestamp_s": 559.9370000000008, "ttft_s": 1.6545598580269143, "turn_id": 1} +{"actual_output_tokens": 64, "cached_tokens": 0, "effective_input_length": 3891, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3891, "latency_s": 0.7742167789838277, "output_length": 64, "proxy_request_id": "1398213:1:1398213:742", "request_id": "1398213:1:1398213:742", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1398213", "t_dispatch_unix": 1779818154.9068127, "t_finish_unix": 1779818155.6810296, "t_first_token_unix": 1779818155.1937985, "tpot_s": 0.0077289575082619515, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13837656], "trace_timestamp_s": 561.1540000000005, "ttft_s": 0.28698451997479424, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7877, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7877, "latency_s": 0.6655036339652725, "output_length": 24, "proxy_request_id": "1398594:1:1398594:744", "request_id": "1398594:1:1398594:744", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1398594", "t_dispatch_unix": 1779818156.133187, "t_finish_unix": 1779818156.7986908, "t_first_token_unix": 1779818156.683857, "tpot_s": 0.004981959782763506, "trace_hash_ids": [13835320, 13835321, 13835322, 13835323, 13835324, 13835325, 13835326, 13841636, 13841637, 13841638, 13841639, 13841640, 13841641, 13841642, 13841643, 13841644], "trace_timestamp_s": 562.3790000000008, "ttft_s": 0.5506682670093141, "turn_id": 1} +{"actual_output_tokens": 2641, "cached_tokens": 28496, "effective_input_length": 33321, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33321, "latency_s": 20.303304879984353, "output_length": 2641, "proxy_request_id": "1391404:2:1393919:720", "request_id": "1391404:2:1393919:720", "request_type": "coder", "requested_output_tokens": 2641, "session_id": "1391404", "t_dispatch_unix": 1779818139.8270636, "t_finish_unix": 1779818160.130368, "t_first_token_unix": 1779818140.9661489, "tpot_s": 0.00725887822045479, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 94557, 94558, 94559, 94560, 94561, 94562, 94563, 94564, 94565, 238090, 238091, 3841644, 3841645, 3841646, 3841647, 3841648, 3841649, 13750192, 3809872, 13750193, 13750194, 13777397, 13777398, 13777399, 13777400, 13777401, 13777402, 13777403, 13777404, 13777405, 13777406, 13777407, 13777408, 13777409, 13777410, 13777411, 13777412, 13777413, 13777414, 13777415, 13777416, 13777417, 13777418, 13777419, 13777420, 13777421, 13777422, 13777423, 13777424, 13777425, 13799002, 13799003, 13799004, 13799005, 13799006, 13799007, 13799008, 13799009, 13799010, 13799011, 13799012], "trace_timestamp_s": 546.0730000000003, "ttft_s": 1.1390838889637962, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 10768, "effective_input_length": 10816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10816, "latency_s": 0.5991674889810383, "output_length": 46, "proxy_request_id": "1362265:6:1399937:747", "request_id": "1362265:6:1399937:747", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1362265", "t_dispatch_unix": 1779818160.9127314, "t_finish_unix": 1779818161.5118985, "t_first_token_unix": 1779818160.9887562, "tpot_s": 0.011619716511470162, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 13854355], "trace_timestamp_s": 567.1610000000001, "ttft_s": 0.07602383696939796, "turn_id": 6} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 3707, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3707, "latency_s": 0.5297412149957381, "output_length": 57, "proxy_request_id": "1400379:1:1400379:751", "request_id": "1400379:1:1400379:751", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1400379", "t_dispatch_unix": 1779818162.2607331, "t_finish_unix": 1779818162.7904744, "t_first_token_unix": 1779818162.5135438, "tpot_s": 0.0049408750533725, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13858195], "trace_timestamp_s": 568.5080000000007, "ttft_s": 0.2528091570129618, "turn_id": 1} +{"actual_output_tokens": 128, "cached_tokens": 0, "effective_input_length": 4991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4991, "latency_s": 2.7180480389506556, "output_length": 128, "proxy_request_id": "1399948:1:1399948:748", "request_id": "1399948:1:1399948:748", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1399948", "t_dispatch_unix": 1779818160.944303, "t_finish_unix": 1779818163.6623511, "t_first_token_unix": 1779818161.2670958, "tpot_s": 0.018857848795229847, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13854387], "trace_timestamp_s": 567.1910000000007, "ttft_s": 0.32279114599805325, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 16592, "effective_input_length": 26440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26440, "latency_s": 1.9326651520095766, "output_length": 32, "proxy_request_id": "1397840:2:1400216:749", "request_id": "1397840:2:1400216:749", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1397840", "t_dispatch_unix": 1779818161.741193, "t_finish_unix": 1779818163.6738577, "t_first_token_unix": 1779818163.46703, "tpot_s": 0.006664777354848, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13843674, 13843675, 13843676, 13843677, 13843678, 13843679, 13843680, 13843681, 13843682, 13843683, 13843684, 13856781, 13856782, 13856783, 13856784, 13856785, 13856786, 13856787, 13856788, 13856789], "trace_timestamp_s": 567.9860000000008, "ttft_s": 1.725834610988386, "turn_id": 2} +{"actual_output_tokens": 67, "cached_tokens": 3760, "effective_input_length": 3863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3863, "latency_s": 0.3751071029691957, "output_length": 67, "proxy_request_id": "1400379:2:1401201:757", "request_id": "1400379:2:1401201:757", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1400379", "t_dispatch_unix": 1779818165.3763645, "t_finish_unix": 1779818165.751471, "t_first_token_unix": 1779818165.4187732, "tpot_s": 0.0050366149243376585, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13866334], "trace_timestamp_s": 571.625, "ttft_s": 0.042408079956658185, "turn_id": 2} +{"actual_output_tokens": 133, "cached_tokens": 17408, "effective_input_length": 63258, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63258, "latency_s": 14.078992641007062, "output_length": 133, "proxy_request_id": "1253743:8:1398344:743", "request_id": "1253743:8:1398344:743", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1253743", "t_dispatch_unix": 1779818155.295851, "t_finish_unix": 1779818169.374843, "t_first_token_unix": 1779818167.961382, "tpot_s": 0.010705894909209967, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 481346, 481347, 481348, 710670, 710671, 710672, 710673, 710674, 710675, 710676, 710677, 710678, 710679, 13839194, 13839195, 13839196, 13839197, 13839198, 13839199, 13839200, 13839201, 13839202, 13839203, 13839204, 13839205, 13839206, 13839207, 13839208, 13839209, 13839210, 13839211, 13839212, 13839213, 13839214, 13839215, 13839216, 13839217, 13839218, 13839219, 184023, 184024, 567789, 13839220, 13839221, 146857, 146858, 146859, 146860, 13839222, 11521, 13839223, 13839224, 13839225, 13839226, 13839227, 13839228, 13839229, 13839230, 13839231, 13839232, 13839233, 13839234, 13839235, 13839236, 13839237, 13839238, 13839239, 13839240, 13839241, 13839242, 13839243, 13839244, 13839245, 13839246, 13839247, 13839248, 13839249, 13839250, 13839251, 13839252, 13839253, 13839254, 13839255, 13839256, 13839257, 11719668, 13839258, 13839259, 13839260, 13839261, 13839262, 13839263, 13839264, 13839265, 13839266, 13839267, 13839268, 13839269, 13839270, 13839271, 13839272, 13839273], "trace_timestamp_s": 561.4990000000007, "ttft_s": 12.665527376986574, "turn_id": 8} +{"actual_output_tokens": 213, "cached_tokens": 28720, "effective_input_length": 31224, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31224, "latency_s": 15.02005063201068, "output_length": 213, "proxy_request_id": "1355484:14:1398178:740", "request_id": "1355484:14:1398178:740", "request_type": "coder", "requested_output_tokens": 213, "session_id": "1355484", "t_dispatch_unix": 1779818154.8411849, "t_finish_unix": 1779818169.8612354, "t_first_token_unix": 1779818155.4960227, "tpot_s": 0.06775904148114177, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299], "trace_timestamp_s": 561.0889999999999, "ttft_s": 0.6548351630335674, "turn_id": 14} +{"actual_output_tokens": 79, "cached_tokens": 31424, "effective_input_length": 31469, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31469, "latency_s": 0.5742207690491341, "output_length": 79, "proxy_request_id": "1355484:15:1400281:750", "request_id": "1355484:15:1400281:750", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1355484", "t_dispatch_unix": 1779818169.8626645, "t_finish_unix": 1779818170.4368856, "t_first_token_unix": 1779818169.9447358, "tpot_s": 0.006304856333045814, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299, 13857350], "trace_timestamp_s": 568.1950000000006, "ttft_s": 0.08206882001832128, "turn_id": 15} +{"actual_output_tokens": 27, "cached_tokens": 26464, "effective_input_length": 28603, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28603, "latency_s": 0.7005545650026761, "output_length": 27, "proxy_request_id": "1397840:3:1402568:761", "request_id": "1397840:3:1402568:761", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1397840", "t_dispatch_unix": 1779818170.0872526, "t_finish_unix": 1779818170.7878075, "t_first_token_unix": 1779818170.6431353, "tpot_s": 0.005552909500413359, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13843674, 13843675, 13843676, 13843677, 13843678, 13843679, 13843680, 13843681, 13843682, 13843683, 13843684, 13856781, 13856782, 13856783, 13856784, 13856785, 13856786, 13856787, 13856788, 13878865, 13878866, 13878867, 13878868, 13878869], "trace_timestamp_s": 576.335, "ttft_s": 0.5558795689721592, "turn_id": 3} +{"actual_output_tokens": 46, "cached_tokens": 3920, "effective_input_length": 11216, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11216, "latency_s": 0.9084531379630789, "output_length": 46, "proxy_request_id": "1400379:3:1402972:763", "request_id": "1400379:3:1402972:763", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1400379", "t_dispatch_unix": 1779818171.58738, "t_finish_unix": 1779818172.495833, "t_first_token_unix": 1779818172.259186, "tpot_s": 0.005253255689361443, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13882808], "trace_timestamp_s": 577.8340000000007, "ttft_s": 0.6718046909663826, "turn_id": 3} +{"actual_output_tokens": 108, "cached_tokens": 0, "effective_input_length": 8848, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8848, "latency_s": 1.2512122599873692, "output_length": 108, "proxy_request_id": "1403188:1:1403188:764", "request_id": "1403188:1:1403188:764", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1403188", "t_dispatch_unix": 1779818172.4877539, "t_finish_unix": 1779818173.7389665, "t_first_token_unix": 1779818173.1702034, "tpot_s": 0.005312724084110287, "trace_hash_ids": [13861837, 13861838, 13861839, 13861840, 13861841, 13861842, 13861843, 13861844, 13873939, 13873940, 13873941, 13873942, 13884865, 13884866, 13884867, 13884868, 13884869, 13884870], "trace_timestamp_s": 578.7340000000004, "ttft_s": 0.6824475409812294, "turn_id": 1} +{"actual_output_tokens": 99, "cached_tokens": 85088, "effective_input_length": 85276, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85276, "latency_s": 28.020893047971185, "output_length": 99, "proxy_request_id": "1366128:17:1395596:731", "request_id": "1366128:17:1395596:731", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1366128", "t_dispatch_unix": 1779818145.8195815, "t_finish_unix": 1779818173.8404741, "t_first_token_unix": 1779818172.4469945, "tpot_s": 0.014216424622905574, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13813611], "trace_timestamp_s": 552.0660000000007, "ttft_s": 26.6274113439722, "turn_id": 17} +{"actual_output_tokens": 568, "cached_tokens": 31536, "effective_input_length": 32332, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32332, "latency_s": 4.095091523020528, "output_length": 568, "proxy_request_id": "1355484:16:1401320:758", "request_id": "1355484:16:1401320:758", "request_type": "coder", "requested_output_tokens": 568, "session_id": "1355484", "t_dispatch_unix": 1779818170.4392574, "t_finish_unix": 1779818174.5343487, "t_first_token_unix": 1779818170.7178483, "tpot_s": 0.006730626275121502, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299, 13867393, 13867394, 13867395], "trace_timestamp_s": 572.0710000000008, "ttft_s": 0.2785881190211512, "turn_id": 16} +{"actual_output_tokens": 87, "cached_tokens": 85360, "effective_input_length": 85504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85504, "latency_s": 1.557296472019516, "output_length": 87, "proxy_request_id": "1366128:18:1397382:735", "request_id": "1366128:18:1397382:735", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1366128", "t_dispatch_unix": 1779818173.843716, "t_finish_unix": 1779818175.4010122, "t_first_token_unix": 1779818174.1283915, "tpot_s": 0.014795006465350907, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174], "trace_timestamp_s": 558.107, "ttft_s": 0.28467256302246824, "turn_id": 18} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 1954, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1954, "latency_s": 0.4766314679873176, "output_length": 71, "proxy_request_id": "1403989:1:1403989:767", "request_id": "1403989:1:1403989:767", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1403989", "t_dispatch_unix": 1779818174.9836802, "t_finish_unix": 1779818175.4603117, "t_first_token_unix": 1779818175.115798, "tpot_s": 0.0049183329708674655, "trace_hash_ids": [13892332, 13892333, 13892334, 13892335], "trace_timestamp_s": 581.232, "ttft_s": 0.13211689901072532, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 3952, "effective_input_length": 11414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11414, "latency_s": 12.836400757019874, "output_length": 73, "proxy_request_id": "1398213:2:1400590:753", "request_id": "1398213:2:1400590:753", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1398213", "t_dispatch_unix": 1779818163.0474768, "t_finish_unix": 1779818175.8838775, "t_first_token_unix": 1779818163.7382216, "tpot_s": 0.1686842450144468, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13846300, 13846301, 13846302, 13846303, 13846304, 13851656, 13851657, 13851658, 13851659, 13851660, 13851661, 13860134, 13860135, 13860136, 13860137, 13860138], "trace_timestamp_s": 569.2930000000006, "ttft_s": 0.6907432680018246, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 85584, "effective_input_length": 85663, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85663, "latency_s": 0.5053475149907172, "output_length": 25, "proxy_request_id": "1366128:19:1398824:745", "request_id": "1366128:19:1398824:745", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1366128", "t_dispatch_unix": 1779818175.4043646, "t_finish_unix": 1779818175.909712, "t_first_token_unix": 1779818175.5999346, "tpot_s": 0.012897063124304017, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13843754], "trace_timestamp_s": 563.2670000000007, "ttft_s": 0.19556717900559306, "turn_id": 19} +{"actual_output_tokens": 115, "cached_tokens": 61984, "effective_input_length": 121811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121811, "latency_s": 35.49424895294942, "output_length": 115, "proxy_request_id": "1313181:7:1327489:383", "request_id": "1313181:7:1327489:383", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1313181", "t_dispatch_unix": 1779818140.6392574, "t_finish_unix": 1779818176.1335063, "t_first_token_unix": 1779818174.672738, "tpot_s": 0.012810633587753074, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321], "trace_timestamp_s": 313.01800000000003, "ttft_s": 34.03347721497994, "turn_id": 7} +{"actual_output_tokens": 81, "cached_tokens": 63376, "effective_input_length": 63643, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63643, "latency_s": 0.8640241039684042, "output_length": 81, "proxy_request_id": "1253743:8:1404284:769", "request_id": "1253743:8:1404284:769", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253743", "t_dispatch_unix": 1779818176.0031507, "t_finish_unix": 1779818176.8671727, "t_first_token_unix": 1779818176.2426746, "tpot_s": 0.007803213937586406, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 481346, 481347, 481348, 710670, 710671, 710672, 710673, 710674, 710675, 710676, 710677, 710678, 710679, 13839194, 13839195, 13839196, 13839197, 13839198, 13839199, 13839200, 13839201, 13839202, 13839203, 13839204, 13839205, 13839206, 13839207, 13839208, 13839209, 13839210, 13839211, 13839212, 13839213, 13839214, 13839215, 13839216, 13839217, 13839218, 13839219, 184023, 184024, 567789, 13839220, 13839221, 146857, 146858, 146859, 146860, 13839222, 11521, 13839223, 13839224, 13839225, 13839226, 13839227, 13839228, 13839229, 13839230, 13839231, 13839232, 13839233, 13839234, 13839235, 13839236, 13839237, 13839238, 13839239, 13839240, 13839241, 13839242, 13839243, 13839244, 13839245, 13839246, 13839247, 13839248, 13839249, 13839250, 13839251, 13839252, 13839253, 13839254, 13839255, 13839256, 13839257, 11719668, 13839258, 13839259, 13839260, 13839261, 13839262, 13839263, 13839264, 13839265, 13839266, 13839267, 13839268, 13839269, 13839270, 13839271, 13839272, 13839273, 13894363], "trace_timestamp_s": 582.25, "ttft_s": 0.23952320899115875, "turn_id": 8} +{"actual_output_tokens": 264, "cached_tokens": 41712, "effective_input_length": 44148, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44148, "latency_s": 2.721401514019817, "output_length": 264, "proxy_request_id": "1268861:8:1403753:765", "request_id": "1268861:8:1403753:765", "request_type": "coder", "requested_output_tokens": 264, "session_id": "1268861", "t_dispatch_unix": 1779818174.2323167, "t_finish_unix": 1779818176.9537177, "t_first_token_unix": 1779818175.0330212, "tpot_s": 0.007302140555222352, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 13890053], "trace_timestamp_s": 580.4790000000003, "ttft_s": 0.8007023539976217, "turn_id": 8} +{"actual_output_tokens": 283, "cached_tokens": 51056, "effective_input_length": 68109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68109, "latency_s": 15.46765036904253, "output_length": 283, "proxy_request_id": "1381387:4:1400724:754", "request_id": "1381387:4:1400724:754", "request_type": "coder", "requested_output_tokens": 283, "session_id": "1381387", "t_dispatch_unix": 1779818163.6167984, "t_finish_unix": 1779818179.0844488, "t_first_token_unix": 1779818172.9644032, "tpot_s": 0.021701266180809774, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13861879], "trace_timestamp_s": 569.8560000000007, "ttft_s": 9.347603158035781, "turn_id": 4} +{"actual_output_tokens": 47, "cached_tokens": 38128, "effective_input_length": 39203, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39203, "latency_s": 1.6248265179456212, "output_length": 47, "proxy_request_id": "1382089:2:1404847:773", "request_id": "1382089:2:1404847:773", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1382089", "t_dispatch_unix": 1779818177.997793, "t_finish_unix": 1779818179.6226192, "t_first_token_unix": 1779818179.1380963, "tpot_s": 0.010526178804550158, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463], "trace_timestamp_s": 584.2460000000001, "ttft_s": 1.140302030951716, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 5104, "effective_input_length": 6149, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6149, "latency_s": 0.24919221503660083, "output_length": 13, "proxy_request_id": "1399948:2:1405276:778", "request_id": "1399948:2:1405276:778", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1399948", "t_dispatch_unix": 1779818179.4547997, "t_finish_unix": 1779818179.703992, "t_first_token_unix": 1779818179.6220045, "tpot_s": 0.006810529167220618, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13902108], "trace_timestamp_s": 585.7030000000004, "ttft_s": 0.1672031840425916, "turn_id": 2} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 21009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21009, "latency_s": 2.4033495349576697, "output_length": 34, "proxy_request_id": "1398594:2:1404702:771", "request_id": "1398594:2:1404702:771", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1398594", "t_dispatch_unix": 1779818177.4936945, "t_finish_unix": 1779818179.8970437, "t_first_token_unix": 1779818179.7190642, "tpot_s": 0.005385359696281905, "trace_hash_ids": [13835320, 13835321, 13835322, 13835323, 13835324, 13835325, 13835326, 13841636, 13841637, 13841638, 13841639, 13841640, 13841641, 13841642, 13841643, 13848797, 13848798, 13848799, 13848800, 13848801, 13848802, 13858752, 13858753, 13858754, 13858755, 13858756, 13858757, 13858758, 13858759, 13858760, 13858761, 13867990, 13867991, 13867992, 13867993, 13877954, 13877955, 13884204, 13884205, 13897216, 13897217, 13897218], "trace_timestamp_s": 583.7370000000001, "ttft_s": 2.225368372979574, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 11503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11503, "latency_s": 1.525479099014774, "output_length": 47, "proxy_request_id": "1405199:1:1405199:776", "request_id": "1405199:1:1405199:776", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1405199", "t_dispatch_unix": 1779818179.2319782, "t_finish_unix": 1779818180.7574568, "t_first_token_unix": 1779818180.1915128, "tpot_s": 0.012295735239446081, "trace_hash_ids": [13880436, 13880437, 13880438, 13880439, 13880440, 13880441, 13880442, 13880443, 13880444, 13880445, 13880446, 13880447, 13880448, 13880449, 13886683, 13886684, 13886685, 13893489, 13901376, 13901377, 13901378, 13901379, 13901380], "trace_timestamp_s": 585.4770000000008, "ttft_s": 0.9595335979829542, "turn_id": 1} +{"actual_output_tokens": 191, "cached_tokens": 68384, "effective_input_length": 69508, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69508, "latency_s": 3.3000551009899937, "output_length": 191, "proxy_request_id": "1381387:5:1404170:768", "request_id": "1381387:5:1404170:768", "request_type": "coder", "requested_output_tokens": 191, "session_id": "1381387", "t_dispatch_unix": 1779818179.089198, "t_finish_unix": 1779818182.3892536, "t_first_token_unix": 1779818179.7749808, "tpot_s": 0.013757824868355927, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13893570], "trace_timestamp_s": 581.8360000000002, "ttft_s": 0.6857803360326216, "turn_id": 5} +{"actual_output_tokens": 56, "cached_tokens": 6160, "effective_input_length": 7995, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7995, "latency_s": 0.6263577839708887, "output_length": 56, "proxy_request_id": "1399948:3:1405988:782", "request_id": "1399948:3:1405988:782", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1399948", "t_dispatch_unix": 1779818182.0746064, "t_finish_unix": 1779818182.7009637, "t_first_token_unix": 1779818182.2878811, "tpot_s": 0.007504593508995392, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13907778], "trace_timestamp_s": 588.3230000000003, "ttft_s": 0.21327389095677063, "turn_id": 3} +{"actual_output_tokens": 458, "cached_tokens": 11472, "effective_input_length": 12910, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12910, "latency_s": 6.958765536022838, "output_length": 458, "proxy_request_id": "1398213:3:1401507:759", "request_id": "1398213:3:1401507:759", "request_type": "coder", "requested_output_tokens": 458, "session_id": "1398213", "t_dispatch_unix": 1779818175.8851323, "t_finish_unix": 1779818182.843898, "t_first_token_unix": 1779818176.1452518, "tpot_s": 0.014657055691503095, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13846300, 13846301, 13846302, 13846303, 13846304, 13851656, 13851657, 13851658, 13851659, 13851660, 13851661, 13860134, 13860135, 13860136, 13860137, 13869190, 13869191, 13869192, 13869193], "trace_timestamp_s": 572.7200000000003, "ttft_s": 0.2601183879887685, "turn_id": 3} +{"actual_output_tokens": 196, "cached_tokens": 0, "effective_input_length": 93040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93040, "latency_s": 30.564615280018188, "output_length": 196, "proxy_request_id": "1397515:1:1397515:736", "request_id": "1397515:1:1397515:736", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1397515", "t_dispatch_unix": 1779818152.3395667, "t_finish_unix": 1779818182.9041815, "t_first_token_unix": 1779818180.8060439, "tpot_s": 0.010758549938253007, "trace_hash_ids": [61256, 61257, 9334, 61258, 61259, 61260, 61261, 61262, 61263, 61264, 61265, 139791, 92491, 139792, 139793, 139794, 139795, 139796, 139797, 139798, 740834, 740835, 740836, 740837, 1942273, 1942274, 1942275, 1942276, 1942277, 1942278, 1942279, 1942280, 1942281, 590845, 590846, 590847, 590848, 1942282, 161018, 161019, 161020, 161021, 1942283, 10351134, 10351135, 10351136, 10351137, 10351138, 10351139, 10351140, 10351141, 10351142, 10351143, 13831505, 2806911, 13831506, 13831507, 13831508, 13831509, 13831510, 13831511, 13831512, 13831513, 13831514, 13831515, 13831516, 13831517, 13831518, 13831519, 13831520, 13831521, 13831522, 13831523, 13831524, 13831525, 13831526, 13831527, 13831528, 13831529, 13831530, 13831531, 13831532, 13831533, 13831534, 13831535, 13831536, 13831537, 13831538, 13831539, 13831540, 13831541, 13831542, 13831543, 13831544, 13831545, 13831546, 13831547, 13831548, 13831549, 13831550, 13831551, 13831552, 13831553, 13831554, 13831555, 13831556, 13831557, 13831558, 13831559, 13831560, 13831561, 13831562, 13831563, 13831564, 13831565, 13831566, 13831567, 13831568, 13831569, 13831570, 13831571, 13831572, 13831573, 13831574, 13831575, 13831576, 13831577, 13831578, 13831579, 13831580, 13831581, 13831582, 13831583, 13831584, 13831585, 13831586, 13831587, 13831588, 13831589, 13831590, 13831591, 13831592, 13831593, 13831594, 13831595, 13831596, 13831597, 13831598, 13831599, 13831600, 13831601, 13831602, 13831603, 13831604, 13831605, 13831606, 13831607, 13831608, 13831609, 13831610, 13831611, 13831612, 13831613, 13831614, 13831615, 13831616, 13831617, 13831618, 13831619, 13831620, 13831621, 13831622, 13831623, 13831624, 13831625, 13831626, 13831627, 13831628, 13831629, 13831630, 13831631, 13831632], "trace_timestamp_s": 558.5540000000001, "ttft_s": 28.46647509903414, "turn_id": 1} +{"actual_output_tokens": 556, "cached_tokens": 49552, "effective_input_length": 62630, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62630, "latency_s": 18.185870163026266, "output_length": 556, "proxy_request_id": "1364090:5:1401054:756", "request_id": "1364090:5:1401054:756", "request_type": "coder", "requested_output_tokens": 556, "session_id": "1364090", "t_dispatch_unix": 1779818164.8852506, "t_finish_unix": 1779818183.0711205, "t_first_token_unix": 1779818175.0087886, "tpot_s": 0.014526216987402992, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13865242], "trace_timestamp_s": 571.1260000000002, "ttft_s": 10.123536115977913, "turn_id": 5} +{"actual_output_tokens": 531, "cached_tokens": 0, "effective_input_length": 13134, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13134, "latency_s": 33.41643302800367, "output_length": 531, "proxy_request_id": "1397223:1:1397223:734", "request_id": "1397223:1:1397223:734", "request_type": "coder", "requested_output_tokens": 531, "session_id": "1397223", "t_dispatch_unix": 1779818151.248274, "t_finish_unix": 1779818184.6647074, "t_first_token_unix": 1779818152.348574, "tpot_s": 0.06097323147729391, "trace_hash_ids": [13793541, 13793542, 13793543, 13802362, 13802363, 13802364, 13802365, 13802366, 13802367, 13811273, 13811274, 13811275, 13811276, 13811277, 13811278, 13811279, 13811280, 13819026, 13819027, 13819028, 13819029, 13828841, 13828842, 13828843, 13828844, 13828845], "trace_timestamp_s": 557.4880000000003, "ttft_s": 1.1002985690138303, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 11248, "effective_input_length": 19966, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19966, "latency_s": 5.200787005014718, "output_length": 49, "proxy_request_id": "1400379:4:1405483:779", "request_id": "1400379:4:1405483:779", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1400379", "t_dispatch_unix": 1779818180.1152105, "t_finish_unix": 1779818185.3159974, "t_first_token_unix": 1779818184.9322112, "tpot_s": 0.007988781458455682, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13889270, 13889271, 13889272, 13889273, 13889274, 13895605, 13895606, 13895607, 13895608, 13895609, 13903871, 13903872, 13903873, 13903874, 13903875, 13903876, 13903877, 13903878], "trace_timestamp_s": 586.3600000000006, "ttft_s": 4.816998334019445, "turn_id": 4} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 2115, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2115, "latency_s": 0.36772920202929527, "output_length": 47, "proxy_request_id": "1406966:1:1406966:785", "request_id": "1406966:1:1406966:785", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1406966", "t_dispatch_unix": 1779818185.4838839, "t_finish_unix": 1779818185.851613, "t_first_token_unix": 1779818185.6264248, "tpot_s": 0.004888234217145035, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13917925], "trace_timestamp_s": 591.732, "ttft_s": 0.14253896701848134, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 8048, "effective_input_length": 8540, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8540, "latency_s": 0.2570640359772369, "output_length": 23, "proxy_request_id": "1399948:4:1407140:786", "request_id": "1399948:4:1407140:786", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1399948", "t_dispatch_unix": 1779818186.016801, "t_finish_unix": 1779818186.2738633, "t_first_token_unix": 1779818186.1209803, "tpot_s": 0.006938306456008418, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13919490], "trace_timestamp_s": 592.2640000000001, "ttft_s": 0.10417973896255717, "turn_id": 4} +{"actual_output_tokens": 64, "cached_tokens": 20000, "effective_input_length": 22009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22009, "latency_s": 0.9564765809918754, "output_length": 64, "proxy_request_id": "1400379:5:1406380:784", "request_id": "1400379:5:1406380:784", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1400379", "t_dispatch_unix": 1779818185.3185587, "t_finish_unix": 1779818186.275035, "t_first_token_unix": 1779818185.729592, "tpot_s": 0.008654980729925371, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13889270, 13889271, 13889272, 13889273, 13889274, 13895605, 13895606, 13895607, 13895608, 13895609, 13903871, 13903872, 13903873, 13903874, 13903875, 13903876, 13903877, 13903878, 13912279, 13912280, 13912281, 13912282], "trace_timestamp_s": 589.7420000000002, "ttft_s": 0.41103195102186874, "turn_id": 5} +{"actual_output_tokens": 1206, "cached_tokens": 0, "effective_input_length": 21684, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21684, "latency_s": 10.707567011006176, "output_length": 1206, "proxy_request_id": "1404395:1:1404395:770", "request_id": "1404395:1:1404395:770", "request_type": "coder", "requested_output_tokens": 1206, "session_id": "1404395", "t_dispatch_unix": 1779818176.3970575, "t_finish_unix": 1779818187.104625, "t_first_token_unix": 1779818178.761029, "tpot_s": 0.006923865219066113, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13895255], "trace_timestamp_s": 582.6379999999999, "ttft_s": 2.363969495985657, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 1531, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1531, "latency_s": 0.3768509450019337, "output_length": 55, "proxy_request_id": "1407494:1:1407494:787", "request_id": "1407494:1:1407494:787", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1407494", "t_dispatch_unix": 1779818187.2801712, "t_finish_unix": 1779818187.6570215, "t_first_token_unix": 1779818187.392866, "tpot_s": 0.004886791647920661, "trace_hash_ids": [13922818, 13922819, 13922820], "trace_timestamp_s": 593.5290000000005, "ttft_s": 0.1126938610104844, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 2160, "effective_input_length": 4789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4789, "latency_s": 0.42461276100948453, "output_length": 44, "proxy_request_id": "1406966:2:1407710:789", "request_id": "1406966:2:1407710:789", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1406966", "t_dispatch_unix": 1779818187.961965, "t_finish_unix": 1779818188.3865778, "t_first_token_unix": 1779818188.168571, "tpot_s": 0.0050625455576579935, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13924515, 13924516, 13924517, 13924518, 13924519, 13924520], "trace_timestamp_s": 594.21, "ttft_s": 0.2066046840045601, "turn_id": 2} +{"actual_output_tokens": 193, "cached_tokens": 0, "effective_input_length": 1501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1501, "latency_s": 1.0556663919705898, "output_length": 193, "proxy_request_id": "1407599:1:1407599:788", "request_id": "1407599:1:1407599:788", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1407599", "t_dispatch_unix": 1779818187.6286957, "t_finish_unix": 1779818188.6843622, "t_first_token_unix": 1779818187.737356, "tpot_s": 0.004931067781096014, "trace_hash_ids": [10764018, 13923669, 13923670], "trace_timestamp_s": 593.8770000000004, "ttft_s": 0.10865893302252516, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 8560, "effective_input_length": 8612, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8612, "latency_s": 0.16209746699314564, "output_length": 24, "proxy_request_id": "1399948:5:1407922:791", "request_id": "1399948:5:1407922:791", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1399948", "t_dispatch_unix": 1779818188.8009021, "t_finish_unix": 1779818188.9629993, "t_first_token_unix": 1779818188.8486989, "tpot_s": 0.0049584312161997605, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13926411], "trace_timestamp_s": 595.0500000000002, "ttft_s": 0.04779564402997494, "turn_id": 5} +{"actual_output_tokens": 76, "cached_tokens": 0, "effective_input_length": 2944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2944, "latency_s": 0.5872661999892443, "output_length": 76, "proxy_request_id": "1407995:1:1407995:793", "request_id": "1407995:1:1407995:793", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1407995", "t_dispatch_unix": 1779818189.0950828, "t_finish_unix": 1779818189.6823492, "t_first_token_unix": 1779818189.3056717, "tpot_s": 0.0050189650671867035, "trace_hash_ids": [13926947, 13926948, 13926949, 13926950, 13926951, 13926952], "trace_timestamp_s": 595.3430000000008, "ttft_s": 0.2105869819642976, "turn_id": 1} +{"actual_output_tokens": 747, "cached_tokens": 0, "effective_input_length": 32944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32944, "latency_s": 11.440294324012939, "output_length": 747, "proxy_request_id": "1405155:1:1405155:775", "request_id": "1405155:1:1405155:775", "request_type": "coder", "requested_output_tokens": 747, "session_id": "1405155", "t_dispatch_unix": 1779818179.1072223, "t_finish_unix": 1779818190.5475163, "t_first_token_unix": 1779818184.8296185, "tpot_s": 0.007663285613950122, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13900957], "trace_timestamp_s": 585.3360000000002, "ttft_s": 5.722392811032478, "turn_id": 1} +{"actual_output_tokens": 53, "cached_tokens": 8944, "effective_input_length": 14728, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14728, "latency_s": 0.9696396880317479, "output_length": 53, "proxy_request_id": "1403188:2:1408249:796", "request_id": "1403188:2:1408249:796", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1403188", "t_dispatch_unix": 1779818190.0420887, "t_finish_unix": 1779818191.011728, "t_first_token_unix": 1779818190.7326188, "tpot_s": 0.005361585230835212, "trace_hash_ids": [13929233, 13929234, 13929235, 13929236, 13929237, 13929238, 13929239, 13929240, 13929241, 13929242, 13929243, 13929244, 13929245, 13929246, 13929247, 13929248, 13929249, 13929250, 13929251, 13929252, 13929253, 13929254, 13929255, 13929256, 13929257, 13929258, 13929259, 13929260, 13929261], "trace_timestamp_s": 596.2850000000008, "ttft_s": 0.6905286990222521, "turn_id": 2} +{"actual_output_tokens": 39, "cached_tokens": 0, "effective_input_length": 7553, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7553, "latency_s": 0.7218587099923752, "output_length": 39, "proxy_request_id": "1408430:1:1408430:797", "request_id": "1408430:1:1408430:797", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1408430", "t_dispatch_unix": 1779818190.627948, "t_finish_unix": 1779818191.3498, "t_first_token_unix": 1779818191.1546302, "tpot_s": 0.005129896710920883, "trace_hash_ids": [13895286, 13899747, 13899748, 13906888, 13906889, 13914310, 13914311, 13914312, 13925471, 13925472, 13930592, 13930593, 13930594, 13930595, 13930596], "trace_timestamp_s": 596.8710000000001, "ttft_s": 0.5266875230008736, "turn_id": 1} +{"actual_output_tokens": 65, "cached_tokens": 68624, "effective_input_length": 73188, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73188, "latency_s": 3.0842956560081802, "output_length": 65, "proxy_request_id": "1363093:5:1407810:790", "request_id": "1363093:5:1407810:790", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1363093", "t_dispatch_unix": 1779818188.4053657, "t_finish_unix": 1779818191.4896612, "t_first_token_unix": 1779818190.5462003, "tpot_s": 0.014736615203219117, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678, 13925441, 13925442, 13925443, 13925444, 13925445, 13925446, 13925447, 13925448, 13925449], "trace_timestamp_s": 594.6500000000005, "ttft_s": 2.140831305005122, "turn_id": 5} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 3230, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3230, "latency_s": 0.326072622963693, "output_length": 26, "proxy_request_id": "1408889:1:1408889:804", "request_id": "1408889:1:1408889:804", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1408889", "t_dispatch_unix": 1779818192.095728, "t_finish_unix": 1779818192.4218004, "t_first_token_unix": 1779818192.298537, "tpot_s": 0.004919964640866965, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13935101], "trace_timestamp_s": 598.344, "ttft_s": 0.20280810398980975, "turn_id": 1} +{"actual_output_tokens": 91, "cached_tokens": 10848, "effective_input_length": 11070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11070, "latency_s": 1.2126826019957662, "output_length": 91, "proxy_request_id": "1362265:7:1408772:800", "request_id": "1362265:7:1408772:800", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1362265", "t_dispatch_unix": 1779818191.7082124, "t_finish_unix": 1779818192.9208956, "t_first_token_unix": 1779818191.810327, "tpot_s": 0.012333890488500603, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 13934071], "trace_timestamp_s": 597.9570000000003, "ttft_s": 0.10211339901434258, "turn_id": 7} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 1801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1801, "latency_s": 1.9689164169831201, "output_length": 47, "proxy_request_id": "1408779:1:1408779:802", "request_id": "1408779:1:1408779:802", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1408779", "t_dispatch_unix": 1779818191.7327478, "t_finish_unix": 1779818193.701664, "t_first_token_unix": 1779818193.3803296, "tpot_s": 0.006975709262010439, "trace_hash_ids": [13934169, 13934170, 13934171, 13934172], "trace_timestamp_s": 597.9740000000002, "ttft_s": 1.6475808029645123, "turn_id": 1} +{"actual_output_tokens": 3525, "cached_tokens": 88128, "effective_input_length": 106143, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106143, "latency_s": 53.10688796802424, "output_length": 3525, "proxy_request_id": "1370129:6:1394177:722", "request_id": "1370129:6:1394177:722", "request_type": "coder", "requested_output_tokens": 3525, "session_id": "1370129", "t_dispatch_unix": 1779818140.8223777, "t_finish_unix": 1779818193.9292653, "t_first_token_unix": 1779818151.8246949, "tpot_s": 0.011947880040572229, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13768317, 13768318, 13768319, 13768320, 13768321, 13801467, 13801468, 13801469, 13801470, 13801471, 13801472, 13801473, 13801474, 13801475, 13801476, 13801477, 13801478, 13801479, 13801480, 13801481, 13801482, 13801483, 13801484, 13801485, 13801486, 13801487, 13801488, 13801489, 13801490, 13801491, 13801492, 13801493, 13801494, 13801495, 13801496, 13801497, 13801498, 13801499, 13801500, 13801501, 13801502, 13801503], "trace_timestamp_s": 547.0610000000006, "ttft_s": 11.002314801036846, "turn_id": 6} +{"actual_output_tokens": 110, "cached_tokens": 0, "effective_input_length": 27786, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27786, "latency_s": 4.32234834501287, "output_length": 110, "proxy_request_id": "1340290:7:1408176:795", "request_id": "1340290:7:1408176:795", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1340290", "t_dispatch_unix": 1779818189.779704, "t_finish_unix": 1779818194.1020525, "t_first_token_unix": 1779818193.2479863, "tpot_s": 0.007833008449887772, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13928402], "trace_timestamp_s": 596.0280000000002, "ttft_s": 3.4682802449679, "turn_id": 7} +{"actual_output_tokens": 196, "cached_tokens": 27888, "effective_input_length": 29730, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29730, "latency_s": 1.7087096329778433, "output_length": 196, "proxy_request_id": "1340290:8:1409129:805", "request_id": "1340290:8:1409129:805", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1340290", "t_dispatch_unix": 1779818194.1041243, "t_finish_unix": 1779818195.812834, "t_first_token_unix": 1779818194.5511012, "tpot_s": 0.006469093938358128, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13936967], "trace_timestamp_s": 599.3500000000004, "ttft_s": 0.446974307007622, "turn_id": 8} +{"actual_output_tokens": 88, "cached_tokens": 85680, "effective_input_length": 97657, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97657, "latency_s": 20.63395429600496, "output_length": 88, "proxy_request_id": "1366128:20:1400446:752", "request_id": "1366128:20:1400446:752", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1366128", "t_dispatch_unix": 1779818175.9177322, "t_finish_unix": 1779818196.5516868, "t_first_token_unix": 1779818182.82737, "tpot_s": 0.15774754824146264, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600], "trace_timestamp_s": 568.7440000000006, "ttft_s": 6.909631840011571, "turn_id": 20} +{"actual_output_tokens": 30, "cached_tokens": 1840, "effective_input_length": 5001, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5001, "latency_s": 0.654025559022557, "output_length": 30, "proxy_request_id": "1408779:2:1410032:807", "request_id": "1408779:2:1410032:807", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1408779", "t_dispatch_unix": 1779818196.2462616, "t_finish_unix": 1779818196.9002867, "t_first_token_unix": 1779818196.4810557, "tpot_s": 0.014447607344883526, "trace_hash_ids": [13934169, 13934170, 13934171, 13940285, 13940286, 13945464, 13945465, 13945466, 13945467, 13945468], "trace_timestamp_s": 602.4940000000006, "ttft_s": 0.2347933590062894, "turn_id": 2} +{"actual_output_tokens": 39, "cached_tokens": 4832, "effective_input_length": 7893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7893, "latency_s": 0.4942089900141582, "output_length": 39, "proxy_request_id": "1406966:3:1410097:808", "request_id": "1406966:3:1410097:808", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1406966", "t_dispatch_unix": 1779818196.4794044, "t_finish_unix": 1779818196.973613, "t_first_token_unix": 1779818196.761384, "tpot_s": 0.005578517446625291, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13924515, 13924516, 13924517, 13924518, 13924519, 13938672, 13938673, 13938674, 13938675, 13938676, 13945877, 13945878], "trace_timestamp_s": 602.7270000000008, "ttft_s": 0.2819782770238817, "turn_id": 3} +{"actual_output_tokens": 28, "cached_tokens": 1584, "effective_input_length": 4728, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4728, "latency_s": 0.3617274509742856, "output_length": 28, "proxy_request_id": "1407494:2:1410400:809", "request_id": "1407494:2:1410400:809", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1407494", "t_dispatch_unix": 1779818197.3439507, "t_finish_unix": 1779818197.705678, "t_first_token_unix": 1779818197.5707357, "tpot_s": 0.004987066926400142, "trace_hash_ids": [13922818, 13922819, 13922820, 13939528, 13939529, 13939530, 13948712, 13948713, 13948714, 13948715], "trace_timestamp_s": 603.5920000000006, "ttft_s": 0.2267834689700976, "turn_id": 2} +{"actual_output_tokens": 49, "cached_tokens": 29920, "effective_input_length": 29958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29958, "latency_s": 0.3690862039802596, "output_length": 49, "proxy_request_id": "1340290:9:1410595:811", "request_id": "1340290:9:1410595:811", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1340290", "t_dispatch_unix": 1779818197.8991866, "t_finish_unix": 1779818198.2682726, "t_first_token_unix": 1779818197.9766629, "tpot_s": 0.006070699520932976, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13950218], "trace_timestamp_s": 604.1469999999999, "ttft_s": 0.07747368997661397, "turn_id": 9} +{"actual_output_tokens": 110, "cached_tokens": 69696, "effective_input_length": 71570, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71570, "latency_s": 5.453055004007183, "output_length": 110, "proxy_request_id": "1381387:6:1409195:806", "request_id": "1381387:6:1409195:806", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1381387", "t_dispatch_unix": 1779818193.3603866, "t_finish_unix": 1779818198.8134413, "t_first_token_unix": 1779818197.2588925, "tpot_s": 0.014259718605765748, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13937687, 13937688, 13937689, 13937690, 13937691], "trace_timestamp_s": 599.6050000000005, "ttft_s": 3.8985036779777147, "turn_id": 6} +{"actual_output_tokens": 207, "cached_tokens": 0, "effective_input_length": 6377, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6377, "latency_s": 8.137268158025108, "output_length": 207, "proxy_request_id": "1408578:1:1408578:798", "request_id": "1408578:1:1408578:798", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1408578", "t_dispatch_unix": 1779818191.049209, "t_finish_unix": 1779818199.1864774, "t_first_token_unix": 1779818191.480094, "tpot_s": 0.03740782771842753, "trace_hash_ids": [13916254, 13916255, 13916256, 13916257, 13916258, 13916259, 13916260, 13921648, 13926172, 13926173, 13926174, 13931865, 13931866], "trace_timestamp_s": 597.2930000000006, "ttft_s": 0.430883647990413, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 5024, "effective_input_length": 7110, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7110, "latency_s": 0.3586462559760548, "output_length": 31, "proxy_request_id": "1408779:3:1411249:815", "request_id": "1408779:3:1411249:815", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1408779", "t_dispatch_unix": 1779818200.2603946, "t_finish_unix": 1779818200.619041, "t_first_token_unix": 1779818200.4668326, "tpot_s": 0.0050649315662061175, "trace_hash_ids": [13934169, 13934170, 13934171, 13940285, 13940286, 13945464, 13945465, 13945466, 13945467, 13956042, 13956043, 13956044, 13956045, 13956046], "trace_timestamp_s": 606.5080000000007, "ttft_s": 0.20643688598647714, "turn_id": 3} +{"actual_output_tokens": 417, "cached_tokens": 63184, "effective_input_length": 73392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73392, "latency_s": 9.888117468974087, "output_length": 417, "proxy_request_id": "1364090:6:1408777:801", "request_id": "1364090:6:1408777:801", "request_type": "coder", "requested_output_tokens": 417, "session_id": "1364090", "t_dispatch_unix": 1779818191.7263908, "t_finish_unix": 1779818201.6145096, "t_first_token_unix": 1779818196.2982419, "tpot_s": 0.012778290024121257, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13934141], "trace_timestamp_s": 597.969, "ttft_s": 4.571848874969874, "turn_id": 6} +{"actual_output_tokens": 280, "cached_tokens": 30000, "effective_input_length": 30154, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30154, "latency_s": 1.9490644910256378, "output_length": 280, "proxy_request_id": "1340290:10:1411397:816", "request_id": "1340290:10:1411397:816", "request_type": "coder", "requested_output_tokens": 280, "session_id": "1340290", "t_dispatch_unix": 1779818200.8852232, "t_finish_unix": 1779818202.8342874, "t_first_token_unix": 1779818201.013433, "tpot_s": 0.00652547894270196, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145], "trace_timestamp_s": 607.1330000000007, "ttft_s": 0.12820838601328433, "turn_id": 10} +{"actual_output_tokens": 63, "cached_tokens": 4752, "effective_input_length": 9801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9801, "latency_s": 0.9886614780407399, "output_length": 63, "proxy_request_id": "1407494:3:1413526:825", "request_id": "1407494:3:1413526:825", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1407494", "t_dispatch_unix": 1779818208.294349, "t_finish_unix": 1779818209.2830102, "t_first_token_unix": 1779818208.770963, "tpot_s": 0.008253042629334115, "trace_hash_ids": [13922818, 13922819, 13922820, 13939528, 13939529, 13939530, 13948712, 13948713, 13948714, 13962495, 13962496, 13962497, 13962498, 13962499, 13962500, 13962501, 13962502, 13977212, 13977213, 13977214], "trace_timestamp_s": 614.5410000000002, "ttft_s": 0.47661177802365273, "turn_id": 3} +{"actual_output_tokens": 249, "cached_tokens": 30432, "effective_input_length": 35022, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35022, "latency_s": 3.3348691210267134, "output_length": 249, "proxy_request_id": "1340290:11:1413050:822", "request_id": "1340290:11:1413050:822", "request_type": "coder", "requested_output_tokens": 249, "session_id": "1340290", "t_dispatch_unix": 1779818206.499067, "t_finish_unix": 1779818209.833936, "t_first_token_unix": 1779818207.6208115, "tpot_s": 0.008922761124971833, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 13972768], "trace_timestamp_s": 612.7440000000006, "ttft_s": 1.1217414350248873, "turn_id": 11} +{"actual_output_tokens": 193, "cached_tokens": 17408, "effective_input_length": 40273, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40273, "latency_s": 6.13578176300507, "output_length": 193, "proxy_request_id": "1277428:8:1412675:821", "request_id": "1277428:8:1412675:821", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1277428", "t_dispatch_unix": 1779818205.2118206, "t_finish_unix": 1779818211.3476024, "t_first_token_unix": 1779818210.0100634, "tpot_s": 0.006964770171786465, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 13969076], "trace_timestamp_s": 611.4540000000006, "ttft_s": 4.798240464006085, "turn_id": 8} +{"actual_output_tokens": 74, "cached_tokens": 0, "effective_input_length": 22392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22392, "latency_s": 2.8826126210042275, "output_length": 74, "proxy_request_id": "1407995:2:1413725:826", "request_id": "1407995:2:1413725:826", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1407995", "t_dispatch_unix": 1779818208.9240344, "t_finish_unix": 1779818211.8066466, "t_first_token_unix": 1779818211.3807764, "tpot_s": 0.005830049492444282, "trace_hash_ids": [13926947, 13926948, 13926949, 13926950, 13926951, 13936036, 13936037, 13936038, 13936039, 13936040, 13945776, 13945777, 13945778, 13945779, 13955974, 13955975, 13955976, 13955977, 13955978, 13955979, 13955980, 13964295, 13964296, 13964297, 13964298, 13964299, 13964300, 13964301, 13964302, 13971392, 13971393, 13971394, 13971395, 13971396, 13971397, 13971398, 13978636, 13978637, 13978638, 13978639, 13978640, 13978641, 13978642, 13978643], "trace_timestamp_s": 615.1620000000003, "ttft_s": 2.456740316003561, "turn_id": 2} +{"actual_output_tokens": 510, "cached_tokens": 73808, "effective_input_length": 86193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86193, "latency_s": 13.577903103956487, "output_length": 510, "proxy_request_id": "1364090:7:1412644:820", "request_id": "1364090:7:1412644:820", "request_type": "coder", "requested_output_tokens": 510, "session_id": "1364090", "t_dispatch_unix": 1779818205.110089, "t_finish_unix": 1779818218.6879919, "t_first_token_unix": 1779818211.4306865, "tpot_s": 0.014257281870340604, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 13968786], "trace_timestamp_s": 611.3520000000008, "ttft_s": 6.320595697965473, "turn_id": 7} +{"actual_output_tokens": 393, "cached_tokens": 62016, "effective_input_length": 62018, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62018, "latency_s": 49.6106996210292, "output_length": 393, "proxy_request_id": "1313181:7:1382851:662", "request_id": "1313181:7:1382851:662", "request_type": "coder", "requested_output_tokens": 393, "session_id": "1313181", "t_dispatch_unix": 1779818176.1367307, "t_finish_unix": 1779818225.7474306, "t_first_token_unix": 1779818176.2512858, "tpot_s": 0.12626504595673582, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13697374], "trace_timestamp_s": 507.1290000000008, "ttft_s": 0.11455248098354787, "turn_id": 7} +{"actual_output_tokens": 743, "cached_tokens": 22000, "effective_input_length": 23641, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23641, "latency_s": 88.33187459799228, "output_length": 743, "proxy_request_id": "1363943:9:1390468:707", "request_id": "1363943:9:1390468:707", "request_type": "coder", "requested_output_tokens": 743, "session_id": "1363943", "t_dispatch_unix": 1779818139.4023514, "t_finish_unix": 1779818227.734226, "t_first_token_unix": 1779818139.7822945, "tpot_s": 0.11853289973311443, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13768294], "trace_timestamp_s": 534.134, "ttft_s": 0.3799411550280638, "turn_id": 9} +{"actual_output_tokens": 212, "cached_tokens": 0, "effective_input_length": 27676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27676, "latency_s": 38.92165185097838, "output_length": 212, "proxy_request_id": "1286804:5:1407989:792", "request_id": "1286804:5:1407989:792", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1286804", "t_dispatch_unix": 1779818189.0675843, "t_finish_unix": 1779818227.9892359, "t_first_token_unix": 1779818224.3914976, "tpot_s": 0.017049362094823484, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13654392, 13654393, 13654394, 13654395, 13654396, 13654397, 13654398, 13654399, 13654400, 13654401, 13654402, 13654403, 13654404, 13926882, 13926883, 13926884, 13926885, 13926886, 13926887, 13926888, 13926889, 13926890, 13926891, 13926892, 13926893], "trace_timestamp_s": 595.3130000000001, "ttft_s": 35.32391189498594, "turn_id": 5} +{"actual_output_tokens": 18, "cached_tokens": 8624, "effective_input_length": 11381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11381, "latency_s": 30.263141031959094, "output_length": 18, "proxy_request_id": "1399948:6:1410696:812", "request_id": "1399948:6:1410696:812", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1399948", "t_dispatch_unix": 1779818198.231738, "t_finish_unix": 1779818228.494879, "t_first_token_unix": 1779818228.3053992, "tpot_s": 0.011132157643955639, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 13951145], "trace_timestamp_s": 604.4790000000003, "ttft_s": 30.07366012199782, "turn_id": 6} +{"actual_output_tokens": 43, "cached_tokens": 0, "effective_input_length": 97814, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97814, "latency_s": 32.290217981964815, "output_length": 43, "proxy_request_id": "1366128:21:1402408:760", "request_id": "1366128:21:1402408:760", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1366128", "t_dispatch_unix": 1779818196.5563996, "t_finish_unix": 1779818228.8466177, "t_first_token_unix": 1779818227.9640722, "tpot_s": 0.021004989333007307, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13877569], "trace_timestamp_s": 575.7920000000004, "ttft_s": 31.407659151009284, "turn_id": 21} +{"actual_output_tokens": 56, "cached_tokens": 3248, "effective_input_length": 4825, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4825, "latency_s": 31.586391579010524, "output_length": 56, "proxy_request_id": "1408889:2:1410453:810", "request_id": "1408889:2:1410453:810", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1408889", "t_dispatch_unix": 1779818197.4825313, "t_finish_unix": 1779818229.0689232, "t_first_token_unix": 1779818228.303304, "tpot_s": 0.013912908691616559, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13940392, 13940393, 13948965, 13948966], "trace_timestamp_s": 603.7310000000007, "ttft_s": 30.82077026698971, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 97856, "effective_input_length": 97917, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97917, "latency_s": 0.3037259610136971, "output_length": 13, "proxy_request_id": "1366128:22:1403837:766", "request_id": "1366128:22:1403837:766", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1366128", "t_dispatch_unix": 1779818228.8518465, "t_finish_unix": 1779818229.1555724, "t_first_token_unix": 1779818229.0842037, "tpot_s": 0.005911071416145812, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13890604], "trace_timestamp_s": 580.759, "ttft_s": 0.23235494398977607, "turn_id": 22} +{"actual_output_tokens": 43, "cached_tokens": 11392, "effective_input_length": 11537, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11537, "latency_s": 0.6755483119632117, "output_length": 43, "proxy_request_id": "1399948:7:1413205:824", "request_id": "1399948:7:1413205:824", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1399948", "t_dispatch_unix": 1779818228.496091, "t_finish_unix": 1779818229.1716392, "t_first_token_unix": 1779818228.5808914, "tpot_s": 0.013676538166778517, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 13974423], "trace_timestamp_s": 613.357, "ttft_s": 0.08479892095783725, "turn_id": 7} +{"actual_output_tokens": 249, "cached_tokens": 43584, "effective_input_length": 85438, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85438, "latency_s": 52.64006894099293, "output_length": 249, "proxy_request_id": "1373577:3:1404917:774", "request_id": "1373577:3:1404917:774", "request_type": "coder", "requested_output_tokens": 249, "session_id": "1373577", "t_dispatch_unix": 1779818178.2861934, "t_finish_unix": 1779818230.9262626, "t_first_token_unix": 1779818201.6277206, "tpot_s": 0.11813828035895224, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13898584, 13898585, 13898586, 13898587, 13898588, 13898589, 13898590, 13898591, 13898592], "trace_timestamp_s": 584.531, "ttft_s": 23.341525193012785, "turn_id": 3} +{"actual_output_tokens": 185, "cached_tokens": 0, "effective_input_length": 10633, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10633, "latency_s": 2.53426817903528, "output_length": 185, "proxy_request_id": "1408889:3:1414177:827", "request_id": "1408889:3:1414177:827", "request_type": "coder", "requested_output_tokens": 185, "session_id": "1408889", "t_dispatch_unix": 1779818229.07198, "t_finish_unix": 1779818231.6062481, "t_first_token_unix": 1779818229.9281108, "tpot_s": 0.009118117440147731, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13940392, 13940393, 13948965, 13956064, 13956065, 13962134, 13962135, 13962136, 13968978, 13968979, 13968980, 13968981, 13968982, 13983352, 13983353], "trace_timestamp_s": 616.6710000000003, "ttft_s": 0.8561295230174437, "turn_id": 3} +{"actual_output_tokens": 46, "cached_tokens": 11120, "effective_input_length": 11132, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11132, "latency_s": 4.161573377030436, "output_length": 46, "proxy_request_id": "1362265:8:1419710:834", "request_id": "1362265:8:1419710:834", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1362265", "t_dispatch_unix": 1779818230.0096323, "t_finish_unix": 1779818234.1712062, "t_first_token_unix": 1779818233.8460395, "tpot_s": 0.007216265311257707, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065], "trace_timestamp_s": 636.2580000000007, "ttft_s": 3.836405383015517, "turn_id": 8} +{"actual_output_tokens": 444, "cached_tokens": 86688, "effective_input_length": 96849, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96849, "latency_s": 12.752859849017113, "output_length": 444, "proxy_request_id": "1364090:8:1417347:830", "request_id": "1364090:8:1417347:830", "request_type": "coder", "requested_output_tokens": 444, "session_id": "1364090", "t_dispatch_unix": 1779818221.7670057, "t_finish_unix": 1779818234.5198653, "t_first_token_unix": 1779818227.7657397, "tpot_s": 0.015245574774166977, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14010113], "trace_timestamp_s": 628.009, "ttft_s": 5.998732397041749, "turn_id": 8} +{"actual_output_tokens": 641, "cached_tokens": 24368, "effective_input_length": 24442, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24442, "latency_s": 8.545734110986814, "output_length": 641, "proxy_request_id": "1363943:10:1401002:755", "request_id": "1363943:10:1401002:755", "request_type": "coder", "requested_output_tokens": 641, "session_id": "1363943", "t_dispatch_unix": 1779818227.7364578, "t_finish_unix": 1779818236.2821918, "t_first_token_unix": 1779818227.8489614, "tpot_s": 0.013176193760955357, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 13864501], "trace_timestamp_s": 570.9030000000002, "ttft_s": 0.11250205797841772, "turn_id": 10} +{"actual_output_tokens": 212, "cached_tokens": 35264, "effective_input_length": 35303, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35303, "latency_s": 2.1620585169875994, "output_length": 212, "proxy_request_id": "1340290:12:1421294:835", "request_id": "1340290:12:1421294:835", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1340290", "t_dispatch_unix": 1779818235.6556313, "t_finish_unix": 1779818237.8176894, "t_first_token_unix": 1779818235.759876, "tpot_s": 0.00975121757356556, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840], "trace_timestamp_s": 641.9040000000005, "ttft_s": 0.10424303798936307, "turn_id": 12} +{"actual_output_tokens": 109, "cached_tokens": 97920, "effective_input_length": 109574, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109574, "latency_s": 8.713799043034669, "output_length": 109, "proxy_request_id": "1366128:23:1405900:781", "request_id": "1366128:23:1405900:781", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1366128", "t_dispatch_unix": 1779818229.164701, "t_finish_unix": 1779818237.8784995, "t_first_token_unix": 1779818236.7861805, "tpot_s": 0.010111078972436694, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13907243], "trace_timestamp_s": 587.9760000000006, "ttft_s": 7.621476856991649, "turn_id": 23} +{"actual_output_tokens": 39, "cached_tokens": 109680, "effective_input_length": 109775, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109775, "latency_s": 0.5806220949743874, "output_length": 39, "proxy_request_id": "1366128:24:1407996:794", "request_id": "1366128:24:1407996:794", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1366128", "t_dispatch_unix": 1779818237.884654, "t_finish_unix": 1779818238.465276, "t_first_token_unix": 1779818238.1407688, "tpot_s": 0.008533228158117518, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13926953], "trace_timestamp_s": 595.344, "ttft_s": 0.2561121169710532, "turn_id": 24} +{"actual_output_tokens": 35, "cached_tokens": 11168, "effective_input_length": 11879, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11879, "latency_s": 0.43214674398768693, "output_length": 35, "proxy_request_id": "1362265:9:1422050:838", "request_id": "1362265:9:1422050:838", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1362265", "t_dispatch_unix": 1779818238.4818113, "t_finish_unix": 1779818238.9139583, "t_first_token_unix": 1779818238.6499903, "tpot_s": 0.007751302588183214, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065, 14053142, 14053143], "trace_timestamp_s": 644.7240000000002, "ttft_s": 0.16817747196182609, "turn_id": 9} +{"actual_output_tokens": 1126, "cached_tokens": 0, "effective_input_length": 113258, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113258, "latency_s": 60.031133771990426, "output_length": 1126, "proxy_request_id": "1264679:2:1405259:777", "request_id": "1264679:2:1405259:777", "request_type": "coder", "requested_output_tokens": 1126, "session_id": "1264679", "t_dispatch_unix": 1779818179.4158552, "t_finish_unix": 1779818239.4469888, "t_first_token_unix": 1779818221.0413263, "tpot_s": 0.016360318351071327, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281, 13901868, 13901869, 13901870, 13901871, 13901872, 13901873, 13901874], "trace_timestamp_s": 585.6600000000008, "ttft_s": 41.6254694450181, "turn_id": 2} +{"actual_output_tokens": 1465, "cached_tokens": 0, "effective_input_length": 43763, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43763, "latency_s": 19.94609738897998, "output_length": 1465, "proxy_request_id": "1270340:5:1417075:829", "request_id": "1270340:5:1417075:829", "request_type": "coder", "requested_output_tokens": 1465, "session_id": "1270340", "t_dispatch_unix": 1779818220.9717522, "t_finish_unix": 1779818240.9178495, "t_first_token_unix": 1779818228.4333873, "tpot_s": 0.008527457951483778, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 14007776, 14007777, 14007778, 14007779, 14007780, 14007781], "trace_timestamp_s": 627.219, "ttft_s": 7.461632922000717, "turn_id": 5} +{"actual_output_tokens": 46, "cached_tokens": 109808, "effective_input_length": 117746, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117746, "latency_s": 6.021721757017076, "output_length": 46, "proxy_request_id": "1366128:25:1411126:813", "request_id": "1366128:25:1411126:813", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1366128", "t_dispatch_unix": 1779818238.4728918, "t_finish_unix": 1779818244.494613, "t_first_token_unix": 1779818244.0697484, "tpot_s": 0.009435220977239724, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916], "trace_timestamp_s": 606.0870000000004, "ttft_s": 5.596854276023805, "turn_id": 25} +{"actual_output_tokens": 1565, "cached_tokens": 6656, "effective_input_length": 32179, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32179, "latency_s": 14.829264444008004, "output_length": 1565, "proxy_request_id": "1364128:3:1419644:833", "request_id": "1364128:3:1419644:833", "request_type": "coder", "requested_output_tokens": 1565, "session_id": "1364128", "t_dispatch_unix": 1779818229.7840023, "t_finish_unix": 1779818244.6132662, "t_first_token_unix": 1779818233.843795, "tpot_s": 0.006885714835704357, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13554127, 14030453, 14030454, 14030455, 14030456, 14030457, 14030458, 14030459, 14030460, 14030461, 14030462, 14030463, 14030464, 14030465, 14030466, 14030467, 14030468, 14030469, 14030470, 14030471, 14030472, 14030473, 14030474, 14030475, 14030476, 14030477, 14030478, 14030479, 14030480, 14030481, 14030482, 14030483, 14030484, 14030485, 14030486, 14030487, 14030488, 14030489, 14030490, 14030491, 14030492, 14030493, 14030494, 14030495, 14030496, 14030497], "trace_timestamp_s": 636.0240000000003, "ttft_s": 4.059790694969706, "turn_id": 3} +{"actual_output_tokens": 129, "cached_tokens": 0, "effective_input_length": 107292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107292, "latency_s": 42.91355741204461, "output_length": 129, "proxy_request_id": "1270606:2:1411654:817", "request_id": "1270606:2:1411654:817", "request_type": "coder", "requested_output_tokens": 129, "session_id": "1270606", "t_dispatch_unix": 1779818201.8960166, "t_finish_unix": 1779818244.8095734, "t_first_token_unix": 1779818241.200612, "tpot_s": 0.02819237331277691, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 13959615, 13959616, 13959617, 13959618, 13959619, 13959620, 13959621, 13959622, 13959623, 13959624, 13959625, 13959626, 13959627, 13959628, 13959629, 13959630, 13959631, 13959632, 13959633, 13959634, 13959635, 13959636, 13959637, 13959638, 13959639, 13959640, 13959641, 13959642, 13959643, 13959644, 13959645, 13959646, 13959647, 13959648, 13959649, 13959650, 13959651, 13959652, 13959653, 13959654, 13959655, 13959656, 13959657, 13959658, 13959659, 13959660, 13959661, 13959662, 13959663, 13959664, 13959665, 13959666, 13959667, 13959668, 13959669, 13959670, 13959671, 13959672, 13959673, 13959674, 13959675, 13959676, 13959677, 13959678, 13959679, 13959680, 13959681, 13959682, 13959683, 13959684, 13959685, 13959686, 13959687, 13959688, 13959689, 13959690, 13959691, 13959692, 13959693, 13959694, 13959695, 13959696, 13959697, 13959698, 13959699, 13959700, 13959701, 13959702, 13959703, 13959704, 13959705, 13959706, 13959707, 13959708, 13959709, 13959710, 13959711, 13959712, 13959713, 13959714, 13959715, 13959716, 13959717, 13959718, 13959719, 13959720, 13959721, 13959722, 13959723, 13959724, 13959725, 13959726, 13959727, 13959728], "trace_timestamp_s": 608.1200000000008, "ttft_s": 39.30459344101837, "turn_id": 2} +{"actual_output_tokens": 221, "cached_tokens": 44400, "effective_input_length": 49308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49308, "latency_s": 10.076611646043602, "output_length": 221, "proxy_request_id": "1268861:9:1421319:836", "request_id": "1268861:9:1421319:836", "request_type": "coder", "requested_output_tokens": 221, "session_id": "1268861", "t_dispatch_unix": 1779818235.7371585, "t_finish_unix": 1779818245.8137705, "t_first_token_unix": 1779818242.691519, "tpot_s": 0.014190869618059052, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14046030], "trace_timestamp_s": 641.9830000000002, "ttft_s": 6.954353975015692, "turn_id": 9} +{"actual_output_tokens": 528, "cached_tokens": 33680, "effective_input_length": 40330, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40330, "latency_s": 37.43849898898043, "output_length": 528, "proxy_request_id": "1405155:2:1414214:828", "request_id": "1405155:2:1414214:828", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1405155", "t_dispatch_unix": 1779818210.5715618, "t_finish_unix": 1779818248.0100605, "t_first_token_unix": 1779818241.1880808, "tpot_s": 0.012944398724771789, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13983589, 13983590, 13983591, 13983592, 13983593, 13983594, 13983595, 13983596, 13983597, 13983598, 13983599, 13983600, 13983601, 13983602, 13983603], "trace_timestamp_s": 616.817, "ttft_s": 30.61651703802636, "turn_id": 2} +{"actual_output_tokens": 344, "cached_tokens": 97280, "effective_input_length": 101432, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101432, "latency_s": 7.7666301730205305, "output_length": 344, "proxy_request_id": "1364090:9:1423736:840", "request_id": "1364090:9:1423736:840", "request_type": "coder", "requested_output_tokens": 344, "session_id": "1364090", "t_dispatch_unix": 1779818244.5827801, "t_finish_unix": 1779818252.34941, "t_first_token_unix": 1779818247.3155015, "tpot_s": 0.014674999408013902, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14068318, 14068319, 14068320, 14068321, 14068322, 14068323, 14068324, 14068325, 14068326, 14068327], "trace_timestamp_s": 650.826, "ttft_s": 2.7327190880314447, "turn_id": 9} +{"actual_output_tokens": 25, "cached_tokens": 11568, "effective_input_length": 11736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11736, "latency_s": 2.3849082340020686, "output_length": 25, "proxy_request_id": "1399948:8:1425345:844", "request_id": "1399948:8:1425345:844", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1399948", "t_dispatch_unix": 1779818250.2021766, "t_finish_unix": 1779818252.5870845, "t_first_token_unix": 1779818252.3656464, "tpot_s": 0.009214915250292203, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14082944], "trace_timestamp_s": 656.451, "ttft_s": 2.1634682459989563, "turn_id": 8} +{"actual_output_tokens": 241, "cached_tokens": 117776, "effective_input_length": 127989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127989, "latency_s": 10.666658814996481, "output_length": 241, "proxy_request_id": "1366128:26:1413108:823", "request_id": "1366128:26:1413108:823", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1366128", "t_dispatch_unix": 1779818244.5045636, "t_finish_unix": 1779818255.1712224, "t_first_token_unix": 1779818252.3108752, "tpot_s": 0.011916757516640548, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401], "trace_timestamp_s": 612.9639999999999, "ttft_s": 7.806309057981707, "turn_id": 26} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 39789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39789, "latency_s": 6.510844437056221, "output_length": 24, "proxy_request_id": "1355951:5:1425005:843", "request_id": "1355951:5:1425005:843", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1355951", "t_dispatch_unix": 1779818248.966014, "t_finish_unix": 1779818255.4768581, "t_first_token_unix": 1779818255.29867, "tpot_s": 0.007731091129876997, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463, 14061275], "trace_timestamp_s": 655.2139999999999, "ttft_s": 6.33265440701507, "turn_id": 5} +{"actual_output_tokens": 156, "cached_tokens": 25072, "effective_input_length": 25225, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25225, "latency_s": 7.381028891017195, "output_length": 156, "proxy_request_id": "1363943:11:1424840:842", "request_id": "1363943:11:1424840:842", "request_type": "coder", "requested_output_tokens": 156, "session_id": "1363943", "t_dispatch_unix": 1779818248.3182905, "t_finish_unix": 1779818255.6993191, "t_first_token_unix": 1779818248.4343123, "tpot_s": 0.04686945180010591, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14078449], "trace_timestamp_s": 654.5660000000007, "ttft_s": 0.1160203680046834, "turn_id": 11} +{"actual_output_tokens": 90, "cached_tokens": 128224, "effective_input_length": 128433, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128433, "latency_s": 1.4005555009935051, "output_length": 90, "proxy_request_id": "1366128:27:1417788:831", "request_id": "1366128:27:1417788:831", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1366128", "t_dispatch_unix": 1779818255.1774971, "t_finish_unix": 1779818256.5780525, "t_first_token_unix": 1779818255.611252, "tpot_s": 0.010859698629441012, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401, 14013930], "trace_timestamp_s": 629.5560000000005, "ttft_s": 0.4337533380021341, "turn_id": 27} +{"actual_output_tokens": 49, "cached_tokens": 128512, "effective_input_length": 128642, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128642, "latency_s": 0.8026814140030183, "output_length": 49, "proxy_request_id": "1366128:28:1421998:837", "request_id": "1366128:28:1421998:837", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1366128", "t_dispatch_unix": 1779818256.5844932, "t_finish_unix": 1779818257.3871744, "t_first_token_unix": 1779818256.9145625, "tpot_s": 0.00983970439483528, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401, 14013930, 14052730], "trace_timestamp_s": 644.5350000000008, "ttft_s": 0.3300672830082476, "turn_id": 28} +{"actual_output_tokens": 33, "cached_tokens": 107408, "effective_input_length": 108318, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108318, "latency_s": 1.0525249450001866, "output_length": 33, "proxy_request_id": "1270606:3:1427164:848", "request_id": "1270606:3:1427164:848", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1270606", "t_dispatch_unix": 1779818256.6256196, "t_finish_unix": 1779818257.6781442, "t_first_token_unix": 1779818257.465464, "tpot_s": 0.006635739031480625, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 13959615, 13959616, 13959617, 13959618, 13959619, 13959620, 13959621, 13959622, 13959623, 13959624, 13959625, 13959626, 13959627, 13959628, 13959629, 13959630, 13959631, 13959632, 13959633, 13959634, 13959635, 13959636, 13959637, 13959638, 13959639, 13959640, 13959641, 14099892, 14099893, 14099894, 14099895, 14099896, 14099897, 14099898, 14099899, 14099900, 14099901, 14099902, 14099903, 14099904, 14099905, 14099906, 14099907, 14099908, 14099909, 14099910, 14099911, 14099912, 14099913, 14099914, 14099915, 14099916, 14099917, 14099918, 14099919, 14099920, 14099921, 14099922, 14099923, 14099924, 14099925, 14099926, 14099927, 14099928, 14099929, 14099930, 14099931, 14099932, 14099933, 14099934, 14099935, 14099936, 14099937, 14099938, 14099939, 14099940, 14099941, 14099942, 14099943, 14099944, 14099945, 14099946, 14099947, 14099948, 14099949, 14099950, 14099951, 14099952, 14099953, 14099954, 14099955, 14099956, 14099957, 14099958, 14099959, 14099960, 14099961, 14099962, 14099963, 14099964, 14099965, 14099966, 14099967, 14099968, 14099969, 14099970, 14099971, 14099972, 14099973, 14099974, 14099975, 14099976, 14099977, 14099978, 14099979, 14099980], "trace_timestamp_s": 662.8530000000001, "ttft_s": 0.8398423960315995, "turn_id": 3} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 119977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119977, "latency_s": 77.25268988503376, "output_length": 111, "proxy_request_id": "1275274:2:1405679:780", "request_id": "1275274:2:1405679:780", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1275274", "t_dispatch_unix": 1779818180.892717, "t_finish_unix": 1779818258.1454065, "t_first_token_unix": 1779818250.5118103, "tpot_s": 0.06939409453612329, "trace_hash_ids": [9491467, 195037, 195038, 195039, 195040, 195041, 195042, 195043, 195044, 10319406, 10319407, 10319408, 10319409, 10319410, 10319411, 10319412, 10319413, 10319414, 5374859, 10319415, 10319416, 816846, 10319417, 10319418, 10319419, 10319420, 194680, 194681, 10319421, 10319422, 10319423, 10319424, 10319425, 10319426, 10319427, 10319428, 10319429, 10319430, 10319431, 10319432, 10319433, 10319434, 10319435, 10319436, 10319437, 10319438, 10319439, 10319440, 10319441, 10319442, 10319443, 10319444, 10319445, 10319446, 10319447, 10319448, 10319449, 10319450, 10319451, 10319452, 10319453, 10319454, 10319455, 10319456, 10319457, 10319458, 10319459, 10319460, 10319461, 10319462, 10319463, 10319464, 10319465, 10319466, 10319467, 10319468, 10319469, 10319470, 10319471, 10319472, 10319473, 10319474, 10319475, 10319476, 10319477, 10319478, 10319479, 10319480, 10319481, 10319482, 10319483, 10319484, 10319485, 10319486, 10319487, 10319488, 10319489, 10319490, 10319491, 10319492, 10319493, 10319494, 10319495, 10319496, 10319497, 10319498, 10319499, 10319500, 10319501, 10319502, 10319503, 10319504, 10319505, 10319506, 10319507, 10319508, 10319509, 10319510, 10319511, 10319512, 10319513, 10319514, 10319515, 10319516, 10319517, 10319518, 10319519, 10319520, 10319521, 10319522, 10319523, 10319524, 10319525, 10319526, 10319527, 10319528, 10319529, 10319530, 10319531, 10319532, 10319533, 10319534, 10319535, 10319536, 10319537, 10319538, 10319539, 10319540, 10319541, 10319542, 10319543, 10319544, 10319545, 10319546, 10319547, 10319548, 10319549, 10319550, 10319551, 10319552, 10319553, 10319554, 10319555, 10319556, 10319557, 10319558, 10319559, 10319560, 10319561, 10319562, 10319563, 10319564, 10319565, 10319566, 10319567, 10319568, 10319569, 10319570, 10319571, 10319572, 10319573, 10451843, 10538212, 10538213, 10590028, 10695557, 10848849, 10848850, 10848851, 10949071, 11065667, 11650526, 11650527, 11650528, 11717015, 11717016, 11717017, 11717018, 11717019, 11717020, 11796353, 11796354, 11796355, 11796356, 11895285, 12041647, 12041648, 12041649, 12041650, 12193888, 12247657, 12247658, 12247659, 12247660, 12374859, 12374860, 12374861, 12437166, 12437167, 12596754, 12596755, 12690937, 12844572, 12844573, 12844574, 12844575, 12958938, 13103548, 13103549, 13454539, 13674772, 13905368, 13905369, 13905370, 13905371], "trace_timestamp_s": 587.1360000000004, "ttft_s": 69.61909128603293, "turn_id": 2} +{"actual_output_tokens": 599, "cached_tokens": 25376, "effective_input_length": 26923, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26923, "latency_s": 4.2097232840023935, "output_length": 599, "proxy_request_id": "1363943:12:1426646:845", "request_id": "1363943:12:1426646:845", "request_type": "coder", "requested_output_tokens": 599, "session_id": "1363943", "t_dispatch_unix": 1779818255.7011657, "t_finish_unix": 1779818259.9108887, "t_first_token_unix": 1779818256.0684252, "tpot_s": 0.006425121185692171, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14094824], "trace_timestamp_s": 661.0390000000007, "ttft_s": 0.36725782096618786, "turn_id": 12} +{"actual_output_tokens": 339, "cached_tokens": 11904, "effective_input_length": 12596, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12596, "latency_s": 2.0317903630202636, "output_length": 339, "proxy_request_id": "1362265:10:1427606:850", "request_id": "1362265:10:1427606:850", "request_type": "coder", "requested_output_tokens": 339, "session_id": "1362265", "t_dispatch_unix": 1779818257.896614, "t_finish_unix": 1779818259.9284046, "t_first_token_unix": 1779818258.04896, "tpot_s": 0.005559723434891254, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065, 14053142, 14104310, 14104311], "trace_timestamp_s": 664.1450000000004, "ttft_s": 0.1523447190411389, "turn_id": 10} +{"actual_output_tokens": 620, "cached_tokens": 126192, "effective_input_length": 126198, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126198, "latency_s": 7.479322723986115, "output_length": 620, "proxy_request_id": "1366128:29:1424316:841", "request_id": "1366128:29:1424316:841", "request_type": "coder", "requested_output_tokens": 620, "session_id": "1366128", "t_dispatch_unix": 1779818257.4458113, "t_finish_unix": 1779818264.9251332, "t_first_token_unix": 1779818257.644999, "tpot_s": 0.011760718812631904, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2239018, 2239019, 2239020, 2239021, 2239022, 177637, 177638, 177639, 2239023, 2239024, 2239025, 2239026, 2239027, 14073495, 14073496, 14073497, 14073498, 6887633, 6887634, 6887635, 6887636, 14073499, 14073500, 14073501, 14073502, 14073503, 14073504, 14073505, 14073506, 14073507, 14073508, 14073509, 14073510, 14073511, 14073512, 14073513, 14073514, 14073515, 14073516, 14073517, 14073518, 14073519, 14073520, 14073521, 14073522, 14073523, 14073524, 14073525, 14073526, 14073527, 14073528, 14073529, 14073530, 14073531, 14073532, 14073533, 14073534, 14073535, 14073536, 14073537, 14073538, 14073539, 14073540, 14073541, 14073542, 14073543, 14073544, 14073545, 14073546, 14073547, 14073548, 14073549, 14073550, 14073551, 14073552, 14073553, 14073554, 14073555, 14073556, 14073557, 14073558, 14073559, 14073560, 14073561, 14073562, 14073563, 14073564, 14073565, 14073566, 14073567, 14073568, 14073569, 14073570, 14073571, 14073572, 14073573, 14073574, 14073575, 14073576, 14073577, 14073578, 14073579, 14073580, 14073581, 14073582, 14073583, 14073584, 14073585, 14073586, 14073587, 14073588, 14073589, 14073590, 14073591, 14073592, 14073593, 14073594, 14073595, 14073596, 14073597, 14073598, 14073599, 14073600, 14073601, 14073602, 14073603, 14073604, 14073605, 14073606, 14073607, 14073608, 14073609, 14073610, 14073611, 14073612, 14073613, 14073614, 14073615, 14073616, 14073617, 14073618, 14073619, 14073620, 14073621, 14073622, 14073623, 14073624, 14073625, 14073626, 14073627, 14073628, 14073629, 14073630, 14073631, 14073632, 14073633, 7128120, 7128121, 7128122, 7128123, 14073634, 14073635, 14073636, 14073637, 14073638, 14073639, 14073640, 14073641, 14073642, 14073643, 14073644, 14073645, 14073646, 14073647, 14073648, 14073649, 14073650, 14073651, 14073652, 14073653, 14073654, 14073655, 14073656, 14073657, 14073658, 14073659, 14073660, 14073661, 14073662, 14073663, 14073664, 14073665, 14073666, 14073667, 14073668, 14073669, 14073670, 14073671, 14073672, 14073673, 14073674, 14073675, 14073676, 14073677, 14073678, 14073679, 14073680, 14073681, 14073682, 14073683, 14073684, 14073685, 14073686, 14073687, 14073688, 14073689, 14073690, 14073691, 14073692, 14073693, 14073694, 14073695, 14073696, 14073697, 14073698, 14073699, 14073700, 14073701, 14073702, 14073703, 14073704, 14073705, 14073706, 14073707, 14073708, 14073709, 14073710, 14073711], "trace_timestamp_s": 652.6850000000004, "ttft_s": 0.19918532395968214, "turn_id": 29} +{"actual_output_tokens": 3818, "cached_tokens": 71664, "effective_input_length": 72608, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72608, "latency_s": 64.46139026799938, "output_length": 3818, "proxy_request_id": "1381387:7:1411928:819", "request_id": "1381387:7:1411928:819", "request_type": "coder", "requested_output_tokens": 3818, "session_id": "1381387", "t_dispatch_unix": 1779818202.7184937, "t_finish_unix": 1779818267.179884, "t_first_token_unix": 1779818203.4042492, "tpot_s": 0.016708183878711758, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13937687, 13937688, 13937689, 13937690, 13937691, 13962250, 13962251], "trace_timestamp_s": 608.9650000000001, "ttft_s": 0.6857530130073428, "turn_id": 7} +{"actual_output_tokens": 71, "cached_tokens": 12800, "effective_input_length": 124090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 124090, "latency_s": 49.376320485025644, "output_length": 71, "proxy_request_id": "1313181:8:1329951:394", "request_id": "1313181:8:1329951:394", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1313181", "t_dispatch_unix": 1779818225.752373, "t_finish_unix": 1779818275.1286938, "t_first_token_unix": 1779818274.2524192, "tpot_s": 0.012514101728863481, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13209153], "trace_timestamp_s": 321.7550000000001, "ttft_s": 48.50004398700548, "turn_id": 8} +{"actual_output_tokens": 64, "cached_tokens": 62432, "effective_input_length": 62444, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62444, "latency_s": 0.8070909089874476, "output_length": 64, "proxy_request_id": "1313181:8:1385690:686", "request_id": "1313181:8:1385690:686", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1313181", "t_dispatch_unix": 1779818275.1318436, "t_finish_unix": 1779818275.9389346, "t_first_token_unix": 1779818275.2497795, "tpot_s": 0.010924622412800553, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278], "trace_timestamp_s": 517.1500000000005, "ttft_s": 0.1179332840256393, "turn_id": 8} +{"actual_output_tokens": 14, "cached_tokens": 11760, "effective_input_length": 11993, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11993, "latency_s": 0.2049526499467902, "output_length": 14, "proxy_request_id": "1399948:9:1433544:857", "request_id": "1399948:9:1433544:857", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1399948", "t_dispatch_unix": 1779818279.0903604, "t_finish_unix": 1779818279.2953131, "t_first_token_unix": 1779818279.1771655, "tpot_s": 0.009060453310107382, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14161913], "trace_timestamp_s": 685.3389999999999, "ttft_s": 0.0868036889587529, "turn_id": 9} +{"actual_output_tokens": 2116, "cached_tokens": 1680, "effective_input_length": 1840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1840, "latency_s": 12.167242991970852, "output_length": 2116, "proxy_request_id": "1407599:2:1430593:852", "request_id": "1407599:2:1430593:852", "request_type": "coder", "requested_output_tokens": 2116, "session_id": "1407599", "t_dispatch_unix": 1779818268.6271403, "t_finish_unix": 1779818280.7943838, "t_first_token_unix": 1779818268.671158, "tpot_s": 0.0057318479290571125, "trace_hash_ids": [10764018, 14132941, 14132942, 14132943], "trace_timestamp_s": 674.8760000000002, "ttft_s": 0.04401660000439733, "turn_id": 2} +{"actual_output_tokens": 298, "cached_tokens": 39248, "effective_input_length": 40567, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40567, "latency_s": 3.007017149007879, "output_length": 298, "proxy_request_id": "1382089:3:1433211:856", "request_id": "1382089:3:1433211:856", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1382089", "t_dispatch_unix": 1779818277.8676403, "t_finish_unix": 1779818280.874658, "t_first_token_unix": 1779818278.3683174, "tpot_s": 0.008437821282911104, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463, 14061275, 14158620, 14158621], "trace_timestamp_s": 684.116, "ttft_s": 0.5006749929743819, "turn_id": 3} +{"actual_output_tokens": 40, "cached_tokens": 12000, "effective_input_length": 12032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12032, "latency_s": 0.25113816204247996, "output_length": 40, "proxy_request_id": "1399948:10:1434418:858", "request_id": "1399948:10:1434418:858", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1399948", "t_dispatch_unix": 1779818282.1027312, "t_finish_unix": 1779818282.3538697, "t_first_token_unix": 1779818282.1471078, "tpot_s": 0.0052952400262419805, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14170064], "trace_timestamp_s": 688.3510000000006, "ttft_s": 0.044374927994795144, "turn_id": 10} +{"actual_output_tokens": 11, "cached_tokens": 12064, "effective_input_length": 12106, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12106, "latency_s": 0.09203944297041744, "output_length": 11, "proxy_request_id": "1399948:11:1435163:860", "request_id": "1399948:11:1435163:860", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1399948", "t_dispatch_unix": 1779818284.805476, "t_finish_unix": 1779818284.8975153, "t_first_token_unix": 1779818284.8521075, "tpot_s": 0.004508765699574724, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14176836], "trace_timestamp_s": 691.0540000000001, "ttft_s": 0.04663057700963691, "turn_id": 11} +{"actual_output_tokens": 200, "cached_tokens": 45216, "effective_input_length": 45269, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45269, "latency_s": 1.57754699094221, "output_length": 200, "proxy_request_id": "1270340:6:1434904:859", "request_id": "1270340:6:1434904:859", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1270340", "t_dispatch_unix": 1779818283.7410266, "t_finish_unix": 1779818285.3185735, "t_first_token_unix": 1779818283.865652, "tpot_s": 0.007299488854369888, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 14007776, 14007777, 14007778, 14007779, 14007780, 14174577, 14174578, 14174579, 14174580], "trace_timestamp_s": 689.9880000000003, "ttft_s": 0.12462345196399838, "turn_id": 6} +{"actual_output_tokens": 192, "cached_tokens": 21312, "effective_input_length": 90818, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90818, "latency_s": 55.72662193700671, "output_length": 192, "proxy_request_id": "1373577:4:1408642:799", "request_id": "1373577:4:1408642:799", "request_type": "coder", "requested_output_tokens": 192, "session_id": "1373577", "t_dispatch_unix": 1779818230.931564, "t_finish_unix": 1779818286.6581855, "t_first_token_unix": 1779818283.0569901, "tpot_s": 0.01885294787956314, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13898584, 13898585, 13898586, 13898587, 13898588, 13898589, 13898590, 13898591, 13898592, 13932466, 13932467, 13932468, 13932469, 13932470, 13932471, 13932472, 13932473, 13932474, 13932475, 13932476], "trace_timestamp_s": 597.5, "ttft_s": 52.12542381399544, "turn_id": 4} +{"actual_output_tokens": 26, "cached_tokens": 12112, "effective_input_length": 12164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12164, "latency_s": 0.6637296520057134, "output_length": 26, "proxy_request_id": "1399948:12:1436179:863", "request_id": "1399948:12:1436179:863", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1399948", "t_dispatch_unix": 1779818288.23107, "t_finish_unix": 1779818288.894799, "t_first_token_unix": 1779818288.7025435, "tpot_s": 0.0076791826402768494, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14186143], "trace_timestamp_s": 694.4800000000005, "ttft_s": 0.4714729810366407, "turn_id": 12} +{"actual_output_tokens": 145, "cached_tokens": 49520, "effective_input_length": 52920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52920, "latency_s": 2.310813906020485, "output_length": 145, "proxy_request_id": "1268861:10:1439325:866", "request_id": "1268861:10:1439325:866", "request_type": "coder", "requested_output_tokens": 145, "session_id": "1268861", "t_dispatch_unix": 1779818298.7541618, "t_finish_unix": 1779818301.064976, "t_first_token_unix": 1779818299.9766676, "tpot_s": 0.007555684479383571, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14214018], "trace_timestamp_s": 705.0, "ttft_s": 1.2225035579758696, "turn_id": 10} +{"actual_output_tokens": 2679, "cached_tokens": 22880, "effective_input_length": 29412, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29412, "latency_s": 19.15760572697036, "output_length": 2679, "proxy_request_id": "1404395:2:1435941:862", "request_id": "1404395:2:1435941:862", "request_type": "coder", "requested_output_tokens": 2679, "session_id": "1404395", "t_dispatch_unix": 1779818287.3867147, "t_finish_unix": 1779818306.5443196, "t_first_token_unix": 1779818288.6924233, "tpot_s": 0.00666603949140059, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14183679], "trace_timestamp_s": 693.6320000000005, "ttft_s": 1.3057074850075878, "turn_id": 2} +{"actual_output_tokens": 1859, "cached_tokens": 0, "effective_input_length": 37398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37398, "latency_s": 83.88136608502828, "output_length": 1859, "proxy_request_id": "1301929:3:1417873:832", "request_id": "1301929:3:1417873:832", "request_type": "coder", "requested_output_tokens": 1859, "session_id": "1301929", "t_dispatch_unix": 1779818223.6045427, "t_finish_unix": 1779818307.485908, "t_first_token_unix": 1779818255.9740613, "tpot_s": 0.027724157884837036, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 14014871, 14014872, 14014873, 14014874], "trace_timestamp_s": 629.8510000000006, "ttft_s": 32.36951766401762, "turn_id": 3} +{"actual_output_tokens": 90, "cached_tokens": 0, "effective_input_length": 19056, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19056, "latency_s": 3.0412845599930733, "output_length": 90, "proxy_request_id": "1371622:2:1442319:869", "request_id": "1371622:2:1442319:869", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1371622", "t_dispatch_unix": 1779818308.6068158, "t_finish_unix": 1779818311.6481004, "t_first_token_unix": 1779818310.5465307, "tpot_s": 0.01237436540469297, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14240621], "trace_timestamp_s": 714.8530000000001, "ttft_s": 1.9397133499733172, "turn_id": 2} +{"actual_output_tokens": 4542, "cached_tokens": 101760, "effective_input_length": 108020, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108020, "latency_s": 56.436905918002594, "output_length": 4542, "proxy_request_id": "1364090:10:1426859:847", "request_id": "1364090:10:1426859:847", "request_type": "coder", "requested_output_tokens": 4542, "session_id": "1364090", "t_dispatch_unix": 1779818255.59562, "t_finish_unix": 1779818312.0325253, "t_first_token_unix": 1779818259.839659, "tpot_s": 0.01149363664699619, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14068318, 14068319, 14068320, 14068321, 14068322, 14068323, 14068324, 14068325, 14068326, 14096917, 14096918, 14096919, 14096920, 14096921, 14096922, 14096923, 14096924, 14096925, 14096926, 14096927, 14096928, 14096929], "trace_timestamp_s": 661.8389999999999, "ttft_s": 4.244037080963608, "turn_id": 10} +{"actual_output_tokens": 302, "cached_tokens": 0, "effective_input_length": 63153, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63153, "latency_s": 16.641648769029416, "output_length": 302, "proxy_request_id": "1294611:12:1441557:868", "request_id": "1294611:12:1441557:868", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1294611", "t_dispatch_unix": 1779818305.8683567, "t_finish_unix": 1779818322.5100052, "t_first_token_unix": 1779818320.026997, "tpot_s": 0.008248234309056508, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14232859], "trace_timestamp_s": 712.1100000000006, "ttft_s": 14.158638580993284, "turn_id": 12} +{"actual_output_tokens": 149, "cached_tokens": 60160, "effective_input_length": 129673, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129673, "latency_s": 47.60826485900907, "output_length": 149, "proxy_request_id": "1313181:9:1333349:415", "request_id": "1313181:9:1333349:415", "request_type": "coder", "requested_output_tokens": 149, "session_id": "1313181", "t_dispatch_unix": 1779818275.9453812, "t_finish_unix": 1779818323.553646, "t_first_token_unix": 1779818320.6682749, "tpot_s": 0.019493669588071597, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13240573], "trace_timestamp_s": 333.6930000000002, "ttft_s": 44.72289178497158, "turn_id": 9} +{"actual_output_tokens": 123, "cached_tokens": 63440, "effective_input_length": 63488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63488, "latency_s": 1.110050235001836, "output_length": 123, "proxy_request_id": "1294611:13:1446349:872", "request_id": "1294611:13:1446349:872", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1294611", "t_dispatch_unix": 1779818322.5135794, "t_finish_unix": 1779818323.623629, "t_first_token_unix": 1779818322.6425989, "tpot_s": 0.008039313286913131, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911], "trace_timestamp_s": 728.4270000000006, "ttft_s": 0.1290171660366468, "turn_id": 13} +{"actual_output_tokens": 3875, "cached_tokens": 3088, "effective_input_length": 101803, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101803, "latency_s": 187.93504702998325, "output_length": 3875, "proxy_request_id": "1314357:5:1393659:719", "request_id": "1314357:5:1393659:719", "request_type": "coder", "requested_output_tokens": 3875, "session_id": "1314357", "t_dispatch_unix": 1779818138.884648, "t_finish_unix": 1779818326.819695, "t_first_token_unix": 1779818172.4396498, "tpot_s": 0.03985009559963998, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 13796640], "trace_timestamp_s": 545.116, "ttft_s": 33.554999614018016, "turn_id": 5} +{"actual_output_tokens": 1070, "cached_tokens": 19136, "effective_input_length": 19292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19292, "latency_s": 13.474225785990711, "output_length": 1070, "proxy_request_id": "1371622:3:1443876:871", "request_id": "1371622:3:1443876:871", "request_type": "coder", "requested_output_tokens": 1070, "session_id": "1371622", "t_dispatch_unix": 1779818313.7152424, "t_finish_unix": 1779818327.1894674, "t_first_token_unix": 1779818313.8236156, "tpot_s": 0.012502907542566272, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523], "trace_timestamp_s": 719.9639999999999, "ttft_s": 0.10837105102837086, "turn_id": 3} +{"actual_output_tokens": 525, "cached_tokens": 105664, "effective_input_length": 105709, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105709, "latency_s": 5.800362174981274, "output_length": 525, "proxy_request_id": "1314357:6:1422517:839", "request_id": "1314357:6:1422517:839", "request_type": "coder", "requested_output_tokens": 525, "session_id": "1314357", "t_dispatch_unix": 1779818326.8264732, "t_finish_unix": 1779818332.6268349, "t_first_token_unix": 1779818327.0392072, "tpot_s": 0.01066288612025367, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14056875, 14056876], "trace_timestamp_s": 646.2290000000003, "ttft_s": 0.2127323029562831, "turn_id": 6} +{"actual_output_tokens": 575, "cached_tokens": 63600, "effective_input_length": 63616, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63616, "latency_s": 4.909491481026635, "output_length": 575, "proxy_request_id": "1294611:14:1449074:877", "request_id": "1294611:14:1449074:877", "request_type": "coder", "requested_output_tokens": 575, "session_id": "1294611", "t_dispatch_unix": 1779818331.1670842, "t_finish_unix": 1779818336.0765753, "t_first_token_unix": 1779818331.2825756, "tpot_s": 0.008351399545303874, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 14306306], "trace_timestamp_s": 737.4130000000005, "ttft_s": 0.1154897779924795, "turn_id": 14} +{"actual_output_tokens": 493, "cached_tokens": 25488, "effective_input_length": 28711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28711, "latency_s": 41.5049473909894, "output_length": 493, "proxy_request_id": "1363943:13:1438562:865", "request_id": "1363943:13:1438562:865", "request_type": "coder", "requested_output_tokens": 493, "session_id": "1363943", "t_dispatch_unix": 1779818296.2001352, "t_finish_unix": 1779818337.7050824, "t_first_token_unix": 1779818324.2551398, "tpot_s": 0.02733641092469575, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14206732], "trace_timestamp_s": 702.4480000000003, "ttft_s": 28.054999224026687, "turn_id": 13} +{"actual_output_tokens": 485, "cached_tokens": 106224, "effective_input_length": 106279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106279, "latency_s": 5.392997674003709, "output_length": 485, "proxy_request_id": "1314357:7:1427957:851", "request_id": "1314357:7:1427957:851", "request_type": "coder", "requested_output_tokens": 485, "session_id": "1314357", "t_dispatch_unix": 1779818332.6340199, "t_finish_unix": 1779818338.0270178, "t_first_token_unix": 1779818332.8744252, "tpot_s": 0.01064527574587471, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14107729], "trace_timestamp_s": 665.424, "ttft_s": 0.24040155403781682, "turn_id": 7} +{"actual_output_tokens": 122, "cached_tokens": 106752, "effective_input_length": 106805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106805, "latency_s": 1.467613000946585, "output_length": 122, "proxy_request_id": "1314357:8:1431749:854", "request_id": "1314357:8:1431749:854", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1314357", "t_dispatch_unix": 1779818338.0330667, "t_finish_unix": 1779818339.5006797, "t_first_token_unix": 1779818338.2717257, "tpot_s": 0.010154059140419603, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14144523], "trace_timestamp_s": 678.8120000000008, "ttft_s": 0.23865633795503527, "turn_id": 8} +{"actual_output_tokens": 243, "cached_tokens": 106912, "effective_input_length": 106959, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106959, "latency_s": 2.8786495579988696, "output_length": 243, "proxy_request_id": "1314357:9:1435219:861", "request_id": "1314357:9:1435219:861", "request_type": "coder", "requested_output_tokens": 243, "session_id": "1314357", "t_dispatch_unix": 1779818339.5064704, "t_finish_unix": 1779818342.38512, "t_first_token_unix": 1779818339.716566, "tpot_s": 0.011025831562010879, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14177399], "trace_timestamp_s": 691.2760000000007, "ttft_s": 0.21009251900250092, "turn_id": 9} +{"actual_output_tokens": 89, "cached_tokens": 20352, "effective_input_length": 20439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20439, "latency_s": 1.1879399659810588, "output_length": 89, "proxy_request_id": "1371622:4:1452210:881", "request_id": "1371622:4:1452210:881", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1371622", "t_dispatch_unix": 1779818341.5910492, "t_finish_unix": 1779818342.7789896, "t_first_token_unix": 1779818341.691672, "tpot_s": 0.012351858227206818, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572], "trace_timestamp_s": 747.8389999999999, "ttft_s": 0.10062093602027744, "turn_id": 4} +{"actual_output_tokens": 65, "cached_tokens": 53056, "effective_input_length": 55050, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55050, "latency_s": 1.3125150030246004, "output_length": 65, "proxy_request_id": "1268861:11:1452208:880", "request_id": "1268861:11:1452208:880", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1268861", "t_dispatch_unix": 1779818341.5818875, "t_finish_unix": 1779818342.8944023, "t_first_token_unix": 1779818342.4321566, "tpot_s": 0.007218598188046599, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14334566], "trace_timestamp_s": 747.8280000000004, "ttft_s": 0.8502678470104001, "turn_id": 11} +{"actual_output_tokens": 33, "cached_tokens": 107200, "effective_input_length": 107228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107228, "latency_s": 0.5065402929903939, "output_length": 33, "proxy_request_id": "1314357:10:1439373:867", "request_id": "1314357:10:1439373:867", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1314357", "t_dispatch_unix": 1779818342.3910758, "t_finish_unix": 1779818342.897616, "t_first_token_unix": 1779818342.5966008, "tpot_s": 0.009399672906511114, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14214206, 14214207], "trace_timestamp_s": 705.1230000000005, "ttft_s": 0.20552309998311102, "turn_id": 10} +{"actual_output_tokens": 193, "cached_tokens": 107248, "effective_input_length": 108166, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108166, "latency_s": 2.76898503000848, "output_length": 193, "proxy_request_id": "1314357:11:1442554:870", "request_id": "1314357:11:1442554:870", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1314357", "t_dispatch_unix": 1779818342.903687, "t_finish_unix": 1779818345.672672, "t_first_token_unix": 1779818343.6749532, "tpot_s": 0.010403472942622708, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14243700, 14243701], "trace_timestamp_s": 715.6370000000006, "ttft_s": 0.7712517310283147, "turn_id": 11} +{"actual_output_tokens": 61, "cached_tokens": 108352, "effective_input_length": 108409, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108409, "latency_s": 0.8197290640091524, "output_length": 61, "proxy_request_id": "1314357:12:1446681:873", "request_id": "1314357:12:1446681:873", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1314357", "t_dispatch_unix": 1779818345.6774497, "t_finish_unix": 1779818346.4971795, "t_first_token_unix": 1779818345.9208875, "tpot_s": 0.009599895399878733, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14283553], "trace_timestamp_s": 729.3620000000001, "ttft_s": 0.2434347080416046, "turn_id": 12} +{"actual_output_tokens": 169, "cached_tokens": 108464, "effective_input_length": 108791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108791, "latency_s": 2.312312602996826, "output_length": 169, "proxy_request_id": "1314357:13:1448346:875", "request_id": "1314357:13:1448346:875", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1314357", "t_dispatch_unix": 1779818346.5032003, "t_finish_unix": 1779818348.815513, "t_first_token_unix": 1779818347.0572574, "tpot_s": 0.010463975190456646, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14298706], "trace_timestamp_s": 735.0250000000005, "ttft_s": 0.5540543890092522, "turn_id": 13} +{"actual_output_tokens": 122, "cached_tokens": 108944, "effective_input_length": 109010, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109010, "latency_s": 1.5115259049925953, "output_length": 122, "proxy_request_id": "1314357:14:1450740:878", "request_id": "1314357:14:1450740:878", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1314357", "t_dispatch_unix": 1779818348.8201363, "t_finish_unix": 1779818350.3316627, "t_first_token_unix": 1779818349.095624, "tpot_s": 0.010211326305519727, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14320601], "trace_timestamp_s": 742.8560000000007, "ttft_s": 0.27548528800252825, "turn_id": 14} +{"actual_output_tokens": 129, "cached_tokens": 0, "effective_input_length": 73878, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73878, "latency_s": 72.95938460103935, "output_length": 129, "proxy_request_id": "1342921:5:1433192:855", "request_id": "1342921:5:1433192:855", "request_type": "coder", "requested_output_tokens": 129, "session_id": "1342921", "t_dispatch_unix": 1779818277.792521, "t_finish_unix": 1779818350.7519057, "t_first_token_unix": 1779818296.4825563, "tpot_s": 0.42397697747628627, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14158436], "trace_timestamp_s": 684.0380000000005, "ttft_s": 18.690022998023778, "turn_id": 5} +{"actual_output_tokens": 140, "cached_tokens": 0, "effective_input_length": 127488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127488, "latency_s": 57.85450475703692, "output_length": 140, "proxy_request_id": "1356885:2:1438037:864", "request_id": "1356885:2:1438037:864", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1356885", "t_dispatch_unix": 1779818294.4813795, "t_finish_unix": 1779818352.3358846, "t_first_token_unix": 1779818347.5042326, "tpot_s": 0.034757986971304465, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14202196, 14202197, 14202198, 14202199, 14202200, 14202201, 14202202, 14202203, 14202204], "trace_timestamp_s": 700.7250000000004, "ttft_s": 53.022850698034745, "turn_id": 2} +{"actual_output_tokens": 589, "cached_tokens": 40464, "effective_input_length": 42342, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42342, "latency_s": 98.84306267701322, "output_length": 589, "proxy_request_id": "1277428:8:1426669:846", "request_id": "1277428:8:1426669:846", "request_type": "coder", "requested_output_tokens": 589, "session_id": "1277428", "t_dispatch_unix": 1779818254.872172, "t_finish_unix": 1779818353.7152345, "t_first_token_unix": 1779818274.2335901, "tpot_s": 0.13517240913949913, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14095200, 14095201, 14095202, 14095203, 14095204], "trace_timestamp_s": 661.1190000000006, "ttft_s": 19.36141581402626, "turn_id": 8} +{"actual_output_tokens": 46, "cached_tokens": 74000, "effective_input_length": 75761, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75761, "latency_s": 3.0079706630203873, "output_length": 46, "proxy_request_id": "1342921:6:1448548:876", "request_id": "1342921:6:1448548:876", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1342921", "t_dispatch_unix": 1779818350.755575, "t_finish_unix": 1779818353.7635531, "t_first_token_unix": 1779818351.7333007, "tpot_s": 0.045110713377491465, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705], "trace_timestamp_s": 735.5860000000002, "ttft_s": 0.977723143005278, "turn_id": 6} +{"actual_output_tokens": 76, "cached_tokens": 20512, "effective_input_length": 21518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21518, "latency_s": 1.2435640909825452, "output_length": 76, "proxy_request_id": "1371622:5:1455608:884", "request_id": "1371622:5:1455608:884", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1371622", "t_dispatch_unix": 1779818353.3732228, "t_finish_unix": 1779818354.6167867, "t_first_token_unix": 1779818353.6672733, "tpot_s": 0.012654998999399444, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14366141], "trace_timestamp_s": 759.6210000000001, "ttft_s": 0.29404856002656743, "turn_id": 5} +{"actual_output_tokens": 365, "cached_tokens": 109120, "effective_input_length": 109164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109164, "latency_s": 4.486968758981675, "output_length": 365, "proxy_request_id": "1314357:15:1452292:882", "request_id": "1314357:15:1452292:882", "request_type": "coder", "requested_output_tokens": 365, "session_id": "1314357", "t_dispatch_unix": 1779818350.339122, "t_finish_unix": 1779818354.826091, "t_first_token_unix": 1779818350.5387123, "tpot_s": 0.011777812659332355, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14335068, 14335069], "trace_timestamp_s": 748.0830000000005, "ttft_s": 0.1995885199867189, "turn_id": 15} +{"actual_output_tokens": 2012, "cached_tokens": 62512, "effective_input_length": 62513, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62513, "latency_s": 39.49781733902637, "output_length": 2012, "proxy_request_id": "1313181:9:1386945:689", "request_id": "1313181:9:1386945:689", "request_type": "coder", "requested_output_tokens": 2012, "session_id": "1313181", "t_dispatch_unix": 1779818323.557637, "t_finish_unix": 1779818363.0554538, "t_first_token_unix": 1779818324.3120663, "tpot_s": 0.01926556986076771, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13734424], "trace_timestamp_s": 521.2310000000007, "ttft_s": 0.7544271450024098, "turn_id": 9} +{"actual_output_tokens": 1368, "cached_tokens": 127616, "effective_input_length": 128563, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128563, "latency_s": 17.70824204897508, "output_length": 1368, "proxy_request_id": "1356885:3:1451307:879", "request_id": "1356885:3:1451307:879", "request_type": "coder", "requested_output_tokens": 1368, "session_id": "1356885", "t_dispatch_unix": 1779818352.3418145, "t_finish_unix": 1779818370.0500562, "t_first_token_unix": 1779818353.4619033, "tpot_s": 0.012134468831721796, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14202196, 14202197, 14202198, 14202199, 14202200, 14202201, 14202202, 14202203, 14202204, 14325634, 14325635, 14325636], "trace_timestamp_s": 744.8150000000005, "ttft_s": 1.120086368988268, "turn_id": 3} +{"actual_output_tokens": 352, "cached_tokens": 32080, "effective_input_length": 34392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34392, "latency_s": 3.060639273026027, "output_length": 352, "proxy_request_id": "1404395:3:1460072:887", "request_id": "1404395:3:1460072:887", "request_type": "coder", "requested_output_tokens": 352, "session_id": "1404395", "t_dispatch_unix": 1779818367.9546542, "t_finish_unix": 1779818371.0152938, "t_first_token_unix": 1779818368.602678, "tpot_s": 0.006872628732223563, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14408522], "trace_timestamp_s": 774.201, "ttft_s": 0.6480219910154119, "turn_id": 3} +{"actual_output_tokens": 116, "cached_tokens": 55104, "effective_input_length": 56147, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56147, "latency_s": 1.4154022939619608, "output_length": 116, "proxy_request_id": "1268861:12:1463977:891", "request_id": "1268861:12:1463977:891", "request_type": "coder", "requested_output_tokens": 116, "session_id": "1268861", "t_dispatch_unix": 1779818380.995181, "t_finish_unix": 1779818382.4105828, "t_first_token_unix": 1779818381.5296807, "tpot_s": 0.007657142921411635, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14445190], "trace_timestamp_s": 787.241, "ttft_s": 0.5344980160007253, "turn_id": 12} +{"actual_output_tokens": 71, "cached_tokens": 44928, "effective_input_length": 81299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81299, "latency_s": 15.324964720988646, "output_length": 71, "proxy_request_id": "1363093:6:1460799:888", "request_id": "1363093:6:1460799:888", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1363093", "t_dispatch_unix": 1779818370.378429, "t_finish_unix": 1779818385.7033935, "t_first_token_unix": 1779818385.1095667, "tpot_s": 0.00847927772805893, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678, 13925441, 13925442, 13925443, 13925444, 13925445, 13925446, 13925447, 13925448, 13925449, 14416033, 14416034, 14416035, 14416036, 14416037, 14416038, 14416039, 14416040, 14416041, 14416042, 14416043, 14416044, 14416045, 14416046, 14416047, 14416048], "trace_timestamp_s": 776.6220000000003, "ttft_s": 14.731133715016767, "turn_id": 6} +{"actual_output_tokens": 86, "cached_tokens": 21584, "effective_input_length": 23079, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23079, "latency_s": 0.8349858620204031, "output_length": 86, "proxy_request_id": "1371622:6:1465333:892", "request_id": "1371622:6:1465333:892", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1371622", "t_dispatch_unix": 1779818385.2541542, "t_finish_unix": 1779818386.08914, "t_first_token_unix": 1779818385.5786982, "tpot_s": 0.006001687976394725, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14456423], "trace_timestamp_s": 791.5020000000004, "ttft_s": 0.32454245100962, "turn_id": 6} +{"actual_output_tokens": 183, "cached_tokens": 34736, "effective_input_length": 34863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34863, "latency_s": 1.3513507510069758, "output_length": 183, "proxy_request_id": "1404395:4:1467473:894", "request_id": "1404395:4:1467473:894", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1404395", "t_dispatch_unix": 1779818392.7084825, "t_finish_unix": 1779818394.0598328, "t_first_token_unix": 1779818392.8306131, "tpot_s": 0.006752245065789404, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14477863], "trace_timestamp_s": 798.9530000000004, "ttft_s": 0.12212893198011443, "turn_id": 4} +{"actual_output_tokens": 137, "cached_tokens": 23152, "effective_input_length": 24036, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24036, "latency_s": 1.064174445986282, "output_length": 137, "proxy_request_id": "1371622:7:1468305:895", "request_id": "1371622:7:1468305:895", "request_type": "coder", "requested_output_tokens": 137, "session_id": "1371622", "t_dispatch_unix": 1779818395.4792595, "t_finish_unix": 1779818396.5434334, "t_first_token_unix": 1779818395.7123287, "tpot_s": 0.00610900544843924, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666], "trace_timestamp_s": 801.7260000000006, "ttft_s": 0.23306744097499177, "turn_id": 7} +{"actual_output_tokens": 79, "cached_tokens": 64512, "effective_input_length": 129839, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129839, "latency_s": 40.53661828901386, "output_length": 79, "proxy_request_id": "1313181:10:1338837:436", "request_id": "1313181:10:1338837:436", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1313181", "t_dispatch_unix": 1779818363.0649762, "t_finish_unix": 1779818403.6015942, "t_first_token_unix": 1779818402.1273775, "tpot_s": 0.018893830051335197, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13291139], "trace_timestamp_s": 353.08300000000054, "ttft_s": 39.0623988470179, "turn_id": 10} +{"actual_output_tokens": 217, "cached_tokens": 40848, "effective_input_length": 66246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66246, "latency_s": 10.727418549999129, "output_length": 217, "proxy_request_id": "1405155:3:1469167:897", "request_id": "1405155:3:1469167:897", "request_type": "coder", "requested_output_tokens": 217, "session_id": "1405155", "t_dispatch_unix": 1779818398.3722973, "t_finish_unix": 1779818409.0997155, "t_first_token_unix": 1779818407.3071296, "tpot_s": 0.008297188323922455, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13983589, 13983590, 13983591, 13983592, 13983593, 13983594, 13983595, 13983596, 13983597, 13983598, 13983599, 13983600, 13983601, 13983602, 13983603, 14163102, 14163103, 14163104, 14163105, 14163106, 14163107, 14163108, 14163109, 14163110, 14163111, 14163112, 14163113, 14163114, 14163115, 14163116, 14493552, 14493553, 14493554, 14493555, 14493556, 14493557, 14493558, 14493559, 14493560, 14493561, 14493562, 14493563, 14493564, 14493565, 14493566, 14493567, 14493568, 14493569, 14493570, 14493571, 14493572, 14493573, 14493574, 14493575, 14493576, 14493577, 14493578, 14493579, 14493580, 14493581, 14493582, 14493583, 14493584, 14493585, 14493586, 14493587], "trace_timestamp_s": 804.6080000000002, "ttft_s": 8.934830053010955, "turn_id": 3} +{"actual_output_tokens": 90, "cached_tokens": 23264, "effective_input_length": 29268, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29268, "latency_s": 47.283696621016134, "output_length": 90, "proxy_request_id": "1363943:14:1458616:885", "request_id": "1363943:14:1458616:885", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1363943", "t_dispatch_unix": 1779818363.3188267, "t_finish_unix": 1779818410.6025233, "t_first_token_unix": 1779818404.9037285, "tpot_s": 0.06402188608961787, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14395120], "trace_timestamp_s": 769.5660000000007, "ttft_s": 41.584899242036045, "turn_id": 14} +{"actual_output_tokens": 27, "cached_tokens": 12176, "effective_input_length": 12247, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12247, "latency_s": 0.19223004998639226, "output_length": 27, "proxy_request_id": "1399948:13:1472968:898", "request_id": "1399948:13:1472968:898", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1399948", "t_dispatch_unix": 1779818410.8302379, "t_finish_unix": 1779818411.0224683, "t_first_token_unix": 1779818410.8871744, "tpot_s": 0.005191497616648961, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14529718], "trace_timestamp_s": 817.0790000000006, "ttft_s": 0.05693508597323671, "turn_id": 13} +{"actual_output_tokens": 150, "cached_tokens": 75792, "effective_input_length": 76600, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76600, "latency_s": 1.8780312999733724, "output_length": 150, "proxy_request_id": "1342921:7:1473812:900", "request_id": "1342921:7:1473812:900", "request_type": "coder", "requested_output_tokens": 150, "session_id": "1342921", "t_dispatch_unix": 1779818413.7860017, "t_finish_unix": 1779818415.6640327, "t_first_token_unix": 1779818414.3538918, "tpot_s": 0.008790871080389284, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14537884], "trace_timestamp_s": 820.0320000000002, "ttft_s": 0.5678880360210314, "turn_id": 7} +{"actual_output_tokens": 499, "cached_tokens": 24160, "effective_input_length": 24569, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24569, "latency_s": 3.282771953032352, "output_length": 499, "proxy_request_id": "1371622:8:1473416:899", "request_id": "1371622:8:1473416:899", "request_type": "coder", "requested_output_tokens": 499, "session_id": "1371622", "t_dispatch_unix": 1779818412.498265, "t_finish_unix": 1779818415.781037, "t_first_token_unix": 1779818412.6673253, "tpot_s": 0.006251870945795443, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666, 14534121], "trace_timestamp_s": 818.7460000000001, "ttft_s": 0.16905855701770633, "turn_id": 8} +{"actual_output_tokens": 210, "cached_tokens": 29344, "effective_input_length": 29651, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29651, "latency_s": 5.789847288979217, "output_length": 210, "proxy_request_id": "1363943:15:1461716:889", "request_id": "1363943:15:1461716:889", "request_type": "coder", "requested_output_tokens": 210, "session_id": "1363943", "t_dispatch_unix": 1779818410.6040707, "t_finish_unix": 1779818416.3939185, "t_first_token_unix": 1779818410.8049905, "tpot_s": 0.0267400183351755, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564], "trace_timestamp_s": 779.4890000000005, "ttft_s": 0.2009172149701044, "turn_id": 15} +{"actual_output_tokens": 303, "cached_tokens": 0, "effective_input_length": 26406, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26406, "latency_s": 49.80063352797879, "output_length": 303, "proxy_request_id": "1242838:5:1460026:886", "request_id": "1242838:5:1460026:886", "request_type": "coder", "requested_output_tokens": 303, "session_id": "1242838", "t_dispatch_unix": 1779818367.806004, "t_finish_unix": 1779818417.6066377, "t_first_token_unix": 1779818408.0896006, "tpot_s": 0.03151235962248043, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082], "trace_timestamp_s": 774.0540000000001, "ttft_s": 40.28359379898757, "turn_id": 5} +{"actual_output_tokens": 2588, "cached_tokens": 114368, "effective_input_length": 125947, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 125947, "latency_s": 146.29837756499182, "output_length": 2588, "proxy_request_id": "1264679:3:1431512:853", "request_id": "1264679:3:1431512:853", "request_type": "coder", "requested_output_tokens": 2588, "session_id": "1264679", "t_dispatch_unix": 1779818271.6057491, "t_finish_unix": 1779818417.9041262, "t_first_token_unix": 1779818280.1633716, "tpot_s": 0.05324332340740878, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281, 13901868, 13901869, 13901870, 13901871, 13901872, 13901873, 13901874, 14141972, 14141973, 14141974, 14141975, 14141976, 14141977, 14141978, 14141979, 14141980, 14141981, 14141982, 14141983, 14141984, 14141985, 14141986, 14141987, 14141988, 14141989, 14141990, 14141991, 14141992, 14141993, 14141994, 14141995], "trace_timestamp_s": 677.8460000000005, "ttft_s": 8.5576200390351, "turn_id": 3} +{"actual_output_tokens": 366, "cached_tokens": 64720, "effective_input_length": 64724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64724, "latency_s": 14.821580766001716, "output_length": 366, "proxy_request_id": "1313181:10:1399867:746", "request_id": "1313181:10:1399867:746", "request_type": "coder", "requested_output_tokens": 366, "session_id": "1313181", "t_dispatch_unix": 1779818403.6064115, "t_finish_unix": 1779818418.4279926, "t_first_token_unix": 1779818408.098625, "tpot_s": 0.028298847737071448, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13853445], "trace_timestamp_s": 566.9639999999999, "ttft_s": 4.4922091359621845, "turn_id": 10} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 44949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44949, "latency_s": 9.089500760019291, "output_length": 183, "proxy_request_id": "1305906:4:1476757:902", "request_id": "1305906:4:1476757:902", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1305906", "t_dispatch_unix": 1779818423.8583639, "t_finish_unix": 1779818432.9478636, "t_first_token_unix": 1779818431.6352997, "tpot_s": 0.007210541549484133, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14566041, 14566042], "trace_timestamp_s": 830.094, "ttft_s": 7.7769349699956365, "turn_id": 4} +{"actual_output_tokens": 90, "cached_tokens": 25056, "effective_input_length": 25286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25286, "latency_s": 0.9153590140049346, "output_length": 90, "proxy_request_id": "1371622:9:1479535:905", "request_id": "1371622:9:1479535:905", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1371622", "t_dispatch_unix": 1779818433.1753712, "t_finish_unix": 1779818434.09073, "t_first_token_unix": 1779818433.292466, "tpot_s": 0.008964525606336721, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666, 14534121, 14590128, 14590129], "trace_timestamp_s": 839.4230000000007, "ttft_s": 0.11709296202752739, "turn_id": 9} +{"actual_output_tokens": 378, "cached_tokens": 35040, "effective_input_length": 36988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36988, "latency_s": 3.2345895870239474, "output_length": 378, "proxy_request_id": "1404395:5:1480170:906", "request_id": "1404395:5:1480170:906", "request_type": "coder", "requested_output_tokens": 378, "session_id": "1404395", "t_dispatch_unix": 1779818435.4145677, "t_finish_unix": 1779818438.6491568, "t_first_token_unix": 1779818436.016138, "tpot_s": 0.006983458039793001, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14596005], "trace_timestamp_s": 841.6610000000001, "ttft_s": 0.6015685939928517, "turn_id": 5} +{"actual_output_tokens": 164, "cached_tokens": 56256, "effective_input_length": 57130, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57130, "latency_s": 1.7130833819974214, "output_length": 164, "proxy_request_id": "1268861:13:1481831:907", "request_id": "1268861:13:1481831:907", "request_type": "coder", "requested_output_tokens": 164, "session_id": "1268861", "t_dispatch_unix": 1779818441.0047972, "t_finish_unix": 1779818442.71788, "t_first_token_unix": 1779818441.4726079, "tpot_s": 0.007637980502981556, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14610203], "trace_timestamp_s": 847.2510000000002, "ttft_s": 0.4678082870086655, "turn_id": 13} +{"actual_output_tokens": 1604, "cached_tokens": 38816, "effective_input_length": 38827, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38827, "latency_s": 11.777222964039538, "output_length": 1604, "proxy_request_id": "1301929:4:1479037:904", "request_id": "1301929:4:1479037:904", "request_type": "coder", "requested_output_tokens": 1604, "session_id": "1301929", "t_dispatch_unix": 1779818431.4313781, "t_finish_unix": 1779818443.2086003, "t_first_token_unix": 1779818431.515744, "tpot_s": 0.00729417061756806, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 14014871, 14014872, 14014873, 14585791, 14585792, 14585793], "trace_timestamp_s": 837.6770000000006, "ttft_s": 0.08436392503790557, "turn_id": 4} +{"actual_output_tokens": 359, "cached_tokens": 37360, "effective_input_length": 37689, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37689, "latency_s": 2.720042029977776, "output_length": 359, "proxy_request_id": "1404395:6:1483967:909", "request_id": "1404395:6:1483967:909", "request_type": "coder", "requested_output_tokens": 359, "session_id": "1404395", "t_dispatch_unix": 1779818448.2600498, "t_finish_unix": 1779818450.9800918, "t_first_token_unix": 1779818448.4866197, "tpot_s": 0.006964175899314054, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14632577], "trace_timestamp_s": 854.5040000000008, "ttft_s": 0.22656712302705273, "turn_id": 6} +{"actual_output_tokens": 76, "cached_tokens": 65088, "effective_input_length": 129931, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129931, "latency_s": 43.983028643007856, "output_length": 76, "proxy_request_id": "1313181:11:1344301:464", "request_id": "1313181:11:1344301:464", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1313181", "t_dispatch_unix": 1779818418.43421, "t_finish_unix": 1779818462.4172385, "t_first_token_unix": 1779818457.4345727, "tpot_s": 0.06643174073348443, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342], "trace_timestamp_s": 371.9440000000004, "ttft_s": 39.00035966001451, "turn_id": 11} +{"actual_output_tokens": 215, "cached_tokens": 29856, "effective_input_length": 34671, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34671, "latency_s": 46.791353593056556, "output_length": 215, "proxy_request_id": "1363943:16:1463626:890", "request_id": "1363943:16:1463626:890", "request_type": "coder", "requested_output_tokens": 215, "session_id": "1363943", "t_dispatch_unix": 1779818416.39751, "t_finish_unix": 1779818463.1888642, "t_first_token_unix": 1779818417.612047, "tpot_s": 0.21297328877121333, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14441618], "trace_timestamp_s": 785.9570000000003, "ttft_s": 1.214533874008339, "turn_id": 16} +{"actual_output_tokens": 51, "cached_tokens": 65120, "effective_input_length": 65123, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65123, "latency_s": 0.7717000979464501, "output_length": 51, "proxy_request_id": "1313181:11:1402841:762", "request_id": "1313181:11:1402841:762", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1313181", "t_dispatch_unix": 1779818462.423054, "t_finish_unix": 1779818463.1947536, "t_first_token_unix": 1779818462.544106, "tpot_s": 0.012890179440146312, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13881594], "trace_timestamp_s": 577.3000000000002, "ttft_s": 0.12105036998400465, "turn_id": 11} +{"actual_output_tokens": 205, "cached_tokens": 0, "effective_input_length": 29903, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29903, "latency_s": 6.620432591997087, "output_length": 205, "proxy_request_id": "1242838:6:1486863:911", "request_id": "1242838:6:1486863:911", "request_type": "coder", "requested_output_tokens": 205, "session_id": "1242838", "t_dispatch_unix": 1779818458.0113742, "t_finish_unix": 1779818464.6318073, "t_first_token_unix": 1779818462.0178592, "tpot_s": 0.012812027323639532, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082, 14660531, 14660532, 14660533, 14660534, 14660535, 14660536, 14660537], "trace_timestamp_s": 864.2580000000007, "ttft_s": 4.006483300996479, "turn_id": 6} +{"actual_output_tokens": 166, "cached_tokens": 34880, "effective_input_length": 35991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35991, "latency_s": 1.8120281459996477, "output_length": 166, "proxy_request_id": "1363943:17:1466811:893", "request_id": "1363943:17:1466811:893", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1363943", "t_dispatch_unix": 1779818463.1917582, "t_finish_unix": 1779818465.0037863, "t_first_token_unix": 1779818463.6047943, "tpot_s": 0.00847675221845169, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14471076], "trace_timestamp_s": 796.6350000000002, "ttft_s": 0.41303327796049416, "turn_id": 17} +{"actual_output_tokens": 366, "cached_tokens": 36144, "effective_input_length": 47303, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47303, "latency_s": 5.97145096299937, "output_length": 366, "proxy_request_id": "1363943:18:1469143:896", "request_id": "1363943:18:1469143:896", "request_type": "coder", "requested_output_tokens": 366, "session_id": "1363943", "t_dispatch_unix": 1779818465.0106897, "t_finish_unix": 1779818470.9821408, "t_first_token_unix": 1779818468.2592394, "tpot_s": 0.0074572650163932, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14493422], "trace_timestamp_s": 804.5360000000001, "ttft_s": 3.2485467590158805, "turn_id": 18} +{"actual_output_tokens": 45, "cached_tokens": 38032, "effective_input_length": 39569, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39569, "latency_s": 0.778398193011526, "output_length": 45, "proxy_request_id": "1404395:7:1491186:914", "request_id": "1404395:7:1491186:914", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1404395", "t_dispatch_unix": 1779818472.8014772, "t_finish_unix": 1779818473.579875, "t_first_token_unix": 1779818473.2969155, "tpot_s": 0.0064245433631268415, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14668041, 14668042, 14668043, 14701438, 14701439], "trace_timestamp_s": 879.0480000000007, "ttft_s": 0.4954358940012753, "turn_id": 7} +{"actual_output_tokens": 235, "cached_tokens": 47664, "effective_input_length": 56056, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56056, "latency_s": 4.82285163301276, "output_length": 235, "proxy_request_id": "1363943:19:1473899:901", "request_id": "1363943:19:1473899:901", "request_type": "coder", "requested_output_tokens": 235, "session_id": "1363943", "t_dispatch_unix": 1779818470.9879682, "t_finish_unix": 1779818475.81082, "t_first_token_unix": 1779818473.9641836, "tpot_s": 0.007890257782165486, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14538809], "trace_timestamp_s": 820.3120000000008, "ttft_s": 2.976212425972335, "turn_id": 19} +{"actual_output_tokens": 419, "cached_tokens": 56288, "effective_input_length": 60761, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60761, "latency_s": 5.250584085995797, "output_length": 419, "proxy_request_id": "1363943:20:1476805:903", "request_id": "1363943:20:1476805:903", "request_type": "coder", "requested_output_tokens": 419, "session_id": "1363943", "t_dispatch_unix": 1779818475.8158681, "t_finish_unix": 1779818481.0664525, "t_first_token_unix": 1779818477.6322079, "tpot_s": 0.008215201217636608, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14566556], "trace_timestamp_s": 830.2800000000007, "ttft_s": 1.816336095042061, "turn_id": 20} +{"actual_output_tokens": 370, "cached_tokens": 61168, "effective_input_length": 65658, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65658, "latency_s": 5.068302258034237, "output_length": 370, "proxy_request_id": "1363943:21:1482184:908", "request_id": "1363943:21:1482184:908", "request_type": "coder", "requested_output_tokens": 370, "session_id": "1363943", "t_dispatch_unix": 1779818481.0718591, "t_finish_unix": 1779818486.1401615, "t_first_token_unix": 1779818483.0242527, "tpot_s": 0.008443486002724375, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14613732], "trace_timestamp_s": 848.5780000000004, "ttft_s": 1.9523902700166218, "turn_id": 21} +{"actual_output_tokens": 504, "cached_tokens": 39600, "effective_input_length": 39820, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39820, "latency_s": 3.741410246002488, "output_length": 504, "proxy_request_id": "1404395:8:1494219:916", "request_id": "1404395:8:1494219:916", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1404395", "t_dispatch_unix": 1779818482.9123778, "t_finish_unix": 1779818486.6537876, "t_first_token_unix": 1779818483.074395, "tpot_s": 0.007115557843034209, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14668041, 14668042, 14668043, 14701438, 14730229], "trace_timestamp_s": 889.1580000000004, "ttft_s": 0.16201416199328378, "turn_id": 8} +{"actual_output_tokens": 398, "cached_tokens": 66016, "effective_input_length": 70238, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70238, "latency_s": 5.405408127000555, "output_length": 398, "proxy_request_id": "1363943:22:1485341:910", "request_id": "1363943:22:1485341:910", "request_type": "coder", "requested_output_tokens": 398, "session_id": "1363943", "t_dispatch_unix": 1779818486.1456301, "t_finish_unix": 1779818491.5510385, "t_first_token_unix": 1779818488.0957286, "tpot_s": 0.008702840282164176, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14647276], "trace_timestamp_s": 859.232, "ttft_s": 1.9500959040015005, "turn_id": 22} +{"actual_output_tokens": 226, "cached_tokens": 70624, "effective_input_length": 72516, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72516, "latency_s": 3.0342728579998948, "output_length": 226, "proxy_request_id": "1363943:23:1488713:912", "request_id": "1363943:23:1488713:912", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1363943", "t_dispatch_unix": 1779818491.555645, "t_finish_unix": 1779818494.5899177, "t_first_token_unix": 1779818492.6268492, "tpot_s": 0.00872341027095293, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14678082], "trace_timestamp_s": 870.3830000000007, "ttft_s": 1.0712012000149116, "turn_id": 23} +{"actual_output_tokens": 181, "cached_tokens": 72736, "effective_input_length": 74939, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74939, "latency_s": 2.825408650969621, "output_length": 181, "proxy_request_id": "1363943:24:1491020:913", "request_id": "1363943:24:1491020:913", "request_type": "coder", "requested_output_tokens": 181, "session_id": "1363943", "t_dispatch_unix": 1779818494.5962894, "t_finish_unix": 1779818497.421698, "t_first_token_unix": 1779818495.8379734, "tpot_s": 0.008796798844317284, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14700163], "trace_timestamp_s": 878.643, "ttft_s": 1.2416808939888142, "turn_id": 24} +{"actual_output_tokens": 74, "cached_tokens": 57280, "effective_input_length": 61910, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61910, "latency_s": 2.406087598996237, "output_length": 74, "proxy_request_id": "1268861:14:1498281:920", "request_id": "1268861:14:1498281:920", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1268861", "t_dispatch_unix": 1779818496.3931828, "t_finish_unix": 1779818498.79927, "t_first_token_unix": 1779818498.2443836, "tpot_s": 0.007597693506857916, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224], "trace_timestamp_s": 902.6390000000001, "ttft_s": 1.851199123018887, "turn_id": 14} +{"actual_output_tokens": 246, "cached_tokens": 75104, "effective_input_length": 75711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75711, "latency_s": 2.6001079729758203, "output_length": 246, "proxy_request_id": "1363943:25:1493325:915", "request_id": "1363943:25:1493325:915", "request_type": "coder", "requested_output_tokens": 246, "session_id": "1363943", "t_dispatch_unix": 1779818497.4258149, "t_finish_unix": 1779818500.0259233, "t_first_token_unix": 1779818497.8588343, "tpot_s": 0.008844199514358627, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986], "trace_timestamp_s": 886.1260000000002, "ttft_s": 0.43301622295985, "turn_id": 25} +{"actual_output_tokens": 197, "cached_tokens": 75952, "effective_input_length": 83861, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83861, "latency_s": 7.138712743006181, "output_length": 197, "proxy_request_id": "1363943:26:1495648:917", "request_id": "1363943:26:1495648:917", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1363943", "t_dispatch_unix": 1779818500.032891, "t_finish_unix": 1779818507.1716037, "t_first_token_unix": 1779818504.1016033, "tpot_s": 0.015661160668598163, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228], "trace_timestamp_s": 893.8879999999999, "ttft_s": 4.068708462989889, "turn_id": 26} +{"actual_output_tokens": 298, "cached_tokens": 30096, "effective_input_length": 33352, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33352, "latency_s": 8.227778894011863, "output_length": 298, "proxy_request_id": "1242838:7:1499476:921", "request_id": "1242838:7:1499476:921", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1242838", "t_dispatch_unix": 1779818500.2312934, "t_finish_unix": 1779818508.4590724, "t_first_token_unix": 1779818504.8315277, "tpot_s": 0.01221279878116774, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082, 14660531, 14660532, 14660533, 14660534, 14660535, 14660536, 14660537, 14778951, 14778952, 14778953, 14778954, 14778955, 14778956, 14778957], "trace_timestamp_s": 906.4770000000008, "ttft_s": 4.600231812975835, "turn_id": 7} +{"actual_output_tokens": 376, "cached_tokens": 84048, "effective_input_length": 84090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 84090, "latency_s": 3.984996489016339, "output_length": 376, "proxy_request_id": "1363943:27:1497882:919", "request_id": "1363943:27:1497882:919", "request_type": "coder", "requested_output_tokens": 376, "session_id": "1363943", "t_dispatch_unix": 1779818507.1757128, "t_finish_unix": 1779818511.1607094, "t_first_token_unix": 1779818507.369816, "tpot_s": 0.010108228034650286, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14764349], "trace_timestamp_s": 901.1640000000007, "ttft_s": 0.19410029600840062, "turn_id": 27} +{"actual_output_tokens": 81, "cached_tokens": 31744, "effective_input_length": 130479, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130479, "latency_s": 50.626353154017124, "output_length": 81, "proxy_request_id": "1313181:12:1346194:470", "request_id": "1313181:12:1346194:470", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1313181", "t_dispatch_unix": 1779818463.2004905, "t_finish_unix": 1779818513.8268437, "t_first_token_unix": 1779818512.958426, "tpot_s": 0.0108519644876651, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182], "trace_timestamp_s": 378.5650000000005, "ttft_s": 49.75793302600505, "turn_id": 12} +{"actual_output_tokens": 229, "cached_tokens": 84464, "effective_input_length": 86984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86984, "latency_s": 3.7423887790064327, "output_length": 229, "proxy_request_id": "1363943:28:1500984:922", "request_id": "1363943:28:1500984:922", "request_type": "coder", "requested_output_tokens": 229, "session_id": "1363943", "t_dispatch_unix": 1779818511.1670024, "t_finish_unix": 1779818514.909391, "t_first_token_unix": 1779818512.7553847, "tpot_s": 0.009446250767500157, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559], "trace_timestamp_s": 911.473, "ttft_s": 1.5883799099829048, "turn_id": 28} +{"actual_output_tokens": 25, "cached_tokens": 76736, "effective_input_length": 78722, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78722, "latency_s": 1.4324231959762983, "output_length": 25, "proxy_request_id": "1342921:8:1503584:925", "request_id": "1342921:8:1503584:925", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1342921", "t_dispatch_unix": 1779818514.0839403, "t_finish_unix": 1779818515.5163636, "t_first_token_unix": 1779818515.245253, "tpot_s": 0.011278297749716634, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14818583, 14818584, 14818585, 14818586, 14818587], "trace_timestamp_s": 920.3299999999999, "ttft_s": 1.1613086659926921, "turn_id": 8} +{"actual_output_tokens": 69, "cached_tokens": 65168, "effective_input_length": 65179, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65179, "latency_s": 1.8218835829757154, "output_length": 69, "proxy_request_id": "1313181:12:1404813:772", "request_id": "1313181:12:1404813:772", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1313181", "t_dispatch_unix": 1779818513.831981, "t_finish_unix": 1779818515.653864, "t_first_token_unix": 1779818513.952939, "tpot_s": 0.025009854073526665, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13897933], "trace_timestamp_s": 584.0840000000007, "ttft_s": 0.1209553389926441, "turn_id": 12} +{"actual_output_tokens": 53, "cached_tokens": 12272, "effective_input_length": 14189, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14189, "latency_s": 0.5841451589949429, "output_length": 53, "proxy_request_id": "1399948:14:1504493:926", "request_id": "1399948:14:1504493:926", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1399948", "t_dispatch_unix": 1779818516.872639, "t_finish_unix": 1779818517.4567835, "t_first_token_unix": 1779818517.1694806, "tpot_s": 0.005519113806747975, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14827845], "trace_timestamp_s": 923.1200000000008, "ttft_s": 0.29684063204331324, "turn_id": 14} +{"actual_output_tokens": 184, "cached_tokens": 0, "effective_input_length": 75760, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75760, "latency_s": 39.48549130000174, "output_length": 184, "proxy_request_id": "1388507:2:1496686:918", "request_id": "1388507:2:1496686:918", "request_type": "coder", "requested_output_tokens": 184, "session_id": "1388507", "t_dispatch_unix": 1779818491.009985, "t_finish_unix": 1779818530.495476, "t_first_token_unix": 1779818510.7269192, "tpot_s": 0.10802302147545521, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728, 14709792, 14709793, 14709794, 14709795, 14709796, 14709797, 14709798], "trace_timestamp_s": 897.2540000000008, "ttft_s": 19.71693143300945, "turn_id": 2} +{"actual_output_tokens": 355, "cached_tokens": 72000, "effective_input_length": 103893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103893, "latency_s": 23.58512925298419, "output_length": 355, "proxy_request_id": "1397515:2:1502033:923", "request_id": "1397515:2:1502033:923", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1397515", "t_dispatch_unix": 1779818508.7853186, "t_finish_unix": 1779818532.3704479, "t_first_token_unix": 1779818527.9006004, "tpot_s": 0.012625857245829483, "trace_hash_ids": [61256, 61257, 9334, 61258, 61259, 61260, 61261, 61262, 61263, 61264, 61265, 139791, 92491, 139792, 139793, 139794, 139795, 139796, 139797, 139798, 740834, 740835, 740836, 740837, 1942273, 1942274, 1942275, 1942276, 1942277, 1942278, 1942279, 1942280, 1942281, 590845, 590846, 590847, 590848, 1942282, 161018, 161019, 161020, 161021, 1942283, 10351134, 10351135, 10351136, 10351137, 10351138, 10351139, 10351140, 10351141, 10351142, 10351143, 13831505, 2806911, 13831506, 13831507, 13831508, 13831509, 13831510, 13831511, 13831512, 13831513, 13831514, 13831515, 13831516, 13831517, 13831518, 13831519, 13831520, 13831521, 13831522, 13831523, 13831524, 13831525, 13831526, 13831527, 13831528, 13831529, 13831530, 13831531, 13831532, 13831533, 13831534, 13831535, 13831536, 13831537, 13831538, 13831539, 13831540, 13831541, 13831542, 13831543, 13831544, 13831545, 13831546, 13831547, 13831548, 13831549, 13831550, 13831551, 13831552, 13831553, 13831554, 13831555, 13831556, 13831557, 13831558, 13831559, 13831560, 13831561, 13831562, 13831563, 13831564, 13831565, 13831566, 13831567, 13831568, 13831569, 13831570, 13831571, 13831572, 13831573, 13831574, 13831575, 13831576, 13831577, 13831578, 13831579, 13831580, 13831581, 13831582, 13831583, 13831584, 13831585, 13831586, 13831587, 13831588, 13831589, 13831590, 13831591, 13831592, 13831593, 13831594, 13831595, 13831596, 13831597, 13831598, 13831599, 13831600, 13831601, 13831602, 13831603, 13831604, 13831605, 13831606, 13831607, 13831608, 13831609, 13831610, 13831611, 13831612, 13831613, 13831614, 13831615, 13831616, 13831617, 13831618, 13831619, 13831620, 13831621, 13831622, 13831623, 13831624, 13831625, 13831626, 13831627, 13831628, 14027210, 14027211, 14027212, 14697579, 14697580, 14697581, 14697582, 14697583, 14697584, 14697585, 14697586, 14697587, 14697588, 14697589, 14697590, 14697591, 14803950, 14803951, 14803952, 14803953, 14803954, 14803955, 14803956, 14803957, 14803958], "trace_timestamp_s": 915.0260000000007, "ttft_s": 19.115279337973334, "turn_id": 2} +{"actual_output_tokens": 174, "cached_tokens": 61968, "effective_input_length": 63035, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63035, "latency_s": 2.002542740025092, "output_length": 174, "proxy_request_id": "1268861:15:1508874:928", "request_id": "1268861:15:1508874:928", "request_type": "coder", "requested_output_tokens": 174, "session_id": "1268861", "t_dispatch_unix": 1779818531.7209194, "t_finish_unix": 1779818533.7234616, "t_first_token_unix": 1779818532.315136, "tpot_s": 0.00813900517949813, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 14868809], "trace_timestamp_s": 937.9670000000006, "ttft_s": 0.5942147939931601, "turn_id": 15} +{"actual_output_tokens": 46, "cached_tokens": 14240, "effective_input_length": 15669, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15669, "latency_s": 0.49451194901484996, "output_length": 46, "proxy_request_id": "1399948:15:1512300:930", "request_id": "1399948:15:1512300:930", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1399948", "t_dispatch_unix": 1779818543.1933494, "t_finish_unix": 1779818543.687861, "t_first_token_unix": 1779818543.4433274, "tpot_s": 0.005427949977779968, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14902700], "trace_timestamp_s": 949.4360000000006, "ttft_s": 0.24997672101017088, "turn_id": 15} +{"actual_output_tokens": 76, "cached_tokens": 15712, "effective_input_length": 15913, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15913, "latency_s": 0.5245349450269714, "output_length": 76, "proxy_request_id": "1399948:16:1513839:933", "request_id": "1399948:16:1513839:933", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1399948", "t_dispatch_unix": 1779818548.3707776, "t_finish_unix": 1779818548.895312, "t_first_token_unix": 1779818548.470717, "tpot_s": 0.005657785386623194, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14917327], "trace_timestamp_s": 954.6170000000002, "ttft_s": 0.0999376630061306, "turn_id": 16} +{"actual_output_tokens": 143, "cached_tokens": 65168, "effective_input_length": 131699, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131699, "latency_s": 43.23828148294706, "output_length": 143, "proxy_request_id": "1313181:13:1349104:484", "request_id": "1313181:13:1349104:484", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1313181", "t_dispatch_unix": 1779818515.6594536, "t_finish_unix": 1779818558.8977356, "t_first_token_unix": 1779818556.5193477, "tpot_s": 0.016747284147717898, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182, 13385557, 13385558, 13385559], "trace_timestamp_s": 388.8780000000006, "ttft_s": 40.85988910397282, "turn_id": 13} +{"actual_output_tokens": 212, "cached_tokens": 87200, "effective_input_length": 89469, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89469, "latency_s": 44.818218043015804, "output_length": 212, "proxy_request_id": "1363943:29:1503515:924", "request_id": "1363943:29:1503515:924", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1363943", "t_dispatch_unix": 1779818514.914789, "t_finish_unix": 1779818559.7330072, "t_first_token_unix": 1779818516.3795872, "tpot_s": 0.20546396390035068, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14817740], "trace_timestamp_s": 920.0750000000007, "ttft_s": 1.4647953670355491, "turn_id": 29} +{"actual_output_tokens": 73, "cached_tokens": 89680, "effective_input_length": 89713, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89713, "latency_s": 1.128201805986464, "output_length": 73, "proxy_request_id": "1363943:30:1506171:927", "request_id": "1363943:30:1506171:927", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1363943", "t_dispatch_unix": 1779818559.7382045, "t_finish_unix": 1779818560.8664062, "t_first_token_unix": 1779818559.9198196, "tpot_s": 0.013142620652312568, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 14843115], "trace_timestamp_s": 928.9100000000008, "ttft_s": 0.18161284999223426, "turn_id": 30} +{"actual_output_tokens": 257, "cached_tokens": 65264, "effective_input_length": 65279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65279, "latency_s": 3.6826222839881666, "output_length": 257, "proxy_request_id": "1313181:13:1406095:783", "request_id": "1313181:13:1406095:783", "request_type": "coder", "requested_output_tokens": 257, "session_id": "1313181", "t_dispatch_unix": 1779818558.9019108, "t_finish_unix": 1779818562.5845327, "t_first_token_unix": 1779818559.031596, "tpot_s": 0.013877354695296162, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13909100], "trace_timestamp_s": 588.6900000000005, "ttft_s": 0.12968342303065583, "turn_id": 13} +{"actual_output_tokens": 63, "cached_tokens": 15984, "effective_input_length": 16604, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16604, "latency_s": 0.5011581460130401, "output_length": 63, "proxy_request_id": "1399948:17:1518102:936", "request_id": "1399948:17:1518102:936", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779818562.4821897, "t_finish_unix": 1779818562.9833477, "t_first_token_unix": 1779818562.6345983, "tpot_s": 0.005620893951873446, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 14957862], "trace_timestamp_s": 968.7300000000005, "ttft_s": 0.15240641200216487, "turn_id": 17} +{"actual_output_tokens": 63, "cached_tokens": 16656, "effective_input_length": 17276, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17276, "latency_s": 0.49224783602403477, "output_length": 63, "proxy_request_id": "1399948:18:1524432:938", "request_id": "1399948:18:1524432:938", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779818583.534017, "t_finish_unix": 1779818584.026265, "t_first_token_unix": 1779818583.6774266, "tpot_s": 0.0056207818223253615, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15019330], "trace_timestamp_s": 989.781, "ttft_s": 0.14340834104223177, "turn_id": 18} +{"actual_output_tokens": 50, "cached_tokens": 17328, "effective_input_length": 18091, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18091, "latency_s": 0.4686202920274809, "output_length": 50, "proxy_request_id": "1399948:19:1526739:941", "request_id": "1399948:19:1526739:941", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1399948", "t_dispatch_unix": 1779818591.454115, "t_finish_unix": 1779818591.9227352, "t_first_token_unix": 1779818591.6381354, "tpot_s": 0.005801514918412253, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15040983], "trace_timestamp_s": 997.7020000000002, "ttft_s": 0.18401699600508437, "turn_id": 19} +{"actual_output_tokens": 92, "cached_tokens": 18128, "effective_input_length": 18164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18164, "latency_s": 0.5872012109612115, "output_length": 92, "proxy_request_id": "1399948:20:1527857:942", "request_id": "1399948:20:1527857:942", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1399948", "t_dispatch_unix": 1779818594.95226, "t_finish_unix": 1779818595.539461, "t_first_token_unix": 1779818595.010169, "tpot_s": 0.005813477373461925, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15053152], "trace_timestamp_s": 1001.2000000000007, "ttft_s": 0.057905995985493064, "turn_id": 20} +{"actual_output_tokens": 100, "cached_tokens": 18240, "effective_input_length": 18388, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18388, "latency_s": 3.6155303950072266, "output_length": 100, "proxy_request_id": "1399948:21:1528978:944", "request_id": "1399948:21:1528978:944", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1399948", "t_dispatch_unix": 1779818598.899651, "t_finish_unix": 1779818602.515181, "t_first_token_unix": 1779818601.7070858, "tpot_s": 0.008158944282596085, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128], "trace_timestamp_s": 1005.1450000000004, "ttft_s": 2.8074328420334496, "turn_id": 21} +{"actual_output_tokens": 45, "cached_tokens": 18480, "effective_input_length": 18563, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18563, "latency_s": 0.44133243802934885, "output_length": 45, "proxy_request_id": "1399948:22:1530122:947", "request_id": "1399948:22:1530122:947", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779818602.7276478, "t_finish_unix": 1779818603.1689801, "t_first_token_unix": 1779818602.803773, "tpot_s": 0.008292215863052248, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15074294], "trace_timestamp_s": 1008.9760000000006, "ttft_s": 0.07612314802827314, "turn_id": 22} +{"actual_output_tokens": 15, "cached_tokens": 41264, "effective_input_length": 79086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79086, "latency_s": 15.052223543985747, "output_length": 15, "proxy_request_id": "1342921:9:1525898:939", "request_id": "1342921:9:1525898:939", "request_type": "coder", "requested_output_tokens": 15, "session_id": "1342921", "t_dispatch_unix": 1779818588.5682342, "t_finish_unix": 1779818603.6204572, "t_first_token_unix": 1779818603.2489488, "tpot_s": 0.026511169217493653, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14818583, 14818584, 14818585, 14818586, 15032686, 15032687], "trace_timestamp_s": 994.8110000000006, "ttft_s": 14.6807054799865, "turn_id": 9} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 44364, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44364, "latency_s": 57.76425017300062, "output_length": 45, "proxy_request_id": "1277428:9:1513231:932", "request_id": "1277428:9:1513231:932", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779818546.2027574, "t_finish_unix": 1779818603.9670072, "t_first_token_unix": 1779818588.634913, "tpot_s": 0.3484489210677566, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14911410], "trace_timestamp_s": 952.4470000000001, "ttft_s": 42.43215363100171, "turn_id": 9} +{"actual_output_tokens": 607, "cached_tokens": 0, "effective_input_length": 36568, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36568, "latency_s": 10.034016871009953, "output_length": 607, "proxy_request_id": "1243831:2:1528168:943", "request_id": "1243831:2:1528168:943", "request_type": "coder", "requested_output_tokens": 607, "session_id": "1243831", "t_dispatch_unix": 1779818596.1575649, "t_finish_unix": 1779818606.1915815, "t_first_token_unix": 1779818601.7048032, "tpot_s": 0.007403483343170034, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 15055359, 15055360, 15055361, 15055362, 15055363, 15055364, 15055365, 15055366, 15055367, 15055368, 15055369, 15055370, 15055371, 15055372, 15055373, 15055374, 15055375, 15055376, 15055377, 15055378, 15055379, 15055380, 15055381, 15055382, 15055383, 15055384, 15055385, 15055386, 15055387, 15055388, 15055389, 15055390, 15055391, 15055392, 15055393, 15055394, 15055395, 15055396, 15055397, 15055398, 15055399, 15055400, 15055401, 15055402, 15055403, 15055404, 15055405, 15055406, 15055407, 15055408], "trace_timestamp_s": 1002.3960000000006, "ttft_s": 5.547235116013326, "turn_id": 2} +{"actual_output_tokens": 133, "cached_tokens": 63200, "effective_input_length": 71192, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71192, "latency_s": 4.5674549950053915, "output_length": 133, "proxy_request_id": "1268861:16:1529894:946", "request_id": "1268861:16:1529894:946", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1268861", "t_dispatch_unix": 1779818601.910846, "t_finish_unix": 1779818606.4783013, "t_first_token_unix": 1779818605.3719897, "tpot_s": 0.008379088030337836, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15072129], "trace_timestamp_s": 1008.1510000000007, "ttft_s": 3.4611411039950326, "turn_id": 16} +{"actual_output_tokens": 151, "cached_tokens": 11568, "effective_input_length": 11584, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11584, "latency_s": 0.8689012860413641, "output_length": 151, "proxy_request_id": "1243831:3:1270336:110", "request_id": "1243831:3:1270336:110", "request_type": "coder", "requested_output_tokens": 151, "session_id": "1243831", "t_dispatch_unix": 1779818606.1927612, "t_finish_unix": 1779818607.0616627, "t_first_token_unix": 1779818606.232316, "tpot_s": 0.005527133486854533, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12641626], "trace_timestamp_s": 113.52800000000025, "ttft_s": 0.039553245005663484, "turn_id": 3} +{"actual_output_tokens": 77, "cached_tokens": 11728, "effective_input_length": 14515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14515, "latency_s": 0.8022360689938068, "output_length": 77, "proxy_request_id": "1243831:4:1284306:183", "request_id": "1243831:4:1284306:183", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1243831", "t_dispatch_unix": 1779818607.0637589, "t_finish_unix": 1779818607.8659952, "t_first_token_unix": 1779818607.443605, "tpot_s": 0.00555428694765157, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 12778587], "trace_timestamp_s": 162.09900000000016, "ttft_s": 0.37984416499966756, "turn_id": 4} +{"actual_output_tokens": 288, "cached_tokens": 72016, "effective_input_length": 130532, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130532, "latency_s": 62.94361801201012, "output_length": 288, "proxy_request_id": "1356885:4:1512902:931", "request_id": "1356885:4:1512902:931", "request_type": "coder", "requested_output_tokens": 288, "session_id": "1356885", "t_dispatch_unix": 1779818545.0677683, "t_finish_unix": 1779818608.011386, "t_first_token_unix": 1779818581.665757, "tpot_s": 0.09179568032751133, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770], "trace_timestamp_s": 951.308, "ttft_s": 36.59798604605021, "turn_id": 4} +{"actual_output_tokens": 81, "cached_tokens": 14576, "effective_input_length": 14627, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14627, "latency_s": 0.507984141993802, "output_length": 81, "proxy_request_id": "1243831:5:1303288:273", "request_id": "1243831:5:1303288:273", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1243831", "t_dispatch_unix": 1779818607.8667934, "t_finish_unix": 1779818608.3747776, "t_first_token_unix": 1779818607.9257183, "tpot_s": 0.005609849387110444, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 12959828], "trace_timestamp_s": 227.3050000000003, "ttft_s": 0.05892232799669728, "turn_id": 5} +{"actual_output_tokens": 284, "cached_tokens": 44400, "effective_input_length": 45851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45851, "latency_s": 4.414394947991241, "output_length": 284, "proxy_request_id": "1277428:10:1517408:935", "request_id": "1277428:10:1517408:935", "request_type": "coder", "requested_output_tokens": 284, "session_id": "1277428", "t_dispatch_unix": 1779818603.9698772, "t_finish_unix": 1779818608.3842723, "t_first_token_unix": 1779818604.5179322, "tpot_s": 0.013661234837449928, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14951061], "trace_timestamp_s": 966.2420000000002, "ttft_s": 0.5480526619940065, "turn_id": 10} +{"actual_output_tokens": 57, "cached_tokens": 46128, "effective_input_length": 46361, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46361, "latency_s": 0.5654286749777384, "output_length": 57, "proxy_request_id": "1277428:11:1520449:937", "request_id": "1277428:11:1520449:937", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1277428", "t_dispatch_unix": 1779818608.3865883, "t_finish_unix": 1779818608.9520168, "t_first_token_unix": 1779818608.5670547, "tpot_s": 0.006869389964517073, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 14979348], "trace_timestamp_s": 976.2290000000003, "ttft_s": 0.18046413297997788, "turn_id": 11} +{"actual_output_tokens": 80, "cached_tokens": 14704, "effective_input_length": 17410, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17410, "latency_s": 0.8714865219662897, "output_length": 80, "proxy_request_id": "1243831:6:1313694:320", "request_id": "1243831:6:1313694:320", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1243831", "t_dispatch_unix": 1779818608.377038, "t_finish_unix": 1779818609.2485244, "t_first_token_unix": 1779818608.7986238, "tpot_s": 0.005691525265515511, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13056746], "trace_timestamp_s": 264.14500000000044, "ttft_s": 0.421584066003561, "turn_id": 6} +{"actual_output_tokens": 103, "cached_tokens": 17488, "effective_input_length": 19460, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19460, "latency_s": 0.9838289209874347, "output_length": 103, "proxy_request_id": "1243831:7:1323865:366", "request_id": "1243831:7:1323865:366", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1243831", "t_dispatch_unix": 1779818609.250426, "t_finish_unix": 1779818610.2342548, "t_first_token_unix": 1779818609.637453, "tpot_s": 0.005848247077950623, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13151112], "trace_timestamp_s": 300.0500000000002, "ttft_s": 0.38702508102869615, "turn_id": 7} +{"actual_output_tokens": 111, "cached_tokens": 19552, "effective_input_length": 24512, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24512, "latency_s": 1.5505780359962955, "output_length": 111, "proxy_request_id": "1243831:8:1333049:414", "request_id": "1243831:8:1333049:414", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1243831", "t_dispatch_unix": 1779818610.237087, "t_finish_unix": 1779818611.7876654, "t_first_token_unix": 1779818611.1176546, "tpot_s": 0.0060884769640820605, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173], "trace_timestamp_s": 332.8090000000002, "ttft_s": 0.8805652259616181, "turn_id": 8} +{"actual_output_tokens": 67, "cached_tokens": 24608, "effective_input_length": 25075, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25075, "latency_s": 0.5724246960016899, "output_length": 67, "proxy_request_id": "1243831:9:1348240:478", "request_id": "1243831:9:1348240:478", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1243831", "t_dispatch_unix": 1779818611.78912, "t_finish_unix": 1779818612.3615441, "t_first_token_unix": 1779818611.9610531, "tpot_s": 0.006063912151148543, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884], "trace_timestamp_s": 385.9180000000006, "ttft_s": 0.17193132400279865, "turn_id": 9} +{"actual_output_tokens": 112, "cached_tokens": 25136, "effective_input_length": 26343, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26343, "latency_s": 0.9846795119810849, "output_length": 112, "proxy_request_id": "1243831:10:1358921:521", "request_id": "1243831:10:1358921:521", "request_type": "coder", "requested_output_tokens": 112, "session_id": "1243831", "t_dispatch_unix": 1779818612.3631198, "t_finish_unix": 1779818613.3477998, "t_first_token_unix": 1779818612.6598504, "tpot_s": 0.006195017666795064, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13476530], "trace_timestamp_s": 423.28400000000056, "ttft_s": 0.296727943001315, "turn_id": 10} +{"actual_output_tokens": 75, "cached_tokens": 26448, "effective_input_length": 26818, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26818, "latency_s": 0.6251372810220346, "output_length": 75, "proxy_request_id": "1243831:11:1371191:594", "request_id": "1243831:11:1371191:594", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1243831", "t_dispatch_unix": 1779818613.3494773, "t_finish_unix": 1779818613.9746144, "t_first_token_unix": 1779818613.5246925, "tpot_s": 0.006076376783705593, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13591639], "trace_timestamp_s": 466.35400000000027, "ttft_s": 0.1752137160510756, "turn_id": 11} +{"actual_output_tokens": 66, "cached_tokens": 26880, "effective_input_length": 27164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27164, "latency_s": 0.5275070689967833, "output_length": 66, "proxy_request_id": "1243831:12:1385174:681", "request_id": "1243831:12:1385174:681", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1243831", "t_dispatch_unix": 1779818613.976429, "t_finish_unix": 1779818614.5039363, "t_first_token_unix": 1779818614.104413, "tpot_s": 0.006142640523075198, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13718858], "trace_timestamp_s": 515.2120000000004, "ttft_s": 0.12798207497689873, "turn_id": 12} +{"actual_output_tokens": 85, "cached_tokens": 27216, "effective_input_length": 27286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27286, "latency_s": 0.6087922389851883, "output_length": 85, "proxy_request_id": "1243831:13:1398072:738", "request_id": "1243831:13:1398072:738", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1243831", "t_dispatch_unix": 1779818614.5051043, "t_finish_unix": 1779818615.1138966, "t_first_token_unix": 1779818614.593104, "tpot_s": 0.006197237511514686, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13836022], "trace_timestamp_s": 560.7880000000005, "ttft_s": 0.08799760701367632, "turn_id": 13} +{"actual_output_tokens": 85, "cached_tokens": 27360, "effective_input_length": 28085, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28085, "latency_s": 0.7660318609559909, "output_length": 85, "proxy_request_id": "1243831:14:1411189:814", "request_id": "1243831:14:1411189:814", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1243831", "t_dispatch_unix": 1779818615.1152678, "t_finish_unix": 1779818615.8813, "t_first_token_unix": 1779818615.3577921, "tpot_s": 0.006229306833120063, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434], "trace_timestamp_s": 606.2490000000007, "ttft_s": 0.24252213299041614, "turn_id": 14} +{"actual_output_tokens": 187, "cached_tokens": 130816, "effective_input_length": 130906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130906, "latency_s": 2.4489688409958035, "output_length": 187, "proxy_request_id": "1356885:5:1533696:948", "request_id": "1356885:5:1533696:948", "request_type": "coder", "requested_output_tokens": 187, "session_id": "1356885", "t_dispatch_unix": 1779818614.5532558, "t_finish_unix": 1779818617.0022247, "t_first_token_unix": 1779818614.8456483, "tpot_s": 0.011593231801143897, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124], "trace_timestamp_s": 1020.7970000000005, "ttft_s": 0.29239049897296354, "turn_id": 5} +{"actual_output_tokens": 133, "cached_tokens": 28160, "effective_input_length": 29382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29382, "latency_s": 1.1714663190068677, "output_length": 133, "proxy_request_id": "1243831:15:1427593:849", "request_id": "1243831:15:1427593:849", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1243831", "t_dispatch_unix": 1779818615.8829377, "t_finish_unix": 1779818617.0544038, "t_first_token_unix": 1779818616.2061286, "tpot_s": 0.006424753810279071, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14104163], "trace_timestamp_s": 664.1060000000007, "ttft_s": 0.3231886330177076, "turn_id": 15} +{"actual_output_tokens": 68, "cached_tokens": 29504, "effective_input_length": 29571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29571, "latency_s": 0.5129692649934441, "output_length": 68, "proxy_request_id": "1243831:16:1446717:874", "request_id": "1243831:16:1446717:874", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1243831", "t_dispatch_unix": 1779818617.055684, "t_finish_unix": 1779818617.5686536, "t_first_token_unix": 1779818617.1489913, "tpot_s": 0.006259699014133649, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14283881], "trace_timestamp_s": 729.4750000000004, "ttft_s": 0.09330486401449889, "turn_id": 16} +{"actual_output_tokens": 662, "cached_tokens": 65520, "effective_input_length": 139357, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 139357, "latency_s": 58.27024005301064, "output_length": 662, "proxy_request_id": "1313181:14:1351342:491", "request_id": "1313181:14:1351342:491", "request_type": "coder", "requested_output_tokens": 662, "session_id": "1313181", "t_dispatch_unix": 1779818562.592762, "t_finish_unix": 1779818620.863002, "t_first_token_unix": 1779818608.840135, "tpot_s": 0.018187502546147153, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182, 13385557, 13385558, 13407607, 13407608, 13407609, 13407610, 13407611, 13407612, 13407613, 13407614, 13407615, 13407616, 13407617, 13407618, 13407619, 13407620, 13407621, 13407622], "trace_timestamp_s": 396.7470000000003, "ttft_s": 46.24737004702911, "turn_id": 14} +{"actual_output_tokens": 314, "cached_tokens": 64176, "effective_input_length": 71987, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71987, "latency_s": 9.576416700962, "output_length": 314, "proxy_request_id": "1294611:15:1533841:949", "request_id": "1294611:15:1533841:949", "request_type": "coder", "requested_output_tokens": 314, "session_id": "1294611", "t_dispatch_unix": 1779818615.0258443, "t_finish_unix": 1779818624.602261, "t_first_token_unix": 1779818620.1261156, "tpot_s": 0.014299738472669769, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15109253, 15109254, 15109255, 15109256, 15109257, 15109258, 15109259, 15109260, 15109261, 15109262, 15109263, 15109264, 15109265, 15109266, 15109267, 15109268, 15109269], "trace_timestamp_s": 1021.2700000000004, "ttft_s": 5.1002689430024475, "turn_id": 15} +{"actual_output_tokens": 350, "cached_tokens": 65872, "effective_input_length": 65876, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65876, "latency_s": 5.0339258589665405, "output_length": 350, "proxy_request_id": "1313181:14:1408792:803", "request_id": "1313181:14:1408792:803", "request_type": "coder", "requested_output_tokens": 350, "session_id": "1313181", "t_dispatch_unix": 1779818620.8673794, "t_finish_unix": 1779818625.9013054, "t_first_token_unix": 1779818620.99754, "tpot_s": 0.014050229077452906, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13934257, 13934258], "trace_timestamp_s": 598.0260000000007, "ttft_s": 0.13015598995843902, "turn_id": 14} +{"actual_output_tokens": 382, "cached_tokens": 66224, "effective_input_length": 66259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66259, "latency_s": 5.536129219981376, "output_length": 382, "proxy_request_id": "1313181:15:1411723:818", "request_id": "1313181:15:1411723:818", "request_type": "coder", "requested_output_tokens": 382, "session_id": "1313181", "t_dispatch_unix": 1779818625.904557, "t_finish_unix": 1779818631.4406862, "t_first_token_unix": 1779818626.080295, "tpot_s": 0.014068300081380299, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13934257, 13934258, 13960252], "trace_timestamp_s": 608.4310000000005, "ttft_s": 0.1757356299785897, "turn_id": 15} +{"actual_output_tokens": 1497, "cached_tokens": 0, "effective_input_length": 87576, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87576, "latency_s": 45.20487968099769, "output_length": 1497, "proxy_request_id": "1253804:7:1526643:940", "request_id": "1253804:7:1526643:940", "request_type": "coder", "requested_output_tokens": 1497, "session_id": "1253804", "t_dispatch_unix": 1779818591.0105119, "t_finish_unix": 1779818636.2153914, "t_first_token_unix": 1779818616.7220109, "tpot_s": 0.013030163338890344, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15040216], "trace_timestamp_s": 997.2470000000003, "ttft_s": 25.711496750998776, "turn_id": 7} +{"actual_output_tokens": 48, "cached_tokens": 89072, "effective_input_length": 89116, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89116, "latency_s": 0.5685731279663742, "output_length": 48, "proxy_request_id": "1253804:8:1541192:953", "request_id": "1253804:8:1541192:953", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1253804", "t_dispatch_unix": 1779818639.4958415, "t_finish_unix": 1779818640.0644145, "t_first_token_unix": 1779818639.669827, "tpot_s": 0.008388918085132745, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15182013], "trace_timestamp_s": 1045.741, "ttft_s": 0.17398354096803814, "turn_id": 8} +{"actual_output_tokens": 165, "cached_tokens": 71312, "effective_input_length": 75693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75693, "latency_s": 3.639849803003017, "output_length": 165, "proxy_request_id": "1268861:17:1540278:951", "request_id": "1268861:17:1540278:951", "request_type": "coder", "requested_output_tokens": 165, "session_id": "1268861", "t_dispatch_unix": 1779818636.4318185, "t_finish_unix": 1779818640.071668, "t_first_token_unix": 1779818638.6483934, "tpot_s": 0.008677000695237571, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15173450], "trace_timestamp_s": 1042.6770000000006, "ttft_s": 2.216572549950797, "turn_id": 17} +{"actual_output_tokens": 76, "cached_tokens": 18592, "effective_input_length": 20031, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20031, "latency_s": 0.9231811619829386, "output_length": 76, "proxy_request_id": "1399948:23:1544108:954", "request_id": "1399948:23:1544108:954", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1399948", "t_dispatch_unix": 1779818648.9504123, "t_finish_unix": 1779818649.8735933, "t_first_token_unix": 1779818649.2521224, "tpot_s": 0.00828142420000707, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15209349], "trace_timestamp_s": 1055.1980000000003, "ttft_s": 0.30170841998187825, "turn_id": 23} +{"actual_output_tokens": 3516, "cached_tokens": 89776, "effective_input_length": 89790, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89790, "latency_s": 90.43406392395264, "output_length": 3516, "proxy_request_id": "1363943:31:1509815:929", "request_id": "1363943:31:1509815:929", "request_type": "coder", "requested_output_tokens": 3516, "session_id": "1363943", "t_dispatch_unix": 1779818560.8711073, "t_finish_unix": 1779818651.3051715, "t_first_token_unix": 1779818561.0310173, "tpot_s": 0.025682415135133915, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 14877475], "trace_timestamp_s": 940.9880000000003, "ttft_s": 0.15990693896310404, "turn_id": 31} +{"actual_output_tokens": 196, "cached_tokens": 93296, "effective_input_length": 93368, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93368, "latency_s": 2.134011195972562, "output_length": 196, "proxy_request_id": "1363943:32:1537767:950", "request_id": "1363943:32:1537767:950", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1363943", "t_dispatch_unix": 1779818651.3122618, "t_finish_unix": 1779818653.446273, "t_first_token_unix": 1779818651.5516045, "tpot_s": 0.009715037651431675, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 15147439, 15147440, 15147441, 15147442, 15147443, 15147444, 15147445, 15147446], "trace_timestamp_s": 1034.5930000000008, "ttft_s": 0.23934032797114924, "turn_id": 32} +{"actual_output_tokens": 45, "cached_tokens": 20096, "effective_input_length": 21809, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21809, "latency_s": 0.730496040021535, "output_length": 45, "proxy_request_id": "1399948:24:1546940:955", "request_id": "1399948:24:1546940:955", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779818658.3967202, "t_finish_unix": 1779818659.127216, "t_first_token_unix": 1779818658.7533758, "tpot_s": 0.00847993293163282, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15237108], "trace_timestamp_s": 1064.6450000000004, "ttft_s": 0.3566539990133606, "turn_id": 24} +{"actual_output_tokens": 643, "cached_tokens": 93552, "effective_input_length": 93596, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93596, "latency_s": 6.591557541047223, "output_length": 643, "proxy_request_id": "1363943:33:1541065:952", "request_id": "1363943:33:1541065:952", "request_type": "coder", "requested_output_tokens": 643, "session_id": "1363943", "t_dispatch_unix": 1779818653.450643, "t_finish_unix": 1779818660.0422003, "t_first_token_unix": 1779818653.6309965, "tpot_s": 0.009985927202520497, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 15147439, 15147440, 15147441, 15147442, 15147443, 15147444, 15147445, 15180688], "trace_timestamp_s": 1045.3250000000007, "ttft_s": 0.18035107402829453, "turn_id": 33} +{"actual_output_tokens": 7535, "cached_tokens": 29632, "effective_input_length": 31161, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31161, "latency_s": 53.02207200002158, "output_length": 7535, "proxy_request_id": "1243831:17:1453633:883", "request_id": "1243831:17:1453633:883", "request_type": "coder", "requested_output_tokens": 7535, "session_id": "1243831", "t_dispatch_unix": 1779818617.5702815, "t_finish_unix": 1779818670.592354, "t_first_token_unix": 1779818617.9746485, "tpot_s": 0.006983991494953122, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14283881, 14347482, 14347483, 14347484], "trace_timestamp_s": 752.9440000000004, "ttft_s": 0.40436464600497857, "turn_id": 17} +{"actual_output_tokens": 92, "cached_tokens": 21840, "effective_input_length": 22250, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22250, "latency_s": 0.6958457890432328, "output_length": 92, "proxy_request_id": "1399948:25:1553234:957", "request_id": "1399948:25:1553234:957", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1399948", "t_dispatch_unix": 1779818678.9314942, "t_finish_unix": 1779818679.62734, "t_first_token_unix": 1779818679.0900354, "tpot_s": 0.005901773077062239, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15296678], "trace_timestamp_s": 1085.179, "ttft_s": 0.15853954601334408, "turn_id": 25} +{"actual_output_tokens": 117, "cached_tokens": 75856, "effective_input_length": 76017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76017, "latency_s": 1.278837462014053, "output_length": 117, "proxy_request_id": "1268861:18:1553083:956", "request_id": "1268861:18:1553083:956", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1268861", "t_dispatch_unix": 1779818678.4902773, "t_finish_unix": 1779818679.769115, "t_first_token_unix": 1779818678.7650974, "tpot_s": 0.008652705681140953, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15295378], "trace_timestamp_s": 1084.7290000000003, "ttft_s": 0.2748174470034428, "turn_id": 18} +{"actual_output_tokens": 49, "cached_tokens": 22336, "effective_input_length": 23042, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23042, "latency_s": 0.49379404896171764, "output_length": 49, "proxy_request_id": "1399948:26:1557859:959", "request_id": "1399948:26:1557859:959", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1399948", "t_dispatch_unix": 1779818694.887931, "t_finish_unix": 1779818695.3817246, "t_first_token_unix": 1779818695.1026535, "tpot_s": 0.005807911979597217, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15340884], "trace_timestamp_s": 1101.1350000000002, "ttft_s": 0.21472010895377025, "turn_id": 26} +{"actual_output_tokens": 156, "cached_tokens": 23088, "effective_input_length": 24139, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24139, "latency_s": 1.2224739930243231, "output_length": 156, "proxy_request_id": "1399948:27:1559017:960", "request_id": "1399948:27:1559017:960", "request_type": "coder", "requested_output_tokens": 156, "session_id": "1399948", "t_dispatch_unix": 1779818698.5563157, "t_finish_unix": 1779818699.7787893, "t_first_token_unix": 1779818698.8313947, "tpot_s": 0.0061103752130762705, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15352258], "trace_timestamp_s": 1104.8010000000004, "ttft_s": 0.27507655101362616, "turn_id": 27} +{"actual_output_tokens": 205, "cached_tokens": 24288, "effective_input_length": 24386, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24386, "latency_s": 1.3488031739834696, "output_length": 205, "proxy_request_id": "1399948:28:1560859:961", "request_id": "1399948:28:1560859:961", "request_type": "coder", "requested_output_tokens": 205, "session_id": "1399948", "t_dispatch_unix": 1779818704.6834228, "t_finish_unix": 1779818706.0322258, "t_first_token_unix": 1779818704.7788491, "tpot_s": 0.006142484058692193, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15369258], "trace_timestamp_s": 1110.929, "ttft_s": 0.0954240650171414, "turn_id": 28} +{"actual_output_tokens": 45, "cached_tokens": 24576, "effective_input_length": 28781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28781, "latency_s": 1.157509315002244, "output_length": 45, "proxy_request_id": "1399948:29:1571125:963", "request_id": "1399948:29:1571125:963", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779818738.5502443, "t_finish_unix": 1779818739.7077532, "t_first_token_unix": 1779818739.446696, "tpot_s": 0.0059274277499009095, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15466683], "trace_timestamp_s": 1144.795, "ttft_s": 0.896449632011354, "turn_id": 29} +{"actual_output_tokens": 184, "cached_tokens": 131088, "effective_input_length": 131413, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131413, "latency_s": 2.818217749008909, "output_length": 184, "proxy_request_id": "1356885:6:1570780:962", "request_id": "1356885:6:1570780:962", "request_type": "coder", "requested_output_tokens": 184, "session_id": "1356885", "t_dispatch_unix": 1779818737.5114505, "t_finish_unix": 1779818740.329668, "t_first_token_unix": 1779818738.1908054, "tpot_s": 0.011686335005441202, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784], "trace_timestamp_s": 1143.7480000000005, "ttft_s": 0.6793524469831027, "turn_id": 6} +{"actual_output_tokens": 46, "cached_tokens": 108336, "effective_input_length": 109083, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109083, "latency_s": 1.8160141510306858, "output_length": 46, "proxy_request_id": "1270606:4:1578042:965", "request_id": "1270606:4:1578042:965", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1270606", "t_dispatch_unix": 1779818762.1631289, "t_finish_unix": 1779818763.9791424, "t_first_token_unix": 1779818762.944038, "tpot_s": 0.022996838133419968, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 15532602, 15532603, 15532604, 15532605, 15532606, 15532607, 15532608, 15532609, 15532610, 15532611, 15532612, 15532613, 15532614, 15532615, 15532616, 15532617, 15532618, 15532619, 15532620, 15532621, 15532622, 15532623, 15532624, 15532625, 15532626, 15532627, 15532628, 15532629, 15532630, 15532631, 15532632, 15532633, 15532634, 15532635, 15532636, 15532637, 15532638, 15532639, 15532640, 15532641, 15532642, 15532643, 15532644, 15532645, 15532646, 15532647, 15532648, 15532649, 15532650, 15532651, 15532652, 15532653, 15532654, 15532655, 15532656, 15532657, 15532658, 15532659, 15532660, 15532661, 15532662, 15532663, 15532664, 15532665, 15532666, 15532667, 15532668, 15532669, 15532670, 15532671, 15532672, 15532673, 15532674, 15532675, 15532676, 15532677, 15532678, 15532679, 15532680, 15532681, 15532682, 15532683, 15532684, 15532685, 15532686, 15532687, 15532688, 15532689, 15532690, 15532691, 15532692, 15532693, 15532694, 15532695, 15532696, 15532697, 15532698, 15532699, 15532700, 15532701, 15532702, 15532703, 15532704, 15532705, 15532706, 15532707, 15532708, 15532709, 15532710, 15532711, 15532712, 15532713, 15532714, 15532715], "trace_timestamp_s": 1168.3640000000005, "ttft_s": 0.780905686027836, "turn_id": 4} +{"actual_output_tokens": 89, "cached_tokens": 76128, "effective_input_length": 76963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76963, "latency_s": 1.9950270210392773, "output_length": 89, "proxy_request_id": "1268861:19:1578134:966", "request_id": "1268861:19:1578134:966", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1268861", "t_dispatch_unix": 1779818762.3943846, "t_finish_unix": 1779818764.3894117, "t_first_token_unix": 1779818763.4027443, "tpot_s": 0.011209546090950344, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15533477], "trace_timestamp_s": 1168.6400000000003, "ttft_s": 1.0083574349991977, "turn_id": 19} +{"actual_output_tokens": 49, "cached_tokens": 28816, "effective_input_length": 30773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30773, "latency_s": 0.8155401119729504, "output_length": 49, "proxy_request_id": "1399948:30:1578524:967", "request_id": "1399948:30:1578524:967", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1399948", "t_dispatch_unix": 1779818763.738859, "t_finish_unix": 1779818764.554399, "t_first_token_unix": 1779818764.2606711, "tpot_s": 0.006114755563127498, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15536842], "trace_timestamp_s": 1169.9860000000008, "ttft_s": 0.5218106349930167, "turn_id": 30} +{"actual_output_tokens": 203, "cached_tokens": 30816, "effective_input_length": 30925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30925, "latency_s": 1.4288120479905047, "output_length": 203, "proxy_request_id": "1399948:31:1579418:968", "request_id": "1399948:31:1579418:968", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1399948", "t_dispatch_unix": 1779818766.9647229, "t_finish_unix": 1779818768.393535, "t_first_token_unix": 1779818767.0741217, "tpot_s": 0.00653054957920086, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15544685], "trace_timestamp_s": 1173.21, "ttft_s": 0.10939680697629228, "turn_id": 31} +{"actual_output_tokens": 170, "cached_tokens": 131584, "effective_input_length": 131775, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131775, "latency_s": 2.4191044599865563, "output_length": 170, "proxy_request_id": "1356885:7:1580925:969", "request_id": "1356885:7:1580925:969", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1356885", "t_dispatch_unix": 1779818772.265467, "t_finish_unix": 1779818774.684571, "t_first_token_unix": 1779818772.7107525, "tpot_s": 0.01167760758568428, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 15560627], "trace_timestamp_s": 1178.5070000000005, "ttft_s": 0.4452836239943281, "turn_id": 7} +{"actual_output_tokens": 154, "cached_tokens": 31120, "effective_input_length": 31231, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31231, "latency_s": 1.1049892979790457, "output_length": 154, "proxy_request_id": "1399948:32:1581424:970", "request_id": "1399948:32:1581424:970", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1399948", "t_dispatch_unix": 1779818773.715797, "t_finish_unix": 1779818774.8207865, "t_first_token_unix": 1779818773.8278713, "tpot_s": 0.006487652653709566, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283], "trace_timestamp_s": 1179.964, "ttft_s": 0.1120723009807989, "turn_id": 32} +{"actual_output_tokens": 260, "cached_tokens": 109120, "effective_input_length": 111387, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111387, "latency_s": 4.577558039978612, "output_length": 260, "proxy_request_id": "1270606:5:1581455:971", "request_id": "1270606:5:1581455:971", "request_type": "coder", "requested_output_tokens": 260, "session_id": "1270606", "t_dispatch_unix": 1779818773.8666625, "t_finish_unix": 1779818778.4442203, "t_first_token_unix": 1779818775.653821, "tpot_s": 0.010772802347621187, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 15532602, 15565484, 15565485, 15565486, 15565487, 15565488, 15565489, 15565490, 15565491, 15565492, 15565493, 15565494, 15565495, 15565496, 15565497, 15565498, 15565499, 15565500, 15565501, 15565502, 15565503, 15565504, 15565505, 15565506, 15565507, 15565508, 15565509, 15565510, 15565511, 15565512, 15565513, 15565514, 15565515, 15565516, 15565517, 15565518, 15565519, 15565520, 15565521, 15565522, 15565523, 15565524, 15565525, 15565526, 15565527, 15565528, 15565529, 15565530, 15565531, 15565532, 15565533, 15565534, 15565535, 15565536, 15565537, 15565538, 15565539, 15565540, 15565541, 15565542, 15565543, 15565544, 15565545, 15565546, 15565547, 15565548, 15565549, 15565550, 15565551, 15565552, 15565553, 15565554, 15565555, 15565556, 15565557, 15565558, 15565559, 15565560, 15565561, 15565562, 15565563, 15565564, 15565565, 15565566, 15565567, 15565568, 15565569, 15565570, 15565571, 15565572, 15565573, 15565574, 15565575, 15565576, 15565577, 15565578, 15565579, 15565580, 15565581, 15565582, 15565583, 15565584, 15565585, 15565586, 15565587, 15565588, 15565589, 15565590, 15565591, 15565592, 15565593, 15565594, 15565595, 15565596, 15565597, 15565598, 15565599, 15565600], "trace_timestamp_s": 1180.0900000000001, "ttft_s": 1.7871546549722552, "turn_id": 5} +{"actual_output_tokens": 102, "cached_tokens": 31376, "effective_input_length": 31445, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31445, "latency_s": 0.7481721290387213, "output_length": 102, "proxy_request_id": "1399948:33:1583165:972", "request_id": "1399948:33:1583165:972", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1399948", "t_dispatch_unix": 1779818779.6220295, "t_finish_unix": 1779818780.3702016, "t_first_token_unix": 1779818779.7244217, "tpot_s": 0.006391452831714091, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15583196], "trace_timestamp_s": 1185.8700000000008, "ttft_s": 0.10238996002590284, "turn_id": 33} +{"actual_output_tokens": 84, "cached_tokens": 46416, "effective_input_length": 47660, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47660, "latency_s": 1.0744046089821495, "output_length": 84, "proxy_request_id": "1277428:12:1586139:973", "request_id": "1277428:12:1586139:973", "request_type": "coder", "requested_output_tokens": 84, "session_id": "1277428", "t_dispatch_unix": 1779818789.762334, "t_finish_unix": 1779818790.836738, "t_first_token_unix": 1779818790.2455378, "tpot_s": 0.007119898795829076, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 15609252, 15609253, 15609254, 15609255], "trace_timestamp_s": 1196.0, "ttft_s": 0.48320229997625574, "turn_id": 12} +{"actual_output_tokens": 136, "cached_tokens": 31536, "effective_input_length": 32143, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32143, "latency_s": 1.110505141026806, "output_length": 136, "proxy_request_id": "1399948:34:1586232:974", "request_id": "1399948:34:1586232:974", "request_type": "coder", "requested_output_tokens": 136, "session_id": "1399948", "t_dispatch_unix": 1779818790.1143272, "t_finish_unix": 1779818791.224832, "t_first_token_unix": 1779818790.3376215, "tpot_s": 0.006570065785113171, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15610086], "trace_timestamp_s": 1196.362, "ttft_s": 0.22329256002558395, "turn_id": 34} +{"actual_output_tokens": 302, "cached_tokens": 72288, "effective_input_length": 75249, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75249, "latency_s": 4.227071715053171, "output_length": 302, "proxy_request_id": "1294611:15:1590202:975", "request_id": "1294611:15:1590202:975", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1294611", "t_dispatch_unix": 1779818803.3048916, "t_finish_unix": 1779818807.5319633, "t_first_token_unix": 1779818804.8548017, "tpot_s": 0.008893263308900683, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15647388, 15647389, 15647390, 15647391, 15647392, 15647393, 15647394, 15647395, 15647396, 15647397, 15647398, 15647399, 15647400, 15647401, 15647402, 15647403, 15647404, 15647405, 15647406, 15647407, 15647408, 15647409, 15647410], "trace_timestamp_s": 1209.5380000000005, "ttft_s": 1.5499073010287248, "turn_id": 15} +{"actual_output_tokens": 202, "cached_tokens": 47728, "effective_input_length": 49316, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49316, "latency_s": 2.167472924978938, "output_length": 202, "proxy_request_id": "1277428:13:1593499:976", "request_id": "1277428:13:1593499:976", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1277428", "t_dispatch_unix": 1779818814.9433613, "t_finish_unix": 1779818817.1108336, "t_first_token_unix": 1779818815.6117494, "tpot_s": 0.0074568301345458, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 15609252, 15609253, 15609254, 15678100, 15678101, 15678102, 15678103], "trace_timestamp_s": 1221.1850000000004, "ttft_s": 0.6683846789528616, "turn_id": 13} +{"actual_output_tokens": 127, "cached_tokens": 75536, "effective_input_length": 75584, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75584, "latency_s": 1.2430501459748484, "output_length": 127, "proxy_request_id": "1294611:15:1594038:977", "request_id": "1294611:15:1594038:977", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1294611", "t_dispatch_unix": 1779818816.66057, "t_finish_unix": 1779818817.9036198, "t_first_token_unix": 1779818816.8123918, "tpot_s": 0.008657857658810884, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15684252, 15684253, 15684254, 15684255, 15684256, 15684257, 15684258, 15684259, 15684260, 15684261, 15684262, 15684263, 15684264, 15684265, 15684266, 15684267, 15684268, 15684269, 15684270, 15684271, 15684272, 15684273, 15684274, 15684275], "trace_timestamp_s": 1222.902, "ttft_s": 0.15181927394587547, "turn_id": 15} +{"actual_output_tokens": 63, "cached_tokens": 77040, "effective_input_length": 77218, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77218, "latency_s": 0.7857997600222006, "output_length": 63, "proxy_request_id": "1268861:20:1595141:978", "request_id": "1268861:20:1595141:978", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1268861", "t_dispatch_unix": 1779818820.6390188, "t_finish_unix": 1779818821.4248183, "t_first_token_unix": 1779818820.9150114, "tpot_s": 0.00821772427392012, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15693702], "trace_timestamp_s": 1226.8830000000007, "ttft_s": 0.2759903350379318, "turn_id": 20} +{"actual_output_tokens": 153, "cached_tokens": 32272, "effective_input_length": 33533, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33533, "latency_s": 1.433590271975845, "output_length": 153, "proxy_request_id": "1399948:35:1602048:980", "request_id": "1399948:35:1602048:980", "request_type": "coder", "requested_output_tokens": 153, "session_id": "1399948", "t_dispatch_unix": 1779818844.0184577, "t_finish_unix": 1779818845.4520469, "t_first_token_unix": 1779818844.4397202, "tpot_s": 0.0066565131840577935, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15759381], "trace_timestamp_s": 1250.2640000000001, "ttft_s": 0.4212617179728113, "turn_id": 35} +{"actual_output_tokens": 365, "cached_tokens": 89152, "effective_input_length": 90656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90656, "latency_s": 6.235621237021405, "output_length": 365, "proxy_request_id": "1253804:9:1605110:981", "request_id": "1253804:9:1605110:981", "request_type": "coder", "requested_output_tokens": 365, "session_id": "1253804", "t_dispatch_unix": 1779818854.0000908, "t_finish_unix": 1779818860.2357116, "t_first_token_unix": 1779818854.9955704, "tpot_s": 0.01439517699719335, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15786880], "trace_timestamp_s": 1260.2450000000008, "ttft_s": 0.995477432035841, "turn_id": 9} +{"actual_output_tokens": 4115, "cached_tokens": 75696, "effective_input_length": 75716, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75716, "latency_s": 40.949991189001594, "output_length": 4115, "proxy_request_id": "1294611:15:1596163:979", "request_id": "1294611:15:1596163:979", "request_type": "coder", "requested_output_tokens": 4115, "session_id": "1294611", "t_dispatch_unix": 1779818823.82436, "t_finish_unix": 1779818864.7743504, "t_first_token_unix": 1779818823.9682262, "tpot_s": 0.009918709906670082, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15703736, 15703737, 15703738, 15703739, 15703740, 15703741, 15703742, 15703743, 15703744, 15703745, 15703746, 15703747, 15703748, 15703749, 15703750, 15703751, 15703752, 15703753, 15703754, 15703755, 15703756, 15703757, 15703758, 15703759], "trace_timestamp_s": 1230.063, "ttft_s": 0.14386432198807597, "turn_id": 15} +{"actual_output_tokens": 178, "cached_tokens": 77280, "effective_input_length": 77293, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77293, "latency_s": 1.7044201110256836, "output_length": 178, "proxy_request_id": "1268861:21:1609831:982", "request_id": "1268861:21:1609831:982", "request_type": "coder", "requested_output_tokens": 178, "session_id": "1268861", "t_dispatch_unix": 1779818869.7467866, "t_finish_unix": 1779818871.4512067, "t_first_token_unix": 1779818869.8870323, "tpot_s": 0.008834756666460301, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363], "trace_timestamp_s": 1275.9880000000003, "ttft_s": 0.14022966503398493, "turn_id": 21} +{"actual_output_tokens": 19, "cached_tokens": 91008, "effective_input_length": 91103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91103, "latency_s": 0.31969594600377604, "output_length": 19, "proxy_request_id": "1253804:10:1611505:983", "request_id": "1253804:10:1611505:983", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1253804", "t_dispatch_unix": 1779818875.2240891, "t_finish_unix": 1779818875.5437841, "t_first_token_unix": 1779818875.4308705, "tpot_s": 0.0062586172781367265, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080], "trace_timestamp_s": 1281.4660000000003, "ttft_s": 0.20677957503357902, "turn_id": 10} +{"actual_output_tokens": 83, "cached_tokens": 33680, "effective_input_length": 34773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34773, "latency_s": 0.908687723975163, "output_length": 83, "proxy_request_id": "1399948:36:1612467:984", "request_id": "1399948:36:1612467:984", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1399948", "t_dispatch_unix": 1779818878.336618, "t_finish_unix": 1779818879.2453058, "t_first_token_unix": 1779818878.7069647, "tpot_s": 0.006561219719204507, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946], "trace_timestamp_s": 1284.5810000000001, "ttft_s": 0.37034439598210156, "turn_id": 36} +{"actual_output_tokens": 212, "cached_tokens": 91120, "effective_input_length": 91131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91131, "latency_s": 2.18973827798618, "output_length": 212, "proxy_request_id": "1253804:11:1613030:985", "request_id": "1253804:11:1613030:985", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1253804", "t_dispatch_unix": 1779818880.558306, "t_finish_unix": 1779818882.7480435, "t_first_token_unix": 1779818880.7096581, "tpot_s": 0.009659285061513803, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080], "trace_timestamp_s": 1286.8030000000008, "ttft_s": 0.15135052299592644, "turn_id": 11} +{"actual_output_tokens": 168, "cached_tokens": 34848, "effective_input_length": 35308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35308, "latency_s": 1.3554853399982676, "output_length": 168, "proxy_request_id": "1399948:37:1613628:986", "request_id": "1399948:37:1613628:986", "request_type": "coder", "requested_output_tokens": 168, "session_id": "1399948", "t_dispatch_unix": 1779818882.4112687, "t_finish_unix": 1779818883.7667534, "t_first_token_unix": 1779818882.6402237, "tpot_s": 0.006743502329468928, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752], "trace_timestamp_s": 1288.6590000000006, "ttft_s": 0.22895353200146928, "turn_id": 37} +{"actual_output_tokens": 79, "cached_tokens": 35472, "effective_input_length": 35581, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35581, "latency_s": 0.6327587169944309, "output_length": 79, "proxy_request_id": "1399948:38:1616890:987", "request_id": "1399948:38:1616890:987", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1399948", "t_dispatch_unix": 1779818893.5982902, "t_finish_unix": 1779818894.2310488, "t_first_token_unix": 1779818893.7198691, "tpot_s": 0.006550118807727137, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15894792], "trace_timestamp_s": 1299.8360000000002, "ttft_s": 0.12157695001224056, "turn_id": 38} +{"actual_output_tokens": 68, "cached_tokens": 35648, "effective_input_length": 35682, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35682, "latency_s": 0.519809091987554, "output_length": 68, "proxy_request_id": "1399948:39:1618250:989", "request_id": "1399948:39:1618250:989", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1399948", "t_dispatch_unix": 1779818898.2907748, "t_finish_unix": 1779818898.8105836, "t_first_token_unix": 1779818898.3775256, "tpot_s": 0.0064589651040871865, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15907502], "trace_timestamp_s": 1304.5330000000004, "ttft_s": 0.08674907498061657, "turn_id": 39} +{"actual_output_tokens": 57, "cached_tokens": 35744, "effective_input_length": 35958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35958, "latency_s": 0.5098045750055462, "output_length": 57, "proxy_request_id": "1399948:40:1620970:991", "request_id": "1399948:40:1620970:991", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1399948", "t_dispatch_unix": 1779818907.2765281, "t_finish_unix": 1779818907.7863324, "t_first_token_unix": 1779818907.4302552, "tpot_s": 0.00635379932230405, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 15932234], "trace_timestamp_s": 1313.5230000000001, "ttft_s": 0.15372412896249443, "turn_id": 40} +{"actual_output_tokens": 141, "cached_tokens": 77456, "effective_input_length": 78439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78439, "latency_s": 1.9644076600088738, "output_length": 141, "proxy_request_id": "1268861:22:1620830:990", "request_id": "1268861:22:1620830:990", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1268861", "t_dispatch_unix": 1779818906.8117764, "t_finish_unix": 1779818908.7761836, "t_first_token_unix": 1779818907.5308046, "tpot_s": 0.008893169035686047, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 15930461], "trace_timestamp_s": 1313.0500000000002, "ttft_s": 0.7190264579840004, "turn_id": 22} +{"actual_output_tokens": 35, "cached_tokens": 91328, "effective_input_length": 91389, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91389, "latency_s": 0.48628081899369135, "output_length": 35, "proxy_request_id": "1253804:12:1621957:992", "request_id": "1253804:12:1621957:992", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779818910.7162523, "t_finish_unix": 1779818911.2025328, "t_first_token_unix": 1779818910.9287708, "tpot_s": 0.008043683971182498, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810], "trace_timestamp_s": 1316.96, "ttft_s": 0.2125159070128575, "turn_id": 12} +{"actual_output_tokens": 100, "cached_tokens": 36000, "effective_input_length": 36168, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36168, "latency_s": 0.8089239629916847, "output_length": 100, "proxy_request_id": "1399948:41:1624143:993", "request_id": "1399948:41:1624143:993", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1399948", "t_dispatch_unix": 1779818918.0885763, "t_finish_unix": 1779818918.8975003, "t_first_token_unix": 1779818918.237198, "tpot_s": 0.006666813141576983, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 15963281], "trace_timestamp_s": 1324.3290000000006, "ttft_s": 0.14861919096438214, "turn_id": 41} +{"actual_output_tokens": 105, "cached_tokens": 91408, "effective_input_length": 91440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91440, "latency_s": 1.1380647770129144, "output_length": 105, "proxy_request_id": "1253804:13:1624613:994", "request_id": "1253804:13:1624613:994", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1253804", "t_dispatch_unix": 1779818919.6558478, "t_finish_unix": 1779818920.7939117, "t_first_token_unix": 1779818919.8184645, "tpot_s": 0.00937655614409148, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810], "trace_timestamp_s": 1325.9010000000007, "ttft_s": 0.16261379601201043, "turn_id": 13} +{"actual_output_tokens": 85, "cached_tokens": 91536, "effective_input_length": 92367, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92367, "latency_s": 1.4561962389852852, "output_length": 85, "proxy_request_id": "1253804:14:1626575:995", "request_id": "1253804:14:1626575:995", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1253804", "t_dispatch_unix": 1779818926.1711907, "t_finish_unix": 1779818927.627387, "t_first_token_unix": 1779818926.8423245, "tpot_s": 0.009342735428834289, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 15986054], "trace_timestamp_s": 1332.411, "ttft_s": 0.6711314439889975, "turn_id": 14} +{"actual_output_tokens": 43, "cached_tokens": 92448, "effective_input_length": 92701, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92701, "latency_s": 0.6803924259729683, "output_length": 43, "proxy_request_id": "1253804:15:1628485:997", "request_id": "1253804:15:1628485:997", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1253804", "t_dispatch_unix": 1779818932.4945846, "t_finish_unix": 1779818933.174977, "t_first_token_unix": 1779818932.814055, "tpot_s": 0.008583957285043738, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16004240], "trace_timestamp_s": 1338.7400000000007, "ttft_s": 0.31946799502475187, "turn_id": 15} +{"actual_output_tokens": 175, "cached_tokens": 36256, "effective_input_length": 36984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36984, "latency_s": 1.5026755630387925, "output_length": 175, "proxy_request_id": "1399948:42:1628429:996", "request_id": "1399948:42:1628429:996", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1399948", "t_dispatch_unix": 1779818932.2780387, "t_finish_unix": 1779818933.780714, "t_first_token_unix": 1779818932.5982983, "tpot_s": 0.006793868620598945, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16003843], "trace_timestamp_s": 1338.5230000000001, "ttft_s": 0.32025730703026056, "turn_id": 42} +{"actual_output_tokens": 65, "cached_tokens": 75936, "effective_input_length": 79074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79074, "latency_s": 2.2666732050129212, "output_length": 65, "proxy_request_id": "1388507:3:1629072:998", "request_id": "1388507:3:1629072:998", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1388507", "t_dispatch_unix": 1779818934.5857155, "t_finish_unix": 1779818936.8523865, "t_first_token_unix": 1779818936.3173008, "tpot_s": 0.008352928249223623, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728, 14709792, 14709793, 14709794, 14709795, 14709796, 14709797, 14709798, 16009495, 16009496, 16009497, 16009498, 16009499, 16009500, 16009501], "trace_timestamp_s": 1340.8290000000006, "ttft_s": 1.7315842850366607, "turn_id": 3} +{"actual_output_tokens": 102, "cached_tokens": 92736, "effective_input_length": 92953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92953, "latency_s": 1.2805208130157553, "output_length": 102, "proxy_request_id": "1253804:16:1629713:999", "request_id": "1253804:16:1629713:999", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1253804", "t_dispatch_unix": 1779818936.5445428, "t_finish_unix": 1779818937.825064, "t_first_token_unix": 1779818936.878464, "tpot_s": 0.009367932633515264, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597], "trace_timestamp_s": 1342.79, "ttft_s": 0.3339191179838963, "turn_id": 16} +{"actual_output_tokens": 74, "cached_tokens": 78576, "effective_input_length": 79693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79693, "latency_s": 1.3494738669833168, "output_length": 74, "proxy_request_id": "1268861:23:1631587:1001", "request_id": "1268861:23:1631587:1001", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1268861", "t_dispatch_unix": 1779818942.5446942, "t_finish_unix": 1779818943.8941684, "t_first_token_unix": 1779818943.2757435, "tpot_s": 0.008467484548630524, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16034091], "trace_timestamp_s": 1348.79, "ttft_s": 0.7310467359493487, "turn_id": 23} +{"actual_output_tokens": 81, "cached_tokens": 93040, "effective_input_length": 93219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93219, "latency_s": 1.446085239003878, "output_length": 81, "proxy_request_id": "1253804:17:1631602:1002", "request_id": "1253804:17:1631602:1002", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253804", "t_dispatch_unix": 1779818942.617533, "t_finish_unix": 1779818944.063618, "t_first_token_unix": 1779818942.9405706, "tpot_s": 0.01403442748778616, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16034156], "trace_timestamp_s": 1348.8640000000005, "ttft_s": 0.3230355459963903, "turn_id": 17} +{"actual_output_tokens": 298, "cached_tokens": 79824, "effective_input_length": 79890, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79890, "latency_s": 3.55341455998132, "output_length": 298, "proxy_request_id": "1294611:15:1631116:1000", "request_id": "1294611:15:1631116:1000", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1294611", "t_dispatch_unix": 1779818941.1282933, "t_finish_unix": 1779818944.6817079, "t_first_token_unix": 1779818941.3359747, "tpot_s": 0.011264118350068615, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16029362, 16029363, 16029364, 16029365, 16029366, 16029367, 16029368, 16029369, 16029370, 16029371, 16029372, 16029373, 16029374, 16029375, 16029376, 16029377, 16029378, 16029379, 16029380, 16029381, 16029382, 16029383, 16029384, 16029385, 16029386, 16029387, 16029388, 16029389, 16029390, 16029391, 16029392, 16029393, 16029394], "trace_timestamp_s": 1347.3670000000002, "ttft_s": 0.20767843001522124, "turn_id": 15} +{"actual_output_tokens": 93, "cached_tokens": 93296, "effective_input_length": 93509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93509, "latency_s": 1.1880399269866757, "output_length": 93, "proxy_request_id": "1253804:18:1633257:1003", "request_id": "1253804:18:1633257:1003", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1253804", "t_dispatch_unix": 1779818948.0725744, "t_finish_unix": 1779818949.2606142, "t_first_token_unix": 1779818948.3953695, "tpot_s": 0.009401547010739982, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428], "trace_timestamp_s": 1354.3140000000003, "ttft_s": 0.32279302598908544, "turn_id": 18} +{"actual_output_tokens": 65, "cached_tokens": 80176, "effective_input_length": 80221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80221, "latency_s": 0.9476103750057518, "output_length": 65, "proxy_request_id": "1294611:15:1634779:1004", "request_id": "1294611:15:1634779:1004", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1294611", "t_dispatch_unix": 1779818953.2418468, "t_finish_unix": 1779818954.189457, "t_first_token_unix": 1779818953.4048193, "tpot_s": 0.012254886187292868, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16063555, 15647389, 15647390, 15647391, 15647392, 15647393, 15647394, 15647395, 15647396, 15647397, 15647398, 15647399, 15647400, 15647401, 15647402, 15647403, 15647404, 15647405, 15647406, 15647407, 15647408, 15647409, 15647410, 16063556, 16063557, 16063558, 16063559, 16063560, 16063561, 16063562, 16063563, 16063564, 16063565], "trace_timestamp_s": 1359.4810000000007, "ttft_s": 0.16296978102764115, "turn_id": 15} +{"actual_output_tokens": 399, "cached_tokens": 93600, "effective_input_length": 93664, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93664, "latency_s": 4.329908946005162, "output_length": 399, "proxy_request_id": "1253804:19:1634903:1005", "request_id": "1253804:19:1634903:1005", "request_type": "coder", "requested_output_tokens": 399, "session_id": "1253804", "t_dispatch_unix": 1779818953.6128178, "t_finish_unix": 1779818957.9427264, "t_first_token_unix": 1779818953.8375006, "tpot_s": 0.010313903806577835, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428], "trace_timestamp_s": 1359.8590000000004, "ttft_s": 0.22468038299120963, "turn_id": 19} +{"actual_output_tokens": 87, "cached_tokens": 94048, "effective_input_length": 94111, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 94111, "latency_s": 1.442400875966996, "output_length": 87, "proxy_request_id": "1253804:20:1638889:1007", "request_id": "1253804:20:1638889:1007", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1253804", "t_dispatch_unix": 1779818966.7894156, "t_finish_unix": 1779818968.2318163, "t_first_token_unix": 1779818967.022155, "tpot_s": 0.01406258929095794, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467], "trace_timestamp_s": 1373.0350000000008, "ttft_s": 0.23273692897055298, "turn_id": 20} +{"actual_output_tokens": 285, "cached_tokens": 0, "effective_input_length": 9804, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9804, "latency_s": 2.3119098719907925, "output_length": 285, "proxy_request_id": "1258908:2:1639411:1008", "request_id": "1258908:2:1639411:1008", "request_type": "coder", "requested_output_tokens": 285, "session_id": "1258908", "t_dispatch_unix": 1779818968.6010237, "t_finish_unix": 1779818970.9129338, "t_first_token_unix": 1779818969.3646562, "tpot_s": 0.005450740211248122, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 16107627, 16107628, 16107629, 16107630, 16107631], "trace_timestamp_s": 1374.8490000000002, "ttft_s": 0.7636308490182273, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 79760, "effective_input_length": 80019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80019, "latency_s": 0.729176331020426, "output_length": 55, "proxy_request_id": "1268861:24:1643502:1011", "request_id": "1268861:24:1643502:1011", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1268861", "t_dispatch_unix": 1779818982.418189, "t_finish_unix": 1779818983.1473653, "t_first_token_unix": 1779818982.7067623, "tpot_s": 0.00815316651844316, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16147319, 16147320], "trace_timestamp_s": 1388.6640000000007, "ttft_s": 0.2885715730371885, "turn_id": 24} +{"actual_output_tokens": 115, "cached_tokens": 37152, "effective_input_length": 38102, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38102, "latency_s": 1.166918717965018, "output_length": 115, "proxy_request_id": "1399948:43:1643413:1010", "request_id": "1399948:43:1643413:1010", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1399948", "t_dispatch_unix": 1779818982.0747964, "t_finish_unix": 1779818983.2417152, "t_first_token_unix": 1779818982.477966, "tpot_s": 0.00669703126339683, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16146472], "trace_timestamp_s": 1388.3220000000001, "ttft_s": 0.40316806797636673, "turn_id": 43} +{"actual_output_tokens": 219, "cached_tokens": 38208, "effective_input_length": 38308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38308, "latency_s": 1.6361378940055147, "output_length": 219, "proxy_request_id": "1399948:44:1644970:1012", "request_id": "1399948:44:1644970:1012", "request_type": "coder", "requested_output_tokens": 219, "session_id": "1399948", "t_dispatch_unix": 1779818987.1995785, "t_finish_unix": 1779818988.8357162, "t_first_token_unix": 1779818987.3293784, "tpot_s": 0.006908010261522077, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765], "trace_timestamp_s": 1393.4470000000001, "ttft_s": 0.1297977640060708, "turn_id": 44} +{"actual_output_tokens": 2429, "cached_tokens": 80272, "effective_input_length": 80717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80717, "latency_s": 30.529182233964093, "output_length": 2429, "proxy_request_id": "1294611:15:1636645:1006", "request_id": "1294611:15:1636645:1006", "request_type": "coder", "requested_output_tokens": 2429, "session_id": "1294611", "t_dispatch_unix": 1779818959.2816207, "t_finish_unix": 1779818989.8108025, "t_first_token_unix": 1779818959.7347374, "tpot_s": 0.01238700994194038, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16080826, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859], "trace_timestamp_s": 1365.5200000000004, "ttft_s": 0.4531144409556873, "turn_id": 15} +{"actual_output_tokens": 1400, "cached_tokens": 94192, "effective_input_length": 94269, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 94269, "latency_s": 20.05660514399642, "output_length": 1400, "proxy_request_id": "1253804:21:1640487:1009", "request_id": "1253804:21:1640487:1009", "request_type": "coder", "requested_output_tokens": 1400, "session_id": "1253804", "t_dispatch_unix": 1779818972.0773566, "t_finish_unix": 1779818992.1339612, "t_first_token_unix": 1779818972.313177, "tpot_s": 0.014167600634039844, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16119050], "trace_timestamp_s": 1378.3230000000003, "ttft_s": 0.23581794695928693, "turn_id": 21} +{"actual_output_tokens": 54, "cached_tokens": 95664, "effective_input_length": 95715, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95715, "latency_s": 0.6931497320183553, "output_length": 54, "proxy_request_id": "1253804:22:1650001:1013", "request_id": "1253804:22:1650001:1013", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1253804", "t_dispatch_unix": 1779819003.783921, "t_finish_unix": 1779819004.4770699, "t_first_token_unix": 1779819004.002544, "tpot_s": 0.008948546415853824, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630], "trace_timestamp_s": 1410.0170000000007, "ttft_s": 0.21861949498998, "turn_id": 22} +{"actual_output_tokens": 87, "cached_tokens": 38512, "effective_input_length": 38758, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38758, "latency_s": 0.7446240040007979, "output_length": 87, "proxy_request_id": "1399948:45:1650679:1014", "request_id": "1399948:45:1650679:1014", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1399948", "t_dispatch_unix": 1779819006.2407644, "t_finish_unix": 1779819006.9853883, "t_first_token_unix": 1779819006.4004755, "tpot_s": 0.006797950697228919, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16213486], "trace_timestamp_s": 1412.487, "ttft_s": 0.15970890800235793, "turn_id": 45} +{"actual_output_tokens": 45, "cached_tokens": 95760, "effective_input_length": 96944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96944, "latency_s": 1.2546374329831451, "output_length": 45, "proxy_request_id": "1253804:23:1651448:1015", "request_id": "1253804:23:1651448:1015", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819008.5326543, "t_finish_unix": 1779819009.7872913, "t_first_token_unix": 1779819009.4107454, "tpot_s": 0.008552234840780411, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16220458], "trace_timestamp_s": 1414.777, "ttft_s": 0.878088058962021, "turn_id": 23} +{"actual_output_tokens": 123, "cached_tokens": 38832, "effective_input_length": 39837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39837, "latency_s": 1.2470693479990587, "output_length": 123, "proxy_request_id": "1399948:46:1658183:1018", "request_id": "1399948:46:1658183:1018", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1399948", "t_dispatch_unix": 1779819031.3751767, "t_finish_unix": 1779819032.622246, "t_first_token_unix": 1779819031.778396, "tpot_s": 0.00691477463964266, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828], "trace_timestamp_s": 1437.6230000000005, "ttft_s": 0.4032165019889362, "turn_id": 46} +{"actual_output_tokens": 45, "cached_tokens": 96976, "effective_input_length": 97769, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97769, "latency_s": 1.3051067070337012, "output_length": 45, "proxy_request_id": "1253804:24:1659020:1019", "request_id": "1253804:24:1659020:1019", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819034.2647457, "t_finish_unix": 1779819035.5698524, "t_first_token_unix": 1779819034.9682937, "tpot_s": 0.013663431227376515, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091], "trace_timestamp_s": 1440.5100000000002, "ttft_s": 0.7035451630363241, "turn_id": 24} +{"actual_output_tokens": 2557, "cached_tokens": 80064, "effective_input_length": 80406, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80406, "latency_s": 24.505733388010412, "output_length": 2557, "proxy_request_id": "1268861:25:1653400:1016", "request_id": "1268861:25:1653400:1016", "request_type": "coder", "requested_output_tokens": 2557, "session_id": "1268861", "t_dispatch_unix": 1779819014.972038, "t_finish_unix": 1779819039.477771, "t_first_token_unix": 1779819015.4034843, "tpot_s": 0.009418635027387825, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16147319, 16238847, 16238848], "trace_timestamp_s": 1421.2150000000001, "ttft_s": 0.43144443299388513, "turn_id": 25} +{"actual_output_tokens": 45, "cached_tokens": 97808, "effective_input_length": 98187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98187, "latency_s": 1.1132644400349818, "output_length": 45, "proxy_request_id": "1253804:25:1662273:1020", "request_id": "1253804:25:1662273:1020", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819045.1285653, "t_finish_unix": 1779819046.2418296, "t_first_token_unix": 1779819045.6471956, "tpot_s": 0.013507770112482831, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784], "trace_timestamp_s": 1451.3740000000007, "ttft_s": 0.5186272610444576, "turn_id": 25} +{"actual_output_tokens": 63, "cached_tokens": 39952, "effective_input_length": 40261, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40261, "latency_s": 0.6539025860256515, "output_length": 63, "proxy_request_id": "1399948:47:1664702:1022", "request_id": "1399948:47:1664702:1022", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779819053.7370791, "t_finish_unix": 1779819054.3909814, "t_first_token_unix": 1779819053.9778855, "tpot_s": 0.0066549247421789914, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16343814], "trace_timestamp_s": 1459.9850000000006, "ttft_s": 0.24080398899968714, "turn_id": 47} +{"actual_output_tokens": 2280, "cached_tokens": 83136, "effective_input_length": 83204, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83204, "latency_s": 26.143011717009358, "output_length": 2280, "proxy_request_id": "1294611:15:1657992:1017", "request_id": "1294611:15:1657992:1017", "request_type": "coder", "requested_output_tokens": 2280, "session_id": "1294611", "t_dispatch_unix": 1779819030.892765, "t_finish_unix": 1779819057.035776, "t_first_token_unix": 1779819031.109712, "tpot_s": 0.01137595736683592, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16281887, 16281888, 16281889, 16281890, 16281891, 16281892, 16281893, 16281894, 16281895, 16281896, 16281897, 16281898, 16281899, 16281900, 16281901, 16281902, 16281903, 16281904, 16281905, 16281906, 16281907, 16281908, 16281909, 16281910, 16281911, 16281912, 16281913, 16281914, 16281915, 16281916, 16281917, 16281918, 16281919, 16281920, 16281921, 16281922, 16281923, 16281924, 16281925], "trace_timestamp_s": 1437.1310000000003, "ttft_s": 0.21694499399745837, "turn_id": 15} +{"actual_output_tokens": 152, "cached_tokens": 131936, "effective_input_length": 132537, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 132537, "latency_s": 2.4536778850015253, "output_length": 152, "proxy_request_id": "1356885:8:1665690:1023", "request_id": "1356885:8:1665690:1023", "request_type": "coder", "requested_output_tokens": 152, "session_id": "1356885", "t_dispatch_unix": 1779819056.9422052, "t_finish_unix": 1779819059.3958826, "t_first_token_unix": 1779819057.6432638, "tpot_s": 0.011605101999894575, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835], "trace_timestamp_s": 1463.1860000000006, "ttft_s": 0.7010565740056336, "turn_id": 8} +{"actual_output_tokens": 197, "cached_tokens": 40320, "effective_input_length": 40343, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40343, "latency_s": 1.4657575350138359, "output_length": 197, "proxy_request_id": "1399948:48:1666394:1024", "request_id": "1399948:48:1666394:1024", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1399948", "t_dispatch_unix": 1779819059.367953, "t_finish_unix": 1779819060.8336995, "t_first_token_unix": 1779819059.4564834, "tpot_s": 0.007025091556062428, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763], "trace_timestamp_s": 1465.6150000000007, "ttft_s": 0.08853949600597844, "turn_id": 48} +{"actual_output_tokens": 154, "cached_tokens": 40528, "effective_input_length": 40642, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40642, "latency_s": 1.2052377720247023, "output_length": 154, "proxy_request_id": "1399948:49:1668825:1025", "request_id": "1399948:49:1668825:1025", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1399948", "t_dispatch_unix": 1779819067.9292452, "t_finish_unix": 1779819069.1344826, "t_first_token_unix": 1779819068.0696163, "tpot_s": 0.00695659029426881, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16382119], "trace_timestamp_s": 1474.1770000000006, "ttft_s": 0.14036916597979143, "turn_id": 49} +{"actual_output_tokens": 169, "cached_tokens": 85472, "effective_input_length": 85542, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85542, "latency_s": 2.7659457629779354, "output_length": 169, "proxy_request_id": "1294611:15:1673197:1026", "request_id": "1294611:15:1673197:1026", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1294611", "t_dispatch_unix": 1779819083.1402352, "t_finish_unix": 1779819085.9061804, "t_first_token_unix": 1779819083.3366368, "tpot_s": 0.01529293674407416, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16425840, 16425841, 16425842, 16425843, 16425844, 16425845, 16425846, 16425847, 16425848, 16425849, 16425850, 16425851, 16425852, 16425853, 16425854, 16425855, 16425856, 16425857, 16425858, 16425859, 16425860, 16425861, 16425862, 16425863, 16425864, 16425865, 16425866, 16425867, 16425868, 16425869, 16425870, 16425871, 16425872, 16425873, 16425874, 16425875, 16425876, 16425877, 16425878, 16425879, 16425880, 16425881, 16425882, 16425883], "trace_timestamp_s": 1489.3780000000006, "ttft_s": 0.19640002195956185, "turn_id": 15} +{"actual_output_tokens": 3441, "cached_tokens": 98224, "effective_input_length": 98254, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98254, "latency_s": 39.376800286991056, "output_length": 3441, "proxy_request_id": "1253804:26:1663639:1021", "request_id": "1253804:26:1663639:1021", "request_type": "coder", "requested_output_tokens": 3441, "session_id": "1253804", "t_dispatch_unix": 1779819049.962703, "t_finish_unix": 1779819089.3395028, "t_first_token_unix": 1779819050.1665232, "tpot_s": 0.011387415165112078, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784], "trace_timestamp_s": 1456.2080000000005, "ttft_s": 0.20381807803642005, "turn_id": 26} +{"actual_output_tokens": 270, "cached_tokens": 85696, "effective_input_length": 85722, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85722, "latency_s": 2.7116926729795523, "output_length": 270, "proxy_request_id": "1294611:15:1676489:1027", "request_id": "1294611:15:1676489:1027", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1294611", "t_dispatch_unix": 1779819094.5267546, "t_finish_unix": 1779819097.2384472, "t_first_token_unix": 1779819094.6847227, "tpot_s": 0.009492398260228792, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16456400, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859, 16456401, 16456402, 16456403, 16456404, 16456405, 16456406, 16456407, 16456408, 16456409, 16456410], "trace_timestamp_s": 1500.7660000000005, "ttft_s": 0.15796618099557236, "turn_id": 15} +{"actual_output_tokens": 500, "cached_tokens": 40784, "effective_input_length": 42648, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42648, "latency_s": 4.244539668026846, "output_length": 500, "proxy_request_id": "1399948:50:1677482:1028", "request_id": "1399948:50:1677482:1028", "request_type": "coder", "requested_output_tokens": 500, "session_id": "1399948", "t_dispatch_unix": 1779819097.7853587, "t_finish_unix": 1779819102.0298977, "t_first_token_unix": 1779819098.3964267, "tpot_s": 0.0072805636332842535, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16467283], "trace_timestamp_s": 1504.031, "ttft_s": 0.6110657600220293, "turn_id": 50} +{"actual_output_tokens": 290, "cached_tokens": 85984, "effective_input_length": 86602, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86602, "latency_s": 3.215882108954247, "output_length": 290, "proxy_request_id": "1294611:15:1679070:1029", "request_id": "1294611:15:1679070:1029", "request_type": "coder", "requested_output_tokens": 290, "session_id": "1294611", "t_dispatch_unix": 1779819103.207322, "t_finish_unix": 1779819106.4232042, "t_first_token_unix": 1779819103.6815274, "tpot_s": 0.009485657353060494, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16482842, 15703737, 15703738, 15703739, 15703740, 15703741, 15703742, 15703743, 15703744, 15703745, 15703746, 15703747, 15703748, 15703749, 15703750, 15703751, 15703752, 15703753, 15703754, 15703755, 15703756, 15703757, 15703758, 15703759, 16482843, 16482844, 16482845, 16482846, 16482847, 16482848, 16482849, 16482850, 16482851, 16482852, 16482853, 16482854, 16482855, 16482856, 16482857, 16482858, 16482859, 16482860, 16482861, 16482862, 16482863, 16482864], "trace_timestamp_s": 1509.4470000000001, "ttft_s": 0.47420197597239166, "turn_id": 15} +{"actual_output_tokens": 35, "cached_tokens": 101680, "effective_input_length": 101743, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101743, "latency_s": 0.7019437059643678, "output_length": 35, "proxy_request_id": "1253804:27:1683133:1031", "request_id": "1253804:27:1683133:1031", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779819116.83445, "t_finish_unix": 1779819117.5363932, "t_first_token_unix": 1779819117.0747104, "tpot_s": 0.013568902588517898, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388], "trace_timestamp_s": 1523.0790000000006, "ttft_s": 0.24025842000264674, "turn_id": 27} +{"actual_output_tokens": 412, "cached_tokens": 86880, "effective_input_length": 86925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86925, "latency_s": 4.403492579003796, "output_length": 412, "proxy_request_id": "1294611:15:1682649:1030", "request_id": "1294611:15:1682649:1030", "request_type": "coder", "requested_output_tokens": 412, "session_id": "1294611", "t_dispatch_unix": 1779819115.1177592, "t_finish_unix": 1779819119.521252, "t_first_token_unix": 1779819115.286654, "tpot_s": 0.01030246450122754, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16515797, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859, 16456401, 16456402, 16456403, 16456404, 16456405, 16456406, 16456407, 16456408, 16456409, 16456410, 16515798, 16515799], "trace_timestamp_s": 1521.3540000000003, "ttft_s": 0.1688923820038326, "turn_id": 15} +{"actual_output_tokens": 73, "cached_tokens": 101776, "effective_input_length": 101794, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101794, "latency_s": 0.8702375700231642, "output_length": 73, "proxy_request_id": "1253804:28:1685257:1032", "request_id": "1253804:28:1685257:1032", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1253804", "t_dispatch_unix": 1779819123.8346744, "t_finish_unix": 1779819124.7049117, "t_first_token_unix": 1779819124.0121083, "tpot_s": 0.009618099208940597, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388], "trace_timestamp_s": 1530.0770000000002, "ttft_s": 0.17743235296802595, "turn_id": 28} +{"actual_output_tokens": 199, "cached_tokens": 43136, "effective_input_length": 43407, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43407, "latency_s": 1.6018059420166537, "output_length": 199, "proxy_request_id": "1399948:51:1686626:1033", "request_id": "1399948:51:1686626:1033", "request_type": "coder", "requested_output_tokens": 199, "session_id": "1399948", "t_dispatch_unix": 1779819128.774907, "t_finish_unix": 1779819130.3767133, "t_first_token_unix": 1779819128.951291, "tpot_s": 0.007197575277655922, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913], "trace_timestamp_s": 1535.0170000000007, "ttft_s": 0.17638210102450103, "turn_id": 51} +{"actual_output_tokens": 101, "cached_tokens": 101856, "effective_input_length": 102067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102067, "latency_s": 1.336127626011148, "output_length": 101, "proxy_request_id": "1253804:29:1688398:1034", "request_id": "1253804:29:1688398:1034", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1253804", "t_dispatch_unix": 1779819134.822724, "t_finish_unix": 1779819136.1588514, "t_first_token_unix": 1779819135.168143, "tpot_s": 0.00990416357992217, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16571621], "trace_timestamp_s": 1541.063, "ttft_s": 0.345416454016231, "turn_id": 29} +{"actual_output_tokens": 105, "cached_tokens": 43600, "effective_input_length": 43673, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43673, "latency_s": 0.8526605530059896, "output_length": 105, "proxy_request_id": "1399948:52:1689144:1035", "request_id": "1399948:52:1689144:1035", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1399948", "t_dispatch_unix": 1779819137.4100718, "t_finish_unix": 1779819138.2627323, "t_first_token_unix": 1779819137.5391934, "tpot_s": 0.006954390951880039, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16578337], "trace_timestamp_s": 1543.656, "ttft_s": 0.12911958602489904, "turn_id": 52} +{"actual_output_tokens": 144, "cached_tokens": 132688, "effective_input_length": 132823, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 132823, "latency_s": 1.9951142349746078, "output_length": 144, "proxy_request_id": "1356885:9:1689871:1036", "request_id": "1356885:9:1689871:1036", "request_type": "coder", "requested_output_tokens": 144, "session_id": "1356885", "t_dispatch_unix": 1779819139.7778995, "t_finish_unix": 1779819141.7730136, "t_first_token_unix": 1779819140.121389, "tpot_s": 0.011547862258625797, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16586340], "trace_timestamp_s": 1546.0200000000004, "ttft_s": 0.34348650701576844, "turn_id": 9} +{"actual_output_tokens": 77, "cached_tokens": 102160, "effective_input_length": 102214, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102214, "latency_s": 0.9635821770061739, "output_length": 77, "proxy_request_id": "1253804:30:1690362:1037", "request_id": "1253804:30:1690362:1037", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1253804", "t_dispatch_unix": 1779819141.4331355, "t_finish_unix": 1779819142.3967183, "t_first_token_unix": 1779819141.664179, "tpot_s": 0.00963458621041163, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691], "trace_timestamp_s": 1547.679, "ttft_s": 0.2310404510353692, "turn_id": 30} +{"actual_output_tokens": 42, "cached_tokens": 102288, "effective_input_length": 102322, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102322, "latency_s": 0.5549045439693145, "output_length": 42, "proxy_request_id": "1253804:31:1691981:1038", "request_id": "1253804:31:1691981:1038", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1253804", "t_dispatch_unix": 1779819147.0113244, "t_finish_unix": 1779819147.566228, "t_first_token_unix": 1779819147.203892, "tpot_s": 0.008831508170881467, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691], "trace_timestamp_s": 1553.2520000000004, "ttft_s": 0.19256541394861415, "turn_id": 31} +{"actual_output_tokens": 188, "cached_tokens": 43776, "effective_input_length": 43938, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43938, "latency_s": 1.5387214020011015, "output_length": 188, "proxy_request_id": "1399948:53:1692115:1039", "request_id": "1399948:53:1692115:1039", "request_type": "coder", "requested_output_tokens": 188, "session_id": "1399948", "t_dispatch_unix": 1779819147.531695, "t_finish_unix": 1779819149.0704165, "t_first_token_unix": 1779819147.7086194, "tpot_s": 0.007280767786025224, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324], "trace_timestamp_s": 1553.7790000000005, "ttft_s": 0.17692252498818561, "turn_id": 53} +{"actual_output_tokens": 79, "cached_tokens": 102352, "effective_input_length": 102509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102509, "latency_s": 1.1038466269965284, "output_length": 79, "proxy_request_id": "1253804:32:1693715:1040", "request_id": "1253804:32:1693715:1040", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1253804", "t_dispatch_unix": 1779819153.0908344, "t_finish_unix": 1779819154.194681, "t_first_token_unix": 1779819153.4418838, "tpot_s": 0.009647283846369157, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16624791], "trace_timestamp_s": 1559.3360000000002, "ttft_s": 0.35104585002409294, "turn_id": 32} +{"actual_output_tokens": 42, "cached_tokens": 44112, "effective_input_length": 44182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44182, "latency_s": 0.39597717503784224, "output_length": 42, "proxy_request_id": "1399948:54:1694570:1041", "request_id": "1399948:54:1694570:1041", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1399948", "t_dispatch_unix": 1779819156.1904776, "t_finish_unix": 1779819156.5864542, "t_first_token_unix": 1779819156.3174796, "tpot_s": 0.006553199781082207, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16632677], "trace_timestamp_s": 1562.4360000000006, "ttft_s": 0.12700034800218418, "turn_id": 54} +{"actual_output_tokens": 53, "cached_tokens": 102576, "effective_input_length": 102632, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102632, "latency_s": 0.7146064029657282, "output_length": 53, "proxy_request_id": "1253804:33:1695393:1042", "request_id": "1253804:33:1695393:1042", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1253804", "t_dispatch_unix": 1779819158.8485703, "t_finish_unix": 1779819159.563176, "t_first_token_unix": 1779819159.0842097, "tpot_s": 0.00920478444291243, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284], "trace_timestamp_s": 1565.0910000000003, "ttft_s": 0.2356371149653569, "turn_id": 33} +{"actual_output_tokens": 323, "cached_tokens": 102672, "effective_input_length": 102792, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102792, "latency_s": 3.645215313998051, "output_length": 323, "proxy_request_id": "1253804:34:1697569:1043", "request_id": "1253804:34:1697569:1043", "request_type": "coder", "requested_output_tokens": 323, "session_id": "1253804", "t_dispatch_unix": 1779819166.6854205, "t_finish_unix": 1779819170.3306353, "t_first_token_unix": 1779819166.968133, "tpot_s": 0.010441512630468592, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284], "trace_timestamp_s": 1572.9230000000007, "ttft_s": 0.28271009295713156, "turn_id": 34} +{"actual_output_tokens": 35, "cached_tokens": 103104, "effective_input_length": 103349, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103349, "latency_s": 0.6465438790037297, "output_length": 35, "proxy_request_id": "1253804:35:1701250:1044", "request_id": "1253804:35:1701250:1044", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779819179.221526, "t_finish_unix": 1779819179.8680696, "t_first_token_unix": 1779819179.5833604, "tpot_s": 0.008365118648404913, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908], "trace_timestamp_s": 1585.4650000000001, "ttft_s": 0.36183194897603244, "turn_id": 35} +{"actual_output_tokens": 48, "cached_tokens": 103376, "effective_input_length": 103400, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103400, "latency_s": 0.6070415899739601, "output_length": 48, "proxy_request_id": "1253804:36:1702697:1045", "request_id": "1253804:36:1702697:1045", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1253804", "t_dispatch_unix": 1779819184.3786812, "t_finish_unix": 1779819184.9857218, "t_first_token_unix": 1779819184.5706956, "tpot_s": 0.008823992488806711, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908], "trace_timestamp_s": 1590.6190000000006, "ttft_s": 0.19201173301553354, "turn_id": 36} +{"actual_output_tokens": 226, "cached_tokens": 44208, "effective_input_length": 45284, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45284, "latency_s": 2.1243074500234798, "output_length": 226, "proxy_request_id": "1399948:55:1704272:1047", "request_id": "1399948:55:1704272:1047", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1399948", "t_dispatch_unix": 1779819189.6565077, "t_finish_unix": 1779819191.780815, "t_first_token_unix": 1779819190.1292412, "tpot_s": 0.007338914444618341, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16728012], "trace_timestamp_s": 1595.9010000000007, "ttft_s": 0.4727307939901948, "turn_id": 55} +{"actual_output_tokens": 126, "cached_tokens": 132960, "effective_input_length": 133014, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 133014, "latency_s": 1.7328814979991876, "output_length": 126, "proxy_request_id": "1356885:10:1706624:1048", "request_id": "1356885:10:1706624:1048", "request_type": "coder", "requested_output_tokens": 126, "session_id": "1356885", "t_dispatch_unix": 1779819197.970164, "t_finish_unix": 1779819199.7030451, "t_first_token_unix": 1779819198.2714798, "tpot_s": 0.011448780335951597, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16751243], "trace_timestamp_s": 1604.2150000000001, "ttft_s": 0.3013139970134944, "turn_id": 10} +{"actual_output_tokens": 1433, "cached_tokens": 103440, "effective_input_length": 103471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103471, "latency_s": 15.536090338020585, "output_length": 1433, "proxy_request_id": "1253804:37:1704071:1046", "request_id": "1253804:37:1704071:1046", "request_type": "coder", "requested_output_tokens": 1433, "session_id": "1253804", "t_dispatch_unix": 1779819188.8520074, "t_finish_unix": 1779819204.388097, "t_first_token_unix": 1779819189.0442095, "tpot_s": 0.01071483115433109, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16725569], "trace_timestamp_s": 1595.0930000000008, "ttft_s": 0.19219999603228644, "turn_id": 37} +{"actual_output_tokens": 123, "cached_tokens": 45504, "effective_input_length": 45571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45571, "latency_s": 1.0157055860036053, "output_length": 123, "proxy_request_id": "1399948:56:1708284:1049", "request_id": "1399948:56:1708284:1049", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1399948", "t_dispatch_unix": 1779819203.691686, "t_finish_unix": 1779819204.7073913, "t_first_token_unix": 1779819203.821662, "tpot_s": 0.007257830442719497, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16766349], "trace_timestamp_s": 1609.9390000000003, "ttft_s": 0.12997455400181934, "turn_id": 56} +{"actual_output_tokens": 336, "cached_tokens": 45680, "effective_input_length": 45756, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45756, "latency_s": 2.5869296549935825, "output_length": 336, "proxy_request_id": "1399948:57:1711464:1050", "request_id": "1399948:57:1711464:1050", "request_type": "coder", "requested_output_tokens": 336, "session_id": "1399948", "t_dispatch_unix": 1779819214.4874473, "t_finish_unix": 1779819217.0743763, "t_first_token_unix": 1779819214.6191194, "tpot_s": 0.007328315155316533, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16797835], "trace_timestamp_s": 1620.7250000000004, "ttft_s": 0.1316699929884635, "turn_id": 57} +{"actual_output_tokens": 35, "cached_tokens": 104896, "effective_input_length": 104953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 104953, "latency_s": 0.5303964740014635, "output_length": 35, "proxy_request_id": "1253804:38:1712824:1051", "request_id": "1253804:38:1712824:1051", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779819219.3059509, "t_finish_unix": 1779819219.8363464, "t_first_token_unix": 1779819219.5461202, "tpot_s": 0.008525811353191623, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701], "trace_timestamp_s": 1625.5480000000007, "ttft_s": 0.24016739102080464, "turn_id": 38} +{"actual_output_tokens": 59, "cached_tokens": 104976, "effective_input_length": 105004, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105004, "latency_s": 0.7350222599925473, "output_length": 59, "proxy_request_id": "1253804:39:1714767:1052", "request_id": "1253804:39:1714767:1052", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1253804", "t_dispatch_unix": 1779819225.8902206, "t_finish_unix": 1779819226.6252418, "t_first_token_unix": 1779819226.0736473, "tpot_s": 0.009505355741692194, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16829979], "trace_timestamp_s": 1632.1290000000008, "ttft_s": 0.18342513596871868, "turn_id": 39} +{"actual_output_tokens": 435, "cached_tokens": 105056, "effective_input_length": 105156, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105156, "latency_s": 5.856679816963151, "output_length": 435, "proxy_request_id": "1253804:40:1716790:1053", "request_id": "1253804:40:1716790:1053", "request_type": "coder", "requested_output_tokens": 435, "session_id": "1253804", "t_dispatch_unix": 1779819232.5957937, "t_finish_unix": 1779819238.452473, "t_first_token_unix": 1779819232.8848789, "tpot_s": 0.012827839403282335, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093], "trace_timestamp_s": 1638.8400000000001, "ttft_s": 0.28908308397512883, "turn_id": 40} +{"actual_output_tokens": 278, "cached_tokens": 45120, "effective_input_length": 47861, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47861, "latency_s": 3.2124350399826653, "output_length": 278, "proxy_request_id": "1305906:4:1718131:1054", "request_id": "1305906:4:1718131:1054", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1305906", "t_dispatch_unix": 1779819237.0552642, "t_finish_unix": 1779819240.267699, "t_first_token_unix": 1779819237.9973798, "tpot_s": 0.008194384483884456, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16863272], "trace_timestamp_s": 1643.3010000000004, "ttft_s": 0.9421140879858285, "turn_id": 4} +{"actual_output_tokens": 92, "cached_tokens": 48128, "effective_input_length": 49817, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49817, "latency_s": 1.333637886971701, "output_length": 92, "proxy_request_id": "1305906:5:1514292:934", "request_id": "1305906:5:1514292:934", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1305906", "t_dispatch_unix": 1779819240.2723267, "t_finish_unix": 1779819241.605965, "t_first_token_unix": 1779819240.9507136, "tpot_s": 0.0071972797472531404, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 14922071, 14922072], "trace_timestamp_s": 956.3870000000006, "ttft_s": 0.6783840109710582, "turn_id": 5} +{"actual_output_tokens": 233, "cached_tokens": 35504, "effective_input_length": 37173, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37173, "latency_s": 2.134893706010189, "output_length": 233, "proxy_request_id": "1340290:13:1718889:1055", "request_id": "1340290:13:1718889:1055", "request_type": "coder", "requested_output_tokens": 233, "session_id": "1340290", "t_dispatch_unix": 1779819239.6906526, "t_finish_unix": 1779819241.8255548, "t_first_token_unix": 1779819240.2272425, "tpot_s": 0.0068880381420905025, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832], "trace_timestamp_s": 1645.9370000000008, "ttft_s": 0.5365878349984996, "turn_id": 13} +{"actual_output_tokens": 66, "cached_tokens": 105584, "effective_input_length": 105638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105638, "latency_s": 0.8638643180020154, "output_length": 66, "proxy_request_id": "1253804:41:1721979:1057", "request_id": "1253804:41:1721979:1057", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1253804", "t_dispatch_unix": 1779819250.2766633, "t_finish_unix": 1779819251.1405277, "t_first_token_unix": 1779819250.5142875, "tpot_s": 0.00963010584595255, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16901523], "trace_timestamp_s": 1656.522, "ttft_s": 0.23762197099858895, "turn_id": 41} +{"actual_output_tokens": 254, "cached_tokens": 37392, "effective_input_length": 37438, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37438, "latency_s": 1.8401104199583642, "output_length": 254, "proxy_request_id": "1340290:14:1721731:1056", "request_id": "1340290:14:1721731:1056", "request_type": "coder", "requested_output_tokens": 254, "session_id": "1340290", "t_dispatch_unix": 1779819249.410769, "t_finish_unix": 1779819251.2508788, "t_first_token_unix": 1779819249.502097, "tpot_s": 0.006911259426840254, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16899322], "trace_timestamp_s": 1655.656, "ttft_s": 0.09132594597758725, "turn_id": 14} +{"actual_output_tokens": 78, "cached_tokens": 105696, "effective_input_length": 105715, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105715, "latency_s": 0.9432351100258529, "output_length": 78, "proxy_request_id": "1253804:42:1724453:1058", "request_id": "1253804:42:1724453:1058", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1253804", "t_dispatch_unix": 1779819258.7756677, "t_finish_unix": 1779819259.7189028, "t_first_token_unix": 1779819258.9573338, "tpot_s": 0.009886488623088588, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815], "trace_timestamp_s": 1665.0170000000007, "ttft_s": 0.18166443903464824, "turn_id": 42} +{"actual_output_tokens": 70, "cached_tokens": 105792, "effective_input_length": 105845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105845, "latency_s": 0.9079653199878521, "output_length": 70, "proxy_request_id": "1253804:43:1726322:1060", "request_id": "1253804:43:1726322:1060", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1253804", "t_dispatch_unix": 1779819264.8511856, "t_finish_unix": 1779819265.7591507, "t_first_token_unix": 1779819265.0887887, "tpot_s": 0.009711240187955453, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815], "trace_timestamp_s": 1671.0960000000005, "ttft_s": 0.23760101798688993, "turn_id": 43} +{"actual_output_tokens": 22, "cached_tokens": 46080, "effective_input_length": 46886, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46886, "latency_s": 0.49634159600827843, "output_length": 22, "proxy_request_id": "1399948:58:1726693:1061", "request_id": "1399948:58:1726693:1061", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1399948", "t_dispatch_unix": 1779819266.0766423, "t_finish_unix": 1779819266.5729837, "t_first_token_unix": 1779819266.4512475, "tpot_s": 0.005783753716275983, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 16945463], "trace_timestamp_s": 1672.3230000000003, "ttft_s": 0.37460324296262115, "turn_id": 58} +{"actual_output_tokens": 24, "cached_tokens": 46896, "effective_input_length": 46927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46927, "latency_s": 0.2372638899832964, "output_length": 24, "proxy_request_id": "1399948:59:1728305:1062", "request_id": "1399948:59:1728305:1062", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1399948", "t_dispatch_unix": 1779819271.3691607, "t_finish_unix": 1779819271.6064246, "t_first_token_unix": 1779819271.469908, "tpot_s": 0.0059177605663021295, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 16960933], "trace_timestamp_s": 1677.616, "ttft_s": 0.10074506397359073, "turn_id": 59} +{"actual_output_tokens": 101, "cached_tokens": 105904, "effective_input_length": 106070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106070, "latency_s": 1.3743608999648131, "output_length": 101, "proxy_request_id": "1253804:44:1728625:1063", "request_id": "1253804:44:1728625:1063", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1253804", "t_dispatch_unix": 1779819272.5539687, "t_finish_unix": 1779819273.9283273, "t_first_token_unix": 1779819272.9102523, "tpot_s": 0.010175547829712741, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 16964762], "trace_timestamp_s": 1678.799, "ttft_s": 0.35628146899398416, "turn_id": 44} +{"actual_output_tokens": 2444, "cached_tokens": 37680, "effective_input_length": 37724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37724, "latency_s": 17.45350004703505, "output_length": 2444, "proxy_request_id": "1340290:15:1725612:1059", "request_id": "1340290:15:1725612:1059", "request_type": "coder", "requested_output_tokens": 2444, "session_id": "1340290", "t_dispatch_unix": 1779819262.595262, "t_finish_unix": 1779819280.0487618, "t_first_token_unix": 1779819262.6870143, "tpot_s": 0.0071066167908495756, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638], "trace_timestamp_s": 1668.8400000000001, "ttft_s": 0.09175025799777359, "turn_id": 15} +{"actual_output_tokens": 40, "cached_tokens": 106160, "effective_input_length": 106394, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106394, "latency_s": 0.7105380319990218, "output_length": 40, "proxy_request_id": "1253804:45:1732408:1064", "request_id": "1253804:45:1732408:1064", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1253804", "t_dispatch_unix": 1779819285.5214012, "t_finish_unix": 1779819286.231939, "t_first_token_unix": 1779819285.8820739, "tpot_s": 0.008963527742964335, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607], "trace_timestamp_s": 1691.7610000000004, "ttft_s": 0.3606701910030097, "turn_id": 45} +{"actual_output_tokens": 54, "cached_tokens": 46944, "effective_input_length": 47074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47074, "latency_s": 0.5033090240322053, "output_length": 54, "proxy_request_id": "1399948:60:1732843:1065", "request_id": "1399948:60:1732843:1065", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1399948", "t_dispatch_unix": 1779819287.1212723, "t_finish_unix": 1779819287.624581, "t_first_token_unix": 1779819287.2619748, "tpot_s": 0.006836226207801615, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902], "trace_timestamp_s": 1693.3680000000004, "ttft_s": 0.1407008080277592, "turn_id": 60} +{"actual_output_tokens": 71, "cached_tokens": 106432, "effective_input_length": 106443, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106443, "latency_s": 0.8655363420257345, "output_length": 71, "proxy_request_id": "1253804:46:1733935:1066", "request_id": "1253804:46:1733935:1066", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1253804", "t_dispatch_unix": 1779819290.6129522, "t_finish_unix": 1779819291.4784882, "t_first_token_unix": 1779819290.7875075, "tpot_s": 0.00986688209980327, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607], "trace_timestamp_s": 1696.8550000000005, "ttft_s": 0.1745526340091601, "turn_id": 46} +{"actual_output_tokens": 207, "cached_tokens": 47120, "effective_input_length": 47205, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47205, "latency_s": 1.6474141869693995, "output_length": 207, "proxy_request_id": "1399948:61:1735933:1067", "request_id": "1399948:61:1735933:1067", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1399948", "t_dispatch_unix": 1779819297.3155434, "t_finish_unix": 1779819298.962957, "t_first_token_unix": 1779819297.4369113, "tpot_s": 0.007406506844789459, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17034825], "trace_timestamp_s": 1703.5600000000004, "ttft_s": 0.12136497796745971, "turn_id": 61} +{"actual_output_tokens": 44, "cached_tokens": 106512, "effective_input_length": 107137, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107137, "latency_s": 1.1541316009825096, "output_length": 44, "proxy_request_id": "1253804:47:1736337:1068", "request_id": "1253804:47:1736337:1068", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1253804", "t_dispatch_unix": 1779819298.589619, "t_finish_unix": 1779819299.7437503, "t_first_token_unix": 1779819299.3561733, "tpot_s": 0.00900710276788274, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17038931], "trace_timestamp_s": 1704.8340000000007, "ttft_s": 0.7665502249728888, "turn_id": 47} +{"actual_output_tokens": 45, "cached_tokens": 107168, "effective_input_length": 108145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108145, "latency_s": 1.3664248710265383, "output_length": 45, "proxy_request_id": "1253804:48:1737694:1069", "request_id": "1253804:48:1737694:1069", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819303.0242105, "t_finish_unix": 1779819304.3906355, "t_first_token_unix": 1779819303.9909246, "tpot_s": 0.009077227636060508, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17053260], "trace_timestamp_s": 1709.268, "ttft_s": 0.9667113210307434, "turn_id": 48} +{"actual_output_tokens": 45, "cached_tokens": 108176, "effective_input_length": 109454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109454, "latency_s": 1.5774518680409528, "output_length": 45, "proxy_request_id": "1253804:49:1739030:1070", "request_id": "1253804:49:1739030:1070", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819307.4110243, "t_finish_unix": 1779819308.9884758, "t_first_token_unix": 1779819308.5818164, "tpot_s": 0.009235896658289923, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558], "trace_timestamp_s": 1713.652, "ttft_s": 1.1707895920262672, "turn_id": 49} +{"actual_output_tokens": 45, "cached_tokens": 109488, "effective_input_length": 110854, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 110854, "latency_s": 1.6005026999628171, "output_length": 45, "proxy_request_id": "1253804:50:1741670:1071", "request_id": "1253804:50:1741670:1071", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819316.3940706, "t_finish_unix": 1779819317.9945717, "t_first_token_unix": 1779819317.5849202, "tpot_s": 0.009303567953545346, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030], "trace_timestamp_s": 1722.6290000000008, "ttft_s": 1.190847454010509, "turn_id": 50} +{"actual_output_tokens": 45, "cached_tokens": 110896, "effective_input_length": 111661, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111661, "latency_s": 1.20085367502179, "output_length": 45, "proxy_request_id": "1253804:51:1744514:1072", "request_id": "1253804:51:1744514:1072", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779819325.8173916, "t_finish_unix": 1779819327.018245, "t_first_token_unix": 1779819326.6088269, "tpot_s": 0.009297882114134898, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17117868], "trace_timestamp_s": 1732.054, "ttft_s": 0.7914329880150035, "turn_id": 51} +{"actual_output_tokens": 105, "cached_tokens": 40160, "effective_input_length": 40200, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40200, "latency_s": 0.8079015930416062, "output_length": 105, "proxy_request_id": "1340290:16:1745847:1073", "request_id": "1340290:16:1745847:1073", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1340290", "t_dispatch_unix": 1779819330.4293, "t_finish_unix": 1779819331.2372015, "t_first_token_unix": 1779819330.5244145, "tpot_s": 0.006849707307432814, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 17129420], "trace_timestamp_s": 1736.6730000000007, "ttft_s": 0.09511281503364444, "turn_id": 16} +{"actual_output_tokens": 76, "cached_tokens": 111696, "effective_input_length": 111724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111724, "latency_s": 0.9514074400067329, "output_length": 76, "proxy_request_id": "1253804:52:1746191:1074", "request_id": "1253804:52:1746191:1074", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1253804", "t_dispatch_unix": 1779819331.4554138, "t_finish_unix": 1779819332.406821, "t_first_token_unix": 1779819331.6504333, "tpot_s": 0.010081449386974176, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17132107], "trace_timestamp_s": 1737.7000000000007, "ttft_s": 0.1950176029931754, "turn_id": 52} +{"actual_output_tokens": 50, "cached_tokens": 111792, "effective_input_length": 111811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111811, "latency_s": 0.6605858170078136, "output_length": 50, "proxy_request_id": "1253804:53:1748377:1075", "request_id": "1253804:53:1748377:1075", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1253804", "t_dispatch_unix": 1779819338.7935169, "t_finish_unix": 1779819339.4541025, "t_first_token_unix": 1779819338.9921923, "tpot_s": 0.009421160448181006, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17153201], "trace_timestamp_s": 1745.0320000000002, "ttft_s": 0.19867098302347586, "turn_id": 53} +{"actual_output_tokens": 78, "cached_tokens": 47408, "effective_input_length": 48212, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48212, "latency_s": 0.9272574409842491, "output_length": 78, "proxy_request_id": "1399948:62:1749028:1076", "request_id": "1399948:62:1749028:1076", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1399948", "t_dispatch_unix": 1779819340.9603083, "t_finish_unix": 1779819341.8875659, "t_first_token_unix": 1779819341.3426585, "tpot_s": 0.007071753233586523, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17159596], "trace_timestamp_s": 1747.2060000000001, "ttft_s": 0.38234755396842957, "turn_id": 62} +{"actual_output_tokens": 534, "cached_tokens": 111856, "effective_input_length": 112074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112074, "latency_s": 6.261478214990348, "output_length": 534, "proxy_request_id": "1253804:54:1750056:1077", "request_id": "1253804:54:1750056:1077", "request_type": "coder", "requested_output_tokens": 534, "session_id": "1253804", "t_dispatch_unix": 1779819344.3861253, "t_finish_unix": 1779819350.6476033, "t_first_token_unix": 1779819344.7636948, "tpot_s": 0.01103863181606613, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17153201], "trace_timestamp_s": 1750.6280000000006, "ttft_s": 0.3775670420145616, "turn_id": 54} +{"actual_output_tokens": 19, "cached_tokens": 48288, "effective_input_length": 48636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48636, "latency_s": 0.38321571197593585, "output_length": 19, "proxy_request_id": "1399948:63:1753316:1079", "request_id": "1399948:63:1753316:1079", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1399948", "t_dispatch_unix": 1779819355.2557397, "t_finish_unix": 1779819355.6389554, "t_first_token_unix": 1779819355.5375087, "tpot_s": 0.0056206782755907625, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857], "trace_timestamp_s": 1761.5030000000006, "ttft_s": 0.28176708600949496, "turn_id": 63} +{"actual_output_tokens": 171, "cached_tokens": 48640, "effective_input_length": 48693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48693, "latency_s": 1.4013781729736365, "output_length": 171, "proxy_request_id": "1399948:64:1754453:1080", "request_id": "1399948:64:1754453:1080", "request_type": "coder", "requested_output_tokens": 171, "session_id": "1399948", "t_dispatch_unix": 1779819359.169119, "t_finish_unix": 1779819360.5704968, "t_first_token_unix": 1779819359.300799, "tpot_s": 0.007467121176202508, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17212612], "trace_timestamp_s": 1765.4160000000002, "ttft_s": 0.13167842902475968, "turn_id": 64} +{"actual_output_tokens": 1391, "cached_tokens": 133136, "effective_input_length": 133552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 133552, "latency_s": 17.833672303997446, "output_length": 1391, "proxy_request_id": "1356885:11:1753167:1078", "request_id": "1356885:11:1753167:1078", "request_type": "coder", "requested_output_tokens": 1391, "session_id": "1356885", "t_dispatch_unix": 1779819354.822888, "t_finish_unix": 1779819372.65656, "t_first_token_unix": 1779819355.517072, "tpot_s": 0.01233020412016211, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16751243, 17201151], "trace_timestamp_s": 1761.0650000000005, "ttft_s": 0.6941809679847211, "turn_id": 11} +{"actual_output_tokens": 725, "cached_tokens": 48848, "effective_input_length": 49220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49220, "latency_s": 5.828803260985296, "output_length": 725, "proxy_request_id": "1399948:65:1759200:1081", "request_id": "1399948:65:1759200:1081", "request_type": "coder", "requested_output_tokens": 725, "session_id": "1399948", "t_dispatch_unix": 1779819375.6660893, "t_finish_unix": 1779819381.4948924, "t_first_token_unix": 1779819375.951259, "tpot_s": 0.007656577584309277, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17258496], "trace_timestamp_s": 1781.9100000000008, "ttft_s": 0.2851669549709186, "turn_id": 65} +{"actual_output_tokens": 140, "cached_tokens": 49504, "effective_input_length": 49716, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49716, "latency_s": 1.2218309150193818, "output_length": 140, "proxy_request_id": "1277428:14:1767578:1082", "request_id": "1277428:14:1767578:1082", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1277428", "t_dispatch_unix": 1779819404.516573, "t_finish_unix": 1779819405.7384036, "t_first_token_unix": 1779819404.714219, "tpot_s": 0.00736620598564782, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17338220], "trace_timestamp_s": 1810.7580000000007, "ttft_s": 0.1976445090258494, "turn_id": 14} +{"actual_output_tokens": 45, "cached_tokens": 49840, "effective_input_length": 49925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49925, "latency_s": 0.4307084530009888, "output_length": 45, "proxy_request_id": "1277428:14:1770237:1083", "request_id": "1277428:14:1770237:1083", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779819413.8747792, "t_finish_unix": 1779819414.3054872, "t_first_token_unix": 1779819414.0031965, "tpot_s": 0.006863221637269651, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17363127], "trace_timestamp_s": 1820.1130000000003, "ttft_s": 0.12841458799084648, "turn_id": 14} +{"actual_output_tokens": 450, "cached_tokens": 49968, "effective_input_length": 51398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51398, "latency_s": 4.058525417000055, "output_length": 450, "proxy_request_id": "1277428:15:1771467:1084", "request_id": "1277428:15:1771467:1084", "request_type": "coder", "requested_output_tokens": 450, "session_id": "1277428", "t_dispatch_unix": 1779819417.9420192, "t_finish_unix": 1779819422.0005445, "t_first_token_unix": 1779819418.542127, "tpot_s": 0.007701863552249744, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17375444], "trace_timestamp_s": 1824.1870000000008, "ttft_s": 0.6001042560092174, "turn_id": 15} +{"actual_output_tokens": 382, "cached_tokens": 49936, "effective_input_length": 51012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51012, "latency_s": 3.4492791289812885, "output_length": 382, "proxy_request_id": "1399948:66:1772336:1085", "request_id": "1399948:66:1772336:1085", "request_type": "coder", "requested_output_tokens": 382, "session_id": "1399948", "t_dispatch_unix": 1779819420.893263, "t_finish_unix": 1779819424.342542, "t_first_token_unix": 1779819421.3982913, "tpot_s": 0.007726893614210051, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17382969], "trace_timestamp_s": 1827.1390000000001, "ttft_s": 0.5050271449727006, "turn_id": 66} +{"actual_output_tokens": 555, "cached_tokens": 51392, "effective_input_length": 52331, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52331, "latency_s": 4.798201227968093, "output_length": 555, "proxy_request_id": "1399948:67:1777074:1086", "request_id": "1399948:67:1777074:1086", "request_type": "coder", "requested_output_tokens": 555, "session_id": "1399948", "t_dispatch_unix": 1779819436.9644663, "t_finish_unix": 1779819441.7626672, "t_first_token_unix": 1779819437.468024, "tpot_s": 0.007751541485588003, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17430076], "trace_timestamp_s": 1843.1980000000003, "ttft_s": 0.5035551629844122, "turn_id": 67} +{"actual_output_tokens": 544, "cached_tokens": 52880, "effective_input_length": 53289, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53289, "latency_s": 4.592840004013851, "output_length": 544, "proxy_request_id": "1399948:68:1784799:1087", "request_id": "1399948:68:1784799:1087", "request_type": "coder", "requested_output_tokens": 544, "session_id": "1399948", "t_dispatch_unix": 1779819463.4583948, "t_finish_unix": 1779819468.0512342, "t_first_token_unix": 1779819463.7677796, "tpot_s": 0.007887504075552658, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17500500], "trace_timestamp_s": 1869.6820000000007, "ttft_s": 0.3093827469856478, "turn_id": 68} +{"actual_output_tokens": 81, "cached_tokens": 51840, "effective_input_length": 52754, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52754, "latency_s": 0.9977413319866173, "output_length": 81, "proxy_request_id": "1277428:16:1787662:1088", "request_id": "1277428:16:1787662:1088", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1277428", "t_dispatch_unix": 1779819473.8964162, "t_finish_unix": 1779819474.8941576, "t_first_token_unix": 1779819474.3127286, "tpot_s": 0.007264118337479886, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 303055], "trace_timestamp_s": 1880.138, "ttft_s": 0.4163100789883174, "turn_id": 16} +{"actual_output_tokens": 70, "cached_tokens": 49904, "effective_input_length": 52461, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52461, "latency_s": 1.5107492170063779, "output_length": 70, "proxy_request_id": "1305906:5:1788459:1089", "request_id": "1305906:5:1788459:1089", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1305906", "t_dispatch_unix": 1779819476.4316456, "t_finish_unix": 1779819477.942394, "t_first_token_unix": 1779819477.4474728, "tpot_s": 0.007168687420283053, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17479967], "trace_timestamp_s": 1882.6760000000004, "ttft_s": 1.0158254859852605, "turn_id": 5} +{"actual_output_tokens": 492, "cached_tokens": 53824, "effective_input_length": 54141, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54141, "latency_s": 4.169404743006453, "output_length": 492, "proxy_request_id": "1399948:69:1790968:1090", "request_id": "1399948:69:1790968:1090", "request_type": "coder", "requested_output_tokens": 492, "session_id": "1399948", "t_dispatch_unix": 1779819485.0267951, "t_finish_unix": 1779819489.1961994, "t_first_token_unix": 1779819485.3294785, "tpot_s": 0.007874620091686947, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437], "trace_timestamp_s": 1891.2740000000003, "ttft_s": 0.302681670000311, "turn_id": 69} +{"actual_output_tokens": 1904, "cached_tokens": 51248, "effective_input_length": 51255, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51255, "latency_s": 14.991565782984253, "output_length": 1904, "proxy_request_id": "1305906:6:1529600:945", "request_id": "1305906:6:1529600:945", "request_type": "coder", "requested_output_tokens": 1904, "session_id": "1305906", "t_dispatch_unix": 1779819477.946467, "t_finish_unix": 1779819492.9380326, "t_first_token_unix": 1779819478.0385885, "tpot_s": 0.007829297935363556, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 15068951, 15068952, 15068953, 15068954, 15068955], "trace_timestamp_s": 1007.1970000000001, "ttft_s": 0.09211940801469609, "turn_id": 6} +{"actual_output_tokens": 170, "cached_tokens": 52832, "effective_input_length": 53574, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53574, "latency_s": 1.7110011280165054, "output_length": 170, "proxy_request_id": "1277428:17:1793546:1091", "request_id": "1277428:17:1793546:1091", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1277428", "t_dispatch_unix": 1779819494.029136, "t_finish_unix": 1779819495.7401369, "t_first_token_unix": 1779819494.4413447, "tpot_s": 0.007683647988355834, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 17586052, 17586053], "trace_timestamp_s": 1900.2750000000005, "ttft_s": 0.41220652300398797, "turn_id": 17} +{"actual_output_tokens": 122, "cached_tokens": 54624, "effective_input_length": 54654, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54654, "latency_s": 1.0298099950305186, "output_length": 122, "proxy_request_id": "1399948:70:1795589:1092", "request_id": "1399948:70:1795589:1092", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1399948", "t_dispatch_unix": 1779819501.3506973, "t_finish_unix": 1779819502.3805072, "t_first_token_unix": 1779819501.460311, "tpot_s": 0.007602599008328258, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564], "trace_timestamp_s": 1907.5920000000006, "ttft_s": 0.10961221402976662, "turn_id": 70} +{"actual_output_tokens": 52, "cached_tokens": 53728, "effective_input_length": 53805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53805, "latency_s": 0.5120081810164265, "output_length": 52, "proxy_request_id": "1277428:18:1796824:1093", "request_id": "1277428:18:1796824:1093", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1277428", "t_dispatch_unix": 1779819505.9466743, "t_finish_unix": 1779819506.4586818, "t_first_token_unix": 1779819506.0959616, "tpot_s": 0.007106385646871857, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 17586052, 17617726, 17617727], "trace_timestamp_s": 1912.1900000000005, "ttft_s": 0.1492852499941364, "turn_id": 18} +{"actual_output_tokens": 265, "cached_tokens": 54768, "effective_input_length": 54920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54920, "latency_s": 2.260444877028931, "output_length": 265, "proxy_request_id": "1399948:71:1800797:1094", "request_id": "1399948:71:1800797:1094", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1399948", "t_dispatch_unix": 1779819519.5235913, "t_finish_unix": 1779819521.7840354, "t_first_token_unix": 1779819519.7252102, "tpot_s": 0.0077974209923537055, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17654371], "trace_timestamp_s": 1925.7700000000004, "ttft_s": 0.20161676703719422, "turn_id": 71} +{"actual_output_tokens": 54, "cached_tokens": 55184, "effective_input_length": 55246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55246, "latency_s": 0.5224868329823948, "output_length": 54, "proxy_request_id": "1399948:72:1804699:1097", "request_id": "1399948:72:1804699:1097", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1399948", "t_dispatch_unix": 1779819532.9871948, "t_finish_unix": 1779819533.5096815, "t_first_token_unix": 1779819533.129363, "tpot_s": 0.007171004378008393, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778], "trace_timestamp_s": 1939.2340000000004, "ttft_s": 0.14216633298201486, "turn_id": 72} +{"actual_output_tokens": 164, "cached_tokens": 55296, "effective_input_length": 55559, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55559, "latency_s": 1.4928688119980507, "output_length": 164, "proxy_request_id": "1399948:73:1805981:1098", "request_id": "1399948:73:1805981:1098", "request_type": "coder", "requested_output_tokens": 164, "session_id": "1399948", "t_dispatch_unix": 1779819537.1689196, "t_finish_unix": 1779819538.6617882, "t_first_token_unix": 1779819537.3836813, "tpot_s": 0.007837799036706814, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17704700], "trace_timestamp_s": 1943.415, "ttft_s": 0.2147592650144361, "turn_id": 73} +{"actual_output_tokens": 95, "cached_tokens": 52928, "effective_input_length": 52932, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52932, "latency_s": 1.4281855470035225, "output_length": 95, "proxy_request_id": "1305906:6:1806419:1099", "request_id": "1305906:6:1806419:1099", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1305906", "t_dispatch_unix": 1779819538.6790752, "t_finish_unix": 1779819540.107261, "t_first_token_unix": 1779819538.7919638, "tpot_s": 0.013989953000341206, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17708612], "trace_timestamp_s": 1944.9260000000004, "ttft_s": 0.11288639600388706, "turn_id": 6} +{"actual_output_tokens": 43, "cached_tokens": 53024, "effective_input_length": 54789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54789, "latency_s": 1.333658391959034, "output_length": 43, "proxy_request_id": "1305906:7:1572780:964", "request_id": "1305906:7:1572780:964", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1305906", "t_dispatch_unix": 1779819540.1109707, "t_finish_unix": 1779819541.444629, "t_first_token_unix": 1779819540.8539126, "tpot_s": 0.01405871304727736, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 15068951, 15068952, 15068953, 15068954, 15254840, 15254841, 15254842, 15254843, 15321386, 15404408, 15482090, 15482091], "trace_timestamp_s": 1150.469, "ttft_s": 0.7429398829699494, "turn_id": 7} +{"actual_output_tokens": 236, "cached_tokens": 55712, "effective_input_length": 55791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55791, "latency_s": 2.014503058977425, "output_length": 236, "proxy_request_id": "1399948:74:1808473:1100", "request_id": "1399948:74:1808473:1100", "request_type": "coder", "requested_output_tokens": 236, "session_id": "1399948", "t_dispatch_unix": 1779819545.8699906, "t_finish_unix": 1779819547.8844938, "t_first_token_unix": 1779819546.0256083, "tpot_s": 0.007908862902029874, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098], "trace_timestamp_s": 1952.1170000000002, "ttft_s": 0.15561598597560078, "turn_id": 74} +{"actual_output_tokens": 3764, "cached_tokens": 111632, "effective_input_length": 111736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111736, "latency_s": 42.523557988984976, "output_length": 3764, "proxy_request_id": "1270606:6:1804345:1096", "request_id": "1270606:6:1804345:1096", "request_type": "coder", "requested_output_tokens": 3764, "session_id": "1270606", "t_dispatch_unix": 1779819531.8153272, "t_finish_unix": 1779819574.3388846, "t_first_token_unix": 1779819532.1337976, "tpot_s": 0.011215678179386504, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17689050, 17689051, 17689052, 17689053, 17689054, 17689055, 17689056, 17689057, 17689058, 17689059, 17689060, 17689061, 17689062, 17689063, 17689064, 17689065, 17689066, 17689067, 17689068, 17689069, 17689070, 17689071, 17689072, 17689073, 17689074, 17689075, 17689076, 17689077, 17689078, 17689079, 17689080, 17689081, 17689082, 17689083, 17689084, 17689085, 17689086, 17689087, 17689088, 17689089, 17689090, 17689091, 17689092, 17689093, 17689094, 17689095, 17689096, 17689097, 17689098, 17689099, 17689100, 17689101, 17689102, 17689103, 17689104, 17689105, 17689106, 17689107, 17689108, 17689109, 17689110, 17689111, 17689112, 17689113, 17689114, 17689115, 17689116, 17689117, 17689118, 17689119, 17689120, 17689121, 17689122, 17689123, 17689124, 17689125, 17689126, 17689127, 17689128, 17689129, 17689130, 17689131, 17689132, 17689133, 17689134, 17689135, 17689136, 17689137, 17689138, 17689139, 17689140, 17689141, 17689142, 17689143, 17689144, 17689145, 17689146, 17689147, 17689148, 17689149, 17689150, 17689151, 17689152, 17689153, 17689154, 17689155, 17689156, 17689157, 17689158, 17689159, 17689160, 17689161, 17689162], "trace_timestamp_s": 1938.0380000000005, "ttft_s": 0.3184678719844669, "turn_id": 6} +{"actual_output_tokens": 108, "cached_tokens": 56016, "effective_input_length": 57308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57308, "latency_s": 1.4772348320111632, "output_length": 108, "proxy_request_id": "1399948:75:1817312:1101", "request_id": "1399948:75:1817312:1101", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1399948", "t_dispatch_unix": 1779819574.4052126, "t_finish_unix": 1779819575.8824472, "t_first_token_unix": 1779819575.0592897, "tpot_s": 0.007690366990233241, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098, 17807927, 17807928, 17807929], "trace_timestamp_s": 1980.652, "ttft_s": 0.6540743230143562, "turn_id": 75} +{"actual_output_tokens": 85, "cached_tokens": 57408, "effective_input_length": 57659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57659, "latency_s": 0.8652097430313006, "output_length": 85, "proxy_request_id": "1399948:76:1821495:1102", "request_id": "1399948:76:1821495:1102", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1399948", "t_dispatch_unix": 1779819588.063316, "t_finish_unix": 1779819588.928526, "t_first_token_unix": 1779819588.2822974, "tpot_s": 0.007689819654582867, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098, 17807927, 17807928, 17807929, 17846855], "trace_timestamp_s": 1994.3100000000004, "ttft_s": 0.21897890500258654, "turn_id": 76} +{"actual_output_tokens": 86, "cached_tokens": 112176, "effective_input_length": 112180, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112180, "latency_s": 1.0450911459629424, "output_length": 86, "proxy_request_id": "1270606:6:1822681:1103", "request_id": "1270606:6:1822681:1103", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1270606", "t_dispatch_unix": 1779819591.8986273, "t_finish_unix": 1779819592.9437182, "t_first_token_unix": 1779819592.0852587, "tpot_s": 0.010096107799943318, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17857677, 17857678, 17857679, 17857680, 17857681, 17857682, 17857683, 17857684, 17857685, 17857686, 17857687, 17857688, 17857689, 17857690, 17857691, 17857692, 17857693, 17857694, 17857695, 17857696, 17857697, 17857698, 17857699, 17857700, 17857701, 17857702, 17857703, 17857704, 17857705, 17857706, 17857707, 17857708, 17857709, 17857710, 17857711, 17857712, 17857713, 17857714, 17857715, 17857716, 17857717, 17857718, 17857719, 17857720, 17857721, 17857722, 17857723, 17857724, 17857725, 17857726, 17857727, 17857728, 17857729, 17857730, 17857731, 17857732, 17857733, 17857734, 17857735, 17857736, 17857737, 17857738, 17857739, 17857740, 17857741, 17857742, 17857743, 17857744, 17857745, 17857746, 17857747, 17857748, 17857749, 17857750, 17857751, 17857752, 17857753, 17857754, 17857755, 17857756, 17857757, 17857758, 17857759, 17857760, 17857761, 17857762, 17857763, 17857764, 17857765, 17857766, 17857767, 17857768, 17857769, 17857770, 17857771, 17857772, 17857773, 17857774, 17857775, 17857776, 17857777, 17857778, 17857779, 17857780, 17857781, 17857782, 17857783, 17857784, 17857785, 17857786, 17857787, 17857788, 17857789], "trace_timestamp_s": 1998.1220000000003, "ttft_s": 0.1866286210133694, "turn_id": 6} +{"actual_output_tokens": 367, "cached_tokens": 112256, "effective_input_length": 112645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112645, "latency_s": 4.594955613021739, "output_length": 367, "proxy_request_id": "1270606:7:1825806:1104", "request_id": "1270606:7:1825806:1104", "request_type": "coder", "requested_output_tokens": 367, "session_id": "1270606", "t_dispatch_unix": 1779819602.512699, "t_finish_unix": 1779819607.1076539, "t_first_token_unix": 1779819603.1181626, "tpot_s": 0.010898824874375301, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 17887190, 17887191, 17887192, 17887193, 17887194, 17887195, 17887196, 17887197, 17887198, 17887199, 17887200, 17887201, 17887202, 17887203, 17887204, 17887205, 17887206, 17887207, 17887208, 17887209, 17887210, 17887211, 17887212, 17887213, 17887214, 17887215, 17887216, 17887217, 17887218, 17887219, 17887220, 17887221, 17887222, 17887223, 17887224, 17887225, 17887226, 17887227, 17887228, 17887229, 17887230, 17887231, 17887232, 17887233, 17887234, 17887235, 17887236, 17887237, 17887238, 17887239, 17887240, 17887241, 17887242, 17887243, 17887244, 17887245, 17887246, 17887247, 17887248, 17887249, 17887250, 17887251, 17887252, 17887253, 17887254, 17887255, 17887256, 17887257, 17887258, 17887259, 17887260, 17887261, 17887262, 17887263, 17887264, 17887265, 17887266, 17887267, 17887268, 17887269, 17887270, 17887271, 17887272, 17887273, 17887274, 17887275, 17887276, 17887277, 17887278, 17887279, 17887280, 17887281, 17887282, 17887283, 17887284, 17887285, 17887286, 17887287, 17887288, 17887289, 17887290, 17887291, 17887292, 17887293, 17887294, 17887295, 17887296, 17887297, 17887298, 17887299, 17887300, 17887301, 17887302], "trace_timestamp_s": 2008.7350000000006, "ttft_s": 0.6054619019851089, "turn_id": 7} +{"actual_output_tokens": 46, "cached_tokens": 53856, "effective_input_length": 58474, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58474, "latency_s": 2.0764137229998596, "output_length": 46, "proxy_request_id": "1277428:19:1834491:1105", "request_id": "1277428:19:1834491:1105", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1277428", "t_dispatch_unix": 1779819631.7901855, "t_finish_unix": 1779819633.8665988, "t_first_token_unix": 1779819633.5456998, "tpot_s": 0.007119840555565638, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 17970607, 17970608, 17970609, 17970610, 17970611, 17970612, 17970613, 17970614], "trace_timestamp_s": 2038.0340000000006, "ttft_s": 1.7555116779985838, "turn_id": 19} +{"actual_output_tokens": 45, "cached_tokens": 113008, "effective_input_length": 113482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113482, "latency_s": 1.0102430940023623, "output_length": 45, "proxy_request_id": "1270606:8:1837578:1106", "request_id": "1270606:8:1837578:1106", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1270606", "t_dispatch_unix": 1779819642.6182103, "t_finish_unix": 1779819643.628453, "t_first_token_unix": 1779819643.230046, "tpot_s": 0.0090477970225038, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18001581, 18001582, 18001583, 18001584, 18001585, 18001586, 18001587, 18001588, 18001589, 18001590, 18001591, 18001592, 18001593, 18001594, 18001595, 18001596, 18001597, 18001598, 18001599, 18001600, 18001601, 18001602, 18001603, 18001604, 18001605, 18001606, 18001607, 18001608, 18001609, 18001610, 18001611, 18001612, 18001613, 18001614, 18001615, 18001616, 18001617, 18001618, 18001619, 18001620, 18001621, 18001622, 18001623, 18001624, 18001625, 18001626, 18001627, 18001628, 18001629, 18001630, 18001631, 18001632, 18001633, 18001634, 18001635, 18001636, 18001637, 18001638, 18001639, 18001640, 18001641, 18001642, 18001643, 18001644, 18001645, 18001646, 18001647, 18001648, 18001649, 18001650, 18001651, 18001652, 18001653, 18001654, 18001655, 18001656, 18001657, 18001658, 18001659, 18001660, 18001661, 18001662, 18001663, 18001664, 18001665, 18001666, 18001667, 18001668, 18001669, 18001670, 18001671, 18001672, 18001673, 18001674, 18001675, 18001676, 18001677, 18001678, 18001679, 18001680, 18001681, 18001682, 18001683, 18001684, 18001685, 18001686, 18001687, 18001688, 18001689, 18001690, 18001691, 18001692], "trace_timestamp_s": 2048.8380000000006, "ttft_s": 0.61183341400465, "turn_id": 8} +{"actual_output_tokens": 10766, "cached_tokens": 112592, "effective_input_length": 112634, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112634, "latency_s": 125.08053881698288, "output_length": 10766, "proxy_request_id": "1253804:55:1803044:1095", "request_id": "1253804:55:1803044:1095", "request_type": "coder", "requested_output_tokens": 10766, "session_id": "1253804", "t_dispatch_unix": 1779819527.4058683, "t_finish_unix": 1779819652.4864066, "t_first_token_unix": 1779819527.6136904, "tpot_s": 0.011599836168788881, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 17676585, 17676586, 17676587, 17676588, 17676589, 17676590, 17676591, 17676592, 17676593, 17676594, 17676595, 17676596, 17676597, 17676598, 17676599, 17676600, 17676601, 17676602, 17676603, 17676604, 17676605, 17676606, 17676607, 17676608, 17676609, 17676610, 17676611, 17676612, 17676613, 17676614, 17676615, 17676616, 17676617, 17676618, 17676619, 17676620, 17676621, 17676622, 17676623, 17676624, 17676625, 17676626, 17676627, 17676628, 17676629, 5483415, 17676630, 17676631, 17676632, 17676633, 17676634, 17676635, 17676636, 17676637, 17676638, 17676639, 17676640, 17676641, 17676642, 17676643, 17676644, 17676645, 17676646, 17676647, 17676648, 17676649, 17676650, 17676651, 17676652, 17676653, 17676654, 17676655, 17676656, 17676657, 17676658, 17676659, 17676660, 17676661, 17676662, 17676663, 17676664, 17676665, 17676666, 17676667, 17676668, 17676669, 17676670, 17676671, 17676672, 17676673, 17676674, 17676675, 17676676, 17676677, 17676678, 17676679, 17676680, 17676681, 17676682, 17676683, 17676684, 17676685, 17676686, 17676687, 17676688, 17676689, 17676690, 17676691, 17676692, 17676693, 17676694, 17676695, 17676696, 17676697, 17676698, 17676699, 17676700, 17676701, 17676702, 17676703, 17676704, 17676705, 17676706, 17676707, 17676708, 17676709, 17676710, 17676711, 17676712, 17676713, 17676714, 17676715, 17676716, 17676717, 17676718, 17676719, 17676720, 17676721, 17676722, 17676723, 17676724, 17676725, 17676726, 17676727, 17676728, 17676729, 17676730, 17676731, 17676732, 17676733, 17676734, 17676735, 17676736, 17676737, 17676738], "trace_timestamp_s": 1933.6150000000007, "ttft_s": 0.20781936997082084, "turn_id": 55} +{"actual_output_tokens": 141, "cached_tokens": 113520, "effective_input_length": 116467, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 116467, "latency_s": 3.7885261659976095, "output_length": 141, "proxy_request_id": "1270606:9:1847569:1107", "request_id": "1270606:9:1847569:1107", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1270606", "t_dispatch_unix": 1779819676.5181148, "t_finish_unix": 1779819680.306641, "t_first_token_unix": 1779819678.8129134, "tpot_s": 0.010667263878193417, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18099243, 18099244, 18099245, 18099246, 18099247, 18099248, 18099249, 18099250, 18099251, 18099252, 18099253, 18099254, 18099255, 18099256, 18099257, 18099258, 18099259, 18099260, 18099261, 18099262, 18099263, 18099264, 18099265, 18099266, 18099267, 18099268, 18099269, 18099270, 18099271, 18099272, 18099273, 18099274, 18099275, 18099276, 18099277, 18099278, 18099279, 18099280, 18099281, 18099282, 18099283, 18099284, 18099285, 18099286, 18099287, 18099288, 18099289, 18099290, 18099291, 18099292, 18099293, 18099294, 18099295, 18099296, 18099297, 18099298, 18099299, 18099300, 18099301, 18099302, 18099303, 18099304, 18099305, 18099306, 18099307, 18099308, 18099309, 18099310, 18099311, 18099312, 18099313, 18099314, 18099315, 18099316, 18099317, 18099318, 18099319, 18099320, 18099321, 18099322, 18099323, 18099324, 18099325, 18099326, 18099327, 18099328, 18099329, 18099330, 18099331, 18099332, 18099333, 18099334, 18099335, 18099336, 18099337, 18099338, 18099339, 18099340, 18099341, 18099342, 18099343, 18099344, 18099345, 18099346, 18099347, 18099348, 18099349, 18099350, 18099351, 18099352, 18099353, 18099354, 18099355, 18099356, 18099357, 18099358, 18099359, 18099360], "trace_timestamp_s": 2082.7170000000006, "ttft_s": 2.294794884044677, "turn_id": 9} +{"actual_output_tokens": 73, "cached_tokens": 116592, "effective_input_length": 116659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 116659, "latency_s": 1.0165739640360698, "output_length": 73, "proxy_request_id": "1270606:10:1851128:1108", "request_id": "1270606:10:1851128:1108", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1270606", "t_dispatch_unix": 1779819688.6027253, "t_finish_unix": 1779819689.6192997, "t_first_token_unix": 1779819688.8929567, "tpot_s": 0.010084198888863385, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18099243, 18099244, 18099245, 18099246, 18099247, 18133288, 18133289, 18133290, 18133291, 18133292, 18133293, 18133294, 18133295, 18133296, 18133297, 18133298, 18133299, 18133300, 18133301, 18133302, 18133303, 18133304, 18133305, 18133306, 18133307, 18133308, 18133309, 18133310, 18133311, 18133312, 18133313, 18133314, 18133315, 18133316, 18133317, 18133318, 18133319, 18133320, 18133321, 18133322, 18133323, 18133324, 18133325, 18133326, 18133327, 18133328, 18133329, 18133330, 18133331, 18133332, 18133333, 18133334, 18133335, 18133336, 18133337, 18133338, 18133339, 18133340, 18133341, 18133342, 18133343, 18133344, 18133345, 18133346, 18133347, 18133348, 18133349, 18133350, 18133351, 18133352, 18133353, 18133354, 18133355, 18133356, 18133357, 18133358, 18133359, 18133360, 18133361, 18133362, 18133363, 18133364, 18133365, 18133366, 18133367, 18133368, 18133369, 18133370, 18133371, 18133372, 18133373, 18133374, 18133375, 18133376, 18133377, 18133378, 18133379, 18133380, 18133381, 18133382, 18133383, 18133384, 18133385, 18133386, 18133387, 18133388, 18133389, 18133390, 18133391, 18133392, 18133393, 18133394, 18133395, 18133396, 18133397, 18133398, 18133399, 18133400], "trace_timestamp_s": 2094.818, "ttft_s": 0.2902279910049401, "turn_id": 10} +{"actual_output_tokens": 279, "cached_tokens": 54816, "effective_input_length": 58042, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58042, "latency_s": 3.5529565420001745, "output_length": 279, "proxy_request_id": "1305906:7:1851943:1109", "request_id": "1305906:7:1851943:1109", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1305906", "t_dispatch_unix": 1779819691.1473713, "t_finish_unix": 1779819694.7003272, "t_first_token_unix": 1779819692.4691246, "tpot_s": 0.008024856219530481, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18141935], "trace_timestamp_s": 2097.389, "ttft_s": 1.3217511489638127, "turn_id": 7} +{"actual_output_tokens": 234, "cached_tokens": 58320, "effective_input_length": 58687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58687, "latency_s": 2.2041529190028086, "output_length": 234, "proxy_request_id": "1305906:8:1866131:1110", "request_id": "1305906:8:1866131:1110", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1305906", "t_dispatch_unix": 1779819739.6180112, "t_finish_unix": 1779819741.8221638, "t_first_token_unix": 1779819739.9576533, "tpot_s": 0.008000898450740928, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18280928], "trace_timestamp_s": 2145.857, "ttft_s": 0.3396394230076112, "turn_id": 8} +{"actual_output_tokens": 157, "cached_tokens": 116720, "effective_input_length": 117828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117828, "latency_s": 2.748548283998389, "output_length": 157, "proxy_request_id": "1270606:11:1868274:1111", "request_id": "1270606:11:1868274:1111", "request_type": "coder", "requested_output_tokens": 157, "session_id": "1270606", "t_dispatch_unix": 1779819746.8873177, "t_finish_unix": 1779819749.6358654, "t_first_token_unix": 1779819747.9351485, "tpot_s": 0.010899927365244366, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18302637, 18302638, 18302639, 18302640, 18302641, 18302642, 18302643, 18302644, 18302645, 18302646, 18302647, 18302648, 18302649, 18302650, 18302651, 18302652, 18302653, 18302654, 18302655, 18302656, 18302657, 18302658, 18302659, 18302660, 18302661, 18302662, 18302663, 18302664, 18302665, 18302666, 18302667, 18302668, 18302669, 18302670, 18302671, 18302672, 18302673, 18302674, 18302675, 18302676, 18302677, 18302678, 18302679, 18302680, 18302681, 18302682, 18302683, 18302684, 18302685, 18302686, 18302687, 18302688, 18302689, 18302690, 18302691, 18302692, 18302693, 18302694, 18302695, 18302696, 18302697, 18302698, 18302699, 18302700, 18302701, 18302702, 18302703, 18302704, 18302705, 18302706, 18302707, 18302708, 18302709, 18302710, 18302711, 18302712, 18302713, 18302714, 18302715, 18302716, 18302717, 18302718, 18302719, 18302720, 18302721, 18302722, 18302723, 18302724, 18302725, 18302726, 18302727, 18302728, 18302729, 18302730, 18302731, 18302732, 18302733, 18302734, 18302735, 18302736, 18302737, 18302738, 18302739, 18302740, 18302741, 18302742, 18302743, 18302744, 18302745, 18302746, 18302747, 18302748, 18302749], "trace_timestamp_s": 2153.103, "ttft_s": 1.0478260520030744, "turn_id": 11} +{"actual_output_tokens": 51, "cached_tokens": 117984, "effective_input_length": 118012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118012, "latency_s": 0.6977419860195369, "output_length": 51, "proxy_request_id": "1270606:11:1870810:1113", "request_id": "1270606:11:1870810:1113", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1270606", "t_dispatch_unix": 1779819755.3820767, "t_finish_unix": 1779819756.0798185, "t_first_token_unix": 1779819755.5965858, "tpot_s": 0.009659576440462843, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18328449, 18328450, 18328451, 18328452, 18328453, 18328454, 18328455, 18328456, 18328457, 18328458, 18328459, 18328460, 18328461, 18328462, 18328463, 18328464, 18328465, 18328466, 18328467, 18328468, 18328469, 18328470, 18328471, 18328472, 18328473, 18328474, 18328475, 18328476, 18328477, 18328478, 18328479, 18328480, 18328481, 18328482, 18328483, 18328484, 18328485, 18328486, 18328487, 18328488, 18328489, 18328490, 18328491, 18328492, 18328493, 18328494, 18328495, 18328496, 18328497, 18328498, 18328499, 18328500, 18328501, 18328502, 18328503, 18328504, 18328505, 18328506, 18328507, 18328508, 18328509, 18328510, 18328511, 18328512, 18328513, 18328514, 18328515, 18328516, 18328517, 18328518, 18328519, 18328520, 18328521, 18328522, 18328523, 18328524, 18328525, 18328526, 18328527, 18328528, 18328529, 18328530, 18328531, 18328532, 18328533, 18328534, 18328535, 18328536, 18328537, 18328538, 18328539, 18328540, 18328541, 18328542, 18328543, 18328544, 18328545, 18328546, 18328547, 18328548, 18328549, 18328550, 18328551, 18328552, 18328553, 18328554, 18328555, 18328556, 18328557, 18328558, 18328559, 18328560, 18328561], "trace_timestamp_s": 2161.6060000000007, "ttft_s": 0.2145067949895747, "turn_id": 11} +{"actual_output_tokens": 211, "cached_tokens": 134928, "effective_input_length": 135435, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 135435, "latency_s": 3.2142725320300087, "output_length": 211, "proxy_request_id": "1356885:12:1874205:1114", "request_id": "1356885:12:1874205:1114", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1356885", "t_dispatch_unix": 1779819766.8445446, "t_finish_unix": 1779819770.0588167, "t_first_token_unix": 1779819767.5586016, "tpot_s": 0.011904587147624365, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18360942], "trace_timestamp_s": 2173.0870000000004, "ttft_s": 0.7140536720398813, "turn_id": 12} +{"actual_output_tokens": 436, "cached_tokens": 40304, "effective_input_length": 40328, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40328, "latency_s": 3.171861097041983, "output_length": 436, "proxy_request_id": "1340290:17:1875101:1115", "request_id": "1340290:17:1875101:1115", "request_type": "coder", "requested_output_tokens": 436, "session_id": "1340290", "t_dispatch_unix": 1779819769.7870672, "t_finish_unix": 1779819772.9589283, "t_first_token_unix": 1779819769.8790865, "tpot_s": 0.007079461666664387, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956], "trace_timestamp_s": 2176.0350000000008, "ttft_s": 0.09201711701462045, "turn_id": 17} +{"actual_output_tokens": 194, "cached_tokens": 118048, "effective_input_length": 118600, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118600, "latency_s": 2.7579774959594943, "output_length": 194, "proxy_request_id": "1270606:12:1876851:1116", "request_id": "1270606:12:1876851:1116", "request_type": "coder", "requested_output_tokens": 194, "session_id": "1270606", "t_dispatch_unix": 1779819775.743954, "t_finish_unix": 1779819778.501931, "t_first_token_unix": 1779819776.3757992, "tpot_s": 0.011013382051738433, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18387421, 18387422, 18387423, 18387424, 18387425, 18387426, 18387427, 18387428, 18387429, 18387430, 18387431, 18387432, 18387433, 18387434, 18387435, 18387436, 18387437, 18387438, 18387439, 18387440, 18387441, 18387442, 18387443, 18387444, 18387445, 18387446, 18387447, 18387448, 18387449, 18387450, 18387451, 18387452, 18387453, 18387454, 18387455, 18387456, 18387457, 18387458, 18387459, 18387460, 18387461, 18387462, 18387463, 18387464, 18387465, 18387466, 18387467, 18387468, 18387469, 18387470, 18387471, 18387472, 18387473, 18387474, 18387475, 18387476, 18387477, 18387478, 18387479, 18387480, 18387481, 18387482, 18387483, 18387484, 18387485, 18387486, 18387487, 18387488, 18387489, 18387490, 18387491, 18387492, 18387493, 18387494, 18387495, 18387496, 18387497, 18387498, 18387499, 18387500, 18387501, 18387502, 18387503, 18387504, 18387505, 18387506, 18387507, 18387508, 18387509, 18387510, 18387511, 18387512, 18387513, 18387514, 18387515, 18387516, 18387517, 18387518, 18387519, 18387520, 18387521, 18387522, 18387523, 18387524, 18387525, 18387526, 18387527, 18387528, 18387529, 18387530, 18387531, 18387532, 18387533], "trace_timestamp_s": 2181.9670000000006, "ttft_s": 0.6318423060001805, "turn_id": 12} +{"actual_output_tokens": 34, "cached_tokens": 40576, "effective_input_length": 40583, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40583, "latency_s": 0.2861973160179332, "output_length": 34, "proxy_request_id": "1340290:18:1878955:1117", "request_id": "1340290:18:1878955:1117", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1340290", "t_dispatch_unix": 1779819783.4646285, "t_finish_unix": 1779819783.7508252, "t_first_token_unix": 1779819783.5467591, "tpot_s": 0.006176429726606743, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18407653], "trace_timestamp_s": 2189.7110000000002, "ttft_s": 0.08212927600834519, "turn_id": 18} +{"actual_output_tokens": 82, "cached_tokens": 40608, "effective_input_length": 40676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40676, "latency_s": 0.6666594769922085, "output_length": 82, "proxy_request_id": "1340290:19:1880565:1118", "request_id": "1340290:19:1880565:1118", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1340290", "t_dispatch_unix": 1779819788.7362564, "t_finish_unix": 1779819789.4029152, "t_first_token_unix": 1779819788.8557127, "tpot_s": 0.006752264246856219, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18422775], "trace_timestamp_s": 2194.9840000000004, "ttft_s": 0.1194547539926134, "turn_id": 19} +{"actual_output_tokens": 49, "cached_tokens": 40752, "effective_input_length": 40883, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40883, "latency_s": 0.44739920395659283, "output_length": 49, "proxy_request_id": "1340290:20:1882251:1120", "request_id": "1340290:20:1882251:1120", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1340290", "t_dispatch_unix": 1779819794.5454464, "t_finish_unix": 1779819794.992845, "t_first_token_unix": 1779819794.6757717, "tpot_s": 0.006600438687504114, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436], "trace_timestamp_s": 2200.7930000000006, "ttft_s": 0.1303233769722283, "turn_id": 20} +{"actual_output_tokens": 355, "cached_tokens": 118784, "effective_input_length": 119030, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119030, "latency_s": 4.387585494027007, "output_length": 355, "proxy_request_id": "1270606:12:1881189:1119", "request_id": "1270606:12:1881189:1119", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1270606", "t_dispatch_unix": 1779819791.1325917, "t_finish_unix": 1779819795.5201766, "t_first_token_unix": 1779819791.5426543, "tpot_s": 0.011235099756928414, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18428324, 18428325, 18428326, 18428327, 18428328, 18428329, 18428330, 18428331, 18428332, 18428333, 18428334, 18428335, 18428336, 18428337, 18428338, 18428339, 18428340, 18428341, 18428342, 18428343, 18428344, 18428345, 18428346, 18428347, 18428348, 18428349, 18428350, 18428351, 18428352, 18428353, 18428354, 18428355, 18428356, 18428357, 18428358, 18428359, 18428360, 18428361, 18428362, 18428363, 18428364, 18428365, 18428366, 18428367, 18428368, 18428369, 18428370, 18428371, 18428372, 18428373, 18428374, 18428375, 18428376, 18428377, 18428378, 18428379, 18428380, 18428381, 18428382, 18428383, 18428384, 18428385, 18428386, 18428387, 18428388, 18428389, 18428390, 18428391, 18428392, 18428393, 18428394, 18428395, 18428396, 18428397, 18428398, 18428399, 18428400, 18428401, 18428402, 18428403, 18428404, 18428405, 18428406, 18428407, 18428408, 18428409, 18428410, 18428411, 18428412, 18428413, 18428414, 18428415, 18428416, 18428417, 18428418, 18428419, 18428420, 18428421, 18428422, 18428423, 18428424, 18428425, 18428426, 18428427, 18428428, 18428429, 18428430, 18428431, 18428432, 18428433, 18428434, 18428435, 18428436], "trace_timestamp_s": 2197.3560000000007, "ttft_s": 0.41006002004723996, "turn_id": 12} +{"actual_output_tokens": 39, "cached_tokens": 40928, "effective_input_length": 41002, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41002, "latency_s": 0.3690231880173087, "output_length": 39, "proxy_request_id": "1340290:21:1883855:1121", "request_id": "1340290:21:1883855:1121", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1340290", "t_dispatch_unix": 1779819800.0140498, "t_finish_unix": 1779819800.383073, "t_first_token_unix": 1779819800.1377656, "tpot_s": 0.006447755710197319, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18454570], "trace_timestamp_s": 2206.2620000000006, "ttft_s": 0.12371310300659388, "turn_id": 21} +{"actual_output_tokens": 51, "cached_tokens": 41040, "effective_input_length": 41909, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41909, "latency_s": 0.6766295860288665, "output_length": 51, "proxy_request_id": "1340290:22:1884847:1122", "request_id": "1340290:22:1884847:1122", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1340290", "t_dispatch_unix": 1779819803.4875748, "t_finish_unix": 1779819804.1642041, "t_first_token_unix": 1779819803.8332896, "tpot_s": 0.006612498059403151, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633], "trace_timestamp_s": 2209.7340000000004, "ttft_s": 0.3457128250156529, "turn_id": 22} +{"actual_output_tokens": 4631, "cached_tokens": 112912, "effective_input_length": 112926, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112926, "latency_s": 52.70093741401797, "output_length": 4631, "proxy_request_id": "1253804:55:1869941:1112", "request_id": "1253804:55:1869941:1112", "request_type": "coder", "requested_output_tokens": 4631, "session_id": "1253804", "t_dispatch_unix": 1779819752.5173664, "t_finish_unix": 1779819805.2183032, "t_first_token_unix": 1779819752.6999097, "tpot_s": 0.011342956317067207, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 17676585, 17676586, 17676587, 17676588, 17676589, 17676590, 17676591, 17676592, 17676593, 17676594, 17676595, 17676596, 17676597, 17676598, 17676599, 17676600, 17676601, 17676602, 17676603, 17676604, 17676605, 17676606, 17676607, 17676608, 17676609, 17676610, 17676611, 17676612, 17676613, 17676614, 17676615, 17676616, 17676617, 17676618, 17676619, 17676620, 17676621, 17676622, 17676623, 17676624, 17676625, 17676626, 17676627, 17676628, 17676629, 5483415, 17676630, 17676631, 17676632, 17676633, 17676634, 17676635, 17676636, 17676637, 17676638, 17676639, 17676640, 17676641, 17676642, 17676643, 17676644, 17676645, 17676646, 17676647, 17676648, 17676649, 17676650, 17676651, 17676652, 17676653, 17676654, 17676655, 17676656, 17676657, 17676658, 17676659, 17676660, 17676661, 17676662, 17676663, 17676664, 17676665, 17676666, 17676667, 17676668, 17676669, 17676670, 17676671, 17676672, 17676673, 17676674, 17676675, 17676676, 17676677, 17676678, 17676679, 17676680, 17676681, 17676682, 17676683, 17676684, 17676685, 17676686, 17676687, 17676688, 17676689, 17676690, 17676691, 17676692, 17676693, 17676694, 17676695, 17676696, 17676697, 17676698, 17676699, 17676700, 17676701, 17676702, 17676703, 17676704, 17676705, 17676706, 17676707, 17676708, 18319657, 18319658, 18319659, 18319660, 18319661, 18319662, 18319663, 18319664, 18319665, 18319666, 18319667, 18319668, 18319669, 18319670, 18319671, 18319672, 18319673, 18319674, 18319675, 18319676, 18319677, 18319678, 18319679, 18319680, 18319681, 18319682, 18319683, 18319684, 18319685, 18319686, 18319687], "trace_timestamp_s": 2158.754000000001, "ttft_s": 0.18254127900581807, "turn_id": 55} +{"actual_output_tokens": 45, "cached_tokens": 41952, "effective_input_length": 42086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42086, "latency_s": 0.41404603800037876, "output_length": 45, "proxy_request_id": "1340290:23:1886013:1124", "request_id": "1340290:23:1886013:1124", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1340290", "t_dispatch_unix": 1779819807.5176184, "t_finish_unix": 1779819807.9316645, "t_first_token_unix": 1779819807.645484, "tpot_s": 0.006497316385238347, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18475697], "trace_timestamp_s": 2213.763, "ttft_s": 0.12786341604078189, "turn_id": 23} +{"actual_output_tokens": 98, "cached_tokens": 119376, "effective_input_length": 119440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119440, "latency_s": 1.2972541759954765, "output_length": 98, "proxy_request_id": "1270606:12:1886765:1125", "request_id": "1270606:12:1886765:1125", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1270606", "t_dispatch_unix": 1779819810.2507837, "t_finish_unix": 1779819811.5480373, "t_first_token_unix": 1779819810.5270102, "tpot_s": 0.010523196175387226, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18483775, 18483776, 18483777, 18483778, 18483779, 18483780, 18483781, 18483782, 18483783, 18483784, 18483785, 18483786, 18483787, 18483788, 18483789, 18483790, 18483791, 18483792, 18483793, 18483794, 18483795, 18483796, 18483797, 18483798, 18483799, 18483800, 18483801, 18483802, 18483803, 18483804, 18483805, 18483806, 18483807, 18483808, 18483809, 18483810, 18483811, 18483812, 18483813, 18483814, 18483815, 18483816, 18483817, 18483818, 18483819, 18483820, 18483821, 18483822, 18483823, 18483824, 18483825, 18483826, 18483827, 18483828, 18483829, 18483830, 18483831, 18483832, 18483833, 18483834, 18483835, 18483836, 18483837, 18483838, 18483839, 18483840, 18483841, 18483842, 18483843, 18483844, 18483845, 18483846, 18483847, 18483848, 18483849, 18483850, 18483851, 18483852, 18483853, 18483854, 18483855, 18483856, 18483857, 18483858, 18483859, 18483860, 18483861, 18483862, 18483863, 18483864, 18483865, 18483866, 18483867, 18483868, 18483869, 18483870, 18483871, 18483872, 18483873, 18483874, 18483875, 18483876, 18483877, 18483878, 18483879, 18483880, 18483881, 18483882, 18483883, 18483884, 18483885, 18483886, 18483887], "trace_timestamp_s": 2216.473, "ttft_s": 0.27622462197905406, "turn_id": 12} +{"actual_output_tokens": 28, "cached_tokens": 42128, "effective_input_length": 42199, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42199, "latency_s": 0.28802450001239777, "output_length": 28, "proxy_request_id": "1340290:24:1887125:1126", "request_id": "1340290:24:1887125:1126", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1340290", "t_dispatch_unix": 1779819811.2936344, "t_finish_unix": 1779819811.5816586, "t_first_token_unix": 1779819811.4199982, "tpot_s": 0.005976804480370548, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18487325], "trace_timestamp_s": 2217.541, "ttft_s": 0.12636149604804814, "turn_id": 24} +{"actual_output_tokens": 46, "cached_tokens": 42224, "effective_input_length": 42444, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42444, "latency_s": 0.4671291320119053, "output_length": 46, "proxy_request_id": "1340290:25:1888447:1127", "request_id": "1340290:25:1888447:1127", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1340290", "t_dispatch_unix": 1779819815.6862988, "t_finish_unix": 1779819816.153428, "t_first_token_unix": 1779819815.8581338, "tpot_s": 0.006555973310282247, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279], "trace_timestamp_s": 2221.934, "ttft_s": 0.17183277301955968, "turn_id": 25} +{"actual_output_tokens": 1188, "cached_tokens": 58512, "effective_input_length": 63845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63845, "latency_s": 12.259311530040577, "output_length": 1188, "proxy_request_id": "1277428:20:1885419:1123", "request_id": "1277428:20:1885419:1123", "request_type": "coder", "requested_output_tokens": 1188, "session_id": "1277428", "t_dispatch_unix": 1779819805.4009287, "t_finish_unix": 1779819817.66024, "t_first_token_unix": 1779819807.631844, "tpot_s": 0.008448290335278873, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 18468806, 18468807, 18468808, 18468809, 18468810, 18468811, 18468812, 18468813, 18468814, 18468815, 18468816, 18468817, 18468818], "trace_timestamp_s": 2211.6440000000002, "ttft_s": 2.2309128180495463, "turn_id": 20} +{"actual_output_tokens": 32, "cached_tokens": 42480, "effective_input_length": 48504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48504, "latency_s": 2.1034711949760094, "output_length": 32, "proxy_request_id": "1340290:26:1889402:1128", "request_id": "1340290:26:1889402:1128", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1340290", "t_dispatch_unix": 1779819819.0056186, "t_finish_unix": 1779819821.1090896, "t_first_token_unix": 1779819820.9118032, "tpot_s": 0.006356124646000324, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944], "trace_timestamp_s": 2225.25, "ttft_s": 1.9061810149578378, "turn_id": 26} +{"actual_output_tokens": 87, "cached_tokens": 119536, "effective_input_length": 119686, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119686, "latency_s": 1.2975994239677675, "output_length": 87, "proxy_request_id": "1270606:13:1890252:1129", "request_id": "1270606:13:1890252:1129", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1270606", "t_dispatch_unix": 1779819821.9794328, "t_finish_unix": 1779819823.2770321, "t_first_token_unix": 1779819822.3831143, "tpot_s": 0.010390747813670354, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18517741, 18517742, 18517743, 18517744, 18517745, 18517746, 18517747, 18517748, 18517749, 18517750, 18517751, 18517752, 18517753, 18517754, 18517755, 18517756, 18517757, 18517758, 18517759, 18517760, 18517761, 18517762, 18517763, 18517764, 18517765, 18517766, 18517767, 18517768, 18517769, 18517770, 18517771, 18517772, 18517773, 18517774, 18517775, 18517776, 18517777, 18517778, 18517779, 18517780, 18517781, 18517782, 18517783, 18517784, 18517785, 18517786, 18517787, 18517788, 18517789, 18517790, 18517791, 18517792, 18517793, 18517794, 18517795, 18517796, 18517797, 18517798, 18517799, 18517800, 18517801, 18517802, 18517803, 18517804, 18517805, 18517806, 18517807, 18517808, 18517809, 18517810, 18517811, 18517812, 18517813, 18517814, 18517815, 18517816, 18517817, 18517818, 18517819, 18517820, 18517821, 18517822, 18517823, 18517824, 18517825, 18517826, 18517827, 18517828, 18517829, 18517830, 18517831, 18517832, 18517833, 18517834, 18517835, 18517836, 18517837, 18517838, 18517839, 18517840, 18517841, 18517842, 18517843, 18517844, 18517845, 18517846, 18517847, 18517848, 18517849, 18517850, 18517851, 18517852, 18517853], "trace_timestamp_s": 2228.202, "ttft_s": 0.40367778699146584, "turn_id": 13} +{"actual_output_tokens": 47, "cached_tokens": 48528, "effective_input_length": 49361, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49361, "latency_s": 0.7079954319633543, "output_length": 47, "proxy_request_id": "1340290:27:1892591:1131", "request_id": "1340290:27:1892591:1131", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1340290", "t_dispatch_unix": 1779819829.592594, "t_finish_unix": 1779819830.300589, "t_first_token_unix": 1779819829.986967, "tpot_s": 0.0068113814998904, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18539337], "trace_timestamp_s": 2235.84, "ttft_s": 0.39437156496569514, "turn_id": 27} +{"actual_output_tokens": 175, "cached_tokens": 119760, "effective_input_length": 119828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119828, "latency_s": 2.2304083119961433, "output_length": 175, "proxy_request_id": "1270606:14:1892412:1130", "request_id": "1270606:14:1892412:1130", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1270606", "t_dispatch_unix": 1779819828.920705, "t_finish_unix": 1779819831.151113, "t_first_token_unix": 1779819829.233602, "tpot_s": 0.011018362804851228, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18537949, 18537950, 18537951, 18537952, 18537953, 18537954, 18537955, 18537956, 18537957, 18537958, 18537959, 18537960, 18537961, 18537962, 18537963, 18537964, 18537965, 18537966, 18537967, 18537968, 18537969, 18537970, 18537971, 18537972, 18537973, 18537974, 18537975, 18537976, 18537977, 18537978, 18537979, 18537980, 18537981, 18537982, 18537983, 18537984, 18537985, 18537986, 18537987, 18537988, 18537989, 18537990, 18537991, 18537992, 18537993, 18537994, 18537995, 18537996, 18537997, 18537998, 18537999, 18538000, 18538001, 18538002, 18538003, 18538004, 18538005, 18538006, 18538007, 18538008, 18538009, 18538010, 18538011, 18538012, 18538013, 18538014, 18538015, 18538016, 18538017, 18538018, 18538019, 18538020, 18538021, 18538022, 18538023, 18538024, 18538025, 18538026, 18538027, 18538028, 18538029, 18538030, 18538031, 18538032, 18538033, 18538034, 18538035, 18538036, 18538037, 18538038, 18538039, 18538040, 18538041, 18538042, 18538043, 18538044, 18538045, 18538046, 18538047, 18538048, 18538049, 18538050, 18538051, 18538052, 18538053, 18538054, 18538055, 18538056, 18538057, 18538058, 18538059, 18538060, 18538061, 18538062], "trace_timestamp_s": 2235.143, "ttft_s": 0.3128941479953937, "turn_id": 14} +{"actual_output_tokens": 38, "cached_tokens": 49392, "effective_input_length": 49454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49454, "latency_s": 0.37253566400613636, "output_length": 38, "proxy_request_id": "1340290:28:1893837:1132", "request_id": "1340290:28:1893837:1132", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1340290", "t_dispatch_unix": 1779819833.9000401, "t_finish_unix": 1779819834.2725754, "t_first_token_unix": 1779819834.0301049, "tpot_s": 0.0065455538916049175, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462], "trace_timestamp_s": 2240.1460000000006, "ttft_s": 0.13006279803812504, "turn_id": 28} +{"actual_output_tokens": 80, "cached_tokens": 58912, "effective_input_length": 59265, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59265, "latency_s": 0.9393338210065849, "output_length": 80, "proxy_request_id": "1305906:9:1893880:1133", "request_id": "1305906:9:1893880:1133", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1305906", "t_dispatch_unix": 1779819834.06659, "t_finish_unix": 1779819835.0059233, "t_first_token_unix": 1779819834.425675, "tpot_s": 0.007341070785157712, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509], "trace_timestamp_s": 2240.313, "ttft_s": 0.3590835430077277, "turn_id": 9} +{"actual_output_tokens": 91, "cached_tokens": 120000, "effective_input_length": 120058, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 120058, "latency_s": 1.2654914720333181, "output_length": 91, "proxy_request_id": "1270606:15:1895310:1134", "request_id": "1270606:15:1895310:1134", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1270606", "t_dispatch_unix": 1779819838.7134433, "t_finish_unix": 1779819839.9789252, "t_first_token_unix": 1779819839.0277627, "tpot_s": 0.01056081804433941, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18566130, 18566131, 18566132, 18566133, 18566134, 18566135, 18566136, 18566137, 18566138, 18566139, 18566140, 18566141, 18566142, 18566143, 18566144, 18566145, 18566146, 18566147, 18566148, 18566149, 18566150, 18566151, 18566152, 18566153, 18566154, 18566155, 18566156, 18566157, 18566158, 18566159, 18566160, 18566161, 18566162, 18566163, 18566164, 18566165, 18566166, 18566167, 18566168, 18566169, 18566170, 18566171, 18566172, 18566173, 18566174, 18566175, 18566176, 18566177, 18566178, 18566179, 18566180, 18566181, 18566182, 18566183, 18566184, 18566185, 18566186, 18566187, 18566188, 18566189, 18566190, 18566191, 18566192, 18566193, 18566194, 18566195, 18566196, 18566197, 18566198, 18566199, 18566200, 18566201, 18566202, 18566203, 18566204, 18566205, 18566206, 18566207, 18566208, 18566209, 18566210, 18566211, 18566212, 18566213, 18566214, 18566215, 18566216, 18566217, 18566218, 18566219, 18566220, 18566221, 18566222, 18566223, 18566224, 18566225, 18566226, 18566227, 18566228, 18566229, 18566230, 18566231, 18566232, 18566233, 18566234, 18566235, 18566236, 18566237, 18566238, 18566239, 18566240, 18566241, 18566242], "trace_timestamp_s": 2244.9320000000007, "ttft_s": 0.31432630703784525, "turn_id": 15} +{"actual_output_tokens": 37, "cached_tokens": 49488, "effective_input_length": 49576, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49576, "latency_s": 0.3642484350129962, "output_length": 37, "proxy_request_id": "1340290:29:1896119:1136", "request_id": "1340290:29:1896119:1136", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1340290", "t_dispatch_unix": 1779819841.2254107, "t_finish_unix": 1779819841.5896587, "t_first_token_unix": 1779819841.3541133, "tpot_s": 0.0065347179996832795, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462], "trace_timestamp_s": 2247.473, "ttft_s": 0.12869995401706547, "turn_id": 29} +{"actual_output_tokens": 200, "cached_tokens": 135632, "effective_input_length": 135905, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 135905, "latency_s": 2.87204909499269, "output_length": 200, "proxy_request_id": "1356885:13:1895311:1135", "request_id": "1356885:13:1895311:1135", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1356885", "t_dispatch_unix": 1779819838.7257307, "t_finish_unix": 1779819841.5977788, "t_first_token_unix": 1779819839.210025, "tpot_s": 0.011997394165756584, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 18566244], "trace_timestamp_s": 2244.933, "ttft_s": 0.4842929230071604, "turn_id": 13} +{"actual_output_tokens": 200, "cached_tokens": 49600, "effective_input_length": 49695, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49695, "latency_s": 1.6158881360315718, "output_length": 200, "proxy_request_id": "1340290:30:1896991:1137", "request_id": "1340290:30:1896991:1137", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1340290", "t_dispatch_unix": 1779819844.1982489, "t_finish_unix": 1779819845.814137, "t_first_token_unix": 1779819844.3344982, "tpot_s": 0.007433769643252912, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18582285], "trace_timestamp_s": 2250.4440000000004, "ttft_s": 0.13624655798776075, "turn_id": 30} +{"actual_output_tokens": 89, "cached_tokens": 49888, "effective_input_length": 49927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49927, "latency_s": 0.7565383030450903, "output_length": 89, "proxy_request_id": "1340290:31:1899492:1138", "request_id": "1340290:31:1899492:1138", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1340290", "t_dispatch_unix": 1779819852.5838048, "t_finish_unix": 1779819853.340343, "t_first_token_unix": 1779819852.6939692, "tpot_s": 0.007341830590369434, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609], "trace_timestamp_s": 2258.8240000000005, "ttft_s": 0.11016209004446864, "turn_id": 31} +{"actual_output_tokens": 89, "cached_tokens": 120144, "effective_input_length": 120572, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 120572, "latency_s": 1.7008350900141522, "output_length": 89, "proxy_request_id": "1270606:16:1902252:1140", "request_id": "1270606:16:1902252:1140", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1270606", "t_dispatch_unix": 1779819861.0758467, "t_finish_unix": 1779819862.7766814, "t_first_token_unix": 1779819861.8474243, "tpot_s": 0.010556360306509305, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18635959, 18635960, 18635961, 18635962, 18635963, 18635964, 18635965, 18635966, 18635967, 18635968, 18635969, 18635970, 18635971, 18635972, 18635973, 18635974, 18635975, 18635976, 18635977, 18635978, 18635979, 18635980, 18635981, 18635982, 18635983, 18635984, 18635985, 18635986, 18635987, 18635988, 18635989, 18635990, 18635991, 18635992, 18635993, 18635994, 18635995, 18635996, 18635997, 18635998, 18635999, 18636000, 18636001, 18636002, 18636003, 18636004, 18636005, 18636006, 18636007, 18636008, 18636009, 18636010, 18636011, 18636012, 18636013, 18636014, 18636015, 18636016, 18636017, 18636018, 18636019, 18636020, 18636021, 18636022, 18636023, 18636024, 18636025, 18636026, 18636027, 18636028, 18636029, 18636030, 18636031, 18636032, 18636033, 18636034, 18636035, 18636036, 18636037, 18636038, 18636039, 18636040, 18636041, 18636042, 18636043, 18636044, 18636045, 18636046, 18636047, 18636048, 18636049, 18636050, 18636051, 18636052, 18636053, 18636054, 18636055, 18636056, 18636057, 18636058, 18636059, 18636060, 18636061, 18636062, 18636063, 18636064, 18636065, 18636066, 18636067, 18636068, 18636069, 18636070, 18636071], "trace_timestamp_s": 2267.299, "ttft_s": 0.7715751230134629, "turn_id": 16} +{"actual_output_tokens": 60, "cached_tokens": 120656, "effective_input_length": 121006, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121006, "latency_s": 1.2198927690042183, "output_length": 60, "proxy_request_id": "1270606:17:1908800:1141", "request_id": "1270606:17:1908800:1141", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1270606", "t_dispatch_unix": 1779819882.6715915, "t_finish_unix": 1779819883.891484, "t_first_token_unix": 1779819883.3023639, "tpot_s": 0.009979835304952526, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18700457, 18700458, 18700459, 18700460, 18700461, 18700462, 18700463, 18700464, 18700465, 18700466, 18700467, 18700468, 18700469, 18700470, 18700471, 18700472, 18700473, 18700474, 18700475, 18700476, 18700477, 18700478, 18700479, 18700480, 18700481, 18700482, 18700483, 18700484, 18700485, 18700486, 18700487, 18700488, 18700489, 18700490, 18700491, 18700492, 18700493, 18700494, 18700495, 18700496, 18700497, 18700498, 18700499, 18700500, 18700501, 18700502, 18700503, 18700504, 18700505, 18700506, 18700507, 18700508, 18700509, 18700510, 18700511, 18700512, 18700513, 18700514, 18700515, 18700516, 18700517, 18700518, 18700519, 18700520, 18700521, 18700522, 18700523, 18700524, 18700525, 18700526, 18700527, 18700528, 18700529, 18700530, 18700531, 18700532, 18700533, 18700534, 18700535, 18700536, 18700537, 18700538, 18700539, 18700540, 18700541, 18700542, 18700543, 18700544, 18700545, 18700546, 18700547, 18700548, 18700549, 18700550, 18700551, 18700552, 18700553, 18700554, 18700555, 18700556, 18700557, 18700558, 18700559, 18700560, 18700561, 18700562, 18700563, 18700564, 18700565, 18700566, 18700567, 18700568, 18700569], "trace_timestamp_s": 2288.8940000000002, "ttft_s": 0.6307696960284375, "turn_id": 17} +{"actual_output_tokens": 3883, "cached_tokens": 50000, "effective_input_length": 50078, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50078, "latency_s": 30.461775421979837, "output_length": 3883, "proxy_request_id": "1340290:32:1901260:1139", "request_id": "1340290:32:1901260:1139", "request_type": "coder", "requested_output_tokens": 3883, "session_id": "1340290", "t_dispatch_unix": 1779819857.994023, "t_finish_unix": 1779819888.455798, "t_first_token_unix": 1779819858.1346695, "tpot_s": 0.0078106273132495605, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609], "trace_timestamp_s": 2264.237, "ttft_s": 0.1406443899613805, "turn_id": 32} +{"actual_output_tokens": 82, "cached_tokens": 121056, "effective_input_length": 121288, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121288, "latency_s": 1.2622577190049924, "output_length": 82, "proxy_request_id": "1270606:18:1915824:1142", "request_id": "1270606:18:1915824:1142", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1270606", "t_dispatch_unix": 1779819905.6381757, "t_finish_unix": 1779819906.9004333, "t_first_token_unix": 1779819906.0613523, "tpot_s": 0.010356233247561542, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18770157, 18770158, 18770159, 18770160, 18770161, 18770162, 18770163, 18770164, 18770165, 18770166, 18770167, 18770168, 18770169, 18770170, 18770171, 18770172, 18770173, 18770174, 18770175, 18770176, 18770177, 18770178, 18770179, 18770180, 18770181, 18770182, 18770183, 18770184, 18770185, 18770186, 18770187, 18770188, 18770189, 18770190, 18770191, 18770192, 18770193, 18770194, 18770195, 18770196, 18770197, 18770198, 18770199, 18770200, 18770201, 18770202, 18770203, 18770204, 18770205, 18770206, 18770207, 18770208, 18770209, 18770210, 18770211, 18770212, 18770213, 18770214, 18770215, 18770216, 18770217, 18770218, 18770219, 18770220, 18770221, 18770222, 18770223, 18770224, 18770225, 18770226, 18770227, 18770228, 18770229, 18770230, 18770231, 18770232, 18770233, 18770234, 18770235, 18770236, 18770237, 18770238, 18770239, 18770240, 18770241, 18770242, 18770243, 18770244, 18770245, 18770246, 18770247, 18770248, 18770249, 18770250, 18770251, 18770252, 18770253, 18770254, 18770255, 18770256, 18770257, 18770258, 18770259, 18770260, 18770261, 18770262, 18770263, 18770264, 18770265, 18770266, 18770267, 18770268, 18770269], "trace_timestamp_s": 2311.8590000000004, "ttft_s": 0.4231740199611522, "turn_id": 18} +{"actual_output_tokens": 91, "cached_tokens": 121360, "effective_input_length": 121560, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121560, "latency_s": 1.3672767719835974, "output_length": 91, "proxy_request_id": "1270606:19:1920499:1143", "request_id": "1270606:19:1920499:1143", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1270606", "t_dispatch_unix": 1779819920.8046362, "t_finish_unix": 1779819922.171912, "t_first_token_unix": 1779819921.2261791, "tpot_s": 0.01050546576669957, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18814461, 18814462, 18814463, 18814464, 18814465, 18814466, 18814467, 18814468, 18814469, 18814470, 18814471, 18814472, 18814473, 18814474, 18814475, 18814476, 18814477, 18814478, 18814479, 18814480, 18814481, 18814482, 18814483, 18814484, 18814485, 18814486, 18814487, 18814488, 18814489, 18814490, 18814491, 18814492, 18814493, 18814494, 18814495, 18814496, 18814497, 18814498, 18814499, 18814500, 18814501, 18814502, 18814503, 18814504, 18814505, 18814506, 18814507, 18814508, 18814509, 18814510, 18814511, 18814512, 18814513, 18814514, 18814515, 18814516, 18814517, 18814518, 18814519, 18814520, 18814521, 18814522, 18814523, 18814524, 18814525, 18814526, 18814527, 18814528, 18814529, 18814530, 18814531, 18814532, 18814533, 18814534, 18814535, 18814536, 18814537, 18814538, 18814539, 18814540, 18814541, 18814542, 18814543, 18814544, 18814545, 18814546, 18814547, 18814548, 18814549, 18814550, 18814551, 18814552, 18814553, 18814554, 18814555, 18814556, 18814557, 18814558, 18814559, 18814560, 18814561, 18814562, 18814563, 18814564, 18814565, 18814566, 18814567, 18814568, 18814569, 18814570, 18814571, 18814572, 18814573, 18814574], "trace_timestamp_s": 2327.013, "ttft_s": 0.42154108599061146, "turn_id": 19} +{"actual_output_tokens": 120, "cached_tokens": 121648, "effective_input_length": 121704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121704, "latency_s": 1.5673427340225317, "output_length": 120, "proxy_request_id": "1270606:20:1922639:1144", "request_id": "1270606:20:1922639:1144", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1270606", "t_dispatch_unix": 1779819928.2367067, "t_finish_unix": 1779819929.8040485, "t_first_token_unix": 1779819928.5168612, "tpot_s": 0.010814396537812975, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18814461, 18833388, 18833389, 18833390, 18833391, 18833392, 18833393, 18833394, 18833395, 18833396, 18833397, 18833398, 18833399, 18833400, 18833401, 18833402, 18833403, 18833404, 18833405, 18833406, 18833407, 18833408, 18833409, 18833410, 18833411, 18833412, 18833413, 18833414, 18833415, 18833416, 18833417, 18833418, 18833419, 18833420, 18833421, 18833422, 18833423, 18833424, 18833425, 18833426, 18833427, 18833428, 18833429, 18833430, 18833431, 18833432, 18833433, 18833434, 18833435, 18833436, 18833437, 18833438, 18833439, 18833440, 18833441, 18833442, 18833443, 18833444, 18833445, 18833446, 18833447, 18833448, 18833449, 18833450, 18833451, 18833452, 18833453, 18833454, 18833455, 18833456, 18833457, 18833458, 18833459, 18833460, 18833461, 18833462, 18833463, 18833464, 18833465, 18833466, 18833467, 18833468, 18833469, 18833470, 18833471, 18833472, 18833473, 18833474, 18833475, 18833476, 18833477, 18833478, 18833479, 18833480, 18833481, 18833482, 18833483, 18833484, 18833485, 18833486, 18833487, 18833488, 18833489, 18833490, 18833491, 18833492, 18833493, 18833494, 18833495, 18833496, 18833497, 18833498, 18833499, 18833500], "trace_timestamp_s": 2334.46, "ttft_s": 0.28015238302759826, "turn_id": 20} +{"actual_output_tokens": 48, "cached_tokens": 59344, "effective_input_length": 61801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61801, "latency_s": 1.4085748309735209, "output_length": 48, "proxy_request_id": "1305906:10:1928316:1145", "request_id": "1305906:10:1928316:1145", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1305906", "t_dispatch_unix": 1779819946.8143044, "t_finish_unix": 1779819948.222879, "t_first_token_unix": 1779819947.8826606, "tpot_s": 0.007232810191047239, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509, 18736108, 18851869, 18889037, 18889038, 18889039], "trace_timestamp_s": 2353.0420000000004, "ttft_s": 1.0683535439893603, "turn_id": 10} +{"actual_output_tokens": 142, "cached_tokens": 53952, "effective_input_length": 53990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53990, "latency_s": 1.1946378300199285, "output_length": 142, "proxy_request_id": "1340290:33:1939781:1146", "request_id": "1340290:33:1939781:1146", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1340290", "t_dispatch_unix": 1779819984.5745075, "t_finish_unix": 1779819985.7691453, "t_first_token_unix": 1779819984.694292, "tpot_s": 0.007621357297518205, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 18997503], "trace_timestamp_s": 2390.7840000000006, "ttft_s": 0.11978158704005182, "turn_id": 33} +{"actual_output_tokens": 314, "cached_tokens": 54128, "effective_input_length": 54164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54164, "latency_s": 2.567201136960648, "output_length": 314, "proxy_request_id": "1340290:34:1942249:1147", "request_id": "1340290:34:1942249:1147", "request_type": "coder", "requested_output_tokens": 314, "session_id": "1340290", "t_dispatch_unix": 1779819992.4146202, "t_finish_unix": 1779819994.9818208, "t_first_token_unix": 1779819992.5360289, "tpot_s": 0.007813144492144628, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002], "trace_timestamp_s": 2398.6550000000007, "ttft_s": 0.12140641495352611, "turn_id": 34} +{"actual_output_tokens": 142, "cached_tokens": 136096, "effective_input_length": 136210, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136210, "latency_s": 2.0429780620033853, "output_length": 142, "proxy_request_id": "1356885:14:1948151:1148", "request_id": "1356885:14:1948151:1148", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1356885", "t_dispatch_unix": 1779820012.1719885, "t_finish_unix": 1779820014.2149658, "t_first_token_unix": 1779820012.5550845, "tpot_s": 0.011768513468113985, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19076313], "trace_timestamp_s": 2418.398, "ttft_s": 0.3830932439886965, "turn_id": 14} +{"actual_output_tokens": 480, "cached_tokens": 54464, "effective_input_length": 54498, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54498, "latency_s": 3.8723615749622695, "output_length": 480, "proxy_request_id": "1340290:35:1964727:1149", "request_id": "1340290:35:1964727:1149", "request_type": "coder", "requested_output_tokens": 480, "session_id": "1340290", "t_dispatch_unix": 1779820066.8963675, "t_finish_unix": 1779820070.7687287, "t_first_token_unix": 1779820067.0180392, "tpot_s": 0.007829564695230964, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19236085], "trace_timestamp_s": 2473.0910000000003, "ttft_s": 0.12166972196428105, "turn_id": 35} +{"actual_output_tokens": 62, "cached_tokens": 54800, "effective_input_length": 54811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54811, "latency_s": 0.5433022309443913, "output_length": 62, "proxy_request_id": "1340290:36:1969509:1150", "request_id": "1340290:36:1969509:1150", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1340290", "t_dispatch_unix": 1779820082.648544, "t_finish_unix": 1779820083.1918461, "t_first_token_unix": 1779820082.7520156, "tpot_s": 0.007205307869179571, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19281054], "trace_timestamp_s": 2488.8830000000007, "ttft_s": 0.10346785094588995, "turn_id": 36} +{"actual_output_tokens": 62, "cached_tokens": 54864, "effective_input_length": 55358, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55358, "latency_s": 0.7662174630095251, "output_length": 62, "proxy_request_id": "1340290:37:1971106:1151", "request_id": "1340290:37:1971106:1151", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1340290", "t_dispatch_unix": 1779820087.793295, "t_finish_unix": 1779820088.559512, "t_first_token_unix": 1779820088.11128, "tpot_s": 0.007343442425452417, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19296412], "trace_timestamp_s": 2494.0340000000006, "ttft_s": 0.31798214704031125, "turn_id": 37} +{"actual_output_tokens": 87, "cached_tokens": 55408, "effective_input_length": 56006, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56006, "latency_s": 0.9769642809988, "output_length": 87, "proxy_request_id": "1340290:38:1972289:1152", "request_id": "1340290:38:1972289:1152", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779820091.7206, "t_finish_unix": 1779820092.6975636, "t_first_token_unix": 1779820092.0490825, "tpot_s": 0.007536998685979999, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19308727], "trace_timestamp_s": 2497.964, "ttft_s": 0.32848039001692086, "turn_id": 38} +{"actual_output_tokens": 87, "cached_tokens": 56080, "effective_input_length": 56242, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56242, "latency_s": 0.8572207409888506, "output_length": 87, "proxy_request_id": "1340290:39:1973889:1153", "request_id": "1340290:39:1973889:1153", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779820097.1466115, "t_finish_unix": 1779820098.003832, "t_first_token_unix": 1779820097.3547068, "tpot_s": 0.007544806592577938, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773], "trace_timestamp_s": 2503.389, "ttft_s": 0.2080930930096656, "turn_id": 39} +{"actual_output_tokens": 65, "cached_tokens": 56320, "effective_input_length": 56416, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56416, "latency_s": 0.6099560529692098, "output_length": 65, "proxy_request_id": "1340290:40:1975278:1154", "request_id": "1340290:40:1975278:1154", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779820101.70931, "t_finish_unix": 1779820102.3192658, "t_first_token_unix": 1779820101.847309, "tpot_s": 0.007370084031208535, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19337746], "trace_timestamp_s": 2507.952, "ttft_s": 0.13799639698117971, "turn_id": 40} +{"actual_output_tokens": 250, "cached_tokens": 56480, "effective_input_length": 57181, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57181, "latency_s": 2.4018214700045064, "output_length": 250, "proxy_request_id": "1340290:41:1977055:1156", "request_id": "1340290:41:1977055:1156", "request_type": "coder", "requested_output_tokens": 250, "session_id": "1340290", "t_dispatch_unix": 1779820107.6445584, "t_finish_unix": 1779820110.0463798, "t_first_token_unix": 1779820108.0840042, "tpot_s": 0.00787977910442577, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819], "trace_timestamp_s": 2513.8910000000005, "ttft_s": 0.43944348202785477, "turn_id": 41} +{"actual_output_tokens": 677, "cached_tokens": 65024, "effective_input_length": 67793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 67793, "latency_s": 7.098219903011341, "output_length": 677, "proxy_request_id": "1277428:21:1976968:1155", "request_id": "1277428:21:1976968:1155", "request_type": "coder", "requested_output_tokens": 677, "session_id": "1277428", "t_dispatch_unix": 1779820107.3590848, "t_finish_unix": 1779820114.4573047, "t_first_token_unix": 1779820108.6377413, "tpot_s": 0.008608416028178887, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19354134, 19354135, 19354136, 19354137, 19354138, 19354139, 19354140, 19354141, 19354142, 19354143, 19354144], "trace_timestamp_s": 2513.5970000000007, "ttft_s": 1.27865460596513, "turn_id": 21} +{"actual_output_tokens": 66, "cached_tokens": 57424, "effective_input_length": 57463, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57463, "latency_s": 0.5992558229481801, "output_length": 66, "proxy_request_id": "1340290:42:1982198:1157", "request_id": "1340290:42:1982198:1157", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1340290", "t_dispatch_unix": 1779820124.5498438, "t_finish_unix": 1779820125.1490993, "t_first_token_unix": 1779820124.669196, "tpot_s": 0.007379290599447604, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19402723], "trace_timestamp_s": 2530.7870000000003, "ttft_s": 0.11935007898136973, "turn_id": 42} +{"actual_output_tokens": 68, "cached_tokens": 57520, "effective_input_length": 57640, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57640, "latency_s": 0.6796429329551756, "output_length": 68, "proxy_request_id": "1340290:43:1983901:1158", "request_id": "1340290:43:1983901:1158", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779820129.9443374, "t_finish_unix": 1779820130.62398, "t_first_token_unix": 1779820130.1190739, "tpot_s": 0.007532339209496085, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878], "trace_timestamp_s": 2536.1860000000006, "ttft_s": 0.1747338489512913, "turn_id": 43} +{"actual_output_tokens": 92, "cached_tokens": 57696, "effective_input_length": 57809, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57809, "latency_s": 0.8820456260000356, "output_length": 92, "proxy_request_id": "1340290:44:1986230:1159", "request_id": "1340290:44:1986230:1159", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1340290", "t_dispatch_unix": 1779820138.0261645, "t_finish_unix": 1779820138.9082103, "t_first_token_unix": 1779820138.222104, "tpot_s": 0.007501962319001105, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878], "trace_timestamp_s": 2544.2660000000005, "ttft_s": 0.19593767396872863, "turn_id": 44} +{"actual_output_tokens": 45, "cached_tokens": 68464, "effective_input_length": 69987, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69987, "latency_s": 1.1304973469814286, "output_length": 45, "proxy_request_id": "1277428:21:1989132:1160", "request_id": "1277428:21:1989132:1160", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779820147.4444637, "t_finish_unix": 1779820148.5749607, "t_first_token_unix": 1779820148.2437334, "tpot_s": 0.007521040887116793, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19467851, 19467852, 19467853, 19467854, 19467855, 19467856, 19467857, 19467858, 19467859, 19467860, 19467861, 19467862, 19467863, 19467864, 19467865], "trace_timestamp_s": 2553.679, "ttft_s": 0.7992669949890114, "turn_id": 21} +{"actual_output_tokens": 52, "cached_tokens": 70016, "effective_input_length": 70055, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70055, "latency_s": 0.538494314008858, "output_length": 52, "proxy_request_id": "1277428:22:1990436:1161", "request_id": "1277428:22:1990436:1161", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1277428", "t_dispatch_unix": 1779820151.9850144, "t_finish_unix": 1779820152.5235088, "t_first_token_unix": 1779820152.1297112, "tpot_s": 0.007715953509414605, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19467851, 19467852, 19467853, 19467854, 19479910, 19479911, 19479912, 19479913, 19479914, 19479915, 19479916, 19479917, 19479918, 19479919, 19479920], "trace_timestamp_s": 2558.2250000000004, "ttft_s": 0.1446938730077818, "turn_id": 22} +{"actual_output_tokens": 36, "cached_tokens": 57888, "effective_input_length": 58053, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58053, "latency_s": 0.4548030439764261, "output_length": 36, "proxy_request_id": "1340290:45:1991694:1162", "request_id": "1340290:45:1991694:1162", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779820155.9989862, "t_finish_unix": 1779820156.4537888, "t_first_token_unix": 1779820156.210881, "tpot_s": 0.006932952200129096, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19491520], "trace_timestamp_s": 2562.2430000000004, "ttft_s": 0.2118928239797242, "turn_id": 45} +{"actual_output_tokens": 56, "cached_tokens": 58080, "effective_input_length": 58122, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58122, "latency_s": 0.5289516340126283, "output_length": 56, "proxy_request_id": "1340290:46:1992980:1163", "request_id": "1340290:46:1992980:1163", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1340290", "t_dispatch_unix": 1779820160.2235787, "t_finish_unix": 1779820160.7525299, "t_first_token_unix": 1779820160.3465204, "tpot_s": 0.0073776571640998805, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2566.4670000000006, "ttft_s": 0.12293980497634038, "turn_id": 46} +{"actual_output_tokens": 36, "cached_tokens": 58176, "effective_input_length": 58307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58307, "latency_s": 0.4038644799729809, "output_length": 36, "proxy_request_id": "1340290:47:1995358:1164", "request_id": "1340290:47:1995358:1164", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779820168.0865335, "t_finish_unix": 1779820168.4903977, "t_first_token_unix": 1779820168.2498133, "tpot_s": 0.006866867343030338, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2574.327, "ttft_s": 0.16327725700102746, "turn_id": 47} +{"actual_output_tokens": 251, "cached_tokens": 58336, "effective_input_length": 58339, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58339, "latency_s": 2.103018317022361, "output_length": 251, "proxy_request_id": "1340290:48:1996945:1165", "request_id": "1340290:48:1996945:1165", "request_type": "coder", "requested_output_tokens": 251, "session_id": "1340290", "t_dispatch_unix": 1779820173.3920507, "t_finish_unix": 1779820175.495069, "t_first_token_unix": 1779820173.494682, "tpot_s": 0.00800050803204067, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2579.634, "ttft_s": 0.10262856702320278, "turn_id": 48} +{"actual_output_tokens": 140, "cached_tokens": 136336, "effective_input_length": 136653, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136653, "latency_s": 2.335559214989189, "output_length": 140, "proxy_request_id": "1356885:15:1998292:1166", "request_id": "1356885:15:1998292:1166", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1356885", "t_dispatch_unix": 1779820177.8518286, "t_finish_unix": 1779820180.1873872, "t_first_token_unix": 1779820178.5525737, "tpot_s": 0.011759230985537359, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016], "trace_timestamp_s": 2584.094, "ttft_s": 0.7007426510099322, "turn_id": 15} +{"actual_output_tokens": 78, "cached_tokens": 58576, "effective_input_length": 58622, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58622, "latency_s": 0.7104996409616433, "output_length": 78, "proxy_request_id": "1340290:48:1999591:1167", "request_id": "1340290:48:1999591:1167", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1340290", "t_dispatch_unix": 1779820182.406404, "t_finish_unix": 1779820183.116903, "t_first_token_unix": 1779820182.526926, "tpot_s": 0.007658893467749578, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958], "trace_timestamp_s": 2588.652, "ttft_s": 0.12052020599367097, "turn_id": 48} +{"actual_output_tokens": 68, "cached_tokens": 58688, "effective_input_length": 58808, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58808, "latency_s": 0.6833889730041847, "output_length": 68, "proxy_request_id": "1340290:48:2001313:1168", "request_id": "1340290:48:2001313:1168", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779820187.873472, "t_finish_unix": 1779820188.5568612, "t_first_token_unix": 1779820188.052716, "tpot_s": 0.007520552000044776, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958], "trace_timestamp_s": 2594.116, "ttft_s": 0.17924172099446878, "turn_id": 48} +{"actual_output_tokens": 113, "cached_tokens": 58864, "effective_input_length": 58977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58977, "latency_s": 1.0515024819760583, "output_length": 113, "proxy_request_id": "1340290:48:2003195:1169", "request_id": "1340290:48:2003195:1169", "request_type": "coder", "requested_output_tokens": 113, "session_id": "1340290", "t_dispatch_unix": 1779820194.1983385, "t_finish_unix": 1779820195.2498407, "t_first_token_unix": 1779820194.3789024, "tpot_s": 0.0077738024021008255, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19598292], "trace_timestamp_s": 2600.4390000000003, "ttft_s": 0.18056186597095802, "turn_id": 48} +{"actual_output_tokens": 108, "cached_tokens": 59088, "effective_input_length": 59220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59220, "latency_s": 0.993805470992811, "output_length": 108, "proxy_request_id": "1340290:48:2005449:1170", "request_id": "1340290:48:2005449:1170", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1340290", "t_dispatch_unix": 1779820201.5881128, "t_finish_unix": 1779820202.581918, "t_first_token_unix": 1779820201.7518547, "tpot_s": 0.007755110803534599, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999], "trace_timestamp_s": 2607.8280000000004, "ttft_s": 0.16373941401252523, "turn_id": 48} +{"actual_output_tokens": 52, "cached_tokens": 59312, "effective_input_length": 59487, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59487, "latency_s": 0.5898598210187629, "output_length": 52, "proxy_request_id": "1340290:48:2007287:1171", "request_id": "1340290:48:2007287:1171", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1340290", "t_dispatch_unix": 1779820207.7129138, "t_finish_unix": 1779820208.3027732, "t_first_token_unix": 1779820207.9322116, "tpot_s": 0.0072597934700110375, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19641799], "trace_timestamp_s": 2613.9540000000006, "ttft_s": 0.21929452603217214, "turn_id": 48} +{"actual_output_tokens": 88, "cached_tokens": 59536, "effective_input_length": 60935, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60935, "latency_s": 1.3664461229927838, "output_length": 88, "proxy_request_id": "1340290:48:2008380:1173", "request_id": "1340290:48:2008380:1173", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1340290", "t_dispatch_unix": 1779820211.814426, "t_finish_unix": 1779820213.1808715, "t_first_token_unix": 1779820212.5050194, "tpot_s": 0.007765613678286131, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19653243], "trace_timestamp_s": 2618.0600000000004, "ttft_s": 0.6905911670182832, "turn_id": 48} +{"actual_output_tokens": 278, "cached_tokens": 61840, "effective_input_length": 66506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66506, "latency_s": 4.320525306975469, "output_length": 278, "proxy_request_id": "1305906:11:2008110:1172", "request_id": "1305906:11:2008110:1172", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1305906", "t_dispatch_unix": 1779820210.802742, "t_finish_unix": 1779820215.1232672, "t_first_token_unix": 1779820212.7946498, "tpot_s": 0.008405547545145229, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509, 18736108, 18851869, 18889037, 18889038, 18889039, 19018877, 19530559, 19650064, 19650065, 19650066, 19650067, 19650068, 19650069, 19650070], "trace_timestamp_s": 2617.0460000000003, "ttft_s": 1.9919064189889468, "turn_id": 11} +{"actual_output_tokens": 128, "cached_tokens": 61008, "effective_input_length": 61080, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61080, "latency_s": 1.169987057975959, "output_length": 128, "proxy_request_id": "1340290:48:2010180:1174", "request_id": "1340290:48:2010180:1174", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1340290", "t_dispatch_unix": 1779820217.6712303, "t_finish_unix": 1779820218.841217, "t_first_token_unix": 1779820217.8388047, "tpot_s": 0.007888822637564378, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19669693], "trace_timestamp_s": 2623.916, "ttft_s": 0.16757268802030012, "turn_id": 48} +{"actual_output_tokens": 68, "cached_tokens": 61200, "effective_input_length": 61365, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61365, "latency_s": 0.7326581660308875, "output_length": 68, "proxy_request_id": "1340290:48:2012871:1175", "request_id": "1340290:48:2012871:1175", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779820226.3521125, "t_finish_unix": 1779820227.0847704, "t_first_token_unix": 1779820226.5729542, "tpot_s": 0.007635440567070479, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456], "trace_timestamp_s": 2632.5910000000003, "ttft_s": 0.2208281600032933, "turn_id": 48} +{"actual_output_tokens": 65, "cached_tokens": 61424, "effective_input_length": 61518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61518, "latency_s": 0.6347813039901666, "output_length": 65, "proxy_request_id": "1340290:48:2014153:1176", "request_id": "1340290:48:2014153:1176", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779820230.7487216, "t_finish_unix": 1779820231.3835022, "t_first_token_unix": 1779820230.896899, "tpot_s": 0.007598741531182895, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19707873], "trace_timestamp_s": 2636.992, "ttft_s": 0.14817581698298454, "turn_id": 48} +{"actual_output_tokens": 281, "cached_tokens": 61568, "effective_input_length": 69113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69113, "latency_s": 5.657297248020768, "output_length": 281, "proxy_request_id": "1340290:48:2015982:1177", "request_id": "1340290:48:2015982:1177", "request_type": "coder", "requested_output_tokens": 281, "session_id": "1340290", "t_dispatch_unix": 1779820236.8479528, "t_finish_unix": 1779820242.50525, "t_first_token_unix": 1779820240.0900154, "tpot_s": 0.008624808196535534, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875], "trace_timestamp_s": 2643.0860000000002, "ttft_s": 3.2420595780131407, "turn_id": 48} +{"actual_output_tokens": 72, "cached_tokens": 69392, "effective_input_length": 69426, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69426, "latency_s": 0.7151746079907753, "output_length": 72, "proxy_request_id": "1340290:48:2018973:1178", "request_id": "1340290:48:2018973:1178", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1340290", "t_dispatch_unix": 1779820246.6298354, "t_finish_unix": 1779820247.3450093, "t_first_token_unix": 1779820246.7690692, "tpot_s": 0.008107612943309556, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176], "trace_timestamp_s": 2652.8720000000003, "ttft_s": 0.1392315060365945, "turn_id": 48} +{"actual_output_tokens": 70, "cached_tokens": 69488, "effective_input_length": 69601, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69601, "latency_s": 0.7630842849612236, "output_length": 70, "proxy_request_id": "1340290:48:2020779:1179", "request_id": "1340290:48:2020779:1179", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1340290", "t_dispatch_unix": 1779820252.6865878, "t_finish_unix": 1779820253.4496717, "t_first_token_unix": 1779820252.8908944, "tpot_s": 0.008093719000327468, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176], "trace_timestamp_s": 2658.928000000001, "ttft_s": 0.20430411997949705, "turn_id": 48} +{"actual_output_tokens": 106, "cached_tokens": 69664, "effective_input_length": 69951, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69951, "latency_s": 1.1374616550165229, "output_length": 106, "proxy_request_id": "1340290:48:2023753:1180", "request_id": "1340290:48:2023753:1180", "request_type": "coder", "requested_output_tokens": 106, "session_id": "1340290", "t_dispatch_unix": 1779820262.3060396, "t_finish_unix": 1779820263.4435008, "t_first_token_unix": 1779820262.566624, "tpot_s": 0.008348213152272538, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067], "trace_timestamp_s": 2668.5430000000006, "ttft_s": 0.26058154803467914, "turn_id": 48} +{"actual_output_tokens": 65, "cached_tokens": 70048, "effective_input_length": 70342, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70342, "latency_s": 0.7735931659699418, "output_length": 65, "proxy_request_id": "1340290:48:2026751:1181", "request_id": "1340290:48:2026751:1181", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779820272.5831475, "t_finish_unix": 1779820273.3567407, "t_first_token_unix": 1779820272.84433, "tpot_s": 0.008002091171874781, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19829875], "trace_timestamp_s": 2678.8200000000006, "ttft_s": 0.2611790900118649, "turn_id": 48} +{"actual_output_tokens": 107, "cached_tokens": 70400, "effective_input_length": 70503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70503, "latency_s": 1.0891528440406546, "output_length": 107, "proxy_request_id": "1340290:48:2028652:1182", "request_id": "1340290:48:2028652:1182", "request_type": "coder", "requested_output_tokens": 107, "session_id": "1340290", "t_dispatch_unix": 1779820278.8347728, "t_finish_unix": 1779820279.9239247, "t_first_token_unix": 1779820279.0417168, "tpot_s": 0.008319768216680595, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190], "trace_timestamp_s": 2685.077, "ttft_s": 0.20694194704992697, "turn_id": 48} +{"actual_output_tokens": 78, "cached_tokens": 70608, "effective_input_length": 70851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70851, "latency_s": 0.88775994599564, "output_length": 78, "proxy_request_id": "1340290:48:2033065:1183", "request_id": "1340290:48:2033065:1183", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1340290", "t_dispatch_unix": 1779820293.5608182, "t_finish_unix": 1779820294.448578, "t_first_token_unix": 1779820293.8176801, "tpot_s": 0.00819009576633863, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19891018], "trace_timestamp_s": 2699.7960000000003, "ttft_s": 0.2568598560173996, "turn_id": 48} +{"actual_output_tokens": 64, "cached_tokens": 70928, "effective_input_length": 71067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71067, "latency_s": 0.6933726830175146, "output_length": 64, "proxy_request_id": "1340290:48:2034908:1184", "request_id": "1340290:48:2034908:1184", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1340290", "t_dispatch_unix": 1779820299.7831564, "t_finish_unix": 1779820300.4765286, "t_first_token_unix": 1779820299.972636, "tpot_s": 0.007994008905601703, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243], "trace_timestamp_s": 2706.0260000000007, "ttft_s": 0.18947638297686353, "turn_id": 48} +{"actual_output_tokens": 193, "cached_tokens": 7840, "effective_input_length": 7844, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7844, "latency_s": 1.0553467010031454, "output_length": 193, "proxy_request_id": "1258908:2:2035438:1185", "request_id": "1258908:2:2035438:1185", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1258908", "t_dispatch_unix": 1779820301.6013868, "t_finish_unix": 1779820302.6567338, "t_first_token_unix": 1779820301.6396554, "tpot_s": 0.005295694249980443, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 19912315], "trace_timestamp_s": 2707.849, "ttft_s": 0.03826726402621716, "turn_id": 2} +{"actual_output_tokens": 125, "cached_tokens": 8032, "effective_input_length": 9120, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9120, "latency_s": 0.8219973139930516, "output_length": 125, "proxy_request_id": "1258908:3:1388683:699", "request_id": "1258908:3:1388683:699", "request_type": "coder", "requested_output_tokens": 125, "session_id": "1258908", "t_dispatch_unix": 1779820302.6577919, "t_finish_unix": 1779820303.479789, "t_first_token_unix": 1779820302.8093514, "tpot_s": 0.005404466919454506, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 13752030], "trace_timestamp_s": 527.4590000000007, "ttft_s": 0.15155814797617495, "turn_id": 3} +{"actual_output_tokens": 87, "cached_tokens": 71120, "effective_input_length": 71240, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71240, "latency_s": 0.9139968719682656, "output_length": 87, "proxy_request_id": "1340290:48:2036994:1186", "request_id": "1340290:48:2036994:1186", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779820306.7266774, "t_finish_unix": 1779820307.640674, "t_first_token_unix": 1779820306.9337192, "tpot_s": 0.00821694302329317, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19926625], "trace_timestamp_s": 2712.9700000000003, "ttft_s": 0.20703909400617704, "turn_id": 48} +{"actual_output_tokens": 133, "cached_tokens": 71312, "effective_input_length": 71545, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71545, "latency_s": 1.3867235030047596, "output_length": 133, "proxy_request_id": "1340290:48:2040473:1187", "request_id": "1340290:48:2040473:1187", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1340290", "t_dispatch_unix": 1779820318.246233, "t_finish_unix": 1779820319.6329563, "t_first_token_unix": 1779820318.504613, "tpot_s": 0.008545762431546764, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166], "trace_timestamp_s": 2724.4890000000005, "ttft_s": 0.2583770659985021, "turn_id": 48} +{"actual_output_tokens": 70, "cached_tokens": 71664, "effective_input_length": 71867, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71867, "latency_s": 0.8215429219999351, "output_length": 70, "proxy_request_id": "1340290:48:2043771:1188", "request_id": "1340290:48:2043771:1188", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1340290", "t_dispatch_unix": 1779820329.2720866, "t_finish_unix": 1779820330.093629, "t_first_token_unix": 1779820329.5321302, "tpot_s": 0.00813329950703875, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 19990868], "trace_timestamp_s": 2735.509, "ttft_s": 0.2600411670282483, "turn_id": 48} +{"actual_output_tokens": 82, "cached_tokens": 71936, "effective_input_length": 72025, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72025, "latency_s": 0.8391325150150806, "output_length": 82, "proxy_request_id": "1340290:48:2045403:1189", "request_id": "1340290:48:2045403:1189", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1340290", "t_dispatch_unix": 1779820334.7828562, "t_finish_unix": 1779820335.621988, "t_first_token_unix": 1779820334.949383, "tpot_s": 0.00830031283929898, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917], "trace_timestamp_s": 2741.0240000000003, "ttft_s": 0.16652448201784864, "turn_id": 48} +{"actual_output_tokens": 67, "cached_tokens": 72096, "effective_input_length": 72211, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72211, "latency_s": 0.7486361779738218, "output_length": 67, "proxy_request_id": "1340290:48:2047167:1190", "request_id": "1340290:48:2047167:1190", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1340290", "t_dispatch_unix": 1779820340.5476146, "t_finish_unix": 1779820341.2962499, "t_first_token_unix": 1779820340.7580612, "tpot_s": 0.008150222137125886, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20025386], "trace_timestamp_s": 2746.7890000000007, "ttft_s": 0.21044411096954718, "turn_id": 48} +{"actual_output_tokens": 64, "cached_tokens": 72272, "effective_input_length": 72777, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72777, "latency_s": 0.910359293979127, "output_length": 64, "proxy_request_id": "1340290:48:2048793:1191", "request_id": "1340290:48:2048793:1191", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1340290", "t_dispatch_unix": 1779820345.980815, "t_finish_unix": 1779820346.8911736, "t_first_token_unix": 1779820346.380495, "tpot_s": 0.008101348682964546, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20040840], "trace_timestamp_s": 2752.2220000000007, "ttft_s": 0.39967731398064643, "turn_id": 48} +{"actual_output_tokens": 46, "cached_tokens": 72832, "effective_input_length": 72952, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72952, "latency_s": 0.5630328639526851, "output_length": 46, "proxy_request_id": "1340290:48:2050838:1192", "request_id": "1340290:48:2050838:1192", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1340290", "t_dispatch_unix": 1779820353.2031326, "t_finish_unix": 1779820353.766165, "t_first_token_unix": 1779820353.4207056, "tpot_s": 0.007670557444604735, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229], "trace_timestamp_s": 2759.443, "ttft_s": 0.21757004997925833, "turn_id": 48} +{"actual_output_tokens": 93, "cached_tokens": 72992, "effective_input_length": 73208, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73208, "latency_s": 1.0290774090099148, "output_length": 93, "proxy_request_id": "1340290:48:2052523:1193", "request_id": "1340290:48:2052523:1193", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1340290", "t_dispatch_unix": 1779820358.7700167, "t_finish_unix": 1779820359.799094, "t_first_token_unix": 1779820359.0286503, "tpot_s": 0.00837123539088719, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229], "trace_timestamp_s": 2765.0120000000006, "ttft_s": 0.2586304980213754, "turn_id": 48} +{"actual_output_tokens": 53, "cached_tokens": 73296, "effective_input_length": 73454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73454, "latency_s": 0.6690375789767131, "output_length": 53, "proxy_request_id": "1340290:48:2055365:1194", "request_id": "1340290:48:2055365:1194", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1340290", "t_dispatch_unix": 1779820368.4844184, "t_finish_unix": 1779820369.1534557, "t_first_token_unix": 1779820368.7420864, "tpot_s": 0.007904638807163931, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2774.7220000000007, "ttft_s": 0.25766570400446653, "turn_id": 48} +{"actual_output_tokens": 36, "cached_tokens": 73504, "effective_input_length": 73636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73636, "latency_s": 0.4553360649733804, "output_length": 36, "proxy_request_id": "1340290:48:2057042:1195", "request_id": "1340290:48:2057042:1195", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779820373.8561141, "t_finish_unix": 1779820374.31145, "t_first_token_unix": 1779820374.051771, "tpot_s": 0.007411250714877886, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2780.098, "ttft_s": 0.19565450795926154, "turn_id": 48} +{"actual_output_tokens": 199, "cached_tokens": 73648, "effective_input_length": 73653, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73653, "latency_s": 1.8578465330065228, "output_length": 199, "proxy_request_id": "1340290:48:2058614:1196", "request_id": "1340290:48:2058614:1196", "request_type": "coder", "requested_output_tokens": 199, "session_id": "1340290", "t_dispatch_unix": 1779820378.9967153, "t_finish_unix": 1779820380.854561, "t_first_token_unix": 1779820379.120578, "tpot_s": 0.008756156636559584, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2785.241, "ttft_s": 0.12386057298863307, "turn_id": 48} +{"actual_output_tokens": 66, "cached_tokens": 73840, "effective_input_length": 73858, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73858, "latency_s": 0.6770324179669842, "output_length": 66, "proxy_request_id": "1340290:48:2061834:1197", "request_id": "1340290:48:2061834:1197", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1340290", "t_dispatch_unix": 1779820389.148725, "t_finish_unix": 1779820389.8257573, "t_first_token_unix": 1779820389.2886329, "tpot_s": 0.008259623307878008, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20166404], "trace_timestamp_s": 2795.3860000000004, "ttft_s": 0.13990580895915627, "turn_id": 48} +{"actual_output_tokens": 198, "cached_tokens": 9232, "effective_input_length": 9359, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9359, "latency_s": 1.130762746965047, "output_length": 198, "proxy_request_id": "1258908:3:2063441:1198", "request_id": "1258908:3:2063441:1198", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1258908", "t_dispatch_unix": 1779820394.1958706, "t_finish_unix": 1779820395.3266332, "t_first_token_unix": 1779820394.2607636, "tpot_s": 0.005408893604077361, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 20179862, 20179863, 20179864, 20179865], "trace_timestamp_s": 2800.4400000000005, "ttft_s": 0.06489179696654901, "turn_id": 3} +{"actual_output_tokens": 69, "cached_tokens": 73920, "effective_input_length": 74011, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74011, "latency_s": 0.7371368840103969, "output_length": 69, "proxy_request_id": "1340290:48:2063837:1199", "request_id": "1340290:48:2063837:1199", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1340290", "t_dispatch_unix": 1779820395.5412817, "t_finish_unix": 1779820396.2784193, "t_first_token_unix": 1779820395.7163568, "tpot_s": 0.008261651308309999, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245], "trace_timestamp_s": 2801.7870000000003, "ttft_s": 0.17507206200389192, "turn_id": 48} +{"actual_output_tokens": 348, "cached_tokens": 9552, "effective_input_length": 9740, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9740, "latency_s": 1.960985786980018, "output_length": 348, "proxy_request_id": "1258908:4:1553508:958", "request_id": "1258908:4:1553508:958", "request_type": "coder", "requested_output_tokens": 348, "session_id": "1258908", "t_dispatch_unix": 1779820395.3278801, "t_finish_unix": 1779820397.288866, "t_first_token_unix": 1779820395.3938944, "tpot_s": 0.00546021687027244, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 15299521, 15299522, 15299523], "trace_timestamp_s": 1086.2330000000002, "ttft_s": 0.06601152196526527, "turn_id": 4} +{"actual_output_tokens": 377, "cached_tokens": 10080, "effective_input_length": 10201, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10201, "latency_s": 2.1073585930280387, "output_length": 377, "proxy_request_id": "1258908:5:1617181:988", "request_id": "1258908:5:1617181:988", "request_type": "coder", "requested_output_tokens": 377, "session_id": "1258908", "t_dispatch_unix": 1779820397.2897317, "t_finish_unix": 1779820399.3970912, "t_first_token_unix": 1779820397.347611, "tpot_s": 0.005449984877641521, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 15299521, 15299522, 15897219], "trace_timestamp_s": 1300.7890000000007, "ttft_s": 0.05787668703123927, "turn_id": 5} +{"actual_output_tokens": 142, "cached_tokens": 74064, "effective_input_length": 74557, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74557, "latency_s": 1.6318952980218455, "output_length": 142, "proxy_request_id": "1340290:48:2066647:1200", "request_id": "1340290:48:2066647:1200", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1340290", "t_dispatch_unix": 1779820404.9796624, "t_finish_unix": 1779820406.6115568, "t_first_token_unix": 1779820405.3908837, "tpot_s": 0.008655110701872366, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606], "trace_timestamp_s": 2811.2200000000003, "ttft_s": 0.4112188470317051, "turn_id": 48} +{"actual_output_tokens": 95, "cached_tokens": 74688, "effective_input_length": 74863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74863, "latency_s": 1.0609895390225574, "output_length": 95, "proxy_request_id": "1340290:48:2071598:1201", "request_id": "1340290:48:2071598:1201", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1340290", "t_dispatch_unix": 1779820421.6364207, "t_finish_unix": 1779820422.6974096, "t_first_token_unix": 1779820421.8991313, "tpot_s": 0.008487349500547739, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20256523], "trace_timestamp_s": 2827.867, "ttft_s": 0.26270790898706764, "turn_id": 48} +{"actual_output_tokens": 54, "cached_tokens": 74944, "effective_input_length": 75113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75113, "latency_s": 0.6900412599788979, "output_length": 54, "proxy_request_id": "1340290:48:2076822:1202", "request_id": "1340290:48:2076822:1202", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1340290", "t_dispatch_unix": 1779820439.1529553, "t_finish_unix": 1779820439.8429966, "t_first_token_unix": 1779820439.4175873, "tpot_s": 0.00802118007537364, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700], "trace_timestamp_s": 2845.3820000000005, "ttft_s": 0.2646290810080245, "turn_id": 48} +{"actual_output_tokens": 37, "cached_tokens": 75152, "effective_input_length": 75299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75299, "latency_s": 0.5334449840011075, "output_length": 37, "proxy_request_id": "1340290:48:2078461:1203", "request_id": "1340290:48:2078461:1203", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1340290", "t_dispatch_unix": 1779820444.441607, "t_finish_unix": 1779820444.9750519, "t_first_token_unix": 1779820444.703371, "tpot_s": 0.007538898833445273, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20321756], "trace_timestamp_s": 2850.683, "ttft_s": 0.2617619420052506, "turn_id": 48} +{"actual_output_tokens": 47, "cached_tokens": 75328, "effective_input_length": 75338, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75338, "latency_s": 0.491253960004542, "output_length": 47, "proxy_request_id": "1340290:48:2080016:1204", "request_id": "1340290:48:2080016:1204", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1340290", "t_dispatch_unix": 1779820449.7309196, "t_finish_unix": 1779820450.2221735, "t_first_token_unix": 1779820449.8602164, "tpot_s": 0.007862098021533988, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20335310], "trace_timestamp_s": 2855.973, "ttft_s": 0.1292934839730151, "turn_id": 48} +{"actual_output_tokens": 232, "cached_tokens": 136784, "effective_input_length": 136991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136991, "latency_s": 3.2499775929609314, "output_length": 232, "proxy_request_id": "1356885:16:2084239:1207", "request_id": "1356885:16:2084239:1207", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1356885", "t_dispatch_unix": 1779820463.4952743, "t_finish_unix": 1779820466.7452521, "t_first_token_unix": 1779820463.9563866, "tpot_s": 0.01207171196094815, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016, 20375498], "trace_timestamp_s": 2869.7350000000006, "ttft_s": 0.4611090529942885, "turn_id": 16} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 114971, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 114971, "latency_s": 44.32116679701721, "output_length": 111, "proxy_request_id": "1382086:2:2082052:1205", "request_id": "1382086:2:2082052:1205", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1382086", "t_dispatch_unix": 1779820456.3894682, "t_finish_unix": 1779820500.7106345, "t_first_token_unix": 1779820499.0675395, "tpot_s": 0.014933784999778833, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756], "trace_timestamp_s": 2862.6050000000005, "ttft_s": 42.67806838400429, "turn_id": 2} +{"actual_output_tokens": 114, "cached_tokens": 75376, "effective_input_length": 75439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75439, "latency_s": 42.33655002602609, "output_length": 114, "proxy_request_id": "1340290:48:2082644:1206", "request_id": "1340290:48:2082644:1206", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1340290", "t_dispatch_unix": 1779820458.4066353, "t_finish_unix": 1779820500.7431843, "t_first_token_unix": 1779820499.073455, "tpot_s": 0.014774530248271417, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630], "trace_timestamp_s": 2864.6510000000007, "ttft_s": 40.66681788797723, "turn_id": 48} +{"actual_output_tokens": 52, "cached_tokens": 115072, "effective_input_length": 115184, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 115184, "latency_s": 1.9619269560207613, "output_length": 52, "proxy_request_id": "1382086:3:2089879:1210", "request_id": "1382086:3:2089879:1210", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1382086", "t_dispatch_unix": 1779820500.715592, "t_finish_unix": 1779820502.6775193, "t_first_token_unix": 1779820501.1395898, "tpot_s": 0.030149707138109223, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756], "trace_timestamp_s": 2888.9900000000007, "ttft_s": 0.4239945969893597, "turn_id": 3} +{"actual_output_tokens": 61, "cached_tokens": 75552, "effective_input_length": 77337, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77337, "latency_s": 2.1804082370363176, "output_length": 61, "proxy_request_id": "1340290:48:2085626:1208", "request_id": "1340290:48:2085626:1208", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1340290", "t_dispatch_unix": 1779820500.7476604, "t_finish_unix": 1779820502.9280684, "t_first_token_unix": 1779820501.9654796, "tpot_s": 0.016019907132916462, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20388781], "trace_timestamp_s": 2874.7270000000008, "ttft_s": 1.2178166750236414, "turn_id": 48} +{"actual_output_tokens": 162, "cached_tokens": 77392, "effective_input_length": 78683, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78683, "latency_s": 3.3783720689825714, "output_length": 162, "proxy_request_id": "1340290:48:2087584:1209", "request_id": "1340290:48:2087584:1209", "request_type": "coder", "requested_output_tokens": 162, "session_id": "1340290", "t_dispatch_unix": 1779820502.9322083, "t_finish_unix": 1779820506.3105807, "t_first_token_unix": 1779820503.8067129, "tpot_s": 0.015549722937823661, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20407911, 20407912, 20407913], "trace_timestamp_s": 2881.3010000000004, "ttft_s": 0.8745016999891959, "turn_id": 48} +{"actual_output_tokens": 143, "cached_tokens": 78832, "effective_input_length": 79023, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79023, "latency_s": 2.4962503999704495, "output_length": 143, "proxy_request_id": "1340290:48:2092759:1211", "request_id": "1340290:48:2092759:1211", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1340290", "t_dispatch_unix": 1779820506.3148634, "t_finish_unix": 1779820508.8111138, "t_first_token_unix": 1779820506.5917833, "tpot_s": 0.015626513901327303, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20407911, 20407912, 20407913, 20456176], "trace_timestamp_s": 2898.5790000000006, "ttft_s": 0.27691690996289253, "turn_id": 48} +{"actual_output_tokens": 220, "cached_tokens": 137216, "effective_input_length": 137546, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 137546, "latency_s": 3.342481511004735, "output_length": 220, "proxy_request_id": "1356885:17:2097011:1213", "request_id": "1356885:17:2097011:1213", "request_type": "coder", "requested_output_tokens": 220, "session_id": "1356885", "t_dispatch_unix": 1779820506.209809, "t_finish_unix": 1779820509.5522902, "t_first_token_unix": 1779820506.9110284, "tpot_s": 0.012059420401966156, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016, 20494065, 20494066], "trace_timestamp_s": 2912.4530000000004, "ttft_s": 0.7012161479797214, "turn_id": 17} +{"actual_output_tokens": 626, "cached_tokens": 115232, "effective_input_length": 115246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 115246, "latency_s": 9.516209095017985, "output_length": 626, "proxy_request_id": "1382086:4:2092953:1212", "request_id": "1382086:4:2092953:1212", "request_type": "coder", "requested_output_tokens": 626, "session_id": "1382086", "t_dispatch_unix": 1779820502.6831703, "t_finish_unix": 1779820512.1993797, "t_first_token_unix": 1779820502.8838964, "tpot_s": 0.014904289513546973, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756, 20458115], "trace_timestamp_s": 2899.327, "ttft_s": 0.20071376604028046, "turn_id": 4} diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/metrics.summary.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/metrics.summary.json new file mode 100644 index 0000000..d6db158 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/metrics.summary.json @@ -0,0 +1,50 @@ +{ + "actual_output_tokens_stats": { + "count": 1214.0, + "mean": 309.1507413509061, + "p50": 92.0, + "p90": 511.4000000000001, + "p99": 4181.989999999992 + }, + "cache_hit_request_count": 895, + "cached_tokens_stats": { + "count": 1214.0, + "mean": 34921.15980230642, + "p50": 24000.0, + "p90": 92948.80000000002, + "p99": 130516.47999999975 + }, + "error_count": 0, + "external_cache_hit_ratio": 0.0, + "external_cache_hits_tokens": 0, + "external_cache_queries_tokens": 0, + "latency_stats_s": { + "count": 1214.0, + "mean": 7.966745891509911, + "p50": 1.9950706280069426, + "p90": 21.26458439627313, + "p99": 77.17173248772794 + }, + "prefix_cache_hit_ratio": 0.0, + "prefix_cache_hits_tokens": 0, + "prefix_cache_queries_tokens": 0, + "request_count": 1214, + "success_count": 1214, + "total_cached_tokens": 42394288, + "total_input_tokens": 53335690, + "tpot_stats_s": { + "count": 1214.0, + "mean": 0.014371074456771783, + "p50": 0.00834782877529764, + "p90": 0.02166754243794215, + "p99": 0.1342057830565418 + }, + "ttft_stats_s": { + "count": 1214.0, + "mean": 3.551512749613402, + "p50": 0.502115077979397, + "p90": 9.801292790105803, + "p99": 42.64609946611393 + }, + "wall_clock_s": 2918.4564750069985 +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/run_window.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/run_window.json new file mode 100644 index 0000000..46cad8e --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/run_window.json @@ -0,0 +1,7 @@ +{ + "policy": "unified_kv_both", + "trace": "/home/admin/cpfs/wjh/agentic-kv/traces/w600_r0.0015_st30.jsonl", + "t_start_unix": 1779817593.1108272, + "t_end_unix": 1779820512.6874907, + "isolated": true +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/stats.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/stats.json new file mode 100644 index 0000000..895cb56 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both/stats.json @@ -0,0 +1 @@ +[{"url":"http://127.0.0.1:8000","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1639},{"url":"http://127.0.0.1:8001","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1874},{"url":"http://127.0.0.1:8002","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2694},{"url":"http://127.0.0.1:8003","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2366},{"url":"http://127.0.0.1:8004","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043},{"url":"http://127.0.0.1:8005","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1822},{"url":"http://127.0.0.1:8006","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779},{"url":"http://127.0.0.1:8007","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2557}] \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/breakdown.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/breakdown.json new file mode 100644 index 0000000..5dda2cb --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/breakdown.json @@ -0,0 +1 @@ +[{"request_id":"1237198:1:1237198:0","session_id":"1237198","input_length":8228,"t_proxy_recv":389821.950754417,"t_decision_unix":1779820686.9646952,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8228,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389822.829993089,"t_first_token_unix":1779820687.843937,"t_done":389822.925949665,"t_done_unix":1779820687.9398994},{"request_id":"1237337:1:1237337:1","session_id":"1237337","input_length":3976,"t_proxy_recv":389822.371242835,"t_decision_unix":1779820687.3851838,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3976,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8228,"ongoing_decode_tokens":0,"pending_prefill_tokens":8228,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":8228.0,"score_lmetric":12204},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":3976,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389822.898565794,"t_first_token_unix":1779820687.91251,"t_done":389823.282924029,"t_done_unix":1779820688.2968674},{"request_id":"1237198:2:1237773:2","session_id":"1237198","input_length":10237,"t_proxy_recv":389823.920528527,"t_decision_unix":1779820688.9344702,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":8192,"affinity_cache_ratio":0.8002344436846732,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":2045,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":16,"cache_hit":8192,"new_prefill":2045,"score_linear":-8192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":7,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10237,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":389824.206520873,"t_first_token_unix":1779820689.220465,"t_done":389824.339936115,"t_done_unix":1779820689.353879},{"request_id":"1237877:1:1237877:3","session_id":"1237877","input_length":749,"t_proxy_recv":389824.378030794,"t_decision_unix":1779820689.391972,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":7,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":749,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389824.495013264,"t_first_token_unix":1779820689.508957,"t_done":389824.620640929,"t_done_unix":1779820689.6345837},{"request_id":"1239034:1:1239034:4","session_id":"1239034","input_length":13489,"t_proxy_recv":389828.156719121,"t_decision_unix":1779820693.1706605,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13489,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":13489,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389829.628828129,"t_first_token_unix":1779820694.6427715,"t_done":389830.075899914,"t_done_unix":1779820695.0898433},{"request_id":"1237877:2:1239577:6","session_id":"1237877","input_length":1620,"t_proxy_recv":389830.038625702,"t_decision_unix":1779820695.0525665,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":512,"affinity_cache_ratio":0.3160493827160494,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":512,"new_prefill":1108,"score_linear":-512.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13489,"ongoing_decode_tokens":13489,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":13489.0,"score_lmetric":1620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":37165.0,"score_lmetric":38785},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1620,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":389830.119718368,"t_first_token_unix":1779820695.1336617,"t_done":389830.561960816,"t_done_unix":1779820695.575904},{"request_id":"1239704:1:1239704:7","session_id":"1239704","input_length":5194,"t_proxy_recv":389830.482571983,"t_decision_unix":1779820695.4965134,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1620,"ongoing_decode_tokens":1620,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":5194,"score_linear":1620.0,"score_lmetric":5194},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":37165.0,"score_lmetric":42359},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":5194,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389831.086931517,"t_first_token_unix":1779820696.100875,"t_done":389831.353778329,"t_done_unix":1779820696.3677216},{"request_id":"1240924:1:1240924:11","session_id":"1240924","input_length":7429,"t_proxy_recv":389834.502871108,"t_decision_unix":1779820699.5168126,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7429,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":66214.0,"score_lmetric":73643},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30040,"ongoing_decode_tokens":0,"pending_prefill_tokens":30040,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7429,"score_linear":30040.0,"score_lmetric":37469},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7429,"score_linear":18420.0,"score_lmetric":7429},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":37165,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":37165.0,"score_lmetric":7429},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7429,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389835.040721228,"t_first_token_unix":1779820700.0546649,"t_done":389835.213800511,"t_done_unix":1779820700.2277436},{"request_id":"1239100:1:1239100:5","session_id":"1239100","input_length":37165,"t_proxy_recv":389828.397932084,"t_decision_unix":1779820693.4118733,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":37165,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":8,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13489,"ongoing_decode_tokens":0,"pending_prefill_tokens":13489,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":13489.0,"score_lmetric":50654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":37165,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389834.376165758,"t_first_token_unix":1779820699.3901093,"t_done":389835.625410263,"t_done_unix":1779820700.6393533},{"request_id":"1240198:1:1240198:9","session_id":"1240198","input_length":30040,"t_proxy_recv":389832.017143502,"t_decision_unix":1779820697.0310848,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":30040,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":66214.0,"score_lmetric":96254},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":37165.0,"score_lmetric":67205},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":30040,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389835.953143163,"t_first_token_unix":1779820700.9670863,"t_done":389836.590947716,"t_done_unix":1779820701.6048913},{"request_id":"1241953:1:1241953:13","session_id":"1241953","input_length":1093,"t_proxy_recv":389837.920521676,"t_decision_unix":1779820702.934463,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1093,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":34,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":66214.0,"score_lmetric":67307},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1093,"score_linear":18420.0,"score_lmetric":1093},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7587,"ongoing_decode_tokens":0,"pending_prefill_tokens":7587,"num_requests":1,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":1093,"score_linear":7587.0,"score_lmetric":8680},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":1093,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389838.03473505,"t_first_token_unix":1779820703.0486789,"t_done":389838.54556402,"t_done_unix":1779820703.5595076},{"request_id":"1241942:1:1241942:12","session_id":"1241942","input_length":7587,"t_proxy_recv":389837.8744764,"t_decision_unix":1779820702.8884175,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7587,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":34,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":66214.0,"score_lmetric":73801},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7587,"score_linear":18420.0,"score_lmetric":7587},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7587,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389838.403302718,"t_first_token_unix":1779820703.4172466,"t_done":389838.592628398,"t_done_unix":1779820703.6065717},{"request_id":"1237877:3:1242953:15","session_id":"1237877","input_length":2659,"t_proxy_recv":389841.306177172,"t_decision_unix":1779820706.3201182,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.5776607747273411,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":1123,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17157,"ongoing_decode_tokens":0,"pending_prefill_tokens":17157,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":2659,"score_linear":17157.0,"score_lmetric":19816},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":66214.0,"score_lmetric":68873},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":1536,"new_prefill":1123,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":2659,"score_linear":18420.0,"score_lmetric":2659},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":2659,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":389841.399751657,"t_first_token_unix":1779820706.4136949,"t_done":389841.462595621,"t_done_unix":1779820706.4765387},{"request_id":"1242838:1:1242838:14","session_id":"1242838","input_length":17157,"t_proxy_recv":389840.927427245,"t_decision_unix":1779820705.9413683,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":66214.0,"score_lmetric":83371},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":68,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17157,"score_linear":18420.0,"score_lmetric":17157},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17157,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389842.625485507,"t_first_token_unix":1779820707.6394312,"t_done":389843.51528001,"t_done_unix":1779820708.5292244},{"request_id":"1239704:2:1243943:17","session_id":"1239704","input_length":14812,"t_proxy_recv":389844.585029164,"t_decision_unix":1779820709.5989704,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":5120,"affinity_cache_ratio":0.3456656764785309,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":9692,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":43,"cache_hit":5120,"new_prefill":9692,"score_linear":-5120.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":11074,"ongoing_decode_tokens":0,"pending_prefill_tokens":11074,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14812,"score_linear":11074.0,"score_lmetric":25886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":66214.0,"score_lmetric":81026},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":14812,"score_linear":18420.0,"score_lmetric":14812},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":14812,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":389845.659265175,"t_first_token_unix":1779820710.6732087,"t_done":389845.771964329,"t_done_unix":1779820710.7859073},{"request_id":"1243831:1:1243831:16","session_id":"1243831","input_length":11074,"t_proxy_recv":389844.183805692,"t_decision_unix":1779820709.1977472,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":43,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":66214.0,"score_lmetric":77288},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":11074,"score_linear":18420.0,"score_lmetric":11074},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389845.122472328,"t_first_token_unix":1779820710.1364162,"t_done":389846.603809071,"t_done_unix":1779820711.6177528},{"request_id":"1239034:2:1240558:10","session_id":"1239034","input_length":18420,"t_proxy_recv":389833.252422348,"t_decision_unix":1779820698.2663636,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":13312,"affinity_cache_ratio":0.7226927252985885,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":5108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":0,"pending_prefill_tokens":66214,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":66214.0,"score_lmetric":84634},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30040,"ongoing_decode_tokens":0,"pending_prefill_tokens":30040,"num_requests":1,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":18420,"score_linear":30040.0,"score_lmetric":48460},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":13312,"new_prefill":5108,"score_linear":-13312.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":37165.0,"score_lmetric":55585},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":18420,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-13312.0,"chosen_score_lmetric":0,"t_first_token":389833.959858597,"t_first_token_unix":1779820698.973802,"t_done":389847.214670543,"t_done_unix":1779820712.2286136},{"request_id":"1239755:1:1239755:8","session_id":"1239755","input_length":66214,"t_proxy_recv":389830.692509129,"t_decision_unix":1779820695.7064502,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66214,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5194,"ongoing_decode_tokens":0,"pending_prefill_tokens":5194,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":5194.0,"score_lmetric":71408},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":20,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":10,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":37165,"ongoing_decode_tokens":0,"pending_prefill_tokens":37165,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":37165.0,"score_lmetric":103379},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":66214,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389846.556750172,"t_first_token_unix":1779820711.5706952,"t_done":389847.236847883,"t_done_unix":1779820712.250792},{"request_id":"1244640:1:1244640:18","session_id":"1244640","input_length":8274,"t_proxy_recv":389847.078261322,"t_decision_unix":1779820712.0922027,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8274,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66214,"ongoing_decode_tokens":66214,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":66214.0,"score_lmetric":8274},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":70,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":18420,"ongoing_decode_tokens":18420,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":8274,"score_linear":18420.0,"score_lmetric":8274},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":8274,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389847.671249985,"t_first_token_unix":1779820712.685194,"t_done":389847.871186959,"t_done_unix":1779820712.8851304},{"request_id":"1245572:1:1245572:19","session_id":"1245572","input_length":6109,"t_proxy_recv":389850.213276654,"t_decision_unix":1779820715.2272182,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6109,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6109,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389850.909410195,"t_first_token_unix":1779820715.9233537,"t_done":389851.149958885,"t_done_unix":1779820716.1639018},{"request_id":"1241953:2:1245624:20","session_id":"1241953","input_length":10382,"t_proxy_recv":389850.303480988,"t_decision_unix":1779820715.3174226,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":1024,"affinity_cache_ratio":0.09863224812174919,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":9358,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":1024,"new_prefill":9358,"score_linear":-1024.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":10382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":6109,"ongoing_decode_tokens":0,"pending_prefill_tokens":6109,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10382,"score_linear":6109.0,"score_lmetric":16491}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":389851.100932056,"t_first_token_unix":1779820716.1148756,"t_done":389851.283486509,"t_done_unix":1779820716.2974296},{"request_id":"1245572:2:1246348:22","session_id":"1245572","input_length":6182,"t_proxy_recv":389852.810205776,"t_decision_unix":1779820717.8241467,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.9938531219670009,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":38,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":17447,"ongoing_decode_tokens":0,"pending_prefill_tokens":10279,"num_requests":1,"active_p_offloads":0,"cached_blocks":76,"cache_hit":0,"new_prefill":6182,"score_linear":17447.0,"score_lmetric":16461},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6182,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":6144,"new_prefill":38,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":389852.840064217,"t_first_token_unix":1779820717.854008,"t_done":389853.016952089,"t_done_unix":1779820718.030895},{"request_id":"1240924:2:1246244:21","session_id":"1240924","input_length":17447,"t_proxy_recv":389852.43642276,"t_decision_unix":1779820717.4503639,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7168,"affinity_cache_ratio":0.4108442712214134,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":76,"cache_hit":7168,"new_prefill":10279,"score_linear":-7168.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":17447,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":389853.651644738,"t_first_token_unix":1779820718.6655884,"t_done":389854.020925245,"t_done_unix":1779820719.0348682},{"request_id":"1241942:2:1247111:23","session_id":"1241942","input_length":17975,"t_proxy_recv":389855.485421654,"t_decision_unix":1779820720.4993627,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":7168,"affinity_cache_ratio":0.3987760778859527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10807,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":7168,"new_prefill":10807,"score_linear":-7168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":17975,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":389856.780426809,"t_first_token_unix":1779820721.7943704,"t_done":389856.960055288,"t_done_unix":1779820721.9739983},{"request_id":"1244640:2:1247941:24","session_id":"1244640","input_length":10696,"t_proxy_recv":389858.298558085,"t_decision_unix":1779820723.3124995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8192,"affinity_cache_ratio":0.7658937920718025,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":2504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":8192,"new_prefill":2504,"score_linear":-8192.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":10696,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8192.0,"chosen_score_lmetric":0,"t_first_token":389858.617906427,"t_first_token_unix":1779820723.6318514,"t_done":389858.664216003,"t_done_unix":1779820723.6781597},{"request_id":"1248768:1:1248768:25","session_id":"1248768","input_length":11515,"t_proxy_recv":389861.076937217,"t_decision_unix":1779820726.0908785,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11515,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":11515,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389862.04901344,"t_first_token_unix":1779820727.062957,"t_done":389862.307051747,"t_done_unix":1779820727.3209953},{"request_id":"1249058:1:1249058:26","session_id":"1249058","input_length":4126,"t_proxy_recv":389862.098025228,"t_decision_unix":1779820727.1119666,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4126,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11515,"ongoing_decode_tokens":11515,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":61,"cache_hit":0,"new_prefill":4126,"score_linear":11515.0,"score_lmetric":4126},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":37,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":4126,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389862.359966146,"t_first_token_unix":1779820727.37391,"t_done":389862.523764813,"t_done_unix":1779820727.5377085},{"request_id":"1248768:2:1249765:27","session_id":"1248768","input_length":12188,"t_proxy_recv":389864.362284814,"t_decision_unix":1779820729.376226,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.924187725631769,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":924,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":83,"cache_hit":11264,"new_prefill":924,"score_linear":-11264.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":45,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":12188,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":389864.503861284,"t_first_token_unix":1779820729.5178049,"t_done":389864.963398826,"t_done_unix":1779820729.977342},{"request_id":"1249058:2:1249872:28","session_id":"1249058","input_length":7482,"t_proxy_recv":389864.753477664,"t_decision_unix":1779820729.767419,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4096,"affinity_cache_ratio":0.5474472066292435,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":3386,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12188,"ongoing_decode_tokens":12188,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":83,"cache_hit":0,"new_prefill":7482,"score_linear":12188.0,"score_lmetric":7482},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":45,"cache_hit":4096,"new_prefill":3386,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":7482,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":389865.069719518,"t_first_token_unix":1779820730.083663,"t_done":389865.19534782,"t_done_unix":1779820730.2092907},{"request_id":"1242838:2:1250503:29","session_id":"1242838","input_length":21578,"t_proxy_recv":389867.029233732,"t_decision_unix":1779820732.0431752,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.783019742330151,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":4682,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":84,"cache_hit":16896,"new_prefill":4682,"score_linear":-16896.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":21578,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":389867.740731864,"t_first_token_unix":1779820732.7546754,"t_done":389868.225083403,"t_done_unix":1779820733.239027},{"request_id":"1250772:1:1250772:30","session_id":"1250772","input_length":6829,"t_proxy_recv":389867.888967785,"t_decision_unix":1779820732.9029093,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6829,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":21578,"ongoing_decode_tokens":21578,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":84,"cache_hit":0,"new_prefill":6829,"score_linear":21578.0,"score_lmetric":6829},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":6829,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389868.875295029,"t_first_token_unix":1779820733.8892386,"t_done":389870.443720464,"t_done_unix":1779820735.4576645},{"request_id":"1251059:1:1251059:32","session_id":"1251059","input_length":16512,"t_proxy_recv":389869.07081308,"t_decision_unix":1779820734.0847547,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":6829,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":16512,"score_linear":6829.0,"score_lmetric":16512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":0,"pending_prefill_tokens":20086,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":16512,"score_linear":20086.0,"score_lmetric":36598},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":16512,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389870.630571353,"t_first_token_unix":1779820735.6445148,"t_done":389870.632411302,"t_done_unix":1779820735.6463542},{"request_id":"1248768:3:1251261:33","session_id":"1248768","input_length":16989,"t_proxy_recv":389869.648082377,"t_decision_unix":1779820734.6620238,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11776,"affinity_cache_ratio":0.6931543940196597,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":5213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":11776,"new_prefill":5213,"score_linear":-11776.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":16512,"ongoing_decode_tokens":0,"pending_prefill_tokens":16512,"num_requests":1,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":16989,"score_linear":16512.0,"score_lmetric":33501},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":6829,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":16989,"score_linear":6829.0,"score_lmetric":16989},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":0,"pending_prefill_tokens":20086,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":16989,"score_linear":20086.0,"score_lmetric":37075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":16989,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":389870.330484118,"t_first_token_unix":1779820735.34443,"t_done":389871.291221281,"t_done_unix":1779820736.3051643},{"request_id":"1251828:1:1251828:35","session_id":"1251828","input_length":1090,"t_proxy_recv":389871.574722198,"t_decision_unix":1779820736.5886638,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1090,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":1090,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":20086,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":1090,"score_linear":20086.0,"score_lmetric":1090},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13780,"ongoing_decode_tokens":0,"pending_prefill_tokens":7636,"num_requests":1,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":1090,"score_linear":13780.0,"score_lmetric":8726}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389871.662116461,"t_first_token_unix":1779820736.67606,"t_done":389871.768254599,"t_done_unix":1779820736.7821975},{"request_id":"1250935:1:1250935:31","session_id":"1250935","input_length":20086,"t_proxy_recv":389868.513350124,"t_decision_unix":1779820733.527291,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":20086,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":6829,"ongoing_decode_tokens":0,"pending_prefill_tokens":6829,"num_requests":1,"active_p_offloads":0,"cached_blocks":0,"cache_hit":0,"new_prefill":20086,"score_linear":6829.0,"score_lmetric":26915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":0,"new_prefill":20086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389870.595184886,"t_first_token_unix":1779820735.6091285,"t_done":389871.83498502,"t_done_unix":1779820736.8489282},{"request_id":"1245572:3:1251662:34","session_id":"1245572","input_length":13780,"t_proxy_recv":389871.056172264,"t_decision_unix":1779820736.070114,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.4458635703918723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":7636,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16989,"ongoing_decode_tokens":16989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":93,"cache_hit":0,"new_prefill":13780,"score_linear":16989.0,"score_lmetric":13780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":90,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":13780,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20086,"ongoing_decode_tokens":20086,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":105,"cache_hit":0,"new_prefill":13780,"score_linear":20086.0,"score_lmetric":13780},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":12,"cache_hit":6144,"new_prefill":7636,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":389871.852992913,"t_first_token_unix":1779820736.8669367,"t_done":389872.074827177,"t_done_unix":1779820737.0887704},{"request_id":"1252010:1:1252010:36","session_id":"1252010","input_length":9855,"t_proxy_recv":389872.18350313,"t_decision_unix":1779820737.1974447,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9855,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":144,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9855,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389872.994089228,"t_first_token_unix":1779820738.008033,"t_done":389873.164277125,"t_done_unix":1779820738.1782203},{"request_id":"1248768:4:1253385:37","session_id":"1248768","input_length":17309,"t_proxy_recv":389876.958418359,"t_decision_unix":1779820741.9723597,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.9761395805650239,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":413,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":103,"cache_hit":16896,"new_prefill":413,"score_linear":-16896.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17309,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":389877.037889727,"t_first_token_unix":1779820742.0518336,"t_done":389879.959330073,"t_done_unix":1779820744.973273},{"request_id":"1251828:2:1254272:41","session_id":"1251828","input_length":3934,"t_proxy_recv":389879.926826837,"t_decision_unix":1779820744.9407685,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":4,"affinity_cache_hit":1024,"affinity_cache_ratio":0.2602948652770717,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3934,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":3934,"score_linear":17309.0,"score_lmetric":3934},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":3934,"score_linear":35221.0,"score_lmetric":39155},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":1024,"new_prefill":2910,"score_linear":48600.0,"score_lmetric":52534},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":0,"pending_prefill_tokens":4108,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":3934,"score_linear":10764.0,"score_lmetric":8042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":3934,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389880.17154577,"t_first_token_unix":1779820745.1854892,"t_done":389880.314995243,"t_done_unix":1779820745.328938},{"request_id":"1254584:1:1254584:42","session_id":"1254584","input_length":748,"t_proxy_recv":389881.05965462,"t_decision_unix":1779820746.0735962,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":748,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":748,"score_linear":35221.0,"score_lmetric":35969},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":748,"score_linear":49624.0,"score_lmetric":50372},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":10764,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":748,"score_linear":10764.0,"score_lmetric":748},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":748,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389881.124850423,"t_first_token_unix":1779820746.1387937,"t_done":389881.275292305,"t_done_unix":1779820746.2892354},{"request_id":"1252010:2:1254691:43","session_id":"1252010","input_length":13092,"t_proxy_recv":389881.512529334,"t_decision_unix":1779820746.5264707,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9728,"affinity_cache_ratio":0.743049190345249,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":3364,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":13092,"score_linear":35221.0,"score_lmetric":48313},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":13092,"score_linear":49624.0,"score_lmetric":62716},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":10764,"ongoing_decode_tokens":10764,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":13092,"score_linear":10764.0,"score_lmetric":13092},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":9728,"new_prefill":3364,"score_linear":-9728.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":13092,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":389881.942871773,"t_first_token_unix":1779820746.956815,"t_done":389882.110776493,"t_done_unix":1779820747.1247196},{"request_id":"1250772:2:1254198:40","session_id":"1250772","input_length":10764,"t_proxy_recv":389879.654709964,"t_decision_unix":1779820744.668651,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6656,"affinity_cache_ratio":0.6183574879227053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":4108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":10764,"score_linear":17309.0,"score_lmetric":10764},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":35221,"ongoing_decode_tokens":0,"pending_prefill_tokens":35221,"num_requests":1,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":10764,"score_linear":35221.0,"score_lmetric":45985},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":10764,"score_linear":49624.0,"score_lmetric":60388},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":6656,"new_prefill":4108,"score_linear":-6656.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":10764,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":389880.037906919,"t_first_token_unix":1779820745.0518506,"t_done":389882.270434325,"t_done_unix":1779820747.2843773},{"request_id":"1253804:1:1253804:39","session_id":"1253804","input_length":35221,"t_proxy_recv":389878.547574572,"t_decision_unix":1779820743.5615156,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":35221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":35221,"score_linear":17309.0,"score_lmetric":35221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":35221,"score_linear":49624.0,"score_lmetric":84845},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":35221,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389883.74392408,"t_first_token_unix":1779820748.7578683,"t_done":389885.940357516,"t_done_unix":1779820750.9543009},{"request_id":"1256273:1:1256273:46","session_id":"1256273","input_length":1694,"t_proxy_recv":389886.742227121,"t_decision_unix":1779820751.7561684,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1694,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":1694,"score_linear":49624.0,"score_lmetric":51318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":0,"pending_prefill_tokens":10618,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":1694,"score_linear":17786.0,"score_lmetric":12312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1694,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389886.886194046,"t_first_token_unix":1779820751.9001374,"t_done":389887.165742944,"t_done_unix":1779820752.179686},{"request_id":"1243831:2:1256324:47","session_id":"1243831","input_length":11448,"t_proxy_recv":389886.90711162,"t_decision_unix":1779820751.9210532,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":11264,"affinity_cache_ratio":0.983927323549965,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":11264,"new_prefill":184,"score_linear":-11264.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":11448,"score_linear":49624.0,"score_lmetric":61072},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":0,"pending_prefill_tokens":10618,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":11448,"score_linear":17786.0,"score_lmetric":22066},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1694,"ongoing_decode_tokens":1694,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":11448,"score_linear":1694.0,"score_lmetric":11448},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":11448,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":389886.960719718,"t_first_token_unix":1779820751.974663,"t_done":389887.395034528,"t_done_unix":1779820752.4089777},{"request_id":"1253743:1:1253743:38","session_id":"1253743","input_length":49624,"t_proxy_recv":389878.306793541,"t_decision_unix":1779820743.3207347,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49624,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":17309,"ongoing_decode_tokens":17309,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":103,"cache_hit":0,"new_prefill":49624,"score_linear":17309.0,"score_lmetric":49624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":96,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":161,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":51,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":13,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":49624,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389887.556059117,"t_first_token_unix":1779820752.5700023,"t_done":389887.948786691,"t_done_unix":1779820752.9627326},{"request_id":"1249058:3:1256222:45","session_id":"1249058","input_length":17786,"t_proxy_recv":389886.595558207,"t_decision_unix":1779820751.6094997,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7168,"affinity_cache_ratio":0.4030136062071292,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":10618,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49624,"ongoing_decode_tokens":0,"pending_prefill_tokens":49624,"num_requests":1,"active_p_offloads":0,"cached_blocks":92,"cache_hit":0,"new_prefill":17786,"score_linear":49624.0,"score_lmetric":67410},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":58,"cache_hit":7168,"new_prefill":10618,"score_linear":-7168.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":21,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":17786,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":389887.861638448,"t_first_token_unix":1779820752.8755832,"t_done":389887.97545204,"t_done_unix":1779820752.9893951},{"request_id":"1253743:2:1256070:44","session_id":"1253743","input_length":49687,"t_proxy_recv":389887.957751361,"t_decision_unix":1779820752.971693,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9995371022601486,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":23,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":3584,"new_prefill":46103,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":49664,"new_prefill":23,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":17786,"ongoing_decode_tokens":17786,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":58,"cache_hit":0,"new_prefill":49687,"score_linear":17786.0,"score_lmetric":49687},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":49687,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":389888.038631475,"t_first_token_unix":1779820753.0525749,"t_done":389888.85208158,"t_done_unix":1779820753.8660252},{"request_id":"1256273:2:1257769:51","session_id":"1256273","input_length":6170,"t_proxy_recv":389891.72652222,"t_decision_unix":1779820756.7404633,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.24894651539708265,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":4634,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":4434,"ongoing_decode_tokens":4434,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":6170,"score_linear":4434.0,"score_lmetric":6170},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":6170,"score_linear":27387.0,"score_lmetric":33557},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6170,"score_linear":90488.0,"score_lmetric":96658},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":1536,"new_prefill":4634,"score_linear":-1536.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":6170,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":389892.054315359,"t_first_token_unix":1779820757.0682588,"t_done":389892.348111726,"t_done_unix":1779820757.362055},{"request_id":"1257572:1:1257572:50","session_id":"1257572","input_length":4434,"t_proxy_recv":389891.092101876,"t_decision_unix":1779820756.1060436,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":4434,"score_linear":27387.0,"score_lmetric":31821},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":4434,"score_linear":90488.0,"score_lmetric":94922},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":4434,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389891.375688117,"t_first_token_unix":1779820756.3896317,"t_done":389892.597111702,"t_done_unix":1779820757.6110554},{"request_id":"1254584:2:1258039:52","session_id":"1254584","input_length":1257,"t_proxy_recv":389892.746186094,"t_decision_unix":1779820757.7601275,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":512,"affinity_cache_ratio":0.40731901352426414,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":745,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":113,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":1257,"score_linear":27387.0,"score_lmetric":28644},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":512,"new_prefill":745,"score_linear":-512.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":1257,"score_linear":90488.0,"score_lmetric":91745},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":1257,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":389892.800349669,"t_first_token_unix":1779820757.8142931,"t_done":389893.128847295,"t_done_unix":1779820758.1427906},{"request_id":"1242838:3:1258161:53","session_id":"1242838","input_length":22262,"t_proxy_recv":389893.206700405,"t_decision_unix":1779820758.220642,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9659509478034318,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":113,"cache_hit":21504,"new_prefill":758,"score_linear":-21504.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":22262,"score_linear":27387.0,"score_lmetric":49649},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22262,"score_linear":90488.0,"score_lmetric":112750},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":22262,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":389893.366910347,"t_first_token_unix":1779820758.3808537,"t_done":389893.909645476,"t_done_unix":1779820758.9235885},{"request_id":"1256273:3:1258499:55","session_id":"1256273","input_length":7934,"t_proxy_recv":389894.370473482,"t_decision_unix":1779820759.3844147,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6144,"affinity_cache_ratio":0.7743887068313587,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":1790,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":0,"pending_prefill_tokens":45037,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":7934,"score_linear":80365.0,"score_lmetric":105942},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":7934,"score_linear":90488.0,"score_lmetric":98422},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":6144,"new_prefill":1790,"score_linear":-6144.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":7934,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":389894.556082434,"t_first_token_unix":1779820759.5700257,"t_done":389895.162639933,"t_done_unix":1779820760.1765828},{"request_id":"1258908:1:1258908:58","session_id":"1258908","input_length":9250,"t_proxy_recv":389895.82295522,"t_decision_unix":1779820760.8368967,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9250,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":9250,"score_linear":80365.0,"score_lmetric":53800},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":9250,"score_linear":68131.0,"score_lmetric":77381},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":9250,"score_linear":90488.0,"score_lmetric":99738},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9250,"score_linear":112793.0,"score_lmetric":122043},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9250,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389896.519626439,"t_first_token_unix":1779820761.53357,"t_done":389898.484096162,"t_done_unix":1779820763.4980392},{"request_id":"1259178:1:1259178:59","session_id":"1259178","input_length":14291,"t_proxy_recv":389896.784500449,"t_decision_unix":1779820761.7984333,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":14291,"score_linear":80365.0,"score_lmetric":63882},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":14291,"score_linear":68131.0,"score_lmetric":82422},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9250,"ongoing_decode_tokens":9250,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":14291,"score_linear":9250.0,"score_lmetric":14291},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":14291,"score_linear":90488.0,"score_lmetric":104779},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14291,"score_linear":112793.0,"score_lmetric":127084},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":14291,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389898.033145621,"t_first_token_unix":1779820763.0470889,"t_done":389899.962443029,"t_done_unix":1779820764.976386},{"request_id":"1257525:1:1257525:49","session_id":"1257525","input_length":27387,"t_proxy_recv":389891.006794878,"t_decision_unix":1779820756.0207362,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":27387,"score_linear":90488.0,"score_lmetric":117875},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":27387,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389894.470772575,"t_first_token_unix":1779820759.4847167,"t_done":389900.106131827,"t_done_unix":1779820765.1200752},{"request_id":"1253804:2:1258346:54","session_id":"1253804","input_length":52978,"t_proxy_recv":389893.916918365,"t_decision_unix":1779820758.9308598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":35328,"affinity_cache_ratio":0.6668428404243271,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":17650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":27387,"ongoing_decode_tokens":0,"pending_prefill_tokens":27387,"num_requests":1,"active_p_offloads":0,"cached_blocks":165,"cache_hit":35328,"new_prefill":17650,"score_linear":-7941.0,"score_lmetric":45037},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":3584,"new_prefill":49394,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":52978,"score_linear":90488.0,"score_lmetric":143466},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":52978,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7941.0,"chosen_score_lmetric":45037,"t_first_token":389899.737384813,"t_first_token_unix":1779820764.7513287,"t_done":389900.659303031,"t_done_unix":1779820765.6732461},{"request_id":"1260746:1:1260746:62","session_id":"1260746","input_length":9571,"t_proxy_recv":389902.329196871,"t_decision_unix":1779820767.343138,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9571,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":9571,"score_linear":68131.0,"score_lmetric":77702},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":9571,"score_linear":90488.0,"score_lmetric":100059},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9571,"score_linear":125063.0,"score_lmetric":253908},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":9571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":9571,"score_linear":30655.0,"score_lmetric":40226}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389903.075140706,"t_first_token_unix":1779820768.089085,"t_done":389903.460880076,"t_done_unix":1779820768.4748237},{"request_id":"1260792:1:1260792:63","session_id":"1260792","input_length":12522,"t_proxy_recv":389902.444382993,"t_decision_unix":1779820767.4583242,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12522,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9571,"ongoing_decode_tokens":0,"pending_prefill_tokens":9571,"num_requests":1,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":12522,"score_linear":9571.0,"score_lmetric":22093},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":12522,"score_linear":68131.0,"score_lmetric":80653},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":12522,"score_linear":90488.0,"score_lmetric":103010},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12522,"score_linear":125063.0,"score_lmetric":259810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":12522,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":12522,"score_linear":30655.0,"score_lmetric":43177}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389903.471592577,"t_first_token_unix":1779820768.4855368,"t_done":389903.803778334,"t_done_unix":1779820768.8177226},{"request_id":"1261126:1:1261126:65","session_id":"1261126","input_length":5640,"t_proxy_recv":389903.48135068,"t_decision_unix":1779820768.4952922,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5640,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":132,"cache_hit":0,"new_prefill":5640,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55138,"ongoing_decode_tokens":0,"pending_prefill_tokens":2402,"num_requests":1,"active_p_offloads":0,"cached_blocks":252,"cache_hit":0,"new_prefill":5640,"score_linear":55138.0,"score_lmetric":8042},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":5640,"score_linear":68131.0,"score_lmetric":73771},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12522,"ongoing_decode_tokens":12522,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5640,"score_linear":12522.0,"score_lmetric":5640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5640,"score_linear":90488.0,"score_lmetric":96128},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5640,"score_linear":125063.0,"score_lmetric":246046},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":5640,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":5640,"score_linear":30655.0,"score_lmetric":36295}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389903.853478676,"t_first_token_unix":1779820768.8674226,"t_done":389904.016276186,"t_done_unix":1779820769.0302193},{"request_id":"1253804:3:1260997:64","session_id":"1253804","input_length":55138,"t_proxy_recv":389903.183593611,"t_decision_unix":1779820768.1975346,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9564365773151003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2402,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9571,"ongoing_decode_tokens":9571,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":55138,"score_linear":9571.0,"score_lmetric":55138},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":252,"cache_hit":52736,"new_prefill":2402,"score_linear":-52736.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":55138,"score_linear":68131.0,"score_lmetric":123269},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12522,"ongoing_decode_tokens":0,"pending_prefill_tokens":12522,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":3584,"new_prefill":51554,"score_linear":8938.0,"score_lmetric":64076},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":55138,"score_linear":90488.0,"score_lmetric":145626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":55138,"score_linear":125063.0,"score_lmetric":345042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":55138,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":30655,"ongoing_decode_tokens":0,"pending_prefill_tokens":30655,"num_requests":1,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":55138,"score_linear":30655.0,"score_lmetric":85793}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":389904.059013825,"t_first_token_unix":1779820769.0729578,"t_done":389904.643225069,"t_done_unix":1779820769.6571686},{"request_id":"1260327:1:1260327:61","session_id":"1260327","input_length":30655,"t_proxy_recv":389900.608767203,"t_decision_unix":1779820765.6227086,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":30655,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":52978,"ongoing_decode_tokens":52978,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":218,"cache_hit":0,"new_prefill":30655,"score_linear":52978.0,"score_lmetric":30655},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":30655,"score_linear":68131.0,"score_lmetric":98786},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":30655,"score_linear":90488.0,"score_lmetric":121143},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":30655,"score_linear":125063.0,"score_lmetric":296076},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":30655,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389904.657404009,"t_first_token_unix":1779820769.6713476,"t_done":389905.300584297,"t_done_unix":1779820770.3145275},{"request_id":"1257525:2:1262205:67","session_id":"1257525","input_length":29988,"t_proxy_recv":389907.299153335,"t_decision_unix":1779820772.3130949,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9048952914499133,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":2852,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":256,"cache_hit":27136,"new_prefill":2852,"score_linear":-27136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":29988,"score_linear":68131.0,"score_lmetric":98119},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":29988,"score_linear":90488.0,"score_lmetric":120476},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":29988,"score_linear":125063.0,"score_lmetric":294742},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":29988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":389907.924408035,"t_first_token_unix":1779820772.9383516,"t_done":389907.956389276,"t_done_unix":1779820772.9703321},{"request_id":"1262757:1:1262757:73","session_id":"1262757","input_length":5465,"t_proxy_recv":389909.176933695,"t_decision_unix":1779820774.1908748,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":5465,"score_linear":55989.0,"score_lmetric":6670},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":5465,"score_linear":68131.0,"score_lmetric":73596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5465,"score_linear":15283.0,"score_lmetric":20748},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5465,"score_linear":113053.0,"score_lmetric":196076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5465,"score_linear":125063.0,"score_lmetric":245696},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":5465,"score_linear":21510.0,"score_lmetric":26975}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389909.537486985,"t_first_token_unix":1779820774.5514314,"t_done":389909.665828805,"t_done_unix":1779820774.679772},{"request_id":"1261126:2:1262820:74","session_id":"1261126","input_length":6953,"t_proxy_recv":389909.349444567,"t_decision_unix":1779820774.3633854,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":5632,"affinity_cache_ratio":0.8100100675967209,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":1321,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":5632,"new_prefill":1321,"score_linear":-5632.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":6953,"score_linear":55989.0,"score_lmetric":8158},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":6953,"score_linear":68131.0,"score_lmetric":75084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":6953,"score_linear":15283.0,"score_lmetric":22236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6953,"score_linear":113053.0,"score_lmetric":199052},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":6953,"score_linear":125063.0,"score_lmetric":248672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":5465,"ongoing_decode_tokens":0,"pending_prefill_tokens":5465,"num_requests":1,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":6953,"score_linear":5465.0,"score_lmetric":12418},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":6953,"score_linear":21510.0,"score_lmetric":28463}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":389909.502971699,"t_first_token_unix":1779820774.5169148,"t_done":389909.736443089,"t_done_unix":1779820774.7503862},{"request_id":"1262354:1:1262354:69","session_id":"1262354","input_length":21510,"t_proxy_recv":389907.893786012,"t_decision_unix":1779820772.9077272,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":29988,"ongoing_decode_tokens":0,"pending_prefill_tokens":2852,"num_requests":1,"active_p_offloads":0,"cached_blocks":256,"cache_hit":0,"new_prefill":21510,"score_linear":29988.0,"score_lmetric":24362},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":21510,"score_linear":68131.0,"score_lmetric":89641},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":21510,"score_linear":113053.0,"score_lmetric":228166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":21510,"score_linear":125063.0,"score_lmetric":277786},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":21510,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389910.198488099,"t_first_token_unix":1779820775.2124324,"t_done":389910.79398777,"t_done_unix":1779820775.8079312},{"request_id":"1258611:1:1258611:56","session_id":"1258611","input_length":68131,"t_proxy_recv":389894.768665277,"t_decision_unix":1779820759.7826066,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":68131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":68131,"score_linear":80365.0,"score_lmetric":171562},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68131,"score_linear":90488.0,"score_lmetric":158619},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7934,"ongoing_decode_tokens":7934,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":33,"cache_hit":0,"new_prefill":68131,"score_linear":7934.0,"score_lmetric":68131},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":68131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389911.120363713,"t_first_token_unix":1779820776.1343076,"t_done":389912.266633649,"t_done_unix":1779820777.280577},{"request_id":"1258611:2:1261594:66","session_id":"1258611","input_length":68320,"t_proxy_recv":389912.278782953,"t_decision_unix":1779820777.2927241,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9967213114754099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":224,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":68320,"score_linear":55989.0,"score_lmetric":68320},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":68096,"new_prefill":224,"score_linear":-68096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":68320,"score_linear":15283.0,"score_lmetric":68320},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68320,"score_linear":113053.0,"score_lmetric":160893},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":68320,"score_linear":125063.0,"score_lmetric":371406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":68320,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":0,"pending_prefill_tokens":605,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":68320,"score_linear":22109.0,"score_lmetric":68925}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":389912.456825526,"t_first_token_unix":1779820777.4707694,"t_done":389912.511894935,"t_done_unix":1779820777.5258381},{"request_id":"1258611:3:1262709:71","session_id":"1258611","input_length":68377,"t_proxy_recv":389912.527887334,"t_decision_unix":1779820777.5418286,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9958904309928778,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":0,"pending_prefill_tokens":5990,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":68377,"score_linear":5990.0,"score_lmetric":74367},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":68377,"score_linear":55989.0,"score_lmetric":68377},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":68096,"new_prefill":281,"score_linear":-68096.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":68377,"score_linear":15283.0,"score_lmetric":68377},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":68377,"score_linear":113053.0,"score_lmetric":160950},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":68377,"score_linear":125063.0,"score_lmetric":371520},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":68377,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":68377,"score_linear":22109.0,"score_lmetric":68377}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":389912.687155527,"t_first_token_unix":1779820777.7010987,"t_done":389913.099942491,"t_done_unix":1779820778.1138856},{"request_id":"1263611:1:1263611:76","session_id":"1263611","input_length":5990,"t_proxy_recv":389912.372444713,"t_decision_unix":1779820777.3863862,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5990,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":5990,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":5990,"score_linear":55989.0,"score_lmetric":5990},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68320,"ongoing_decode_tokens":0,"pending_prefill_tokens":224,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":5990,"score_linear":68320.0,"score_lmetric":6214},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5990,"score_linear":15283.0,"score_lmetric":5990},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":5990,"score_linear":113053.0,"score_lmetric":98563},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5990,"score_linear":125063.0,"score_lmetric":246746},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5990,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":0,"pending_prefill_tokens":605,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":5990,"score_linear":22109.0,"score_lmetric":6595}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389912.765997773,"t_first_token_unix":1779820777.7799509,"t_done":389913.151310284,"t_done_unix":1779820778.1652534},{"request_id":"1262354:2:1263593:75","session_id":"1262354","input_length":22109,"t_proxy_recv":389912.259237056,"t_decision_unix":1779820777.2731783,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9726355782712922,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":605,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":22109,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":22109,"score_linear":55989.0,"score_lmetric":22109},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":68131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22109,"score_linear":68131.0,"score_lmetric":22109},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22109,"score_linear":15283.0,"score_lmetric":22109},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22109,"score_linear":113053.0,"score_lmetric":114682},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22109,"score_linear":125063.0,"score_lmetric":278984},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":22109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":128,"cache_hit":21504,"new_prefill":605,"score_linear":-21504.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":389912.409302153,"t_first_token_unix":1779820777.4232457,"t_done":389913.62460207,"t_done_unix":1779820778.6385553},{"request_id":"1263971:1:1263971:80","session_id":"1263971","input_length":6336,"t_proxy_recv":389913.680179829,"t_decision_unix":1779820778.6941214,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":6336,"score_linear":55989.0,"score_lmetric":6336},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":6336,"score_linear":71575.0,"score_lmetric":125256},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":6336,"score_linear":113053.0,"score_lmetric":98909},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":6336,"score_linear":125063.0,"score_lmetric":247438},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":6336,"score_linear":50783.0,"score_lmetric":57119},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":129,"cache_hit":0,"new_prefill":6336,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389914.097069266,"t_first_token_unix":1779820779.1110127,"t_done":389914.455634196,"t_done_unix":1779820779.4695778},{"request_id":"1257323:1:1257323:48","session_id":"1257323","input_length":90488,"t_proxy_recv":389890.40676934,"t_decision_unix":1779820755.4207106,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":90488,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":104,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":162,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":24,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":90488,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389917.973857089,"t_first_token_unix":1779820782.9878006,"t_done":389918.389708194,"t_done_unix":1779820783.4036515},{"request_id":"1239034:3:1262346:68","session_id":"1239034","input_length":22565,"t_proxy_recv":389907.862388758,"t_decision_unix":1779820772.87633,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":20480,"affinity_cache_ratio":0.9076002658985154,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":2085,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":29988,"ongoing_decode_tokens":0,"pending_prefill_tokens":2852,"num_requests":1,"active_p_offloads":0,"cached_blocks":256,"cache_hit":0,"new_prefill":22565,"score_linear":29988.0,"score_lmetric":25417},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":22565,"score_linear":68131.0,"score_lmetric":90696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":20480,"new_prefill":2085,"score_linear":70008.0,"score_lmetric":92573},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22565,"score_linear":125063.0,"score_lmetric":279896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":22565,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":70008.0,"chosen_score_lmetric":92573,"t_first_token":389917.975188588,"t_first_token_unix":1779820782.9891315,"t_done":389918.514112279,"t_done_unix":1779820783.5280557},{"request_id":"1265000:1:1265000:83","session_id":"1265000","input_length":301,"t_proxy_recv":389917.305635627,"t_decision_unix":1779820782.319577,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":301,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":301,"score_linear":110048.0,"score_lmetric":110349},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":301,"score_linear":55989.0,"score_lmetric":301},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":301,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":301,"score_linear":71575.0,"score_lmetric":113186},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":301,"score_linear":113053.0,"score_lmetric":92874},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":301,"score_linear":125063.0,"score_lmetric":235368},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":301,"score_linear":50783.0,"score_lmetric":51084},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":301,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389917.344550655,"t_first_token_unix":1779820782.358494,"t_done":389918.852634457,"t_done_unix":1779820783.8665779},{"request_id":"1265128:1:1265128:85","session_id":"1265128","input_length":14028,"t_proxy_recv":389917.634587,"t_decision_unix":1779820782.6485283,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":14028,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14028,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":14028,"score_linear":110048.0,"score_lmetric":124076},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":14028,"score_linear":55989.0,"score_lmetric":14028},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":301,"ongoing_decode_tokens":301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":14028,"score_linear":301.0,"score_lmetric":14028},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":14028,"score_linear":71575.0,"score_lmetric":140640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":14028,"score_linear":113053.0,"score_lmetric":106601},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14028,"score_linear":125063.0,"score_lmetric":262822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":14028,"score_linear":50783.0,"score_lmetric":64811},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":23540,"ongoing_decode_tokens":0,"pending_prefill_tokens":23540,"num_requests":1,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":14028,"score_linear":23540.0,"score_lmetric":37568}],"chosen_score_linear":301.0,"chosen_score_lmetric":14028,"t_first_token":389918.850976372,"t_first_token_unix":1779820783.8649201,"t_done":389919.274313283,"t_done_unix":1779820784.2882562},{"request_id":"1266067:1:1266067:91","session_id":"1266067","input_length":579,"t_proxy_recv":389920.856218949,"t_decision_unix":1779820785.87016,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":579,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":579,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":579,"score_linear":135235.0,"score_lmetric":227596},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":579,"score_linear":55989.0,"score_lmetric":579},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":579,"score_linear":13178.0,"score_lmetric":13757},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":579,"score_linear":92560.0,"score_lmetric":196704},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31709,"ongoing_decode_tokens":27639,"pending_prefill_tokens":4070,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":579,"score_linear":31709.0,"score_lmetric":4649},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":579,"score_linear":125063.0,"score_lmetric":235924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":579,"score_linear":50783.0,"score_lmetric":51362},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":579,"score_linear":45884.0,"score_lmetric":1158}],"chosen_score_linear":55989.0,"chosen_score_lmetric":579,"t_first_token":389921.02139611,"t_first_token_unix":1779820786.0353396,"t_done":389921.221660725,"t_done_unix":1779820786.235604},{"request_id":"1263611:2:1265770:88","session_id":"1263611","input_length":13178,"t_proxy_recv":389919.953985185,"t_decision_unix":1779820784.967926,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":2,"affinity_cache_hit":5632,"affinity_cache_ratio":0.4273789649415693,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":5632,"new_prefill":7546,"score_linear":129603.0,"score_lmetric":241530},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":13178,"score_linear":55989.0,"score_lmetric":13178},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":13178,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":13178,"score_linear":71575.0,"score_lmetric":138940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":13178,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":13178,"score_linear":125063.0,"score_lmetric":261122},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":13178,"score_linear":50783.0,"score_lmetric":63961},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":13178,"score_linear":45884.0,"score_lmetric":74092}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389921.061729613,"t_first_token_unix":1779820786.0756729,"t_done":389921.306750603,"t_done_unix":1779820786.320694},{"request_id":"1265942:1:1265942:89","session_id":"1265942","input_length":4070,"t_proxy_recv":389920.593687648,"t_decision_unix":1779820785.607629,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4070,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":4070,"score_linear":135235.0,"score_lmetric":234578},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":4070,"score_linear":55989.0,"score_lmetric":4070},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":4070,"score_linear":13178.0,"score_lmetric":17248},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":4070,"score_linear":71575.0,"score_lmetric":120724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":4070,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":4070,"score_linear":125063.0,"score_lmetric":242906},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":4070,"score_linear":50783.0,"score_lmetric":54853},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":4070,"score_linear":45884.0,"score_lmetric":8140}],"chosen_score_linear":27639.0,"chosen_score_lmetric":0,"t_first_token":389920.85745814,"t_first_token_unix":1779820785.8714015,"t_done":389921.554101962,"t_done_unix":1779820786.5680454},{"request_id":"1250772:3:1265019:84","session_id":"1250772","input_length":23540,"t_proxy_recv":389917.379248286,"t_decision_unix":1779820782.3931897,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.45675446049277824,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":23540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":23540,"score_linear":110048.0,"score_lmetric":133588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":23540,"score_linear":55989.0,"score_lmetric":23540},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":301,"ongoing_decode_tokens":301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":23540,"score_linear":301.0,"score_lmetric":23540},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":23540,"score_linear":71575.0,"score_lmetric":159664},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":23540,"score_linear":113053.0,"score_lmetric":116113},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":10752,"new_prefill":12788,"score_linear":114311.0,"score_lmetric":260342},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":23540,"score_linear":50783.0,"score_lmetric":74323},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":23540,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389920.04808734,"t_first_token_unix":1779820785.0620308,"t_done":389921.653901412,"t_done_unix":1779820786.6678443},{"request_id":"1262354:3:1265178:86","session_id":"1262354","input_length":22344,"t_proxy_recv":389917.742582546,"t_decision_unix":1779820782.7565238,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9853204439670605,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":22344,"score_linear":110048.0,"score_lmetric":132392},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":22344,"score_linear":55989.0,"score_lmetric":22344},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14329,"ongoing_decode_tokens":301,"pending_prefill_tokens":14028,"num_requests":2,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":22344,"score_linear":14329.0,"score_lmetric":72744},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":22344,"score_linear":71575.0,"score_lmetric":157272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":22344,"score_linear":113053.0,"score_lmetric":114917},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":22344,"score_linear":125063.0,"score_lmetric":279454},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":22344,"score_linear":50783.0,"score_lmetric":73127},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":23540,"ongoing_decode_tokens":0,"pending_prefill_tokens":23540,"num_requests":1,"active_p_offloads":0,"cached_blocks":141,"cache_hit":22016,"new_prefill":328,"score_linear":1524.0,"score_lmetric":23868}],"chosen_score_linear":1524.0,"chosen_score_lmetric":23868,"t_first_token":389920.050698043,"t_first_token_unix":1779820785.0646412,"t_done":389922.439162545,"t_done_unix":1779820787.453107},{"request_id":"1266440:1:1266440:92","session_id":"1266440","input_length":5381,"t_proxy_recv":389921.929490299,"t_decision_unix":1779820786.9434316,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":5381,"score_linear":135235.0,"score_lmetric":237200},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":262,"cache_hit":0,"new_prefill":5381,"score_linear":55989.0,"score_lmetric":5381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":5381,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":5381,"score_linear":92560.0,"score_lmetric":211110},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":5381,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":5381,"score_linear":125063.0,"score_lmetric":245528},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":5381,"score_linear":50783.0,"score_lmetric":56164},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22344,"ongoing_decode_tokens":22344,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":187,"cache_hit":0,"new_prefill":5381,"score_linear":22344.0,"score_lmetric":5381}],"chosen_score_linear":27639.0,"chosen_score_lmetric":0,"t_first_token":389922.28619325,"t_first_token_unix":1779820787.3001397,"t_done":389922.729166161,"t_done_unix":1779820787.7431095},{"request_id":"1263727:1:1263727:77","session_id":"1263727","input_length":50783,"t_proxy_recv":389912.847595725,"t_decision_unix":1779820777.861537,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":50783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":5990,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":50783,"score_linear":5990.0,"score_lmetric":50783},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":50783,"score_linear":55989.0,"score_lmetric":50783},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68377,"ongoing_decode_tokens":68377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":50783,"score_linear":68377.0,"score_lmetric":50783},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":50783,"score_linear":15283.0,"score_lmetric":50783},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":50783,"score_linear":113053.0,"score_lmetric":143356},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":50783,"score_linear":125063.0,"score_lmetric":336332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":50783,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":50783,"score_linear":22109.0,"score_lmetric":50783}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389922.566696682,"t_first_token_unix":1779820787.5806406,"t_done":389922.749262214,"t_done_unix":1779820787.763206},{"request_id":"1253804:4:1262690:70","session_id":"1253804","input_length":55989,"t_proxy_recv":389908.995895241,"t_decision_unix":1779820774.009836,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":54784,"affinity_cache_ratio":0.978477915304792,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":1205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":55989,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":261,"cache_hit":54784,"new_prefill":1205,"score_linear":-54784.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":55989,"score_linear":68131.0,"score_lmetric":124120},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":3584,"new_prefill":52405,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":55989,"score_linear":113053.0,"score_lmetric":297124},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":55989,"score_linear":125063.0,"score_lmetric":346744},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":55989,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":55989,"score_linear":21510.0,"score_lmetric":77499}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":389909.410295225,"t_first_token_unix":1779820774.4242387,"t_done":389922.868817457,"t_done_unix":1779820787.882761},{"request_id":"1263971:2:1266797:94","session_id":"1263971","input_length":9504,"t_proxy_recv":389923.278040964,"t_decision_unix":1779820788.2919824,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.6464646464646465,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":3360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":9504,"score_linear":135235.0,"score_lmetric":245446},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":9504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":9504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":9504,"score_linear":92560.0,"score_lmetric":223479},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":276,"cache_hit":0,"new_prefill":9504,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":9504,"score_linear":125063.0,"score_lmetric":253774},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":0,"pending_prefill_tokens":17466,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":9504,"score_linear":17466.0,"score_lmetric":26970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":188,"cache_hit":6144,"new_prefill":3360,"score_linear":-6144.0,"score_lmetric":0}],"chosen_score_linear":-6144.0,"chosen_score_lmetric":0,"t_first_token":389923.631668486,"t_first_token_unix":1779820788.6456127,"t_done":389923.784010854,"t_done_unix":1779820788.7979543},{"request_id":"1260792:2:1265951:90","session_id":"1260792","input_length":20985,"t_proxy_recv":389920.610176128,"t_decision_unix":1779820785.6241176,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":12288,"affinity_cache_ratio":0.5855611150822015,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":8697,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":20985,"score_linear":135235.0,"score_lmetric":268408},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":20985,"score_linear":55989.0,"score_lmetric":20985},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13178,"ongoing_decode_tokens":0,"pending_prefill_tokens":13178,"num_requests":1,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":20985,"score_linear":13178.0,"score_lmetric":34163},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":12288,"new_prefill":8697,"score_linear":59287.0,"score_lmetric":129978},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31709,"ongoing_decode_tokens":27639,"pending_prefill_tokens":4070,"num_requests":1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":20985,"score_linear":31709.0,"score_lmetric":25055},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":20985,"score_linear":125063.0,"score_lmetric":276736},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":20985,"score_linear":50783.0,"score_lmetric":71768},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":45884,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":20985,"score_linear":45884.0,"score_lmetric":41970}],"chosen_score_linear":59287.0,"chosen_score_lmetric":129978,"t_first_token":389925.517525608,"t_first_token_unix":1779820790.5314693,"t_done":389926.029430975,"t_done_unix":1779820791.0433748},{"request_id":"1263749:1:1263749:79","session_id":"1263749","input_length":56292,"t_proxy_recv":389912.916412658,"t_decision_unix":1779820777.9303544,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":56292,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":56292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":5990,"ongoing_decode_tokens":5990,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":145,"cache_hit":0,"new_prefill":56292,"score_linear":5990.0,"score_lmetric":56292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":56292,"score_linear":55989.0,"score_lmetric":56292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68377,"ongoing_decode_tokens":68377,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":56292,"score_linear":68377.0,"score_lmetric":56292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":56292,"score_linear":15283.0,"score_lmetric":56292},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":56292,"score_linear":113053.0,"score_lmetric":148865},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":56292,"score_linear":125063.0,"score_lmetric":347350},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":56292,"score_linear":50783.0,"score_lmetric":107075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22109,"ongoing_decode_tokens":22109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":128,"cache_hit":0,"new_prefill":56292,"score_linear":22109.0,"score_lmetric":56292}],"chosen_score_linear":15283.0,"chosen_score_lmetric":56292,"t_first_token":389924.349705874,"t_first_token_unix":1779820789.3636498,"t_done":389926.964924888,"t_done_unix":1779820791.9788682},{"request_id":"1266668:1:1266668:93","session_id":"1266668","input_length":17466,"t_proxy_recv":389922.830028526,"t_decision_unix":1779820787.8439698,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17466,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":13370,"score_linear":131139.0,"score_lmetric":253178},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":262,"cache_hit":0,"new_prefill":17466,"score_linear":55989.0,"score_lmetric":17466},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":92560,"ongoing_decode_tokens":15283,"pending_prefill_tokens":64989,"num_requests":3,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":17466,"score_linear":92560.0,"score_lmetric":247365},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":276,"cache_hit":0,"new_prefill":17466,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":17466,"score_linear":125063.0,"score_lmetric":269698},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":188,"cache_hit":0,"new_prefill":17466,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389924.535629626,"t_first_token_unix":1779820789.5495732,"t_done":389928.388285886,"t_done_unix":1779820793.402229},{"request_id":"1265942:2:1268069:97","session_id":"1265942","input_length":10457,"t_proxy_recv":389927.586884588,"t_decision_unix":1779820792.6008255,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4096,"affinity_cache_ratio":0.39169934015492014,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":6361,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":10457,"score_linear":135235.0,"score_lmetric":247352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":10457,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":10457,"score_linear":126924.0,"score_lmetric":118437},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10457,"score_linear":15283.0,"score_lmetric":10457},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":276,"cache_hit":4096,"new_prefill":6361,"score_linear":23543.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":10457,"score_linear":125063.0,"score_lmetric":255680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":10457,"score_linear":17466.0,"score_lmetric":10457},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28671,"ongoing_decode_tokens":0,"pending_prefill_tokens":6143,"num_requests":1,"active_p_offloads":0,"cached_blocks":194,"cache_hit":0,"new_prefill":10457,"score_linear":28671.0,"score_lmetric":16600}],"chosen_score_linear":23543.0,"chosen_score_lmetric":0,"t_first_token":389928.164291854,"t_first_token_unix":1779820793.178236,"t_done":389928.689927276,"t_done_unix":1779820793.703871},{"request_id":"1262354:4:1267821:95","session_id":"1262354","input_length":28671,"t_proxy_recv":389926.88772259,"t_decision_unix":1779820791.9016638,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22528,"affinity_cache_ratio":0.7857416902096195,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":6143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28671,"score_linear":135235.0,"score_lmetric":283780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":28671,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":28671,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":71575,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":248,"cache_hit":0,"new_prefill":28671,"score_linear":71575.0,"score_lmetric":57342},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":276,"cache_hit":0,"new_prefill":28671,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28671,"score_linear":125063.0,"score_lmetric":292108},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":28671,"score_linear":17466.0,"score_lmetric":28671},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":194,"cache_hit":22528,"new_prefill":6143,"score_linear":-22528.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":389928.072728552,"t_first_token_unix":1779820793.0866723,"t_done":389929.361042968,"t_done_unix":1779820794.3749874},{"request_id":"1268634:1:1268634:99","session_id":"1268634","input_length":2298,"t_proxy_recv":389929.826728839,"t_decision_unix":1779820794.8406699,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2298,"score_linear":135235.0,"score_lmetric":231034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":2298,"score_linear":126924.0,"score_lmetric":110278},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2298,"score_linear":15283.0,"score_lmetric":2298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":2298,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":2298,"score_linear":125063.0,"score_lmetric":239362},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":2298,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389930.039958348,"t_first_token_unix":1779820795.0539017,"t_done":389930.153019293,"t_done_unix":1779820795.1669621},{"request_id":"1268649:1:1268649:100","session_id":"1268649","input_length":18638,"t_proxy_recv":389929.829508241,"t_decision_unix":1779820794.8434496,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18638,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":18638,"score_linear":135235.0,"score_lmetric":263714},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":18638,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":18638,"score_linear":126924.0,"score_lmetric":126618},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18638,"score_linear":15283.0,"score_lmetric":18638},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":18638,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":18638,"score_linear":125063.0,"score_lmetric":272042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":18638,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2298,"ongoing_decode_tokens":0,"pending_prefill_tokens":2298,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":18638,"score_linear":2298.0,"score_lmetric":20936}],"chosen_score_linear":27639.0,"chosen_score_lmetric":0,"t_first_token":389931.72183714,"t_first_token_unix":1779820796.7357807,"t_done":389931.92302723,"t_done_unix":1779820796.936971},{"request_id":"1263971:3:1269088:104","session_id":"1263971","input_length":13955,"t_proxy_recv":389931.218934928,"t_decision_unix":1779820796.232876,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9216,"affinity_cache_ratio":0.660408455750627,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":4739,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":13955,"score_linear":135235.0,"score_lmetric":254348},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":13955,"score_linear":102074.0,"score_lmetric":112445},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":13955,"score_linear":126924.0,"score_lmetric":121935},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":13955,"score_linear":15283.0,"score_lmetric":13955},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":46277,"ongoing_decode_tokens":27639,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":13955,"score_linear":46277.0,"score_lmetric":32593},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":13955,"score_linear":125063.0,"score_lmetric":262676},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12320,"ongoing_decode_tokens":0,"pending_prefill_tokens":12320,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":13955,"score_linear":12320.0,"score_lmetric":26275},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":36224,"ongoing_decode_tokens":0,"pending_prefill_tokens":12672,"num_requests":2,"active_p_offloads":0,"cached_blocks":210,"cache_hit":9216,"new_prefill":4739,"score_linear":27008.0,"score_lmetric":34822}],"chosen_score_linear":27008.0,"chosen_score_lmetric":34822,"t_first_token":389931.918472693,"t_first_token_unix":1779820796.9324164,"t_done":389932.188383605,"t_done_unix":1779820797.2023265},{"request_id":"1250772:4:1268869:103","session_id":"1250772","input_length":24029,"t_proxy_recv":389930.479346152,"t_decision_unix":1779820795.4932876,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9801489866411419,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":24029,"score_linear":135235.0,"score_lmetric":274496},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":24029,"score_linear":102074.0,"score_lmetric":122519},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":24029,"score_linear":126924.0,"score_lmetric":132009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24029,"score_linear":15283.0,"score_lmetric":24029},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":46277,"ongoing_decode_tokens":27639,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":24029,"score_linear":46277.0,"score_lmetric":42667},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":10752,"new_prefill":13277,"score_linear":114311.0,"score_lmetric":261320},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12320,"ongoing_decode_tokens":0,"pending_prefill_tokens":12320,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":24029,"score_linear":12320.0,"score_lmetric":36349},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":210,"cache_hit":23552,"new_prefill":477,"score_linear":-11357.0,"score_lmetric":12672}],"chosen_score_linear":-11357.0,"chosen_score_lmetric":12672,"t_first_token":389931.455763266,"t_first_token_unix":1779820796.469707,"t_done":389932.901519,"t_done_unix":1779820797.9154623},{"request_id":"1268831:1:1268831:101","session_id":"1268831","input_length":12195,"t_proxy_recv":389930.321407058,"t_decision_unix":1779820795.3353488,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":12195,"score_linear":135235.0,"score_lmetric":250828},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":12195,"score_linear":102074.0,"score_lmetric":110685},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":12195,"score_linear":126924.0,"score_lmetric":120175},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12195,"score_linear":15283.0,"score_lmetric":12195},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":46277,"ongoing_decode_tokens":27639,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":12195,"score_linear":46277.0,"score_lmetric":30833},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12195,"score_linear":125063.0,"score_lmetric":259156},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":12195,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":210,"cache_hit":0,"new_prefill":12195,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389931.320271953,"t_first_token_unix":1779820796.3342154,"t_done":389933.566268392,"t_done_unix":1779820798.5802114},{"request_id":"1269901:1:1269901:107","session_id":"1269901","input_length":1323,"t_proxy_recv":389933.858313046,"t_decision_unix":1779820798.8722541,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1323,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":1323,"score_linear":135235.0,"score_lmetric":229084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":1323,"score_linear":102074.0,"score_lmetric":99813},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":1323,"score_linear":126924.0,"score_lmetric":109303},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":1323,"score_linear":15283.0,"score_lmetric":1323},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":56545,"ongoing_decode_tokens":27639,"pending_prefill_tokens":28906,"num_requests":1,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":1323,"score_linear":56545.0,"score_lmetric":30229},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":1323,"score_linear":125063.0,"score_lmetric":237412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":26424,"ongoing_decode_tokens":26424,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":1323,"score_linear":26424.0,"score_lmetric":2646},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":244,"cache_hit":0,"new_prefill":1323,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389934.001678049,"t_first_token_unix":1779820799.0156212,"t_done":389934.594283706,"t_done_unix":1779820799.6082265},{"request_id":"1260327:2:1270005:108","session_id":"1260327","input_length":30828,"t_proxy_recv":389934.283939549,"t_decision_unix":1779820799.297881,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9964966913195796,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":30828,"score_linear":135235.0,"score_lmetric":288094},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":30828,"score_linear":102074.0,"score_lmetric":129318},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":30828,"score_linear":126924.0,"score_lmetric":138808},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":30828,"score_linear":15283.0,"score_lmetric":30828},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":56545,"ongoing_decode_tokens":27639,"pending_prefill_tokens":28906,"num_requests":1,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":30828,"score_linear":56545.0,"score_lmetric":59734},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":30828,"score_linear":125063.0,"score_lmetric":296422},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":26424,"ongoing_decode_tokens":26424,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":30828,"score_linear":26424.0,"score_lmetric":61656},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":1323,"ongoing_decode_tokens":1323,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":244,"cache_hit":30720,"new_prefill":108,"score_linear":-29397.0,"score_lmetric":108}],"chosen_score_linear":-29397.0,"chosen_score_lmetric":108,"t_first_token":389934.369401986,"t_first_token_unix":1779820799.3833458,"t_done":389934.746715994,"t_done_unix":1779820799.7606595},{"request_id":"1266440:2:1270501:112","session_id":"1266440","input_length":11128,"t_proxy_recv":389936.051846564,"t_decision_unix":1779820801.0657878,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":5120,"affinity_cache_ratio":0.46010064701653486,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":6008,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":6008,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":11128,"score_linear":135235.0,"score_lmetric":248694},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":11128,"score_linear":102074.0,"score_lmetric":109618},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":11128,"score_linear":126924.0,"score_lmetric":119108},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11128,"score_linear":15283.0,"score_lmetric":11128},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":56545,"ongoing_decode_tokens":56545,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":324,"cache_hit":5120,"new_prefill":6008,"score_linear":51425.0,"score_lmetric":6008},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":11128,"score_linear":125063.0,"score_lmetric":257022},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":84227,"ongoing_decode_tokens":26424,"pending_prefill_tokens":7115,"num_requests":3,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":11128,"score_linear":84227.0,"score_lmetric":54729},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":11128,"score_linear":27927.0,"score_lmetric":39055}],"chosen_score_linear":51425.0,"chosen_score_lmetric":6008,"t_first_token":389936.615305748,"t_first_token_unix":1779820801.6292493,"t_done":389936.922647947,"t_done_unix":1779820801.936595},{"request_id":"1262354:5:1269336:105","session_id":"1262354","input_length":28906,"t_proxy_recv":389932.177332721,"t_decision_unix":1779820797.1912737,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":4,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9919047948522798,"affinity_num_requests":3,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":28906,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28906,"score_linear":135235.0,"score_lmetric":284250},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":28906,"score_linear":102074.0,"score_lmetric":127396},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":28906,"score_linear":126924.0,"score_lmetric":136886},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28906,"score_linear":15283.0,"score_lmetric":28906},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":28906,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28906,"score_linear":125063.0,"score_lmetric":292578},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12320,"ongoing_decode_tokens":12320,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":28906,"score_linear":12320.0,"score_lmetric":28906},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":50179,"ongoing_decode_tokens":50179,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":210,"cache_hit":28672,"new_prefill":234,"score_linear":21507.0,"score_lmetric":702}],"chosen_score_linear":27639.0,"chosen_score_lmetric":0,"t_first_token":389935.880413841,"t_first_token_unix":1779820800.8943577,"t_done":389937.319105082,"t_done_unix":1779820802.3330488},{"request_id":"1256273:4:1259632:60","session_id":"1256273","input_length":12270,"t_proxy_recv":389898.326743446,"t_decision_unix":1779820763.340685,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":7680,"affinity_cache_ratio":0.6259168704156479,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":4590,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":12270,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":12270,"score_linear":80365.0,"score_lmetric":59840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":12270,"score_linear":68131.0,"score_lmetric":80401},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9250,"ongoing_decode_tokens":9250,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":12270,"score_linear":9250.0,"score_lmetric":12270},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":12270,"score_linear":90488.0,"score_lmetric":102758},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":112793,"ongoing_decode_tokens":0,"pending_prefill_tokens":112793,"num_requests":1,"active_p_offloads":0,"cached_blocks":36,"cache_hit":7680,"new_prefill":4590,"score_linear":105113.0,"score_lmetric":117383},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14291,"ongoing_decode_tokens":14291,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":12270,"score_linear":14291.0,"score_lmetric":12270},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":12270,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":105113.0,"chosen_score_lmetric":117383,"t_first_token":389937.130784658,"t_first_token_unix":1779820802.1447284,"t_done":389938.16740348,"t_done_unix":1779820803.1813467},{"request_id":"1258859:1:1258859:57","session_id":"1258859","input_length":112793,"t_proxy_recv":389895.749120553,"t_decision_unix":1779820760.7630587,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":112793,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":114,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":80365,"ongoing_decode_tokens":27387,"pending_prefill_tokens":17650,"num_requests":2,"active_p_offloads":0,"cached_blocks":165,"cache_hit":0,"new_prefill":112793,"score_linear":80365.0,"score_lmetric":260886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":112793,"score_linear":68131.0,"score_lmetric":180924},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":189,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":90488,"ongoing_decode_tokens":0,"pending_prefill_tokens":90488,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":112793,"score_linear":90488.0,"score_lmetric":203281},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":169,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":26,"cache_hit":0,"new_prefill":112793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389936.906085881,"t_first_token_unix":1779820801.9200296,"t_done":389938.281045998,"t_done_unix":1779820803.2949893},{"request_id":"1268861:1:1268861:102","session_id":"1268861","input_length":12320,"t_proxy_recv":389930.440702066,"t_decision_unix":1779820795.4546435,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":12320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":12320,"score_linear":135235.0,"score_lmetric":251078},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":12320,"score_linear":102074.0,"score_lmetric":110810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":12320,"score_linear":126924.0,"score_lmetric":120300},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":12320,"score_linear":15283.0,"score_lmetric":12320},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":46277,"ongoing_decode_tokens":27639,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":12320,"score_linear":46277.0,"score_lmetric":30958},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":12320,"score_linear":125063.0,"score_lmetric":259406},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":12320,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12195,"ongoing_decode_tokens":0,"pending_prefill_tokens":12195,"num_requests":1,"active_p_offloads":0,"cached_blocks":210,"cache_hit":0,"new_prefill":12320,"score_linear":12195.0,"score_lmetric":24515}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389931.460160707,"t_first_token_unix":1779820796.4741042,"t_done":389938.979039888,"t_done_unix":1779820803.992983},{"request_id":"1269373:1:1269373:106","session_id":"1269373","input_length":14104,"t_proxy_recv":389932.300234105,"t_decision_unix":1779820797.3141751,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":6424,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6424,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":10008,"score_linear":131139.0,"score_lmetric":246454},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":14104,"score_linear":102074.0,"score_lmetric":112594},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":14104,"score_linear":126924.0,"score_lmetric":122084},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14104,"score_linear":15283.0,"score_lmetric":14104},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":56545,"ongoing_decode_tokens":27639,"pending_prefill_tokens":28906,"num_requests":1,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":14104,"score_linear":56545.0,"score_lmetric":43010},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":14104,"score_linear":125063.0,"score_lmetric":262974},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":12320,"ongoing_decode_tokens":12320,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":341,"cache_hit":7680,"new_prefill":6424,"score_linear":4640.0,"score_lmetric":6424},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":36224,"ongoing_decode_tokens":36224,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":219,"cache_hit":0,"new_prefill":14104,"score_linear":36224.0,"score_lmetric":28208}],"chosen_score_linear":4640.0,"chosen_score_lmetric":6424,"t_first_token":389933.019008514,"t_first_token_unix":1779820798.032952,"t_done":389939.062423414,"t_done_unix":1779820804.0763667},{"request_id":"1263727:2:1270052:109","session_id":"1263727","input_length":57803,"t_proxy_recv":389934.479010202,"t_decision_unix":1779820799.4929516,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":50688,"affinity_cache_ratio":0.876909502966974,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":7115,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":57803,"score_linear":135235.0,"score_lmetric":342044},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":57803,"score_linear":102074.0,"score_lmetric":156293},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":57803,"score_linear":126924.0,"score_lmetric":165783},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":57803,"score_linear":15283.0,"score_lmetric":57803},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":56545,"ongoing_decode_tokens":27639,"pending_prefill_tokens":28906,"num_requests":1,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":57803,"score_linear":56545.0,"score_lmetric":86709},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":57803,"score_linear":125063.0,"score_lmetric":350372},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":26424,"ongoing_decode_tokens":26424,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":341,"cache_hit":50688,"new_prefill":7115,"score_linear":-24264.0,"score_lmetric":14230},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":32151,"ongoing_decode_tokens":32151,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":244,"cache_hit":0,"new_prefill":57803,"score_linear":32151.0,"score_lmetric":115606}],"chosen_score_linear":-24264.0,"chosen_score_lmetric":14230,"t_first_token":389937.025886353,"t_first_token_unix":1779820802.03983,"t_done":389939.156722488,"t_done_unix":1779820804.1706662},{"request_id":"1270340:1:1270340:111","session_id":"1270340","input_length":27927,"t_proxy_recv":389935.484552501,"t_decision_unix":1779820800.4984937,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":27927,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":27927,"score_linear":135235.0,"score_lmetric":282292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":27927,"score_linear":102074.0,"score_lmetric":126417},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":27927,"score_linear":126924.0,"score_lmetric":135907},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":27927,"score_linear":15283.0,"score_lmetric":27927},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":56545,"ongoing_decode_tokens":27639,"pending_prefill_tokens":28906,"num_requests":1,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":27927,"score_linear":56545.0,"score_lmetric":56833},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":27927,"score_linear":125063.0,"score_lmetric":290620},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":84227,"ongoing_decode_tokens":26424,"pending_prefill_tokens":7115,"num_requests":3,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":27927,"score_linear":84227.0,"score_lmetric":105126},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":27927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389939.073257739,"t_first_token_unix":1779820804.087201,"t_done":389940.311349408,"t_done_unix":1779820805.3252928},{"request_id":"1271459:1:1271459:118","session_id":"1271459","input_length":751,"t_proxy_recv":389939.444901193,"t_decision_unix":1779820804.4588423,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":751,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":751,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":751,"score_linear":135235.0,"score_lmetric":227940},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":751,"score_linear":102074.0,"score_lmetric":99241},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":751,"score_linear":126924.0,"score_lmetric":108731},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":751,"score_linear":108713.0,"score_lmetric":188362},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":60413,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":751,"score_linear":78119.0,"score_lmetric":36914},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":751,"score_linear":113172.0,"score_lmetric":751},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":28385,"ongoing_decode_tokens":28385,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":751,"score_linear":28385.0,"score_lmetric":751},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47375,"ongoing_decode_tokens":27927,"pending_prefill_tokens":7160,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":751,"score_linear":47375.0,"score_lmetric":15822}],"chosen_score_linear":28385.0,"chosen_score_lmetric":751,"t_first_token":389939.56320292,"t_first_token_unix":1779820804.577146,"t_done":389940.734051341,"t_done_unix":1779820805.747995},{"request_id":"1271847:1:1271847:123","session_id":"1271847","input_length":2524,"t_proxy_recv":389940.740386898,"t_decision_unix":1779820805.7543283,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":5048,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2524,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2524,"score_linear":135235.0,"score_lmetric":231486},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":2524,"score_linear":102074.0,"score_lmetric":101014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":2524,"score_linear":150574.0,"score_lmetric":240660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2524,"score_linear":108713.0,"score_lmetric":191908},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":60413,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":2524,"score_linear":78119.0,"score_lmetric":40460},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":113172,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":2524,"score_linear":134891.0,"score_lmetric":48486},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42789,"ongoing_decode_tokens":42789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":392,"cache_hit":0,"new_prefill":2524,"score_linear":42789.0,"score_lmetric":5048},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47771,"ongoing_decode_tokens":47771,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":2524,"score_linear":47771.0,"score_lmetric":5048}],"chosen_score_linear":42789.0,"chosen_score_lmetric":5048,"t_first_token":389940.962859716,"t_first_token_unix":1779820805.976803,"t_done":389941.187734816,"t_done_unix":1779820806.201678},{"request_id":"1268831:2:1271087:116","session_id":"1268831","input_length":19448,"t_proxy_recv":389938.314013531,"t_decision_unix":1779820803.3279552,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":12288,"affinity_cache_ratio":0.6318387494858083,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":7160,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":19448,"score_linear":135235.0,"score_lmetric":265334},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":19448,"score_linear":102074.0,"score_lmetric":117938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":19448,"score_linear":126924.0,"score_lmetric":127428},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":19448,"score_linear":108713.0,"score_lmetric":225756},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":19448,"score_linear":60413.0,"score_lmetric":19448},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":0,"pending_prefill_tokens":532,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":19448,"score_linear":113172.0,"score_lmetric":19980},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":112612,"ongoing_decode_tokens":84227,"pending_prefill_tokens":10465,"num_requests":4,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":19448,"score_linear":112612.0,"score_lmetric":119652},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":12288,"new_prefill":7160,"score_linear":15639.0,"score_lmetric":35087}],"chosen_score_linear":15639.0,"chosen_score_lmetric":35087,"t_first_token":389939.953155219,"t_first_token_unix":1779820804.9670985,"t_done":389941.662065887,"t_done_unix":1779820806.6760092},{"request_id":"1271991:1:1271991:124","session_id":"1271991","input_length":2851,"t_proxy_recv":389941.271521104,"t_decision_unix":1779820806.2854624,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":5702,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":2851,"score_linear":135235.0,"score_lmetric":232140},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":2851,"score_linear":102074.0,"score_lmetric":101341},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":2851,"score_linear":150574.0,"score_lmetric":241314},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":2851,"score_linear":108713.0,"score_lmetric":192562},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":78119,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":2851,"score_linear":78119.0,"score_lmetric":5702},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":113172,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":2851,"score_linear":134891.0,"score_lmetric":49140},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42789,"ongoing_decode_tokens":42789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":396,"cache_hit":0,"new_prefill":2851,"score_linear":42789.0,"score_lmetric":5702},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47771,"ongoing_decode_tokens":47771,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":2851,"score_linear":47771.0,"score_lmetric":5702}],"chosen_score_linear":78119.0,"chosen_score_lmetric":5702,"t_first_token":389941.497237889,"t_first_token_unix":1779820806.5111814,"t_done":389941.82885371,"t_done_unix":1779820806.8427968},{"request_id":"1271328:1:1271328:117","session_id":"1271328","input_length":17706,"t_proxy_recv":389939.035475665,"t_decision_unix":1779820804.0494165,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":17706,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":17706,"score_linear":135235.0,"score_lmetric":261850},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":17706,"score_linear":102074.0,"score_lmetric":116196},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":17706,"score_linear":126924.0,"score_lmetric":125686},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17706,"score_linear":108713.0,"score_lmetric":222272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":17706,"score_linear":60413.0,"score_lmetric":17706},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":17706,"score_linear":113172.0,"score_lmetric":17706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":100292,"ongoing_decode_tokens":100292,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":365,"cache_hit":0,"new_prefill":17706,"score_linear":100292.0,"score_lmetric":53118},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47375,"ongoing_decode_tokens":0,"pending_prefill_tokens":35087,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":17706,"score_linear":47375.0,"score_lmetric":105586}],"chosen_score_linear":60413.0,"chosen_score_lmetric":17706,"t_first_token":389940.841080513,"t_first_token_unix":1779820805.8550236,"t_done":389941.918381445,"t_done_unix":1779820806.9323246},{"request_id":"1270340:2:1271641:121","session_id":"1270340","input_length":28323,"t_proxy_recv":389940.317457756,"t_decision_unix":1779820805.3313992,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9761677788369876,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":28323,"score_linear":135235.0,"score_lmetric":283084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":28323,"score_linear":102074.0,"score_lmetric":126813},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":28323,"score_linear":150574.0,"score_lmetric":292258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28323,"score_linear":108713.0,"score_lmetric":243506},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":60413,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":28323,"score_linear":78119.0,"score_lmetric":92058},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":113172,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":28323,"score_linear":134891.0,"score_lmetric":100084},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":43540,"ongoing_decode_tokens":43540,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":28323,"score_linear":43540.0,"score_lmetric":84969},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19448,"ongoing_decode_tokens":19448,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":300,"cache_hit":27648,"new_prefill":675,"score_linear":-8200.0,"score_lmetric":675}],"chosen_score_linear":-8200.0,"chosen_score_lmetric":675,"t_first_token":389940.487738075,"t_first_token_unix":1779820805.501681,"t_done":389942.240239322,"t_done_unix":1779820807.2541842},{"request_id":"1272085:1:1272085:125","session_id":"1272085","input_length":5302,"t_proxy_recv":389941.608539509,"t_decision_unix":1779820806.6224809,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":10604,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":5302,"score_linear":135235.0,"score_lmetric":237042},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":5302,"score_linear":102074.0,"score_lmetric":103792},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":5302,"score_linear":150574.0,"score_lmetric":246216},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":5302,"score_linear":108713.0,"score_lmetric":197464},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":80970,"ongoing_decode_tokens":80970,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":5302,"score_linear":80970.0,"score_lmetric":15906},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":113172,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":5302,"score_linear":134891.0,"score_lmetric":54042},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":42789,"ongoing_decode_tokens":42789,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":396,"cache_hit":0,"new_prefill":5302,"score_linear":42789.0,"score_lmetric":10604},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47771,"ongoing_decode_tokens":47771,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":300,"cache_hit":0,"new_prefill":5302,"score_linear":47771.0,"score_lmetric":10604}],"chosen_score_linear":42789.0,"chosen_score_lmetric":10604,"t_first_token":389941.952237387,"t_first_token_unix":1779820806.9661803,"t_done":389942.573844734,"t_done_unix":1779820807.587788},{"request_id":"1266668:2:1270661:115","session_id":"1266668","input_length":28385,"t_proxy_recv":389936.670191395,"t_decision_unix":1779820801.6841328,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":17920,"affinity_cache_ratio":0.6313193588162762,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":10465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":24289,"score_linear":131139.0,"score_lmetric":275016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":28385,"score_linear":102074.0,"score_lmetric":126875},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":28385,"score_linear":126924.0,"score_lmetric":136365},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":28385,"score_linear":108713.0,"score_lmetric":243630},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":67673,"ongoing_decode_tokens":67673,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":28385,"score_linear":67673.0,"score_lmetric":56770},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":28385,"score_linear":125063.0,"score_lmetric":291536},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":84227,"ongoing_decode_tokens":26424,"pending_prefill_tokens":7115,"num_requests":3,"active_p_offloads":0,"cached_blocks":341,"cache_hit":17920,"new_prefill":10465,"score_linear":66307.0,"score_lmetric":52740},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":28385,"score_linear":27927.0,"score_lmetric":56312}],"chosen_score_linear":66307.0,"chosen_score_lmetric":52740,"t_first_token":389938.846373972,"t_first_token_unix":1779820803.860318,"t_done":389942.597344897,"t_done_unix":1779820807.611288},{"request_id":"1269373:2:1271580:120","session_id":"1269373","input_length":14404,"t_proxy_recv":389939.856728509,"t_decision_unix":1779820804.8706698,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.995279089141905,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":68,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":10308,"score_linear":131139.0,"score_lmetric":247054},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":14404,"score_linear":102074.0,"score_lmetric":112894},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":14404,"score_linear":126924.0,"score_lmetric":122384},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":14404,"score_linear":108713.0,"score_lmetric":215668},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":60413,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":14404,"score_linear":78119.0,"score_lmetric":64220},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":113172,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":14404,"score_linear":134891.0,"score_lmetric":72246},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29136,"ongoing_decode_tokens":29136,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":14336,"new_prefill":68,"score_linear":14800.0,"score_lmetric":136},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47375,"ongoing_decode_tokens":27927,"pending_prefill_tokens":7160,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":14404,"score_linear":47375.0,"score_lmetric":43128}],"chosen_score_linear":14800.0,"chosen_score_lmetric":136,"t_first_token":389939.920208128,"t_first_token_unix":1779820804.9341512,"t_done":389943.919435945,"t_done_unix":1779820808.9333797},{"request_id":"1265942:3:1272453:127","session_id":"1265942","input_length":18093,"t_proxy_recv":389943.071567327,"t_decision_unix":1779820808.0855086,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":10240,"affinity_cache_ratio":0.5659647377438789,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":7853,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":18093,"score_linear":135235.0,"score_lmetric":262624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":18093,"score_linear":102074.0,"score_lmetric":116583},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":18093,"score_linear":150574.0,"score_lmetric":271798},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":18093,"score_linear":108713.0,"score_lmetric":223046},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":430,"cache_hit":10240,"new_prefill":7853,"score_linear":50173.0,"score_lmetric":7853},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":134891,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":18093,"score_linear":134891.0,"score_lmetric":36186},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14404,"ongoing_decode_tokens":14404,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":427,"cache_hit":0,"new_prefill":18093,"score_linear":14404.0,"score_lmetric":18093},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9718,"ongoing_decode_tokens":0,"pending_prefill_tokens":9718,"num_requests":1,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":18093,"score_linear":9718.0,"score_lmetric":27811}],"chosen_score_linear":50173.0,"chosen_score_lmetric":7853,"t_first_token":389944.071627843,"t_first_token_unix":1779820809.0855713,"t_done":389944.544159491,"t_done_unix":1779820809.558103},{"request_id":"1271486:1:1271486:119","session_id":"1271486","input_length":21719,"t_proxy_recv":389939.542799317,"t_decision_unix":1779820804.5567405,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":21719,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21719,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21719,"score_linear":135235.0,"score_lmetric":269876},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":21719,"score_linear":102074.0,"score_lmetric":120209},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":21719,"score_linear":126924.0,"score_lmetric":129699},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21719,"score_linear":108713.0,"score_lmetric":230298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":60413,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":21719,"score_linear":78119.0,"score_lmetric":78850},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":21719,"score_linear":113172.0,"score_lmetric":21719},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":29136,"ongoing_decode_tokens":28385,"pending_prefill_tokens":751,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":21719,"score_linear":29136.0,"score_lmetric":44940},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47375,"ongoing_decode_tokens":27927,"pending_prefill_tokens":7160,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":21719,"score_linear":47375.0,"score_lmetric":57758}],"chosen_score_linear":113172.0,"chosen_score_lmetric":21719,"t_first_token":389941.91889132,"t_first_token_unix":1779820806.9328344,"t_done":389945.077098281,"t_done_unix":1779820810.0910416},{"request_id":"1272313:1:1272313:126","session_id":"1272313","input_length":9718,"t_proxy_recv":389942.521042879,"t_decision_unix":1779820807.5349836,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9718,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":5622,"score_linear":131139.0,"score_lmetric":237682},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":9718,"score_linear":102074.0,"score_lmetric":108208},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":9718,"score_linear":150574.0,"score_lmetric":255048},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":9718,"score_linear":108713.0,"score_lmetric":206296},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":430,"cache_hit":0,"new_prefill":9718,"score_linear":60413.0,"score_lmetric":9718},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":134891,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":9718,"score_linear":134891.0,"score_lmetric":19436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":48091,"ongoing_decode_tokens":48091,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":396,"cache_hit":7680,"new_prefill":2038,"score_linear":40411.0,"score_lmetric":6114},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":9718,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389943.287539474,"t_first_token_unix":1779820808.301483,"t_done":389945.50424161,"t_done_unix":1779820810.5181901},{"request_id":"1272085:2:1273645:130","session_id":"1272085","input_length":8017,"t_proxy_recv":389947.240094122,"t_decision_unix":1779820812.2540357,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":5120,"affinity_cache_ratio":0.6386428838717725,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":2897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":8017,"score_linear":135235.0,"score_lmetric":242472},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":8017,"score_linear":102074.0,"score_lmetric":106507},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":8017,"score_linear":150574.0,"score_lmetric":251646},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8017,"score_linear":108713.0,"score_lmetric":202894},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":8017,"score_linear":60413.0,"score_lmetric":8017},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":307,"cache_hit":0,"new_prefill":8017,"score_linear":113172.0,"score_lmetric":8017},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33711,"ongoing_decode_tokens":33711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":428,"cache_hit":5120,"new_prefill":2897,"score_linear":28591.0,"score_lmetric":2897},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":0,"pending_prefill_tokens":21963,"num_requests":1,"active_p_offloads":0,"cached_blocks":334,"cache_hit":0,"new_prefill":8017,"score_linear":21963.0,"score_lmetric":29980}],"chosen_score_linear":28591.0,"chosen_score_lmetric":2897,"t_first_token":389947.499996772,"t_first_token_unix":1779820812.5139399,"t_done":389948.016435611,"t_done_unix":1779820813.0303786},{"request_id":"1260327:3:1273741:132","session_id":"1260327","input_length":31283,"t_proxy_recv":389947.64532989,"t_decision_unix":1779820812.6592715,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9820030048269028,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":563,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":31283,"score_linear":135235.0,"score_lmetric":289004},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":31283,"score_linear":102074.0,"score_lmetric":129773},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":31283,"score_linear":150574.0,"score_lmetric":298178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31283,"score_linear":108713.0,"score_lmetric":249426},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":85521,"ongoing_decode_tokens":60413,"pending_prefill_tokens":7700,"num_requests":2,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":31283,"score_linear":85521.0,"score_lmetric":77966},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":307,"cache_hit":0,"new_prefill":31283,"score_linear":113172.0,"score_lmetric":31283},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41728,"ongoing_decode_tokens":41728,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":428,"cache_hit":0,"new_prefill":31283,"score_linear":41728.0,"score_lmetric":62566},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":0,"pending_prefill_tokens":21963,"num_requests":1,"active_p_offloads":0,"cached_blocks":334,"cache_hit":30720,"new_prefill":563,"score_linear":-8757.0,"score_lmetric":22526}],"chosen_score_linear":-8757.0,"chosen_score_lmetric":22526,"t_first_token":389948.109663295,"t_first_token_unix":1779820813.1236062,"t_done":389948.924287061,"t_done_unix":1779820813.9382312},{"request_id":"1258859:2:1264639:81","session_id":"1258859","input_length":113172,"t_proxy_recv":389938.303237782,"t_decision_unix":1779820803.3171794,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":112640,"affinity_cache_ratio":0.995299190612519,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":113172,"score_linear":135235.0,"score_lmetric":452782},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":113172,"score_linear":102074.0,"score_lmetric":211662},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":113172,"score_linear":126924.0,"score_lmetric":221152},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":113172,"score_linear":108713.0,"score_lmetric":413204},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":113172,"score_linear":60413.0,"score_lmetric":113172},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":265,"cache_hit":112640,"new_prefill":532,"score_linear":-112640.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":112612,"ongoing_decode_tokens":84227,"pending_prefill_tokens":10465,"num_requests":4,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":113172,"score_linear":112612.0,"score_lmetric":494548},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":113172,"score_linear":27927.0,"score_lmetric":141099}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":389938.673265339,"t_first_token_unix":1779820803.6872087,"t_done":389948.944962568,"t_done_unix":1779820813.958906},{"request_id":"1262354:6:1270643:114","session_id":"1262354","input_length":32774,"t_proxy_recv":389937.329652418,"t_decision_unix":1779820802.3435938,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":28672,"affinity_cache_ratio":0.8748398120461341,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":4102,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":32774,"score_linear":135235.0,"score_lmetric":291986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":32774,"score_linear":102074.0,"score_lmetric":131264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":32774,"score_linear":126924.0,"score_lmetric":140754},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32774,"score_linear":108713.0,"score_lmetric":252408},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":391,"cache_hit":28672,"new_prefill":4102,"score_linear":-1033.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":125063,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":32774,"score_linear":125063.0,"score_lmetric":65548},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":112612,"ongoing_decode_tokens":84227,"pending_prefill_tokens":10465,"num_requests":4,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":32774,"score_linear":112612.0,"score_lmetric":172956},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":28672,"new_prefill":4102,"score_linear":-745.0,"score_lmetric":32029}],"chosen_score_linear":-1033.0,"chosen_score_lmetric":0,"t_first_token":389938.263875365,"t_first_token_unix":1779820803.2778187,"t_done":389949.007370881,"t_done_unix":1779820814.0213141},{"request_id":"1266668:3:1273119:128","session_id":"1266668","input_length":33711,"t_proxy_recv":389945.296189728,"t_decision_unix":1779820810.3101308,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":28672,"affinity_cache_ratio":0.850523567974845,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":5039,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":29615,"score_linear":131139.0,"score_lmetric":285668},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":33711,"score_linear":102074.0,"score_lmetric":132201},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":33711,"score_linear":150574.0,"score_lmetric":303034},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33711,"score_linear":108713.0,"score_lmetric":254282},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":33711,"score_linear":60413.0,"score_lmetric":33711},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":307,"cache_hit":0,"new_prefill":33711,"score_linear":113172.0,"score_lmetric":33711},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":428,"cache_hit":28672,"new_prefill":5039,"score_linear":-28672.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9718,"ongoing_decode_tokens":9718,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":315,"cache_hit":0,"new_prefill":33711,"score_linear":9718.0,"score_lmetric":33711}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":389946.435302803,"t_first_token_unix":1779820811.4492462,"t_done":389949.298087978,"t_done_unix":1779820814.3120313},{"request_id":"1265942:4:1274182:133","session_id":"1265942","input_length":21229,"t_proxy_recv":389949.123182517,"t_decision_unix":1779820814.137124,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":17920,"affinity_cache_ratio":0.8441283150407461,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":3309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21229,"score_linear":135235.0,"score_lmetric":268896},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":21229,"score_linear":102074.0,"score_lmetric":119719},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":21229,"score_linear":150574.0,"score_lmetric":278070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21229,"score_linear":108713.0,"score_lmetric":229318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":52747,"ongoing_decode_tokens":52747,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":454,"cache_hit":17920,"new_prefill":3309,"score_linear":34827.0,"score_lmetric":3309},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":21229,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33711,"ongoing_decode_tokens":33711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":0,"new_prefill":21229,"score_linear":33711.0,"score_lmetric":21229},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":21963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":335,"cache_hit":0,"new_prefill":21229,"score_linear":21963.0,"score_lmetric":21229}],"chosen_score_linear":34827.0,"chosen_score_lmetric":3309,"t_first_token":389949.706969445,"t_first_token_unix":1779820814.7209132,"t_done":389950.523066955,"t_done_unix":1779820815.53701},{"request_id":"1274405:1:1274405:134","session_id":"1274405","input_length":6208,"t_proxy_recv":389950.038045337,"t_decision_unix":1779820815.0519867,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6208,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":6208,"score_linear":135235.0,"score_lmetric":238854},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":6208,"score_linear":102074.0,"score_lmetric":104698},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":6208,"score_linear":150574.0,"score_lmetric":248028},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":6208,"score_linear":108713.0,"score_lmetric":199276},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":73976,"ongoing_decode_tokens":73976,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":454,"cache_hit":0,"new_prefill":6208,"score_linear":73976.0,"score_lmetric":12416},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":6208,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":6208,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":21963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":335,"cache_hit":0,"new_prefill":6208,"score_linear":21963.0,"score_lmetric":6208}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389950.445853764,"t_first_token_unix":1779820815.4597971,"t_done":389950.912387314,"t_done_unix":1779820815.9263308},{"request_id":"1273203:1:1273203:129","session_id":"1273203","input_length":21963,"t_proxy_recv":389945.599450381,"t_decision_unix":1779820810.6133919,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21963,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":21963,"score_linear":135235.0,"score_lmetric":270364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":21963,"score_linear":102074.0,"score_lmetric":120453},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":21963,"score_linear":150574.0,"score_lmetric":279538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":21963,"score_linear":108713.0,"score_lmetric":230786},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":445,"cache_hit":0,"new_prefill":21963,"score_linear":60413.0,"score_lmetric":21963},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":307,"cache_hit":12800,"new_prefill":9163,"score_linear":100372.0,"score_lmetric":9163},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":33711,"ongoing_decode_tokens":0,"pending_prefill_tokens":5039,"num_requests":1,"active_p_offloads":0,"cached_blocks":428,"cache_hit":0,"new_prefill":21963,"score_linear":33711.0,"score_lmetric":27002},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":334,"cache_hit":0,"new_prefill":21963,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389947.958267447,"t_first_token_unix":1779820812.9722106,"t_done":389951.661946957,"t_done_unix":1779820816.6758907},{"request_id":"1274890:1:1274890:135","session_id":"1274890","input_length":10506,"t_proxy_recv":389951.56396972,"t_decision_unix":1779820816.577911,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10506,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":10506,"score_linear":135235.0,"score_lmetric":247450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":10506,"score_linear":102074.0,"score_lmetric":108996},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":10506,"score_linear":150574.0,"score_lmetric":256624},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10506,"score_linear":108713.0,"score_lmetric":207872},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":52747,"ongoing_decode_tokens":52747,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":460,"cache_hit":0,"new_prefill":10506,"score_linear":52747.0,"score_lmetric":10506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":309,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":10506,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":21963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":335,"cache_hit":0,"new_prefill":10506,"score_linear":21963.0,"score_lmetric":10506}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389952.387474234,"t_first_token_unix":1779820817.4014182,"t_done":389952.632772846,"t_done_unix":1779820817.6467166},{"request_id":"1271328:2:1273711:131","session_id":"1271328","input_length":25108,"t_proxy_recv":389947.503276873,"t_decision_unix":1779820812.5172186,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":17408,"affinity_cache_ratio":0.6933248367054325,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":7700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":25108,"score_linear":135235.0,"score_lmetric":276654},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":25108,"score_linear":102074.0,"score_lmetric":123598},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":25108,"score_linear":150574.0,"score_lmetric":285828},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":25108,"score_linear":108713.0,"score_lmetric":237076},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60413,"ongoing_decode_tokens":60413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":445,"cache_hit":17408,"new_prefill":7700,"score_linear":43005.0,"score_lmetric":7700},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":113172,"ongoing_decode_tokens":113172,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":307,"cache_hit":0,"new_prefill":25108,"score_linear":113172.0,"score_lmetric":25108},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":41728,"ongoing_decode_tokens":41728,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":428,"cache_hit":0,"new_prefill":25108,"score_linear":41728.0,"score_lmetric":50216},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21963,"ongoing_decode_tokens":0,"pending_prefill_tokens":21963,"num_requests":1,"active_p_offloads":0,"cached_blocks":334,"cache_hit":0,"new_prefill":25108,"score_linear":21963.0,"score_lmetric":47071}],"chosen_score_linear":43005.0,"chosen_score_lmetric":7700,"t_first_token":389948.76345875,"t_first_token_unix":1779820813.7774026,"t_done":389953.400799312,"t_done_unix":1779820818.4147427},{"request_id":"1275433:1:1275433:137","session_id":"1275433","input_length":7794,"t_proxy_recv":389953.314787615,"t_decision_unix":1779820818.3287287,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7794,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":7794,"score_linear":135235.0,"score_lmetric":242026},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":7794,"score_linear":102074.0,"score_lmetric":106284},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":7794,"score_linear":150574.0,"score_lmetric":251200},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":7794,"score_linear":108713.0,"score_lmetric":202448},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":52747,"ongoing_decode_tokens":52747,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":460,"cache_hit":0,"new_prefill":7794,"score_linear":52747.0,"score_lmetric":7794},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":329,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":7794,"score_linear":114612.0,"score_lmetric":122406},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":378,"cache_hit":0,"new_prefill":7794,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389953.855995683,"t_first_token_unix":1779820818.869939,"t_done":389953.904843969,"t_done_unix":1779820818.9187872},{"request_id":"1275433:2:1276027:139","session_id":"1275433","input_length":7463,"t_proxy_recv":389955.586132807,"t_decision_unix":1779820820.6000743,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":7168,"affinity_cache_ratio":0.960471660190272,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":295,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":7463,"score_linear":135235.0,"score_lmetric":241364},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":7463,"score_linear":102074.0,"score_lmetric":105953},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":7463,"score_linear":150574.0,"score_lmetric":250538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":7463,"score_linear":108713.0,"score_lmetric":201786},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":7463,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":344,"cache_hit":7168,"new_prefill":295,"score_linear":-7168.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":7463,"score_linear":114612.0,"score_lmetric":122075},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":378,"cache_hit":0,"new_prefill":7463,"score_linear":10639.0,"score_lmetric":7463}],"chosen_score_linear":-7168.0,"chosen_score_lmetric":0,"t_first_token":389955.613884175,"t_first_token_unix":1779820820.6278276,"t_done":389955.622384776,"t_done_unix":1779820820.6363277},{"request_id":"1272313:2:1275926:138","session_id":"1272313","input_length":10639,"t_proxy_recv":389955.254195471,"t_decision_unix":1779820820.2681367,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9728,"affinity_cache_ratio":0.914371651471003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":4096,"new_prefill":6543,"score_linear":131139.0,"score_lmetric":239524},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":10639,"score_linear":102074.0,"score_lmetric":109129},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":10639,"score_linear":150574.0,"score_lmetric":256890},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":10639,"score_linear":108713.0,"score_lmetric":208138},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":10639,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":344,"cache_hit":0,"new_prefill":10639,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":2959,"score_linear":106932.0,"score_lmetric":117571},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":378,"cache_hit":9728,"new_prefill":911,"score_linear":-9728.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":389955.413575462,"t_first_token_unix":1779820820.4275193,"t_done":389956.684241604,"t_done_unix":1779820821.6981854},{"request_id":"1264679:1:1264679:82","session_id":"1264679","input_length":110048,"t_proxy_recv":389916.213304739,"t_decision_unix":1779820781.2272458,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":110048,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":110048,"score_linear":55989.0,"score_lmetric":110048},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":110048,"score_linear":71575.0,"score_lmetric":332680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":1,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":110048,"score_linear":113053.0,"score_lmetric":202621},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":110048,"score_linear":125063.0,"score_lmetric":454862},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":110048,"score_linear":50783.0,"score_lmetric":160831},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":110048,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389955.885618581,"t_first_token_unix":1779820820.8995616,"t_done":389956.982257589,"t_done_unix":1779820821.9962015},{"request_id":"1276111:1:1276111:140","session_id":"1276111","input_length":15783,"t_proxy_recv":389955.934900589,"t_decision_unix":1779820820.9488423,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":135235,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":15783,"score_linear":135235.0,"score_lmetric":31566},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":15783,"score_linear":102074.0,"score_lmetric":114273},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":15783,"score_linear":150574.0,"score_lmetric":267178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":15783,"score_linear":108713.0,"score_lmetric":218426},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":15783,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":344,"cache_hit":0,"new_prefill":15783,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":15783,"score_linear":114612.0,"score_lmetric":130395},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":378,"cache_hit":0,"new_prefill":15783,"score_linear":10639.0,"score_lmetric":15783}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389957.365851498,"t_first_token_unix":1779820822.3797948,"t_done":389957.545993777,"t_done_unix":1779820822.5599372},{"request_id":"1276498:1:1276498:142","session_id":"1276498","input_length":8704,"t_proxy_recv":389957.267279543,"t_decision_unix":1779820822.2812207,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8704,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":8704,"score_linear":25187.0,"score_lmetric":8704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":8704,"score_linear":102074.0,"score_lmetric":107194},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":8704,"score_linear":150574.0,"score_lmetric":253020},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8704,"score_linear":108713.0,"score_lmetric":204268},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44919,"ongoing_decode_tokens":27639,"pending_prefill_tokens":17280,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":8704,"score_linear":44919.0,"score_lmetric":25984},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":344,"cache_hit":0,"new_prefill":8704,"score_linear":15783.0,"score_lmetric":24487},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":8704,"score_linear":114612.0,"score_lmetric":123316},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":380,"cache_hit":0,"new_prefill":8704,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389957.906592499,"t_first_token_unix":1779820822.9205365,"t_done":389958.160694439,"t_done_unix":1779820823.1746385},{"request_id":"1276136:1:1276136:141","session_id":"1276136","input_length":17280,"t_proxy_recv":389956.018902303,"t_decision_unix":1779820821.0328438,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":17280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":135235,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":17280,"score_linear":135235.0,"score_lmetric":34560},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":17280,"score_linear":102074.0,"score_lmetric":115770},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":17280,"score_linear":150574.0,"score_lmetric":270172},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":17280,"score_linear":108713.0,"score_lmetric":221420},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":17280,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":344,"cache_hit":0,"new_prefill":17280,"score_linear":15783.0,"score_lmetric":33063},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":17280,"score_linear":114612.0,"score_lmetric":131892},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":10639,"ongoing_decode_tokens":10639,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":378,"cache_hit":0,"new_prefill":17280,"score_linear":10639.0,"score_lmetric":17280}],"chosen_score_linear":27639.0,"chosen_score_lmetric":0,"t_first_token":389957.746531063,"t_first_token_unix":1779820822.7604754,"t_done":389958.303735583,"t_done_unix":1779820823.3176787},{"request_id":"1271991:2:1276999:145","session_id":"1271991","input_length":11292,"t_proxy_recv":389959.036215267,"t_decision_unix":1779820824.0501566,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":2560,"affinity_cache_ratio":0.2267091746369111,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":8732,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":11292,"score_linear":25187.0,"score_lmetric":11292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":11292,"score_linear":102074.0,"score_lmetric":109782},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":11292,"score_linear":150574.0,"score_lmetric":258196},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11292,"score_linear":108713.0,"score_lmetric":209444},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":508,"cache_hit":2560,"new_prefill":8732,"score_linear":25079.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":11292,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":11292,"score_linear":170352.0,"score_lmetric":425124},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":397,"cache_hit":0,"new_prefill":11292,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":25079.0,"chosen_score_lmetric":0,"t_first_token":389959.79892089,"t_first_token_unix":1779820824.8128643,"t_done":389960.144127191,"t_done_unix":1779820825.1580703},{"request_id":"1277533:1:1277533:150","session_id":"1277533","input_length":4729,"t_proxy_recv":389961.067460437,"t_decision_unix":1779820826.0814018,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":4729,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":25187,"pending_prefill_tokens":27221,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":4729,"score_linear":52408.0,"score_lmetric":63900},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":4729,"score_linear":102074.0,"score_lmetric":103219},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":4729,"score_linear":150574.0,"score_lmetric":245070},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":4729,"score_linear":108713.0,"score_lmetric":196318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":525,"cache_hit":0,"new_prefill":4729,"score_linear":61163.0,"score_lmetric":4729},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16900,"ongoing_decode_tokens":0,"pending_prefill_tokens":16900,"num_requests":1,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":4729,"score_linear":16900.0,"score_lmetric":21629},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":4729,"score_linear":170352.0,"score_lmetric":405435},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31845,"ongoing_decode_tokens":0,"pending_prefill_tokens":12389,"num_requests":1,"active_p_offloads":0,"cached_blocks":397,"cache_hit":0,"new_prefill":4729,"score_linear":31845.0,"score_lmetric":17118}],"chosen_score_linear":61163.0,"chosen_score_lmetric":4729,"t_first_token":389961.380894611,"t_first_token_unix":1779820826.3948379,"t_done":389961.668996731,"t_done_unix":1779820826.6829395},{"request_id":"1262354:7:1277104:146","session_id":"1262354","input_length":33524,"t_proxy_recv":389959.444174935,"t_decision_unix":1779820824.4581158,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33280,"affinity_cache_ratio":0.992721632263453,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":33524,"score_linear":25187.0,"score_lmetric":33524},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":33524,"score_linear":102074.0,"score_lmetric":132014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":33524,"score_linear":150574.0,"score_lmetric":302660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":33524,"score_linear":108713.0,"score_lmetric":253908},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":38931,"ongoing_decode_tokens":27639,"pending_prefill_tokens":8732,"num_requests":1,"active_p_offloads":0,"cached_blocks":508,"cache_hit":33280,"new_prefill":244,"score_linear":5651.0,"score_lmetric":8976},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":33524,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":33524,"score_linear":170352.0,"score_lmetric":491820},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":397,"cache_hit":28672,"new_prefill":4852,"score_linear":-28672.0,"score_lmetric":0}],"chosen_score_linear":5651.0,"chosen_score_lmetric":8976,"t_first_token":389959.846209842,"t_first_token_unix":1779820824.8601532,"t_done":389963.526330317,"t_done_unix":1779820828.5402734},{"request_id":"1260327:4:1277974:154","session_id":"1260327","input_length":31430,"t_proxy_recv":389962.692735285,"t_decision_unix":1779820827.7066767,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9937002863506205,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":198,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":25187,"pending_prefill_tokens":27221,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":31430,"score_linear":52408.0,"score_lmetric":117302},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":31430,"score_linear":102074.0,"score_lmetric":129920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":31430,"score_linear":150574.0,"score_lmetric":298472},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31430,"score_linear":108713.0,"score_lmetric":249720},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":31430,"score_linear":61163.0,"score_lmetric":31430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":41122,"ongoing_decode_tokens":16900,"pending_prefill_tokens":24222,"num_requests":2,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":31430,"score_linear":41122.0,"score_lmetric":111304},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":31430,"score_linear":170352.0,"score_lmetric":485538},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63302,"ongoing_decode_tokens":63302,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":397,"cache_hit":31232,"new_prefill":198,"score_linear":32070.0,"score_lmetric":594}],"chosen_score_linear":32070.0,"chosen_score_lmetric":594,"t_first_token":389962.769874939,"t_first_token_unix":1779820827.783818,"t_done":389963.529524345,"t_done_unix":1779820828.5434675},{"request_id":"1277428:1:1277428:149","session_id":"1277428","input_length":27221,"t_proxy_recv":389960.638417977,"t_decision_unix":1779820825.6523592,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":27221,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":27221,"score_linear":25187.0,"score_lmetric":27221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":3584,"new_prefill":23637,"score_linear":98490.0,"score_lmetric":122127},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":27221,"score_linear":150574.0,"score_lmetric":290054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":17408,"new_prefill":9813,"score_linear":91305.0,"score_lmetric":206486},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":525,"cache_hit":0,"new_prefill":27221,"score_linear":61163.0,"score_lmetric":27221},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16900,"ongoing_decode_tokens":0,"pending_prefill_tokens":16900,"num_requests":1,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":27221,"score_linear":16900.0,"score_lmetric":44121},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":27221,"score_linear":170352.0,"score_lmetric":472911},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31845,"ongoing_decode_tokens":0,"pending_prefill_tokens":12389,"num_requests":1,"active_p_offloads":0,"cached_blocks":397,"cache_hit":0,"new_prefill":27221,"score_linear":31845.0,"score_lmetric":39610}],"chosen_score_linear":25187.0,"chosen_score_lmetric":27221,"t_first_token":389964.007283408,"t_first_token_unix":1779820829.0212271,"t_done":389964.830627753,"t_done_unix":1779820829.8445728},{"request_id":"1268831:3:1277112:147","session_id":"1268831","input_length":31845,"t_proxy_recv":389959.484916948,"t_decision_unix":1779820824.4988585,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19456,"affinity_cache_ratio":0.6109593342753965,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":12389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":31845,"score_linear":25187.0,"score_lmetric":31845},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":31845,"score_linear":102074.0,"score_lmetric":130335},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":31845,"score_linear":150574.0,"score_lmetric":299302},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":31845,"score_linear":108713.0,"score_lmetric":250550},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72455,"ongoing_decode_tokens":27639,"pending_prefill_tokens":8976,"num_requests":2,"active_p_offloads":0,"cached_blocks":508,"cache_hit":0,"new_prefill":31845,"score_linear":72455.0,"score_lmetric":81642},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":31845,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":31845,"score_linear":170352.0,"score_lmetric":486783},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":397,"cache_hit":19456,"new_prefill":12389,"score_linear":-19456.0,"score_lmetric":0}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":389961.838175,"t_first_token_unix":1779820826.8521187,"t_done":389964.974201115,"t_done_unix":1779820829.9881442},{"request_id":"1273203:2:1277744:152","session_id":"1273203","input_length":22573,"t_proxy_recv":389961.790840336,"t_decision_unix":1779820826.8047812,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9753245027244939,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":557,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":25187,"pending_prefill_tokens":27221,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":22573,"score_linear":52408.0,"score_lmetric":99588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":22573,"score_linear":102074.0,"score_lmetric":121063},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":22573,"score_linear":150574.0,"score_lmetric":280758},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":22573,"score_linear":108713.0,"score_lmetric":232006},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":22573,"score_linear":61163.0,"score_lmetric":22573},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16900,"ongoing_decode_tokens":0,"pending_prefill_tokens":16900,"num_requests":1,"active_p_offloads":0,"cached_blocks":374,"cache_hit":12800,"new_prefill":9773,"score_linear":4100.0,"score_lmetric":26673},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":22573,"score_linear":170352.0,"score_lmetric":458967},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":40729,"ongoing_decode_tokens":0,"pending_prefill_tokens":21273,"num_requests":2,"active_p_offloads":0,"cached_blocks":397,"cache_hit":22016,"new_prefill":557,"score_linear":18713.0,"score_lmetric":43660}],"chosen_score_linear":18713.0,"chosen_score_lmetric":43660,"t_first_token":389962.522139408,"t_first_token_unix":1779820827.5360827,"t_done":389965.261890947,"t_done_unix":1779820830.2758346},{"request_id":"1268630:1:1268630:98","session_id":"1268630","input_length":102074,"t_proxy_recv":389929.837325982,"t_decision_unix":1779820794.8512676,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":98490,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":102074,"score_linear":135235.0,"score_lmetric":430586},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":3584,"new_prefill":98490,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":102074,"score_linear":126924.0,"score_lmetric":210054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":4608,"new_prefill":97466,"score_linear":10675.0,"score_lmetric":97466},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":46277,"ongoing_decode_tokens":27639,"pending_prefill_tokens":18638,"num_requests":1,"active_p_offloads":0,"cached_blocks":288,"cache_hit":0,"new_prefill":102074,"score_linear":46277.0,"score_lmetric":120712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":102074,"score_linear":125063.0,"score_lmetric":438914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":102074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":2298,"ongoing_decode_tokens":0,"pending_prefill_tokens":2298,"num_requests":1,"active_p_offloads":0,"cached_blocks":206,"cache_hit":0,"new_prefill":102074,"score_linear":2298.0,"score_lmetric":104372}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":389963.818178097,"t_first_token_unix":1779820828.8321216,"t_done":389966.01193132,"t_done_unix":1779820831.025875},{"request_id":"1271459:2:1277544:151","session_id":"1271459","input_length":8884,"t_proxy_recv":389961.106281635,"t_decision_unix":1779820826.120223,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":7,"affinity_cache_hit":512,"affinity_cache_ratio":0.05763169743358847,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":21273,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8884,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":25187,"pending_prefill_tokens":27221,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":8884,"score_linear":52408.0,"score_lmetric":72210},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":8884,"score_linear":102074.0,"score_lmetric":107374},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":8884,"score_linear":150574.0,"score_lmetric":253380},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":8884,"score_linear":108713.0,"score_lmetric":204628},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":65892,"ongoing_decode_tokens":61163,"pending_prefill_tokens":4729,"num_requests":2,"active_p_offloads":0,"cached_blocks":525,"cache_hit":0,"new_prefill":8884,"score_linear":65892.0,"score_lmetric":27226},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16900,"ongoing_decode_tokens":0,"pending_prefill_tokens":16900,"num_requests":1,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":8884,"score_linear":16900.0,"score_lmetric":25784},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":512,"new_prefill":8372,"score_linear":169840.0,"score_lmetric":416364},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31845,"ongoing_decode_tokens":0,"pending_prefill_tokens":12389,"num_requests":1,"active_p_offloads":0,"cached_blocks":397,"cache_hit":0,"new_prefill":8884,"score_linear":31845.0,"score_lmetric":21273}],"chosen_score_linear":31845.0,"chosen_score_lmetric":21273,"t_first_token":389962.523627413,"t_first_token_unix":1779820827.5375705,"t_done":389966.161120856,"t_done_unix":1779820831.1750643},{"request_id":"1270606:1:1270606:113","session_id":"1270606","input_length":93430,"t_proxy_recv":389936.490652408,"t_decision_unix":1779820801.5045934,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":93430,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":93430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":93430,"score_linear":135235.0,"score_lmetric":413298},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":93430,"score_linear":102074.0,"score_lmetric":191920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":93430,"score_linear":126924.0,"score_lmetric":201410},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":93430,"score_linear":15283.0,"score_lmetric":93430},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":67673,"ongoing_decode_tokens":56545,"pending_prefill_tokens":6008,"num_requests":2,"active_p_offloads":0,"cached_blocks":324,"cache_hit":0,"new_prefill":93430,"score_linear":67673.0,"score_lmetric":198876},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":93430,"score_linear":125063.0,"score_lmetric":421626},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":84227,"ongoing_decode_tokens":26424,"pending_prefill_tokens":7115,"num_requests":3,"active_p_offloads":0,"cached_blocks":341,"cache_hit":0,"new_prefill":93430,"score_linear":84227.0,"score_lmetric":301635},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27927,"ongoing_decode_tokens":0,"pending_prefill_tokens":27927,"num_requests":1,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":93430,"score_linear":27927.0,"score_lmetric":121357}],"chosen_score_linear":15283.0,"chosen_score_lmetric":93430,"t_first_token":389965.333758044,"t_first_token_unix":1779820830.3477018,"t_done":389967.272729678,"t_done_unix":1779820832.286673},{"request_id":"1276498:2:1278996:157","session_id":"1276498","input_length":16650,"t_proxy_recv":389966.237096796,"t_decision_unix":1779820831.2510383,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":8704,"affinity_cache_ratio":0.5227627627627628,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":7946,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":16650,"score_linear":25187.0,"score_lmetric":16650},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":458,"cache_hit":0,"new_prefill":16650,"score_linear":58752.0,"score_lmetric":16650},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":16650,"score_linear":150574.0,"score_lmetric":268912},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":108713,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":16650,"score_linear":108713.0,"score_lmetric":33300},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":16650,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":16900,"pending_prefill_tokens":28655,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":16650,"score_linear":159219.0,"score_lmetric":135915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":16650,"score_linear":170352.0,"score_lmetric":441198},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":440,"cache_hit":8704,"new_prefill":7946,"score_linear":-8704.0,"score_lmetric":0}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":389967.183643034,"t_first_token_unix":1779820832.1975873,"t_done":389967.632370647,"t_done_unix":1779820832.6463134},{"request_id":"1268831:4:1279168:158","session_id":"1268831","input_length":32346,"t_proxy_recv":389966.707352265,"t_decision_unix":1779820831.7212932,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9813887343102702,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":602,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":32346,"score_linear":25187.0,"score_lmetric":32346},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":458,"cache_hit":0,"new_prefill":32346,"score_linear":58752.0,"score_lmetric":32346},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":32346,"score_linear":150574.0,"score_lmetric":300304},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":108713,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":32346,"score_linear":108713.0,"score_lmetric":64692},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":32346,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":16900,"pending_prefill_tokens":28655,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":32346,"score_linear":159219.0,"score_lmetric":183003},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":32346,"score_linear":170352.0,"score_lmetric":488286},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":16650,"ongoing_decode_tokens":0,"pending_prefill_tokens":7946,"num_requests":1,"active_p_offloads":0,"cached_blocks":440,"cache_hit":31744,"new_prefill":602,"score_linear":-15094.0,"score_lmetric":8548}],"chosen_score_linear":-15094.0,"chosen_score_lmetric":8548,"t_first_token":389967.36464662,"t_first_token_unix":1779820832.3785903,"t_done":389968.770862125,"t_done_unix":1779820833.7848063},{"request_id":"1272313:3:1279208:159","session_id":"1272313","input_length":11549,"t_proxy_recv":389966.884255621,"t_decision_unix":1779820831.8981972,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9309896960775825,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":797,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":4096,"new_prefill":7453,"score_linear":21091.0,"score_lmetric":7453},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":458,"cache_hit":0,"new_prefill":11549,"score_linear":58752.0,"score_lmetric":11549},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":11549,"score_linear":150574.0,"score_lmetric":258710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":108713,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":11549,"score_linear":108713.0,"score_lmetric":23098},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":11549,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":16900,"pending_prefill_tokens":28655,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":11549,"score_linear":159219.0,"score_lmetric":120612},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":3869,"score_linear":162672.0,"score_lmetric":402855},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":48996,"ongoing_decode_tokens":0,"pending_prefill_tokens":8548,"num_requests":2,"active_p_offloads":0,"cached_blocks":440,"cache_hit":10752,"new_prefill":797,"score_linear":38244.0,"score_lmetric":18690}],"chosen_score_linear":38244.0,"chosen_score_lmetric":18690,"t_first_token":389967.367934454,"t_first_token_unix":1779820832.3818777,"t_done":389968.952845348,"t_done_unix":1779820833.9667885},{"request_id":"1253804:5:1278488:156","session_id":"1253804","input_length":58752,"t_proxy_recv":389964.372196679,"t_decision_unix":1779820829.3861375,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9760348583877996,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":1408,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":52408,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":58752,"score_linear":52408.0,"score_lmetric":117504},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":102074,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":57344,"new_prefill":1408,"score_linear":44730.0,"score_lmetric":1408},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":58752,"score_linear":150574.0,"score_lmetric":353116},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":3584,"new_prefill":55168,"score_linear":105129.0,"score_lmetric":297196},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":58752,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":16900,"pending_prefill_tokens":28655,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":58752,"score_linear":159219.0,"score_lmetric":262221},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":58752,"score_linear":170352.0,"score_lmetric":567504},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63302,"ongoing_decode_tokens":63302,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":397,"cache_hit":0,"new_prefill":58752,"score_linear":63302.0,"score_lmetric":176256}],"chosen_score_linear":44730.0,"chosen_score_lmetric":1408,"t_first_token":389964.917068081,"t_first_token_unix":1779820829.9310117,"t_done":389969.458869022,"t_done_unix":1779820834.4728122},{"request_id":"1276136:2:1280145:162","session_id":"1276136","input_length":24519,"t_proxy_recv":389969.998462729,"t_decision_unix":1779820835.012404,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":16896,"affinity_cache_ratio":0.6890982503364738,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":7623,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":24519,"score_linear":25187.0,"score_lmetric":24519},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":24519,"score_linear":88317.0,"score_lmetric":112836},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":24519,"score_linear":150574.0,"score_lmetric":284650},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":24519,"score_linear":15283.0,"score_lmetric":24519},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":47775,"ongoing_decode_tokens":47775,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":535,"cache_hit":16896,"new_prefill":7623,"score_linear":30879.0,"score_lmetric":7623},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":24519,"score_linear":159219.0,"score_lmetric":73557},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":24519,"score_linear":170352.0,"score_lmetric":464805},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":24519,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":30879.0,"chosen_score_lmetric":7623,"t_first_token":389971.224807886,"t_first_token_unix":1779820836.238751,"t_done":389971.842848369,"t_done_unix":1779820836.8567915},{"request_id":"1262354:8:1280463:163","session_id":"1262354","input_length":33928,"t_proxy_recv":389971.002894176,"t_decision_unix":1779820836.0168357,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9959915114359821,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":33928,"score_linear":25187.0,"score_lmetric":33928},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":33928,"score_linear":88317.0,"score_lmetric":122245},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":33928,"score_linear":150574.0,"score_lmetric":303468},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":33928,"score_linear":15283.0,"score_lmetric":33928},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":72294,"ongoing_decode_tokens":47775,"pending_prefill_tokens":7623,"num_requests":2,"active_p_offloads":0,"cached_blocks":535,"cache_hit":33792,"new_prefill":136,"score_linear":38502.0,"score_lmetric":15518},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":33928,"score_linear":159219.0,"score_lmetric":101784},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":33928,"score_linear":170352.0,"score_lmetric":493032},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":28672,"new_prefill":5256,"score_linear":-28672.0,"score_lmetric":0}],"chosen_score_linear":38502.0,"chosen_score_lmetric":15518,"t_first_token":389971.27606236,"t_first_token_unix":1779820836.2900062,"t_done":389972.129810336,"t_done_unix":1779820837.1437538},{"request_id":"1279412:1:1279412:160","session_id":"1279412","input_length":20136,"t_proxy_recv":389967.692674291,"t_decision_unix":1779820832.706616,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":7336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":20136,"score_linear":25187.0,"score_lmetric":20136},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":58752,"ongoing_decode_tokens":58752,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":458,"cache_hit":0,"new_prefill":20136,"score_linear":58752.0,"score_lmetric":20136},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":20136,"score_linear":150574.0,"score_lmetric":275884},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":20136,"score_linear":15283.0,"score_lmetric":20136},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":12800,"new_prefill":7336,"score_linear":14839.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":16900,"pending_prefill_tokens":28655,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":20136,"score_linear":159219.0,"score_lmetric":146373},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":20136,"score_linear":170352.0,"score_lmetric":451656},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43895,"ongoing_decode_tokens":43895,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":455,"cache_hit":12800,"new_prefill":7336,"score_linear":31095.0,"score_lmetric":14672}],"chosen_score_linear":14839.0,"chosen_score_lmetric":0,"t_first_token":389968.737725793,"t_first_token_unix":1779820833.7516708,"t_done":389972.355792516,"t_done_unix":1779820837.3697357},{"request_id":"1262727:1:1262727:72","session_id":"1262727","input_length":15283,"t_proxy_recv":389909.100124516,"t_decision_unix":1779820774.1140654,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":143,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":0,"pending_prefill_tokens":1205,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":15283,"score_linear":55989.0,"score_lmetric":16488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68131,"ongoing_decode_tokens":0,"pending_prefill_tokens":68131,"num_requests":1,"active_p_offloads":0,"cached_blocks":163,"cache_hit":0,"new_prefill":15283,"score_linear":68131.0,"score_lmetric":83414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113053,"ongoing_decode_tokens":0,"pending_prefill_tokens":92573,"num_requests":2,"active_p_offloads":0,"cached_blocks":78,"cache_hit":0,"new_prefill":15283,"score_linear":113053.0,"score_lmetric":215712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":15283,"score_linear":125063.0,"score_lmetric":265332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":197,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21510,"ongoing_decode_tokens":0,"pending_prefill_tokens":21510,"num_requests":1,"active_p_offloads":0,"cached_blocks":86,"cache_hit":0,"new_prefill":15283,"score_linear":21510.0,"score_lmetric":36793}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389910.515963719,"t_first_token_unix":1779820775.5299077,"t_done":389973.967856775,"t_done_unix":1779820838.9818015},{"request_id":"1276136:3:1280987:166","session_id":"1276136","input_length":25923,"t_proxy_recv":389972.94417575,"t_decision_unix":1779820837.9581175,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9282876210315164,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":1859,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":25923,"score_linear":25187.0,"score_lmetric":25923},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":25923,"score_linear":88317.0,"score_lmetric":114240},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":25923,"score_linear":150574.0,"score_lmetric":287458},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":25923,"score_linear":15283.0,"score_lmetric":25923},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":563,"cache_hit":24064,"new_prefill":1859,"score_linear":3575.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":25923,"score_linear":159219.0,"score_lmetric":77769},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":25923,"score_linear":183117.0,"score_lmetric":627264},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":25923,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":3575.0,"chosen_score_lmetric":0,"t_first_token":389973.283021203,"t_first_token_unix":1779820838.296965,"t_done":389975.2206986,"t_done_unix":1779820840.2346416},{"request_id":"1269373:3:1277365:148","session_id":"1269373","input_length":16900,"t_proxy_recv":389960.359020207,"t_decision_unix":1779820825.3729613,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":5,"affinity_cache_hit":14848,"affinity_cache_ratio":0.8785798816568048,"affinity_num_requests":3,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":16900,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":12804,"score_linear":21091.0,"score_lmetric":12804},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":16900,"score_linear":102074.0,"score_lmetric":115390},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":16900,"score_linear":150574.0,"score_lmetric":269412},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":16900,"score_linear":108713.0,"score_lmetric":220660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":525,"cache_hit":0,"new_prefill":16900,"score_linear":61163.0,"score_lmetric":16900},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":16900,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":14848,"new_prefill":2052,"score_linear":155504.0,"score_lmetric":397404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":31845,"ongoing_decode_tokens":0,"pending_prefill_tokens":12389,"num_requests":1,"active_p_offloads":0,"cached_blocks":397,"cache_hit":7680,"new_prefill":9220,"score_linear":24165.0,"score_lmetric":21609}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389961.972207468,"t_first_token_unix":1779820826.9861512,"t_done":389975.55319279,"t_done_unix":1779820840.567136},{"request_id":"1281887:1:1281887:171","session_id":"1281887","input_length":9370,"t_proxy_recv":389975.861295567,"t_decision_unix":1779820840.8752372,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9370,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":9370,"score_linear":25187.0,"score_lmetric":9370},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":9370,"score_linear":88317.0,"score_lmetric":97687},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":9370,"score_linear":150574.0,"score_lmetric":254352},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":9370,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88093,"ongoing_decode_tokens":88093,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":9370,"score_linear":88093.0,"score_lmetric":18740},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":172581,"ongoing_decode_tokens":142319,"pending_prefill_tokens":12854,"num_requests":3,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":9370,"score_linear":172581.0,"score_lmetric":66672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":9370,"score_linear":183117.0,"score_lmetric":561052},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13901,"ongoing_decode_tokens":13901,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":9370,"score_linear":13901.0,"score_lmetric":9370}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389976.568684625,"t_first_token_unix":1779820841.582628,"t_done":389976.7349229,"t_done_unix":1779820841.7488658},{"request_id":"1282082:1:1282082:173","session_id":"1282082","input_length":4972,"t_proxy_recv":389976.53538993,"t_decision_unix":1779820841.5493314,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":4972,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4972,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":4972,"score_linear":25187.0,"score_lmetric":4972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":4972,"score_linear":88317.0,"score_lmetric":93289},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":4972,"score_linear":150574.0,"score_lmetric":245556},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9370,"ongoing_decode_tokens":0,"pending_prefill_tokens":9370,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":4972,"score_linear":9370.0,"score_lmetric":14342},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88093,"ongoing_decode_tokens":88093,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":4972,"score_linear":88093.0,"score_lmetric":9944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":172581,"ongoing_decode_tokens":142319,"pending_prefill_tokens":12854,"num_requests":3,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":4972,"score_linear":172581.0,"score_lmetric":53478},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":4972,"score_linear":183117.0,"score_lmetric":543460},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55924,"ongoing_decode_tokens":13901,"pending_prefill_tokens":10791,"num_requests":2,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":4972,"score_linear":55924.0,"score_lmetric":31526}],"chosen_score_linear":25187.0,"chosen_score_lmetric":4972,"t_first_token":389976.85412273,"t_first_token_unix":1779820841.8680665,"t_done":389977.095541323,"t_done_unix":1779820842.1094842},{"request_id":"1262354:9:1281632:169","session_id":"1262354","input_length":34028,"t_proxy_recv":389974.9964862,"t_decision_unix":1779820840.0104277,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9930645350887505,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":236,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":34028,"score_linear":25187.0,"score_lmetric":34028},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":34028,"score_linear":88317.0,"score_lmetric":122345},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":34028,"score_linear":150574.0,"score_lmetric":303668},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":34028,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79988,"ongoing_decode_tokens":79988,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":563,"cache_hit":33792,"new_prefill":236,"score_linear":46196.0,"score_lmetric":472},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":34028,"score_linear":159219.0,"score_lmetric":102084},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":34028,"score_linear":183117.0,"score_lmetric":659684},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":28672,"new_prefill":5356,"score_linear":-28672.0,"score_lmetric":0}],"chosen_score_linear":46196.0,"chosen_score_lmetric":472,"t_first_token":389975.083593502,"t_first_token_unix":1779820840.097537,"t_done":389977.680084806,"t_done_unix":1779820842.6940281},{"request_id":"1267915:1:1267915:96","session_id":"1267915","input_length":126924,"t_proxy_recv":389927.215501052,"t_decision_unix":1779820792.2294326,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":107980,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":126924,"score_linear":135235.0,"score_lmetric":480286},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":126924,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":348,"cache_hit":18944,"new_prefill":107980,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":126924,"score_linear":15283.0,"score_lmetric":126924},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":276,"cache_hit":0,"new_prefill":126924,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":126924,"score_linear":125063.0,"score_lmetric":488614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17466,"ongoing_decode_tokens":17466,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":306,"cache_hit":0,"new_prefill":126924,"score_linear":17466.0,"score_lmetric":126924},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28671,"ongoing_decode_tokens":0,"pending_prefill_tokens":6143,"num_requests":1,"active_p_offloads":0,"cached_blocks":194,"cache_hit":0,"new_prefill":126924,"score_linear":28671.0,"score_lmetric":133067}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":389977.458507446,"t_first_token_unix":1779820842.4724517,"t_done":389978.761832668,"t_done_unix":1779820843.7757761},{"request_id":"1265128:2:1271655:122","session_id":"1265128","input_length":23650,"t_proxy_recv":389940.0536971,"t_decision_unix":1779820805.0676389,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13824,"affinity_cache_ratio":0.5845243128964059,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":9826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":23650,"score_linear":135235.0,"score_lmetric":273738},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":23650,"score_linear":102074.0,"score_lmetric":122140},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":126924,"ongoing_decode_tokens":0,"pending_prefill_tokens":107980,"num_requests":1,"active_p_offloads":0,"cached_blocks":348,"cache_hit":13824,"new_prefill":9826,"score_linear":113100.0,"score_lmetric":117806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":23650,"score_linear":108713.0,"score_lmetric":234160},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":78119,"ongoing_decode_tokens":60413,"pending_prefill_tokens":17706,"num_requests":2,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":23650,"score_linear":78119.0,"score_lmetric":82712},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134891,"ongoing_decode_tokens":113172,"pending_prefill_tokens":21719,"num_requests":2,"active_p_offloads":0,"cached_blocks":265,"cache_hit":0,"new_prefill":23650,"score_linear":134891.0,"score_lmetric":90738},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":43540,"ongoing_decode_tokens":43540,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":391,"cache_hit":0,"new_prefill":23650,"score_linear":43540.0,"score_lmetric":70950},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":47375,"ongoing_decode_tokens":47375,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":246,"cache_hit":0,"new_prefill":23650,"score_linear":47375.0,"score_lmetric":47300}],"chosen_score_linear":113100.0,"chosen_score_lmetric":117806,"t_first_token":389977.981641524,"t_first_token_unix":1779820842.9955847,"t_done":389979.11670496,"t_done_unix":1779820844.1306484},{"request_id":"1260327:5:1281915:172","session_id":"1260327","input_length":42023,"t_proxy_recv":389975.976835802,"t_decision_unix":1779820840.990777,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":31232,"affinity_cache_ratio":0.7432120505437498,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":10791,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":42023,"score_linear":25187.0,"score_lmetric":42023},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":42023,"score_linear":88317.0,"score_lmetric":130340},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":42023,"score_linear":150574.0,"score_lmetric":319658},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9370,"ongoing_decode_tokens":0,"pending_prefill_tokens":9370,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":42023,"score_linear":9370.0,"score_lmetric":51393},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88093,"ongoing_decode_tokens":88093,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":42023,"score_linear":88093.0,"score_lmetric":84046},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":172581,"ongoing_decode_tokens":142319,"pending_prefill_tokens":12854,"num_requests":3,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":42023,"score_linear":172581.0,"score_lmetric":164631},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":42023,"score_linear":183117.0,"score_lmetric":691664},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13901,"ongoing_decode_tokens":13901,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":457,"cache_hit":31232,"new_prefill":10791,"score_linear":-17331.0,"score_lmetric":10791}],"chosen_score_linear":-17331.0,"chosen_score_lmetric":10791,"t_first_token":389978.706908443,"t_first_token_unix":1779820843.7208524,"t_done":389979.465591293,"t_done_unix":1779820844.4795344},{"request_id":"1258859:3:1278118:155","session_id":"1258859","input_length":118097,"t_proxy_recv":389963.212396126,"t_decision_unix":1779820828.2263374,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":113664,"affinity_cache_ratio":0.962463060026927,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":113664,"estimated_new_tokens":4433,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":25187,"pending_prefill_tokens":27221,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":118097,"score_linear":52408.0,"score_lmetric":290636},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":118097,"score_linear":102074.0,"score_lmetric":216587},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":118097,"score_linear":150574.0,"score_lmetric":471806},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":118097,"score_linear":108713.0,"score_lmetric":423054},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":118097,"score_linear":61163.0,"score_lmetric":118097},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":41122,"ongoing_decode_tokens":16900,"pending_prefill_tokens":24222,"num_requests":2,"active_p_offloads":0,"cached_blocks":374,"cache_hit":113664,"new_prefill":4433,"score_linear":-72542.0,"score_lmetric":57310},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":118097,"score_linear":170352.0,"score_lmetric":745539},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94732,"ongoing_decode_tokens":94732,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":397,"cache_hit":0,"new_prefill":118097,"score_linear":94732.0,"score_lmetric":472388}],"chosen_score_linear":-72542.0,"chosen_score_lmetric":57310,"t_first_token":389967.822839498,"t_first_token_unix":1779820832.8367827,"t_done":389979.882293686,"t_done_unix":1779820844.896239},{"request_id":"1272313:4:1281720:170","session_id":"1272313","input_length":13901,"t_proxy_recv":389975.293597536,"t_decision_unix":1779820840.3075392,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":11264,"affinity_cache_ratio":0.8103014171642328,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":2637,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":4096,"new_prefill":9805,"score_linear":21091.0,"score_lmetric":9805},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":13901,"score_linear":88317.0,"score_lmetric":102218},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":13901,"score_linear":150574.0,"score_lmetric":263414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":13901,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88093,"ongoing_decode_tokens":88093,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":13901,"score_linear":88093.0,"score_lmetric":27802},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":13901,"score_linear":159219.0,"score_lmetric":41703},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":6221,"score_linear":175437.0,"score_lmetric":548456},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":11264,"new_prefill":2637,"score_linear":-11264.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":389975.61046933,"t_first_token_unix":1779820840.6244133,"t_done":389980.08934117,"t_done_unix":1779820845.1032841},{"request_id":"1277533:2:1282872:175","session_id":"1277533","input_length":16299,"t_proxy_recv":389979.277979756,"t_decision_unix":1779820844.291921,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":3,"affinity_cache_hit":4608,"affinity_cache_ratio":0.2827167310877968,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16299,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":0,"new_prefill":16299,"score_linear":25187.0,"score_lmetric":16299},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":16299,"score_linear":88317.0,"score_lmetric":104616},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":16299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":54065,"ongoing_decode_tokens":54065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":566,"cache_hit":4608,"new_prefill":11691,"score_linear":49457.0,"score_lmetric":11691},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":172581,"ongoing_decode_tokens":172581,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":408,"cache_hit":0,"new_prefill":16299,"score_linear":172581.0,"score_lmetric":48897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":16299,"score_linear":183117.0,"score_lmetric":588768},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55924,"ongoing_decode_tokens":55924,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":16299,"score_linear":55924.0,"score_lmetric":32598}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389980.769635266,"t_first_token_unix":1779820845.783579,"t_done":389980.785161556,"t_done_unix":1779820845.7991045},{"request_id":"1279412:2:1281113:167","session_id":"1279412","input_length":26426,"t_proxy_recv":389973.47896074,"t_decision_unix":1779820838.4929025,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.7556194656777416,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":6458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":26426,"score_linear":25187.0,"score_lmetric":26426},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":26426,"score_linear":88317.0,"score_lmetric":114743},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":26426,"score_linear":150574.0,"score_lmetric":288464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":26426,"score_linear":15283.0,"score_lmetric":26426},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":53562,"ongoing_decode_tokens":53562,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":563,"cache_hit":19968,"new_prefill":6458,"score_linear":33594.0,"score_lmetric":6458},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":26426,"score_linear":159219.0,"score_lmetric":79278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":26426,"score_linear":183117.0,"score_lmetric":629276},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":12800,"new_prefill":13626,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":33594.0,"chosen_score_lmetric":6458,"t_first_token":389974.605012867,"t_first_token_unix":1779820839.6189563,"t_done":389980.856310254,"t_done_unix":1779820845.8702533},{"request_id":"1277909:1:1277909:153","session_id":"1277909","input_length":24222,"t_proxy_recv":389962.493856753,"t_decision_unix":1779820827.5077977,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":24222,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":52408,"ongoing_decode_tokens":25187,"pending_prefill_tokens":27221,"num_requests":2,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":20126,"score_linear":48312.0,"score_lmetric":94694},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":24222,"score_linear":102074.0,"score_lmetric":122712},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":24222,"score_linear":150574.0,"score_lmetric":284056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":24222,"score_linear":108713.0,"score_lmetric":235304},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":61163,"ongoing_decode_tokens":61163,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":534,"cache_hit":0,"new_prefill":24222,"score_linear":61163.0,"score_lmetric":24222},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16900,"ongoing_decode_tokens":16900,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":24222,"score_linear":16900.0,"score_lmetric":24222},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":16542,"score_linear":162672.0,"score_lmetric":440874},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63302,"ongoing_decode_tokens":31845,"pending_prefill_tokens":9441,"num_requests":3,"active_p_offloads":0,"cached_blocks":397,"cache_hit":7680,"new_prefill":16542,"score_linear":55622.0,"score_lmetric":77949}],"chosen_score_linear":16900.0,"chosen_score_lmetric":24222,"t_first_token":389967.818543861,"t_first_token_unix":1779820832.832487,"t_done":389981.046483975,"t_done_unix":1779820846.0604277},{"request_id":"1283642:1:1283642:178","session_id":"1283642","input_length":8510,"t_proxy_recv":389981.713987067,"t_decision_unix":1779820846.7279284,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":0,"new_prefill":8510,"score_linear":25187.0,"score_lmetric":8510},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":8510,"score_linear":88317.0,"score_lmetric":96827},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":8510,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":148998,"ongoing_decode_tokens":148998,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":8510,"score_linear":148998.0,"score_lmetric":17020},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":8510,"score_linear":183117.0,"score_lmetric":557612},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":483,"cache_hit":0,"new_prefill":8510,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389982.345175966,"t_first_token_unix":1779820847.3591197,"t_done":389982.652205269,"t_done_unix":1779820847.6661487},{"request_id":"1262354:10:1283773:180","session_id":"1262354","input_length":34282,"t_proxy_recv":389982.147386397,"t_decision_unix":1779820847.1613274,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9857067849016977,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":490,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":0,"new_prefill":34282,"score_linear":25187.0,"score_lmetric":34282},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":34282,"score_linear":88317.0,"score_lmetric":122599},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8510,"ongoing_decode_tokens":0,"pending_prefill_tokens":8510,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":34282,"score_linear":8510.0,"score_lmetric":42792},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":34282,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":579,"cache_hit":33792,"new_prefill":490,"score_linear":-6153.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":179963,"ongoing_decode_tokens":148998,"pending_prefill_tokens":6389,"num_requests":3,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":34282,"score_linear":179963.0,"score_lmetric":122013},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":34282,"score_linear":183117.0,"score_lmetric":660700},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":483,"cache_hit":28672,"new_prefill":5610,"score_linear":-28672.0,"score_lmetric":0}],"chosen_score_linear":-6153.0,"chosen_score_lmetric":0,"t_first_token":389982.232935079,"t_first_token_unix":1779820847.2468781,"t_done":389982.815970675,"t_done_unix":1779820847.8299146},{"request_id":"1269373:4:1280765:165","session_id":"1269373","input_length":30262,"t_proxy_recv":389975.646667628,"t_decision_unix":1779820840.6606092,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":17408,"affinity_cache_ratio":0.5752428788579736,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":12854,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":4096,"new_prefill":26166,"score_linear":21091.0,"score_lmetric":26166},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":30262,"score_linear":88317.0,"score_lmetric":118579},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":30262,"score_linear":150574.0,"score_lmetric":296136},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":30262,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":88093,"ongoing_decode_tokens":88093,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":30262,"score_linear":88093.0,"score_lmetric":60524},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":142319,"ongoing_decode_tokens":142319,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":408,"cache_hit":17408,"new_prefill":12854,"score_linear":124911.0,"score_lmetric":25708},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":14848,"new_prefill":15414,"score_linear":168269.0,"score_lmetric":585228},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13901,"ongoing_decode_tokens":13901,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":457,"cache_hit":7680,"new_prefill":22582,"score_linear":6221.0,"score_lmetric":22582}],"chosen_score_linear":124911.0,"chosen_score_lmetric":25708,"t_first_token":389977.994341323,"t_first_token_unix":1779820843.0082846,"t_done":389984.185915005,"t_done_unix":1779820849.1998584},{"request_id":"1242838:4:1265709:87","session_id":"1242838","input_length":25187,"t_proxy_recv":389919.68286441,"t_decision_unix":1779820784.6968057,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":22016,"affinity_cache_ratio":0.8741017191408266,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":3171,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":22016,"new_prefill":3171,"score_linear":88032.0,"score_lmetric":113219},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":25187,"score_linear":55989.0,"score_lmetric":25187},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":323,"cache_hit":0,"new_prefill":25187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":25187,"score_linear":71575.0,"score_lmetric":162958},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":258,"cache_hit":0,"new_prefill":25187,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":25187,"score_linear":125063.0,"score_lmetric":285140},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":25187,"score_linear":50783.0,"score_lmetric":75970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":25187,"score_linear":45884.0,"score_lmetric":98110}],"chosen_score_linear":88032.0,"chosen_score_lmetric":113219,"t_first_token":389955.887390934,"t_first_token_unix":1779820820.901334,"t_done":389984.383927857,"t_done_unix":1779820849.397871},{"request_id":"1239034:4:1263738:78","session_id":"1239034","input_length":27639,"t_proxy_recv":389918.521928135,"t_decision_unix":1779820783.5358696,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":22528,"affinity_cache_ratio":0.8150801403813452,"affinity_num_requests":-1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":5111,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110048,"ongoing_decode_tokens":0,"pending_prefill_tokens":110048,"num_requests":1,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":27639,"score_linear":110048.0,"score_lmetric":137687},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":55989,"ongoing_decode_tokens":55989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":261,"cache_hit":0,"new_prefill":27639,"score_linear":55989.0,"score_lmetric":27639},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14329,"ongoing_decode_tokens":301,"pending_prefill_tokens":14028,"num_requests":2,"active_p_offloads":0,"cached_blocks":296,"cache_hit":0,"new_prefill":27639,"score_linear":14329.0,"score_lmetric":83334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71575,"ongoing_decode_tokens":15283,"pending_prefill_tokens":56292,"num_requests":2,"active_p_offloads":0,"cached_blocks":231,"cache_hit":0,"new_prefill":27639,"score_linear":71575.0,"score_lmetric":167862},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":258,"cache_hit":22528,"new_prefill":5111,"score_linear":-22528.0,"score_lmetric":-5111},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125063,"ongoing_decode_tokens":0,"pending_prefill_tokens":117383,"num_requests":2,"active_p_offloads":0,"cached_blocks":36,"cache_hit":0,"new_prefill":27639,"score_linear":125063.0,"score_lmetric":290044},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":50783,"ongoing_decode_tokens":0,"pending_prefill_tokens":50783,"num_requests":1,"active_p_offloads":0,"cached_blocks":207,"cache_hit":0,"new_prefill":27639,"score_linear":50783.0,"score_lmetric":78422},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45884,"ongoing_decode_tokens":0,"pending_prefill_tokens":23868,"num_requests":2,"active_p_offloads":0,"cached_blocks":141,"cache_hit":0,"new_prefill":27639,"score_linear":45884.0,"score_lmetric":103014}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":-5111,"t_first_token":389919.528544639,"t_first_token_unix":1779820784.542488,"t_done":389984.491860043,"t_done_unix":1779820849.5058033},{"request_id":"1258859:4:1282900:176","session_id":"1258859","input_length":118736,"t_proxy_recv":389979.902238505,"t_decision_unix":1779820844.91618,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":118272,"affinity_cache_ratio":0.9960921708664601,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":118272,"estimated_new_tokens":464,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":0,"new_prefill":118736,"score_linear":25187.0,"score_lmetric":118736},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":118736,"score_linear":88317.0,"score_lmetric":207053},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":118736,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16299,"ongoing_decode_tokens":0,"pending_prefill_tokens":16299,"num_requests":1,"active_p_offloads":0,"cached_blocks":593,"cache_hit":0,"new_prefill":118736,"score_linear":16299.0,"score_lmetric":135035},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":54065,"ongoing_decode_tokens":54065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":566,"cache_hit":0,"new_prefill":118736,"score_linear":54065.0,"score_lmetric":118736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54484,"ongoing_decode_tokens":54484,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":417,"cache_hit":118272,"new_prefill":464,"score_linear":-63788.0,"score_lmetric":928},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":118736,"score_linear":183117.0,"score_lmetric":998516},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13901,"ongoing_decode_tokens":13901,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":478,"cache_hit":0,"new_prefill":118736,"score_linear":13901.0,"score_lmetric":118736}],"chosen_score_linear":-63788.0,"chosen_score_lmetric":928,"t_first_token":389980.132778235,"t_first_token_unix":1779820845.146722,"t_done":389987.420548542,"t_done_unix":1779820852.4344964},{"request_id":"1279412:3:1285475:187","session_id":"1279412","input_length":27077,"t_proxy_recv":389988.180018874,"t_decision_unix":1779820853.1939597,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9832699338922333,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":453,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":27077,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":27077,"score_linear":88317.0,"score_lmetric":115394},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":27077,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":27077,"score_linear":49619.0,"score_lmetric":76696},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":590,"cache_hit":26624,"new_prefill":453,"score_linear":7729.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":61559,"ongoing_decode_tokens":61559,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":476,"cache_hit":0,"new_prefill":27077,"score_linear":61559.0,"score_lmetric":54154},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":27077,"score_linear":183117.0,"score_lmetric":631880},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57149,"ongoing_decode_tokens":57149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":483,"cache_hit":12800,"new_prefill":14277,"score_linear":44349.0,"score_lmetric":28554}],"chosen_score_linear":7729.0,"chosen_score_lmetric":0,"t_first_token":389988.251443955,"t_first_token_unix":1779820853.2653875,"t_done":389988.352147069,"t_done_unix":1779820853.3660905},{"request_id":"1268831:5:1284640:184","session_id":"1268831","input_length":42264,"t_proxy_recv":389985.230664693,"t_decision_unix":1779820850.2446058,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":32256,"affinity_cache_ratio":0.7632027257240205,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":10008,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":42264,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":42264,"score_linear":88317.0,"score_lmetric":130581},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":42264,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":42264,"score_linear":49619.0,"score_lmetric":91883},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":590,"cache_hit":0,"new_prefill":42264,"score_linear":0.0,"score_lmetric":-42264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":180295,"ongoing_decode_tokens":180295,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":42264,"score_linear":180295.0,"score_lmetric":126792},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":42264,"score_linear":183117.0,"score_lmetric":692628},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":483,"cache_hit":32256,"new_prefill":10008,"score_linear":-32256.0,"score_lmetric":0}],"chosen_score_linear":-32256.0,"chosen_score_lmetric":0,"t_first_token":389987.887952971,"t_first_token_unix":1779820852.9018974,"t_done":389989.606936399,"t_done_unix":1779820854.6208801},{"request_id":"1285800:1:1285800:191","session_id":"1285800","input_length":4510,"t_proxy_recv":389989.290931612,"t_decision_unix":1779820854.3048732,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4510,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":4510,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":4510,"score_linear":88317.0,"score_lmetric":92827},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14203,"ongoing_decode_tokens":11,"pending_prefill_tokens":6000,"num_requests":2,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":4510,"score_linear":14203.0,"score_lmetric":21020},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":4510,"score_linear":49619.0,"score_lmetric":54129},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":590,"cache_hit":0,"new_prefill":4510,"score_linear":34353.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":61559,"ongoing_decode_tokens":61559,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":476,"cache_hit":0,"new_prefill":4510,"score_linear":61559.0,"score_lmetric":9020},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":4510,"score_linear":183117.0,"score_lmetric":541612},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57149,"ongoing_decode_tokens":57149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":483,"cache_hit":0,"new_prefill":4510,"score_linear":57149.0,"score_lmetric":9020}],"chosen_score_linear":34353.0,"chosen_score_lmetric":0,"t_first_token":389989.58255473,"t_first_token_unix":1779820854.5964987,"t_done":389990.001413174,"t_done_unix":1779820855.0153558},{"request_id":"1283642:2:1285731:190","session_id":"1283642","input_length":14192,"t_proxy_recv":389989.036663487,"t_decision_unix":1779820854.0506046,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8192,"affinity_cache_ratio":0.5772266065388951,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":6000,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":14192,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":14192,"score_linear":88317.0,"score_lmetric":102509},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":11,"ongoing_decode_tokens":11,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":572,"cache_hit":8192,"new_prefill":6000,"score_linear":-8181.0,"score_lmetric":6000},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":14192,"score_linear":49619.0,"score_lmetric":63811},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":590,"cache_hit":0,"new_prefill":14192,"score_linear":34353.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":61559,"ongoing_decode_tokens":61559,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":476,"cache_hit":0,"new_prefill":14192,"score_linear":61559.0,"score_lmetric":28384},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":14192,"score_linear":183117.0,"score_lmetric":580340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57149,"ongoing_decode_tokens":57149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":483,"cache_hit":0,"new_prefill":14192,"score_linear":57149.0,"score_lmetric":28384}],"chosen_score_linear":-8181.0,"chosen_score_lmetric":6000,"t_first_token":389989.730908317,"t_first_token_unix":1779820854.7448542,"t_done":389990.192205388,"t_done_unix":1779820855.2061489},{"request_id":"1269373:5:1282812:174","session_id":"1269373","input_length":30594,"t_proxy_recv":389984.192545881,"t_decision_unix":1779820849.2064877,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":30208,"affinity_cache_ratio":0.9873831470222919,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":30208,"estimated_new_tokens":386,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":4096,"new_prefill":26498,"score_linear":21091.0,"score_lmetric":26498},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":30594,"score_linear":88317.0,"score_lmetric":118911},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":30594,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":30594,"score_linear":49619.0,"score_lmetric":80213},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":30594,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":149701,"ongoing_decode_tokens":149701,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":475,"cache_hit":30208,"new_prefill":386,"score_linear":119493.0,"score_lmetric":772},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":14848,"new_prefill":15746,"score_linear":168269.0,"score_lmetric":586556},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":483,"cache_hit":7680,"new_prefill":22914,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":119493.0,"chosen_score_lmetric":772,"t_first_token":389984.320122882,"t_first_token_unix":1779820849.3340664,"t_done":389990.560065741,"t_done_unix":1779820855.574009},{"request_id":"1285558:1:1285558:188","session_id":"1285558","input_length":11,"t_proxy_recv":389988.381952845,"t_decision_unix":1779820853.3958943,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":11,"score_linear":88317.0,"score_lmetric":88328},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":11,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":11,"score_linear":49619.0,"score_lmetric":49630},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":590,"cache_hit":0,"new_prefill":11,"score_linear":34353.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":61559,"ongoing_decode_tokens":61559,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":476,"cache_hit":0,"new_prefill":11,"score_linear":61559.0,"score_lmetric":22},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":11,"score_linear":183117.0,"score_lmetric":523616},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57149,"ongoing_decode_tokens":57149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":483,"cache_hit":0,"new_prefill":11,"score_linear":57149.0,"score_lmetric":22}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389988.399158452,"t_first_token_unix":1779820853.413102,"t_done":389990.877455156,"t_done_unix":1779820855.8913984},{"request_id":"1272313:5:1284744:185","session_id":"1272313","input_length":14885,"t_proxy_recv":389985.668490929,"t_decision_unix":1779820850.682432,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":13824,"affinity_cache_ratio":0.9287201881088344,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1061,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":4096,"new_prefill":10789,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":14885,"score_linear":88317.0,"score_lmetric":103202},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":14885,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":14885,"score_linear":49619.0,"score_lmetric":64504},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":590,"cache_hit":0,"new_prefill":14885,"score_linear":0.0,"score_lmetric":-14885},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":180295,"ongoing_decode_tokens":180295,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":475,"cache_hit":7680,"new_prefill":7205,"score_linear":172615.0,"score_lmetric":21615},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":7205,"score_linear":175437.0,"score_lmetric":552392},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":42264,"ongoing_decode_tokens":0,"pending_prefill_tokens":10008,"num_requests":1,"active_p_offloads":0,"cached_blocks":483,"cache_hit":13824,"new_prefill":1061,"score_linear":28440.0,"score_lmetric":11069}],"chosen_score_linear":28440.0,"chosen_score_lmetric":11069,"t_first_token":389987.953440621,"t_first_token_unix":1779820852.9673843,"t_done":389991.327691519,"t_done_unix":1779820856.3416348},{"request_id":"1262354:11:1284987:186","session_id":"1262354","input_length":34353,"t_proxy_recv":389986.635484594,"t_decision_unix":1779820851.6494248,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9985736325793962,"affinity_num_requests":-1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":49,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":34353,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":34353,"score_linear":88317.0,"score_lmetric":122670},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":34353,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":34353,"score_linear":49619.0,"score_lmetric":83972},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":590,"cache_hit":34304,"new_prefill":49,"score_linear":-34304.0,"score_lmetric":-49},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":180295,"ongoing_decode_tokens":180295,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":34353,"score_linear":180295.0,"score_lmetric":103059},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":34353,"score_linear":183117.0,"score_lmetric":660984},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57149,"ongoing_decode_tokens":0,"pending_prefill_tokens":11069,"num_requests":2,"active_p_offloads":0,"cached_blocks":483,"cache_hit":28672,"new_prefill":5681,"score_linear":28477.0,"score_lmetric":33500}],"chosen_score_linear":-34304.0,"chosen_score_lmetric":-49,"t_first_token":389986.700811015,"t_first_token_unix":1779820851.7147543,"t_done":389991.758943464,"t_done_unix":1779820856.7728872},{"request_id":"1286551:1:1286551:194","session_id":"1286551","input_length":1700,"t_proxy_recv":389992.252393368,"t_decision_unix":1779820857.2663348,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":1700,"score_linear":88317.0,"score_lmetric":90017},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":583,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":1700,"score_linear":49619.0,"score_lmetric":51319},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31898,"ongoing_decode_tokens":0,"pending_prefill_tokens":5274,"num_requests":0,"active_p_offloads":0,"cached_blocks":599,"cache_hit":0,"new_prefill":1700,"score_linear":31898.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69753,"ongoing_decode_tokens":30965,"pending_prefill_tokens":8068,"num_requests":2,"active_p_offloads":0,"cached_blocks":477,"cache_hit":0,"new_prefill":1700,"score_linear":69753.0,"score_lmetric":19536},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":1700,"score_linear":183117.0,"score_lmetric":530372},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":1700,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389992.368912321,"t_first_token_unix":1779820857.382856,"t_done":389992.559639386,"t_done_unix":1779820857.5735826},{"request_id":"1277909:2:1283679:179","session_id":"1277909","input_length":30965,"t_proxy_recv":389981.821151608,"t_decision_unix":1779820846.835093,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24576,"affinity_cache_ratio":0.7936702728887454,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":6389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":4096,"new_prefill":26869,"score_linear":21091.0,"score_lmetric":26869},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":30965,"score_linear":88317.0,"score_lmetric":119282},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":8510,"ongoing_decode_tokens":0,"pending_prefill_tokens":8510,"num_requests":1,"active_p_offloads":0,"cached_blocks":556,"cache_hit":0,"new_prefill":30965,"score_linear":8510.0,"score_lmetric":39475},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":30965,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":30965,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":148998,"ongoing_decode_tokens":148998,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":450,"cache_hit":24576,"new_prefill":6389,"score_linear":124422.0,"score_lmetric":12778},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":23285,"score_linear":175437.0,"score_lmetric":616712},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":483,"cache_hit":7680,"new_prefill":23285,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":124422.0,"chosen_score_lmetric":12778,"t_first_token":389983.115860109,"t_first_token_unix":1779820848.1298037,"t_done":389993.230776966,"t_done_unix":1779820858.2447221},{"request_id":"1279412:4:1286447:193","session_id":"1279412","input_length":31898,"t_proxy_recv":389991.852329194,"t_decision_unix":1779820856.8662703,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8346604802808953,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":5274,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":31898,"score_linear":88317.0,"score_lmetric":120215},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":583,"cache_hit":0,"new_prefill":31898,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":31898,"score_linear":49619.0,"score_lmetric":81517},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":599,"cache_hit":26624,"new_prefill":5274,"score_linear":-26624.0,"score_lmetric":-5274},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69753,"ongoing_decode_tokens":30965,"pending_prefill_tokens":8068,"num_requests":2,"active_p_offloads":0,"cached_blocks":477,"cache_hit":0,"new_prefill":31898,"score_linear":69753.0,"score_lmetric":79932},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":31898,"score_linear":183117.0,"score_lmetric":651164},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":12800,"new_prefill":19098,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":-5274,"t_first_token":389992.928768791,"t_first_token_unix":1779820857.942713,"t_done":389994.543551156,"t_done_unix":1779820859.5574942},{"request_id":"1286804:1:1286804:195","session_id":"1286804","input_length":13962,"t_proxy_recv":389992.985300533,"t_decision_unix":1779820857.999242,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13962,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":13962,"score_linear":88317.0,"score_lmetric":102279},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":583,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":13962,"score_linear":49619.0,"score_lmetric":13962},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31898,"ongoing_decode_tokens":31898,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":599,"cache_hit":0,"new_prefill":13962,"score_linear":31898.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69753,"ongoing_decode_tokens":69753,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":477,"cache_hit":0,"new_prefill":13962,"score_linear":69753.0,"score_lmetric":27924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":13962,"score_linear":183117.0,"score_lmetric":579420},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":13962,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389994.184303481,"t_first_token_unix":1779820859.1982474,"t_done":389994.88103393,"t_done_unix":1779820859.8949776},{"request_id":"1269373:6:1285668:189","session_id":"1269373","input_length":38788,"t_proxy_recv":389990.571525378,"t_decision_unix":1779820855.5854669,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":30720,"affinity_cache_ratio":0.7919975250077343,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":8068,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":443,"cache_hit":4096,"new_prefill":34692,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":38788,"score_linear":88317.0,"score_lmetric":127105},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":11,"ongoing_decode_tokens":11,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":583,"cache_hit":0,"new_prefill":38788,"score_linear":11.0,"score_lmetric":38788},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":0,"pending_prefill_tokens":49619,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":38788,"score_linear":49619.0,"score_lmetric":88407},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34353,"ongoing_decode_tokens":34353,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":598,"cache_hit":0,"new_prefill":38788,"score_linear":34353.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":30965,"ongoing_decode_tokens":30965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":477,"cache_hit":30720,"new_prefill":8068,"score_linear":245.0,"score_lmetric":8068},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":14848,"new_prefill":23940,"score_linear":168269.0,"score_lmetric":619332},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":14885,"ongoing_decode_tokens":14885,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":502,"cache_hit":7680,"new_prefill":31108,"score_linear":7205.0,"score_lmetric":31108}],"chosen_score_linear":245.0,"chosen_score_lmetric":8068,"t_first_token":389992.472744834,"t_first_token_unix":1779820857.4866889,"t_done":389995.803313145,"t_done_unix":1779820860.8172565},{"request_id":"1279994:1:1279994:161","session_id":"1279994","input_length":88317,"t_proxy_recv":389969.568967445,"t_decision_unix":1779820834.5829082,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":88317,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":88317,"score_linear":25187.0,"score_lmetric":88317},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":88317,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":88317,"score_linear":150574.0,"score_lmetric":412246},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":88317,"score_linear":15283.0,"score_lmetric":88317},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":47775,"ongoing_decode_tokens":47775,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":88317,"score_linear":47775.0,"score_lmetric":88317},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":88317,"score_linear":159219.0,"score_lmetric":264951},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":88317,"score_linear":170352.0,"score_lmetric":656199},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":88317,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389995.595697961,"t_first_token_unix":1779820860.6096416,"t_done":389996.450913097,"t_done_unix":1779820861.4648569},{"request_id":"1287588:1:1287588:198","session_id":"1287588","input_length":9925,"t_proxy_recv":389995.536801284,"t_decision_unix":1779820860.550742,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-9925,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9925,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":9925,"score_linear":88317.0,"score_lmetric":98242},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":9925,"score_linear":49619.0,"score_lmetric":9925},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":9925,"score_linear":0.0,"score_lmetric":-9925},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38788,"ongoing_decode_tokens":38788,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":9925,"score_linear":38788.0,"score_lmetric":9925},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":114612,"pending_prefill_tokens":16281,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":9925,"score_linear":183117.0,"score_lmetric":104824},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":9925,"score_linear":77805.0,"score_lmetric":87730}],"chosen_score_linear":0.0,"chosen_score_lmetric":-9925,"t_first_token":389996.343640416,"t_first_token_unix":1779820861.3575838,"t_done":389997.644105322,"t_done_unix":1779820862.658049},{"request_id":"1279994:2:1283011:177","session_id":"1279994","input_length":88940,"t_proxy_recv":389996.467697102,"t_decision_unix":1779820861.4816387,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88064,"affinity_cache_ratio":0.990150663368563,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":876,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":633,"cache_hit":88064,"new_prefill":876,"score_linear":-88064.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":88940,"score_linear":49619.0,"score_lmetric":88940},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9925,"ongoing_decode_tokens":9925,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":88940,"score_linear":9925.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":506,"cache_hit":0,"new_prefill":88940,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":114612,"pending_prefill_tokens":16281,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":88940,"score_linear":183117.0,"score_lmetric":420884},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":88940,"score_linear":93352.0,"score_lmetric":333864}],"chosen_score_linear":-88064.0,"chosen_score_lmetric":0,"t_first_token":389996.926040086,"t_first_token_unix":1779820861.9399836,"t_done":389997.720075016,"t_done_unix":1779820862.7340188},{"request_id":"1288143:1:1288143:200","session_id":"1288143","input_length":448,"t_proxy_recv":389997.50114115,"t_decision_unix":1779820862.5150826,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":448,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88940,"ongoing_decode_tokens":88940,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":633,"cache_hit":0,"new_prefill":448,"score_linear":88940.0,"score_lmetric":448},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":448,"score_linear":49619.0,"score_lmetric":448},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9925,"ongoing_decode_tokens":9925,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":448,"score_linear":9925.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":506,"cache_hit":0,"new_prefill":448,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":114612,"pending_prefill_tokens":16281,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":448,"score_linear":183117.0,"score_lmetric":66916},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":448,"score_linear":93352.0,"score_lmetric":156880}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389997.54922643,"t_first_token_unix":1779820862.5631707,"t_done":389998.063838207,"t_done_unix":1779820863.0777812},{"request_id":"1284132:1:1284132:182","session_id":"1284132","input_length":49619,"t_proxy_recv":389983.506675992,"t_decision_unix":1779820848.5206172,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":49619,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":433,"cache_hit":0,"new_prefill":49619,"score_linear":25187.0,"score_lmetric":49619},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":49619,"score_linear":88317.0,"score_lmetric":137936},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":572,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":27639,"ongoing_decode_tokens":27639,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":580,"cache_hit":0,"new_prefill":49619,"score_linear":27639.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":179963,"ongoing_decode_tokens":179963,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":450,"cache_hit":0,"new_prefill":49619,"score_linear":179963.0,"score_lmetric":148857},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":49619,"score_linear":183117.0,"score_lmetric":722048},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":483,"cache_hit":0,"new_prefill":49619,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389992.745560656,"t_first_token_unix":1779820857.7595043,"t_done":389999.378725781,"t_done_unix":1779820864.3926697},{"request_id":"1274405:2:1276717:144","session_id":"1274405","input_length":6360,"t_proxy_recv":389958.049706434,"t_decision_unix":1779820823.0636477,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":6144,"affinity_cache_ratio":0.9660377358490566,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":0,"new_prefill":6360,"score_linear":25187.0,"score_lmetric":6360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":6360,"score_linear":102074.0,"score_lmetric":104850},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":6360,"score_linear":150574.0,"score_lmetric":248332},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":6360,"score_linear":108713.0,"score_lmetric":199580},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44919,"ongoing_decode_tokens":44919,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":6360,"score_linear":44919.0,"score_lmetric":6360},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":6360,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163992,"ongoing_decode_tokens":0,"pending_prefill_tokens":130200,"num_requests":2,"active_p_offloads":0,"cached_blocks":455,"cache_hit":6144,"new_prefill":216,"score_linear":157848.0,"score_lmetric":260832},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":8704,"ongoing_decode_tokens":8704,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":380,"cache_hit":0,"new_prefill":6360,"score_linear":8704.0,"score_lmetric":6360}],"chosen_score_linear":157848.0,"chosen_score_lmetric":260832,"t_first_token":389999.431731122,"t_first_token_unix":1779820864.4456742,"t_done":389999.993175821,"t_done_unix":1779820865.007119},{"request_id":"1279994:3:1286181:192","session_id":"1279994","input_length":89226,"t_proxy_recv":389997.739504641,"t_decision_unix":1779820862.753446,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88576,"affinity_cache_ratio":0.9927151278775245,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88576,"estimated_new_tokens":650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":634,"cache_hit":88576,"new_prefill":650,"score_linear":-88576.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":89226,"score_linear":49619.0,"score_lmetric":89226},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":628,"cache_hit":0,"new_prefill":89226,"score_linear":0.0,"score_lmetric":-89226},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":448,"ongoing_decode_tokens":448,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":506,"cache_hit":0,"new_prefill":89226,"score_linear":448.0,"score_lmetric":89226},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":114612,"pending_prefill_tokens":16281,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":89226,"score_linear":183117.0,"score_lmetric":422028},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":89226,"score_linear":93352.0,"score_lmetric":334436}],"chosen_score_linear":-88576.0,"chosen_score_lmetric":0,"t_first_token":389998.017546296,"t_first_token_unix":1779820863.0314903,"t_done":390002.693186322,"t_done_unix":1779820867.7071347},{"request_id":"1286551:2:1289450:202","session_id":"1286551","input_length":9610,"t_proxy_recv":390001.845688673,"t_decision_unix":1779820866.85963,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":1536,"affinity_cache_ratio":0.1598335067637877,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":8074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":1536,"new_prefill":8074,"score_linear":-1536.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89226,"ongoing_decode_tokens":89226,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":634,"cache_hit":0,"new_prefill":9610,"score_linear":89226.0,"score_lmetric":9610},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":628,"cache_hit":0,"new_prefill":9610,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":9610,"score_linear":44920.0,"score_lmetric":23298},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":9610,"score_linear":176757.0,"score_lmetric":28830},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":9610,"score_linear":93352.0,"score_lmetric":175204}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390002.468657967,"t_first_token_unix":1779820867.4826012,"t_done":390002.830730788,"t_done_unix":1779820867.8446739},{"request_id":"1287588:2:1289701:205","session_id":"1287588","input_length":10195,"t_proxy_recv":390002.762337825,"t_decision_unix":1779820867.7762792,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":9728,"affinity_cache_ratio":0.954193231976459,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":9610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":10195,"score_linear":9610.0,"score_lmetric":10195},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":10195,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":10195,"score_linear":82014.0,"score_lmetric":92209},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":10195,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32191,"ongoing_decode_tokens":32191,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":628,"cache_hit":9728,"new_prefill":467,"score_linear":22463.0,"score_lmetric":467},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":10195,"score_linear":44920.0,"score_lmetric":23883},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":10195,"score_linear":176757.0,"score_lmetric":30585},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":10195,"score_linear":93352.0,"score_lmetric":176374}],"chosen_score_linear":22463.0,"chosen_score_lmetric":467,"t_first_token":390002.808634181,"t_first_token_unix":1779820867.8225777,"t_done":390002.899462009,"t_done_unix":1779820867.9134052},{"request_id":"1279412:4:1289482:203","session_id":"1279412","input_length":32191,"t_proxy_recv":390001.925189958,"t_decision_unix":1779820866.9391315,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9861141312789289,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":447,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":8074,"num_requests":1,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":32191,"score_linear":9610.0,"score_lmetric":40265},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89226,"ongoing_decode_tokens":89226,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":634,"cache_hit":0,"new_prefill":32191,"score_linear":89226.0,"score_lmetric":32191},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":32191,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":32191,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":628,"cache_hit":31744,"new_prefill":447,"score_linear":-31744.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":32191,"score_linear":44920.0,"score_lmetric":45879},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":32191,"score_linear":176757.0,"score_lmetric":96573},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":12800,"new_prefill":19391,"score_linear":80552.0,"score_lmetric":194766}],"chosen_score_linear":-31744.0,"chosen_score_lmetric":0,"t_first_token":390002.003032853,"t_first_token_unix":1779820867.016976,"t_done":390003.054946778,"t_done_unix":1779820868.0688899},{"request_id":"1290442:1:1290442:210","session_id":"1290442","input_length":7261,"t_proxy_recv":390005.115842539,"t_decision_unix":1779820870.129784,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13552,"ongoing_decode_tokens":0,"pending_prefill_tokens":12016,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":7261,"score_linear":13552.0,"score_lmetric":19277},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":7261,"score_linear":23228.0,"score_lmetric":30489},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":7261,"score_linear":82014.0,"score_lmetric":89275},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":7261,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":7261,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":44920,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":7261,"score_linear":87665.0,"score_lmetric":22188},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":7261,"score_linear":176757.0,"score_lmetric":21783},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":7261,"score_linear":93352.0,"score_lmetric":170506}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390005.611748644,"t_first_token_unix":1779820870.6256921,"t_done":390005.754077592,"t_done_unix":1779820870.7680206},{"request_id":"1268861:2:1280530:164","session_id":"1268861","input_length":12765,"t_proxy_recv":389971.217538299,"t_decision_unix":1779820836.23148,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":12288,"affinity_cache_ratio":0.9626321974148061,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":424,"cache_hit":0,"new_prefill":12765,"score_linear":25187.0,"score_lmetric":12765},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":12765,"score_linear":88317.0,"score_lmetric":101082},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":12765,"score_linear":150574.0,"score_lmetric":261142},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":540,"cache_hit":0,"new_prefill":12765,"score_linear":15283.0,"score_lmetric":12765},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":106222,"ongoing_decode_tokens":47775,"pending_prefill_tokens":7759,"num_requests":3,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":12765,"score_linear":106222.0,"score_lmetric":61572},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":159219,"ongoing_decode_tokens":159219,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":374,"cache_hit":0,"new_prefill":12765,"score_linear":159219.0,"score_lmetric":38295},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":170352,"ongoing_decode_tokens":0,"pending_prefill_tokens":130416,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":12288,"new_prefill":477,"score_linear":158064.0,"score_lmetric":392679},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":457,"cache_hit":0,"new_prefill":12765,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":158064.0,"chosen_score_lmetric":392679,"t_first_token":389999.430177244,"t_first_token_unix":1779820864.4441206,"t_done":390006.055994115,"t_done_unix":1779820871.0699372},{"request_id":"1290426:1:1290426:209","session_id":"1290426","input_length":13552,"t_proxy_recv":390005.091419233,"t_decision_unix":1779820870.1053607,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":12016,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":461,"cache_hit":1536,"new_prefill":12016,"score_linear":-1536.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":13552,"score_linear":23228.0,"score_lmetric":36780},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":13552,"score_linear":82014.0,"score_lmetric":95566},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":13552,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":13552,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":44920,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":13552,"score_linear":87665.0,"score_lmetric":34770},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":13552,"score_linear":176757.0,"score_lmetric":40656},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":13552,"score_linear":93352.0,"score_lmetric":183088}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390006.178526418,"t_first_token_unix":1779820871.1924696,"t_done":390006.549479233,"t_done_unix":1779820871.5634222},{"request_id":"1266668:4:1276519:143","session_id":"1266668","input_length":49380,"t_proxy_recv":389957.326662695,"t_decision_unix":1779820822.3406036,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":33792,"affinity_cache_ratio":0.684325637910085,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":15588,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25187,"ongoing_decode_tokens":25187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":371,"cache_hit":4096,"new_prefill":45284,"score_linear":21091.0,"score_lmetric":45284},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":49380,"score_linear":102074.0,"score_lmetric":147870},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":49380,"score_linear":150574.0,"score_lmetric":334372},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":49380,"score_linear":108713.0,"score_lmetric":285620},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":44919,"ongoing_decode_tokens":27639,"pending_prefill_tokens":17280,"num_requests":1,"active_p_offloads":0,"cached_blocks":475,"cache_hit":0,"new_prefill":49380,"score_linear":44919.0,"score_lmetric":66660},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":15783,"ongoing_decode_tokens":0,"pending_prefill_tokens":15783,"num_requests":1,"active_p_offloads":0,"cached_blocks":344,"cache_hit":0,"new_prefill":49380,"score_linear":15783.0,"score_lmetric":65163},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":0,"pending_prefill_tokens":114612,"num_requests":1,"active_p_offloads":0,"cached_blocks":455,"cache_hit":33792,"new_prefill":15588,"score_linear":80820.0,"score_lmetric":130200},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":8704,"ongoing_decode_tokens":0,"pending_prefill_tokens":8704,"num_requests":1,"active_p_offloads":0,"cached_blocks":380,"cache_hit":7680,"new_prefill":41700,"score_linear":1024.0,"score_lmetric":50404}],"chosen_score_linear":80820.0,"chosen_score_lmetric":130200,"t_first_token":389999.425844679,"t_first_token_unix":1779820864.439793,"t_done":390007.822460088,"t_done_unix":1779820872.8364031},{"request_id":"1291100:1:1291100:212","session_id":"1291100","input_length":1744,"t_proxy_recv":390007.330653297,"t_decision_unix":1779820872.3445947,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1744,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":470,"cache_hit":0,"new_prefill":1744,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112977,"ongoing_decode_tokens":0,"pending_prefill_tokens":23377,"num_requests":2,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":1744,"score_linear":112977.0,"score_lmetric":50242},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":1744,"score_linear":82014.0,"score_lmetric":83758},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":1744,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":1744,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":1744,"score_linear":87665.0,"score_lmetric":3488},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":163992,"ongoing_decode_tokens":163992,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":456,"cache_hit":0,"new_prefill":1744,"score_linear":163992.0,"score_lmetric":3488},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":1744,"score_linear":93352.0,"score_lmetric":159472}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390007.49085779,"t_first_token_unix":1779820872.504801,"t_done":390007.879554106,"t_done_unix":1779820872.893497},{"request_id":"1290365:1:1290365:208","session_id":"1290365","input_length":23228,"t_proxy_recv":390004.915047047,"t_decision_unix":1779820869.9289868,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":23228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":23228,"score_linear":82014.0,"score_lmetric":105242},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":23228,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":44920,"pending_prefill_tokens":3833,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":23228,"score_linear":87665.0,"score_lmetric":54122},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":23228,"score_linear":176757.0,"score_lmetric":69684},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":23228,"score_linear":93352.0,"score_lmetric":202440}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390007.493689771,"t_first_token_unix":1779820872.5076332,"t_done":390008.895905526,"t_done_unix":1779820873.9098501},{"request_id":"1262354:12:1291548:213","session_id":"1262354","input_length":35099,"t_proxy_recv":390008.974598454,"t_decision_unix":1779820873.9885397,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9919370922248497,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":470,"cache_hit":0,"new_prefill":35099,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89749,"ongoing_decode_tokens":89749,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":677,"cache_hit":0,"new_prefill":35099,"score_linear":89749.0,"score_lmetric":35099},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":35099,"score_linear":82014.0,"score_lmetric":117113},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":35099,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":34816,"new_prefill":283,"score_linear":-34816.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":35099,"score_linear":87665.0,"score_lmetric":70198},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":35099,"score_linear":172644.0,"score_lmetric":86934},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":28672,"new_prefill":6427,"score_linear":64680.0,"score_lmetric":168838}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":390009.068797724,"t_first_token_unix":1779820874.0827415,"t_done":390009.711727531,"t_done_unix":1779820874.725671},{"request_id":"1279994:4:1290711:211","session_id":"1279994","input_length":89749,"t_proxy_recv":390005.991991979,"t_decision_unix":1779820871.005933,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9983398143711908,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":149,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13552,"ongoing_decode_tokens":0,"pending_prefill_tokens":12016,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":89749,"score_linear":13552.0,"score_lmetric":101765},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23228,"ongoing_decode_tokens":0,"pending_prefill_tokens":23228,"num_requests":1,"active_p_offloads":0,"cached_blocks":636,"cache_hit":89600,"new_prefill":149,"score_linear":-66372.0,"score_lmetric":23377},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":89749,"score_linear":82014.0,"score_lmetric":171763},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":89749,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":89749,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":89749,"score_linear":87665.0,"score_lmetric":179498},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":89749,"score_linear":176757.0,"score_lmetric":269247},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":89749,"score_linear":93352.0,"score_lmetric":335482}],"chosen_score_linear":-66372.0,"chosen_score_lmetric":23377,"t_first_token":390007.604130025,"t_first_token_unix":1779820872.618073,"t_done":390009.784830339,"t_done_unix":1779820874.798774},{"request_id":"1279412:5:1291651:214","session_id":"1279412","input_length":32359,"t_proxy_recv":390009.255671784,"t_decision_unix":1779820874.269613,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":32256,"affinity_cache_ratio":0.9968169597329954,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":470,"cache_hit":0,"new_prefill":32359,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89749,"ongoing_decode_tokens":89749,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":677,"cache_hit":0,"new_prefill":32359,"score_linear":89749.0,"score_lmetric":32359},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":32359,"score_linear":82014.0,"score_lmetric":114373},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":32359,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35099,"ongoing_decode_tokens":35099,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":629,"cache_hit":32256,"new_prefill":103,"score_linear":2843.0,"score_lmetric":103},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":32359,"score_linear":87665.0,"score_lmetric":64718},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":32359,"score_linear":172644.0,"score_lmetric":81454},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":12800,"new_prefill":19559,"score_linear":80552.0,"score_lmetric":195102}],"chosen_score_linear":2843.0,"chosen_score_lmetric":103,"t_first_token":390009.317193207,"t_first_token_unix":1779820874.331137,"t_done":390010.00132378,"t_done_unix":1779820875.015267},{"request_id":"1290365:2:1292000:217","session_id":"1290365","input_length":23414,"t_proxy_recv":390010.507388272,"t_decision_unix":1779820875.5213294,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9840266507217904,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":374,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":8144,"ongoing_decode_tokens":0,"pending_prefill_tokens":8144,"num_requests":1,"active_p_offloads":0,"cached_blocks":470,"cache_hit":0,"new_prefill":23414,"score_linear":8144.0,"score_lmetric":31558},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":677,"cache_hit":23040,"new_prefill":374,"score_linear":-23040.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":23414,"score_linear":82014.0,"score_lmetric":105428},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":23414,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":23414,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":23414,"score_linear":87665.0,"score_lmetric":46828},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":23414,"score_linear":172644.0,"score_lmetric":63564},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":0,"pending_prefill_tokens":78161,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":23414,"score_linear":135505.0,"score_lmetric":304725}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":390010.578447514,"t_first_token_unix":1779820875.5923905,"t_done":390010.89246841,"t_done_unix":1779820875.906412},{"request_id":"1291944:1:1291944:216","session_id":"1291944","input_length":8144,"t_proxy_recv":390010.310817194,"t_decision_unix":1779820875.3247583,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":470,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":677,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":8144,"score_linear":82014.0,"score_lmetric":90158},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":8144,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":8144,"score_linear":87665.0,"score_lmetric":16288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":8144,"score_linear":172644.0,"score_lmetric":33024},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":0,"pending_prefill_tokens":78161,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":8144,"score_linear":135505.0,"score_lmetric":258915}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390010.879835014,"t_first_token_unix":1779820875.8937795,"t_done":390011.021898107,"t_done_unix":1779820876.0358415},{"request_id":"1269373:7:1290314:207","session_id":"1269373","input_length":42745,"t_proxy_recv":390004.74597763,"t_decision_unix":1779820869.7599192,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":38912,"affinity_cache_ratio":0.9103286934144345,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38912,"estimated_new_tokens":3833,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":461,"cache_hit":4096,"new_prefill":38649,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":42745,"score_linear":82014.0,"score_lmetric":124759},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":42745,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":38912,"new_prefill":3833,"score_linear":6008.0,"score_lmetric":3833},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":14848,"new_prefill":27897,"score_linear":161909.0,"score_lmetric":83691},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":7680,"new_prefill":35065,"score_linear":85672.0,"score_lmetric":226114}],"chosen_score_linear":6008.0,"chosen_score_lmetric":3833,"t_first_token":390005.854723994,"t_first_token_unix":1779820870.8686674,"t_done":390011.46198388,"t_done_unix":1779820876.475927},{"request_id":"1286551:3:1292589:219","session_id":"1286551","input_length":16914,"t_proxy_recv":390012.17809899,"t_decision_unix":1779820877.1920404,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.54487406881873,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":7698,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":485,"cache_hit":9216,"new_prefill":7698,"score_linear":-9216.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":677,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":16914,"score_linear":82014.0,"score_lmetric":98928},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":16914,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":16914,"score_linear":44920.0,"score_lmetric":16914},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":16914,"score_linear":172644.0,"score_lmetric":33828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":0,"pending_prefill_tokens":78161,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":16914,"score_linear":135505.0,"score_lmetric":285225}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":390013.07207599,"t_first_token_unix":1779820878.0860195,"t_done":390013.252525725,"t_done_unix":1779820878.2664685},{"request_id":"1292750:1:1292750:220","session_id":"1292750","input_length":4684,"t_proxy_recv":390012.814482783,"t_decision_unix":1779820877.8284245,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":16914,"ongoing_decode_tokens":0,"pending_prefill_tokens":7698,"num_requests":1,"active_p_offloads":0,"cached_blocks":485,"cache_hit":0,"new_prefill":4684,"score_linear":16914.0,"score_lmetric":12382},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":677,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":4684,"score_linear":82014.0,"score_lmetric":86698},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":4684,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":4684,"score_linear":44920.0,"score_lmetric":4684},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":4684,"score_linear":172644.0,"score_lmetric":9368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":0,"pending_prefill_tokens":78161,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":4684,"score_linear":135505.0,"score_lmetric":248535}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390013.117211518,"t_first_token_unix":1779820878.1311548,"t_done":390013.553034447,"t_done_unix":1779820878.5669792},{"request_id":"1262354:13:1293000:221","session_id":"1262354","input_length":35210,"t_proxy_recv":390013.659153628,"t_decision_unix":1779820878.6730952,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9888099971598977,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":394,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":35210,"score_linear":82014.0,"score_lmetric":117224},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":35210,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":34816,"new_prefill":394,"score_linear":-34816.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":35210,"score_linear":44920.0,"score_lmetric":35210},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":35210,"score_linear":172644.0,"score_lmetric":70420},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":0,"pending_prefill_tokens":78161,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":28672,"new_prefill":6538,"score_linear":106833.0,"score_lmetric":254097}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":390013.729122314,"t_first_token_unix":1779820878.7430656,"t_done":390014.328169214,"t_done_unix":1779820879.3421123},{"request_id":"1291100:2:1293458:223","session_id":"1291100","input_length":2572,"t_proxy_recv":390015.302172392,"t_decision_unix":1779820880.3161137,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.5972006220839814,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":1036,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":2572,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":2572,"score_linear":24482.0,"score_lmetric":2572},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":2572,"score_linear":82014.0,"score_lmetric":84586},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":1536,"new_prefill":1036,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":2572,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":2572,"score_linear":44920.0,"score_lmetric":2572},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":2572,"score_linear":172644.0,"score_lmetric":5144},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":135505,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":2572,"score_linear":135505.0,"score_lmetric":7716}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390015.380991802,"t_first_token_unix":1779820880.3949354,"t_done":390015.529574608,"t_done_unix":1779820880.5435183},{"request_id":"1287100:1:1287100:196","session_id":"1287100","input_length":77805,"t_proxy_recv":389993.956855903,"t_decision_unix":1779820858.9707968,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":77805,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":0,"pending_prefill_tokens":88317,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":77805,"score_linear":88317.0,"score_lmetric":166122},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13962,"ongoing_decode_tokens":0,"pending_prefill_tokens":13962,"num_requests":1,"active_p_offloads":0,"cached_blocks":583,"cache_hit":0,"new_prefill":77805,"score_linear":13962.0,"score_lmetric":91767},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":77805,"score_linear":49619.0,"score_lmetric":77805},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":31898,"ongoing_decode_tokens":31898,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":599,"cache_hit":0,"new_prefill":77805,"score_linear":31898.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38788,"ongoing_decode_tokens":38788,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":490,"cache_hit":0,"new_prefill":77805,"score_linear":38788.0,"score_lmetric":77805},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":0,"pending_prefill_tokens":130893,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":77805,"score_linear":183117.0,"score_lmetric":834792},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":77805,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390014.590917709,"t_first_token_unix":1779820879.6048644,"t_done":390015.729060289,"t_done_unix":1779820880.7430038},{"request_id":"1260327:6:1291827:215","session_id":"1260327","input_length":42153,"t_proxy_recv":390009.941799123,"t_decision_unix":1779820874.9557405,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9959907954356748,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":169,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":470,"cache_hit":0,"new_prefill":42153,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":677,"cache_hit":0,"new_prefill":42153,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":42153,"score_linear":82014.0,"score_lmetric":124167},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":42153,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32359,"ongoing_decode_tokens":32359,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":42153,"score_linear":32359.0,"score_lmetric":42153},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":42153,"score_linear":87665.0,"score_lmetric":84306},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8368,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":42153,"score_linear":172644.0,"score_lmetric":101042},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":41984,"new_prefill":169,"score_linear":51368.0,"score_lmetric":156322}],"chosen_score_linear":51368.0,"chosen_score_lmetric":156322,"t_first_token":390014.640648483,"t_first_token_unix":1779820879.6545918,"t_done":390015.769829923,"t_done_unix":1779820880.7837732},{"request_id":"1293507:1:1293507:224","session_id":"1293507","input_length":6460,"t_proxy_recv":390015.490154324,"t_decision_unix":1779820880.5040953,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":6460,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":6460,"score_linear":24482.0,"score_lmetric":6460},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":6460,"score_linear":82014.0,"score_lmetric":88474},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":2572,"ongoing_decode_tokens":2572,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":6460,"score_linear":2572.0,"score_lmetric":6460},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":6460,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":6460,"score_linear":44920.0,"score_lmetric":6460},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":6460,"score_linear":172644.0,"score_lmetric":12920},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":135505,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":6460,"score_linear":135505.0,"score_lmetric":19380}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390015.916180868,"t_first_token_unix":1779820880.9301243,"t_done":390016.034583654,"t_done_unix":1779820881.048528},{"request_id":"1266668:5:1281133:168","session_id":"1266668","input_length":58032,"t_proxy_recv":390007.836695941,"t_decision_unix":1779820872.8506377,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49664,"affinity_cache_ratio":0.8558036945133719,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":8368,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":470,"cache_hit":4096,"new_prefill":53936,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112977,"ongoing_decode_tokens":112977,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":636,"cache_hit":0,"new_prefill":58032,"score_linear":112977.0,"score_lmetric":116064},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":58032,"score_linear":82014.0,"score_lmetric":140046},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":1744,"ongoing_decode_tokens":1744,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":736,"cache_hit":0,"new_prefill":58032,"score_linear":1744.0,"score_lmetric":58032},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":58032,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87665,"ongoing_decode_tokens":87665,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":507,"cache_hit":7680,"new_prefill":50352,"score_linear":79985.0,"score_lmetric":100704},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":487,"cache_hit":49664,"new_prefill":8368,"score_linear":64948.0,"score_lmetric":8368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":7680,"new_prefill":50352,"score_linear":85672.0,"score_lmetric":256688}],"chosen_score_linear":64948.0,"chosen_score_lmetric":8368,"t_first_token":390010.765994779,"t_first_token_unix":1779820875.7799382,"t_done":390016.507183702,"t_done_unix":1779820881.521127},{"request_id":"1290365:3:1293216:222","session_id":"1290365","input_length":24482,"t_proxy_recv":390014.441951272,"t_decision_unix":1779820879.455893,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":23040,"affinity_cache_ratio":0.941099583367372,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1442,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":493,"cache_hit":0,"new_prefill":24482,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":23040,"new_prefill":1442,"score_linear":-23040.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":24482,"score_linear":82014.0,"score_lmetric":106496},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":739,"cache_hit":0,"new_prefill":24482,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":24482,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":24482,"score_linear":44920.0,"score_lmetric":24482},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":24482,"score_linear":172644.0,"score_lmetric":48964},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":135505,"ongoing_decode_tokens":0,"pending_prefill_tokens":78161,"num_requests":3,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":24482,"score_linear":135505.0,"score_lmetric":307929}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":390014.706185877,"t_first_token_unix":1779820879.7201295,"t_done":390016.741714191,"t_done_unix":1779820881.7556572},{"request_id":"1272313:6:1287745:199","session_id":"1272313","input_length":15547,"t_proxy_recv":389996.084161093,"t_decision_unix":1779820861.0981026,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":15360,"affinity_cache_ratio":0.9879719560043738,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":4096,"new_prefill":11451,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":88317,"ongoing_decode_tokens":88317,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":461,"cache_hit":0,"new_prefill":15547,"score_linear":88317.0,"score_lmetric":15547},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":15547,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49619,"ongoing_decode_tokens":49619,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":624,"cache_hit":0,"new_prefill":15547,"score_linear":49619.0,"score_lmetric":15547},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9925,"ongoing_decode_tokens":0,"pending_prefill_tokens":9925,"num_requests":0,"active_p_offloads":0,"cached_blocks":609,"cache_hit":0,"new_prefill":15547,"score_linear":9925.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":506,"cache_hit":7680,"new_prefill":7867,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":183117,"ongoing_decode_tokens":114612,"pending_prefill_tokens":16281,"num_requests":4,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":7867,"score_linear":175437.0,"score_lmetric":96592},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77805,"ongoing_decode_tokens":0,"pending_prefill_tokens":77805,"num_requests":1,"active_p_offloads":0,"cached_blocks":505,"cache_hit":15360,"new_prefill":187,"score_linear":62445.0,"score_lmetric":77992}],"chosen_score_linear":62445.0,"chosen_score_lmetric":77992,"t_first_token":390014.59163629,"t_first_token_unix":1779820879.6055815,"t_done":390016.938830133,"t_done_unix":1779820881.9527733},{"request_id":"1291944:2:1293798:227","session_id":"1291944","input_length":12388,"t_proxy_recv":390016.573201041,"t_decision_unix":1779820881.5871425,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":7680,"affinity_cache_ratio":0.6199547949628673,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":4708,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":7680,"new_prefill":4708,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":12388,"score_linear":24482.0,"score_lmetric":12388},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":12388,"score_linear":82014.0,"score_lmetric":94402},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":12388,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40278,"ongoing_decode_tokens":0,"pending_prefill_tokens":8022,"num_requests":1,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":12388,"score_linear":40278.0,"score_lmetric":20410},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":12388,"score_linear":44920.0,"score_lmetric":12388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":12388,"score_linear":194667.0,"score_lmetric":68150},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15547,"ongoing_decode_tokens":15547,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":657,"cache_hit":0,"new_prefill":12388,"score_linear":15547.0,"score_lmetric":12388}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":390017.039544736,"t_first_token_unix":1779820882.0534878,"t_done":390017.376974003,"t_done_unix":1779820882.390917},{"request_id":"1272313:7:1290281:206","session_id":"1272313","input_length":15969,"t_proxy_recv":390016.943375274,"t_decision_unix":1779820881.9573169,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":15360,"affinity_cache_ratio":0.96186361074582,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12388,"ongoing_decode_tokens":0,"pending_prefill_tokens":4708,"num_requests":1,"active_p_offloads":0,"cached_blocks":505,"cache_hit":4096,"new_prefill":11873,"score_linear":8292.0,"score_lmetric":16581},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":15969,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":15969,"score_linear":82014.0,"score_lmetric":97983},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":15969,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40278,"ongoing_decode_tokens":0,"pending_prefill_tokens":8022,"num_requests":1,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":15969,"score_linear":40278.0,"score_lmetric":23991},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":7680,"new_prefill":8289,"score_linear":37240.0,"score_lmetric":8289},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":7680,"new_prefill":8289,"score_linear":186987.0,"score_lmetric":59952},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":657,"cache_hit":15360,"new_prefill":609,"score_linear":-15360.0,"score_lmetric":0}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":390017.017121732,"t_first_token_unix":1779820882.031065,"t_done":390018.98469451,"t_done_unix":1779820883.998638},{"request_id":"1262354:14:1294243:228","session_id":"1262354","input_length":35435,"t_proxy_recv":390017.741344816,"t_decision_unix":1779820882.755286,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9825313955129109,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":619,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":514,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":35435,"score_linear":82014.0,"score_lmetric":117449},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":35435,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40278,"ongoing_decode_tokens":0,"pending_prefill_tokens":8022,"num_requests":1,"active_p_offloads":0,"cached_blocks":629,"cache_hit":34816,"new_prefill":619,"score_linear":5462.0,"score_lmetric":8641},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":35435,"score_linear":44920.0,"score_lmetric":35435},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":35435,"score_linear":194667.0,"score_lmetric":114244},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15969,"ongoing_decode_tokens":15969,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":657,"cache_hit":28672,"new_prefill":6763,"score_linear":-12703.0,"score_lmetric":6763}],"chosen_score_linear":5462.0,"chosen_score_lmetric":8641,"t_first_token":390018.188418927,"t_first_token_unix":1779820883.2023625,"t_done":390020.075180954,"t_done_unix":1779820885.0891244},{"request_id":"1294611:1:1294611:229","session_id":"1294611","input_length":21947,"t_proxy_recv":390019.049820003,"t_decision_unix":1779820884.0637615,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21947,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":514,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":21947,"score_linear":82014.0,"score_lmetric":103961},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":21947,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75713,"ongoing_decode_tokens":75713,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":21947,"score_linear":75713.0,"score_lmetric":43894},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":12800,"new_prefill":9147,"score_linear":32120.0,"score_lmetric":9147},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":21947,"score_linear":194667.0,"score_lmetric":87268},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28796,"ongoing_decode_tokens":0,"pending_prefill_tokens":12924,"num_requests":1,"active_p_offloads":0,"cached_blocks":658,"cache_hit":12800,"new_prefill":9147,"score_linear":15996.0,"score_lmetric":22071}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390021.407987668,"t_first_token_unix":1779820886.4219313,"t_done":390022.065460001,"t_done_unix":1779820887.0794032},{"request_id":"1279412:6:1293655:225","session_id":"1279412","input_length":40278,"t_proxy_recv":390016.068873174,"t_decision_unix":1779820881.0828147,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":32256,"affinity_cache_ratio":0.8008342022940563,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":8022,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":40278,"score_linear":24482.0,"score_lmetric":40278},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":40278,"score_linear":82014.0,"score_lmetric":122292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":40278,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":629,"cache_hit":32256,"new_prefill":8022,"score_linear":-32256.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":40278,"score_linear":44920.0,"score_lmetric":40278},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":172644,"ongoing_decode_tokens":172644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":487,"cache_hit":0,"new_prefill":40278,"score_linear":172644.0,"score_lmetric":80556},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15547,"ongoing_decode_tokens":15547,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":657,"cache_hit":12800,"new_prefill":27478,"score_linear":2747.0,"score_lmetric":27478}],"chosen_score_linear":-32256.0,"chosen_score_lmetric":0,"t_first_token":390018.099759076,"t_first_token_unix":1779820883.1137028,"t_done":390022.141706534,"t_done_unix":1779820887.15565},{"request_id":"1272313:8:1293738:226","session_id":"1272313","input_length":28796,"t_proxy_recv":390018.995905283,"t_decision_unix":1779820884.0098464,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":15872,"affinity_cache_ratio":0.5511876649534657,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":12924,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":514,"cache_hit":4096,"new_prefill":24700,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":28796,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":28796,"score_linear":82014.0,"score_lmetric":110810},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":28796,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75713,"ongoing_decode_tokens":75713,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":28796,"score_linear":75713.0,"score_lmetric":57592},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":7680,"new_prefill":21116,"score_linear":37240.0,"score_lmetric":21116},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":7680,"new_prefill":21116,"score_linear":186987.0,"score_lmetric":85606},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":658,"cache_hit":15872,"new_prefill":12924,"score_linear":-15872.0,"score_lmetric":0}],"chosen_score_linear":-15872.0,"chosen_score_lmetric":0,"t_first_token":390021.17766928,"t_first_token_unix":1779820886.191613,"t_done":390022.968193428,"t_done_unix":1779820887.9821365},{"request_id":"1295690:1:1295690:232","session_id":"1295690","input_length":10857,"t_proxy_recv":390022.938490324,"t_decision_unix":1779820887.9524314,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10857,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":514,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":10857,"score_linear":82014.0,"score_lmetric":92871},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":10857,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":44920,"pending_prefill_tokens":7672,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":10857,"score_linear":95600.0,"score_lmetric":37058},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":10857,"score_linear":194667.0,"score_lmetric":65088},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28796,"ongoing_decode_tokens":28796,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":658,"cache_hit":0,"new_prefill":10857,"score_linear":28796.0,"score_lmetric":10857}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390023.796543837,"t_first_token_unix":1779820888.8104882,"t_done":390024.228345131,"t_done_unix":1779820889.2422903},{"request_id":"1294611:2:1295852:233","session_id":"1294611","input_length":23610,"t_proxy_recv":390023.443276098,"t_decision_unix":1779820888.4572175,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9324862346463363,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":1594,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":10857,"ongoing_decode_tokens":0,"pending_prefill_tokens":10857,"num_requests":1,"active_p_offloads":0,"cached_blocks":514,"cache_hit":0,"new_prefill":23610,"score_linear":10857.0,"score_lmetric":34467},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":23610,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":23610,"score_linear":82014.0,"score_lmetric":105624},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":784,"cache_hit":22016,"new_prefill":1594,"score_linear":-22016.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":0,"new_prefill":23610,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":44920,"pending_prefill_tokens":7672,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":12800,"new_prefill":10810,"score_linear":82800.0,"score_lmetric":36964},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":23610,"score_linear":194667.0,"score_lmetric":90594},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":12800,"new_prefill":10810,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":390023.799702837,"t_first_token_unix":1779820888.8136466,"t_done":390025.150333288,"t_done_unix":1779820890.1642773},{"request_id":"1289570:1:1289570:204","session_id":"1289570","input_length":82014,"t_proxy_recv":390002.279629457,"t_decision_unix":1779820867.2935708,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":82014,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9610,"ongoing_decode_tokens":0,"pending_prefill_tokens":8074,"num_requests":1,"active_p_offloads":0,"cached_blocks":446,"cache_hit":0,"new_prefill":82014,"score_linear":9610.0,"score_lmetric":90088},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89226,"ongoing_decode_tokens":89226,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":634,"cache_hit":0,"new_prefill":82014,"score_linear":89226.0,"score_lmetric":82014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":82014,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":82014,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":32191,"ongoing_decode_tokens":32191,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":628,"cache_hit":0,"new_prefill":82014,"score_linear":32191.0,"score_lmetric":82014},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":0,"pending_prefill_tokens":13688,"num_requests":1,"active_p_offloads":0,"cached_blocks":507,"cache_hit":0,"new_prefill":82014,"score_linear":44920.0,"score_lmetric":95702},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":82014,"score_linear":176757.0,"score_lmetric":246042},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":0,"new_prefill":82014,"score_linear":93352.0,"score_lmetric":320012}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390024.966256517,"t_first_token_unix":1779820889.9802003,"t_done":390025.484161863,"t_done_unix":1779820890.4981053},{"request_id":"1262354:15:1296106:234","session_id":"1262354","input_length":35669,"t_proxy_recv":390024.390716402,"t_decision_unix":1779820889.4046576,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9904398777650061,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":341,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":35669,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":35669,"score_linear":82014.0,"score_lmetric":117683},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23610,"ongoing_decode_tokens":23610,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":784,"cache_hit":0,"new_prefill":35669,"score_linear":23610.0,"score_lmetric":35669},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":646,"cache_hit":35328,"new_prefill":341,"score_linear":-35328.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":35669,"score_linear":95600.0,"score_lmetric":71338},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":35669,"score_linear":194667.0,"score_lmetric":114712},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":28672,"new_prefill":6997,"score_linear":-28672.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":390024.463503923,"t_first_token_unix":1779820889.4774475,"t_done":390026.888310649,"t_done_unix":1779820891.902254},{"request_id":"1296872:1:1296872:235","session_id":"1296872","input_length":624,"t_proxy_recv":390027.002072615,"t_decision_unix":1779820892.016014,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":624,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":624,"score_linear":95600.0,"score_lmetric":1248},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":624,"score_linear":194667.0,"score_lmetric":1248},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":624,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390027.066448108,"t_first_token_unix":1779820892.0803914,"t_done":390027.167715048,"t_done_unix":1779820892.181658},{"request_id":"1296983:1:1296983:236","session_id":"1296983","input_length":1791,"t_proxy_recv":390027.435296638,"t_decision_unix":1779820892.4492378,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1791,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":1791,"score_linear":95600.0,"score_lmetric":3582},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":1791,"score_linear":194667.0,"score_lmetric":3582},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":1791,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390027.589070994,"t_first_token_unix":1779820892.6030145,"t_done":390027.80939539,"t_done_unix":1779820892.8233385},{"request_id":"1269373:8:1295332:230","session_id":"1269373","input_length":50680,"t_proxy_recv":390021.585853196,"t_decision_unix":1779820886.5997946,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":43008,"affinity_cache_ratio":0.8486187845303867,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43008,"estimated_new_tokens":7672,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":514,"cache_hit":4096,"new_prefill":46584,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":50680,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":50680,"score_linear":82014.0,"score_lmetric":132694},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":21947,"ongoing_decode_tokens":21947,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":50680,"score_linear":21947.0,"score_lmetric":50680},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40278,"ongoing_decode_tokens":40278,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":630,"cache_hit":0,"new_prefill":50680,"score_linear":40278.0,"score_lmetric":50680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":43008,"new_prefill":7672,"score_linear":1912.0,"score_lmetric":7672},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":114612,"pending_prefill_tokens":21687,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":14848,"new_prefill":35832,"score_linear":179819.0,"score_lmetric":115038},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":28796,"ongoing_decode_tokens":28796,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":658,"cache_hit":7680,"new_prefill":43000,"score_linear":21116.0,"score_lmetric":43000}],"chosen_score_linear":1912.0,"chosen_score_lmetric":7672,"t_first_token":390023.918134673,"t_first_token_unix":1779820888.9320781,"t_done":390029.611321895,"t_done_unix":1779820894.6252654},{"request_id":"1260327:7:1297673:242","session_id":"1260327","input_length":42363,"t_proxy_recv":390029.624187002,"t_decision_unix":1779820894.6381288,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.99105351367939,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":379,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":42363,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":42363,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":42363,"score_linear":62414.0,"score_lmetric":85833},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83370,"ongoing_decode_tokens":0,"pending_prefill_tokens":59818,"num_requests":2,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":42363,"score_linear":83370.0,"score_lmetric":204362},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":42363,"score_linear":60193.0,"score_lmetric":62108},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":42363,"score_linear":44920.0,"score_lmetric":42363},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":42363,"score_linear":194667.0,"score_lmetric":84726},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":41984,"new_prefill":379,"score_linear":-41984.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":390029.776330473,"t_first_token_unix":1779820894.790274,"t_done":390030.002296785,"t_done_unix":1779820895.01624},{"request_id":"1272313:9:1297810:243","session_id":"1272313","input_length":29149,"t_proxy_recv":390030.104275937,"t_decision_unix":1779820895.1182175,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9836358022573674,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":4096,"new_prefill":25053,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":29149,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":29149,"score_linear":62414.0,"score_lmetric":72619},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83370,"ongoing_decode_tokens":0,"pending_prefill_tokens":59818,"num_requests":2,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":29149,"score_linear":83370.0,"score_lmetric":177934},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":29149,"score_linear":60193.0,"score_lmetric":48894},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":7680,"new_prefill":21469,"score_linear":37240.0,"score_lmetric":21469},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":7680,"new_prefill":21469,"score_linear":186987.0,"score_lmetric":42938},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":28672,"new_prefill":477,"score_linear":-28672.0,"score_lmetric":0}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":390030.198838421,"t_first_token_unix":1779820895.212782,"t_done":390031.098898262,"t_done_unix":1779820896.1128423},{"request_id":"1277909:3:1289205:201","session_id":"1277909","input_length":44920,"t_proxy_recv":390000.982477863,"t_decision_unix":1779820865.9964187,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":31232,"affinity_cache_ratio":0.6952804986642921,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":13688,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":446,"cache_hit":4096,"new_prefill":40824,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89226,"ongoing_decode_tokens":89226,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":634,"cache_hit":0,"new_prefill":44920,"score_linear":89226.0,"score_lmetric":44920},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":628,"cache_hit":0,"new_prefill":44920,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":507,"cache_hit":31232,"new_prefill":13688,"score_linear":-31232.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":176757,"ongoing_decode_tokens":176757,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":455,"cache_hit":7680,"new_prefill":37240,"score_linear":169077.0,"score_lmetric":111720},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93352,"ongoing_decode_tokens":0,"pending_prefill_tokens":77992,"num_requests":2,"active_p_offloads":0,"cached_blocks":505,"cache_hit":7680,"new_prefill":37240,"score_linear":85672.0,"score_lmetric":230464}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":390004.539811298,"t_first_token_unix":1779820869.5537548,"t_done":390031.380810211,"t_done_unix":1779820896.3947535},{"request_id":"1297811:1:1297811:244","session_id":"1297811","input_length":13992,"t_proxy_recv":390030.108169309,"t_decision_unix":1779820895.1221113,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13992,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":13992,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":13992,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":1536,"new_prefill":12456,"score_linear":60878.0,"score_lmetric":55926},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83370,"ongoing_decode_tokens":0,"pending_prefill_tokens":59818,"num_requests":2,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":13992,"score_linear":83370.0,"score_lmetric":147620},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":13992,"score_linear":60193.0,"score_lmetric":33737},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":13992,"score_linear":44920.0,"score_lmetric":13992},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":13992,"score_linear":194667.0,"score_lmetric":27984},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29149,"ongoing_decode_tokens":0,"pending_prefill_tokens":477,"num_requests":1,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":13992,"score_linear":29149.0,"score_lmetric":14469}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390031.313413975,"t_first_token_unix":1779820896.3273575,"t_done":390032.591100005,"t_done_unix":1779820897.605043},{"request_id":"1290365:4:1298540:247","session_id":"1290365","input_length":25103,"t_proxy_recv":390032.678486276,"t_decision_unix":1779820897.6924276,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":24576,"affinity_cache_ratio":0.979006493247819,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":527,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":562,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":24576,"new_prefill":527,"score_linear":-24576.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":25103,"score_linear":62414.0,"score_lmetric":68573},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":25103,"score_linear":95364.0,"score_lmetric":269241},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":25103,"score_linear":60193.0,"score_lmetric":44848},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":216297,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":25103,"score_linear":216297.0,"score_lmetric":75309},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":25103,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390032.788789735,"t_first_token_unix":1779820897.8027334,"t_done":390033.841890458,"t_done_unix":1779820898.8558335},{"request_id":"1298970:1:1298970:248","session_id":"1298970","input_length":9530,"t_proxy_recv":390034.244321398,"t_decision_unix":1779820899.2582629,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":562,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":9530,"score_linear":62414.0,"score_lmetric":53000},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":9530,"score_linear":95364.0,"score_lmetric":222522},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":9530,"score_linear":60193.0,"score_lmetric":29275},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":216297,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":9530,"score_linear":216297.0,"score_lmetric":28590},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":9530,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390035.000666701,"t_first_token_unix":1779820900.0146103,"t_done":390035.183724094,"t_done_unix":1779820900.1976671},{"request_id":"1266668:6:1284003:181","session_id":"1266668","input_length":80055,"t_proxy_recv":390016.528937428,"t_decision_unix":1779820881.5428789,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":58368,"affinity_cache_ratio":0.7290987446130786,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":21687,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":505,"cache_hit":4096,"new_prefill":75959,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24482,"ongoing_decode_tokens":24482,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":80055,"score_linear":24482.0,"score_lmetric":80055},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82014,"ongoing_decode_tokens":0,"pending_prefill_tokens":82014,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":80055,"score_linear":82014.0,"score_lmetric":162069},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":741,"cache_hit":0,"new_prefill":80055,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":40278,"ongoing_decode_tokens":0,"pending_prefill_tokens":8022,"num_requests":1,"active_p_offloads":0,"cached_blocks":629,"cache_hit":0,"new_prefill":80055,"score_linear":40278.0,"score_lmetric":88077},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":515,"cache_hit":7680,"new_prefill":72375,"score_linear":37240.0,"score_lmetric":72375},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":504,"cache_hit":58368,"new_prefill":21687,"score_linear":56244.0,"score_lmetric":21687},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15547,"ongoing_decode_tokens":15547,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":657,"cache_hit":7680,"new_prefill":72375,"score_linear":7867.0,"score_lmetric":72375}],"chosen_score_linear":56244.0,"chosen_score_lmetric":21687,"t_first_token":390026.07095595,"t_first_token_unix":1779820891.0849,"t_done":390035.653670514,"t_done_unix":1779820900.667614},{"request_id":"1299073:1:1299073:249","session_id":"1299073","input_length":881,"t_proxy_recv":390034.600887577,"t_decision_unix":1779820899.6148288,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":881,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":562,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":9530,"ongoing_decode_tokens":0,"pending_prefill_tokens":9530,"num_requests":1,"active_p_offloads":0,"cached_blocks":691,"cache_hit":0,"new_prefill":881,"score_linear":9530.0,"score_lmetric":10411},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":881,"score_linear":62414.0,"score_lmetric":44351},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":881,"score_linear":95364.0,"score_lmetric":196575},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":881,"score_linear":60193.0,"score_lmetric":20626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":216297,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":881,"score_linear":216297.0,"score_lmetric":2643},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":881,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390034.678228173,"t_first_token_unix":1779820899.6921716,"t_done":390035.789686955,"t_done_unix":1779820900.80363},{"request_id":"1296983:2:1299368:250","session_id":"1296983","input_length":7963,"t_proxy_recv":390035.425660729,"t_decision_unix":1779820900.4396021,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":5,"affinity_cache_hit":1536,"affinity_cache_ratio":0.1928921260831345,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7963,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":562,"cache_hit":0,"new_prefill":7963,"score_linear":881.0,"score_lmetric":7963},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":709,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":1536,"new_prefill":6427,"score_linear":60878.0,"score_lmetric":49897},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":7963,"score_linear":95364.0,"score_lmetric":217821},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":60193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":7963,"score_linear":60193.0,"score_lmetric":7963},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":216297,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":7963,"score_linear":216297.0,"score_lmetric":23889},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":7963,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390035.981243415,"t_first_token_unix":1779820900.9951868,"t_done":390036.17118973,"t_done_unix":1779820901.1851327},{"request_id":"1296872:2:1299394:251","session_id":"1296872","input_length":8352,"t_proxy_recv":390035.539937884,"t_decision_unix":1779820900.5538795,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":512,"affinity_cache_ratio":0.06130268199233716,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":7840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":562,"cache_hit":0,"new_prefill":8352,"score_linear":881.0,"score_lmetric":8352},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":709,"cache_hit":512,"new_prefill":7840,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":8352,"score_linear":62414.0,"score_lmetric":51822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":8352,"score_linear":95364.0,"score_lmetric":218988},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":60193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":8352,"score_linear":60193.0,"score_lmetric":8352},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":8352,"score_linear":7963.0,"score_lmetric":16315},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":216297,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":8352,"score_linear":216297.0,"score_lmetric":25056},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":8352,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390036.098331604,"t_first_token_unix":1779820901.1122751,"t_done":390036.230083389,"t_done_unix":1779820901.2440264},{"request_id":"1279412:7:1297236:238","session_id":"1279412","input_length":60193,"t_proxy_recv":390028.439391111,"t_decision_unix":1779820893.4533324,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":40448,"affinity_cache_ratio":0.6719718239662419,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":19745,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":60193,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":60193,"score_linear":59507.0,"score_lmetric":119700},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":647,"cache_hit":40448,"new_prefill":19745,"score_linear":-40448.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":60193,"score_linear":95600.0,"score_lmetric":120386},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":60193,"score_linear":194667.0,"score_lmetric":120386},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":12800,"new_prefill":47393,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":390034.966944399,"t_first_token_unix":1779820899.9808881,"t_done":390036.783403051,"t_done_unix":1779820901.797346},{"request_id":"1292750:2:1299406:252","session_id":"1292750","input_length":19157,"t_proxy_recv":390035.580272772,"t_decision_unix":1779820900.5942144,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.24053870647804979,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":19157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":562,"cache_hit":0,"new_prefill":19157,"score_linear":881.0,"score_lmetric":19157},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":7840,"num_requests":1,"active_p_offloads":0,"cached_blocks":709,"cache_hit":4608,"new_prefill":14549,"score_linear":3744.0,"score_lmetric":22389},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":19157,"score_linear":62414.0,"score_lmetric":62627},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":19157,"score_linear":95364.0,"score_lmetric":251403},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":60193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":19157,"score_linear":60193.0,"score_lmetric":19157},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":19157,"score_linear":7963.0,"score_lmetric":27120},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":216297,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":19157,"score_linear":216297.0,"score_lmetric":57471},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":19157,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390037.500322731,"t_first_token_unix":1779820902.5142663,"t_done":390037.696526433,"t_done_unix":1779820902.7104695},{"request_id":"1272313:10:1299814:254","session_id":"1272313","input_length":29486,"t_proxy_recv":390036.959158018,"t_decision_unix":1779820901.9730995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9897578511836126,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18893,"ongoing_decode_tokens":0,"pending_prefill_tokens":18893,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":4096,"new_prefill":25390,"score_linear":14797.0,"score_lmetric":44283},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":29486,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":29486,"score_linear":62414.0,"score_lmetric":72956},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":29486,"score_linear":95364.0,"score_lmetric":282390},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":29486,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":7680,"new_prefill":21806,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":136242,"pending_prefill_tokens":7357,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":7680,"new_prefill":21806,"score_linear":216303.0,"score_lmetric":87489},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":684,"cache_hit":29184,"new_prefill":302,"score_linear":-10027.0,"score_lmetric":19459}],"chosen_score_linear":-10027.0,"chosen_score_lmetric":19459,"t_first_token":390037.579924348,"t_first_token_unix":1779820902.5938678,"t_done":390039.051165755,"t_done_unix":1779820904.0651093},{"request_id":"1279412:8:1300001:255","session_id":"1279412","input_length":60678,"t_proxy_recv":390037.64474519,"t_decision_unix":1779820902.6586866,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":60416,"affinity_cache_ratio":0.9956821253172484,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":262,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18893,"ongoing_decode_tokens":0,"pending_prefill_tokens":18893,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":60678,"score_linear":18893.0,"score_lmetric":79571},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":60678,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":60678,"score_linear":62414.0,"score_lmetric":104148},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":60678,"score_linear":95364.0,"score_lmetric":375966},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":60416,"new_prefill":262,"score_linear":-60416.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":60678,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":136242,"pending_prefill_tokens":7357,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":0,"new_prefill":60678,"score_linear":223983.0,"score_lmetric":204105},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":48643,"ongoing_decode_tokens":48643,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":684,"cache_hit":12800,"new_prefill":47878,"score_linear":35843.0,"score_lmetric":95756}],"chosen_score_linear":-60416.0,"chosen_score_lmetric":0,"t_first_token":390037.853268764,"t_first_token_unix":1779820902.867212,"t_done":390039.568035543,"t_done_unix":1779820904.581979},{"request_id":"1290442:2:1298058:246","session_id":"1290442","input_length":11994,"t_proxy_recv":390030.97641027,"t_decision_unix":1779820895.990352,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7168,"affinity_cache_ratio":0.5976321494080373,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":4826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":13992,"num_requests":1,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":11994,"score_linear":13992.0,"score_lmetric":25986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":11994,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":11994,"score_linear":62414.0,"score_lmetric":55464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83370,"ongoing_decode_tokens":0,"pending_prefill_tokens":59818,"num_requests":2,"active_p_offloads":0,"cached_blocks":787,"cache_hit":7168,"new_prefill":4826,"score_linear":76202.0,"score_lmetric":129288},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":11994,"score_linear":60193.0,"score_lmetric":31739},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":11994,"score_linear":44920.0,"score_lmetric":11994},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":216297,"ongoing_decode_tokens":194667,"pending_prefill_tokens":8830,"num_requests":3,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":11994,"score_linear":216297.0,"score_lmetric":62472},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29149,"ongoing_decode_tokens":29149,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":11994,"score_linear":29149.0,"score_lmetric":11994}],"chosen_score_linear":76202.0,"chosen_score_lmetric":129288,"t_first_token":390041.074037868,"t_first_token_unix":1779820906.0879807,"t_done":390041.200101169,"t_done_unix":1779820906.2140481},{"request_id":"1297473:1:1297473:239","session_id":"1297473","input_length":62414,"t_proxy_recv":390029.185530329,"t_decision_unix":1779820894.1994717,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":43470,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":18944,"new_prefill":43470,"score_linear":-18944.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":62414,"score_linear":59507.0,"score_lmetric":121921},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":62414,"score_linear":60193.0,"score_lmetric":82159},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":62414,"score_linear":95600.0,"score_lmetric":124828},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":62414,"score_linear":194667.0,"score_lmetric":124828},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":62414,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":390041.270469344,"t_first_token_unix":1779820906.2844126,"t_done":390041.691277705,"t_done_unix":1779820906.705221},{"request_id":"1286804:2:1300234:256","session_id":"1286804","input_length":14213,"t_proxy_recv":390038.406879004,"t_decision_unix":1779820903.4208205,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13824,"affinity_cache_ratio":0.9726306902131852,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":389,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":1536,"new_prefill":12677,"score_linear":17357.0,"score_lmetric":12677},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":14213,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":13824,"new_prefill":389,"score_linear":48590.0,"score_lmetric":43859},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":14213,"score_linear":95364.0,"score_lmetric":236571},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60678,"ongoing_decode_tokens":60678,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":14213,"score_linear":60678.0,"score_lmetric":14213},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":14213,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":136242,"pending_prefill_tokens":7357,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":0,"new_prefill":14213,"score_linear":223983.0,"score_lmetric":64710},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29486,"ongoing_decode_tokens":29486,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":721,"cache_hit":0,"new_prefill":14213,"score_linear":29486.0,"score_lmetric":14213}],"chosen_score_linear":48590.0,"chosen_score_lmetric":43859,"t_first_token":390041.283925534,"t_first_token_unix":1779820906.2978706,"t_done":390042.093884693,"t_done_unix":1779820907.1078277},{"request_id":"1268861:3:1298057:245","session_id":"1268861","input_length":21630,"t_proxy_recv":390030.959173452,"t_decision_unix":1779820895.973115,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":12800,"affinity_cache_ratio":0.5917706888580675,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":8830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13992,"ongoing_decode_tokens":0,"pending_prefill_tokens":13992,"num_requests":1,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":21630,"score_linear":13992.0,"score_lmetric":35622},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":21630,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":21630,"score_linear":62414.0,"score_lmetric":65100},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83370,"ongoing_decode_tokens":0,"pending_prefill_tokens":59818,"num_requests":2,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":21630,"score_linear":83370.0,"score_lmetric":162896},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":21630,"score_linear":60193.0,"score_lmetric":41375},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":44920,"ongoing_decode_tokens":44920,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":530,"cache_hit":0,"new_prefill":21630,"score_linear":44920.0,"score_lmetric":21630},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":12800,"new_prefill":8830,"score_linear":181867.0,"score_lmetric":17660},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29149,"ongoing_decode_tokens":29149,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":21630,"score_linear":29149.0,"score_lmetric":21630}],"chosen_score_linear":181867.0,"chosen_score_lmetric":17660,"t_first_token":390032.286920585,"t_first_token_unix":1779820897.3008637,"t_done":390042.545924755,"t_done_unix":1779820907.559868},{"request_id":"1297117:1:1297117:237","session_id":"1297117","input_length":59507,"t_proxy_recv":390027.91592807,"t_decision_unix":1779820892.9298692,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":59507,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":0,"new_prefill":59507,"score_linear":95600.0,"score_lmetric":119014},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":59507,"score_linear":194667.0,"score_lmetric":119014},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":59507,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390041.06646518,"t_first_token_unix":1779820906.080409,"t_done":390043.2752878,"t_done_unix":1779820908.289231},{"request_id":"1299507:1:1299507:253","session_id":"1299507","input_length":18893,"t_proxy_recv":390035.840602732,"t_decision_unix":1779820900.8545442,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18893,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":18893,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":7840,"num_requests":1,"active_p_offloads":0,"cached_blocks":709,"cache_hit":0,"new_prefill":18893,"score_linear":8352.0,"score_lmetric":26733},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":18893,"score_linear":62414.0,"score_lmetric":62363},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":18893,"score_linear":95364.0,"score_lmetric":250611},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":60193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":18893,"score_linear":60193.0,"score_lmetric":18893},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":560,"cache_hit":0,"new_prefill":18893,"score_linear":7963.0,"score_lmetric":26856},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":136242,"pending_prefill_tokens":7357,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":11776,"new_prefill":7117,"score_linear":212207.0,"score_lmetric":43422},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":684,"cache_hit":0,"new_prefill":18893,"score_linear":19157.0,"score_lmetric":38050}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390037.768801977,"t_first_token_unix":1779820902.7827456,"t_done":390043.356364622,"t_done_unix":1779820908.370308},{"request_id":"1294611:3:1297534:240","session_id":"1294611","input_length":23863,"t_proxy_recv":390029.279714512,"t_decision_unix":1779820894.2936559,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9869672715081926,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":535,"cache_hit":0,"new_prefill":23863,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":690,"cache_hit":0,"new_prefill":23863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":23863,"score_linear":62414.0,"score_lmetric":67333},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":59507,"ongoing_decode_tokens":0,"pending_prefill_tokens":59507,"num_requests":1,"active_p_offloads":0,"cached_blocks":787,"cache_hit":23552,"new_prefill":311,"score_linear":35955.0,"score_lmetric":59818},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":0,"pending_prefill_tokens":19745,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":23863,"score_linear":60193.0,"score_lmetric":43608},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95600,"ongoing_decode_tokens":95600,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":515,"cache_hit":12800,"new_prefill":11063,"score_linear":82800.0,"score_lmetric":22126},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":194667,"ongoing_decode_tokens":194667,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":504,"cache_hit":0,"new_prefill":23863,"score_linear":194667.0,"score_lmetric":47726},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":12800,"new_prefill":11063,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":35955.0,"chosen_score_lmetric":59818,"t_first_token":390041.06788051,"t_first_token_unix":1779820906.081824,"t_done":390044.923873093,"t_done_unix":1779820909.9378204},{"request_id":"1294611:4:1300505:257","session_id":"1294611","input_length":24384,"t_proxy_recv":390044.930122734,"t_decision_unix":1779820909.9440646,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9868766404199475,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":18220,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":24384,"score_linear":28972.0,"score_lmetric":42604},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":24384,"score_linear":69555.0,"score_lmetric":137702},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":24384,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":913,"cache_hit":24064,"new_prefill":320,"score_linear":-24064.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":24384,"score_linear":34706.0,"score_lmetric":59090},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":12800,"new_prefill":11584,"score_linear":41651.0,"score_lmetric":11584},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":24384,"score_linear":202353.0,"score_lmetric":48768},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":12800,"new_prefill":11584,"score_linear":30381.0,"score_lmetric":11584}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":390044.992379421,"t_first_token_unix":1779820910.0063226,"t_done":390045.350531865,"t_done_unix":1779820910.3644753},{"request_id":"1302071:1:1302071:267","session_id":"1302071","input_length":6527,"t_proxy_recv":390044.958037842,"t_decision_unix":1779820909.9719796,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":6527,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6527,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":18220,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":6527,"score_linear":28972.0,"score_lmetric":24747},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":6527,"score_linear":69555.0,"score_lmetric":101988},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":6527,"score_linear":26441.0,"score_lmetric":32968},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24384,"ongoing_decode_tokens":0,"pending_prefill_tokens":320,"num_requests":1,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":6527,"score_linear":24384.0,"score_lmetric":6847},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":6527,"score_linear":34706.0,"score_lmetric":41233},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":6527,"score_linear":54451.0,"score_lmetric":6527},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":6527,"score_linear":202353.0,"score_lmetric":13054},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":6527,"score_linear":43181.0,"score_lmetric":6527}],"chosen_score_linear":54451.0,"chosen_score_lmetric":6527,"t_first_token":390045.403351861,"t_first_token_unix":1779820910.4172952,"t_done":390045.838984284,"t_done_unix":1779820910.8529272},{"request_id":"1269373:9:1300958:261","session_id":"1269373","input_length":54451,"t_proxy_recv":390041.103258644,"t_decision_unix":1779820906.1172001,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":50688,"affinity_cache_ratio":0.9308919946373804,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":3763,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":4096,"new_prefill":50355,"score_linear":14797.0,"score_lmetric":50355},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":54451,"score_linear":69555.0,"score_lmetric":197836},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":76627,"ongoing_decode_tokens":0,"pending_prefill_tokens":43859,"num_requests":2,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":54451,"score_linear":76627.0,"score_lmetric":196620},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":95364,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":54451,"score_linear":95364.0,"score_lmetric":163353},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":54451,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":50688,"new_prefill":3763,"score_linear":-50688.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":223983,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":14848,"new_prefill":39603,"score_linear":209135.0,"score_lmetric":118809},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":7680,"new_prefill":46771,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-50688.0,"chosen_score_lmetric":0,"t_first_token":390042.369888688,"t_first_token_unix":1779820907.3838317,"t_done":390046.663507793,"t_done_unix":1779820911.6774526},{"request_id":"1266668:7:1287468:197","session_id":"1266668","input_length":87741,"t_proxy_recv":390035.672440418,"t_decision_unix":1779820900.686382,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":80384,"affinity_cache_ratio":0.916150944256391,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":80384,"estimated_new_tokens":7357,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":881,"ongoing_decode_tokens":881,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":562,"cache_hit":4096,"new_prefill":83645,"score_linear":-3215.0,"score_lmetric":83645},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":8352,"ongoing_decode_tokens":0,"pending_prefill_tokens":7840,"num_requests":1,"active_p_offloads":0,"cached_blocks":709,"cache_hit":0,"new_prefill":87741,"score_linear":8352.0,"score_lmetric":95581},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62414,"ongoing_decode_tokens":0,"pending_prefill_tokens":43470,"num_requests":1,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":87741,"score_linear":62414.0,"score_lmetric":131211},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":87741,"score_linear":95364.0,"score_lmetric":457155},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":60193,"ongoing_decode_tokens":60193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":647,"cache_hit":0,"new_prefill":87741,"score_linear":60193.0,"score_lmetric":87741},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":7963,"ongoing_decode_tokens":0,"pending_prefill_tokens":7963,"num_requests":1,"active_p_offloads":0,"cached_blocks":560,"cache_hit":7680,"new_prefill":80061,"score_linear":283.0,"score_lmetric":88024},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":136242,"ongoing_decode_tokens":136242,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":547,"cache_hit":80384,"new_prefill":7357,"score_linear":55858.0,"score_lmetric":14714},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":19157,"ongoing_decode_tokens":0,"pending_prefill_tokens":19157,"num_requests":1,"active_p_offloads":0,"cached_blocks":684,"cache_hit":7680,"new_prefill":80061,"score_linear":11477.0,"score_lmetric":99218}],"chosen_score_linear":55858.0,"chosen_score_lmetric":14714,"t_first_token":390039.555192333,"t_first_token_unix":1779820904.5691364,"t_done":390046.703486072,"t_done_unix":1779820911.7174292},{"request_id":"1295690:2:1301706:264","session_id":"1295690","input_length":28972,"t_proxy_recv":390043.536500671,"t_decision_unix":1779820908.550432,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":10752,"affinity_cache_ratio":0.37111694049427035,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":18220,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":10752,"new_prefill":18220,"score_linear":-10752.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":28972,"score_linear":69555.0,"score_lmetric":146878},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":28972,"score_linear":23863.0,"score_lmetric":28972},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":28972,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":28972,"score_linear":54451.0,"score_lmetric":28972},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":28972,"score_linear":202353.0,"score_lmetric":57944},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":0,"pending_prefill_tokens":1197,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":28972,"score_linear":43181.0,"score_lmetric":30169}],"chosen_score_linear":-10752.0,"chosen_score_lmetric":0,"t_first_token":390046.448785692,"t_first_token_unix":1779820911.4627306,"t_done":390046.714859126,"t_done_unix":1779820911.7288022},{"request_id":"1302449:1:1302449:269","session_id":"1302449","input_length":1105,"t_proxy_recv":390046.502652896,"t_decision_unix":1779820911.5165944,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":1105,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1105,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":28972,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":1105,"score_linear":28972.0,"score_lmetric":1105},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":1105,"score_linear":69555.0,"score_lmetric":91144},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":1105,"score_linear":26441.0,"score_lmetric":27546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":1105,"score_linear":75505.0,"score_lmetric":2592},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":1105,"score_linear":34706.0,"score_lmetric":35811},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":587,"cache_hit":0,"new_prefill":1105,"score_linear":54451.0,"score_lmetric":1105},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":1105,"score_linear":202353.0,"score_lmetric":2210},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":1105,"score_linear":43181.0,"score_lmetric":1105}],"chosen_score_linear":43181.0,"chosen_score_lmetric":1105,"t_first_token":390046.65940701,"t_first_token_unix":1779820911.6733506,"t_done":390047.64746301,"t_done_unix":1779820912.661406},{"request_id":"1302063:1:1302063:266","session_id":"1302063","input_length":26441,"t_proxy_recv":390044.953400106,"t_decision_unix":1779820909.9673417,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":26441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":18220,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":26441,"score_linear":28972.0,"score_lmetric":44661},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":26441,"score_linear":69555.0,"score_lmetric":141816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":26441,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24384,"ongoing_decode_tokens":0,"pending_prefill_tokens":320,"num_requests":1,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":26441,"score_linear":24384.0,"score_lmetric":26761},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":26441,"score_linear":34706.0,"score_lmetric":61147},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":26441,"score_linear":54451.0,"score_lmetric":26441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":26441,"score_linear":202353.0,"score_lmetric":52882},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":26441,"score_linear":43181.0,"score_lmetric":26441}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390048.17286941,"t_first_token_unix":1779820913.1868129,"t_done":390048.422367117,"t_done_unix":1779820913.4363103},{"request_id":"1260327:8:1301686:263","session_id":"1260327","input_length":43181,"t_proxy_recv":390043.448729258,"t_decision_unix":1779820908.4626708,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9722794747689957,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":1197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":43181,"score_linear":69555.0,"score_lmetric":175296},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":43181,"score_linear":23863.0,"score_lmetric":43181},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":43181,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":43181,"score_linear":54451.0,"score_lmetric":43181},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":43181,"score_linear":202353.0,"score_lmetric":86362},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":41984,"new_prefill":1197,"score_linear":-41984.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":390043.779016014,"t_first_token_unix":1779820908.7929623,"t_done":390049.466415077,"t_done_unix":1779820914.4803584},{"request_id":"1302907:1:1302907:272","session_id":"1302907","input_length":15958,"t_proxy_recv":390047.867748957,"t_decision_unix":1779820912.88169,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15958,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":15958,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":15958,"score_linear":69555.0,"score_lmetric":31916},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":15958,"score_linear":26441.0,"score_lmetric":42399},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":15958,"score_linear":75505.0,"score_lmetric":32298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":15958,"score_linear":34706.0,"score_lmetric":50664},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":15958,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":15958,"score_linear":210717.0,"score_lmetric":47998},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":73129,"ongoing_decode_tokens":73129,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":15958,"score_linear":73129.0,"score_lmetric":31916}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390049.331662634,"t_first_token_unix":1779820914.3456063,"t_done":390049.523791586,"t_done_unix":1779820914.5377371},{"request_id":"1290365:5:1300807:259","session_id":"1290365","input_length":25948,"t_proxy_recv":390040.602318403,"t_decision_unix":1779820905.6162598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9668567905040851,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":860,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":25948,"score_linear":18893.0,"score_lmetric":25948},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":0,"pending_prefill_tokens":43607,"num_requests":1,"active_p_offloads":0,"cached_blocks":724,"cache_hit":25088,"new_prefill":860,"score_linear":18519.0,"score_lmetric":44467},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":76627,"ongoing_decode_tokens":0,"pending_prefill_tokens":43859,"num_requests":2,"active_p_offloads":0,"cached_blocks":773,"cache_hit":0,"new_prefill":25948,"score_linear":76627.0,"score_lmetric":139614},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":25948,"score_linear":95364.0,"score_lmetric":271776},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":25948,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":25948,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":223983,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":0,"new_prefill":25948,"score_linear":223983.0,"score_lmetric":77844},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":25948,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":18519.0,"chosen_score_lmetric":44467,"t_first_token":390047.265418536,"t_first_token_unix":1779820912.2793617,"t_done":390050.303324997,"t_done_unix":1779820915.3172681},{"request_id":"1294611:5:1301356:262","session_id":"1294611","input_length":25650,"t_proxy_recv":390045.357385027,"t_decision_unix":1779820910.3713264,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9381676413255361,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":1586,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":18220,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":25650,"score_linear":28972.0,"score_lmetric":43870},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":25650,"score_linear":69555.0,"score_lmetric":140234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":25650,"score_linear":26441.0,"score_lmetric":52091},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":913,"cache_hit":24064,"new_prefill":1586,"score_linear":-24064.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":25650,"score_linear":34706.0,"score_lmetric":60356},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":60978,"ongoing_decode_tokens":54451,"pending_prefill_tokens":6527,"num_requests":2,"active_p_offloads":0,"cached_blocks":575,"cache_hit":12800,"new_prefill":12850,"score_linear":48178.0,"score_lmetric":38754},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":25650,"score_linear":202353.0,"score_lmetric":51300},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":12800,"new_prefill":12850,"score_linear":30381.0,"score_lmetric":12850}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":390045.639779791,"t_first_token_unix":1779820910.6537235,"t_done":390050.40062274,"t_done_unix":1779820915.414566},{"request_id":"1302449:2:1303563:277","session_id":"1302449","input_length":3709,"t_proxy_recv":390050.19233159,"t_decision_unix":1779820915.206273,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":5,"affinity_cache_hit":1024,"affinity_cache_ratio":0.27608519816662175,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3709,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":668,"cache_hit":0,"new_prefill":3709,"score_linear":15081.0,"score_lmetric":18790},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":3709,"score_linear":69555.0,"score_lmetric":7418},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":3709,"score_linear":14944.0,"score_lmetric":18653},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":3709,"score_linear":75505.0,"score_lmetric":7800},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":3709,"score_linear":34706.0,"score_lmetric":3709},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":3709,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":3709,"score_linear":210717.0,"score_lmetric":23500},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":1024,"new_prefill":2685,"score_linear":28924.0,"score_lmetric":2685}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390050.421723681,"t_first_token_unix":1779820915.435667,"t_done":390050.642329811,"t_done_unix":1779820915.6562731},{"request_id":"1303651:1:1303651:278","session_id":"1303651","input_length":3065,"t_proxy_recv":390050.498895836,"t_decision_unix":1779820915.5128372,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":3065,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3065,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":668,"cache_hit":0,"new_prefill":3065,"score_linear":15081.0,"score_lmetric":18146},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":3065,"score_linear":43607.0,"score_lmetric":3065},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":3065,"score_linear":14944.0,"score_lmetric":18009},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":3065,"score_linear":80500.0,"score_lmetric":16602},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":3065,"score_linear":34706.0,"score_lmetric":3065},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":3709,"ongoing_decode_tokens":3709,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":3065,"score_linear":3709.0,"score_lmetric":3065},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":3065,"score_linear":210717.0,"score_lmetric":22212},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":3065,"score_linear":29948.0,"score_lmetric":3065}],"chosen_score_linear":29948.0,"chosen_score_lmetric":3065,"t_first_token":390050.716834416,"t_first_token_unix":1779820915.7307785,"t_done":390051.06061511,"t_done_unix":1779820916.074559},{"request_id":"1303517:1:1303517:275","session_id":"1303517","input_length":15081,"t_proxy_recv":390050.064460142,"t_decision_unix":1779820915.0784009,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15081,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":668,"cache_hit":0,"new_prefill":15081,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":15081,"score_linear":69555.0,"score_lmetric":30162},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":15081,"score_linear":14944.0,"score_lmetric":30025},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":15081,"score_linear":75505.0,"score_lmetric":30544},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":15081,"score_linear":34706.0,"score_lmetric":15081},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":15081,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":15081,"score_linear":210717.0,"score_lmetric":46244},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":15081,"score_linear":29948.0,"score_lmetric":15081}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390051.405563732,"t_first_token_unix":1779820916.4195073,"t_done":390051.737686386,"t_done_unix":1779820916.7516298},{"request_id":"1275274:1:1275274:136","session_id":"1275274","input_length":114612,"t_proxy_recv":389952.818356066,"t_decision_unix":1779820817.8322973,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":114612,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":135235,"ongoing_decode_tokens":0,"pending_prefill_tokens":113219,"num_requests":2,"active_p_offloads":0,"cached_blocks":156,"cache_hit":0,"new_prefill":114612,"score_linear":135235.0,"score_lmetric":455662},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102074,"ongoing_decode_tokens":0,"pending_prefill_tokens":98490,"num_requests":1,"active_p_offloads":0,"cached_blocks":266,"cache_hit":0,"new_prefill":114612,"score_linear":102074.0,"score_lmetric":213102},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":150574,"ongoing_decode_tokens":0,"pending_prefill_tokens":117806,"num_requests":2,"active_p_offloads":0,"cached_blocks":348,"cache_hit":0,"new_prefill":114612,"score_linear":150574.0,"score_lmetric":464836},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":108713,"ongoing_decode_tokens":15283,"pending_prefill_tokens":93430,"num_requests":2,"active_p_offloads":0,"cached_blocks":358,"cache_hit":0,"new_prefill":114612,"score_linear":108713.0,"score_lmetric":416084},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":52747,"ongoing_decode_tokens":52747,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":460,"cache_hit":0,"new_prefill":114612,"score_linear":52747.0,"score_lmetric":114612},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":329,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":455,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":378,"cache_hit":0,"new_prefill":114612,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":389995.159463858,"t_first_token_unix":1779820860.1734076,"t_done":390052.162151336,"t_done_unix":1779820917.1760979},{"request_id":"1302063:2:1303816:279","session_id":"1302063","input_length":30248,"t_proxy_recv":390051.17292462,"t_decision_unix":1779820916.1868656,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26112,"affinity_cache_ratio":0.8632636868553293,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":4136,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":668,"cache_hit":0,"new_prefill":30248,"score_linear":15081.0,"score_lmetric":45329},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":30248,"score_linear":43607.0,"score_lmetric":30248},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":26112,"new_prefill":4136,"score_linear":-11168.0,"score_lmetric":19080},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":30248,"score_linear":80500.0,"score_lmetric":70968},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":30248,"score_linear":34706.0,"score_lmetric":30248},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":30248,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":30248,"score_linear":210717.0,"score_lmetric":76578},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":30248,"score_linear":29948.0,"score_lmetric":30248}],"chosen_score_linear":-11168.0,"chosen_score_lmetric":19080,"t_first_token":390052.05634313,"t_first_token_unix":1779820917.0702877,"t_done":390052.423461068,"t_done_unix":1779820917.4374042},{"request_id":"1303462:1:1303462:274","session_id":"1303462","input_length":14944,"t_proxy_recv":390049.899970278,"t_decision_unix":1779820914.9139116,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":668,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":69555,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":14944,"score_linear":69555.0,"score_lmetric":29888},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":14944,"score_linear":75505.0,"score_lmetric":30270},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":14944,"score_linear":34706.0,"score_lmetric":14944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":0,"new_prefill":14944,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":14944,"score_linear":210717.0,"score_lmetric":45970},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":14944,"score_linear":29948.0,"score_lmetric":14944}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390051.229569872,"t_first_token_unix":1779820916.2435133,"t_done":390052.424275662,"t_done_unix":1779820917.4382186},{"request_id":"1266668:8:1292408:218","session_id":"1266668","input_length":96105,"t_proxy_recv":390046.724128919,"t_decision_unix":1779820911.7380705,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":88064,"affinity_cache_ratio":0.916331096196868,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":8041,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":4096,"new_prefill":92009,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":96105,"score_linear":69555.0,"score_lmetric":281144},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":96105,"score_linear":26441.0,"score_lmetric":122546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":96105,"score_linear":75505.0,"score_lmetric":192592},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":96105,"score_linear":34706.0,"score_lmetric":130811},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":7680,"new_prefill":88425,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114612,"ongoing_decode_tokens":114612,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":579,"cache_hit":88064,"new_prefill":8041,"score_linear":26548.0,"score_lmetric":8041},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44286,"ongoing_decode_tokens":44286,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":722,"cache_hit":7680,"new_prefill":88425,"score_linear":36606.0,"score_lmetric":176850}],"chosen_score_linear":26548.0,"chosen_score_lmetric":8041,"t_first_token":390051.308361301,"t_first_token_unix":1779820916.322305,"t_done":390052.595180056,"t_done_unix":1779820917.6091232},{"request_id":"1304239:1:1304239:280","session_id":"1304239","input_length":1300,"t_proxy_recv":390052.697913197,"t_decision_unix":1779820917.7118547,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1300,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":1300,"score_linear":43607.0,"score_lmetric":1300},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":1300,"score_linear":80500.0,"score_lmetric":13072},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":1300,"score_linear":34706.0,"score_lmetric":1300},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":1300,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":96717,"ongoing_decode_tokens":0,"pending_prefill_tokens":973,"num_requests":1,"active_p_offloads":0,"cached_blocks":819,"cache_hit":0,"new_prefill":1300,"score_linear":96717.0,"score_lmetric":2273},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":1300,"score_linear":29948.0,"score_lmetric":1300}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390052.824504828,"t_first_token_unix":1779820917.8384485,"t_done":390052.965398888,"t_done_unix":1779820917.979343},{"request_id":"1266668:9:1295576:231","session_id":"1266668","input_length":96717,"t_proxy_recv":390052.612931338,"t_decision_unix":1779820917.6268728,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9899397210418024,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":973,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":4096,"new_prefill":92621,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":96717,"score_linear":43607.0,"score_lmetric":96717},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":96717,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":96717,"score_linear":80500.0,"score_lmetric":203906},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":96717,"score_linear":34706.0,"score_lmetric":96717},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":7680,"new_prefill":89037,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":819,"cache_hit":95744,"new_prefill":973,"score_linear":-95744.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":7680,"new_prefill":89037,"score_linear":22268.0,"score_lmetric":89037}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":390053.151595062,"t_first_token_unix":1779820918.1655388,"t_done":390053.43940314,"t_done_unix":1779820918.453347},{"request_id":"1304239:2:1304866:281","session_id":"1304239","input_length":7798,"t_proxy_recv":390054.847247484,"t_decision_unix":1779820919.8611884,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":1024,"affinity_cache_ratio":0.13131572197999486,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":6774,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":7798,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":7798,"score_linear":43607.0,"score_lmetric":7798},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":947,"cache_hit":1024,"new_prefill":6774,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":7798,"score_linear":80500.0,"score_lmetric":26068},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":7798,"score_linear":34706.0,"score_lmetric":7798},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":7798,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":7798,"score_linear":97145.0,"score_lmetric":7798},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":7798,"score_linear":29948.0,"score_lmetric":7798}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":390055.329634124,"t_first_token_unix":1779820920.3435776,"t_done":390055.47481793,"t_done_unix":1779820920.488761},{"request_id":"1304943:1:1304943:283","session_id":"1304943","input_length":2772,"t_proxy_recv":390055.103975922,"t_decision_unix":1779820920.1179175,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2772,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":0,"new_prefill":2772,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":2772,"score_linear":43607.0,"score_lmetric":2772},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7798,"ongoing_decode_tokens":0,"pending_prefill_tokens":6774,"num_requests":1,"active_p_offloads":0,"cached_blocks":947,"cache_hit":0,"new_prefill":2772,"score_linear":7798.0,"score_lmetric":9546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":2772,"score_linear":80500.0,"score_lmetric":16016},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":2772,"score_linear":34706.0,"score_lmetric":2772},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59146,"ongoing_decode_tokens":0,"pending_prefill_tokens":4362,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":2772,"score_linear":59146.0,"score_lmetric":7134},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":2772,"score_linear":97145.0,"score_lmetric":2772},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":2772,"score_linear":29948.0,"score_lmetric":2772}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390055.300846254,"t_first_token_unix":1779820920.3147905,"t_done":390055.596445166,"t_done_unix":1779820920.6103883},{"request_id":"1266668:10:1297641:241","session_id":"1266668","input_length":97145,"t_proxy_recv":390053.455860878,"t_decision_unix":1779820918.4698024,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":96256,"affinity_cache_ratio":0.9908487312779866,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":96256,"estimated_new_tokens":889,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":4096,"new_prefill":93049,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":97145,"score_linear":43607.0,"score_lmetric":97145},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":947,"cache_hit":0,"new_prefill":97145,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":97145,"score_linear":80500.0,"score_lmetric":204762},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":97145,"score_linear":34706.0,"score_lmetric":97145},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":7680,"new_prefill":89465,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":820,"cache_hit":96256,"new_prefill":889,"score_linear":-96256.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":7680,"new_prefill":89465,"score_linear":22268.0,"score_lmetric":89465}],"chosen_score_linear":-96256.0,"chosen_score_lmetric":0,"t_first_token":390053.937992128,"t_first_token_unix":1779820918.951936,"t_done":390056.658692249,"t_done_unix":1779820921.6726384},{"request_id":"1253743:3:1302294:268","session_id":"1253743","input_length":49855,"t_proxy_recv":390045.887944704,"t_decision_unix":1779820910.9018862,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.996168889780363,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":191,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":18220,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":17408,"new_prefill":32447,"score_linear":11564.0,"score_lmetric":50667},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":4608,"new_prefill":45247,"score_linear":64947.0,"score_lmetric":179428},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":49855,"score_linear":26441.0,"score_lmetric":76296},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":25650,"ongoing_decode_tokens":25650,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":913,"cache_hit":49664,"new_prefill":191,"score_linear":-24014.0,"score_lmetric":191},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":49855,"score_linear":34706.0,"score_lmetric":84561},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":587,"cache_hit":0,"new_prefill":49855,"score_linear":54451.0,"score_lmetric":49855},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":49855,"score_linear":202353.0,"score_lmetric":99710},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":49855,"score_linear":43181.0,"score_lmetric":49855}],"chosen_score_linear":-24014.0,"chosen_score_lmetric":191,"t_first_token":390056.18807886,"t_first_token_unix":1779820921.202023,"t_done":390056.959134941,"t_done_unix":1779820921.9730783},{"request_id":"1269373:10:1304899:282","session_id":"1269373","input_length":59146,"t_proxy_recv":390054.975696185,"t_decision_unix":1779820919.9896376,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9262502958779968,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":4362,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":697,"cache_hit":4096,"new_prefill":55050,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":59146,"score_linear":43607.0,"score_lmetric":59146},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":7798,"ongoing_decode_tokens":0,"pending_prefill_tokens":6774,"num_requests":1,"active_p_offloads":0,"cached_blocks":947,"cache_hit":0,"new_prefill":59146,"score_linear":7798.0,"score_lmetric":65920},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":0,"pending_prefill_tokens":5236,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":59146,"score_linear":80500.0,"score_lmetric":128764},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":59146,"score_linear":34706.0,"score_lmetric":59146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":602,"cache_hit":54784,"new_prefill":4362,"score_linear":-54784.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97145,"ongoing_decode_tokens":97145,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":14848,"new_prefill":44298,"score_linear":82297.0,"score_lmetric":44298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":7680,"new_prefill":51466,"score_linear":22268.0,"score_lmetric":51466}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":390056.614880022,"t_first_token_unix":1779820921.628825,"t_done":390058.485970663,"t_done_unix":1779820923.499914},{"request_id":"1294611:6:1302460:270","session_id":"1294611","input_length":30645,"t_proxy_recv":390050.409217854,"t_decision_unix":1779820915.423159,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":25600,"affinity_cache_ratio":0.8353728177516724,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":25600,"estimated_new_tokens":5045,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15081,"ongoing_decode_tokens":0,"pending_prefill_tokens":15081,"num_requests":1,"active_p_offloads":0,"cached_blocks":668,"cache_hit":0,"new_prefill":30645,"score_linear":15081.0,"score_lmetric":45726},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":30645,"score_linear":43607.0,"score_lmetric":30645},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14944,"ongoing_decode_tokens":0,"pending_prefill_tokens":14944,"num_requests":1,"active_p_offloads":0,"cached_blocks":908,"cache_hit":0,"new_prefill":30645,"score_linear":14944.0,"score_lmetric":45589},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":49855,"ongoing_decode_tokens":0,"pending_prefill_tokens":191,"num_requests":1,"active_p_offloads":0,"cached_blocks":916,"cache_hit":25600,"new_prefill":5045,"score_linear":24255.0,"score_lmetric":5236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":30645,"score_linear":34706.0,"score_lmetric":30645},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":3709,"ongoing_decode_tokens":0,"pending_prefill_tokens":3709,"num_requests":1,"active_p_offloads":0,"cached_blocks":595,"cache_hit":12800,"new_prefill":17845,"score_linear":-9091.0,"score_lmetric":21554},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":0,"new_prefill":30645,"score_linear":210717.0,"score_lmetric":77372},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":12800,"new_prefill":17845,"score_linear":17148.0,"score_lmetric":17845}],"chosen_score_linear":24255.0,"chosen_score_lmetric":5236,"t_first_token":390056.189047216,"t_first_token_unix":1779820921.2029903,"t_done":390058.524287492,"t_done_unix":1779820923.5382304},{"request_id":"1279412:9:1305633:286","session_id":"1279412","input_length":61291,"t_proxy_recv":390057.778169105,"t_decision_unix":1779820922.7921095,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":60416,"affinity_cache_ratio":0.985723841999641,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":875,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":702,"cache_hit":0,"new_prefill":61291,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":61291,"score_linear":43607.0,"score_lmetric":61291},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":61291,"score_linear":75826.0,"score_lmetric":137117},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":61291,"score_linear":30645.0,"score_lmetric":61291},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":60416,"new_prefill":875,"score_linear":-25710.0,"score_lmetric":875},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59146,"ongoing_decode_tokens":59146,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":61291,"score_linear":59146.0,"score_lmetric":61291},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":61291,"score_linear":97811.0,"score_lmetric":61291},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":12800,"new_prefill":48491,"score_linear":17148.0,"score_lmetric":48491}],"chosen_score_linear":-25710.0,"chosen_score_lmetric":875,"t_first_token":390058.122116276,"t_first_token_unix":1779820923.1360593,"t_done":390059.257031642,"t_done_unix":1779820924.2709749},{"request_id":"1303651:2:1305707:287","session_id":"1303651","input_length":12795,"t_proxy_recv":390058.040676962,"t_decision_unix":1779820923.0546184,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":0,"affinity_cache_hit":3072,"affinity_cache_ratio":0.24009378663540445,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":12795,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":702,"cache_hit":0,"new_prefill":12795,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":12795,"score_linear":43607.0,"score_lmetric":12795},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":12795,"score_linear":75826.0,"score_lmetric":88621},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":12795,"score_linear":30645.0,"score_lmetric":12795},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95997,"ongoing_decode_tokens":34706,"pending_prefill_tokens":875,"num_requests":2,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":12795,"score_linear":95997.0,"score_lmetric":27340},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59146,"ongoing_decode_tokens":59146,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":12795,"score_linear":59146.0,"score_lmetric":12795},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":12795,"score_linear":97811.0,"score_lmetric":12795},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":3072,"new_prefill":9723,"score_linear":26876.0,"score_lmetric":9723}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390059.109114149,"t_first_token_unix":1779820924.1230574,"t_done":390059.264244919,"t_done_unix":1779820924.278188},{"request_id":"1294611:6:1305080:284","session_id":"1294611","input_length":30995,"t_proxy_recv":390058.530833805,"t_decision_unix":1779820923.5447755,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9911276012260042,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":275,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31710,"ongoing_decode_tokens":0,"pending_prefill_tokens":13278,"num_requests":2,"active_p_offloads":0,"cached_blocks":702,"cache_hit":0,"new_prefill":30995,"score_linear":31710.0,"score_lmetric":88546},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":30995,"score_linear":43607.0,"score_lmetric":30995},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":30995,"score_linear":75826.0,"score_lmetric":106821},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":926,"cache_hit":30720,"new_prefill":275,"score_linear":-30720.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95997,"ongoing_decode_tokens":95997,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":30995,"score_linear":95997.0,"score_lmetric":61990},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":12800,"new_prefill":18195,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":30995,"score_linear":97811.0,"score_lmetric":30995},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":12800,"new_prefill":18195,"score_linear":17148.0,"score_lmetric":18195}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":390058.596836462,"t_first_token_unix":1779820923.6107798,"t_done":390059.901264289,"t_done_unix":1779820924.9152074},{"request_id":"1272313:11:1302571:271","session_id":"1272313","input_length":29948,"t_proxy_recv":390046.826174325,"t_decision_unix":1779820911.840116,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":29696,"affinity_cache_ratio":0.991585414718846,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":4096,"new_prefill":25852,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":29948,"score_linear":69555.0,"score_lmetric":148830},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":26441,"ongoing_decode_tokens":0,"pending_prefill_tokens":26441,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":29948,"score_linear":26441.0,"score_lmetric":56389},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75505,"ongoing_decode_tokens":25650,"pending_prefill_tokens":191,"num_requests":2,"active_p_offloads":0,"cached_blocks":913,"cache_hit":0,"new_prefill":29948,"score_linear":75505.0,"score_lmetric":60278},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":0,"pending_prefill_tokens":34706,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":29948,"score_linear":34706.0,"score_lmetric":64654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":595,"cache_hit":7680,"new_prefill":22268,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":210717,"ongoing_decode_tokens":114612,"pending_prefill_tokens":8041,"num_requests":2,"active_p_offloads":0,"cached_blocks":579,"cache_hit":7680,"new_prefill":22268,"score_linear":203037.0,"score_lmetric":60618},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44286,"ongoing_decode_tokens":44286,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":722,"cache_hit":29696,"new_prefill":252,"score_linear":14590.0,"score_lmetric":504}],"chosen_score_linear":14590.0,"chosen_score_lmetric":504,"t_first_token":390046.944326476,"t_first_token_unix":1779820911.9582703,"t_done":390060.173651353,"t_done_unix":1779820925.187597},{"request_id":"1266668:11:1300918:260","session_id":"1266668","input_length":97811,"t_proxy_recv":390056.675577718,"t_decision_unix":1779820921.6895192,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9945711627526557,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":702,"cache_hit":4096,"new_prefill":93715,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":97811,"score_linear":43607.0,"score_lmetric":97811},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":97811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":80500,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":97811,"score_linear":80500.0,"score_lmetric":195622},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":97811,"score_linear":34706.0,"score_lmetric":97811},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59146,"ongoing_decode_tokens":59146,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":7680,"new_prefill":90131,"score_linear":51466.0,"score_lmetric":90131},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":822,"cache_hit":97280,"new_prefill":531,"score_linear":-97280.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":7680,"new_prefill":90131,"score_linear":22268.0,"score_lmetric":90131}],"chosen_score_linear":-97280.0,"chosen_score_lmetric":0,"t_first_token":390057.165649399,"t_first_token_unix":1779820922.1795928,"t_done":390060.279560145,"t_done_unix":1779820925.2935038},{"request_id":"1306347:1:1306347:291","session_id":"1306347","input_length":897,"t_proxy_recv":390060.057269878,"t_decision_unix":1779820925.071211,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18915,"ongoing_decode_tokens":18915,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":897,"score_linear":18915.0,"score_lmetric":897},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":897,"score_linear":43607.0,"score_lmetric":897},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":94457,"ongoing_decode_tokens":0,"pending_prefill_tokens":79609,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":897,"score_linear":94457.0,"score_lmetric":161012},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":926,"cache_hit":0,"new_prefill":897,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":897,"score_linear":34706.0,"score_lmetric":897},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":897,"score_linear":14027.0,"score_lmetric":897},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":897,"score_linear":97811.0,"score_lmetric":897},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":897,"score_linear":29948.0,"score_lmetric":897}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390060.131074029,"t_first_token_unix":1779820925.1450174,"t_done":390060.492747229,"t_done_unix":1779820925.50669},{"request_id":"1305906:1:1305906:289","session_id":"1305906","input_length":14027,"t_proxy_recv":390058.652902365,"t_decision_unix":1779820923.6668432,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":14027,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31710,"ongoing_decode_tokens":0,"pending_prefill_tokens":13278,"num_requests":2,"active_p_offloads":0,"cached_blocks":702,"cache_hit":0,"new_prefill":14027,"score_linear":31710.0,"score_lmetric":54610},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":14027,"score_linear":43607.0,"score_lmetric":14027},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":14027,"score_linear":75826.0,"score_lmetric":89853},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30995,"ongoing_decode_tokens":30995,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":926,"cache_hit":0,"new_prefill":14027,"score_linear":30995.0,"score_lmetric":14027},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95997,"ongoing_decode_tokens":95997,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":14027,"score_linear":95997.0,"score_lmetric":28054},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":14027,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":14027,"score_linear":97811.0,"score_lmetric":14027},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":14027,"score_linear":29948.0,"score_lmetric":14027}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390059.860469592,"t_first_token_unix":1779820924.8744133,"t_done":390060.88944896,"t_done_unix":1779820925.903392},{"request_id":"1299507:2:1305770:288","session_id":"1299507","input_length":18915,"t_proxy_recv":390058.23525355,"t_decision_unix":1779820923.2491949,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9744647105471848,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12795,"ongoing_decode_tokens":0,"pending_prefill_tokens":12795,"num_requests":1,"active_p_offloads":0,"cached_blocks":702,"cache_hit":18432,"new_prefill":483,"score_linear":-5637.0,"score_lmetric":13278},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":18915,"score_linear":43607.0,"score_lmetric":18915},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":18915,"score_linear":75826.0,"score_lmetric":94741},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30645,"ongoing_decode_tokens":30645,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":18915,"score_linear":30645.0,"score_lmetric":18915},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95997,"ongoing_decode_tokens":95997,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":18915,"score_linear":95997.0,"score_lmetric":37830},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59146,"ongoing_decode_tokens":59146,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":18915,"score_linear":59146.0,"score_lmetric":18915},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":11776,"new_prefill":7139,"score_linear":86035.0,"score_lmetric":7139},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":18915,"score_linear":29948.0,"score_lmetric":18915}],"chosen_score_linear":-5637.0,"chosen_score_lmetric":13278,"t_first_token":390059.144184441,"t_first_token_unix":1779820924.1581275,"t_done":390061.397708699,"t_done_unix":1779820926.4116518},{"request_id":"1277428:2:1306373:292","session_id":"1277428","input_length":31058,"t_proxy_recv":390060.167882445,"t_decision_unix":1779820925.181824,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27136,"affinity_cache_ratio":0.8737201365187713,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":3922,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18915,"ongoing_decode_tokens":18915,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":27136,"new_prefill":3922,"score_linear":-8221.0,"score_lmetric":3922},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":4608,"new_prefill":26450,"score_linear":38999.0,"score_lmetric":26450},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":94457,"ongoing_decode_tokens":0,"pending_prefill_tokens":79609,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":31058,"score_linear":94457.0,"score_lmetric":221334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":897,"ongoing_decode_tokens":897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":926,"cache_hit":17408,"new_prefill":13650,"score_linear":-16511.0,"score_lmetric":13650},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":31058,"score_linear":34706.0,"score_lmetric":31058},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":31058,"score_linear":14027.0,"score_lmetric":31058},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":31058,"score_linear":97811.0,"score_lmetric":31058},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":31058,"score_linear":29948.0,"score_lmetric":31058}],"chosen_score_linear":-8221.0,"chosen_score_lmetric":3922,"t_first_token":390061.040178637,"t_first_token_unix":1779820926.0541222,"t_done":390064.572961857,"t_done_unix":1779820929.5869048},{"request_id":"1253743:4:1307058:295","session_id":"1253743","input_length":49975,"t_proxy_recv":390062.613394178,"t_decision_unix":1779820927.6273332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9937768884442221,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":17408,"new_prefill":32567,"score_linear":13650.0,"score_lmetric":32567},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":4608,"new_prefill":45367,"score_linear":38999.0,"score_lmetric":45367},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":49975,"score_linear":108297.0,"score_lmetric":271488},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43378,"ongoing_decode_tokens":0,"pending_prefill_tokens":12658,"num_requests":1,"active_p_offloads":0,"cached_blocks":927,"cache_hit":49664,"new_prefill":311,"score_linear":-6286.0,"score_lmetric":12969},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":49975,"score_linear":34706.0,"score_lmetric":49975},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":49975,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":49975,"score_linear":121968.0,"score_lmetric":74151},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":0,"new_prefill":49975,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6286.0,"chosen_score_lmetric":12969,"t_first_token":390065.114382177,"t_first_token_unix":1779820930.1283255,"t_done":390065.723957052,"t_done_unix":1779820930.7379024},{"request_id":"1294611:7:1306822:293","session_id":"1294611","input_length":43378,"t_proxy_recv":390061.879877561,"t_decision_unix":1779820926.893819,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":30720,"affinity_cache_ratio":0.7081930932730878,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":12658,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":43378,"score_linear":31058.0,"score_lmetric":43378},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":43378,"score_linear":43607.0,"score_lmetric":43378},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":94457,"ongoing_decode_tokens":0,"pending_prefill_tokens":79609,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":43378,"score_linear":94457.0,"score_lmetric":122987},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":927,"cache_hit":30720,"new_prefill":12658,"score_linear":-30720.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":43378,"score_linear":34706.0,"score_lmetric":43378},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":12800,"new_prefill":30578,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":43378,"score_linear":121968.0,"score_lmetric":67554},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":12800,"new_prefill":30578,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":390065.03889787,"t_first_token_unix":1779820930.0528414,"t_done":390066.387122882,"t_done_unix":1779820931.401066},{"request_id":"1303517:2:1307703:297","session_id":"1303517","input_length":23131,"t_proxy_recv":390064.937643353,"t_decision_unix":1779820929.9515846,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":14848,"affinity_cache_ratio":0.6419091262807488,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":8283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":14848,"new_prefill":8283,"score_linear":-14848.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":23131,"score_linear":43607.0,"score_lmetric":23131},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":23131,"score_linear":108297.0,"score_lmetric":217800},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":93353,"ongoing_decode_tokens":0,"pending_prefill_tokens":12969,"num_requests":2,"active_p_offloads":0,"cached_blocks":927,"cache_hit":0,"new_prefill":23131,"score_linear":93353.0,"score_lmetric":72200},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":23131,"score_linear":34706.0,"score_lmetric":23131},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":23131,"score_linear":59446.0,"score_lmetric":23131},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":23131,"score_linear":121968.0,"score_lmetric":47307},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":0,"new_prefill":23131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":390066.182322036,"t_first_token_unix":1779820931.1962657,"t_done":390066.56536191,"t_done_unix":1779820931.579305},{"request_id":"1302449:3:1308121:299","session_id":"1302449","input_length":8729,"t_proxy_recv":390066.344393537,"t_decision_unix":1779820931.358335,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":7,"affinity_cache_hit":3584,"affinity_cache_ratio":0.41058540497193263,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":7705,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23131,"ongoing_decode_tokens":23131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":735,"cache_hit":0,"new_prefill":8729,"score_linear":23131.0,"score_lmetric":8729},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":8729,"score_linear":43607.0,"score_lmetric":8729},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":8729,"score_linear":108297.0,"score_lmetric":188996},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43378,"ongoing_decode_tokens":43378,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":927,"cache_hit":0,"new_prefill":8729,"score_linear":43378.0,"score_lmetric":8729},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96211,"ongoing_decode_tokens":34706,"pending_prefill_tokens":577,"num_requests":2,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":8729,"score_linear":96211.0,"score_lmetric":18612},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":637,"cache_hit":3584,"new_prefill":5145,"score_linear":55862.0,"score_lmetric":5145},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":8729,"score_linear":121968.0,"score_lmetric":32905},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":1024,"new_prefill":7705,"score_linear":-1024.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":390066.911891051,"t_first_token_unix":1779820931.9258344,"t_done":390066.993730363,"t_done_unix":1779820932.0076733},{"request_id":"1279412:10:1308091:298","session_id":"1279412","input_length":61505,"t_proxy_recv":390066.248010702,"t_decision_unix":1779820931.261952,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9906186488903341,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":577,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23131,"ongoing_decode_tokens":23131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":735,"cache_hit":0,"new_prefill":61505,"score_linear":23131.0,"score_lmetric":61505},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":61505,"score_linear":43607.0,"score_lmetric":61505},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":61505,"score_linear":108297.0,"score_lmetric":294548},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43378,"ongoing_decode_tokens":43378,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":927,"cache_hit":0,"new_prefill":61505,"score_linear":43378.0,"score_lmetric":61505},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":60928,"new_prefill":577,"score_linear":-26222.0,"score_lmetric":577},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":61505,"score_linear":59446.0,"score_lmetric":61505},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":61505,"score_linear":121968.0,"score_lmetric":85681},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":12800,"new_prefill":48705,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-26222.0,"chosen_score_lmetric":577,"t_first_token":390066.414047846,"t_first_token_unix":1779820931.4279907,"t_done":390067.460161926,"t_done_unix":1779820932.4741054},{"request_id":"1269373:11:1307381:296","session_id":"1269373","input_length":59446,"t_proxy_recv":390063.784918616,"t_decision_unix":1779820928.7988598,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9904787538270027,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":4096,"new_prefill":55350,"score_linear":26962.0,"score_lmetric":55350},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":59446,"score_linear":43607.0,"score_lmetric":59446},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":59446,"score_linear":108297.0,"score_lmetric":290430},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":93353,"ongoing_decode_tokens":0,"pending_prefill_tokens":12969,"num_requests":2,"active_p_offloads":0,"cached_blocks":927,"cache_hit":0,"new_prefill":59446,"score_linear":93353.0,"score_lmetric":144830},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":59446,"score_linear":34706.0,"score_lmetric":59446},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":58880,"new_prefill":566,"score_linear":-58880.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":14848,"new_prefill":44598,"score_linear":107120.0,"score_lmetric":68774},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":7680,"new_prefill":51766,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":390063.92724532,"t_first_token_unix":1779820928.941189,"t_done":390068.009204842,"t_done_unix":1779820933.0231483},{"request_id":"1303651:3:1308202:300","session_id":"1303651","input_length":22896,"t_proxy_recv":390066.6005951,"t_decision_unix":1779820931.6145368,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":12800,"affinity_cache_ratio":0.5590496156533893,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":10096,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":751,"cache_hit":12800,"new_prefill":10096,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":22896,"score_linear":43607.0,"score_lmetric":22896},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":22896,"score_linear":108297.0,"score_lmetric":217330},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":22896,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96211,"ongoing_decode_tokens":96211,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":22896,"score_linear":96211.0,"score_lmetric":45792},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59446,"ongoing_decode_tokens":59446,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":22896,"score_linear":59446.0,"score_lmetric":22896},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":22896,"score_linear":121968.0,"score_lmetric":47072},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":8729,"ongoing_decode_tokens":0,"pending_prefill_tokens":7705,"num_requests":1,"active_p_offloads":0,"cached_blocks":735,"cache_hit":3072,"new_prefill":19824,"score_linear":5657.0,"score_lmetric":27529}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":390068.165155707,"t_first_token_unix":1779820933.1790993,"t_done":390068.241911593,"t_done_unix":1779820933.2558546},{"request_id":"1301929:1:1301929:265","session_id":"1301929","input_length":34706,"t_proxy_recv":390044.402998554,"t_decision_unix":1779820909.41694,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":34706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28972,"ongoing_decode_tokens":0,"pending_prefill_tokens":18220,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":3584,"new_prefill":31122,"score_linear":25388.0,"score_lmetric":49342},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":69555,"ongoing_decode_tokens":0,"pending_prefill_tokens":44467,"num_requests":2,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":34706,"score_linear":69555.0,"score_lmetric":158346},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23863,"ongoing_decode_tokens":23863,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":912,"cache_hit":0,"new_prefill":34706,"score_linear":23863.0,"score_lmetric":34706},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":34706,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54451,"ongoing_decode_tokens":54451,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":34706,"score_linear":54451.0,"score_lmetric":34706},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":202353,"ongoing_decode_tokens":202353,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":564,"cache_hit":0,"new_prefill":34706,"score_linear":202353.0,"score_lmetric":69412},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43181,"ongoing_decode_tokens":43181,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":34706,"score_linear":43181.0,"score_lmetric":34706}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390049.455868918,"t_first_token_unix":1779820914.4698148,"t_done":390069.21527907,"t_done_unix":1779820934.2292228},{"request_id":"1303517:3:1309213:303","session_id":"1303517","input_length":23259,"t_proxy_recv":390070.343506365,"t_decision_unix":1779820935.3574479,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9905842899522765,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":23040,"new_prefill":219,"score_linear":-23040.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":23259,"score_linear":43607.0,"score_lmetric":23259},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":23259,"score_linear":108297.0,"score_lmetric":218056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43710,"ongoing_decode_tokens":43710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":23259,"score_linear":43710.0,"score_lmetric":23259},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":757,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4679,"ongoing_decode_tokens":4679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":639,"cache_hit":0,"new_prefill":23259,"score_linear":4679.0,"score_lmetric":23259},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":23259,"score_linear":121968.0,"score_lmetric":47435},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":23259,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":390070.414255946,"t_first_token_unix":1779820935.428199,"t_done":390070.466081321,"t_done_unix":1779820935.4800243},{"request_id":"1309040:1:1309040:302","session_id":"1309040","input_length":4679,"t_proxy_recv":390069.716071585,"t_decision_unix":1779820934.7300134,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4679,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":4679,"score_linear":43607.0,"score_lmetric":4679},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":4679,"score_linear":108297.0,"score_lmetric":180896},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43710,"ongoing_decode_tokens":43710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":4679,"score_linear":43710.0,"score_lmetric":4679},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":757,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":639,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":4679,"score_linear":121968.0,"score_lmetric":28855},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":4679,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390070.011282923,"t_first_token_unix":1779820935.0252264,"t_done":390070.499800252,"t_done_unix":1779820935.5137434},{"request_id":"1294611:8:1308970:301","session_id":"1294611","input_length":43710,"t_proxy_recv":390069.386612725,"t_decision_unix":1779820934.400553,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9956531686113017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":43710,"score_linear":43607.0,"score_lmetric":43710},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":43710,"score_linear":108297.0,"score_lmetric":258958},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":43520,"new_prefill":190,"score_linear":-43520.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":757,"cache_hit":0,"new_prefill":43710,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":639,"cache_hit":12800,"new_prefill":30910,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":43710,"score_linear":121968.0,"score_lmetric":67886},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":12800,"new_prefill":30910,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":390069.553916783,"t_first_token_unix":1779820934.5678604,"t_done":390070.804062608,"t_done_unix":1779820935.818006},{"request_id":"1309252:1:1309252:304","session_id":"1309252","input_length":24545,"t_proxy_recv":390070.565154951,"t_decision_unix":1779820935.5790966,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24545,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":24545,"score_linear":43607.0,"score_lmetric":24545},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":24545,"score_linear":108297.0,"score_lmetric":220628},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43710,"ongoing_decode_tokens":43710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":24545,"score_linear":43710.0,"score_lmetric":24545},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":757,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":24545,"score_linear":121968.0,"score_lmetric":48721},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":24545,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390073.380516779,"t_first_token_unix":1779820938.394461,"t_done":390075.232027274,"t_done_unix":1779820940.245972},{"request_id":"1279412:11:1310014:305","session_id":"1279412","input_length":64558,"t_proxy_recv":390073.189205825,"t_decision_unix":1779820938.203147,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9517023451779795,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":3118,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":64558,"score_linear":43607.0,"score_lmetric":64558},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":64558,"score_linear":108297.0,"score_lmetric":300654},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":757,"cache_hit":61440,"new_prefill":3118,"score_linear":-61440.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":64558,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":64558,"score_linear":121968.0,"score_lmetric":88734},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24545,"ongoing_decode_tokens":0,"pending_prefill_tokens":24545,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":12800,"new_prefill":51758,"score_linear":11745.0,"score_lmetric":76303}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":390074.50377931,"t_first_token_unix":1779820939.5177267,"t_done":390075.881947192,"t_done_unix":1779820940.8958907},{"request_id":"1310590:1:1310590:306","session_id":"1310590","input_length":18089,"t_proxy_recv":390075.132120909,"t_decision_unix":1779820940.1460624,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18089,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":18089,"score_linear":43607.0,"score_lmetric":18089},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":18089,"score_linear":108297.0,"score_lmetric":207716},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":64558,"ongoing_decode_tokens":64558,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":757,"cache_hit":0,"new_prefill":18089,"score_linear":64558.0,"score_lmetric":18089},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":18089,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":18089,"score_linear":121968.0,"score_lmetric":42265},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24545,"ongoing_decode_tokens":24545,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":750,"cache_hit":0,"new_prefill":18089,"score_linear":24545.0,"score_lmetric":18089}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390076.93514746,"t_first_token_unix":1779820941.949091,"t_done":390077.419188929,"t_done_unix":1779820942.433132},{"request_id":"1303462:2:1306126:290","session_id":"1303462","input_length":18631,"t_proxy_recv":390059.270453484,"t_decision_unix":1779820924.284395,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14848,"affinity_cache_ratio":0.7969513176963126,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":3783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18915,"ongoing_decode_tokens":18915,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":18631,"score_linear":18915.0,"score_lmetric":18631},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":18631,"score_linear":43607.0,"score_lmetric":18631},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":75826,"ongoing_decode_tokens":0,"pending_prefill_tokens":75826,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":14848,"new_prefill":3783,"score_linear":60978.0,"score_lmetric":79609},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30995,"ongoing_decode_tokens":30995,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":926,"cache_hit":0,"new_prefill":18631,"score_linear":30995.0,"score_lmetric":18631},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":18631,"score_linear":34706.0,"score_lmetric":18631},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":0,"pending_prefill_tokens":14027,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":0,"new_prefill":18631,"score_linear":14027.0,"score_lmetric":32658},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":97811,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":18631,"score_linear":97811.0,"score_lmetric":18631},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":18631,"score_linear":29948.0,"score_lmetric":18631}],"chosen_score_linear":60978.0,"chosen_score_lmetric":79609,"t_first_token":390077.299143415,"t_first_token_unix":1779820942.3130865,"t_done":390077.707504487,"t_done_unix":1779820942.7214477},{"request_id":"1304239:3:1307007:294","session_id":"1304239","input_length":13840,"t_proxy_recv":390062.410882078,"t_decision_unix":1779820927.4248235,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":7680,"affinity_cache_ratio":0.5549132947976878,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":6160,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31058,"ongoing_decode_tokens":31058,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":727,"cache_hit":0,"new_prefill":13840,"score_linear":31058.0,"score_lmetric":13840},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":13840,"score_linear":43607.0,"score_lmetric":13840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":94457,"ongoing_decode_tokens":0,"pending_prefill_tokens":79609,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":7680,"new_prefill":6160,"score_linear":86777.0,"score_lmetric":85769},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":43378,"ongoing_decode_tokens":0,"pending_prefill_tokens":12658,"num_requests":1,"active_p_offloads":0,"cached_blocks":927,"cache_hit":0,"new_prefill":13840,"score_linear":43378.0,"score_lmetric":26498},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":13840,"score_linear":34706.0,"score_lmetric":13840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":637,"cache_hit":0,"new_prefill":13840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":0,"pending_prefill_tokens":24176,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":13840,"score_linear":121968.0,"score_lmetric":38016},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":0,"new_prefill":13840,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":86777.0,"chosen_score_lmetric":85769,"t_first_token":390077.638620778,"t_first_token_unix":1779820942.6525717,"t_done":390077.950342452,"t_done_unix":1779820942.9642875},{"request_id":"1305420:1:1305420:285","session_id":"1305420","input_length":75826,"t_proxy_recv":390056.86472935,"t_decision_unix":1779820921.8786707,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":75826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":702,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":75826,"score_linear":43607.0,"score_lmetric":75826},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":75826,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80500,"ongoing_decode_tokens":80500,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":916,"cache_hit":0,"new_prefill":75826,"score_linear":80500.0,"score_lmetric":151652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":75826,"score_linear":34706.0,"score_lmetric":75826},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59146,"ongoing_decode_tokens":59146,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":602,"cache_hit":0,"new_prefill":75826,"score_linear":59146.0,"score_lmetric":75826},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":97811,"ongoing_decode_tokens":0,"pending_prefill_tokens":531,"num_requests":1,"active_p_offloads":0,"cached_blocks":822,"cache_hit":0,"new_prefill":75826,"score_linear":97811.0,"score_lmetric":76357},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29948,"ongoing_decode_tokens":29948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":733,"cache_hit":0,"new_prefill":75826,"score_linear":29948.0,"score_lmetric":75826}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390077.298090631,"t_first_token_unix":1779820942.312034,"t_done":390078.341806653,"t_done_unix":1779820943.3557498},{"request_id":"1304943:2:1311189:307","session_id":"1304943","input_length":13164,"t_proxy_recv":390077.261562,"t_decision_unix":1779820942.275503,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":2560,"affinity_cache_ratio":0.19446976602856275,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":10604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":770,"cache_hit":2560,"new_prefill":10604,"score_linear":-2560.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":13164,"score_linear":43607.0,"score_lmetric":13164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":0,"pending_prefill_tokens":85769,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":13164,"score_linear":108297.0,"score_lmetric":197866},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":18089,"ongoing_decode_tokens":18089,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":648,"cache_hit":0,"new_prefill":13164,"score_linear":18089.0,"score_lmetric":13164},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":13164,"score_linear":121968.0,"score_lmetric":13164},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":13164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":390078.227717277,"t_first_token_unix":1779820943.2416606,"t_done":390078.580400847,"t_done_unix":1779820943.594344},{"request_id":"1303517:4:1311293:308","session_id":"1303517","input_length":24638,"t_proxy_recv":390077.577307455,"t_decision_unix":1779820942.591249,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9351408393538436,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1598,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":13164,"ongoing_decode_tokens":0,"pending_prefill_tokens":10604,"num_requests":1,"active_p_offloads":0,"cached_blocks":770,"cache_hit":23040,"new_prefill":1598,"score_linear":-9876.0,"score_lmetric":12202},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":24638,"score_linear":43607.0,"score_lmetric":24638},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108297,"ongoing_decode_tokens":94457,"pending_prefill_tokens":6160,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":24638,"score_linear":108297.0,"score_lmetric":61596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":24638,"score_linear":121968.0,"score_lmetric":24638},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":24638,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9876.0,"chosen_score_lmetric":12202,"t_first_token":390078.522169231,"t_first_token_unix":1779820943.5361125,"t_done":390078.704435836,"t_done_unix":1779820943.7183788},{"request_id":"1297811:2:1300578:258","session_id":"1297811","input_length":43607,"t_proxy_recv":390039.745829077,"t_decision_unix":1779820904.7597704,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":1,"affinity_cache_hit":13824,"affinity_cache_ratio":0.3170133235489715,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":43607,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":18893,"ongoing_decode_tokens":18893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":564,"cache_hit":13824,"new_prefill":29783,"score_linear":5069.0,"score_lmetric":29783},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":724,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":76627,"ongoing_decode_tokens":0,"pending_prefill_tokens":43859,"num_requests":2,"active_p_offloads":0,"cached_blocks":773,"cache_hit":1536,"new_prefill":42071,"score_linear":75091.0,"score_lmetric":171860},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":95364,"ongoing_decode_tokens":0,"pending_prefill_tokens":64644,"num_requests":3,"active_p_offloads":0,"cached_blocks":787,"cache_hit":0,"new_prefill":43607,"score_linear":95364.0,"score_lmetric":324753},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":686,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":575,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":223983,"ongoing_decode_tokens":223983,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":547,"cache_hit":0,"new_prefill":43607,"score_linear":223983.0,"score_lmetric":130821},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":722,"cache_hit":0,"new_prefill":43607,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390047.26164783,"t_first_token_unix":1779820912.2755914,"t_done":390079.24809154,"t_done_unix":1779820944.262035},{"request_id":"1277428:3:1311644:311","session_id":"1277428","input_length":31611,"t_proxy_recv":390078.884520331,"t_decision_unix":1779820943.898462,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9880105026731201,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":379,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":31232,"new_prefill":379,"score_linear":-31232.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":4608,"new_prefill":27003,"score_linear":38999.0,"score_lmetric":27003},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":-31611},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8996,"ongoing_decode_tokens":0,"pending_prefill_tokens":292,"num_requests":1,"active_p_offloads":0,"cached_blocks":952,"cache_hit":17408,"new_prefill":14203,"score_linear":-8412.0,"score_lmetric":14495},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":31611,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":31611,"score_linear":121968.0,"score_lmetric":31611},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":31611,"score_linear":44792.0,"score_lmetric":51827}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":390078.948271433,"t_first_token_unix":1779820943.9622147,"t_done":390079.285885852,"t_done_unix":1779820944.2998288},{"request_id":"1258908:2:1311606:310","session_id":"1258908","input_length":8996,"t_proxy_recv":390078.706173987,"t_decision_unix":1779820943.7201157,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9675411293908404,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":8996,"score_linear":43607.0,"score_lmetric":8996},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":-8996},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":8704,"new_prefill":292,"score_linear":-8704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":8996,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":8996,"score_linear":121968.0,"score_lmetric":8996},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":8996,"score_linear":44792.0,"score_lmetric":29212}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":390079.383518507,"t_first_token_unix":1779820944.3974621,"t_done":390081.257229135,"t_done_unix":1779820946.2711723},{"request_id":"1311753:1:1311753:312","session_id":"1311753","input_length":20175,"t_proxy_recv":390079.278055653,"t_decision_unix":1779820944.2919972,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-20175,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":20175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31611,"ongoing_decode_tokens":31611,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":20175,"score_linear":31611.0,"score_lmetric":20175},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":-20175},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8996,"ongoing_decode_tokens":0,"pending_prefill_tokens":292,"num_requests":1,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":20175,"score_linear":8996.0,"score_lmetric":20467},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":20175,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":20175,"score_linear":121968.0,"score_lmetric":20175},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":20175,"score_linear":44792.0,"score_lmetric":40391}],"chosen_score_linear":0.0,"chosen_score_lmetric":-20175,"t_first_token":390081.377283176,"t_first_token_unix":1779820946.3912265,"t_done":390081.552378567,"t_done_unix":1779820946.5663216},{"request_id":"1294611:9:1312398:313","session_id":"1294611","input_length":44335,"t_proxy_recv":390081.561955118,"t_decision_unix":1779820946.5758965,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9816172324348709,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":815,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1166,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":-44335},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":953,"cache_hit":43520,"new_prefill":815,"score_linear":-43520.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":44335,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":12800,"new_prefill":31535,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":44335,"score_linear":121968.0,"score_lmetric":44335},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":12800,"new_prefill":31535,"score_linear":31992.0,"score_lmetric":51751}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":390081.807721149,"t_first_token_unix":1779820946.8216646,"t_done":390083.091204804,"t_done_unix":1779820948.1051538},{"request_id":"1303517:5:1313040:317","session_id":"1303517","input_length":25637,"t_proxy_recv":390083.624432247,"t_decision_unix":1779820948.6383734,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9586145024768888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":1061,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":24576,"new_prefill":1061,"score_linear":-24576.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13360,"ongoing_decode_tokens":13360,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1166,"cache_hit":0,"new_prefill":25637,"score_linear":13360.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":954,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":25637,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":62840,"ongoing_decode_tokens":0,"pending_prefill_tokens":2936,"num_requests":1,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":25637,"score_linear":62840.0,"score_lmetric":28573},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":148853,"ongoing_decode_tokens":148853,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":25637,"score_linear":148853.0,"score_lmetric":51274},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":44792,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":25637,"score_linear":44792.0,"score_lmetric":25637}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390083.89587534,"t_first_token_unix":1779820948.9098191,"t_done":390083.929132403,"t_done_unix":1779820948.943076},{"request_id":"1309252:2:1311531:309","session_id":"1309252","input_length":44792,"t_proxy_recv":390078.476086942,"t_decision_unix":1779820943.4900284,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24576,"affinity_cache_ratio":0.5486694052509377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":20216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":37802,"ongoing_decode_tokens":13164,"pending_prefill_tokens":1598,"num_requests":2,"active_p_offloads":0,"cached_blocks":770,"cache_hit":0,"new_prefill":44792,"score_linear":37802.0,"score_lmetric":92780},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":44792,"score_linear":43607.0,"score_lmetric":44792},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":-44792},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":952,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":44792,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":44792,"score_linear":121968.0,"score_lmetric":44792},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":798,"cache_hit":24576,"new_prefill":20216,"score_linear":-24576.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390083.354980332,"t_first_token_unix":1779820948.368924,"t_done":390084.028477512,"t_done_unix":1779820949.0424213},{"request_id":"1306347:2:1312642:314","session_id":"1306347","input_length":13360,"t_proxy_recv":390082.451918537,"t_decision_unix":1779820947.46586,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":2,"affinity_cache_hit":512,"affinity_cache_ratio":0.03832335329341317,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":-13360,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1166,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":-13360},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":512,"new_prefill":12848,"score_linear":43823.0,"score_lmetric":12848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":13360,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":13360,"score_linear":121968.0,"score_lmetric":13360},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":13360,"score_linear":44792.0,"score_lmetric":33576}],"chosen_score_linear":0.0,"chosen_score_lmetric":-13360,"t_first_token":390083.584893925,"t_first_token_unix":1779820948.5988376,"t_done":390084.124406783,"t_done_unix":1779820949.1383502},{"request_id":"1268861:4:1312689:315","session_id":"1268861","input_length":26885,"t_proxy_recv":390082.620040277,"t_decision_unix":1779820947.6339817,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":21504,"affinity_cache_ratio":0.7998512181513855,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":5381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13360,"ongoing_decode_tokens":0,"pending_prefill_tokens":13360,"num_requests":0,"active_p_offloads":0,"cached_blocks":1166,"cache_hit":0,"new_prefill":26885,"score_linear":13360.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":26885,"score_linear":44335.0,"score_lmetric":26885},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":26885,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":823,"cache_hit":21504,"new_prefill":5381,"score_linear":100464.0,"score_lmetric":5381},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":0,"new_prefill":26885,"score_linear":44792.0,"score_lmetric":47101}],"chosen_score_linear":100464.0,"chosen_score_lmetric":5381,"t_first_token":390083.59383158,"t_first_token_unix":1779820948.607775,"t_done":390086.330520955,"t_done_unix":1779820951.344464},{"request_id":"1279412:12:1313518:319","session_id":"1279412","input_length":64755,"t_proxy_recv":390085.36250803,"t_decision_unix":1779820950.3764496,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9962473940236275,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":243,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":22686,"ongoing_decode_tokens":0,"pending_prefill_tokens":22686,"num_requests":0,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":64755,"score_linear":22686.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":954,"cache_hit":0,"new_prefill":64755,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":64512,"new_prefill":243,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":62840,"ongoing_decode_tokens":62840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":64755,"score_linear":62840.0,"score_lmetric":64755},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":148853,"ongoing_decode_tokens":148853,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":64755,"score_linear":148853.0,"score_lmetric":129510},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":12800,"new_prefill":51955,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-64512.0,"chosen_score_lmetric":0,"t_first_token":390085.473637864,"t_first_token_unix":1779820950.4875813,"t_done":390086.774869364,"t_done_unix":1779820951.7888126},{"request_id":"1269373:12:1312836:316","session_id":"1269373","input_length":62840,"t_proxy_recv":390082.99210187,"t_decision_unix":1779820948.0060432,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":59904,"affinity_cache_ratio":0.9532781667727562,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59904,"estimated_new_tokens":2936,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":793,"cache_hit":4096,"new_prefill":58744,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":62840,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":13360,"ongoing_decode_tokens":0,"pending_prefill_tokens":13360,"num_requests":0,"active_p_offloads":0,"cached_blocks":1166,"cache_hit":0,"new_prefill":62840,"score_linear":13360.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":44335,"ongoing_decode_tokens":44335,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":953,"cache_hit":0,"new_prefill":62840,"score_linear":44335.0,"score_lmetric":62840},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":62840,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":683,"cache_hit":59904,"new_prefill":2936,"score_linear":-59904.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":148853,"ongoing_decode_tokens":121968,"pending_prefill_tokens":5381,"num_requests":2,"active_p_offloads":0,"cached_blocks":823,"cache_hit":14848,"new_prefill":47992,"score_linear":134005.0,"score_lmetric":106746},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":44792,"ongoing_decode_tokens":0,"pending_prefill_tokens":20216,"num_requests":1,"active_p_offloads":0,"cached_blocks":798,"cache_hit":7680,"new_prefill":55160,"score_linear":37112.0,"score_lmetric":75376}],"chosen_score_linear":-59904.0,"chosen_score_lmetric":0,"t_first_token":390084.259905644,"t_first_token_unix":1779820949.2738488,"t_done":390087.350196173,"t_done_unix":1779820952.3641396},{"request_id":"1313181:1:1313181:318","session_id":"1313181","input_length":22686,"t_proxy_recv":390084.24059095,"t_decision_unix":1779820949.254532,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-22686,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":22686,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":-22686},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":954,"cache_hit":0,"new_prefill":22686,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":12800,"new_prefill":9886,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":62840,"ongoing_decode_tokens":0,"pending_prefill_tokens":2936,"num_requests":1,"active_p_offloads":0,"cached_blocks":683,"cache_hit":0,"new_prefill":22686,"score_linear":62840.0,"score_lmetric":25622},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":148853,"ongoing_decode_tokens":148853,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":823,"cache_hit":0,"new_prefill":22686,"score_linear":148853.0,"score_lmetric":45372},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":12800,"new_prefill":9886,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":-22686,"t_first_token":390086.742420704,"t_first_token_unix":1779820951.7563653,"t_done":390087.400903736,"t_done_unix":1779820952.414847},{"request_id":"1294611:10:1314495:322","session_id":"1294611","input_length":45362,"t_proxy_recv":390089.018024221,"t_decision_unix":1779820954.0319655,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":44032,"affinity_cache_ratio":0.970680305101186,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":57051,"num_requests":0,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":45362,"score_linear":57051.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":954,"cache_hit":44032,"new_prefill":1330,"score_linear":-44032.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":45362,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":12800,"new_prefill":32562,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":45362,"score_linear":121968.0,"score_lmetric":45362},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":12800,"new_prefill":32562,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":390089.366439058,"t_first_token_unix":1779820954.3803828,"t_done":390090.817347192,"t_done_unix":1779820955.8312905},{"request_id":"1315313:1:1315313:325","session_id":"1315313","input_length":7,"t_proxy_recv":390091.661126982,"t_decision_unix":1779820956.6750684,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":7,"score_linear":81357.0,"score_lmetric":58836},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":7,"score_linear":32440.0,"score_lmetric":14527},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":7,"score_linear":121968.0,"score_lmetric":7},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":7,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390091.676073323,"t_first_token_unix":1779820956.6900167,"t_done":390091.680285397,"t_done_unix":1779820956.694228},{"request_id":"1310590:2:1315212:324","session_id":"1310590","input_length":32440,"t_proxy_recv":390091.310059695,"t_decision_unix":1779820956.3240008,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":17920,"affinity_cache_ratio":0.5524044389642416,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":14520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":32440,"score_linear":81357.0,"score_lmetric":91269},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":17920,"new_prefill":14520,"score_linear":-17920.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":32440,"score_linear":121968.0,"score_lmetric":32440},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":32440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":390094.023127397,"t_first_token_unix":1779820959.0370708,"t_done":390094.169681953,"t_done_unix":1779820959.183631},{"request_id":"1309040:2:1315488:326","session_id":"1309040","input_length":23097,"t_proxy_recv":390092.381357751,"t_decision_unix":1779820957.3952987,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":1,"affinity_cache_hit":4608,"affinity_cache_ratio":0.1995064294064164,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":23097,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":23097,"score_linear":81357.0,"score_lmetric":81926},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":4608,"new_prefill":18489,"score_linear":27832.0,"score_lmetric":33009},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":23097,"score_linear":121968.0,"score_lmetric":23097},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":23097,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390094.949518607,"t_first_token_unix":1779820959.963462,"t_done":390095.308181964,"t_done_unix":1779820960.3221257},{"request_id":"1279412:13:1315780:328","session_id":"1279412","input_length":64949,"t_proxy_recv":390093.448901776,"t_decision_unix":1779820958.4628432,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9932716439052179,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":23097,"num_requests":1,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":64949,"score_linear":23097.0,"score_lmetric":88046},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":12800,"new_prefill":52149,"score_linear":68557.0,"score_lmetric":110978},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":64949,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":64512,"new_prefill":437,"score_linear":-64512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":64949,"score_linear":32440.0,"score_lmetric":79469},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":64949,"score_linear":121968.0,"score_lmetric":64949},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":16960,"ongoing_decode_tokens":0,"pending_prefill_tokens":9280,"num_requests":1,"active_p_offloads":0,"cached_blocks":837,"cache_hit":12800,"new_prefill":52149,"score_linear":4160.0,"score_lmetric":61429}],"chosen_score_linear":-64512.0,"chosen_score_lmetric":0,"t_first_token":390093.584162071,"t_first_token_unix":1779820958.598106,"t_done":390096.174125513,"t_done_unix":1779820961.1880689},{"request_id":"1315567:1:1315567:327","session_id":"1315567","input_length":16960,"t_proxy_recv":390092.652472126,"t_decision_unix":1779820957.6664135,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":9280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":4096,"new_prefill":12864,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":23097,"num_requests":1,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":16960,"score_linear":23097.0,"score_lmetric":40057},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":16960,"score_linear":81357.0,"score_lmetric":75789},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":16960,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":32440,"ongoing_decode_tokens":0,"pending_prefill_tokens":14520,"num_requests":1,"active_p_offloads":0,"cached_blocks":689,"cache_hit":7680,"new_prefill":9280,"score_linear":24760.0,"score_lmetric":23800},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":7680,"new_prefill":9280,"score_linear":114288.0,"score_lmetric":9280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":7680,"new_prefill":9280,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":390093.763054089,"t_first_token_unix":1779820958.7769976,"t_done":390096.833222935,"t_done_unix":1779820961.8471673},{"request_id":"1316848:1:1316848:331","session_id":"1316848","input_length":5985,"t_proxy_recv":390097.002416873,"t_decision_unix":1779820962.0163581,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":4961,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":1024,"new_prefill":4961,"score_linear":-1024.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":5985,"score_linear":81357.0,"score_lmetric":64814},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":24487,"ongoing_decode_tokens":0,"pending_prefill_tokens":24487,"num_requests":1,"active_p_offloads":0,"cached_blocks":717,"cache_hit":0,"new_prefill":5985,"score_linear":24487.0,"score_lmetric":30472},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":5985,"score_linear":121968.0,"score_lmetric":5985},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":5985,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":390097.344857459,"t_first_token_unix":1779820962.3588014,"t_done":390097.527200074,"t_done_unix":1779820962.5411432},{"request_id":"1316201:1:1316201:329","session_id":"1316201","input_length":24487,"t_proxy_recv":390094.915374494,"t_decision_unix":1779820959.9293156,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24487,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":23097,"ongoing_decode_tokens":0,"pending_prefill_tokens":23097,"num_requests":1,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":24487,"score_linear":23097.0,"score_lmetric":47584},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":24487,"score_linear":81357.0,"score_lmetric":83316},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":64949,"ongoing_decode_tokens":64949,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":24487,"score_linear":64949.0,"score_lmetric":24487},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":717,"cache_hit":0,"new_prefill":24487,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":24487,"score_linear":121968.0,"score_lmetric":24487},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":16960,"ongoing_decode_tokens":16960,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":24487,"score_linear":16960.0,"score_lmetric":24487}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390097.706205149,"t_first_token_unix":1779820962.7201486,"t_done":390097.994830649,"t_done_unix":1779820963.0087736},{"request_id":"1317160:1:1317160:332","session_id":"1317160","input_length":3441,"t_proxy_recv":390098.157388592,"t_decision_unix":1779820963.17133,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":3441,"score_linear":81357.0,"score_lmetric":62270},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":3441,"score_linear":121968.0,"score_lmetric":3441},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":3441,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390098.369700609,"t_first_token_unix":1779820963.383644,"t_done":390098.524673999,"t_done_unix":1779820963.5386171},{"request_id":"1316848:2:1317438:333","session_id":"1316848","input_length":6040,"t_proxy_recv":390099.239088481,"t_decision_unix":1779820964.2530298,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":5632,"affinity_cache_ratio":0.9324503311258279,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":408,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":5632,"new_prefill":408,"score_linear":-5632.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":6040,"score_linear":81357.0,"score_lmetric":64869},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":6040,"score_linear":121968.0,"score_lmetric":6040},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":6040,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5632.0,"chosen_score_lmetric":0,"t_first_token":390099.266369273,"t_first_token_unix":1779820964.2803125,"t_done":390099.672119078,"t_done_unix":1779820964.686062},{"request_id":"1317160:2:1317773:336","session_id":"1317160","input_length":7440,"t_proxy_recv":390100.555691183,"t_decision_unix":1779820965.5696325,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":3072,"affinity_cache_ratio":0.4129032258064516,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":4368,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":801,"cache_hit":3072,"new_prefill":4368,"score_linear":-3072.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":57051,"pending_prefill_tokens":1778,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":7440,"score_linear":81357.0,"score_lmetric":9218},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":7440,"score_linear":79663.0,"score_lmetric":86591},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":0,"pending_prefill_tokens":3159,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":7440,"score_linear":66135.0,"score_lmetric":10599},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":7440,"score_linear":121968.0,"score_lmetric":7440},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-3072.0,"chosen_score_lmetric":0,"t_first_token":390100.889510759,"t_first_token_unix":1779820965.9034543,"t_done":390101.013362301,"t_done_unix":1779820966.0273051},{"request_id":"1313181:2:1314940:323","session_id":"1313181","input_length":24306,"t_proxy_recv":390090.439641302,"t_decision_unix":1779820955.453583,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":22528,"affinity_cache_ratio":0.9268493376121122,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":1778,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":57051,"ongoing_decode_tokens":0,"pending_prefill_tokens":57051,"num_requests":0,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":22528,"new_prefill":1778,"score_linear":34523.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45362,"ongoing_decode_tokens":45362,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":954,"cache_hit":0,"new_prefill":24306,"score_linear":45362.0,"score_lmetric":24306},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":12800,"new_prefill":11506,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":24306,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":24306,"score_linear":121968.0,"score_lmetric":24306},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":12800,"new_prefill":11506,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":34523.0,"chosen_score_lmetric":0,"t_first_token":390100.599034675,"t_first_token_unix":1779820965.6129782,"t_done":390101.536538001,"t_done_unix":1779820966.550481},{"request_id":"1318031:1:1318031:338","session_id":"1318031","input_length":5219,"t_proxy_recv":390101.217965321,"t_decision_unix":1779820966.231907,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":81357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":5219,"score_linear":81357.0,"score_lmetric":5219},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":5219,"score_linear":79663.0,"score_lmetric":84370},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":90903,"ongoing_decode_tokens":90903,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":5219,"score_linear":90903.0,"score_lmetric":10438},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":5219,"score_linear":121968.0,"score_lmetric":5219},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":5219,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390101.555557151,"t_first_token_unix":1779820966.569501,"t_done":390101.774900261,"t_done_unix":1779820966.7888448},{"request_id":"1316201:2:1317776:337","session_id":"1316201","input_length":24768,"t_proxy_recv":390100.574811728,"t_decision_unix":1779820965.5887532,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9715762273901809,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":704,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":7440,"ongoing_decode_tokens":0,"pending_prefill_tokens":4368,"num_requests":1,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":24768,"score_linear":7440.0,"score_lmetric":29136},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":57051,"pending_prefill_tokens":1778,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":24768,"score_linear":81357.0,"score_lmetric":26546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":24768,"score_linear":79663.0,"score_lmetric":103919},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":0,"pending_prefill_tokens":3159,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":24064,"new_prefill":704,"score_linear":42071.0,"score_lmetric":3863},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":24768,"score_linear":121968.0,"score_lmetric":24768},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":24768,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":42071.0,"chosen_score_lmetric":3863,"t_first_token":390100.88247131,"t_first_token_unix":1779820965.896415,"t_done":390101.794267511,"t_done_unix":1779820966.8082104},{"request_id":"1318036:1:1318036:339","session_id":"1318036","input_length":2696,"t_proxy_recv":390101.22233562,"t_decision_unix":1779820966.2362773,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2696,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5219,"ongoing_decode_tokens":0,"pending_prefill_tokens":5219,"num_requests":1,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":2696,"score_linear":5219.0,"score_lmetric":7915},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":81357,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":2696,"score_linear":81357.0,"score_lmetric":2696},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":2696,"score_linear":79663.0,"score_lmetric":81847},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":90903,"ongoing_decode_tokens":90903,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":2696,"score_linear":90903.0,"score_lmetric":5392},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":2696,"score_linear":121968.0,"score_lmetric":2696},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":2696,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390101.390139307,"t_first_token_unix":1779820966.404083,"t_done":390101.873306599,"t_done_unix":1779820966.88725},{"request_id":"1314357:1:1314357:321","session_id":"1314357","input_length":57051,"t_proxy_recv":390088.557768872,"t_decision_unix":1779820953.57171,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-57051,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":57051,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":795,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":812,"cache_hit":3584,"new_prefill":53467,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":-57051},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":954,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":763,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":689,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":57051,"score_linear":121968.0,"score_lmetric":57051},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":57051,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":-57051,"t_first_token":390100.376984473,"t_first_token_unix":1779820965.3909278,"t_done":390102.680278852,"t_done_unix":1779820967.6942225},{"request_id":"1318604:1:1318604:341","session_id":"1318604","input_length":14412,"t_proxy_recv":390103.266342769,"t_decision_unix":1779820968.2802844,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-14412,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":14412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":0,"pending_prefill_tokens":3738,"num_requests":1,"active_p_offloads":0,"cached_blocks":876,"cache_hit":0,"new_prefill":14412,"score_linear":62618.0,"score_lmetric":18150},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":-14412},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":14412,"score_linear":79663.0,"score_lmetric":93563},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":765,"cache_hit":0,"new_prefill":14412,"score_linear":66135.0,"score_lmetric":14412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":14412,"score_linear":121968.0,"score_lmetric":14412},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":14412,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":-14412,"t_first_token":390104.511438471,"t_first_token_unix":1779820969.5253818,"t_done":390104.695743028,"t_done_unix":1779820969.7096863},{"request_id":"1269373:13:1317516:334","session_id":"1269373","input_length":66135,"t_proxy_recv":390099.50020411,"t_decision_unix":1779820964.5141459,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9522340666817872,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":3159,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":801,"cache_hit":4096,"new_prefill":62039,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":6040,"ongoing_decode_tokens":6040,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":66135,"score_linear":6040.0,"score_lmetric":66135},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":66135,"score_linear":81357.0,"score_lmetric":124964},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":66135,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":62976,"new_prefill":3159,"score_linear":-62976.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":14848,"new_prefill":51287,"score_linear":107120.0,"score_lmetric":51287},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":7680,"new_prefill":58455,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":390100.829517348,"t_first_token_unix":1779820965.8434608,"t_done":390105.033672477,"t_done_unix":1779820970.0476165},{"request_id":"1316848:3:1318975:343","session_id":"1316848","input_length":6298,"t_proxy_recv":390104.638344372,"t_decision_unix":1779820969.652286,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":5632,"affinity_cache_ratio":0.8942521435376309,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5632,"estimated_new_tokens":666,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":876,"cache_hit":5632,"new_prefill":666,"score_linear":56986.0,"score_lmetric":666},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14412,"ongoing_decode_tokens":14412,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":6298,"score_linear":14412.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":6298,"score_linear":79663.0,"score_lmetric":85449},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":765,"cache_hit":0,"new_prefill":6298,"score_linear":66135.0,"score_lmetric":6298},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":6298,"score_linear":121968.0,"score_lmetric":6298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":6298,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":56986.0,"chosen_score_lmetric":666,"t_first_token":390104.709406976,"t_first_token_unix":1779820969.7233503,"t_done":390105.210897905,"t_done_unix":1779820970.224841},{"request_id":"1318604:2:1319895:347","session_id":"1318604","input_length":15745,"t_proxy_recv":390107.78385459,"t_decision_unix":1779820972.7977962,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9105112734201334,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":1409,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":15745,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":15745,"score_linear":62618.0,"score_lmetric":15745},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21140,"ongoing_decode_tokens":0,"pending_prefill_tokens":21140,"num_requests":0,"active_p_offloads":0,"cached_blocks":1378,"cache_hit":14336,"new_prefill":1409,"score_linear":6804.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":15745,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":15745,"score_linear":151517.0,"score_lmetric":203452},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":15745,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":15745,"score_linear":121968.0,"score_lmetric":15745},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":37138,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":15745,"score_linear":54546.0,"score_lmetric":52883}],"chosen_score_linear":6804.0,"chosen_score_lmetric":0,"t_first_token":390109.962817147,"t_first_token_unix":1779820974.9767604,"t_done":390110.191650211,"t_done_unix":1779820975.2055936},{"request_id":"1320630:1:1320630:348","session_id":"1320630","input_length":3099,"t_proxy_recv":390110.556869975,"t_decision_unix":1779820975.570811,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3099,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":3099,"score_linear":62618.0,"score_lmetric":3099},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21140,"ongoing_decode_tokens":21140,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1380,"cache_hit":0,"new_prefill":3099,"score_linear":21140.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":3099,"score_linear":151517.0,"score_lmetric":178160},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":3099,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":3099,"score_linear":121968.0,"score_lmetric":3099},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":37138,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":3099,"score_linear":54546.0,"score_lmetric":40237}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390110.75422025,"t_first_token_unix":1779820975.7681637,"t_done":390110.948209064,"t_done_unix":1779820975.9621522},{"request_id":"1318604:3:1320865:350","session_id":"1318604","input_length":17883,"t_proxy_recv":390111.40091518,"t_decision_unix":1779820976.4148567,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":15360,"affinity_cache_ratio":0.8589162892132193,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":2523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":17883,"score_linear":62618.0,"score_lmetric":17883},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21140,"ongoing_decode_tokens":21140,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1380,"cache_hit":15360,"new_prefill":2523,"score_linear":5780.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":17883,"score_linear":151517.0,"score_lmetric":207728},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":17883,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":17883,"score_linear":121968.0,"score_lmetric":17883},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":37138,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":17883,"score_linear":54546.0,"score_lmetric":55021}],"chosen_score_linear":5780.0,"chosen_score_lmetric":0,"t_first_token":390111.748998685,"t_first_token_unix":1779820976.7629504,"t_done":390112.056856854,"t_done_unix":1779820977.0707998},{"request_id":"1316848:4:1319820:345","session_id":"1316848","input_length":21140,"t_proxy_recv":390107.546436686,"t_decision_unix":1779820972.560378,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":2,"affinity_cache_hit":6144,"affinity_cache_ratio":0.29063386944181646,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":-21140,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21140,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":14996,"score_linear":56474.0,"score_lmetric":14996},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1378,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":-21140},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":21140,"score_linear":151517.0,"score_lmetric":214242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":772,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":21140,"score_linear":121968.0,"score_lmetric":21140},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":21140,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":-21140,"t_first_token":390109.960721917,"t_first_token_unix":1779820974.9746652,"t_done":390112.207567628,"t_done_unix":1779820977.2215118},{"request_id":"1321042:1:1321042:351","session_id":"1321042","input_length":8095,"t_proxy_recv":390112.054840007,"t_decision_unix":1779820977.0687811,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8095,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":8095,"score_linear":62618.0,"score_lmetric":8095},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":39023,"ongoing_decode_tokens":39023,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1380,"cache_hit":0,"new_prefill":8095,"score_linear":39023.0,"score_lmetric":8095},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":8095,"score_linear":151517.0,"score_lmetric":188152},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":8095,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":8095,"score_linear":121968.0,"score_lmetric":8095},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":37138,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":8095,"score_linear":54546.0,"score_lmetric":45233}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390112.618988729,"t_first_token_unix":1779820977.6329322,"t_done":390112.926190328,"t_done_unix":1779820977.9401333},{"request_id":"1277428:4:1321259:352","session_id":"1277428","input_length":33906,"t_proxy_recv":390112.809720055,"t_decision_unix":1779820977.8236616,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9211349023771603,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":2674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":31232,"new_prefill":2674,"score_linear":-31232.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":4608,"new_prefill":29298,"score_linear":58010.0,"score_lmetric":29298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":-33906},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8095,"ongoing_decode_tokens":8095,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":17408,"new_prefill":16498,"score_linear":-9313.0,"score_lmetric":16498},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":33906,"score_linear":151517.0,"score_lmetric":239774},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":33906,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":33906,"score_linear":121968.0,"score_lmetric":33906},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":37138,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":33906,"score_linear":54546.0,"score_lmetric":71044}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":390113.420310173,"t_first_token_unix":1779820978.4342546,"t_done":390114.055785781,"t_done_unix":1779820979.069729},{"request_id":"1318604:4:1321889:356","session_id":"1318604","input_length":21033,"t_proxy_recv":390114.992948308,"t_decision_unix":1779820980.0068896,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":17920,"affinity_cache_ratio":0.8519944848571293,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":3113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":814,"cache_hit":0,"new_prefill":21033,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21033,"score_linear":62618.0,"score_lmetric":21033},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":17920,"new_prefill":3113,"score_linear":-17920.0,"score_lmetric":-3113},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":21033,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":21033,"score_linear":151517.0,"score_lmetric":214028},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66840,"ongoing_decode_tokens":66840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":21033,"score_linear":66840.0,"score_lmetric":21033},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":21033,"score_linear":121968.0,"score_lmetric":21033},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57223,"ongoing_decode_tokens":0,"pending_prefill_tokens":37255,"num_requests":2,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":21033,"score_linear":57223.0,"score_lmetric":116576}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":-3113,"t_first_token":390115.518911199,"t_first_token_unix":1779820980.5328546,"t_done":390115.749985586,"t_done_unix":1779820980.763929},{"request_id":"1269373:14:1321512:354","session_id":"1269373","input_length":66840,"t_proxy_recv":390113.651149363,"t_decision_unix":1779820978.6650903,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":66560,"affinity_cache_ratio":0.9958108916816277,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66560,"estimated_new_tokens":280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33906,"ongoing_decode_tokens":33906,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":809,"cache_hit":4096,"new_prefill":62744,"score_linear":29810.0,"score_lmetric":62744},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":66840,"score_linear":62618.0,"score_lmetric":66840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":66840,"score_linear":0.0,"score_lmetric":-66840},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":66840,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":66840,"score_linear":151517.0,"score_lmetric":305642},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":778,"cache_hit":66560,"new_prefill":280,"score_linear":-66560.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":14848,"new_prefill":51992,"score_linear":107120.0,"score_lmetric":51992},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57223,"ongoing_decode_tokens":0,"pending_prefill_tokens":37255,"num_requests":2,"active_p_offloads":0,"cached_blocks":861,"cache_hit":7680,"new_prefill":59160,"score_linear":49543.0,"score_lmetric":192830}],"chosen_score_linear":-66560.0,"chosen_score_lmetric":0,"t_first_token":390113.870872237,"t_first_token_unix":1779820978.884816,"t_done":390116.047334515,"t_done_unix":1779820981.061281},{"request_id":"1318036:2:1321282:353","session_id":"1318036","input_length":2677,"t_proxy_recv":390112.861162073,"t_decision_unix":1779820977.8751037,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":2560,"affinity_cache_ratio":0.9562943593574897,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":117,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33906,"ongoing_decode_tokens":0,"pending_prefill_tokens":2674,"num_requests":1,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":2677,"score_linear":33906.0,"score_lmetric":5351},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":2677,"score_linear":62618.0,"score_lmetric":2677},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":2677,"score_linear":0.0,"score_lmetric":-2677},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":8095,"ongoing_decode_tokens":8095,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":2677,"score_linear":8095.0,"score_lmetric":2677},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":2677,"score_linear":151517.0,"score_lmetric":177316},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":2677,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":2677,"score_linear":121968.0,"score_lmetric":2677},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":0,"pending_prefill_tokens":37138,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":2560,"new_prefill":117,"score_linear":51986.0,"score_lmetric":37255}],"chosen_score_linear":51986.0,"chosen_score_lmetric":37255,"t_first_token":390117.011651633,"t_first_token_unix":1779820982.0255947,"t_done":390117.047952142,"t_done_unix":1779820982.0618951},{"request_id":"1322540:1:1322540:359","session_id":"1322540","input_length":8939,"t_proxy_recv":390117.452671047,"t_decision_unix":1779820982.4666126,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8939,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":814,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":8939,"score_linear":62618.0,"score_lmetric":8939},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":54653,"ongoing_decode_tokens":21471,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":0,"new_prefill":8939,"score_linear":54653.0,"score_lmetric":42121},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":8939,"score_linear":151517.0,"score_lmetric":189840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":8939,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":8939,"score_linear":121968.0,"score_lmetric":8939},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":54546,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":8939,"score_linear":54546.0,"score_lmetric":8939}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390118.122333636,"t_first_token_unix":1779820983.1362772,"t_done":390118.37982486,"t_done_unix":1779820983.3937678},{"request_id":"1318031:2:1322552:360","session_id":"1318031","input_length":11145,"t_proxy_recv":390117.505170319,"t_decision_unix":1779820982.5191119,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":5,"affinity_cache_hit":5120,"affinity_cache_ratio":0.45939883355764916,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11145,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":8939,"ongoing_decode_tokens":0,"pending_prefill_tokens":8939,"num_requests":1,"active_p_offloads":0,"cached_blocks":814,"cache_hit":0,"new_prefill":11145,"score_linear":8939.0,"score_lmetric":20084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":5120,"new_prefill":6025,"score_linear":57498.0,"score_lmetric":6025},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":54653,"ongoing_decode_tokens":21471,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":0,"new_prefill":11145,"score_linear":54653.0,"score_lmetric":44327},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":11145,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":11145,"score_linear":151517.0,"score_lmetric":194252},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":11145,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":11145,"score_linear":121968.0,"score_lmetric":11145},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":54546,"ongoing_decode_tokens":54546,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":11145,"score_linear":54546.0,"score_lmetric":11145}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390118.388632271,"t_first_token_unix":1779820983.4025757,"t_done":390118.439943872,"t_done_unix":1779820983.453887},{"request_id":"1315567:2:1319894:346","session_id":"1315567","input_length":54546,"t_proxy_recv":390107.777747234,"t_decision_unix":1779820972.7916887,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":17408,"affinity_cache_ratio":0.31914347523191433,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":37138,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":4096,"new_prefill":50450,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":54546,"score_linear":62618.0,"score_lmetric":54546},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21140,"ongoing_decode_tokens":0,"pending_prefill_tokens":21140,"num_requests":0,"active_p_offloads":0,"cached_blocks":1378,"cache_hit":0,"new_prefill":54546,"score_linear":21140.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":54546,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":54546,"score_linear":151517.0,"score_lmetric":281054},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":772,"cache_hit":7680,"new_prefill":46866,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":7680,"new_prefill":46866,"score_linear":114288.0,"score_lmetric":46866},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":861,"cache_hit":17408,"new_prefill":37138,"score_linear":-17408.0,"score_lmetric":0}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":390117.010297352,"t_first_token_unix":1779820982.0242412,"t_done":390119.76530436,"t_done_unix":1779820984.7792492},{"request_id":"1322540:2:1323519:362","session_id":"1322540","input_length":9016,"t_proxy_recv":390120.749089576,"t_decision_unix":1779820985.763031,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9653948535936113,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":312,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":8704,"new_prefill":312,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9016,"score_linear":62618.0,"score_lmetric":9016},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":54653,"ongoing_decode_tokens":21471,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":0,"new_prefill":9016,"score_linear":54653.0,"score_lmetric":42198},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13008,"ongoing_decode_tokens":0,"pending_prefill_tokens":5328,"num_requests":1,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":9016,"score_linear":13008.0,"score_lmetric":14344},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":9016,"score_linear":151517.0,"score_lmetric":189994},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":800,"cache_hit":0,"new_prefill":9016,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":9016,"score_linear":121968.0,"score_lmetric":9016},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":9016,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":390120.783019684,"t_first_token_unix":1779820985.7969627,"t_done":390120.906336718,"t_done_unix":1779820985.9202797},{"request_id":"1316848:5:1322192:357","session_id":"1316848","input_length":21471,"t_proxy_recv":390116.171119817,"t_decision_unix":1779820981.1850615,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9776908388058311,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":479,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":814,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":15327,"score_linear":56474.0,"score_lmetric":15327},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":20992,"new_prefill":479,"score_linear":-20992.0,"score_lmetric":-479},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":21471,"score_linear":151517.0,"score_lmetric":214904},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":21471,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":21471,"score_linear":121968.0,"score_lmetric":21471},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57223,"ongoing_decode_tokens":0,"pending_prefill_tokens":37255,"num_requests":2,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":21471,"score_linear":57223.0,"score_lmetric":117452}],"chosen_score_linear":-20992.0,"chosen_score_lmetric":-479,"t_first_token":390116.236152912,"t_first_token_unix":1779820981.2500958,"t_done":390121.541802214,"t_done_unix":1779820986.5557456},{"request_id":"1321042:2:1323492:361","session_id":"1321042","input_length":13008,"t_proxy_recv":390120.6798981,"t_decision_unix":1779820985.6938396,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.5904059040590406,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":5328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":13008,"score_linear":62618.0,"score_lmetric":13008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":54653,"ongoing_decode_tokens":21471,"pending_prefill_tokens":33182,"num_requests":1,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":0,"new_prefill":13008,"score_linear":54653.0,"score_lmetric":46190},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":7680,"new_prefill":5328,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":13008,"score_linear":151517.0,"score_lmetric":197978},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":800,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":13008,"score_linear":121968.0,"score_lmetric":13008},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":13008,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":390121.215805525,"t_first_token_unix":1779820986.2297487,"t_done":390121.603229139,"t_done_unix":1779820986.6171722},{"request_id":"1320630:2:1323748:364","session_id":"1320630","input_length":11298,"t_proxy_recv":390121.521401013,"t_decision_unix":1779820986.535342,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":3072,"affinity_cache_ratio":0.27190653212958044,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":8226,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":11298,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":11298,"score_linear":62618.0,"score_lmetric":11298},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":54653,"ongoing_decode_tokens":54653,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":0,"new_prefill":11298,"score_linear":54653.0,"score_lmetric":11298},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13008,"ongoing_decode_tokens":13008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":11298,"score_linear":13008.0,"score_lmetric":11298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":11298,"score_linear":151517.0,"score_lmetric":194558},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":800,"cache_hit":3072,"new_prefill":8226,"score_linear":-3072.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":11298,"score_linear":121968.0,"score_lmetric":11298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":11298,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-3072.0,"chosen_score_lmetric":0,"t_first_token":390122.236023946,"t_first_token_unix":1779820987.2499673,"t_done":390122.512147431,"t_done_unix":1779820987.5260904},{"request_id":"1316848:6:1323535:363","session_id":"1316848","input_length":24395,"t_proxy_recv":390121.549161831,"t_decision_unix":1779820986.563103,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":21504,"affinity_cache_ratio":0.8814921090387374,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":2891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":24395,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":18251,"score_linear":56474.0,"score_lmetric":18251},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":21504,"new_prefill":2891,"score_linear":11678.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13008,"ongoing_decode_tokens":13008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":24395,"score_linear":13008.0,"score_lmetric":24395},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":24395,"score_linear":151517.0,"score_lmetric":220752},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":11298,"ongoing_decode_tokens":0,"pending_prefill_tokens":8226,"num_requests":1,"active_p_offloads":0,"cached_blocks":800,"cache_hit":0,"new_prefill":24395,"score_linear":11298.0,"score_lmetric":32621},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":24395,"score_linear":121968.0,"score_lmetric":24395},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":24395,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":11678.0,"chosen_score_lmetric":0,"t_first_token":390122.168659824,"t_first_token_unix":1779820987.1826036,"t_done":390122.979392567,"t_done_unix":1779820987.9933357},{"request_id":"1324227:1:1324227:367","session_id":"1324227","input_length":14863,"t_proxy_recv":390123.31152898,"t_decision_unix":1779820988.3254704,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14863,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14863,"score_linear":62618.0,"score_lmetric":14863},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1438,"cache_hit":0,"new_prefill":14863,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":981,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":79663,"pending_prefill_tokens":6830,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":14863,"score_linear":151517.0,"score_lmetric":43386},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":14863,"score_linear":121968.0,"score_lmetric":14863},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":14863,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":33182.0,"chosen_score_lmetric":0,"t_first_token":390124.633613614,"t_first_token_unix":1779820989.6475573,"t_done":390124.98717324,"t_done_unix":1779820990.0011165},{"request_id":"1316848:7:1325031:371","session_id":"1316848","input_length":26994,"t_proxy_recv":390125.972783507,"t_decision_unix":1779820990.986725,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24064,"affinity_cache_ratio":0.8914573608950137,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":2930,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":26994,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":20850,"score_linear":56474.0,"score_lmetric":20850},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":24064,"new_prefill":2930,"score_linear":9118.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":4312,"ongoing_decode_tokens":0,"pending_prefill_tokens":4312,"num_requests":1,"active_p_offloads":0,"cached_blocks":981,"cache_hit":0,"new_prefill":26994,"score_linear":4312.0,"score_lmetric":31306},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":151517,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":26994,"score_linear":151517.0,"score_lmetric":53988},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":26994,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":26994,"score_linear":121968.0,"score_lmetric":26994},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":26994,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":9118.0,"chosen_score_lmetric":0,"t_first_token":390126.536050073,"t_first_token_unix":1779820991.5499935,"t_done":390127.421353103,"t_done_unix":1779820992.435299},{"request_id":"1324964:1:1324964:370","session_id":"1324964","input_length":4312,"t_proxy_recv":390125.727876531,"t_decision_unix":1779820990.741818,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4312,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":4312,"score_linear":62618.0,"score_lmetric":4312},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":0,"new_prefill":4312,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":981,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":151517,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":4312,"score_linear":151517.0,"score_lmetric":8624},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":4312,"score_linear":121968.0,"score_lmetric":4312},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":4312,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390125.997982065,"t_first_token_unix":1779820991.0119255,"t_done":390127.599457942,"t_done_unix":1779820992.613401},{"request_id":"1322540:3:1325410:373","session_id":"1322540","input_length":12118,"t_proxy_recv":390127.345740916,"t_decision_unix":1779820992.3596826,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":8704,"affinity_cache_ratio":0.7182703416405347,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":3414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":8704,"new_prefill":3414,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":12118,"score_linear":62618.0,"score_lmetric":12118},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60176,"ongoing_decode_tokens":60176,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":0,"new_prefill":12118,"score_linear":60176.0,"score_lmetric":12118},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":4312,"ongoing_decode_tokens":4312,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":981,"cache_hit":0,"new_prefill":12118,"score_linear":4312.0,"score_lmetric":12118},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":151517,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":12118,"score_linear":151517.0,"score_lmetric":24236},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":12118,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":12118,"score_linear":121968.0,"score_lmetric":12118},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":12118,"score_linear":55130.0,"score_lmetric":12118}],"chosen_score_linear":-8704.0,"chosen_score_lmetric":0,"t_first_token":390127.700662602,"t_first_token_unix":1779820992.714606,"t_done":390127.824907611,"t_done_unix":1779820992.8388505},{"request_id":"1279412:14:1319059:344","session_id":"1279412","input_length":71854,"t_proxy_recv":390104.997686086,"t_decision_unix":1779820970.0116274,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9049461407854816,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":6830,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":68916,"ongoing_decode_tokens":68916,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":876,"cache_hit":0,"new_prefill":71854,"score_linear":68916.0,"score_lmetric":143708},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1378,"cache_hit":12800,"new_prefill":59054,"score_linear":-12800.0,"score_lmetric":-59054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":71854,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":65024,"new_prefill":6830,"score_linear":14639.0,"score_lmetric":85981},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":765,"cache_hit":0,"new_prefill":71854,"score_linear":66135.0,"score_lmetric":71854},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":71854,"score_linear":121968.0,"score_lmetric":71854},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":861,"cache_hit":12800,"new_prefill":59054,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":14639.0,"chosen_score_lmetric":85981,"t_first_token":390124.297974704,"t_first_token_unix":1779820989.3119204,"t_done":390128.728102952,"t_done_unix":1779820993.7420468},{"request_id":"1325987:1:1325987:376","session_id":"1325987","input_length":1823,"t_proxy_recv":390129.443791315,"t_decision_unix":1779820994.457733,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1823,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":1823,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":1823,"score_linear":62618.0,"score_lmetric":1823},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":1823,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":1823,"score_linear":66703.0,"score_lmetric":68526},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":152065,"ongoing_decode_tokens":152065,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":777,"cache_hit":0,"new_prefill":1823,"score_linear":152065.0,"score_lmetric":3646},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":1823,"score_linear":69041.0,"score_lmetric":1823},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":1823,"score_linear":121968.0,"score_lmetric":1823},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":1823,"score_linear":55130.0,"score_lmetric":1823}],"chosen_score_linear":33182.0,"chosen_score_lmetric":0,"t_first_token":390129.614396867,"t_first_token_unix":1779820994.62834,"t_done":390129.905255926,"t_done_unix":1779820994.919199},{"request_id":"1326192:1:1326192:378","session_id":"1326192","input_length":9513,"t_proxy_recv":390130.324894429,"t_decision_unix":1779820995.338836,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9513,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":9513,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9513,"score_linear":62618.0,"score_lmetric":9513},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":9513,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":9513,"score_linear":66703.0,"score_lmetric":76216},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":152065,"ongoing_decode_tokens":152065,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":777,"cache_hit":0,"new_prefill":9513,"score_linear":152065.0,"score_lmetric":19026},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":9513,"score_linear":69041.0,"score_lmetric":9513},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":9513,"score_linear":121968.0,"score_lmetric":9513},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":9513,"score_linear":55130.0,"score_lmetric":9513}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390131.048533117,"t_first_token_unix":1779820996.0624766,"t_done":390131.58170846,"t_done_unix":1779820996.5956528},{"request_id":"1279412:15:1321613:355","session_id":"1279412","input_length":72402,"t_proxy_recv":390128.7421937,"t_decision_unix":1779820993.756135,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71680,"affinity_cache_ratio":0.990027899781774,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":722,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":72402,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":72402,"score_linear":62618.0,"score_lmetric":72402},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":12800,"new_prefill":59602,"score_linear":20382.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":72402,"score_linear":66703.0,"score_lmetric":139105},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":777,"cache_hit":71680,"new_prefill":722,"score_linear":7983.0,"score_lmetric":722},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":0,"pending_prefill_tokens":1969,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":72402,"score_linear":69041.0,"score_lmetric":74371},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":72402,"score_linear":121968.0,"score_lmetric":72402},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":12800,"new_prefill":59602,"score_linear":42330.0,"score_lmetric":59602}],"chosen_score_linear":7983.0,"chosen_score_lmetric":722,"t_first_token":390128.984105858,"t_first_token_unix":1779820993.9980493,"t_done":390132.462358439,"t_done_unix":1779820997.4763024},{"request_id":"1266668:12:1303535:276","session_id":"1266668","input_length":121968,"t_proxy_recv":390060.310168089,"t_decision_unix":1779820925.3241093,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":97792,"affinity_cache_ratio":0.8017840745113473,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":24176,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49973,"ongoing_decode_tokens":18915,"pending_prefill_tokens":3922,"num_requests":2,"active_p_offloads":0,"cached_blocks":727,"cache_hit":4096,"new_prefill":117872,"score_linear":45877.0,"score_lmetric":243588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":43607,"ongoing_decode_tokens":43607,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":726,"cache_hit":0,"new_prefill":121968,"score_linear":43607.0,"score_lmetric":121968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":94457,"ongoing_decode_tokens":0,"pending_prefill_tokens":79609,"num_requests":2,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":121968,"score_linear":94457.0,"score_lmetric":403154},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":897,"ongoing_decode_tokens":897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":926,"cache_hit":0,"new_prefill":121968,"score_linear":897.0,"score_lmetric":121968},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34706,"ongoing_decode_tokens":34706,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":687,"cache_hit":0,"new_prefill":121968,"score_linear":34706.0,"score_lmetric":121968},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14027,"ongoing_decode_tokens":14027,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":610,"cache_hit":7680,"new_prefill":114288,"score_linear":6347.0,"score_lmetric":114288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":823,"cache_hit":97792,"new_prefill":24176,"score_linear":-97792.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":735,"cache_hit":7680,"new_prefill":114288,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-97792.0,"chosen_score_lmetric":0,"t_first_token":390076.215066171,"t_first_token_unix":1779820941.22901,"t_done":390132.748049192,"t_done_unix":1779820997.7619927},{"request_id":"1322540:4:1326861:380","session_id":"1322540","input_length":13249,"t_proxy_recv":390132.596009993,"t_decision_unix":1779820997.6099513,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11776,"affinity_cache_ratio":0.8888217978715375,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":1473,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":11776,"new_prefill":1473,"score_linear":-11776.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":13249,"score_linear":62618.0,"score_lmetric":13249},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61302,"ongoing_decode_tokens":61302,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":13249,"score_linear":61302.0,"score_lmetric":13249},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":13249,"score_linear":66703.0,"score_lmetric":79952},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":155287,"ongoing_decode_tokens":79663,"pending_prefill_tokens":3432,"num_requests":2,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":13249,"score_linear":155287.0,"score_lmetric":33362},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":13249,"score_linear":69041.0,"score_lmetric":13249},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":13249,"score_linear":121968.0,"score_lmetric":13249},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":13249,"score_linear":55130.0,"score_lmetric":13249}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390132.778233692,"t_first_token_unix":1779820997.7921772,"t_done":390132.906748748,"t_done_unix":1779820997.920692},{"request_id":"1316848:8:1326380:379","session_id":"1316848","input_length":28120,"t_proxy_recv":390130.930586965,"t_decision_unix":1779820995.944528,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9467994310099573,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":1496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9513,"ongoing_decode_tokens":0,"pending_prefill_tokens":9513,"num_requests":1,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":28120,"score_linear":9513.0,"score_lmetric":37633},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":21976,"score_linear":56474.0,"score_lmetric":21976},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":26624,"new_prefill":1496,"score_linear":6558.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":28120,"score_linear":66703.0,"score_lmetric":94823},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":152065,"ongoing_decode_tokens":152065,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":777,"cache_hit":0,"new_prefill":28120,"score_linear":152065.0,"score_lmetric":56240},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":28120,"score_linear":69041.0,"score_lmetric":28120},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":28120,"score_linear":121968.0,"score_lmetric":28120},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":28120,"score_linear":55130.0,"score_lmetric":28120}],"chosen_score_linear":6558.0,"chosen_score_lmetric":0,"t_first_token":390131.284334202,"t_first_token_unix":1779820996.2982779,"t_done":390133.911860711,"t_done_unix":1779820998.9258037},{"request_id":"1269373:15:1325630:375","session_id":"1269373","input_length":69041,"t_proxy_recv":390128.191482195,"t_decision_unix":1779820993.2054234,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":67072,"affinity_cache_ratio":0.971480714358135,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":67072,"estimated_new_tokens":1969,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":4096,"new_prefill":64945,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":69041,"score_linear":62618.0,"score_lmetric":69041},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":69041,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":69041,"score_linear":66703.0,"score_lmetric":135744},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":151517,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":69041,"score_linear":151517.0,"score_lmetric":138082},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":67072,"new_prefill":1969,"score_linear":-67072.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":14848,"new_prefill":54193,"score_linear":107120.0,"score_lmetric":54193},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":7680,"new_prefill":61361,"score_linear":47450.0,"score_lmetric":61361}],"chosen_score_linear":-67072.0,"chosen_score_lmetric":0,"t_first_token":390129.239202991,"t_first_token_unix":1779820994.2531464,"t_done":390134.054147823,"t_done_unix":1779820999.0680914},{"request_id":"1326192:2:1327234:381","session_id":"1326192","input_length":15253,"t_proxy_recv":390133.880186149,"t_decision_unix":1779820998.8941276,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.6042090080639874,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":6037,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":857,"cache_hit":9216,"new_prefill":6037,"score_linear":-9216.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":15253,"score_linear":62618.0,"score_lmetric":15253},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61302,"ongoing_decode_tokens":61302,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":0,"new_prefill":15253,"score_linear":61302.0,"score_lmetric":15253},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":15253,"score_linear":66703.0,"score_lmetric":81956},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":155287,"ongoing_decode_tokens":79663,"pending_prefill_tokens":3432,"num_requests":2,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":15253,"score_linear":155287.0,"score_lmetric":37370},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":15253,"score_linear":69041.0,"score_lmetric":15253},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":15253,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":15253,"score_linear":55130.0,"score_lmetric":15253}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":390134.566610627,"t_first_token_unix":1779820999.5805545,"t_done":390134.945828,"t_done_unix":1779820999.9597712},{"request_id":"1317598:1:1317598:335","session_id":"1317598","input_length":79663,"t_proxy_recv":390099.805103238,"t_decision_unix":1779820964.8190448,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":79151,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":801,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":866,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":81357,"ongoing_decode_tokens":0,"pending_prefill_tokens":58829,"num_requests":1,"active_p_offloads":0,"cached_blocks":1236,"cache_hit":0,"new_prefill":79663,"score_linear":81357.0,"score_lmetric":138492},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":764,"cache_hit":512,"new_prefill":79151,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":0,"pending_prefill_tokens":3159,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":79663,"score_linear":66135.0,"score_lmetric":82822},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":79663,"score_linear":121968.0,"score_lmetric":79663},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":856,"cache_hit":0,"new_prefill":79663,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390122.385079002,"t_first_token_unix":1779820987.399022,"t_done":390136.428752103,"t_done_unix":1779821001.4426997},{"request_id":"1279412:16:1323780:365","session_id":"1279412","input_length":75624,"t_proxy_recv":390132.478071077,"t_decision_unix":1779820997.4920125,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9546175817200888,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":3432,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":855,"cache_hit":0,"new_prefill":75624,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":75624,"score_linear":62618.0,"score_lmetric":75624},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61302,"ongoing_decode_tokens":61302,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1475,"cache_hit":12800,"new_prefill":62824,"score_linear":48502.0,"score_lmetric":62824},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":75624,"score_linear":66703.0,"score_lmetric":142327},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":79663,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":778,"cache_hit":72192,"new_prefill":3432,"score_linear":7471.0,"score_lmetric":3432},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69041,"ongoing_decode_tokens":69041,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":75624,"score_linear":69041.0,"score_lmetric":75624},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":75624,"score_linear":121968.0,"score_lmetric":75624},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":12800,"new_prefill":62824,"score_linear":42330.0,"score_lmetric":62824}],"chosen_score_linear":7471.0,"chosen_score_lmetric":3432,"t_first_token":390133.995920563,"t_first_token_unix":1779820999.0098653,"t_done":390138.349910227,"t_done_unix":1779821003.3638535},{"request_id":"1329110:1:1329110:389","session_id":"1329110","input_length":9292,"t_proxy_recv":390140.711334964,"t_decision_unix":1779821005.7252765,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9292,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":9292,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9292,"score_linear":62618.0,"score_lmetric":9292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61797,"ongoing_decode_tokens":61797,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":9292,"score_linear":61797.0,"score_lmetric":9292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":9292,"score_linear":71849.0,"score_lmetric":153066},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":81220,"pending_prefill_tokens":5232,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":9292,"score_linear":162228.0,"score_lmetric":29048},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":9292,"score_linear":36880.0,"score_lmetric":46172},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":0,"pending_prefill_tokens":7640,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":9292,"score_linear":34264.0,"score_lmetric":16932},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":9292,"score_linear":55130.0,"score_lmetric":9292}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390141.409360418,"t_first_token_unix":1779821006.423304,"t_done":390141.717786151,"t_done_unix":1779821006.7317295},{"request_id":"1316848:9:1328693:386","session_id":"1316848","input_length":28615,"t_proxy_recv":390139.212741671,"t_decision_unix":1779821004.226683,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9840992486458151,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":455,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":22471,"score_linear":56474.0,"score_lmetric":22471},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":28160,"new_prefill":455,"score_linear":5022.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":28615,"score_linear":71849.0,"score_lmetric":191712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":81220,"pending_prefill_tokens":5232,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":28615,"score_linear":162228.0,"score_lmetric":67694},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":28615,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":28615,"score_linear":55130.0,"score_lmetric":28615}],"chosen_score_linear":5022.0,"chosen_score_lmetric":0,"t_first_token":390139.334926902,"t_first_token_unix":1779821004.3488708,"t_done":390142.041671468,"t_done_unix":1779821007.055615},{"request_id":"1325987:2:1329336:391","session_id":"1325987","input_length":7423,"t_proxy_recv":390141.581220814,"t_decision_unix":1779821006.595162,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":1536,"affinity_cache_ratio":0.20692442408729625,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":5887,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":5887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9292,"ongoing_decode_tokens":9292,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":7423,"score_linear":9292.0,"score_lmetric":7423},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":7423,"score_linear":62618.0,"score_lmetric":7423},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61797,"ongoing_decode_tokens":61797,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":1536,"new_prefill":5887,"score_linear":60261.0,"score_lmetric":5887},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":7423,"score_linear":71849.0,"score_lmetric":149328},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":162228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":7423,"score_linear":162228.0,"score_lmetric":14846},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":7423,"score_linear":36880.0,"score_lmetric":44303},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":0,"pending_prefill_tokens":7640,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":7423,"score_linear":34264.0,"score_lmetric":15063},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":7423,"score_linear":55130.0,"score_lmetric":7423}],"chosen_score_linear":60261.0,"chosen_score_lmetric":5887,"t_first_token":390142.016138216,"t_first_token_unix":1779821007.0300822,"t_done":390142.341853373,"t_done_unix":1779821007.3557968},{"request_id":"1325541:1:1325541:374","session_id":"1325541","input_length":66703,"t_proxy_recv":390127.931073304,"t_decision_unix":1779820992.9450145,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":66703,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":837,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":66703,"score_linear":62618.0,"score_lmetric":66703},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":66703,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":151517,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":66703,"score_linear":151517.0,"score_lmetric":133406},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":0,"new_prefill":66703,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":66703,"score_linear":121968.0,"score_lmetric":66703},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":66703,"score_linear":55130.0,"score_lmetric":66703}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390143.560104454,"t_first_token_unix":1779821008.5740476,"t_done":390143.85545953,"t_done_unix":1779821008.8694074},{"request_id":"1324964:2:1327382:382","session_id":"1324964","input_length":5146,"t_proxy_recv":390134.483923017,"t_decision_unix":1779820999.497864,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":4608,"affinity_cache_ratio":0.895452778857365,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":538,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":15253,"ongoing_decode_tokens":0,"pending_prefill_tokens":6037,"num_requests":1,"active_p_offloads":0,"cached_blocks":857,"cache_hit":0,"new_prefill":5146,"score_linear":15253.0,"score_lmetric":11183},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":5146,"score_linear":62618.0,"score_lmetric":5146},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":5146,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66703,"ongoing_decode_tokens":0,"pending_prefill_tokens":66703,"num_requests":1,"active_p_offloads":0,"cached_blocks":990,"cache_hit":4608,"new_prefill":538,"score_linear":62095.0,"score_lmetric":67241},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":155287,"ongoing_decode_tokens":155287,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":778,"cache_hit":0,"new_prefill":5146,"score_linear":155287.0,"score_lmetric":10292},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":5146,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":5146,"score_linear":55130.0,"score_lmetric":5146}],"chosen_score_linear":62095.0,"chosen_score_lmetric":67241,"t_first_token":390143.561623519,"t_first_token_unix":1779821008.5755682,"t_done":390144.116216228,"t_done_unix":1779821009.1301596},{"request_id":"1324964:3:1328499:384","session_id":"1324964","input_length":5234,"t_proxy_recv":390144.118806853,"t_decision_unix":1779821009.1327486,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.9782193351165457,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":114,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":10847,"ongoing_decode_tokens":10847,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":5234,"score_linear":10847.0,"score_lmetric":5234},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":5234,"score_linear":62618.0,"score_lmetric":5234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":0,"new_prefill":5234,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":5120,"new_prefill":114,"score_linear":-5120.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":5234,"score_linear":252833.0,"score_lmetric":17181},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":5234,"score_linear":36880.0,"score_lmetric":42114},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":34264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":5234,"score_linear":34264.0,"score_lmetric":5234},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":5234,"score_linear":55130.0,"score_lmetric":5234}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":390144.139478627,"t_first_token_unix":1779821009.1534216,"t_done":390144.349152064,"t_done_unix":1779821009.3630955},{"request_id":"1329470:1:1329470:392","session_id":"1329470","input_length":10847,"t_proxy_recv":390142.047013101,"t_decision_unix":1779821007.0609543,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":10847,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":10847,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":10847,"score_linear":62618.0,"score_lmetric":10847},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":40605,"ongoing_decode_tokens":40605,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1479,"cache_hit":0,"new_prefill":10847,"score_linear":40605.0,"score_lmetric":10847},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":10847,"score_linear":71849.0,"score_lmetric":156176},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":162228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":10847,"score_linear":162228.0,"score_lmetric":21694},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":10847,"score_linear":36880.0,"score_lmetric":47727},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":0,"pending_prefill_tokens":7640,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":10847,"score_linear":34264.0,"score_lmetric":18487},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":10847,"score_linear":55130.0,"score_lmetric":10847}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390142.900287795,"t_first_token_unix":1779821007.9142315,"t_done":390144.390819356,"t_done_unix":1779821009.4047623},{"request_id":"1324964:4:1329201:390","session_id":"1324964","input_length":5414,"t_proxy_recv":390144.352470316,"t_decision_unix":1779821009.3664114,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.9456963428149243,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":294,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":10847,"ongoing_decode_tokens":10847,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":5414,"score_linear":10847.0,"score_lmetric":5414},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":5414,"score_linear":62618.0,"score_lmetric":5414},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44907,"ongoing_decode_tokens":33182,"pending_prefill_tokens":11725,"num_requests":1,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":0,"new_prefill":5414,"score_linear":44907.0,"score_lmetric":17139},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":5120,"new_prefill":294,"score_linear":-5120.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":5414,"score_linear":252833.0,"score_lmetric":17721},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":5414,"score_linear":36880.0,"score_lmetric":42294},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":34264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":5414,"score_linear":34264.0,"score_lmetric":5414},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":5414,"score_linear":55130.0,"score_lmetric":5414}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":390144.39696145,"t_first_token_unix":1779821009.4109046,"t_done":390144.782751189,"t_done_unix":1779821009.7966955},{"request_id":"1268861:5:1329060:388","session_id":"1268861","input_length":34264,"t_proxy_recv":390140.583546146,"t_decision_unix":1779821005.5974874,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":26624,"affinity_cache_ratio":0.7770254494513191,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":7640,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":34264,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":34264,"score_linear":62618.0,"score_lmetric":34264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61797,"ongoing_decode_tokens":61797,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":34264,"score_linear":61797.0,"score_lmetric":34264},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":34264,"score_linear":71849.0,"score_lmetric":203010},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":81220,"pending_prefill_tokens":5232,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":34264,"score_linear":162228.0,"score_lmetric":78992},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":34264,"score_linear":36880.0,"score_lmetric":71144},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":26624,"new_prefill":7640,"score_linear":-26624.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":34264,"score_linear":55130.0,"score_lmetric":34264}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":390142.207311342,"t_first_token_unix":1779821007.2212548,"t_done":390144.944787866,"t_done_unix":1779821009.9587312},{"request_id":"1324964:5:1330169:397","session_id":"1324964","input_length":6691,"t_proxy_recv":390144.786786675,"t_decision_unix":1779821009.8007278,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.7652069944701838,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":1571,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":6691,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":6691,"score_linear":62618.0,"score_lmetric":6691},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44907,"ongoing_decode_tokens":33182,"pending_prefill_tokens":11725,"num_requests":1,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":0,"new_prefill":6691,"score_linear":44907.0,"score_lmetric":18416},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":5120,"new_prefill":1571,"score_linear":-5120.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":6691,"score_linear":252833.0,"score_lmetric":21552},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":6691,"score_linear":36880.0,"score_lmetric":43571},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":34264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":6691,"score_linear":34264.0,"score_lmetric":6691},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":6691,"score_linear":55130.0,"score_lmetric":6691}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":390144.915975,"t_first_token_unix":1779821009.9299185,"t_done":390145.11979313,"t_done_unix":1779821010.1337366},{"request_id":"1328753:1:1328753:387","session_id":"1328753","input_length":36880,"t_proxy_recv":390139.445826896,"t_decision_unix":1779821004.4597683,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":36880,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":36880,"score_linear":62618.0,"score_lmetric":36880},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61797,"ongoing_decode_tokens":61797,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":36880,"score_linear":61797.0,"score_lmetric":36880},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":36880,"score_linear":71849.0,"score_lmetric":208242},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":81220,"pending_prefill_tokens":5232,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":36880,"score_linear":162228.0,"score_lmetric":84224},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":36880,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":36880,"score_linear":55130.0,"score_lmetric":36880}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390144.99736533,"t_first_token_unix":1779821010.0113091,"t_done":390145.372264138,"t_done_unix":1779821010.3862073},{"request_id":"1328753:2:1330033:395","session_id":"1328753","input_length":37007,"t_proxy_recv":390145.380349479,"t_decision_unix":1779821010.394291,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9961358661874781,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":37007,"score_linear":62618.0,"score_lmetric":37007},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44907,"ongoing_decode_tokens":44907,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":0,"new_prefill":37007,"score_linear":44907.0,"score_lmetric":37007},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":37007,"score_linear":252833.0,"score_lmetric":112500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":36864,"new_prefill":143,"score_linear":-36864.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":37007,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":37007,"score_linear":55130.0,"score_lmetric":37007}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":390145.48744405,"t_first_token_unix":1779821010.5013878,"t_done":390145.932753031,"t_done_unix":1779821010.9466965},{"request_id":"1330130:1:1330130:396","session_id":"1330130","input_length":11725,"t_proxy_recv":390144.314901525,"t_decision_unix":1779821009.3288426,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11725,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":10847,"ongoing_decode_tokens":10847,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":11725,"score_linear":10847.0,"score_lmetric":11725},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":11725,"score_linear":62618.0,"score_lmetric":11725},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":0,"new_prefill":11725,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":5234,"ongoing_decode_tokens":5234,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1121,"cache_hit":0,"new_prefill":11725,"score_linear":5234.0,"score_lmetric":11725},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":11725,"score_linear":252833.0,"score_lmetric":36654},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":11725,"score_linear":36880.0,"score_lmetric":48605},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":34264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":11725,"score_linear":34264.0,"score_lmetric":11725},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":11725,"score_linear":55130.0,"score_lmetric":11725}],"chosen_score_linear":33182.0,"chosen_score_lmetric":0,"t_first_token":390145.277898598,"t_first_token_unix":1779821010.2918425,"t_done":390146.09203376,"t_done_unix":1779821011.1059768},{"request_id":"1322225:1:1322225:358","session_id":"1322225","input_length":33182,"t_proxy_recv":390116.286724446,"t_decision_unix":1779820981.3006659,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":33182,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":814,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":33182,"score_linear":62618.0,"score_lmetric":33182},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21471,"ongoing_decode_tokens":21471,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1432,"cache_hit":0,"new_prefill":33182,"score_linear":21471.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":971,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":0,"pending_prefill_tokens":85981,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":33182,"score_linear":151517.0,"score_lmetric":238326},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":779,"cache_hit":0,"new_prefill":33182,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":33182,"score_linear":121968.0,"score_lmetric":33182},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":57223,"ongoing_decode_tokens":0,"pending_prefill_tokens":37255,"num_requests":2,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":33182,"score_linear":57223.0,"score_lmetric":140874}],"chosen_score_linear":21471.0,"chosen_score_lmetric":0,"t_first_token":390120.971449687,"t_first_token_unix":1779820985.9853938,"t_done":390147.37773383,"t_done_unix":1779821012.3916805},{"request_id":"1330881:1:1330881:400","session_id":"1330881","input_length":3866,"t_proxy_recv":390147.074042815,"t_decision_unix":1779821012.087984,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3866,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":25688,"ongoing_decode_tokens":0,"pending_prefill_tokens":10840,"num_requests":1,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":3866,"score_linear":25688.0,"score_lmetric":14706},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":3866,"score_linear":62618.0,"score_lmetric":3866},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62159,"ongoing_decode_tokens":62159,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":3866,"score_linear":62159.0,"score_lmetric":3866},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":3866,"score_linear":252833.0,"score_lmetric":13077},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":3866,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":3866,"score_linear":55130.0,"score_lmetric":3866}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390147.315714191,"t_first_token_unix":1779821012.329659,"t_done":390147.67058329,"t_done_unix":1779821012.6845264},{"request_id":"1326192:3:1330643:399","session_id":"1326192","input_length":25688,"t_proxy_recv":390146.215224583,"t_decision_unix":1779821011.229166,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":14848,"affinity_cache_ratio":0.5780130800373715,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":10840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":907,"cache_hit":14848,"new_prefill":10840,"score_linear":-14848.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":25688,"score_linear":62618.0,"score_lmetric":25688},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":62159,"ongoing_decode_tokens":62159,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1513,"cache_hit":0,"new_prefill":25688,"score_linear":62159.0,"score_lmetric":25688},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":25688,"score_linear":252833.0,"score_lmetric":78543},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":25688,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":25688,"score_linear":55130.0,"score_lmetric":25688}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":390147.957058664,"t_first_token_unix":1779821012.971002,"t_done":390148.23826043,"t_done_unix":1779821013.2522037},{"request_id":"1316848:10:1330509:398","session_id":"1316848","input_length":28977,"t_proxy_recv":390145.685242519,"t_decision_unix":1779821010.6991837,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9894744107395521,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":305,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":907,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":22833,"score_linear":56474.0,"score_lmetric":22833},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":44907,"ongoing_decode_tokens":44907,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":28672,"new_prefill":305,"score_linear":16235.0,"score_lmetric":305},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":28977,"score_linear":252833.0,"score_lmetric":88410},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37007,"ongoing_decode_tokens":37007,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":28977,"score_linear":37007.0,"score_lmetric":28977},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":28977,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":28977,"score_linear":55130.0,"score_lmetric":28977}],"chosen_score_linear":16235.0,"chosen_score_lmetric":305,"t_first_token":390145.801032531,"t_first_token_unix":1779821010.8149757,"t_done":390149.338396899,"t_done_unix":1779821014.35234},{"request_id":"1326192:4:1331370:401","session_id":"1326192","input_length":27049,"t_proxy_recv":390148.848353405,"t_decision_unix":1779821013.8622947,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":25600,"affinity_cache_ratio":0.9464305519612555,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25600,"estimated_new_tokens":1449,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":928,"cache_hit":25600,"new_prefill":1449,"score_linear":-25600.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":27049,"score_linear":62618.0,"score_lmetric":27049},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1579,"cache_hit":0,"new_prefill":27049,"score_linear":28977.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":27049,"score_linear":252833.0,"score_lmetric":82626},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":27049,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":27049,"score_linear":55130.0,"score_lmetric":27049}],"chosen_score_linear":-25600.0,"chosen_score_lmetric":0,"t_first_token":390149.19300856,"t_first_token_unix":1779821014.2069519,"t_done":390149.998931043,"t_done_unix":1779821015.0128741},{"request_id":"1329110:2:1331399:402","session_id":"1329110","input_length":12781,"t_proxy_recv":390148.925016375,"t_decision_unix":1779821013.9389582,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.7210703387841327,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":3565,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":27049,"ongoing_decode_tokens":0,"pending_prefill_tokens":1449,"num_requests":1,"active_p_offloads":0,"cached_blocks":928,"cache_hit":9216,"new_prefill":3565,"score_linear":17833.0,"score_lmetric":5014},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":12781,"score_linear":62618.0,"score_lmetric":12781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":28977,"ongoing_decode_tokens":28977,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1579,"cache_hit":0,"new_prefill":12781,"score_linear":28977.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":12781,"score_linear":252833.0,"score_lmetric":39822},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":12781,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":12781,"score_linear":55130.0,"score_lmetric":12781}],"chosen_score_linear":17833.0,"chosen_score_lmetric":5014,"t_first_token":390149.574228137,"t_first_token_unix":1779821014.5881715,"t_done":390150.069970776,"t_done_unix":1779821015.0839138},{"request_id":"1330130:2:1331784:403","session_id":"1330130","input_length":14067,"t_proxy_recv":390150.119565057,"t_decision_unix":1779821015.1335068,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11776,"affinity_cache_ratio":0.8371365607450061,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":2291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":937,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14067,"score_linear":62618.0,"score_lmetric":14067},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":11776,"new_prefill":2291,"score_linear":-11776.0,"score_lmetric":-2291},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":14067,"score_linear":252833.0,"score_lmetric":43680},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":14067,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":14067,"score_linear":55130.0,"score_lmetric":14067}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":-2291,"t_first_token":390150.440587761,"t_first_token_unix":1779821015.454531,"t_done":390150.576384589,"t_done_unix":1779821015.5903275},{"request_id":"1329470:2:1332133:409","session_id":"1329470","input_length":11766,"t_proxy_recv":390151.288740202,"t_decision_unix":1779821016.302682,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9138194798572157,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":1014,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":12421,"ongoing_decode_tokens":0,"pending_prefill_tokens":12421,"num_requests":1,"active_p_offloads":0,"cached_blocks":937,"cache_hit":10752,"new_prefill":1014,"score_linear":1669.0,"score_lmetric":13435},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":11766,"score_linear":62618.0,"score_lmetric":11766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":21680,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":11766,"score_linear":21680.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73234,"ongoing_decode_tokens":0,"pending_prefill_tokens":6674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":11766,"score_linear":73234.0,"score_lmetric":18440},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":11766,"score_linear":252833.0,"score_lmetric":36777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71777,"ongoing_decode_tokens":0,"pending_prefill_tokens":2657,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":11766,"score_linear":71777.0,"score_lmetric":14423},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":11766,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":11766,"score_linear":55130.0,"score_lmetric":11766}],"chosen_score_linear":1669.0,"chosen_score_lmetric":13435,"t_first_token":390152.051932954,"t_first_token_unix":1779821017.0658765,"t_done":390152.13221161,"t_done_unix":1779821017.1461546},{"request_id":"1332021:1:1332021:407","session_id":"1332021","input_length":12421,"t_proxy_recv":390150.921379692,"t_decision_unix":1779821015.935321,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12421,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":937,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":12421,"score_linear":62618.0,"score_lmetric":12421},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":21680,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":12421,"score_linear":21680.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73234,"ongoing_decode_tokens":0,"pending_prefill_tokens":6674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":12421,"score_linear":73234.0,"score_lmetric":19095},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":12421,"score_linear":252833.0,"score_lmetric":38742},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71777,"ongoing_decode_tokens":0,"pending_prefill_tokens":2657,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":12421,"score_linear":71777.0,"score_lmetric":15078},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":12421,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":12421,"score_linear":55130.0,"score_lmetric":12421}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390151.98458456,"t_first_token_unix":1779821016.9985282,"t_done":390152.316256419,"t_done_unix":1779821017.3301995},{"request_id":"1329110:3:1332476:411","session_id":"1329110","input_length":13479,"t_proxy_recv":390152.600671316,"t_decision_unix":1779821017.6146128,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":12800,"affinity_cache_ratio":0.9496253431263447,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":679,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":963,"cache_hit":12800,"new_prefill":679,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":13479,"score_linear":62618.0,"score_lmetric":13479},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":23490,"ongoing_decode_tokens":0,"pending_prefill_tokens":23490,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":13479,"score_linear":23490.0,"score_lmetric":36969},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73234,"ongoing_decode_tokens":0,"pending_prefill_tokens":6674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":13479,"score_linear":73234.0,"score_lmetric":20153},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":13479,"score_linear":252833.0,"score_lmetric":41916},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":13479,"score_linear":71777.0,"score_lmetric":13479},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":13479,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":13479,"score_linear":55130.0,"score_lmetric":13479}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":390152.739791996,"t_first_token_unix":1779821017.753735,"t_done":390153.093341889,"t_done_unix":1779821018.1072855},{"request_id":"1325541:2:1331846:404","session_id":"1325541","input_length":73234,"t_proxy_recv":390150.321429065,"t_decision_unix":1779821015.3353708,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":66560,"affinity_cache_ratio":0.9088674659311249,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66560,"estimated_new_tokens":6674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":937,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":73234,"score_linear":62618.0,"score_lmetric":73234},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14067,"ongoing_decode_tokens":0,"pending_prefill_tokens":2291,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":73234,"score_linear":14067.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":66560,"new_prefill":6674,"score_linear":-66560.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":73234,"score_linear":252833.0,"score_lmetric":221181},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":73234,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":73234,"score_linear":55130.0,"score_lmetric":73234}],"chosen_score_linear":-66560.0,"chosen_score_lmetric":0,"t_first_token":390153.242315178,"t_first_token_unix":1779821018.2562587,"t_done":390153.293514885,"t_done_unix":1779821018.3074584},{"request_id":"1269373:16:1331896:405","session_id":"1269373","input_length":71777,"t_proxy_recv":390150.520055267,"t_decision_unix":1779821015.533997,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9629825710185714,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":2657,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":937,"cache_hit":4096,"new_prefill":67681,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":71777,"score_linear":62618.0,"score_lmetric":71777},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":14067,"ongoing_decode_tokens":14067,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":71777,"score_linear":14067.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73234,"ongoing_decode_tokens":0,"pending_prefill_tokens":6674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":71777,"score_linear":73234.0,"score_lmetric":78451},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":71777,"score_linear":252833.0,"score_lmetric":216810},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":892,"cache_hit":69120,"new_prefill":2657,"score_linear":-69120.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":14848,"new_prefill":56929,"score_linear":-14848.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":7680,"new_prefill":64097,"score_linear":47450.0,"score_lmetric":64097}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":390151.698281291,"t_first_token_unix":1779821016.7122252,"t_done":390154.317556746,"t_done_unix":1779821019.3315017},{"request_id":"1332472:1:1332472:410","session_id":"1332472","input_length":1810,"t_proxy_recv":390152.574927359,"t_decision_unix":1779821017.5888689,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1810,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":963,"cache_hit":0,"new_prefill":1810,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":1810,"score_linear":62618.0,"score_lmetric":1810},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":21680,"ongoing_decode_tokens":0,"pending_prefill_tokens":21680,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":1810,"score_linear":21680.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73234,"ongoing_decode_tokens":0,"pending_prefill_tokens":6674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":0,"new_prefill":1810,"score_linear":73234.0,"score_lmetric":8484},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":1810,"score_linear":252833.0,"score_lmetric":6909},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":1810,"score_linear":71777.0,"score_lmetric":1810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":1810,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":1810,"score_linear":55130.0,"score_lmetric":1810}],"chosen_score_linear":21680.0,"chosen_score_lmetric":0,"t_first_token":390153.34717258,"t_first_token_unix":1779821018.3611162,"t_done":390154.369333209,"t_done_unix":1779821019.3832762},{"request_id":"1332013:1:1332013:406","session_id":"1332013","input_length":21680,"t_proxy_recv":390150.902899739,"t_decision_unix":1779821015.9168413,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-21680,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21680,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":937,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21680,"score_linear":62618.0,"score_lmetric":21680},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":-21680},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73234,"ongoing_decode_tokens":0,"pending_prefill_tokens":6674,"num_requests":1,"active_p_offloads":0,"cached_blocks":1124,"cache_hit":12800,"new_prefill":8880,"score_linear":60434.0,"score_lmetric":15554},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":21680,"score_linear":252833.0,"score_lmetric":66519},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71777,"ongoing_decode_tokens":0,"pending_prefill_tokens":2657,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":12800,"new_prefill":8880,"score_linear":58977.0,"score_lmetric":11537},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":21680,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":12800,"new_prefill":8880,"score_linear":42330.0,"score_lmetric":8880}],"chosen_score_linear":0.0,"chosen_score_lmetric":-21680,"t_first_token":390153.233506767,"t_first_token_unix":1779821018.2474506,"t_done":390154.643045209,"t_done_unix":1779821019.6569884},{"request_id":"1332754:1:1332754:412","session_id":"1332754","input_length":19766,"t_proxy_recv":390153.603812915,"t_decision_unix":1779821018.6177542,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19766,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":19766,"score_linear":62618.0,"score_lmetric":19766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":23490,"ongoing_decode_tokens":23490,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":19766,"score_linear":23490.0,"score_lmetric":19766},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":19766,"score_linear":252833.0,"score_lmetric":60777},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":71777,"ongoing_decode_tokens":71777,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":892,"cache_hit":0,"new_prefill":19766,"score_linear":71777.0,"score_lmetric":19766},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":904,"cache_hit":0,"new_prefill":19766,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":19766,"score_linear":55130.0,"score_lmetric":19766}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390155.625840666,"t_first_token_unix":1779821020.6397843,"t_done":390156.100707582,"t_done_unix":1779821021.1146512},{"request_id":"1316848:11:1333994:416","session_id":"1316848","input_length":29656,"t_proxy_recv":390157.978107308,"t_decision_unix":1779821022.992048,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9840841650930672,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":472,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":23512,"score_linear":56474.0,"score_lmetric":23512},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1629,"cache_hit":29184,"new_prefill":472,"score_linear":-29184.0,"score_lmetric":-472},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":29656,"score_linear":252833.0,"score_lmetric":90447},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":29656,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":29656,"score_linear":55130.0,"score_lmetric":29656}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":-472,"t_first_token":390158.100755233,"t_first_token_unix":1779821023.1146986,"t_done":390158.380099599,"t_done_unix":1779821023.3940432},{"request_id":"1309252:2:1334746:419","session_id":"1309252","input_length":45601,"t_proxy_recv":390160.826743582,"t_decision_unix":1779821025.8406851,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":44544,"affinity_cache_ratio":0.9768206837569352,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":1057,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":45601,"score_linear":62618.0,"score_lmetric":45601},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68353,"ongoing_decode_tokens":0,"pending_prefill_tokens":38657,"num_requests":1,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":0,"new_prefill":45601,"score_linear":68353.0,"score_lmetric":84258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":45601,"score_linear":252833.0,"score_lmetric":138282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":45601,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":44544,"new_prefill":1057,"score_linear":10586.0,"score_lmetric":1057}],"chosen_score_linear":10586.0,"chosen_score_lmetric":1057,"t_first_token":390161.171813669,"t_first_token_unix":1779821026.1857574,"t_done":390163.637216741,"t_done_unix":1779821028.6511614},{"request_id":"1330881:2:1336222:422","session_id":"1330881","input_length":11989,"t_proxy_recv":390165.932631491,"t_decision_unix":1779821030.9465728,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":3584,"affinity_cache_ratio":0.29894069563766784,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":8405,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":11989,"score_linear":62618.0,"score_lmetric":11989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129582,"ongoing_decode_tokens":68353,"pending_prefill_tokens":4397,"num_requests":2,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":0,"new_prefill":11989,"score_linear":129582.0,"score_lmetric":32772},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":11989,"score_linear":252833.0,"score_lmetric":37446},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":11989,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":942,"cache_hit":3584,"new_prefill":8405,"score_linear":-3584.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":11989,"score_linear":55130.0,"score_lmetric":11989}],"chosen_score_linear":-3584.0,"chosen_score_lmetric":0,"t_first_token":390166.67419778,"t_first_token_unix":1779821031.6881413,"t_done":390166.830993198,"t_done_unix":1779821031.8449361},{"request_id":"1334223:1:1334223:417","session_id":"1334223","input_length":23689,"t_proxy_recv":390158.849792875,"t_decision_unix":1779821023.8637342,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-23689,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":23689,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":23689,"score_linear":62618.0,"score_lmetric":23689},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":-23689},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":23689,"score_linear":252833.0,"score_lmetric":72546},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":23689,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":23689,"score_linear":55130.0,"score_lmetric":23689}],"chosen_score_linear":0.0,"chosen_score_lmetric":-23689,"t_first_token":390161.518863383,"t_first_token_unix":1779821026.5328074,"t_done":390168.531795174,"t_done_unix":1779821033.5457394},{"request_id":"1316848:12:1334743:418","session_id":"1316848","input_length":44664,"t_proxy_recv":390160.819360982,"t_decision_unix":1779821025.8333023,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":29696,"affinity_cache_ratio":0.6648755149561167,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":14968,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":38520,"score_linear":56474.0,"score_lmetric":38520},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":23689,"ongoing_decode_tokens":0,"pending_prefill_tokens":23689,"num_requests":0,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":29696,"new_prefill":14968,"score_linear":-6007.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":44664,"score_linear":252833.0,"score_lmetric":135471},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":44664,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":44664,"score_linear":55130.0,"score_lmetric":44664}],"chosen_score_linear":-6007.0,"chosen_score_lmetric":0,"t_first_token":390165.320615642,"t_first_token_unix":1779821030.334561,"t_done":390168.919063401,"t_done_unix":1779821033.9330068},{"request_id":"1336620:1:1336620:423","session_id":"1336620","input_length":14666,"t_proxy_recv":390167.235282663,"t_decision_unix":1779821032.2492237,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":7680,"estimated_new_tokens":6986,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":4096,"new_prefill":10570,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14666,"score_linear":62618.0,"score_lmetric":14666},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129582,"ongoing_decode_tokens":129582,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":0,"new_prefill":14666,"score_linear":129582.0,"score_lmetric":29332},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":14666,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":14666,"score_linear":252833.0,"score_lmetric":45477},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":7680,"new_prefill":6986,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":958,"cache_hit":7680,"new_prefill":6986,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":7680,"new_prefill":6986,"score_linear":47450.0,"score_lmetric":6986}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":390168.019213698,"t_first_token_unix":1779821033.0331569,"t_done":390168.968138342,"t_done_unix":1779821033.9820812},{"request_id":"1337035:1:1337035:425","session_id":"1337035","input_length":12644,"t_proxy_recv":390168.72896584,"t_decision_unix":1779821033.742907,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":12644,"score_linear":62618.0,"score_lmetric":12644},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":105893,"ongoing_decode_tokens":105893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":12644,"score_linear":105893.0,"score_lmetric":12644},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":12644,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":12644,"score_linear":252833.0,"score_lmetric":39411},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14666,"ongoing_decode_tokens":14666,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":12644,"score_linear":14666.0,"score_lmetric":12644},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":0,"pending_prefill_tokens":5673,"num_requests":1,"active_p_offloads":0,"cached_blocks":958,"cache_hit":0,"new_prefill":12644,"score_linear":20009.0,"score_lmetric":18317},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":12644,"score_linear":55130.0,"score_lmetric":12644}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390169.777598645,"t_first_token_unix":1779821034.791542,"t_done":390169.952543222,"t_done_unix":1779821034.9664862},{"request_id":"1257323:2:1329541:393","session_id":"1257323","input_length":90605,"t_proxy_recv":390142.493821449,"t_decision_unix":1779821007.5077622,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":90112,"affinity_cache_ratio":0.9945587991832681,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":90112,"estimated_new_tokens":493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":10847,"ongoing_decode_tokens":0,"pending_prefill_tokens":10847,"num_requests":1,"active_p_offloads":0,"cached_blocks":886,"cache_hit":0,"new_prefill":90605,"score_linear":10847.0,"score_lmetric":101452},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":90605,"score_linear":62618.0,"score_lmetric":90605},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1490,"cache_hit":0,"new_prefill":90605,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":90605,"score_linear":71849.0,"score_lmetric":315692},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":162228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":941,"cache_hit":90112,"new_prefill":493,"score_linear":72116.0,"score_lmetric":986},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36880,"ongoing_decode_tokens":0,"pending_prefill_tokens":36880,"num_requests":1,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":90605,"score_linear":36880.0,"score_lmetric":127485},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":34264,"ongoing_decode_tokens":34264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":90605,"score_linear":34264.0,"score_lmetric":90605},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":90605,"score_linear":55130.0,"score_lmetric":90605}],"chosen_score_linear":72116.0,"chosen_score_lmetric":986,"t_first_token":390169.823546497,"t_first_token_unix":1779821034.8374894,"t_done":390170.557681972,"t_done_unix":1779821035.5716255},{"request_id":"1259178:2:1336768:424","session_id":"1259178","input_length":20009,"t_proxy_recv":390167.700121479,"t_decision_unix":1779821032.7140627,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":14336,"affinity_cache_ratio":0.716477585086711,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":5673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":20009,"score_linear":62618.0,"score_lmetric":20009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129582,"ongoing_decode_tokens":129582,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":0,"new_prefill":20009,"score_linear":129582.0,"score_lmetric":40018},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":20009,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":20009,"score_linear":252833.0,"score_lmetric":61506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14666,"ongoing_decode_tokens":0,"pending_prefill_tokens":6986,"num_requests":1,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":20009,"score_linear":14666.0,"score_lmetric":26995},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":958,"cache_hit":14336,"new_prefill":5673,"score_linear":-14336.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":20009,"score_linear":55130.0,"score_lmetric":20009}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":390169.760105779,"t_first_token_unix":1779821034.7740495,"t_done":390170.559200067,"t_done_unix":1779821035.5731432},{"request_id":"1317598:2:1324364:368","session_id":"1317598","input_length":81220,"t_proxy_recv":390136.444944648,"t_decision_unix":1779821001.458886,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":80384,"affinity_cache_ratio":0.9897069687269145,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":80384,"estimated_new_tokens":836,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":81220,"score_linear":62618.0,"score_lmetric":81220},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":0,"new_prefill":81220,"score_linear":33182.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":81220,"score_linear":71849.0,"score_lmetric":296922},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75624,"ongoing_decode_tokens":75624,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":80384,"new_prefill":836,"score_linear":-4760.0,"score_lmetric":836},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":81220,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":81220,"score_linear":55130.0,"score_lmetric":81220}],"chosen_score_linear":-4760.0,"chosen_score_lmetric":836,"t_first_token":390137.019083484,"t_first_token_unix":1779821002.0330272,"t_done":390171.163177287,"t_done_unix":1779821036.1771228},{"request_id":"1259178:3:1337653:429","session_id":"1259178","input_length":22398,"t_proxy_recv":390171.018114821,"t_decision_unix":1779821036.032056,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":19968,"affinity_cache_ratio":0.8915081703723546,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":2430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":22398,"score_linear":62618.0,"score_lmetric":22398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":22398,"score_linear":142752.0,"score_lmetric":78818},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":162228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":22398,"score_linear":162228.0,"score_lmetric":44796},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":22398,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":969,"cache_hit":19968,"new_prefill":2430,"score_linear":-19968.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":22398,"score_linear":55130.0,"score_lmetric":22398}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":390171.456085494,"t_first_token_unix":1779821036.4700286,"t_done":390172.300055267,"t_done_unix":1779821037.3139992},{"request_id":"1317598:3:1328678:385","session_id":"1317598","input_length":81827,"t_proxy_recv":390171.175992922,"t_decision_unix":1779821036.1899343,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9948794407713836,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":419,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":81827,"score_linear":62618.0,"score_lmetric":81827},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":81827,"score_linear":142752.0,"score_lmetric":197676},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":944,"cache_hit":81408,"new_prefill":419,"score_linear":-400.0,"score_lmetric":419},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":81827,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":22398,"ongoing_decode_tokens":0,"pending_prefill_tokens":2430,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":81827,"score_linear":22398.0,"score_lmetric":84257},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":81827,"score_linear":55130.0,"score_lmetric":81827}],"chosen_score_linear":-400.0,"chosen_score_lmetric":419,"t_first_token":390171.582067256,"t_first_token_unix":1779821036.5960104,"t_done":390173.945771605,"t_done_unix":1779821038.9597151},{"request_id":"1338292:1:1338292:432","session_id":"1338292","input_length":9325,"t_proxy_recv":390173.215340638,"t_decision_unix":1779821038.229282,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9325,"score_linear":62618.0,"score_lmetric":9325},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":9325,"score_linear":142752.0,"score_lmetric":52672},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162835,"ongoing_decode_tokens":162835,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":9325,"score_linear":162835.0,"score_lmetric":18650},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73073,"ongoing_decode_tokens":0,"pending_prefill_tokens":1393,"num_requests":1,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":9325,"score_linear":73073.0,"score_lmetric":10718},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":9325,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":9325,"score_linear":55130.0,"score_lmetric":9325}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390173.920469893,"t_first_token_unix":1779821038.934414,"t_done":390174.036680325,"t_done_unix":1779821039.0506234},{"request_id":"1336620:2:1338440:434","session_id":"1336620","input_length":14918,"t_proxy_recv":390173.625851134,"t_decision_unix":1779821038.6397924,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":14336,"affinity_cache_ratio":0.960986727443357,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":582,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":4096,"new_prefill":10822,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14918,"score_linear":62618.0,"score_lmetric":14918},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":14918,"score_linear":142752.0,"score_lmetric":63858},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":0,"pending_prefill_tokens":551,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":14918,"score_linear":50215.0,"score_lmetric":15469},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162835,"ongoing_decode_tokens":162835,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":14918,"score_linear":162835.0,"score_lmetric":29836},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":910,"cache_hit":14336,"new_prefill":582,"score_linear":58737.0,"score_lmetric":582},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":9325,"ongoing_decode_tokens":0,"pending_prefill_tokens":9325,"num_requests":1,"active_p_offloads":0,"cached_blocks":974,"cache_hit":7680,"new_prefill":7238,"score_linear":1645.0,"score_lmetric":16563},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":7680,"new_prefill":7238,"score_linear":47450.0,"score_lmetric":7238}],"chosen_score_linear":58737.0,"chosen_score_lmetric":582,"t_first_token":390173.700402133,"t_first_token_unix":1779821038.7143455,"t_done":390175.329288895,"t_done_unix":1779821040.3432322},{"request_id":"1314357:2:1335184:420","session_id":"1314357","input_length":61229,"t_proxy_recv":390162.184563236,"t_decision_unix":1779821027.198504,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9281876235117347,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":4397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":3584,"new_prefill":57645,"score_linear":59034.0,"score_lmetric":57645},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68353,"ongoing_decode_tokens":23689,"pending_prefill_tokens":14968,"num_requests":1,"active_p_offloads":0,"cached_blocks":1630,"cache_hit":56832,"new_prefill":4397,"score_linear":11521.0,"score_lmetric":19365},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":61229,"score_linear":252833.0,"score_lmetric":185166},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":897,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":61229,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":100731,"ongoing_decode_tokens":100731,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":934,"cache_hit":0,"new_prefill":61229,"score_linear":100731.0,"score_lmetric":122458}],"chosen_score_linear":11521.0,"chosen_score_lmetric":19365,"t_first_token":390166.85586751,"t_first_token_unix":1779821031.8698103,"t_done":390175.41365248,"t_done_unix":1779821040.427596},{"request_id":"1311753:2:1337278:426","session_id":"1311753","input_length":36518,"t_proxy_recv":390169.591038184,"t_decision_unix":1779821034.6049793,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":19968,"affinity_cache_ratio":0.5467988389287475,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":16550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":36518,"score_linear":62618.0,"score_lmetric":36518},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":61229,"ongoing_decode_tokens":61229,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":19968,"new_prefill":16550,"score_linear":41261.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12644,"ongoing_decode_tokens":0,"pending_prefill_tokens":12644,"num_requests":1,"active_p_offloads":0,"cached_blocks":1137,"cache_hit":0,"new_prefill":36518,"score_linear":12644.0,"score_lmetric":49162},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":252833,"ongoing_decode_tokens":162228,"pending_prefill_tokens":493,"num_requests":3,"active_p_offloads":0,"cached_blocks":941,"cache_hit":0,"new_prefill":36518,"score_linear":252833.0,"score_lmetric":111033},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":36518,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":20009,"ongoing_decode_tokens":0,"pending_prefill_tokens":5673,"num_requests":1,"active_p_offloads":0,"cached_blocks":958,"cache_hit":0,"new_prefill":36518,"score_linear":20009.0,"score_lmetric":42191},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":36518,"score_linear":55130.0,"score_lmetric":36518}],"chosen_score_linear":41261.0,"chosen_score_lmetric":0,"t_first_token":390175.146774507,"t_first_token_unix":1779821040.160719,"t_done":390175.511939658,"t_done_unix":1779821040.5258844},{"request_id":"1316848:13:1337519:427","session_id":"1316848","input_length":45005,"t_proxy_recv":390170.56702762,"t_decision_unix":1779821035.5809693,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":44544,"affinity_cache_ratio":0.9897566937007,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":461,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":38861,"score_linear":56474.0,"score_lmetric":38861},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":97747,"ongoing_decode_tokens":61229,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":44544,"new_prefill":461,"score_linear":53203.0,"score_lmetric":17011},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162228,"ongoing_decode_tokens":162228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":942,"cache_hit":0,"new_prefill":45005,"score_linear":162228.0,"score_lmetric":90010},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":45005,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":45005,"score_linear":55130.0,"score_lmetric":45005}],"chosen_score_linear":53203.0,"chosen_score_lmetric":17011,"t_first_token":390175.15140477,"t_first_token_unix":1779821040.165348,"t_done":390175.606398658,"t_done_unix":1779821040.6203427},{"request_id":"1269373:17:1338104:431","session_id":"1269373","input_length":73073,"t_proxy_recv":390172.673654752,"t_decision_unix":1779821037.687596,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9809368713478303,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":1393,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":4096,"new_prefill":68977,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":73073,"score_linear":62618.0,"score_lmetric":73073},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":73073,"score_linear":142752.0,"score_lmetric":180168},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":73073,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162835,"ongoing_decode_tokens":162835,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":73073,"score_linear":162835.0,"score_lmetric":146146},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":910,"cache_hit":71680,"new_prefill":1393,"score_linear":-71680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":974,"cache_hit":14848,"new_prefill":58225,"score_linear":-14848.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":7680,"new_prefill":65393,"score_linear":47450.0,"score_lmetric":65393}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":390173.366237329,"t_first_token_unix":1779821038.3801813,"t_done":390176.027924812,"t_done_unix":1779821041.0418682},{"request_id":"1253743:5:1338406:433","session_id":"1253743","input_length":50215,"t_proxy_recv":390173.537428515,"t_decision_unix":1779821038.5513694,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9890271831126157,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":551,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":17408,"new_prefill":32807,"score_linear":-17408.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":4608,"new_prefill":45607,"score_linear":58010.0,"score_lmetric":45607},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":50215,"score_linear":142752.0,"score_lmetric":134452},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":49664,"new_prefill":551,"score_linear":-49664.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":162835,"ongoing_decode_tokens":162835,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":944,"cache_hit":0,"new_prefill":50215,"score_linear":162835.0,"score_lmetric":100430},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":50215,"score_linear":73073.0,"score_lmetric":50215},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":9325,"ongoing_decode_tokens":0,"pending_prefill_tokens":9325,"num_requests":1,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":50215,"score_linear":9325.0,"score_lmetric":59540},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":50215,"score_linear":55130.0,"score_lmetric":50215}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":390173.710207933,"t_first_token_unix":1779821038.7241514,"t_done":390176.708061314,"t_done_unix":1779821041.7220044},{"request_id":"1339977:1:1339977:442","session_id":"1339977","input_length":13816,"t_proxy_recv":390179.278619763,"t_decision_unix":1779821044.2925608,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":13816,"score_linear":62618.0,"score_lmetric":13816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":13816,"score_linear":115840.0,"score_lmetric":13816},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":13816,"score_linear":163150.0,"score_lmetric":27632},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":13816,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":31527,"ongoing_decode_tokens":31527,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":13816,"score_linear":31527.0,"score_lmetric":27632},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":101124,"ongoing_decode_tokens":101124,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":13816,"score_linear":101124.0,"score_lmetric":27632}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390180.47077786,"t_first_token_unix":1779821045.4847214,"t_done":390180.660967116,"t_done_unix":1779821045.6749105},{"request_id":"1315567:3:1325346:372","session_id":"1315567","input_length":55130,"t_proxy_recv":390127.118329943,"t_decision_unix":1779820992.1322713,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9937239252675494,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":346,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":831,"cache_hit":4096,"new_prefill":51034,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":55130,"score_linear":62618.0,"score_lmetric":55130},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":60176,"ongoing_decode_tokens":60176,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1467,"cache_hit":0,"new_prefill":55130,"score_linear":60176.0,"score_lmetric":55130},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":4312,"ongoing_decode_tokens":4312,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":981,"cache_hit":0,"new_prefill":55130,"score_linear":4312.0,"score_lmetric":55130},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":151517,"ongoing_decode_tokens":151517,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":55130,"score_linear":151517.0,"score_lmetric":110260},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":816,"cache_hit":7680,"new_prefill":47450,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":7680,"new_prefill":47450,"score_linear":114288.0,"score_lmetric":47450},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":934,"cache_hit":54784,"new_prefill":346,"score_linear":-54784.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":390127.31208779,"t_first_token_unix":1779820992.3260307,"t_done":390180.833924966,"t_done_unix":1779821045.84787},{"request_id":"1317598:4:1332127:408","session_id":"1317598","input_length":82142,"t_proxy_recv":390173.960811018,"t_decision_unix":1779821038.9747522,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81920,"affinity_cache_ratio":0.9972973631029194,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":81920,"estimated_new_tokens":222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":82142,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":82142,"score_linear":62618.0,"score_lmetric":82142},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":142752,"ongoing_decode_tokens":61229,"pending_prefill_tokens":17011,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":82142,"score_linear":142752.0,"score_lmetric":198306},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":50215,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":82142,"score_linear":50215.0,"score_lmetric":82142},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":945,"cache_hit":81920,"new_prefill":222,"score_linear":-912.0,"score_lmetric":222},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":87991,"ongoing_decode_tokens":87991,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":910,"cache_hit":0,"new_prefill":82142,"score_linear":87991.0,"score_lmetric":164284},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":9325,"ongoing_decode_tokens":9325,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":974,"cache_hit":0,"new_prefill":82142,"score_linear":9325.0,"score_lmetric":82142},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":82142,"score_linear":55130.0,"score_lmetric":82142}],"chosen_score_linear":-912.0,"chosen_score_lmetric":222,"t_first_token":390174.225915948,"t_first_token_unix":1779821039.2398598,"t_done":390181.435740197,"t_done_unix":1779821046.4496837},{"request_id":"1259178:4:1339295:439","session_id":"1259178","input_length":24462,"t_proxy_recv":390176.687790741,"t_decision_unix":1779821041.701732,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":22528,"affinity_cache_ratio":0.9209385986427929,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":1934,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":24462,"score_linear":62618.0,"score_lmetric":24462},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":0,"pending_prefill_tokens":9856,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":24462,"score_linear":115840.0,"score_lmetric":34318},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":50215,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":24462,"score_linear":50215.0,"score_lmetric":24462},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":24462,"score_linear":163150.0,"score_lmetric":48924},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":24462,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":992,"cache_hit":22528,"new_prefill":1934,"score_linear":-15463.0,"score_lmetric":1934},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":24462,"score_linear":55130.0,"score_lmetric":24462}],"chosen_score_linear":-15463.0,"chosen_score_lmetric":1934,"t_first_token":390177.115783435,"t_first_token_unix":1779821042.129727,"t_done":390182.276051164,"t_done_unix":1779821047.2899945},{"request_id":"1279412:17:1326166:377","session_id":"1279412","input_length":81008,"t_proxy_recv":390138.366470295,"t_decision_unix":1779821003.3804116,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9354137862927119,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":5232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":868,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":81008,"score_linear":62618.0,"score_lmetric":81008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33182,"ongoing_decode_tokens":33182,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1478,"cache_hit":12800,"new_prefill":68208,"score_linear":20382.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71849,"ongoing_decode_tokens":0,"pending_prefill_tokens":67241,"num_requests":2,"active_p_offloads":0,"cached_blocks":990,"cache_hit":0,"new_prefill":81008,"score_linear":71849.0,"score_lmetric":296498},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81220,"ongoing_decode_tokens":81220,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":941,"cache_hit":75776,"new_prefill":5232,"score_linear":5444.0,"score_lmetric":5232},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":820,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":882,"cache_hit":0,"new_prefill":81008,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":934,"cache_hit":12800,"new_prefill":68208,"score_linear":42330.0,"score_lmetric":68208}],"chosen_score_linear":5444.0,"chosen_score_lmetric":5232,"t_first_token":390140.997424515,"t_first_token_unix":1779821006.011368,"t_done":390182.316444566,"t_done_unix":1779821047.3303885},{"request_id":"1309252:3:1339771:441","session_id":"1309252","input_length":45994,"t_proxy_recv":390178.512986933,"t_decision_unix":1779821043.526928,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":45568,"affinity_cache_ratio":0.9907379223376962,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45568,"estimated_new_tokens":426,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":45994,"score_linear":62618.0,"score_lmetric":45994},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":49688,"pending_prefill_tokens":4712,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":45994,"score_linear":115840.0,"score_lmetric":50706},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":45994,"score_linear":163150.0,"score_lmetric":91988},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":45994,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":31527,"ongoing_decode_tokens":31527,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":45994,"score_linear":31527.0,"score_lmetric":91988},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":45568,"new_prefill":426,"score_linear":9562.0,"score_lmetric":426}],"chosen_score_linear":9562.0,"chosen_score_lmetric":426,"t_first_token":390178.680421327,"t_first_token_unix":1779821043.6943648,"t_done":390182.819923457,"t_done_unix":1779821047.8338668},{"request_id":"1317598:5:1337780:430","session_id":"1317598","input_length":83088,"t_proxy_recv":390181.450317472,"t_decision_unix":1779821046.464259,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82432,"affinity_cache_ratio":0.99210475640285,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":82432,"estimated_new_tokens":656,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":83088,"score_linear":48381.0,"score_lmetric":131469},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":83088,"score_linear":62618.0,"score_lmetric":83088},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":83088,"score_linear":115840.0,"score_lmetric":83088},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":83088,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":81008,"ongoing_decode_tokens":81008,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":946,"cache_hit":82432,"new_prefill":656,"score_linear":-1424.0,"score_lmetric":656},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42592,"ongoing_decode_tokens":21371,"pending_prefill_tokens":21221,"num_requests":2,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":83088,"score_linear":42592.0,"score_lmetric":208618},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":31527,"ongoing_decode_tokens":31527,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":83088,"score_linear":31527.0,"score_lmetric":166176},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":938,"cache_hit":0,"new_prefill":83088,"score_linear":45994.0,"score_lmetric":83088}],"chosen_score_linear":-1424.0,"chosen_score_lmetric":656,"t_first_token":390181.874051164,"t_first_token_unix":1779821046.8879948,"t_done":390183.065869567,"t_done_unix":1779821048.079814},{"request_id":"1341005:1:1341005:447","session_id":"1341005","input_length":5280,"t_proxy_recv":390182.740946725,"t_decision_unix":1779821047.7548883,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":5280,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5280,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":5280,"score_linear":48381.0,"score_lmetric":53661},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":5280,"score_linear":62618.0,"score_lmetric":5280},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":5280,"score_linear":115840.0,"score_lmetric":5280},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":2279,"ongoing_decode_tokens":2279,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":5280,"score_linear":2279.0,"score_lmetric":5280},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":165576,"ongoing_decode_tokens":83088,"pending_prefill_tokens":1080,"num_requests":2,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":5280,"score_linear":165576.0,"score_lmetric":12720},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42592,"ongoing_decode_tokens":42592,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":5280,"score_linear":42592.0,"score_lmetric":10560},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":5280,"score_linear":7065.0,"score_lmetric":5280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":938,"cache_hit":0,"new_prefill":5280,"score_linear":45994.0,"score_lmetric":5280}],"chosen_score_linear":2279.0,"chosen_score_lmetric":5280,"t_first_token":390183.084570742,"t_first_token_unix":1779821048.0985143,"t_done":390183.523180775,"t_done_unix":1779821048.5371242},{"request_id":"1340903:1:1340903:446","session_id":"1340903","input_length":2279,"t_proxy_recv":390182.400784934,"t_decision_unix":1779821047.4147263,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":2279,"score_linear":48381.0,"score_lmetric":50660},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":2279,"score_linear":62618.0,"score_lmetric":2279},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":2279,"score_linear":115840.0,"score_lmetric":2279},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":2279,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":165576,"ongoing_decode_tokens":83088,"pending_prefill_tokens":1080,"num_requests":2,"active_p_offloads":0,"cached_blocks":957,"cache_hit":0,"new_prefill":2279,"score_linear":165576.0,"score_lmetric":6718},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42592,"ongoing_decode_tokens":21371,"pending_prefill_tokens":21221,"num_requests":2,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":2279,"score_linear":42592.0,"score_lmetric":47000},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":2279,"score_linear":7065.0,"score_lmetric":2279},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":938,"cache_hit":0,"new_prefill":2279,"score_linear":45994.0,"score_lmetric":2279}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390182.590743162,"t_first_token_unix":1779821047.6046867,"t_done":390184.007064294,"t_done_unix":1779821049.021008},{"request_id":"1340290:1:1340290:445","session_id":"1340290","input_length":21221,"t_proxy_recv":390180.392781579,"t_decision_unix":1779821045.4067233,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":21221,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21221,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":21221,"score_linear":48381.0,"score_lmetric":69602},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21221,"score_linear":62618.0,"score_lmetric":21221},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":21221,"score_linear":115840.0,"score_lmetric":21221},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":21221,"score_linear":13816.0,"score_lmetric":35037},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":21221,"score_linear":163150.0,"score_lmetric":42442},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":21221,"score_linear":21371.0,"score_lmetric":21221},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":31527,"ongoing_decode_tokens":31527,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":1024,"new_prefill":20197,"score_linear":30503.0,"score_lmetric":40394},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":101124,"ongoing_decode_tokens":101124,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":21221,"score_linear":101124.0,"score_lmetric":42442}],"chosen_score_linear":21371.0,"chosen_score_lmetric":21221,"t_first_token":390182.64452389,"t_first_token_unix":1779821047.6584678,"t_done":390185.006940592,"t_done_unix":1779821050.0208838},{"request_id":"1279412:18:1332945:413","session_id":"1279412","input_length":82488,"t_proxy_recv":390182.331370848,"t_decision_unix":1779821047.3453126,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9869071864998545,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":1080,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":82488,"score_linear":48381.0,"score_lmetric":130869},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":82488,"score_linear":62618.0,"score_lmetric":82488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":12800,"new_prefill":69688,"score_linear":103040.0,"score_lmetric":69688},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1189,"cache_hit":0,"new_prefill":82488,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":83088,"ongoing_decode_tokens":83088,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":957,"cache_hit":81408,"new_prefill":1080,"score_linear":1680.0,"score_lmetric":1080},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42592,"ongoing_decode_tokens":21371,"pending_prefill_tokens":21221,"num_requests":2,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":82488,"score_linear":42592.0,"score_lmetric":207418},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":82488,"score_linear":7065.0,"score_lmetric":82488},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45994,"ongoing_decode_tokens":45994,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":938,"cache_hit":12800,"new_prefill":69688,"score_linear":33194.0,"score_lmetric":69688}],"chosen_score_linear":1680.0,"chosen_score_lmetric":1080,"t_first_token":390182.759215704,"t_first_token_unix":1779821047.773159,"t_done":390185.628727399,"t_done_unix":1779821050.6426759},{"request_id":"1341912:1:1341912:449","session_id":"1341912","input_length":9909,"t_proxy_recv":390185.778753568,"t_decision_unix":1779821050.792695,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9909,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":9909,"score_linear":48381.0,"score_lmetric":58290},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9909,"score_linear":62618.0,"score_lmetric":9909},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":9909,"score_linear":153367.0,"score_lmetric":47768},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":0,"pending_prefill_tokens":4832,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":9909,"score_linear":87264.0,"score_lmetric":14741},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":9909,"score_linear":21371.0,"score_lmetric":9909},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":9909,"score_linear":7065.0,"score_lmetric":9909},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":9909,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390186.537297634,"t_first_token_unix":1779821051.5512407,"t_done":390187.026038245,"t_done_unix":1779821052.0399816},{"request_id":"1340290:2:1342119:451","session_id":"1340290","input_length":21380,"t_proxy_recv":390186.441519594,"t_decision_unix":1779821051.455461,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9818521983161833,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":388,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":21380,"score_linear":48381.0,"score_lmetric":69761},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21380,"score_linear":62618.0,"score_lmetric":21380},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":21380,"score_linear":153367.0,"score_lmetric":70710},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19887,"ongoing_decode_tokens":0,"pending_prefill_tokens":19887,"num_requests":1,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":21380,"score_linear":19887.0,"score_lmetric":41267},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":0,"pending_prefill_tokens":4832,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":21380,"score_linear":87264.0,"score_lmetric":26212},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":20992,"new_prefill":388,"score_linear":379.0,"score_lmetric":388},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":1024,"new_prefill":20356,"score_linear":6041.0,"score_lmetric":20356},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9909,"ongoing_decode_tokens":0,"pending_prefill_tokens":9909,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":21380,"score_linear":9909.0,"score_lmetric":31289}],"chosen_score_linear":379.0,"chosen_score_lmetric":388,"t_first_token":390186.486135189,"t_first_token_unix":1779821051.5000787,"t_done":390187.405655932,"t_done_unix":1779821052.4195995},{"request_id":"1342327:1:1342327:452","session_id":"1342327","input_length":6180,"t_proxy_recv":390187.201123214,"t_decision_unix":1779821052.2150645,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":6180,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":6180,"score_linear":48381.0,"score_lmetric":54561},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":6180,"score_linear":62618.0,"score_lmetric":6180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":6180,"score_linear":153367.0,"score_lmetric":40310},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":19887,"ongoing_decode_tokens":0,"pending_prefill_tokens":19887,"num_requests":1,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":6180,"score_linear":19887.0,"score_lmetric":26067},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":0,"pending_prefill_tokens":4832,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":6180,"score_linear":87264.0,"score_lmetric":11012},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42751,"ongoing_decode_tokens":42751,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":6180,"score_linear":42751.0,"score_lmetric":12360},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":6180,"score_linear":7065.0,"score_lmetric":6180},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":958,"cache_hit":0,"new_prefill":6180,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390187.601809793,"t_first_token_unix":1779821052.6157532,"t_done":390187.899063991,"t_done_unix":1779821052.9130073},{"request_id":"1341948:1:1341948:450","session_id":"1341948","input_length":19887,"t_proxy_recv":390185.897661122,"t_decision_unix":1779821050.9116027,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":19887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":19887,"score_linear":48381.0,"score_lmetric":68268},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":19887,"score_linear":62618.0,"score_lmetric":19887},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":19887,"score_linear":153367.0,"score_lmetric":67724},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":19887,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":0,"pending_prefill_tokens":4832,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":19887,"score_linear":87264.0,"score_lmetric":24719},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":19887,"score_linear":21371.0,"score_lmetric":19887},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":19887,"score_linear":7065.0,"score_lmetric":19887},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":9909,"ongoing_decode_tokens":0,"pending_prefill_tokens":9909,"num_requests":1,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":19887,"score_linear":9909.0,"score_lmetric":29796}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390187.964067038,"t_first_token_unix":1779821052.978011,"t_done":390188.213672402,"t_done_unix":1779821053.2276158},{"request_id":"1340903:2:1342632:453","session_id":"1340903","input_length":2129,"t_proxy_recv":390188.237782575,"t_decision_unix":1779821053.251724,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":2048,"affinity_cache_ratio":0.9619539689995303,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":2048,"estimated_new_tokens":81,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":2129,"score_linear":48381.0,"score_lmetric":50510},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":2129,"score_linear":62618.0,"score_lmetric":2129},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":2129,"score_linear":153367.0,"score_lmetric":32208},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":2048,"new_prefill":81,"score_linear":-2048.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":87264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":2129,"score_linear":87264.0,"score_lmetric":2129},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":2129,"score_linear":21371.0,"score_lmetric":2129},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":2129,"score_linear":7065.0,"score_lmetric":2129},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":2129,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-2048.0,"chosen_score_lmetric":0,"t_first_token":390188.252528273,"t_first_token_unix":1779821053.2664719,"t_done":390188.324899884,"t_done_unix":1779821053.3388429},{"request_id":"1316848:14:1338658:435","session_id":"1316848","input_length":49688,"t_proxy_recv":390175.619040809,"t_decision_unix":1779821040.6329823,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":44544,"affinity_cache_ratio":0.8964739977459346,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44544,"estimated_new_tokens":5144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":43544,"score_linear":56474.0,"score_lmetric":43544},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":44544,"new_prefill":5144,"score_linear":-44544.0,"score_lmetric":-5144},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":50215,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":49688,"score_linear":50215.0,"score_lmetric":49688},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":49688,"score_linear":163150.0,"score_lmetric":99376},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":49688,"score_linear":73073.0,"score_lmetric":49688},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":49688,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":49688,"score_linear":55130.0,"score_lmetric":49688}],"chosen_score_linear":-44544.0,"chosen_score_lmetric":-5144,"t_first_token":390177.11850323,"t_first_token_unix":1779821042.1324468,"t_done":390188.606205175,"t_done_unix":1779821053.6201487},{"request_id":"1340278:1:1340278:444","session_id":"1340278","input_length":48381,"t_proxy_recv":390180.370387666,"t_decision_unix":1779821045.3843288,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":48381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":48381,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":48381,"score_linear":62618.0,"score_lmetric":48381},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":48381,"score_linear":115840.0,"score_lmetric":48381},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":48381,"score_linear":13816.0,"score_lmetric":62197},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":48381,"score_linear":163150.0,"score_lmetric":96762},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":914,"cache_hit":0,"new_prefill":48381,"score_linear":21371.0,"score_lmetric":48381},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":31527,"ongoing_decode_tokens":31527,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":48381,"score_linear":31527.0,"score_lmetric":96762},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":101124,"ongoing_decode_tokens":101124,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":48381,"score_linear":101124.0,"score_lmetric":96762}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390189.136549273,"t_first_token_unix":1779821054.150493,"t_done":390189.718847167,"t_done_unix":1779821054.732793},{"request_id":"1279412:19:1335444:421","session_id":"1279412","input_length":87264,"t_proxy_recv":390185.645617061,"t_decision_unix":1779821050.6595588,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82432,"affinity_cache_ratio":0.9446277961129447,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82432,"estimated_new_tokens":4832,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":87264,"score_linear":48381.0,"score_lmetric":135645},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":87264,"score_linear":62618.0,"score_lmetric":87264},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":12800,"new_prefill":74464,"score_linear":140567.0,"score_lmetric":176878},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":87264,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":960,"cache_hit":82432,"new_prefill":4832,"score_linear":-82432.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":87264,"score_linear":21371.0,"score_lmetric":87264},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":87264,"score_linear":7065.0,"score_lmetric":87264},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":12800,"new_prefill":74464,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-82432.0,"chosen_score_lmetric":0,"t_first_token":390188.137787301,"t_first_token_unix":1779821053.1517308,"t_done":390190.10680805,"t_done_unix":1779821055.1207514},{"request_id":"1343191:1:1343191:457","session_id":"1343191","input_length":11912,"t_proxy_recv":390190.309775573,"t_decision_unix":1779821055.3237169,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11912,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1058,"cache_hit":0,"new_prefill":11912,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":11912,"score_linear":62618.0,"score_lmetric":11912},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":103679,"ongoing_decode_tokens":103679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":11912,"score_linear":103679.0,"score_lmetric":11912},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":11912,"score_linear":74649.0,"score_lmetric":162882},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":11912,"score_linear":95383.0,"score_lmetric":20255},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":11912,"score_linear":21371.0,"score_lmetric":11912},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":11912,"score_linear":7065.0,"score_lmetric":11912},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":11912,"score_linear":59219.0,"score_lmetric":71131}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390191.267283954,"t_first_token_unix":1779821056.281228,"t_done":390191.318965274,"t_done_unix":1779821056.3329089},{"request_id":"1334223:2:1341796:448","session_id":"1334223","input_length":37527,"t_proxy_recv":390185.346725617,"t_decision_unix":1779821050.360667,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":23552,"affinity_cache_ratio":0.6276014602819303,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":13975,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":37527,"score_linear":48381.0,"score_lmetric":85908},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":37527,"score_linear":62618.0,"score_lmetric":37527},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":23552,"new_prefill":13975,"score_linear":92288.0,"score_lmetric":13975},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1203,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":82488,"ongoing_decode_tokens":82488,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":958,"cache_hit":0,"new_prefill":37527,"score_linear":82488.0,"score_lmetric":37527},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":37527,"score_linear":21371.0,"score_lmetric":37527},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":37527,"score_linear":7065.0,"score_lmetric":37527},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":939,"cache_hit":0,"new_prefill":37527,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":92288.0,"chosen_score_lmetric":13975,"t_first_token":390188.402484157,"t_first_token_unix":1779821053.416428,"t_done":390191.513255702,"t_done_unix":1779821056.5271993},{"request_id":"1338292:2:1343599:460","session_id":"1338292","input_length":14103,"t_proxy_recv":390191.516953859,"t_decision_unix":1779821056.5308955,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":9216,"affinity_cache_ratio":0.6534779834077856,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":4887,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":14103,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14103,"score_linear":62618.0,"score_lmetric":14103},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":14103,"score_linear":66152.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":14103,"score_linear":74649.0,"score_lmetric":167264},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":14103,"score_linear":95383.0,"score_lmetric":22446},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42773,"ongoing_decode_tokens":21371,"pending_prefill_tokens":21402,"num_requests":2,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":14103,"score_linear":42773.0,"score_lmetric":71010},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":9216,"new_prefill":4887,"score_linear":-2151.0,"score_lmetric":4887},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":69451,"ongoing_decode_tokens":0,"pending_prefill_tokens":59723,"num_requests":2,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":14103,"score_linear":69451.0,"score_lmetric":147652}],"chosen_score_linear":-2151.0,"chosen_score_lmetric":4887,"t_first_token":390192.081717948,"t_first_token_unix":1779821057.0956616,"t_done":390192.165593001,"t_done_unix":1779821057.179536},{"request_id":"1343312:1:1343312:459","session_id":"1343312","input_length":21402,"t_proxy_recv":390190.674266365,"t_decision_unix":1779821055.6882076,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":21402,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21402,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11912,"ongoing_decode_tokens":0,"pending_prefill_tokens":11912,"num_requests":1,"active_p_offloads":0,"cached_blocks":1058,"cache_hit":0,"new_prefill":21402,"score_linear":11912.0,"score_lmetric":33314},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21402,"score_linear":62618.0,"score_lmetric":21402},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":103679,"ongoing_decode_tokens":103679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":21402,"score_linear":103679.0,"score_lmetric":21402},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":21402,"score_linear":74649.0,"score_lmetric":181862},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":21402,"score_linear":95383.0,"score_lmetric":29745},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":21402,"score_linear":21371.0,"score_lmetric":21402},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":21402,"score_linear":7065.0,"score_lmetric":21402},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":69451,"ongoing_decode_tokens":0,"pending_prefill_tokens":59723,"num_requests":2,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":21402,"score_linear":69451.0,"score_lmetric":162250}],"chosen_score_linear":21371.0,"chosen_score_lmetric":21402,"t_first_token":390192.974466761,"t_first_token_unix":1779821057.9884114,"t_done":390193.059871332,"t_done_unix":1779821058.0738142},{"request_id":"1316848:15:1344261:463","session_id":"1316848","input_length":50447,"t_proxy_recv":390193.747903806,"t_decision_unix":1779821058.7618446,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":50176,"affinity_cache_ratio":0.9946280254524551,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":271,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":50447,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":44303,"score_linear":56474.0,"score_lmetric":44303},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":50176,"new_prefill":271,"score_linear":15976.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":50447,"score_linear":74649.0,"score_lmetric":239952},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":50447,"score_linear":95383.0,"score_lmetric":58790},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":50447,"score_linear":21371.0,"score_lmetric":50447},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":50447,"score_linear":7065.0,"score_lmetric":50447},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":50447,"score_linear":79271.0,"score_lmetric":341538}],"chosen_score_linear":15976.0,"chosen_score_lmetric":0,"t_first_token":390193.938235887,"t_first_token_unix":1779821058.9521792,"t_done":390194.441720929,"t_done_unix":1779821059.4556646},{"request_id":"1279412:20:1337591:428","session_id":"1279412","input_length":95383,"t_proxy_recv":390190.126781002,"t_decision_unix":1779821055.1407228,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":87040,"affinity_cache_ratio":0.912531583196167,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":87040,"estimated_new_tokens":8343,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1058,"cache_hit":0,"new_prefill":95383,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":95383,"score_linear":62618.0,"score_lmetric":95383},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":103679,"ongoing_decode_tokens":103679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":12800,"new_prefill":82583,"score_linear":90879.0,"score_lmetric":82583},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":95383,"score_linear":74649.0,"score_lmetric":329824},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":969,"cache_hit":87040,"new_prefill":8343,"score_linear":-87040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":95383,"score_linear":21371.0,"score_lmetric":95383},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":95383,"score_linear":7065.0,"score_lmetric":95383},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":970,"cache_hit":12800,"new_prefill":82583,"score_linear":46419.0,"score_lmetric":141802}],"chosen_score_linear":-87040.0,"chosen_score_lmetric":0,"t_first_token":390194.655920764,"t_first_token_unix":1779821059.669866,"t_done":390196.146091116,"t_done_unix":1779821061.1600385},{"request_id":"1279412:21:1339581:440","session_id":"1279412","input_length":95543,"t_proxy_recv":390196.160956808,"t_decision_unix":1779821061.1748981,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":95232,"affinity_cache_ratio":0.9967449211349864,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":95232,"estimated_new_tokens":311,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":95543,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":95543,"score_linear":62618.0,"score_lmetric":95543},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":98968,"ongoing_decode_tokens":66152,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":12800,"new_prefill":82743,"score_linear":86168.0,"score_lmetric":115559},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":95543,"score_linear":74649.0,"score_lmetric":330144},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":985,"cache_hit":95232,"new_prefill":311,"score_linear":-95232.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":95543,"score_linear":21371.0,"score_lmetric":95543},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":95543,"score_linear":7065.0,"score_lmetric":95543},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":12800,"new_prefill":82743,"score_linear":66471.0,"score_lmetric":438426}],"chosen_score_linear":-95232.0,"chosen_score_lmetric":0,"t_first_token":390196.300789942,"t_first_token_unix":1779821061.3147335,"t_done":390198.585595988,"t_done_unix":1779821063.5995395},{"request_id":"1345921:1:1345921:469","session_id":"1345921","input_length":505,"t_proxy_recv":390199.438934832,"t_decision_unix":1779821064.4528763,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":505,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":505,"score_linear":62618.0,"score_lmetric":505},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157783,"ongoing_decode_tokens":66152,"pending_prefill_tokens":41455,"num_requests":2,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":505,"score_linear":157783.0,"score_lmetric":83920},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":505,"score_linear":74649.0,"score_lmetric":140068},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95781,"ongoing_decode_tokens":95781,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":505,"score_linear":95781.0,"score_lmetric":505},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95317,"ongoing_decode_tokens":95317,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":505,"score_linear":95317.0,"score_lmetric":1010},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":505,"score_linear":7065.0,"score_lmetric":505},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":505,"score_linear":79271.0,"score_lmetric":191712}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390199.488722448,"t_first_token_unix":1779821064.5026658,"t_done":390199.809571704,"t_done_unix":1779821064.8235147},{"request_id":"1279412:22:1344210:462","session_id":"1279412","input_length":95781,"t_proxy_recv":390198.604910449,"t_decision_unix":1779821063.618852,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9996137020912289,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":37,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":95781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":95781,"score_linear":62618.0,"score_lmetric":95781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157783,"ongoing_decode_tokens":66152,"pending_prefill_tokens":41455,"num_requests":2,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":12800,"new_prefill":82981,"score_linear":144983.0,"score_lmetric":248872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":95781,"score_linear":74649.0,"score_lmetric":330620},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":95744,"new_prefill":37,"score_linear":-95744.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95317,"ongoing_decode_tokens":95317,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":95781,"score_linear":95317.0,"score_lmetric":191562},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":95781,"score_linear":7065.0,"score_lmetric":95781},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":12800,"new_prefill":82981,"score_linear":66471.0,"score_lmetric":439140}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":390198.743490898,"t_first_token_unix":1779821063.7574422,"t_done":390200.845901408,"t_done_unix":1779821065.8598454},{"request_id":"1342327:2:1343857:461","session_id":"1342327","input_length":9820,"t_proxy_recv":390192.336915682,"t_decision_unix":1779821057.350857,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":6144,"affinity_cache_ratio":0.6256619144602852,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":3676,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":9820,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9820,"score_linear":62618.0,"score_lmetric":9820},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":9820,"score_linear":66152.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":9820,"score_linear":74649.0,"score_lmetric":158698},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":9820,"score_linear":95383.0,"score_lmetric":18163},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":42773,"ongoing_decode_tokens":21371,"pending_prefill_tokens":21402,"num_requests":2,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":9820,"score_linear":42773.0,"score_lmetric":62444},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":9820,"score_linear":7065.0,"score_lmetric":9820},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":69451,"ongoing_decode_tokens":0,"pending_prefill_tokens":59723,"num_requests":2,"active_p_offloads":0,"cached_blocks":970,"cache_hit":6144,"new_prefill":3676,"score_linear":63307.0,"score_lmetric":126798}],"chosen_score_linear":63307.0,"chosen_score_lmetric":126798,"t_first_token":390201.20141394,"t_first_token_unix":1779821066.2153566,"t_done":390201.63596675,"t_done_unix":1779821066.649916},{"request_id":"1342327:3:1344788:466","session_id":"1342327","input_length":12398,"t_proxy_recv":390201.641525272,"t_decision_unix":1779821066.6554663,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9728,"affinity_cache_ratio":0.78464268430392,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":2670,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":12398,"score_linear":62618.0,"score_lmetric":12398},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157783,"ongoing_decode_tokens":98968,"pending_prefill_tokens":8639,"num_requests":2,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":12398,"score_linear":157783.0,"score_lmetric":42074},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":12398,"score_linear":74649.0,"score_lmetric":163854},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":12398,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95317,"ongoing_decode_tokens":95317,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":12398,"score_linear":95317.0,"score_lmetric":24796},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44084,"ongoing_decode_tokens":7065,"pending_prefill_tokens":2715,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":12398,"score_linear":44084.0,"score_lmetric":30226},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":69451,"ongoing_decode_tokens":69451,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":977,"cache_hit":9728,"new_prefill":2670,"score_linear":59723.0,"score_lmetric":5340}],"chosen_score_linear":59723.0,"chosen_score_lmetric":5340,"t_first_token":390201.973617587,"t_first_token_unix":1779821066.987562,"t_done":390202.254289297,"t_done_unix":1779821067.2682328},{"request_id":"1269373:18:1345570:467","session_id":"1269373","input_length":73946,"t_proxy_recv":390198.110940327,"t_decision_unix":1779821063.1248817,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9901279311930328,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":730,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":4096,"new_prefill":69850,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":73946,"score_linear":62618.0,"score_lmetric":73946},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":98968,"ongoing_decode_tokens":66152,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":73946,"score_linear":98968.0,"score_lmetric":106762},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":73946,"score_linear":74649.0,"score_lmetric":286950},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95543,"ongoing_decode_tokens":95543,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":73946,"score_linear":95543.0,"score_lmetric":73946},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":73216,"new_prefill":730,"score_linear":-51845.0,"score_lmetric":730},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":14848,"new_prefill":59098,"score_linear":-7783.0,"score_lmetric":59098},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":7680,"new_prefill":66266,"score_linear":71591.0,"score_lmetric":388995}],"chosen_score_linear":-51845.0,"chosen_score_lmetric":730,"t_first_token":390198.552706346,"t_first_token_unix":1779821063.5666502,"t_done":390202.632138726,"t_done_unix":1779821067.6460826},{"request_id":"1342327:4:1346218:471","session_id":"1342327","input_length":14842,"t_proxy_recv":390202.302642794,"t_decision_unix":1779821067.3165839,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":12288,"affinity_cache_ratio":0.8279207653954993,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":2554,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":14842,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14842,"score_linear":62618.0,"score_lmetric":14842},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157783,"ongoing_decode_tokens":98968,"pending_prefill_tokens":8639,"num_requests":2,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":14842,"score_linear":157783.0,"score_lmetric":46962},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":14842,"score_linear":74649.0,"score_lmetric":168742},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":14842,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95317,"ongoing_decode_tokens":95317,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":14842,"score_linear":95317.0,"score_lmetric":29684},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44084,"ongoing_decode_tokens":44084,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":14842,"score_linear":44084.0,"score_lmetric":29684},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":69451,"ongoing_decode_tokens":69451,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":982,"cache_hit":12288,"new_prefill":2554,"score_linear":57163.0,"score_lmetric":5108}],"chosen_score_linear":57163.0,"chosen_score_lmetric":5108,"t_first_token":390202.656064938,"t_first_token_unix":1779821067.6700091,"t_done":390202.779883211,"t_done_unix":1779821067.7938268},{"request_id":"1342634:1:1342634:454","session_id":"1342634","input_length":59219,"t_proxy_recv":390188.293227839,"t_decision_unix":1779821053.307169,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":59219,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":0,"pending_prefill_tokens":48381,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":59219,"score_linear":48381.0,"score_lmetric":107600},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":59219,"score_linear":62618.0,"score_lmetric":59219},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":153367,"ongoing_decode_tokens":115840,"pending_prefill_tokens":13975,"num_requests":2,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":59219,"score_linear":153367.0,"score_lmetric":146388},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":2129,"ongoing_decode_tokens":2129,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":59219,"score_linear":2129.0,"score_lmetric":59219},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":87264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":59219,"score_linear":87264.0,"score_lmetric":59219},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":59219,"score_linear":21371.0,"score_lmetric":59219},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":59219,"score_linear":7065.0,"score_lmetric":59219},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":59219,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390201.198434251,"t_first_token_unix":1779821066.2123787,"t_done":390203.025741587,"t_done_unix":1779821068.039685},{"request_id":"1341912:2:1343220:458","session_id":"1341912","input_length":10232,"t_proxy_recv":390190.387960583,"t_decision_unix":1779821055.4019022,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9507427677873339,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11912,"ongoing_decode_tokens":0,"pending_prefill_tokens":11912,"num_requests":1,"active_p_offloads":0,"cached_blocks":1058,"cache_hit":0,"new_prefill":10232,"score_linear":11912.0,"score_lmetric":22144},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":10232,"score_linear":62618.0,"score_lmetric":10232},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":103679,"ongoing_decode_tokens":103679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":10232,"score_linear":103679.0,"score_lmetric":10232},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":10232,"score_linear":74649.0,"score_lmetric":159522},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":0,"pending_prefill_tokens":8343,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":10232,"score_linear":95383.0,"score_lmetric":18575},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":10232,"score_linear":21371.0,"score_lmetric":10232},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":10232,"score_linear":7065.0,"score_lmetric":10232},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":970,"cache_hit":9728,"new_prefill":504,"score_linear":49491.0,"score_lmetric":59723}],"chosen_score_linear":49491.0,"chosen_score_lmetric":59723,"t_first_token":390201.20069255,"t_first_token_unix":1779821066.2146363,"t_done":390203.229370742,"t_done_unix":1779821068.2433145},{"request_id":"1316848:16:1345678:468","session_id":"1316848","input_length":58815,"t_proxy_recv":390198.573748492,"t_decision_unix":1779821063.5876899,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":50176,"affinity_cache_ratio":0.8531157017767577,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":8639,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":58815,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":6144,"new_prefill":52671,"score_linear":56474.0,"score_lmetric":52671},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":98968,"ongoing_decode_tokens":66152,"pending_prefill_tokens":32816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":50176,"new_prefill":8639,"score_linear":48792.0,"score_lmetric":41455},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":58815,"score_linear":74649.0,"score_lmetric":256688},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95543,"ongoing_decode_tokens":95543,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":985,"cache_hit":0,"new_prefill":58815,"score_linear":95543.0,"score_lmetric":58815},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95317,"ongoing_decode_tokens":95317,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":58815,"score_linear":95317.0,"score_lmetric":117630},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":58815,"score_linear":7065.0,"score_lmetric":58815},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":58815,"score_linear":79271.0,"score_lmetric":366642}],"chosen_score_linear":48792.0,"chosen_score_lmetric":41455,"t_first_token":390203.145367551,"t_first_token_unix":1779821068.1593113,"t_done":390203.380334131,"t_done_unix":1779821068.3942776},{"request_id":"1344773:1:1344773:465","session_id":"1344773","input_length":32816,"t_proxy_recv":390195.542866365,"t_decision_unix":1779821060.5568078,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":32816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1081,"cache_hit":0,"new_prefill":32816,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":32816,"score_linear":62618.0,"score_lmetric":32816},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":32816,"score_linear":66152.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":32816,"score_linear":74649.0,"score_lmetric":204690},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":95383,"ongoing_decode_tokens":95383,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":969,"cache_hit":0,"new_prefill":32816,"score_linear":95383.0,"score_lmetric":32816},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":32816,"score_linear":21371.0,"score_lmetric":32816},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":32816,"score_linear":7065.0,"score_lmetric":32816},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":32816,"score_linear":79271.0,"score_lmetric":288645}],"chosen_score_linear":66152.0,"chosen_score_lmetric":0,"t_first_token":390200.134935088,"t_first_token_unix":1779821065.148879,"t_done":390203.413742045,"t_done_unix":1779821068.4276853},{"request_id":"1268861:6:1346340:472","session_id":"1268861","input_length":37019,"t_proxy_recv":390200.983391897,"t_decision_unix":1779821065.9973328,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9266592830708555,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":2715,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":37019,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":37019,"score_linear":62618.0,"score_lmetric":37019},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157783,"ongoing_decode_tokens":98968,"pending_prefill_tokens":8639,"num_requests":2,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":37019,"score_linear":157783.0,"score_lmetric":91316},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":37019,"score_linear":74649.0,"score_lmetric":213096},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":37019,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95317,"ongoing_decode_tokens":95317,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":37019,"score_linear":95317.0,"score_lmetric":74038},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":34304,"new_prefill":2715,"score_linear":-27239.0,"score_lmetric":2715},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79271,"ongoing_decode_tokens":0,"pending_prefill_tokens":63399,"num_requests":3,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":37019,"score_linear":79271.0,"score_lmetric":301254}],"chosen_score_linear":-27239.0,"chosen_score_lmetric":2715,"t_first_token":390201.646318487,"t_first_token_unix":1779821066.6602619,"t_done":390203.856158104,"t_done_unix":1779821068.8701017},{"request_id":"1344773:2:1346419:473","session_id":"1344773","input_length":33008,"t_proxy_recv":390203.420920517,"t_decision_unix":1779821068.4348621,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":32768,"affinity_cache_ratio":0.9927290353853612,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32768,"estimated_new_tokens":240,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":33008,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":33008,"score_linear":62618.0,"score_lmetric":33008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":32768,"new_prefill":240,"score_linear":33384.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":33008,"score_linear":74649.0,"score_lmetric":205074},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":33008,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":33008,"score_linear":21371.0,"score_lmetric":33008},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44084,"ongoing_decode_tokens":44084,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":33008,"score_linear":44084.0,"score_lmetric":66016},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":33008,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":33384.0,"chosen_score_lmetric":0,"t_first_token":390203.560281542,"t_first_token_unix":1779821068.5742252,"t_done":390203.860624639,"t_done_unix":1779821068.874568},{"request_id":"1345921:2:1347089:474","session_id":"1345921","input_length":773,"t_proxy_recv":390203.625681519,"t_decision_unix":1779821068.639623,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":512,"affinity_cache_ratio":0.6623544631306598,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":512,"new_prefill":261,"score_linear":-512.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":773,"score_linear":62618.0,"score_lmetric":773},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":99160,"ongoing_decode_tokens":99160,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":773,"score_linear":99160.0,"score_lmetric":773},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":0,"pending_prefill_tokens":69529,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":773,"score_linear":74649.0,"score_lmetric":140604},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":773,"score_linear":21371.0,"score_lmetric":773},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44084,"ongoing_decode_tokens":44084,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":773,"score_linear":44084.0,"score_lmetric":1546},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390203.660796439,"t_first_token_unix":1779821068.6747446,"t_done":390203.907705698,"t_done_unix":1779821068.9216492},{"request_id":"1314357:3:1338999:437","session_id":"1314357","input_length":66152,"t_proxy_recv":390175.653318776,"t_decision_unix":1779821040.6672604,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9287701052122385,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":4712,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":3584,"new_prefill":62568,"score_linear":59034.0,"score_lmetric":62568},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":49688,"ongoing_decode_tokens":0,"pending_prefill_tokens":5144,"num_requests":0,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":61440,"new_prefill":4712,"score_linear":-11752.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":50215,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":66152,"score_linear":50215.0,"score_lmetric":66152},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":66152,"score_linear":163150.0,"score_lmetric":132304},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":66152,"score_linear":73073.0,"score_lmetric":66152},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":66152,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":66152,"score_linear":55130.0,"score_lmetric":66152}],"chosen_score_linear":-11752.0,"chosen_score_lmetric":0,"t_first_token":390179.096459731,"t_first_token_unix":1779821044.110404,"t_done":390204.784180036,"t_done_unix":1779821069.7981243},{"request_id":"1341948:2:1347296:475","session_id":"1341948","input_length":25661,"t_proxy_recv":390204.347144729,"t_decision_unix":1779821069.361086,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":19456,"affinity_cache_ratio":0.7581933673668212,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":6205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":25661,"score_linear":62618.0,"score_lmetric":25661},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66152,"ongoing_decode_tokens":66152,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1864,"cache_hit":0,"new_prefill":25661,"score_linear":66152.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74649,"ongoing_decode_tokens":65289,"pending_prefill_tokens":4240,"num_requests":2,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":19456,"new_prefill":6205,"score_linear":55193.0,"score_lmetric":20890},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":25661,"score_linear":21371.0,"score_lmetric":25661},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1011,"cache_hit":0,"new_prefill":25661,"score_linear":7065.0,"score_lmetric":25661},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":25661,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":55193.0,"chosen_score_lmetric":20890,"t_first_token":390205.60699547,"t_first_token_unix":1779821070.6209393,"t_done":390206.193108451,"t_done_unix":1779821071.2070534},{"request_id":"1341005:2:1342961:456","session_id":"1341005","input_length":9360,"t_proxy_recv":390189.408689704,"t_decision_unix":1779821054.4226305,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":5120,"affinity_cache_ratio":0.5470085470085471,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":4240,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":48381,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":9360,"score_linear":48381.0,"score_lmetric":9360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":9360,"score_linear":62618.0,"score_lmetric":9360},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":103679,"ongoing_decode_tokens":103679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":9360,"score_linear":103679.0,"score_lmetric":9360},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":0,"pending_prefill_tokens":65289,"num_requests":1,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":5120,"new_prefill":4240,"score_linear":60169.0,"score_lmetric":69529},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":87264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":9360,"score_linear":87264.0,"score_lmetric":9360},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":9360,"score_linear":21371.0,"score_lmetric":9360},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":9360,"score_linear":7065.0,"score_lmetric":9360},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":9360,"score_linear":59219.0,"score_lmetric":68579}],"chosen_score_linear":60169.0,"chosen_score_lmetric":69529,"t_first_token":390204.609214636,"t_first_token_unix":1779821069.623158,"t_done":390206.220419365,"t_done_unix":1779821071.2343624},{"request_id":"1347763:1:1347763:476","session_id":"1347763","input_length":5465,"t_proxy_recv":390205.950767398,"t_decision_unix":1779821070.9647083,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-5465,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":5465,"score_linear":62618.0,"score_lmetric":5465},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1875,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":-5465},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":100310,"ongoing_decode_tokens":100310,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":5465,"score_linear":100310.0,"score_lmetric":16395},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":5465,"score_linear":21371.0,"score_lmetric":5465},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1011,"cache_hit":0,"new_prefill":5465,"score_linear":7065.0,"score_lmetric":5465},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":5465,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":-5465,"t_first_token":390206.309277072,"t_first_token_unix":1779821071.3232212,"t_done":390206.43334548,"t_done_unix":1779821071.4472888},{"request_id":"1339070:1:1339070:438","session_id":"1339070","input_length":7065,"t_proxy_recv":390175.860627838,"t_decision_unix":1779821040.8745692,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7065,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":7065,"score_linear":62618.0,"score_lmetric":7065},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":0,"pending_prefill_tokens":9856,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":7065,"score_linear":115840.0,"score_lmetric":16921},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":50215,"ongoing_decode_tokens":50215,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":7065,"score_linear":50215.0,"score_lmetric":7065},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":7065,"score_linear":163150.0,"score_lmetric":14130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73073,"ongoing_decode_tokens":73073,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":911,"cache_hit":0,"new_prefill":7065,"score_linear":73073.0,"score_lmetric":7065},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":992,"cache_hit":0,"new_prefill":7065,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55130,"ongoing_decode_tokens":55130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":936,"cache_hit":0,"new_prefill":7065,"score_linear":55130.0,"score_lmetric":7065}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390176.338200248,"t_first_token_unix":1779821041.3521442,"t_done":390206.906478348,"t_done_unix":1779821071.9204216},{"request_id":"1342921:1:1342921:455","session_id":"1342921","input_length":65289,"t_proxy_recv":390189.314775688,"t_decision_unix":1779821054.328717,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":65289,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48381,"ongoing_decode_tokens":48381,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":964,"cache_hit":0,"new_prefill":65289,"score_linear":48381.0,"score_lmetric":65289},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":65289,"score_linear":62618.0,"score_lmetric":65289},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":103679,"ongoing_decode_tokens":103679,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1757,"cache_hit":0,"new_prefill":65289,"score_linear":103679.0,"score_lmetric":65289},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1241,"cache_hit":0,"new_prefill":65289,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":87264,"ongoing_decode_tokens":87264,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":960,"cache_hit":0,"new_prefill":65289,"score_linear":87264.0,"score_lmetric":65289},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":956,"cache_hit":0,"new_prefill":65289,"score_linear":21371.0,"score_lmetric":65289},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":7065,"ongoing_decode_tokens":7065,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":997,"cache_hit":0,"new_prefill":65289,"score_linear":7065.0,"score_lmetric":65289},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":59219,"ongoing_decode_tokens":0,"pending_prefill_tokens":59219,"num_requests":1,"active_p_offloads":0,"cached_blocks":970,"cache_hit":0,"new_prefill":65289,"score_linear":59219.0,"score_lmetric":124508}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390204.336239924,"t_first_token_unix":1779821069.3501835,"t_done":390209.142193294,"t_done_unix":1779821074.1561368},{"request_id":"1345921:3:1348784:483","session_id":"1345921","input_length":1397,"t_proxy_recv":390209.623452836,"t_decision_unix":1779821074.6373944,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":512,"affinity_cache_ratio":0.36649964209019326,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":885,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":512,"new_prefill":885,"score_linear":-512.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":1397,"score_linear":62618.0,"score_lmetric":1397},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":80838,"ongoing_decode_tokens":41202,"pending_prefill_tokens":3284,"num_requests":1,"active_p_offloads":0,"cached_blocks":1885,"cache_hit":0,"new_prefill":1397,"score_linear":80838.0,"score_lmetric":4681},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":1397,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":1397,"score_linear":96026.0,"score_lmetric":1397},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":1397,"score_linear":21371.0,"score_lmetric":1397},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":1397,"score_linear":17217.0,"score_lmetric":18614},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12701,"ongoing_decode_tokens":0,"pending_prefill_tokens":12701,"num_requests":1,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":1397,"score_linear":12701.0,"score_lmetric":14098}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390209.686212647,"t_first_token_unix":1779821074.7001565,"t_done":390209.802990082,"t_done_unix":1779821074.8169336},{"request_id":"1311753:3:1348389:480","session_id":"1311753","input_length":39636,"t_proxy_recv":390208.432081336,"t_decision_unix":1779821073.4460225,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9171460288626501,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":3284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":39636,"score_linear":62618.0,"score_lmetric":39636},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":41202,"ongoing_decode_tokens":0,"pending_prefill_tokens":3826,"num_requests":0,"active_p_offloads":0,"cached_blocks":1885,"cache_hit":36352,"new_prefill":3284,"score_linear":4850.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":39636,"score_linear":65289.0,"score_lmetric":39636},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":39636,"score_linear":96026.0,"score_lmetric":39636},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":39636,"score_linear":21371.0,"score_lmetric":39636},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":39636,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":4850.0,"chosen_score_lmetric":0,"t_first_token":390209.65348522,"t_first_token_unix":1779821074.667429,"t_done":390210.046392772,"t_done_unix":1779821075.0603364},{"request_id":"1348394:1:1348394:481","session_id":"1348394","input_length":17217,"t_proxy_recv":390208.459853173,"t_decision_unix":1779821073.4737937,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17217,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":17217,"score_linear":62618.0,"score_lmetric":17217},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":80838,"ongoing_decode_tokens":0,"pending_prefill_tokens":7110,"num_requests":1,"active_p_offloads":0,"cached_blocks":1885,"cache_hit":0,"new_prefill":17217,"score_linear":80838.0,"score_lmetric":24327},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":17217,"score_linear":65289.0,"score_lmetric":17217},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":17217,"score_linear":96026.0,"score_lmetric":17217},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":17217,"score_linear":21371.0,"score_lmetric":17217},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":17217,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390210.123132556,"t_first_token_unix":1779821075.1370761,"t_done":390210.490078694,"t_done_unix":1779821075.5040221},{"request_id":"1348691:1:1348691:482","session_id":"1348691","input_length":12701,"t_proxy_recv":390209.322816355,"t_decision_unix":1779821074.3367574,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12701,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":12701,"score_linear":62618.0,"score_lmetric":12701},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":80838,"ongoing_decode_tokens":41202,"pending_prefill_tokens":3284,"num_requests":1,"active_p_offloads":0,"cached_blocks":1885,"cache_hit":0,"new_prefill":12701,"score_linear":80838.0,"score_lmetric":15985},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":12701,"score_linear":96026.0,"score_lmetric":12701},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":12701,"score_linear":21371.0,"score_lmetric":12701},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":17217,"ongoing_decode_tokens":0,"pending_prefill_tokens":17217,"num_requests":1,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":12701,"score_linear":17217.0,"score_lmetric":29918},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":12701,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390210.374410879,"t_first_token_unix":1779821075.388355,"t_done":390210.728481054,"t_done_unix":1779821075.7424242},{"request_id":"1349975:1:1349975:487","session_id":"1349975","input_length":4988,"t_proxy_recv":390213.847593595,"t_decision_unix":1779821078.861535,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4988,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":4988,"score_linear":62618.0,"score_lmetric":4988},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":74536,"ongoing_decode_tokens":74536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1891,"cache_hit":0,"new_prefill":4988,"score_linear":74536.0,"score_lmetric":4988},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":4988,"score_linear":96026.0,"score_lmetric":4988},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":97864,"ongoing_decode_tokens":97864,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":4988,"score_linear":97864.0,"score_lmetric":9976},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1059,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":4988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390214.165138722,"t_first_token_unix":1779821079.1790822,"t_done":390214.479677361,"t_done_unix":1779821079.4936242},{"request_id":"1344773:3:1349525:486","session_id":"1344773","input_length":33334,"t_proxy_recv":390212.261074583,"t_decision_unix":1779821077.2750158,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":32768,"affinity_cache_ratio":0.9830203395932081,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32768,"estimated_new_tokens":566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":33334,"score_linear":62618.0,"score_lmetric":33334},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1891,"cache_hit":32768,"new_prefill":566,"score_linear":8434.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":33334,"score_linear":96026.0,"score_lmetric":33334},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":97864,"ongoing_decode_tokens":21371,"pending_prefill_tokens":2253,"num_requests":2,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":33334,"score_linear":97864.0,"score_lmetric":71174},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1059,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":33334,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":8434.0,"chosen_score_lmetric":0,"t_first_token":390212.452873692,"t_first_token_unix":1779821077.4668167,"t_done":390214.484969218,"t_done_unix":1779821079.4989126},{"request_id":"1350162:1:1350162:488","session_id":"1350162","input_length":4594,"t_proxy_recv":390214.534288194,"t_decision_unix":1779821079.5482295,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4594,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":4594,"score_linear":62618.0,"score_lmetric":4594},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1892,"cache_hit":0,"new_prefill":4594,"score_linear":41202.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":4594,"score_linear":96026.0,"score_lmetric":4594},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":97864,"ongoing_decode_tokens":97864,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":4594,"score_linear":97864.0,"score_lmetric":9188},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":0,"new_prefill":4594,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390214.823331447,"t_first_token_unix":1779821079.8372757,"t_done":390214.936572307,"t_done_unix":1779821079.950516},{"request_id":"1269373:19:1349406:485","session_id":"1269373","input_length":76493,"t_proxy_recv":390211.913575155,"t_decision_unix":1779821076.9275165,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":74240,"affinity_cache_ratio":0.9705463245002811,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74240,"estimated_new_tokens":2253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":4096,"new_prefill":72397,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":76493,"score_linear":62618.0,"score_lmetric":76493},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1891,"cache_hit":0,"new_prefill":76493,"score_linear":41202.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":76493,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":76493,"score_linear":96026.0,"score_lmetric":76493},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":74240,"new_prefill":2253,"score_linear":-52869.0,"score_lmetric":2253},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1059,"cache_hit":14848,"new_prefill":61645,"score_linear":-14848.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1127,"cache_hit":7680,"new_prefill":68813,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-52869.0,"chosen_score_lmetric":2253,"t_first_token":390213.149241717,"t_first_token_unix":1779821078.1631854,"t_done":390217.390862923,"t_done_unix":1779821082.4048066},{"request_id":"1350896:1:1350896:489","session_id":"1350896","input_length":1471,"t_proxy_recv":390216.979105656,"t_decision_unix":1779821081.993047,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":1471,"score_linear":62618.0,"score_lmetric":1471},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1892,"cache_hit":0,"new_prefill":1471,"score_linear":41202.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":1471,"score_linear":96026.0,"score_lmetric":1471},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":97864,"ongoing_decode_tokens":97864,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":1471,"score_linear":97864.0,"score_lmetric":2942},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":1471,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390217.079419102,"t_first_token_unix":1779821082.0933623,"t_done":390217.436683516,"t_done_unix":1779821082.450627},{"request_id":"1334223:3:1348241:479","session_id":"1334223","input_length":41202,"t_proxy_recv":390207.863595464,"t_decision_unix":1779821072.8775368,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9071404300762099,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":3826,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":41202,"score_linear":62618.0,"score_lmetric":41202},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1885,"cache_hit":37376,"new_prefill":3826,"score_linear":-37376.0,"score_lmetric":-3826},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":41202,"score_linear":65289.0,"score_lmetric":41202},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":41202,"score_linear":96026.0,"score_lmetric":41202},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":41202,"score_linear":21371.0,"score_lmetric":41202},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":0,"new_prefill":41202,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":-3826,"t_first_token":390208.839268375,"t_first_token_unix":1779821073.8532116,"t_done":390218.389932911,"t_done_unix":1779821083.4038832},{"request_id":"1350980:1:1350980:490","session_id":"1350980","input_length":15313,"t_proxy_recv":390217.228167506,"t_decision_unix":1779821082.2421088,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15313,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":1471,"ongoing_decode_tokens":1471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1083,"cache_hit":0,"new_prefill":15313,"score_linear":1471.0,"score_lmetric":15313},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":15313,"score_linear":62618.0,"score_lmetric":15313},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":41202,"ongoing_decode_tokens":41202,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1892,"cache_hit":0,"new_prefill":15313,"score_linear":41202.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1389,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":15313,"score_linear":96026.0,"score_lmetric":15313},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":97864,"ongoing_decode_tokens":97864,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":15313,"score_linear":97864.0,"score_lmetric":30626},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":15313,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390218.593062155,"t_first_token_unix":1779821083.6070056,"t_done":390218.632814698,"t_done_unix":1779821083.646758},{"request_id":"1253743:5:1351907:492","session_id":"1253743","input_length":51340,"t_proxy_recv":390220.763149488,"t_decision_unix":1779821085.7770908,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":50176,"affinity_cache_ratio":0.9773276197896377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":50176,"estimated_new_tokens":1164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":17408,"new_prefill":33932,"score_linear":-17408.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":4608,"new_prefill":46732,"score_linear":58010.0,"score_lmetric":46732},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":-51340},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":50176,"new_prefill":1164,"score_linear":-50176.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":51340,"score_linear":96026.0,"score_lmetric":51340},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":51340,"score_linear":21371.0,"score_lmetric":51340},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":51340,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-50176.0,"chosen_score_lmetric":0,"t_first_token":390221.148945584,"t_first_token_unix":1779821086.1628892,"t_done":390221.567125247,"t_done_unix":1779821086.5810683},{"request_id":"1344773:4:1352462:494","session_id":"1344773","input_length":33579,"t_proxy_recv":390222.558035033,"t_decision_unix":1779821087.571975,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9910956252419667,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":299,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":33579,"score_linear":62618.0,"score_lmetric":33579},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":33280,"new_prefill":299,"score_linear":-33280.0,"score_lmetric":-299},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":33579,"score_linear":96026.0,"score_lmetric":33579},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":33579,"score_linear":21371.0,"score_lmetric":33579},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":33579,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":33579,"score_linear":21436.0,"score_lmetric":42727}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":-299,"t_first_token":390222.627650454,"t_first_token_unix":1779821087.6415942,"t_done":390222.79453665,"t_done_unix":1779821087.80848},{"request_id":"1348691:2:1352277:493","session_id":"1348691","input_length":21436,"t_proxy_recv":390221.94709489,"t_decision_unix":1779821086.9610362,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":12288,"affinity_cache_ratio":0.5732412763575294,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":12288,"estimated_new_tokens":9148,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21436,"score_linear":62618.0,"score_lmetric":21436},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":-21436},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":21436,"score_linear":96026.0,"score_lmetric":21436},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":21436,"score_linear":21371.0,"score_lmetric":21436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":21436,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":12288,"new_prefill":9148,"score_linear":-12288.0,"score_lmetric":0}],"chosen_score_linear":-12288.0,"chosen_score_lmetric":0,"t_first_token":390223.230982924,"t_first_token_unix":1779821088.244926,"t_done":390223.454038557,"t_done_unix":1779821088.4679818},{"request_id":"1350162:2:1352468:495","session_id":"1350162","input_length":10575,"t_proxy_recv":390222.571373796,"t_decision_unix":1779821087.5853152,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":3,"affinity_cache_hit":4608,"affinity_cache_ratio":0.4357446808510638,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":10575,"score_linear":62618.0,"score_lmetric":10575},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":33579,"ongoing_decode_tokens":0,"pending_prefill_tokens":299,"num_requests":0,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":10575,"score_linear":33579.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":10575,"score_linear":96026.0,"score_lmetric":10575},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":10575,"score_linear":21371.0,"score_lmetric":10575},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":10575,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":4608,"new_prefill":5967,"score_linear":16828.0,"score_lmetric":15115}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390223.39143855,"t_first_token_unix":1779821088.4053824,"t_done":390223.514297709,"t_done_unix":1779821088.5282412},{"request_id":"1345921:4:1353010:501","session_id":"1345921","input_length":6935,"t_proxy_recv":390224.55187521,"t_decision_unix":1779821089.5658162,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":1024,"affinity_cache_ratio":0.14765681326604183,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":5911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":1024,"new_prefill":5911,"score_linear":-1024.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":6935,"score_linear":62618.0,"score_lmetric":6935},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":87099,"ongoing_decode_tokens":0,"pending_prefill_tokens":20027,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":6935,"score_linear":87099.0,"score_lmetric":26962},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":6935,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":179352,"ongoing_decode_tokens":96026,"pending_prefill_tokens":382,"num_requests":2,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":6935,"score_linear":179352.0,"score_lmetric":14634},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99161,"ongoing_decode_tokens":99161,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":6935,"score_linear":99161.0,"score_lmetric":13870},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14239,"ongoing_decode_tokens":0,"pending_prefill_tokens":9631,"num_requests":1,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":6935,"score_linear":14239.0,"score_lmetric":16566},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":6935,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":390224.950489463,"t_first_token_unix":1779821089.9644434,"t_done":390224.953038785,"t_done_unix":1779821089.966983},{"request_id":"1349975:2:1352986:500","session_id":"1349975","input_length":14239,"t_proxy_recv":390224.510778428,"t_decision_unix":1779821089.52472,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":4608,"affinity_cache_ratio":0.32361823161738884,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":9631,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":14239,"score_linear":62618.0,"score_lmetric":14239},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":87099,"ongoing_decode_tokens":0,"pending_prefill_tokens":20027,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":14239,"score_linear":87099.0,"score_lmetric":34266},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":179352,"ongoing_decode_tokens":96026,"pending_prefill_tokens":382,"num_requests":2,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":14239,"score_linear":179352.0,"score_lmetric":29242},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99161,"ongoing_decode_tokens":99161,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":14239,"score_linear":99161.0,"score_lmetric":28478},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":4608,"new_prefill":9631,"score_linear":-4608.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":14239,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":390225.481322371,"t_first_token_unix":1779821090.495266,"t_done":390225.669448496,"t_done_unix":1779821090.683392},{"request_id":"1352606:1:1352606:496","session_id":"1352606","input_length":18840,"t_proxy_recv":390223.138651367,"t_decision_unix":1779821088.152593,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":-18840,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":18840,"score_linear":62618.0,"score_lmetric":18840},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":-18840},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10575,"ongoing_decode_tokens":0,"pending_prefill_tokens":10575,"num_requests":1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":18840,"score_linear":10575.0,"score_lmetric":29415},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":18840,"score_linear":96026.0,"score_lmetric":18840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":18840,"score_linear":21371.0,"score_lmetric":18840},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":18840,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":18840,"score_linear":21436.0,"score_lmetric":27988}],"chosen_score_linear":0.0,"chosen_score_lmetric":-18840,"t_first_token":390225.43188434,"t_first_token_unix":1779821090.4458284,"t_done":390226.36420681,"t_done_unix":1779821091.3781505},{"request_id":"1317598:6:1352957:499","session_id":"1317598","input_length":83326,"t_proxy_recv":390224.410614564,"t_decision_unix":1779821089.4245558,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":82944,"affinity_cache_ratio":0.9954155965724983,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82944,"estimated_new_tokens":382,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":83326,"score_linear":62618.0,"score_lmetric":83326},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":87099,"ongoing_decode_tokens":0,"pending_prefill_tokens":20027,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":83326,"score_linear":87099.0,"score_lmetric":103353},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":82944,"new_prefill":382,"score_linear":13082.0,"score_lmetric":382},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99161,"ongoing_decode_tokens":21371,"pending_prefill_tokens":990,"num_requests":2,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":83326,"score_linear":99161.0,"score_lmetric":168632},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":83326,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":13082.0,"chosen_score_lmetric":382,"t_first_token":390224.678818486,"t_first_token_unix":1779821089.692762,"t_done":390226.372881338,"t_done_unix":1779821091.3868246},{"request_id":"1269373:20:1352797:498","session_id":"1269373","input_length":77790,"t_proxy_recv":390223.812950938,"t_decision_unix":1779821088.8268921,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9872734284612418,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":990,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":4096,"new_prefill":73694,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":77790,"score_linear":62618.0,"score_lmetric":77790},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":87099,"ongoing_decode_tokens":0,"pending_prefill_tokens":20027,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":0,"new_prefill":77790,"score_linear":87099.0,"score_lmetric":97817},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":77790,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":77790,"score_linear":96026.0,"score_lmetric":77790},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":76800,"new_prefill":990,"score_linear":-55429.0,"score_lmetric":990},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":14848,"new_prefill":62942,"score_linear":-14848.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":7680,"new_prefill":70110,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-55429.0,"chosen_score_lmetric":990,"t_first_token":390224.436750935,"t_first_token_unix":1779821089.450694,"t_done":390227.116354658,"t_done_unix":1779821092.130298},{"request_id":"1279412:23:1348089:477","session_id":"1279412","input_length":96026,"t_proxy_recv":390207.253553173,"t_decision_unix":1779821072.2674942,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9970632953575074,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":282,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1082,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":96026,"score_linear":62618.0,"score_lmetric":96026},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1885,"cache_hit":12800,"new_prefill":83226,"score_linear":-12800.0,"score_lmetric":-83226},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":65289,"ongoing_decode_tokens":65289,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":96026,"score_linear":65289.0,"score_lmetric":96026},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":986,"cache_hit":95744,"new_prefill":282,"score_linear":-95744.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":999,"cache_hit":0,"new_prefill":96026,"score_linear":21371.0,"score_lmetric":96026},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1026,"cache_hit":0,"new_prefill":96026,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1103,"cache_hit":12800,"new_prefill":83226,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":390207.405827989,"t_first_token_unix":1779821072.4197717,"t_done":390228.157068846,"t_done_unix":1779821093.1710124},{"request_id":"1344773:5:1353365:502","session_id":"1344773","input_length":33875,"t_proxy_recv":390226.017544592,"t_decision_unix":1779821091.031486,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9824354243542436,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":595,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":33875,"score_linear":62618.0,"score_lmetric":33875},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":87099,"ongoing_decode_tokens":87099,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":33280,"new_prefill":595,"score_linear":53819.0,"score_lmetric":595},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":179352,"ongoing_decode_tokens":179352,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":33875,"score_linear":179352.0,"score_lmetric":67750},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99161,"ongoing_decode_tokens":99161,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":33875,"score_linear":99161.0,"score_lmetric":67750},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":33875,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":53819.0,"chosen_score_lmetric":595,"t_first_token":390226.210163112,"t_first_token_unix":1779821091.2241066,"t_done":390229.209285606,"t_done_unix":1779821094.2232287},{"request_id":"1253804:6:1318560:340","session_id":"1253804","input_length":62618,"t_proxy_recv":390103.05630617,"t_decision_unix":1779820968.0702477,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9403047047174934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":3738,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":809,"cache_hit":3584,"new_prefill":59034,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":876,"cache_hit":58880,"new_prefill":3738,"score_linear":-58880.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1350,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":-62618},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":956,"cache_hit":3584,"new_prefill":59034,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79663,"ongoing_decode_tokens":0,"pending_prefill_tokens":79151,"num_requests":1,"active_p_offloads":0,"cached_blocks":764,"cache_hit":0,"new_prefill":62618,"score_linear":79663.0,"score_lmetric":141769},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":66135,"ongoing_decode_tokens":66135,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":765,"cache_hit":0,"new_prefill":62618,"score_linear":66135.0,"score_lmetric":62618},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":121968,"ongoing_decode_tokens":121968,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":833,"cache_hit":0,"new_prefill":62618,"score_linear":121968.0,"score_lmetric":62618},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":861,"cache_hit":0,"new_prefill":62618,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":390104.448177856,"t_first_token_unix":1779820969.4621215,"t_done":390229.75820231,"t_done_unix":1779821094.7721457},{"request_id":"1253743:6:1354346:505","session_id":"1253743","input_length":51436,"t_proxy_recv":390229.263193562,"t_decision_unix":1779821094.277135,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9954117738548877,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":236,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":17408,"new_prefill":34028,"score_linear":66118.0,"score_lmetric":117554},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":4608,"new_prefill":46828,"score_linear":58010.0,"score_lmetric":46828},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":0,"new_prefill":51436,"score_linear":68259.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":51200,"new_prefill":236,"score_linear":-51200.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":988,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":51436,"score_linear":21371.0,"score_lmetric":51436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":51436,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27651,"ongoing_decode_tokens":0,"pending_prefill_tokens":27651,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":51436,"score_linear":27651.0,"score_lmetric":79087}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":390229.35688876,"t_first_token_unix":1779821094.3708327,"t_done":390229.77539621,"t_done_unix":1779821094.7893393},{"request_id":"1353821:1:1353821:503","session_id":"1353821","input_length":27651,"t_proxy_recv":390227.433524375,"t_decision_unix":1779821092.4474657,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":27651,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":27651,"score_linear":62618.0,"score_lmetric":27651},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":102134,"ongoing_decode_tokens":102134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1937,"cache_hit":0,"new_prefill":27651,"score_linear":102134.0,"score_lmetric":27651},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":27651,"score_linear":96026.0,"score_lmetric":27651},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":27651,"score_linear":21371.0,"score_lmetric":27651},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":27651,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390230.85493888,"t_first_token_unix":1779821095.868882,"t_done":390231.655573546,"t_done_unix":1779821096.6695192},{"request_id":"1355484:1:1355484:508","session_id":"1355484","input_length":19366,"t_proxy_recv":390233.148953414,"t_decision_unix":1779821098.162895,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":12800,"estimated_new_tokens":6566,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":19366,"score_linear":83526.0,"score_lmetric":102892},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":19366,"score_linear":24503.0,"score_lmetric":43869},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":12800,"new_prefill":6566,"score_linear":70978.0,"score_lmetric":6566},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":988,"cache_hit":12800,"new_prefill":6566,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":19366,"score_linear":21371.0,"score_lmetric":19366},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":19366,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":12800,"new_prefill":6566,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":390234.078769002,"t_first_token_unix":1779821099.0927122,"t_done":390234.669374523,"t_done_unix":1779821099.6833177},{"request_id":"1286804:3:1354910:506","session_id":"1286804","input_length":15519,"t_proxy_recv":390231.235837938,"t_decision_unix":1779821096.2497795,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8907790450415619,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1695,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":1536,"new_prefill":13983,"score_linear":81990.0,"score_lmetric":97509},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":888,"cache_hit":1536,"new_prefill":13983,"score_linear":-1536.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":13824,"new_prefill":1695,"score_linear":54435.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":988,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":15519,"score_linear":21371.0,"score_lmetric":15519},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":15519,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27651,"ongoing_decode_tokens":27651,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":15519,"score_linear":27651.0,"score_lmetric":15519}],"chosen_score_linear":54435.0,"chosen_score_lmetric":0,"t_first_token":390232.645168142,"t_first_token_unix":1779821097.659112,"t_done":390235.433515823,"t_done_unix":1779821100.4474587},{"request_id":"1355325:1:1355325:507","session_id":"1355325","input_length":24503,"t_proxy_recv":390232.70883501,"t_decision_unix":1779821097.7227764,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":24503,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":24503,"score_linear":83526.0,"score_lmetric":108029},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":0,"new_prefill":24503,"score_linear":83778.0,"score_lmetric":24503},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":988,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":24503,"score_linear":21371.0,"score_lmetric":24503},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":24503,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390235.530228882,"t_first_token_unix":1779821100.5441723,"t_done":390235.575110746,"t_done_unix":1779821100.5890536},{"request_id":"1344773:6:1356097:513","session_id":"1344773","input_length":34198,"t_proxy_recv":390235.396674097,"t_decision_unix":1779821100.4106154,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9881279606994561,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":406,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":34198,"score_linear":132503.0,"score_lmetric":237146},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":34198,"score_linear":24503.0,"score_lmetric":58701},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":33792,"new_prefill":406,"score_linear":49986.0,"score_lmetric":406},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":34198,"score_linear":48193.0,"score_lmetric":37335},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":34198,"score_linear":35308.0,"score_lmetric":69506},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99460,"ongoing_decode_tokens":99460,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":34198,"score_linear":99460.0,"score_lmetric":68396},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":34198,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":34198,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":49986.0,"chosen_score_lmetric":406,"t_first_token":390235.491305577,"t_first_token_unix":1779821100.50525,"t_done":390235.76373042,"t_done_unix":1779821100.7776742},{"request_id":"1269373:21:1355702:509","session_id":"1269373","input_length":78089,"t_proxy_recv":390233.825132471,"t_decision_unix":1779821098.839074,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":77824,"affinity_cache_ratio":0.9966064362458221,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77824,"estimated_new_tokens":265,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":4096,"new_prefill":73993,"score_linear":79430.0,"score_lmetric":157519},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":78089,"score_linear":24503.0,"score_lmetric":102592},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":0,"new_prefill":78089,"score_linear":83778.0,"score_lmetric":78089},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":78089,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":19366,"ongoing_decode_tokens":0,"pending_prefill_tokens":6566,"num_requests":1,"active_p_offloads":0,"cached_blocks":988,"cache_hit":0,"new_prefill":78089,"score_linear":19366.0,"score_lmetric":84655},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":77824,"new_prefill":265,"score_linear":-56453.0,"score_lmetric":265},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":14848,"new_prefill":63241,"score_linear":-14848.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":7680,"new_prefill":70409,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-56453.0,"chosen_score_lmetric":265,"t_first_token":390234.031239688,"t_first_token_unix":1779821099.0451832,"t_done":390238.715284199,"t_done_unix":1779821103.7292275},{"request_id":"1356948:1:1356948:515","session_id":"1356948","input_length":6711,"t_proxy_recv":390238.425166637,"t_decision_unix":1779821103.4391081,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6711,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":6711,"score_linear":132503.0,"score_lmetric":182172},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":6711,"score_linear":122597.0,"score_lmetric":122652},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1941,"cache_hit":0,"new_prefill":6711,"score_linear":68259.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":6711,"score_linear":48193.0,"score_lmetric":9848},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":6711,"score_linear":35308.0,"score_lmetric":42019},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99460,"ongoing_decode_tokens":99460,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":6711,"score_linear":99460.0,"score_lmetric":13422},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":6711,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390238.87474169,"t_first_token_unix":1779821103.8886852,"t_done":390239.14384409,"t_done_unix":1779821104.1577873},{"request_id":"1355951:1:1355951:511","session_id":"1355951","input_length":35308,"t_proxy_recv":390234.7342698,"t_decision_unix":1779821099.7482114,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":35308,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":35308,"score_linear":83526.0,"score_lmetric":118834},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":35308,"score_linear":24503.0,"score_lmetric":59811},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":0,"new_prefill":35308,"score_linear":83778.0,"score_lmetric":35308},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":35308,"score_linear":48193.0,"score_lmetric":38445},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99460,"ongoing_decode_tokens":99460,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":35308,"score_linear":99460.0,"score_lmetric":70616},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390239.904245558,"t_first_token_unix":1779821104.918189,"t_done":390240.292973399,"t_done_unix":1779821105.3069181},{"request_id":"1357132:1:1357132:516","session_id":"1357132","input_length":13520,"t_proxy_recv":390238.96633942,"t_decision_unix":1779821103.980281,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":13520,"score_linear":132503.0,"score_lmetric":195790},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":13520,"score_linear":122597.0,"score_lmetric":129461},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1941,"cache_hit":0,"new_prefill":13520,"score_linear":68259.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":13520,"score_linear":48193.0,"score_lmetric":16657},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":13520,"score_linear":35308.0,"score_lmetric":48828},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":13520,"score_linear":21371.0,"score_lmetric":13520},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":6711,"ongoing_decode_tokens":6711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":13520,"score_linear":6711.0,"score_lmetric":13520},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":13520,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390240.116990157,"t_first_token_unix":1779821105.1309345,"t_done":390241.019687574,"t_done_unix":1779821106.0336306},{"request_id":"1353821:2:1357420:517","session_id":"1353821","input_length":27805,"t_proxy_recv":390239.817265203,"t_decision_unix":1779821104.8312066,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9943535335371336,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":157,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":27805,"score_linear":132503.0,"score_lmetric":224360},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":27805,"score_linear":122597.0,"score_lmetric":143746},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1941,"cache_hit":0,"new_prefill":27805,"score_linear":68259.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":27805,"score_linear":48193.0,"score_lmetric":30942},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":27805,"score_linear":35308.0,"score_lmetric":63113},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":27805,"score_linear":21371.0,"score_lmetric":27805},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":27805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13520,"ongoing_decode_tokens":0,"pending_prefill_tokens":13520,"num_requests":1,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":27648,"new_prefill":157,"score_linear":-14128.0,"score_lmetric":13677}],"chosen_score_linear":-14128.0,"chosen_score_lmetric":13677,"t_first_token":390240.152248651,"t_first_token_unix":1779821105.166192,"t_done":390241.09726231,"t_done_unix":1779821106.111205},{"request_id":"1344773:7:1357714:518","session_id":"1344773","input_length":34351,"t_proxy_recv":390240.901629116,"t_decision_unix":1779821105.9155707,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9837268201799074,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":34351,"score_linear":132503.0,"score_lmetric":237452},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":34351,"score_linear":122597.0,"score_lmetric":150292},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1941,"cache_hit":33792,"new_prefill":559,"score_linear":34467.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":34351,"score_linear":48193.0,"score_lmetric":37488},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":34351,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":34351,"score_linear":21371.0,"score_lmetric":34351},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":34351,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":41325,"ongoing_decode_tokens":41325,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":34351,"score_linear":41325.0,"score_lmetric":68702}],"chosen_score_linear":34467.0,"chosen_score_lmetric":0,"t_first_token":390241.028446071,"t_first_token_unix":1779821106.0423892,"t_done":390241.689100101,"t_done_unix":1779821106.703044},{"request_id":"1253743:7:1359251:524","session_id":"1253743","input_length":51509,"t_proxy_recv":390246.46786425,"t_decision_unix":1779821111.4818056,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9940010483604806,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":17408,"new_prefill":34101,"score_linear":115095.0,"score_lmetric":236952},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":4608,"new_prefill":46901,"score_linear":117989.0,"score_lmetric":162842},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":51509,"score_linear":161569.0,"score_lmetric":172902},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":51200,"new_prefill":309,"score_linear":-3007.0,"score_lmetric":309},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":51509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":51509,"score_linear":101617.0,"score_lmetric":103018},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":51509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":51509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-3007.0,"chosen_score_lmetric":309,"t_first_token":390246.570512623,"t_first_token_unix":1779821111.584456,"t_done":390246.827831891,"t_done_unix":1779821111.841775},{"request_id":"1355484:2:1359370:525","session_id":"1355484","input_length":19493,"t_proxy_recv":390246.917139014,"t_decision_unix":1779821111.9310803,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9981018827271328,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":37,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":19493,"score_linear":132503.0,"score_lmetric":207736},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":19493,"score_linear":122597.0,"score_lmetric":135434},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":12800,"new_prefill":6693,"score_linear":148769.0,"score_lmetric":83270},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":19493,"score_linear":48193.0,"score_lmetric":19493},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":19456,"new_prefill":37,"score_linear":-19456.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":19493,"score_linear":101617.0,"score_lmetric":38986},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":19493,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":12800,"new_prefill":6693,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":390246.966612791,"t_first_token_unix":1779821111.9805562,"t_done":390248.081855583,"t_done_unix":1779821113.0957987},{"request_id":"1294611:11:1355750:510","session_id":"1294611","input_length":48193,"t_proxy_recv":390233.921488928,"t_decision_unix":1779821098.9354303,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9349075591890939,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":3137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":48193,"score_linear":83526.0,"score_lmetric":131719},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":48193,"score_linear":24503.0,"score_lmetric":72696},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":12800,"new_prefill":35393,"score_linear":70978.0,"score_lmetric":35393},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":45056,"new_prefill":3137,"score_linear":-45056.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":19366,"ongoing_decode_tokens":0,"pending_prefill_tokens":6566,"num_requests":1,"active_p_offloads":0,"cached_blocks":988,"cache_hit":0,"new_prefill":48193,"score_linear":19366.0,"score_lmetric":54759},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99460,"ongoing_decode_tokens":21371,"pending_prefill_tokens":265,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":12800,"new_prefill":35393,"score_linear":86660.0,"score_lmetric":71316},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":48193,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":12800,"new_prefill":35393,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":390242.656286337,"t_first_token_unix":1779821107.67023,"t_done":390250.160035245,"t_done_unix":1779821115.17398},{"request_id":"1340278:2:1356079:512","session_id":"1340278","input_length":48977,"t_proxy_recv":390235.337244937,"t_decision_unix":1779821100.3511863,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9826653327071891,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":849,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":0,"pending_prefill_tokens":83526,"num_requests":1,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":48128,"new_prefill":849,"score_linear":35398.0,"score_lmetric":84375},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":24503,"ongoing_decode_tokens":0,"pending_prefill_tokens":24503,"num_requests":1,"active_p_offloads":0,"cached_blocks":888,"cache_hit":0,"new_prefill":48977,"score_linear":24503.0,"score_lmetric":73480},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":83778,"ongoing_decode_tokens":83778,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1938,"cache_hit":0,"new_prefill":48977,"score_linear":83778.0,"score_lmetric":48977},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":48977,"score_linear":48193.0,"score_lmetric":52114},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":48977,"score_linear":35308.0,"score_lmetric":84285},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99460,"ongoing_decode_tokens":99460,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":48977,"score_linear":99460.0,"score_lmetric":97954},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":48977,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":48977,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":35398.0,"chosen_score_lmetric":84375,"t_first_token":390251.623065233,"t_first_token_unix":1779821116.6370087,"t_done":390252.6804095,"t_done_unix":1779821117.6943529},{"request_id":"1353951:1:1353951:504","session_id":"1353951","input_length":83526,"t_proxy_recv":390227.919631896,"t_decision_unix":1779821092.9335735,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":83526,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":83526,"score_linear":62618.0,"score_lmetric":83526},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":102134,"ongoing_decode_tokens":102134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1937,"cache_hit":0,"new_prefill":83526,"score_linear":102134.0,"score_lmetric":83526},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":83526,"score_linear":96026.0,"score_lmetric":83526},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":83526,"score_linear":21371.0,"score_lmetric":83526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":83526,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":27651,"ongoing_decode_tokens":0,"pending_prefill_tokens":27651,"num_requests":1,"active_p_offloads":0,"cached_blocks":1153,"cache_hit":0,"new_prefill":83526,"score_linear":27651.0,"score_lmetric":111177}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390251.620614069,"t_first_token_unix":1779821116.6345575,"t_done":390253.238135558,"t_done_unix":1779821118.2520788},{"request_id":"1355484:3:1361065:531","session_id":"1355484","input_length":19714,"t_proxy_recv":390252.86558482,"t_decision_unix":1779821117.8795254,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9869128538094755,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":258,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":83526,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":19714,"score_linear":83526.0,"score_lmetric":19714},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":19714,"score_linear":122597.0,"score_lmetric":135655},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":12800,"new_prefill":6914,"score_linear":148769.0,"score_lmetric":83712},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66032,"ongoing_decode_tokens":0,"pending_prefill_tokens":496,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":19714,"score_linear":66032.0,"score_lmetric":20210},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":19456,"new_prefill":258,"score_linear":-19456.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":19714,"score_linear":101617.0,"score_lmetric":39428},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":19714,"score_linear":117888.0,"score_lmetric":137602},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":12800,"new_prefill":6914,"score_linear":48611.0,"score_lmetric":25034}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":390252.922667619,"t_first_token_unix":1779821117.9366117,"t_done":390253.294821824,"t_done_unix":1779821118.308765},{"request_id":"1342921:2:1361022:530","session_id":"1342921","input_length":66032,"t_proxy_recv":390252.699820974,"t_decision_unix":1779821117.7137623,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65536,"affinity_cache_ratio":0.992488490428883,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":83526,"ongoing_decode_tokens":83526,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1098,"cache_hit":0,"new_prefill":66032,"score_linear":83526.0,"score_lmetric":66032},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":66032,"score_linear":122597.0,"score_lmetric":181973},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":66032,"score_linear":161569.0,"score_lmetric":201948},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":65536,"new_prefill":496,"score_linear":-65536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":66032,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":66032,"score_linear":101617.0,"score_lmetric":132064},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":66032,"score_linear":117888.0,"score_lmetric":183920},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":66032,"score_linear":61411.0,"score_lmetric":143270}],"chosen_score_linear":-65536.0,"chosen_score_lmetric":0,"t_first_token":390253.037650589,"t_first_token_unix":1779821118.0515945,"t_done":390253.399637685,"t_done_unix":1779821118.4135845},{"request_id":"1353951:2:1358300:520","session_id":"1353951","input_length":83905,"t_proxy_recv":390253.253007915,"t_decision_unix":1779821118.266949,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9946487098504261,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":449,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":83456,"new_prefill":449,"score_linear":-83456.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":83905,"score_linear":122597.0,"score_lmetric":199846},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":83905,"score_linear":161569.0,"score_lmetric":237694},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":66032,"ongoing_decode_tokens":66032,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":83905,"score_linear":66032.0,"score_lmetric":83905},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":19714,"ongoing_decode_tokens":19714,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":83905,"score_linear":19714.0,"score_lmetric":83905},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":83905,"score_linear":101617.0,"score_lmetric":167810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":83905,"score_linear":117888.0,"score_lmetric":201793},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":83905,"score_linear":61411.0,"score_lmetric":179016}],"chosen_score_linear":-83456.0,"chosen_score_lmetric":0,"t_first_token":390253.522171299,"t_first_token_unix":1779821118.5361173,"t_done":390253.672041472,"t_done_unix":1779821118.6859846},{"request_id":"1344773:8:1358989:523","session_id":"1344773","input_length":34552,"t_proxy_recv":390245.424901142,"t_decision_unix":1779821110.4388423,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9928224125955082,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":248,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":34552,"score_linear":132503.0,"score_lmetric":237854},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":34552,"score_linear":122597.0,"score_lmetric":150493},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34694,"num_requests":1,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":34304,"new_prefill":248,"score_linear":92713.0,"score_lmetric":34942},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":34552,"score_linear":48193.0,"score_lmetric":34552},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":21371,"pending_prefill_tokens":1910,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":34552,"score_linear":101617.0,"score_lmetric":72924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":34552,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":92713.0,"chosen_score_lmetric":34942,"t_first_token":390254.632223229,"t_first_token_unix":1779821119.6461666,"t_done":390255.175839498,"t_done_unix":1779821120.1897836},{"request_id":"1356948:2:1361262:532","session_id":"1356948","input_length":16480,"t_proxy_recv":390253.71224358,"t_decision_unix":1779821118.7261853,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":3,"affinity_cache_hit":6656,"affinity_cache_ratio":0.40388349514563104,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":16480,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":16480,"score_linear":122597.0,"score_lmetric":132421},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":16480,"score_linear":161569.0,"score_lmetric":102844},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1449,"cache_hit":0,"new_prefill":16480,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":16480,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":16480,"score_linear":101617.0,"score_lmetric":32960},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":6656,"new_prefill":9824,"score_linear":111232.0,"score_lmetric":127712},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":16480,"score_linear":61411.0,"score_lmetric":44166}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390255.246408958,"t_first_token_unix":1779821120.2603528,"t_done":390255.407879908,"t_done_unix":1779821120.421823},{"request_id":"1344773:9:1360064:526","session_id":"1344773","input_length":34611,"t_proxy_recv":390255.182404095,"t_decision_unix":1779821120.1963456,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9911299875762041,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":307,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":34611,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":34611,"score_linear":122597.0,"score_lmetric":150552},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":127017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":34304,"new_prefill":307,"score_linear":92713.0,"score_lmetric":307},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16480,"ongoing_decode_tokens":0,"pending_prefill_tokens":16480,"num_requests":1,"active_p_offloads":0,"cached_blocks":1449,"cache_hit":0,"new_prefill":34611,"score_linear":16480.0,"score_lmetric":51091},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":34611,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":34611,"score_linear":101617.0,"score_lmetric":69222},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":34611,"score_linear":117888.0,"score_lmetric":152499},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":34611,"score_linear":61411.0,"score_lmetric":80428}],"chosen_score_linear":92713.0,"chosen_score_lmetric":307,"t_first_token":390255.277152667,"t_first_token_unix":1779821120.2910957,"t_done":390256.15756854,"t_done_unix":1779821121.1715117},{"request_id":"1353821:3:1360898:529","session_id":"1353821","input_length":27933,"t_proxy_recv":390252.239167623,"t_decision_unix":1779821117.2531085,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.98979701428418,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":285,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":132503,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":27933,"score_linear":132503.0,"score_lmetric":55866},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":27933,"score_linear":122597.0,"score_lmetric":143874},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":27933,"score_linear":161569.0,"score_lmetric":125750},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":27933,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":27933,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":27933,"score_linear":101617.0,"score_lmetric":55866},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":27933,"score_linear":117888.0,"score_lmetric":145821},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":33478,"ongoing_decode_tokens":0,"pending_prefill_tokens":5318,"num_requests":1,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":27648,"new_prefill":285,"score_linear":5830.0,"score_lmetric":5603}],"chosen_score_linear":5830.0,"chosen_score_lmetric":5603,"t_first_token":390256.317320566,"t_first_token_unix":1779821121.3312638,"t_done":390256.873327688,"t_done_unix":1779821121.8872716},{"request_id":"1270340:3:1360716:528","session_id":"1270340","input_length":33478,"t_proxy_recv":390251.570976847,"t_decision_unix":1779821116.5849178,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":28160,"affinity_cache_ratio":0.8411494115538563,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":5318,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":33478,"score_linear":132503.0,"score_lmetric":235706},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":33478,"score_linear":122597.0,"score_lmetric":149419},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":33478,"score_linear":161569.0,"score_lmetric":136840},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":1536,"new_prefill":31942,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":33478,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":33478,"score_linear":101617.0,"score_lmetric":66956},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":33478,"score_linear":117888.0,"score_lmetric":151366},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":28160,"new_prefill":5318,"score_linear":-28160.0,"score_lmetric":0}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":390256.314427357,"t_first_token_unix":1779821121.328371,"t_done":390256.966240699,"t_done_unix":1779821121.9801838},{"request_id":"1361992:1:1361992:535","session_id":"1361992","input_length":8113,"t_proxy_recv":390256.288117311,"t_decision_unix":1779821121.302059,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":8113,"score_linear":76969.0,"score_lmetric":85082},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":8113,"score_linear":122597.0,"score_lmetric":124054},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":8113,"score_linear":161696.0,"score_lmetric":16226},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":8113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":8113,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":8113,"score_linear":101617.0,"score_lmetric":16226},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":8113,"score_linear":117888.0,"score_lmetric":126001},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":8113,"score_linear":61411.0,"score_lmetric":27432}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390256.859204241,"t_first_token_unix":1779821121.8731475,"t_done":390256.992921854,"t_done_unix":1779821122.0068645},{"request_id":"1336620:3:1339999:443","session_id":"1336620","input_length":21371,"t_proxy_recv":390179.320588861,"t_decision_unix":1779821044.33453,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":14848,"affinity_cache_ratio":0.6947732909082401,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":6523,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":964,"cache_hit":4096,"new_prefill":17275,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":0,"new_prefill":21371,"score_linear":62618.0,"score_lmetric":21371},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":115840,"ongoing_decode_tokens":115840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1746,"cache_hit":0,"new_prefill":21371,"score_linear":115840.0,"score_lmetric":21371},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":13816,"ongoing_decode_tokens":0,"pending_prefill_tokens":13816,"num_requests":1,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":21371,"score_linear":13816.0,"score_lmetric":35187},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":163150,"ongoing_decode_tokens":163150,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":945,"cache_hit":0,"new_prefill":21371,"score_linear":163150.0,"score_lmetric":42742},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":914,"cache_hit":14848,"new_prefill":6523,"score_linear":-14848.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":31527,"ongoing_decode_tokens":31527,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":992,"cache_hit":7680,"new_prefill":13691,"score_linear":23847.0,"score_lmetric":27382},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":101124,"ongoing_decode_tokens":101124,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":936,"cache_hit":7680,"new_prefill":13691,"score_linear":93444.0,"score_lmetric":27382}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":390180.294316451,"t_first_token_unix":1779821045.3082602,"t_done":390257.009455456,"t_done_unix":1779821122.0233984},{"request_id":"1362265:1:1362265:536","session_id":"1362265","input_length":8825,"t_proxy_recv":390257.134921033,"t_decision_unix":1779821122.1488624,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":8825,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":8825,"score_linear":76969.0,"score_lmetric":85794},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":8825,"score_linear":122597.0,"score_lmetric":124766},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":8825,"score_linear":161696.0,"score_lmetric":17650},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":8825,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1085,"cache_hit":0,"new_prefill":8825,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":8825,"score_linear":80246.0,"score_lmetric":8825},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":8825,"score_linear":117888.0,"score_lmetric":126713},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":8825,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390257.806763857,"t_first_token_unix":1779821122.8207076,"t_done":390258.85517373,"t_done_unix":1779821123.869117},{"request_id":"1361992:2:1362904:537","session_id":"1361992","input_length":10347,"t_proxy_recv":390259.380082951,"t_decision_unix":1779821124.3940244,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":7680,"affinity_cache_ratio":0.7422441287329661,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2667,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":10347,"score_linear":76969.0,"score_lmetric":87316},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":10347,"score_linear":122597.0,"score_lmetric":126288},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":10347,"score_linear":161696.0,"score_lmetric":20694},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":10347,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1102,"cache_hit":7680,"new_prefill":2667,"score_linear":-7680.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":10347,"score_linear":80246.0,"score_lmetric":10347},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":10347,"score_linear":117888.0,"score_lmetric":128235},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":10347,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":390259.640549798,"t_first_token_unix":1779821124.654493,"t_done":390259.78664002,"t_done_unix":1779821124.8005831},{"request_id":"1363440:1:1363440:542","session_id":"1363440","input_length":543,"t_proxy_recv":390261.328077768,"t_decision_unix":1779821126.3420193,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":543,"score_linear":76969.0,"score_lmetric":77512},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":543,"score_linear":122597.0,"score_lmetric":116484},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":543,"score_linear":161696.0,"score_lmetric":1086},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":543,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37232,"ongoing_decode_tokens":0,"pending_prefill_tokens":1904,"num_requests":1,"active_p_offloads":0,"cached_blocks":1107,"cache_hit":0,"new_prefill":543,"score_linear":37232.0,"score_lmetric":2447},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":543,"score_linear":96303.0,"score_lmetric":1086},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":543,"score_linear":117888.0,"score_lmetric":118431},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":543,"score_linear":90778.0,"score_lmetric":127346}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390261.387844956,"t_first_token_unix":1779821126.4017885,"t_done":390261.562235232,"t_done_unix":1779821126.5761786},{"request_id":"1344773:10:1361326:533","session_id":"1344773","input_length":34679,"t_proxy_recv":390256.164643514,"t_decision_unix":1779821121.1785848,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9891865394042504,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":375,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":34679,"score_linear":76969.0,"score_lmetric":111648},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":34679,"score_linear":122597.0,"score_lmetric":150620},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":127017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":34304,"new_prefill":375,"score_linear":92713.0,"score_lmetric":375},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":34679,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":34679,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":34679,"score_linear":101617.0,"score_lmetric":69358},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":34679,"score_linear":117888.0,"score_lmetric":152567},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":34679,"score_linear":61411.0,"score_lmetric":80564}],"chosen_score_linear":92713.0,"chosen_score_lmetric":375,"t_first_token":390256.256767153,"t_first_token_unix":1779821121.2707102,"t_done":390261.573463926,"t_done_unix":1779821126.587408},{"request_id":"1355951:2:1363365:540","session_id":"1355951","input_length":37232,"t_proxy_recv":390261.042958605,"t_decision_unix":1779821126.0568998,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9488611946712505,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":1904,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":37232,"score_linear":76969.0,"score_lmetric":114201},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":37232,"score_linear":122597.0,"score_lmetric":153173},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":37232,"score_linear":161696.0,"score_lmetric":74464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":37232,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1107,"cache_hit":35328,"new_prefill":1904,"score_linear":-35328.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":37232,"score_linear":96303.0,"score_lmetric":74464},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":37232,"score_linear":117888.0,"score_lmetric":155120},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":62685,"ongoing_decode_tokens":0,"pending_prefill_tokens":62685,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":37232,"score_linear":62685.0,"score_lmetric":99917}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":390261.576968118,"t_first_token_unix":1779821126.5909111,"t_done":390262.221726712,"t_done_unix":1779821127.23567},{"request_id":"1363943:1:1363943:543","session_id":"1363943","input_length":12636,"t_proxy_recv":390263.011510677,"t_decision_unix":1779821128.0254521,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":12636,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":8704,"new_prefill":3932,"score_linear":68265.0,"score_lmetric":80901},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":12636,"score_linear":122597.0,"score_lmetric":128577},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":127017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1943,"cache_hit":0,"new_prefill":12636,"score_linear":127017.0,"score_lmetric":12636},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1482,"cache_hit":0,"new_prefill":12636,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":0,"new_prefill":12636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":4096,"new_prefill":8540,"score_linear":92207.0,"score_lmetric":17080},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":4096,"new_prefill":8540,"score_linear":113792.0,"score_lmetric":126428},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":4096,"new_prefill":8540,"score_linear":86682.0,"score_lmetric":143340}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390264.063073358,"t_first_token_unix":1779821129.0770168,"t_done":390265.398553588,"t_done_unix":1779821130.412498},{"request_id":"1313181:2:1358046:519","session_id":"1313181","input_length":58758,"t_proxy_recv":390242.102182774,"t_decision_unix":1779821107.1161237,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24064,"affinity_cache_ratio":0.40954423227475406,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":34694,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":58758,"score_linear":132503.0,"score_lmetric":286266},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":58758,"score_linear":122597.0,"score_lmetric":174699},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":24064,"new_prefill":34694,"score_linear":44195.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":58758,"score_linear":48193.0,"score_lmetric":61895},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":12800,"new_prefill":45958,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":58758,"score_linear":21371.0,"score_lmetric":58758},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":58758,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":12800,"new_prefill":45958,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":44195.0,"chosen_score_lmetric":0,"t_first_token":390254.62718319,"t_first_token_unix":1779821119.6411278,"t_done":390265.751434204,"t_done_unix":1779821130.7653773},{"request_id":"1364128:1:1364128:545","session_id":"1364128","input_length":8706,"t_proxy_recv":390263.496921759,"t_decision_unix":1779821128.5108633,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":8706,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":8706,"score_linear":76969.0,"score_lmetric":85675},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":8706,"score_linear":122597.0,"score_lmetric":124647},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":127017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1943,"cache_hit":0,"new_prefill":8706,"score_linear":127017.0,"score_lmetric":8706},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12636,"ongoing_decode_tokens":0,"pending_prefill_tokens":12636,"num_requests":1,"active_p_offloads":0,"cached_blocks":1482,"cache_hit":0,"new_prefill":8706,"score_linear":12636.0,"score_lmetric":21342},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13897,"ongoing_decode_tokens":0,"pending_prefill_tokens":13897,"num_requests":1,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":6656,"new_prefill":2050,"score_linear":7241.0,"score_lmetric":15947},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":8706,"score_linear":96303.0,"score_lmetric":17412},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":8706,"score_linear":117888.0,"score_lmetric":126594},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":8706,"score_linear":90778.0,"score_lmetric":143672}],"chosen_score_linear":127017.0,"chosen_score_lmetric":8706,"t_first_token":390264.253698084,"t_first_token_unix":1779821129.2676423,"t_done":390266.231499549,"t_done_unix":1779821131.2454438},{"request_id":"1364960:1:1364960:549","session_id":"1364960","input_length":2019,"t_proxy_recv":390266.421884158,"t_decision_unix":1779821131.4358256,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2019,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":2019,"score_linear":76969.0,"score_lmetric":78988},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":2019,"score_linear":122597.0,"score_lmetric":117960},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92710,"ongoing_decode_tokens":92710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":2019,"score_linear":92710.0,"score_lmetric":2019},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1507,"cache_hit":0,"new_prefill":2019,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131741,"ongoing_decode_tokens":131741,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":0,"new_prefill":2019,"score_linear":131741.0,"score_lmetric":6057},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":2019,"score_linear":96303.0,"score_lmetric":4038},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":2019,"score_linear":117888.0,"score_lmetric":119907},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":2019,"score_linear":90778.0,"score_lmetric":130298}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390266.555988351,"t_first_token_unix":1779821131.5699315,"t_done":390266.732096517,"t_done_unix":1779821131.7460399},{"request_id":"1313181:3:1316742:330","session_id":"1313181","input_length":24451,"t_proxy_recv":390265.757675919,"t_decision_unix":1779821130.7716177,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9841724264856243,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":24451,"score_linear":76969.0,"score_lmetric":101420},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":24451,"score_linear":122597.0,"score_lmetric":140392},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":76965,"ongoing_decode_tokens":76965,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":24064,"new_prefill":387,"score_linear":52901.0,"score_lmetric":387},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1507,"cache_hit":0,"new_prefill":24451,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111935,"ongoing_decode_tokens":111935,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":12800,"new_prefill":11651,"score_linear":99135.0,"score_lmetric":23302},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":24451,"score_linear":96303.0,"score_lmetric":48902},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":24451,"score_linear":117888.0,"score_lmetric":142339},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":12800,"new_prefill":11651,"score_linear":77978.0,"score_lmetric":149562}],"chosen_score_linear":52901.0,"chosen_score_lmetric":387,"t_first_token":390265.816217625,"t_first_token_unix":1779821130.8301609,"t_done":390266.868217097,"t_done_unix":1779821131.8821607},{"request_id":"1279412:24:1364169:546","session_id":"1279412","input_length":98038,"t_proxy_recv":390263.673289469,"t_decision_unix":1779821128.6872308,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9974907688855342,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":98038,"score_linear":76969.0,"score_lmetric":175007},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":98038,"score_linear":122597.0,"score_lmetric":213979},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":135723,"ongoing_decode_tokens":127017,"pending_prefill_tokens":8706,"num_requests":2,"active_p_offloads":0,"cached_blocks":1943,"cache_hit":12800,"new_prefill":85238,"score_linear":122923.0,"score_lmetric":187888},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12636,"ongoing_decode_tokens":0,"pending_prefill_tokens":12636,"num_requests":1,"active_p_offloads":0,"cached_blocks":1482,"cache_hit":0,"new_prefill":98038,"score_linear":12636.0,"score_lmetric":110674},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13897,"ongoing_decode_tokens":0,"pending_prefill_tokens":13897,"num_requests":1,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":97792,"new_prefill":246,"score_linear":-83895.0,"score_lmetric":14143},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":98038,"score_linear":96303.0,"score_lmetric":196076},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":98038,"score_linear":117888.0,"score_lmetric":215926},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":12800,"new_prefill":85238,"score_linear":77978.0,"score_lmetric":296736}],"chosen_score_linear":-83895.0,"chosen_score_lmetric":14143,"t_first_token":390264.760876719,"t_first_token_unix":1779821129.7748203,"t_done":390267.165859532,"t_done_unix":1779821132.1798031},{"request_id":"1363440:2:1365095:551","session_id":"1363440","input_length":3866,"t_proxy_recv":390267.005710983,"t_decision_unix":1779821132.0196526,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":512,"affinity_cache_ratio":0.13243662700465597,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":3354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":3866,"score_linear":76969.0,"score_lmetric":80835},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":3866,"score_linear":122597.0,"score_lmetric":119807},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127773,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":3866,"score_linear":127773.0,"score_lmetric":39316},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":512,"new_prefill":3354,"score_linear":-512.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131741,"ongoing_decode_tokens":131741,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":0,"new_prefill":3866,"score_linear":131741.0,"score_lmetric":11598},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":3866,"score_linear":96303.0,"score_lmetric":7732},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":3866,"score_linear":117888.0,"score_lmetric":121754},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":3866,"score_linear":105499.0,"score_lmetric":205215}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390267.218667719,"t_first_token_unix":1779821132.2326107,"t_done":390267.469378002,"t_done_unix":1779821132.4833212},{"request_id":"1355484:4:1364784:548","session_id":"1355484","input_length":19806,"t_proxy_recv":390265.809224737,"t_decision_unix":1779821130.8231661,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19456,"affinity_cache_ratio":0.9823285872967787,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":350,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":19806,"score_linear":76969.0,"score_lmetric":96775},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":19806,"score_linear":122597.0,"score_lmetric":135747},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101416,"ongoing_decode_tokens":76965,"pending_prefill_tokens":387,"num_requests":2,"active_p_offloads":0,"cached_blocks":2012,"cache_hit":12800,"new_prefill":7006,"score_linear":88616.0,"score_lmetric":14786},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1507,"cache_hit":0,"new_prefill":19806,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":111935,"ongoing_decode_tokens":111935,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":19456,"new_prefill":350,"score_linear":92479.0,"score_lmetric":700},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":19806,"score_linear":96303.0,"score_lmetric":39612},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":19806,"score_linear":117888.0,"score_lmetric":137694},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":12800,"new_prefill":7006,"score_linear":77978.0,"score_lmetric":140272}],"chosen_score_linear":92479.0,"chosen_score_lmetric":700,"t_first_token":390265.884595044,"t_first_token_unix":1779821130.8985386,"t_done":390267.840022089,"t_done_unix":1779821132.8539653},{"request_id":"1305906:2:1363233:539","session_id":"1305906","input_length":16057,"t_proxy_recv":390260.495869964,"t_decision_unix":1779821125.5098112,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8609329264495236,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":2233,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":16057,"score_linear":76969.0,"score_lmetric":93026},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":16057,"score_linear":122597.0,"score_lmetric":131998},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":16057,"score_linear":161696.0,"score_lmetric":32114},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":16057,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1107,"cache_hit":0,"new_prefill":16057,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":13824,"new_prefill":2233,"score_linear":66422.0,"score_lmetric":2233},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":16057,"score_linear":117888.0,"score_lmetric":133945},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":62685,"ongoing_decode_tokens":0,"pending_prefill_tokens":62685,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":16057,"score_linear":62685.0,"score_lmetric":78742}],"chosen_score_linear":66422.0,"chosen_score_lmetric":2233,"t_first_token":390261.031436283,"t_first_token_unix":1779821126.0453799,"t_done":390268.461889171,"t_done_unix":1779821133.4758325},{"request_id":"1365440:1:1365440:552","session_id":"1365440","input_length":9913,"t_proxy_recv":390268.227043519,"t_decision_unix":1779821133.240985,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9913,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":9913,"score_linear":76969.0,"score_lmetric":86882},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":9913,"score_linear":122597.0,"score_lmetric":125854},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127773,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":9913,"score_linear":127773.0,"score_lmetric":45363},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1517,"cache_hit":0,"new_prefill":9913,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":13897,"ongoing_decode_tokens":13897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1111,"cache_hit":0,"new_prefill":9913,"score_linear":13897.0,"score_lmetric":9913},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":9913,"score_linear":96303.0,"score_lmetric":19826},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":9913,"score_linear":117888.0,"score_lmetric":127801},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":9913,"score_linear":105499.0,"score_lmetric":223356}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390268.986083495,"t_first_token_unix":1779821134.0000272,"t_done":390269.097349338,"t_done_unix":1779821134.1112926},{"request_id":"1364090:1:1364090:544","session_id":"1364090","input_length":13897,"t_proxy_recv":390263.390135776,"t_decision_unix":1779821128.404077,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13897,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":4096,"new_prefill":9801,"score_linear":72873.0,"score_lmetric":86770},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":13897,"score_linear":122597.0,"score_lmetric":129838},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":127017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1943,"cache_hit":0,"new_prefill":13897,"score_linear":127017.0,"score_lmetric":13897},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12636,"ongoing_decode_tokens":0,"pending_prefill_tokens":12636,"num_requests":1,"active_p_offloads":0,"cached_blocks":1482,"cache_hit":0,"new_prefill":13897,"score_linear":12636.0,"score_lmetric":26533},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":0,"new_prefill":13897,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":11264,"new_prefill":2633,"score_linear":85039.0,"score_lmetric":5266},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":11264,"new_prefill":2633,"score_linear":106624.0,"score_lmetric":120521},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":7680,"new_prefill":6217,"score_linear":83098.0,"score_lmetric":138694}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390264.610684685,"t_first_token_unix":1779821129.6246283,"t_done":390269.536808965,"t_done_unix":1779821134.550752},{"request_id":"1366128:1:1366128:553","session_id":"1366128","input_length":11154,"t_proxy_recv":390270.517505984,"t_decision_unix":1779821135.5314474,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11154,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":11154,"score_linear":76969.0,"score_lmetric":88123},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":11154,"score_linear":122597.0,"score_lmetric":127095},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127773,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":11154,"score_linear":127773.0,"score_lmetric":46604},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":11154,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":11154,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":11154,"score_linear":80246.0,"score_lmetric":11154},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":11154,"score_linear":117888.0,"score_lmetric":129042},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":11154,"score_linear":105499.0,"score_lmetric":227079}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390271.408364726,"t_first_token_unix":1779821136.4223084,"t_done":390272.52827672,"t_done_unix":1779821137.5422218},{"request_id":"1363943:2:1366428:556","session_id":"1363943","input_length":12984,"t_proxy_recv":390271.62772908,"t_decision_unix":1779821136.6416702,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":12800,"affinity_cache_ratio":0.9858287122612446,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":8704,"new_prefill":4280,"score_linear":68265.0,"score_lmetric":81249},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":12984,"score_linear":122597.0,"score_lmetric":128925},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":12984,"score_linear":162844.0,"score_lmetric":97378},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":12800,"new_prefill":184,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109421,"ongoing_decode_tokens":109421,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":4096,"new_prefill":8888,"score_linear":105325.0,"score_lmetric":17776},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":4096,"new_prefill":8888,"score_linear":76150.0,"score_lmetric":8888},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":4096,"new_prefill":8888,"score_linear":113792.0,"score_lmetric":126776},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":4096,"new_prefill":8888,"score_linear":101403.0,"score_lmetric":220281}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":390271.685588767,"t_first_token_unix":1779821136.6995325,"t_done":390273.47712229,"t_done_unix":1779821138.4910653},{"request_id":"1355484:5:1366753:560","session_id":"1355484","input_length":20026,"t_proxy_recv":390272.693153525,"t_decision_unix":1779821137.7070951,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.997103765105363,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":58,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113270,"ongoing_decode_tokens":0,"pending_prefill_tokens":79478,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":20026,"score_linear":113270.0,"score_lmetric":199008},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":20026,"score_linear":122597.0,"score_lmetric":135967},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":12800,"new_prefill":7226,"score_linear":150044.0,"score_lmetric":85862},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12984,"ongoing_decode_tokens":12984,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":20026,"score_linear":12984.0,"score_lmetric":20026},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":19968,"new_prefill":58,"score_linear":78299.0,"score_lmetric":58},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":20026,"score_linear":80246.0,"score_lmetric":20026},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":20026,"score_linear":117888.0,"score_lmetric":137914},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":0,"pending_prefill_tokens":72276,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":12800,"new_prefill":7226,"score_linear":133716.0,"score_lmetric":318008}],"chosen_score_linear":78299.0,"chosen_score_lmetric":58,"t_first_token":390272.774976914,"t_first_token_unix":1779821137.7889204,"t_done":390273.488275548,"t_done_unix":1779821138.502219},{"request_id":"1367424:1:1367424:569","session_id":"1367424","input_length":3392,"t_proxy_recv":390275.254361245,"t_decision_unix":1779821140.268303,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.375,"fallback_score":14466,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":0,"pending_prefill_tokens":80321,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":3392,"score_linear":162753.0,"score_lmetric":251139},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":3392,"score_linear":122597.0,"score_lmetric":119333},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":68259,"pending_prefill_tokens":36096,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":3392,"score_linear":171939.0,"score_lmetric":118464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":0,"pending_prefill_tokens":45652,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":3392,"score_linear":45652.0,"score_lmetric":98088},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":123812,"ongoing_decode_tokens":113678,"pending_prefill_tokens":1430,"num_requests":3,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":3392,"score_linear":123812.0,"score_lmetric":14466},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93995,"ongoing_decode_tokens":80246,"pending_prefill_tokens":13749,"num_requests":2,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":3392,"score_linear":93995.0,"score_lmetric":34282},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":3392,"score_linear":117888.0,"score_lmetric":121280},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":3392,"score_linear":146516.0,"score_lmetric":44516}],"chosen_score_linear":123812.0,"chosen_score_lmetric":14466,"t_first_token":390275.699198238,"t_first_token_unix":1779821140.7131417,"t_done":390275.869744373,"t_done_unix":1779821140.8836877},{"request_id":"1362265:2:1367373:568","session_id":"1362265","input_length":10134,"t_proxy_recv":390275.056847345,"t_decision_unix":1779821140.0707889,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":8704,"affinity_cache_ratio":0.8588908624432603,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":1430,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":0,"pending_prefill_tokens":80321,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":10134,"score_linear":162753.0,"score_lmetric":271365},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":10134,"score_linear":122597.0,"score_lmetric":126075},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":68259,"pending_prefill_tokens":36096,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":6656,"new_prefill":3478,"score_linear":165283.0,"score_lmetric":118722},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":0,"pending_prefill_tokens":45652,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":10134,"score_linear":45652.0,"score_lmetric":111572},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113678,"ongoing_decode_tokens":98267,"pending_prefill_tokens":4659,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":8704,"new_prefill":1430,"score_linear":104974.0,"score_lmetric":12178},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93995,"ongoing_decode_tokens":80246,"pending_prefill_tokens":13749,"num_requests":2,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":10134,"score_linear":93995.0,"score_lmetric":47766},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":10134,"score_linear":117888.0,"score_lmetric":128022},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":10134,"score_linear":146516.0,"score_lmetric":71484}],"chosen_score_linear":104974.0,"chosen_score_lmetric":12178,"t_first_token":390275.359571623,"t_first_token_unix":1779821140.3735154,"t_done":390276.203640687,"t_done_unix":1779821141.217584},{"request_id":"1353821:4:1363399:541","session_id":"1353821","input_length":28093,"t_proxy_recv":390261.154753256,"t_decision_unix":1779821126.1686947,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":27648,"affinity_cache_ratio":0.984159755099135,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":445,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":28093,"score_linear":76969.0,"score_lmetric":105062},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":28093,"score_linear":122597.0,"score_lmetric":144034},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":28093,"score_linear":161696.0,"score_lmetric":56186},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":28093,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37232,"ongoing_decode_tokens":0,"pending_prefill_tokens":1904,"num_requests":1,"active_p_offloads":0,"cached_blocks":1107,"cache_hit":0,"new_prefill":28093,"score_linear":37232.0,"score_lmetric":29997},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":28093,"score_linear":96303.0,"score_lmetric":56186},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":28093,"score_linear":117888.0,"score_lmetric":145981},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":62685,"ongoing_decode_tokens":0,"pending_prefill_tokens":62685,"num_requests":1,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":27648,"new_prefill":445,"score_linear":35037.0,"score_lmetric":63130}],"chosen_score_linear":35037.0,"chosen_score_lmetric":63130,"t_first_token":390274.061463257,"t_first_token_unix":1779821139.0754066,"t_done":390276.266345141,"t_done_unix":1779821141.2802882},{"request_id":"1367312:1:1367312:566","session_id":"1367312","input_length":13749,"t_proxy_recv":390274.850456675,"t_decision_unix":1779821139.8643978,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":13749,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":13749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":0,"pending_prefill_tokens":80321,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":13749,"score_linear":162753.0,"score_lmetric":282210},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":13749,"score_linear":122597.0,"score_lmetric":129690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":68259,"pending_prefill_tokens":36096,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":13749,"score_linear":171939.0,"score_lmetric":149535},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":18815,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":13749,"score_linear":18815.0,"score_lmetric":32564},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113678,"ongoing_decode_tokens":98267,"pending_prefill_tokens":4659,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":13749,"score_linear":113678.0,"score_lmetric":36816},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":13749,"score_linear":80246.0,"score_lmetric":13749},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":13749,"score_linear":117888.0,"score_lmetric":131637},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":13749,"score_linear":146516.0,"score_lmetric":85944}],"chosen_score_linear":80246.0,"chosen_score_lmetric":13749,"t_first_token":390276.033310388,"t_first_token_unix":1779821141.0472538,"t_done":390276.656472145,"t_done_unix":1779821141.6704154},{"request_id":"1366128:2:1367220:563","session_id":"1366128","input_length":15411,"t_proxy_recv":390274.554043764,"t_decision_unix":1779821139.567985,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":10752,"affinity_cache_ratio":0.6976834728440724,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":4659,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113270,"ongoing_decode_tokens":0,"pending_prefill_tokens":79478,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":15411,"score_linear":113270.0,"score_lmetric":189778},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":15411,"score_linear":122597.0,"score_lmetric":131352},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":15411,"score_linear":162844.0,"score_lmetric":102232},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":18815,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":15411,"score_linear":18815.0,"score_lmetric":34226},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":10752,"new_prefill":4659,"score_linear":87515.0,"score_lmetric":4659},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":15411,"score_linear":80246.0,"score_lmetric":15411},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":15411,"score_linear":117888.0,"score_lmetric":133299},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":15411,"score_linear":146516.0,"score_lmetric":92592}],"chosen_score_linear":87515.0,"chosen_score_lmetric":4659,"t_first_token":390275.114439482,"t_first_token_unix":1779821140.128383,"t_done":390276.883457939,"t_done_unix":1779821141.8974006},{"request_id":"1363093:1:1363093:538","session_id":"1363093","input_length":62685,"t_proxy_recv":390260.015207657,"t_decision_unix":1779821125.0291488,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":62685,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":62685,"score_linear":76969.0,"score_lmetric":139654},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":62685,"score_linear":122597.0,"score_lmetric":178626},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161696,"ongoing_decode_tokens":161696,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":62685,"score_linear":161696.0,"score_lmetric":125370},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1481,"cache_hit":0,"new_prefill":62685,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1107,"cache_hit":0,"new_prefill":62685,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":62685,"score_linear":80246.0,"score_lmetric":62685},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":62685,"score_linear":117888.0,"score_lmetric":180573},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":62685,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390274.059421777,"t_first_token_unix":1779821139.0733654,"t_done":390276.929877137,"t_done_unix":1779821141.9438205},{"request_id":"1364128:2:1367249:565","session_id":"1364128","input_length":9095,"t_proxy_recv":390274.648060143,"t_decision_unix":1779821139.6620018,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":8704,"affinity_cache_ratio":0.9570093457943926,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":391,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":0,"pending_prefill_tokens":80321,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":9095,"score_linear":162753.0,"score_lmetric":268248},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":9095,"score_linear":122597.0,"score_lmetric":125036},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":8704,"new_prefill":391,"score_linear":154140.0,"score_lmetric":72192},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":18815,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":9095,"score_linear":18815.0,"score_lmetric":27910},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113678,"ongoing_decode_tokens":98267,"pending_prefill_tokens":4659,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":6656,"new_prefill":2439,"score_linear":107022.0,"score_lmetric":14196},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":9095,"score_linear":80246.0,"score_lmetric":9095},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":9095,"score_linear":117888.0,"score_lmetric":126983},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":9095,"score_linear":146516.0,"score_lmetric":67328}],"chosen_score_linear":154140.0,"chosen_score_lmetric":72192,"t_first_token":390276.843987508,"t_first_token_unix":1779821141.857931,"t_done":390278.155626194,"t_done_unix":1779821143.1695693},{"request_id":"1344773:11:1366387:555","session_id":"1344773","input_length":35071,"t_proxy_recv":390271.491344939,"t_decision_unix":1779821136.5052862,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9927290353853612,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":35071,"score_linear":76969.0,"score_lmetric":112040},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":35071,"score_linear":122597.0,"score_lmetric":151012},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127773,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":34816,"new_prefill":255,"score_linear":92957.0,"score_lmetric":35705},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":35071,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109421,"ongoing_decode_tokens":11154,"pending_prefill_tokens":475,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":35071,"score_linear":109421.0,"score_lmetric":71092},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":35071,"score_linear":80246.0,"score_lmetric":35071},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":35071,"score_linear":117888.0,"score_lmetric":152959},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":35071,"score_linear":105499.0,"score_lmetric":298830}],"chosen_score_linear":92957.0,"chosen_score_lmetric":35705,"t_first_token":390276.822886833,"t_first_token_unix":1779821141.83683,"t_done":390278.7022075,"t_done_unix":1779821143.7161505},{"request_id":"1367312:2:1368064:574","session_id":"1367312","input_length":15501,"t_proxy_recv":390277.546437827,"t_decision_unix":1779821142.560379,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13312,"affinity_cache_ratio":0.8587833043029482,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":2189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":15501,"score_linear":162753.0,"score_lmetric":56559},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":15501,"score_linear":122597.0,"score_lmetric":131442},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":171939,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":15501,"score_linear":171939.0,"score_lmetric":46503},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":18815,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":15501,"score_linear":45652.0,"score_lmetric":84676},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":15501,"score_linear":171186.0,"score_lmetric":176840},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":13312,"new_prefill":2189,"score_linear":66934.0,"score_lmetric":2189},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":15501,"score_linear":117888.0,"score_lmetric":133389},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55738,"ongoing_decode_tokens":55738,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":15501,"score_linear":55738.0,"score_lmetric":31002}],"chosen_score_linear":66934.0,"chosen_score_lmetric":2189,"t_first_token":390277.823304199,"t_first_token_unix":1779821142.8372471,"t_done":390278.926137706,"t_done_unix":1779821143.940081},{"request_id":"1364960:2:1368239:578","session_id":"1364960","input_length":7048,"t_proxy_recv":390278.146557798,"t_decision_unix":1779821143.160499,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":5,"affinity_cache_hit":2048,"affinity_cache_ratio":0.2905788876276958,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":14096,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7048,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":7048,"score_linear":162753.0,"score_lmetric":31200},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":7048,"score_linear":122597.0,"score_lmetric":122989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":180784,"ongoing_decode_tokens":180784,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":7048,"score_linear":180784.0,"score_lmetric":28192},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":18815,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":2048,"new_prefill":5000,"score_linear":43604.0,"score_lmetric":63674},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":7048,"score_linear":171186.0,"score_lmetric":159934},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95747,"ongoing_decode_tokens":95747,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":7048,"score_linear":95747.0,"score_lmetric":14096},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":7048,"score_linear":117888.0,"score_lmetric":124936},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77511,"ongoing_decode_tokens":55738,"pending_prefill_tokens":21773,"num_requests":3,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":7048,"score_linear":77511.0,"score_lmetric":86463}],"chosen_score_linear":95747.0,"chosen_score_lmetric":14096,"t_first_token":390278.635112238,"t_first_token_unix":1779821143.6490555,"t_done":390279.262490475,"t_done_unix":1779821144.2764335},{"request_id":"1357132:2:1364990:550","session_id":"1357132","input_length":14721,"t_proxy_recv":390266.497089972,"t_decision_unix":1779821131.5110316,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":13312,"affinity_cache_ratio":0.9042863935873922,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":1409,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":14721,"score_linear":76969.0,"score_lmetric":91690},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":14721,"score_linear":122597.0,"score_lmetric":130662},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":92710,"ongoing_decode_tokens":92710,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":14721,"score_linear":92710.0,"score_lmetric":14721},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":2019,"ongoing_decode_tokens":0,"pending_prefill_tokens":2019,"num_requests":1,"active_p_offloads":0,"cached_blocks":1507,"cache_hit":0,"new_prefill":14721,"score_linear":2019.0,"score_lmetric":16740},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131741,"ongoing_decode_tokens":131741,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":0,"new_prefill":14721,"score_linear":131741.0,"score_lmetric":44163},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":14721,"score_linear":96303.0,"score_lmetric":29442},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":14721,"score_linear":117888.0,"score_lmetric":132609},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90778,"ongoing_decode_tokens":0,"pending_prefill_tokens":63130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":13312,"new_prefill":1409,"score_linear":77466.0,"score_lmetric":129078}],"chosen_score_linear":77466.0,"chosen_score_lmetric":129078,"t_first_token":390274.062538063,"t_first_token_unix":1779821139.0764813,"t_done":390280.235032588,"t_done_unix":1779821145.2489765},{"request_id":"1367329:1:1367329:567","session_id":"1367329","input_length":26837,"t_proxy_recv":390274.910952559,"t_decision_unix":1779821139.9248936,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":45652,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":26837,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":0,"pending_prefill_tokens":80321,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":26837,"score_linear":162753.0,"score_lmetric":321474},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":26837,"score_linear":122597.0,"score_lmetric":142778},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":68259,"pending_prefill_tokens":36096,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":26837,"score_linear":171939.0,"score_lmetric":188799},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":18815,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":26837,"score_linear":18815.0,"score_lmetric":45652},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113678,"ongoing_decode_tokens":98267,"pending_prefill_tokens":4659,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":26837,"score_linear":113678.0,"score_lmetric":62992},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":93995,"ongoing_decode_tokens":80246,"pending_prefill_tokens":13749,"num_requests":2,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":26837,"score_linear":93995.0,"score_lmetric":81172},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":26837,"score_linear":117888.0,"score_lmetric":144725},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":26837,"score_linear":146516.0,"score_lmetric":138296}],"chosen_score_linear":18815.0,"chosen_score_lmetric":45652,"t_first_token":390279.467316416,"t_first_token_unix":1779821144.48126,"t_done":390280.254725204,"t_done_unix":1779821145.268669},{"request_id":"1270340:4:1366608:558","session_id":"1270340","input_length":41017,"t_proxy_recv":390272.246471472,"t_decision_unix":1779821137.260413,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":33280,"affinity_cache_ratio":0.8113708949947582,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":7737,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":41017,"score_linear":76969.0,"score_lmetric":117986},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":41017,"score_linear":122597.0,"score_lmetric":156958},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":41017,"score_linear":162844.0,"score_lmetric":153444},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12984,"ongoing_decode_tokens":12984,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":1536,"new_prefill":39481,"score_linear":11448.0,"score_lmetric":39481},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109421,"ongoing_decode_tokens":109421,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":41017,"score_linear":109421.0,"score_lmetric":82034},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":41017,"score_linear":80246.0,"score_lmetric":41017},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":41017,"score_linear":117888.0,"score_lmetric":158905},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":33280,"new_prefill":7737,"score_linear":72219.0,"score_lmetric":216828}],"chosen_score_linear":72219.0,"chosen_score_lmetric":216828,"t_first_token":390275.924441528,"t_first_token_unix":1779821140.938385,"t_done":390280.377373372,"t_done_unix":1779821145.3913167},{"request_id":"1368070:1:1368070:575","session_id":"1368070","input_length":21773,"t_proxy_recv":390277.569794272,"t_decision_unix":1779821142.5837357,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":43546,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21773,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":21773,"score_linear":162753.0,"score_lmetric":75375},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":21773,"score_linear":122597.0,"score_lmetric":137714},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":171939,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":21773,"score_linear":171939.0,"score_lmetric":65319},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":18815,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":21773,"score_linear":45652.0,"score_lmetric":97220},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":21773,"score_linear":171186.0,"score_lmetric":189384},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95747,"ongoing_decode_tokens":80246,"pending_prefill_tokens":2189,"num_requests":2,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":21773,"score_linear":95747.0,"score_lmetric":47924},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":21773,"score_linear":117888.0,"score_lmetric":139661},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55738,"ongoing_decode_tokens":55738,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":21773,"score_linear":55738.0,"score_lmetric":43546}],"chosen_score_linear":55738.0,"chosen_score_lmetric":43546,"t_first_token":390279.935588221,"t_first_token_unix":1779821144.9495323,"t_done":390280.499292883,"t_done_unix":1779821145.513236},{"request_id":"1357132:3:1366582:557","session_id":"1357132","input_length":14816,"t_proxy_recv":390280.242911656,"t_decision_unix":1779821145.2568533,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9676025917926566,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":14816,"score_linear":162753.0,"score_lmetric":54504},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":14816,"score_linear":122597.0,"score_lmetric":130757},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171812,"ongoing_decode_tokens":171812,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":14816,"score_linear":171812.0,"score_lmetric":44448},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":45652,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":14816,"score_linear":45652.0,"score_lmetric":29632},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":14816,"score_linear":171186.0,"score_lmetric":175470},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":14816,"score_linear":80246.0,"score_lmetric":14816},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":14816,"score_linear":117888.0,"score_lmetric":132704},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":126025,"ongoing_decode_tokens":126025,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1368,"cache_hit":14336,"new_prefill":480,"score_linear":111689.0,"score_lmetric":1440}],"chosen_score_linear":111689.0,"chosen_score_lmetric":1440,"t_first_token":390280.311712151,"t_first_token_unix":1779821145.3256555,"t_done":390280.608102072,"t_done_unix":1779821145.6220458},{"request_id":"1357132:4:1367654:570","session_id":"1357132","input_length":14949,"t_proxy_recv":390280.613255003,"t_decision_unix":1779821145.6271963,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14336,"affinity_cache_ratio":0.9589939126362967,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":613,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":14949,"score_linear":162753.0,"score_lmetric":54903},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":14949,"score_linear":122597.0,"score_lmetric":130890},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171812,"ongoing_decode_tokens":171812,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":14949,"score_linear":171812.0,"score_lmetric":44847},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1588,"cache_hit":0,"new_prefill":14949,"score_linear":18815.0,"score_lmetric":14949},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":14949,"score_linear":171186.0,"score_lmetric":175736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":14949,"score_linear":80246.0,"score_lmetric":14949},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":14949,"score_linear":117888.0,"score_lmetric":132837},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63235,"ongoing_decode_tokens":63235,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":14336,"new_prefill":613,"score_linear":48899.0,"score_lmetric":613}],"chosen_score_linear":48899.0,"chosen_score_lmetric":613,"t_first_token":390280.687302277,"t_first_token_unix":1779821145.7012458,"t_done":390280.994142872,"t_done_unix":1779821146.008086},{"request_id":"1367169:1:1367169:562","session_id":"1367169","input_length":18815,"t_proxy_recv":390274.36746465,"t_decision_unix":1779821139.3814056,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":18815,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113270,"ongoing_decode_tokens":0,"pending_prefill_tokens":79478,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":11776,"new_prefill":7039,"score_linear":101494.0,"score_lmetric":173034},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":18815,"score_linear":122597.0,"score_lmetric":134756},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":18815,"score_linear":162844.0,"score_lmetric":109040},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":18815,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":18815,"score_linear":98267.0,"score_lmetric":18815},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":18815,"score_linear":80246.0,"score_lmetric":18815},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":11776,"new_prefill":7039,"score_linear":106112.0,"score_lmetric":124927},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":18815,"score_linear":146516.0,"score_lmetric":106208}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390276.572638155,"t_first_token_unix":1779821141.5865822,"t_done":390281.186357161,"t_done_unix":1779821146.2003002},{"request_id":"1357132:5:1368445:579","session_id":"1357132","input_length":15871,"t_proxy_recv":390280.999966586,"t_decision_unix":1779821146.0139081,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14848,"affinity_cache_ratio":0.93554281393737,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":1023,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":15871,"score_linear":162753.0,"score_lmetric":57669},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":15871,"score_linear":122597.0,"score_lmetric":131812},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171812,"ongoing_decode_tokens":171812,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":15871,"score_linear":171812.0,"score_lmetric":47613},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":18815,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1588,"cache_hit":0,"new_prefill":15871,"score_linear":18815.0,"score_lmetric":15871},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":15871,"score_linear":171186.0,"score_lmetric":177580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":15871,"score_linear":80246.0,"score_lmetric":15871},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":15871,"score_linear":117888.0,"score_lmetric":133759},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63235,"ongoing_decode_tokens":63235,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":14848,"new_prefill":1023,"score_linear":48387.0,"score_lmetric":1023}],"chosen_score_linear":48387.0,"chosen_score_lmetric":1023,"t_first_token":390281.198395876,"t_first_token_unix":1779821146.2123394,"t_done":390281.494909329,"t_done_unix":1779821146.5088537},{"request_id":"1363093:2:1368700:580","session_id":"1363093","input_length":63235,"t_proxy_recv":390279.730268051,"t_decision_unix":1779821144.744209,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":62464,"affinity_cache_ratio":0.9878073851506286,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":63235,"score_linear":162753.0,"score_lmetric":199761},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":63235,"score_linear":122597.0,"score_lmetric":179176},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171812,"ongoing_decode_tokens":171812,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":63235,"score_linear":171812.0,"score_lmetric":189705},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":45652,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":63235,"score_linear":45652.0,"score_lmetric":126470},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":63235,"score_linear":171186.0,"score_lmetric":272308},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":63235,"score_linear":80246.0,"score_lmetric":63235},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":63235,"score_linear":117888.0,"score_lmetric":181123},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77511,"ongoing_decode_tokens":55738,"pending_prefill_tokens":21773,"num_requests":3,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":62464,"new_prefill":771,"score_linear":15047.0,"score_lmetric":67632}],"chosen_score_linear":15047.0,"chosen_score_lmetric":67632,"t_first_token":390280.231982631,"t_first_token_unix":1779821145.2459266,"t_done":390281.967197458,"t_done_unix":1779821146.9811409},{"request_id":"1369172:1:1369172:581","session_id":"1369172","input_length":6345,"t_proxy_recv":390281.414699502,"t_decision_unix":1779821146.428641,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":6345,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":162753,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":6345,"score_linear":162753.0,"score_lmetric":19035},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":6345,"score_linear":122597.0,"score_lmetric":122286},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171812,"ongoing_decode_tokens":171812,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":6345,"score_linear":171812.0,"score_lmetric":19035},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1625,"cache_hit":0,"new_prefill":6345,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":6345,"score_linear":171186.0,"score_lmetric":158528},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":6345,"score_linear":80246.0,"score_lmetric":6345},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":6345,"score_linear":117888.0,"score_lmetric":124233},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79106,"ongoing_decode_tokens":79106,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":6345,"score_linear":79106.0,"score_lmetric":12690}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390281.832710734,"t_first_token_unix":1779821146.8466542,"t_done":390282.071887313,"t_done_unix":1779821147.0858305},{"request_id":"1344773:12:1367864:571","session_id":"1344773","input_length":35194,"t_proxy_recv":390278.709221511,"t_decision_unix":1779821143.723163,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9892595328749219,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":378,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":35194,"score_linear":162753.0,"score_lmetric":115638},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":35194,"score_linear":122597.0,"score_lmetric":151135},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136618,"ongoing_decode_tokens":136618,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":34816,"new_prefill":378,"score_linear":101802.0,"score_lmetric":756},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":18815,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":35194,"score_linear":45652.0,"score_lmetric":124062},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":35194,"score_linear":171186.0,"score_lmetric":216226},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":102795,"ongoing_decode_tokens":102795,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":35194,"score_linear":102795.0,"score_lmetric":105582},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":35194,"score_linear":117888.0,"score_lmetric":153082},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77511,"ongoing_decode_tokens":55738,"pending_prefill_tokens":21773,"num_requests":3,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":35194,"score_linear":77511.0,"score_lmetric":170901}],"chosen_score_linear":101802.0,"chosen_score_lmetric":756,"t_first_token":390278.818260887,"t_first_token_unix":1779821143.8322043,"t_done":390282.093714011,"t_done_unix":1779821147.107657},{"request_id":"1361694:1:1361694:534","session_id":"1361694","input_length":76969,"t_proxy_recv":390255.270902278,"t_decision_unix":1779821120.2848432,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":76969,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":76969,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":76969,"score_linear":122597.0,"score_lmetric":192910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161628,"ongoing_decode_tokens":127017,"pending_prefill_tokens":307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":76969,"score_linear":161628.0,"score_lmetric":154552},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":16480,"ongoing_decode_tokens":16480,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1449,"cache_hit":0,"new_prefill":76969,"score_linear":16480.0,"score_lmetric":76969},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":76969,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":76969,"score_linear":101617.0,"score_lmetric":153938},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":3584,"new_prefill":73385,"score_linear":114304.0,"score_lmetric":191273},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":61411,"ongoing_decode_tokens":0,"pending_prefill_tokens":5603,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":76969,"score_linear":61411.0,"score_lmetric":165144}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390275.519992669,"t_first_token_unix":1779821140.5339365,"t_done":390282.776773403,"t_done_unix":1779821147.7907166},{"request_id":"1277428:5:1366630:559","session_id":"1277428","input_length":36301,"t_proxy_recv":390272.317890592,"t_decision_unix":1779821137.3318322,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":33792,"affinity_cache_ratio":0.9308834467370045,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":33792,"estimated_new_tokens":2509,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":33792,"new_prefill":2509,"score_linear":43177.0,"score_lmetric":79478},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":4608,"new_prefill":31693,"score_linear":117989.0,"score_lmetric":147634},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":36301,"score_linear":162844.0,"score_lmetric":144012},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":12984,"ongoing_decode_tokens":12984,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":17408,"new_prefill":18893,"score_linear":-4424.0,"score_lmetric":18893},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":109421,"ongoing_decode_tokens":109421,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":36301,"score_linear":109421.0,"score_lmetric":72602},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":36301,"score_linear":80246.0,"score_lmetric":36301},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":36301,"score_linear":117888.0,"score_lmetric":154189},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":0,"pending_prefill_tokens":72276,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":36301,"score_linear":146516.0,"score_lmetric":434308}],"chosen_score_linear":43177.0,"chosen_score_lmetric":79478,"t_first_token":390281.028291066,"t_first_token_unix":1779821146.0422344,"t_done":390282.896947515,"t_done_unix":1779821147.910891},{"request_id":"1368132:1:1368132:577","session_id":"1368132","input_length":8845,"t_proxy_recv":390277.821071249,"t_decision_unix":1779821142.835013,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":6567,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":2189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":8845,"score_linear":162753.0,"score_lmetric":36591},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":8845,"score_linear":122597.0,"score_lmetric":124786},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":171939,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":6656,"new_prefill":2189,"score_linear":165283.0,"score_lmetric":6567},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":18815,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":8845,"score_linear":45652.0,"score_lmetric":71364},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":6656,"new_prefill":2189,"score_linear":164530.0,"score_lmetric":150216},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":95747,"ongoing_decode_tokens":80246,"pending_prefill_tokens":2189,"num_requests":2,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":8845,"score_linear":95747.0,"score_lmetric":22068},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":8845,"score_linear":117888.0,"score_lmetric":126733},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":77511,"ongoing_decode_tokens":55738,"pending_prefill_tokens":21773,"num_requests":3,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":8845,"score_linear":77511.0,"score_lmetric":91854}],"chosen_score_linear":165283.0,"chosen_score_lmetric":6567,"t_first_token":390278.090321547,"t_first_token_unix":1779821143.104265,"t_done":390283.661072639,"t_done_unix":1779821148.6750162},{"request_id":"1369768:1:1369768:584","session_id":"1369768","input_length":7712,"t_proxy_recv":390283.417163027,"t_decision_unix":1779821148.4311042,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7712,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1416,"cache_hit":0,"new_prefill":7712,"score_linear":49483.0,"score_lmetric":7712},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":7712,"score_linear":122597.0,"score_lmetric":123653},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136618,"ongoing_decode_tokens":136618,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":7712,"score_linear":136618.0,"score_lmetric":15424},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18160,"ongoing_decode_tokens":18160,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":7712,"score_linear":18160.0,"score_lmetric":7712},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":7712,"score_linear":191344.0,"score_lmetric":242463},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":7712,"score_linear":80246.0,"score_lmetric":7712},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":7712,"score_linear":117888.0,"score_lmetric":125600},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1429,"cache_hit":0,"new_prefill":7712,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390283.951214024,"t_first_token_unix":1779821148.9651582,"t_done":390284.063592757,"t_done_unix":1779821149.077538},{"request_id":"1313181:3:1364311:547","session_id":"1313181","input_length":59514,"t_proxy_recv":390266.882911892,"t_decision_unix":1779821131.8968532,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24064,"affinity_cache_ratio":0.4043418355344961,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":35450,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":59514,"score_linear":76969.0,"score_lmetric":136483},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":59514,"score_linear":122597.0,"score_lmetric":175455},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":24064,"new_prefill":35450,"score_linear":44195.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1511,"cache_hit":0,"new_prefill":59514,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":131741,"ongoing_decode_tokens":131741,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1110,"cache_hit":12800,"new_prefill":46714,"score_linear":118941.0,"score_lmetric":140142},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":96303,"ongoing_decode_tokens":96303,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1023,"cache_hit":0,"new_prefill":59514,"score_linear":96303.0,"score_lmetric":119028},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":59514,"score_linear":117888.0,"score_lmetric":177402},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":12800,"new_prefill":46714,"score_linear":92699.0,"score_lmetric":333759}],"chosen_score_linear":44195.0,"chosen_score_lmetric":0,"t_first_token":390276.817539358,"t_first_token_unix":1779821141.8314831,"t_done":390284.507792689,"t_done_unix":1779821149.5217361},{"request_id":"1363943:3:1369535:582","session_id":"1363943","input_length":18160,"t_proxy_recv":390282.596334519,"t_decision_unix":1779821147.6102757,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":12800,"affinity_cache_ratio":0.7048458149779736,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":12800,"estimated_new_tokens":5360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":162753,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":8704,"new_prefill":9456,"score_linear":154049.0,"score_lmetric":28368},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":18160,"score_linear":122597.0,"score_lmetric":134101},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136618,"ongoing_decode_tokens":136618,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":18160,"score_linear":136618.0,"score_lmetric":36320},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":12800,"new_prefill":5360,"score_linear":-12800.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":4096,"new_prefill":14064,"score_linear":167090.0,"score_lmetric":173966},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":4096,"new_prefill":14064,"score_linear":76150.0,"score_lmetric":14064},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":4096,"new_prefill":14064,"score_linear":113792.0,"score_lmetric":131952},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1429,"cache_hit":4096,"new_prefill":14064,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-12800.0,"chosen_score_lmetric":0,"t_first_token":390283.278981778,"t_first_token_unix":1779821148.2929256,"t_done":390284.647565201,"t_done_unix":1779821149.6615086},{"request_id":"1340278:2:1367225:564","session_id":"1340278","input_length":49483,"t_proxy_recv":390274.618774088,"t_decision_unix":1779821139.6327152,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9829638461693915,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":843,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":113270,"ongoing_decode_tokens":0,"pending_prefill_tokens":79478,"num_requests":2,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":48640,"new_prefill":843,"score_linear":64630.0,"score_lmetric":160642},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":49483,"score_linear":122597.0,"score_lmetric":165424},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":162844,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35705,"num_requests":2,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":0,"new_prefill":49483,"score_linear":162844.0,"score_lmetric":170376},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18815,"ongoing_decode_tokens":0,"pending_prefill_tokens":18815,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":49483,"score_linear":18815.0,"score_lmetric":68298},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":113678,"ongoing_decode_tokens":98267,"pending_prefill_tokens":4659,"num_requests":2,"active_p_offloads":0,"cached_blocks":1160,"cache_hit":0,"new_prefill":49483,"score_linear":113678.0,"score_lmetric":108284},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":49483,"score_linear":80246.0,"score_lmetric":49483},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":49483,"score_linear":117888.0,"score_lmetric":167371},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":146516,"ongoing_decode_tokens":105499,"pending_prefill_tokens":7737,"num_requests":4,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":0,"new_prefill":49483,"score_linear":146516.0,"score_lmetric":228880}],"chosen_score_linear":64630.0,"chosen_score_lmetric":160642,"t_first_token":390281.031801592,"t_first_token_unix":1779821146.0457447,"t_done":390284.798485358,"t_done_unix":1779821149.8124282},{"request_id":"1340278:3:1368072:576","session_id":"1340278","input_length":50124,"t_proxy_recv":390284.828948988,"t_decision_unix":1779821149.8428905,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9908227595563004,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":49664,"new_prefill":460,"score_linear":-49664.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":50124,"score_linear":122597.0,"score_lmetric":166065},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":110963,"ongoing_decode_tokens":110963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":50124,"score_linear":110963.0,"score_lmetric":50124},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":14205,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":50124,"score_linear":18301.0,"score_lmetric":64329},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":50124,"score_linear":191344.0,"score_lmetric":369699},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":50124,"score_linear":103553.0,"score_lmetric":146862},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":50124,"score_linear":117888.0,"score_lmetric":168012},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":50124,"score_linear":29501.0,"score_lmetric":58121}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":390285.006721764,"t_first_token_unix":1779821150.020665,"t_done":390285.035214247,"t_done_unix":1779821150.0491574},{"request_id":"1370269:1:1370269:591","session_id":"1370269","input_length":2381,"t_proxy_recv":390285.149668228,"t_decision_unix":1779821150.1636097,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":0,"new_prefill":2381,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":2381,"score_linear":122597.0,"score_lmetric":118322},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157509,"ongoing_decode_tokens":110963,"pending_prefill_tokens":11218,"num_requests":3,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":2381,"score_linear":157509.0,"score_lmetric":40797},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":14205,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":2381,"score_linear":18301.0,"score_lmetric":16586},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":2381,"score_linear":191344.0,"score_lmetric":226470},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":2381,"score_linear":103553.0,"score_lmetric":51376},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":2381,"score_linear":117888.0,"score_lmetric":120269},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94032,"ongoing_decode_tokens":0,"pending_prefill_tokens":13648,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":2381,"score_linear":94032.0,"score_lmetric":32058}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390285.298023103,"t_first_token_unix":1779821150.3119667,"t_done":390285.739826441,"t_done_unix":1779821150.7537694},{"request_id":"1344773:13:1370257:589","session_id":"1344773","input_length":35413,"t_proxy_recv":390285.087282633,"t_decision_unix":1779821150.1012244,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9975997515036851,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":85,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":0,"new_prefill":35413,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":35413,"score_linear":122597.0,"score_lmetric":151354},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":122096,"ongoing_decode_tokens":110963,"pending_prefill_tokens":11133,"num_requests":2,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":35328,"new_prefill":85,"score_linear":86768.0,"score_lmetric":22436},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":14205,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":35413,"score_linear":18301.0,"score_lmetric":49618},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":35413,"score_linear":191344.0,"score_lmetric":325566},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":35413,"score_linear":103553.0,"score_lmetric":117440},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":35413,"score_linear":117888.0,"score_lmetric":153301},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":35413,"score_linear":29501.0,"score_lmetric":43410}],"chosen_score_linear":86768.0,"chosen_score_lmetric":22436,"t_first_token":390285.872892926,"t_first_token_unix":1779821150.8868365,"t_done":390285.949881673,"t_done_unix":1779821150.9638247},{"request_id":"1367424:2:1370211:588","session_id":"1367424","input_length":11133,"t_proxy_recv":390284.896039239,"t_decision_unix":1779821149.9099786,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":2,"affinity_cache_hit":3072,"affinity_cache_ratio":0.27593640528159524,"affinity_num_requests":3,"avg_num_requests":1.375,"fallback_score":11133,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11133,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":50124,"ongoing_decode_tokens":0,"pending_prefill_tokens":460,"num_requests":1,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":0,"new_prefill":11133,"score_linear":50124.0,"score_lmetric":11593},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":11133,"score_linear":122597.0,"score_lmetric":127074},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":110963,"ongoing_decode_tokens":110963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":11133,"score_linear":110963.0,"score_lmetric":11133},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":14205,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":11133,"score_linear":18301.0,"score_lmetric":25338},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":3072,"new_prefill":8061,"score_linear":188272.0,"score_lmetric":243510},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":11133,"score_linear":103553.0,"score_lmetric":68880},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":11133,"score_linear":117888.0,"score_lmetric":129021},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":11133,"score_linear":29501.0,"score_lmetric":19130}],"chosen_score_linear":110963.0,"chosen_score_lmetric":11133,"t_first_token":390285.806161186,"t_first_token_unix":1779821150.8201046,"t_done":390286.029965917,"t_done_unix":1779821151.043909},{"request_id":"1370466:1:1370466:592","session_id":"1370466","input_length":7710,"t_proxy_recv":390285.949071212,"t_decision_unix":1779821150.963013,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1422,"cache_hit":0,"new_prefill":7710,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":122597,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":7710,"score_linear":122597.0,"score_lmetric":7710},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157509,"ongoing_decode_tokens":157509,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":7710,"score_linear":157509.0,"score_lmetric":23130},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":14205,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":7710,"score_linear":18301.0,"score_lmetric":21915},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":7710,"score_linear":191344.0,"score_lmetric":242457},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":7710,"score_linear":103553.0,"score_lmetric":62034},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":7710,"score_linear":117888.0,"score_lmetric":125598},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94032,"ongoing_decode_tokens":0,"pending_prefill_tokens":13648,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":7710,"score_linear":94032.0,"score_lmetric":42716}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390286.480245275,"t_first_token_unix":1779821151.4941893,"t_done":390286.59316068,"t_done_unix":1779821151.607104},{"request_id":"1313181:4:1318843:342","session_id":"1313181","input_length":42704,"t_proxy_recv":390284.523267885,"t_decision_unix":1779821149.5372093,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":42496,"affinity_cache_ratio":0.9951292618958412,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":208,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1416,"cache_hit":0,"new_prefill":42704,"score_linear":49483.0,"score_lmetric":42704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":42704,"score_linear":122597.0,"score_lmetric":158645},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":42496,"new_prefill":208,"score_linear":25763.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18160,"ongoing_decode_tokens":18160,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":42704,"score_linear":18160.0,"score_lmetric":42704},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":12800,"new_prefill":29904,"score_linear":178544.0,"score_lmetric":309039},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":42704,"score_linear":103553.0,"score_lmetric":132022},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":42704,"score_linear":117888.0,"score_lmetric":160592},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":12800,"new_prefill":29904,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":25763.0,"chosen_score_lmetric":0,"t_first_token":390284.613735522,"t_first_token_unix":1779821149.6276786,"t_done":390286.691717449,"t_done_unix":1779821151.7056613},{"request_id":"1366128:3:1369902:585","session_id":"1366128","input_length":23307,"t_proxy_recv":390283.88406916,"t_decision_unix":1779821148.8980103,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":5,"affinity_cache_hit":15360,"affinity_cache_ratio":0.6590294761230532,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":23307,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":23307,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1416,"cache_hit":0,"new_prefill":23307,"score_linear":49483.0,"score_lmetric":23307},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":23307,"score_linear":122597.0,"score_lmetric":139248},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127773,"ongoing_decode_tokens":127773,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":0,"new_prefill":23307,"score_linear":127773.0,"score_lmetric":23307},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18160,"ongoing_decode_tokens":18160,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":23307,"score_linear":18160.0,"score_lmetric":23307},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":15360,"new_prefill":7947,"score_linear":175984.0,"score_lmetric":243168},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":23307,"score_linear":80246.0,"score_lmetric":23307},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":23307,"score_linear":117888.0,"score_lmetric":141195},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":7712,"ongoing_decode_tokens":0,"pending_prefill_tokens":7712,"num_requests":1,"active_p_offloads":0,"cached_blocks":1429,"cache_hit":0,"new_prefill":23307,"score_linear":7712.0,"score_lmetric":31019}],"chosen_score_linear":80246.0,"chosen_score_lmetric":23307,"t_first_token":390286.490860592,"t_first_token_unix":1779821151.5048041,"t_done":390286.945876573,"t_done_unix":1779821151.9598196},{"request_id":"1356885:1:1356885:514","session_id":"1356885","input_length":122597,"t_proxy_recv":390238.175861825,"t_decision_unix":1779821103.1898034,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":115941,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":122597,"score_linear":132503.0,"score_lmetric":413944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":935,"cache_hit":6656,"new_prefill":115941,"score_linear":-6656.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1941,"cache_hit":1024,"new_prefill":121573,"score_linear":67235.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":0,"pending_prefill_tokens":3137,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":122597,"score_linear":48193.0,"score_lmetric":125734},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35308,"ongoing_decode_tokens":0,"pending_prefill_tokens":35308,"num_requests":1,"active_p_offloads":0,"cached_blocks":1001,"cache_hit":0,"new_prefill":122597,"score_linear":35308.0,"score_lmetric":157905},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99460,"ongoing_decode_tokens":99460,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1006,"cache_hit":0,"new_prefill":122597,"score_linear":99460.0,"score_lmetric":245194},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1207,"cache_hit":0,"new_prefill":122597,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":390285.935645011,"t_first_token_unix":1779821150.9495885,"t_done":390288.093471283,"t_done_unix":1779821153.1074147},{"request_id":"1277428:6:1371101:593","session_id":"1277428","input_length":36583,"t_proxy_recv":390287.975351613,"t_decision_unix":1779821152.9892929,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9936855916682612,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":231,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":36352,"new_prefill":231,"score_linear":-36352.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":122597,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":4608,"new_prefill":31975,"score_linear":117989.0,"score_lmetric":31975},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":36583,"score_linear":128263.0,"score_lmetric":54091},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":17408,"new_prefill":19175,"score_linear":893.0,"score_lmetric":19175},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":36583,"score_linear":191344.0,"score_lmetric":329076},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":0,"new_prefill":36583,"score_linear":80246.0,"score_lmetric":36583},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":36583,"score_linear":117888.0,"score_lmetric":154471},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94032,"ongoing_decode_tokens":29501,"pending_prefill_tokens":5651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":36583,"score_linear":94032.0,"score_lmetric":84468}],"chosen_score_linear":-36352.0,"chosen_score_lmetric":0,"t_first_token":390288.108302609,"t_first_token_unix":1779821153.122246,"t_done":390288.434132596,"t_done_unix":1779821153.4480758},{"request_id":"1368070:2:1370108:586","session_id":"1368070","input_length":29501,"t_proxy_recv":390284.600704847,"t_decision_unix":1779821149.6146462,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":21504,"affinity_cache_ratio":0.7289244432392122,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":7997,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1416,"cache_hit":0,"new_prefill":29501,"score_linear":49483.0,"score_lmetric":29501},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":29501,"score_linear":122597.0,"score_lmetric":145442},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":110963,"ongoing_decode_tokens":68259,"pending_prefill_tokens":208,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":29501,"score_linear":110963.0,"score_lmetric":29709},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18160,"ongoing_decode_tokens":18160,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":29501,"score_linear":18160.0,"score_lmetric":29501},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":29501,"score_linear":191344.0,"score_lmetric":307830},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":29501,"score_linear":103553.0,"score_lmetric":105616},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":29501,"score_linear":117888.0,"score_lmetric":147389},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":21504,"new_prefill":7997,"score_linear":-21504.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":390286.097274435,"t_first_token_unix":1779821151.111218,"t_done":390288.588888452,"t_done_unix":1779821153.6028318},{"request_id":"1342634:2:1370263:590","session_id":"1342634","input_length":64531,"t_proxy_recv":390285.131291568,"t_decision_unix":1779821150.1452332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9124296849576172,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":5651,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1418,"cache_hit":0,"new_prefill":64531,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":64531,"score_linear":122597.0,"score_lmetric":180472},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":157509,"ongoing_decode_tokens":110963,"pending_prefill_tokens":11218,"num_requests":3,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":64531,"score_linear":157509.0,"score_lmetric":227247},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":0,"pending_prefill_tokens":14205,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":64531,"score_linear":18301.0,"score_lmetric":78736},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":64531,"score_linear":191344.0,"score_lmetric":412920},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":64531,"score_linear":103553.0,"score_lmetric":175676},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":64531,"score_linear":117888.0,"score_lmetric":182419},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":58880,"new_prefill":5651,"score_linear":-29379.0,"score_lmetric":13648}],"chosen_score_linear":-29379.0,"chosen_score_lmetric":13648,"t_first_token":390288.393865995,"t_first_token_unix":1779821153.4078093,"t_done":390289.27411053,"t_done_unix":1779821154.2880538},{"request_id":"1371337:1:1371337:597","session_id":"1371337","input_length":9399,"t_proxy_recv":390288.810141804,"t_decision_unix":1779821153.824083,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":9399,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":9399,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":9399,"score_linear":128263.0,"score_lmetric":26907},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":51115,"ongoing_decode_tokens":18301,"pending_prefill_tokens":6190,"num_requests":2,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":9399,"score_linear":51115.0,"score_lmetric":31178},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":9399,"score_linear":191344.0,"score_lmetric":247524},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":0,"new_prefill":9399,"score_linear":80246.0,"score_lmetric":9399},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":9399,"score_linear":117888.0,"score_lmetric":127287},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":64531,"ongoing_decode_tokens":64531,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":9399,"score_linear":64531.0,"score_lmetric":9399}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390289.51485948,"t_first_token_unix":1779821154.528804,"t_done":390290.042361831,"t_done_unix":1779821155.0563052},{"request_id":"1367329:2:1371226:595","session_id":"1367329","input_length":32814,"t_proxy_recv":390288.384733318,"t_decision_unix":1779821153.3986747,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8113610044493205,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":6190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36583,"ongoing_decode_tokens":36583,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":32814,"score_linear":36583.0,"score_lmetric":32814},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":32814,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":32814,"score_linear":128263.0,"score_lmetric":50322},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":26624,"new_prefill":6190,"score_linear":-8323.0,"score_lmetric":6190},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":32814,"score_linear":191344.0,"score_lmetric":317769},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":0,"new_prefill":32814,"score_linear":80246.0,"score_lmetric":32814},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":32814,"score_linear":117888.0,"score_lmetric":150702},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94032,"ongoing_decode_tokens":29501,"pending_prefill_tokens":5651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":32814,"score_linear":94032.0,"score_lmetric":76930}],"chosen_score_linear":-8323.0,"chosen_score_lmetric":6190,"t_first_token":390289.662972911,"t_first_token_unix":1779821154.676917,"t_done":390290.585286137,"t_done_unix":1779821155.5992298},{"request_id":"1370129:1:1370129:587","session_id":"1370129","input_length":18301,"t_proxy_recv":390284.670531266,"t_decision_unix":1779821149.6844728,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":14205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1416,"cache_hit":4096,"new_prefill":14205,"score_linear":45387.0,"score_lmetric":14205},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":18301,"score_linear":122597.0,"score_lmetric":134242},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":110963,"ongoing_decode_tokens":110963,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":18301,"score_linear":110963.0,"score_lmetric":18301},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":4096,"new_prefill":14205,"score_linear":-4096.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":7680,"new_prefill":10621,"score_linear":183664.0,"score_lmetric":251190},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":80246,"pending_prefill_tokens":23307,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":7680,"new_prefill":10621,"score_linear":95873.0,"score_lmetric":67856},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":7680,"new_prefill":10621,"score_linear":110208.0,"score_lmetric":128509},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":29501,"ongoing_decode_tokens":0,"pending_prefill_tokens":7997,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":7680,"new_prefill":10621,"score_linear":21821.0,"score_lmetric":18618}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":390286.221042253,"t_first_token_unix":1779821151.2349863,"t_done":390290.787947555,"t_done_unix":1779821155.801891},{"request_id":"1371622:1:1371622:598","session_id":"1371622","input_length":13616,"t_proxy_recv":390289.812958783,"t_decision_unix":1779821154.8269,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13616,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9399,"ongoing_decode_tokens":9399,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":13616,"score_linear":9399.0,"score_lmetric":13616},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":13616,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":13616,"score_linear":128263.0,"score_lmetric":31124},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":51115,"ongoing_decode_tokens":51115,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":13616,"score_linear":51115.0,"score_lmetric":27232},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":11264,"new_prefill":2352,"score_linear":180080.0,"score_lmetric":226383},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":0,"new_prefill":13616,"score_linear":80246.0,"score_lmetric":13616},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":13616,"score_linear":117888.0,"score_lmetric":131504},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":13616,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390290.973167282,"t_first_token_unix":1779821155.9871109,"t_done":390291.706616373,"t_done_unix":1779821156.7205617},{"request_id":"1363943:4:1372250:603","session_id":"1363943","input_length":18396,"t_proxy_recv":390292.157115887,"t_decision_unix":1779821157.1710575,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":17920,"affinity_cache_ratio":0.974124809741248,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":476,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":0,"pending_prefill_tokens":24509,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":8704,"new_prefill":9692,"score_linear":56253.0,"score_lmetric":68402},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":17407,"ongoing_decode_tokens":0,"pending_prefill_tokens":17407,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":18396,"score_linear":17407.0,"score_lmetric":35803},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":18396,"score_linear":128263.0,"score_lmetric":35904},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":17920,"new_prefill":476,"score_linear":-17920.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":4096,"new_prefill":14300,"score_linear":187248.0,"score_lmetric":262227},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115283,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11997,"num_requests":2,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":4096,"new_prefill":14300,"score_linear":111187.0,"score_lmetric":52594},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":4096,"new_prefill":14300,"score_linear":113792.0,"score_lmetric":132188},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1496,"cache_hit":4096,"new_prefill":14300,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":390292.198667784,"t_first_token_unix":1779821157.2126114,"t_done":390292.705160643,"t_done_unix":1779821157.7191038},{"request_id":"1366128:4:1371629:599","session_id":"1366128","input_length":35037,"t_proxy_recv":390289.844797477,"t_decision_unix":1779821154.8587387,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":23040,"affinity_cache_ratio":0.6575905471358849,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":11997,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":9399,"ongoing_decode_tokens":9399,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":35037,"score_linear":9399.0,"score_lmetric":35037},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":35037,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":35037,"score_linear":128263.0,"score_lmetric":52545},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":51115,"ongoing_decode_tokens":51115,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":35037,"score_linear":51115.0,"score_lmetric":70074},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":15360,"new_prefill":19677,"score_linear":175984.0,"score_lmetric":278358},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":23040,"new_prefill":11997,"score_linear":57206.0,"score_lmetric":11997},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":35037,"score_linear":117888.0,"score_lmetric":152925},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13616,"ongoing_decode_tokens":0,"pending_prefill_tokens":13616,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":35037,"score_linear":13616.0,"score_lmetric":48653}],"chosen_score_linear":57206.0,"chosen_score_lmetric":11997,"t_first_token":390292.356062059,"t_first_token_unix":1779821157.3700051,"t_done":390292.824570525,"t_done_unix":1779821157.8385136},{"request_id":"1371929:1:1371929:601","session_id":"1371929","input_length":17407,"t_proxy_recv":390290.920359157,"t_decision_unix":1779821155.9343007,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":17407,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26705,"ongoing_decode_tokens":0,"pending_prefill_tokens":22609,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":17407,"score_linear":26705.0,"score_lmetric":40016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":17407,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":17407,"score_linear":128263.0,"score_lmetric":34915},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":17407,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":17407,"score_linear":191344.0,"score_lmetric":271548},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115283,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11997,"num_requests":2,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":0,"new_prefill":17407,"score_linear":115283.0,"score_lmetric":58808},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":17407,"score_linear":117888.0,"score_lmetric":135295},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13616,"ongoing_decode_tokens":0,"pending_prefill_tokens":13616,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":0,"new_prefill":17407,"score_linear":13616.0,"score_lmetric":31023}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390292.612294427,"t_first_token_unix":1779821157.6262379,"t_done":390293.074576757,"t_done_unix":1779821158.08852},{"request_id":"1372791:1:1372791:604","session_id":"1372791","input_length":4811,"t_proxy_recv":390293.929553302,"t_decision_unix":1779821158.9434946,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4811,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":0,"pending_prefill_tokens":24509,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":4811,"score_linear":64957.0,"score_lmetric":58640},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":4811,"score_linear":128263.0,"score_lmetric":4811},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":4811,"score_linear":191344.0,"score_lmetric":233760},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":4811,"score_linear":80246.0,"score_lmetric":4811},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":4811,"score_linear":117888.0,"score_lmetric":122699},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1496,"cache_hit":0,"new_prefill":4811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390294.231896869,"t_first_token_unix":1779821159.2458405,"t_done":390294.408756627,"t_done_unix":1779821159.422701},{"request_id":"1362265:3:1373357:605","session_id":"1362265","input_length":10284,"t_proxy_recv":390295.927898563,"t_decision_unix":1779821160.94184,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":7,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9459354336833917,"affinity_num_requests":3,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":10284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":10284,"score_linear":64957.0,"score_lmetric":20568},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":10284,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":6656,"new_prefill":3628,"score_linear":121607.0,"score_lmetric":3628},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":10284,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":191344,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":9728,"new_prefill":556,"score_linear":181616.0,"score_lmetric":1668},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":10284,"score_linear":80246.0,"score_lmetric":10284},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":10284,"score_linear":117888.0,"score_lmetric":128172},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1496,"cache_hit":0,"new_prefill":10284,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390296.72328797,"t_first_token_unix":1779821161.737232,"t_done":390296.822095196,"t_done_unix":1779821161.836038},{"request_id":"1367957:1:1367957:572","session_id":"1367957","input_length":72919,"t_proxy_recv":390277.134903201,"t_decision_unix":1779821142.1488447,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":72919,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":72919,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":162753,"ongoing_decode_tokens":76969,"pending_prefill_tokens":3352,"num_requests":3,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":72919,"score_linear":162753.0,"score_lmetric":228813},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":72919,"score_linear":122597.0,"score_lmetric":188860},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171939,"ongoing_decode_tokens":171939,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":18944,"new_prefill":53975,"score_linear":152995.0,"score_lmetric":161925},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":45652,"ongoing_decode_tokens":18815,"pending_prefill_tokens":26837,"num_requests":2,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":72919,"score_linear":45652.0,"score_lmetric":199512},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":72919,"score_linear":98267.0,"score_lmetric":72919},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1054,"cache_hit":0,"new_prefill":72919,"score_linear":80246.0,"score_lmetric":72919},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":72919,"score_linear":117888.0,"score_lmetric":190807},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":55738,"ongoing_decode_tokens":55738,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":72919,"score_linear":55738.0,"score_lmetric":145838}],"chosen_score_linear":98267.0,"chosen_score_lmetric":72919,"t_first_token":390295.556590297,"t_first_token_unix":1779821160.570536,"t_done":390296.869459146,"t_done_unix":1779821161.8834028},{"request_id":"1355484:6:1369697:583","session_id":"1355484","input_length":20158,"t_proxy_recv":390283.197145564,"t_decision_unix":1779821148.2110865,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9905744617521579,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49483,"ongoing_decode_tokens":49483,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1416,"cache_hit":0,"new_prefill":20158,"score_linear":49483.0,"score_lmetric":20158},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":20158,"score_linear":122597.0,"score_lmetric":136099},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":136618,"ongoing_decode_tokens":136618,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":12800,"new_prefill":7358,"score_linear":123818.0,"score_lmetric":14716},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18160,"ongoing_decode_tokens":0,"pending_prefill_tokens":5360,"num_requests":1,"active_p_offloads":0,"cached_blocks":1637,"cache_hit":0,"new_prefill":20158,"score_linear":18160.0,"score_lmetric":25518},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":171186,"ongoing_decode_tokens":98267,"pending_prefill_tokens":72919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":19968,"new_prefill":190,"score_linear":151218.0,"score_lmetric":146218},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":20158,"score_linear":80246.0,"score_lmetric":20158},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":20158,"score_linear":117888.0,"score_lmetric":138046},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1429,"cache_hit":12800,"new_prefill":7358,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":151218.0,"chosen_score_lmetric":146218,"t_first_token":390295.557679105,"t_first_token_unix":1779821160.5716224,"t_done":390296.988978141,"t_done_unix":1779821162.002921},{"request_id":"1277428:7:1372183:602","session_id":"1277428","input_length":38252,"t_proxy_recv":390291.887774479,"t_decision_unix":1779821156.901716,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":36352,"affinity_cache_ratio":0.9503293945414619,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":36352,"estimated_new_tokens":1900,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26705,"ongoing_decode_tokens":0,"pending_prefill_tokens":22609,"num_requests":1,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":36352,"new_prefill":1900,"score_linear":-9647.0,"score_lmetric":24509},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":17407,"ongoing_decode_tokens":0,"pending_prefill_tokens":17407,"num_requests":1,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":4608,"new_prefill":33644,"score_linear":12799.0,"score_lmetric":51051},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":38252,"score_linear":128263.0,"score_lmetric":55760},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":17408,"new_prefill":20844,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":38252,"score_linear":191344.0,"score_lmetric":334083},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115283,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11997,"num_requests":2,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":0,"new_prefill":38252,"score_linear":115283.0,"score_lmetric":100498},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":38252,"score_linear":117888.0,"score_lmetric":156140},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1496,"cache_hit":0,"new_prefill":38252,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9647.0,"chosen_score_lmetric":24509,"t_first_token":390294.17464903,"t_first_token_unix":1779821159.1885922,"t_done":390298.943944876,"t_done_unix":1779821163.957888},{"request_id":"1355484:7:1371284:596","session_id":"1355484","input_length":22992,"t_proxy_recv":390297.000782991,"t_decision_unix":1779821162.014724,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.8684759916492694,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":3024,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":22992,"score_linear":64957.0,"score_lmetric":45984},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":22992,"score_linear":56286.0,"score_lmetric":79278},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":12800,"new_prefill":10192,"score_linear":115463.0,"score_lmetric":10192},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":22992,"score_linear":145016.0,"score_lmetric":299152},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":19968,"new_prefill":3024,"score_linear":78299.0,"score_lmetric":3024},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":22992,"score_linear":80246.0,"score_lmetric":22992},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":22992,"score_linear":117888.0,"score_lmetric":22992},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":76935,"num_requests":1,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":12800,"new_prefill":10192,"score_linear":66695.0,"score_lmetric":87127}],"chosen_score_linear":78299.0,"chosen_score_lmetric":3024,"t_first_token":390297.552174373,"t_first_token_unix":1779821162.5661185,"t_done":390301.033690966,"t_done_unix":1779821166.0476415},{"request_id":"1366128:5:1373829:610","session_id":"1366128","input_length":46764,"t_proxy_recv":390297.65112792,"t_decision_unix":1779821162.665069,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34816,"affinity_cache_ratio":0.7445043195620563,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":11948,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":46764,"score_linear":64957.0,"score_lmetric":93528},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":46764,"score_linear":56286.0,"score_lmetric":103050},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":46764,"score_linear":128263.0,"score_lmetric":46764},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":46764,"score_linear":145016.0,"score_lmetric":346696},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121259,"ongoing_decode_tokens":121259,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":15360,"new_prefill":31404,"score_linear":105899.0,"score_lmetric":62808},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":34816,"new_prefill":11948,"score_linear":45430.0,"score_lmetric":11948},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":46764,"score_linear":117888.0,"score_lmetric":46764},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":76935,"num_requests":1,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":46764,"score_linear":79495.0,"score_lmetric":123699}],"chosen_score_linear":45430.0,"chosen_score_lmetric":11948,"t_first_token":390300.949531818,"t_first_token_unix":1779821165.9634757,"t_done":390301.323480091,"t_done_unix":1779821166.337424},{"request_id":"1364090:2:1371798:600","session_id":"1364090","input_length":26705,"t_proxy_recv":390290.456373534,"t_decision_unix":1779821155.4703145,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":0,"affinity_cache_hit":14336,"affinity_cache_ratio":0.5368283093053735,"affinity_num_requests":3,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":4096,"estimated_new_tokens":22609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":4096,"new_prefill":22609,"score_linear":-4096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1161,"cache_hit":0,"new_prefill":26705,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":68259,"pending_prefill_tokens":17508,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":26705,"score_linear":128263.0,"score_lmetric":44213},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":51115,"ongoing_decode_tokens":51115,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":4096,"new_prefill":22609,"score_linear":47019.0,"score_lmetric":45218},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":14336,"new_prefill":12369,"score_linear":177008.0,"score_lmetric":256434},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":115283,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11997,"num_requests":2,"active_p_offloads":0,"cached_blocks":1116,"cache_hit":11264,"new_prefill":15441,"score_linear":104019.0,"score_lmetric":54876},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":11264,"new_prefill":15441,"score_linear":106624.0,"score_lmetric":133329},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":13616,"ongoing_decode_tokens":0,"pending_prefill_tokens":13616,"num_requests":1,"active_p_offloads":0,"cached_blocks":1470,"cache_hit":7680,"new_prefill":19025,"score_linear":5936.0,"score_lmetric":32641}],"chosen_score_linear":-4096.0,"chosen_score_lmetric":0,"t_first_token":390294.172237955,"t_first_token_unix":1779821159.1861813,"t_done":390301.784753089,"t_done_unix":1779821166.7986963},{"request_id":"1374347:1:1374347:611","session_id":"1374347","input_length":19862,"t_proxy_recv":390299.436046382,"t_decision_unix":1779821164.4499872,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":19862,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19862,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":19862,"score_linear":26705.0,"score_lmetric":19862},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":19862,"score_linear":56286.0,"score_lmetric":76148},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":19862,"score_linear":128263.0,"score_lmetric":19862},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":19862,"score_linear":145016.0,"score_lmetric":292892},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121259,"ongoing_decode_tokens":121259,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":0,"new_prefill":19862,"score_linear":121259.0,"score_lmetric":39724},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":127010,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11948,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":19862,"score_linear":127010.0,"score_lmetric":63620},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":19862,"score_linear":117888.0,"score_lmetric":19862},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":76935,"num_requests":1,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":19862,"score_linear":79495.0,"score_lmetric":96797}],"chosen_score_linear":128263.0,"chosen_score_lmetric":19862,"t_first_token":390301.500990061,"t_first_token_unix":1779821166.514934,"t_done":390302.461805691,"t_done_unix":1779821167.4757488},{"request_id":"1374465:1:1374465:613","session_id":"1374465","input_length":18497,"t_proxy_recv":390299.877677835,"t_decision_unix":1779821164.891619,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":18497,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":18497,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":18497,"score_linear":26705.0,"score_lmetric":18497},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":18497,"score_linear":56286.0,"score_lmetric":74783},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":148125,"ongoing_decode_tokens":128263,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":18497,"score_linear":148125.0,"score_lmetric":76718},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":18497,"score_linear":145016.0,"score_lmetric":290162},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121259,"ongoing_decode_tokens":121259,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":0,"new_prefill":18497,"score_linear":121259.0,"score_lmetric":36994},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":127010,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11948,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":18497,"score_linear":127010.0,"score_lmetric":60890},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":18497,"score_linear":117888.0,"score_lmetric":18497},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":18497,"score_linear":143031.0,"score_lmetric":191984}],"chosen_score_linear":117888.0,"chosen_score_lmetric":18497,"t_first_token":390302.917158658,"t_first_token_unix":1779821167.9311025,"t_done":390303.464667677,"t_done_unix":1779821168.4786108},{"request_id":"1313181:4:1368020:573","session_id":"1313181","input_length":60004,"t_proxy_recv":390286.704793692,"t_decision_unix":1779821151.7187347,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":42496,"affinity_cache_ratio":0.7082194520365309,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":17508,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1437,"cache_hit":0,"new_prefill":60004,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":122597,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":60004,"score_linear":122597.0,"score_lmetric":60004},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":42496,"new_prefill":17508,"score_linear":25763.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":18301,"ongoing_decode_tokens":18301,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":60004,"score_linear":18301.0,"score_lmetric":60004},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":98267,"pending_prefill_tokens":73109,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":12800,"new_prefill":47204,"score_linear":178544.0,"score_lmetric":360939},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":103553,"ongoing_decode_tokens":103553,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1071,"cache_hit":0,"new_prefill":60004,"score_linear":103553.0,"score_lmetric":120008},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":60004,"score_linear":117888.0,"score_lmetric":177892},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":94032,"ongoing_decode_tokens":29501,"pending_prefill_tokens":5651,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":12800,"new_prefill":47204,"score_linear":81232.0,"score_lmetric":105710}],"chosen_score_linear":25763.0,"chosen_score_lmetric":0,"t_first_token":390292.533535452,"t_first_token_unix":1779821157.5474787,"t_done":390305.282895506,"t_done_unix":1779821170.2968392},{"request_id":"1268861:7:1374579:614","session_id":"1268861","input_length":41508,"t_proxy_recv":390300.347937506,"t_decision_unix":1779821165.3618789,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":36864,"affinity_cache_ratio":0.8881179531656548,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":4644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":41508,"score_linear":26705.0,"score_lmetric":41508},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":41508,"score_linear":56286.0,"score_lmetric":97794},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":148125,"ongoing_decode_tokens":128263,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":41508,"score_linear":148125.0,"score_lmetric":122740},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":41508,"score_linear":145016.0,"score_lmetric":336184},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121259,"ongoing_decode_tokens":121259,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":0,"new_prefill":41508,"score_linear":121259.0,"score_lmetric":83016},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":127010,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11948,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":41508,"score_linear":127010.0,"score_lmetric":106912},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":136385,"ongoing_decode_tokens":117888,"pending_prefill_tokens":18497,"num_requests":2,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":36864,"new_prefill":4644,"score_linear":99521.0,"score_lmetric":46282},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":41508,"score_linear":143031.0,"score_lmetric":238006}],"chosen_score_linear":99521.0,"chosen_score_lmetric":46282,"t_first_token":390302.919322792,"t_first_token_unix":1779821167.9332664,"t_done":390305.865830801,"t_done_unix":1779821170.8797739},{"request_id":"1360649:1:1360649:527","session_id":"1360649","input_length":117888,"t_proxy_recv":390251.446140973,"t_decision_unix":1779821116.4600823,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":117888,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":0,"new_prefill":117888,"score_linear":132503.0,"score_lmetric":404526},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":117888,"score_linear":122597.0,"score_lmetric":233829},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":161569,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34942,"num_requests":2,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":117888,"score_linear":161569.0,"score_lmetric":305660},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1448,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101617,"ongoing_decode_tokens":101617,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":0,"new_prefill":117888,"score_linear":101617.0,"score_lmetric":235776},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":117888,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390296.170435965,"t_first_token_unix":1779821161.1843793,"t_done":390307.281455106,"t_done_unix":1779821172.2953987},{"request_id":"1374465:2:1376358:620","session_id":"1374465","input_length":21588,"t_proxy_recv":390306.278666866,"t_decision_unix":1779821171.2926085,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":18432,"affinity_cache_ratio":0.8538076709282935,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":3156,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":0,"new_prefill":21588,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":21588,"score_linear":56286.0,"score_lmetric":77874},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":21588,"score_linear":174161.0,"score_lmetric":67074},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":21588,"score_linear":145016.0,"score_lmetric":296344},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":98267,"pending_prefill_tokens":1225,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":0,"new_prefill":21588,"score_linear":172196.0,"score_lmetric":68439},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":138757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":21588,"score_linear":138757.0,"score_lmetric":43176},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":18432,"new_prefill":3156,"score_linear":99456.0,"score_lmetric":3156},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":21588,"score_linear":143031.0,"score_lmetric":198166}],"chosen_score_linear":99456.0,"chosen_score_lmetric":3156,"t_first_token":390306.874372552,"t_first_token_unix":1779821171.888316,"t_done":390307.966601041,"t_done_unix":1779821172.9805443},{"request_id":"1366128:6:1375094:616","session_id":"1366128","input_length":58511,"t_proxy_recv":390302.144572218,"t_decision_unix":1779821167.1585133,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":46592,"affinity_cache_ratio":0.7962947138144965,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":11919,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":0,"new_prefill":58511,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":58511,"score_linear":56286.0,"score_lmetric":114797},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":148125,"ongoing_decode_tokens":148125,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":58511,"score_linear":148125.0,"score_lmetric":117022},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":58511,"score_linear":145016.0,"score_lmetric":370190},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":15360,"new_prefill":43151,"score_linear":82907.0,"score_lmetric":43151},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":46592,"new_prefill":11919,"score_linear":33654.0,"score_lmetric":11919},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":177893,"ongoing_decode_tokens":117888,"pending_prefill_tokens":23141,"num_requests":3,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":58511,"score_linear":177893.0,"score_lmetric":244956},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":58511,"score_linear":143031.0,"score_lmetric":272012}],"chosen_score_linear":33654.0,"chosen_score_lmetric":11919,"t_first_token":390306.224283019,"t_first_token_unix":1779821171.2382267,"t_done":390308.978880366,"t_done_unix":1779821173.9928238},{"request_id":"1360649:2:1367022:561","session_id":"1360649","input_length":119052,"t_proxy_recv":390307.309337374,"t_decision_unix":1779821172.3232772,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":118272,"affinity_cache_ratio":0.9934482411047273,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":118272,"estimated_new_tokens":780,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24323,"ongoing_decode_tokens":0,"pending_prefill_tokens":15107,"num_requests":1,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":4096,"new_prefill":114956,"score_linear":20227.0,"score_lmetric":130063},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":119052,"score_linear":56286.0,"score_lmetric":175338},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":119052,"score_linear":174161.0,"score_lmetric":164538},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":119052,"score_linear":145016.0,"score_lmetric":491272},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":98267,"pending_prefill_tokens":1225,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":0,"new_prefill":119052,"score_linear":172196.0,"score_lmetric":360831},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":138757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":119052,"score_linear":138757.0,"score_lmetric":238104},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21588,"ongoing_decode_tokens":21588,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1375,"cache_hit":118272,"new_prefill":780,"score_linear":-96684.0,"score_lmetric":780},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":119052,"score_linear":143031.0,"score_lmetric":393094}],"chosen_score_linear":-96684.0,"chosen_score_lmetric":780,"t_first_token":390307.914834989,"t_first_token_unix":1779821172.9287786,"t_done":390309.231250356,"t_done_unix":1779821174.2451935},{"request_id":"1371337:2:1376534:621","session_id":"1371337","input_length":24323,"t_proxy_recv":390306.944511091,"t_decision_unix":1779821171.9584525,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":9216,"affinity_cache_ratio":0.3789006290342474,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":15107,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":9216,"new_prefill":15107,"score_linear":-9216.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":24323,"score_linear":56286.0,"score_lmetric":80609},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":24323,"score_linear":174161.0,"score_lmetric":69809},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":24323,"score_linear":145016.0,"score_lmetric":301814},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":98267,"pending_prefill_tokens":1225,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":0,"new_prefill":24323,"score_linear":172196.0,"score_lmetric":76644},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":138757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":24323,"score_linear":138757.0,"score_lmetric":48646},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":139476,"ongoing_decode_tokens":139476,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1144,"cache_hit":0,"new_prefill":24323,"score_linear":139476.0,"score_lmetric":48646},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":24323,"score_linear":143031.0,"score_lmetric":203636}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":390309.060179443,"t_first_token_unix":1779821174.074123,"t_done":390309.648064661,"t_done_unix":1779821174.6620078},{"request_id":"1377061:1:1377061:622","session_id":"1377061","input_length":16241,"t_proxy_recv":390308.906433673,"t_decision_unix":1779821173.920375,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":16241,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":24323,"ongoing_decode_tokens":0,"pending_prefill_tokens":15107,"num_requests":1,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":0,"new_prefill":16241,"score_linear":24323.0,"score_lmetric":31348},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":16241,"score_linear":56286.0,"score_lmetric":16241},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":16241,"score_linear":174161.0,"score_lmetric":61727},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":16241,"score_linear":145016.0,"score_lmetric":285650},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":134155,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":0,"new_prefill":16241,"score_linear":172196.0,"score_lmetric":52254},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":138757,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":16241,"score_linear":138757.0,"score_lmetric":32482},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":119052,"ongoing_decode_tokens":119052,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1381,"cache_hit":0,"new_prefill":16241,"score_linear":119052.0,"score_lmetric":16241},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":16241,"score_linear":143031.0,"score_lmetric":187472}],"chosen_score_linear":56286.0,"chosen_score_lmetric":16241,"t_first_token":390310.412151614,"t_first_token_unix":1779821175.426095,"t_done":390310.659762675,"t_done_unix":1779821175.6737058},{"request_id":"1355951:3:1375866:619","session_id":"1355951","input_length":38041,"t_proxy_recv":390304.822163154,"t_decision_unix":1779821169.8361044,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9690596987460898,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":1177,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":0,"new_prefill":38041,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":38041,"score_linear":56286.0,"score_lmetric":94327},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2097,"cache_hit":0,"new_prefill":38041,"score_linear":128263.0,"score_lmetric":38041},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":38041,"score_linear":145016.0,"score_lmetric":329250},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":98267,"pending_prefill_tokens":48,"num_requests":2,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":36864,"new_prefill":1177,"score_linear":97291.0,"score_lmetric":2450},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":38041,"score_linear":138757.0,"score_lmetric":99920},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":159396,"ongoing_decode_tokens":159396,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":38041,"score_linear":159396.0,"score_lmetric":76082},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":38041,"score_linear":143031.0,"score_lmetric":231072}],"chosen_score_linear":97291.0,"chosen_score_lmetric":2450,"t_first_token":390311.558720954,"t_first_token_unix":1779821176.5726647,"t_done":390312.405518513,"t_done_unix":1779821177.4194646},{"request_id":"1372791:2:1377698:624","session_id":"1372791","input_length":14851,"t_proxy_recv":390311.146371762,"t_decision_unix":1779821176.1603131,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":6,"affinity_cache_hit":4608,"affinity_cache_ratio":0.3102821358831055,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":14851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":14851,"score_linear":56286.0,"score_lmetric":14851},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":14851,"score_linear":174161.0,"score_lmetric":60337},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":4608,"new_prefill":10243,"score_linear":140408.0,"score_lmetric":273654},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":134155,"pending_prefill_tokens":1177,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":0,"new_prefill":14851,"score_linear":172196.0,"score_lmetric":48084},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1185,"cache_hit":0,"new_prefill":14851,"score_linear":80246.0,"score_lmetric":14851},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":0,"new_prefill":14851,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":14851,"score_linear":143031.0,"score_lmetric":184692}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390312.460629953,"t_first_token_unix":1779821177.4745746,"t_done":390312.653974954,"t_done_unix":1779821177.6679177},{"request_id":"1370129:2:1373467:607","session_id":"1370129","input_length":56286,"t_proxy_recv":390296.411386926,"t_decision_unix":1779821161.4253287,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":1,"affinity_cache_hit":18432,"affinity_cache_ratio":0.3274704189318836,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":56286,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":4096,"new_prefill":52190,"score_linear":60861.0,"score_lmetric":104380},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":56286,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":56286,"score_linear":128263.0,"score_lmetric":56286},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":126340,"num_requests":1,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":18432,"new_prefill":37854,"score_linear":107908.0,"score_lmetric":164194},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":191344,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":7680,"new_prefill":48606,"score_linear":183664.0,"score_lmetric":145818},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":7680,"new_prefill":48606,"score_linear":72566.0,"score_lmetric":48606},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":7680,"new_prefill":48606,"score_linear":110208.0,"score_lmetric":48606},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":10284,"ongoing_decode_tokens":0,"pending_prefill_tokens":10284,"num_requests":1,"active_p_offloads":0,"cached_blocks":1496,"cache_hit":7680,"new_prefill":48606,"score_linear":2604.0,"score_lmetric":58890}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390307.879510174,"t_first_token_unix":1779821172.8934538,"t_done":390313.899778473,"t_done_unix":1779821178.9137218},{"request_id":"1366128:7:1378071:626","session_id":"1366128","input_length":59007,"t_proxy_recv":390312.398420238,"t_decision_unix":1779821177.4123614,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9891707763485688,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":639,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23457,"ongoing_decode_tokens":0,"pending_prefill_tokens":23457,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":59007,"score_linear":23457.0,"score_lmetric":82464},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":59007,"score_linear":56286.0,"score_lmetric":59007},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":59007,"score_linear":174161.0,"score_lmetric":104493},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":59007,"score_linear":145016.0,"score_lmetric":371182},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":172196,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":15360,"new_prefill":43647,"score_linear":156836.0,"score_lmetric":130941},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1185,"cache_hit":58368,"new_prefill":639,"score_linear":21878.0,"score_lmetric":639},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14851,"ongoing_decode_tokens":0,"pending_prefill_tokens":14851,"num_requests":1,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":0,"new_prefill":59007,"score_linear":14851.0,"score_lmetric":73858},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":59007,"score_linear":143031.0,"score_lmetric":273004}],"chosen_score_linear":21878.0,"chosen_score_lmetric":639,"t_first_token":390312.674499558,"t_first_token_unix":1779821177.688444,"t_done":390313.933664582,"t_done_unix":1779821178.9476078},{"request_id":"1377061:2:1378590:631","session_id":"1377061","input_length":16515,"t_proxy_recv":390314.177179634,"t_decision_unix":1779821179.191121,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":15872,"affinity_cache_ratio":0.961065697850439,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":643,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23457,"ongoing_decode_tokens":0,"pending_prefill_tokens":23457,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":16515,"score_linear":23457.0,"score_lmetric":39972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5458,"ongoing_decode_tokens":0,"pending_prefill_tokens":5458,"num_requests":1,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":15872,"new_prefill":643,"score_linear":-10414.0,"score_lmetric":6101},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":16515,"score_linear":196293.0,"score_lmetric":137546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":16515,"score_linear":145016.0,"score_lmetric":286198},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":16515,"score_linear":134155.0,"score_lmetric":33030},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":16515,"score_linear":80246.0,"score_lmetric":16515},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1411,"cache_hit":0,"new_prefill":16515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":16515,"score_linear":143031.0,"score_lmetric":188020}],"chosen_score_linear":-10414.0,"chosen_score_lmetric":6101,"t_first_token":390314.443365489,"t_first_token_unix":1779821179.4573088,"t_done":390314.529072199,"t_done_unix":1779821179.5430152},{"request_id":"1378684:1:1378684:632","session_id":"1378684","input_length":7810,"t_proxy_recv":390314.514227338,"t_decision_unix":1779821179.528169,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7810,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23457,"ongoing_decode_tokens":0,"pending_prefill_tokens":23457,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":7810,"score_linear":23457.0,"score_lmetric":31267},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":21973,"ongoing_decode_tokens":21973,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":7810,"score_linear":21973.0,"score_lmetric":15620},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":7810,"score_linear":196293.0,"score_lmetric":120136},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":7810,"score_linear":145016.0,"score_lmetric":268788},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":7810,"score_linear":134155.0,"score_lmetric":15620},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":7810,"score_linear":80246.0,"score_lmetric":7810},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1411,"cache_hit":0,"new_prefill":7810,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":7810,"score_linear":143031.0,"score_lmetric":170610}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390315.055635385,"t_first_token_unix":1779821180.0695796,"t_done":390315.318859794,"t_done_unix":1779821180.3328032},{"request_id":"1378543:1:1378543:630","session_id":"1378543","input_length":5458,"t_proxy_recv":390314.022711644,"t_decision_unix":1779821179.036653,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23457,"ongoing_decode_tokens":0,"pending_prefill_tokens":23457,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":5458,"score_linear":23457.0,"score_lmetric":28915},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1336,"cache_hit":0,"new_prefill":5458,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":5458,"score_linear":196293.0,"score_lmetric":115432},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5458,"score_linear":145016.0,"score_lmetric":264084},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":5458,"score_linear":134155.0,"score_lmetric":10916},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":5458,"score_linear":80246.0,"score_lmetric":5458},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1411,"cache_hit":0,"new_prefill":5458,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":5458,"score_linear":143031.0,"score_lmetric":165906}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390314.377271248,"t_first_token_unix":1779821179.3912146,"t_done":390315.51522749,"t_done_unix":1779821180.5291708},{"request_id":"1269373:22:1358956:522","session_id":"1269373","input_length":80246,"t_proxy_recv":390245.332127849,"t_decision_unix":1779821110.3460693,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9761981905640157,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":1910,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":132503,"ongoing_decode_tokens":0,"pending_prefill_tokens":84375,"num_requests":2,"active_p_offloads":0,"cached_blocks":1097,"cache_hit":4096,"new_prefill":76150,"score_linear":128407.0,"score_lmetric":321050},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":80246,"score_linear":122597.0,"score_lmetric":196187},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127017,"ongoing_decode_tokens":68259,"pending_prefill_tokens":34694,"num_requests":1,"active_p_offloads":0,"cached_blocks":1942,"cache_hit":0,"new_prefill":80246,"score_linear":127017.0,"score_lmetric":114940},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":48193,"ongoing_decode_tokens":48193,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1440,"cache_hit":0,"new_prefill":80246,"score_linear":48193.0,"score_lmetric":80246},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1070,"cache_hit":0,"new_prefill":80246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1007,"cache_hit":78336,"new_prefill":1910,"score_linear":-56965.0,"score_lmetric":1910},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":14848,"new_prefill":65398,"score_linear":-14848.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":7680,"new_prefill":72566,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-56965.0,"chosen_score_lmetric":1910,"t_first_token":390246.33606709,"t_first_token_unix":1779821111.3500106,"t_done":390315.947813872,"t_done_unix":1779821180.9617574},{"request_id":"1355484:8:1377993:625","session_id":"1355484","input_length":23457,"t_proxy_recv":390312.127051636,"t_decision_unix":1779821177.140993,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":0,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9822227906381891,"affinity_num_requests":3,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":23457,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":23457,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":0,"new_prefill":23457,"score_linear":56286.0,"score_lmetric":23457},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":12800,"new_prefill":10657,"score_linear":161361.0,"score_lmetric":56143},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":23457,"score_linear":145016.0,"score_lmetric":300082},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":172196,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":23040,"new_prefill":417,"score_linear":149156.0,"score_lmetric":1251},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1185,"cache_hit":0,"new_prefill":23457,"score_linear":80246.0,"score_lmetric":23457},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":14851,"ongoing_decode_tokens":0,"pending_prefill_tokens":14851,"num_requests":1,"active_p_offloads":0,"cached_blocks":1382,"cache_hit":0,"new_prefill":23457,"score_linear":14851.0,"score_lmetric":38308},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":12800,"new_prefill":10657,"score_linear":130231.0,"score_lmetric":176304}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390314.750093246,"t_first_token_unix":1779821179.7640371,"t_done":390316.150069202,"t_done_unix":1779821181.1640124},{"request_id":"1379185:1:1379185:634","session_id":"1379185","input_length":1422,"t_proxy_recv":390316.231295892,"t_decision_unix":1779821181.2452374,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1422,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":1422,"score_linear":196293.0,"score_lmetric":107360},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":1422,"score_linear":145016.0,"score_lmetric":256012},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":1422,"score_linear":134155.0,"score_lmetric":2844},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":1422,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":1422,"score_linear":15283.0,"score_lmetric":16705},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":1422,"score_linear":143031.0,"score_lmetric":157834}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390316.328146813,"t_first_token_unix":1779821181.3420901,"t_done":390316.509335177,"t_done_unix":1779821181.523279},{"request_id":"1379569:1:1379569:638","session_id":"1379569","input_length":2632,"t_proxy_recv":390317.488583006,"t_decision_unix":1779821182.5025244,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2632,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1582,"cache_hit":0,"new_prefill":2632,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":0,"pending_prefill_tokens":4625,"num_requests":1,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":0,"new_prefill":2632,"score_linear":61457.0,"score_lmetric":7257},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":2632,"score_linear":196293.0,"score_lmetric":109780},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":2632,"score_linear":202672.0,"score_lmetric":391656},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":2632,"score_linear":134155.0,"score_lmetric":5264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":2632,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":2632,"score_linear":15283.0,"score_lmetric":2632},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":2632,"score_linear":143031.0,"score_lmetric":160254}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390317.653547467,"t_first_token_unix":1779821182.6674907,"t_done":390318.143887562,"t_done_unix":1779821183.1578307},{"request_id":"1355484:9:1379722:640","session_id":"1355484","input_length":23717,"t_proxy_recv":390317.975753961,"t_decision_unix":1779821182.9896955,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9930429649618417,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":165,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":2632,"ongoing_decode_tokens":2632,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1582,"cache_hit":23552,"new_prefill":165,"score_linear":-20920.0,"score_lmetric":165},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":0,"pending_prefill_tokens":4625,"num_requests":1,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":0,"new_prefill":23717,"score_linear":61457.0,"score_lmetric":28342},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":12800,"new_prefill":10917,"score_linear":183493.0,"score_lmetric":126350},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":23717,"score_linear":202672.0,"score_lmetric":454911},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":23040,"new_prefill":677,"score_linear":111115.0,"score_lmetric":1354},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":23717,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":23717,"score_linear":15283.0,"score_lmetric":23717},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":12800,"new_prefill":10917,"score_linear":130231.0,"score_lmetric":176824}],"chosen_score_linear":-20920.0,"chosen_score_lmetric":165,"t_first_token":390318.028397019,"t_first_token_unix":1779821183.0423408,"t_done":390318.842982517,"t_done_unix":1779821183.8569257},{"request_id":"1377061:3:1380174:641","session_id":"1377061","input_length":17368,"t_proxy_recv":390319.58248723,"t_decision_unix":1779821184.5964286,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":16384,"affinity_cache_ratio":0.943344081068632,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":984,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":17368,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":16384,"new_prefill":984,"score_linear":45073.0,"score_lmetric":984},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":17368,"score_linear":196293.0,"score_lmetric":139252},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":17368,"score_linear":202672.0,"score_lmetric":435864},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":17368,"score_linear":134155.0,"score_lmetric":34736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":17368,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":17368,"score_linear":15283.0,"score_lmetric":17368},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":143031,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":17368,"score_linear":143031.0,"score_lmetric":34736}],"chosen_score_linear":45073.0,"chosen_score_lmetric":984,"t_first_token":390319.779400308,"t_first_token_unix":1779821184.7933438,"t_done":390319.95842432,"t_done_unix":1779821184.9723675},{"request_id":"1378543:2:1380447:644","session_id":"1378543","input_length":5314,"t_proxy_recv":390320.499928042,"t_decision_unix":1779821185.5138695,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":5120,"affinity_cache_ratio":0.963492660895747,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":5314,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":5120,"new_prefill":194,"score_linear":56337.0,"score_lmetric":194},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":5314,"score_linear":196293.0,"score_lmetric":115144},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5314,"score_linear":202672.0,"score_lmetric":399702},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":5314,"score_linear":134155.0,"score_lmetric":10628},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59230,"ongoing_decode_tokens":0,"pending_prefill_tokens":350,"num_requests":1,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":5314,"score_linear":59230.0,"score_lmetric":5664},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":46190,"ongoing_decode_tokens":15283,"pending_prefill_tokens":9403,"num_requests":2,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":5314,"score_linear":46190.0,"score_lmetric":29434},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":143031,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":5314,"score_linear":143031.0,"score_lmetric":10628}],"chosen_score_linear":56337.0,"chosen_score_lmetric":194,"t_first_token":390320.528774413,"t_first_token_unix":1779821185.542718,"t_done":390320.535015301,"t_done_unix":1779821185.5489583},{"request_id":"1366128:8:1380438:643","session_id":"1366128","input_length":59230,"t_proxy_recv":390320.460686194,"t_decision_unix":1779821185.4746273,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9940908323484721,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":350,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":59230,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":59230,"score_linear":61457.0,"score_lmetric":59230},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":59230,"score_linear":196293.0,"score_lmetric":222976},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":59230,"score_linear":202672.0,"score_lmetric":561450},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":15360,"new_prefill":43870,"score_linear":118795.0,"score_lmetric":87740},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":58880,"new_prefill":350,"score_linear":-58880.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":46190,"ongoing_decode_tokens":15283,"pending_prefill_tokens":9403,"num_requests":2,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":59230,"score_linear":46190.0,"score_lmetric":137266},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":143031,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":59230,"score_linear":143031.0,"score_lmetric":118460}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":390320.624593721,"t_first_token_unix":1779821185.638537,"t_done":390321.246994464,"t_done_unix":1779821186.2609384},{"request_id":"1379569:2:1380473:645","session_id":"1379569","input_length":6767,"t_proxy_recv":390320.645689542,"t_decision_unix":1779821185.659631,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":2560,"affinity_cache_ratio":0.37830648736515443,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":4207,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":2560,"new_prefill":4207,"score_linear":-2560.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":6767,"score_linear":61457.0,"score_lmetric":6767},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":6767,"score_linear":196293.0,"score_lmetric":118050},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":6767,"score_linear":202672.0,"score_lmetric":404061},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":6767,"score_linear":134155.0,"score_lmetric":13534},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59230,"ongoing_decode_tokens":59230,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":6767,"score_linear":59230.0,"score_lmetric":6767},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":46190,"ongoing_decode_tokens":15283,"pending_prefill_tokens":9403,"num_requests":2,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":6767,"score_linear":46190.0,"score_lmetric":32340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":143031,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":6767,"score_linear":143031.0,"score_lmetric":13534}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":390320.96236147,"t_first_token_unix":1779821185.9763052,"t_done":390321.573527391,"t_done_unix":1779821186.5874717},{"request_id":"1374465:3:1380413:642","session_id":"1374465","input_length":30907,"t_proxy_recv":390320.376433411,"t_decision_unix":1779821185.3903747,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":21504,"affinity_cache_ratio":0.6957647134953246,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":9403,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1587,"cache_hit":0,"new_prefill":30907,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":30907,"score_linear":61457.0,"score_lmetric":30907},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":30907,"score_linear":196293.0,"score_lmetric":166330},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":30907,"score_linear":202672.0,"score_lmetric":476481},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":30907,"score_linear":134155.0,"score_lmetric":61814},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":30907,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":21504,"new_prefill":9403,"score_linear":-6221.0,"score_lmetric":9403},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":143031,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":30907,"score_linear":143031.0,"score_lmetric":61814}],"chosen_score_linear":-6221.0,"chosen_score_lmetric":9403,"t_first_token":390322.247878703,"t_first_token_unix":1779821187.261823,"t_done":390323.056221305,"t_done_unix":1779821188.0701644},{"request_id":"1373577:1:1373577:608","session_id":"1373577","input_length":79495,"t_proxy_recv":390296.831358751,"t_decision_unix":1779821161.8453002,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":76935,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":0,"new_prefill":79495,"score_linear":64957.0,"score_lmetric":158990},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":79495,"score_linear":56286.0,"score_lmetric":135781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":79495,"score_linear":128263.0,"score_lmetric":79495},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":126340,"num_requests":1,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":79495,"score_linear":126340.0,"score_lmetric":205835},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":191344,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":79495,"score_linear":191344.0,"score_lmetric":238485},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":79495,"score_linear":80246.0,"score_lmetric":79495},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":79495,"score_linear":117888.0,"score_lmetric":79495},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":2560,"new_prefill":76935,"score_linear":-2560.0,"score_lmetric":0}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":390318.194600316,"t_first_token_unix":1779821183.2085435,"t_done":390323.249784228,"t_done_unix":1779821188.2637277},{"request_id":"1370129:3:1379538:637","session_id":"1370129","input_length":61457,"t_proxy_recv":390317.353457943,"t_decision_unix":1779821182.3673995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9247441300421433,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":4625,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1582,"cache_hit":7680,"new_prefill":53777,"score_linear":-7680.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":56832,"new_prefill":4625,"score_linear":-56832.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":61457,"score_linear":196293.0,"score_lmetric":227430},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":18432,"new_prefill":43025,"score_linear":184240.0,"score_lmetric":512835},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":7680,"new_prefill":53777,"score_linear":126475.0,"score_lmetric":107554},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":7680,"new_prefill":53777,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":7680,"new_prefill":53777,"score_linear":7603.0,"score_lmetric":53777},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":7680,"new_prefill":53777,"score_linear":135351.0,"score_lmetric":262544}],"chosen_score_linear":-56832.0,"chosen_score_lmetric":0,"t_first_token":390319.170078098,"t_first_token_unix":1779821184.1840215,"t_done":390324.579024802,"t_done_unix":1779821189.5929687},{"request_id":"1379569:3:1381510:649","session_id":"1379569","input_length":7620,"t_proxy_recv":390324.277995576,"t_decision_unix":1779821189.2919369,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":6656,"affinity_cache_ratio":0.873490813648294,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":6656,"estimated_new_tokens":964,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":6656,"new_prefill":964,"score_linear":-6656.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":7620,"score_linear":61457.0,"score_lmetric":7620},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":7620,"score_linear":196293.0,"score_lmetric":119756},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":7620,"score_linear":202672.0,"score_lmetric":406620},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":7620,"score_linear":134155.0,"score_lmetric":15240},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":0,"pending_prefill_tokens":13989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":7620,"score_linear":13989.0,"score_lmetric":21609},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":7620,"score_linear":15283.0,"score_lmetric":7620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":7620,"score_linear":144683.0,"score_lmetric":15240}],"chosen_score_linear":-6656.0,"chosen_score_lmetric":0,"t_first_token":390324.384716282,"t_first_token_unix":1779821189.3986595,"t_done":390324.886136297,"t_done_unix":1779821189.9000793},{"request_id":"1381728:1:1381728:651","session_id":"1381728","input_length":1391,"t_proxy_recv":390325.1787494,"t_decision_unix":1779821190.1926906,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1391,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1597,"cache_hit":0,"new_prefill":1391,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":1391,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":1391,"score_linear":196293.0,"score_lmetric":107298},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":1391,"score_linear":202672.0,"score_lmetric":387933},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":1391,"score_linear":134155.0,"score_lmetric":2782},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":1391,"score_linear":13989.0,"score_lmetric":1391},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":1391,"score_linear":15283.0,"score_lmetric":1391},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":155328,"ongoing_decode_tokens":155328,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":1391,"score_linear":155328.0,"score_lmetric":4173}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390325.288112342,"t_first_token_unix":1779821190.3020575,"t_done":390325.443384174,"t_done_unix":1779821190.4573271},{"request_id":"1362265:4:1381673:650","session_id":"1362265","input_length":10645,"t_proxy_recv":390324.957675517,"t_decision_unix":1779821189.971617,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10240,"affinity_cache_ratio":0.9619539689995303,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":405,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1597,"cache_hit":0,"new_prefill":10645,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":10645,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":6656,"new_prefill":3989,"score_linear":189637.0,"score_lmetric":112494},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":10645,"score_linear":202672.0,"score_lmetric":415695},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":9728,"new_prefill":917,"score_linear":124427.0,"score_lmetric":1834},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":0,"pending_prefill_tokens":13989,"num_requests":1,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":10645,"score_linear":13989.0,"score_lmetric":24634},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":10645,"score_linear":15283.0,"score_lmetric":10645},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":10240,"new_prefill":405,"score_linear":134443.0,"score_lmetric":810}],"chosen_score_linear":134443.0,"chosen_score_lmetric":810,"t_first_token":390325.067761602,"t_first_token_unix":1779821190.0817053,"t_done":390325.773512881,"t_done_unix":1779821190.787456},{"request_id":"1366128:9:1381799:652","session_id":"1366128","input_length":59374,"t_proxy_recv":390325.436628924,"t_decision_unix":1779821190.4505699,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9916798598713241,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":494,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":1391,"ongoing_decode_tokens":1391,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1597,"cache_hit":0,"new_prefill":59374,"score_linear":1391.0,"score_lmetric":59374},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":59374,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":59374,"score_linear":196293.0,"score_lmetric":223264},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":59374,"score_linear":202672.0,"score_lmetric":561882},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":15360,"new_prefill":44014,"score_linear":118795.0,"score_lmetric":88028},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":58880,"new_prefill":494,"score_linear":-44891.0,"score_lmetric":494},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":59374,"score_linear":15283.0,"score_lmetric":59374},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":155328,"ongoing_decode_tokens":155328,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":59374,"score_linear":155328.0,"score_lmetric":178122}],"chosen_score_linear":-44891.0,"chosen_score_lmetric":494,"t_first_token":390325.584485393,"t_first_token_unix":1779821190.598429,"t_done":390326.022824143,"t_done_unix":1779821191.0367677},{"request_id":"1279412:25:1366203:554","session_id":"1279412","input_length":98267,"t_proxy_recv":390270.811130305,"t_decision_unix":1779821135.8250718,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9951662307794071,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":475,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":76969,"ongoing_decode_tokens":0,"pending_prefill_tokens":76969,"num_requests":1,"active_p_offloads":0,"cached_blocks":1261,"cache_hit":0,"new_prefill":98267,"score_linear":76969.0,"score_lmetric":175236},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":122597,"ongoing_decode_tokens":0,"pending_prefill_tokens":115941,"num_requests":1,"active_p_offloads":0,"cached_blocks":935,"cache_hit":0,"new_prefill":98267,"score_linear":122597.0,"score_lmetric":214208},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":127773,"ongoing_decode_tokens":68259,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":2029,"cache_hit":12800,"new_prefill":85467,"score_linear":114973.0,"score_lmetric":120917},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":98267,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":11154,"ongoing_decode_tokens":0,"pending_prefill_tokens":11154,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":97792,"new_prefill":475,"score_linear":-86638.0,"score_lmetric":11629},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1028,"cache_hit":0,"new_prefill":98267,"score_linear":80246.0,"score_lmetric":98267},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":0,"pending_prefill_tokens":117888,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":98267,"score_linear":117888.0,"score_lmetric":216155},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":105499,"ongoing_decode_tokens":0,"pending_prefill_tokens":64539,"num_requests":3,"active_p_offloads":0,"cached_blocks":1243,"cache_hit":12800,"new_prefill":85467,"score_linear":92699.0,"score_lmetric":450018}],"chosen_score_linear":-86638.0,"chosen_score_lmetric":11629,"t_first_token":390271.50267532,"t_first_token_unix":1779821136.5166183,"t_done":390326.091414751,"t_done_unix":1779821191.1053581},{"request_id":"1381387:1:1381387:648","session_id":"1381387","input_length":13989,"t_proxy_recv":390323.859913545,"t_decision_unix":1779821188.8738546,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":13989,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":13989,"score_linear":61457.0,"score_lmetric":13989},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":13989,"score_linear":196293.0,"score_lmetric":132494},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":13989,"score_linear":202672.0,"score_lmetric":425727},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":13989,"score_linear":134155.0,"score_lmetric":27978},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":13989,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":13989,"score_linear":15283.0,"score_lmetric":13989},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":63536,"pending_prefill_tokens":1275,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":13989,"score_linear":144683.0,"score_lmetric":30528}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390325.059749184,"t_first_token_unix":1779821190.073693,"t_done":390326.831128389,"t_done_unix":1779821191.8450732},{"request_id":"1382294:1:1382294:656","session_id":"1382294","input_length":3034,"t_proxy_recv":390327.182060486,"t_decision_unix":1779821192.196002,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3034,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":3034,"score_linear":47401.0,"score_lmetric":22787},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":3034,"score_linear":38111.0,"score_lmetric":41145},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":3034,"score_linear":196293.0,"score_lmetric":110584},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3034,"score_linear":202672.0,"score_lmetric":392862},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136228,"ongoing_decode_tokens":136228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":0,"new_prefill":3034,"score_linear":136228.0,"score_lmetric":6068},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1219,"cache_hit":0,"new_prefill":3034,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":3034,"score_linear":69295.0,"score_lmetric":114092},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":3034,"score_linear":144683.0,"score_lmetric":6068}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390327.366246459,"t_first_token_unix":1779821192.38019,"t_done":390327.520104542,"t_done_unix":1779821192.534048},{"request_id":"1279412:26:1378269:628","session_id":"1279412","input_length":100340,"t_proxy_recv":390326.109397154,"t_decision_unix":1779821191.1233387,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":99840,"affinity_cache_ratio":0.9950169423958541,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":99840,"estimated_new_tokens":500,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":12800,"new_prefill":87540,"score_linear":34601.0,"score_lmetric":107293},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":100340,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":12800,"new_prefill":87540,"score_linear":183493.0,"score_lmetric":279596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":100340,"score_linear":202672.0,"score_lmetric":684780},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":99840,"new_prefill":500,"score_linear":-63952.0,"score_lmetric":500},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":100340,"score_linear":13989.0,"score_lmetric":100340},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":100340,"score_linear":15283.0,"score_lmetric":100340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":12800,"new_prefill":87540,"score_linear":131883.0,"score_lmetric":175080}],"chosen_score_linear":-63952.0,"chosen_score_lmetric":500,"t_first_token":390326.3247771,"t_first_token_unix":1779821191.3387203,"t_done":390328.036906763,"t_done_unix":1779821193.0508504},{"request_id":"1373577:2:1380740:647","session_id":"1373577","input_length":81147,"t_proxy_recv":390323.26401064,"t_decision_unix":1779821188.277952,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9842877740397057,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":1275,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":81147,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":61457,"ongoing_decode_tokens":61457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1349,"cache_hit":0,"new_prefill":81147,"score_linear":61457.0,"score_lmetric":81147},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":81147,"score_linear":196293.0,"score_lmetric":266810},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":81147,"score_linear":202672.0,"score_lmetric":627201},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":81147,"score_linear":134155.0,"score_lmetric":162294},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":81147,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":81147,"score_linear":15283.0,"score_lmetric":81147},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":79872,"new_prefill":1275,"score_linear":-16336.0,"score_lmetric":1275}],"chosen_score_linear":-16336.0,"chosen_score_lmetric":1275,"t_first_token":390324.124139052,"t_first_token_unix":1779821189.1380825,"t_done":390328.998029276,"t_done_unix":1779821194.011973},{"request_id":"1382710:1:1382710:659","session_id":"1382710","input_length":3190,"t_proxy_recv":390328.696586455,"t_decision_unix":1779821193.7105277,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":5145,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":3190,"score_linear":47401.0,"score_lmetric":22943},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":3190,"score_linear":38111.0,"score_lmetric":41301},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":3190,"score_linear":196293.0,"score_lmetric":110896},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3190,"score_linear":202672.0,"score_lmetric":393330},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":3190,"score_linear":136426.0,"score_lmetric":6380},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":1955,"ongoing_decode_tokens":0,"pending_prefill_tokens":1955,"num_requests":1,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":3190,"score_linear":1955.0,"score_lmetric":5145},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":3190,"score_linear":69295.0,"score_lmetric":114404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":3190,"score_linear":144683.0,"score_lmetric":6380}],"chosen_score_linear":1955.0,"chosen_score_lmetric":5145,"t_first_token":390328.913814888,"t_first_token_unix":1779821193.927759,"t_done":390329.069125275,"t_done_unix":1779821194.0830681},{"request_id":"1382667:1:1382667:658","session_id":"1382667","input_length":1955,"t_proxy_recv":390328.598670135,"t_decision_unix":1779821193.6126113,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1955,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":1955,"score_linear":47401.0,"score_lmetric":21708},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":1955,"score_linear":38111.0,"score_lmetric":40066},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":1955,"score_linear":196293.0,"score_lmetric":108426},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":1955,"score_linear":202672.0,"score_lmetric":389625},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":1955,"score_linear":136426.0,"score_lmetric":3910},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":1955,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":1955,"score_linear":69295.0,"score_lmetric":111934},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":1955,"score_linear":144683.0,"score_lmetric":3910}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390328.724162224,"t_first_token_unix":1779821193.7381053,"t_done":390329.288844738,"t_done_unix":1779821194.3027892},{"request_id":"1382804:1:1382804:660","session_id":"1382804","input_length":627,"t_proxy_recv":390328.927143705,"t_decision_unix":1779821193.941085,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":1254,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":627,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":627,"score_linear":47401.0,"score_lmetric":20380},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":627,"score_linear":38111.0,"score_lmetric":38738},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":174161,"pending_prefill_tokens":6772,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":627,"score_linear":196293.0,"score_lmetric":14798},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":627,"score_linear":202672.0,"score_lmetric":385641},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":627,"score_linear":136426.0,"score_lmetric":1254},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5145,"ongoing_decode_tokens":5145,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":627,"score_linear":5145.0,"score_lmetric":1254},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":627,"score_linear":69295.0,"score_lmetric":109278},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":627,"score_linear":144683.0,"score_lmetric":1254}],"chosen_score_linear":144683.0,"chosen_score_lmetric":1254,"t_first_token":390329.112651352,"t_first_token_unix":1779821194.1265945,"t_done":390329.43285902,"t_done_unix":1779821194.4468026},{"request_id":"1366128:10:1382843:661","session_id":"1366128","input_length":59506,"t_proxy_recv":390329.05226729,"t_decision_unix":1779821194.0662088,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":59392,"affinity_cache_ratio":0.9980842268006588,"affinity_num_requests":2,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":114,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":59506,"score_linear":47401.0,"score_lmetric":79259},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":59506,"score_linear":38111.0,"score_lmetric":97617},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":174161,"pending_prefill_tokens":6772,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":59506,"score_linear":196293.0,"score_lmetric":132556},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":59506,"score_linear":202672.0,"score_lmetric":562278},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":15360,"new_prefill":44146,"score_linear":121066.0,"score_lmetric":88292},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5145,"ongoing_decode_tokens":5145,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":59392,"new_prefill":114,"score_linear":-54247.0,"score_lmetric":228},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":59506,"score_linear":69295.0,"score_lmetric":227036},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":64163,"ongoing_decode_tokens":63536,"pending_prefill_tokens":627,"num_requests":2,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":59506,"score_linear":64163.0,"score_lmetric":120266}],"chosen_score_linear":-54247.0,"chosen_score_lmetric":228,"t_first_token":390329.178283617,"t_first_token_unix":1779821194.1922278,"t_done":390329.690979154,"t_done_unix":1779821194.7049227},{"request_id":"1383009:1:1383009:663","session_id":"1383009","input_length":5135,"t_proxy_recv":390329.570150832,"t_decision_unix":1779821194.5840921,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":5135,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5135,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":5135,"score_linear":47401.0,"score_lmetric":24888},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":5135,"score_linear":38111.0,"score_lmetric":43246},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":174161,"pending_prefill_tokens":6772,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":5135,"score_linear":196293.0,"score_lmetric":23814},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5135,"score_linear":202672.0,"score_lmetric":399165},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":5135,"score_linear":136426.0,"score_lmetric":10270},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":59506,"ongoing_decode_tokens":59506,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":5135,"score_linear":59506.0,"score_lmetric":5135},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":5135,"score_linear":69295.0,"score_lmetric":118294},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":5135,"score_linear":63536.0,"score_lmetric":5135}],"chosen_score_linear":63536.0,"chosen_score_lmetric":5135,"t_first_token":390329.931211958,"t_first_token_unix":1779821194.9451554,"t_done":390330.412208216,"t_done_unix":1779821195.426152},{"request_id":"1279412:27:1380696:646","session_id":"1279412","input_length":100538,"t_proxy_recv":390328.055679996,"t_decision_unix":1779821193.0696213,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":100352,"affinity_cache_ratio":0.9981499532515069,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":100352,"estimated_new_tokens":186,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":12800,"new_prefill":87738,"score_linear":34601.0,"score_lmetric":107491},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":100538,"score_linear":38111.0,"score_lmetric":138649},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":12800,"new_prefill":87738,"score_linear":183493.0,"score_lmetric":279992},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":100538,"score_linear":202672.0,"score_lmetric":685374},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":100352,"new_prefill":186,"score_linear":-64464.0,"score_lmetric":186},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1224,"cache_hit":0,"new_prefill":100538,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":100538,"score_linear":69295.0,"score_lmetric":309100},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":12800,"new_prefill":87738,"score_linear":131883.0,"score_lmetric":175476}],"chosen_score_linear":-64464.0,"chosen_score_lmetric":186,"t_first_token":390328.27041956,"t_first_token_unix":1779821193.284364,"t_done":390330.794907835,"t_done_unix":1779821195.8088517},{"request_id":"1382294:2:1383073:664","session_id":"1382294","input_length":5164,"t_proxy_recv":390329.793576524,"t_decision_unix":1779821194.8075182,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":2560,"affinity_cache_ratio":0.4957397366382649,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":2560,"estimated_new_tokens":2604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":5164,"score_linear":47401.0,"score_lmetric":24917},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":5164,"score_linear":38111.0,"score_lmetric":43275},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":174161,"pending_prefill_tokens":6772,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":5164,"score_linear":196293.0,"score_lmetric":23872},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5164,"score_linear":202672.0,"score_lmetric":399252},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":5164,"score_linear":136426.0,"score_lmetric":10328},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":2560,"new_prefill":2604,"score_linear":-2560.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":5164,"score_linear":69295.0,"score_lmetric":118352},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68671,"ongoing_decode_tokens":63536,"pending_prefill_tokens":5135,"num_requests":2,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":5164,"score_linear":68671.0,"score_lmetric":20598}],"chosen_score_linear":-2560.0,"chosen_score_lmetric":0,"t_first_token":390329.971333058,"t_first_token_unix":1779821194.9852762,"t_done":390330.932033845,"t_done_unix":1779821195.9459767},{"request_id":"1383090:1:1383090:665","session_id":"1383090","input_length":9305,"t_proxy_recv":390329.84179581,"t_decision_unix":1779821194.8557367,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":11909,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":9305,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":9305,"score_linear":47401.0,"score_lmetric":29058},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":9305,"score_linear":38111.0,"score_lmetric":47416},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":174161,"pending_prefill_tokens":6772,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":9305,"score_linear":196293.0,"score_lmetric":32154},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":9305,"score_linear":202672.0,"score_lmetric":411675},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":9305,"score_linear":136426.0,"score_lmetric":18610},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":5164,"ongoing_decode_tokens":0,"pending_prefill_tokens":2604,"num_requests":1,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":9305,"score_linear":5164.0,"score_lmetric":11909},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":9305,"score_linear":69295.0,"score_lmetric":126634},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68671,"ongoing_decode_tokens":63536,"pending_prefill_tokens":5135,"num_requests":2,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":9305,"score_linear":68671.0,"score_lmetric":28880}],"chosen_score_linear":5164.0,"chosen_score_lmetric":11909,"t_first_token":390330.652585491,"t_first_token_unix":1779821195.66653,"t_done":390330.936427897,"t_done_unix":1779821195.9503708},{"request_id":"1379569:4:1383116:666","session_id":"1379569","input_length":10217,"t_proxy_recv":390329.92653589,"t_decision_unix":1779821194.9404774,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":7680,"affinity_cache_ratio":0.7516883625330332,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":2537,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":7680,"new_prefill":2537,"score_linear":39721.0,"score_lmetric":22290},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":10217,"score_linear":38111.0,"score_lmetric":48328},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":174161,"pending_prefill_tokens":6772,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":10217,"score_linear":196293.0,"score_lmetric":33978},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":10217,"score_linear":202672.0,"score_lmetric":414411},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136426,"ongoing_decode_tokens":136426,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":10217,"score_linear":136426.0,"score_lmetric":20434},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14469,"ongoing_decode_tokens":0,"pending_prefill_tokens":11909,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":10217,"score_linear":14469.0,"score_lmetric":44252},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":10217,"score_linear":69295.0,"score_lmetric":128458},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68671,"ongoing_decode_tokens":63536,"pending_prefill_tokens":5135,"num_requests":2,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":10217,"score_linear":68671.0,"score_lmetric":30704}],"chosen_score_linear":39721.0,"chosen_score_lmetric":22290,"t_first_token":390331.326845645,"t_first_token_unix":1779821196.3407893,"t_done":390331.815439921,"t_done_unix":1779821196.8293831},{"request_id":"1383625:1:1383625:668","session_id":"1383625","input_length":3186,"t_proxy_recv":390331.767809786,"t_decision_unix":1779821196.7817512,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3186,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":57618,"ongoing_decode_tokens":57618,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":3186,"score_linear":57618.0,"score_lmetric":6372},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":3186,"score_linear":38111.0,"score_lmetric":41297},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":3186,"score_linear":196293.0,"score_lmetric":6372},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3186,"score_linear":202672.0,"score_lmetric":393318},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136654,"ongoing_decode_tokens":136654,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":3186,"score_linear":136654.0,"score_lmetric":6372},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1256,"cache_hit":0,"new_prefill":3186,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":3186,"score_linear":69295.0,"score_lmetric":114396},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":3186,"score_linear":63536.0,"score_lmetric":3186}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390331.963283351,"t_first_token_unix":1779821196.9772267,"t_done":390332.100261673,"t_done_unix":1779821197.1142051},{"request_id":"1382089:1:1382089:655","session_id":"1382089","input_length":38111,"t_proxy_recv":390326.460064481,"t_decision_unix":1779821191.4740057,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":38111,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":38111,"score_linear":47401.0,"score_lmetric":57864},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":38111,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":38111,"score_linear":196293.0,"score_lmetric":180738},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":38111,"score_linear":202672.0,"score_lmetric":498093},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136228,"ongoing_decode_tokens":136228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":34816,"new_prefill":3295,"score_linear":101412.0,"score_lmetric":6590},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":38111,"score_linear":13989.0,"score_lmetric":38111},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":38111,"score_linear":15283.0,"score_lmetric":38111},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":38111,"score_linear":144683.0,"score_lmetric":76222}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390332.334713616,"t_first_token_unix":1779821197.3486576,"t_done":390332.477967953,"t_done_unix":1779821197.4919114},{"request_id":"1279412:28:1382526:657","session_id":"1279412","input_length":100766,"t_proxy_recv":390330.822769557,"t_decision_unix":1779821195.836711,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":100352,"affinity_cache_ratio":0.9958914713296152,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":100352,"estimated_new_tokens":414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":57618,"ongoing_decode_tokens":0,"pending_prefill_tokens":22290,"num_requests":2,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":12800,"new_prefill":87966,"score_linear":44818.0,"score_lmetric":220512},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":100766,"score_linear":38111.0,"score_lmetric":138877},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":12800,"new_prefill":87966,"score_linear":183493.0,"score_lmetric":175932},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":100766,"score_linear":202672.0,"score_lmetric":686058},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":100352,"new_prefill":414,"score_linear":-64464.0,"score_lmetric":414},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":14469,"ongoing_decode_tokens":14469,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1233,"cache_hit":0,"new_prefill":100766,"score_linear":14469.0,"score_lmetric":201532},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":100766,"score_linear":69295.0,"score_lmetric":309556},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":12800,"new_prefill":87966,"score_linear":50736.0,"score_lmetric":87966}],"chosen_score_linear":-64464.0,"chosen_score_lmetric":414,"t_first_token":390331.005436957,"t_first_token_unix":1779821196.0193806,"t_done":390333.641084007,"t_done_unix":1779821198.6550276},{"request_id":"1382667:2:1384299:674","session_id":"1382667","input_length":5989,"t_proxy_recv":390334.257589391,"t_decision_unix":1779821199.2715309,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":1,"affinity_cache_hit":1536,"affinity_cache_ratio":0.2564701953581566,"affinity_num_requests":4,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":5989,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":5989,"score_linear":47401.0,"score_lmetric":5989},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":0,"new_prefill":5989,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":5989,"score_linear":196293.0,"score_lmetric":11978},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5989,"score_linear":272137.0,"score_lmetric":549304},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":5989,"score_linear":35888.0,"score_lmetric":5989},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":0,"pending_prefill_tokens":27728,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":1536,"new_prefill":4453,"score_linear":123472.0,"score_lmetric":128724},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":5989,"score_linear":69295.0,"score_lmetric":120002},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":5989,"score_linear":63536.0,"score_lmetric":5989}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390334.647202613,"t_first_token_unix":1779821199.6611457,"t_done":390334.949440061,"t_done_unix":1779821199.9633832},{"request_id":"1286804:4:1378156:627","session_id":"1286804","input_length":22132,"t_proxy_recv":390312.65629981,"t_decision_unix":1779821177.6702416,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":15360,"affinity_cache_ratio":0.694017711910356,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":6772,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23457,"ongoing_decode_tokens":0,"pending_prefill_tokens":23457,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":1536,"new_prefill":20596,"score_linear":21921.0,"score_lmetric":44053},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":56286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1226,"cache_hit":1536,"new_prefill":20596,"score_linear":54750.0,"score_lmetric":20596},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":68259,"pending_prefill_tokens":45486,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":15360,"new_prefill":6772,"score_linear":158801.0,"score_lmetric":52258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":22132,"score_linear":145016.0,"score_lmetric":297432},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":22132,"score_linear":134155.0,"score_lmetric":44264},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":139253,"ongoing_decode_tokens":80246,"pending_prefill_tokens":639,"num_requests":2,"active_p_offloads":0,"cached_blocks":1185,"cache_hit":0,"new_prefill":22132,"score_linear":139253.0,"score_lmetric":45542},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1411,"cache_hit":0,"new_prefill":22132,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":22132,"score_linear":143031.0,"score_lmetric":199254}],"chosen_score_linear":158801.0,"chosen_score_lmetric":52258,"t_first_token":390330.80956595,"t_first_token_unix":1779821195.8235097,"t_done":390336.036575187,"t_done_unix":1779821201.0505183},{"request_id":"1301929:2:1375154:617","session_id":"1301929","input_length":35888,"t_proxy_recv":390302.329776661,"t_decision_unix":1779821167.3437178,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":35840,"affinity_cache_ratio":0.9986625055728935,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":48,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":3584,"new_prefill":32304,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":35888,"score_linear":56286.0,"score_lmetric":92174},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":148125,"ongoing_decode_tokens":148125,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":35888,"score_linear":148125.0,"score_lmetric":71776},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":35888,"score_linear":145016.0,"score_lmetric":324944},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":35840,"new_prefill":48,"score_linear":62427.0,"score_lmetric":48},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":35888,"score_linear":138757.0,"score_lmetric":95614},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":177893,"ongoing_decode_tokens":117888,"pending_prefill_tokens":23141,"num_requests":3,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":35888,"score_linear":177893.0,"score_lmetric":177087},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":35888,"score_linear":143031.0,"score_lmetric":226766}],"chosen_score_linear":62427.0,"chosen_score_lmetric":48,"t_first_token":390308.47612118,"t_first_token_unix":1779821173.490065,"t_done":390336.698281254,"t_done_unix":1779821201.7122245},{"request_id":"1340278:3:1384549:676","session_id":"1340278","input_length":49865,"t_proxy_recv":390335.019870646,"t_decision_unix":1779821200.0338123,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9959691166148601,"affinity_num_requests":2,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":201,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72627,"ongoing_decode_tokens":47401,"pending_prefill_tokens":1674,"num_requests":2,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":49664,"new_prefill":201,"score_linear":22963.0,"score_lmetric":3750},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":49865,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":49865,"score_linear":196293.0,"score_lmetric":99730},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":49865,"score_linear":272137.0,"score_lmetric":724808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":49865,"score_linear":35888.0,"score_lmetric":49865},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":49865,"score_linear":125008.0,"score_lmetric":252136},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":49865,"score_linear":69295.0,"score_lmetric":207754},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":49865,"score_linear":63536.0,"score_lmetric":49865}],"chosen_score_linear":22963.0,"chosen_score_lmetric":3750,"t_first_token":390335.236923457,"t_first_token_unix":1779821200.2508667,"t_done":390337.077925245,"t_done_unix":1779821202.0918715},{"request_id":"1383009:2:1384930:679","session_id":"1383009","input_length":11113,"t_proxy_recv":390336.22218136,"t_decision_unix":1779821201.2361228,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":5120,"affinity_cache_ratio":0.46072167731485647,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":5993,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":5993,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122492,"ongoing_decode_tokens":122492,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":11113,"score_linear":122492.0,"score_lmetric":33339},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":11113,"score_linear":89874.0,"score_lmetric":68690},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":174161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2113,"cache_hit":0,"new_prefill":11113,"score_linear":174161.0,"score_lmetric":11113},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":11113,"score_linear":272137.0,"score_lmetric":569800},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":11113,"score_linear":35888.0,"score_lmetric":11113},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":11113,"score_linear":125008.0,"score_lmetric":97128},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":11113,"score_linear":69295.0,"score_lmetric":130250},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":5120,"new_prefill":5993,"score_linear":58416.0,"score_lmetric":5993}],"chosen_score_linear":58416.0,"chosen_score_lmetric":5993,"t_first_token":390336.80213763,"t_first_token_unix":1779821201.8160806,"t_done":390337.105502677,"t_done_unix":1779821202.1194458},{"request_id":"1355484:10:1384484:675","session_id":"1355484","input_length":25226,"t_proxy_recv":390334.854980819,"t_decision_unix":1779821199.8689218,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":23552,"affinity_cache_ratio":0.9336398953460715,"affinity_num_requests":1,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23552,"estimated_new_tokens":1674,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":23552,"new_prefill":1674,"score_linear":23849.0,"score_lmetric":1674},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5989,"ongoing_decode_tokens":5989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":0,"new_prefill":25226,"score_linear":5989.0,"score_lmetric":25226},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":12800,"new_prefill":12426,"score_linear":183493.0,"score_lmetric":24852},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":25226,"score_linear":272137.0,"score_lmetric":626252},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":23040,"new_prefill":2186,"score_linear":12848.0,"score_lmetric":2186},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":25226,"score_linear":125008.0,"score_lmetric":153580},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":25226,"score_linear":69295.0,"score_lmetric":158476},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":12800,"new_prefill":12426,"score_linear":50736.0,"score_lmetric":12426}],"chosen_score_linear":23849.0,"chosen_score_lmetric":1674,"t_first_token":390335.18679063,"t_first_token_unix":1779821200.200734,"t_done":390337.945922882,"t_done_unix":1779821202.959866},{"request_id":"1340278:3:1385417:683","session_id":"1340278","input_length":50272,"t_proxy_recv":390338.016510647,"t_decision_unix":1779821203.030452,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9879057924888606,"affinity_num_requests":1,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":608,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1607,"cache_hit":49664,"new_prefill":608,"score_linear":-2263.0,"score_lmetric":608},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":50272,"score_linear":89874.0,"score_lmetric":147008},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":193195,"ongoing_decode_tokens":174161,"pending_prefill_tokens":19034,"num_requests":2,"active_p_offloads":0,"cached_blocks":2113,"cache_hit":0,"new_prefill":50272,"score_linear":193195.0,"score_lmetric":138612},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":50272,"score_linear":272137.0,"score_lmetric":726436},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":50272,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":141742,"ongoing_decode_tokens":28383,"pending_prefill_tokens":20687,"num_requests":5,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":50272,"score_linear":141742.0,"score_lmetric":354795},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":69295,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":50272,"score_linear":69295.0,"score_lmetric":100544},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":50272,"score_linear":63536.0,"score_lmetric":50272}],"chosen_score_linear":-2263.0,"chosen_score_lmetric":608,"t_first_token":390338.194149711,"t_first_token_unix":1779821203.208093,"t_done":390338.208032291,"t_done_unix":1779821203.2219753},{"request_id":"1382086:1:1382086:654","session_id":"1382086","input_length":54012,"t_proxy_recv":390326.46717575,"t_decision_unix":1779821191.4811175,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":54012,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":54012,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":0,"pending_prefill_tokens":19753,"num_requests":1,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":0,"new_prefill":54012,"score_linear":47401.0,"score_lmetric":73765},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":54012,"score_linear":38111.0,"score_lmetric":92123},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":54012,"score_linear":196293.0,"score_lmetric":212540},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":54012,"score_linear":202672.0,"score_lmetric":545796},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136228,"ongoing_decode_tokens":136228,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1329,"cache_hit":0,"new_prefill":54012,"score_linear":136228.0,"score_lmetric":108024},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":13989,"ongoing_decode_tokens":13989,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1192,"cache_hit":0,"new_prefill":54012,"score_linear":13989.0,"score_lmetric":54012},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":54012,"score_linear":15283.0,"score_lmetric":54012},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":0,"new_prefill":54012,"score_linear":144683.0,"score_lmetric":108024}],"chosen_score_linear":15283.0,"chosen_score_lmetric":54012,"t_first_token":390337.172546033,"t_first_token_unix":1779821202.1864893,"t_done":390338.605267028,"t_done_unix":1779821203.6192102},{"request_id":"1313181:5:1320817:349","session_id":"1313181","input_length":105902,"t_proxy_recv":390305.325480629,"t_decision_unix":1779821170.3394217,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":60416,"affinity_cache_ratio":0.5704896980227002,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":45486,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1505,"cache_hit":0,"new_prefill":105902,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":105902,"score_linear":56286.0,"score_lmetric":162188},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":60416,"new_prefill":45486,"score_linear":7843.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":105902,"score_linear":145016.0,"score_lmetric":464972},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":172196,"ongoing_decode_tokens":98267,"pending_prefill_tokens":1225,"num_requests":3,"active_p_offloads":0,"cached_blocks":1325,"cache_hit":12800,"new_prefill":93102,"score_linear":159396.0,"score_lmetric":282981},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":138757,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11919,"num_requests":2,"active_p_offloads":0,"cached_blocks":1162,"cache_hit":0,"new_prefill":105902,"score_linear":138757.0,"score_lmetric":235642},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":159396,"ongoing_decode_tokens":159396,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1135,"cache_hit":0,"new_prefill":105902,"score_linear":159396.0,"score_lmetric":211804},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":12800,"new_prefill":93102,"score_linear":130231.0,"score_lmetric":341194}],"chosen_score_linear":7843.0,"chosen_score_lmetric":0,"t_first_token":390328.720471307,"t_first_token_unix":1779821193.7344148,"t_done":390338.988659276,"t_done_unix":1779821204.0026033},{"request_id":"1384947:1:1384947:680","session_id":"1384947","input_length":19034,"t_proxy_recv":390336.281132394,"t_decision_unix":1779821201.295074,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":2,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.375,"fallback_score":19034,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":19034,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122492,"ongoing_decode_tokens":122492,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":19034,"score_linear":122492.0,"score_lmetric":57102},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":19034,"score_linear":89874.0,"score_lmetric":84532},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174161,"ongoing_decode_tokens":174161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2113,"cache_hit":0,"new_prefill":19034,"score_linear":174161.0,"score_lmetric":19034},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":19034,"score_linear":272137.0,"score_lmetric":601484},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":19034,"score_linear":35888.0,"score_lmetric":19034},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":19034,"score_linear":125008.0,"score_lmetric":128812},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":19034,"score_linear":69295.0,"score_lmetric":146092},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":74649,"ongoing_decode_tokens":63536,"pending_prefill_tokens":5993,"num_requests":2,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":19034,"score_linear":74649.0,"score_lmetric":50054}],"chosen_score_linear":174161.0,"chosen_score_lmetric":19034,"t_first_token":390338.249938449,"t_first_token_unix":1779821203.2638817,"t_done":390339.008390289,"t_done_unix":1779821204.0223334},{"request_id":"1364090:3:1381959:653","session_id":"1364090","input_length":47401,"t_proxy_recv":390325.963142216,"t_decision_unix":1779821190.9770834,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":27648,"affinity_cache_ratio":0.5832788337798781,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":19753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1599,"cache_hit":27648,"new_prefill":19753,"score_linear":-27648.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":7680,"new_prefill":39721,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":47401,"score_linear":196293.0,"score_lmetric":199318},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":7680,"new_prefill":39721,"score_linear":194992.0,"score_lmetric":502923},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":14336,"new_prefill":33065,"score_linear":119819.0,"score_lmetric":66130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":73363,"ongoing_decode_tokens":73363,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":11264,"new_prefill":36137,"score_linear":62099.0,"score_lmetric":72274},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":11264,"new_prefill":36137,"score_linear":4019.0,"score_lmetric":36137},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":144683,"ongoing_decode_tokens":144683,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":7680,"new_prefill":39721,"score_linear":137003.0,"score_lmetric":79442}],"chosen_score_linear":-27648.0,"chosen_score_lmetric":0,"t_first_token":390331.082757942,"t_first_token_unix":1779821196.0967011,"t_done":390339.07343985,"t_done_unix":1779821204.0873835},{"request_id":"1363093:3:1374394:612","session_id":"1363093","input_length":63536,"t_proxy_recv":390299.59148215,"t_decision_unix":1779821164.6054235,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9911860992193402,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":560,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26705,"ongoing_decode_tokens":26705,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":63536,"score_linear":26705.0,"score_lmetric":63536},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":63536,"score_linear":56286.0,"score_lmetric":119822},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":148125,"ongoing_decode_tokens":128263,"pending_prefill_tokens":19862,"num_requests":2,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":63536,"score_linear":148125.0,"score_lmetric":166796},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":63536,"score_linear":145016.0,"score_lmetric":380240},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":121259,"ongoing_decode_tokens":121259,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":0,"new_prefill":63536,"score_linear":121259.0,"score_lmetric":127072},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":127010,"ongoing_decode_tokens":80246,"pending_prefill_tokens":11948,"num_requests":2,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":63536,"score_linear":127010.0,"score_lmetric":150968},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":63536,"score_linear":117888.0,"score_lmetric":63536},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":76935,"num_requests":1,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":62976,"new_prefill":560,"score_linear":16519.0,"score_lmetric":77495}],"chosen_score_linear":16519.0,"chosen_score_lmetric":77495,"t_first_token":390318.201616961,"t_first_token_unix":1779821183.2155602,"t_done":390339.734204102,"t_done_unix":1779821204.7481477},{"request_id":"1279412:29:1385688:685","session_id":"1279412","input_length":101200,"t_proxy_recv":390339.060251533,"t_decision_unix":1779821204.074193,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":100864,"affinity_cache_ratio":0.9966798418972332,"affinity_num_requests":0,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":100864,"estimated_new_tokens":336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":12800,"new_prefill":88400,"score_linear":34601.0,"score_lmetric":88400},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":101200,"score_linear":89874.0,"score_lmetric":248864},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":68259,"pending_prefill_tokens":442,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":12800,"new_prefill":88400,"score_linear":116317.0,"score_lmetric":88842},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":101200,"score_linear":272137.0,"score_lmetric":930148},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":100864,"new_prefill":336,"score_linear":-100864.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":141742,"ongoing_decode_tokens":28383,"pending_prefill_tokens":20687,"num_requests":5,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":101200,"score_linear":141742.0,"score_lmetric":609435},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":101200,"score_linear":15283.0,"score_lmetric":101200},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":12800,"new_prefill":88400,"score_linear":50736.0,"score_lmetric":88400}],"chosen_score_linear":-100864.0,"chosen_score_lmetric":0,"t_first_token":390339.374448089,"t_first_token_unix":1779821204.3883917,"t_done":390340.072813792,"t_done_unix":1779821205.0867572},{"request_id":"1383625:2:1384279:673","session_id":"1383625","input_length":4150,"t_proxy_recv":390334.186182466,"t_decision_unix":1779821199.2001224,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":3072,"affinity_cache_ratio":0.7402409638554217,"affinity_num_requests":3,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":1078,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":4150,"score_linear":47401.0,"score_lmetric":4150},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":0,"new_prefill":4150,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":4150,"score_linear":196293.0,"score_lmetric":8300},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4150,"score_linear":272137.0,"score_lmetric":541948},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":4150,"score_linear":35888.0,"score_lmetric":4150},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120858,"ongoing_decode_tokens":0,"pending_prefill_tokens":26650,"num_requests":3,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":3072,"new_prefill":1078,"score_linear":117786.0,"score_lmetric":83184},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":4150,"score_linear":69295.0,"score_lmetric":116324},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":4150,"score_linear":63536.0,"score_lmetric":4150}],"chosen_score_linear":117786.0,"chosen_score_lmetric":83184,"t_first_token":390342.305701925,"t_first_token_unix":1779821207.3196452,"t_done":390342.80416813,"t_done_unix":1779821207.8181117},{"request_id":"1383090:2:1385262:682","session_id":"1383090","input_length":16734,"t_proxy_recv":390337.47048893,"t_decision_unix":1779821202.4844303,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":9216,"affinity_cache_ratio":0.5507350304768734,"affinity_num_requests":4,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":7518,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":72627,"ongoing_decode_tokens":72627,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":16734,"score_linear":72627.0,"score_lmetric":33468},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":16734,"score_linear":89874.0,"score_lmetric":79932},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":193195,"ongoing_decode_tokens":174161,"pending_prefill_tokens":19034,"num_requests":2,"active_p_offloads":0,"cached_blocks":2113,"cache_hit":0,"new_prefill":16734,"score_linear":193195.0,"score_lmetric":71536},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":16734,"score_linear":272137.0,"score_lmetric":592284},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":16734,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":9216,"new_prefill":7518,"score_linear":115792.0,"score_lmetric":82748},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":69295,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":16734,"score_linear":69295.0,"score_lmetric":33468},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":16734,"score_linear":63536.0,"score_lmetric":16734}],"chosen_score_linear":115792.0,"chosen_score_lmetric":82748,"t_first_token":390342.380657083,"t_first_token_unix":1779821207.3946004,"t_done":390343.158081453,"t_done_unix":1779821208.1720247},{"request_id":"1381728:2:1387040:690","session_id":"1381728","input_length":12399,"t_proxy_recv":390343.504629189,"t_decision_unix":1779821208.5185702,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":1024,"affinity_cache_ratio":0.08258730542785708,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":1024,"estimated_new_tokens":11375,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1648,"cache_hit":1024,"new_prefill":11375,"score_linear":-1024.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":12399,"score_linear":89874.0,"score_lmetric":71262},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":0,"new_prefill":12399,"score_linear":129117.0,"score_lmetric":12399},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":12399,"score_linear":272137.0,"score_lmetric":574944},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":12399,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120858,"ongoing_decode_tokens":120858,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1278,"cache_hit":0,"new_prefill":12399,"score_linear":120858.0,"score_lmetric":37197},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":12399,"score_linear":15283.0,"score_lmetric":12399},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":12399,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1024.0,"chosen_score_lmetric":0,"t_first_token":390344.456456654,"t_first_token_unix":1779821209.4704006,"t_done":390344.541443367,"t_done_unix":1779821209.5553865},{"request_id":"1366128:11:1384044:671","session_id":"1366128","input_length":71254,"t_proxy_recv":390333.259130428,"t_decision_unix":1779821198.2730718,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":59392,"affinity_cache_ratio":0.8335251354309934,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":11862,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":71254,"score_linear":47401.0,"score_lmetric":71254},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":0,"new_prefill":71254,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":71254,"score_linear":196293.0,"score_lmetric":142508},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":71254,"score_linear":272137.0,"score_lmetric":810364},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136654,"ongoing_decode_tokens":136654,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":15360,"new_prefill":55894,"score_linear":121294.0,"score_lmetric":111788},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":0,"pending_prefill_tokens":14559,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":59392,"new_prefill":11862,"score_linear":-31009.0,"score_lmetric":26421},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":71254,"score_linear":69295.0,"score_lmetric":250532},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":71254,"score_linear":63536.0,"score_lmetric":71254}],"chosen_score_linear":-31009.0,"chosen_score_lmetric":26421,"t_first_token":390339.515170551,"t_first_token_unix":1779821204.5291135,"t_done":390345.191513496,"t_done_unix":1779821210.2054572},{"request_id":"1279412:30:1387344:694","session_id":"1279412","input_length":101396,"t_proxy_recv":390344.637662733,"t_decision_unix":1779821209.651604,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":100864,"affinity_cache_ratio":0.9947532447039331,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":100864,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":12800,"new_prefill":88596,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":101396,"score_linear":89874.0,"score_lmetric":249256},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":12800,"new_prefill":88596,"score_linear":116317.0,"score_lmetric":88596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":101396,"score_linear":272137.0,"score_lmetric":930932},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":100864,"new_prefill":532,"score_linear":-100864.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":120858,"ongoing_decode_tokens":120858,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1278,"cache_hit":0,"new_prefill":101396,"score_linear":120858.0,"score_lmetric":304188},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":101396,"score_linear":15283.0,"score_lmetric":101396},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":12800,"new_prefill":88596,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-100864.0,"chosen_score_lmetric":0,"t_first_token":390344.861205748,"t_first_token_unix":1779821209.8751495,"t_done":390345.657272862,"t_done_unix":1779821210.671217},{"request_id":"1340290:3:1384149:672","session_id":"1340290","input_length":21221,"t_proxy_recv":390333.708551809,"t_decision_unix":1779821198.7224934,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":20992,"affinity_cache_ratio":0.9892088026011969,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":229,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":21221,"score_linear":47401.0,"score_lmetric":21221},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":0,"new_prefill":21221,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":21221,"score_linear":196293.0,"score_lmetric":42442},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":21221,"score_linear":272137.0,"score_lmetric":610232},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":21221,"score_linear":35888.0,"score_lmetric":21221},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99637,"ongoing_decode_tokens":0,"pending_prefill_tokens":26421,"num_requests":2,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":20992,"new_prefill":229,"score_linear":78645.0,"score_lmetric":53300},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":1024,"new_prefill":20197,"score_linear":68271.0,"score_lmetric":148418},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":21221,"score_linear":63536.0,"score_lmetric":21221}],"chosen_score_linear":78645.0,"chosen_score_lmetric":53300,"t_first_token":390342.304793154,"t_first_token_unix":1779821207.3187368,"t_done":390345.850900247,"t_done_unix":1779821210.8648438},{"request_id":"1384772:1:1384772:677","session_id":"1384772","input_length":4690,"t_proxy_recv":390335.713812954,"t_decision_unix":1779821200.7277544,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4690,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122492,"ongoing_decode_tokens":122492,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":4690,"score_linear":122492.0,"score_lmetric":14070},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":4690,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":4690,"score_linear":196293.0,"score_lmetric":9380},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4690,"score_linear":272137.0,"score_lmetric":544108},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":0,"new_prefill":4690,"score_linear":35888.0,"score_lmetric":4690},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":4690,"score_linear":125008.0,"score_lmetric":71436},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":4690,"score_linear":69295.0,"score_lmetric":117404},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":4690,"score_linear":63536.0,"score_lmetric":4690}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390336.014859101,"t_first_token_unix":1779821201.0288022,"t_done":390346.845907787,"t_done_unix":1779821211.859852},{"request_id":"1366128:12:1386045:687","session_id":"1366128","input_length":71578,"t_proxy_recv":390345.204914606,"t_decision_unix":1779821210.2188559,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9942719830115399,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":410,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":71578,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":71578,"score_linear":89874.0,"score_lmetric":189620},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":0,"new_prefill":71578,"score_linear":129117.0,"score_lmetric":71578},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":71578,"score_linear":272137.0,"score_lmetric":811660},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101396,"ongoing_decode_tokens":101396,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":15360,"new_prefill":56218,"score_linear":86036.0,"score_lmetric":56218},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49604,"ongoing_decode_tokens":49604,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":71168,"new_prefill":410,"score_linear":-21564.0,"score_lmetric":820},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":71578,"score_linear":15283.0,"score_lmetric":71578},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":71578,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21564.0,"chosen_score_lmetric":820,"t_first_token":390345.43981578,"t_first_token_unix":1779821210.4537592,"t_done":390347.12756764,"t_done_unix":1779821212.141511},{"request_id":"1340290:4:1385568:684","session_id":"1340290","input_length":26146,"t_proxy_recv":390345.859683257,"t_decision_unix":1779821210.8736248,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":20992,"affinity_cache_ratio":0.8028761569647365,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":20992,"estimated_new_tokens":5154,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":26146,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":26146,"score_linear":89874.0,"score_lmetric":98756},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":0,"new_prefill":26146,"score_linear":129117.0,"score_lmetric":26146},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":26146,"score_linear":272137.0,"score_lmetric":629932},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":26146,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":99961,"ongoing_decode_tokens":99961,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":20992,"new_prefill":5154,"score_linear":78969.0,"score_lmetric":10308},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":1024,"new_prefill":25122,"score_linear":14259.0,"score_lmetric":25122},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":26146,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":78969.0,"chosen_score_lmetric":10308,"t_first_token":390346.76125237,"t_first_token_unix":1779821211.7751956,"t_done":390347.494367712,"t_done_unix":1779821212.5083108},{"request_id":"1313181:5:1374956:615","session_id":"1313181","input_length":60858,"t_proxy_recv":390339.001412388,"t_decision_unix":1779821204.015354,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":60416,"affinity_cache_ratio":0.9927371914949554,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":60416,"estimated_new_tokens":442,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1608,"cache_hit":12800,"new_prefill":48058,"score_linear":34601.0,"score_lmetric":48058},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":89874,"ongoing_decode_tokens":4690,"pending_prefill_tokens":23232,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":60858,"score_linear":89874.0,"score_lmetric":168180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":87293,"ongoing_decode_tokens":87293,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":60416,"new_prefill":442,"score_linear":26877.0,"score_lmetric":442},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":60858,"score_linear":272137.0,"score_lmetric":768780},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":12800,"new_prefill":48058,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":141742,"ongoing_decode_tokens":28383,"pending_prefill_tokens":20687,"num_requests":5,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":60858,"score_linear":141742.0,"score_lmetric":407725},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":60858,"score_linear":15283.0,"score_lmetric":60858},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":12800,"new_prefill":48058,"score_linear":50736.0,"score_lmetric":48058}],"chosen_score_linear":26877.0,"chosen_score_lmetric":442,"t_first_token":390339.097241003,"t_first_token_unix":1779821204.1111846,"t_done":390347.711925598,"t_done_unix":1779821212.725869},{"request_id":"1384772:2:1387335:693","session_id":"1384772","input_length":11530,"t_proxy_recv":390346.852463756,"t_decision_unix":1779821211.8664055,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":7,"affinity_cache_hit":4608,"affinity_cache_ratio":0.39965307892454466,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":11530,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":4608,"new_prefill":6922,"score_linear":80576.0,"score_lmetric":6922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":0,"new_prefill":11530,"score_linear":129117.0,"score_lmetric":11530},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":11530,"score_linear":272137.0,"score_lmetric":571468},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":11530,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":126107,"ongoing_decode_tokens":126107,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":0,"new_prefill":11530,"score_linear":126107.0,"score_lmetric":34590},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":11530,"score_linear":15283.0,"score_lmetric":11530},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":11530,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390347.777630071,"t_first_token_unix":1779821212.7915735,"t_done":390347.831805155,"t_done_unix":1779821212.8457484},{"request_id":"1381387:2:1383735:669","session_id":"1381387","input_length":28383,"t_proxy_recv":390332.080352764,"t_decision_unix":1779821197.094294,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.4870521086565902,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":14559,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":14559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":28383,"score_linear":47401.0,"score_lmetric":28383},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":38111,"ongoing_decode_tokens":0,"pending_prefill_tokens":38111,"num_requests":1,"active_p_offloads":0,"cached_blocks":1359,"cache_hit":0,"new_prefill":28383,"score_linear":38111.0,"score_lmetric":66494},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":28383,"score_linear":196293.0,"score_lmetric":56766},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":28383,"score_linear":202672.0,"score_lmetric":468909},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136654,"ongoing_decode_tokens":136654,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":28383,"score_linear":136654.0,"score_lmetric":56766},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":3186,"ongoing_decode_tokens":3186,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1256,"cache_hit":13824,"new_prefill":14559,"score_linear":-10638.0,"score_lmetric":14559},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":28383,"score_linear":69295.0,"score_lmetric":164790},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":28383,"score_linear":63536.0,"score_lmetric":28383}],"chosen_score_linear":-10638.0,"chosen_score_lmetric":14559,"t_first_token":390334.441337062,"t_first_token_unix":1779821199.4552803,"t_done":390348.00943739,"t_done_unix":1779821213.0233812},{"request_id":"1378979:1:1378979:633","session_id":"1378979","input_length":15283,"t_proxy_recv":390315.496202246,"t_decision_unix":1779821180.5101433,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":15283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":23457,"ongoing_decode_tokens":23457,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":15283,"score_linear":23457.0,"score_lmetric":15283},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5458,"ongoing_decode_tokens":5458,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1337,"cache_hit":0,"new_prefill":15283,"score_linear":5458.0,"score_lmetric":15283},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":15283,"score_linear":196293.0,"score_lmetric":135082},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":14848,"new_prefill":435,"score_linear":130168.0,"score_lmetric":254038},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":15283,"score_linear":134155.0,"score_lmetric":30566},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1186,"cache_hit":0,"new_prefill":15283,"score_linear":80246.0,"score_lmetric":15283},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":15283,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":15283,"score_linear":143031.0,"score_lmetric":185556}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390316.859510231,"t_first_token_unix":1779821181.8734539,"t_done":390348.291533551,"t_done_unix":1779821213.3054767},{"request_id":"1355484:11:1388276:696","session_id":"1355484","input_length":26837,"t_proxy_recv":390347.836499884,"t_decision_unix":1779821212.850433,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9348287811603383,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1749,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":25088,"new_prefill":1749,"score_linear":-25088.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":26837,"score_linear":85184.0,"score_lmetric":26837},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174564,"ongoing_decode_tokens":68259,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":12800,"new_prefill":14037,"score_linear":161764.0,"score_lmetric":58902},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":26837,"score_linear":272137.0,"score_lmetric":126360},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":23040,"new_prefill":3797,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":127311,"ongoing_decode_tokens":127311,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1311,"cache_hit":0,"new_prefill":26837,"score_linear":127311.0,"score_lmetric":80511},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":26837,"score_linear":15283.0,"score_lmetric":26837},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1717,"cache_hit":12800,"new_prefill":14037,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":0,"t_first_token":390348.178249962,"t_first_token_unix":1779821213.1921937,"t_done":390349.220993515,"t_done_unix":1779821214.2349365},{"request_id":"1382804:2:1388620:698","session_id":"1382804","input_length":3678,"t_proxy_recv":390349.212206775,"t_decision_unix":1779821214.2261484,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":512,"affinity_cache_ratio":0.13920609026644915,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":3166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26837,"ongoing_decode_tokens":26837,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":3678,"score_linear":26837.0,"score_lmetric":3678},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":3678,"score_linear":85184.0,"score_lmetric":3678},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174564,"ongoing_decode_tokens":68259,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":3678,"score_linear":174564.0,"score_lmetric":48543},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":3678,"score_linear":272137.0,"score_lmetric":33724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":3678,"score_linear":71899.0,"score_lmetric":75577},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":149721,"ongoing_decode_tokens":98928,"pending_prefill_tokens":22633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":3678,"score_linear":149721.0,"score_lmetric":78933},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":3678,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1717,"cache_hit":512,"new_prefill":3166,"score_linear":-512.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390349.415363833,"t_first_token_unix":1779821214.4293077,"t_done":390349.467584526,"t_done_unix":1779821214.4815278},{"request_id":"1366128:13:1387308:692","session_id":"1366128","input_length":71708,"t_proxy_recv":390347.141818134,"t_decision_unix":1779821212.1557596,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9924694594745356,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":71708,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":71708,"score_linear":85184.0,"score_lmetric":71708},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":0,"new_prefill":71708,"score_linear":129117.0,"score_lmetric":71708},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":71708,"score_linear":272137.0,"score_lmetric":305844},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":15360,"new_prefill":56348,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":54529,"ongoing_decode_tokens":54529,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1301,"cache_hit":71168,"new_prefill":540,"score_linear":-16639.0,"score_lmetric":1080},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":71708,"score_linear":15283.0,"score_lmetric":71708},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":11530,"ongoing_decode_tokens":0,"pending_prefill_tokens":11530,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":71708,"score_linear":11530.0,"score_lmetric":83238}],"chosen_score_linear":-16639.0,"chosen_score_lmetric":1080,"t_first_token":390347.302783433,"t_first_token_unix":1779821212.3167264,"t_done":390349.939945802,"t_done_unix":1779821214.9538894},{"request_id":"1370129:4:1384856:678","session_id":"1370129","input_length":85184,"t_proxy_recv":390336.006618103,"t_decision_unix":1779821201.0205593,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":61952,"affinity_cache_ratio":0.7272727272727273,"affinity_num_requests":1,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":23232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":122492,"ongoing_decode_tokens":122492,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":7680,"new_prefill":77504,"score_linear":114812.0,"score_lmetric":232512},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":4690,"ongoing_decode_tokens":0,"pending_prefill_tokens":4690,"num_requests":1,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":61952,"new_prefill":23232,"score_linear":-57262.0,"score_lmetric":27922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":85184,"score_linear":196293.0,"score_lmetric":170368},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":0,"pending_prefill_tokens":131337,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":18432,"new_prefill":66752,"score_linear":253705.0,"score_lmetric":792356},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35888,"ongoing_decode_tokens":35888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1331,"cache_hit":7680,"new_prefill":77504,"score_linear":28208.0,"score_lmetric":77504},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":125008,"ongoing_decode_tokens":28383,"pending_prefill_tokens":13169,"num_requests":4,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":7680,"new_prefill":77504,"score_linear":117328.0,"score_lmetric":362692},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":7680,"new_prefill":77504,"score_linear":61615.0,"score_lmetric":263032},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":7680,"new_prefill":77504,"score_linear":55856.0,"score_lmetric":77504}],"chosen_score_linear":-57262.0,"chosen_score_lmetric":27922,"t_first_token":390346.723517026,"t_first_token_unix":1779821211.7374616,"t_done":390352.337308117,"t_done_unix":1779821217.3512514},{"request_id":"1390240:1:1390240:705","session_id":"1390240","input_length":5110,"t_proxy_recv":390355.15632047,"t_decision_unix":1779821220.1702611,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":5110,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":5110,"score_linear":194747.0,"score_lmetric":102428},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":5110,"score_linear":272137.0,"score_lmetric":39452},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":110141,"ongoing_decode_tokens":0,"pending_prefill_tokens":72253,"num_requests":2,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":5110,"score_linear":110141.0,"score_lmetric":154726},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":5110,"score_linear":161417.0,"score_lmetric":50502},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":5110,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68187,"ongoing_decode_tokens":0,"pending_prefill_tokens":3163,"num_requests":1,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":0,"new_prefill":5110,"score_linear":68187.0,"score_lmetric":8273}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390355.481441932,"t_first_token_unix":1779821220.4953861,"t_done":390355.752304234,"t_done_unix":1779821220.7662473},{"request_id":"1390356:1:1390356:706","session_id":"1390356","input_length":1349,"t_proxy_recv":390355.588892834,"t_decision_unix":1779821220.6028345,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1349,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":1349,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":5110,"ongoing_decode_tokens":5110,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":1349,"score_linear":5110.0,"score_lmetric":1349},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":1349,"score_linear":194747.0,"score_lmetric":94906},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":1349,"score_linear":272137.0,"score_lmetric":24408},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":110141,"ongoing_decode_tokens":0,"pending_prefill_tokens":72253,"num_requests":2,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":1349,"score_linear":110141.0,"score_lmetric":147204},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":1349,"score_linear":161417.0,"score_lmetric":39219},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":1349,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68187,"ongoing_decode_tokens":0,"pending_prefill_tokens":3163,"num_requests":1,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":0,"new_prefill":1349,"score_linear":68187.0,"score_lmetric":4512}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390355.684325874,"t_first_token_unix":1779821220.6982694,"t_done":390357.341596915,"t_done_unix":1779821222.3555408},{"request_id":"1363093:4:1390050:704","session_id":"1363093","input_length":68187,"t_proxy_recv":390354.385562754,"t_decision_unix":1779821219.3995035,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9536128587560678,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":3163,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":68187,"score_linear":194747.0,"score_lmetric":228582},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":68187,"score_linear":272137.0,"score_lmetric":291760},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":110141,"ongoing_decode_tokens":0,"pending_prefill_tokens":72253,"num_requests":2,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":68187,"score_linear":110141.0,"score_lmetric":280880},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":68187,"score_linear":161417.0,"score_lmetric":239733},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":68187,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":65024,"new_prefill":3163,"score_linear":-65024.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":390355.641542442,"t_first_token_unix":1779821220.655486,"t_done":390359.392791333,"t_done_unix":1779821224.406735},{"request_id":"1340290:5:1386504:688","session_id":"1340290","input_length":27220,"t_proxy_recv":390347.501048815,"t_decision_unix":1779821212.5149903,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9592946362968405,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":27220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":27220,"score_linear":85184.0,"score_lmetric":27220},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129117,"ongoing_decode_tokens":129117,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2238,"cache_hit":0,"new_prefill":27220,"score_linear":129117.0,"score_lmetric":27220},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":27220,"score_linear":272137.0,"score_lmetric":127892},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":27220,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":100091,"ongoing_decode_tokens":100091,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1311,"cache_hit":26112,"new_prefill":1108,"score_linear":73979.0,"score_lmetric":2216},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":1024,"new_prefill":26196,"score_linear":14259.0,"score_lmetric":26196},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":11530,"ongoing_decode_tokens":0,"pending_prefill_tokens":11530,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":27220,"score_linear":11530.0,"score_lmetric":38750}],"chosen_score_linear":73979.0,"chosen_score_lmetric":2216,"t_first_token":390347.789936486,"t_first_token_unix":1779821212.8038797,"t_done":390359.726771231,"t_done_unix":1779821224.7407146},{"request_id":"1366128:14:1389156:701","session_id":"1366128","input_length":83404,"t_proxy_recv":390351.199651911,"t_decision_unix":1779821216.213593,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.8594312023404154,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":11724,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":83404,"score_linear":85184.0,"score_lmetric":83404},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":83404,"score_linear":194747.0,"score_lmetric":259016},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":83404,"score_linear":272137.0,"score_lmetric":352628},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":15360,"new_prefill":68044,"score_linear":56539.0,"score_lmetric":139943},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":78013,"ongoing_decode_tokens":27220,"pending_prefill_tokens":22633,"num_requests":2,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":71680,"new_prefill":11724,"score_linear":6333.0,"score_lmetric":68714},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":0,"new_prefill":83404,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":6333.0,"chosen_score_lmetric":68714,"t_first_token":390359.682059742,"t_first_token_unix":1779821224.696004,"t_done":390361.195722721,"t_done_unix":1779821226.2096713},{"request_id":"1391584:1:1391584:713","session_id":"1391584","input_length":15302,"t_proxy_recv":390359.661892852,"t_decision_unix":1779821224.6758344,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":15302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":26771,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":15302,"score_linear":28307.0,"score_lmetric":42073},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":0,"new_prefill":15302,"score_linear":87687.0,"score_lmetric":15302},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":15302,"score_linear":194747.0,"score_lmetric":122812},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":15302,"score_linear":272137.0,"score_lmetric":74876},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":15302,"score_linear":212134.0,"score_lmetric":264516},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":15302,"score_linear":161417.0,"score_lmetric":81078},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":15302,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":15302,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390361.025726035,"t_first_token_unix":1779821226.0396693,"t_done":390361.237626388,"t_done_unix":1779821226.2515695},{"request_id":"1370129:5:1390477:708","session_id":"1370129","input_length":87687,"t_proxy_recv":390356.122172311,"t_decision_unix":1779821221.1361136,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9751046335260642,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":2183,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":1349,"ongoing_decode_tokens":1349,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":7680,"new_prefill":80007,"score_linear":-6331.0,"score_lmetric":80007},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":85504,"new_prefill":2183,"score_linear":-85504.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":87687,"score_linear":194747.0,"score_lmetric":267582},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":18432,"new_prefill":69255,"score_linear":253705.0,"score_lmetric":296032},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":110141,"ongoing_decode_tokens":0,"pending_prefill_tokens":72253,"num_requests":2,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":7680,"new_prefill":80007,"score_linear":102461.0,"score_lmetric":304520},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":7680,"new_prefill":80007,"score_linear":153737.0,"score_lmetric":275193},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":7680,"new_prefill":80007,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68187,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":7680,"new_prefill":80007,"score_linear":60507.0,"score_lmetric":80007}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":390357.365842162,"t_first_token_unix":1779821222.3797858,"t_done":390361.808766016,"t_done_unix":1779821226.8227093},{"request_id":"1340290:6:1387365:695","session_id":"1340290","input_length":27285,"t_proxy_recv":390359.734958376,"t_decision_unix":1779821224.7489002,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9945391240608393,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":149,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":26771,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":27285,"score_linear":28307.0,"score_lmetric":54056},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":0,"new_prefill":27285,"score_linear":87687.0,"score_lmetric":27285},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":27285,"score_linear":194747.0,"score_lmetric":146778},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":27285,"score_linear":272137.0,"score_lmetric":122808},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":27285,"score_linear":212134.0,"score_lmetric":300465},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134197,"ongoing_decode_tokens":134197,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1342,"cache_hit":27136,"new_prefill":149,"score_linear":107061.0,"score_lmetric":298},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":1024,"new_prefill":26261,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15302,"ongoing_decode_tokens":0,"pending_prefill_tokens":15302,"num_requests":1,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":27285,"score_linear":15302.0,"score_lmetric":42587}],"chosen_score_linear":107061.0,"chosen_score_lmetric":298,"t_first_token":390359.824655035,"t_first_token_unix":1779821224.8385992,"t_done":390362.500282169,"t_done_unix":1779821227.5142255},{"request_id":"1366128:15:1390663:709","session_id":"1366128","input_length":83622,"t_proxy_recv":390361.20932443,"t_decision_unix":1779821226.2232661,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9980148764679151,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":56689,"ongoing_decode_tokens":0,"pending_prefill_tokens":28529,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":83622,"score_linear":56689.0,"score_lmetric":112151},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":0,"new_prefill":83622,"score_linear":87687.0,"score_lmetric":83622},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":83622,"score_linear":194747.0,"score_lmetric":259452},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":83622,"score_linear":272137.0,"score_lmetric":348156},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":15360,"new_prefill":68262,"score_linear":196774.0,"score_lmetric":423396},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":78078,"ongoing_decode_tokens":78078,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":83456,"new_prefill":166,"score_linear":-5378.0,"score_lmetric":332},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":83622,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15302,"ongoing_decode_tokens":15302,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":83622,"score_linear":15302.0,"score_lmetric":83622}],"chosen_score_linear":-5378.0,"chosen_score_lmetric":332,"t_first_token":390361.400555176,"t_first_token_unix":1779821226.4144986,"t_done":390363.035447837,"t_done_unix":1779821228.0493913},{"request_id":"1381387:3:1387093:691","session_id":"1381387","input_length":50793,"t_proxy_recv":390348.040944332,"t_decision_unix":1779821213.0548856,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":28160,"affinity_cache_ratio":0.5544071033410115,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":22633,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26837,"ongoing_decode_tokens":0,"pending_prefill_tokens":1749,"num_requests":1,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":50793,"score_linear":26837.0,"score_lmetric":52542},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":50793,"score_linear":85184.0,"score_lmetric":50793},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174564,"ongoing_decode_tokens":68259,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":50793,"score_linear":174564.0,"score_lmetric":95658},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":50793,"score_linear":272137.0,"score_lmetric":222184},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":50793,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":98928,"ongoing_decode_tokens":98928,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":28160,"new_prefill":22633,"score_linear":70768.0,"score_lmetric":45266},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":50793,"score_linear":15283.0,"score_lmetric":50793},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1717,"cache_hit":0,"new_prefill":50793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":70768.0,"chosen_score_lmetric":45266,"t_first_token":390354.001152044,"t_first_token_unix":1779821219.0150964,"t_done":390363.313332643,"t_done_unix":1779821228.3272758},{"request_id":"1391584:2:1392466:715","session_id":"1391584","input_length":15483,"t_proxy_recv":390362.978776931,"t_decision_unix":1779821227.992718,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":14848,"affinity_cache_ratio":0.958987276367629,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":14848,"estimated_new_tokens":635,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":56689,"ongoing_decode_tokens":28307,"pending_prefill_tokens":1758,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":15483,"score_linear":56689.0,"score_lmetric":17241},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":0,"new_prefill":15483,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":15483,"score_linear":194747.0,"score_lmetric":123174},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":15483,"score_linear":272137.0,"score_lmetric":75600},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":15483,"score_linear":212134.0,"score_lmetric":265059},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":134415,"ongoing_decode_tokens":134415,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1365,"cache_hit":0,"new_prefill":15483,"score_linear":134415.0,"score_lmetric":30966},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":15483,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":14848,"new_prefill":635,"score_linear":-14848.0,"score_lmetric":0}],"chosen_score_linear":-14848.0,"chosen_score_lmetric":0,"t_first_token":390363.059413445,"t_first_token_unix":1779821228.073357,"t_done":390363.436964422,"t_done_unix":1779821228.4509077},{"request_id":"1391404:1:1391404:712","session_id":"1391404","input_length":28307,"t_proxy_recv":390359.15040381,"t_decision_unix":1779821224.164345,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":26771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":1536,"new_prefill":26771,"score_linear":-1536.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":1536,"new_prefill":26771,"score_linear":86151.0,"score_lmetric":26771},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":2560,"new_prefill":25747,"score_linear":192187.0,"score_lmetric":143702},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":28307,"score_linear":272137.0,"score_lmetric":126896},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":28307,"score_linear":212134.0,"score_lmetric":303531},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":28307,"score_linear":161417.0,"score_lmetric":120093},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":28307,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68187,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":0,"new_prefill":28307,"score_linear":68187.0,"score_lmetric":28307}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390362.701161694,"t_first_token_unix":1779821227.715105,"t_done":390364.765704077,"t_done_unix":1779821229.7796476},{"request_id":"1390240:2:1392954:717","session_id":"1390240","input_length":7440,"t_proxy_recv":390364.696046825,"t_decision_unix":1779821229.7099884,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":5120,"affinity_cache_ratio":0.6881720430107527,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":5120,"estimated_new_tokens":2320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":56689,"ongoing_decode_tokens":56689,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":7440,"score_linear":56689.0,"score_lmetric":7440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":5120,"new_prefill":2320,"score_linear":-5120.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":7440,"score_linear":194747.0,"score_lmetric":107088},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":7440,"score_linear":272137.0,"score_lmetric":43428},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":7440,"score_linear":212134.0,"score_lmetric":240930},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":84897,"ongoing_decode_tokens":84897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1409,"cache_hit":0,"new_prefill":7440,"score_linear":84897.0,"score_lmetric":7440},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":7440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-5120.0,"chosen_score_lmetric":0,"t_first_token":390364.917879929,"t_first_token_unix":1779821229.9318233,"t_done":390365.142287543,"t_done_unix":1779821230.1562304},{"request_id":"1355484:12:1391879:714","session_id":"1355484","input_length":28382,"t_proxy_recv":390360.800509932,"t_decision_unix":1779821225.8144512,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9380593333803114,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":1758,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28307,"ongoing_decode_tokens":0,"pending_prefill_tokens":26771,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":26624,"new_prefill":1758,"score_linear":1683.0,"score_lmetric":28529},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":0,"new_prefill":28382,"score_linear":87687.0,"score_lmetric":28382},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":12800,"new_prefill":15582,"score_linear":181947.0,"score_lmetric":123372},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":28382,"score_linear":272137.0,"score_lmetric":127196},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":23040,"new_prefill":5342,"score_linear":189094.0,"score_lmetric":234636},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161482,"ongoing_decode_tokens":161482,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1342,"cache_hit":0,"new_prefill":28382,"score_linear":161482.0,"score_lmetric":85146},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":28382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":15302,"ongoing_decode_tokens":0,"pending_prefill_tokens":15302,"num_requests":1,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":12800,"new_prefill":15582,"score_linear":2502.0,"score_lmetric":30884}],"chosen_score_linear":1683.0,"chosen_score_lmetric":28529,"t_first_token":390363.017111636,"t_first_token_unix":1779821228.0310552,"t_done":390365.505075636,"t_done_unix":1779821230.5190194},{"request_id":"1366128:16:1392704:716","session_id":"1366128","input_length":84897,"t_proxy_recv":390363.878343023,"t_decision_unix":1779821228.8922842,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":83456,"affinity_cache_ratio":0.9830264909242965,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":83456,"estimated_new_tokens":1441,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":56689,"ongoing_decode_tokens":56689,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":84897,"score_linear":56689.0,"score_lmetric":84897},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":0,"new_prefill":84897,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":84897,"score_linear":194747.0,"score_lmetric":262002},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":84897,"score_linear":272137.0,"score_lmetric":353256},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":15360,"new_prefill":69537,"score_linear":196774.0,"score_lmetric":427221},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1409,"cache_hit":83456,"new_prefill":1441,"score_linear":-83456.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":84897,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":84897,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-83456.0,"chosen_score_lmetric":0,"t_first_token":390364.622591089,"t_first_token_unix":1779821229.6365345,"t_done":390366.526464122,"t_done_unix":1779821231.5404077},{"request_id":"1388507:1:1388507:697","session_id":"1388507","input_length":71899,"t_proxy_recv":390348.758930553,"t_decision_unix":1779821213.772872,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":71899,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":26837,"ongoing_decode_tokens":26837,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":0,"new_prefill":71899,"score_linear":26837.0,"score_lmetric":71899},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":71899,"score_linear":85184.0,"score_lmetric":71899},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174564,"ongoing_decode_tokens":68259,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":71899,"score_linear":174564.0,"score_lmetric":116764},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":71899,"score_linear":272137.0,"score_lmetric":306608},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":71899,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":149721,"ongoing_decode_tokens":98928,"pending_prefill_tokens":22633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1339,"cache_hit":0,"new_prefill":71899,"score_linear":149721.0,"score_lmetric":283596},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":71899,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1717,"cache_hit":0,"new_prefill":71899,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390367.150936564,"t_first_token_unix":1779821232.1648803,"t_done":390367.865104942,"t_done_unix":1779821232.8790486},{"request_id":"1355951:4:1389858:703","session_id":"1355951","input_length":38242,"t_proxy_recv":390353.755688311,"t_decision_unix":1779821218.7696292,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9907431619685163,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":38242,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1499,"cache_hit":34816,"new_prefill":3426,"score_linear":-34816.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":38242,"score_linear":194747.0,"score_lmetric":168692},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":38242,"score_linear":272137.0,"score_lmetric":171980},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":37888,"new_prefill":354,"score_linear":34011.0,"score_lmetric":72253},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":27220,"pending_prefill_tokens":34357,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":38242,"score_linear":161417.0,"score_lmetric":217797},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":38242,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":0,"new_prefill":38242,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":34011.0,"chosen_score_lmetric":72253,"t_first_token":390367.157687869,"t_first_token_unix":1779821232.1716313,"t_done":390367.876312458,"t_done_unix":1779821232.890256},{"request_id":"1394428:1:1394428:724","session_id":"1394428","input_length":982,"t_proxy_recv":390369.857017143,"t_decision_unix":1779821234.8709579,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":982,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110930,"ongoing_decode_tokens":110930,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":512,"new_prefill":470,"score_linear":110418.0,"score_lmetric":940},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":982,"score_linear":110818.0,"score_lmetric":38122},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":982,"score_linear":194747.0,"score_lmetric":94172},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":982,"score_linear":272137.0,"score_lmetric":17596},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":982,"score_linear":101993.0,"score_lmetric":982},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":982,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":982,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":982,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390369.935550665,"t_first_token_unix":1779821234.9494948,"t_done":390369.939416171,"t_done_unix":1779821234.9533598},{"request_id":"1279412:31:1391216:711","session_id":"1279412","input_length":101993,"t_proxy_recv":390358.696980065,"t_decision_unix":1779821223.7109213,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":101376,"affinity_cache_ratio":0.993950565234869,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":617,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":12800,"new_prefill":89193,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87687,"ongoing_decode_tokens":87687,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1509,"cache_hit":0,"new_prefill":101993,"score_linear":87687.0,"score_lmetric":101993},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":12800,"new_prefill":89193,"score_linear":181947.0,"score_lmetric":270594},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":101993,"score_linear":272137.0,"score_lmetric":421640},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":110141,"ongoing_decode_tokens":0,"pending_prefill_tokens":72253,"num_requests":2,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":101376,"new_prefill":617,"score_linear":8765.0,"score_lmetric":145740},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":161417,"ongoing_decode_tokens":78013,"pending_prefill_tokens":11724,"num_requests":3,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":101993,"score_linear":161417.0,"score_lmetric":341151},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":101993,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":68187,"ongoing_decode_tokens":68187,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":12800,"new_prefill":89193,"score_linear":55387.0,"score_lmetric":89193}],"chosen_score_linear":8765.0,"chosen_score_lmetric":145740,"t_first_token":390367.158208765,"t_first_token_unix":1779821232.1721516,"t_done":390370.212234046,"t_done_unix":1779821235.2261777},{"request_id":"1394432:1:1394432:725","session_id":"1394432","input_length":4736,"t_proxy_recv":390369.865268589,"t_decision_unix":1779821234.8792102,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4736,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110930,"ongoing_decode_tokens":110930,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":4736,"score_linear":110930.0,"score_lmetric":9472},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":4736,"score_linear":110818.0,"score_lmetric":45630},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":4736,"score_linear":194747.0,"score_lmetric":101680},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4736,"score_linear":272137.0,"score_lmetric":32612},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":4736,"score_linear":101993.0,"score_lmetric":4736},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":4736,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":4736,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":982,"ongoing_decode_tokens":0,"pending_prefill_tokens":982,"num_requests":1,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":4736,"score_linear":982.0,"score_lmetric":5718}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390370.175232588,"t_first_token_unix":1779821235.189176,"t_done":390370.430167119,"t_done_unix":1779821235.4441102},{"request_id":"1394482:1:1394482:726","session_id":"1394482","input_length":4428,"t_proxy_recv":390370.119666376,"t_decision_unix":1779821235.1336076,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4428,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":110930,"ongoing_decode_tokens":110930,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":4428,"score_linear":110930.0,"score_lmetric":8856},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":4428,"score_linear":110818.0,"score_lmetric":45014},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":4428,"score_linear":194747.0,"score_lmetric":101064},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4428,"score_linear":272137.0,"score_lmetric":31380},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":4428,"score_linear":101993.0,"score_lmetric":4428},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4736,"ongoing_decode_tokens":0,"pending_prefill_tokens":4736,"num_requests":1,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":4428,"score_linear":4736.0,"score_lmetric":9164},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":4428,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":0,"new_prefill":4428,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390370.393799288,"t_first_token_unix":1779821235.4077432,"t_done":390370.480795077,"t_done_unix":1779821235.494738},{"request_id":"1355484:13:1394384:723","session_id":"1355484","input_length":28665,"t_proxy_recv":390369.706268555,"t_decision_unix":1779821234.7202098,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9823826966684109,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":28160,"new_prefill":505,"score_linear":54105.0,"score_lmetric":505},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":28665,"score_linear":110818.0,"score_lmetric":93488},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":12800,"new_prefill":15865,"score_linear":181947.0,"score_lmetric":123938},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":28665,"score_linear":272137.0,"score_lmetric":128328},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":23040,"new_prefill":5625,"score_linear":78953.0,"score_lmetric":5625},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":28665,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":28665,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":12800,"new_prefill":15865,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":54105.0,"chosen_score_lmetric":505,"t_first_token":390369.786919129,"t_first_token_unix":1779821234.800863,"t_done":390370.667682135,"t_done_unix":1779821235.6816256},{"request_id":"1364090:4:1392998:718","session_id":"1364090","input_length":48944,"t_proxy_recv":390364.802437944,"t_decision_unix":1779821229.8163795,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9833278849297156,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":816,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":28382,"ongoing_decode_tokens":28382,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":48128,"new_prefill":816,"score_linear":-19746.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":7440,"ongoing_decode_tokens":0,"pending_prefill_tokens":2320,"num_requests":1,"active_p_offloads":0,"cached_blocks":1514,"cache_hit":7680,"new_prefill":41264,"score_linear":-240.0,"score_lmetric":43584},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":48944,"score_linear":194747.0,"score_lmetric":190096},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":7680,"new_prefill":41264,"score_linear":264457.0,"score_lmetric":178724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":212134,"ongoing_decode_tokens":0,"pending_prefill_tokens":72870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":14336,"new_prefill":34608,"score_linear":197798.0,"score_lmetric":322434},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":84897,"ongoing_decode_tokens":84897,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1409,"cache_hit":11264,"new_prefill":37680,"score_linear":73633.0,"score_lmetric":37680},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":11264,"new_prefill":37680,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":7680,"new_prefill":41264,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-19746.0,"chosen_score_lmetric":0,"t_first_token":390365.170261789,"t_first_token_unix":1779821230.184205,"t_done":390371.82196522,"t_done_unix":1779821236.8359087},{"request_id":"1394432:2:1395186:729","session_id":"1394432","input_length":6892,"t_proxy_recv":390372.454853246,"t_decision_unix":1779821237.4687939,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.6686012768427162,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":2284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":6892,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":6892,"score_linear":110818.0,"score_lmetric":49942},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":194747,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":6892,"score_linear":194747.0,"score_lmetric":13784},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":6892,"score_linear":272137.0,"score_lmetric":41236},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":0,"new_prefill":6892,"score_linear":35450.0,"score_lmetric":42342},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1421,"cache_hit":4608,"new_prefill":2284,"score_linear":-4608.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":6892,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":6892,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":390372.651060926,"t_first_token_unix":1779821237.6650052,"t_done":390372.900328288,"t_done_unix":1779821237.9142728},{"request_id":"1384947:2:1388842:700","session_id":"1384947","input_length":20183,"t_proxy_recv":390349.97207034,"t_decision_unix":1779821214.9860115,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9386117029182975,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":1239,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":20183,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":20183,"score_linear":85184.0,"score_lmetric":20183},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174564,"ongoing_decode_tokens":68259,"pending_prefill_tokens":44865,"num_requests":1,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":18944,"new_prefill":1239,"score_linear":155620.0,"score_lmetric":46104},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":20183,"score_linear":272137.0,"score_lmetric":99744},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":71899,"ongoing_decode_tokens":0,"pending_prefill_tokens":71899,"num_requests":1,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":0,"new_prefill":20183,"score_linear":71899.0,"score_lmetric":92082},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":78013,"ongoing_decode_tokens":27220,"pending_prefill_tokens":22633,"num_requests":2,"active_p_offloads":0,"cached_blocks":1340,"cache_hit":0,"new_prefill":20183,"score_linear":78013.0,"score_lmetric":85632},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":20183,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1723,"cache_hit":0,"new_prefill":20183,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":155620.0,"chosen_score_lmetric":46104,"t_first_token":390370.99696612,"t_first_token_unix":1779821236.0109096,"t_done":390374.012510661,"t_done_unix":1779821239.026454},{"request_id":"1313181:6:1324908:369","session_id":"1313181","input_length":106305,"t_proxy_recv":390347.73033546,"t_decision_unix":1779821212.744277,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61440,"affinity_cache_ratio":0.5779596444193594,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":44865,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1670,"cache_hit":12800,"new_prefill":93505,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":85184,"ongoing_decode_tokens":85184,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1453,"cache_hit":0,"new_prefill":106305,"score_linear":85184.0,"score_lmetric":106305},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":68259,"ongoing_decode_tokens":68259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":61440,"new_prefill":44865,"score_linear":6819.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":145016,"pending_prefill_tokens":4753,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":106305,"score_linear":272137.0,"score_lmetric":444232},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1332,"cache_hit":12800,"new_prefill":93505,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":127311,"ongoing_decode_tokens":100091,"pending_prefill_tokens":1108,"num_requests":3,"active_p_offloads":0,"cached_blocks":1311,"cache_hit":0,"new_prefill":106305,"score_linear":127311.0,"score_lmetric":322239},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":15283,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":106305,"score_linear":15283.0,"score_lmetric":106305},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":11530,"ongoing_decode_tokens":0,"pending_prefill_tokens":11530,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":12800,"new_prefill":93505,"score_linear":-1270.0,"score_lmetric":105035}],"chosen_score_linear":6819.0,"chosen_score_lmetric":0,"t_first_token":390370.995421783,"t_first_token_unix":1779821236.0093656,"t_done":390374.186161871,"t_done_unix":1779821239.2001054},{"request_id":"1314357:4:1352612:497","session_id":"1314357","input_length":68259,"t_proxy_recv":390223.172117912,"t_decision_unix":1779821088.1860595,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":67072,"affinity_cache_ratio":0.9826103517484874,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":67072,"estimated_new_tokens":1187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1086,"cache_hit":0,"new_prefill":68259,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":62618,"ongoing_decode_tokens":62618,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":877,"cache_hit":3584,"new_prefill":64675,"score_linear":59034.0,"score_lmetric":64675},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":18840,"ongoing_decode_tokens":0,"pending_prefill_tokens":18840,"num_requests":0,"active_p_offloads":0,"cached_blocks":1901,"cache_hit":67072,"new_prefill":1187,"score_linear":-48232.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":10575,"ongoing_decode_tokens":0,"pending_prefill_tokens":10575,"num_requests":1,"active_p_offloads":0,"cached_blocks":1420,"cache_hit":0,"new_prefill":68259,"score_linear":10575.0,"score_lmetric":78834},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":96026,"ongoing_decode_tokens":96026,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":986,"cache_hit":0,"new_prefill":68259,"score_linear":96026.0,"score_lmetric":68259},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":21371,"ongoing_decode_tokens":21371,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1004,"cache_hit":0,"new_prefill":68259,"score_linear":21371.0,"score_lmetric":68259},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1068,"cache_hit":0,"new_prefill":68259,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":21436,"ongoing_decode_tokens":0,"pending_prefill_tokens":9148,"num_requests":1,"active_p_offloads":0,"cached_blocks":1136,"cache_hit":0,"new_prefill":68259,"score_linear":21436.0,"score_lmetric":77407}],"chosen_score_linear":-48232.0,"chosen_score_lmetric":0,"t_first_token":390225.434179251,"t_first_token_unix":1779821090.4481227,"t_done":390374.311108001,"t_done_unix":1779821239.3250513},{"request_id":"1366128:17:1395596:731","session_id":"1366128","input_length":85276,"t_proxy_recv":390374.003833133,"t_decision_unix":1779821239.0177746,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9966696374126366,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":284,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":85276,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":85276,"score_linear":121708.0,"score_lmetric":321231},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":194747,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":85276,"score_linear":194747.0,"score_lmetric":170552},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":85276,"score_linear":272137.0,"score_lmetric":354772},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":15360,"new_prefill":69916,"score_linear":20090.0,"score_lmetric":105366},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":84992,"new_prefill":284,"score_linear":-84992.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":85276,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":85276,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-84992.0,"chosen_score_lmetric":0,"t_first_token":390374.276878518,"t_first_token_unix":1779821239.2908218,"t_done":390375.177289881,"t_done_unix":1779821240.191233},{"request_id":"1263749:2:1379302:636","session_id":"1263749","input_length":57656,"t_proxy_recv":390316.711736881,"t_decision_unix":1779821181.7256784,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":56320,"affinity_cache_ratio":0.9768280838074095,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":1336,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1582,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1348,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":68259,"pending_prefill_tokens":52258,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":57656,"score_linear":196293.0,"score_lmetric":219828},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":0,"pending_prefill_tokens":126584,"num_requests":2,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":56320,"new_prefill":1336,"score_linear":88696.0,"score_lmetric":255840},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":134155,"ongoing_decode_tokens":134155,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1327,"cache_hit":0,"new_prefill":57656,"score_linear":134155.0,"score_lmetric":115312},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1191,"cache_hit":0,"new_prefill":57656,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":15283,"ongoing_decode_tokens":0,"pending_prefill_tokens":15283,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":57656,"score_linear":15283.0,"score_lmetric":72939},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":143031,"ongoing_decode_tokens":0,"pending_prefill_tokens":77495,"num_requests":2,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":0,"new_prefill":57656,"score_linear":143031.0,"score_lmetric":270302}],"chosen_score_linear":88696.0,"chosen_score_lmetric":255840,"t_first_token":390358.669021992,"t_first_token_unix":1779821223.6829658,"t_done":390376.396922007,"t_done_unix":1779821241.4108708},{"request_id":"1394696:1:1394696:727","session_id":"1394696","input_length":35450,"t_proxy_recv":390370.897456248,"t_decision_unix":1779821235.9113975,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":35450,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82265,"ongoing_decode_tokens":82265,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":35450,"score_linear":82265.0,"score_lmetric":35450},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":35450,"score_linear":110818.0,"score_lmetric":107058},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":35450,"score_linear":194747.0,"score_lmetric":163108},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":35450,"score_linear":272137.0,"score_lmetric":155468},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1421,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":35450,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390376.1141599,"t_first_token_unix":1779821241.1281035,"t_done":390376.530402484,"t_done_unix":1779821241.5443459},{"request_id":"1342921:3:1384020:670","session_id":"1342921","input_length":69465,"t_proxy_recv":390333.14328008,"t_decision_unix":1779821198.1572213,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":66048,"affinity_cache_ratio":0.950809760310948,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":66048,"estimated_new_tokens":3417,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47401,"ongoing_decode_tokens":47401,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1604,"cache_hit":0,"new_prefill":69465,"score_linear":47401.0,"score_lmetric":69465},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1433,"cache_hit":0,"new_prefill":69465,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":196293,"ongoing_decode_tokens":196293,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":69465,"score_linear":196293.0,"score_lmetric":138930},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":202672,"ongoing_decode_tokens":0,"pending_prefill_tokens":127920,"num_requests":3,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":66048,"new_prefill":3417,"score_linear":136624.0,"score_lmetric":394011},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":136654,"ongoing_decode_tokens":136654,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1330,"cache_hit":0,"new_prefill":69465,"score_linear":136654.0,"score_lmetric":138930},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":28383,"ongoing_decode_tokens":0,"pending_prefill_tokens":14559,"num_requests":1,"active_p_offloads":0,"cached_blocks":1262,"cache_hit":0,"new_prefill":69465,"score_linear":28383.0,"score_lmetric":84024},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":69295,"ongoing_decode_tokens":15283,"pending_prefill_tokens":54012,"num_requests":2,"active_p_offloads":0,"cached_blocks":1444,"cache_hit":0,"new_prefill":69465,"score_linear":69295.0,"score_lmetric":246954},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":63536,"ongoing_decode_tokens":63536,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1681,"cache_hit":0,"new_prefill":69465,"score_linear":63536.0,"score_lmetric":69465}],"chosen_score_linear":136624.0,"chosen_score_lmetric":394011,"t_first_token":390375.003143288,"t_first_token_unix":1779821240.0170867,"t_done":390377.635589855,"t_done_unix":1779821242.6495337},{"request_id":"1395933:1:1395933:732","session_id":"1395933","input_length":21241,"t_proxy_recv":390375.188789854,"t_decision_unix":1779821240.2027314,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":11776,"estimated_new_tokens":9465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":11776,"new_prefill":9465,"score_linear":21545.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":21241,"score_linear":121708.0,"score_lmetric":129126},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":21241,"score_linear":184029.0,"score_lmetric":99656},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":272137,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":11776,"new_prefill":9465,"score_linear":260361.0,"score_lmetric":37860},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":0,"new_prefill":21241,"score_linear":35450.0,"score_lmetric":56691},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":21241,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":11776,"new_prefill":9465,"score_linear":-11776.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":21241,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390377.464503266,"t_first_token_unix":1779821242.4784474,"t_done":390378.742133285,"t_done_unix":1779821243.7560768},{"request_id":"1363943:5:1373637:609","session_id":"1363943","input_length":18676,"t_proxy_recv":390296.998146981,"t_decision_unix":1779821162.012088,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9869351038766331,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":8704,"new_prefill":9972,"score_linear":56253.0,"score_lmetric":19944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":56286,"ongoing_decode_tokens":0,"pending_prefill_tokens":56286,"num_requests":1,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":18676,"score_linear":56286.0,"score_lmetric":74962},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":18676,"score_linear":128263.0,"score_lmetric":18676},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":126340,"ongoing_decode_tokens":0,"pending_prefill_tokens":126340,"num_requests":1,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":18432,"new_prefill":244,"score_linear":107908.0,"score_lmetric":126584},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":98267,"ongoing_decode_tokens":98267,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1319,"cache_hit":4096,"new_prefill":14580,"score_linear":94171.0,"score_lmetric":14580},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":4096,"new_prefill":14580,"score_linear":76150.0,"score_lmetric":14580},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":4096,"new_prefill":14580,"score_linear":113792.0,"score_lmetric":14580},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":79495,"ongoing_decode_tokens":0,"pending_prefill_tokens":76935,"num_requests":1,"active_p_offloads":0,"cached_blocks":1516,"cache_hit":4096,"new_prefill":14580,"score_linear":75399.0,"score_lmetric":91515}],"chosen_score_linear":107908.0,"chosen_score_lmetric":126584,"t_first_token":390346.913930589,"t_first_token_unix":1779821211.9278738,"t_done":390379.168973078,"t_done_unix":1779821244.1829164},{"request_id":"1305906:3:1396717:733","session_id":"1305906","input_length":17047,"t_proxy_recv":390377.778587202,"t_decision_unix":1779821242.7925289,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":16384,"affinity_cache_ratio":0.9611075262509532,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":663,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":17047,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":17047,"score_linear":121708.0,"score_lmetric":116544},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":17047,"score_linear":184029.0,"score_lmetric":91268},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":216006,"ongoing_decode_tokens":145016,"pending_prefill_tokens":1870,"num_requests":3,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":17047,"score_linear":216006.0,"score_lmetric":56751},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":17047,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":16384,"new_prefill":663,"score_linear":-16384.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21241,"ongoing_decode_tokens":21241,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":17047,"score_linear":21241.0,"score_lmetric":17047},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":17047,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16384.0,"chosen_score_lmetric":0,"t_first_token":390379.425888321,"t_first_token_unix":1779821244.4398313,"t_done":390380.373378356,"t_done_unix":1779821245.3873217},{"request_id":"1366128:18:1397382:735","session_id":"1366128","input_length":85504,"t_proxy_recv":390380.052864045,"t_decision_unix":1779821245.0668056,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9940119760479041,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":85504,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":85504,"score_linear":121708.0,"score_lmetric":321915},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":85504,"score_linear":184029.0,"score_lmetric":228182},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":216446,"ongoing_decode_tokens":216446,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":85504,"score_linear":216446.0,"score_lmetric":256512},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":15360,"new_prefill":70144,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":17047,"ongoing_decode_tokens":17047,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":84992,"new_prefill":512,"score_linear":-67945.0,"score_lmetric":512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":0,"pending_prefill_tokens":13134,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":85504,"score_linear":13134.0,"score_lmetric":98638},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":85504,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-67945.0,"chosen_score_lmetric":512,"t_first_token":390380.253901918,"t_first_token_unix":1779821245.2678463,"t_done":390381.062370641,"t_done_unix":1779821246.076314},{"request_id":"1394167:1:1394167:721","session_id":"1394167","input_length":4675,"t_proxy_recv":390368.960135942,"t_decision_unix":1779821233.9740772,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82265,"ongoing_decode_tokens":48944,"pending_prefill_tokens":5161,"num_requests":1,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":4675,"score_linear":82265.0,"score_lmetric":9836},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":4675,"score_linear":194747.0,"score_lmetric":101558},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":4675,"score_linear":272137.0,"score_lmetric":32368},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":4675,"score_linear":101993.0,"score_lmetric":4675},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":4675,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390369.256419883,"t_first_token_unix":1779821234.2703636,"t_done":390381.213634154,"t_done_unix":1779821246.2275774},{"request_id":"1390240:3:1395387:730","session_id":"1390240","input_length":10890,"t_proxy_recv":390373.2479873,"t_decision_unix":1779821238.2619288,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":7168,"affinity_cache_ratio":0.65821854912764,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":7168,"estimated_new_tokens":3722,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":10890,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":110818,"ongoing_decode_tokens":4675,"pending_prefill_tokens":18079,"num_requests":2,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":7168,"new_prefill":3722,"score_linear":103650.0,"score_lmetric":43602},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":194747,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":10890,"score_linear":194747.0,"score_lmetric":21780},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":10890,"score_linear":272137.0,"score_lmetric":57228},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":0,"new_prefill":10890,"score_linear":35450.0,"score_lmetric":46340},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":10890,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":10890,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":10890,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":103650.0,"chosen_score_lmetric":43602,"t_first_token":390380.34434189,"t_first_token_unix":1779821245.3582854,"t_done":390381.765250655,"t_done_unix":1779821246.7791936},{"request_id":"1363943:6:1375416:618","session_id":"1363943","input_length":19116,"t_proxy_recv":390379.17444547,"t_decision_unix":1779821244.1883872,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9642184557438794,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":8704,"new_prefill":10412,"score_linear":24617.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":4096,"new_prefill":15020,"score_linear":117612.0,"score_lmetric":110463},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":19116,"score_linear":184029.0,"score_lmetric":95406},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":197330,"ongoing_decode_tokens":197330,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":18432,"new_prefill":684,"score_linear":178898.0,"score_lmetric":1368},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":4096,"new_prefill":15020,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":17047,"ongoing_decode_tokens":0,"pending_prefill_tokens":663,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":4096,"new_prefill":15020,"score_linear":12951.0,"score_lmetric":15683},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":4096,"new_prefill":15020,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":4096,"new_prefill":15020,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":178898.0,"chosen_score_lmetric":1368,"t_first_token":390379.304563888,"t_first_token_unix":1779821244.3185072,"t_done":390382.169392226,"t_done_unix":1779821247.1833372},{"request_id":"1394167:2:1395165:728","session_id":"1394167","input_length":4863,"t_proxy_recv":390381.216257312,"t_decision_unix":1779821246.2301989,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":4608,"affinity_cache_ratio":0.9475632325724861,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":4863,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":117033,"ongoing_decode_tokens":117033,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1527,"cache_hit":4608,"new_prefill":255,"score_linear":112425.0,"score_lmetric":510},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":4863,"score_linear":184029.0,"score_lmetric":66900},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":216446,"ongoing_decode_tokens":216446,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":4863,"score_linear":216446.0,"score_lmetric":14589},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":4863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":4863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":4863,"score_linear":13134.0,"score_lmetric":4863},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":92528,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":4863,"score_linear":93040.0,"score_lmetric":97391}],"chosen_score_linear":112425.0,"chosen_score_lmetric":510,"t_first_token":390381.279112409,"t_first_token_unix":1779821246.2930558,"t_done":390382.760386267,"t_done_unix":1779821247.7743294},{"request_id":"1397223:1:1397223:734","session_id":"1397223","input_length":13134,"t_proxy_recv":390379.41981608,"t_decision_unix":1779821244.4337575,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":13134,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":13134,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":13134,"score_linear":121708.0,"score_lmetric":104805},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":13134,"score_linear":184029.0,"score_lmetric":83442},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":216446,"ongoing_decode_tokens":216446,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":13134,"score_linear":216446.0,"score_lmetric":39402},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":17047,"ongoing_decode_tokens":0,"pending_prefill_tokens":663,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":13134,"score_linear":17047.0,"score_lmetric":13797},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":13134,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390380.520383538,"t_first_token_unix":1779821245.534327,"t_done":390383.481314151,"t_done_unix":1779821248.4952571},{"request_id":"1398213:1:1398213:742","session_id":"1398213","input_length":3891,"t_proxy_recv":390383.081396121,"t_decision_unix":1779821248.0953374,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":67758,"ongoing_decode_tokens":33321,"pending_prefill_tokens":5765,"num_requests":2,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":3891,"score_linear":67758.0,"score_lmetric":19312},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":3891,"score_linear":106143.0,"score_lmetric":3891},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":3891,"score_linear":184029.0,"score_lmetric":64956},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":218057,"ongoing_decode_tokens":218057,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":3891,"score_linear":218057.0,"score_lmetric":11673},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":3891,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":3891,"score_linear":16550.0,"score_lmetric":20441},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":3891,"score_linear":13134.0,"score_lmetric":3891},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":3891,"score_linear":103776.0,"score_lmetric":193830}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390383.321621748,"t_first_token_unix":1779821248.3355658,"t_done":390383.6391098,"t_done_unix":1779821248.6530533},{"request_id":"1397840:1:1397840:737","session_id":"1397840","input_length":16550,"t_proxy_recv":390381.871055681,"t_decision_unix":1779821246.884997,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":16550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":16550,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":111006,"ongoing_decode_tokens":111006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":16550,"score_linear":111006.0,"score_lmetric":33100},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":16550,"score_linear":184029.0,"score_lmetric":90274},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":216446,"ongoing_decode_tokens":216446,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":16550,"score_linear":216446.0,"score_lmetric":49650},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":16550,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":16550,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":16550,"score_linear":13134.0,"score_lmetric":16550},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":92528,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":16550,"score_linear":93040.0,"score_lmetric":109078}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390383.42783978,"t_first_token_unix":1779821248.441784,"t_done":390383.667076329,"t_done_unix":1779821248.6810195},{"request_id":"1398145:1:1398145:739","session_id":"1398145","input_length":3213,"t_proxy_recv":390382.940533184,"t_decision_unix":1779821247.9544744,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":3213,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":3213,"score_linear":106143.0,"score_lmetric":3213},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":3213,"score_linear":184029.0,"score_lmetric":63600},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":218057,"ongoing_decode_tokens":218057,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":3213,"score_linear":218057.0,"score_lmetric":9639},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":3213,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":3213,"score_linear":16550.0,"score_lmetric":19763},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":3213,"score_linear":13134.0,"score_lmetric":3213},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":92528,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":3213,"score_linear":93040.0,"score_lmetric":95741}],"chosen_score_linear":33321.0,"chosen_score_lmetric":0,"t_first_token":390383.178113558,"t_first_token_unix":1779821248.1920574,"t_done":390383.976858318,"t_done_unix":1779821248.9908025},{"request_id":"1398594:1:1398594:744","session_id":"1398594","input_length":7877,"t_proxy_recv":390384.309395589,"t_decision_unix":1779821249.3233361,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":7877,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64545,"ongoing_decode_tokens":64545,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":7877,"score_linear":64545.0,"score_lmetric":7877},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":7877,"score_linear":106143.0,"score_lmetric":7877},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":7877,"score_linear":184029.0,"score_lmetric":72928},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":7877,"score_linear":281315.0,"score_lmetric":79740},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1459,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":7877,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":7877,"score_linear":103776.0,"score_lmetric":201802}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390384.850894576,"t_first_token_unix":1779821249.8648388,"t_done":390384.966447507,"t_done_unix":1779821249.9803913},{"request_id":"1366128:19:1398824:745","session_id":"1366128","input_length":85663,"t_proxy_recv":390385.206600733,"t_decision_unix":1779821250.220542,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9981438894271739,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":159,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64545,"ongoing_decode_tokens":64545,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":85663,"score_linear":64545.0,"score_lmetric":85663},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":85663,"score_linear":106143.0,"score_lmetric":85663},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":85663,"score_linear":184029.0,"score_lmetric":228500},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":85663,"score_linear":281315.0,"score_lmetric":390884},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":15360,"new_prefill":70303,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":85504,"new_prefill":159,"score_linear":-85504.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":85663,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":85663,"score_linear":103776.0,"score_lmetric":357374}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":390385.395215761,"t_first_token_unix":1779821250.4091592,"t_done":390385.57585207,"t_done_unix":1779821250.5897956},{"request_id":"1355484:14:1398178:740","session_id":"1355484","input_length":31224,"t_proxy_recv":390383.019249814,"t_decision_unix":1779821248.0331914,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9182679989751473,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":2552,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":36534,"ongoing_decode_tokens":33321,"pending_prefill_tokens":3213,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":28672,"new_prefill":2552,"score_linear":7862.0,"score_lmetric":5765},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":31224,"score_linear":106143.0,"score_lmetric":31224},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":12800,"new_prefill":18424,"score_linear":171229.0,"score_lmetric":94022},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":218057,"ongoing_decode_tokens":218057,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":31224,"score_linear":218057.0,"score_lmetric":93672},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":23040,"new_prefill":8184,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":31224,"score_linear":16550.0,"score_lmetric":47774},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":31224,"score_linear":13134.0,"score_lmetric":31224},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":92528,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":12800,"new_prefill":18424,"score_linear":80240.0,"score_lmetric":110952}],"chosen_score_linear":7862.0,"chosen_score_lmetric":5765,"t_first_token":390383.791573796,"t_first_token_unix":1779821248.8055172,"t_done":390385.762973402,"t_done_unix":1779821250.7769167},{"request_id":"1391404:2:1393919:720","session_id":"1391404","input_length":33321,"t_proxy_recv":390368.005962813,"t_decision_unix":1779821233.0199044,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":28160,"affinity_cache_ratio":0.8451126916959275,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":5161,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":48944,"ongoing_decode_tokens":48944,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":28160,"new_prefill":5161,"score_linear":20784.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":1536,"new_prefill":31785,"score_linear":-1536.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":2560,"new_prefill":30761,"score_linear":192187.0,"score_lmetric":153730},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":33321,"score_linear":272137.0,"score_lmetric":146952},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":0,"new_prefill":33321,"score_linear":101993.0,"score_lmetric":33321},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":33321,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":20784.0,"chosen_score_lmetric":0,"t_first_token":390369.119888905,"t_first_token_unix":1779821234.1338325,"t_done":390389.614917369,"t_done_unix":1779821254.6288614},{"request_id":"1355484:15:1400281:750","session_id":"1355484","input_length":31469,"t_proxy_recv":390390.125417131,"t_decision_unix":1779821255.1393588,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9924687787981823,"affinity_num_requests":-1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":237,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1756,"cache_hit":31232,"new_prefill":237,"score_linear":-31232.0,"score_lmetric":-237},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":31469,"score_linear":106143.0,"score_lmetric":31469},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":184029,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":12800,"new_prefill":18669,"score_linear":171229.0,"score_lmetric":37338},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":31469,"score_linear":281315.0,"score_lmetric":174108},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":23040,"new_prefill":8429,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":31469,"score_linear":31431.0,"score_lmetric":83050},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":31469,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":12800,"new_prefill":18669,"score_linear":90976.0,"score_lmetric":223386}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":-237,"t_first_token":390390.191826876,"t_first_token_unix":1779821255.2057703,"t_done":390390.947572733,"t_done_unix":1779821255.9615161},{"request_id":"1400379:1:1400379:751","session_id":"1400379","input_length":3707,"t_proxy_recv":390390.436115545,"t_decision_unix":1779821255.4500573,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":3707,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":31469,"ongoing_decode_tokens":31469,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1756,"cache_hit":0,"new_prefill":3707,"score_linear":31469.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":3707,"score_linear":106143.0,"score_lmetric":3707},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":184029,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":3707,"score_linear":184029.0,"score_lmetric":7414},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":3707,"score_linear":281315.0,"score_lmetric":63060},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":3707,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":3707,"score_linear":31431.0,"score_lmetric":27526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":3707,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":3707,"score_linear":103776.0,"score_lmetric":193462}],"chosen_score_linear":31469.0,"chosen_score_lmetric":0,"t_first_token":390390.685892869,"t_first_token_unix":1779821255.699837,"t_done":390391.057210564,"t_done_unix":1779821256.0711536},{"request_id":"1398213:2:1400590:753","session_id":"1398213","input_length":11414,"t_proxy_recv":390391.222423248,"t_decision_unix":1779821256.2363648,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":0,"affinity_cache_hit":3584,"affinity_cache_ratio":0.3140003504468197,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":-11414,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1763,"cache_hit":0,"new_prefill":11414,"score_linear":0.0,"score_lmetric":-11414},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":11414,"score_linear":106143.0,"score_lmetric":11414},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":184029,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":11414,"score_linear":184029.0,"score_lmetric":22828},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":11414,"score_linear":281315.0,"score_lmetric":93888},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":3584,"new_prefill":7830,"score_linear":-3584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":129088,"ongoing_decode_tokens":4991,"pending_prefill_tokens":22209,"num_requests":3,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":11414,"score_linear":129088.0,"score_lmetric":100869},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":11414,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":11414,"score_linear":103776.0,"score_lmetric":208876}],"chosen_score_linear":0.0,"chosen_score_lmetric":-11414,"t_first_token":390392.133547923,"t_first_token_unix":1779821257.1474912,"t_done":390392.527192068,"t_done_unix":1779821257.541135},{"request_id":"1384947:3:1390898:710","session_id":"1384947","input_length":20683,"t_proxy_recv":390374.019742069,"t_decision_unix":1779821239.0336838,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9654305468258957,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":715,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":20683,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":20683,"score_linear":121708.0,"score_lmetric":127452},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174564,"ongoing_decode_tokens":174564,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2242,"cache_hit":19968,"new_prefill":715,"score_linear":154596.0,"score_lmetric":715},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":20683,"score_linear":272137.0,"score_lmetric":96400},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":0,"new_prefill":20683,"score_linear":35450.0,"score_lmetric":56133},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":85276,"ongoing_decode_tokens":0,"pending_prefill_tokens":284,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":20683,"score_linear":85276.0,"score_lmetric":20967},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":20683,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":20683,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":154596.0,"chosen_score_lmetric":715,"t_first_token":390374.160618885,"t_first_token_unix":1779821239.1745622,"t_done":390392.560569947,"t_done_unix":1779821257.574513},{"request_id":"1342921:4:1389290:702","session_id":"1342921","input_length":70990,"t_proxy_recv":390377.650448653,"t_decision_unix":1779821242.66439,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9736582617270038,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":1870,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":70990,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":70990,"score_linear":121708.0,"score_lmetric":278373},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":70990,"score_linear":184029.0,"score_lmetric":199154},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":145016,"ongoing_decode_tokens":145016,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":69120,"new_prefill":1870,"score_linear":75896.0,"score_lmetric":3740},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":70990,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":70990,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":21241,"ongoing_decode_tokens":21241,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":70990,"score_linear":21241.0,"score_lmetric":70990},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":70990,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":75896.0,"chosen_score_lmetric":3740,"t_first_token":390378.421595617,"t_first_token_unix":1779821243.4355395,"t_done":390395.355879207,"t_done_unix":1779821260.3698275},{"request_id":"1313181:6:1379623:639","session_id":"1313181","input_length":61543,"t_proxy_recv":390374.205829806,"t_decision_unix":1779821239.2197711,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9983263734299596,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":103,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":12800,"new_prefill":48743,"score_linear":20521.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":61543,"score_linear":121708.0,"score_lmetric":250032},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":88942,"ongoing_decode_tokens":88942,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2244,"cache_hit":61440,"new_prefill":103,"score_linear":27502.0,"score_lmetric":103},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":61543,"score_linear":272137.0,"score_lmetric":259840},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":12800,"new_prefill":48743,"score_linear":22650.0,"score_lmetric":84193},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":85276,"ongoing_decode_tokens":0,"pending_prefill_tokens":284,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":61543,"score_linear":85276.0,"score_lmetric":61827},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":61543,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":12800,"new_prefill":48743,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":27502.0,"chosen_score_lmetric":103,"t_first_token":390374.298033945,"t_first_token_unix":1779821239.3119771,"t_done":390396.397366012,"t_done_unix":1779821261.4113095},{"request_id":"1400379:2:1401201:757","session_id":"1400379","input_length":3863,"t_proxy_recv":390393.550698044,"t_decision_unix":1779821258.5646396,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":3584,"affinity_cache_ratio":0.92777633963241,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":3584,"estimated_new_tokens":279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":62630,"ongoing_decode_tokens":0,"pending_prefill_tokens":13478,"num_requests":0,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":3584,"new_prefill":279,"score_linear":59046.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":3863,"score_linear":106143.0,"score_lmetric":3863},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":163346,"ongoing_decode_tokens":163346,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2249,"cache_hit":0,"new_prefill":3863,"score_linear":163346.0,"score_lmetric":3863},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":3863,"score_linear":281315.0,"score_lmetric":63684},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":3863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":31431,"pending_prefill_tokens":29574,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":3863,"score_linear":197197.0,"score_lmetric":133748},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":3863,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":3863,"score_linear":103776.0,"score_lmetric":193774}],"chosen_score_linear":59046.0,"chosen_score_lmetric":0,"t_first_token":390398.235326059,"t_first_token_unix":1779821263.2492697,"t_done":390399.18196069,"t_done_unix":1779821264.195904},{"request_id":"1373431:1:1373431:606","session_id":"1373431","input_length":126340,"t_proxy_recv":390296.321465002,"t_decision_unix":1779821161.335406,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":126340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":64957,"ongoing_decode_tokens":64957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1455,"cache_hit":1024,"new_prefill":125316,"score_linear":63933.0,"score_lmetric":250632},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1195,"cache_hit":0,"new_prefill":126340,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":128263,"ongoing_decode_tokens":128263,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2059,"cache_hit":0,"new_prefill":126340,"score_linear":128263.0,"score_lmetric":126340},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":126340,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":191344,"ongoing_decode_tokens":191344,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1177,"cache_hit":0,"new_prefill":126340,"score_linear":191344.0,"score_lmetric":379020},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":80246,"ongoing_decode_tokens":80246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1139,"cache_hit":0,"new_prefill":126340,"score_linear":80246.0,"score_lmetric":126340},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":117888,"ongoing_decode_tokens":117888,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1099,"cache_hit":0,"new_prefill":126340,"score_linear":117888.0,"score_lmetric":126340},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":10284,"ongoing_decode_tokens":0,"pending_prefill_tokens":10284,"num_requests":1,"active_p_offloads":0,"cached_blocks":1496,"cache_hit":0,"new_prefill":126340,"score_linear":10284.0,"score_lmetric":136624}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390346.912545486,"t_first_token_unix":1779821211.9264886,"t_done":390399.731574497,"t_done_unix":1779821264.7455184},{"request_id":"1363943:7:1377305:623","session_id":"1363943","input_length":20727,"t_proxy_recv":390382.175818192,"t_decision_unix":1779821247.1897597,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9139769382930477,"affinity_num_requests":2,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":1783,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":8704,"new_prefill":12023,"score_linear":24617.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":111006,"ongoing_decode_tokens":111006,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":4096,"new_prefill":16631,"score_linear":106910.0,"score_lmetric":33262},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":20727,"score_linear":184029.0,"score_lmetric":98628},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":197330,"ongoing_decode_tokens":197330,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":18944,"new_prefill":1783,"score_linear":178386.0,"score_lmetric":3566},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":4096,"new_prefill":16631,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":4096,"new_prefill":16631,"score_linear":12454.0,"score_lmetric":33181},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":4096,"new_prefill":16631,"score_linear":9038.0,"score_lmetric":16631},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":92528,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":4096,"new_prefill":16631,"score_linear":88944.0,"score_lmetric":109159}],"chosen_score_linear":178386.0,"chosen_score_lmetric":3566,"t_first_token":390382.524236755,"t_first_token_unix":1779821247.538181,"t_done":390399.815124167,"t_done_unix":1779821264.8290691},{"request_id":"1253743:8:1398344:743","session_id":"1253743","input_length":63258,"t_proxy_recv":390383.456513587,"t_decision_unix":1779821248.4704542,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":51200,"affinity_cache_ratio":0.8093837933542003,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":12058,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":67758,"ongoing_decode_tokens":36534,"pending_prefill_tokens":2552,"num_requests":2,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":17408,"new_prefill":45850,"score_linear":50350.0,"score_lmetric":96804},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":4608,"new_prefill":58650,"score_linear":101535.0,"score_lmetric":58650},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":63258,"score_linear":184029.0,"score_lmetric":183690},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":218057,"ongoing_decode_tokens":218057,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":51200,"new_prefill":12058,"score_linear":166857.0,"score_lmetric":36174},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":3891,"ongoing_decode_tokens":3891,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":63258,"score_linear":3891.0,"score_lmetric":63258},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16550,"ongoing_decode_tokens":16550,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":63258,"score_linear":16550.0,"score_lmetric":63258},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":63258,"score_linear":13134.0,"score_lmetric":63258},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":63258,"score_linear":103776.0,"score_lmetric":312564}],"chosen_score_linear":166857.0,"chosen_score_lmetric":36174,"t_first_token":390397.703361565,"t_first_token_unix":1779821262.717306,"t_done":390400.508449961,"t_done_unix":1779821265.5223932},{"request_id":"1400379:3:1402972:763","session_id":"1400379","input_length":11216,"t_proxy_recv":390399.767142561,"t_decision_unix":1779821264.781084,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":0,"chosen_idx":4,"affinity_cache_hit":3584,"affinity_cache_ratio":0.3195435092724679,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":11216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":3584,"new_prefill":7632,"score_linear":104288.0,"score_lmetric":15264},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":11216,"score_linear":106143.0,"score_lmetric":11216},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":11216,"score_linear":223614.0,"score_lmetric":71075},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":211252,"ongoing_decode_tokens":83985,"pending_prefill_tokens":803,"num_requests":3,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":0,"new_prefill":11216,"score_linear":211252.0,"score_lmetric":36057},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":11216,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":11216,"score_linear":197197.0,"score_lmetric":114548},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":11216,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":11216,"score_linear":103776.0,"score_lmetric":208480}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390400.655700624,"t_first_token_unix":1779821265.6696434,"t_done":390400.893636344,"t_done_unix":1779821265.9075801},{"request_id":"1403188:1:1403188:764","session_id":"1403188","input_length":8848,"t_proxy_recv":390400.664029136,"t_decision_unix":1779821265.6779702,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":6,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":8848,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":8848,"score_linear":107872.0,"score_lmetric":17696},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":8848,"score_linear":106143.0,"score_lmetric":8848},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":8848,"score_linear":223614.0,"score_lmetric":68707},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":148215,"ongoing_decode_tokens":148215,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1983,"cache_hit":0,"new_prefill":8848,"score_linear":148215.0,"score_lmetric":17696},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":11216,"ongoing_decode_tokens":11216,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":8848,"score_linear":11216.0,"score_lmetric":8848},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":8848,"score_linear":197197.0,"score_lmetric":105076},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":8848,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":8848,"score_linear":103776.0,"score_lmetric":203744}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390401.339965553,"t_first_token_unix":1779821266.353909,"t_done":390401.903137175,"t_done_unix":1779821266.9170802},{"request_id":"1373431:2:1378320:629","session_id":"1373431","input_length":127267,"t_proxy_recv":390399.754301154,"t_decision_unix":1779821264.7682424,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":126464,"affinity_cache_ratio":0.9936904303550803,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":126464,"estimated_new_tokens":803,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":1024,"new_prefill":126243,"score_linear":106848.0,"score_lmetric":252486},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":127267,"score_linear":106143.0,"score_lmetric":127267},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":127267,"score_linear":223614.0,"score_lmetric":187126},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83985,"ongoing_decode_tokens":83985,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1957,"cache_hit":126464,"new_prefill":803,"score_linear":-42479.0,"score_lmetric":1606},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":127267,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":127267,"score_linear":197197.0,"score_lmetric":578752},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":1024,"new_prefill":126243,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":127267,"score_linear":103776.0,"score_lmetric":440582}],"chosen_score_linear":-42479.0,"chosen_score_lmetric":1606,"t_first_token":390400.385197388,"t_first_token_unix":1779821265.3991406,"t_done":390402.257614147,"t_done_unix":1779821267.2715573},{"request_id":"1403989:1:1403989:767","session_id":"1403989","input_length":1954,"t_proxy_recv":390403.164955756,"t_decision_unix":1779821268.178897,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1954,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":1954,"score_linear":107872.0,"score_lmetric":3908},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":1954,"score_linear":106143.0,"score_lmetric":1954},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":1954,"score_linear":223614.0,"score_lmetric":61813},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":149149,"ongoing_decode_tokens":149149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1984,"cache_hit":0,"new_prefill":1954,"score_linear":149149.0,"score_lmetric":3908},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1570,"cache_hit":0,"new_prefill":1954,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":1954,"score_linear":197197.0,"score_lmetric":77500},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":1954,"score_linear":44148.0,"score_lmetric":4630},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":1954,"score_linear":103776.0,"score_lmetric":189956}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390403.289344892,"t_first_token_unix":1779821268.3032882,"t_done":390403.633814588,"t_done_unix":1779821268.647758},{"request_id":"1373431:3:1383388:667","session_id":"1373431","input_length":128201,"t_proxy_recv":390402.277838405,"t_decision_unix":1779821267.29178,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":126976,"affinity_cache_ratio":0.9904446923190927,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":126976,"estimated_new_tokens":1225,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":1024,"new_prefill":127177,"score_linear":106848.0,"score_lmetric":254354},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":128201,"score_linear":106143.0,"score_lmetric":128201},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":128201,"score_linear":223614.0,"score_lmetric":188060},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1984,"cache_hit":126976,"new_prefill":1225,"score_linear":-106028.0,"score_lmetric":1225},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1570,"cache_hit":0,"new_prefill":128201,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":128201,"score_linear":197197.0,"score_lmetric":582488},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":1024,"new_prefill":127177,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":128201,"score_linear":103776.0,"score_lmetric":442450}],"chosen_score_linear":-106028.0,"chosen_score_lmetric":1225,"t_first_token":390403.147859509,"t_first_token_unix":1779821268.1618037,"t_done":390404.462818811,"t_done_unix":1779821269.4767628},{"request_id":"1253743:8:1404284:769","session_id":"1253743","input_length":63643,"t_proxy_recv":390404.186207297,"t_decision_unix":1779821269.2001486,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9895196643778578,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":667,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":17408,"new_prefill":46235,"score_linear":90464.0,"score_lmetric":92470},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":4608,"new_prefill":59035,"score_linear":101535.0,"score_lmetric":59035},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":63643,"score_linear":223614.0,"score_lmetric":123502},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":149149,"ongoing_decode_tokens":149149,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1984,"cache_hit":62976,"new_prefill":667,"score_linear":86173.0,"score_lmetric":1334},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":63643,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":63643,"score_linear":197197.0,"score_lmetric":324256},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":63643,"score_linear":44148.0,"score_lmetric":66319},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":63643,"score_linear":103776.0,"score_lmetric":313334}],"chosen_score_linear":86173.0,"chosen_score_lmetric":1334,"t_first_token":390404.452013287,"t_first_token_unix":1779821269.4659572,"t_done":390405.240837805,"t_done_unix":1779821270.2547827},{"request_id":"1398213:3:1401507:759","session_id":"1398213","input_length":12910,"t_proxy_recv":390394.651574523,"t_decision_unix":1779821259.6655161,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":11264,"affinity_cache_ratio":0.8725019364833463,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":1646,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":98825,"ongoing_decode_tokens":0,"pending_prefill_tokens":14857,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":11264,"new_prefill":1646,"score_linear":87561.0,"score_lmetric":33006},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":12910,"score_linear":106143.0,"score_lmetric":12910},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":163346,"ongoing_decode_tokens":163346,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2249,"cache_hit":0,"new_prefill":12910,"score_linear":163346.0,"score_lmetric":12910},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":12910,"score_linear":281315.0,"score_lmetric":99872},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":3584,"new_prefill":9326,"score_linear":-3584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":31431,"pending_prefill_tokens":29574,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":12910,"score_linear":197197.0,"score_lmetric":169936},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":12910,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":12910,"score_linear":103776.0,"score_lmetric":211868}],"chosen_score_linear":87561.0,"chosen_score_lmetric":33006,"t_first_token":390398.233902962,"t_first_token_unix":1779821263.2478466,"t_done":390405.484256927,"t_done_unix":1779821270.4982002},{"request_id":"1399948:1:1399948:748","session_id":"1399948","input_length":4991,"t_proxy_recv":390389.118765994,"t_decision_unix":1779821254.1327069,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":5,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.125,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":4991,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1745,"cache_hit":0,"new_prefill":4991,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":4991,"score_linear":106143.0,"score_lmetric":4991},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":4991,"score_linear":184029.0,"score_lmetric":67156},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":4991,"score_linear":281315.0,"score_lmetric":68196},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":4991,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":4991,"score_linear":103776.0,"score_lmetric":196030}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390389.43302578,"t_first_token_unix":1779821254.4469697,"t_done":390405.488729734,"t_done_unix":1779821270.502673},{"request_id":"1397840:2:1400216:749","session_id":"1397840","input_length":26440,"t_proxy_recv":390389.919867822,"t_decision_unix":1779821254.9338088,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":16384,"affinity_cache_ratio":0.6196671709531013,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":10056,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1756,"cache_hit":0,"new_prefill":26440,"score_linear":0.0,"score_lmetric":-26440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":26440,"score_linear":106143.0,"score_lmetric":26440},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":184029,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":26440,"score_linear":184029.0,"score_lmetric":52880},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":26440,"score_linear":281315.0,"score_lmetric":153992},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":26440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":4991,"ongoing_decode_tokens":4991,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":16384,"new_prefill":10056,"score_linear":-11393.0,"score_lmetric":10056},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":26440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":26440,"score_linear":103776.0,"score_lmetric":238928}],"chosen_score_linear":-11393.0,"chosen_score_lmetric":10056,"t_first_token":390391.629789791,"t_first_token_unix":1779821256.6437333,"t_done":390405.557288757,"t_done_unix":1779821270.5712318},{"request_id":"1397840:3:1402568:761","session_id":"1397840","input_length":28603,"t_proxy_recv":390405.564755016,"t_decision_unix":1779821270.5786965,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9129112330874384,"affinity_num_requests":2,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":2491,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":94962,"ongoing_decode_tokens":94962,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":28603,"score_linear":94962.0,"score_lmetric":28603},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":28603,"score_linear":106143.0,"score_lmetric":28603},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":28603,"score_linear":223614.0,"score_lmetric":88462},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":28603,"score_linear":20948.0,"score_lmetric":28603},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":28603,"score_linear":21684.0,"score_lmetric":50287},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165766,"ongoing_decode_tokens":165766,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":26112,"new_prefill":2491,"score_linear":139654.0,"score_lmetric":4982},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":28603,"score_linear":44148.0,"score_lmetric":31279},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":28603,"score_linear":103776.0,"score_lmetric":243254}],"chosen_score_linear":139654.0,"chosen_score_lmetric":4982,"t_first_token":390406.101155028,"t_first_token_unix":1779821271.115099,"t_done":390406.539030149,"t_done_unix":1779821271.5529735},{"request_id":"1364090:5:1401054:756","session_id":"1364090","input_length":62630,"t_proxy_recv":390393.066462613,"t_decision_unix":1779821258.080404,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49152,"affinity_cache_ratio":0.7847996167970621,"affinity_num_requests":-1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":13478,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":49152,"new_prefill":13478,"score_linear":-49152.0,"score_lmetric":-13478},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":7680,"new_prefill":54950,"score_linear":98463.0,"score_lmetric":54950},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":163346,"ongoing_decode_tokens":163346,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2249,"cache_hit":0,"new_prefill":62630,"score_linear":163346.0,"score_lmetric":62630},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":7680,"new_prefill":54950,"score_linear":273635.0,"score_lmetric":268032},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":14336,"new_prefill":48294,"score_linear":-14336.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":31431,"pending_prefill_tokens":29574,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":11264,"new_prefill":51366,"score_linear":185933.0,"score_lmetric":323760},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":11264,"new_prefill":51366,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":7680,"new_prefill":54950,"score_linear":96096.0,"score_lmetric":295948}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":-13478,"t_first_token":390397.853797644,"t_first_token_unix":1779821262.8677416,"t_done":390406.545450263,"t_done_unix":1779821271.5593936},{"request_id":"1355484:16:1401320:758","session_id":"1355484","input_length":32332,"t_proxy_recv":390394.002514984,"t_decision_unix":1779821259.0164561,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9659779784733391,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":1100,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66493,"ongoing_decode_tokens":0,"pending_prefill_tokens":13757,"num_requests":1,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":31232,"new_prefill":1100,"score_linear":35261.0,"score_lmetric":14857},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":32332,"score_linear":106143.0,"score_lmetric":32332},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":163346,"ongoing_decode_tokens":163346,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2249,"cache_hit":12800,"new_prefill":19532,"score_linear":150546.0,"score_lmetric":19532},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":32332,"score_linear":281315.0,"score_lmetric":177560},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":23040,"new_prefill":9292,"score_linear":-23040.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":31431,"pending_prefill_tokens":29574,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":32332,"score_linear":197197.0,"score_lmetric":247624},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":32332,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":12800,"new_prefill":19532,"score_linear":90976.0,"score_lmetric":225112}],"chosen_score_linear":35261.0,"chosen_score_lmetric":14857,"t_first_token":390398.230802092,"t_first_token_unix":1779821263.2447462,"t_done":390406.630680273,"t_done_unix":1779821271.6446235},{"request_id":"1366128:20:1400446:752","session_id":"1366128","input_length":97657,"t_proxy_recv":390390.696817162,"t_decision_unix":1779821255.7107584,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":85504,"affinity_cache_ratio":0.8755542357434695,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":12153,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":35176,"ongoing_decode_tokens":35176,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1756,"cache_hit":0,"new_prefill":97657,"score_linear":35176.0,"score_lmetric":97657},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":97657,"score_linear":106143.0,"score_lmetric":97657},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":184029,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":97657,"score_linear":184029.0,"score_lmetric":195314},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":97657,"score_linear":281315.0,"score_lmetric":438860},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":15360,"new_prefill":82297,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":31431,"ongoing_decode_tokens":4991,"pending_prefill_tokens":10056,"num_requests":2,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":85504,"new_prefill":12153,"score_linear":-54073.0,"score_lmetric":44418},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":97657,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":97657,"score_linear":103776.0,"score_lmetric":381362}],"chosen_score_linear":-54073.0,"chosen_score_lmetric":44418,"t_first_token":390398.483217781,"t_first_token_unix":1779821263.4971619,"t_done":390406.945118906,"t_done_unix":1779821271.9590664},{"request_id":"1382089:2:1404847:773","session_id":"1382089","input_length":39203,"t_proxy_recv":390406.177151595,"t_decision_unix":1779821271.1910927,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9664566487258628,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":94962,"ongoing_decode_tokens":94962,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":39203,"score_linear":94962.0,"score_lmetric":39203},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":37888,"new_prefill":1315,"score_linear":68255.0,"score_lmetric":1315},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":39203,"score_linear":223614.0,"score_lmetric":99062},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":39203,"score_linear":41957.0,"score_lmetric":120424},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":34816,"new_prefill":4387,"score_linear":-13132.0,"score_lmetric":26071},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":194369,"ongoing_decode_tokens":194369,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":39203,"score_linear":194369.0,"score_lmetric":117609},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":39203,"score_linear":44148.0,"score_lmetric":41879},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":39203,"score_linear":103776.0,"score_lmetric":264454}],"chosen_score_linear":68255.0,"chosen_score_lmetric":1315,"t_first_token":390406.566797418,"t_first_token_unix":1779821271.5807412,"t_done":390407.186885314,"t_done_unix":1779821272.2008283},{"request_id":"1366128:21:1402408:760","session_id":"1366128","input_length":97814,"t_proxy_recv":390406.961161966,"t_decision_unix":1779821271.9751034,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9945406588013985,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":534,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":97814,"score_linear":0.0,"score_lmetric":-97814},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":145346,"ongoing_decode_tokens":145346,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":97814,"score_linear":145346.0,"score_lmetric":195628},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":97814,"score_linear":223614.0,"score_lmetric":157673},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":97814,"score_linear":41957.0,"score_lmetric":237646},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":15360,"new_prefill":82454,"score_linear":6324.0,"score_lmetric":82454},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68109,"ongoing_decode_tokens":68109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1529,"cache_hit":97280,"new_prefill":534,"score_linear":-29171.0,"score_lmetric":534},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":97814,"score_linear":44148.0,"score_lmetric":100490},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":97814,"score_linear":189214.0,"score_lmetric":584604}],"chosen_score_linear":-29171.0,"chosen_score_lmetric":534,"t_first_token":390407.169859361,"t_first_token_unix":1779821272.1838055,"t_done":390407.934939773,"t_done_unix":1779821272.9488838},{"request_id":"1398594:2:1404702:771","session_id":"1398594","input_length":21009,"t_proxy_recv":390405.670978275,"t_decision_unix":1779821270.6849196,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.3655576181636441,"affinity_num_requests":3,"avg_num_requests":1.375,"fallback_score":21009,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":21009,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":94962,"ongoing_decode_tokens":94962,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":21009,"score_linear":94962.0,"score_lmetric":21009},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":21009,"score_linear":106143.0,"score_lmetric":21009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":21009,"score_linear":223614.0,"score_lmetric":80868},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":21009,"score_linear":20948.0,"score_lmetric":21009},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":21009,"score_linear":21684.0,"score_lmetric":42693},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":194369,"ongoing_decode_tokens":165766,"pending_prefill_tokens":2491,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":7680,"new_prefill":13329,"score_linear":186689.0,"score_lmetric":47460},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":21009,"score_linear":44148.0,"score_lmetric":23685},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":21009,"score_linear":103776.0,"score_lmetric":228066}],"chosen_score_linear":20948.0,"chosen_score_lmetric":21009,"t_first_token":390407.872238277,"t_first_token_unix":1779821272.886182,"t_done":390408.110932016,"t_done_unix":1779821273.124875},{"request_id":"1399948:2:1405276:778","session_id":"1399948","input_length":6149,"t_proxy_recv":390407.628997611,"t_decision_unix":1779821272.642939,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":4608,"affinity_cache_ratio":0.7493901447389819,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":1541,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":6149,"score_linear":157705.0,"score_lmetric":107548},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":6149,"score_linear":106143.0,"score_lmetric":6149},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":6149,"score_linear":223614.0,"score_lmetric":66008},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":6149,"score_linear":41957.0,"score_lmetric":54316},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":6149,"score_linear":21684.0,"score_lmetric":6149},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165923,"ongoing_decode_tokens":165923,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1529,"cache_hit":4608,"new_prefill":1541,"score_linear":161315.0,"score_lmetric":3082},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":6149,"score_linear":44148.0,"score_lmetric":8825},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":6149,"score_linear":189214.0,"score_lmetric":309609}],"chosen_score_linear":161315.0,"chosen_score_lmetric":3082,"t_first_token":390407.887787452,"t_first_token_unix":1779821272.9017308,"t_done":390408.143796041,"t_done_unix":1779821273.1577387},{"request_id":"1366128:22:1403837:766","session_id":"1366128","input_length":97917,"t_proxy_recv":390407.959867179,"t_decision_unix":1779821272.9738085,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9987234086011622,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":125,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":97917,"score_linear":157705.0,"score_lmetric":291084},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":97917,"score_linear":106143.0,"score_lmetric":97917},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":97917,"score_linear":223614.0,"score_lmetric":157776},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":41957,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":97917,"score_linear":41957.0,"score_lmetric":195834},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":15360,"new_prefill":82557,"score_linear":6324.0,"score_lmetric":82557},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":74258,"ongoing_decode_tokens":74258,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1530,"cache_hit":97792,"new_prefill":125,"score_linear":-23534.0,"score_lmetric":250},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":97917,"score_linear":44148.0,"score_lmetric":100593},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":97917,"score_linear":189214.0,"score_lmetric":584913}],"chosen_score_linear":-23534.0,"chosen_score_lmetric":250,"t_first_token":390408.142582738,"t_first_token_unix":1779821273.156526,"t_done":390408.261233694,"t_done_unix":1779821273.2751775},{"request_id":"1381387:4:1400724:754","session_id":"1381387","input_length":68109,"t_proxy_recv":390391.798830629,"t_decision_unix":1779821256.8127718,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":50688,"affinity_cache_ratio":0.7442188257058538,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":50688,"estimated_new_tokens":17421,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":11414,"ongoing_decode_tokens":0,"pending_prefill_tokens":11414,"num_requests":0,"active_p_offloads":0,"cached_blocks":1763,"cache_hit":0,"new_prefill":68109,"score_linear":11414.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":68109,"score_linear":106143.0,"score_lmetric":68109},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":184029,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":68109,"score_linear":184029.0,"score_lmetric":136218},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":281315,"ongoing_decode_tokens":218057,"pending_prefill_tokens":12058,"num_requests":4,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":68109,"score_linear":281315.0,"score_lmetric":320668},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":0,"new_prefill":68109,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":129088,"ongoing_decode_tokens":31431,"pending_prefill_tokens":12153,"num_requests":3,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":50688,"new_prefill":17421,"score_linear":78400.0,"score_lmetric":88722},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":68109,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":68109,"score_linear":103776.0,"score_lmetric":322266}],"chosen_score_linear":78400.0,"chosen_score_lmetric":88722,"t_first_token":390405.056158509,"t_first_token_unix":1779821270.0701034,"t_done":390409.365834283,"t_done_unix":1779821274.3797774},{"request_id":"1400379:4:1405483:779","session_id":"1400379","input_length":19966,"t_proxy_recv":390408.297538386,"t_decision_unix":1779821273.3114798,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":10752,"affinity_cache_ratio":0.5385154763097265,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":9214,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":3584,"new_prefill":16382,"score_linear":154121.0,"score_lmetric":128014},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":19966,"score_linear":106143.0,"score_lmetric":19966},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":19966,"score_linear":223614.0,"score_lmetric":79825},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2028,"cache_hit":0,"new_prefill":19966,"score_linear":20948.0,"score_lmetric":19966},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":10752,"new_prefill":9214,"score_linear":10932.0,"score_lmetric":9214},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68109,"ongoing_decode_tokens":68109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":19966,"score_linear":68109.0,"score_lmetric":19966},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":19966,"score_linear":44148.0,"score_lmetric":22642},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":19966,"score_linear":189214.0,"score_lmetric":351060}],"chosen_score_linear":10932.0,"chosen_score_lmetric":9214,"t_first_token":390409.519975349,"t_first_token_unix":1779821274.5339189,"t_done":390409.890205662,"t_done_unix":1779821274.904149},{"request_id":"1363943:8:1379215:635","session_id":"1363943","input_length":20948,"t_proxy_recv":390399.821292704,"t_decision_unix":1779821264.8352344,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":20480,"affinity_cache_ratio":0.97765896505633,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":468,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":8704,"new_prefill":12244,"score_linear":99168.0,"score_lmetric":24488},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":4096,"new_prefill":16852,"score_linear":102047.0,"score_lmetric":16852},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":20948,"score_linear":223614.0,"score_lmetric":80807},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":190525,"ongoing_decode_tokens":63258,"pending_prefill_tokens":803,"num_requests":2,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":20480,"new_prefill":468,"score_linear":170045.0,"score_lmetric":2542},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":11216,"ongoing_decode_tokens":0,"pending_prefill_tokens":11216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":4096,"new_prefill":16852,"score_linear":7120.0,"score_lmetric":28068},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":4096,"new_prefill":16852,"score_linear":193101.0,"score_lmetric":137092},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":4096,"new_prefill":16852,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":4096,"new_prefill":16852,"score_linear":99680.0,"score_lmetric":219752}],"chosen_score_linear":170045.0,"chosen_score_lmetric":2542,"t_first_token":390400.473359111,"t_first_token_unix":1779821265.4873023,"t_done":390411.916143018,"t_done_unix":1779821276.9300864},{"request_id":"1400379:5:1406380:784","session_id":"1400379","input_length":22009,"t_proxy_recv":390411.679488912,"t_decision_unix":1779821276.69343,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9072652096869462,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":2041,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":3584,"new_prefill":18425,"score_linear":154121.0,"score_lmetric":132100},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":22009,"score_linear":106143.0,"score_lmetric":22009},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":22009,"score_linear":223614.0,"score_lmetric":81868},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2028,"cache_hit":0,"new_prefill":22009,"score_linear":20948.0,"score_lmetric":22009},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":19968,"new_prefill":2041,"score_linear":1716.0,"score_lmetric":2041},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":22009,"score_linear":187077.0,"score_lmetric":106926},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":22009,"score_linear":164125.0,"score_lmetric":51524},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":22009,"score_linear":189214.0,"score_lmetric":78117}],"chosen_score_linear":1716.0,"chosen_score_lmetric":2041,"t_first_token":390412.070296022,"t_first_token_unix":1779821277.0842397,"t_done":390412.577273914,"t_done_unix":1779821277.5912185},{"request_id":"1406966:1:1406966:785","session_id":"1406966","input_length":2115,"t_proxy_recv":390413.658956978,"t_decision_unix":1779821278.672898,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":2115,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":2115,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":2115,"score_linear":157705.0,"score_lmetric":10586},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":2115,"score_linear":106143.0,"score_lmetric":2115},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":2115,"score_linear":223614.0,"score_lmetric":61974},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":2115,"score_linear":23641.0,"score_lmetric":2115},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":2115,"score_linear":21684.0,"score_lmetric":2115},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":2115,"score_linear":187077.0,"score_lmetric":47244},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":2115,"score_linear":164125.0,"score_lmetric":11736},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":2115,"score_linear":189214.0,"score_lmetric":18435}],"chosen_score_linear":106143.0,"chosen_score_lmetric":2115,"t_first_token":390413.979470092,"t_first_token_unix":1779821278.9934134,"t_done":390414.532787878,"t_done_unix":1779821279.5467343},{"request_id":"1407494:1:1407494:787","session_id":"1407494","input_length":1531,"t_proxy_recv":390415.454796868,"t_decision_unix":1779821280.4687383,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.75,"fallback_score":1531,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":1531,"score_linear":157705.0,"score_lmetric":9418},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":0,"new_prefill":1531,"score_linear":106143.0,"score_lmetric":1531},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":1531,"score_linear":223614.0,"score_lmetric":61390},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":1531,"score_linear":23641.0,"score_lmetric":1531},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":1531,"score_linear":21684.0,"score_lmetric":1531},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":1531,"score_linear":187077.0,"score_lmetric":45492},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":1531,"score_linear":164125.0,"score_lmetric":10568},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":1531,"score_linear":189214.0,"score_lmetric":16683}],"chosen_score_linear":23641.0,"chosen_score_lmetric":1531,"t_first_token":390415.593533395,"t_first_token_unix":1779821280.607477,"t_done":390415.987977919,"t_done_unix":1779821281.001922},{"request_id":"1404395:1:1404395:770","session_id":"1404395","input_length":21684,"t_proxy_recv":390404.574842637,"t_decision_unix":1779821269.5887842,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.625,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":21684,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":512,"new_prefill":21172,"score_linear":107360.0,"score_lmetric":42344},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":512,"new_prefill":21172,"score_linear":105631.0,"score_lmetric":21172},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":512,"new_prefill":21172,"score_linear":223102.0,"score_lmetric":81031},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84591,"ongoing_decode_tokens":84591,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1986,"cache_hit":0,"new_prefill":21684,"score_linear":84591.0,"score_lmetric":43368},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":21684,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":21684,"score_linear":197197.0,"score_lmetric":156420},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":21684,"score_linear":44148.0,"score_lmetric":24360},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":21684,"score_linear":103776.0,"score_lmetric":229416}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390406.907708162,"t_first_token_unix":1779821271.9216514,"t_done":390416.056041358,"t_done_unix":1779821281.069985},{"request_id":"1406966:2:1407710:789","session_id":"1406966","input_length":4789,"t_proxy_recv":390416.136530172,"t_decision_unix":1779821281.1504717,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":4,"affinity_cache_hit":2048,"affinity_cache_ratio":0.42764669033201086,"affinity_num_requests":2,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":4789,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":4789,"score_linear":157705.0,"score_lmetric":15934},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":2048,"new_prefill":2741,"score_linear":105596.0,"score_lmetric":5482},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":4789,"score_linear":223614.0,"score_lmetric":64648},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2033,"cache_hit":0,"new_prefill":4789,"score_linear":23641.0,"score_lmetric":4789},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":4789,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":4789,"score_linear":187077.0,"score_lmetric":55266},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":4789,"score_linear":164125.0,"score_lmetric":17084},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":4789,"score_linear":189214.0,"score_lmetric":26457}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390416.435560295,"t_first_token_unix":1779821281.4495037,"t_done":390416.654434996,"t_done_unix":1779821281.668378},{"request_id":"1363943:9:1390468:707","session_id":"1363943","input_length":23641,"t_proxy_recv":390411.922259235,"t_decision_unix":1779821276.9362009,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9096061926314454,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":2137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":8704,"new_prefill":14937,"score_linear":149001.0,"score_lmetric":125124},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":4096,"new_prefill":19545,"score_linear":102047.0,"score_lmetric":19545},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":23641,"score_linear":223614.0,"score_lmetric":83500},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":21504,"new_prefill":2137,"score_linear":-21504.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":43693,"ongoing_decode_tokens":21684,"pending_prefill_tokens":2041,"num_requests":2,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":4096,"new_prefill":19545,"score_linear":39597.0,"score_lmetric":43172},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":4096,"new_prefill":19545,"score_linear":182981.0,"score_lmetric":99534},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":4096,"new_prefill":19545,"score_linear":160029.0,"score_lmetric":46596},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":4096,"new_prefill":19545,"score_linear":185118.0,"score_lmetric":70725}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":390412.279062161,"t_first_token_unix":1779821277.2930052,"t_done":390417.066080582,"t_done_unix":1779821282.0800238},{"request_id":"1407995:1:1407995:793","session_id":"1407995","input_length":2944,"t_proxy_recv":390417.297545912,"t_decision_unix":1779821282.311487,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.0,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":2944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":2944,"score_linear":157705.0,"score_lmetric":12244},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":0,"new_prefill":2944,"score_linear":107644.0,"score_lmetric":5888},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":2944,"score_linear":251290.0,"score_lmetric":136926},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":2944,"score_linear":24442.0,"score_lmetric":2944},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":0,"new_prefill":2944,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":2944,"score_linear":187077.0,"score_lmetric":49731},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":2944,"score_linear":164125.0,"score_lmetric":13394},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":2944,"score_linear":262402.0,"score_lmetric":46216}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390417.479831948,"t_first_token_unix":1779821282.4937751,"t_done":390417.856292195,"t_done_unix":1779821282.870236},{"request_id":"1407599:1:1407599:788","session_id":"1407599","input_length":1501,"t_proxy_recv":390415.802411972,"t_decision_unix":1779821280.816353,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":1,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.875,"fallback_score":1501,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":1501,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":1501,"score_linear":157705.0,"score_lmetric":9358},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":0,"new_prefill":1501,"score_linear":106143.0,"score_lmetric":1501},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":1501,"score_linear":223614.0,"score_lmetric":61360},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":25172,"ongoing_decode_tokens":25172,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":1501,"score_linear":25172.0,"score_lmetric":3002},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1595,"cache_hit":0,"new_prefill":1501,"score_linear":21684.0,"score_lmetric":1501},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":1501,"score_linear":187077.0,"score_lmetric":45402},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":1501,"score_linear":164125.0,"score_lmetric":10508},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":1501,"score_linear":189214.0,"score_lmetric":16593}],"chosen_score_linear":106143.0,"chosen_score_lmetric":1501,"t_first_token":390416.091483372,"t_first_token_unix":1779821281.1054268,"t_done":390418.406918795,"t_done_unix":1779821283.420862},{"request_id":"1399948:3:1405988:782","session_id":"1399948","input_length":7995,"t_proxy_recv":390410.255253641,"t_decision_unix":1779821275.2691953,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":6144,"affinity_cache_ratio":0.7684803001876173,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":6144,"estimated_new_tokens":1851,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":7995,"score_linear":157705.0,"score_lmetric":111240},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":7995,"score_linear":106143.0,"score_lmetric":7995},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":7995,"score_linear":223614.0,"score_lmetric":67854},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2028,"cache_hit":0,"new_prefill":7995,"score_linear":20948.0,"score_lmetric":7995},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":0,"new_prefill":7995,"score_linear":21684.0,"score_lmetric":7995},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":179082,"ongoing_decode_tokens":69508,"pending_prefill_tokens":11782,"num_requests":2,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":6144,"new_prefill":1851,"score_linear":172938.0,"score_lmetric":27266},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":7995,"score_linear":164125.0,"score_lmetric":23496},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":93040,"pending_prefill_tokens":4526,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":7995,"score_linear":189214.0,"score_lmetric":37563}],"chosen_score_linear":172938.0,"chosen_score_lmetric":27266,"t_first_token":390417.71378756,"t_first_token_unix":1779821282.7277317,"t_done":390418.976765535,"t_done_unix":1779821283.9907088},{"request_id":"1399948:4:1407140:786","session_id":"1399948","input_length":8540,"t_proxy_recv":390418.980988209,"t_decision_unix":1779821283.994929,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":7680,"affinity_cache_ratio":0.8992974238875878,"affinity_num_requests":3,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":860,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":8540,"score_linear":157705.0,"score_lmetric":23436},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":8540,"score_linear":106143.0,"score_lmetric":8540},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":8540,"score_linear":251290.0,"score_lmetric":148118},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":8540,"score_linear":24442.0,"score_lmetric":8540},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":7553,"ongoing_decode_tokens":0,"pending_prefill_tokens":7553,"num_requests":1,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":8540,"score_linear":7553.0,"score_lmetric":16093},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":206868,"ongoing_decode_tokens":206868,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1570,"cache_hit":7680,"new_prefill":860,"score_linear":199188.0,"score_lmetric":2580},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":8540,"score_linear":178853.0,"score_lmetric":54951},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":8540,"score_linear":262402.0,"score_lmetric":68600}],"chosen_score_linear":199188.0,"chosen_score_lmetric":2580,"t_first_token":390419.107885822,"t_first_token_unix":1779821284.1218297,"t_done":390419.506744429,"t_done_unix":1779821284.520688},{"request_id":"1408430:1:1408430:797","session_id":"1408430","input_length":7553,"t_proxy_recv":390418.800905109,"t_decision_unix":1779821283.814846,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.125,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":7553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":7553,"score_linear":157705.0,"score_lmetric":21462},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":7553,"score_linear":106143.0,"score_lmetric":7553},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":7553,"score_linear":251290.0,"score_lmetric":146144},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":7553,"score_linear":24442.0,"score_lmetric":7553},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":7553,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":214863,"ongoing_decode_tokens":214863,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":7553,"score_linear":214863.0,"score_lmetric":30212},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":7553,"score_linear":178853.0,"score_lmetric":51990},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":7553,"score_linear":262402.0,"score_lmetric":64652}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390419.315601695,"t_first_token_unix":1779821284.3295603,"t_done":390419.511015972,"t_done_unix":1779821284.5249593},{"request_id":"1399948:5:1407922:791","session_id":"1399948","input_length":8612,"t_proxy_recv":390419.511956086,"t_decision_unix":1779821284.5258977,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":8192,"affinity_cache_ratio":0.9512308406874129,"affinity_num_requests":3,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":8612,"score_linear":157705.0,"score_lmetric":23580},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":8612,"score_linear":106143.0,"score_lmetric":8612},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":8612,"score_linear":251290.0,"score_lmetric":148262},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30819,"ongoing_decode_tokens":24442,"pending_prefill_tokens":6377,"num_requests":2,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":8612,"score_linear":30819.0,"score_lmetric":29978},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":8612,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":206868,"ongoing_decode_tokens":206868,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1571,"cache_hit":8192,"new_prefill":420,"score_linear":198676.0,"score_lmetric":1260},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":8612,"score_linear":178853.0,"score_lmetric":55167},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":8612,"score_linear":262402.0,"score_lmetric":68888}],"chosen_score_linear":198676.0,"chosen_score_lmetric":1260,"t_first_token":390419.597911808,"t_first_token_unix":1779821284.6118553,"t_done":390420.009400185,"t_done_unix":1779821285.0233436},{"request_id":"1366128:23:1405900:781","session_id":"1366128","input_length":109574,"t_proxy_recv":390409.926204635,"t_decision_unix":1779821274.940146,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":97792,"affinity_cache_ratio":0.8924744921240441,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":11782,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":109574,"score_linear":157705.0,"score_lmetric":314398},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":109574,"score_linear":106143.0,"score_lmetric":109574},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":109574,"score_linear":223614.0,"score_lmetric":169433},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2028,"cache_hit":0,"new_prefill":109574,"score_linear":20948.0,"score_lmetric":109574},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1591,"cache_hit":15360,"new_prefill":94214,"score_linear":6324.0,"score_lmetric":94214},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":69508,"ongoing_decode_tokens":0,"pending_prefill_tokens":1412,"num_requests":1,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":97792,"new_prefill":11782,"score_linear":-28284.0,"score_lmetric":13194},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":0,"pending_prefill_tokens":6429,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":109574,"score_linear":164125.0,"score_lmetric":232006},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":93040,"pending_prefill_tokens":4526,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":109574,"score_linear":189214.0,"score_lmetric":342300}],"chosen_score_linear":-28284.0,"chosen_score_lmetric":13194,"t_first_token":390417.535321978,"t_first_token_unix":1779821282.5492656,"t_done":390420.033213156,"t_done_unix":1779821285.0471609},{"request_id":"1408779:1:1408779:802","session_id":"1408779","input_length":1801,"t_proxy_recv":390419.907884925,"t_decision_unix":1779821284.9218261,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":1801,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":1801,"score_linear":157705.0,"score_lmetric":9958},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":1801,"score_linear":106143.0,"score_lmetric":1801},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":1801,"score_linear":251290.0,"score_lmetric":134640},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30819,"ongoing_decode_tokens":30819,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":1801,"score_linear":30819.0,"score_lmetric":3602},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":1801,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":215480,"ongoing_decode_tokens":215480,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1571,"cache_hit":0,"new_prefill":1801,"score_linear":215480.0,"score_lmetric":7204},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":1801,"score_linear":178853.0,"score_lmetric":34734},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":1801,"score_linear":262402.0,"score_lmetric":41644}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390420.039276465,"t_first_token_unix":1779821285.0532196,"t_done":390420.264888451,"t_done_unix":1779821285.278832},{"request_id":"1340290:7:1408176:795","session_id":"1340290","input_length":27786,"t_proxy_recv":390417.958912789,"t_decision_unix":1779821282.972854,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9766069243503923,"affinity_num_requests":3,"avg_num_requests":2.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":650,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":27786,"score_linear":157705.0,"score_lmetric":61928},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":0,"new_prefill":27786,"score_linear":107644.0,"score_lmetric":55572},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":27786,"score_linear":251290.0,"score_lmetric":186610},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":27786,"score_linear":24442.0,"score_lmetric":27786},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":27786,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":187077,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":27136,"new_prefill":650,"score_linear":159941.0,"score_lmetric":1950},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":1024,"new_prefill":26762,"score_linear":163101.0,"score_lmetric":61030},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":27786,"score_linear":262402.0,"score_lmetric":145584}],"chosen_score_linear":159941.0,"chosen_score_lmetric":1950,"t_first_token":390418.140466963,"t_first_token_unix":1779821283.154411,"t_done":390420.498095769,"t_done_unix":1779821285.5120392},{"request_id":"1370129:6:1394177:722","session_id":"1370129","input_length":106143,"t_proxy_recv":390369.012429383,"t_decision_unix":1779821234.0263705,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88064,"affinity_cache_ratio":0.8296731767521174,"affinity_num_requests":1,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":88064,"estimated_new_tokens":18079,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":82265,"ongoing_decode_tokens":48944,"pending_prefill_tokens":5161,"num_requests":1,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":7680,"new_prefill":98463,"score_linear":74585.0,"score_lmetric":103624},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":4675,"ongoing_decode_tokens":0,"pending_prefill_tokens":4675,"num_requests":1,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":88064,"new_prefill":18079,"score_linear":-83389.0,"score_lmetric":22754},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":194747,"ongoing_decode_tokens":68259,"pending_prefill_tokens":46104,"num_requests":2,"active_p_offloads":0,"cached_blocks":2240,"cache_hit":0,"new_prefill":106143,"score_linear":194747.0,"score_lmetric":304494},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":18432,"new_prefill":87711,"score_linear":253705.0,"score_lmetric":364512},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":101993,"ongoing_decode_tokens":101993,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1472,"cache_hit":7680,"new_prefill":98463,"score_linear":94313.0,"score_lmetric":98463},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1412,"cache_hit":7680,"new_prefill":98463,"score_linear":-7680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":7680,"new_prefill":98463,"score_linear":-7680.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":7680,"new_prefill":98463,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":-83389.0,"chosen_score_lmetric":22754,"t_first_token":390380.34311095,"t_first_token_unix":1779821245.3570552,"t_done":390420.502488447,"t_done_unix":1779821285.5164318},{"request_id":"1408889:1:1408889:804","session_id":"1408889","input_length":3230,"t_proxy_recv":390420.271551005,"t_decision_unix":1779821285.2854924,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":4,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":3230,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":3230,"score_linear":231097.0,"score_lmetric":50472},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":3230,"score_linear":106143.0,"score_lmetric":3230},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":3230,"score_linear":251290.0,"score_lmetric":137498},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30819,"ongoing_decode_tokens":30819,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":3230,"score_linear":30819.0,"score_lmetric":6460},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1669,"cache_hit":0,"new_prefill":3230,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":207069,"ongoing_decode_tokens":97294,"pending_prefill_tokens":207,"num_requests":3,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":0,"new_prefill":3230,"score_linear":207069.0,"score_lmetric":10311},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":3230,"score_linear":178853.0,"score_lmetric":39021},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":3230,"score_linear":262402.0,"score_lmetric":47360}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390420.466815659,"t_first_token_unix":1779821285.4807596,"t_done":390420.590293042,"t_done_unix":1779821285.6042361},{"request_id":"1366128:24:1407996:794","session_id":"1366128","input_length":109775,"t_proxy_recv":390420.049940554,"t_decision_unix":1779821285.0638819,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":109568,"affinity_cache_ratio":0.998114324755181,"affinity_num_requests":2,"avg_num_requests":2.25,"fallback_score":null,"tie_break_used":false,"cache_hit":109568,"estimated_new_tokens":207,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":109775,"score_linear":231097.0,"score_lmetric":370107},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":109775,"score_linear":106143.0,"score_lmetric":109775},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":109775,"score_linear":251290.0,"score_lmetric":350588},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30819,"ongoing_decode_tokens":30819,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":109775,"score_linear":30819.0,"score_lmetric":219550},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":1801,"ongoing_decode_tokens":1801,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":15360,"new_prefill":94415,"score_linear":-13559.0,"score_lmetric":94415},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":97294,"ongoing_decode_tokens":97294,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1594,"cache_hit":109568,"new_prefill":207,"score_linear":-12274.0,"score_lmetric":414},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":109775,"score_linear":178853.0,"score_lmetric":358656},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":109775,"score_linear":262402.0,"score_lmetric":473540}],"chosen_score_linear":-12274.0,"chosen_score_lmetric":414,"t_first_token":390420.314237733,"t_first_token_unix":1779821285.3281813,"t_done":390420.868912139,"t_done_unix":1779821285.8828557},{"request_id":"1381387:5:1404170:768","session_id":"1381387","input_length":69508,"t_proxy_recv":390409.387661699,"t_decision_unix":1779821274.401603,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9796857915635611,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":1412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":69508,"score_linear":157705.0,"score_lmetric":234266},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":69508,"score_linear":106143.0,"score_lmetric":69508},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":69508,"score_linear":223614.0,"score_lmetric":129367},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2028,"cache_hit":0,"new_prefill":69508,"score_linear":20948.0,"score_lmetric":69508},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":41650,"ongoing_decode_tokens":21684,"pending_prefill_tokens":9214,"num_requests":2,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":69508,"score_linear":41650.0,"score_lmetric":157444},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":68096,"new_prefill":1412,"score_linear":-68096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":0,"pending_prefill_tokens":6429,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":69508,"score_linear":164125.0,"score_lmetric":151874},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":93040,"pending_prefill_tokens":4526,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":69508,"score_linear":189214.0,"score_lmetric":222102}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":390410.02181489,"t_first_token_unix":1779821275.0357585,"t_done":390421.168874758,"t_done_unix":1779821286.1828206},{"request_id":"1408578:1:1408578:798","session_id":"1408578","input_length":6377,"t_proxy_recv":390419.221195792,"t_decision_unix":1779821284.2351372,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":3,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":2.25,"fallback_score":6377,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":6377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":6377,"score_linear":157705.0,"score_lmetric":19110},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":0,"new_prefill":6377,"score_linear":106143.0,"score_lmetric":6377},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":6377,"score_linear":251290.0,"score_lmetric":143792},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":6377,"score_linear":24442.0,"score_lmetric":6377},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":7553,"ongoing_decode_tokens":0,"pending_prefill_tokens":7553,"num_requests":1,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":6377,"score_linear":7553.0,"score_lmetric":13930},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":215408,"ongoing_decode_tokens":215408,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1570,"cache_hit":0,"new_prefill":6377,"score_linear":215408.0,"score_lmetric":25508},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":6377,"score_linear":178853.0,"score_lmetric":48462},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":6377,"score_linear":262402.0,"score_lmetric":59948}],"chosen_score_linear":24442.0,"chosen_score_lmetric":6377,"t_first_token":390419.647148971,"t_first_token_unix":1779821284.6610928,"t_done":390421.184162339,"t_done_unix":1779821286.1981056},{"request_id":"1363943:10:1401002:755","session_id":"1363943","input_length":24442,"t_proxy_recv":390417.072251828,"t_decision_unix":1779821282.086193,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9845348171180754,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":378,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":8704,"new_prefill":15738,"score_linear":149001.0,"score_lmetric":37832},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":4096,"new_prefill":20346,"score_linear":103548.0,"score_lmetric":40692},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":24442,"score_linear":223614.0,"score_lmetric":84301},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":24064,"new_prefill":378,"score_linear":-24064.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":4096,"new_prefill":20346,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":4096,"new_prefill":20346,"score_linear":182981.0,"score_lmetric":101937},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":4096,"new_prefill":20346,"score_linear":160029.0,"score_lmetric":48198},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":4096,"new_prefill":20346,"score_linear":258306.0,"score_lmetric":115824}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":390417.142111499,"t_first_token_unix":1779821282.1560547,"t_done":390421.781451072,"t_done_unix":1779821286.7953947},{"request_id":"1362265:5:1398180:741","session_id":"1362265","input_length":10736,"t_proxy_recv":390383.024010989,"t_decision_unix":1779821248.0379527,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10240,"affinity_cache_ratio":0.9538002980625931,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":10240,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":67758,"ongoing_decode_tokens":33321,"pending_prefill_tokens":5765,"num_requests":2,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":10736,"score_linear":67758.0,"score_lmetric":33002},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":10736,"score_linear":106143.0,"score_lmetric":10736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":6656,"new_prefill":4080,"score_linear":177373.0,"score_lmetric":65334},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":218057,"ongoing_decode_tokens":218057,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":10736,"score_linear":218057.0,"score_lmetric":32208},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":9728,"new_prefill":1008,"score_linear":-9728.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":16550,"ongoing_decode_tokens":0,"pending_prefill_tokens":16550,"num_requests":1,"active_p_offloads":0,"cached_blocks":1427,"cache_hit":0,"new_prefill":10736,"score_linear":16550.0,"score_lmetric":27286},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":10736,"score_linear":13134.0,"score_lmetric":10736},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":93040,"ongoing_decode_tokens":0,"pending_prefill_tokens":92528,"num_requests":1,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":10240,"new_prefill":496,"score_linear":82800.0,"score_lmetric":93024}],"chosen_score_linear":82800.0,"chosen_score_lmetric":93024,"t_first_token":390410.904350182,"t_first_token_unix":1779821275.9182937,"t_done":390423.430706986,"t_done_unix":1779821288.44465},{"request_id":"1381387:6:1409195:806","session_id":"1381387","input_length":71570,"t_proxy_recv":390421.543027993,"t_decision_unix":1779821286.5569692,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69632,"affinity_cache_ratio":0.9729216152019002,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":1938,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":71570,"score_linear":231097.0,"score_lmetric":255492},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":71570,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":71570,"score_linear":251290.0,"score_lmetric":274178},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2050,"cache_hit":0,"new_prefill":71570,"score_linear":24442.0,"score_lmetric":71570},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":0,"new_prefill":71570,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":29730,"ongoing_decode_tokens":0,"pending_prefill_tokens":2082,"num_requests":1,"active_p_offloads":0,"cached_blocks":1598,"cache_hit":69632,"new_prefill":1938,"score_linear":-39902.0,"score_lmetric":4020},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":71570,"score_linear":178853.0,"score_lmetric":244041},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":189214,"pending_prefill_tokens":4580,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":71570,"score_linear":262402.0,"score_lmetric":304600}],"chosen_score_linear":-39902.0,"chosen_score_lmetric":4020,"t_first_token":390422.70089406,"t_first_token_unix":1779821287.7148378,"t_done":390423.89336093,"t_done_unix":1779821288.9073048},{"request_id":"1363093:5:1407810:790","session_id":"1363093","input_length":73188,"t_proxy_recv":390416.588217554,"t_decision_unix":1779821281.602159,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":68608,"affinity_cache_ratio":0.9374214352079576,"affinity_num_requests":3,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":68608,"estimated_new_tokens":4580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":73188,"score_linear":157705.0,"score_lmetric":152732},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":0,"new_prefill":73188,"score_linear":107644.0,"score_lmetric":146376},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":73188,"score_linear":223614.0,"score_lmetric":133047},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":23641,"ongoing_decode_tokens":23641,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2033,"cache_hit":0,"new_prefill":73188,"score_linear":23641.0,"score_lmetric":73188},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":4789,"ongoing_decode_tokens":4789,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1638,"cache_hit":0,"new_prefill":73188,"score_linear":4789.0,"score_lmetric":73188},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":73188,"score_linear":187077.0,"score_lmetric":260463},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":73188,"score_linear":164125.0,"score_lmetric":153882},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":103776,"pending_prefill_tokens":4030,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":68608,"new_prefill":4580,"score_linear":120606.0,"score_lmetric":25830}],"chosen_score_linear":120606.0,"chosen_score_lmetric":25830,"t_first_token":390422.887950588,"t_first_token_unix":1779821287.901894,"t_done":390424.228162646,"t_done_unix":1779821289.2421064},{"request_id":"1362265:6:1399937:747","session_id":"1362265","input_length":10816,"t_proxy_recv":390423.434698884,"t_decision_unix":1779821288.4486403,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9940828402366864,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":64,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":10816,"score_linear":231097.0,"score_lmetric":73230},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":10816,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":6656,"new_prefill":4160,"score_linear":244634.0,"score_lmetric":139358},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":10816,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":9728,"new_prefill":1088,"score_linear":-9728.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":101300,"ongoing_decode_tokens":101300,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1598,"cache_hit":0,"new_prefill":10816,"score_linear":101300.0,"score_lmetric":21632},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":10816,"score_linear":178853.0,"score_lmetric":61779},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":251666,"ongoing_decode_tokens":251666,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1770,"cache_hit":10752,"new_prefill":64,"score_linear":240914.0,"score_lmetric":192}],"chosen_score_linear":240914.0,"chosen_score_lmetric":192,"t_first_token":390423.530468416,"t_first_token_unix":1779821288.5444124,"t_done":390424.430372723,"t_done_unix":1779821289.444316},{"request_id":"1340290:8:1409129:805","session_id":"1340290","input_length":29730,"t_proxy_recv":390421.28069405,"t_decision_unix":1779821286.2946355,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":27648,"affinity_cache_ratio":0.9299697275479314,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":27648,"estimated_new_tokens":2082,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":29730,"score_linear":231097.0,"score_lmetric":129972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":29730,"score_linear":251290.0,"score_lmetric":190498},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2050,"cache_hit":0,"new_prefill":29730,"score_linear":24442.0,"score_lmetric":29730},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":0,"new_prefill":29730,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1598,"cache_hit":27648,"new_prefill":2082,"score_linear":-27648.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":1024,"new_prefill":28706,"score_linear":177829.0,"score_lmetric":115449},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":189214,"pending_prefill_tokens":4580,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":29730,"score_linear":262402.0,"score_lmetric":137240}],"chosen_score_linear":-27648.0,"chosen_score_lmetric":0,"t_first_token":390421.723348261,"t_first_token_unix":1779821286.7372918,"t_done":390424.448068659,"t_done_unix":1779821289.4620125},{"request_id":"1408779:2:1410032:807","session_id":"1408779","input_length":5001,"t_proxy_recv":390424.421550876,"t_decision_unix":1779821289.4354918,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":1536,"affinity_cache_ratio":0.30713857228554287,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":3465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":5001,"score_linear":231097.0,"score_lmetric":55785},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":5001,"score_linear":251290.0,"score_lmetric":141040},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":5001,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":1536,"new_prefill":3465,"score_linear":-1536.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":29730,"ongoing_decode_tokens":29730,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":5001,"score_linear":29730.0,"score_lmetric":5001},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":5001,"score_linear":178853.0,"score_lmetric":44334},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189294,"ongoing_decode_tokens":189294,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":5001,"score_linear":189294.0,"score_lmetric":15003}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390424.653932646,"t_first_token_unix":1779821289.667876,"t_done":390425.071472388,"t_done_unix":1779821290.0854156},{"request_id":"1406966:3:1410097:808","session_id":"1406966","input_length":7893,"t_proxy_recv":390424.655648382,"t_decision_unix":1779821289.6695898,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4608,"affinity_cache_ratio":0.5838084378563284,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":3285,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":7893,"score_linear":231097.0,"score_lmetric":64461},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":2048,"new_prefill":5845,"score_linear":-2048.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":7893,"score_linear":251290.0,"score_lmetric":146824},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":5001,"ongoing_decode_tokens":5001,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":4608,"new_prefill":3285,"score_linear":393.0,"score_lmetric":3285},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1606,"cache_hit":0,"new_prefill":7893,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":7893,"score_linear":178853.0,"score_lmetric":53010},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189548,"ongoing_decode_tokens":189548,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":7893,"score_linear":189548.0,"score_lmetric":23679}],"chosen_score_linear":393.0,"chosen_score_lmetric":3285,"t_first_token":390424.932119989,"t_first_token_unix":1779821289.9460633,"t_done":390425.146069799,"t_done_unix":1779821290.1600132},{"request_id":"1407494:2:1410400:809","session_id":"1407494","input_length":4728,"t_proxy_recv":390425.520727681,"t_decision_unix":1779821290.5346682,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":1536,"affinity_cache_ratio":0.3248730964467005,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":3192,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":4728,"score_linear":231097.0,"score_lmetric":54966},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":4728,"score_linear":251290.0,"score_lmetric":140494},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":1536,"new_prefill":3192,"score_linear":-1536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1606,"cache_hit":0,"new_prefill":4728,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":4728,"score_linear":178853.0,"score_lmetric":43515},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189548,"ongoing_decode_tokens":189548,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":4728,"score_linear":189548.0,"score_lmetric":14184}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390425.74653559,"t_first_token_unix":1779821290.760479,"t_done":390425.882260012,"t_done_unix":1779821290.896203},{"request_id":"1362265:7:1408772:800","session_id":"1362265","input_length":11070,"t_proxy_recv":390424.434532713,"t_decision_unix":1779821289.448474,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9712737127371274,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":318,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":11070,"score_linear":231097.0,"score_lmetric":73992},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":11070,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":6656,"new_prefill":4414,"score_linear":244634.0,"score_lmetric":139866},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":11070,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":5001,"ongoing_decode_tokens":0,"pending_prefill_tokens":3465,"num_requests":1,"active_p_offloads":0,"cached_blocks":1675,"cache_hit":9728,"new_prefill":1342,"score_linear":-4727.0,"score_lmetric":4807},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":29730,"ongoing_decode_tokens":29730,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":11070,"score_linear":29730.0,"score_lmetric":11070},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":11070,"score_linear":178853.0,"score_lmetric":62541},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":178478,"ongoing_decode_tokens":178478,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":10752,"new_prefill":318,"score_linear":167726.0,"score_lmetric":636}],"chosen_score_linear":167726.0,"chosen_score_lmetric":636,"t_first_token":390424.529727909,"t_first_token_unix":1779821289.5436711,"t_done":390426.070208322,"t_done_unix":1779821291.084153},{"request_id":"1408889:2:1410453:810","session_id":"1408889","input_length":4825,"t_proxy_recv":390425.657935339,"t_decision_unix":1779821290.6718762,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":3072,"affinity_cache_ratio":0.6366839378238341,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":3072,"estimated_new_tokens":1753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":4825,"score_linear":231097.0,"score_lmetric":55257},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":4825,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":4825,"score_linear":251290.0,"score_lmetric":140688},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":4728,"ongoing_decode_tokens":0,"pending_prefill_tokens":3192,"num_requests":1,"active_p_offloads":0,"cached_blocks":2051,"cache_hit":0,"new_prefill":4825,"score_linear":4728.0,"score_lmetric":8017},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":3072,"new_prefill":1753,"score_linear":-3072.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1606,"cache_hit":0,"new_prefill":4825,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":4825,"score_linear":178853.0,"score_lmetric":43806},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189548,"ongoing_decode_tokens":189548,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":4825,"score_linear":189548.0,"score_lmetric":14475}],"chosen_score_linear":-3072.0,"chosen_score_lmetric":0,"t_first_token":390425.802085384,"t_first_token_unix":1779821290.8160286,"t_done":390426.083093118,"t_done_unix":1779821291.0970361},{"request_id":"1397515:1:1397515:736","session_id":"1397515","input_length":93040,"t_proxy_recv":390380.536122405,"t_decision_unix":1779821245.5500638,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":7,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":0,"tie_break_used":false,"cache_hit":512,"estimated_new_tokens":92528,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":93040,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":121708,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":0,"new_prefill":93040,"score_linear":121708.0,"score_lmetric":279120},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":184029,"ongoing_decode_tokens":82226,"pending_prefill_tokens":28587,"num_requests":2,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":93040,"score_linear":184029.0,"score_lmetric":243254},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":216446,"ongoing_decode_tokens":216446,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":93040,"score_linear":216446.0,"score_lmetric":279120},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1542,"cache_hit":0,"new_prefill":93040,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":85504,"ongoing_decode_tokens":85504,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1426,"cache_hit":0,"new_prefill":93040,"score_linear":85504.0,"score_lmetric":93040},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":13134,"ongoing_decode_tokens":13134,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1602,"cache_hit":0,"new_prefill":93040,"score_linear":13134.0,"score_lmetric":93040},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":512,"new_prefill":92528,"score_linear":-512.0,"score_lmetric":0}],"chosen_score_linear":-512.0,"chosen_score_lmetric":0,"t_first_token":390409.374054594,"t_first_token_unix":1779821274.387998,"t_done":390426.395951497,"t_done_unix":1779821291.409895},{"request_id":"1340290:9:1410595:811","session_id":"1340290","input_length":29958,"t_proxy_recv":390426.07714084,"t_decision_unix":1779821291.0910826,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":29696,"affinity_cache_ratio":0.9912544228586688,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":262,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":29958,"score_linear":231097.0,"score_lmetric":130656},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":29958,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":29958,"score_linear":251290.0,"score_lmetric":190954},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":29958,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":4825,"ongoing_decode_tokens":4825,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1687,"cache_hit":0,"new_prefill":29958,"score_linear":4825.0,"score_lmetric":29958},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1606,"cache_hit":29696,"new_prefill":262,"score_linear":-29696.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":1024,"new_prefill":28934,"score_linear":177829.0,"score_lmetric":116133},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":178478,"ongoing_decode_tokens":178478,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":29958,"score_linear":178478.0,"score_lmetric":59916}],"chosen_score_linear":-29696.0,"chosen_score_lmetric":0,"t_first_token":390426.140987933,"t_first_token_unix":1779821291.1549315,"t_done":390426.737971031,"t_done_unix":1779821291.7519145},{"request_id":"1399948:6:1410696:812","session_id":"1399948","input_length":11381,"t_proxy_recv":390426.406797746,"t_decision_unix":1779821291.4207394,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":8192,"affinity_cache_ratio":0.7197961514805378,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":8192,"estimated_new_tokens":3189,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":11381,"score_linear":231097.0,"score_lmetric":74925},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":11381,"score_linear":251290.0,"score_lmetric":153800},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":0,"new_prefill":11381,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":29958,"ongoing_decode_tokens":29958,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1606,"cache_hit":8192,"new_prefill":3189,"score_linear":21766.0,"score_lmetric":3189},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":11381,"score_linear":178853.0,"score_lmetric":63474},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":85438,"ongoing_decode_tokens":85438,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1960,"cache_hit":0,"new_prefill":11381,"score_linear":85438.0,"score_lmetric":11381}],"chosen_score_linear":21766.0,"chosen_score_lmetric":3189,"t_first_token":390426.736110598,"t_first_token_unix":1779821291.7500536,"t_done":390426.825020327,"t_done_unix":1779821291.8389642},{"request_id":"1373577:3:1404917:774","session_id":"1373577","input_length":85438,"t_proxy_recv":390406.470721539,"t_decision_unix":1779821271.4846623,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":81408,"affinity_cache_ratio":0.9528312928673424,"affinity_num_requests":2,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":81408,"estimated_new_tokens":4030,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":94962,"ongoing_decode_tokens":94962,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":0,"new_prefill":85438,"score_linear":94962.0,"score_lmetric":85438},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":145346,"ongoing_decode_tokens":106143,"pending_prefill_tokens":1315,"num_requests":2,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":85438,"score_linear":145346.0,"score_lmetric":173506},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":85438,"score_linear":223614.0,"score_lmetric":145297},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":85438,"score_linear":41957.0,"score_lmetric":212894},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":0,"pending_prefill_tokens":21684,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":85438,"score_linear":21684.0,"score_lmetric":107122},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":194369,"ongoing_decode_tokens":194369,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1502,"cache_hit":0,"new_prefill":85438,"score_linear":194369.0,"score_lmetric":256314},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":85438,"score_linear":44148.0,"score_lmetric":88114},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":81408,"new_prefill":4030,"score_linear":22368.0,"score_lmetric":194108}],"chosen_score_linear":22368.0,"chosen_score_lmetric":194108,"t_first_token":390420.840756014,"t_first_token_unix":1779821285.8546996,"t_done":390426.946585647,"t_done_unix":1779821291.960529},{"request_id":"1408779:3:1411249:815","session_id":"1408779","input_length":7110,"t_proxy_recv":390428.435987109,"t_decision_unix":1779821293.4499285,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4608,"affinity_cache_ratio":0.6481012658227848,"affinity_num_requests":0,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":2502,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":7110,"score_linear":231097.0,"score_lmetric":62112},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":7110,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":7110,"score_linear":251290.0,"score_lmetric":145258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":7110,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":4608,"new_prefill":2502,"score_linear":-4608.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117746,"ongoing_decode_tokens":0,"pending_prefill_tokens":8178,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":7110,"score_linear":117746.0,"score_lmetric":15288},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":7110,"score_linear":178853.0,"score_lmetric":50661},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90818,"ongoing_decode_tokens":0,"pending_prefill_tokens":5314,"num_requests":1,"active_p_offloads":0,"cached_blocks":1968,"cache_hit":0,"new_prefill":7110,"score_linear":90818.0,"score_lmetric":12424}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":390428.633797161,"t_first_token_unix":1779821293.6477408,"t_done":390428.786758119,"t_done_unix":1779821293.8007014},{"request_id":"1373577:4:1408642:799","session_id":"1373577","input_length":90818,"t_proxy_recv":390426.96397493,"t_decision_unix":1779821291.9779165,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9414873703450858,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":5314,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":90818,"score_linear":231097.0,"score_lmetric":313236},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":90818,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":90818,"score_linear":251290.0,"score_lmetric":312674},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":90818,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":0,"new_prefill":90818,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":90818,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":90818,"score_linear":178853.0,"score_lmetric":301785},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1968,"cache_hit":85504,"new_prefill":5314,"score_linear":-85504.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":390429.86906067,"t_first_token_unix":1779821294.8830044,"t_done":390431.720233338,"t_done_unix":1779821296.7341774},{"request_id":"1366128:25:1411126:813","session_id":"1366128","input_length":117746,"t_proxy_recv":390428.036708171,"t_decision_unix":1779821293.0506496,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":109568,"affinity_cache_ratio":0.9305454113090891,"affinity_num_requests":0,"avg_num_requests":1.125,"fallback_score":null,"tie_break_used":false,"cache_hit":109568,"estimated_new_tokens":8178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":117746,"score_linear":231097.0,"score_lmetric":394020},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":117746,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":117746,"score_linear":251290.0,"score_lmetric":366530},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":117746,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":15360,"new_prefill":102386,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":109568,"new_prefill":8178,"score_linear":-109568.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":117746,"score_linear":178853.0,"score_lmetric":382569},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90818,"ongoing_decode_tokens":0,"pending_prefill_tokens":5314,"num_requests":1,"active_p_offloads":0,"cached_blocks":1968,"cache_hit":0,"new_prefill":117746,"score_linear":90818.0,"score_lmetric":123060}],"chosen_score_linear":-109568.0,"chosen_score_lmetric":0,"t_first_token":390433.577801062,"t_first_token_unix":1779821298.5917528,"t_done":390434.867517477,"t_done_unix":1779821299.8814611},{"request_id":"1313181:7:1327489:383","session_id":"1313181","input_length":121811,"t_proxy_recv":390396.426080425,"t_decision_unix":1779821261.4400218,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61952,"affinity_cache_ratio":0.5085911781366215,"affinity_num_requests":0,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":59859,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":111735,"ongoing_decode_tokens":0,"pending_prefill_tokens":16503,"num_requests":3,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":12800,"new_prefill":109011,"score_linear":98935.0,"score_lmetric":376542},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":121811,"score_linear":106143.0,"score_lmetric":121811},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":61952,"new_prefill":59859,"score_linear":39851.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":210325,"ongoing_decode_tokens":147067,"pending_prefill_tokens":12058,"num_requests":3,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":0,"new_prefill":121811,"score_linear":210325.0,"score_lmetric":401607},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1549,"cache_hit":12800,"new_prefill":109011,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":31431,"pending_prefill_tokens":29574,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":121811,"score_linear":197197.0,"score_lmetric":605540},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":121811,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":12800,"new_prefill":109011,"score_linear":90976.0,"score_lmetric":404070}],"chosen_score_linear":39851.0,"chosen_score_lmetric":0,"t_first_token":390430.311071056,"t_first_token_unix":1779821295.325015,"t_done":390435.571874819,"t_done_unix":1779821300.5858185},{"request_id":"1286804:5:1407989:792","session_id":"1286804","input_length":27676,"t_proxy_recv":390417.243953172,"t_decision_unix":1779821282.2578945,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":22016,"affinity_cache_ratio":0.795490677843619,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":5660,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":2560,"new_prefill":25116,"score_linear":155145.0,"score_lmetric":56588},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":1536,"new_prefill":26140,"score_linear":106108.0,"score_lmetric":52280},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":22016,"new_prefill":5660,"score_linear":201598.0,"score_lmetric":65519},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":27676,"score_linear":24442.0,"score_lmetric":27676},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1647,"cache_hit":512,"new_prefill":27164,"score_linear":-512.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":187077,"ongoing_decode_tokens":69508,"pending_prefill_tokens":13633,"num_requests":3,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":27676,"score_linear":187077.0,"score_lmetric":123927},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":27676,"score_linear":164125.0,"score_lmetric":62858},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":27676,"score_linear":262402.0,"score_lmetric":145144}],"chosen_score_linear":201598.0,"chosen_score_lmetric":65519,"t_first_token":390433.330615757,"t_first_token_unix":1779821298.3445594,"t_done":390437.289158138,"t_done_unix":1779821302.3031037},{"request_id":"1407494:3:1413526:825","session_id":"1407494","input_length":9801,"t_proxy_recv":390436.470107354,"t_decision_unix":1779821301.4840481,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":3,"chosen_idx":4,"affinity_cache_hit":4608,"affinity_cache_ratio":0.4701561065197429,"affinity_num_requests":1,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":9801,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":9801,"score_linear":271370.0,"score_lmetric":101072},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":9801,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":191497,"ongoing_decode_tokens":191497,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":9801,"score_linear":191497.0,"score_lmetric":19602},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":4608,"new_prefill":5193,"score_linear":102684.0,"score_lmetric":19301},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":9801,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":242288,"ongoing_decode_tokens":102762,"pending_prefill_tokens":10502,"num_requests":4,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":9801,"score_linear":242288.0,"score_lmetric":81212},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":9801,"score_linear":178853.0,"score_lmetric":58734},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":9801,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390437.224090859,"t_first_token_unix":1779821302.2380345,"t_done":390437.551586522,"t_done_unix":1779821302.5655296},{"request_id":"1407995:2:1413725:826","session_id":"1407995","input_length":22392,"t_proxy_recv":390437.103453369,"t_decision_unix":1779821302.1173935,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":7,"affinity_cache_hit":2560,"affinity_cache_ratio":0.1143265451947124,"affinity_num_requests":1,"avg_num_requests":1.875,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":22392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":22392,"score_linear":271370.0,"score_lmetric":151436},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":22392,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":191497,"ongoing_decode_tokens":191497,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":22392,"score_linear":191497.0,"score_lmetric":44784},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":22392,"score_linear":107292.0,"score_lmetric":36500},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":9801,"ongoing_decode_tokens":0,"pending_prefill_tokens":9801,"num_requests":1,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":2560,"new_prefill":19832,"score_linear":7241.0,"score_lmetric":29633},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":242288,"ongoing_decode_tokens":102762,"pending_prefill_tokens":10502,"num_requests":4,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":22392,"score_linear":242288.0,"score_lmetric":131576},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":22392,"score_linear":178853.0,"score_lmetric":96507},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":22392,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390439.546796916,"t_first_token_unix":1779821304.5607405,"t_done":390439.976777884,"t_done_unix":1779821304.9907207},{"request_id":"1408889:3:1414177:827","session_id":"1408889","input_length":10633,"t_proxy_recv":390438.599900968,"t_decision_unix":1779821303.6138425,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":4608,"affinity_cache_ratio":0.43336781717295214,"affinity_num_requests":0,"avg_num_requests":1.75,"fallback_score":0,"tie_break_used":false,"cache_hit":4608,"estimated_new_tokens":6025,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":10633,"score_linear":271370.0,"score_lmetric":104400},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":10633,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":163821,"ongoing_decode_tokens":163821,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":10633,"score_linear":163821.0,"score_lmetric":10633},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":10633,"score_linear":107292.0,"score_lmetric":24741},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":4608,"new_prefill":6025,"score_linear":-4608.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":242288,"ongoing_decode_tokens":102762,"pending_prefill_tokens":10502,"num_requests":4,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":10633,"score_linear":242288.0,"score_lmetric":84540},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":10633,"score_linear":178853.0,"score_lmetric":61230},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":22392,"ongoing_decode_tokens":0,"pending_prefill_tokens":22392,"num_requests":1,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":10633,"score_linear":22392.0,"score_lmetric":33025}],"chosen_score_linear":-4608.0,"chosen_score_lmetric":0,"t_first_token":390439.132852109,"t_first_token_unix":1779821304.1467957,"t_done":390440.132104334,"t_done_unix":1779821305.1460476},{"request_id":"1313181:7:1382851:662","session_id":"1313181","input_length":62018,"t_proxy_recv":390435.582983432,"t_decision_unix":1779821300.596925,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9989357928343384,"affinity_num_requests":1,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":66,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":12800,"new_prefill":49218,"score_linear":258570.0,"score_lmetric":258740},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":62018,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":129479,"ongoing_decode_tokens":129479,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":61952,"new_prefill":66,"score_linear":67527.0,"score_lmetric":66},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":62018,"score_linear":107292.0,"score_lmetric":76126},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":12800,"new_prefill":49218,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":242288,"ongoing_decode_tokens":102762,"pending_prefill_tokens":10502,"num_requests":4,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":62018,"score_linear":242288.0,"score_lmetric":290080},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":62018,"score_linear":178853.0,"score_lmetric":215385},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":12800,"new_prefill":49218,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":67527.0,"chosen_score_lmetric":66,"t_first_token":390435.683960547,"t_first_token_unix":1779821300.697904,"t_done":390441.787542602,"t_done_unix":1779821306.8014863},{"request_id":"1399948:7:1413205:824","session_id":"1399948","input_length":11537,"t_proxy_recv":390435.284134212,"t_decision_unix":1779821300.2980754,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9763370026870071,"affinity_num_requests":3,"avg_num_requests":1.625,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":273,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":11537,"score_linear":271370.0,"score_lmetric":108016},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":11537,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":251290,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":11537,"score_linear":251290.0,"score_lmetric":23074},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":11537,"score_linear":107292.0,"score_lmetric":25645},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":11537,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":230751,"ongoing_decode_tokens":102762,"pending_prefill_tokens":10229,"num_requests":3,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":11264,"new_prefill":273,"score_linear":219487.0,"score_lmetric":31506},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":11537,"score_linear":178853.0,"score_lmetric":63942},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":11537,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":219487.0,"chosen_score_lmetric":31506,"t_first_token":390442.720482714,"t_first_token_unix":1779821307.7344263,"t_done":390443.856567743,"t_done_unix":1779821308.870511},{"request_id":"1340290:10:1411397:816","session_id":"1340290","input_length":30154,"t_proxy_recv":390429.063255076,"t_decision_unix":1779821294.0771966,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":29696,"affinity_cache_ratio":0.9848113019831531,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":30154,"score_linear":231097.0,"score_lmetric":131244},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":30154,"score_linear":251290.0,"score_lmetric":191346},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":30154,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":117746,"ongoing_decode_tokens":0,"pending_prefill_tokens":8178,"num_requests":1,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":29696,"new_prefill":458,"score_linear":88050.0,"score_lmetric":8636},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":1024,"new_prefill":29130,"score_linear":177829.0,"score_lmetric":116721},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90818,"ongoing_decode_tokens":0,"pending_prefill_tokens":5314,"num_requests":1,"active_p_offloads":0,"cached_blocks":1968,"cache_hit":0,"new_prefill":30154,"score_linear":90818.0,"score_lmetric":35468}],"chosen_score_linear":88050.0,"chosen_score_lmetric":8636,"t_first_token":390434.165532031,"t_first_token_unix":1779821299.179476,"t_done":390447.333890641,"t_done_unix":1779821312.3478339},{"request_id":"1366128:26:1413108:823","session_id":"1366128","input_length":127989,"t_proxy_recv":390434.918197246,"t_decision_unix":1779821299.9321382,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9200790692950176,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":10229,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":127989,"score_linear":271370.0,"score_lmetric":573824},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":251290,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":127989,"score_linear":251290.0,"score_lmetric":255978},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":127989,"score_linear":107292.0,"score_lmetric":142097},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":15360,"new_prefill":112629,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":102762,"ongoing_decode_tokens":102762,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":117760,"new_prefill":10229,"score_linear":-14998.0,"score_lmetric":20458},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":127989,"score_linear":178853.0,"score_lmetric":413298},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":127989,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14998.0,"chosen_score_lmetric":20458,"t_first_token":390442.678356566,"t_first_token_unix":1779821307.6923008,"t_done":390448.716361041,"t_done_unix":1779821313.7303045},{"request_id":"1340290:11:1413050:822","session_id":"1340290","input_length":35022,"t_proxy_recv":390447.342432204,"t_decision_unix":1779821312.3563738,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":30208,"affinity_cache_ratio":0.8625435440580207,"affinity_num_requests":2,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":30208,"estimated_new_tokens":4814,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":35022,"score_linear":271370.0,"score_lmetric":201956},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":35022,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":35022,"score_linear":225893.0,"score_lmetric":97160},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":35022,"score_linear":107292.0,"score_lmetric":49130},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":35022,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":200597,"ongoing_decode_tokens":200597,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1629,"cache_hit":30208,"new_prefill":4814,"score_linear":170389.0,"score_lmetric":9628},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":1024,"new_prefill":33998,"score_linear":177829.0,"score_lmetric":131325},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":0,"new_prefill":35022,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":170389.0,"chosen_score_lmetric":9628,"t_first_token":390448.505549528,"t_first_token_unix":1779821313.5194933,"t_done":390451.443180076,"t_done_unix":1779821316.457123},{"request_id":"1366128:27:1417788:831","session_id":"1366128","input_length":128433,"t_proxy_recv":390451.508717563,"t_decision_unix":1779821316.5226588,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":128000,"affinity_cache_ratio":0.9966285923399749,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":128000,"estimated_new_tokens":433,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":128433,"score_linear":271370.0,"score_lmetric":575600},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":128433,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":128433,"score_linear":225893.0,"score_lmetric":190571},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":128433,"score_linear":107292.0,"score_lmetric":142541},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":15360,"new_prefill":113073,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1658,"cache_hit":128000,"new_prefill":433,"score_linear":-55392.0,"score_lmetric":433},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":128433,"score_linear":178853.0,"score_lmetric":414630},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":0,"pending_prefill_tokens":2803,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":0,"new_prefill":128433,"score_linear":43763.0,"score_lmetric":131236}],"chosen_score_linear":-55392.0,"chosen_score_lmetric":433,"t_first_token":390451.89630563,"t_first_token_unix":1779821316.9102492,"t_done":390453.266765446,"t_done_unix":1779821318.2807093},{"request_id":"1403188:2:1408249:796","session_id":"1403188","input_length":14728,"t_proxy_recv":390418.218233373,"t_decision_unix":1779821283.2321744,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":8704,"affinity_cache_ratio":0.5909831613253667,"affinity_num_requests":2,"avg_num_requests":2.125,"fallback_score":null,"tie_break_used":false,"cache_hit":8704,"estimated_new_tokens":6024,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":14728,"score_linear":157705.0,"score_lmetric":35812},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":107644,"ongoing_decode_tokens":107644,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1540,"cache_hit":0,"new_prefill":14728,"score_linear":107644.0,"score_lmetric":29456},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":14728,"score_linear":251290.0,"score_lmetric":160494},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":24442,"ongoing_decode_tokens":24442,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":0,"new_prefill":14728,"score_linear":24442.0,"score_lmetric":14728},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1652,"cache_hit":0,"new_prefill":14728,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":214863,"ongoing_decode_tokens":214863,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1567,"cache_hit":0,"new_prefill":14728,"score_linear":214863.0,"score_lmetric":58912},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":44148,"pending_prefill_tokens":3753,"num_requests":2,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":8704,"new_prefill":6024,"score_linear":155421.0,"score_lmetric":19554},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":14728,"score_linear":262402.0,"score_lmetric":93352}],"chosen_score_linear":155421.0,"chosen_score_lmetric":19554,"t_first_token":390456.621351882,"t_first_token_unix":1779821321.6352952,"t_done":390457.477314507,"t_done_unix":1779821322.491258},{"request_id":"1275274:2:1405679:780","session_id":"1275274","input_length":119977,"t_proxy_recv":390409.084793664,"t_decision_unix":1779821274.0987344,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9687190044758579,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":3753,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":0,"pending_prefill_tokens":47625,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":119977,"score_linear":157705.0,"score_lmetric":335204},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":119977,"score_linear":106143.0,"score_lmetric":119977},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":119977,"score_linear":223614.0,"score_lmetric":179836},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":20948,"ongoing_decode_tokens":20948,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2028,"cache_hit":0,"new_prefill":119977,"score_linear":20948.0,"score_lmetric":119977},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":41650,"ongoing_decode_tokens":21684,"pending_prefill_tokens":9214,"num_requests":2,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":119977,"score_linear":41650.0,"score_lmetric":258382},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":68109,"ongoing_decode_tokens":68109,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1533,"cache_hit":0,"new_prefill":119977,"score_linear":68109.0,"score_lmetric":119977},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":116224,"new_prefill":3753,"score_linear":-72076.0,"score_lmetric":6429},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":119977,"score_linear":189214.0,"score_lmetric":651093}],"chosen_score_linear":-72076.0,"chosen_score_lmetric":6429,"t_first_token":390456.311366743,"t_first_token_unix":1779821321.3253102,"t_done":390458.341977986,"t_done_unix":1779821323.3559217},{"request_id":"1362265:8:1419710:834","session_id":"1362265","input_length":11132,"t_proxy_recv":390458.186154928,"t_decision_unix":1779821323.2000964,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9658641753503413,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":380,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":157705,"pending_prefill_tokens":12289,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":11132,"score_linear":271370.0,"score_lmetric":93684},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":0,"pending_prefill_tokens":32179,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":11132,"score_linear":32179.0,"score_lmetric":43311},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":6656,"new_prefill":4476,"score_linear":219237.0,"score_lmetric":66614},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":11132,"score_linear":107292.0,"score_lmetric":25240},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":9728,"new_prefill":1404,"score_linear":27670.0,"score_lmetric":1404},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":11132,"score_linear":72608.0,"score_lmetric":11132},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":164125,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1656,"cache_hit":0,"new_prefill":11132,"score_linear":164125.0,"score_lmetric":22264},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":10752,"new_prefill":380,"score_linear":33011.0,"score_lmetric":380}],"chosen_score_linear":33011.0,"chosen_score_lmetric":380,"t_first_token":390458.230307587,"t_first_token_unix":1779821323.2442508,"t_done":390458.612560406,"t_done_unix":1779821323.6265047},{"request_id":"1268861:8:1403753:765","session_id":"1268861","input_length":44148,"t_proxy_recv":390402.412418858,"t_decision_unix":1779821267.4263601,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":41472,"affinity_cache_ratio":0.939385702636586,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":41472,"estimated_new_tokens":2676,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":107872,"ongoing_decode_tokens":107872,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1785,"cache_hit":0,"new_prefill":44148,"score_linear":107872.0,"score_lmetric":88296},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1534,"cache_hit":0,"new_prefill":44148,"score_linear":106143.0,"score_lmetric":44148},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":44148,"score_linear":223614.0,"score_lmetric":104007},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":149149,"ongoing_decode_tokens":20948,"pending_prefill_tokens":1225,"num_requests":2,"active_p_offloads":0,"cached_blocks":1984,"cache_hit":0,"new_prefill":44148,"score_linear":149149.0,"score_lmetric":90746},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1570,"cache_hit":0,"new_prefill":44148,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":197197,"ongoing_decode_tokens":129088,"pending_prefill_tokens":17421,"num_requests":4,"active_p_offloads":0,"cached_blocks":1474,"cache_hit":0,"new_prefill":44148,"score_linear":197197.0,"score_lmetric":246276},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":41472,"new_prefill":2676,"score_linear":-41472.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103776,"ongoing_decode_tokens":0,"pending_prefill_tokens":93024,"num_requests":2,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":44148,"score_linear":103776.0,"score_lmetric":274344}],"chosen_score_linear":-41472.0,"chosen_score_lmetric":0,"t_first_token":390410.029800732,"t_first_token_unix":1779821275.0437443,"t_done":390459.348085497,"t_done_unix":1779821324.362029},{"request_id":"1405199:1:1405199:776","session_id":"1405199","input_length":11503,"t_proxy_recv":390407.40847041,"t_decision_unix":1779821272.4224117,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":11503,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":32944,"ongoing_decode_tokens":0,"pending_prefill_tokens":32944,"num_requests":0,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":11503,"score_linear":32944.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":11503,"score_linear":106143.0,"score_lmetric":11503},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":11503,"score_linear":223614.0,"score_lmetric":71362},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":11503,"score_linear":41957.0,"score_lmetric":65024},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":11503,"score_linear":21684.0,"score_lmetric":11503},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165923,"ongoing_decode_tokens":165923,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1529,"cache_hit":0,"new_prefill":11503,"score_linear":165923.0,"score_lmetric":23006},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":11503,"score_linear":44148.0,"score_lmetric":14179},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":11503,"score_linear":189214.0,"score_lmetric":325671}],"chosen_score_linear":32944.0,"chosen_score_lmetric":0,"t_first_token":390412.991438754,"t_first_token_unix":1779821278.0053825,"t_done":390465.791300489,"t_done_unix":1779821330.805244},{"request_id":"1340290:12:1421294:835","session_id":"1340290","input_length":35303,"t_proxy_recv":390463.835568867,"t_decision_unix":1779821328.8495102,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9862051383735093,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":487,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":231097,"pending_prefill_tokens":1873,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":35303,"score_linear":271370.0,"score_lmetric":148704},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":35303,"score_linear":32179.0,"score_lmetric":35303},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":35303,"score_linear":225893.0,"score_lmetric":97441},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":35303,"score_linear":107292.0,"score_lmetric":49411},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":35303,"score_linear":37398.0,"score_lmetric":35303},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":34816,"new_prefill":487,"score_linear":37792.0,"score_lmetric":487},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":1024,"new_prefill":34279,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":0,"new_prefill":35303,"score_linear":43763.0,"score_lmetric":35303}],"chosen_score_linear":37792.0,"chosen_score_lmetric":487,"t_first_token":390463.931958985,"t_first_token_unix":1779821328.945902,"t_done":390466.380266727,"t_done_unix":1779821331.39421},{"request_id":"1362265:9:1422050:838","session_id":"1362265","input_length":11879,"t_proxy_recv":390466.651557568,"t_decision_unix":1779821331.6654992,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":10752,"affinity_cache_ratio":0.9051266941661756,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":10752,"estimated_new_tokens":1127,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":259867,"ongoing_decode_tokens":259867,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1841,"cache_hit":0,"new_prefill":11879,"score_linear":259867.0,"score_lmetric":35637},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":11879,"score_linear":32179.0,"score_lmetric":11879},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":6656,"new_prefill":5223,"score_linear":219237.0,"score_lmetric":67361},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":11879,"score_linear":107292.0,"score_lmetric":25987},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":9728,"new_prefill":2151,"score_linear":27670.0,"score_lmetric":2151},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":201250,"ongoing_decode_tokens":72608,"pending_prefill_tokens":130,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":11879,"score_linear":201250.0,"score_lmetric":24018},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":49308,"ongoing_decode_tokens":49308,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":0,"new_prefill":11879,"score_linear":49308.0,"score_lmetric":11879},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":10752,"new_prefill":1127,"score_linear":33011.0,"score_lmetric":1127}],"chosen_score_linear":33011.0,"chosen_score_lmetric":1127,"t_first_token":390466.806981211,"t_first_token_unix":1779821331.820925,"t_done":390467.098791493,"t_done_unix":1779821332.112735},{"request_id":"1268861:9:1421319:836","session_id":"1268861","input_length":49308,"t_proxy_recv":390463.917850164,"t_decision_unix":1779821328.9317915,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":44032,"affinity_cache_ratio":0.8929991076498742,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":5276,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":231097,"pending_prefill_tokens":1873,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":49308,"score_linear":271370.0,"score_lmetric":204724},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":49308,"score_linear":32179.0,"score_lmetric":49308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":49308,"score_linear":225893.0,"score_lmetric":111446},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":49308,"score_linear":107292.0,"score_lmetric":63416},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":49308,"score_linear":37398.0,"score_lmetric":49308},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":107911,"ongoing_decode_tokens":72608,"pending_prefill_tokens":487,"num_requests":2,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":49308,"score_linear":107911.0,"score_lmetric":99590},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":44032,"new_prefill":5276,"score_linear":-44032.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":0,"new_prefill":49308,"score_linear":43763.0,"score_lmetric":49308}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":390465.492767963,"t_first_token_unix":1779821330.5067115,"t_done":390467.141807622,"t_done_unix":1779821332.1557512},{"request_id":"1366128:28:1421998:837","session_id":"1366128","input_length":128642,"t_proxy_recv":390466.535451903,"t_decision_unix":1779821331.5493932,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":128512,"affinity_cache_ratio":0.9989894435720837,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":128512,"estimated_new_tokens":130,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":259867,"ongoing_decode_tokens":259867,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1841,"cache_hit":0,"new_prefill":128642,"score_linear":259867.0,"score_lmetric":385926},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":32179,"ongoing_decode_tokens":32179,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":128642,"score_linear":32179.0,"score_lmetric":128642},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":128642,"score_linear":225893.0,"score_lmetric":190780},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":128642,"score_linear":107292.0,"score_lmetric":142750},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":15360,"new_prefill":113282,"score_linear":22038.0,"score_lmetric":113282},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":128512,"new_prefill":130,"score_linear":-55904.0,"score_lmetric":130},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":49308,"ongoing_decode_tokens":49308,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":0,"new_prefill":128642,"score_linear":49308.0,"score_lmetric":128642},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":0,"new_prefill":128642,"score_linear":43763.0,"score_lmetric":128642}],"chosen_score_linear":-55904.0,"chosen_score_lmetric":130,"t_first_token":390466.875635454,"t_first_token_unix":1779821331.889579,"t_done":390467.583734696,"t_done_unix":1779821332.5976822},{"request_id":"1270340:5:1417075:829","session_id":"1270340","input_length":43763,"t_proxy_recv":390449.151804655,"t_decision_unix":1779821314.1657462,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":40960,"affinity_cache_ratio":0.9359504604346137,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":40960,"estimated_new_tokens":2803,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":43763,"score_linear":271370.0,"score_lmetric":236920},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":43763,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":43763,"score_linear":225893.0,"score_lmetric":105901},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":1536,"new_prefill":42227,"score_linear":105756.0,"score_lmetric":56335},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":43763,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":107630,"ongoing_decode_tokens":107630,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1649,"cache_hit":0,"new_prefill":43763,"score_linear":107630.0,"score_lmetric":87526},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":43763,"score_linear":178853.0,"score_lmetric":160620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":40960,"new_prefill":2803,"score_linear":-40960.0,"score_lmetric":0}],"chosen_score_linear":-40960.0,"chosen_score_lmetric":0,"t_first_token":390456.602377184,"t_first_token_unix":1779821321.6163225,"t_done":390467.632931515,"t_done_unix":1779821332.646875},{"request_id":"1270606:2:1411654:817","session_id":"1270606","input_length":107292,"t_proxy_recv":390430.083382983,"t_decision_unix":1779821295.0973241,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":93184,"affinity_cache_ratio":0.8685083696827349,"affinity_num_requests":0,"avg_num_requests":1.375,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":14108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":107292,"score_linear":231097.0,"score_lmetric":362658},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":107292,"score_linear":251290.0,"score_lmetric":345622},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":93184,"new_prefill":14108,"score_linear":-93184.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":107292,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":147900,"ongoing_decode_tokens":0,"pending_prefill_tokens":8636,"num_requests":2,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":107292,"score_linear":147900.0,"score_lmetric":231856},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":107292,"score_linear":178853.0,"score_lmetric":351207},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90818,"ongoing_decode_tokens":90818,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1968,"cache_hit":1536,"new_prefill":105756,"score_linear":89282.0,"score_lmetric":105756}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":390467.145535745,"t_first_token_unix":1779821332.159479,"t_done":390468.464962344,"t_done_unix":1779821333.478906},{"request_id":"1277428:8:1412675:821","session_id":"1277428","input_length":40273,"t_proxy_recv":390433.390358147,"t_decision_unix":1779821298.4042995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9534924142725896,"affinity_num_requests":3,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":1873,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":38400,"new_prefill":1873,"score_linear":192697.0,"score_lmetric":46401},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":4608,"new_prefill":35665,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":251290,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":40273,"score_linear":251290.0,"score_lmetric":80546},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":17408,"new_prefill":22865,"score_linear":89884.0,"score_lmetric":36973},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":40273,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":220508,"ongoing_decode_tokens":0,"pending_prefill_tokens":9564,"num_requests":3,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":0,"new_prefill":40273,"score_linear":220508.0,"score_lmetric":149511},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":40273,"score_linear":178853.0,"score_lmetric":150150},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1978,"cache_hit":0,"new_prefill":40273,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":192697.0,"chosen_score_lmetric":46401,"t_first_token":390464.979124819,"t_first_token_unix":1779821329.9930701,"t_done":390469.357286969,"t_done_unix":1779821334.3712301},{"request_id":"1301929:3:1417873:832","session_id":"1301929","input_length":37398,"t_proxy_recv":390451.785718697,"t_decision_unix":1779821316.7996597,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9994117332477672,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":22,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":3584,"new_prefill":33814,"score_linear":267786.0,"score_lmetric":197124},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":37398,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":37398,"score_linear":225893.0,"score_lmetric":99536},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":37398,"score_linear":107292.0,"score_lmetric":51506},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":37376,"new_prefill":22,"score_linear":-37376.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":201041,"ongoing_decode_tokens":72608,"pending_prefill_tokens":433,"num_requests":2,"active_p_offloads":0,"cached_blocks":1658,"cache_hit":0,"new_prefill":37398,"score_linear":201041.0,"score_lmetric":75662},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":37398,"score_linear":178853.0,"score_lmetric":141525},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":0,"pending_prefill_tokens":2803,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":0,"new_prefill":37398,"score_linear":43763.0,"score_lmetric":40201}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":390457.416249764,"t_first_token_unix":1779821322.4301934,"t_done":390470.529709166,"t_done_unix":1779821335.5436523},{"request_id":"1364128:3:1419644:833","session_id":"1364128","input_length":32179,"t_proxy_recv":390457.962509319,"t_decision_unix":1779821322.976451,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":1,"affinity_cache_hit":8704,"affinity_cache_ratio":0.2704869635476553,"affinity_num_requests":1,"avg_num_requests":1.375,"fallback_score":0,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":32179,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":157705,"pending_prefill_tokens":12289,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":32179,"score_linear":271370.0,"score_lmetric":177872},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":32179,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":8704,"new_prefill":23475,"score_linear":217189.0,"score_lmetric":85613},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":32179,"score_linear":107292.0,"score_lmetric":46287},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37398,"ongoing_decode_tokens":37398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":6656,"new_prefill":25523,"score_linear":30742.0,"score_lmetric":25523},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1659,"cache_hit":0,"new_prefill":32179,"score_linear":72608.0,"score_lmetric":32179},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":164125,"ongoing_decode_tokens":164125,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1656,"cache_hit":0,"new_prefill":32179,"score_linear":164125.0,"score_lmetric":64358},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":43763,"ongoing_decode_tokens":43763,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":6656,"new_prefill":25523,"score_linear":37107.0,"score_lmetric":25523}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390462.358175799,"t_first_token_unix":1779821327.3721192,"t_done":390472.91897788,"t_done_unix":1779821337.9329216},{"request_id":"1364090:6:1408777:801","session_id":"1364090","input_length":73392,"t_proxy_recv":390419.913817604,"t_decision_unix":1779821284.9277592,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":62976,"affinity_cache_ratio":0.8580771746239372,"affinity_num_requests":2,"avg_num_requests":2.375,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":10416,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":157705,"ongoing_decode_tokens":44447,"pending_prefill_tokens":3178,"num_requests":2,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":62976,"new_prefill":10416,"score_linear":94729.0,"score_lmetric":27188},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1543,"cache_hit":7680,"new_prefill":65712,"score_linear":98463.0,"score_lmetric":65712},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65519,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":73392,"score_linear":251290.0,"score_lmetric":277822},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":30819,"ongoing_decode_tokens":30819,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2038,"cache_hit":7680,"new_prefill":65712,"score_linear":23139.0,"score_lmetric":131424},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":1801,"ongoing_decode_tokens":0,"pending_prefill_tokens":1801,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":14336,"new_prefill":59056,"score_linear":-12535.0,"score_lmetric":60857},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":215480,"ongoing_decode_tokens":215480,"pending_prefill_tokens":0,"num_requests":4,"active_p_offloads":0,"cached_blocks":1571,"cache_hit":11264,"new_prefill":62128,"score_linear":204216.0,"score_lmetric":248512},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":11264,"new_prefill":62128,"score_linear":167589.0,"score_lmetric":215715},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":262402,"ongoing_decode_tokens":103776,"pending_prefill_tokens":8610,"num_requests":4,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":7680,"new_prefill":65712,"score_linear":254722.0,"score_lmetric":297288}],"chosen_score_linear":94729.0,"chosen_score_lmetric":27188,"t_first_token":390458.756288519,"t_first_token_unix":1779821323.7702327,"t_done":390473.429724328,"t_done_unix":1779821338.443668},{"request_id":"1363943:11:1424840:842","session_id":"1363943","input_length":25225,"t_proxy_recv":390476.496158259,"t_decision_unix":1779821341.5100992,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9742715559960357,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":649,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":146202,"pending_prefill_tokens":12465,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":8704,"new_prefill":16521,"score_linear":223691.0,"score_lmetric":57972},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":25225,"score_linear":225893.0,"score_lmetric":87363},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2084,"cache_hit":24576,"new_prefill":649,"score_linear":-24576.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":4096,"new_prefill":21129,"score_linear":194710.0,"score_lmetric":42258},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":4096,"new_prefill":21129,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390476.604670745,"t_first_token_unix":1779821341.6186144,"t_done":390477.575183356,"t_done_unix":1779821342.5891263},{"request_id":"1313181:8:1329951:394","session_id":"1313181","input_length":124090,"t_proxy_recv":390441.813260192,"t_decision_unix":1779821306.8272014,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61952,"affinity_cache_ratio":0.499250543960029,"affinity_num_requests":0,"avg_num_requests":1.5,"fallback_score":0,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":62138,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":271370,"ongoing_decode_tokens":44447,"pending_prefill_tokens":15467,"num_requests":4,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":12800,"new_prefill":111290,"score_linear":258570.0,"score_lmetric":507028},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":124090,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":61952,"new_prefill":62138,"score_linear":39851.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":124090,"score_linear":107292.0,"score_lmetric":138198},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":12800,"new_prefill":111290,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":242288,"ongoing_decode_tokens":102762,"pending_prefill_tokens":10502,"num_requests":4,"active_p_offloads":0,"cached_blocks":1628,"cache_hit":0,"new_prefill":124090,"score_linear":242288.0,"score_lmetric":538368},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":124090,"score_linear":178853.0,"score_lmetric":401601},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2021,"cache_hit":12800,"new_prefill":111290,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":39851.0,"chosen_score_lmetric":0,"t_first_token":390476.95444313,"t_first_token_unix":1779821341.9683876,"t_done":390478.150123127,"t_done_unix":1779821343.1640668},{"request_id":"1399948:8:1425345:844","session_id":"1399948","input_length":11736,"t_proxy_recv":390478.378552219,"t_decision_unix":1779821343.3924937,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9597818677573279,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":472,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":146202,"pending_prefill_tokens":12465,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":11736,"score_linear":232395.0,"score_lmetric":48402},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164247,"ongoing_decode_tokens":164247,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2299,"cache_hit":0,"new_prefill":11736,"score_linear":164247.0,"score_lmetric":11736},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2085,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39789,"ongoing_decode_tokens":0,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":11736,"score_linear":39789.0,"score_lmetric":13637},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":11264,"new_prefill":472,"score_linear":187542.0,"score_lmetric":944},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":11736,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":187542.0,"chosen_score_lmetric":944,"t_first_token":390478.49009323,"t_first_token_unix":1779821343.5040367,"t_done":390478.927179179,"t_done_unix":1779821343.941125},{"request_id":"1313181:8:1385690:686","session_id":"1313181","input_length":62444,"t_proxy_recv":390478.159846977,"t_decision_unix":1779821343.1737883,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9921209403625648,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":492,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":146202,"pending_prefill_tokens":12465,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":12800,"new_prefill":49644,"score_linear":219595.0,"score_lmetric":124218},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2299,"cache_hit":61952,"new_prefill":492,"score_linear":39851.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2085,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39789,"ongoing_decode_tokens":0,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":12800,"new_prefill":49644,"score_linear":26989.0,"score_lmetric":51545},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":62444,"score_linear":198806.0,"score_lmetric":124888},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":62444,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":12800,"new_prefill":49644,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":39851.0,"chosen_score_lmetric":0,"t_first_token":390478.261112905,"t_first_token_unix":1779821343.2750568,"t_done":390479.157242371,"t_done_unix":1779821344.1711862},{"request_id":"1355951:5:1425005:843","session_id":"1355951","input_length":39789,"t_proxy_recv":390477.174070203,"t_decision_unix":1779821342.1880114,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9522229761994521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1901,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":146202,"pending_prefill_tokens":12465,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":39789,"score_linear":232395.0,"score_lmetric":104508},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":34816,"new_prefill":4973,"score_linear":-34816.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":225893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":39789,"score_linear":225893.0,"score_lmetric":39789},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":25225,"ongoing_decode_tokens":25225,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2084,"cache_hit":0,"new_prefill":39789,"score_linear":25225.0,"score_lmetric":39789},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":37888,"new_prefill":1901,"score_linear":-37888.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":39789,"score_linear":198806.0,"score_lmetric":79578},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":39789,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":39789,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37888.0,"chosen_score_lmetric":0,"t_first_token":390483.067519007,"t_first_token_unix":1779821348.0814624,"t_done":390483.205265456,"t_done_unix":1779821348.219209},{"request_id":"1366128:29:1424316:841","session_id":"1366128","input_length":126198,"t_proxy_recv":390474.677890195,"t_decision_unix":1779821339.6918314,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":125952,"affinity_cache_ratio":0.9980506822612085,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":125952,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":146202,"pending_prefill_tokens":12465,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":126198,"score_linear":232395.0,"score_lmetric":277326},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":126198,"score_linear":225893.0,"score_lmetric":188336},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2084,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":15360,"new_prefill":110838,"score_linear":-15360.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":125952,"new_prefill":246,"score_linear":-53344.0,"score_lmetric":246},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":126198,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53344.0,"chosen_score_lmetric":246,"t_first_token":390474.851183329,"t_first_token_unix":1779821339.865127,"t_done":390485.285960844,"t_done_unix":1779821350.299905},{"request_id":"1270606:3:1427164:848","session_id":"1270606","input_length":108318,"t_proxy_recv":390484.815053961,"t_decision_unix":1779821349.8289926,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":107008,"affinity_cache_ratio":0.987905980538784,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1310,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":274737,"ongoing_decode_tokens":274737,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":108318,"score_linear":274737.0,"score_lmetric":324954},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":108318,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":108318,"score_linear":231476.0,"score_lmetric":175527},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2085,"cache_hit":107008,"new_prefill":1310,"score_linear":-80085.0,"score_lmetric":1310},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":108318,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":108318,"score_linear":198806.0,"score_lmetric":216636},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":108318,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":1536,"new_prefill":106782,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-80085.0,"chosen_score_lmetric":1310,"t_first_token":390485.561664676,"t_first_token_unix":1779821350.5756085,"t_done":390485.900686697,"t_done_unix":1779821350.9146304},{"request_id":"1405155:1:1405155:775","session_id":"1405155","input_length":32944,"t_proxy_recv":390407.277475313,"t_decision_unix":1779821272.291417,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":null,"chosen_idx":0,"affinity_cache_hit":null,"affinity_cache_ratio":null,"affinity_num_requests":null,"avg_num_requests":1.25,"fallback_score":-32944,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":32944,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":32944,"score_linear":0.0,"score_lmetric":-32944},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":32944,"score_linear":106143.0,"score_lmetric":32944},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":32944,"score_linear":223614.0,"score_lmetric":92803},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":32944,"score_linear":41957.0,"score_lmetric":107906},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":32944,"score_linear":21684.0,"score_lmetric":32944},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165923,"ongoing_decode_tokens":165923,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1529,"cache_hit":512,"new_prefill":32432,"score_linear":165411.0,"score_lmetric":64864},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":32944,"score_linear":44148.0,"score_lmetric":35620},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":32944,"score_linear":189214.0,"score_lmetric":389994}],"chosen_score_linear":0.0,"chosen_score_lmetric":-32944,"t_first_token":390412.375068831,"t_first_token_unix":1779821277.3890126,"t_done":390487.912359298,"t_done_unix":1779821352.926304},{"request_id":"1363943:12:1426646:845","session_id":"1363943","input_length":26923,"t_proxy_recv":390482.96936215,"t_decision_unix":1779821347.983303,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9318426624076068,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1835,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":232395,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":8704,"new_prefill":18219,"score_linear":223691.0,"score_lmetric":36438},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":26923,"score_linear":231476.0,"score_lmetric":94132},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2085,"cache_hit":25088,"new_prefill":1835,"score_linear":-25088.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39789,"ongoing_decode_tokens":0,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":4096,"new_prefill":22827,"score_linear":35693.0,"score_lmetric":24728},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":4096,"new_prefill":22827,"score_linear":194710.0,"score_lmetric":45654},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":4096,"new_prefill":22827,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":0,"t_first_token":390483.320703257,"t_first_token_unix":1779821348.3346472,"t_done":390487.989994106,"t_done_unix":1779821353.00394},{"request_id":"1362265:10:1427606:850","session_id":"1362265","input_length":12596,"t_proxy_recv":390486.073311609,"t_decision_unix":1779821351.0872526,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":11776,"affinity_cache_ratio":0.934899968243887,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":820,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":274737,"ongoing_decode_tokens":274737,"pending_prefill_tokens":0,"num_requests":3,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":0,"new_prefill":12596,"score_linear":274737.0,"score_lmetric":37788},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":6656,"new_prefill":5940,"score_linear":-6656.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":6656,"new_prefill":5940,"score_linear":224820.0,"score_lmetric":73149},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2087,"cache_hit":0,"new_prefill":12596,"score_linear":26923.0,"score_lmetric":12596},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":9728,"new_prefill":2868,"score_linear":-9728.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":0,"new_prefill":12596,"score_linear":72608.0,"score_lmetric":12596},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":12596,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":11776,"new_prefill":820,"score_linear":-11776.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390486.211285941,"t_first_token_unix":1779821351.2252295,"t_done":390488.094056381,"t_done_unix":1779821353.108002},{"request_id":"1381387:7:1411928:819","session_id":"1381387","input_length":72608,"t_proxy_recv":390430.913020699,"t_decision_unix":1779821295.9269617,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9872190392243279,"affinity_num_requests":2,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":928,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":231097,"ongoing_decode_tokens":44447,"pending_prefill_tokens":13594,"num_requests":3,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":0,"new_prefill":72608,"score_linear":231097.0,"score_lmetric":258606},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1580,"cache_hit":0,"new_prefill":72608,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":251290,"ongoing_decode_tokens":223614,"pending_prefill_tokens":5660,"num_requests":2,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":72608,"score_linear":251290.0,"score_lmetric":156536},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":107292,"ongoing_decode_tokens":0,"pending_prefill_tokens":14108,"num_requests":1,"active_p_offloads":0,"cached_blocks":2057,"cache_hit":0,"new_prefill":72608,"score_linear":107292.0,"score_lmetric":86716},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1694,"cache_hit":0,"new_prefill":72608,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":147900,"ongoing_decode_tokens":0,"pending_prefill_tokens":8636,"num_requests":2,"active_p_offloads":0,"cached_blocks":1612,"cache_hit":71680,"new_prefill":928,"score_linear":76220.0,"score_lmetric":19128},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":178853,"ongoing_decode_tokens":44148,"pending_prefill_tokens":9777,"num_requests":3,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":72608,"score_linear":178853.0,"score_lmetric":247155},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":90818,"ongoing_decode_tokens":90818,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1968,"cache_hit":0,"new_prefill":72608,"score_linear":90818.0,"score_lmetric":72608}],"chosen_score_linear":76220.0,"chosen_score_lmetric":19128,"t_first_token":390434.169304635,"t_first_token_unix":1779821299.1832516,"t_done":390488.220888257,"t_done_unix":1779821353.234834},{"request_id":"1364090:7:1412644:820","session_id":"1364090","input_length":86193,"t_proxy_recv":390473.452161047,"t_decision_unix":1779821338.4661002,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":73728,"affinity_cache_ratio":0.8553826876892555,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":12465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":146202,"ongoing_decode_tokens":146202,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":73728,"new_prefill":12465,"score_linear":72474.0,"score_lmetric":12465},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":7680,"new_prefill":78513,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":225893,"ongoing_decode_tokens":101803,"pending_prefill_tokens":62138,"num_requests":1,"active_p_offloads":0,"cached_blocks":2293,"cache_hit":0,"new_prefill":86193,"score_linear":225893.0,"score_lmetric":148331},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2084,"cache_hit":7680,"new_prefill":78513,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":14336,"new_prefill":71857,"score_linear":-14336.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":11264,"new_prefill":74929,"score_linear":61344.0,"score_lmetric":74929},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":11264,"new_prefill":74929,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":7680,"new_prefill":78513,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":72474.0,"chosen_score_lmetric":12465,"t_first_token":390479.773092486,"t_first_token_unix":1779821344.787036,"t_done":390493.935311498,"t_done_unix":1779821358.949255},{"request_id":"1264679:2:1405259:777","session_id":"1264679","input_length":113258,"t_proxy_recv":390407.611105377,"t_decision_unix":1779821272.6250463,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":110080,"affinity_cache_ratio":0.9719401719966801,"affinity_num_requests":1,"avg_num_requests":1.5,"fallback_score":null,"tie_break_used":false,"cache_hit":110080,"estimated_new_tokens":3178,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":44447,"ongoing_decode_tokens":0,"pending_prefill_tokens":44447,"num_requests":1,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":110080,"new_prefill":3178,"score_linear":-65633.0,"score_lmetric":47625},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":106143,"ongoing_decode_tokens":106143,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1536,"cache_hit":0,"new_prefill":113258,"score_linear":106143.0,"score_lmetric":113258},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":223614,"ongoing_decode_tokens":101803,"pending_prefill_tokens":59859,"num_requests":1,"active_p_offloads":0,"cached_blocks":2250,"cache_hit":0,"new_prefill":113258,"score_linear":223614.0,"score_lmetric":173117},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":41957,"ongoing_decode_tokens":20948,"pending_prefill_tokens":21009,"num_requests":2,"active_p_offloads":0,"cached_blocks":1987,"cache_hit":0,"new_prefill":113258,"score_linear":41957.0,"score_lmetric":268534},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":21684,"ongoing_decode_tokens":21684,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1573,"cache_hit":0,"new_prefill":113258,"score_linear":21684.0,"score_lmetric":113258},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":165923,"ongoing_decode_tokens":165923,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1529,"cache_hit":0,"new_prefill":113258,"score_linear":165923.0,"score_lmetric":226516},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":44148,"ongoing_decode_tokens":0,"pending_prefill_tokens":2676,"num_requests":1,"active_p_offloads":0,"cached_blocks":1645,"cache_hit":0,"new_prefill":113258,"score_linear":44148.0,"score_lmetric":115934},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":189214,"ongoing_decode_tokens":0,"pending_prefill_tokens":97054,"num_requests":3,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":113258,"score_linear":189214.0,"score_lmetric":630936}],"chosen_score_linear":-65633.0,"chosen_score_lmetric":47625,"t_first_token":390456.675062795,"t_first_token_unix":1779821321.6890073,"t_done":390498.845821733,"t_done_unix":1779821363.8597703},{"request_id":"1277428:8:1426669:846","session_id":"1277428","input_length":42342,"t_proxy_recv":390483.054333135,"t_decision_unix":1779821348.0682745,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9552690000472345,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":1894,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":232395,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":40448,"new_prefill":1894,"score_linear":191947.0,"score_lmetric":3788},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":4608,"new_prefill":37734,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":42342,"score_linear":231476.0,"score_lmetric":109551},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26923,"ongoing_decode_tokens":0,"pending_prefill_tokens":1835,"num_requests":1,"active_p_offloads":0,"cached_blocks":2085,"cache_hit":17408,"new_prefill":24934,"score_linear":9515.0,"score_lmetric":26769},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39789,"ongoing_decode_tokens":0,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":42342,"score_linear":39789.0,"score_lmetric":44243},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":42342,"score_linear":198806.0,"score_lmetric":84684},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":42342,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":42342,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":191947.0,"chosen_score_lmetric":3788,"t_first_token":390483.721014799,"t_first_token_unix":1779821348.7349582,"t_done":390507.295231092,"t_done_unix":1779821372.3091748},{"request_id":"1399948:9:1433544:857","session_id":"1399948","input_length":11993,"t_proxy_recv":390507.267327291,"t_decision_unix":1779821372.281268,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9392145418160593,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":729,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":305468,"ongoing_decode_tokens":179521,"pending_prefill_tokens":11771,"num_requests":3,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":11993,"score_linear":305468.0,"score_lmetric":71292},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":42407,"ongoing_decode_tokens":42407,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":11993,"score_linear":42407.0,"score_lmetric":23986},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":11993,"score_linear":231476.0,"score_lmetric":79202},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":11993,"score_linear":73878.0,"score_lmetric":14703},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1663,"cache_hit":11264,"new_prefill":729,"score_linear":-11264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":11993,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":390507.337100515,"t_first_token_unix":1779821372.3510444,"t_done":390507.400260164,"t_done_unix":1779821372.4142034},{"request_id":"1407599:2:1430593:852","session_id":"1407599","input_length":1840,"t_proxy_recv":390496.801730602,"t_decision_unix":1779821361.8156722,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":1536,"affinity_cache_ratio":0.8347826086956521,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":1536,"estimated_new_tokens":304,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":292779,"ongoing_decode_tokens":195930,"pending_prefill_tokens":10321,"num_requests":3,"active_p_offloads":0,"cached_blocks":1956,"cache_hit":0,"new_prefill":1840,"score_linear":292779.0,"score_lmetric":36483},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":1536,"new_prefill":304,"score_linear":-1536.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":1840,"score_linear":231476.0,"score_lmetric":69049},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1663,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":1840,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-1536.0,"chosen_score_lmetric":0,"t_first_token":390496.836059504,"t_first_token_unix":1779821361.8500028,"t_done":390508.897371956,"t_done_unix":1779821373.9113162},{"request_id":"1382089:3:1433211:856","session_id":"1382089","input_length":40567,"t_proxy_recv":390506.04869494,"t_decision_unix":1779821371.0626364,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":38912,"affinity_cache_ratio":0.9592032933172283,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38912,"estimated_new_tokens":1655,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":305468,"ongoing_decode_tokens":82672,"pending_prefill_tokens":22092,"num_requests":3,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":40567,"score_linear":305468.0,"score_lmetric":187977},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":38912,"new_prefill":1655,"score_linear":-37072.0,"score_lmetric":1655},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":40567,"score_linear":231476.0,"score_lmetric":107776},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40567,"score_linear":73878.0,"score_lmetric":43277},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":34816,"new_prefill":5751,"score_linear":-34816.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1663,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":40567,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37072.0,"chosen_score_lmetric":1655,"t_first_token":390506.521085239,"t_first_token_unix":1779821371.5350287,"t_done":390508.99913192,"t_done_unix":1779821374.0130768},{"request_id":"1399948:10:1434418:858","session_id":"1399948","input_length":12032,"t_proxy_recv":390510.280264459,"t_decision_unix":1779821375.2942057,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9787234042553191,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":256,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":0,"new_prefill":12032,"score_linear":263126.0,"score_lmetric":47606},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":12032,"score_linear":231476.0,"score_lmetric":79241},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":12032,"score_linear":73878.0,"score_lmetric":14742},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11776,"new_prefill":256,"score_linear":-11776.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":12032,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390510.319961493,"t_first_token_unix":1779821375.3339052,"t_done":390510.523894506,"t_done_unix":1779821375.5378377},{"request_id":"1399948:11:1435163:860","session_id":"1399948","input_length":12106,"t_proxy_recv":390512.981206989,"t_decision_unix":1779821377.995148,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9727407896910623,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":0,"new_prefill":12106,"score_linear":263126.0,"score_lmetric":47754},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":12106,"score_linear":231476.0,"score_lmetric":79315},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":12106,"score_linear":73878.0,"score_lmetric":14816},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11776,"new_prefill":330,"score_linear":-11776.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":12106,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":45269,"ongoing_decode_tokens":45269,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":12106,"score_linear":45269.0,"score_lmetric":12106}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390513.021411555,"t_first_token_unix":1779821378.035355,"t_done":390513.068654618,"t_done_unix":1779821378.082598},{"request_id":"1270340:6:1434904:859","session_id":"1270340","input_length":45269,"t_proxy_recv":390511.922728224,"t_decision_unix":1779821376.9366693,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9952947933464402,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":0,"new_prefill":45269,"score_linear":263126.0,"score_lmetric":114080},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":45269,"score_linear":231476.0,"score_lmetric":112478},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":43733,"score_linear":72342.0,"score_lmetric":46443},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":45269,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":45056,"new_prefill":213,"score_linear":-45056.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":390512.02595384,"t_first_token_unix":1779821377.0398977,"t_done":390513.490457826,"t_done_unix":1779821378.5044017},{"request_id":"1399948:12:1436179:863","session_id":"1399948","input_length":12164,"t_proxy_recv":390516.409239906,"t_decision_unix":1779821381.4231813,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9681025978296613,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":388,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":0,"new_prefill":12164,"score_linear":263126.0,"score_lmetric":47870},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":12164,"score_linear":231476.0,"score_lmetric":79373},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":12164,"score_linear":73878.0,"score_lmetric":14874},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":0,"pending_prefill_tokens":6884,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":12164,"score_linear":29412.0,"score_lmetric":19048},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11776,"new_prefill":388,"score_linear":-11776.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":12164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390516.455336764,"t_first_token_unix":1779821381.4692802,"t_done":390516.583834996,"t_done_unix":1779821381.597778},{"request_id":"1313181:9:1333349:415","session_id":"1313181","input_length":129673,"t_proxy_recv":390479.180686096,"t_decision_unix":1779821344.194627,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":62464,"affinity_cache_ratio":0.481703978468918,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":67209,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":232395,"ongoing_decode_tokens":146202,"pending_prefill_tokens":12465,"num_requests":2,"active_p_offloads":0,"cached_blocks":1866,"cache_hit":12800,"new_prefill":116873,"score_linear":219595.0,"score_lmetric":258676},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":62464,"new_prefill":67209,"score_linear":39339.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2085,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":39789,"ongoing_decode_tokens":0,"pending_prefill_tokens":1901,"num_requests":1,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":12800,"new_prefill":116873,"score_linear":26989.0,"score_lmetric":118774},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":198806,"ongoing_decode_tokens":198806,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":129673,"score_linear":198806.0,"score_lmetric":259346},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":129673,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":12800,"new_prefill":116873,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":39339.0,"chosen_score_lmetric":0,"t_first_token":390518.504194018,"t_first_token_unix":1779821383.5181375,"t_done":390521.154707069,"t_done_unix":1779821386.1686504},{"request_id":"1342921:5:1433192:855","session_id":"1342921","input_length":73878,"t_proxy_recv":390505.976868163,"t_decision_unix":1779821370.9908094,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9633179024878854,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":2710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":305468,"ongoing_decode_tokens":82672,"pending_prefill_tokens":22092,"num_requests":3,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":0,"new_prefill":73878,"score_linear":305468.0,"score_lmetric":287910},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":73878,"score_linear":1840.0,"score_lmetric":73878},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":73878,"score_linear":231476.0,"score_lmetric":141087},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":71168,"new_prefill":2710,"score_linear":-71168.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1663,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":73878,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":390524.811879629,"t_first_token_unix":1779821389.825823,"t_done":390526.412575729,"t_done_unix":1779821391.426524},{"request_id":"1363943:13:1438562:865","session_id":"1363943","input_length":28711,"t_proxy_recv":390524.378389788,"t_decision_unix":1779821389.3923314,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9451429765595069,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":1575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":8704,"new_prefill":20007,"score_linear":254422.0,"score_lmetric":63556},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":4096,"new_prefill":24615,"score_linear":123392.0,"score_lmetric":29735},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":0,"new_prefill":28711,"score_linear":164316.0,"score_lmetric":28711},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":27136,"new_prefill":1575,"score_linear":46742.0,"score_lmetric":4285},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":4096,"new_prefill":24615,"score_linear":25316.0,"score_lmetric":24615},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":4096,"new_prefill":24615,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":46742.0,"chosen_score_lmetric":4285,"t_first_token":390525.021591412,"t_first_token_unix":1779821390.0355349,"t_done":390528.786978639,"t_done_unix":1779821393.8009224},{"request_id":"1268861:10:1439325:866","session_id":"1268861","input_length":52920,"t_proxy_recv":390526.93498548,"t_decision_unix":1779821391.9489267,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9287981859410431,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":3768,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":263126,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":0,"new_prefill":52920,"score_linear":263126.0,"score_lmetric":105840},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":52920,"score_linear":127488.0,"score_lmetric":58040},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":0,"new_prefill":52920,"score_linear":164316.0,"score_lmetric":52920},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":28711,"ongoing_decode_tokens":28711,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2096,"cache_hit":0,"new_prefill":52920,"score_linear":28711.0,"score_lmetric":52920},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":52920,"score_linear":29412.0,"score_lmetric":52920},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":52920,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":49152,"new_prefill":3768,"score_linear":-49152.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":52920,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":390528.140813536,"t_first_token_unix":1779821393.154757,"t_done":390529.240470126,"t_done_unix":1779821394.2544153},{"request_id":"1405155:2:1414214:828","session_id":"1405155","input_length":40330,"t_proxy_recv":390487.924869112,"t_decision_unix":1779821352.9388106,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":33280,"affinity_cache_ratio":0.825192164641706,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":7050,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":241793,"ongoing_decode_tokens":241793,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1931,"cache_hit":33280,"new_prefill":7050,"score_linear":208513.0,"score_lmetric":14100},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":40330,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":40330,"score_linear":231476.0,"score_lmetric":107539},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":26923,"ongoing_decode_tokens":26923,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2087,"cache_hit":0,"new_prefill":40330,"score_linear":26923.0,"score_lmetric":40330},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":40330,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":72608,"ongoing_decode_tokens":72608,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1661,"cache_hit":512,"new_prefill":39818,"score_linear":72096.0,"score_lmetric":39818},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":40330,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":12596,"ongoing_decode_tokens":12596,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2030,"cache_hit":0,"new_prefill":40330,"score_linear":12596.0,"score_lmetric":40330}],"chosen_score_linear":208513.0,"chosen_score_lmetric":14100,"t_first_token":390495.67721402,"t_first_token_unix":1779821360.6911578,"t_done":390530.297518934,"t_done_unix":1779821395.3114643},{"request_id":"1364090:8:1417347:830","session_id":"1364090","input_length":96849,"t_proxy_recv":390493.95570841,"t_decision_unix":1779821358.96965,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":86528,"affinity_cache_ratio":0.893432043696889,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":86528,"estimated_new_tokens":10321,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":195930,"ongoing_decode_tokens":155600,"pending_prefill_tokens":7050,"num_requests":2,"active_p_offloads":0,"cached_blocks":1956,"cache_hit":86528,"new_prefill":10321,"score_linear":109402.0,"score_lmetric":34742},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":7680,"new_prefill":89169,"score_linear":-7680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":96849,"score_linear":231476.0,"score_lmetric":164058},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":7680,"new_prefill":89169,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":14336,"new_prefill":82513,"score_linear":-14336.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1663,"cache_hit":11264,"new_prefill":85585,"score_linear":-11264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":11264,"new_prefill":85585,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":7680,"new_prefill":89169,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":109402.0,"chosen_score_lmetric":34742,"t_first_token":390506.349628733,"t_first_token_unix":1779821371.3635721,"t_done":390532.272685059,"t_done_unix":1779821397.2866287},{"request_id":"1404395:2:1435941:862","session_id":"1404395","input_length":29412,"t_proxy_recv":390515.567291165,"t_decision_unix":1779821380.5812318,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":22528,"affinity_cache_ratio":0.7659458724330205,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22528,"estimated_new_tokens":6884,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":512,"new_prefill":28900,"score_linear":262614.0,"score_lmetric":81342},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":512,"new_prefill":28900,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":512,"new_prefill":28900,"score_linear":230964.0,"score_lmetric":96109},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":29412,"score_linear":73878.0,"score_lmetric":32122},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":22528,"new_prefill":6884,"score_linear":-22528.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":29412,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-22528.0,"chosen_score_lmetric":0,"t_first_token":390516.854304609,"t_first_token_unix":1779821381.868248,"t_done":390534.658346222,"t_done_unix":1779821399.6722915},{"request_id":"1371622:2:1442319:869","session_id":"1371622","input_length":19056,"t_proxy_recv":390536.784323066,"t_decision_unix":1779821401.798264,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":13312,"affinity_cache_ratio":0.6985726280436608,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13312,"estimated_new_tokens":5744,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":227379,"ongoing_decode_tokens":227379,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":19056,"score_linear":227379.0,"score_lmetric":19056},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":19056,"score_linear":127488.0,"score_lmetric":24176},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":0,"new_prefill":19056,"score_linear":164316.0,"score_lmetric":19056},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63153,"ongoing_decode_tokens":0,"pending_prefill_tokens":14001,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":19056,"score_linear":63153.0,"score_lmetric":33057},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":11264,"new_prefill":7792,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":19056,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":13312,"new_prefill":5744,"score_linear":-13312.0,"score_lmetric":0}],"chosen_score_linear":-13312.0,"chosen_score_lmetric":0,"t_first_token":390538.702761401,"t_first_token_unix":1779821403.716705,"t_done":390539.221582625,"t_done_unix":1779821404.235526},{"request_id":"1364090:9:1423736:840","session_id":"1364090","input_length":101432,"t_proxy_recv":390532.290146588,"t_decision_unix":1779821397.304088,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":97280,"affinity_cache_ratio":0.9590661724110734,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97280,"estimated_new_tokens":4152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":125947,"ongoing_decode_tokens":125947,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":97280,"new_prefill":4152,"score_linear":28667.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":7680,"new_prefill":93752,"score_linear":119808.0,"score_lmetric":98872},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":0,"new_prefill":101432,"score_linear":164316.0,"score_lmetric":101432},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":7680,"new_prefill":93752,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":14336,"new_prefill":87096,"score_linear":15076.0,"score_lmetric":87096},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11264,"new_prefill":90168,"score_linear":-11264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":11264,"new_prefill":90168,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":7680,"new_prefill":93752,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":28667.0,"chosen_score_lmetric":0,"t_first_token":390535.000382091,"t_first_token_unix":1779821400.014326,"t_done":390541.307218103,"t_done_unix":1779821406.3211625},{"request_id":"1371622:3:1443876:871","session_id":"1371622","input_length":19292,"t_proxy_recv":390541.892340344,"t_decision_unix":1779821406.906282,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":18944,"affinity_cache_ratio":0.9819614347916235,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18944,"estimated_new_tokens":348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":125947,"pending_prefill_tokens":6644,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":19292,"score_linear":233967.0,"score_lmetric":25936},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":19292,"score_linear":127488.0,"score_lmetric":24412},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":0,"new_prefill":19292,"score_linear":164316.0,"score_lmetric":19292},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63153,"ongoing_decode_tokens":0,"pending_prefill_tokens":14001,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":0,"new_prefill":19292,"score_linear":63153.0,"score_lmetric":33293},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":11264,"new_prefill":8028,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":19292,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":18944,"new_prefill":348,"score_linear":-18944.0,"score_lmetric":0}],"chosen_score_linear":-18944.0,"chosen_score_lmetric":0,"t_first_token":390541.977373114,"t_first_token_unix":1779821406.9913173,"t_done":390548.369668311,"t_done_unix":1779821413.3836117},{"request_id":"1294611:12:1441557:868","session_id":"1294611","input_length":63153,"t_proxy_recv":390534.054540657,"t_decision_unix":1779821399.0684817,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":49152,"affinity_cache_ratio":0.7783003182746663,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":14001,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":227379,"ongoing_decode_tokens":125947,"pending_prefill_tokens":4152,"num_requests":1,"active_p_offloads":0,"cached_blocks":2002,"cache_hit":0,"new_prefill":63153,"score_linear":227379.0,"score_lmetric":67305},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":63153,"score_linear":127488.0,"score_lmetric":68273},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":12800,"new_prefill":50353,"score_linear":151516.0,"score_lmetric":50353},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":49152,"new_prefill":14001,"score_linear":-49152.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":63153,"score_linear":29412.0,"score_lmetric":63153},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":12800,"new_prefill":50353,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":63153,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":12800,"new_prefill":50353,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":390548.061942492,"t_first_token_unix":1779821413.0758905,"t_done":390550.541132838,"t_done_unix":1779821415.555079},{"request_id":"1294611:13:1446349:872","session_id":"1294611","input_length":63488,"t_proxy_recv":390550.552026232,"t_decision_unix":1779821415.5659676,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":62976,"affinity_cache_ratio":0.9919354838709677,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":512,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":63488,"score_linear":233967.0,"score_lmetric":63488},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":63488,"score_linear":127488.0,"score_lmetric":68608},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":12800,"new_prefill":50688,"score_linear":151516.0,"score_lmetric":50688},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2127,"cache_hit":62976,"new_prefill":512,"score_linear":-62976.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":12800,"new_prefill":50688,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":63488,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2045,"cache_hit":12800,"new_prefill":50688,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":390550.659916599,"t_first_token_unix":1779821415.6738603,"t_done":390551.644049087,"t_done_unix":1779821416.6579924},{"request_id":"1313181:9:1386945:689","session_id":"1313181","input_length":62513,"t_proxy_recv":390521.163307851,"t_decision_unix":1779821386.1772494,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":62464,"affinity_cache_ratio":0.999216163038088,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62464,"estimated_new_tokens":49,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":12800,"new_prefill":49713,"score_linear":250326.0,"score_lmetric":122968},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":62464,"new_prefill":49,"score_linear":39339.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":62513,"score_linear":73878.0,"score_lmetric":65223},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":12800,"new_prefill":49713,"score_linear":16612.0,"score_lmetric":49713},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":62513,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":12800,"new_prefill":49713,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":39339.0,"chosen_score_lmetric":0,"t_first_token":390521.2592381,"t_first_token_unix":1779821386.2731814,"t_done":390551.809330555,"t_done_unix":1779821416.8232737},{"request_id":"1342921:6:1448548:876","session_id":"1342921","input_length":75761,"t_proxy_recv":390557.523937539,"t_decision_unix":1779821422.5378788,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9731656129142963,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":2033,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":75761,"score_linear":233967.0,"score_lmetric":75761},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":75761,"score_linear":127488.0,"score_lmetric":80881},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":75761,"score_linear":231642.0,"score_lmetric":141088},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2128,"cache_hit":73728,"new_prefill":2033,"score_linear":-73728.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2045,"cache_hit":0,"new_prefill":75761,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":390558.478234796,"t_first_token_unix":1779821423.4921782,"t_done":390558.838821974,"t_done_unix":1779821423.852765},{"request_id":"1294611:14:1449074:877","session_id":"1294611","input_length":63616,"t_proxy_recv":390559.34842723,"t_decision_unix":1779821424.3623688,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":63488,"affinity_cache_ratio":0.9979879275653923,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":63488,"estimated_new_tokens":128,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":63616,"score_linear":233967.0,"score_lmetric":63616},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":63616,"score_linear":127488.0,"score_lmetric":68736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":12800,"new_prefill":50816,"score_linear":218842.0,"score_lmetric":116143},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2132,"cache_hit":63488,"new_prefill":128,"score_linear":-63488.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":12800,"new_prefill":50816,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":63616,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2045,"cache_hit":12800,"new_prefill":50816,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-63488.0,"chosen_score_lmetric":0,"t_first_token":390559.440243159,"t_first_token_unix":1779821424.4541864,"t_done":390564.244035439,"t_done_unix":1779821429.2579792},{"request_id":"1371622:4:1452210:881","session_id":"1371622","input_length":20439,"t_proxy_recv":390569.790028836,"t_decision_unix":1779821434.8039706,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9769558197563482,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":20439,"score_linear":233967.0,"score_lmetric":20439},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":20439,"score_linear":127488.0,"score_lmetric":25559},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":20439,"score_linear":231642.0,"score_lmetric":85766},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":11264,"new_prefill":9175,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":20439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":55050,"ongoing_decode_tokens":0,"pending_prefill_tokens":2314,"num_requests":1,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":20439,"score_linear":55050.0,"score_lmetric":22753},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2045,"cache_hit":19968,"new_prefill":471,"score_linear":-19968.0,"score_lmetric":0}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":390569.849138868,"t_first_token_unix":1779821434.8630834,"t_done":390570.372564144,"t_done_unix":1779821435.3865073},{"request_id":"1268861:11:1452208:880","session_id":"1268861","input_length":55050,"t_proxy_recv":390569.763084138,"t_decision_unix":1779821434.7770252,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9579654859218892,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2314,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":55050,"score_linear":233967.0,"score_lmetric":55050},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":55050,"score_linear":127488.0,"score_lmetric":60170},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":55050,"score_linear":231642.0,"score_lmetric":120377},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":52736,"new_prefill":2314,"score_linear":-52736.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2045,"cache_hit":0,"new_prefill":55050,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":390570.593113448,"t_first_token_unix":1779821435.6070573,"t_done":390571.064523195,"t_done_unix":1779821436.0784671},{"request_id":"1356885:2:1438037:864","session_id":"1356885","input_length":127488,"t_proxy_recv":390522.676247073,"t_decision_unix":1779821387.6901882,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":122368,"affinity_cache_ratio":0.9598393574297188,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":122368,"estimated_new_tokens":5120,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":263126,"ongoing_decode_tokens":137179,"pending_prefill_tokens":11771,"num_requests":2,"active_p_offloads":0,"cached_blocks":1967,"cache_hit":0,"new_prefill":127488,"score_linear":263126.0,"score_lmetric":278518},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":122368,"new_prefill":5120,"score_linear":-122368.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":1024,"new_prefill":126464,"score_linear":163292.0,"score_lmetric":126464},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":73878,"ongoing_decode_tokens":0,"pending_prefill_tokens":2710,"num_requests":1,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":127488,"score_linear":73878.0,"score_lmetric":130198},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":29412,"ongoing_decode_tokens":29412,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":127488,"score_linear":29412.0,"score_lmetric":127488},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":127488,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-122368.0,"chosen_score_lmetric":0,"t_first_token":390571.793741343,"t_first_token_unix":1779821436.8076873,"t_done":390573.366957176,"t_done_unix":1779821438.3809032},{"request_id":"1264679:3:1431512:853","session_id":"1264679","input_length":125947,"t_proxy_recv":390499.795433368,"t_decision_unix":1779821364.8093748,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":114176,"affinity_cache_ratio":0.9065400525617918,"affinity_num_requests":2,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":114176,"estimated_new_tokens":11771,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":179521,"ongoing_decode_tokens":82672,"pending_prefill_tokens":10321,"num_requests":2,"active_p_offloads":0,"cached_blocks":1963,"cache_hit":114176,"new_prefill":11771,"score_linear":65345.0,"score_lmetric":44184},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":1840,"ongoing_decode_tokens":1840,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1643,"cache_hit":0,"new_prefill":125947,"score_linear":1840.0,"score_lmetric":125947},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231476,"ongoing_decode_tokens":101803,"pending_prefill_tokens":67209,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":125947,"score_linear":231476.0,"score_lmetric":193156},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1728,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1663,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1678,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2032,"cache_hit":0,"new_prefill":125947,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":65345.0,"chosen_score_lmetric":44184,"t_first_token":390524.72730697,"t_first_token_unix":1779821389.7412505,"t_done":390579.619422867,"t_done_unix":1779821444.6333666},{"request_id":"1371622:5:1455608:884","session_id":"1371622","input_length":21518,"t_proxy_recv":390581.550052095,"t_decision_unix":1779821446.5639935,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":20480,"affinity_cache_ratio":0.951761316107445,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":20480,"estimated_new_tokens":1038,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":0,"new_prefill":21518,"score_linear":108020.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":128563,"ongoing_decode_tokens":128563,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":0,"new_prefill":21518,"score_linear":128563.0,"score_lmetric":21518},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":21518,"score_linear":231642.0,"score_lmetric":86845},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":11264,"new_prefill":10254,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":21518,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2046,"cache_hit":20480,"new_prefill":1038,"score_linear":-20480.0,"score_lmetric":0}],"chosen_score_linear":-20480.0,"chosen_score_lmetric":0,"t_first_token":390581.786772317,"t_first_token_unix":1779821446.800716,"t_done":390582.230580018,"t_done_unix":1779821447.2445235},{"request_id":"1356885:3:1451307:879","session_id":"1356885","input_length":128563,"t_proxy_recv":390573.387912515,"t_decision_unix":1779821438.401854,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":127488,"affinity_cache_ratio":0.9916383407356705,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":127488,"estimated_new_tokens":1075,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":0,"new_prefill":128563,"score_linear":233967.0,"score_lmetric":128563},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1660,"cache_hit":127488,"new_prefill":1075,"score_linear":-127488.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":101803,"pending_prefill_tokens":65327,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":1024,"new_prefill":127539,"score_linear":230618.0,"score_lmetric":192866},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2046,"cache_hit":0,"new_prefill":128563,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-127488.0,"chosen_score_lmetric":0,"t_first_token":390574.493622306,"t_first_token_unix":1779821439.507566,"t_done":390590.928851855,"t_done_unix":1779821455.942799},{"request_id":"1313181:10:1338837:436","session_id":"1313181","input_length":129839,"t_proxy_recv":390551.82950836,"t_decision_unix":1779821416.8434498,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":64512,"affinity_cache_ratio":0.4968614977009989,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":65327,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":233967,"ongoing_decode_tokens":233967,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":12800,"new_prefill":117039,"score_linear":221167.0,"score_lmetric":117039},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":0,"new_prefill":129839,"score_linear":127488.0,"score_lmetric":134959},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":64512,"new_prefill":65327,"score_linear":37291.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2128,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":12800,"new_prefill":117039,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":0,"new_prefill":129839,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2045,"cache_hit":12800,"new_prefill":117039,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":37291.0,"chosen_score_lmetric":0,"t_first_token":390590.313930325,"t_first_token_unix":1779821455.3278737,"t_done":390591.667577739,"t_done_unix":1779821456.6815214},{"request_id":"1363943:14:1458616:885","session_id":"1363943","input_length":29268,"t_proxy_recv":390591.495857744,"t_decision_unix":1779821456.5097992,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29184,"affinity_cache_ratio":0.997129971299713,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":84,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":8704,"new_prefill":20564,"score_linear":99316.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231642,"ongoing_decode_tokens":231642,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":29268,"score_linear":231642.0,"score_lmetric":29268},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":29184,"new_prefill":84,"score_linear":-29184.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":4096,"new_prefill":25172,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":390591.580404248,"t_first_token_unix":1779821456.5943475,"t_done":390592.139831423,"t_done_unix":1779821457.1537745},{"request_id":"1313181:10:1399867:746","session_id":"1313181","input_length":64724,"t_proxy_recv":390591.683121284,"t_decision_unix":1779821456.697063,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":64512,"affinity_cache_ratio":0.9967245534886595,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64512,"estimated_new_tokens":212,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":12800,"new_prefill":51924,"score_linear":95220.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":64512,"new_prefill":212,"score_linear":37291.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":29268,"ongoing_decode_tokens":29268,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":64724,"score_linear":29268.0,"score_lmetric":64724},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":12800,"new_prefill":51924,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":64724,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":12800,"new_prefill":51924,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":37291.0,"chosen_score_lmetric":0,"t_first_token":390591.780773474,"t_first_token_unix":1779821456.7947166,"t_done":390597.313647812,"t_done_unix":1779821462.3275986},{"request_id":"1404395:3:1460072:887","session_id":"1404395","input_length":34392,"t_proxy_recv":390596.133326287,"t_decision_unix":1779821461.1472676,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":31744,"affinity_cache_ratio":0.9230053500814143,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31744,"estimated_new_tokens":2648,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134426,"ongoing_decode_tokens":108020,"pending_prefill_tokens":294,"num_requests":1,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":512,"new_prefill":33880,"score_linear":133914.0,"score_lmetric":34174},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":33880,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":166527,"ongoing_decode_tokens":166527,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":512,"new_prefill":33880,"score_linear":166015.0,"score_lmetric":33880},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":31744,"new_prefill":2648,"score_linear":-31744.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":0,"new_prefill":34392,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31744.0,"chosen_score_lmetric":0,"t_first_token":390596.751520264,"t_first_token_unix":1779821461.7654636,"t_done":390599.145636702,"t_done_unix":1779821464.1595802},{"request_id":"1363943:15:1461716:889","session_id":"1363943","input_length":29651,"t_proxy_recv":390601.427601133,"t_decision_unix":1779821466.4415426,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29184,"affinity_cache_ratio":0.984250109608445,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":467,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134426,"ongoing_decode_tokens":134426,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":8704,"new_prefill":20947,"score_linear":125722.0,"score_lmetric":20947},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":29651,"score_linear":231734.0,"score_lmetric":94558},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":29184,"new_prefill":467,"score_linear":-29184.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1748,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":4096,"new_prefill":25555,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81299,"ongoing_decode_tokens":0,"pending_prefill_tokens":8083,"num_requests":1,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":4096,"new_prefill":25555,"score_linear":77203.0,"score_lmetric":33638}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":390601.597759987,"t_first_token_unix":1779821466.6117036,"t_done":390602.964990916,"t_done_unix":1779821467.978934},{"request_id":"1242838:5:1460026:886","session_id":"1242838","input_length":26406,"t_proxy_recv":390595.984265214,"t_decision_unix":1779821460.9982066,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9888661667802772,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":294,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":26112,"new_prefill":294,"score_linear":81908.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":166527,"ongoing_decode_tokens":166527,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":26406,"score_linear":166527.0,"score_lmetric":26406},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":3584,"new_prefill":22822,"score_linear":-3584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":0,"new_prefill":26406,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":81908.0,"chosen_score_lmetric":0,"t_first_token":390599.246355678,"t_first_token_unix":1779821464.2602997,"t_done":390603.241325717,"t_done_unix":1779821468.25527},{"request_id":"1363943:16:1463626:890","session_id":"1363943","input_length":34671,"t_proxy_recv":390607.890087393,"t_decision_unix":1779821472.9040287,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":29696,"affinity_cache_ratio":0.8565083210752502,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":4975,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":8704,"new_prefill":25967,"score_linear":99316.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":34671,"score_linear":231734.0,"score_lmetric":99578},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2134,"cache_hit":29696,"new_prefill":4975,"score_linear":-29696.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1748,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":4096,"new_prefill":30575,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81299,"ongoing_decode_tokens":0,"pending_prefill_tokens":8083,"num_requests":1,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":4096,"new_prefill":30575,"score_linear":77203.0,"score_lmetric":38658}],"chosen_score_linear":-29696.0,"chosen_score_lmetric":0,"t_first_token":390609.038079777,"t_first_token_unix":1779821474.052023,"t_done":390610.48975925,"t_done_unix":1779821475.5037026},{"request_id":"1268861:12:1463977:891","session_id":"1268861","input_length":56147,"t_proxy_recv":390609.175805538,"t_decision_unix":1779821474.1897466,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9757244376369174,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":1363,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":108020,"ongoing_decode_tokens":108020,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":0,"new_prefill":56147,"score_linear":108020.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":56147,"score_linear":231734.0,"score_lmetric":121054},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":34671,"ongoing_decode_tokens":34671,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2134,"cache_hit":0,"new_prefill":56147,"score_linear":34671.0,"score_lmetric":56147},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1748,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":56147,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":54784,"new_prefill":1363,"score_linear":-54784.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81299,"ongoing_decode_tokens":0,"pending_prefill_tokens":8083,"num_requests":1,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":0,"new_prefill":56147,"score_linear":81299.0,"score_lmetric":64230}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":390609.696099707,"t_first_token_unix":1779821474.7100432,"t_done":390610.583626766,"t_done_unix":1779821475.5975704},{"request_id":"1364090:10:1426859:847","session_id":"1364090","input_length":108020,"t_proxy_recv":390541.325585286,"t_decision_unix":1779821406.3395267,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9384928716904277,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":6644,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":125947,"ongoing_decode_tokens":125947,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2010,"cache_hit":101376,"new_prefill":6644,"score_linear":24571.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":127488,"ongoing_decode_tokens":0,"pending_prefill_tokens":5120,"num_requests":1,"active_p_offloads":0,"cached_blocks":1650,"cache_hit":7680,"new_prefill":100340,"score_linear":119808.0,"score_lmetric":105460},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":164316,"ongoing_decode_tokens":164316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2312,"cache_hit":0,"new_prefill":108020,"score_linear":164316.0,"score_lmetric":108020},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":63153,"ongoing_decode_tokens":0,"pending_prefill_tokens":14001,"num_requests":1,"active_p_offloads":0,"cached_blocks":2100,"cache_hit":7680,"new_prefill":100340,"score_linear":55473.0,"score_lmetric":114341},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":14336,"new_prefill":93684,"score_linear":-14336.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11264,"new_prefill":96756,"score_linear":-11264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1685,"cache_hit":11264,"new_prefill":96756,"score_linear":-11264.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2043,"cache_hit":7680,"new_prefill":100340,"score_linear":-7680.0,"score_lmetric":0}],"chosen_score_linear":24571.0,"chosen_score_lmetric":0,"t_first_token":390545.531415765,"t_first_token_unix":1779821410.5453596,"t_done":390613.270750862,"t_done_unix":1779821478.2846944},{"request_id":"1363943:17:1466811:893","session_id":"1363943","input_length":35991,"t_proxy_recv":390618.572383599,"t_decision_unix":1779821483.5863247,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9673529493484482,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":1175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":8704,"new_prefill":27287,"score_linear":-8704.0,"score_lmetric":-27287},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":35991,"score_linear":231734.0,"score_lmetric":100898},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2144,"cache_hit":34816,"new_prefill":1175,"score_linear":-34816.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1748,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":4096,"new_prefill":31895,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":104378,"ongoing_decode_tokens":0,"pending_prefill_tokens":9658,"num_requests":2,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":4096,"new_prefill":31895,"score_linear":100282.0,"score_lmetric":83106}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":390618.931629672,"t_first_token_unix":1779821483.9455729,"t_done":390620.046396368,"t_done_unix":1779821485.060341},{"request_id":"1363093:6:1460799:888","session_id":"1363093","input_length":81299,"t_proxy_recv":390598.566601532,"t_decision_unix":1779821463.5805428,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9005768828644879,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":8083,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134426,"ongoing_decode_tokens":108020,"pending_prefill_tokens":294,"num_requests":1,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":0,"new_prefill":81299,"score_linear":134426.0,"score_lmetric":81593},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":81299,"score_linear":231734.0,"score_lmetric":146206},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34392,"ongoing_decode_tokens":34392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":0,"new_prefill":81299,"score_linear":34392.0,"score_lmetric":81299},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":81299,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":73216,"new_prefill":8083,"score_linear":-73216.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":390620.900740041,"t_first_token_unix":1779821485.914683,"t_done":390621.828683632,"t_done_unix":1779821486.8426273},{"request_id":"1371622:6:1465333:892","session_id":"1371622","input_length":23079,"t_proxy_recv":390613.431631702,"t_decision_unix":1779821478.4455733,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9317561419472248,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":1575,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":-23079},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":23079,"score_linear":231734.0,"score_lmetric":87986},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2144,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1748,"cache_hit":11264,"new_prefill":11815,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":23079,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":81299,"ongoing_decode_tokens":0,"pending_prefill_tokens":8083,"num_requests":1,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":21504,"new_prefill":1575,"score_linear":59795.0,"score_lmetric":9658}],"chosen_score_linear":59795.0,"chosen_score_lmetric":9658,"t_first_token":390621.080169686,"t_first_token_unix":1779821486.094113,"t_done":390621.923751128,"t_done_unix":1779821486.9376945},{"request_id":"1404395:4:1467473:894","session_id":"1404395","input_length":34863,"t_proxy_recv":390620.886006672,"t_decision_unix":1779821485.899948,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34304,"affinity_cache_ratio":0.9839658090238935,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34304,"estimated_new_tokens":559,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":512,"new_prefill":34351,"score_linear":-512.0,"score_lmetric":-34351},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":34351,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":512,"new_prefill":34351,"score_linear":231222.0,"score_lmetric":99258},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2146,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1748,"cache_hit":34304,"new_prefill":559,"score_linear":-34304.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":34863,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":104378,"ongoing_decode_tokens":0,"pending_prefill_tokens":9658,"num_requests":2,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":0,"new_prefill":34863,"score_linear":104378.0,"score_lmetric":89042}],"chosen_score_linear":-34304.0,"chosen_score_lmetric":0,"t_first_token":390620.990336453,"t_first_token_unix":1779821486.00428,"t_done":390622.222336138,"t_done_unix":1779821487.2362792},{"request_id":"1371622:7:1468305:895","session_id":"1371622","input_length":24036,"t_proxy_recv":390623.657126209,"t_decision_unix":1779821488.6710677,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9585621567648527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":-24036},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":24036,"score_linear":231734.0,"score_lmetric":88943},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2146,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":11264,"new_prefill":12772,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":24036,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2066,"cache_hit":23040,"new_prefill":996,"score_linear":-23040.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":390623.874780107,"t_first_token_unix":1779821488.8887239,"t_done":390624.70772317,"t_done_unix":1779821489.7216663},{"request_id":"1363943:18:1469143:896","session_id":"1363943","input_length":47303,"t_proxy_recv":390626.474684826,"t_decision_unix":1779821491.4886258,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":35840,"affinity_cache_ratio":0.7576686468088705,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":11463,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":8704,"new_prefill":38599,"score_linear":-8704.0,"score_lmetric":-38599},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":47303,"score_linear":231734.0,"score_lmetric":112210},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2146,"cache_hit":35840,"new_prefill":11463,"score_linear":-35840.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":4096,"new_prefill":43207,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":390629.678850139,"t_first_token_unix":1779821494.6927938,"t_done":390632.404873225,"t_done_unix":1779821497.4188206},{"request_id":"1313181:11:1344301:464","session_id":"1313181","input_length":129931,"t_proxy_recv":390597.335640207,"t_decision_unix":1779821462.3495815,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.5004502389729933,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":64907,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":134426,"ongoing_decode_tokens":108020,"pending_prefill_tokens":294,"num_requests":1,"active_p_offloads":0,"cached_blocks":2034,"cache_hit":12800,"new_prefill":117131,"score_linear":121626.0,"score_lmetric":117425},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":65024,"new_prefill":64907,"score_linear":36779.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2133,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":34392,"ongoing_decode_tokens":34392,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1743,"cache_hit":12800,"new_prefill":117131,"score_linear":21592.0,"score_lmetric":117131},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":129931,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2048,"cache_hit":12800,"new_prefill":117131,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":36779.0,"chosen_score_lmetric":0,"t_first_token":390635.738061789,"t_first_token_unix":1779821500.752007,"t_done":390637.088944613,"t_done_unix":1779821502.102888},{"request_id":"1314357:5:1393659:719","session_id":"1314357","input_length":101803,"t_proxy_recv":390374.357445334,"t_decision_unix":1779821239.3713865,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":73216,"affinity_cache_ratio":0.7191929510918146,"affinity_num_requests":1,"avg_num_requests":1.25,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":28587,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":33321,"ongoing_decode_tokens":33321,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":101803,"score_linear":33321.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":121708,"ongoing_decode_tokens":4675,"pending_prefill_tokens":21801,"num_requests":3,"active_p_offloads":0,"cached_blocks":1518,"cache_hit":3584,"new_prefill":98219,"score_linear":118124.0,"score_lmetric":360060},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":82226,"ongoing_decode_tokens":82226,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":73216,"new_prefill":28587,"score_linear":9010.0,"score_lmetric":28587},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":272137,"ongoing_decode_tokens":202672,"pending_prefill_tokens":3417,"num_requests":4,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":101803,"score_linear":272137.0,"score_lmetric":420880},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":35450,"ongoing_decode_tokens":0,"pending_prefill_tokens":35450,"num_requests":1,"active_p_offloads":0,"cached_blocks":1473,"cache_hit":0,"new_prefill":101803,"score_linear":35450.0,"score_lmetric":137253},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":85276,"ongoing_decode_tokens":85276,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1425,"cache_hit":0,"new_prefill":101803,"score_linear":85276.0,"score_lmetric":101803},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1584,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1769,"cache_hit":0,"new_prefill":101803,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":9010.0,"chosen_score_lmetric":28587,"t_first_token":390389.704978764,"t_first_token_unix":1779821254.7189226,"t_done":390637.566135159,"t_done_unix":1779821502.5800784},{"request_id":"1313181:11:1402841:762","session_id":"1313181","input_length":65123,"t_proxy_recv":390637.099942035,"t_decision_unix":1779821502.113883,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9984797997635244,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":99,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":0,"pending_prefill_tokens":25798,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":12800,"new_prefill":52323,"score_linear":53446.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":101803,"ongoing_decode_tokens":101803,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2319,"cache_hit":65024,"new_prefill":99,"score_linear":36779.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":12800,"new_prefill":52323,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":65123,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":12800,"new_prefill":52323,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":36779.0,"chosen_score_lmetric":0,"t_first_token":390637.197330917,"t_first_token_unix":1779821502.2112744,"t_done":390637.926348721,"t_done_unix":1779821502.9402921},{"request_id":"1399948:13:1472968:898","session_id":"1399948","input_length":12247,"t_proxy_recv":390639.016695817,"t_decision_unix":1779821504.0306365,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11776,"affinity_cache_ratio":0.9615416020249857,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":471,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":0,"pending_prefill_tokens":25798,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":0,"new_prefill":12247,"score_linear":66246.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":12247,"score_linear":236188.0,"score_lmetric":77702},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11776,"new_prefill":471,"score_linear":-11776.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":0,"new_prefill":12247,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390639.067068497,"t_first_token_unix":1779821504.0810125,"t_done":390639.20240051,"t_done_unix":1779821504.2163439},{"request_id":"1405155:3:1469167:897","session_id":"1405155","input_length":66246,"t_proxy_recv":390626.552294864,"t_decision_unix":1779821491.5662363,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":40448,"affinity_cache_ratio":0.610572713824231,"affinity_num_requests":-1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":25798,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":40448,"new_prefill":25798,"score_linear":-40448.0,"score_lmetric":-25798},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":231734,"ongoing_decode_tokens":101803,"pending_prefill_tokens":64907,"num_requests":1,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":0,"new_prefill":66246,"score_linear":231734.0,"score_lmetric":131153},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":47303,"ongoing_decode_tokens":0,"pending_prefill_tokens":11463,"num_requests":1,"active_p_offloads":0,"cached_blocks":2146,"cache_hit":0,"new_prefill":66246,"score_linear":47303.0,"score_lmetric":77709},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":65734,"score_linear":-512.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":0,"new_prefill":66246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":-25798,"t_first_token":390640.953851044,"t_first_token_unix":1779821505.9677944,"t_done":390642.750593754,"t_done_unix":1779821507.764537},{"request_id":"1371622:8:1473416:899","session_id":"1371622","input_length":24569,"t_proxy_recv":390640.677280952,"t_decision_unix":1779821505.6912224,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9794456428833083,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":0,"pending_prefill_tokens":25798,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":0,"new_prefill":24569,"score_linear":66246.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":24569,"score_linear":236188.0,"score_lmetric":90024},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":11264,"new_prefill":13305,"score_linear":-11264.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":24569,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":24064,"new_prefill":505,"score_linear":-24064.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":390640.834917686,"t_first_token_unix":1779821505.8488615,"t_done":390643.944148355,"t_done_unix":1779821508.958092},{"request_id":"1342921:7:1473812:900","session_id":"1342921","input_length":76600,"t_proxy_recv":390641.981328802,"t_decision_unix":1779821506.9952703,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9892428198433421,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":824,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":66246,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":0,"new_prefill":76600,"score_linear":66246.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":76600,"score_linear":236188.0,"score_lmetric":142055},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":75776,"new_prefill":824,"score_linear":-75776.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":76600,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24569,"ongoing_decode_tokens":24569,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":0,"new_prefill":76600,"score_linear":24569.0,"score_lmetric":76600}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":390642.525920155,"t_first_token_unix":1779821507.5398636,"t_done":390647.213218599,"t_done_unix":1779821512.2271624},{"request_id":"1363943:19:1473899:901","session_id":"1363943","input_length":56056,"t_proxy_recv":390642.25063749,"t_decision_unix":1779821507.2645788,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":47616,"affinity_cache_ratio":0.8494362780077066,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47616,"estimated_new_tokens":8440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":66246,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":8704,"new_prefill":47352,"score_linear":57542.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":56056,"score_linear":236188.0,"score_lmetric":121511},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":76600,"ongoing_decode_tokens":0,"pending_prefill_tokens":824,"num_requests":1,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":47616,"new_prefill":8440,"score_linear":28984.0,"score_lmetric":9264},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":4096,"new_prefill":51960,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":24569,"ongoing_decode_tokens":24569,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":4096,"new_prefill":51960,"score_linear":20473.0,"score_lmetric":51960}],"chosen_score_linear":28984.0,"chosen_score_lmetric":9264,"t_first_token":390645.38463205,"t_first_token_unix":1779821510.3985765,"t_done":390647.918112513,"t_done_unix":1779821512.9320564},{"request_id":"1363943:20:1476805:903","session_id":"1363943","input_length":60761,"t_proxy_recv":390652.217956028,"t_decision_unix":1779821517.2318969,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9184838959200803,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":4953,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":44949,"ongoing_decode_tokens":0,"pending_prefill_tokens":44949,"num_requests":0,"active_p_offloads":0,"cached_blocks":2097,"cache_hit":8704,"new_prefill":52057,"score_linear":36245.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":60761,"score_linear":236188.0,"score_lmetric":126216},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2186,"cache_hit":55808,"new_prefill":4953,"score_linear":-55808.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2069,"cache_hit":4096,"new_prefill":56665,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":390654.000484751,"t_first_token_unix":1779821519.014429,"t_done":390657.434560546,"t_done_unix":1779821522.448506},{"request_id":"1305906:4:1476757:902","session_id":"1305906","input_length":44949,"t_proxy_recv":390652.040035049,"t_decision_unix":1779821517.0539756,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":5,"chosen_idx":0,"affinity_cache_hit":16896,"affinity_cache_ratio":0.375892678368818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":-44949,"tie_break_used":false,"cache_hit":0,"estimated_new_tokens":44949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2097,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":-44949},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":44949,"score_linear":236188.0,"score_lmetric":110404},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2186,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":16896,"new_prefill":28053,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2069,"cache_hit":0,"new_prefill":44949,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":-44949,"t_first_token":390659.827924087,"t_first_token_unix":1779821524.8418674,"t_done":390661.149850913,"t_done_unix":1779821526.1637945},{"request_id":"1371622:9:1479535:905","session_id":"1371622","input_length":25286,"t_proxy_recv":390661.352458601,"t_decision_unix":1779821526.3663995,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":24576,"affinity_cache_ratio":0.9719212212291386,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":-25286},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":25286,"score_linear":236188.0,"score_lmetric":90741},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2196,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":11264,"new_prefill":14022,"score_linear":27563.0,"score_lmetric":14022},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":25286,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2069,"cache_hit":24576,"new_prefill":710,"score_linear":-24576.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390661.46487619,"t_first_token_unix":1779821526.4788196,"t_done":390662.007166603,"t_done_unix":1779821527.02111},{"request_id":"1404395:5:1480170:906","session_id":"1404395","input_length":36988,"t_proxy_recv":390663.593278858,"t_decision_unix":1779821528.6072202,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9412782524061858,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":2172,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":512,"new_prefill":36476,"score_linear":-512.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":36476,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":512,"new_prefill":36476,"score_linear":235676.0,"score_lmetric":101931},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2196,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":34816,"new_prefill":2172,"score_linear":4011.0,"score_lmetric":2172},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":36988,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":4011.0,"chosen_score_lmetric":2172,"t_first_token":390664.177535131,"t_first_token_unix":1779821529.19148,"t_done":390667.773831247,"t_done_unix":1779821532.787775},{"request_id":"1268861:13:1481831:907","session_id":"1268861","input_length":57130,"t_proxy_recv":390669.18544743,"t_decision_unix":1779821534.199389,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":55808,"affinity_cache_ratio":0.976859793453527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":1322,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":57130,"score_linear":236188.0,"score_lmetric":122585},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2196,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":57130,"score_linear":38827.0,"score_lmetric":57130},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":55808,"new_prefill":1322,"score_linear":-55808.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":57130,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":390669.613018183,"t_first_token_unix":1779821534.6269624,"t_done":390670.887728196,"t_done_unix":1779821535.901672},{"request_id":"1301929:4:1479037:904","session_id":"1301929","input_length":38827,"t_proxy_recv":390659.610312651,"t_decision_unix":1779821524.6242537,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9890024982615191,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":427,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":44949,"ongoing_decode_tokens":0,"pending_prefill_tokens":44949,"num_requests":0,"active_p_offloads":0,"cached_blocks":2097,"cache_hit":3584,"new_prefill":35243,"score_linear":41365.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":38827,"score_linear":236188.0,"score_lmetric":104282},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2196,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":38400,"new_prefill":427,"score_linear":-38400.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2069,"cache_hit":0,"new_prefill":38827,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":390659.674191514,"t_first_token_unix":1779821524.6881351,"t_done":390672.569898949,"t_done_unix":1779821537.5838423},{"request_id":"1363943:21:1482184:908","session_id":"1363943","input_length":65658,"t_proxy_recv":390670.524121041,"t_decision_unix":1779821535.5380623,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9279600353346127,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":4730,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":8704,"new_prefill":56954,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":0,"new_prefill":65658,"score_linear":236188.0,"score_lmetric":131113},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2196,"cache_hit":60928,"new_prefill":4730,"score_linear":-60928.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":38827,"ongoing_decode_tokens":38827,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":4096,"new_prefill":61562,"score_linear":34731.0,"score_lmetric":61562},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":57130,"ongoing_decode_tokens":57130,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":4096,"new_prefill":61562,"score_linear":53034.0,"score_lmetric":61562},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":61562,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":390672.442209947,"t_first_token_unix":1779821537.456156,"t_done":390675.557054457,"t_done_unix":1779821540.5709977},{"request_id":"1313181:12:1346194:470","session_id":"1313181","input_length":130479,"t_proxy_recv":390637.947389025,"t_decision_unix":1779821502.9613304,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.49834839322802904,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":65455,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":0,"pending_prefill_tokens":25798,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":12800,"new_prefill":117679,"score_linear":53446.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":105709,"ongoing_decode_tokens":105709,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":65024,"new_prefill":65455,"score_linear":40685.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":12800,"new_prefill":117679,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":130479,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":12800,"new_prefill":117679,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":40685.0,"chosen_score_lmetric":0,"t_first_token":390676.627739629,"t_first_token_unix":1779821541.6416838,"t_done":390678.047036678,"t_done_unix":1779821543.0609803},{"request_id":"1404395:6:1483967:909","session_id":"1404395","input_length":37689,"t_proxy_recv":390676.436647322,"t_decision_unix":1779821541.450589,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9781103239672053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":825,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":512,"new_prefill":37177,"score_linear":-512.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":37177,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":236188,"ongoing_decode_tokens":105709,"pending_prefill_tokens":65455,"num_requests":1,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":512,"new_prefill":37177,"score_linear":235676.0,"score_lmetric":102632},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":36864,"new_prefill":825,"score_linear":-36864.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":37689,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":390676.645633144,"t_first_token_unix":1779821541.6595767,"t_done":390679.135449068,"t_done_unix":1779821544.1493933},{"request_id":"1313181:12:1404813:772","session_id":"1313181","input_length":65179,"t_proxy_recv":390678.057354092,"t_decision_unix":1779821543.0712955,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9976219334448212,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":155,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":12800,"new_prefill":52379,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":105709,"ongoing_decode_tokens":105709,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":65024,"new_prefill":155,"score_linear":40685.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":37689,"ongoing_decode_tokens":37689,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":12800,"new_prefill":52379,"score_linear":24889.0,"score_lmetric":52379},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":65179,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":12800,"new_prefill":52379,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":40685.0,"chosen_score_lmetric":0,"t_first_token":390678.164571914,"t_first_token_unix":1779821543.1785154,"t_done":390679.147301642,"t_done_unix":1779821544.161245},{"request_id":"1363943:22:1485341:910","session_id":"1363943","input_length":70238,"t_proxy_recv":390681.172371263,"t_decision_unix":1779821546.1863124,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":65536,"affinity_cache_ratio":0.9330561804151599,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":4702,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":8704,"new_prefill":61534,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":70238,"score_linear":237408.0,"score_lmetric":136913},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":65536,"new_prefill":4702,"score_linear":-65536.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":66142,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-65536.0,"chosen_score_lmetric":0,"t_first_token":390683.087945307,"t_first_token_unix":1779821548.1018887,"t_done":390686.548345713,"t_done_unix":1779821551.56229},{"request_id":"1242838:6:1486863:911","session_id":"1242838","input_length":29903,"t_proxy_recv":390686.191282356,"t_decision_unix":1779821551.2052233,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":26624,"affinity_cache_ratio":0.8903454502892686,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":3279,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":26624,"new_prefill":3279,"score_linear":-26624.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":29903,"score_linear":237408.0,"score_lmetric":96578},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":70238,"ongoing_decode_tokens":70238,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":29903,"score_linear":70238.0,"score_lmetric":29903},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":3584,"new_prefill":26319,"score_linear":-3584.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":29903,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":390686.925967604,"t_first_token_unix":1779821551.939912,"t_done":390688.258283205,"t_done_unix":1779821553.2722268},{"request_id":"1363943:23:1488713:912","session_id":"1363943","input_length":72516,"t_proxy_recv":390692.321928145,"t_decision_unix":1779821557.335869,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9672899773843014,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":2372,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":8704,"new_prefill":63812,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":72516,"score_linear":237408.0,"score_lmetric":139191},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2214,"cache_hit":70144,"new_prefill":2372,"score_linear":-70144.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":68420,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":390693.362468638,"t_first_token_unix":1779821558.3764126,"t_done":390695.332060684,"t_done_unix":1779821560.346004},{"request_id":"1404395:7:1491186:914","session_id":"1404395","input_length":39569,"t_proxy_recv":390700.981250339,"t_decision_unix":1779821565.9951918,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9575172483509818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":1681,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":512,"new_prefill":39057,"score_linear":-512.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":39057,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":512,"new_prefill":39057,"score_linear":236896.0,"score_lmetric":105732},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":74939,"ongoing_decode_tokens":0,"pending_prefill_tokens":2235,"num_requests":1,"active_p_offloads":0,"cached_blocks":2219,"cache_hit":0,"new_prefill":39569,"score_linear":74939.0,"score_lmetric":41804},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":37888,"new_prefill":1681,"score_linear":-37888.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":39569,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37888.0,"chosen_score_lmetric":0,"t_first_token":390701.457329298,"t_first_token_unix":1779821566.4712734,"t_done":390701.746454253,"t_done_unix":1779821566.760398},{"request_id":"1363943:24:1491020:913","session_id":"1363943","input_length":74939,"t_proxy_recv":390700.588576218,"t_decision_unix":1779821565.6025176,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9701757429375892,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":2235,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":8704,"new_prefill":66235,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":74939,"score_linear":237408.0,"score_lmetric":141614},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2219,"cache_hit":72704,"new_prefill":2235,"score_linear":-72704.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":70843,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":390701.800360691,"t_first_token_unix":1779821566.8143044,"t_done":390703.387990396,"t_done_unix":1779821568.4019344},{"request_id":"1363943:25:1493325:915","session_id":"1363943","input_length":75711,"t_proxy_recv":390708.065742836,"t_decision_unix":1779821573.079684,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9873334125820554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":959,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":8704,"new_prefill":67007,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":75711,"score_linear":237408.0,"score_lmetric":142386},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2223,"cache_hit":74752,"new_prefill":959,"score_linear":-74752.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1758,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":71615,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":390708.470248072,"t_first_token_unix":1779821573.4841917,"t_done":390710.646622762,"t_done_unix":1779821575.6605687},{"request_id":"1404395:8:1494219:916","session_id":"1404395","input_length":39820,"t_proxy_recv":390711.090205875,"t_decision_unix":1779821576.1041472,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":39424,"affinity_cache_ratio":0.9900552486187846,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39424,"estimated_new_tokens":396,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":512,"new_prefill":39308,"score_linear":-512.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":512,"new_prefill":39308,"score_linear":-512.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":512,"new_prefill":39308,"score_linear":236896.0,"score_lmetric":105983},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1758,"cache_hit":39424,"new_prefill":396,"score_linear":-39424.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":39820,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39424.0,"chosen_score_lmetric":0,"t_first_token":390711.233972126,"t_first_token_unix":1779821576.2479157,"t_done":390714.80596122,"t_done_unix":1779821579.8199048},{"request_id":"1313181:13:1349104:484","session_id":"1313181","input_length":131699,"t_proxy_recv":390679.168150905,"t_decision_unix":1779821544.1820922,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.49373191899710706,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":66675,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2185,"cache_hit":12800,"new_prefill":118899,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":105709,"ongoing_decode_tokens":105709,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":65024,"new_prefill":66675,"score_linear":40685.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":12800,"new_prefill":118899,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":131699,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":12800,"new_prefill":118899,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":40685.0,"chosen_score_lmetric":0,"t_first_token":390719.045102028,"t_first_token_unix":1779821584.0590458,"t_done":390721.600187507,"t_done_unix":1779821586.6141312},{"request_id":"1363943:26:1495648:917","session_id":"1363943","input_length":83861,"t_proxy_recv":390715.833415638,"t_decision_unix":1779821580.8473566,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":75776,"affinity_cache_ratio":0.903590465174515,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":8085,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":8704,"new_prefill":75157,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":105709,"pending_prefill_tokens":66675,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":83861,"score_linear":237408.0,"score_lmetric":150536},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":75776,"new_prefill":8085,"score_linear":-75776.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":79765,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":390719.830949067,"t_first_token_unix":1779821584.8448927,"t_done":390721.66475572,"t_done_unix":1779821586.6787016},{"request_id":"1314357:6:1422517:839","session_id":"1314357","input_length":105709,"t_proxy_recv":390637.585367499,"t_decision_unix":1779821502.599309,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9977579960079085,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":237,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66246,"ongoing_decode_tokens":0,"pending_prefill_tokens":25798,"num_requests":0,"active_p_offloads":0,"cached_blocks":2047,"cache_hit":0,"new_prefill":105709,"score_linear":66246.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":3584,"new_prefill":102125,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":65123,"ongoing_decode_tokens":65123,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2375,"cache_hit":105472,"new_prefill":237,"score_linear":-40349.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2169,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1749,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2068,"cache_hit":0,"new_prefill":105709,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40349.0,"chosen_score_lmetric":0,"t_first_token":390637.755135908,"t_first_token_unix":1779821502.7690792,"t_done":390724.32108408,"t_done_unix":1779821589.3350282},{"request_id":"1313181:13:1406095:783","session_id":"1313181","input_length":65279,"t_proxy_recv":390721.609459879,"t_decision_unix":1779821586.6234014,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9960936901606948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":12800,"new_prefill":52479,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":105709,"ongoing_decode_tokens":105709,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2382,"cache_hit":65024,"new_prefill":255,"score_linear":40685.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83861,"ongoing_decode_tokens":83861,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":0,"new_prefill":65279,"score_linear":83861.0,"score_lmetric":65279},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":12800,"new_prefill":52479,"score_linear":62960.0,"score_lmetric":56559},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":65279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":12800,"new_prefill":52479,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":40685.0,"chosen_score_lmetric":0,"t_first_token":390721.717133546,"t_first_token_unix":1779821586.731077,"t_done":390725.534979913,"t_done_unix":1779821590.5489235},{"request_id":"1363943:27:1497882:919","session_id":"1363943","input_length":84090,"t_proxy_recv":390723.102393485,"t_decision_unix":1779821588.116335,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":83968,"affinity_cache_ratio":0.9985491735045784,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83968,"estimated_new_tokens":122,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":8704,"new_prefill":75386,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":170988,"ongoing_decode_tokens":170988,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2382,"cache_hit":0,"new_prefill":84090,"score_linear":170988.0,"score_lmetric":84090},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":83968,"new_prefill":122,"score_linear":-83968.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":4096,"new_prefill":79994,"score_linear":71664.0,"score_lmetric":84074},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":79994,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-83968.0,"chosen_score_lmetric":0,"t_first_token":390723.237777647,"t_first_token_unix":1779821588.2517211,"t_done":390726.782409934,"t_done_unix":1779821591.7963538},{"request_id":"1268861:14:1498281:920","session_id":"1268861","input_length":61910,"t_proxy_recv":390724.575440237,"t_decision_unix":1779821589.5893815,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":56832,"affinity_cache_ratio":0.9179777095784203,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56832,"estimated_new_tokens":5078,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":171558,"ongoing_decode_tokens":171558,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":0,"new_prefill":61910,"score_linear":171558.0,"score_lmetric":61910},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84090,"ongoing_decode_tokens":84090,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":61910,"score_linear":84090.0,"score_lmetric":61910},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":61910,"score_linear":75760.0,"score_lmetric":65990},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":56832,"new_prefill":5078,"score_linear":-56832.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":61910,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56832.0,"chosen_score_lmetric":0,"t_first_token":390726.416116113,"t_first_token_unix":1779821591.4300594,"t_done":390726.980822689,"t_done_unix":1779821591.9947658},{"request_id":"1242838:7:1499476:921","session_id":"1242838","input_length":33352,"t_proxy_recv":390728.41036257,"t_decision_unix":1779821593.4243038,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":29696,"affinity_cache_ratio":0.8903813864236028,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29696,"estimated_new_tokens":3656,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":29696,"new_prefill":3656,"score_linear":-29696.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":33352,"score_linear":245636.0,"score_lmetric":41125},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":3584,"new_prefill":29768,"score_linear":72176.0,"score_lmetric":33848},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":33352,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29696.0,"chosen_score_lmetric":0,"t_first_token":390729.21169311,"t_first_token_unix":1779821594.2256372,"t_done":390731.199510851,"t_done_unix":1779821596.213455},{"request_id":"1363943:28:1500984:922","session_id":"1363943","input_length":86984,"t_proxy_recv":390733.418933669,"t_decision_unix":1779821598.432874,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":83968,"affinity_cache_ratio":0.9653269566816886,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":83968,"estimated_new_tokens":3016,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":8704,"new_prefill":78280,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":86984,"score_linear":245636.0,"score_lmetric":94757},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":83968,"new_prefill":3016,"score_linear":-83968.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":4096,"new_prefill":82888,"score_linear":71664.0,"score_lmetric":86968},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":82888,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-83968.0,"chosen_score_lmetric":0,"t_first_token":390734.967979002,"t_first_token_unix":1779821599.9819229,"t_done":390737.128375446,"t_done_unix":1779821602.1423192},{"request_id":"1388507:2:1496686:918","session_id":"1388507","input_length":75760,"t_proxy_recv":390719.192685213,"t_decision_unix":1779821584.2066264,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9461457233368532,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":4080,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":237408,"ongoing_decode_tokens":237408,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2378,"cache_hit":0,"new_prefill":75760,"score_linear":237408.0,"score_lmetric":75760},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83861,"ongoing_decode_tokens":0,"pending_prefill_tokens":8085,"num_requests":1,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":0,"new_prefill":75760,"score_linear":83861.0,"score_lmetric":83845},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":71680,"new_prefill":4080,"score_linear":-71680.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":75760,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":390738.845851263,"t_first_token_unix":1779821603.8597965,"t_done":390740.465903196,"t_done_unix":1779821605.4798467},{"request_id":"1342921:8:1503584:925","session_id":"1342921","input_length":78722,"t_proxy_recv":390742.268515215,"t_decision_unix":1779821607.2824569,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":76288,"affinity_cache_ratio":0.9690810700947639,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76288,"estimated_new_tokens":2434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":78722,"score_linear":245636.0,"score_lmetric":86495},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89469,"ongoing_decode_tokens":0,"pending_prefill_tokens":2429,"num_requests":1,"active_p_offloads":0,"cached_blocks":2247,"cache_hit":76288,"new_prefill":2434,"score_linear":13181.0,"score_lmetric":4863},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":78722,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":78722,"score_linear":103893.0,"score_lmetric":89431}],"chosen_score_linear":13181.0,"chosen_score_lmetric":4863,"t_first_token":390744.511601897,"t_first_token_unix":1779821609.5255558,"t_done":390744.782879087,"t_done_unix":1779821609.7968225},{"request_id":"1399948:14:1504493:926","session_id":"1399948","input_length":14189,"t_proxy_recv":390745.048142171,"t_decision_unix":1779821610.062083,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":11776,"affinity_cache_ratio":0.829938684896751,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11776,"estimated_new_tokens":2413,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":14189,"score_linear":245636.0,"score_lmetric":21962},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89469,"ongoing_decode_tokens":89469,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2251,"cache_hit":0,"new_prefill":14189,"score_linear":89469.0,"score_lmetric":14189},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":11776,"new_prefill":2413,"score_linear":-11776.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":14189,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":14189,"score_linear":103893.0,"score_lmetric":24898}],"chosen_score_linear":-11776.0,"chosen_score_lmetric":0,"t_first_token":390745.332499477,"t_first_token_unix":1779821610.3464444,"t_done":390745.619814611,"t_done_unix":1779821610.6337583},{"request_id":"1363943:29:1503515:924","session_id":"1363943","input_length":89469,"t_proxy_recv":390742.017671486,"t_decision_unix":1779821607.0316124,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":87040,"affinity_cache_ratio":0.972850931607596,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":87040,"estimated_new_tokens":2429,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":8704,"new_prefill":80765,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":89469,"score_linear":245636.0,"score_lmetric":97242},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2247,"cache_hit":87040,"new_prefill":2429,"score_linear":-87040.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":4096,"new_prefill":85373,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":85373,"score_linear":99797.0,"score_lmetric":96082}],"chosen_score_linear":-87040.0,"chosen_score_lmetric":0,"t_first_token":390743.448029236,"t_first_token_unix":1779821608.461973,"t_done":390746.603317651,"t_done_unix":1779821611.6172614},{"request_id":"1363943:30:1506171:927","session_id":"1363943","input_length":89713,"t_proxy_recv":390750.855024761,"t_decision_unix":1779821615.868966,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9987404278086788,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":113,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":8704,"new_prefill":81009,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":89713,"score_linear":245636.0,"score_lmetric":97486},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":89600,"new_prefill":113,"score_linear":-89600.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":4096,"new_prefill":85617,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":85617,"score_linear":99797.0,"score_lmetric":96326}],"chosen_score_linear":-89600.0,"chosen_score_lmetric":0,"t_first_token":390750.993866821,"t_first_token_unix":1779821616.0078106,"t_done":390751.652592619,"t_done_unix":1779821616.6665368},{"request_id":"1268861:15:1508874:928","session_id":"1268861","input_length":63035,"t_proxy_recv":390759.905712934,"t_decision_unix":1779821624.919654,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":61952,"affinity_cache_ratio":0.9828190687713175,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61952,"estimated_new_tokens":1083,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":63035,"score_linear":245636.0,"score_lmetric":70808},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":0,"new_prefill":63035,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":61952,"new_prefill":1083,"score_linear":-61952.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":63035,"score_linear":103893.0,"score_lmetric":73744}],"chosen_score_linear":-61952.0,"chosen_score_lmetric":0,"t_first_token":390760.490086778,"t_first_token_unix":1779821625.5040305,"t_done":390761.90722576,"t_done_unix":1779821626.9211764},{"request_id":"1399948:15:1512300:930","session_id":"1399948","input_length":15669,"t_proxy_recv":390771.370620558,"t_decision_unix":1779821636.384562,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":13824,"affinity_cache_ratio":0.8822515795519816,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":13824,"estimated_new_tokens":1845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":245636,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":15669,"score_linear":245636.0,"score_lmetric":15669},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":15669,"score_linear":89790.0,"score_lmetric":15669},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":13824,"new_prefill":1845,"score_linear":-13824.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":15669,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":15669,"score_linear":103893.0,"score_lmetric":26378}],"chosen_score_linear":-13824.0,"chosen_score_lmetric":0,"t_first_token":390771.61241309,"t_first_token_unix":1779821636.6263568,"t_done":390771.858866672,"t_done_unix":1779821636.8728096},{"request_id":"1397515:2:1502033:923","session_id":"1397515","input_length":103893,"t_proxy_recv":390736.976940199,"t_decision_unix":1779821601.990881,"policy":"unified_kv_both","decision":"affinity","affinity_idx":7,"chosen_idx":7,"affinity_cache_hit":93184,"affinity_cache_ratio":0.8969227955685176,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":10709,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8007","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":103893,"score_linear":245636.0,"score_lmetric":111666},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":86984,"ongoing_decode_tokens":86984,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":103893,"score_linear":86984.0,"score_lmetric":103893},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":103893,"score_linear":75760.0,"score_lmetric":107973},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":103893,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":93184,"new_prefill":10709,"score_linear":-93184.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":390771.971585777,"t_first_token_unix":1779821636.9855292,"t_done":390775.715370951,"t_done_unix":1779821640.7293143},{"request_id":"1399948:16:1513839:933","session_id":"1399948","input_length":15913,"t_proxy_recv":390776.5453859,"t_decision_unix":1779821641.5593266,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":15360,"affinity_cache_ratio":0.9652485389304343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15360,"estimated_new_tokens":553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":44364,"ongoing_decode_tokens":0,"pending_prefill_tokens":1868,"num_requests":1,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":15913,"score_linear":44364.0,"score_lmetric":17781},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":130532,"ongoing_decode_tokens":130532,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":15913,"score_linear":130532.0,"score_lmetric":15913},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":245636,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":15913,"score_linear":245636.0,"score_lmetric":15913},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":15913,"score_linear":89790.0,"score_lmetric":15913},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":15360,"new_prefill":553,"score_linear":-15360.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":15913,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-15360.0,"chosen_score_lmetric":0,"t_first_token":390776.622979102,"t_first_token_unix":1779821641.6369228,"t_done":390777.049827721,"t_done_unix":1779821642.0637715},{"request_id":"1356885:4:1512902:931","session_id":"1356885","input_length":130532,"t_proxy_recv":390773.257360906,"t_decision_unix":1779821638.2713025,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":129536,"affinity_cache_ratio":0.9923696871265284,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":129536,"estimated_new_tokens":996,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":129536,"new_prefill":996,"score_linear":-129536.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":245636,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":1024,"new_prefill":129508,"score_linear":244612.0,"score_lmetric":129508},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":130532,"score_linear":89790.0,"score_lmetric":130532},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":130532,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":103893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":130532,"score_linear":103893.0,"score_lmetric":130532}],"chosen_score_linear":-129536.0,"chosen_score_lmetric":0,"t_first_token":390773.909915634,"t_first_token_unix":1779821638.9238596,"t_done":390777.333126251,"t_done_unix":1779821642.3470702},{"request_id":"1314357:7:1427957:851","session_id":"1314357","input_length":106279,"t_proxy_recv":390724.338723874,"t_decision_unix":1779821589.3526654,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9972242870181315,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":295,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":3584,"new_prefill":102695,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":65279,"ongoing_decode_tokens":65279,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2383,"cache_hit":105984,"new_prefill":295,"score_linear":-40705.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84090,"ongoing_decode_tokens":84090,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":106279,"score_linear":84090.0,"score_lmetric":106279},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":106279,"score_linear":75760.0,"score_lmetric":110359},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":106279,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40705.0,"chosen_score_lmetric":0,"t_first_token":390724.521104551,"t_first_token_unix":1779821589.5350487,"t_done":390778.773488177,"t_done_unix":1779821643.787432},{"request_id":"1314357:8:1431749:854","session_id":"1314357","input_length":106805,"t_proxy_recv":390778.790247033,"t_decision_unix":1779821643.8041885,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":106496,"affinity_cache_ratio":0.9971068770188661,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":309,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":44364,"ongoing_decode_tokens":0,"pending_prefill_tokens":1868,"num_requests":1,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":106805,"score_linear":44364.0,"score_lmetric":108673},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":103221,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":106496,"new_prefill":309,"score_linear":32861.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":106805,"score_linear":89790.0,"score_lmetric":106805},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":106805,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":32861.0,"chosen_score_lmetric":0,"t_first_token":390779.014392758,"t_first_token_unix":1779821644.0283365,"t_done":390781.234728636,"t_done_unix":1779821646.2486758},{"request_id":"1277428:9:1513231:932","session_id":"1277428","input_length":44364,"t_proxy_recv":390774.382952862,"t_decision_unix":1779821639.396894,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":42496,"affinity_cache_ratio":0.9578937877558381,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":42496,"estimated_new_tokens":1868,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":42496,"new_prefill":1868,"score_linear":-42496.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":130532,"ongoing_decode_tokens":130532,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4608,"new_prefill":39756,"score_linear":125924.0,"score_lmetric":39756},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":245636,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":44364,"score_linear":245636.0,"score_lmetric":44364},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":17408,"new_prefill":26956,"score_linear":72382.0,"score_lmetric":26956},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1671,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":44364,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":103893,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":0,"new_prefill":44364,"score_linear":103893.0,"score_lmetric":44364}],"chosen_score_linear":-42496.0,"chosen_score_lmetric":0,"t_first_token":390781.951322806,"t_first_token_unix":1779821646.9652665,"t_done":390782.248582472,"t_done_unix":1779821647.2625256},{"request_id":"1313181:14:1351342:491","session_id":"1313181","input_length":139357,"t_proxy_recv":390725.560410718,"t_decision_unix":1779821590.574352,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9442223928471479,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":7773,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2191,"cache_hit":12800,"new_prefill":126557,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":106279,"ongoing_decode_tokens":106279,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":131584,"new_prefill":7773,"score_linear":-25305.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":84090,"ongoing_decode_tokens":84090,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2241,"cache_hit":0,"new_prefill":139357,"score_linear":84090.0,"score_lmetric":139357},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":75760,"ongoing_decode_tokens":0,"pending_prefill_tokens":4080,"num_requests":1,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":12800,"new_prefill":126557,"score_linear":62960.0,"score_lmetric":130637},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":0,"new_prefill":139357,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":61910,"ongoing_decode_tokens":0,"pending_prefill_tokens":5078,"num_requests":1,"active_p_offloads":0,"cached_blocks":1693,"cache_hit":0,"new_prefill":139357,"score_linear":61910.0,"score_lmetric":144435},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":12800,"new_prefill":126557,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-25305.0,"chosen_score_lmetric":0,"t_first_token":390771.320640456,"t_first_token_unix":1779821636.3345838,"t_done":390783.863778403,"t_done_unix":1779821648.8777223},{"request_id":"1314357:9:1435219:861","session_id":"1314357","input_length":106959,"t_proxy_recv":390781.252740543,"t_decision_unix":1779821646.2666821,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":106496,"affinity_cache_ratio":0.9956712385119532,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":463,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":44364,"ongoing_decode_tokens":0,"pending_prefill_tokens":1868,"num_requests":1,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":0,"new_prefill":106959,"score_linear":44364.0,"score_lmetric":108827},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":103375,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":139357,"ongoing_decode_tokens":139357,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2385,"cache_hit":106496,"new_prefill":463,"score_linear":32861.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":106959,"score_linear":89790.0,"score_lmetric":106959},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":106959,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":32861.0,"chosen_score_lmetric":0,"t_first_token":390781.456600116,"t_first_token_unix":1779821646.4705434,"t_done":390785.588158952,"t_done_unix":1779821650.6021059},{"request_id":"1314357:10:1439373:867","session_id":"1314357","input_length":107228,"t_proxy_recv":390785.607250567,"t_decision_unix":1779821650.621192,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":107008,"affinity_cache_ratio":0.9979482970865818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":220,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":103644,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":65876,"ongoing_decode_tokens":65876,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2402,"cache_hit":107008,"new_prefill":220,"score_linear":-41132.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":107228,"score_linear":89790.0,"score_lmetric":107228},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":107228,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41132.0,"chosen_score_lmetric":0,"t_first_token":390785.764444364,"t_first_token_unix":1779821650.7783883,"t_done":390786.208931654,"t_done_unix":1779821651.2228756},{"request_id":"1314357:11:1442554:870","session_id":"1314357","input_length":108166,"t_proxy_recv":390786.228591786,"t_decision_unix":1779821651.2425332,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":107008,"affinity_cache_ratio":0.9892942329382616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1158,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":104582,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":65876,"ongoing_decode_tokens":65876,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2402,"cache_hit":107008,"new_prefill":1158,"score_linear":-41132.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":108166,"score_linear":89790.0,"score_lmetric":108166},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":108166,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41132.0,"chosen_score_lmetric":0,"t_first_token":390787.067502751,"t_first_token_unix":1779821652.0814476,"t_done":390789.999366885,"t_done_unix":1779821655.0133126},{"request_id":"1313181:14:1408792:803","session_id":"1313181","input_length":65876,"t_proxy_recv":390783.874843399,"t_decision_unix":1779821648.888785,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":65536,"affinity_cache_ratio":0.9948387880259882,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65536,"estimated_new_tokens":340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":12800,"new_prefill":53076,"score_linear":-12800.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":106959,"ongoing_decode_tokens":106959,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2401,"cache_hit":65536,"new_prefill":340,"score_linear":41423.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":65876,"score_linear":89790.0,"score_lmetric":65876},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":12800,"new_prefill":53076,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":65876,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":53076,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":41423.0,"chosen_score_lmetric":0,"t_first_token":390783.974837814,"t_first_token_unix":1779821648.9887812,"t_done":390790.028271421,"t_done_unix":1779821655.0422149},{"request_id":"1277428:10:1517408:935","session_id":"1277428","input_length":45851,"t_proxy_recv":390788.176347863,"t_decision_unix":1779821653.1902893,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9603280190181239,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1819,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":44032,"new_prefill":1819,"score_linear":-44032.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4608,"new_prefill":41243,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174042,"ongoing_decode_tokens":174042,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2402,"cache_hit":0,"new_prefill":45851,"score_linear":174042.0,"score_lmetric":45851},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":17408,"new_prefill":28443,"score_linear":72382.0,"score_lmetric":28443},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":45851,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":390788.710921855,"t_first_token_unix":1779821653.7248654,"t_done":390790.7887566,"t_done_unix":1779821655.8027008},{"request_id":"1399948:17:1518102:936","session_id":"1399948","input_length":16604,"t_proxy_recv":390790.658718392,"t_decision_unix":1779821655.6726596,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":15872,"affinity_cache_ratio":0.9559142375331245,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":15872,"estimated_new_tokens":732,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":45851,"ongoing_decode_tokens":45851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":0,"new_prefill":16604,"score_linear":45851.0,"score_lmetric":16604},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":174668,"ongoing_decode_tokens":174668,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2405,"cache_hit":0,"new_prefill":16604,"score_linear":174668.0,"score_lmetric":16604},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":16604,"score_linear":89790.0,"score_lmetric":16604},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":15872,"new_prefill":732,"score_linear":-15872.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":16604,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-15872.0,"chosen_score_lmetric":0,"t_first_token":390790.79415876,"t_first_token_unix":1779821655.8081021,"t_done":390791.143922326,"t_done_unix":1779821656.157866},{"request_id":"1314357:12:1446681:873","session_id":"1314357","input_length":108409,"t_proxy_recv":390790.015772716,"t_decision_unix":1779821655.029714,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":108032,"affinity_cache_ratio":0.996522428949626,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":45851,"ongoing_decode_tokens":45851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":0,"new_prefill":108409,"score_linear":45851.0,"score_lmetric":108409},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":104825,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":65876,"ongoing_decode_tokens":65876,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2404,"cache_hit":108032,"new_prefill":377,"score_linear":-42156.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":108409,"score_linear":89790.0,"score_lmetric":108409},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":108409,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-42156.0,"chosen_score_lmetric":0,"t_first_token":390790.237907438,"t_first_token_unix":1779821655.2518516,"t_done":390791.150620067,"t_done_unix":1779821656.1645637},{"request_id":"1314357:13:1448346:875","session_id":"1314357","input_length":108791,"t_proxy_recv":390791.169099187,"t_decision_unix":1779821656.1830406,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9930233199437454,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":759,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":105207,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66259,"ongoing_decode_tokens":66259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2405,"cache_hit":108032,"new_prefill":759,"score_linear":-41773.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":108791,"score_linear":89790.0,"score_lmetric":108791},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":108791,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41773.0,"chosen_score_lmetric":0,"t_first_token":390791.690027088,"t_first_token_unix":1779821656.7039711,"t_done":390794.277621742,"t_done_unix":1779821659.2915661},{"request_id":"1314357:14:1450740:878","session_id":"1314357","input_length":109010,"t_proxy_recv":390794.297295319,"t_decision_unix":1779821659.3112366,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":108544,"affinity_cache_ratio":0.9957251628290983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108544,"estimated_new_tokens":466,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":105426,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66259,"ongoing_decode_tokens":66259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2406,"cache_hit":108544,"new_prefill":466,"score_linear":-42285.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":109010,"score_linear":89790.0,"score_lmetric":109010},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":109010,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-42285.0,"chosen_score_lmetric":0,"t_first_token":390794.539677759,"t_first_token_unix":1779821659.5536218,"t_done":390796.374216242,"t_done_unix":1779821661.3881648},{"request_id":"1313181:15:1411723:818","session_id":"1313181","input_length":66259,"t_proxy_recv":390790.045179456,"t_decision_unix":1779821655.059121,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":66048,"affinity_cache_ratio":0.9968155269472826,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":66048,"estimated_new_tokens":211,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":45851,"ongoing_decode_tokens":45851,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2201,"cache_hit":12800,"new_prefill":53459,"score_linear":33051.0,"score_lmetric":53459},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":108409,"ongoing_decode_tokens":0,"pending_prefill_tokens":377,"num_requests":0,"active_p_offloads":0,"cached_blocks":2405,"cache_hit":66048,"new_prefill":211,"score_linear":42361.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":66259,"score_linear":89790.0,"score_lmetric":66259},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":12800,"new_prefill":53459,"score_linear":-12800.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1672,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":66259,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":53459,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":42361.0,"chosen_score_lmetric":0,"t_first_token":390790.326373686,"t_first_token_unix":1779821655.3403172,"t_done":390796.621180417,"t_done_unix":1779821661.635124},{"request_id":"1363943:31:1509815:929","session_id":"1363943","input_length":89790,"t_proxy_recv":390762.929204676,"t_decision_unix":1779821627.943146,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":89600,"affinity_cache_ratio":0.9978839514422542,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89600,"estimated_new_tokens":190,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2198,"cache_hit":8704,"new_prefill":81086,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1664,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":245636,"ongoing_decode_tokens":106279,"pending_prefill_tokens":7773,"num_requests":1,"active_p_offloads":0,"cached_blocks":2384,"cache_hit":0,"new_prefill":89790,"score_linear":245636.0,"score_lmetric":97563},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":89600,"new_prefill":190,"score_linear":-89600.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1668,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":4096,"new_prefill":85694,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":103893,"ongoing_decode_tokens":0,"pending_prefill_tokens":10709,"num_requests":1,"active_p_offloads":0,"cached_blocks":2070,"cache_hit":4096,"new_prefill":85694,"score_linear":99797.0,"score_lmetric":96403}],"chosen_score_linear":-89600.0,"chosen_score_lmetric":0,"t_first_token":390763.050805638,"t_first_token_unix":1779821628.0647492,"t_done":390798.114803796,"t_done_unix":1779821663.1287496},{"request_id":"1277428:11:1520449:937","session_id":"1277428","input_length":46361,"t_proxy_recv":390798.163896591,"t_decision_unix":1779821663.177838,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":46080,"affinity_cache_ratio":0.9939388710338432,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":46080,"new_prefill":281,"score_linear":-46080.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":4608,"new_prefill":41753,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":109164,"ongoing_decode_tokens":109164,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":46361,"score_linear":109164.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2257,"cache_hit":17408,"new_prefill":28953,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":46361,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":390798.329260222,"t_first_token_unix":1779821663.3432035,"t_done":390798.721180096,"t_done_unix":1779821663.735126},{"request_id":"1314357:15:1452292:882","session_id":"1314357","input_length":109164,"t_proxy_recv":390796.394200418,"t_decision_unix":1779821661.4081416,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9990106628558866,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":3584,"new_prefill":105580,"score_linear":-3584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":66259,"ongoing_decode_tokens":66259,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2407,"cache_hit":109056,"new_prefill":108,"score_linear":-42797.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":89790,"ongoing_decode_tokens":89790,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":109164,"score_linear":89790.0,"score_lmetric":109164},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":109164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-42797.0,"chosen_score_lmetric":0,"t_first_token":390796.565504912,"t_first_token_unix":1779821661.5794485,"t_done":390800.524271445,"t_done_unix":1779821665.5382152},{"request_id":"1399948:18:1524432:938","session_id":"1399948","input_length":17276,"t_proxy_recv":390811.716288157,"t_decision_unix":1779821676.7302296,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":16384,"affinity_cache_ratio":0.948367677703172,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16384,"estimated_new_tokens":892,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":-1,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":-17276},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2257,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1673,"cache_hit":16384,"new_prefill":892,"score_linear":-16384.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":17276,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16384.0,"chosen_score_lmetric":0,"t_first_token":390811.849791479,"t_first_token_unix":1779821676.8637347,"t_done":390812.200533467,"t_done_unix":1779821677.2144766},{"request_id":"1342921:9:1525898:939","session_id":"1342921","input_length":79086,"t_proxy_recv":390816.754125539,"t_decision_unix":1779821681.768067,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9905166527577574,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":750,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2257,"cache_hit":78336,"new_prefill":750,"score_linear":-78336.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":79086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":390817.151703484,"t_first_token_unix":1779821682.1656468,"t_done":390817.231741009,"t_done_unix":1779821682.2456844},{"request_id":"1399948:19:1526739:941","session_id":"1399948","input_length":18091,"t_proxy_recv":390819.630447077,"t_decision_unix":1779821684.6443887,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":16896,"affinity_cache_ratio":0.9339450555524846,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":16896,"estimated_new_tokens":1195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":18091,"score_linear":87576.0,"score_lmetric":28867},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":16896,"new_prefill":1195,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":18091,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-16896.0,"chosen_score_lmetric":0,"t_first_token":390819.803383574,"t_first_token_unix":1779821684.817327,"t_done":390820.083414275,"t_done_unix":1779821685.097358},{"request_id":"1399948:20:1527857:942","session_id":"1399948","input_length":18164,"t_proxy_recv":390823.132360355,"t_decision_unix":1779821688.146301,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":17920,"affinity_cache_ratio":0.9865668354987888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":244,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":18164,"score_linear":87576.0,"score_lmetric":28940},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":17920,"new_prefill":244,"score_linear":-17920.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":18164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":390823.179432485,"t_first_token_unix":1779821688.193376,"t_done":390823.710506311,"t_done_unix":1779821688.7244503},{"request_id":"1399948:21:1528978:944","session_id":"1399948","input_length":18388,"t_proxy_recv":390827.075882612,"t_decision_unix":1779821692.089824,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":17920,"affinity_cache_ratio":0.9745486186643463,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17920,"estimated_new_tokens":468,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":18388,"score_linear":87576.0,"score_lmetric":29164},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36568,"ongoing_decode_tokens":0,"pending_prefill_tokens":36568,"num_requests":1,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":18388,"score_linear":36568.0,"score_lmetric":54956},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":17920,"new_prefill":468,"score_linear":-17920.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":18388,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17920.0,"chosen_score_lmetric":0,"t_first_token":390827.15761515,"t_first_token_unix":1779821692.1715589,"t_done":390827.736036775,"t_done_unix":1779821692.7499807},{"request_id":"1399948:22:1530122:947","session_id":"1399948","input_length":18563,"t_proxy_recv":390830.904075099,"t_decision_unix":1779821695.9180164,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":18432,"affinity_cache_ratio":0.992942951031622,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":18563,"score_linear":87576.0,"score_lmetric":29339},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36568,"ongoing_decode_tokens":36568,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":18563,"score_linear":36568.0,"score_lmetric":18563},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":18432,"new_prefill":131,"score_linear":-18432.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71192,"ongoing_decode_tokens":0,"pending_prefill_tokens":8216,"num_requests":1,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":18563,"score_linear":71192.0,"score_lmetric":26779},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":18563,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-18432.0,"chosen_score_lmetric":0,"t_first_token":390830.960768713,"t_first_token_unix":1779821695.9747126,"t_done":390831.210725685,"t_done_unix":1779821696.2246692},{"request_id":"1243831:2:1528168:943","session_id":"1243831","input_length":36568,"t_proxy_recv":390824.337091164,"t_decision_unix":1779821689.351032,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":1,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.30802887770728504,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":true,"cache_hit":0,"estimated_new_tokens":36568,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":25304,"score_linear":76312.0,"score_lmetric":36080},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1676,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":36568,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":0.0,"chosen_score_lmetric":0,"t_first_token":390829.812314877,"t_first_token_unix":1779821694.8262582,"t_done":390834.04191781,"t_done_unix":1779821699.0558612},{"request_id":"1268861:16:1529894:946","session_id":"1268861","input_length":71192,"t_proxy_recv":390830.090829598,"t_decision_unix":1779821695.1047711,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":62976,"affinity_cache_ratio":0.8845937745814136,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":62976,"estimated_new_tokens":8216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":71192,"score_linear":87576.0,"score_lmetric":81968},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":36568,"ongoing_decode_tokens":36568,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":71192,"score_linear":36568.0,"score_lmetric":71192},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":62976,"new_prefill":8216,"score_linear":-62976.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":71192,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-62976.0,"chosen_score_lmetric":0,"t_first_token":390833.56188308,"t_first_token_unix":1779821698.575827,"t_done":390834.676564885,"t_done_unix":1779821699.6905086},{"request_id":"1243831:3:1270336:110","session_id":"1243831","input_length":11584,"t_proxy_recv":390834.045169782,"t_decision_unix":1779821699.059111,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.9723756906077348,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":320,"score_linear":76312.0,"score_lmetric":11096},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2480,"cache_hit":11264,"new_prefill":320,"score_linear":-11264.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":71192,"ongoing_decode_tokens":71192,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":11584,"score_linear":71192.0,"score_lmetric":11584},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":11584,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":390834.076016372,"t_first_token_unix":1779821699.0899596,"t_done":390834.906043826,"t_done_unix":1779821699.9199872},{"request_id":"1243831:4:1284306:183","session_id":"1243831","input_length":14515,"t_proxy_recv":390834.911344331,"t_decision_unix":1779821699.9252858,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":11264,"affinity_cache_ratio":0.7760248019290389,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":11264,"estimated_new_tokens":3251,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":3251,"score_linear":76312.0,"score_lmetric":14027},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2480,"cache_hit":11264,"new_prefill":3251,"score_linear":-11264.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":14515,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-11264.0,"chosen_score_lmetric":0,"t_first_token":390835.280508806,"t_first_token_unix":1779821700.2944527,"t_done":390835.705175391,"t_done_unix":1779821700.7191184},{"request_id":"1243831:5:1303288:273","session_id":"1243831","input_length":14627,"t_proxy_recv":390835.709352512,"t_decision_unix":1779821700.7232943,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.980105284747385,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":291,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":3363,"score_linear":76312.0,"score_lmetric":14139},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2486,"cache_hit":14336,"new_prefill":291,"score_linear":-14336.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":14627,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":390835.754959437,"t_first_token_unix":1779821700.7689025,"t_done":390836.202524018,"t_done_unix":1779821701.2164671},{"request_id":"1243831:6:1313694:320","session_id":"1243831","input_length":17410,"t_proxy_recv":390836.208338307,"t_decision_unix":1779821701.22228,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":14336,"affinity_cache_ratio":0.8234348075818495,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":14336,"estimated_new_tokens":3074,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":6146,"score_linear":76312.0,"score_lmetric":16922},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2486,"cache_hit":14336,"new_prefill":3074,"score_linear":-14336.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":17410,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-14336.0,"chosen_score_lmetric":0,"t_first_token":390836.620113519,"t_first_token_unix":1779821701.6340578,"t_done":390837.070076473,"t_done_unix":1779821702.08402},{"request_id":"1243831:7:1323865:366","session_id":"1243831","input_length":19460,"t_proxy_recv":390837.075838312,"t_decision_unix":1779821702.0897799,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":17408,"affinity_cache_ratio":0.8945529290853032,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":17408,"estimated_new_tokens":2052,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":8196,"score_linear":76312.0,"score_lmetric":18972},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2492,"cache_hit":17408,"new_prefill":2052,"score_linear":-17408.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":19460,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-17408.0,"chosen_score_lmetric":0,"t_first_token":390837.426297547,"t_first_token_unix":1779821702.4402413,"t_done":390838.023815585,"t_done_unix":1779821703.0377595},{"request_id":"1243831:8:1333049:414","session_id":"1243831","input_length":24512,"t_proxy_recv":390838.030732396,"t_decision_unix":1779821703.0446742,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":19456,"affinity_cache_ratio":0.793733681462141,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19456,"estimated_new_tokens":5056,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":13248,"score_linear":76312.0,"score_lmetric":24024},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2496,"cache_hit":19456,"new_prefill":5056,"score_linear":-19456.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":24512,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-19456.0,"chosen_score_lmetric":0,"t_first_token":390838.897405827,"t_first_token_unix":1779821703.9113498,"t_done":390839.569854958,"t_done_unix":1779821704.5837982},{"request_id":"1243831:9:1348240:478","session_id":"1243831","input_length":25075,"t_proxy_recv":390839.575390202,"t_decision_unix":1779821704.5893319,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":24576,"affinity_cache_ratio":0.980099700897308,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":499,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":13811,"score_linear":76312.0,"score_lmetric":24587},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2506,"cache_hit":24576,"new_prefill":499,"score_linear":-24576.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":25075,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390839.736838502,"t_first_token_unix":1779821704.750782,"t_done":390840.140876787,"t_done_unix":1779821705.1548216},{"request_id":"1243831:10:1358921:521","session_id":"1243831","input_length":26343,"t_proxy_recv":390840.147332942,"t_decision_unix":1779821705.1612747,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":25088,"affinity_cache_ratio":0.9523592605246175,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":25088,"estimated_new_tokens":1255,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":15079,"score_linear":76312.0,"score_lmetric":25855},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2507,"cache_hit":25088,"new_prefill":1255,"score_linear":-25088.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":26343,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-25088.0,"chosen_score_lmetric":0,"t_first_token":390840.432337579,"t_first_token_unix":1779821705.4462814,"t_done":390841.12227718,"t_done_unix":1779821706.1362205},{"request_id":"1243831:11:1371191:594","session_id":"1243831","input_length":26818,"t_proxy_recv":390841.128727314,"t_decision_unix":1779821706.1426687,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26112,"affinity_cache_ratio":0.9736743977925274,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26112,"estimated_new_tokens":706,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":15554,"score_linear":76312.0,"score_lmetric":26330},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2509,"cache_hit":26112,"new_prefill":706,"score_linear":-26112.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":26818,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26112.0,"chosen_score_lmetric":0,"t_first_token":390841.290901413,"t_first_token_unix":1779821706.3048456,"t_done":390841.744731426,"t_done_unix":1779821706.7586744},{"request_id":"1243831:12:1385174:681","session_id":"1243831","input_length":27164,"t_proxy_recv":390841.750800142,"t_decision_unix":1779821706.764742,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":26624,"affinity_cache_ratio":0.9801207480488883,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":26624,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":15900,"score_linear":76312.0,"score_lmetric":26676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2510,"cache_hit":26624,"new_prefill":540,"score_linear":-26624.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":27164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-26624.0,"chosen_score_lmetric":0,"t_first_token":390841.861511871,"t_first_token_unix":1779821706.8754554,"t_done":390842.266652417,"t_done_unix":1779821707.2805958},{"request_id":"1243831:13:1398072:738","session_id":"1243831","input_length":27286,"t_proxy_recv":390842.27285085,"t_decision_unix":1779821707.2867925,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9945026753646559,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":150,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":16022,"score_linear":76312.0,"score_lmetric":26798},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2511,"cache_hit":27136,"new_prefill":150,"score_linear":-27136.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":27286,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":390842.345371174,"t_first_token_unix":1779821707.3593144,"t_done":390842.873832173,"t_done_unix":1779821707.8877752},{"request_id":"1243831:14:1411189:814","session_id":"1243831","input_length":28085,"t_proxy_recv":390842.879921772,"t_decision_unix":1779821707.8938632,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":27136,"affinity_cache_ratio":0.9662097204913654,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":27136,"estimated_new_tokens":949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":218482,"ongoing_decode_tokens":0,"pending_prefill_tokens":11122,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":16821,"score_linear":207218.0,"score_lmetric":55886},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2511,"cache_hit":27136,"new_prefill":949,"score_linear":-27136.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":28085,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-27136.0,"chosen_score_lmetric":0,"t_first_token":390843.114264532,"t_first_token_unix":1779821708.1282082,"t_done":390843.641511289,"t_done_unix":1779821708.6554544},{"request_id":"1243831:15:1427593:849","session_id":"1243831","input_length":29382,"t_proxy_recv":390843.648021548,"t_decision_unix":1779821708.6619632,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":28160,"affinity_cache_ratio":0.9584099108297597,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28160,"estimated_new_tokens":1222,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":218482,"ongoing_decode_tokens":0,"pending_prefill_tokens":11122,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":18118,"score_linear":207218.0,"score_lmetric":58480},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2513,"cache_hit":28160,"new_prefill":1222,"score_linear":-28160.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71987,"ongoing_decode_tokens":0,"pending_prefill_tokens":7987,"num_requests":1,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":29382,"score_linear":71987.0,"score_lmetric":37369},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":29382,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-28160.0,"chosen_score_lmetric":0,"t_first_token":390843.957192448,"t_first_token_unix":1779821708.971136,"t_done":390844.804487414,"t_done_unix":1779821709.8184304},{"request_id":"1243831:16:1446717:874","session_id":"1243831","input_length":29571,"t_proxy_recv":390844.814268617,"t_decision_unix":1779821709.82821,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9869128538094755,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":387,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":218482,"ongoing_decode_tokens":0,"pending_prefill_tokens":11122,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":18307,"score_linear":207218.0,"score_lmetric":58858},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":29184,"new_prefill":387,"score_linear":-29184.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71987,"ongoing_decode_tokens":0,"pending_prefill_tokens":7987,"num_requests":1,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":29571,"score_linear":71987.0,"score_lmetric":37558},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":29571,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":390844.89876846,"t_first_token_unix":1779821709.9127119,"t_done":390845.322093356,"t_done_unix":1779821710.3360367},{"request_id":"1356885:5:1533696:948","session_id":"1356885","input_length":130906,"t_proxy_recv":390842.742957193,"t_decision_unix":1779821707.7568986,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":130560,"affinity_cache_ratio":0.9973568820374925,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":130560,"estimated_new_tokens":346,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":0,"pending_prefill_tokens":10776,"num_requests":1,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":130560,"new_prefill":346,"score_linear":-42984.0,"score_lmetric":11122},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":27286,"ongoing_decode_tokens":27286,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2511,"cache_hit":1024,"new_prefill":129882,"score_linear":26262.0,"score_lmetric":129882},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":130906,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-42984.0,"chosen_score_lmetric":11122,"t_first_token":390845.163686213,"t_first_token_unix":1779821710.1776295,"t_done":390848.367420735,"t_done_unix":1779821713.381364},{"request_id":"1294611:15:1533841:949","session_id":"1294611","input_length":71987,"t_proxy_recv":390843.210458519,"t_decision_unix":1779821708.2244,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":64000,"affinity_cache_ratio":0.8890494116993346,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":64000,"estimated_new_tokens":7987,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":218482,"ongoing_decode_tokens":0,"pending_prefill_tokens":11122,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":0,"new_prefill":71987,"score_linear":218482.0,"score_lmetric":166218},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":28085,"ongoing_decode_tokens":28085,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2511,"cache_hit":12800,"new_prefill":59187,"score_linear":15285.0,"score_lmetric":59187},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":64000,"new_prefill":7987,"score_linear":-64000.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":12800,"new_prefill":59187,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":71987,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":59187,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-64000.0,"chosen_score_lmetric":0,"t_first_token":390846.661227038,"t_first_token_unix":1779821711.6751704,"t_done":390849.418122323,"t_done_unix":1779821714.432066},{"request_id":"1363943:32:1537767:950","session_id":"1363943","input_length":93368,"t_proxy_recv":390856.535834097,"t_decision_unix":1779821721.5497754,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9980293034015937,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":184,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":8704,"new_prefill":84664,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":87576,"ongoing_decode_tokens":87576,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1667,"cache_hit":4096,"new_prefill":89272,"score_linear":83480.0,"score_lmetric":89272},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":0,"new_prefill":93368,"score_linear":31161.0,"score_lmetric":93368},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2274,"cache_hit":93184,"new_prefill":184,"score_linear":-93184.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":4096,"new_prefill":89272,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":390856.736828565,"t_first_token_unix":1779821721.750772,"t_done":390858.650979329,"t_done_unix":1779821723.6649253},{"request_id":"1253804:7:1526643:940","session_id":"1253804","input_length":87576,"t_proxy_recv":390819.197845129,"t_decision_unix":1779821684.2117865,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":76800,"affinity_cache_ratio":0.8769525897506166,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":10776,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":3584,"new_prefill":83992,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":76800,"new_prefill":10776,"score_linear":-76800.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2408,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":3584,"new_prefill":83992,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1674,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1705,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":87576,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":390844.944155817,"t_first_token_unix":1779821709.9580991,"t_done":390861.263311252,"t_done_unix":1779821726.2772546},{"request_id":"1253804:8:1541192:953","session_id":"1253804","input_length":89116,"t_proxy_recv":390867.680450268,"t_decision_unix":1779821732.6943915,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":88576,"affinity_cache_ratio":0.9939404820683154,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":88576,"estimated_new_tokens":540,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":3584,"new_prefill":85532,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":88576,"new_prefill":540,"score_linear":-88576.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":0,"new_prefill":89116,"score_linear":31161.0,"score_lmetric":89116},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":93596,"ongoing_decode_tokens":93596,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2274,"cache_hit":3584,"new_prefill":85532,"score_linear":90012.0,"score_lmetric":85532},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75693,"ongoing_decode_tokens":75693,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":89116,"score_linear":75693.0,"score_lmetric":89116},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":89116,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-88576.0,"chosen_score_lmetric":0,"t_first_token":390867.823719777,"t_first_token_unix":1779821732.837664,"t_done":390868.237160286,"t_done_unix":1779821733.251104},{"request_id":"1268861:17:1540278:951","session_id":"1268861","input_length":75693,"t_proxy_recv":390864.615965436,"t_decision_unix":1779821729.6299067,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9402190427120077,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":4525,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":0,"new_prefill":75693,"score_linear":31161.0,"score_lmetric":75693},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2274,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":71168,"new_prefill":4525,"score_linear":-71168.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":75693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":390866.813321337,"t_first_token_unix":1779821731.827265,"t_done":390868.254957268,"t_done_unix":1779821733.2689009},{"request_id":"1363943:33:1541065:952","session_id":"1363943","input_length":93596,"t_proxy_recv":390867.264926239,"t_decision_unix":1779821732.2788675,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9955981024830121,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":412,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":8704,"new_prefill":84892,"score_linear":-8704.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1690,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":0,"new_prefill":93596,"score_linear":31161.0,"score_lmetric":93596},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2274,"cache_hit":93184,"new_prefill":412,"score_linear":-93184.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":75693,"ongoing_decode_tokens":75693,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":4096,"new_prefill":89500,"score_linear":71597.0,"score_lmetric":89500},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":4096,"new_prefill":89500,"score_linear":-4096.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":390867.414674935,"t_first_token_unix":1779821732.4286184,"t_done":390873.843044068,"t_done_unix":1779821738.856988},{"request_id":"1399948:23:1544108:954","session_id":"1399948","input_length":20031,"t_proxy_recv":390877.127955676,"t_decision_unix":1779821742.1418967,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":18432,"affinity_cache_ratio":0.9201737307173881,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":18432,"estimated_new_tokens":1599,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":0,"new_prefill":20031,"score_linear":31161.0,"score_lmetric":20031},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":18432,"new_prefill":1599,"score_linear":-18432.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":20031,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-18432.0,"chosen_score_lmetric":0,"t_first_token":390877.410125597,"t_first_token_unix":1779821742.4240694,"t_done":390877.841813321,"t_done_unix":1779821742.8557575},{"request_id":"1399948:24:1546940:955","session_id":"1399948","input_length":21809,"t_proxy_recv":390886.575449768,"t_decision_unix":1779821751.5893896,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":19968,"affinity_cache_ratio":0.9155853088174607,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":19968,"estimated_new_tokens":1841,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":31161,"ongoing_decode_tokens":31161,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":0,"new_prefill":21809,"score_linear":31161.0,"score_lmetric":21809},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1680,"cache_hit":19968,"new_prefill":1841,"score_linear":-19968.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":21809,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-19968.0,"chosen_score_lmetric":0,"t_first_token":390886.918322406,"t_first_token_unix":1779821751.9322658,"t_done":390887.171905531,"t_done_unix":1779821752.1858487},{"request_id":"1243831:17:1453633:883","session_id":"1243831","input_length":31161,"t_proxy_recv":390845.32887018,"t_decision_unix":1779821710.3428116,"policy":"unified_kv_both","decision":"affinity","affinity_idx":2,"chosen_idx":2,"affinity_cache_hit":29184,"affinity_cache_ratio":0.9365553095215173,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":29184,"estimated_new_tokens":1977,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8002","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":218482,"ongoing_decode_tokens":218482,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1666,"cache_hit":11264,"new_prefill":19897,"score_linear":207218.0,"score_lmetric":39794},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2515,"cache_hit":29184,"new_prefill":1977,"score_linear":-29184.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":71987,"ongoing_decode_tokens":0,"pending_prefill_tokens":7987,"num_requests":1,"active_p_offloads":0,"cached_blocks":2258,"cache_hit":0,"new_prefill":31161,"score_linear":71987.0,"score_lmetric":39148},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1677,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":31161,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29184.0,"chosen_score_lmetric":0,"t_first_token":390845.716849147,"t_first_token_unix":1779821710.7307928,"t_done":390897.625899964,"t_done_unix":1779821762.639843},{"request_id":"1399948:25:1553234:957","session_id":"1399948","input_length":22250,"t_proxy_recv":390907.109565176,"t_decision_unix":1779821772.1235065,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":21504,"affinity_cache_ratio":0.9664719101123596,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":21504,"estimated_new_tokens":746,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1683,"cache_hit":21504,"new_prefill":746,"score_linear":-21504.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":76017,"ongoing_decode_tokens":76017,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":22250,"score_linear":76017.0,"score_lmetric":22250},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":22250,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21504.0,"chosen_score_lmetric":0,"t_first_token":390907.256056409,"t_first_token_unix":1779821772.27,"t_done":390907.798070785,"t_done_unix":1779821772.8120139},{"request_id":"1268861:18:1553083:956","session_id":"1268861","input_length":76017,"t_proxy_recv":390906.676335986,"t_decision_unix":1779821771.6902773,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9968296565241985,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":241,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1683,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":75776,"new_prefill":241,"score_linear":-75776.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":76017,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":390906.921908725,"t_first_token_unix":1779821771.9358525,"t_done":390907.940777476,"t_done_unix":1779821772.9547207},{"request_id":"1399948:26:1557859:959","session_id":"1399948","input_length":23042,"t_proxy_recv":390923.071686544,"t_decision_unix":1779821788.0856276,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":22016,"affinity_cache_ratio":0.9554726152243729,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":22016,"estimated_new_tokens":1026,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1684,"cache_hit":22016,"new_prefill":1026,"score_linear":-22016.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":23042,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-22016.0,"chosen_score_lmetric":0,"t_first_token":390923.278036384,"t_first_token_unix":1779821788.2919803,"t_done":390923.561227368,"t_done_unix":1779821788.5751703},{"request_id":"1399948:27:1559017:960","session_id":"1399948","input_length":24139,"t_proxy_recv":390926.735181331,"t_decision_unix":1779821791.7491226,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":23040,"affinity_cache_ratio":0.9544720162392808,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":23040,"estimated_new_tokens":1099,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1686,"cache_hit":23040,"new_prefill":1099,"score_linear":-23040.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":24139,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-23040.0,"chosen_score_lmetric":0,"t_first_token":390926.998840668,"t_first_token_unix":1779821792.0127845,"t_done":390927.949795502,"t_done_unix":1779821792.9637387},{"request_id":"1399948:28:1560859:961","session_id":"1399948","input_length":24386,"t_proxy_recv":390932.862967822,"t_decision_unix":1779821797.876909,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24064,"affinity_cache_ratio":0.9867957024522267,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24064,"estimated_new_tokens":322,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1688,"cache_hit":24064,"new_prefill":322,"score_linear":-24064.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":24386,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24064.0,"chosen_score_lmetric":0,"t_first_token":390932.94456554,"t_first_token_unix":1779821797.9585092,"t_done":390934.204522557,"t_done_unix":1779821799.2184658},{"request_id":"1399948:29:1571125:963","session_id":"1399948","input_length":28781,"t_proxy_recv":390966.727201823,"t_decision_unix":1779821831.7411427,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":24576,"affinity_cache_ratio":0.8538966679406553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":24576,"estimated_new_tokens":4205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":131413,"ongoing_decode_tokens":131413,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":0,"new_prefill":28781,"score_linear":131413.0,"score_lmetric":28781},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":24576,"new_prefill":4205,"score_linear":-24576.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":28781,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-24576.0,"chosen_score_lmetric":0,"t_first_token":390967.603522533,"t_first_token_unix":1779821832.6174662,"t_done":390967.869930792,"t_done_unix":1779821832.8838837},{"request_id":"1356885:6:1570780:962","session_id":"1356885","input_length":131413,"t_proxy_recv":390965.701885412,"t_decision_unix":1779821830.7158267,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":131072,"affinity_cache_ratio":0.9974051273466096,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131072,"estimated_new_tokens":341,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1691,"cache_hit":131072,"new_prefill":341,"score_linear":-131072.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":130389,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1689,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":131413,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131072.0,"chosen_score_lmetric":0,"t_first_token":390966.336334766,"t_first_token_unix":1779821831.3502786,"t_done":390968.519794824,"t_done_unix":1779821833.5337389},{"request_id":"1268861:19:1578134:966","session_id":"1268861","input_length":76963,"t_proxy_recv":390990.577821559,"t_decision_unix":1779821855.591763,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9845770045346465,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":1187,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":76963,"score_linear":109083.0,"score_lmetric":78014},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":75776,"new_prefill":1187,"score_linear":-75776.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":76963,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":390991.12464877,"t_first_token_unix":1779821856.1385925,"t_done":390991.887180415,"t_done_unix":1779821856.9011238},{"request_id":"1399948:30:1578524:967","session_id":"1399948","input_length":30773,"t_proxy_recv":390991.916532639,"t_decision_unix":1779821856.9304743,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":28672,"affinity_cache_ratio":0.9317258635817113,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":28672,"estimated_new_tokens":2101,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":30773,"score_linear":109083.0,"score_lmetric":31824},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":28672,"new_prefill":2101,"score_linear":-28672.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":30773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-28672.0,"chosen_score_lmetric":0,"t_first_token":390992.417469813,"t_first_token_unix":1779821857.4314132,"t_done":390992.714590467,"t_done_unix":1779821857.7285335},{"request_id":"1399948:31:1579418:968","session_id":"1399948","input_length":30925,"t_proxy_recv":390995.143414407,"t_decision_unix":1779821860.1573558,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9933710590137429,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":205,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":30925,"score_linear":109083.0,"score_lmetric":31976},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":30720,"new_prefill":205,"score_linear":-30720.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":30925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":390995.238801489,"t_first_token_unix":1779821860.2527447,"t_done":390996.560219025,"t_done_unix":1779821861.5741622},{"request_id":"1356885:7:1580925:969","session_id":"1356885","input_length":131775,"t_proxy_recv":391000.454316818,"t_decision_unix":1779821865.4682581,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9985505596660975,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":191,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":131584,"new_prefill":191,"score_linear":-131584.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":130751,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":131775,"score_linear":109083.0,"score_lmetric":132826},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":131775,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-131584.0,"chosen_score_lmetric":0,"t_first_token":391000.852661722,"t_first_token_unix":1779821865.8666058,"t_done":391002.863325331,"t_done_unix":1779821867.8772688},{"request_id":"1399948:32:1581424:970","session_id":"1399948","input_length":31231,"t_proxy_recv":391001.900873353,"t_decision_unix":1779821866.9148145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":30720,"affinity_cache_ratio":0.9836380519355769,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":30720,"estimated_new_tokens":511,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":131775,"ongoing_decode_tokens":131775,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":31231,"score_linear":131775.0,"score_lmetric":31231},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":31231,"score_linear":109083.0,"score_lmetric":32282},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":30720,"new_prefill":511,"score_linear":-30720.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":31231,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-30720.0,"chosen_score_lmetric":0,"t_first_token":391001.997940762,"t_first_token_unix":1779821867.0118842,"t_done":391002.99332225,"t_done_unix":1779821868.0072653},{"request_id":"1399948:33:1583165:972","session_id":"1399948","input_length":31445,"t_proxy_recv":391007.805485417,"t_decision_unix":1779821872.8194265,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":31232,"affinity_cache_ratio":0.9932262680871363,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":213,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":31445,"score_linear":109083.0,"score_lmetric":32496},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1702,"cache_hit":31232,"new_prefill":213,"score_linear":-31232.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":31445,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":391007.890574568,"t_first_token_unix":1779821872.904518,"t_done":391008.540100386,"t_done_unix":1779821873.5540435},{"request_id":"1277428:12:1586139:973","session_id":"1277428","input_length":47660,"t_proxy_recv":391017.942928261,"t_decision_unix":1779821882.9568696,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":46080,"affinity_cache_ratio":0.9668485102811583,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":1580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":46080,"new_prefill":1580,"score_linear":-46080.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":4608,"new_prefill":43052,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":17408,"new_prefill":30252,"score_linear":91675.0,"score_lmetric":31303},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1702,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":47660,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46080.0,"chosen_score_lmetric":0,"t_first_token":391018.402866208,"t_first_token_unix":1779821883.4168098,"t_done":391019.007727486,"t_done_unix":1779821884.0216708},{"request_id":"1399948:34:1586232:974","session_id":"1399948","input_length":32143,"t_proxy_recv":391018.292934502,"t_decision_unix":1779821883.3068757,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":31232,"affinity_cache_ratio":0.97165790374265,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":31232,"estimated_new_tokens":911,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47660,"ongoing_decode_tokens":0,"pending_prefill_tokens":1580,"num_requests":1,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":32143,"score_linear":47660.0,"score_lmetric":33723},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":109083,"ongoing_decode_tokens":0,"pending_prefill_tokens":1051,"num_requests":1,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":0,"new_prefill":32143,"score_linear":109083.0,"score_lmetric":33194},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1702,"cache_hit":31232,"new_prefill":911,"score_linear":-31232.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":32143,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-31232.0,"chosen_score_lmetric":0,"t_first_token":391018.502988283,"t_first_token_unix":1779821883.516933,"t_done":391019.391788953,"t_done_unix":1779821884.4057324},{"request_id":"1270606:4:1578042:965","session_id":"1270606","input_length":109083,"t_proxy_recv":390990.353038765,"t_decision_unix":1779821855.3669798,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9903651348056067,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":1051,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2205,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2275,"cache_hit":108032,"new_prefill":1051,"score_linear":-108032.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1697,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":0,"new_prefill":109083,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":107547,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":391023.709986524,"t_first_token_unix":1779821888.7239304,"t_done":391024.138631518,"t_done_unix":1779821889.152575},{"request_id":"1270606:5:1581455:971","session_id":"1270606","input_length":111387,"t_proxy_recv":391024.178180928,"t_decision_unix":1779821889.1921227,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9790729618357618,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":2331,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2208,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2277,"cache_hit":109056,"new_prefill":2331,"score_linear":-109056.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":111387,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":109851,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":391025.928787606,"t_first_token_unix":1779821890.9427314,"t_done":391028.741637847,"t_done_unix":1779821893.7555811},{"request_id":"1294611:15:1590202:975","session_id":"1294611","input_length":75249,"t_proxy_recv":391031.481804113,"t_decision_unix":1779821896.4957452,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9593748754136268,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":3057,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2208,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":72192,"new_prefill":3057,"score_linear":-72192.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":75249,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":62449,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-72192.0,"chosen_score_lmetric":0,"t_first_token":391032.977216739,"t_first_token_unix":1779821897.9911606,"t_done":391035.661674481,"t_done_unix":1779821900.6756177},{"request_id":"1277428:13:1593499:976","session_id":"1277428","input_length":49316,"t_proxy_recv":391043.126599966,"t_decision_unix":1779821908.140541,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":47616,"affinity_cache_ratio":0.9655284289074539,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47616,"estimated_new_tokens":1700,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2208,"cache_hit":47616,"new_prefill":1700,"score_linear":-47616.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":4608,"new_prefill":44708,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":17408,"new_prefill":31908,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49316,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47616.0,"chosen_score_lmetric":0,"t_first_token":391043.773127013,"t_first_token_unix":1779821908.787071,"t_done":391045.283722743,"t_done_unix":1779821910.2976718},{"request_id":"1294611:15:1594038:977","session_id":"1294611","input_length":75584,"t_proxy_recv":391044.850308433,"t_decision_unix":1779821909.86425,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":75264,"affinity_cache_ratio":0.995766299745978,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":320,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":49316,"ongoing_decode_tokens":49316,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2208,"cache_hit":0,"new_prefill":75584,"score_linear":49316.0,"score_lmetric":75584},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":62784,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":75264,"new_prefill":320,"score_linear":-75264.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":12800,"new_prefill":62784,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":75584,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":62784,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":391044.974795711,"t_first_token_unix":1779821909.988739,"t_done":391046.071191135,"t_done_unix":1779821911.0851347},{"request_id":"1268861:20:1595141:978","session_id":"1268861","input_length":77218,"t_proxy_recv":391048.821819309,"t_decision_unix":1779821913.8357606,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9945867543836929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":76800,"new_prefill":418,"score_linear":-76800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":77218,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":391049.071966585,"t_first_token_unix":1779821914.0859103,"t_done":391049.592025309,"t_done_unix":1779821914.6059687},{"request_id":"1399948:35:1602048:980","session_id":"1399948","input_length":33533,"t_proxy_recv":391072.196641448,"t_decision_unix":1779821937.2105825,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":32256,"affinity_cache_ratio":0.9619181105179972,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":32256,"estimated_new_tokens":1277,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75716,"ongoing_decode_tokens":75716,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":0,"new_prefill":33533,"score_linear":75716.0,"score_lmetric":33533},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":32256,"new_prefill":1277,"score_linear":-32256.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":33533,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-32256.0,"chosen_score_lmetric":0,"t_first_token":391072.601997594,"t_first_token_unix":1779821937.615949,"t_done":391073.609151631,"t_done_unix":1779821938.6230948},{"request_id":"1253804:9:1605110:981","session_id":"1253804","input_length":90656,"t_proxy_recv":391082.192231924,"t_decision_unix":1779821947.2061732,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":89088,"affinity_cache_ratio":0.9827038475114719,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":89088,"estimated_new_tokens":1568,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":87072,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":89088,"new_prefill":1568,"score_linear":-89088.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":75716,"ongoing_decode_tokens":75716,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":3584,"new_prefill":87072,"score_linear":72132.0,"score_lmetric":87072},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":90656,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-89088.0,"chosen_score_lmetric":0,"t_first_token":391083.159219113,"t_first_token_unix":1779821948.1731632,"t_done":391086.756749169,"t_done_unix":1779821951.7707186},{"request_id":"1294611:15:1596163:979","session_id":"1294611","input_length":75716,"t_proxy_recv":391052.007372177,"t_decision_unix":1779821917.0213134,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9940303238417243,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":452,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1692,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2288,"cache_hit":75264,"new_prefill":452,"score_linear":-75264.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":75716,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":62916,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":391052.134563653,"t_first_token_unix":1779821917.1485069,"t_done":391090.083673309,"t_done_unix":1779821955.097617},{"request_id":"1268861:21:1609831:982","session_id":"1268861","input_length":77293,"t_proxy_recv":391097.932821273,"t_decision_unix":1779821962.9467628,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":76800,"affinity_cache_ratio":0.9936216733727504,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":76800,"estimated_new_tokens":493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":76800,"new_prefill":493,"score_linear":-76800.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":77293,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-76800.0,"chosen_score_lmetric":0,"t_first_token":391098.041357411,"t_first_token_unix":1779821963.0553007,"t_done":391099.624313455,"t_done_unix":1779821964.6382565},{"request_id":"1253804:10:1611505:983","session_id":"1253804","input_length":91103,"t_proxy_recv":391103.409100548,"t_decision_unix":1779821968.4230418,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":90624,"affinity_cache_ratio":0.9947422148557128,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":90624,"estimated_new_tokens":479,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":87519,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":90624,"new_prefill":479,"score_linear":-90624.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":87519,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":91103,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-90624.0,"chosen_score_lmetric":0,"t_first_token":391103.579537284,"t_first_token_unix":1779821968.593481,"t_done":391103.71013801,"t_done_unix":1779821968.7240818},{"request_id":"1399948:36:1612467:984","session_id":"1399948","input_length":34773,"t_proxy_recv":391106.513184577,"t_decision_unix":1779821971.5271258,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":33280,"affinity_cache_ratio":0.9570643890374716,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":33280,"estimated_new_tokens":1493,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":33280,"new_prefill":1493,"score_linear":-33280.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":34773,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-33280.0,"chosen_score_lmetric":0,"t_first_token":391106.860672229,"t_first_token_unix":1779821971.874616,"t_done":391107.403026806,"t_done_unix":1779821972.4169703},{"request_id":"1253804:11:1613030:985","session_id":"1253804","input_length":91131,"t_proxy_recv":391108.747191223,"t_decision_unix":1779821973.761132,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":90624,"affinity_cache_ratio":0.9944365803074695,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":90624,"estimated_new_tokens":507,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":87547,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":90624,"new_prefill":507,"score_linear":-90624.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":87547,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1709,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":91131,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-90624.0,"chosen_score_lmetric":0,"t_first_token":391108.869856651,"t_first_token_unix":1779821973.8838003,"t_done":391110.937429044,"t_done_unix":1779821975.9513724},{"request_id":"1399948:37:1613628:986","session_id":"1399948","input_length":35308,"t_proxy_recv":391110.595503524,"t_decision_unix":1779821975.6094449,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":34816,"affinity_cache_ratio":0.9860654809108418,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":34816,"estimated_new_tokens":492,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":91131,"ongoing_decode_tokens":91131,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1695,"cache_hit":0,"new_prefill":35308,"score_linear":91131.0,"score_lmetric":35308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1709,"cache_hit":34816,"new_prefill":492,"score_linear":-34816.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":35308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-34816.0,"chosen_score_lmetric":0,"t_first_token":391110.803655486,"t_first_token_unix":1779821975.817599,"t_done":391111.933227359,"t_done_unix":1779821976.9471717},{"request_id":"1399948:38:1616890:987","session_id":"1399948","input_length":35581,"t_proxy_recv":391121.769257324,"t_decision_unix":1779821986.7831988,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9928894634776988,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":35328,"new_prefill":253,"score_linear":-35328.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":35581,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":391121.878441094,"t_first_token_unix":1779821986.8923845,"t_done":391122.393776409,"t_done_unix":1779821987.4077199},{"request_id":"1399948:39:1618250:989","session_id":"1399948","input_length":35682,"t_proxy_recv":391126.469034692,"t_decision_unix":1779821991.482976,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9900790314444258,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":354,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":35328,"new_prefill":354,"score_linear":-35328.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":35682,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":391126.537794746,"t_first_token_unix":1779821991.551738,"t_done":391126.977232752,"t_done_unix":1779821991.991176},{"request_id":"1399948:40:1620970:991","session_id":"1399948","input_length":35958,"t_proxy_recv":391135.455893249,"t_decision_unix":1779822000.469834,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9824795594860671,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":630,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":35328,"new_prefill":630,"score_linear":-35328.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":78439,"ongoing_decode_tokens":0,"pending_prefill_tokens":1127,"num_requests":1,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":0,"new_prefill":35958,"score_linear":78439.0,"score_lmetric":37085},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":35958,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":391135.596544675,"t_first_token_unix":1779822000.610489,"t_done":391135.955846692,"t_done_unix":1779822000.9697902},{"request_id":"1268861:22:1620830:990","session_id":"1268861","input_length":78439,"t_proxy_recv":391134.997042222,"t_decision_unix":1779822000.0109832,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":77312,"affinity_cache_ratio":0.9856321472736777,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77312,"estimated_new_tokens":1127,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1733,"cache_hit":77312,"new_prefill":1127,"score_linear":-77312.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":78439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-77312.0,"chosen_score_lmetric":0,"t_first_token":391135.724399874,"t_first_token_unix":1779822000.7383437,"t_done":391136.954955093,"t_done_unix":1779822001.9688985},{"request_id":"1253804:12:1621957:992","session_id":"1253804","input_length":91389,"t_proxy_recv":391138.903062317,"t_decision_unix":1779822003.9170032,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9972316143080677,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":253,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":87805,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":91136,"new_prefill":253,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":87805,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":91389,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":391139.081466718,"t_first_token_unix":1779822004.0954103,"t_done":391139.37172723,"t_done_unix":1779822004.385673},{"request_id":"1399948:41:1624143:993","session_id":"1399948","input_length":36168,"t_proxy_recv":391146.267511281,"t_decision_unix":1779822011.2814527,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35840,"affinity_cache_ratio":0.990931209909312,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":328,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":35840,"new_prefill":328,"score_linear":-35840.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":36168,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":391146.399342323,"t_first_token_unix":1779822011.4132864,"t_done":391147.062787535,"t_done_unix":1779822012.0767312},{"request_id":"1253804:13:1624613:994","session_id":"1253804","input_length":91440,"t_proxy_recv":391147.840731656,"t_decision_unix":1779822012.8546727,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9966754155730534,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":304,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":87856,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":91136,"new_prefill":304,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":87856,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":91440,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":391147.970428236,"t_first_token_unix":1779822012.9843712,"t_done":391148.963375078,"t_done_unix":1779822013.9773188},{"request_id":"1253804:14:1626575:995","session_id":"1253804","input_length":92367,"t_proxy_recv":391154.352229855,"t_decision_unix":1779822019.366171,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":91136,"affinity_cache_ratio":0.9866727294380028,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":91136,"estimated_new_tokens":1231,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":88783,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1696,"cache_hit":91136,"new_prefill":1231,"score_linear":-91136.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":88783,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":92367,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-91136.0,"chosen_score_lmetric":0,"t_first_token":391154.991168046,"t_first_token_unix":1779822020.0051117,"t_done":391155.794206685,"t_done_unix":1779822020.8081498},{"request_id":"1253804:15:1628485:997","session_id":"1253804","input_length":92701,"t_proxy_recv":391160.684402316,"t_decision_unix":1779822025.6983438,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92160,"affinity_cache_ratio":0.9941640327504557,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92160,"estimated_new_tokens":541,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":89117,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1698,"cache_hit":92160,"new_prefill":541,"score_linear":-92160.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":89117,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":36984,"ongoing_decode_tokens":0,"pending_prefill_tokens":1144,"num_requests":1,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":92701,"score_linear":36984.0,"score_lmetric":93845},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":92701,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-92160.0,"chosen_score_lmetric":0,"t_first_token":391160.97166098,"t_first_token_unix":1779822025.9856045,"t_done":391161.347825892,"t_done_unix":1779822026.3617692},{"request_id":"1399948:42:1628429:996","session_id":"1399948","input_length":36984,"t_proxy_recv":391160.459175521,"t_decision_unix":1779822025.4731166,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35840,"affinity_cache_ratio":0.9690677049534934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35840,"estimated_new_tokens":1144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1698,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":35840,"new_prefill":1144,"score_linear":-35840.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":36984,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35840.0,"chosen_score_lmetric":0,"t_first_token":391160.74695751,"t_first_token_unix":1779822025.7609005,"t_done":391161.945644281,"t_done_unix":1779822026.9595876},{"request_id":"1388507:3:1629072:998","session_id":"1388507","input_length":79074,"t_proxy_recv":391162.768974921,"t_decision_unix":1779822027.7829163,"policy":"unified_kv_both","decision":"affinity","affinity_idx":4,"chosen_idx":4,"affinity_cache_hit":75776,"affinity_cache_ratio":0.9582922325922554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75776,"estimated_new_tokens":3298,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8004","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1699,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":75776,"new_prefill":3298,"score_linear":-75776.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":79074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75776.0,"chosen_score_lmetric":0,"t_first_token":391164.488458699,"t_first_token_unix":1779822029.5024028,"t_done":391165.036537773,"t_done_unix":1779822030.0504813},{"request_id":"1253804:16:1629713:999","session_id":"1253804","input_length":92953,"t_proxy_recv":391164.730563077,"t_decision_unix":1779822029.7445047,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92672,"affinity_cache_ratio":0.9969769668542167,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92672,"estimated_new_tokens":281,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":89369,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1699,"cache_hit":92672,"new_prefill":281,"score_linear":-92672.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":89369,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":79074,"ongoing_decode_tokens":79074,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1767,"cache_hit":0,"new_prefill":92953,"score_linear":79074.0,"score_lmetric":92953},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":92953,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-92672.0,"chosen_score_lmetric":0,"t_first_token":391165.019413395,"t_first_token_unix":1779822030.033357,"t_done":391165.993381318,"t_done_unix":1779822031.0073247},{"request_id":"1253804:17:1631602:1002","session_id":"1253804","input_length":93219,"t_proxy_recv":391170.805693202,"t_decision_unix":1779822035.819635,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":92672,"affinity_cache_ratio":0.9941320975337645,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":92672,"estimated_new_tokens":547,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":89635,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1699,"cache_hit":92672,"new_prefill":547,"score_linear":-92672.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":3584,"new_prefill":89635,"score_linear":76306.0,"score_lmetric":89635},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":79693,"ongoing_decode_tokens":0,"pending_prefill_tokens":1357,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":93219,"score_linear":79693.0,"score_lmetric":94576},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":93219,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-92672.0,"chosen_score_lmetric":0,"t_first_token":391171.093885716,"t_first_token_unix":1779822036.1078293,"t_done":391171.852533287,"t_done_unix":1779822036.8664765},{"request_id":"1268861:23:1631587:1001","session_id":"1268861","input_length":79693,"t_proxy_recv":391170.728202519,"t_decision_unix":1779822035.7421436,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9829721556472965,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":1357,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1699,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":79890,"ongoing_decode_tokens":79890,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":0,"new_prefill":79693,"score_linear":79890.0,"score_lmetric":79693},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":78336,"new_prefill":1357,"score_linear":-78336.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":79693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":391171.43740972,"t_first_token_unix":1779822036.451353,"t_done":391172.068599262,"t_done_unix":1779822037.082543},{"request_id":"1294611:15:1631116:1000","session_id":"1294611","input_length":79890,"t_proxy_recv":391169.314103879,"t_decision_unix":1779822034.3280451,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":79360,"affinity_cache_ratio":0.9933658780823632,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79360,"estimated_new_tokens":530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1699,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2290,"cache_hit":79360,"new_prefill":530,"score_linear":-79360.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":79890,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":67090,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-79360.0,"chosen_score_lmetric":0,"t_first_token":391169.494146409,"t_first_token_unix":1779822034.50809,"t_done":391172.217246054,"t_done_unix":1779822037.2311895},{"request_id":"1253804:18:1633257:1003","session_id":"1253804","input_length":93509,"t_proxy_recv":391176.255335753,"t_decision_unix":1779822041.2692766,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9965243987209788,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":89925,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":93184,"new_prefill":325,"score_linear":-93184.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":3584,"new_prefill":89925,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":93509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":391176.543633249,"t_first_token_unix":1779822041.5575771,"t_done":391177.426324804,"t_done_unix":1779822042.4402683},{"request_id":"1294611:15:1634779:1004","session_id":"1294611","input_length":80221,"t_proxy_recv":391181.424317738,"t_decision_unix":1779822046.4382591,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":79872,"affinity_cache_ratio":0.995649518205956,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":349,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":79872,"new_prefill":349,"score_linear":-79872.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":80221,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":67421,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":391181.552274508,"t_first_token_unix":1779822046.5662181,"t_done":391182.105789903,"t_done_unix":1779822047.1197336},{"request_id":"1253804:19:1634903:1005","session_id":"1253804","input_length":93664,"t_proxy_recv":391181.798451753,"t_decision_unix":1779822046.8123932,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93184,"affinity_cache_ratio":0.9948752989408951,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93184,"estimated_new_tokens":480,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":90080,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1700,"cache_hit":93184,"new_prefill":480,"score_linear":-93184.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80221,"ongoing_decode_tokens":80221,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":3584,"new_prefill":90080,"score_linear":76637.0,"score_lmetric":90080},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":93664,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-93184.0,"chosen_score_lmetric":0,"t_first_token":391181.979743157,"t_first_token_unix":1779822046.9936867,"t_done":391185.970274683,"t_done_unix":1779822050.9842186},{"request_id":"1253804:20:1638889:1007","session_id":"1253804","input_length":94111,"t_proxy_recv":391194.97826719,"t_decision_unix":1779822059.9922085,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93696,"affinity_cache_ratio":0.9955903135658956,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93696,"estimated_new_tokens":415,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":90527,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":93696,"new_prefill":415,"score_linear":-93696.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":3584,"new_prefill":90527,"score_linear":77133.0,"score_lmetric":90527},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":94111,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-93696.0,"chosen_score_lmetric":0,"t_first_token":391195.168809957,"t_first_token_unix":1779822060.1827536,"t_done":391195.989109993,"t_done_unix":1779822061.0030575},{"request_id":"1258908:2:1639411:1008","session_id":"1258908","input_length":9804,"t_proxy_recv":391196.777055184,"t_decision_unix":1779822061.7909966,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9400244798041616,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":588,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":9216,"new_prefill":588,"score_linear":71501.0,"score_lmetric":588},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":9804,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":71501.0,"chosen_score_lmetric":588,"t_first_token":391197.58953985,"t_first_token_unix":1779822062.6034837,"t_done":391200.594589121,"t_done_unix":1779822065.608532},{"request_id":"1268861:24:1643502:1011","session_id":"1268861","input_length":80019,"t_proxy_recv":391210.602678492,"t_decision_unix":1779822075.6166198,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":79360,"affinity_cache_ratio":0.9917644559417138,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79360,"estimated_new_tokens":659,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":94269,"ongoing_decode_tokens":94269,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":80019,"score_linear":94269.0,"score_lmetric":80019},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":80019,"score_linear":80717.0,"score_lmetric":80019},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":38102,"ongoing_decode_tokens":0,"pending_prefill_tokens":1238,"num_requests":1,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":80019,"score_linear":38102.0,"score_lmetric":81257},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":79360,"new_prefill":659,"score_linear":-79360.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":80019,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79360.0,"chosen_score_lmetric":0,"t_first_token":391210.864958477,"t_first_token_unix":1779822075.878902,"t_done":391211.319839678,"t_done_unix":1779822076.3337827},{"request_id":"1399948:43:1643413:1010","session_id":"1399948","input_length":38102,"t_proxy_recv":391210.254910861,"t_decision_unix":1779822075.268852,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":36864,"affinity_cache_ratio":0.9675082672825573,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":36864,"estimated_new_tokens":1238,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":94269,"ongoing_decode_tokens":94269,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":38102,"score_linear":94269.0,"score_lmetric":38102},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":80717,"ongoing_decode_tokens":80717,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":38102,"score_linear":80717.0,"score_lmetric":38102},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":36864,"new_prefill":1238,"score_linear":-36864.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":38102,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-36864.0,"chosen_score_lmetric":0,"t_first_token":391210.626063237,"t_first_token_unix":1779822075.640006,"t_done":391211.402719882,"t_done_unix":1779822076.416663},{"request_id":"1294611:15:1636645:1006","session_id":"1294611","input_length":80717,"t_proxy_recv":391187.466427598,"t_decision_unix":1779822052.4803689,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9895313254952488,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":79872,"new_prefill":845,"score_linear":-79872.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":80717,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":67917,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":391187.874395237,"t_first_token_unix":1779822052.8883388,"t_done":391211.912086531,"t_done_unix":1779822076.9260302},{"request_id":"1253804:21:1640487:1009","session_id":"1253804","input_length":94269,"t_proxy_recv":391200.263575959,"t_decision_unix":1779822065.2775173,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":93696,"affinity_cache_ratio":0.9939216497470006,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":93696,"estimated_new_tokens":573,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":90685,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1701,"cache_hit":93696,"new_prefill":573,"score_linear":-93696.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":90521,"ongoing_decode_tokens":90521,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":2291,"cache_hit":3584,"new_prefill":90685,"score_linear":86937.0,"score_lmetric":181370},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":94269,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-93696.0,"chosen_score_lmetric":0,"t_first_token":391200.46344898,"t_first_token_unix":1779822065.4773924,"t_done":391214.791746215,"t_done_unix":1779822079.8056898},{"request_id":"1399948:44:1644970:1012","session_id":"1399948","input_length":38308,"t_proxy_recv":391215.380145274,"t_decision_unix":1779822080.3940864,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":37888,"affinity_cache_ratio":0.9890362326407017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37888,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1715,"cache_hit":37888,"new_prefill":420,"score_linear":-37888.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":38308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37888.0,"chosen_score_lmetric":0,"t_first_token":391215.492369491,"t_first_token_unix":1779822080.5063136,"t_done":391216.999468302,"t_done_unix":1779822082.0134118},{"request_id":"1253804:22:1650001:1013","session_id":"1253804","input_length":95715,"t_proxy_recv":391231.967877716,"t_decision_unix":1779822096.981819,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":95232,"affinity_cache_ratio":0.9949537690017238,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95232,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":92131,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1703,"cache_hit":95232,"new_prefill":483,"score_linear":-95232.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":3584,"new_prefill":92131,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":95715,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-95232.0,"chosen_score_lmetric":0,"t_first_token":391232.15889579,"t_first_token_unix":1779822097.1728394,"t_done":391232.645430234,"t_done_unix":1779822097.6593807},{"request_id":"1399948:45:1650679:1014","session_id":"1399948","input_length":38758,"t_proxy_recv":391234.422190458,"t_decision_unix":1779822099.436132,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9907631972754012,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":358,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":38400,"new_prefill":358,"score_linear":-38400.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":38758,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":391234.567339199,"t_first_token_unix":1779822099.5812826,"t_done":391235.155515259,"t_done_unix":1779822100.1694589},{"request_id":"1253804:23:1651448:1015","session_id":"1253804","input_length":96944,"t_proxy_recv":391236.722689022,"t_decision_unix":1779822101.7366302,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":95744,"affinity_cache_ratio":0.9876217197557353,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":95744,"estimated_new_tokens":1200,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":93360,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1704,"cache_hit":95744,"new_prefill":1200,"score_linear":-95744.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":3584,"new_prefill":93360,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":96944,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-95744.0,"chosen_score_lmetric":0,"t_first_token":391237.565548777,"t_first_token_unix":1779822102.5794926,"t_done":391237.970892863,"t_done_unix":1779822102.9848366},{"request_id":"1399948:46:1658183:1018","session_id":"1399948","input_length":39837,"t_proxy_recv":391259.55551125,"t_decision_unix":1779822124.5694525,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":38400,"affinity_cache_ratio":0.9639280066270051,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":38400,"estimated_new_tokens":1437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":0,"new_prefill":39837,"score_linear":83204.0,"score_lmetric":39837},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":38400,"new_prefill":1437,"score_linear":-38400.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":39837,"score_linear":80406.0,"score_lmetric":39837},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":39837,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-38400.0,"chosen_score_lmetric":0,"t_first_token":391259.944565274,"t_first_token_unix":1779822124.9585085,"t_done":391260.797676518,"t_done_unix":1779822125.8116198},{"request_id":"1253804:24:1659020:1019","session_id":"1253804","input_length":97769,"t_proxy_recv":391262.451386067,"t_decision_unix":1779822127.4653275,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":96768,"affinity_cache_ratio":0.9897615808691916,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":96768,"estimated_new_tokens":1001,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":94185,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":96768,"new_prefill":1001,"score_linear":-96768.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":3584,"new_prefill":94185,"score_linear":79620.0,"score_lmetric":94185},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":97769,"score_linear":80406.0,"score_lmetric":97769},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":97769,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-96768.0,"chosen_score_lmetric":0,"t_first_token":391263.117319162,"t_first_token_unix":1779822128.1312625,"t_done":391263.523193014,"t_done_unix":1779822128.537136},{"request_id":"1268861:25:1653400:1016","session_id":"1268861","input_length":80406,"t_proxy_recv":391243.160365407,"t_decision_unix":1779822108.1743062,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":79872,"affinity_cache_ratio":0.9933587045742855,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":79872,"estimated_new_tokens":534,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":79872,"new_prefill":534,"score_linear":-79872.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":80406,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-79872.0,"chosen_score_lmetric":0,"t_first_token":391243.566151904,"t_first_token_unix":1779822108.5800958,"t_done":391267.714671864,"t_done_unix":1779822132.728618},{"request_id":"1253804:25:1662273:1020","session_id":"1253804","input_length":98187,"t_proxy_recv":391273.315393781,"t_decision_unix":1779822138.329335,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9959770641734649,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":395,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":94603,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1708,"cache_hit":97792,"new_prefill":395,"score_linear":-97792.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":3584,"new_prefill":94603,"score_linear":79620.0,"score_lmetric":94603},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":98187,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-97792.0,"chosen_score_lmetric":0,"t_first_token":391273.796217109,"t_first_token_unix":1779822138.8101606,"t_done":391274.199957666,"t_done_unix":1779822139.2139013},{"request_id":"1294611:15:1657992:1017","session_id":"1294611","input_length":83204,"t_proxy_recv":391259.078593254,"t_decision_unix":1779822124.0925345,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":82944,"affinity_cache_ratio":0.9968751502331619,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":82944,"estimated_new_tokens":260,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1706,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":82944,"new_prefill":260,"score_linear":-82944.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":83204,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":80406,"ongoing_decode_tokens":80406,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":83204,"score_linear":80406.0,"score_lmetric":83204},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":70404,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-82944.0,"chosen_score_lmetric":0,"t_first_token":391259.263462707,"t_first_token_unix":1779822124.277406,"t_done":391281.092801726,"t_done_unix":1779822146.1067448},{"request_id":"1399948:47:1664702:1022","session_id":"1399948","input_length":40261,"t_proxy_recv":391281.917252523,"t_decision_unix":1779822146.9311936,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9919276719405876,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":325,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1708,"cache_hit":0,"new_prefill":40261,"score_linear":98254.0,"score_lmetric":40261},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":39936,"new_prefill":325,"score_linear":-39936.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40261,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":391282.137039049,"t_first_token_unix":1779822147.1509826,"t_done":391282.555188066,"t_done_unix":1779822147.5691316},{"request_id":"1356885:8:1665690:1023","session_id":"1356885","input_length":132537,"t_proxy_recv":391285.13332038,"t_decision_unix":1779822150.1472614,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":131584,"affinity_cache_ratio":0.9928095550676415,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":131584,"estimated_new_tokens":953,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1708,"cache_hit":131584,"new_prefill":953,"score_linear":-33330.0,"score_lmetric":953},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":131513,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":132537,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-33330.0,"chosen_score_lmetric":953,"t_first_token":391285.785164546,"t_first_token_unix":1779822150.7991085,"t_done":391288.405795654,"t_done_unix":1779822153.41974},{"request_id":"1399948:48:1666394:1024","session_id":"1399948","input_length":40343,"t_proxy_recv":391287.553163813,"t_decision_unix":1779822152.5671053,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9899115088119377,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":407,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":230791,"ongoing_decode_tokens":230791,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1708,"cache_hit":0,"new_prefill":40343,"score_linear":230791.0,"score_lmetric":80686},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":39936,"new_prefill":407,"score_linear":-39936.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40343,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":391287.62544502,"t_first_token_unix":1779822152.6393886,"t_done":391289.001450686,"t_done_unix":1779822154.0153942},{"request_id":"1399948:49:1668825:1025","session_id":"1399948","input_length":40642,"t_proxy_recv":391296.111231432,"t_decision_unix":1779822161.1251729,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9952266128635402,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":194,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":0,"new_prefill":40642,"score_linear":98254.0,"score_lmetric":40642},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":40448,"new_prefill":194,"score_linear":-40448.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40642,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":391296.230142295,"t_first_token_unix":1779822161.2440858,"t_done":391297.299376216,"t_done_unix":1779822162.3133745},{"request_id":"1294611:15:1673197:1026","session_id":"1294611","input_length":85542,"t_proxy_recv":391311.324791225,"t_decision_unix":1779822176.3387325,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":84992,"affinity_cache_ratio":0.9935704098571462,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":84992,"estimated_new_tokens":550,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":98254,"ongoing_decode_tokens":98254,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1710,"cache_hit":0,"new_prefill":85542,"score_linear":98254.0,"score_lmetric":85542},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2296,"cache_hit":84992,"new_prefill":550,"score_linear":-84992.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":85542,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":72742,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-84992.0,"chosen_score_lmetric":0,"t_first_token":391311.514046323,"t_first_token_unix":1779822176.52799,"t_done":391313.099448599,"t_done_unix":1779822178.113392},{"request_id":"1253804:26:1663639:1021","session_id":"1253804","input_length":98254,"t_proxy_recv":391278.149116812,"t_decision_unix":1779822143.1630583,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":97792,"affinity_cache_ratio":0.9952979013577056,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":97792,"estimated_new_tokens":462,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":94670,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1708,"cache_hit":97792,"new_prefill":462,"score_linear":-97792.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":83204,"ongoing_decode_tokens":83204,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2294,"cache_hit":3584,"new_prefill":94670,"score_linear":79620.0,"score_lmetric":94670},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":98254,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-97792.0,"chosen_score_lmetric":0,"t_first_token":391278.291598362,"t_first_token_unix":1779822143.3055422,"t_done":391316.019625458,"t_done_unix":1779822181.033572},{"request_id":"1294611:15:1676489:1027","session_id":"1294611","input_length":85722,"t_proxy_recv":391322.714269062,"t_decision_unix":1779822187.7282104,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":85504,"affinity_cache_ratio":0.9974568955460675,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":218,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":85504,"new_prefill":218,"score_linear":-85504.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":85722,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":72922,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":391322.882415802,"t_first_token_unix":1779822187.8963594,"t_done":391325.411985208,"t_done_unix":1779822190.425929},{"request_id":"1399948:50:1677482:1028","session_id":"1399948","input_length":42648,"t_proxy_recv":391325.965281123,"t_decision_unix":1779822190.9792218,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9484149315325455,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":2200,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":40448,"new_prefill":2200,"score_linear":-40448.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":42648,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":391326.551120583,"t_first_token_unix":1779822191.5650642,"t_done":391330.179693072,"t_done_unix":1779822195.193638},{"request_id":"1294611:15:1679070:1029","session_id":"1294611","input_length":86602,"t_proxy_recv":391331.39783154,"t_decision_unix":1779822196.4117725,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":85504,"affinity_cache_ratio":0.987321308976698,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":85504,"estimated_new_tokens":1098,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2297,"cache_hit":85504,"new_prefill":1098,"score_linear":-85504.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":86602,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":73802,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-85504.0,"chosen_score_lmetric":0,"t_first_token":391331.844284267,"t_first_token_unix":1779822196.8582277,"t_done":391334.601472068,"t_done_unix":1779822199.6154158},{"request_id":"1253804:27:1683133:1031","session_id":"1253804","input_length":101743,"t_proxy_recv":391345.022560743,"t_decision_unix":1779822210.0365021,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9963928722369106,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":367,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":98159,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":101376,"new_prefill":367,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":86925,"ongoing_decode_tokens":86925,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2299,"cache_hit":3584,"new_prefill":98159,"score_linear":83341.0,"score_lmetric":98159},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":101743,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":391345.246059212,"t_first_token_unix":1779822210.2600029,"t_done":391345.532711726,"t_done_unix":1779822210.5466552},{"request_id":"1294611:15:1682649:1030","session_id":"1294611","input_length":86925,"t_proxy_recv":391343.301329642,"t_decision_unix":1779822208.3152707,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":86528,"affinity_cache_ratio":0.9954328444060973,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":86528,"estimated_new_tokens":397,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2299,"cache_hit":86528,"new_prefill":397,"score_linear":-86528.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":86925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":12800,"new_prefill":74125,"score_linear":-12800.0,"score_lmetric":0}],"chosen_score_linear":-86528.0,"chosen_score_lmetric":0,"t_first_token":391343.439975671,"t_first_token_unix":1779822208.4539194,"t_done":391347.385641224,"t_done_unix":1779822212.399585},{"request_id":"1253804:28:1685257:1032","session_id":"1253804","input_length":101794,"t_proxy_recv":391352.023175518,"t_decision_unix":1779822217.0371168,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9958936676031986,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":98210,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":101376,"new_prefill":418,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":98210,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":101794,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":391352.163441387,"t_first_token_unix":1779822217.1773846,"t_done":391352.87773901,"t_done_unix":1779822217.8916826},{"request_id":"1399948:51:1686626:1033","session_id":"1399948","input_length":43407,"t_proxy_recv":391356.95421953,"t_decision_unix":1779822221.9681606,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":43008,"affinity_cache_ratio":0.9908079342041606,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43008,"estimated_new_tokens":399,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1725,"cache_hit":43008,"new_prefill":399,"score_linear":-43008.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":43407,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43008.0,"chosen_score_lmetric":0,"t_first_token":391357.114830845,"t_first_token_unix":1779822222.1287744,"t_done":391358.544251403,"t_done_unix":1779822223.5581977},{"request_id":"1253804:29:1688398:1034","session_id":"1253804","input_length":102067,"t_proxy_recv":391363.010278948,"t_decision_unix":1779822228.0242205,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101376,"affinity_cache_ratio":0.9932299371981149,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101376,"estimated_new_tokens":691,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":98483,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1711,"cache_hit":101376,"new_prefill":691,"score_linear":-101376.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":98483,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":102067,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101376.0,"chosen_score_lmetric":0,"t_first_token":391363.321579974,"t_first_token_unix":1779822228.3355238,"t_done":391364.334353007,"t_done_unix":1779822229.3482966},{"request_id":"1399948:52:1689144:1035","session_id":"1399948","input_length":43673,"t_proxy_recv":391365.5904358,"t_decision_unix":1779822230.6043768,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9964966913195796,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":153,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1712,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":43520,"new_prefill":153,"score_linear":-43520.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":43673,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":391365.701174962,"t_first_token_unix":1779822230.7151182,"t_done":391366.430504994,"t_done_unix":1779822231.444449},{"request_id":"1356885:9:1689871:1036","session_id":"1356885","input_length":132823,"t_proxy_recv":391367.970096699,"t_decision_unix":1779822232.9840379,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":132608,"affinity_cache_ratio":0.9983813044427546,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":132608,"estimated_new_tokens":215,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1712,"cache_hit":132608,"new_prefill":215,"score_linear":-132608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":131799,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":132823,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-132608.0,"chosen_score_lmetric":0,"t_first_token":391368.253618779,"t_first_token_unix":1779822233.2675624,"t_done":391370.180207141,"t_done_unix":1779822235.1941504},{"request_id":"1253804:30:1690362:1037","session_id":"1253804","input_length":102214,"t_proxy_recv":391369.62043681,"t_decision_unix":1779822234.6343777,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9968106130275696,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":326,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":98630,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":132823,"ongoing_decode_tokens":132823,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1712,"cache_hit":101888,"new_prefill":326,"score_linear":30935.0,"score_lmetric":326},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":98630,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":102214,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":30935.0,"chosen_score_lmetric":326,"t_first_token":391369.833077696,"t_first_token_unix":1779822234.8470213,"t_done":391370.762649827,"t_done_unix":1779822235.776594},{"request_id":"1253804:31:1691981:1038","session_id":"1253804","input_length":102322,"t_proxy_recv":391375.197109469,"t_decision_unix":1779822240.2110505,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9957584879107132,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":98738,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1712,"cache_hit":101888,"new_prefill":434,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":98738,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":102322,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":391375.348637839,"t_first_token_unix":1779822240.3625815,"t_done":391375.732258041,"t_done_unix":1779822240.7462046},{"request_id":"1399948:53:1692115:1039","session_id":"1399948","input_length":43938,"t_proxy_recv":391375.712209275,"t_decision_unix":1779822240.7261508,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":43520,"affinity_cache_ratio":0.9904865947471437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":43520,"estimated_new_tokens":418,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":102322,"ongoing_decode_tokens":102322,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1712,"cache_hit":0,"new_prefill":43938,"score_linear":102322.0,"score_lmetric":43938},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":43520,"new_prefill":418,"score_linear":-43520.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":43938,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-43520.0,"chosen_score_lmetric":0,"t_first_token":391375.869923393,"t_first_token_unix":1779822240.8838668,"t_done":391377.229577288,"t_done_unix":1779822242.2435207},{"request_id":"1253804:32:1693715:1040","session_id":"1253804","input_length":102509,"t_proxy_recv":391381.286126757,"t_decision_unix":1779822246.3000681,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":101888,"affinity_cache_ratio":0.9939419953369948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":101888,"estimated_new_tokens":621,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":98925,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1712,"cache_hit":101888,"new_prefill":621,"score_linear":-101888.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":98925,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":102509,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-101888.0,"chosen_score_lmetric":0,"t_first_token":391381.596788935,"t_first_token_unix":1779822246.6107326,"t_done":391382.374933267,"t_done_unix":1779822247.3888774},{"request_id":"1399948:54:1694570:1041","session_id":"1399948","input_length":44182,"t_proxy_recv":391384.370852592,"t_decision_unix":1779822249.3847938,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9966049522429948,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":150,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":44032,"new_prefill":150,"score_linear":-44032.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":44182,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":391384.478435813,"t_first_token_unix":1779822249.4923797,"t_done":391384.75513949,"t_done_unix":1779822249.7690825},{"request_id":"1253804:33:1695393:1042","session_id":"1253804","input_length":102632,"t_proxy_recv":391387.034945652,"t_decision_unix":1779822252.0488865,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102400,"affinity_cache_ratio":0.9977394964533479,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102400,"estimated_new_tokens":232,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":99048,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":102400,"new_prefill":232,"score_linear":-102400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":99048,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":102632,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102400.0,"chosen_score_lmetric":0,"t_first_token":391387.227367561,"t_first_token_unix":1779822252.241311,"t_done":391387.726294551,"t_done_unix":1779822252.7402382},{"request_id":"1253804:34:1697569:1043","session_id":"1253804","input_length":102792,"t_proxy_recv":391394.87147314,"t_decision_unix":1779822259.8854144,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102400,"affinity_cache_ratio":0.9961864736555374,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102400,"estimated_new_tokens":392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":99208,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1713,"cache_hit":102400,"new_prefill":392,"score_linear":-102400.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":99208,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":102792,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102400.0,"chosen_score_lmetric":0,"t_first_token":391395.121847106,"t_first_token_unix":1779822260.135791,"t_done":391398.502858979,"t_done_unix":1779822263.5168023},{"request_id":"1253804:35:1701250:1044","session_id":"1253804","input_length":103349,"t_proxy_recv":391407.41547362,"t_decision_unix":1779822272.4294145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102912,"affinity_cache_ratio":0.9957716088205981,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102912,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":99765,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":102912,"new_prefill":437,"score_linear":-102912.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":99765,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":103349,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102912.0,"chosen_score_lmetric":0,"t_first_token":391407.732017745,"t_first_token_unix":1779822272.745962,"t_done":391408.041026346,"t_done_unix":1779822273.0549703},{"request_id":"1253804:36:1702697:1045","session_id":"1253804","input_length":103400,"t_proxy_recv":391412.567422375,"t_decision_unix":1779822277.5813632,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":102912,"affinity_cache_ratio":0.9952804642166344,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":102912,"estimated_new_tokens":488,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":99816,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1714,"cache_hit":102912,"new_prefill":488,"score_linear":-102912.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":99816,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":103400,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-102912.0,"chosen_score_lmetric":0,"t_first_token":391412.712016995,"t_first_token_unix":1779822277.7259605,"t_done":391413.159863114,"t_done_unix":1779822278.173807},{"request_id":"1399948:55:1704272:1047","session_id":"1399948","input_length":45284,"t_proxy_recv":391417.835915645,"t_decision_unix":1779822282.8498566,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":44032,"affinity_cache_ratio":0.9723522657009098,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":44032,"estimated_new_tokens":1252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1715,"cache_hit":0,"new_prefill":45284,"score_linear":103471.0,"score_lmetric":45284},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":44032,"new_prefill":1252,"score_linear":-44032.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":45284,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-44032.0,"chosen_score_lmetric":0,"t_first_token":391418.277826144,"t_first_token_unix":1779822283.2917695,"t_done":391419.934353393,"t_done_unix":1779822284.948297},{"request_id":"1356885:10:1706624:1048","session_id":"1356885","input_length":133014,"t_proxy_recv":391426.162785087,"t_decision_unix":1779822291.1767242,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":132608,"affinity_cache_ratio":0.9969476897168719,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":132608,"estimated_new_tokens":406,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1715,"cache_hit":132608,"new_prefill":406,"score_linear":-29137.0,"score_lmetric":406},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":131990,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1729,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":133014,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-29137.0,"chosen_score_lmetric":406,"t_first_token":391426.388198954,"t_first_token_unix":1779822291.4021423,"t_done":391428.672931205,"t_done_unix":1779822293.6868777},{"request_id":"1399948:56:1708284:1049","session_id":"1399948","input_length":45571,"t_proxy_recv":391431.872714778,"t_decision_unix":1779822296.8866563,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9886989532816923,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":515,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":103471,"ongoing_decode_tokens":103471,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1716,"cache_hit":0,"new_prefill":45571,"score_linear":103471.0,"score_lmetric":45571},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1729,"cache_hit":45056,"new_prefill":515,"score_linear":-45056.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":45571,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":391431.987066661,"t_first_token_unix":1779822297.0010107,"t_done":391432.877138356,"t_done_unix":1779822297.891082},{"request_id":"1253804:37:1704071:1046","session_id":"1253804","input_length":103471,"t_proxy_recv":391417.041203768,"t_decision_unix":1779822282.055145,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":103424,"affinity_cache_ratio":0.9995457664466372,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":103424,"estimated_new_tokens":47,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":99887,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1715,"cache_hit":103424,"new_prefill":47,"score_linear":-103424.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":99887,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1727,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":103471,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-103424.0,"chosen_score_lmetric":0,"t_first_token":391417.182731075,"t_first_token_unix":1779822282.1966746,"t_done":391433.662926528,"t_done_unix":1779822298.67687},{"request_id":"1399948:57:1711464:1050","session_id":"1399948","input_length":45756,"t_proxy_recv":391442.667439546,"t_decision_unix":1779822307.6813807,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":45568,"affinity_cache_ratio":0.995891249235073,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45568,"estimated_new_tokens":188,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1717,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1730,"cache_hit":45568,"new_prefill":188,"score_linear":-45568.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":45756,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45568.0,"chosen_score_lmetric":0,"t_first_token":391442.781667556,"t_first_token_unix":1779822307.795611,"t_done":391445.237254588,"t_done_unix":1779822310.251198},{"request_id":"1253804:38:1712824:1051","session_id":"1253804","input_length":104953,"t_proxy_recv":391447.492426485,"t_decision_unix":1779822312.5063677,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104448,"affinity_cache_ratio":0.9951883223919278,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104448,"estimated_new_tokens":505,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":101369,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1717,"cache_hit":104448,"new_prefill":505,"score_linear":-104448.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":101369,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":104953,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104448.0,"chosen_score_lmetric":0,"t_first_token":391447.692205076,"t_first_token_unix":1779822312.7061489,"t_done":391448.004048433,"t_done_unix":1779822313.017992},{"request_id":"1253804:39:1714767:1052","session_id":"1253804","input_length":105004,"t_proxy_recv":391454.07793403,"t_decision_unix":1779822319.0918753,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104960,"affinity_cache_ratio":0.9995809683440631,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104960,"estimated_new_tokens":44,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":101420,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1718,"cache_hit":104960,"new_prefill":44,"score_linear":-104960.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":101420,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":105004,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104960.0,"chosen_score_lmetric":0,"t_first_token":391454.222816521,"t_first_token_unix":1779822319.23676,"t_done":391454.794504241,"t_done_unix":1779822319.808448},{"request_id":"1253804:40:1716790:1053","session_id":"1253804","input_length":105156,"t_proxy_recv":391460.782931933,"t_decision_unix":1779822325.7968736,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":104960,"affinity_cache_ratio":0.9981361025523984,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":104960,"estimated_new_tokens":196,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":3584,"new_prefill":101572,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1718,"cache_hit":104960,"new_prefill":196,"score_linear":-104960.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":101572,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":105156,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-104960.0,"chosen_score_lmetric":0,"t_first_token":391461.035521347,"t_first_token_unix":1779822326.0494652,"t_done":391465.668424496,"t_done_unix":1779822330.6823683},{"request_id":"1305906:4:1718131:1054","session_id":"1305906","input_length":47861,"t_proxy_recv":391465.237927438,"t_decision_unix":1779822330.2518687,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":45056,"affinity_cache_ratio":0.9413927832682142,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":45056,"estimated_new_tokens":2805,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":45056,"new_prefill":2805,"score_linear":-45056.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":105156,"ongoing_decode_tokens":105156,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1718,"cache_hit":0,"new_prefill":47861,"score_linear":105156.0,"score_lmetric":47861},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":16896,"new_prefill":30965,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":47861,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-45056.0,"chosen_score_lmetric":0,"t_first_token":391466.156814024,"t_first_token_unix":1779822331.1707606,"t_done":391468.214770811,"t_done_unix":1779822333.228714},{"request_id":"1305906:5:1514292:934","session_id":"1305906","input_length":49817,"t_proxy_recv":391468.230842806,"t_decision_unix":1779822333.2447844,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9660959110343859,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":1689,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2217,"cache_hit":48128,"new_prefill":1689,"score_linear":-48128.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37173,"ongoing_decode_tokens":0,"pending_prefill_tokens":1845,"num_requests":1,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":16896,"new_prefill":32921,"score_linear":20277.0,"score_lmetric":34766},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49817,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":391468.890338531,"t_first_token_unix":1779822333.9042828,"t_done":391469.552645845,"t_done_unix":1779822334.5665894},{"request_id":"1340290:13:1718889:1055","session_id":"1340290","input_length":37173,"t_proxy_recv":391467.870680321,"t_decision_unix":1779822332.8846214,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":35328,"affinity_cache_ratio":0.9503672020014526,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":35328,"estimated_new_tokens":1845,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":47861,"ongoing_decode_tokens":47861,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2211,"cache_hit":0,"new_prefill":37173,"score_linear":47861.0,"score_lmetric":37173},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":35328,"new_prefill":1845,"score_linear":-35328.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":36149,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":37173,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-35328.0,"chosen_score_lmetric":0,"t_first_token":391469.890406325,"t_first_token_unix":1779822334.90435,"t_done":391471.493474734,"t_done_unix":1779822336.5074184},{"request_id":"1253804:41:1721979:1057","session_id":"1253804","input_length":105638,"t_proxy_recv":391478.464076075,"t_decision_unix":1779822343.4780173,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9984285957704614,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":166,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":102054,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":105472,"new_prefill":166,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":102054,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37438,"ongoing_decode_tokens":37438,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":105638,"score_linear":37438.0,"score_lmetric":105638},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":105638,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":391478.665209774,"t_first_token_unix":1779822343.6791532,"t_done":391479.310764292,"t_done_unix":1779822344.3247094},{"request_id":"1340290:14:1721731:1056","session_id":"1340290","input_length":37438,"t_proxy_recv":391477.588313013,"t_decision_unix":1779822342.6022544,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":37376,"affinity_cache_ratio":0.998343928628666,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":62,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":37376,"new_prefill":62,"score_linear":-37376.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":36414,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":37438,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":391477.673953898,"t_first_token_unix":1779822342.6878974,"t_done":391479.419655058,"t_done_unix":1779822344.4335988},{"request_id":"1253804:42:1724453:1058","session_id":"1253804","input_length":105715,"t_proxy_recv":391486.967027008,"t_decision_unix":1779822351.980968,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9977013668826562,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":243,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":102131,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":105472,"new_prefill":243,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":102131,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":105715,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":391487.112657937,"t_first_token_unix":1779822352.1266017,"t_done":391487.889043796,"t_done_unix":1779822352.9029875},{"request_id":"1253804:43:1726322:1060","session_id":"1253804","input_length":105845,"t_proxy_recv":391493.037733536,"t_decision_unix":1779822358.051675,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9964759790259341,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":373,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":102261,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":105472,"new_prefill":373,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":102261,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":105845,"score_linear":37724.0,"score_lmetric":105845},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":105845,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":391493.23518136,"t_first_token_unix":1779822358.249125,"t_done":391493.926160127,"t_done_unix":1779822358.940104},{"request_id":"1399948:58:1726693:1061","session_id":"1399948","input_length":46886,"t_proxy_recv":391494.258009853,"t_decision_unix":1779822359.2719502,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":46080,"affinity_cache_ratio":0.982809367401783,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46080,"estimated_new_tokens":806,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":46080,"new_prefill":806,"score_linear":-8356.0,"score_lmetric":806},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":46886,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8356.0,"chosen_score_lmetric":806,"t_first_token":391494.614762327,"t_first_token_unix":1779822359.6287074,"t_done":391494.804311535,"t_done_unix":1779822359.8182554},{"request_id":"1399948:59:1728305:1062","session_id":"1399948","input_length":46927,"t_proxy_recv":391499.550281066,"t_decision_unix":1779822364.5642219,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":46592,"affinity_cache_ratio":0.9928612525838004,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":335,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":46592,"new_prefill":335,"score_linear":-8868.0,"score_lmetric":335},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":46927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-8868.0,"chosen_score_lmetric":335,"t_first_token":391499.645767136,"t_first_token_unix":1779822364.659711,"t_done":391499.851466662,"t_done_unix":1779822364.8654099},{"request_id":"1253804:44:1728625:1063","session_id":"1253804","input_length":106070,"t_proxy_recv":391500.745224137,"t_decision_unix":1779822365.7591658,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105472,"affinity_cache_ratio":0.9943622136325069,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105472,"estimated_new_tokens":598,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":102486,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":105472,"new_prefill":598,"score_linear":-105472.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":102486,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":37724,"ongoing_decode_tokens":37724,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":106070,"score_linear":37724.0,"score_lmetric":106070},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":106070,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105472.0,"chosen_score_lmetric":0,"t_first_token":391501.093333579,"t_first_token_unix":1779822366.107277,"t_done":391502.102739541,"t_done_unix":1779822367.116683},{"request_id":"1340290:15:1725612:1059","session_id":"1340290","input_length":37724,"t_proxy_recv":391490.774549161,"t_decision_unix":1779822355.7884908,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":37376,"affinity_cache_ratio":0.9907751033824621,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":37376,"estimated_new_tokens":348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1719,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":37376,"new_prefill":348,"score_linear":-37376.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":36700,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":37724,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-37376.0,"chosen_score_lmetric":0,"t_first_token":391490.8511816,"t_first_token_unix":1779822355.8651252,"t_done":391508.680602103,"t_done_unix":1779822373.6945615},{"request_id":"1253804:45:1732408:1064","session_id":"1253804","input_length":106394,"t_proxy_recv":391513.708862583,"t_decision_unix":1779822378.722804,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9961463992330395,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":410,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":102810,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":105984,"new_prefill":410,"score_linear":-105984.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":102810,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":106394,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":391514.03208748,"t_first_token_unix":1779822379.0460315,"t_done":391514.403151445,"t_done_unix":1779822379.4170952},{"request_id":"1399948:60:1732843:1065","session_id":"1399948","input_length":47074,"t_proxy_recv":391515.302656383,"t_decision_unix":1779822380.3165977,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":46592,"affinity_cache_ratio":0.9897608021413095,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":46592,"estimated_new_tokens":482,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":46592,"new_prefill":482,"score_linear":-46592.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":47074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-46592.0,"chosen_score_lmetric":0,"t_first_token":391515.425753086,"t_first_token_unix":1779822380.4396966,"t_done":391515.794766312,"t_done_unix":1779822380.8087096},{"request_id":"1253804:46:1733935:1066","session_id":"1253804","input_length":106443,"t_proxy_recv":391518.801741955,"t_decision_unix":1779822383.8156826,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":105984,"affinity_cache_ratio":0.9956878329246639,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":105984,"estimated_new_tokens":459,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":102859,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1720,"cache_hit":105984,"new_prefill":459,"score_linear":-105984.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":102859,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":106443,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-105984.0,"chosen_score_lmetric":0,"t_first_token":391518.937230675,"t_first_token_unix":1779822383.9511745,"t_done":391519.645540449,"t_done_unix":1779822384.6594887},{"request_id":"1399948:61:1735933:1067","session_id":"1399948","input_length":47205,"t_proxy_recv":391525.499172339,"t_decision_unix":1779822390.5131135,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":47104,"affinity_cache_ratio":0.9978603961444762,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47104,"estimated_new_tokens":101,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":47104,"new_prefill":101,"score_linear":-47104.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":47205,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47104.0,"chosen_score_lmetric":0,"t_first_token":391525.601650696,"t_first_token_unix":1779822390.6155941,"t_done":391527.12566112,"t_done_unix":1779822392.1396043},{"request_id":"1253804:47:1736337:1068","session_id":"1253804","input_length":107137,"t_proxy_recv":391526.777040699,"t_decision_unix":1779822391.7909815,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":106496,"affinity_cache_ratio":0.994017006263009,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":106496,"estimated_new_tokens":641,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":103553,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1721,"cache_hit":106496,"new_prefill":641,"score_linear":-106496.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":103553,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":47205,"ongoing_decode_tokens":47205,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":107137,"score_linear":47205.0,"score_lmetric":107137},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":107137,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-106496.0,"chosen_score_lmetric":0,"t_first_token":391527.493118566,"t_first_token_unix":1779822392.5070622,"t_done":391527.906514797,"t_done_unix":1779822392.9204586},{"request_id":"1253804:48:1737694:1069","session_id":"1253804","input_length":108145,"t_proxy_recv":391531.212579532,"t_decision_unix":1779822396.2265205,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":107008,"affinity_cache_ratio":0.98948633778723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":107008,"estimated_new_tokens":1137,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":104561,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1722,"cache_hit":107008,"new_prefill":1137,"score_linear":-107008.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":104561,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":108145,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-107008.0,"chosen_score_lmetric":0,"t_first_token":391532.131055034,"t_first_token_unix":1779822397.144999,"t_done":391532.555051139,"t_done_unix":1779822397.5689952},{"request_id":"1253804:49:1739030:1070","session_id":"1253804","input_length":109454,"t_proxy_recv":391535.59852003,"t_decision_unix":1779822400.6124613,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":108032,"affinity_cache_ratio":0.9870082409048551,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":108032,"estimated_new_tokens":1422,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":105870,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1724,"cache_hit":108032,"new_prefill":1422,"score_linear":-108032.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":105870,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":109454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-108032.0,"chosen_score_lmetric":0,"t_first_token":391536.726723969,"t_first_token_unix":1779822401.740668,"t_done":391537.15413279,"t_done_unix":1779822402.1680765},{"request_id":"1253804:50:1741670:1071","session_id":"1253804","input_length":110854,"t_proxy_recv":391544.57940529,"t_decision_unix":1779822409.5933468,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":109056,"affinity_cache_ratio":0.9837804680029588,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":109056,"estimated_new_tokens":1798,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":107270,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1726,"cache_hit":109056,"new_prefill":1798,"score_linear":-109056.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":107270,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":110854,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-109056.0,"chosen_score_lmetric":0,"t_first_token":391545.726213182,"t_first_token_unix":1779822410.7401571,"t_done":391546.159731941,"t_done_unix":1779822411.173677},{"request_id":"1253804:51:1744514:1072","session_id":"1253804","input_length":111661,"t_proxy_recv":391554.003326307,"t_decision_unix":1779822419.0172677,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":110592,"affinity_cache_ratio":0.9904263798461415,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":110592,"estimated_new_tokens":1069,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":108077,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1729,"cache_hit":110592,"new_prefill":1069,"score_linear":-110592.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":108077,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":111661,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-110592.0,"chosen_score_lmetric":0,"t_first_token":391554.75426163,"t_first_token_unix":1779822419.7682056,"t_done":391555.183262614,"t_done_unix":1779822420.1972058},{"request_id":"1340290:16:1745847:1073","session_id":"1340290","input_length":40200,"t_proxy_recv":391558.613264878,"t_decision_unix":1779822423.6272063,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9934328358208955,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":264,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":39936,"new_prefill":264,"score_linear":-39936.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":39176,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40200,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":391558.688307146,"t_first_token_unix":1779822423.7022507,"t_done":391559.408021082,"t_done_unix":1779822424.421965},{"request_id":"1253804:52:1746191:1074","session_id":"1253804","input_length":111724,"t_proxy_recv":391559.643117077,"t_decision_unix":1779822424.6570585,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9990333321399162,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":108140,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":111616,"new_prefill":108,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":108140,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":111724,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":391559.793895417,"t_first_token_unix":1779822424.8078392,"t_done":391560.574740967,"t_done_unix":1779822425.5886846},{"request_id":"1253804:53:1748377:1075","session_id":"1253804","input_length":111811,"t_proxy_recv":391566.981831628,"t_decision_unix":1779822431.9957728,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9982559855470392,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":195,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":108227,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":111616,"new_prefill":195,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":108227,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":111811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":391567.133552171,"t_first_token_unix":1779822432.147496,"t_done":391567.621490597,"t_done_unix":1779822432.6354446},{"request_id":"1399948:62:1749028:1076","session_id":"1399948","input_length":48212,"t_proxy_recv":391569.141677705,"t_decision_unix":1779822434.1556191,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":47104,"affinity_cache_ratio":0.9770181697502697,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":47104,"estimated_new_tokens":1108,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":47104,"new_prefill":1108,"score_linear":-47104.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":48212,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-47104.0,"chosen_score_lmetric":0,"t_first_token":391569.503422885,"t_first_token_unix":1779822434.5173662,"t_done":391570.054114099,"t_done_unix":1779822435.0680575},{"request_id":"1253804:54:1750056:1077","session_id":"1253804","input_length":112074,"t_proxy_recv":391572.574710877,"t_decision_unix":1779822437.5886524,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9959134143512323,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":458,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":3584,"new_prefill":108490,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1731,"cache_hit":111616,"new_prefill":458,"score_linear":-111616.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":108490,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":112074,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":391572.913735908,"t_first_token_unix":1779822437.9276795,"t_done":391578.813669154,"t_done_unix":1779822443.8276126},{"request_id":"1399948:63:1753316:1079","session_id":"1399948","input_length":48636,"t_proxy_recv":391583.439246896,"t_decision_unix":1779822448.4531882,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9895550620939222,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":508,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":133552,"ongoing_decode_tokens":0,"pending_prefill_tokens":432,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":48636,"score_linear":133552.0,"score_lmetric":49068},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":48128,"new_prefill":508,"score_linear":-48128.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":48636,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":391583.70008968,"t_first_token_unix":1779822448.7140331,"t_done":391583.807280248,"t_done_unix":1779822448.8212235},{"request_id":"1399948:64:1754453:1080","session_id":"1399948","input_length":48693,"t_proxy_recv":391587.350719699,"t_decision_unix":1779822452.364661,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9989115478610888,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":53,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":133552,"ongoing_decode_tokens":133552,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":0,"new_prefill":48693,"score_linear":133552.0,"score_lmetric":48693},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1742,"cache_hit":48640,"new_prefill":53,"score_linear":-48640.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":48693,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48640.0,"chosen_score_lmetric":0,"t_first_token":391587.487687666,"t_first_token_unix":1779822452.501631,"t_done":391588.733204058,"t_done_unix":1779822453.7471507},{"request_id":"1356885:11:1753167:1078","session_id":"1356885","input_length":133552,"t_proxy_recv":391583.014505689,"t_decision_unix":1779822448.0284467,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":133120,"affinity_cache_ratio":0.9967653048999641,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":133120,"estimated_new_tokens":432,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1732,"cache_hit":133120,"new_prefill":432,"score_linear":-133120.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":132528,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":133552,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-133120.0,"chosen_score_lmetric":0,"t_first_token":391583.657821957,"t_first_token_unix":1779822448.671766,"t_done":391600.929593444,"t_done_unix":1779822465.9435375},{"request_id":"1399948:65:1759200:1081","session_id":"1399948","input_length":49220,"t_proxy_recv":391603.848697744,"t_decision_unix":1779822468.862639,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":48640,"affinity_cache_ratio":0.9882161722876879,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48640,"estimated_new_tokens":580,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1742,"cache_hit":48640,"new_prefill":580,"score_linear":-48640.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49220,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48640.0,"chosen_score_lmetric":0,"t_first_token":391604.115784086,"t_first_token_unix":1779822469.1297276,"t_done":391609.641978722,"t_done_unix":1779822474.6559222},{"request_id":"1277428:14:1767578:1082","session_id":"1277428","input_length":49716,"t_proxy_recv":391632.695619745,"t_decision_unix":1779822497.7095602,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9886555636012552,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":564,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2220,"cache_hit":49152,"new_prefill":564,"score_linear":-49152.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":45108,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":17408,"new_prefill":32308,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1744,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49716,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":391632.87215373,"t_first_token_unix":1779822497.8860972,"t_done":391633.904987816,"t_done_unix":1779822498.9189312},{"request_id":"1277428:14:1770237:1083","session_id":"1277428","input_length":49925,"t_proxy_recv":391642.05419581,"t_decision_unix":1779822507.068137,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.994772158237356,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":261,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2221,"cache_hit":49664,"new_prefill":261,"score_linear":-49664.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":45317,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":17408,"new_prefill":32517,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1744,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49925,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":391642.16467759,"t_first_token_unix":1779822507.178622,"t_done":391642.475126811,"t_done_unix":1779822507.4890702},{"request_id":"1277428:15:1771467:1084","session_id":"1277428","input_length":51398,"t_proxy_recv":391646.12437735,"t_decision_unix":1779822511.1383185,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9662632787267987,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":1734,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2221,"cache_hit":49664,"new_prefill":1734,"score_linear":-49664.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":46790,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":17408,"new_prefill":33990,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1744,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":51398,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":391646.704360625,"t_first_token_unix":1779822511.718304,"t_done":391650.173730263,"t_done_unix":1779822515.1876738},{"request_id":"1399948:66:1772336:1085","session_id":"1399948","input_length":51012,"t_proxy_recv":391649.074685229,"t_decision_unix":1779822514.0886261,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9735748451344781,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":1348,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":51398,"ongoing_decode_tokens":51398,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2221,"cache_hit":0,"new_prefill":51012,"score_linear":51398.0,"score_lmetric":51012},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1744,"cache_hit":49664,"new_prefill":1348,"score_linear":-49664.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":51012,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":391649.56418452,"t_first_token_unix":1779822514.5781283,"t_done":391652.490654529,"t_done_unix":1779822517.5045977},{"request_id":"1399948:67:1777074:1086","session_id":"1399948","input_length":52331,"t_proxy_recv":391665.145623615,"t_decision_unix":1779822530.1595647,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9783875714203818,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":1131,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1747,"cache_hit":51200,"new_prefill":1131,"score_linear":-51200.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":52331,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":391665.629389188,"t_first_token_unix":1779822530.6433332,"t_done":391669.920602064,"t_done_unix":1779822534.9346259},{"request_id":"1399948:68:1784799:1087","session_id":"1399948","input_length":53289,"t_proxy_recv":391691.636968525,"t_decision_unix":1779822556.6509097,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9896226238060387,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":553,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1750,"cache_hit":52736,"new_prefill":553,"score_linear":-52736.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":53289,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":391691.921271421,"t_first_token_unix":1779822556.935215,"t_done":391696.200533301,"t_done_unix":1779822561.2144785},{"request_id":"1277428:16:1787662:1088","session_id":"1277428","input_length":52754,"t_proxy_recv":391702.07745916,"t_decision_unix":1779822567.0914001,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":51712,"affinity_cache_ratio":0.9802479432839216,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51712,"estimated_new_tokens":1042,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2225,"cache_hit":51712,"new_prefill":1042,"score_linear":-51712.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":48146,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":17408,"new_prefill":35346,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1752,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":52754,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51712.0,"chosen_score_lmetric":0,"t_first_token":391702.474932192,"t_first_token_unix":1779822567.488877,"t_done":391703.064840045,"t_done_unix":1779822568.0787842},{"request_id":"1305906:5:1788459:1089","session_id":"1305906","input_length":52461,"t_proxy_recv":391704.61611188,"t_decision_unix":1779822569.6300526,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":49664,"affinity_cache_ratio":0.946684203503555,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":2797,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2227,"cache_hit":49664,"new_prefill":2797,"score_linear":-49664.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1752,"cache_hit":16896,"new_prefill":35565,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":52461,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":391705.600920475,"t_first_token_unix":1779822570.614864,"t_done":391706.102936334,"t_done_unix":1779822571.1168797},{"request_id":"1399948:69:1790968:1090","session_id":"1399948","input_length":54141,"t_proxy_recv":391713.209307228,"t_decision_unix":1779822578.2232487,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9929628193051476,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":381,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":51255,"ongoing_decode_tokens":51255,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2232,"cache_hit":0,"new_prefill":54141,"score_linear":51255.0,"score_lmetric":54141},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1752,"cache_hit":53760,"new_prefill":381,"score_linear":-53760.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54141,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":391713.493877122,"t_first_token_unix":1779822578.5078204,"t_done":391717.354286915,"t_done_unix":1779822582.3682306},{"request_id":"1305906:6:1529600:945","session_id":"1305906","input_length":51255,"t_proxy_recv":391706.112788511,"t_decision_unix":1779822571.12673,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":51200,"affinity_cache_ratio":0.9989269339576626,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":51200,"estimated_new_tokens":55,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2232,"cache_hit":51200,"new_prefill":55,"score_linear":-51200.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1752,"cache_hit":16896,"new_prefill":34359,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":51255,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-51200.0,"chosen_score_lmetric":0,"t_first_token":391706.186222198,"t_first_token_unix":1779822571.2001657,"t_done":391721.046377822,"t_done_unix":1779822586.060324},{"request_id":"1277428:17:1793546:1091","session_id":"1277428","input_length":53574,"t_proxy_recv":391722.211313067,"t_decision_unix":1779822587.2252543,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9843580841452944,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":838,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2233,"cache_hit":52736,"new_prefill":838,"score_linear":-52736.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":48966,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":17408,"new_prefill":36166,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":53574,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":391722.602397204,"t_first_token_unix":1779822587.6163406,"t_done":391723.90906695,"t_done_unix":1779822588.9230106},{"request_id":"1399948:70:1795589:1092","session_id":"1399948","input_length":54654,"t_proxy_recv":391729.532826317,"t_decision_unix":1779822594.5467677,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9930105756211806,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":382,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":54272,"new_prefill":382,"score_linear":-54272.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54654,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":391729.621874837,"t_first_token_unix":1779822594.6358182,"t_done":391730.548442289,"t_done_unix":1779822595.5623856},{"request_id":"1277428:18:1796824:1093","session_id":"1277428","input_length":53805,"t_proxy_recv":391734.12865272,"t_decision_unix":1779822599.1425934,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":53248,"affinity_cache_ratio":0.9896478022488616,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53248,"estimated_new_tokens":557,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2234,"cache_hit":53248,"new_prefill":557,"score_linear":-53248.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":49197,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":17408,"new_prefill":36397,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":53805,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53248.0,"chosen_score_lmetric":0,"t_first_token":391734.258078179,"t_first_token_unix":1779822599.2720218,"t_done":391734.629087776,"t_done_unix":1779822599.6430311},{"request_id":"1399948:71:1800797:1094","session_id":"1399948","input_length":54920,"t_proxy_recv":391747.717385032,"t_decision_unix":1779822612.7313266,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9882010196649672,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":648,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1753,"cache_hit":54272,"new_prefill":648,"score_linear":-54272.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54920,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":391747.899537195,"t_first_token_unix":1779822612.9134808,"t_done":391749.958804076,"t_done_unix":1779822614.972748},{"request_id":"1399948:72:1804699:1097","session_id":"1399948","input_length":55246,"t_proxy_recv":391761.168353653,"t_decision_unix":1779822626.182295,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9916374036129313,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":462,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":55246,"score_linear":112634.0,"score_lmetric":55246},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":55246,"score_linear":111736.0,"score_lmetric":55246},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1754,"cache_hit":54784,"new_prefill":462,"score_linear":-54784.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":55246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":391761.296954801,"t_first_token_unix":1779822626.310898,"t_done":391761.682405584,"t_done_unix":1779822626.696349},{"request_id":"1399948:73:1805981:1098","session_id":"1399948","input_length":55559,"t_proxy_recv":391765.351264509,"t_decision_unix":1779822630.365206,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9952662934898037,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":263,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":55559,"score_linear":112634.0,"score_lmetric":55559},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":55559,"score_linear":111736.0,"score_lmetric":55559},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":55296,"new_prefill":263,"score_linear":-55296.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":55559,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":391765.544148277,"t_first_token_unix":1779822630.5580924,"t_done":391766.825742954,"t_done_unix":1779822631.8396866},{"request_id":"1305906:6:1806419:1099","session_id":"1305906","input_length":52932,"t_proxy_recv":391766.860555786,"t_decision_unix":1779822631.874497,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9962971359480087,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":196,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":52736,"new_prefill":196,"score_linear":-52736.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":52932,"score_linear":112634.0,"score_lmetric":52932},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":52932,"score_linear":111736.0,"score_lmetric":52932},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":16896,"new_prefill":36036,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":52932,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":391766.937939003,"t_first_token_unix":1779822631.9518826,"t_done":391767.641777355,"t_done_unix":1779822632.6557238},{"request_id":"1305906:7:1572780:964","session_id":"1305906","input_length":54789,"t_proxy_recv":391767.667531689,"t_decision_unix":1779822632.6814733,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":52736,"affinity_cache_ratio":0.9625289747942105,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":52736,"estimated_new_tokens":2053,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":52736,"new_prefill":2053,"score_linear":-52736.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":54789,"score_linear":112634.0,"score_lmetric":54789},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":54789,"score_linear":111736.0,"score_lmetric":54789},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":16896,"new_prefill":37893,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54789,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-52736.0,"chosen_score_lmetric":0,"t_first_token":391768.383655364,"t_first_token_unix":1779822633.397599,"t_done":391768.681504546,"t_done_unix":1779822633.6954484},{"request_id":"1399948:74:1808473:1100","session_id":"1399948","input_length":55791,"t_proxy_recv":391774.052237289,"t_decision_unix":1779822639.0661786,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9911276012260042,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":495,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2239,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":55791,"score_linear":112634.0,"score_lmetric":55791},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":111736,"ongoing_decode_tokens":111736,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":0,"new_prefill":55791,"score_linear":111736.0,"score_lmetric":55791},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1755,"cache_hit":55296,"new_prefill":495,"score_linear":-55296.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":55791,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":391774.182977359,"t_first_token_unix":1779822639.1969206,"t_done":391776.044024804,"t_done_unix":1779822641.0579689},{"request_id":"1270606:6:1804345:1096","session_id":"1270606","input_length":111736,"t_proxy_recv":391760.012292685,"t_decision_unix":1779822625.0262337,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":111616,"affinity_cache_ratio":0.9989260399513138,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":111616,"estimated_new_tokens":120,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":111736,"score_linear":112634.0,"score_lmetric":111736},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":111616,"new_prefill":120,"score_linear":-111616.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1754,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":111736,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":110200,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-111616.0,"chosen_score_lmetric":0,"t_first_token":391760.292759428,"t_first_token_unix":1779822625.3067026,"t_done":391802.457592953,"t_done_unix":1779822667.4715397},{"request_id":"1399948:75:1817312:1101","session_id":"1399948","input_length":57308,"t_proxy_recv":391802.587755108,"t_decision_unix":1779822667.6016965,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9738256438891604,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":1500,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2239,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":57308,"score_linear":112634.0,"score_lmetric":57308},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1756,"cache_hit":55808,"new_prefill":1500,"score_linear":-55808.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":57308,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":391803.216402672,"t_first_token_unix":1779822668.230346,"t_done":391804.044349535,"t_done_unix":1779822669.0582926},{"request_id":"1399948:76:1821495:1102","session_id":"1399948","input_length":57659,"t_proxy_recv":391816.24485277,"t_decision_unix":1779822681.2587938,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9945368459390554,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2239,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":57659,"score_linear":112634.0,"score_lmetric":57659},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":57344,"new_prefill":315,"score_linear":-57344.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":57659,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":391816.440991069,"t_first_token_unix":1779822681.4549348,"t_done":391817.09471599,"t_done_unix":1779822682.1086612},{"request_id":"1270606:6:1822681:1103","session_id":"1270606","input_length":112180,"t_proxy_recv":391820.089299837,"t_decision_unix":1779822685.103241,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9995364592619005,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":52,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2239,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":112180,"score_linear":112634.0,"score_lmetric":112180},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":112128,"new_prefill":52,"score_linear":-112128.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":112180,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":110644,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":391820.234737075,"t_first_token_unix":1779822685.2486806,"t_done":391821.1131281,"t_done_unix":1779822686.1270726},{"request_id":"1270606:7:1825806:1104","session_id":"1270606","input_length":112645,"t_proxy_recv":391830.704223795,"t_decision_unix":1779822695.718165,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9954103599804697,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":517,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2239,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":112645,"score_linear":112634.0,"score_lmetric":112645},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2302,"cache_hit":112128,"new_prefill":517,"score_linear":-112128.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":112645,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":111109,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":391831.254742819,"t_first_token_unix":1779822696.2686863,"t_done":391835.276561655,"t_done_unix":1779822700.2905087},{"request_id":"1277428:19:1834491:1105","session_id":"1277428","input_length":58474,"t_proxy_recv":391859.972197559,"t_decision_unix":1779822724.9861386,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9193829736293053,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":4714,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2239,"cache_hit":53760,"new_prefill":4714,"score_linear":-53760.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":4608,"new_prefill":53866,"score_linear":108026.0,"score_lmetric":53866},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":17408,"new_prefill":41066,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58474,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":391861.70326046,"t_first_token_unix":1779822726.7172058,"t_done":391862.035058195,"t_done_unix":1779822727.0490055},{"request_id":"1270606:8:1837578:1106","session_id":"1270606","input_length":113482,"t_proxy_recv":391870.804078987,"t_decision_unix":1779822735.8180199,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":112640,"affinity_cache_ratio":0.9925803211081934,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":842,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112634,"ongoing_decode_tokens":112634,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":0,"new_prefill":113482,"score_linear":112634.0,"score_lmetric":113482},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2303,"cache_hit":112640,"new_prefill":842,"score_linear":-112640.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":113482,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":111946,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":391871.365179675,"t_first_token_unix":1779822736.3791232,"t_done":391871.793418687,"t_done_unix":1779822736.807362},{"request_id":"1253804:55:1803044:1095","session_id":"1253804","input_length":112634,"t_proxy_recv":391755.593592974,"t_decision_unix":1779822620.6075342,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":112128,"affinity_cache_ratio":0.9955075732016976,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112128,"estimated_new_tokens":506,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2235,"cache_hit":3584,"new_prefill":109050,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1734,"cache_hit":112128,"new_prefill":506,"score_linear":-112128.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2300,"cache_hit":3584,"new_prefill":109050,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1754,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":112634,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-112128.0,"chosen_score_lmetric":0,"t_first_token":391755.761716893,"t_first_token_unix":1779822620.7756603,"t_done":391879.605766857,"t_done_unix":1779822744.6197133},{"request_id":"1270606:9:1847569:1107","session_id":"1270606","input_length":116467,"t_proxy_recv":391904.708661139,"t_decision_unix":1779822769.7226026,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":113152,"affinity_cache_ratio":0.9715370018975332,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":113152,"estimated_new_tokens":3315,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2304,"cache_hit":113152,"new_prefill":3315,"score_linear":-113152.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":116467,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":114931,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-113152.0,"chosen_score_lmetric":0,"t_first_token":391906.961252252,"t_first_token_unix":1779822771.9751964,"t_done":391908.484395913,"t_done_unix":1779822773.498344},{"request_id":"1270606:10:1851128:1108","session_id":"1270606","input_length":116659,"t_proxy_recv":391916.788876704,"t_decision_unix":1779822781.802818,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9962711835349181,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":116224,"new_prefill":435,"score_linear":-116224.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":116659,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":115123,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-116224.0,"chosen_score_lmetric":0,"t_first_token":391917.039726813,"t_first_token_unix":1779822782.0536702,"t_done":391917.789859213,"t_done_unix":1779822782.8038032},{"request_id":"1305906:7:1851943:1109","session_id":"1305906","input_length":58042,"t_proxy_recv":391919.335902247,"t_decision_unix":1779822784.3498428,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9438682333482651,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":3258,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2248,"cache_hit":54784,"new_prefill":3258,"score_linear":-54784.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":16896,"new_prefill":41146,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58042,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":391920.630820639,"t_first_token_unix":1779822785.6447644,"t_done":391922.868862915,"t_done_unix":1779822787.8828068},{"request_id":"1305906:8:1866131:1110","session_id":"1305906","input_length":58687,"t_proxy_recv":391967.796524329,"t_decision_unix":1779822832.8104637,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9858401349532264,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":831,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2254,"cache_hit":57856,"new_prefill":831,"score_linear":-57856.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":16896,"new_prefill":41791,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58687,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":391968.107777041,"t_first_token_unix":1779822833.121721,"t_done":391969.976368279,"t_done_unix":1779822834.9903119},{"request_id":"1270606:11:1868274:1111","session_id":"1270606","input_length":117828,"t_proxy_recv":391975.075044999,"t_decision_unix":1779822840.0889862,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":116224,"affinity_cache_ratio":0.9863869368910615,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":116224,"estimated_new_tokens":1604,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2310,"cache_hit":116224,"new_prefill":1604,"score_linear":-116224.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":117828,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":116292,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-116224.0,"chosen_score_lmetric":0,"t_first_token":391976.08015366,"t_first_token_unix":1779822841.0940976,"t_done":391977.805972891,"t_done_unix":1779822842.8199165},{"request_id":"1270606:11:1870810:1113","session_id":"1270606","input_length":118012,"t_proxy_recv":391983.572311723,"t_decision_unix":1779822848.5862527,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9978646239365488,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":252,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":118012,"score_linear":112926.0,"score_lmetric":118012},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":117760,"new_prefill":252,"score_linear":-117760.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":118012,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":116476,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":391983.765336713,"t_first_token_unix":1779822848.77928,"t_done":391984.257066703,"t_done_unix":1779822849.2710102},{"request_id":"1356885:12:1874205:1114","session_id":"1356885","input_length":135435,"t_proxy_recv":391995.040653607,"t_decision_unix":1779822860.0545945,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":134656,"affinity_cache_ratio":0.9942481633255805,"affinity_num_requests":1,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":134656,"estimated_new_tokens":779,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":134656,"new_prefill":779,"score_linear":-21730.0,"score_lmetric":779},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":134411,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":135435,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-21730.0,"chosen_score_lmetric":779,"t_first_token":391995.70569088,"t_first_token_unix":1779822860.7196345,"t_done":391999.629068512,"t_done_unix":1779822864.6430187},{"request_id":"1340290:17:1875101:1115","session_id":"1340290","input_length":40328,"t_proxy_recv":391997.967295805,"t_decision_unix":1779822862.9812367,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":39936,"affinity_cache_ratio":0.9902797064074589,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":39936,"estimated_new_tokens":392,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":248361,"ongoing_decode_tokens":248361,"pending_prefill_tokens":0,"num_requests":2,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":0,"new_prefill":40328,"score_linear":248361.0,"score_lmetric":80656},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":39936,"new_prefill":392,"score_linear":-39936.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":39304,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40328,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-39936.0,"chosen_score_lmetric":0,"t_first_token":391998.041769746,"t_first_token_unix":1779822863.0557132,"t_done":392001.127944302,"t_done_unix":1779822866.1418877},{"request_id":"1270606:12:1876851:1116","session_id":"1270606","input_length":118600,"t_proxy_recv":392003.933124891,"t_decision_unix":1779822868.9470663,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":117760,"affinity_cache_ratio":0.9929173693086003,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":117760,"estimated_new_tokens":840,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":118600,"score_linear":112926.0,"score_lmetric":118600},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":117760,"new_prefill":840,"score_linear":-117760.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":118600,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":117064,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-117760.0,"chosen_score_lmetric":0,"t_first_token":392004.521168969,"t_first_token_unix":1779822869.5351121,"t_done":392006.672193782,"t_done_unix":1779822871.6861377},{"request_id":"1340290:18:1878955:1117","session_id":"1340290","input_length":40583,"t_proxy_recv":392011.644953453,"t_decision_unix":1779822876.6588936,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9966734839711209,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":135,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":40583,"score_linear":112926.0,"score_lmetric":40583},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2315,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":40448,"new_prefill":135,"score_linear":-40448.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":39559,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40583,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":392011.705944262,"t_first_token_unix":1779822876.7198877,"t_done":392011.91708348,"t_done_unix":1779822876.9310267},{"request_id":"1340290:19:1880565:1118","session_id":"1340290","input_length":40676,"t_proxy_recv":392016.917359404,"t_decision_unix":1779822881.9313009,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9943947290785722,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":228,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":40676,"score_linear":112926.0,"score_lmetric":40676},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2315,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":40448,"new_prefill":228,"score_linear":-40448.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":39652,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40676,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":392017.018519036,"t_first_token_unix":1779822882.0324626,"t_done":392017.572644767,"t_done_unix":1779822882.5865886},{"request_id":"1340290:20:1882251:1120","session_id":"1340290","input_length":40883,"t_proxy_recv":392022.725195939,"t_decision_unix":1779822887.7391372,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40448,"affinity_cache_ratio":0.9893598806349827,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":435,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":40883,"score_linear":112926.0,"score_lmetric":40883},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119030,"ongoing_decode_tokens":119030,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2315,"cache_hit":0,"new_prefill":40883,"score_linear":119030.0,"score_lmetric":40883},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":40448,"new_prefill":435,"score_linear":-40448.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":39859,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":40883,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":392022.833754248,"t_first_token_unix":1779822887.847698,"t_done":392023.157364529,"t_done_unix":1779822888.1713142},{"request_id":"1270606:12:1881189:1119","session_id":"1270606","input_length":119030,"t_proxy_recv":392019.32855138,"t_decision_unix":1779822884.3424923,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":118784,"affinity_cache_ratio":0.9979332941275308,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":118784,"estimated_new_tokens":246,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":119030,"score_linear":112926.0,"score_lmetric":119030},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2315,"cache_hit":118784,"new_prefill":246,"score_linear":-118784.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":119030,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":117494,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-118784.0,"chosen_score_lmetric":0,"t_first_token":392019.696149458,"t_first_token_unix":1779822884.7100937,"t_done":392023.700078962,"t_done_unix":1779822888.714023},{"request_id":"1340290:21:1883855:1121","session_id":"1340290","input_length":41002,"t_proxy_recv":392028.194682858,"t_decision_unix":1779822893.2086234,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40448,"affinity_cache_ratio":0.986488463977367,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40448,"estimated_new_tokens":554,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":41002,"score_linear":112926.0,"score_lmetric":41002},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1760,"cache_hit":40448,"new_prefill":554,"score_linear":-40448.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":39978,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":41002,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40448.0,"chosen_score_lmetric":0,"t_first_token":392028.300578814,"t_first_token_unix":1779822893.314522,"t_done":392028.551429217,"t_done_unix":1779822893.5653727},{"request_id":"1340290:22:1884847:1122","session_id":"1340290","input_length":41909,"t_proxy_recv":392031.666743621,"t_decision_unix":1779822896.6806848,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":40960,"affinity_cache_ratio":0.9773556992531437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":40960,"estimated_new_tokens":949,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":41909,"score_linear":112926.0,"score_lmetric":41909},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1761,"cache_hit":40960,"new_prefill":949,"score_linear":-40960.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":40885,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":41909,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-40960.0,"chosen_score_lmetric":0,"t_first_token":392031.995089456,"t_first_token_unix":1779822897.009033,"t_done":392032.332251699,"t_done_unix":1779822897.346195},{"request_id":"1253804:55:1869941:1112","session_id":"1253804","input_length":112926,"t_proxy_recv":391980.706229384,"t_decision_unix":1779822845.7201707,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":112640,"affinity_cache_ratio":0.9974673680109098,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":112640,"estimated_new_tokens":286,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":3584,"new_prefill":109342,"score_linear":-3584.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1735,"cache_hit":112640,"new_prefill":286,"score_linear":-112640.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2313,"cache_hit":3584,"new_prefill":109342,"score_linear":-3584.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1759,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":112926,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-112640.0,"chosen_score_lmetric":0,"t_first_token":391980.848212305,"t_first_token_unix":1779822845.862156,"t_done":392035.523598771,"t_done_unix":1779822900.5375426},{"request_id":"1340290:23:1886013:1124","session_id":"1340290","input_length":42086,"t_proxy_recv":392035.695248965,"t_decision_unix":1779822900.7091906,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41472,"affinity_cache_ratio":0.9854108254526446,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41472,"estimated_new_tokens":614,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":63845,"ongoing_decode_tokens":0,"pending_prefill_tokens":5477,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":42086,"score_linear":63845.0,"score_lmetric":47563},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1762,"cache_hit":41472,"new_prefill":614,"score_linear":-41472.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":41062,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":42086,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41472.0,"chosen_score_lmetric":0,"t_first_token":392035.805141524,"t_first_token_unix":1779822900.819085,"t_done":392036.098378161,"t_done_unix":1779822901.1123219},{"request_id":"1270606:12:1886765:1125","session_id":"1270606","input_length":119440,"t_proxy_recv":392038.441893492,"t_decision_unix":1779822903.4558346,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9987943737441393,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":144,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":119440,"score_linear":63845.0,"score_lmetric":119440},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":119296,"new_prefill":144,"score_linear":-119296.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1763,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":119440,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":117904,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":392038.677807735,"t_first_token_unix":1779822903.6917515,"t_done":392039.723893563,"t_done_unix":1779822904.737837},{"request_id":"1340290:24:1887125:1126","session_id":"1340290","input_length":42199,"t_proxy_recv":392039.477771107,"t_decision_unix":1779822904.4917123,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9949050925377378,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":215,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":42199,"score_linear":63845.0,"score_lmetric":42199},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119440,"ongoing_decode_tokens":119440,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":42199,"score_linear":119440.0,"score_lmetric":42199},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1763,"cache_hit":41984,"new_prefill":215,"score_linear":-41984.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":41175,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":42199,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":392039.587175147,"t_first_token_unix":1779822904.6011186,"t_done":392039.757560938,"t_done_unix":1779822904.771504},{"request_id":"1340290:25:1888447:1127","session_id":"1340290","input_length":42444,"t_proxy_recv":392043.866367179,"t_decision_unix":1779822908.8803082,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41984,"affinity_cache_ratio":0.9891621901800018,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":460,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":63845,"ongoing_decode_tokens":63845,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":0,"new_prefill":42444,"score_linear":63845.0,"score_lmetric":42444},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1763,"cache_hit":41984,"new_prefill":460,"score_linear":-41984.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":41420,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":42444,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":392044.020031037,"t_first_token_unix":1779822909.0339744,"t_done":392044.320635358,"t_done_unix":1779822909.3345785},{"request_id":"1277428:20:1885419:1123","session_id":"1277428","input_length":63845,"t_proxy_recv":392033.583790585,"t_decision_unix":1779822898.5977318,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9142141123032343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":5477,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2256,"cache_hit":58368,"new_prefill":5477,"score_linear":-58368.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":112926,"ongoing_decode_tokens":112926,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":4608,"new_prefill":59237,"score_linear":108318.0,"score_lmetric":59237},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":17408,"new_prefill":46437,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1762,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":63845,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":392035.787238027,"t_first_token_unix":1779822900.8011816,"t_done":392045.856052211,"t_done_unix":1779822910.869998},{"request_id":"1340290:26:1889402:1128","session_id":"1340290","input_length":48504,"t_proxy_recv":392047.186208742,"t_decision_unix":1779822912.20015,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":41984,"affinity_cache_ratio":0.8655780966518225,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":41984,"estimated_new_tokens":6520,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1763,"cache_hit":41984,"new_prefill":6520,"score_linear":-41984.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":47480,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":48504,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-41984.0,"chosen_score_lmetric":0,"t_first_token":392049.07170352,"t_first_token_unix":1779822914.0856476,"t_done":392049.277686841,"t_done_unix":1779822914.29163},{"request_id":"1270606:13:1890252:1129","session_id":"1270606","input_length":119686,"t_proxy_recv":392050.168550749,"t_decision_unix":1779822915.182492,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9967414735223836,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":390,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":119296,"new_prefill":390,"score_linear":-119296.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":119686,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":118150,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":392050.532025393,"t_first_token_unix":1779822915.5459692,"t_done":392051.450640941,"t_done_unix":1779822916.4645846},{"request_id":"1340290:27:1892591:1131","session_id":"1340290","input_length":49361,"t_proxy_recv":392057.773334216,"t_decision_unix":1779822922.7872756,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":48128,"affinity_cache_ratio":0.9750207653815766,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":48128,"estimated_new_tokens":1233,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":119828,"ongoing_decode_tokens":119828,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":0,"new_prefill":49361,"score_linear":119828.0,"score_lmetric":49361},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":48128,"new_prefill":1233,"score_linear":-48128.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":48337,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49361,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-48128.0,"chosen_score_lmetric":0,"t_first_token":392058.14498645,"t_first_token_unix":1779822923.1589298,"t_done":392058.466755496,"t_done_unix":1779822923.4806986},{"request_id":"1270606:14:1892412:1130","session_id":"1270606","input_length":119828,"t_proxy_recv":392057.114740255,"t_decision_unix":1779822922.1286814,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":119296,"affinity_cache_ratio":0.9955603031011115,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119296,"estimated_new_tokens":532,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2316,"cache_hit":119296,"new_prefill":532,"score_linear":-119296.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1775,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":119828,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":118292,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119296.0,"chosen_score_lmetric":0,"t_first_token":392057.370184491,"t_first_token_unix":1779822922.3841279,"t_done":392059.324131174,"t_done_unix":1779822924.3380752},{"request_id":"1340290:28:1893837:1132","session_id":"1340290","input_length":49454,"t_proxy_recv":392062.08221561,"t_decision_unix":1779822927.0961566,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9938933149997978,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":302,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":49152,"new_prefill":302,"score_linear":-49152.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":48430,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":392062.191522733,"t_first_token_unix":1779822927.2054665,"t_done":392062.443418581,"t_done_unix":1779822927.457362},{"request_id":"1305906:9:1893880:1133","session_id":"1305906","input_length":59265,"t_proxy_recv":392062.271915596,"t_decision_unix":1779822927.285857,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9935037543237999,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":385,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":58880,"new_prefill":385,"score_linear":-58880.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":49454,"ongoing_decode_tokens":49454,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":16896,"new_prefill":42369,"score_linear":32558.0,"score_lmetric":42369},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":59265,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":392062.580863447,"t_first_token_unix":1779822927.5948071,"t_done":392063.190317414,"t_done_unix":1779822928.2042608},{"request_id":"1270606:15:1895310:1134","session_id":"1270606","input_length":120058,"t_proxy_recv":392066.936187314,"t_decision_unix":1779822931.9501288,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":119808,"affinity_cache_ratio":0.9979176731246564,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119808,"estimated_new_tokens":250,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":135905,"ongoing_decode_tokens":0,"pending_prefill_tokens":737,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":120058,"score_linear":135905.0,"score_lmetric":120795},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":119808,"new_prefill":250,"score_linear":-119808.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":120058,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":118522,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119808.0,"chosen_score_lmetric":0,"t_first_token":392067.170768654,"t_first_token_unix":1779822932.1847122,"t_done":392068.147218456,"t_done_unix":1779822933.161163},{"request_id":"1340290:29:1896119:1136","session_id":"1340290","input_length":49576,"t_proxy_recv":392069.40590679,"t_decision_unix":1779822934.419848,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9914474745844764,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":424,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":135905,"ongoing_decode_tokens":135905,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":0,"new_prefill":49576,"score_linear":135905.0,"score_lmetric":49576},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":49152,"new_prefill":424,"score_linear":-49152.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":48552,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49576,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":392069.513997401,"t_first_token_unix":1779822934.5279408,"t_done":392069.76371735,"t_done_unix":1779822934.7776604},{"request_id":"1356885:13:1895311:1135","session_id":"1356885","input_length":135905,"t_proxy_recv":392066.917296828,"t_decision_unix":1779822931.9312382,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":135168,"affinity_cache_ratio":0.9945770942938081,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":135168,"estimated_new_tokens":737,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1736,"cache_hit":135168,"new_prefill":737,"score_linear":-135168.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":134881,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":135905,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-135168.0,"chosen_score_lmetric":0,"t_first_token":392067.376077046,"t_first_token_unix":1779822932.3900201,"t_done":392069.78353716,"t_done_unix":1779822934.7974808},{"request_id":"1340290:30:1896991:1137","session_id":"1340290","input_length":49695,"t_proxy_recv":392072.381625083,"t_decision_unix":1779822937.395566,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49152,"affinity_cache_ratio":0.9890733474192575,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49152,"estimated_new_tokens":543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1777,"cache_hit":49152,"new_prefill":543,"score_linear":-49152.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":48671,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49695,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49152.0,"chosen_score_lmetric":0,"t_first_token":392072.493954346,"t_first_token_unix":1779822937.507898,"t_done":392073.987347367,"t_done_unix":1779822939.0012908},{"request_id":"1340290:31:1899492:1138","session_id":"1340290","input_length":49927,"t_proxy_recv":392080.764397383,"t_decision_unix":1779822945.7783387,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9947323091713902,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":263,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1778,"cache_hit":49664,"new_prefill":263,"score_linear":-49664.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":48903,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":49927,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":392080.856626905,"t_first_token_unix":1779822945.8705707,"t_done":392081.51007461,"t_done_unix":1779822946.5240178},{"request_id":"1270606:16:1902252:1140","session_id":"1270606","input_length":120572,"t_proxy_recv":392089.407647297,"t_decision_unix":1779822954.4215884,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":119808,"affinity_cache_ratio":0.9936635371396344,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":119808,"estimated_new_tokens":764,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":119808,"new_prefill":764,"score_linear":-119808.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50078,"ongoing_decode_tokens":50078,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1778,"cache_hit":0,"new_prefill":120572,"score_linear":50078.0,"score_lmetric":120572},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":120572,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":119036,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-119808.0,"chosen_score_lmetric":0,"t_first_token":392089.99319496,"t_first_token_unix":1779822955.0071383,"t_done":392090.946173827,"t_done_unix":1779822955.9601173},{"request_id":"1270606:17:1908800:1141","session_id":"1270606","input_length":121006,"t_proxy_recv":392110.86120052,"t_decision_unix":1779822975.8751416,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":120320,"affinity_cache_ratio":0.9943308596267953,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":120320,"estimated_new_tokens":686,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2318,"cache_hit":120320,"new_prefill":686,"score_linear":-120320.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":50078,"ongoing_decode_tokens":50078,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1778,"cache_hit":0,"new_prefill":121006,"score_linear":50078.0,"score_lmetric":121006},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":121006,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":119470,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-120320.0,"chosen_score_lmetric":0,"t_first_token":392111.44666487,"t_first_token_unix":1779822976.4606085,"t_done":392112.061234154,"t_done_unix":1779822977.0751824},{"request_id":"1340290:32:1901260:1139","session_id":"1340290","input_length":50078,"t_proxy_recv":392086.176115266,"t_decision_unix":1779822951.1900566,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":49664,"affinity_cache_ratio":0.9917328966811774,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":49664,"estimated_new_tokens":414,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2317,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1778,"cache_hit":49664,"new_prefill":414,"score_linear":-49664.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":49054,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":50078,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-49664.0,"chosen_score_lmetric":0,"t_first_token":392086.298437413,"t_first_token_unix":1779822951.312381,"t_done":392116.614036289,"t_done_unix":1779822981.6279798},{"request_id":"1270606:18:1915824:1142","session_id":"1270606","input_length":121288,"t_proxy_recv":392133.841986699,"t_decision_unix":1779822998.8559282,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":120832,"affinity_cache_ratio":0.9962403535386848,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":120832,"estimated_new_tokens":456,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2319,"cache_hit":120832,"new_prefill":456,"score_linear":-120832.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":121288,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":119752,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-120832.0,"chosen_score_lmetric":0,"t_first_token":392134.216710381,"t_first_token_unix":1779822999.2306542,"t_done":392135.082688977,"t_done_unix":1779823000.0966325},{"request_id":"1270606:19:1920499:1143","session_id":"1270606","input_length":121560,"t_proxy_recv":392148.99391521,"t_decision_unix":1779823014.0078564,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":121344,"affinity_cache_ratio":0.9982230997038499,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":121344,"estimated_new_tokens":216,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":121344,"new_prefill":216,"score_linear":-121344.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":121560,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":120024,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-121344.0,"chosen_score_lmetric":0,"t_first_token":392149.367759727,"t_first_token_unix":1779823014.3817034,"t_done":392150.341620229,"t_done_unix":1779823015.3555672},{"request_id":"1270606:20:1922639:1144","session_id":"1270606","input_length":121704,"t_proxy_recv":392156.433684303,"t_decision_unix":1779823021.4476254,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":121344,"affinity_cache_ratio":0.9970420035495957,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":121344,"estimated_new_tokens":360,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":121344,"new_prefill":360,"score_linear":-121344.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":121704,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":1536,"new_prefill":120168,"score_linear":-1536.0,"score_lmetric":0}],"chosen_score_linear":-121344.0,"chosen_score_lmetric":0,"t_first_token":392156.669590466,"t_first_token_unix":1779823021.6835341,"t_done":392157.981020768,"t_done_unix":1779823022.9949644},{"request_id":"1305906:10:1928316:1145","session_id":"1305906","input_length":61801,"t_proxy_recv":392174.995889258,"t_decision_unix":1779823040.0098302,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9527353926311872,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":2921,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2268,"cache_hit":58880,"new_prefill":2921,"score_linear":-58880.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":16896,"new_prefill":44905,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":61801,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":392176.031546598,"t_first_token_unix":1779823041.0454905,"t_done":392176.383874847,"t_done_unix":1779823041.3978183},{"request_id":"1340290:33:1939781:1146","session_id":"1340290","input_length":53990,"t_proxy_recv":392212.755944734,"t_decision_unix":1779823077.769886,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":53760,"affinity_cache_ratio":0.9957399518429338,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":230,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":53760,"new_prefill":230,"score_linear":-53760.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":52966,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":53990,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":392212.852881047,"t_first_token_unix":1779823077.8668244,"t_done":392213.938075212,"t_done_unix":1779823078.952019},{"request_id":"1340290:34:1942249:1147","session_id":"1340290","input_length":54164,"t_proxy_recv":392220.596304784,"t_decision_unix":1779823085.6102462,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":53760,"affinity_cache_ratio":0.992541171257662,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":404,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1779,"cache_hit":53760,"new_prefill":404,"score_linear":-53760.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":53140,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54164,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":392220.690650305,"t_first_token_unix":1779823085.7045937,"t_done":392223.139233166,"t_done_unix":1779823088.1531773},{"request_id":"1356885:14:1948151:1148","session_id":"1356885","input_length":136210,"t_proxy_recv":392240.362094548,"t_decision_unix":1779823105.3760357,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":135680,"affinity_cache_ratio":0.9961089494163424,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":135680,"estimated_new_tokens":530,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1737,"cache_hit":135680,"new_prefill":530,"score_linear":-135680.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":135186,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":136210,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-135680.0,"chosen_score_lmetric":0,"t_first_token":392240.696685844,"t_first_token_unix":1779823105.7106295,"t_done":392242.390559842,"t_done_unix":1779823107.404504},{"request_id":"1340290:35:1964727:1149","session_id":"1340290","input_length":54498,"t_proxy_recv":392295.078573579,"t_decision_unix":1779823160.0925143,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54272,"affinity_cache_ratio":0.9958530588278469,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54272,"estimated_new_tokens":226,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1780,"cache_hit":54272,"new_prefill":226,"score_linear":-54272.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":53474,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54498,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54272.0,"chosen_score_lmetric":0,"t_first_token":392295.175104889,"t_first_token_unix":1779823160.1890483,"t_done":392298.939928965,"t_done_unix":1779823163.9538722},{"request_id":"1340290:36:1969509:1150","session_id":"1340290","input_length":54811,"t_proxy_recv":392310.829657516,"t_decision_unix":1779823175.8435984,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9995073981500063,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":27,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1781,"cache_hit":54784,"new_prefill":27,"score_linear":-54784.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":53787,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":54811,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":392310.910976776,"t_first_token_unix":1779823175.9249203,"t_done":392311.361904936,"t_done_unix":1779823176.375848},{"request_id":"1340290:37:1971106:1151","session_id":"1340290","input_length":55358,"t_proxy_recv":392315.973756984,"t_decision_unix":1779823180.987698,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":54784,"affinity_cache_ratio":0.9896311282922071,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":54784,"estimated_new_tokens":574,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1781,"cache_hit":54784,"new_prefill":574,"score_linear":-54784.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":54334,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":55358,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-54784.0,"chosen_score_lmetric":0,"t_first_token":392316.268877376,"t_first_token_unix":1779823181.2828212,"t_done":392316.726666025,"t_done_unix":1779823181.7406092},{"request_id":"1340290:38:1972289:1152","session_id":"1340290","input_length":56006,"t_proxy_recv":392319.90288987,"t_decision_unix":1779823184.9168308,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":55296,"affinity_cache_ratio":0.9873227868442667,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55296,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1782,"cache_hit":55296,"new_prefill":710,"score_linear":-55296.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":54982,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":56006,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55296.0,"chosen_score_lmetric":0,"t_first_token":392320.20792638,"t_first_token_unix":1779823185.221871,"t_done":392320.866730667,"t_done_unix":1779823185.8806741},{"request_id":"1340290:39:1973889:1153","session_id":"1340290","input_length":56242,"t_proxy_recv":392325.329279923,"t_decision_unix":1779823190.3432207,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":55808,"affinity_cache_ratio":0.9922833469649017,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":55808,"estimated_new_tokens":434,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1783,"cache_hit":55808,"new_prefill":434,"score_linear":-55808.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":55218,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":56242,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-55808.0,"chosen_score_lmetric":0,"t_first_token":392325.515722017,"t_first_token_unix":1779823190.5296655,"t_done":392326.174955562,"t_done_unix":1779823191.1888988},{"request_id":"1340290:40:1975278:1154","session_id":"1340290","input_length":56416,"t_proxy_recv":392329.889576423,"t_decision_unix":1779823194.9035177,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":56320,"affinity_cache_ratio":0.998298355076574,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":96,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":56320,"new_prefill":96,"score_linear":-56320.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":55392,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":56416,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56320.0,"chosen_score_lmetric":0,"t_first_token":392330.004596829,"t_first_token_unix":1779823195.0185401,"t_done":392330.488344468,"t_done_unix":1779823195.50229},{"request_id":"1340290:41:1977055:1156","session_id":"1340290","input_length":57181,"t_proxy_recv":392335.825926939,"t_decision_unix":1779823200.8398683,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":56320,"affinity_cache_ratio":0.9849425508473094,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":56320,"estimated_new_tokens":861,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":67793,"ongoing_decode_tokens":0,"pending_prefill_tokens":2769,"num_requests":1,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":0,"new_prefill":57181,"score_linear":67793.0,"score_lmetric":59950},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":56320,"new_prefill":861,"score_linear":-56320.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":56157,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":57181,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-56320.0,"chosen_score_lmetric":0,"t_first_token":392336.239582355,"t_first_token_unix":1779823201.2535257,"t_done":392338.210536317,"t_done_unix":1779823203.2244806},{"request_id":"1277428:21:1976968:1155","session_id":"1277428","input_length":67793,"t_proxy_recv":392335.542216977,"t_decision_unix":1779823200.5561583,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":65024,"affinity_cache_ratio":0.9591550750077442,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":65024,"estimated_new_tokens":2769,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2273,"cache_hit":65024,"new_prefill":2769,"score_linear":-65024.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":4608,"new_prefill":63185,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":17408,"new_prefill":50385,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1784,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":67793,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-65024.0,"chosen_score_lmetric":0,"t_first_token":392336.793550785,"t_first_token_unix":1779823201.807495,"t_done":392342.629381183,"t_done_unix":1779823207.6433253},{"request_id":"1340290:42:1982198:1157","session_id":"1340290","input_length":57463,"t_proxy_recv":392352.727753082,"t_decision_unix":1779823217.7416923,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9979291022048971,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":119,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2279,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1786,"cache_hit":57344,"new_prefill":119,"score_linear":-57344.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":56439,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":57463,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":392352.84325082,"t_first_token_unix":1779823217.8571944,"t_done":392353.316683989,"t_done_unix":1779823218.3306274},{"request_id":"1340290:43:1983901:1158","session_id":"1340290","input_length":57640,"t_proxy_recv":392358.125323445,"t_decision_unix":1779823223.1392648,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9948646773074254,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":296,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2279,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1786,"cache_hit":57344,"new_prefill":296,"score_linear":-57344.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":56616,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":57640,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":392358.278015896,"t_first_token_unix":1779823223.2919593,"t_done":392358.792360447,"t_done_unix":1779823223.8063037},{"request_id":"1340290:44:1986230:1159","session_id":"1340290","input_length":57809,"t_proxy_recv":392366.207554948,"t_decision_unix":1779823231.2214963,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57344,"affinity_cache_ratio":0.9919562697849815,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57344,"estimated_new_tokens":465,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2279,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1786,"cache_hit":57344,"new_prefill":465,"score_linear":-57344.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":56785,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":57809,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57344.0,"chosen_score_lmetric":0,"t_first_token":392366.361641684,"t_first_token_unix":1779823231.3755858,"t_done":392367.072672805,"t_done_unix":1779823232.0866163},{"request_id":"1277428:21:1989132:1160","session_id":"1277428","input_length":69987,"t_proxy_recv":392375.626723675,"t_decision_unix":1779823240.640665,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":68096,"affinity_cache_ratio":0.9729806964150485,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":68096,"estimated_new_tokens":1891,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2279,"cache_hit":68096,"new_prefill":1891,"score_linear":-68096.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":4608,"new_prefill":65379,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":17408,"new_prefill":52579,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":69987,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-68096.0,"chosen_score_lmetric":0,"t_first_token":392376.393186587,"t_first_token_unix":1779823241.40713,"t_done":392376.73746302,"t_done_unix":1779823241.7514062},{"request_id":"1277428:22:1990436:1161","session_id":"1277428","input_length":70055,"t_proxy_recv":392380.16715446,"t_decision_unix":1779823245.1810956,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":69632,"affinity_cache_ratio":0.993961887088716,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":423,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":69632,"new_prefill":423,"score_linear":-69632.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":4608,"new_prefill":65447,"score_linear":-4608.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":17408,"new_prefill":52647,"score_linear":-17408.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":70055,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":392380.282514163,"t_first_token_unix":1779823245.2964578,"t_done":392380.690090006,"t_done_unix":1779823245.7040336},{"request_id":"1340290:45:1991694:1162","session_id":"1340290","input_length":58053,"t_proxy_recv":392384.181274587,"t_decision_unix":1779823249.195216,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9966065491878111,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":197,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":57856,"new_prefill":197,"score_linear":-57856.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57029,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58053,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":392384.373009395,"t_first_token_unix":1779823249.3869529,"t_done":392384.625291264,"t_done_unix":1779823249.6392345},{"request_id":"1340290:46:1992980:1163","session_id":"1340290","input_length":58122,"t_proxy_recv":392388.406551521,"t_decision_unix":1779823253.420493,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9954234197033826,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":266,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":57856,"new_prefill":266,"score_linear":-57856.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57098,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58122,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":392388.507662094,"t_first_token_unix":1779823253.5216057,"t_done":392388.9230758,"t_done_unix":1779823253.937019},{"request_id":"1340290:47:1995358:1164","session_id":"1340290","input_length":58307,"t_proxy_recv":392396.269093164,"t_decision_unix":1779823261.2830324,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9922650796645343,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":451,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":57856,"new_prefill":451,"score_linear":-57856.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57283,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58307,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":392396.409087052,"t_first_token_unix":1779823261.4230306,"t_done":392396.660314164,"t_done_unix":1779823261.674257},{"request_id":"1340290:48:1996945:1165","session_id":"1340290","input_length":58339,"t_proxy_recv":392401.573080942,"t_decision_unix":1779823266.5870218,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":57856,"affinity_cache_ratio":0.9917208042647285,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":57856,"estimated_new_tokens":483,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1787,"cache_hit":57856,"new_prefill":483,"score_linear":-57856.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57315,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58339,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-57856.0,"chosen_score_lmetric":0,"t_first_token":392401.652686832,"t_first_token_unix":1779823266.66663,"t_done":392403.664770085,"t_done_unix":1779823268.6787136},{"request_id":"1356885:15:1998292:1166","session_id":"1356885","input_length":136653,"t_proxy_recv":392406.044311622,"t_decision_unix":1779823271.0582528,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":136192,"affinity_cache_ratio":0.9966264919174844,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":136192,"estimated_new_tokens":461,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1738,"cache_hit":136192,"new_prefill":461,"score_linear":-136192.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":135629,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":136653,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-136192.0,"chosen_score_lmetric":0,"t_first_token":392406.704355129,"t_first_token_unix":1779823271.7182992,"t_done":392408.373341473,"t_done_unix":1779823273.3872848},{"request_id":"1340290:48:1999591:1167","session_id":"1340290","input_length":58622,"t_proxy_recv":392410.589784408,"t_decision_unix":1779823275.6037257,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9956671556753437,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":254,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":58368,"new_prefill":254,"score_linear":-58368.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57598,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58622,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":392410.690210733,"t_first_token_unix":1779823275.7041543,"t_done":392411.28577029,"t_done_unix":1779823276.2997162},{"request_id":"1340290:48:2001313:1168","session_id":"1340290","input_length":58808,"t_proxy_recv":392416.055812601,"t_decision_unix":1779823281.0697536,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58368,"affinity_cache_ratio":0.9925180247585362,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":58368,"new_prefill":440,"score_linear":-58368.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57784,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58808,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":392416.212797158,"t_first_token_unix":1779823281.2267408,"t_done":392416.726811477,"t_done_unix":1779823281.7407548},{"request_id":"1340290:48:2003195:1169","session_id":"1340290","input_length":58977,"t_proxy_recv":392422.379596053,"t_decision_unix":1779823287.3935375,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58368,"affinity_cache_ratio":0.989673940688743,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58368,"estimated_new_tokens":609,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1788,"cache_hit":58368,"new_prefill":609,"score_linear":-58368.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":57953,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":58977,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58368.0,"chosen_score_lmetric":0,"t_first_token":392422.538595642,"t_first_token_unix":1779823287.5525389,"t_done":392423.417407888,"t_done_unix":1779823288.431351},{"request_id":"1340290:48:2005449:1170","session_id":"1340290","input_length":59220,"t_proxy_recv":392429.768761557,"t_decision_unix":1779823294.782703,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.994258696386356,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":340,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":58880,"new_prefill":340,"score_linear":-58880.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":58196,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":59220,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":392429.909862116,"t_first_token_unix":1779823294.923806,"t_done":392430.750971421,"t_done_unix":1779823295.7649155},{"request_id":"1340290:48:2007287:1171","session_id":"1340290","input_length":59487,"t_proxy_recv":392435.894849507,"t_decision_unix":1779823300.9087908,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":58880,"affinity_cache_ratio":0.9897960899019954,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":58880,"estimated_new_tokens":607,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1789,"cache_hit":58880,"new_prefill":607,"score_linear":-58880.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":58463,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":59487,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-58880.0,"chosen_score_lmetric":0,"t_first_token":392436.08974601,"t_first_token_unix":1779823301.1036894,"t_done":392436.471286755,"t_done_unix":1779823301.48523},{"request_id":"1340290:48:2008380:1173","session_id":"1340290","input_length":60935,"t_proxy_recv":392439.997251788,"t_decision_unix":1779823305.011193,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":59392,"affinity_cache_ratio":0.9746779355050463,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":59392,"estimated_new_tokens":1543,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":66506,"ongoing_decode_tokens":0,"pending_prefill_tokens":5066,"num_requests":1,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":0,"new_prefill":60935,"score_linear":66506.0,"score_lmetric":66001},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1790,"cache_hit":59392,"new_prefill":1543,"score_linear":-59392.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":59911,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":60935,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-59392.0,"chosen_score_lmetric":0,"t_first_token":392440.665111408,"t_first_token_unix":1779823305.6790555,"t_done":392441.351484608,"t_done_unix":1779823306.365428},{"request_id":"1305906:11:2008110:1172","session_id":"1305906","input_length":66506,"t_proxy_recv":392438.986264662,"t_decision_unix":1779823304.000206,"policy":"unified_kv_both","decision":"affinity","affinity_idx":0,"chosen_idx":0,"affinity_cache_hit":61440,"affinity_cache_ratio":0.9238264216762397,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":5066,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8000","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2282,"cache_hit":61440,"new_prefill":5066,"score_linear":-61440.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1790,"cache_hit":16896,"new_prefill":49610,"score_linear":-16896.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":66506,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":392440.934487982,"t_first_token_unix":1779823305.9484313,"t_done":392443.266348708,"t_done_unix":1779823308.280292},{"request_id":"1340290:48:2010180:1174","session_id":"1340290","input_length":61080,"t_proxy_recv":392445.855913402,"t_decision_unix":1779823310.8698545,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9975114603798297,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":152,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1793,"cache_hit":60928,"new_prefill":152,"score_linear":-60928.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":60056,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":61080,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":392445.994169746,"t_first_token_unix":1779823311.0081131,"t_done":392447.013636899,"t_done_unix":1779823312.027581},{"request_id":"1340290:48:2012871:1175","session_id":"1340290","input_length":61365,"t_proxy_recv":392454.53226428,"t_decision_unix":1779823319.5462058,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9928786767701459,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1793,"cache_hit":60928,"new_prefill":437,"score_linear":-60928.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":60341,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":61365,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":392454.734642546,"t_first_token_unix":1779823319.7485857,"t_done":392455.254170891,"t_done_unix":1779823320.268114},{"request_id":"1340290:48:2014153:1176","session_id":"1340290","input_length":61518,"t_proxy_recv":392458.930020875,"t_decision_unix":1779823323.943962,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":60928,"affinity_cache_ratio":0.9904093110959394,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":60928,"estimated_new_tokens":590,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1793,"cache_hit":60928,"new_prefill":590,"score_linear":-60928.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":60494,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":61518,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-60928.0,"chosen_score_lmetric":0,"t_first_token":392459.058540461,"t_first_token_unix":1779823324.0724843,"t_done":392459.552089005,"t_done_unix":1779823324.5660324},{"request_id":"1340290:48:2015982:1177","session_id":"1340290","input_length":69113,"t_proxy_recv":392465.031020642,"t_decision_unix":1779823330.0449617,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":61440,"affinity_cache_ratio":0.8889789185826111,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":61440,"estimated_new_tokens":7673,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1794,"cache_hit":61440,"new_prefill":7673,"score_linear":-61440.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":68089,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":69113,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-61440.0,"chosen_score_lmetric":0,"t_first_token":392468.244188037,"t_first_token_unix":1779823333.2581315,"t_done":392470.676204497,"t_done_unix":1779823335.6901503},{"request_id":"1340290:48:2018973:1178","session_id":"1340290","input_length":69426,"t_proxy_recv":392474.812257677,"t_decision_unix":1779823339.826199,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9955924293492352,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":306,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1809,"cache_hit":69120,"new_prefill":306,"score_linear":-69120.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":68402,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":69426,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":392474.930308049,"t_first_token_unix":1779823339.9442515,"t_done":392475.515588872,"t_done_unix":1779823340.5295322},{"request_id":"1340290:48:2020779:1179","session_id":"1340290","input_length":69601,"t_proxy_recv":392480.870108145,"t_decision_unix":1779823345.8840494,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69120,"affinity_cache_ratio":0.9930891797531645,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69120,"estimated_new_tokens":481,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1809,"cache_hit":69120,"new_prefill":481,"score_linear":-69120.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":68577,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":69601,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69120.0,"chosen_score_lmetric":0,"t_first_token":392481.049389728,"t_first_token_unix":1779823346.0633337,"t_done":392481.618955044,"t_done_unix":1779823346.6328986},{"request_id":"1340290:48:2023753:1180","session_id":"1340290","input_length":69951,"t_proxy_recv":392490.487829562,"t_decision_unix":1779823355.501771,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69632,"affinity_cache_ratio":0.9954396649082929,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":319,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1810,"cache_hit":69632,"new_prefill":319,"score_linear":-69632.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":68927,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":69951,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":392490.718059619,"t_first_token_unix":1779823355.7320032,"t_done":392491.604267441,"t_done_unix":1779823356.6182108},{"request_id":"1340290:48:2026751:1181","session_id":"1340290","input_length":70342,"t_proxy_recv":392500.764682096,"t_decision_unix":1779823365.7786233,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":69632,"affinity_cache_ratio":0.989906457024253,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":69632,"estimated_new_tokens":710,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1810,"cache_hit":69632,"new_prefill":710,"score_linear":-69632.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":69318,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":70342,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-69632.0,"chosen_score_lmetric":0,"t_first_token":392500.999687994,"t_first_token_unix":1779823366.013632,"t_done":392501.521628794,"t_done_unix":1779823366.5355728},{"request_id":"1340290:48:2028652:1182","session_id":"1340290","input_length":70503,"t_proxy_recv":392507.019879282,"t_decision_unix":1779823372.03382,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9949080180985206,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":359,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":70144,"new_prefill":359,"score_linear":-70144.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":69479,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":70503,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":392507.201975652,"t_first_token_unix":1779823372.2159197,"t_done":392508.097790293,"t_done_unix":1779823373.111737},{"request_id":"1340290:48:2033065:1183","session_id":"1340290","input_length":70851,"t_proxy_recv":392521.746948387,"t_decision_unix":1779823386.7608895,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":70144,"affinity_cache_ratio":0.9900213123315126,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70144,"estimated_new_tokens":707,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1811,"cache_hit":70144,"new_prefill":707,"score_linear":-70144.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":69827,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":70851,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70144.0,"chosen_score_lmetric":0,"t_first_token":392521.978454874,"t_first_token_unix":1779823386.9923983,"t_done":392522.615988403,"t_done_unix":1779823387.6299317},{"request_id":"1340290:48:2034908:1184","session_id":"1340290","input_length":71067,"t_proxy_recv":392527.969338876,"t_decision_unix":1779823392.9832802,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":70656,"affinity_cache_ratio":0.9942167250622652,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70656,"estimated_new_tokens":411,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":70656,"new_prefill":411,"score_linear":-70656.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":70043,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":71067,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70656.0,"chosen_score_lmetric":0,"t_first_token":392528.13141565,"t_first_token_unix":1779823393.145359,"t_done":392528.646929343,"t_done_unix":1779823393.6608734},{"request_id":"1258908:2:2035438:1185","session_id":"1258908","input_length":7844,"t_proxy_recv":392529.776821274,"t_decision_unix":1779823394.790762,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.9790922998470168,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":164,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":7680,"new_prefill":164,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":7844,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":392529.806040492,"t_first_token_unix":1779823394.819984,"t_done":392530.823328548,"t_done_unix":1779823395.8372722},{"request_id":"1258908:3:1388683:699","session_id":"1258908","input_length":9120,"t_proxy_recv":392530.826649814,"t_decision_unix":1779823395.8405914,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":7680,"affinity_cache_ratio":0.8421052631578947,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":7680,"estimated_new_tokens":1440,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2320,"cache_hit":7680,"new_prefill":1440,"score_linear":-7680.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":9120,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-7680.0,"chosen_score_lmetric":0,"t_first_token":392530.973364443,"t_first_token_unix":1779823395.9873078,"t_done":392531.64548087,"t_done_unix":1779823396.6594245},{"request_id":"1340290:48:2036994:1186","session_id":"1340290","input_length":71240,"t_proxy_recv":392534.910341399,"t_decision_unix":1779823399.9242826,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":70656,"affinity_cache_ratio":0.9918023582257159,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":70656,"estimated_new_tokens":584,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1812,"cache_hit":70656,"new_prefill":584,"score_linear":-70656.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":70216,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":71240,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-70656.0,"chosen_score_lmetric":0,"t_first_token":392535.094849468,"t_first_token_unix":1779823400.108793,"t_done":392535.813795784,"t_done_unix":1779823400.8277392},{"request_id":"1340290:48:2040473:1187","session_id":"1340290","input_length":71545,"t_proxy_recv":392546.437036869,"t_decision_unix":1779823411.4509783,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9947305891397022,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":377,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":71168,"new_prefill":377,"score_linear":-71168.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":70521,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":71545,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":392546.675152219,"t_first_token_unix":1779823411.6890955,"t_done":392547.813082808,"t_done_unix":1779823412.827027},{"request_id":"1340290:48:2043771:1188","session_id":"1340290","input_length":71867,"t_proxy_recv":392557.456804506,"t_decision_unix":1779823422.4707456,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71168,"affinity_cache_ratio":0.9902737000292207,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71168,"estimated_new_tokens":699,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1813,"cache_hit":71168,"new_prefill":699,"score_linear":-71168.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":70843,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":71867,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71168.0,"chosen_score_lmetric":0,"t_first_token":392557.691389572,"t_first_token_unix":1779823422.7053337,"t_done":392558.264310473,"t_done_unix":1779823423.278254},{"request_id":"1340290:48:2045403:1189","session_id":"1340290","input_length":72025,"t_proxy_recv":392562.964231808,"t_decision_unix":1779823427.9781733,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.995209996528983,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":345,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":71680,"new_prefill":345,"score_linear":-71680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":71001,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":72025,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":392563.106051881,"t_first_token_unix":1779823428.1199956,"t_done":392563.790059708,"t_done_unix":1779823428.8040032},{"request_id":"1340290:48:2047167:1190","session_id":"1340290","input_length":72211,"t_proxy_recv":392568.730280092,"t_decision_unix":1779823433.7442214,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":71680,"affinity_cache_ratio":0.9926465496946448,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":71680,"estimated_new_tokens":531,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1814,"cache_hit":71680,"new_prefill":531,"score_linear":-71680.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":71187,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":72211,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-71680.0,"chosen_score_lmetric":0,"t_first_token":392568.918843688,"t_first_token_unix":1779823433.9327872,"t_done":392569.467191423,"t_done_unix":1779823434.4811347},{"request_id":"1340290:48:2048793:1191","session_id":"1340290","input_length":72777,"t_proxy_recv":392574.16345453,"t_decision_unix":1779823439.1773958,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":72192,"affinity_cache_ratio":0.9919617461560658,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72192,"estimated_new_tokens":585,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1815,"cache_hit":72192,"new_prefill":585,"score_linear":-72192.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":71753,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":72777,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72192.0,"chosen_score_lmetric":0,"t_first_token":392574.536838365,"t_first_token_unix":1779823439.5507822,"t_done":392575.060093611,"t_done_unix":1779823440.0740373},{"request_id":"1340290:48:2050838:1192","session_id":"1340290","input_length":72952,"t_proxy_recv":392581.386205216,"t_decision_unix":1779823446.4001467,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9966005044412765,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":248,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1816,"cache_hit":72704,"new_prefill":248,"score_linear":-72704.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":71928,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":72952,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":392581.574832858,"t_first_token_unix":1779823446.588777,"t_done":392581.935572755,"t_done_unix":1779823446.9495165},{"request_id":"1340290:48:2052523:1193","session_id":"1340290","input_length":73208,"t_proxy_recv":392586.954477317,"t_decision_unix":1779823451.9684186,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":72704,"affinity_cache_ratio":0.9931155065020216,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":72704,"estimated_new_tokens":504,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1816,"cache_hit":72704,"new_prefill":504,"score_linear":-72704.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":72184,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":73208,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-72704.0,"chosen_score_lmetric":0,"t_first_token":392587.190882158,"t_first_token_unix":1779823452.2048259,"t_done":392587.970395487,"t_done_unix":1779823452.9843395},{"request_id":"1340290:48:2055365:1194","session_id":"1340290","input_length":73454,"t_proxy_recv":392596.667428352,"t_decision_unix":1779823461.681369,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9967598769297792,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":238,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":73216,"new_prefill":238,"score_linear":-73216.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":72430,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":73454,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":392596.899470218,"t_first_token_unix":1779823461.913414,"t_done":392597.323635569,"t_done_unix":1779823462.3375797},{"request_id":"1340290:48:2057042:1195","session_id":"1340290","input_length":73636,"t_proxy_recv":392602.039397914,"t_decision_unix":1779823467.0533388,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9942962681297192,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":420,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":73216,"new_prefill":420,"score_linear":-73216.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":72612,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":73636,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":392602.20917991,"t_first_token_unix":1779823467.2231236,"t_done":392602.479229456,"t_done_unix":1779823467.4931734},{"request_id":"1340290:48:2058614:1196","session_id":"1340290","input_length":73653,"t_proxy_recv":392607.183085608,"t_decision_unix":1779823472.1970265,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73216,"affinity_cache_ratio":0.9940667725686666,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73216,"estimated_new_tokens":437,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1817,"cache_hit":73216,"new_prefill":437,"score_linear":-73216.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":72629,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":73653,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73216.0,"chosen_score_lmetric":0,"t_first_token":392607.284725838,"t_first_token_unix":1779823472.2986693,"t_done":392609.029687168,"t_done_unix":1779823474.043634},{"request_id":"1340290:48:2061834:1197","session_id":"1340290","input_length":73858,"t_proxy_recv":392617.330742408,"t_decision_unix":1779823482.344684,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9982398656882125,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":130,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":73728,"new_prefill":130,"score_linear":-73728.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":72834,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":73858,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":392617.440168171,"t_first_token_unix":1779823482.4541113,"t_done":392617.988997319,"t_done_unix":1779823483.0029407},{"request_id":"1258908:3:2063441:1198","session_id":"1258908","input_length":9359,"t_proxy_recv":392622.369342834,"t_decision_unix":1779823487.3832839,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9847205898066033,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":143,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":9216,"new_prefill":143,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":9359,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":392622.419159049,"t_first_token_unix":1779823487.4331026,"t_done":392623.486304725,"t_done_unix":1779823488.500248},{"request_id":"1340290:48:2063837:1199","session_id":"1340290","input_length":74011,"t_proxy_recv":392623.724162585,"t_decision_unix":1779823488.738104,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9961762440718271,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":283,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":9740,"ongoing_decode_tokens":9740,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":0,"new_prefill":74011,"score_linear":9740.0,"score_lmetric":74011},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":73728,"new_prefill":283,"score_linear":-73728.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":72987,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":74011,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":392623.868195954,"t_first_token_unix":1779823488.8821394,"t_done":392624.445194596,"t_done_unix":1779823489.4591389},{"request_id":"1258908:4:1553508:958","session_id":"1258908","input_length":9740,"t_proxy_recv":392623.489977888,"t_decision_unix":1779823488.5039194,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9216,"affinity_cache_ratio":0.9462012320328542,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9216,"estimated_new_tokens":524,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2323,"cache_hit":9216,"new_prefill":524,"score_linear":-9216.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":9740,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9216.0,"chosen_score_lmetric":0,"t_first_token":392623.547518746,"t_first_token_unix":1779823488.5614622,"t_done":392625.43650598,"t_done_unix":1779823490.45045},{"request_id":"1258908:5:1617181:988","session_id":"1258908","input_length":10201,"t_proxy_recv":392625.441077479,"t_decision_unix":1779823490.4550188,"policy":"unified_kv_both","decision":"affinity","affinity_idx":3,"chosen_idx":3,"affinity_cache_hit":9728,"affinity_cache_ratio":0.9536319968630527,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":9728,"estimated_new_tokens":473,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8003","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2324,"cache_hit":9728,"new_prefill":473,"score_linear":-9728.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":10201,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-9728.0,"chosen_score_lmetric":0,"t_first_token":392625.491768269,"t_first_token_unix":1779823490.505713,"t_done":392627.539207014,"t_done_unix":1779823492.55315},{"request_id":"1340290:48:2066647:1200","session_id":"1340290","input_length":74557,"t_proxy_recv":392633.163114404,"t_decision_unix":1779823498.1770558,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":73728,"affinity_cache_ratio":0.9888809903831968,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":73728,"estimated_new_tokens":829,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1818,"cache_hit":73728,"new_prefill":829,"score_linear":-73728.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":73533,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":74557,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-73728.0,"chosen_score_lmetric":0,"t_first_token":392633.546185169,"t_first_token_unix":1779823498.5601292,"t_done":392634.783464208,"t_done_unix":1779823499.797408},{"request_id":"1340290:48:2071598:1201","session_id":"1340290","input_length":74863,"t_proxy_recv":392649.821038797,"t_decision_unix":1779823514.83498,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":74240,"affinity_cache_ratio":0.991678132054553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74240,"estimated_new_tokens":623,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1819,"cache_hit":74240,"new_prefill":623,"score_linear":-74240.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":73839,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":74863,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74240.0,"chosen_score_lmetric":0,"t_first_token":392650.060881973,"t_first_token_unix":1779823515.0748255,"t_done":392650.869293922,"t_done_unix":1779823515.8832371},{"request_id":"1340290:48:2076822:1202","session_id":"1340290","input_length":75113,"t_proxy_recv":392667.338486623,"t_decision_unix":1779823532.3524275,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9951939078455128,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":361,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":74752,"new_prefill":361,"score_linear":-74752.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":74089,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":75113,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":392667.579132712,"t_first_token_unix":1779823532.5930762,"t_done":392668.015966052,"t_done_unix":1779823533.0299096},{"request_id":"1340290:48:2078461:1203","session_id":"1340290","input_length":75299,"t_proxy_recv":392672.627897547,"t_decision_unix":1779823537.6418386,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":74752,"affinity_cache_ratio":0.9927356272991673,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":74752,"estimated_new_tokens":547,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1820,"cache_hit":74752,"new_prefill":547,"score_linear":-74752.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":74275,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":75299,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-74752.0,"chosen_score_lmetric":0,"t_first_token":392672.866663647,"t_first_token_unix":1779823537.8806071,"t_done":392673.148592162,"t_done_unix":1779823538.1625357},{"request_id":"1340290:48:2080016:1204","session_id":"1340290","input_length":75338,"t_proxy_recv":392677.916435325,"t_decision_unix":1779823542.9303768,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9990177599617723,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":74,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":75264,"new_prefill":74,"score_linear":-75264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":74314,"score_linear":-1024.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":75338,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":392678.044134163,"t_first_token_unix":1779823543.0580778,"t_done":392678.394477766,"t_done_unix":1779823543.408421},{"request_id":"1340290:48:2082644:1206","session_id":"1340290","input_length":75439,"t_proxy_recv":392686.590774634,"t_decision_unix":1779823551.6047156,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9976802449661316,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":175,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":75264,"new_prefill":175,"score_linear":-75264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":74415,"score_linear":113947.0,"score_lmetric":135626},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":75439,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":392686.745656605,"t_first_token_unix":1779823551.7596002,"t_done":392687.729726129,"t_done_unix":1779823552.7436697},{"request_id":"1356885:16:2084239:1207","session_id":"1356885","input_length":136991,"t_proxy_recv":392691.68778419,"t_decision_unix":1779823556.7017255,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":136704,"affinity_cache_ratio":0.9979049718594653,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":136704,"estimated_new_tokens":287,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":136704,"new_prefill":287,"score_linear":-136704.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":135967,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":0,"new_prefill":136991,"score_linear":114971.0,"score_lmetric":198202},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":136991,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-136704.0,"chosen_score_lmetric":0,"t_first_token":392692.108611434,"t_first_token_unix":1779823557.1225555,"t_done":392694.937034287,"t_done_unix":1779823559.950978},{"request_id":"1340290:48:2085626:1208","session_id":"1340290","input_length":77337,"t_proxy_recv":392696.667191521,"t_decision_unix":1779823561.6811326,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":75264,"affinity_cache_ratio":0.9731952364327553,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":75264,"estimated_new_tokens":2073,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":75264,"new_prefill":2073,"score_linear":-75264.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":76313,"score_linear":113947.0,"score_lmetric":137524},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":77337,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-75264.0,"chosen_score_lmetric":0,"t_first_token":392697.63648545,"t_first_token_unix":1779823562.6504292,"t_done":392698.144823536,"t_done_unix":1779823563.1587725},{"request_id":"1340290:48:2087584:1209","session_id":"1340290","input_length":78683,"t_proxy_recv":392703.245040893,"t_decision_unix":1779823568.2589822,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":77312,"affinity_cache_ratio":0.9825756516655441,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":77312,"estimated_new_tokens":1371,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1825,"cache_hit":77312,"new_prefill":1371,"score_linear":-77312.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":77659,"score_linear":113947.0,"score_lmetric":138870},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":78683,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-77312.0,"chosen_score_lmetric":0,"t_first_token":392704.082541986,"t_first_token_unix":1779823569.0964859,"t_done":392705.535435839,"t_done_unix":1779823570.5493796},{"request_id":"1340290:48:2092759:1211","session_id":"1340290","input_length":79023,"t_proxy_recv":392720.537046745,"t_decision_unix":1779823585.5509877,"policy":"unified_kv_both","decision":"affinity","affinity_idx":5,"chosen_idx":5,"affinity_cache_hit":78336,"affinity_cache_ratio":0.9913063285372613,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":78336,"estimated_new_tokens":687,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8005","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1827,"cache_hit":78336,"new_prefill":687,"score_linear":-78336.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":114971,"ongoing_decode_tokens":0,"pending_prefill_tokens":61211,"num_requests":1,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":1024,"new_prefill":77999,"score_linear":113947.0,"score_lmetric":139210},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":79023,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-78336.0,"chosen_score_lmetric":0,"t_first_token":392720.788406411,"t_first_token_unix":1779823585.8023503,"t_done":392722.069359785,"t_done_unix":1779823587.0833035},{"request_id":"1382086:2:2082052:1205","session_id":"1382086","input_length":114971,"t_proxy_recv":392684.579832173,"t_decision_unix":1779823549.5937731,"policy":"unified_kv_both","decision":"lmetric_fallback","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":53760,"affinity_cache_ratio":0.467596176427099,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":0,"tie_break_used":false,"cache_hit":53760,"estimated_new_tokens":61211,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1739,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1821,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741,"cache_hit":53760,"new_prefill":61211,"score_linear":-53760.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":114971,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-53760.0,"chosen_score_lmetric":0,"t_first_token":392726.644974782,"t_first_token_unix":1779823591.658919,"t_done":392727.809396197,"t_done_unix":1779823592.8233395},{"request_id":"1382086:3:2089879:1210","session_id":"1382086","input_length":115184,"t_proxy_recv":392727.827855447,"t_decision_unix":1779823592.841795,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":114688,"affinity_cache_ratio":0.9956938463675511,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":114688,"estimated_new_tokens":496,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1828,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1860,"cache_hit":114688,"new_prefill":496,"score_linear":-114688.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":115184,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-114688.0,"chosen_score_lmetric":0,"t_first_token":392728.147713081,"t_first_token_unix":1779823593.1616566,"t_done":392728.618578341,"t_done_unix":1779823593.6325219},{"request_id":"1382086:4:2092953:1212","session_id":"1382086","input_length":115246,"t_proxy_recv":392728.636665432,"t_decision_unix":1779823593.650607,"policy":"unified_kv_both","decision":"affinity","affinity_idx":6,"chosen_idx":6,"affinity_cache_hit":115200,"affinity_cache_ratio":0.9996008538257293,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":115200,"estimated_new_tokens":46,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8006","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1828,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":115200,"new_prefill":46,"score_linear":-115200.0,"score_lmetric":0},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":115246,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-115200.0,"chosen_score_lmetric":0,"t_first_token":392728.788720652,"t_first_token_unix":1779823593.802664,"t_done":392735.822687152,"t_done_unix":1779823600.8366303},{"request_id":"1356885:17:2097011:1213","session_id":"1356885","input_length":137546,"t_proxy_recv":392734.400026296,"t_decision_unix":1779823599.4139676,"policy":"unified_kv_both","decision":"affinity","affinity_idx":1,"chosen_idx":1,"affinity_cache_hit":137216,"affinity_cache_ratio":0.9976008026405712,"affinity_num_requests":0,"avg_num_requests":1.0,"fallback_score":null,"tie_break_used":false,"cache_hit":137216,"estimated_new_tokens":330,"route_class":"LOCAL","routed_to":"http://127.0.0.1:8001","candidate_scores":[{"idx":0,"url":"http://127.0.0.1:8000","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":1,"url":"http://127.0.0.1:8001","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1740,"cache_hit":137216,"new_prefill":330,"score_linear":-137216.0,"score_lmetric":0},{"idx":2,"url":"http://127.0.0.1:8002","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520,"cache_hit":1024,"new_prefill":136522,"score_linear":-1024.0,"score_lmetric":0},{"idx":3,"url":"http://127.0.0.1:8003","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":4,"url":"http://127.0.0.1:8004","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":5,"url":"http://127.0.0.1:8005","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1828,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0},{"idx":6,"url":"http://127.0.0.1:8006","ongoing_tokens":115246,"ongoing_decode_tokens":115246,"pending_prefill_tokens":0,"num_requests":1,"active_p_offloads":0,"cached_blocks":1861,"cache_hit":0,"new_prefill":137546,"score_linear":115246.0,"score_lmetric":137546},{"idx":7,"url":"http://127.0.0.1:8007","ongoing_tokens":0,"ongoing_decode_tokens":0,"pending_prefill_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091,"cache_hit":0,"new_prefill":137546,"score_linear":0.0,"score_lmetric":0}],"chosen_score_linear":-137216.0,"chosen_score_lmetric":0,"t_first_token":392735.058814258,"t_first_token_unix":1779823600.072758,"t_done":392737.739966228,"t_done_unix":1779823602.7539098}] \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/metrics.jsonl b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/metrics.jsonl new file mode 100644 index 0000000..2982991 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/metrics.jsonl @@ -0,0 +1,1214 @@ +{"actual_output_tokens": 21, "cached_tokens": 0, "effective_input_length": 8228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8228, "latency_s": 0.9794983949977905, "output_length": 21, "proxy_request_id": "1237198:1:1237198:0", "request_id": "1237198:1:1237198:0", "request_type": "coder", "requested_output_tokens": 21, "session_id": "1237198", "t_dispatch_unix": 1779820686.960778, "t_finish_unix": 1779820687.9402761, "t_first_token_unix": 1779820687.8452384, "tpot_s": 0.004729678598232567, "trace_hash_ids": [12292995, 12292996, 12292997, 12304212, 12304213, 12304214, 12304215, 12304216, 12304217, 12311566, 12311567, 12311568, 12311569, 12311570, 12318563, 12318564, 12318565], "trace_timestamp_s": 0.0, "ttft_s": 0.8844572440139018, "turn_id": 1} +{"actual_output_tokens": 78, "cached_tokens": 0, "effective_input_length": 3976, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3976, "latency_s": 0.9140813439735211, "output_length": 78, "proxy_request_id": "1237337:1:1237337:1", "request_id": "1237337:1:1237337:1", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1237337", "t_dispatch_unix": 1779820687.3830469, "t_finish_unix": 1779820688.2971284, "t_first_token_unix": 1779820687.9132025, "tpot_s": 0.004981740142744905, "trace_hash_ids": [12309322, 12309323, 12309324, 12319949, 12319950, 12319951, 12319952, 12319953], "trace_timestamp_s": 0.4420000000000073, "ttft_s": 0.5301524450187571, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 8240, "effective_input_length": 10237, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10237, "latency_s": 0.4227774160099216, "output_length": 27, "proxy_request_id": "1237198:2:1237773:2", "request_id": "1237198:2:1237773:2", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1237198", "t_dispatch_unix": 1779820688.9314468, "t_finish_unix": 1779820689.354224, "t_first_token_unix": 1779820689.221811, "tpot_s": 0.005079204232270758, "trace_hash_ids": [12292995, 12292996, 12292997, 12304212, 12304213, 12304214, 12304215, 12304216, 12304217, 12311566, 12311567, 12311568, 12311569, 12311570, 12318563, 12318564, 12323845, 12323846, 12323847, 12323848], "trace_timestamp_s": 1.9920000000001892, "ttft_s": 0.29036227497272193, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 749, "latency_s": 0.24459523998666555, "output_length": 27, "proxy_request_id": "1237877:1:1237877:3", "request_id": "1237877:1:1237877:3", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1237877", "t_dispatch_unix": 1779820689.3902502, "t_finish_unix": 1779820689.6348455, "t_first_token_unix": 1779820689.5093548, "tpot_s": 0.004814831616106228, "trace_hash_ids": [12325182, 12325183], "trace_timestamp_s": 2.4520000000002256, "ttft_s": 0.11910315899876878, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 13489, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13489, "latency_s": 1.9227660250035115, "output_length": 83, "proxy_request_id": "1239034:1:1239034:4", "request_id": "1239034:1:1239034:4", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1239034", "t_dispatch_unix": 1779820693.1672444, "t_finish_unix": 1779820695.0900106, "t_first_token_unix": 1779820694.6451397, "tpot_s": 0.0054210979759795365, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12336730], "trace_timestamp_s": 6.222000000000662, "ttft_s": 1.4778930869651958, "turn_id": 1} +{"actual_output_tokens": 91, "cached_tokens": 768, "effective_input_length": 1620, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1620, "latency_s": 0.5255115350009874, "output_length": 91, "proxy_request_id": "1237877:2:1239577:6", "request_id": "1237877:2:1239577:6", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1237877", "t_dispatch_unix": 1779820695.0508084, "t_finish_unix": 1779820695.5763197, "t_first_token_unix": 1779820695.134077, "tpot_s": 0.004910116911115539, "trace_hash_ids": [12325182, 12342035, 12342036, 12342037], "trace_timestamp_s": 8.113000000000284, "ttft_s": 0.08326729998225346, "turn_id": 2} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 5194, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5194, "latency_s": 0.8738758820109069, "output_length": 54, "proxy_request_id": "1239704:1:1239704:7", "request_id": "1239704:1:1239704:7", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1239704", "t_dispatch_unix": 1779820695.4942284, "t_finish_unix": 1779820696.3681045, "t_first_token_unix": 1779820696.1017416, "tpot_s": 0.005019039734934439, "trace_hash_ids": [12325298, 12325299, 12325300, 12325301, 12325302, 12325303, 12325304, 12335875, 12343073, 12343074, 12343075], "trace_timestamp_s": 8.554000000000087, "ttft_s": 0.6075106100179255, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 7429, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7429, "latency_s": 0.7137760689947754, "output_length": 35, "proxy_request_id": "1240924:1:1240924:11", "request_id": "1240924:1:1240924:11", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1240924", "t_dispatch_unix": 1779820699.5142055, "t_finish_unix": 1779820700.2279813, "t_first_token_unix": 1779820700.0553255, "tpot_s": 0.005068073793903322, "trace_hash_ids": [12342008, 12342009, 12342010, 12342011, 12342012, 12342013, 12342014, 12342015, 12342016, 12342017, 12342018, 12342019, 12354472, 12354473, 12354474], "trace_timestamp_s": 12.574000000000524, "ttft_s": 0.5411184519762173, "turn_id": 1} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 37165, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37165, "latency_s": 7.234261224977672, "output_length": 183, "proxy_request_id": "1239100:1:1239100:5", "request_id": "1239100:1:1239100:5", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1239100", "t_dispatch_unix": 1779820693.4044492, "t_finish_unix": 1779820700.6387103, "t_first_token_unix": 1779820699.396264, "tpot_s": 0.006825189120878189, "trace_hash_ids": [44767, 44768, 44769, 44770, 44771, 44772, 44773, 127444, 75740, 127445, 127446, 127447, 127448, 127449, 127450, 127451, 127452, 127453, 127454, 127455, 127456, 127457, 127458, 127459, 127460, 127461, 127462, 127463, 127464, 127465, 127466, 127467, 127468, 127469, 8983871, 8983872, 8983873, 8983874, 12337377, 12337378, 12337379, 12337380, 12337381, 12337382, 12337383, 12337384, 12337385, 12337386, 12337386, 12337387, 1738555, 1738555, 12337388, 12337389, 12337390, 12337391, 12337392, 12337393, 12337394, 12337395, 12337396, 12337397, 12337398, 12337399, 12337400, 12337401, 12337402, 12337403, 12337404, 12337405, 12337406, 12337407, 12337408], "trace_timestamp_s": 6.451000000000022, "ttft_s": 5.9918124649557285, "turn_id": 1} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 30040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30040, "latency_s": 4.580872028018348, "output_length": 101, "proxy_request_id": "1240198:1:1240198:9", "request_id": "1240198:1:1240198:9", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1240198", "t_dispatch_unix": 1779820697.0233176, "t_finish_unix": 1779820701.604189, "t_first_token_unix": 1779820700.971746, "tpot_s": 0.006321854999987409, "trace_hash_ids": [156827, 156828, 156829, 156830, 156831, 156832, 156833, 156834, 156835, 156836, 156837, 5767151, 5767152, 5767153, 5767154, 5767155, 5767156, 5767157, 5767158, 5767159, 5767160, 5767161, 5767162, 5767163, 5767164, 5767165, 5767166, 5767167, 5767168, 5767169, 5767170, 5767171, 8388251, 8388252, 8388253, 8388254, 8388255, 8388256, 8388257, 8388258, 8388259, 8388260, 8388261, 8388262, 8388263, 8388264, 8388265, 8388266, 8388267, 8388268, 8388269, 8388270, 8388271, 8388272, 12328522, 12348124, 12348125, 12348126, 12328526], "trace_timestamp_s": 10.07300000000032, "ttft_s": 3.9484268790110946, "turn_id": 1} +{"actual_output_tokens": 105, "cached_tokens": 0, "effective_input_length": 1093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1093, "latency_s": 0.6269934870069847, "output_length": 105, "proxy_request_id": "1241953:1:1241953:13", "request_id": "1241953:1:1241953:13", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1241953", "t_dispatch_unix": 1779820702.9326797, "t_finish_unix": 1779820703.5596733, "t_first_token_unix": 1779820703.0491686, "tpot_s": 0.0049058204805568, "trace_hash_ids": [12364240, 12364241, 12364242], "trace_timestamp_s": 15.994000000000597, "ttft_s": 0.11648699402576312, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 7587, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7587, "latency_s": 0.7209033890394494, "output_length": 38, "proxy_request_id": "1241942:1:1241942:12", "request_id": "1241942:1:1241942:12", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1241942", "t_dispatch_unix": 1779820702.8857806, "t_finish_unix": 1779820703.6066837, "t_first_token_unix": 1779820703.4179099, "tpot_s": 0.005094587324640235, "trace_hash_ids": [12364172, 12364173, 12364174, 12364175, 12364176, 12364177, 12364178, 12364179, 12364180, 12364181, 12364182, 12364183, 12364184, 12364185, 12364186], "trace_timestamp_s": 15.945000000000618, "ttft_s": 0.5321280020289123, "turn_id": 1} +{"actual_output_tokens": 14, "cached_tokens": 1696, "effective_input_length": 2659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2659, "latency_s": 0.15994893800234422, "output_length": 14, "proxy_request_id": "1237877:3:1242953:15", "request_id": "1237877:3:1242953:15", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1237877", "t_dispatch_unix": 1779820706.317017, "t_finish_unix": 1779820706.4769661, "t_first_token_unix": 1779820706.4141128, "tpot_s": 0.004806663536538298, "trace_hash_ids": [12325182, 12342035, 12342036, 12357464, 12373319, 12373320], "trace_timestamp_s": 19.379000000000815, "ttft_s": 0.09709416498662904, "turn_id": 3} +{"actual_output_tokens": 155, "cached_tokens": 0, "effective_input_length": 17157, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17157, "latency_s": 2.591828341013752, "output_length": 155, "proxy_request_id": "1242838:1:1242838:14", "request_id": "1242838:1:1242838:14", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1242838", "t_dispatch_unix": 1779820705.9375904, "t_finish_unix": 1779820708.5294187, "t_first_token_unix": 1779820707.6427817, "tpot_s": 0.005754968941789241, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275], "trace_timestamp_s": 18.993000000000393, "ttft_s": 1.705188947962597, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 5232, "effective_input_length": 14812, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14812, "latency_s": 1.1905996730201878, "output_length": 23, "proxy_request_id": "1239704:2:1243943:17", "request_id": "1239704:2:1243943:17", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1239704", "t_dispatch_unix": 1779820709.5954077, "t_finish_unix": 1779820710.7860074, "t_first_token_unix": 1779820710.6753166, "tpot_s": 0.005017042181200602, "trace_hash_ids": [12325298, 12325299, 12325300, 12325301, 12325302, 12325303, 12325304, 12335875, 12343073, 12343074, 12353398, 12353399, 12353400, 12353401, 12353402, 12362248, 12362249, 12362250, 12362251, 12362252, 12362253, 12374360, 12374361, 12374362, 12374363, 12374364, 12382332, 12382333, 12382334], "trace_timestamp_s": 22.65400000000045, "ttft_s": 1.0799068720079958, "turn_id": 2} +{"actual_output_tokens": 264, "cached_tokens": 0, "effective_input_length": 11074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11074, "latency_s": 2.423360049026087, "output_length": 264, "proxy_request_id": "1243831:1:1243831:16", "request_id": "1243831:1:1243831:16", "request_type": "coder", "requested_output_tokens": 264, "session_id": "1243831", "t_dispatch_unix": 1779820709.194454, "t_finish_unix": 1779820711.6178136, "t_first_token_unix": 1779820710.1381562, "tpot_s": 0.005624970806073822, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12381653], "trace_timestamp_s": 22.252000000000407, "ttft_s": 0.9437003880157135, "turn_id": 1} +{"actual_output_tokens": 2204, "cached_tokens": 13568, "effective_input_length": 18420, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18420, "latency_s": 13.966384097991977, "output_length": 2204, "proxy_request_id": "1239034:2:1240558:10", "request_id": "1239034:2:1240558:10", "request_type": "coder", "requested_output_tokens": 2204, "session_id": "1239034", "t_dispatch_unix": 1779820698.2621353, "t_finish_unix": 1779820712.228519, "t_first_token_unix": 1779820698.977412, "tpot_s": 0.00601486786699013, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445], "trace_timestamp_s": 11.321000000000822, "ttft_s": 0.7152740320307203, "turn_id": 2} +{"actual_output_tokens": 86, "cached_tokens": 0, "effective_input_length": 66214, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66214, "latency_s": 16.55225047102431, "output_length": 86, "proxy_request_id": "1239755:1:1239755:8", "request_id": "1239755:1:1239755:8", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1239755", "t_dispatch_unix": 1779820695.6958275, "t_finish_unix": 1779820712.2480774, "t_first_token_unix": 1779820711.5850847, "tpot_s": 0.007796855623532525, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12343455, 6866241, 2853774, 6866242, 7163, 7164, 7165, 7166, 7167, 7168, 7169, 7170, 7171, 7172, 7173, 7174, 7175, 7176, 7177, 7178, 7179, 7180, 7181, 7182, 7183, 7184, 6866243, 6866244, 6866245, 6866246, 6866247, 6866248, 6866249, 6866250, 6866251, 6866252, 6866253, 6866254, 6866255, 6866256, 6866257, 8545375, 8556763, 8697639, 8697640, 8697641, 8697642, 8697643, 8697644, 8801955, 9096778, 9096779, 9096780, 9096781, 9096782, 9096783, 9096784, 9096785, 9096786, 9149397, 9149398, 9362937, 9625264, 9969708, 9969709, 9969710, 9969711, 9969712, 10041460, 11312552, 11312553, 11312554, 11312555, 11312556, 11738834, 11738835, 11738836, 11738837, 11817307, 11870242, 11870243, 12068422, 12068423, 12068424, 12068425, 12068426, 12068427, 12068428, 12068429, 12180426, 12180427, 12343456, 12343457], "trace_timestamp_s": 8.731000000000677, "ttft_s": 15.889254292997066, "turn_id": 1} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 8274, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8274, "latency_s": 0.7953854459919967, "output_length": 40, "proxy_request_id": "1244640:1:1244640:18", "request_id": "1244640:1:1244640:18", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1244640", "t_dispatch_unix": 1779820712.0898728, "t_finish_unix": 1779820712.8852582, "t_first_token_unix": 1779820712.686224, "tpot_s": 0.0050967966925758775, "trace_hash_ids": [12346349, 12346350, 12346351, 12346352, 12346353, 12346354, 12346355, 12353250, 12363902, 12363903, 12363904, 12370522, 12389149, 12389150, 12389151, 12389152, 12389153], "trace_timestamp_s": 25.149000000000342, "ttft_s": 0.5963491880102083, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 0, "effective_input_length": 6109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6109, "latency_s": 0.9392378589836881, "output_length": 49, "proxy_request_id": "1245572:1:1245572:19", "request_id": "1245572:1:1245572:19", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1245572", "t_dispatch_unix": 1779820715.2247863, "t_finish_unix": 1779820716.164024, "t_first_token_unix": 1779820715.9241805, "tpot_s": 0.004991305083725213, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667], "trace_timestamp_s": 28.282000000000153, "ttft_s": 0.6993920889799483, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 1184, "effective_input_length": 10382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10382, "latency_s": 0.9827105079893954, "output_length": 36, "proxy_request_id": "1241953:2:1245624:20", "request_id": "1241953:2:1245624:20", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1241953", "t_dispatch_unix": 1779820715.3147888, "t_finish_unix": 1779820716.2974994, "t_first_token_unix": 1779820716.1158023, "tpot_s": 0.005184136370995215, "trace_hash_ids": [12364240, 12364241, 12380769, 12380770, 12380771, 12380772, 12380773, 12380774, 12380775, 12380776, 12380777, 12380778, 12398115, 12398116, 12398117, 12398118, 12398119, 12398120, 12398121, 12398122, 12398123], "trace_timestamp_s": 28.373000000000502, "ttft_s": 0.8010120970429853, "turn_id": 2} +{"actual_output_tokens": 36, "cached_tokens": 6144, "effective_input_length": 6182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6182, "latency_s": 0.21015171299222857, "output_length": 36, "proxy_request_id": "1245572:2:1246348:22", "request_id": "1245572:2:1246348:22", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1245572", "t_dispatch_unix": 1779820717.821156, "t_finish_unix": 1779820718.0313077, "t_first_token_unix": 1779820717.855374, "tpot_s": 0.0050162991725041396, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667, 12405800], "trace_timestamp_s": 30.882000000000517, "ttft_s": 0.03421520296251401, "turn_id": 2} +{"actual_output_tokens": 66, "cached_tokens": 7456, "effective_input_length": 17447, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17447, "latency_s": 1.588402289955411, "output_length": 66, "proxy_request_id": "1240924:2:1246244:21", "request_id": "1240924:2:1246244:21", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1240924", "t_dispatch_unix": 1779820717.4467058, "t_finish_unix": 1779820719.0351083, "t_first_token_unix": 1779820718.668253, "tpot_s": 0.005638359400192992, "trace_hash_ids": [12342008, 12342009, 12342010, 12342011, 12342012, 12342013, 12342014, 12342015, 12342016, 12342017, 12342018, 12342019, 12354472, 12354473, 12365097, 12370962, 12370963, 12370964, 12370965, 12378987, 12378988, 12378989, 12378990, 12384895, 12384896, 12384897, 12384898, 12393889, 12393890, 12393891, 12404797, 12404798, 12404799, 12404800, 12404801], "trace_timestamp_s": 30.502000000000407, "ttft_s": 1.2215449449722655, "turn_id": 2} +{"actual_output_tokens": 35, "cached_tokens": 7616, "effective_input_length": 17975, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17975, "latency_s": 1.4810600379714742, "output_length": 35, "proxy_request_id": "1241942:2:1247111:23", "request_id": "1241942:2:1247111:23", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1241942", "t_dispatch_unix": 1779820720.492962, "t_finish_unix": 1779820721.9740214, "t_first_token_unix": 1779820721.7970557, "tpot_s": 0.005196029705556986, "trace_hash_ids": [12364172, 12364173, 12364174, 12364175, 12364176, 12364177, 12364178, 12364179, 12364180, 12364181, 12364182, 12364183, 12364184, 12364185, 12370891, 12379261, 12379262, 12379263, 12379264, 12386129, 12386130, 12386131, 12386132, 12386133, 12391712, 12391713, 12391714, 12391715, 12398819, 12398820, 12398821, 12398822, 12412294, 12412295, 12412296, 12412297], "trace_timestamp_s": 33.54899999999998, "ttft_s": 1.3040909609990194, "turn_id": 2} +{"actual_output_tokens": 11, "cached_tokens": 8304, "effective_input_length": 10696, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10696, "latency_s": 0.3698908649967052, "output_length": 11, "proxy_request_id": "1244640:2:1247941:24", "request_id": "1244640:2:1247941:24", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1244640", "t_dispatch_unix": 1779820723.3092036, "t_finish_unix": 1779820723.6790943, "t_first_token_unix": 1779820723.6338058, "tpot_s": 0.004439860803540796, "trace_hash_ids": [12421739, 12421740, 12421741, 12421742, 12421743, 12421744, 12421745, 12421746, 12421747, 12421748, 12421749, 12421750, 12421751, 12421752, 12421753, 12421754, 12421755, 12421756, 12421757, 12421758, 12421759], "trace_timestamp_s": 36.365999999999985, "ttft_s": 0.3246000469662249, "turn_id": 2} +{"actual_output_tokens": 49, "cached_tokens": 0, "effective_input_length": 11515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11515, "latency_s": 1.233560353051871, "output_length": 49, "proxy_request_id": "1248768:1:1248768:25", "request_id": "1248768:1:1248768:25", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1248768", "t_dispatch_unix": 1779820726.0875015, "t_finish_unix": 1779820727.3210614, "t_first_token_unix": 1779820727.0649302, "tpot_s": 0.005329769541276619, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12429472], "trace_timestamp_s": 39.14500000000044, "ttft_s": 0.977426819037646, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 4126, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4126, "latency_s": 0.4279431830509566, "output_length": 34, "proxy_request_id": "1249058:1:1249058:26", "request_id": "1249058:1:1249058:26", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1249058", "t_dispatch_unix": 1779820727.1099064, "t_finish_unix": 1779820727.5378497, "t_first_token_unix": 1779820727.3745015, "tpot_s": 0.0049413730916002705, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12432334], "trace_timestamp_s": 40.17100000000028, "ttft_s": 0.26459237502422184, "turn_id": 1} +{"actual_output_tokens": 85, "cached_tokens": 11552, "effective_input_length": 12188, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12188, "latency_s": 0.6044955589459278, "output_length": 85, "proxy_request_id": "1248768:2:1249765:27", "request_id": "1248768:2:1249765:27", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1248768", "t_dispatch_unix": 1779820729.3729556, "t_finish_unix": 1779820729.9774501, "t_first_token_unix": 1779820729.519744, "tpot_s": 0.0054454817623731545, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396], "trace_timestamp_s": 42.43299999999999, "ttft_s": 0.14678699296200648, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 4144, "effective_input_length": 7482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7482, "latency_s": 0.44457964901812375, "output_length": 26, "proxy_request_id": "1249058:2:1249872:28", "request_id": "1249058:2:1249872:28", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1249058", "t_dispatch_unix": 1779820729.764891, "t_finish_unix": 1779820730.2094703, "t_first_token_unix": 1779820730.0845015, "tpot_s": 0.004987175720743835, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12440459, 12440460, 12440461, 12440462, 12440463, 12440464, 12440465], "trace_timestamp_s": 42.82600000000002, "ttft_s": 0.3196094899903983, "turn_id": 2} +{"actual_output_tokens": 83, "cached_tokens": 17296, "effective_input_length": 21578, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21578, "latency_s": 1.201753229019232, "output_length": 83, "proxy_request_id": "1242838:2:1250503:29", "request_id": "1242838:2:1250503:29", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1242838", "t_dispatch_unix": 1779820732.0385113, "t_finish_unix": 1779820733.2402642, "t_first_token_unix": 1779820732.7582412, "tpot_s": 0.005858800670688563, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12446387], "trace_timestamp_s": 45.09700000000066, "ttft_s": 0.7197279949905351, "turn_id": 2} +{"actual_output_tokens": 297, "cached_tokens": 0, "effective_input_length": 6829, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6829, "latency_s": 2.5574392080307007, "output_length": 297, "proxy_request_id": "1250772:1:1250772:30", "request_id": "1250772:1:1250772:30", "request_type": "coder", "requested_output_tokens": 297, "session_id": "1250772", "t_dispatch_unix": 1779820732.9003415, "t_finish_unix": 1779820735.4577804, "t_first_token_unix": 1779820733.890229, "tpot_s": 0.005294766094585931, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12449313], "trace_timestamp_s": 45.960000000000036, "ttft_s": 0.9898849760065787, "turn_id": 1} +{"actual_output_tokens": 1, "cached_tokens": 0, "effective_input_length": 16512, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16512, "latency_s": 1.5663954420015216, "output_length": 1, "proxy_request_id": "1251059:1:1251059:32", "request_id": "1251059:1:1251059:32", "request_type": "coder", "requested_output_tokens": 1, "session_id": "1251059", "t_dispatch_unix": 1779820734.0809903, "t_finish_unix": 1779820735.6473851, "t_first_token_unix": 1779820735.6467438, "tpot_s": 0.0, "trace_hash_ids": [7062, 7063, 7064, 7065, 7066, 7067, 7068, 7069, 7070, 7071, 7072, 7073, 7074, 7075, 7076, 7077, 7078, 7079, 7080, 7081, 7082, 7083, 7084, 7085, 490787, 490788, 490789, 585565, 585566, 8073040, 572419, 572420, 572421], "trace_timestamp_s": 47.137000000000626, "ttft_s": 1.5657521180110052, "turn_id": 1} +{"actual_output_tokens": 167, "cached_tokens": 12272, "effective_input_length": 16989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16989, "latency_s": 1.647954820015002, "output_length": 167, "proxy_request_id": "1248768:3:1251261:33", "request_id": "1248768:3:1251261:33", "request_type": "coder", "requested_output_tokens": 167, "session_id": "1248768", "t_dispatch_unix": 1779820734.6573274, "t_finish_unix": 1779820736.3052819, "t_first_token_unix": 1779820735.3473973, "tpot_s": 0.005768434036206117, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396, 12454154, 12454155, 12454156, 12454157, 12454158, 12454159, 12454160, 12454161, 12454162, 12454163], "trace_timestamp_s": 47.715000000000146, "ttft_s": 0.6900682330015115, "turn_id": 3} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 1090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1090, "latency_s": 0.19544596696505323, "output_length": 23, "proxy_request_id": "1251828:1:1251828:35", "request_id": "1251828:1:1251828:35", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1251828", "t_dispatch_unix": 1779820736.587007, "t_finish_unix": 1779820736.782453, "t_first_token_unix": 1779820736.6762915, "tpot_s": 0.00481267313642258, "trace_hash_ids": [12459863, 12459864, 12459865], "trace_timestamp_s": 49.64900000000034, "ttft_s": 0.08928333298536018, "turn_id": 1} +{"actual_output_tokens": 211, "cached_tokens": 0, "effective_input_length": 20086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20086, "latency_s": 3.3256418480305, "output_length": 211, "proxy_request_id": "1250935:1:1250935:31", "request_id": "1250935:1:1250935:31", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1250935", "t_dispatch_unix": 1779820733.523141, "t_finish_unix": 1779820736.8487823, "t_first_token_unix": 1779820735.6124818, "tpot_s": 0.005885947971338673, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 59796, 4849633, 12365971, 12450880, 12450881, 12450882, 12450883, 12450884, 12450885, 12450886, 12450887, 12450888, 12450889, 12450890, 12450891, 12450892, 603588], "trace_timestamp_s": 46.577000000000226, "ttft_s": 2.089339131023735, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 6208, "effective_input_length": 13780, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13780, "latency_s": 1.0225528570008464, "output_length": 42, "proxy_request_id": "1245572:3:1251662:34", "request_id": "1245572:3:1251662:34", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1245572", "t_dispatch_unix": 1779820736.0664513, "t_finish_unix": 1779820737.0890038, "t_first_token_unix": 1779820736.86893, "tpot_s": 0.005360001634249873, "trace_hash_ids": [12397656, 12397657, 12397658, 12397659, 12397660, 12397661, 12397662, 12397663, 12397664, 12397665, 12397666, 12397667, 12411607, 12411608, 12419790, 12419791, 12419792, 12419793, 12419794, 12438738, 12438739, 12438740, 12447608, 12447609, 12458533, 12458534, 12458535], "trace_timestamp_s": 49.126000000000204, "ttft_s": 0.8024772959761322, "turn_id": 3} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 9855, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9855, "latency_s": 0.9836503329570405, "output_length": 34, "proxy_request_id": "1252010:1:1252010:36", "request_id": "1252010:1:1252010:36", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1252010", "t_dispatch_unix": 1779820737.1947098, "t_finish_unix": 1779820738.17836, "t_first_token_unix": 1779820738.0092168, "tpot_s": 0.005116681453673113, "trace_hash_ids": [12424913, 12432715, 12432716, 12432717, 12440818, 12440819, 12440820, 12440821, 12452285, 12452286, 12452287, 12452288, 12452289, 12452290, 12452291, 12461892, 12461893, 12461894, 12461895, 12461896], "trace_timestamp_s": 50.25300000000061, "ttft_s": 0.8145046390127391, "turn_id": 1} +{"actual_output_tokens": 501, "cached_tokens": 17152, "effective_input_length": 17309, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17309, "latency_s": 3.0046973829739727, "output_length": 501, "proxy_request_id": "1248768:4:1253385:37", "request_id": "1248768:4:1253385:37", "request_type": "coder", "requested_output_tokens": 501, "session_id": "1248768", "t_dispatch_unix": 1779820741.9683979, "t_finish_unix": 1779820744.9730947, "t_first_token_unix": 1779820742.054466, "tpot_s": 0.005836701762047597, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 58774, 12408861, 12408862, 12408863, 12429471, 12439395, 12439396, 12454154, 12454155, 12454156, 12454157, 12454158, 12454159, 12454160, 12454161, 12454162, 12475383], "trace_timestamp_s": 55.02600000000075, "ttft_s": 0.08606643800158054, "turn_id": 4} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 3934, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3934, "latency_s": 0.3906755470088683, "output_length": 30, "proxy_request_id": "1251828:2:1254272:41", "request_id": "1251828:2:1254272:41", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1251828", "t_dispatch_unix": 1779820744.9385812, "t_finish_unix": 1779820745.3292565, "t_first_token_unix": 1779820745.185957, "tpot_s": 0.004930858827469036, "trace_hash_ids": [12459863, 12459864, 12467072, 12467073, 12467074, 12467075, 12477189, 12485024], "trace_timestamp_s": 58.0, "ttft_s": 0.24737463699420914, "turn_id": 2} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 748, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 748, "latency_s": 0.21752842800924554, "output_length": 32, "proxy_request_id": "1254584:1:1254584:42", "request_id": "1254584:1:1254584:42", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1254584", "t_dispatch_unix": 1779820746.071959, "t_finish_unix": 1779820746.289487, "t_first_token_unix": 1779820746.1389968, "tpot_s": 0.004845233677300594, "trace_hash_ids": [12480388, 12487633], "trace_timestamp_s": 59.134000000000015, "ttft_s": 0.0670367429847829, "turn_id": 1} +{"actual_output_tokens": 33, "cached_tokens": 9888, "effective_input_length": 13092, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13092, "latency_s": 0.601544670003932, "output_length": 33, "proxy_request_id": "1252010:2:1254691:43", "request_id": "1252010:2:1254691:43", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1252010", "t_dispatch_unix": 1779820746.5231774, "t_finish_unix": 1779820747.1247222, "t_first_token_unix": 1779820746.959491, "tpot_s": 0.005152678842932801, "trace_hash_ids": [12424913, 12432715, 12432716, 12432717, 12440818, 12440819, 12440820, 12440821, 12452285, 12452286, 12452287, 12452288, 12452289, 12452290, 12452291, 12461892, 12461893, 12461894, 12461895, 12469281, 12469282, 12480858, 12480859, 12488817, 12488818, 12488819], "trace_timestamp_s": 59.58400000000074, "ttft_s": 0.43631215998902917, "turn_id": 2} +{"actual_output_tokens": 410, "cached_tokens": 7120, "effective_input_length": 10764, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10764, "latency_s": 2.6186050950200297, "output_length": 410, "proxy_request_id": "1250772:2:1254198:40", "request_id": "1250772:2:1254198:40", "request_type": "coder", "requested_output_tokens": 410, "session_id": "1250772", "t_dispatch_unix": 1779820744.665786, "t_finish_unix": 1779820747.2843912, "t_first_token_unix": 1779820745.053764, "tpot_s": 0.00545321184840659, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12484460], "trace_timestamp_s": 57.72600000000057, "ttft_s": 0.3879763879813254, "turn_id": 2} +{"actual_output_tokens": 321, "cached_tokens": 0, "effective_input_length": 35221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35221, "latency_s": 7.398806648969185, "output_length": 321, "proxy_request_id": "1253804:1:1253804:39", "request_id": "1253804:1:1253804:39", "request_type": "coder", "requested_output_tokens": 321, "session_id": "1253804", "t_dispatch_unix": 1779820743.554884, "t_finish_unix": 1779820750.9536903, "t_first_token_unix": 1779820748.7645965, "tpot_s": 0.00683993412185373, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114], "trace_timestamp_s": 56.60400000000027, "ttft_s": 5.20970845798729, "turn_id": 1} +{"actual_output_tokens": 58, "cached_tokens": 0, "effective_input_length": 1694, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1694, "latency_s": 0.42554825503611937, "output_length": 58, "proxy_request_id": "1256273:1:1256273:46", "request_id": "1256273:1:1256273:46", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1256273", "t_dispatch_unix": 1779820751.7543886, "t_finish_unix": 1779820752.1799364, "t_first_token_unix": 1779820751.900663, "tpot_s": 0.004894491684369808, "trace_hash_ids": [12492922, 12504484, 12504485, 12504486], "trace_timestamp_s": 64.81600000000071, "ttft_s": 0.1462722690193914, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 11328, "effective_input_length": 11448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11448, "latency_s": 0.49112397100543603, "output_length": 80, "proxy_request_id": "1243831:2:1256324:47", "request_id": "1243831:2:1256324:47", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1243831", "t_dispatch_unix": 1779820751.9181113, "t_finish_unix": 1779820752.4092352, "t_first_token_unix": 1779820751.9769619, "tpot_s": 0.005467697417310474, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12504841], "trace_timestamp_s": 64.98000000000047, "ttft_s": 0.058849264052696526, "turn_id": 2} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 49624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49624, "latency_s": 9.651960065995809, "output_length": 57, "proxy_request_id": "1253743:1:1253743:38", "request_id": "1253743:1:1253743:38", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1253743", "t_dispatch_unix": 1779820743.3098054, "t_finish_unix": 1779820752.961765, "t_first_token_unix": 1779820752.5775597, "tpot_s": 0.006852604945639281, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411], "trace_timestamp_s": 56.35200000000077, "ttft_s": 9.26775074301986, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 7504, "effective_input_length": 17786, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17786, "latency_s": 1.383891228993889, "output_length": 23, "proxy_request_id": "1249058:3:1256222:45", "request_id": "1249058:3:1256222:45", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1249058", "t_dispatch_unix": 1779820751.605458, "t_finish_unix": 1779820752.9893486, "t_first_token_unix": 1779820752.8781328, "tpot_s": 0.005044422546316954, "trace_hash_ids": [12432326, 12432327, 12432328, 12432329, 12432330, 12432331, 12432332, 12432333, 12440459, 12440460, 12440461, 12440462, 12440463, 12440464, 12464529, 12464530, 12464531, 12464532, 12474164, 12474165, 12474166, 12481572, 12481573, 12481574, 12481575, 12481576, 12481577, 12481578, 12494816, 12494817, 12494818, 12494819, 12504084, 12504085, 12504086], "trace_timestamp_s": 64.66300000000047, "ttft_s": 1.2726728789857589, "turn_id": 3} +{"actual_output_tokens": 112, "cached_tokens": 49680, "effective_input_length": 49687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49687, "latency_s": 0.9018225879990496, "output_length": 112, "proxy_request_id": "1253743:2:1256070:44", "request_id": "1253743:2:1256070:44", "request_type": "coder", "requested_output_tokens": 112, "session_id": "1253743", "t_dispatch_unix": 1779820752.9637554, "t_finish_unix": 1779820753.8655782, "t_first_token_unix": 1779820753.0596042, "tpot_s": 0.007258223738366117, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12502790], "trace_timestamp_s": 64.15700000000015, "ttft_s": 0.09584620303940028, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 1744, "effective_input_length": 6170, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6170, "latency_s": 0.6261004480184056, "output_length": 59, "proxy_request_id": "1256273:2:1257769:51", "request_id": "1256273:2:1257769:51", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1256273", "t_dispatch_unix": 1779820756.7361546, "t_finish_unix": 1779820757.362255, "t_first_token_unix": 1779820757.068925, "tpot_s": 0.005051815517021921, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12519481], "trace_timestamp_s": 69.79700000000048, "ttft_s": 0.33276911603752524, "turn_id": 2} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 4434, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4434, "latency_s": 1.5072742460179143, "output_length": 237, "proxy_request_id": "1257572:1:1257572:50", "request_id": "1257572:1:1257572:50", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1257572", "t_dispatch_unix": 1779820756.1039402, "t_finish_unix": 1779820757.6112146, "t_first_token_unix": 1779820756.390432, "tpot_s": 0.005171586762841443, "trace_hash_ids": [12494641, 12494642, 12494643, 12494644, 12494645, 12494646, 12494647, 12516925, 12516926], "trace_timestamp_s": 69.16400000000067, "ttft_s": 0.2864899699925445, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 768, "effective_input_length": 1257, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1257, "latency_s": 0.38464475999353454, "output_length": 68, "proxy_request_id": "1254584:2:1258039:52", "request_id": "1254584:2:1258039:52", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1254584", "t_dispatch_unix": 1779820757.7584085, "t_finish_unix": 1779820758.1430535, "t_first_token_unix": 1779820757.814768, "tpot_s": 0.004895102029402198, "trace_hash_ids": [12480388, 12511291, 12522116], "trace_timestamp_s": 70.82000000000062, "ttft_s": 0.0563576880376786, "turn_id": 2} +{"actual_output_tokens": 92, "cached_tokens": 21648, "effective_input_length": 22262, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22262, "latency_s": 0.710250033007469, "output_length": 92, "proxy_request_id": "1242838:3:1258161:53", "request_id": "1242838:3:1258161:53", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1242838", "t_dispatch_unix": 1779820758.2163904, "t_finish_unix": 1779820758.92664, "t_first_token_unix": 1779820758.3847897, "tpot_s": 0.005951372428111486, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892], "trace_timestamp_s": 71.27700000000004, "ttft_s": 0.1683975729974918, "turn_id": 3} +{"actual_output_tokens": 116, "cached_tokens": 6224, "effective_input_length": 7934, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7934, "latency_s": 0.7952511059702374, "output_length": 116, "proxy_request_id": "1256273:3:1258499:55", "request_id": "1256273:3:1258499:55", "request_type": "coder", "requested_output_tokens": 116, "session_id": "1256273", "t_dispatch_unix": 1779820759.3815436, "t_finish_unix": 1779820760.1767943, "t_first_token_unix": 1779820759.571276, "tpot_s": 0.005262423113352902, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12526397, 12526398, 12526399, 12526400], "trace_timestamp_s": 72.44200000000001, "ttft_s": 0.1897294059745036, "turn_id": 3} +{"actual_output_tokens": 362, "cached_tokens": 0, "effective_input_length": 9250, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9250, "latency_s": 2.6644015329657122, "output_length": 362, "proxy_request_id": "1258908:1:1258908:58", "request_id": "1258908:1:1258908:58", "request_type": "coder", "requested_output_tokens": 362, "session_id": "1258908", "t_dispatch_unix": 1779820760.8341432, "t_finish_unix": 1779820763.498545, "t_first_token_unix": 1779820761.5348322, "tpot_s": 0.005438377296454028, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 12530208, 12530209, 12530210, 12530211], "trace_timestamp_s": 73.89300000000003, "ttft_s": 0.7006860859692097, "turn_id": 1} +{"actual_output_tokens": 341, "cached_tokens": 0, "effective_input_length": 14291, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14291, "latency_s": 3.1812958419905044, "output_length": 341, "proxy_request_id": "1259178:1:1259178:59", "request_id": "1259178:1:1259178:59", "request_type": "coder", "requested_output_tokens": 341, "session_id": "1259178", "t_dispatch_unix": 1779820761.7949865, "t_finish_unix": 1779820764.9762821, "t_first_token_unix": 1779820763.049454, "tpot_s": 0.005666375367710476, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319], "trace_timestamp_s": 74.85200000000077, "ttft_s": 1.2544662929722108, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 27387, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27387, "latency_s": 9.10408998397179, "output_length": 45, "proxy_request_id": "1257525:1:1257525:49", "request_id": "1257525:1:1257525:49", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1257525", "t_dispatch_unix": 1779820756.0156727, "t_finish_unix": 1779820765.1197624, "t_first_token_unix": 1779820759.4906857, "tpot_s": 0.1279238132503286, "trace_hash_ids": [12479517, 12479518, 12479519, 12479520, 12479521, 12479522, 12479523, 12479524, 12479525, 12479526, 12479527, 12479528, 12479529, 12479530, 12479531, 12479532, 12479533, 12479534, 12479535, 12479536, 12479537, 12479538, 12479539, 12479540, 12479541, 12479542, 12479543, 12479544, 12479545, 12479546, 12479547, 12479548, 12479549, 12479550, 12479551, 12479552, 12479553, 12479554, 12479555, 12479556, 12479557, 12479558, 12479559, 12479560, 12479561, 12479562, 12479563, 12499990, 12499991, 12509015, 12516559, 12516560, 12516561, 12516562], "trace_timestamp_s": 69.06500000000051, "ttft_s": 3.475010089983698, "turn_id": 1} +{"actual_output_tokens": 110, "cached_tokens": 35536, "effective_input_length": 52978, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52978, "latency_s": 6.750234550971072, "output_length": 110, "proxy_request_id": "1253804:2:1258346:54", "request_id": "1253804:2:1258346:54", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1253804", "t_dispatch_unix": 1779820758.922226, "t_finish_unix": 1779820765.67246, "t_first_token_unix": 1779820764.760909, "tpot_s": 0.008360162834474527, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968], "trace_timestamp_s": 71.97700000000077, "ttft_s": 5.83867906400701, "turn_id": 2} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 9571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9571, "latency_s": 1.1347017919761129, "output_length": 73, "proxy_request_id": "1260746:1:1260746:62", "request_id": "1260746:1:1260746:62", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1260746", "t_dispatch_unix": 1779820767.340251, "t_finish_unix": 1779820768.4749525, "t_first_token_unix": 1779820768.0904245, "tpot_s": 0.0053370362640837105, "trace_hash_ids": [12532255, 12532256, 12532257, 12532258, 12532259, 12532260, 12538543, 12538544, 12538545, 12547747, 12547748, 12547749, 12547750, 12547751, 12547752, 12547753, 12547754, 12547755, 12547756], "trace_timestamp_s": 80.39699999999993, "ttft_s": 0.7501721479929984, "turn_id": 1} +{"actual_output_tokens": 62, "cached_tokens": 0, "effective_input_length": 12522, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12522, "latency_s": 1.3623814010061324, "output_length": 62, "proxy_request_id": "1260792:1:1260792:63", "request_id": "1260792:1:1260792:63", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1260792", "t_dispatch_unix": 1779820767.455346, "t_finish_unix": 1779820768.8177273, "t_first_token_unix": 1779820768.4875243, "tpot_s": 0.005408691704181619, "trace_hash_ids": [12518548, 12518549, 12518550, 12528577, 12528578, 12528579, 12538129, 12538130, 12538131, 12538132, 12538133, 12538134, 12538135, 12538136, 12538137, 12538138, 12548530, 12548531, 12548532, 12548533, 12548534, 12548535, 12548536, 12548537, 12548538], "trace_timestamp_s": 80.51299999999992, "ttft_s": 1.0321766000124626, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 5640, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5640, "latency_s": 0.5373633949784562, "output_length": 34, "proxy_request_id": "1261126:1:1261126:65", "request_id": "1261126:1:1261126:65", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1261126", "t_dispatch_unix": 1779820768.4930437, "t_finish_unix": 1779820769.0304072, "t_first_token_unix": 1779820768.8681052, "tpot_s": 0.0049103318173861635, "trace_hash_ids": [12523217, 12523218, 12542338, 12542339, 12542340, 12542341, 12550806, 12550807, 12550808, 12550809, 12550810, 12550811], "trace_timestamp_s": 81.5530000000008, "ttft_s": 0.3750596729805693, "turn_id": 1} +{"actual_output_tokens": 79, "cached_tokens": 53072, "effective_input_length": 55138, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55138, "latency_s": 1.4673314590472728, "output_length": 79, "proxy_request_id": "1253804:3:1260997:64", "request_id": "1253804:3:1260997:64", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1253804", "t_dispatch_unix": 1779820768.1893282, "t_finish_unix": 1779820769.6566594, "t_first_token_unix": 1779820769.0845606, "tpot_s": 0.007330812602632273, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987], "trace_timestamp_s": 81.2490000000007, "ttft_s": 0.895229960035067, "turn_id": 3} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 30655, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30655, "latency_s": 4.696912785002496, "output_length": 101, "proxy_request_id": "1260327:1:1260327:61", "request_id": "1260327:1:1260327:61", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1260327", "t_dispatch_unix": 1779820765.617371, "t_finish_unix": 1779820770.3142836, "t_first_token_unix": 1779820769.6758738, "tpot_s": 0.006381540059810504, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103], "trace_timestamp_s": 78.66800000000057, "ttft_s": 4.058501232007984, "turn_id": 1} +{"actual_output_tokens": 9, "cached_tokens": 27424, "effective_input_length": 29988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29988, "latency_s": 0.662923978001345, "output_length": 9, "proxy_request_id": "1257525:2:1262205:67", "request_id": "1257525:2:1262205:67", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1257525", "t_dispatch_unix": 1779820772.307404, "t_finish_unix": 1779820772.970328, "t_first_token_unix": 1779820772.9430254, "tpot_s": 0.0033740189974196255, "trace_hash_ids": [12560509, 12560510, 12560511, 12560512, 12560513, 12560514, 12560515, 12560516, 12560517, 12560518, 12560519, 12560520, 12560521, 12560522, 12560523, 12560524, 12560525, 12560526, 12560527, 12560528, 12560529, 12560530, 12560531, 12560532, 12560533, 12560534, 12560535, 12560536, 12560537, 12560538, 12560539, 12560540, 12560541, 12560542, 12560543, 12560544, 12560545, 12560546, 12560547, 12560548, 12560549, 12560550, 12560551, 12560552, 12560553, 12560554, 12560555, 12560556, 12560557, 12560558, 12560559, 12560560, 12560561, 12560562, 12560563, 12560564, 12560565, 12560566, 12560567], "trace_timestamp_s": 85.35500000000047, "ttft_s": 0.6356190349906683, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 5465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5465, "latency_s": 0.4912472809664905, "output_length": 27, "proxy_request_id": "1262757:1:1262757:73", "request_id": "1262757:1:1262757:73", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1262757", "t_dispatch_unix": 1779820774.1887217, "t_finish_unix": 1779820774.6799688, "t_first_token_unix": 1779820774.5519671, "tpot_s": 0.004912255846787817, "trace_hash_ids": [12513740, 12528866, 12528867, 12537233, 12537234, 12537235, 12547253, 12557610, 12557611, 12557612, 12566807], "trace_timestamp_s": 87.2490000000007, "ttft_s": 0.36324444197816774, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 5664, "effective_input_length": 6953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6953, "latency_s": 0.38947331201052293, "output_length": 46, "proxy_request_id": "1261126:2:1262820:74", "request_id": "1261126:2:1262820:74", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1261126", "t_dispatch_unix": 1779820774.3610594, "t_finish_unix": 1779820774.7505324, "t_first_token_unix": 1779820774.5174994, "tpot_s": 0.005172831043859737, "trace_hash_ids": [12523217, 12523218, 12542338, 12542339, 12542340, 12542341, 12550806, 12550807, 12550808, 12550809, 12550810, 12557298, 12567376, 12567377], "trace_timestamp_s": 87.42200000000048, "ttft_s": 0.156439095037058, "turn_id": 2} +{"actual_output_tokens": 101, "cached_tokens": 0, "effective_input_length": 21510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21510, "latency_s": 2.9039223410072736, "output_length": 101, "proxy_request_id": "1262354:1:1262354:69", "request_id": "1262354:1:1262354:69", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1262354", "t_dispatch_unix": 1779820772.9039047, "t_finish_unix": 1779820775.8078272, "t_first_token_unix": 1779820775.2154067, "tpot_s": 0.005921610710211098, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12562242], "trace_timestamp_s": 85.95800000000054, "ttft_s": 2.311499870964326, "turn_id": 1} +{"actual_output_tokens": 139, "cached_tokens": 0, "effective_input_length": 68131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68131, "latency_s": 17.509852939052507, "output_length": 139, "proxy_request_id": "1258611:1:1258611:56", "request_id": "1258611:1:1258611:56", "request_type": "coder", "requested_output_tokens": 139, "session_id": "1258611", "t_dispatch_unix": 1779820759.7693596, "t_finish_unix": 1779820777.2792122, "t_first_token_unix": 1779820776.1461048, "tpot_s": 0.008208777362386278, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 72.80500000000029, "ttft_s": 16.376742518041283, "turn_id": 1} +{"actual_output_tokens": 10, "cached_tokens": 68256, "effective_input_length": 68320, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68320, "latency_s": 0.24195619102101773, "output_length": 10, "proxy_request_id": "1258611:2:1261594:66", "request_id": "1258611:2:1261594:66", "request_type": "coder", "requested_output_tokens": 10, "session_id": "1258611", "t_dispatch_unix": 1779820777.2824056, "t_finish_unix": 1779820777.5243616, "t_first_token_unix": 1779820777.4829936, "tpot_s": 0.004559732333291322, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 83.19100000000071, "ttft_s": 0.20058541203616187, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 68320, "effective_input_length": 68377, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68377, "latency_s": 0.5844688609940931, "output_length": 55, "proxy_request_id": "1258611:3:1262709:71", "request_id": "1258611:3:1262709:71", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1258611", "t_dispatch_unix": 1779820777.5287008, "t_finish_unix": 1779820778.11317, "t_first_token_unix": 1779820777.7144415, "tpot_s": 0.007378994980913207, "trace_hash_ids": [41795, 129659, 129660, 129661, 129662, 129663, 129664, 129665, 129666, 129667, 129668, 129669, 129670, 129671, 129672, 129673, 129674, 129675, 129676, 129677, 129678, 129679, 129680, 129681, 129682, 129683, 129684, 129685, 129686, 129687, 129688, 129689, 129690, 129691, 129692, 129693, 129694, 129695, 129696, 129697, 129698, 129699, 129700, 129701, 129702, 129703, 129704, 129705, 129706, 129707, 129708, 129709, 129710, 129711, 129712, 129713, 129714, 129715, 129716, 129717, 129718, 129719, 129720, 129721, 129722, 129723, 129724, 129725, 129726, 416576, 416577, 416578, 416579, 416580, 416581, 416582, 416583, 416584, 416585, 646369, 12527337, 646371, 646372, 646373, 646374, 646375, 12527338, 957044, 957045, 12527339, 12527340, 12527341, 12527342, 12527343, 12527344, 12527345, 12527346, 12527347, 12527348, 12527349, 12527350, 12527351, 12527352, 12527353, 12527354, 12527355, 12527356, 12527357, 12527358, 12527359, 12527360, 12527361, 12527362, 12527363, 12527364, 12527365, 12527366, 12527367, 12527368, 12527369, 12527370, 12527371, 12527372, 12527373, 12527374, 12527375, 12527376, 12527377, 12527378, 12527379, 12527380, 12527381, 12527382, 12527383], "trace_timestamp_s": 87.12800000000061, "ttft_s": 0.18573146703420207, "turn_id": 3} +{"actual_output_tokens": 76, "cached_tokens": 0, "effective_input_length": 5990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5990, "latency_s": 0.7842526689637452, "output_length": 76, "proxy_request_id": "1263611:1:1263611:76", "request_id": "1263611:1:1263611:76", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1263611", "t_dispatch_unix": 1779820777.3811293, "t_finish_unix": 1779820778.165382, "t_first_token_unix": 1779820777.7807705, "tpot_s": 0.005125170866958797, "trace_hash_ids": [12565267, 12565268, 12565269, 12565270, 12574728, 12574729, 12574730, 12574731, 12574732, 12574733, 12574734, 12574735], "trace_timestamp_s": 90.44100000000071, "ttft_s": 0.3996388749801554, "turn_id": 1} +{"actual_output_tokens": 202, "cached_tokens": 21600, "effective_input_length": 22109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22109, "latency_s": 1.3703778500203043, "output_length": 202, "proxy_request_id": "1262354:2:1263593:75", "request_id": "1262354:2:1263593:75", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1262354", "t_dispatch_unix": 1779820777.2680223, "t_finish_unix": 1779820778.6384, "t_first_token_unix": 1779820777.4264548, "tpot_s": 0.006028239134251979, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12574479], "trace_timestamp_s": 90.32900000000063, "ttft_s": 0.1584302670089528, "turn_id": 2} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 6336, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6336, "latency_s": 0.7780403450015001, "output_length": 71, "proxy_request_id": "1263971:1:1263971:80", "request_id": "1263971:1:1263971:80", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1263971", "t_dispatch_unix": 1779820778.6917467, "t_finish_unix": 1779820779.4697871, "t_first_token_unix": 1779820779.1118238, "tpot_s": 0.005109347671636247, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12579286], "trace_timestamp_s": 91.7510000000002, "ttft_s": 0.42007582198129967, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 0, "effective_input_length": 90488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90488, "latency_s": 27.994021442951635, "output_length": 42, "proxy_request_id": "1257323:1:1257323:48", "request_id": "1257323:1:1257323:48", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1257323", "t_dispatch_unix": 1779820755.4076192, "t_finish_unix": 1779820783.4016402, "t_first_token_unix": 1779820783.006633, "tpot_s": 0.009627142049394912, "trace_hash_ids": [2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518, 46994, 46995, 46996, 46997, 46998, 46999, 47000, 47001, 47002, 47003, 47004, 47005, 47006, 47007, 47008, 47009, 47010, 47011, 47012, 4751454, 2379937, 2379938, 2379939, 2379940, 2379941, 4751455, 4751456, 4751457, 4751458, 4751459, 4751460, 4751461, 4751462, 4751463, 4751464, 4751465, 4751466, 4751467, 4751468, 4751469, 4751470, 4751471, 4751472, 4751473, 4751474, 4751475, 4751476, 4751477, 4751478, 4751479, 4751480, 4751481, 4751482, 4751483, 4751484, 4751485, 10670236, 10670237, 10670238, 10670239, 10670240, 10670241, 10670242, 10670243, 10670244, 10670245, 10670246, 10670247, 10670248, 10670249, 10670250, 10670251, 10670252, 10670253, 10670254, 10670255, 10670256, 10670257, 10670258, 10670259, 10670260, 10670261, 10994656, 10994657, 10994658, 10994659, 10994660, 10994661, 10994662, 10994663, 10994664, 10994665, 10994666, 10994667, 10994668, 10994669, 10994670, 10994671, 10994672, 10994673, 10994674, 10994675, 10994676, 10994677, 10994678, 10994679, 10994680, 10994681, 10994682, 10994683, 10994684, 10994685, 10994686, 10994687, 10994688, 10994689, 10994690, 10994691, 10994692, 10994693, 10994694, 10994695, 10994696, 10994697, 10994698, 10994699, 10994700, 10994701, 10994702, 10994703, 10994704, 10994705, 10994706, 10994707, 10994708, 10994709, 10994710, 10994711, 10994712, 10994713, 10994714, 10994715, 10994716, 10994717, 10994718, 10994719, 10994720, 10994721, 10994722, 10994723, 10994724, 10994725, 10994726, 10994727, 11134572, 11161915, 11261064, 11282181, 11360636, 11420052, 11420053, 11446131, 11701929, 12264742, 12297965, 12385798, 12385799, 12514819, 12514820], "trace_timestamp_s": 68.43299999999999, "ttft_s": 27.599012148973998, "turn_id": 1} +{"actual_output_tokens": 63, "cached_tokens": 20608, "effective_input_length": 22565, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22565, "latency_s": 10.655526146001648, "output_length": 63, "proxy_request_id": "1239034:3:1262346:68", "request_id": "1239034:3:1262346:68", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1239034", "t_dispatch_unix": 1779820772.8721647, "t_finish_unix": 1779820783.5276906, "t_first_token_unix": 1779820782.993786, "tpot_s": 0.008606805323412823, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445, 12562130, 12562131, 12562132, 12562133, 12562134, 12562135, 12562136, 12562137, 12562138], "trace_timestamp_s": 85.9320000000007, "ttft_s": 10.121619634970557, "turn_id": 3} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 301, "latency_s": 1.5496148180100136, "output_length": 68, "proxy_request_id": "1265000:1:1265000:83", "request_id": "1265000:1:1265000:83", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1265000", "t_dispatch_unix": 1779820782.3180976, "t_finish_unix": 1779820783.867712, "t_first_token_unix": 1779820782.3586667, "tpot_s": 0.0225188947611127, "trace_hash_ids": [12589398], "trace_timestamp_s": 95.38000000000011, "ttft_s": 0.04056838102405891, "turn_id": 1} +{"actual_output_tokens": 77, "cached_tokens": 0, "effective_input_length": 14028, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14028, "latency_s": 1.6434186060214415, "output_length": 77, "proxy_request_id": "1265128:1:1265128:85", "request_id": "1265128:1:1265128:85", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1265128", "t_dispatch_unix": 1779820782.644694, "t_finish_unix": 1779820784.2881124, "t_first_token_unix": 1779820783.867071, "tpot_s": 0.00553671905302173, "trace_hash_ids": [12531602, 12531603, 12531604, 12531605, 12531606, 12531607, 12531608, 12531609, 12531610, 12531611, 12531612, 12531613, 12531614, 12531615, 12531616, 12531617, 12544382, 12544383, 12544384, 12557454, 12557455, 12557456, 12557457, 12557458, 12590524, 12590525, 12590526, 12590527], "trace_timestamp_s": 95.70100000000002, "ttft_s": 1.2223753120051697, "turn_id": 1} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 579, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 579, "latency_s": 0.36802475596778095, "output_length": 23, "proxy_request_id": "1266067:1:1266067:91", "request_id": "1266067:1:1266067:91", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1266067", "t_dispatch_unix": 1779820785.867872, "t_finish_unix": 1779820786.2358968, "t_first_token_unix": 1779820786.0356803, "tpot_s": 0.00908851313711652, "trace_hash_ids": [12599495, 12599496], "trace_timestamp_s": 98.93000000000029, "ttft_s": 0.16780726797878742, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 13178, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13178, "latency_s": 1.3561191949993372, "output_length": 47, "proxy_request_id": "1263611:2:1265770:88", "request_id": "1263611:2:1265770:88", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1263611", "t_dispatch_unix": 1779820784.9644566, "t_finish_unix": 1779820786.3205755, "t_first_token_unix": 1779820786.077602, "tpot_s": 0.005276441304569902, "trace_hash_ids": [12565267, 12565268, 12565269, 12565270, 12574728, 12574729, 12574730, 12574731, 12574732, 12574733, 12574734, 12587940, 12587941, 12587942, 12587943, 12587944, 12587945, 12587946, 12587947, 12596811, 12596812, 12596813, 12596814, 12596815, 12596816, 12596817], "trace_timestamp_s": 98.02400000000034, "ttft_s": 1.1131438729935326, "turn_id": 2} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 4070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4070, "latency_s": 0.9750323420157656, "output_length": 92, "proxy_request_id": "1265942:1:1265942:89", "request_id": "1265942:1:1265942:89", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1265942", "t_dispatch_unix": 1779820785.5932925, "t_finish_unix": 1779820786.568325, "t_first_token_unix": 1779820785.8720407, "tpot_s": 0.007647233670398306, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596], "trace_timestamp_s": 98.65400000000045, "ttft_s": 0.2787467750022188, "turn_id": 1} +{"actual_output_tokens": 203, "cached_tokens": 0, "effective_input_length": 23540, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23540, "latency_s": 4.282170384016354, "output_length": 203, "proxy_request_id": "1250772:3:1265019:84", "request_id": "1250772:3:1265019:84", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1250772", "t_dispatch_unix": 1779820782.3854759, "t_finish_unix": 1779820786.667646, "t_first_token_unix": 1779820785.0656302, "tpot_s": 0.007929212188101512, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12546417, 12546418, 12546419, 12546420, 12546421, 12546422, 12546423, 12546424, 12546425, 12546426, 12546427, 12546428, 12546429, 12546430, 12546431, 12546432, 12546433, 12546434, 12589516, 12589517, 12589518, 12589519, 12589520, 12589521, 12589522], "trace_timestamp_s": 95.44100000000071, "ttft_s": 2.6801527549978346, "turn_id": 3} +{"actual_output_tokens": 331, "cached_tokens": 22304, "effective_input_length": 22344, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22344, "latency_s": 4.700955480046105, "output_length": 331, "proxy_request_id": "1262354:3:1265178:86", "request_id": "1262354:3:1265178:86", "request_type": "coder", "requested_output_tokens": 331, "session_id": "1262354", "t_dispatch_unix": 1779820782.7519717, "t_finish_unix": 1779820787.4529274, "t_first_token_unix": 1779820785.0686533, "tpot_s": 0.007224237587952027, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12591121], "trace_timestamp_s": 95.8130000000001, "ttft_s": 2.316680310002994, "turn_id": 3} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 5381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5381, "latency_s": 0.8024295089999214, "output_length": 59, "proxy_request_id": "1266440:1:1266440:92", "request_id": "1266440:1:1266440:92", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1266440", "t_dispatch_unix": 1779820786.9410992, "t_finish_unix": 1779820787.7435286, "t_first_token_unix": 1779820787.3007305, "tpot_s": 0.007626970414000018, "trace_hash_ids": [12582173, 12582174, 12582175, 12603412, 12603413, 12603414, 12603415, 12603416, 12603417, 12603418, 12603419], "trace_timestamp_s": 100.0010000000002, "ttft_s": 0.3596296549658291, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 50783, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50783, "latency_s": 9.910051779006608, "output_length": 29, "proxy_request_id": "1263727:1:1263727:77", "request_id": "1263727:1:1263727:77", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1263727", "t_dispatch_unix": 1779820777.8526268, "t_finish_unix": 1779820787.762678, "t_first_token_unix": 1779820787.5894926, "tpot_s": 0.006174954787378998, "trace_hash_ids": [12556738, 12556739, 12556740, 12556741, 12556742, 12556743, 12556744, 12556745, 12556746, 12556747, 12556748, 12556749, 12556750, 12556751, 12556752, 12556753, 12556754, 12556755, 12556756, 12556757, 12556758, 12556759, 12556760, 12556761, 12556762, 12556763, 12556764, 12556765, 12556766, 12556767, 12556768, 12556769, 12556770, 12556771, 12556772, 12556773, 12556774, 12556775, 12556776, 12556777, 12556778, 12556779, 12556780, 12556781, 12556782, 12556783, 12556784, 12556785, 12556786, 12556787, 12556788, 12556789, 12556790, 12556791, 12556792, 12556793, 12556794, 12556795, 12556796, 12556797, 12556798, 12556799, 12556800, 12556801, 12556802, 12556803, 12556804, 12556805, 12556806, 12556807, 12556808, 12556809, 12556810, 12556811, 12556812, 12556813, 12556814, 12556815, 12556816, 12556817, 12556818, 12556819, 12556820, 12556821, 12556822, 12556823, 12556824, 12556825, 12556826, 12556827, 12556828, 12556829, 12556830, 12556831, 12556832, 12556833, 12556834, 12556835, 12575902, 12575903], "trace_timestamp_s": 90.88900000000012, "ttft_s": 9.736864133970812, "turn_id": 1} +{"actual_output_tokens": 1649, "cached_tokens": 55216, "effective_input_length": 55989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55989, "latency_s": 13.883551512029953, "output_length": 1649, "proxy_request_id": "1253804:4:1262690:70", "request_id": "1253804:4:1262690:70", "request_type": "coder", "requested_output_tokens": 1649, "session_id": "1253804", "t_dispatch_unix": 1779820773.9985447, "t_finish_unix": 1779820787.8820953, "t_first_token_unix": 1779820774.4339082, "tpot_s": 0.008160162331902046, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12566184], "trace_timestamp_s": 87.0560000000005, "ttft_s": 0.43536026403307915, "turn_id": 4} +{"actual_output_tokens": 30, "cached_tokens": 6400, "effective_input_length": 9504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9504, "latency_s": 0.5084897860069759, "output_length": 30, "proxy_request_id": "1263971:2:1266797:94", "request_id": "1263971:2:1266797:94", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1263971", "t_dispatch_unix": 1779820788.2894502, "t_finish_unix": 1779820788.7979403, "t_first_token_unix": 1779820788.6463737, "tpot_s": 0.005217913620511134, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12597530, 12597531, 12597532, 12606764, 12606765, 12606766, 12606767], "trace_timestamp_s": 101.35000000000036, "ttft_s": 0.35692208900582045, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 12576, "effective_input_length": 20985, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20985, "latency_s": 5.424592205963563, "output_length": 46, "proxy_request_id": "1260792:2:1265951:90", "request_id": "1260792:2:1265951:90", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1260792", "t_dispatch_unix": 1779820785.6194692, "t_finish_unix": 1779820791.0440614, "t_first_token_unix": 1779820790.5346565, "tpot_s": 0.0113003626672758, "trace_hash_ids": [12598651, 12598652, 12598653, 12598654, 12598655, 12598656, 12598657, 12598658, 12598659, 12598660, 12598661, 12598662, 12598663, 12598664, 12598665, 12598666, 12598667, 12598668, 12598669, 12598670, 12598671, 12598672, 12598673, 12598674, 12598675, 12598676, 12598677, 12598678, 12598679, 12598680, 12598681, 12598682, 12598683, 12598684, 12598685, 12598686, 12598687, 12598688, 12598689, 12598690, 12598691], "trace_timestamp_s": 98.67300000000068, "ttft_s": 4.915185469959397, "turn_id": 2} +{"actual_output_tokens": 143, "cached_tokens": 0, "effective_input_length": 56292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56292, "latency_s": 14.059615947015118, "output_length": 143, "proxy_request_id": "1263749:1:1263749:79", "request_id": "1263749:1:1263749:79", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1263749", "t_dispatch_unix": 1779820777.9180112, "t_finish_unix": 1779820791.9776268, "t_first_token_unix": 1779820789.377106, "tpot_s": 0.018311799337848052, "trace_hash_ids": [51262, 61305, 61306, 637504, 637505, 637506, 637507, 637508, 637509, 637510, 637511, 637512, 637513, 637514, 637515, 637516, 637517, 637518, 637519, 637520, 637521, 637522, 637523, 637524, 637525, 637526, 584014, 637527, 637528, 1022562, 637530, 1022563, 637532, 637533, 248930, 1022564, 4415649, 4415650, 4415651, 12449838, 12449839, 12449840, 12449841, 12449842, 12449843, 12449844, 12449845, 12449846, 12449847, 12449848, 12449849, 12449850, 12449851, 12449852, 12449853, 12449854, 12449855, 12449856, 12449857, 12449858, 12449859, 12449860, 12449861, 12449862, 12449863, 12449864, 12449865, 12449866, 12449867, 12449868, 12449869, 12449870, 12449871, 12449872, 12449873, 12449874, 12449875, 12449876, 12449877, 12449878, 12449879, 12449880, 12449881, 12449882, 12449883, 12449884, 12449885, 12449886, 12449887, 12449888, 12449889, 12449890, 12449891, 12449892, 12449893, 12449894, 12449895, 12449896, 12449897, 12553020, 12553021, 12553022, 12553023, 12553024, 12553025, 12553026, 12553027, 12553028, 12553029, 12553030], "trace_timestamp_s": 90.95900000000074, "ttft_s": 11.459089560026769, "turn_id": 1} +{"actual_output_tokens": 662, "cached_tokens": 0, "effective_input_length": 17466, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17466, "latency_s": 5.562005010026041, "output_length": 662, "proxy_request_id": "1266668:1:1266668:93", "request_id": "1266668:1:1266668:93", "request_type": "coder", "requested_output_tokens": 662, "session_id": "1266668", "t_dispatch_unix": 1779820787.8399847, "t_finish_unix": 1779820793.4019897, "t_first_token_unix": 1779820789.5527635, "tpot_s": 0.0058229152162865075, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12605179], "trace_timestamp_s": 100.89699999999993, "ttft_s": 1.7127766430494376, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 4160, "effective_input_length": 10457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10457, "latency_s": 1.1066048599896021, "output_length": 67, "proxy_request_id": "1265942:2:1268069:97", "request_id": "1265942:2:1268069:97", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1265942", "t_dispatch_unix": 1779820792.5973854, "t_finish_unix": 1779820793.70399, "t_first_token_unix": 1779820793.1802986, "tpot_s": 0.007929880394261669, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596, 12609655, 12609656, 12609657, 12609658, 12618768, 12618769, 12618770, 12618771, 12618772, 12618773, 12618774, 12618775, 12618776], "trace_timestamp_s": 105.65700000000015, "ttft_s": 0.5829116029781289, "turn_id": 2} +{"actual_output_tokens": 202, "cached_tokens": 22672, "effective_input_length": 28671, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28671, "latency_s": 2.4790181929711252, "output_length": 202, "proxy_request_id": "1262354:4:1267821:95", "request_id": "1262354:4:1267821:95", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1262354", "t_dispatch_unix": 1779820791.8956425, "t_finish_unix": 1779820794.374661, "t_first_token_unix": 1779820793.091411, "tpot_s": 0.006382854925283226, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939], "trace_timestamp_s": 104.95499999999993, "ttft_s": 1.1957660439657047, "turn_id": 4} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 2298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2298, "latency_s": 0.36492394196102396, "output_length": 24, "proxy_request_id": "1268634:1:1268634:99", "request_id": "1268634:1:1268634:99", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1268634", "t_dispatch_unix": 1779820794.8022387, "t_finish_unix": 1779820795.167163, "t_first_token_unix": 1779820795.0542748, "tpot_s": 0.004896832781884334, "trace_hash_ids": [12598584, 12598585, 12598586, 12612307, 12624657], "trace_timestamp_s": 107.82400000000052, "ttft_s": 0.2520349739934318, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 18638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18638, "latency_s": 2.126753891003318, "output_length": 27, "proxy_request_id": "1268649:1:1268649:100", "request_id": "1268649:1:1268649:100", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1268649", "t_dispatch_unix": 1779820794.8102815, "t_finish_unix": 1779820796.937035, "t_first_token_unix": 1779820796.738576, "tpot_s": 0.00762176438449667, "trace_hash_ids": [12606450, 12606451, 12606452, 12606453, 12606454, 12606455, 12606456, 12606457, 12606458, 12606459, 12606460, 12606461, 12606462, 12606463, 12606464, 12606465, 12606466, 12606467, 12606468, 12606469, 12606470, 12606471, 12606472, 12606473, 12606474, 12606475, 12606476, 12606477, 12606478, 12606479, 12606480, 12606481, 12606482, 12606483, 12624720, 12624721, 12624722], "trace_timestamp_s": 107.86400000000049, "ttft_s": 1.928292552009225, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 9520, "effective_input_length": 13955, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13955, "latency_s": 0.9731873040436767, "output_length": 31, "proxy_request_id": "1263971:3:1269088:104", "request_id": "1263971:3:1269088:104", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1263971", "t_dispatch_unix": 1779820796.2295616, "t_finish_unix": 1779820797.202749, "t_first_token_unix": 1779820796.9360657, "tpot_s": 0.008872815599897877, "trace_hash_ids": [12579274, 12579275, 12579276, 12579277, 12579278, 12579279, 12579280, 12579281, 12579282, 12579283, 12579284, 12579285, 12597530, 12597531, 12597532, 12606764, 12606765, 12606766, 12613478, 12613479, 12622426, 12622427, 12622428, 12622429, 12622430, 12622431, 12629103, 12629104], "trace_timestamp_s": 109.28900000000067, "ttft_s": 0.706502219021786, "turn_id": 3} +{"actual_output_tokens": 128, "cached_tokens": 23728, "effective_input_length": 24029, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24029, "latency_s": 2.426462760020513, "output_length": 128, "proxy_request_id": "1250772:4:1268869:103", "request_id": "1250772:4:1268869:103", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1250772", "t_dispatch_unix": 1779820795.488803, "t_finish_unix": 1779820797.9152656, "t_first_token_unix": 1779820796.4740026, "tpot_s": 0.011345244968386998, "trace_hash_ids": [85000, 11362, 11363, 11364, 11365, 85001, 11367, 2920612, 12393745, 12423526, 12423527, 12449311, 12449312, 12484452, 12484453, 12484454, 12484455, 12484456, 12484457, 12484458, 12484459, 12546417, 12546418, 12546419, 12546420, 12546421, 12546422, 12546423, 12546424, 12546425, 12546426, 12546427, 12546428, 12546429, 12546430, 12546431, 12546432, 12546433, 12546434, 12589516, 12589517, 12589518, 12589519, 12589520, 12589521, 12589522, 12627093], "trace_timestamp_s": 108.55000000000018, "ttft_s": 0.985197706031613, "turn_id": 4} +{"actual_output_tokens": 248, "cached_tokens": 0, "effective_input_length": 12195, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12195, "latency_s": 3.2476479780161753, "output_length": 248, "proxy_request_id": "1268831:1:1268831:101", "request_id": "1268831:1:1268831:101", "request_type": "coder", "requested_output_tokens": 248, "session_id": "1268831", "t_dispatch_unix": 1779820795.3325098, "t_finish_unix": 1779820798.5801578, "t_first_token_unix": 1779820796.336479, "tpot_s": 0.009082539765181223, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771], "trace_timestamp_s": 108.39000000000033, "ttft_s": 1.0039674260187894, "turn_id": 1} +{"actual_output_tokens": 94, "cached_tokens": 0, "effective_input_length": 1323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1323, "latency_s": 0.7382026159903035, "output_length": 94, "proxy_request_id": "1269901:1:1269901:107", "request_id": "1269901:1:1269901:107", "request_type": "coder", "requested_output_tokens": 94, "session_id": "1269901", "t_dispatch_unix": 1779820798.8703887, "t_finish_unix": 1779820799.608591, "t_first_token_unix": 1779820799.0160735, "tpot_s": 0.0063678816346431615, "trace_hash_ids": [12637519, 12637520, 12637521], "trace_timestamp_s": 111.9320000000007, "ttft_s": 0.14568323898129165, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 30752, "effective_input_length": 30828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30828, "latency_s": 0.4684149540262297, "output_length": 55, "proxy_request_id": "1260327:2:1270005:108", "request_id": "1260327:2:1270005:108", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1260327", "t_dispatch_unix": 1779820799.2920015, "t_finish_unix": 1779820799.7604163, "t_first_token_unix": 1779820799.3889222, "tpot_s": 0.006875150666692881, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12638441], "trace_timestamp_s": 112.35300000000007, "ttft_s": 0.09691804402973503, "turn_id": 2} +{"actual_output_tokens": 32, "cached_tokens": 5424, "effective_input_length": 11128, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11128, "latency_s": 0.8805823079892434, "output_length": 32, "proxy_request_id": "1266440:2:1270501:112", "request_id": "1266440:2:1270501:112", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1266440", "t_dispatch_unix": 1779820801.0627959, "t_finish_unix": 1779820801.943378, "t_first_token_unix": 1779820801.631624, "tpot_s": 0.010048665192669197, "trace_hash_ids": [12582173, 12582174, 12582175, 12603412, 12603413, 12603414, 12603415, 12603416, 12603417, 12603418, 12611059, 12611060, 12611061, 12618733, 12618734, 12618735, 12618736, 12629763, 12642862, 12642863, 12642864, 12642865], "trace_timestamp_s": 114.1230000000005, "ttft_s": 0.568826295027975, "turn_id": 2} +{"actual_output_tokens": 102, "cached_tokens": 0, "effective_input_length": 28906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28906, "latency_s": 5.148933427000884, "output_length": 102, "proxy_request_id": "1262354:5:1269336:105", "request_id": "1262354:5:1269336:105", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1262354", "t_dispatch_unix": 1779820797.1838427, "t_finish_unix": 1779820802.3327758, "t_first_token_unix": 1779820800.8995073, "tpot_s": 0.014187851326544723, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12632148], "trace_timestamp_s": 110.2450000000008, "ttft_s": 3.7156631220132113, "turn_id": 5} +{"actual_output_tokens": 86, "cached_tokens": 8048, "effective_input_length": 12270, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12270, "latency_s": 39.84420498798136, "output_length": 86, "proxy_request_id": "1256273:4:1259632:60", "request_id": "1256273:4:1259632:60", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1256273", "t_dispatch_unix": 1779820763.337226, "t_finish_unix": 1779820803.1814308, "t_first_token_unix": 1779820802.1478913, "tpot_s": 0.012156249835457215, "trace_hash_ids": [12492922, 12504484, 12504485, 12519472, 12519473, 12519474, 12519475, 12519476, 12519477, 12519478, 12519479, 12519480, 12526397, 12526398, 12526399, 12536749, 12536750, 12536751, 12536752, 12536753, 12536754, 12536755, 12536756, 12536757], "trace_timestamp_s": 76.39800000000014, "ttft_s": 38.81066387996543, "turn_id": 4} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 112793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112793, "latency_s": 42.55517665296793, "output_length": 97, "proxy_request_id": "1258859:1:1258859:57", "request_id": "1258859:1:1258859:57", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1258859", "t_dispatch_unix": 1779820760.7374148, "t_finish_unix": 1779820803.292581, "t_first_token_unix": 1779820801.9426749, "tpot_s": 0.014058931708253416, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503], "trace_timestamp_s": 73.75200000000041, "ttft_s": 41.20526807499118, "turn_id": 1} +{"actual_output_tokens": 383, "cached_tokens": 0, "effective_input_length": 12320, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12320, "latency_s": 8.54117415699875, "output_length": 383, "proxy_request_id": "1268861:1:1268861:102", "request_id": "1268861:1:1268861:102", "request_type": "coder", "requested_output_tokens": 383, "session_id": "1268861", "t_dispatch_unix": 1779820795.4517214, "t_finish_unix": 1779820803.992896, "t_first_token_unix": 1779820796.4766505, "tpot_s": 0.019675152921495735, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12627028], "trace_timestamp_s": 108.50900000000001, "ttft_s": 1.0249274029629305, "turn_id": 1} +{"actual_output_tokens": 234, "cached_tokens": 7680, "effective_input_length": 14104, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14104, "latency_s": 6.765950984030496, "output_length": 234, "proxy_request_id": "1269373:1:1269373:106", "request_id": "1269373:1:1269373:106", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1269373", "t_dispatch_unix": 1779820797.310441, "t_finish_unix": 1779820804.0763915, "t_first_token_unix": 1779820798.0356426, "tpot_s": 0.025924918566562653, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12632634], "trace_timestamp_s": 110.3700000000008, "ttft_s": 0.7252004130277783, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 50800, "effective_input_length": 57803, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57803, "latency_s": 4.687030688044615, "output_length": 29, "proxy_request_id": "1263727:2:1270052:109", "request_id": "1263727:2:1270052:109", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1263727", "t_dispatch_unix": 1779820799.4829762, "t_finish_unix": 1779820804.1700065, "t_first_token_unix": 1779820802.0489907, "tpot_s": 0.07573859935759433, "trace_hash_ids": [12556738, 12556739, 12556740, 12556741, 12556742, 12556743, 12556744, 12556745, 12556746, 12556747, 12556748, 12556749, 12556750, 12556751, 12556752, 12556753, 12556754, 12556755, 12556756, 12556757, 12556758, 12556759, 12556760, 12556761, 12556762, 12556763, 12556764, 12556765, 12556766, 12556767, 12556768, 12556769, 12556770, 12556771, 12556772, 12556773, 12556774, 12556775, 12556776, 12556777, 12556778, 12556779, 12556780, 12556781, 12556782, 12556783, 12556784, 12556785, 12556786, 12556787, 12556788, 12556789, 12556790, 12556791, 12556792, 12556793, 12556794, 12556795, 12556796, 12556797, 12556798, 12556799, 12556800, 12556801, 12556802, 12556803, 12556804, 12556805, 12556806, 12556807, 12556808, 12556809, 12556810, 12556811, 12556812, 12556813, 12556814, 12556815, 12556816, 12556817, 12556818, 12556819, 12556820, 12556821, 12556822, 12556823, 12556824, 12556825, 12556826, 12556827, 12556828, 12556829, 12556830, 12556831, 12556832, 12556833, 12556834, 12556835, 12575902, 12585534, 12585535, 12585536, 12585537, 12600891, 12600892, 12600893, 12600894, 12600895, 12638702, 12638703, 12638704, 12638705, 12638706], "trace_timestamp_s": 112.54100000000017, "ttft_s": 2.5660122820409015, "turn_id": 2} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 27927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27927, "latency_s": 4.831514657998923, "output_length": 50, "proxy_request_id": "1270340:1:1270340:111", "request_id": "1270340:1:1270340:111", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1270340", "t_dispatch_unix": 1779820800.4933414, "t_finish_unix": 1779820805.3248563, "t_first_token_unix": 1779820804.0909073, "tpot_s": 0.02517482285668161, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646], "trace_timestamp_s": 113.54500000000007, "ttft_s": 3.597563875024207, "turn_id": 1} +{"actual_output_tokens": 138, "cached_tokens": 0, "effective_input_length": 751, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 751, "latency_s": 1.291860055993311, "output_length": 138, "proxy_request_id": "1271459:1:1271459:118", "request_id": "1271459:1:1271459:118", "request_type": "coder", "requested_output_tokens": 138, "session_id": "1271459", "t_dispatch_unix": 1779820804.4565887, "t_finish_unix": 1779820805.7484484, "t_first_token_unix": 1779820804.5775068, "tpot_s": 0.00854441172266583, "trace_hash_ids": [12654275, 12654276], "trace_timestamp_s": 117.51900000000023, "ttft_s": 0.12091735302237794, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 2524, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2524, "latency_s": 0.4491551530081779, "output_length": 27, "proxy_request_id": "1271847:1:1271847:123", "request_id": "1271847:1:1271847:123", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1271847", "t_dispatch_unix": 1779820805.7527764, "t_finish_unix": 1779820806.2019317, "t_first_token_unix": 1779820805.9773715, "tpot_s": 0.008624730345148306, "trace_hash_ids": [12630061, 12635974, 12658850, 12658851, 12658852], "trace_timestamp_s": 118.8140000000003, "ttft_s": 0.22459384700050578, "turn_id": 1} +{"actual_output_tokens": 204, "cached_tokens": 12432, "effective_input_length": 19448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19448, "latency_s": 3.366638678009622, "output_length": 204, "proxy_request_id": "1268831:2:1271087:116", "request_id": "1268831:2:1271087:116", "request_type": "coder", "requested_output_tokens": 204, "session_id": "1268831", "t_dispatch_unix": 1779820803.3093677, "t_finish_unix": 1779820806.6760058, "t_first_token_unix": 1779820804.9703374, "tpot_s": 0.008401163546896077, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753], "trace_timestamp_s": 116.3690000000006, "ttft_s": 1.6609683649730869, "turn_id": 2} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 2851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2851, "latency_s": 0.5595067649846897, "output_length": 30, "proxy_request_id": "1271991:1:1271991:124", "request_id": "1271991:1:1271991:124", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1271991", "t_dispatch_unix": 1779820806.283528, "t_finish_unix": 1779820806.843035, "t_first_token_unix": 1779820806.5115883, "tpot_s": 0.011418842277007884, "trace_hash_ids": [12652320, 12652321, 12652322, 12652323, 12652324, 12659858], "trace_timestamp_s": 119.34500000000025, "ttft_s": 0.2280590909649618, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 17706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17706, "latency_s": 2.8889343310147524, "output_length": 81, "proxy_request_id": "1271328:1:1271328:117", "request_id": "1271328:1:1271328:117", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1271328", "t_dispatch_unix": 1779820804.043662, "t_finish_unix": 1779820806.9325957, "t_first_token_unix": 1779820805.857559, "tpot_s": 0.013432767087215325, "trace_hash_ids": [12623302, 12623303, 12623304, 12623305, 12623306, 12623307, 12623308, 12623309, 12623310, 12623311, 12623312, 12623313, 12623314, 12623315, 12623316, 12637741, 12637742, 12637743, 12637744, 12637745, 12652577, 12652578, 12652579, 12652580, 12652581, 12652582, 12652583, 12652584, 12652585, 12652586, 12652587, 12652588, 12652589, 12652590, 12652591], "trace_timestamp_s": 117.09300000000076, "ttft_s": 1.813895917031914, "turn_id": 1} +{"actual_output_tokens": 239, "cached_tokens": 27968, "effective_input_length": 28323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28323, "latency_s": 1.9276582499733195, "output_length": 239, "proxy_request_id": "1270340:2:1271641:121", "request_id": "1270340:2:1271641:121", "request_type": "coder", "requested_output_tokens": 239, "session_id": "1270340", "t_dispatch_unix": 1779820805.3261058, "t_finish_unix": 1779820807.2537642, "t_first_token_unix": 1779820805.506698, "tpot_s": 0.007338940575591703, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 12656113], "trace_timestamp_s": 118.08300000000054, "ttft_s": 0.18058966100215912, "turn_id": 2} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 5302, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5302, "latency_s": 0.9682193190092221, "output_length": 73, "proxy_request_id": "1272085:1:1272085:125", "request_id": "1272085:1:1272085:125", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1272085", "t_dispatch_unix": 1779820806.6201835, "t_finish_unix": 1779820807.5884027, "t_first_token_unix": 1779820806.9668627, "tpot_s": 0.008626427929913107, "trace_hash_ids": [12650221, 12650222, 12660755, 12660756, 12660757, 12660758, 12660759, 12660760, 12660761, 12660762, 12660763], "trace_timestamp_s": 119.68000000000029, "ttft_s": 0.34667796903522685, "turn_id": 1} +{"actual_output_tokens": 374, "cached_tokens": 18112, "effective_input_length": 28385, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28385, "latency_s": 5.934611025964841, "output_length": 374, "proxy_request_id": "1266668:2:1270661:115", "request_id": "1266668:2:1270661:115", "request_type": "coder", "requested_output_tokens": 374, "session_id": "1266668", "t_dispatch_unix": 1779820801.6768389, "t_finish_unix": 1779820807.61145, "t_first_token_unix": 1779820803.8651795, "tpot_s": 0.010042835107346592, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12644244], "trace_timestamp_s": 114.73400000000038, "ttft_s": 2.1883381009683944, "turn_id": 2} +{"actual_output_tokens": 490, "cached_tokens": 14336, "effective_input_length": 14404, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14404, "latency_s": 4.066097044968046, "output_length": 490, "proxy_request_id": "1269373:2:1271580:120", "request_id": "1269373:2:1271580:120", "request_type": "coder", "requested_output_tokens": 490, "session_id": "1269373", "t_dispatch_unix": 1779820804.8672, "t_finish_unix": 1779820808.9332972, "t_first_token_unix": 1779820804.936566, "tpot_s": 0.00817278039056983, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12655307], "trace_timestamp_s": 117.92900000000009, "ttft_s": 0.06936448300257325, "turn_id": 2} +{"actual_output_tokens": 44, "cached_tokens": 10512, "effective_input_length": 18093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18093, "latency_s": 1.4764701910316944, "output_length": 44, "proxy_request_id": "1265942:3:1272453:127", "request_id": "1265942:3:1272453:127", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1265942", "t_dispatch_unix": 1779820808.0816824, "t_finish_unix": 1779820809.5581524, "t_first_token_unix": 1779820809.0885148, "tpot_s": 0.010915938326222606, "trace_hash_ids": [12598589, 12598590, 12598591, 12598592, 12598593, 12598594, 12598595, 12598596, 12609655, 12609656, 12609657, 12609658, 12618768, 12618769, 12618770, 12618771, 12618772, 12618773, 12618774, 12618775, 12635330, 12635331, 12635332, 12635333, 12643363, 12643364, 12643365, 12643366, 12643367, 12654593, 12654594, 12663906, 12663907, 12663908, 12663909, 12663910], "trace_timestamp_s": 121.14100000000053, "ttft_s": 1.00683075300185, "turn_id": 3} +{"actual_output_tokens": 237, "cached_tokens": 0, "effective_input_length": 21719, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21719, "latency_s": 5.538234215986449, "output_length": 237, "proxy_request_id": "1271486:1:1271486:119", "request_id": "1271486:1:1271486:119", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1271486", "t_dispatch_unix": 1779820804.5523088, "t_finish_unix": 1779820810.0905428, "t_first_token_unix": 1779820806.936142, "tpot_s": 0.013365055156686201, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 41451, 41452, 41453, 41454, 41455, 41456, 41457, 41458, 41459, 41460, 12602726, 12602727, 12602728, 9026439, 12602729, 12602730, 12654424, 12654425], "trace_timestamp_s": 117.60600000000068, "ttft_s": 2.383831963990815, "turn_id": 1} +{"actual_output_tokens": 408, "cached_tokens": 0, "effective_input_length": 9718, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9718, "latency_s": 2.9864341510110535, "output_length": 408, "proxy_request_id": "1272313:1:1272313:126", "request_id": "1272313:1:1272313:126", "request_type": "coder", "requested_output_tokens": 408, "session_id": "1272313", "t_dispatch_unix": 1779820807.5317645, "t_finish_unix": 1779820810.5181983, "t_first_token_unix": 1779820808.302273, "tpot_s": 0.00544381018668523, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675], "trace_timestamp_s": 120.59300000000076, "ttft_s": 0.7705072530079633, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 5360, "effective_input_length": 8017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8017, "latency_s": 0.7787565040052868, "output_length": 67, "proxy_request_id": "1272085:2:1273645:130", "request_id": "1272085:2:1273645:130", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1272085", "t_dispatch_unix": 1779820812.2517776, "t_finish_unix": 1779820813.0305338, "t_first_token_unix": 1779820812.5148978, "tpot_s": 0.007808698636698396, "trace_hash_ids": [12650221, 12650222, 12660755, 12660756, 12660757, 12660758, 12660759, 12660760, 12660761, 12660762, 12676216, 12676217, 12676218, 12676219, 12676220, 12676221], "trace_timestamp_s": 125.3130000000001, "ttft_s": 0.2631194419809617, "turn_id": 2} +{"actual_output_tokens": 103, "cached_tokens": 30880, "effective_input_length": 31283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31283, "latency_s": 1.2874483749619685, "output_length": 103, "proxy_request_id": "1260327:3:1273741:132", "request_id": "1260327:3:1273741:132", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1260327", "t_dispatch_unix": 1779820812.6507194, "t_finish_unix": 1779820813.9381676, "t_first_token_unix": 1779820813.128819, "tpot_s": 0.00793072939211247, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12677039], "trace_timestamp_s": 125.71200000000044, "ttft_s": 0.4780971349682659, "turn_id": 3} +{"actual_output_tokens": 670, "cached_tokens": 112880, "effective_input_length": 113172, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113172, "latency_s": 10.658065647992771, "output_length": 670, "proxy_request_id": "1258859:2:1264639:81", "request_id": "1258859:2:1264639:81", "request_type": "coder", "requested_output_tokens": 670, "session_id": "1258859", "t_dispatch_unix": 1779820803.2980516, "t_finish_unix": 1779820813.956117, "t_first_token_unix": 1779820803.707591, "tpot_s": 0.015318803457450679, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12585542], "trace_timestamp_s": 94.09700000000066, "ttft_s": 0.4095371720031835, "turn_id": 2} +{"actual_output_tokens": 717, "cached_tokens": 28992, "effective_input_length": 32774, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32774, "latency_s": 11.684682040009648, "output_length": 717, "proxy_request_id": "1262354:6:1270643:114", "request_id": "1262354:6:1270643:114", "request_type": "coder", "requested_output_tokens": 717, "session_id": "1262354", "t_dispatch_unix": 1779820802.3359954, "t_finish_unix": 1779820814.0206769, "t_first_token_unix": 1779820803.2824023, "tpot_s": 0.014997266314262993, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12644066], "trace_timestamp_s": 114.65599999999995, "ttft_s": 0.9464048690279014, "turn_id": 6} +{"actual_output_tokens": 380, "cached_tokens": 28752, "effective_input_length": 33711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33711, "latency_s": 4.007745050999802, "output_length": 380, "proxy_request_id": "1266668:3:1273119:128", "request_id": "1266668:3:1273119:128", "request_type": "coder", "requested_output_tokens": 380, "session_id": "1266668", "t_dispatch_unix": 1779820810.304075, "t_finish_unix": 1779820814.3118198, "t_first_token_unix": 1779820811.4547496, "tpot_s": 0.007537821316686127, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12670179], "trace_timestamp_s": 123.36300000000028, "ttft_s": 1.1506720499601215, "turn_id": 3} +{"actual_output_tokens": 77, "cached_tokens": 18128, "effective_input_length": 21229, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21229, "latency_s": 1.4045355599955656, "output_length": 77, "proxy_request_id": "1265942:4:1274182:133", "request_id": "1265942:4:1274182:133", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1265942", "t_dispatch_unix": 1779820814.1324766, "t_finish_unix": 1779820815.5370119, "t_first_token_unix": 1779820814.7242894, "tpot_s": 0.010690130013053453, "trace_hash_ids": [12681319, 12681320, 12681321, 12681322, 12681323, 12681324, 12681325, 12681326, 12681327, 12681328, 12681329, 12681330, 12681331, 12681332, 12681333, 12681334, 12681335, 12681336, 12681337, 12681338, 12681339, 12681340, 12681341, 12681342, 12681343, 12681344, 12681345, 12681346, 12681347, 12681348, 12681349, 12681350, 12681351, 12681352, 12681353, 12681354, 12681355, 12681356, 12681357, 12681358, 12681359, 12681360], "trace_timestamp_s": 127.1860000000006, "ttft_s": 0.5918109439662658, "turn_id": 4} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 6208, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6208, "latency_s": 0.8766212380141951, "output_length": 92, "proxy_request_id": "1274405:1:1274405:134", "request_id": "1274405:1:1274405:134", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1274405", "t_dispatch_unix": 1779820815.0498002, "t_finish_unix": 1779820815.9264214, "t_first_token_unix": 1779820815.4603446, "tpot_s": 0.005118659032882283, "trace_hash_ids": [12683425, 12683426, 12683427, 12683428, 12683429, 12683430, 12683431, 12683432, 12683433, 12683434, 12683435, 12683436, 12683437], "trace_timestamp_s": 128.11000000000058, "ttft_s": 0.41054307698505, "turn_id": 1} +{"actual_output_tokens": 553, "cached_tokens": 0, "effective_input_length": 21963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21963, "latency_s": 6.066914858005475, "output_length": 553, "proxy_request_id": "1273203:1:1273203:129", "request_id": "1273203:1:1273203:129", "request_type": "coder", "requested_output_tokens": 553, "session_id": "1273203", "t_dispatch_unix": 1779820810.6086428, "t_finish_unix": 1779820816.6755576, "t_first_token_unix": 1779820812.9754012, "tpot_s": 0.006702632264405374, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 788374, 12645257, 12645258, 109688, 109689, 109690, 109691, 109692, 109693, 12645259, 12645260, 2777791, 2777792, 12645261, 12645262, 12671102, 12671103, 12671104], "trace_timestamp_s": 123.66700000000037, "ttft_s": 2.3667564670322463, "turn_id": 1} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 10506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10506, "latency_s": 1.071977969026193, "output_length": 48, "proxy_request_id": "1274890:1:1274890:135", "request_id": "1274890:1:1274890:135", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1274890", "t_dispatch_unix": 1779820816.5747912, "t_finish_unix": 1779820817.646769, "t_first_token_unix": 1779820817.403251, "tpot_s": 0.005175021786658847, "trace_hash_ids": [12642876, 12642877, 12654445, 12654446, 12654447, 12654448, 12654449, 12668949, 12668950, 12668951, 12668952, 12668953, 12679551, 12679552, 12679553, 12679554, 12679555, 12687863, 12687864, 12687865, 12687866], "trace_timestamp_s": 129.63300000000072, "ttft_s": 0.8284563190536574, "turn_id": 1} +{"actual_output_tokens": 439, "cached_tokens": 17776, "effective_input_length": 25108, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25108, "latency_s": 5.902562623028643, "output_length": 439, "proxy_request_id": "1271328:2:1273711:131", "request_id": "1271328:2:1273711:131", "request_type": "coder", "requested_output_tokens": 439, "session_id": "1271328", "t_dispatch_unix": 1779820812.5118852, "t_finish_unix": 1779820818.4144475, "t_first_token_unix": 1779820813.7826405, "tpot_s": 0.010574193696329821, "trace_hash_ids": [12623302, 12623303, 12623304, 12623305, 12623306, 12623307, 12623308, 12623309, 12623310, 12623311, 12623312, 12623313, 12623314, 12623315, 12623316, 12637741, 12637742, 12637743, 12637744, 12637745, 12652577, 12652578, 12652579, 12652580, 12652581, 12652582, 12652583, 12652584, 12652585, 12652586, 12652587, 12652588, 12652589, 12652590, 12668017, 12668018, 12668019, 12668020, 12668021, 12668022, 12668023, 12668024, 12668025, 12668026, 12676731, 12676732, 12676733, 12676734, 12676735, 12676736], "trace_timestamp_s": 125.57100000000082, "ttft_s": 1.2707392960437573, "turn_id": 2} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 7794, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7794, "latency_s": 0.592736808990594, "output_length": 12, "proxy_request_id": "1275433:1:1275433:137", "request_id": "1275433:1:1275433:137", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1275433", "t_dispatch_unix": 1779820818.3260396, "t_finish_unix": 1779820818.918776, "t_first_token_unix": 1779820818.870802, "tpot_s": 0.0043377557303756475, "trace_hash_ids": [12648375, 12648376, 12656103, 12660867, 12660868, 12660869, 12660870, 12681196, 12681197, 12681198, 12681199, 12681200, 12692620, 12692621, 12692622, 12692623], "trace_timestamp_s": 131.38500000000022, "ttft_s": 0.5447606289526448, "turn_id": 1} +{"actual_output_tokens": 4, "cached_tokens": 7456, "effective_input_length": 7463, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7463, "latency_s": 0.03880157700041309, "output_length": 4, "proxy_request_id": "1275433:2:1276027:139", "request_id": "1275433:2:1276027:139", "request_type": "coder", "requested_output_tokens": 4, "session_id": "1275433", "t_dispatch_unix": 1779820820.5976582, "t_finish_unix": 1779820820.6364594, "t_first_token_unix": 1779820820.6285017, "tpot_s": 0.002569762679437796, "trace_hash_ids": [12698576, 12698577, 12698578, 12698579, 12698580, 12698581, 12698582, 12698583, 12698584, 12698585, 12698586, 12698587, 12698588, 12698589, 12698590], "trace_timestamp_s": 133.65700000000015, "ttft_s": 0.03084232099354267, "turn_id": 2} +{"actual_output_tokens": 235, "cached_tokens": 10112, "effective_input_length": 10639, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10639, "latency_s": 1.4327998780063353, "output_length": 235, "proxy_request_id": "1272313:2:1275926:138", "request_id": "1272313:2:1275926:138", "request_type": "coder", "requested_output_tokens": 235, "session_id": "1272313", "t_dispatch_unix": 1779820820.2654335, "t_finish_unix": 1779820821.6982331, "t_first_token_unix": 1779820820.4291263, "tpot_s": 0.005422448901594895, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12697306], "trace_timestamp_s": 133.32700000000023, "ttft_s": 0.1636907550273463, "turn_id": 2} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 110048, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 110048, "latency_s": 40.781406716036145, "output_length": 93, "proxy_request_id": "1264679:1:1264679:82", "request_id": "1264679:1:1264679:82", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1264679", "t_dispatch_unix": 1779820781.2117176, "t_finish_unix": 1779820821.9931238, "t_first_token_unix": 1779820820.922206, "tpot_s": 0.011637334956701481, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281], "trace_timestamp_s": 94.22100000000046, "ttft_s": 39.7104867050075, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 15783, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15783, "latency_s": 1.6146124600199983, "output_length": 35, "proxy_request_id": "1276111:1:1276111:140", "request_id": "1276111:1:1276111:140", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1276111", "t_dispatch_unix": 1779820820.9454541, "t_finish_unix": 1779820822.5600665, "t_first_token_unix": 1779820822.3819034, "tpot_s": 0.005231449705795111, "trace_hash_ids": [12617937, 12617938, 12617939, 12617940, 12617941, 12617942, 12617943, 12617944, 12617945, 12617946, 12637526, 12637527, 12637528, 12637529, 12637530, 12637531, 12637532, 12637533, 12643664, 12659893, 12659894, 12659895, 12659896, 12659897, 12676458, 12676459, 12682485, 12682486, 12682487, 12682488, 12699285], "trace_timestamp_s": 134.0020000000004, "ttft_s": 1.4364476980408654, "turn_id": 1} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 8704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8704, "latency_s": 0.8966453290195204, "output_length": 50, "proxy_request_id": "1276498:1:1276498:142", "request_id": "1276498:1:1276498:142", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1276498", "t_dispatch_unix": 1779820822.2779894, "t_finish_unix": 1779820823.1746342, "t_first_token_unix": 1779820822.9212859, "tpot_s": 0.005165293653571636, "trace_hash_ids": [12669649, 12669650, 12669651, 12669652, 12669653, 12669654, 12669655, 12669656, 12680491, 12680492, 12689566, 12689567, 12695712, 12695713, 12695714, 12695715, 12703411], "trace_timestamp_s": 135.33700000000044, "ttft_s": 0.6432951859897003, "turn_id": 1} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 17280, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17280, "latency_s": 2.2882797790225595, "output_length": 67, "proxy_request_id": "1276136:1:1276136:141", "request_id": "1276136:1:1276136:141", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1276136", "t_dispatch_unix": 1779820821.0293312, "t_finish_unix": 1779820823.317611, "t_first_token_unix": 1779820822.7629519, "tpot_s": 0.008398961499827265, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12699544], "trace_timestamp_s": 134.08500000000004, "ttft_s": 1.7336180820129812, "turn_id": 1} +{"actual_output_tokens": 31, "cached_tokens": 2880, "effective_input_length": 11292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11292, "latency_s": 1.1113607080187649, "output_length": 31, "proxy_request_id": "1271991:2:1276999:145", "request_id": "1271991:2:1276999:145", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1271991", "t_dispatch_unix": 1779820824.0471625, "t_finish_unix": 1779820825.158523, "t_first_token_unix": 1779820824.8146229, "tpot_s": 0.011448679466654236, "trace_hash_ids": [12652320, 12652321, 12652322, 12652323, 12652324, 12677010, 12677011, 12677012, 12677013, 12686644, 12686645, 12686646, 12686647, 12686648, 12693874, 12700012, 12700013, 12700014, 12708525, 12708526, 12708527, 12708528, 12708529], "trace_timestamp_s": 137.10600000000068, "ttft_s": 0.7674592710100114, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 4729, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4729, "latency_s": 0.6036622530082241, "output_length": 29, "proxy_request_id": "1277533:1:1277533:150", "request_id": "1277533:1:1277533:150", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1277533", "t_dispatch_unix": 1779820826.0795965, "t_finish_unix": 1779820826.6832588, "t_first_token_unix": 1779820826.3956306, "tpot_s": 0.01026289957267831, "trace_hash_ids": [12707525, 12707526, 12707527, 12707528, 12707529, 12707530, 12707531, 12707532, 12714414, 12714415], "trace_timestamp_s": 139.14000000000033, "ttft_s": 0.31603283499134704, "turn_id": 1} +{"actual_output_tokens": 371, "cached_tokens": 33488, "effective_input_length": 33524, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33524, "latency_s": 4.087607779016253, "output_length": 371, "proxy_request_id": "1262354:7:1277104:146", "request_id": "1262354:7:1277104:146", "request_type": "coder", "requested_output_tokens": 371, "session_id": "1262354", "t_dispatch_unix": 1779820824.452369, "t_finish_unix": 1779820828.5399764, "t_first_token_unix": 1779820824.8652415, "tpot_s": 0.009930453443352284, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12709527], "trace_timestamp_s": 137.51299999999992, "ttft_s": 0.4128711179946549, "turn_id": 7} +{"actual_output_tokens": 66, "cached_tokens": 31376, "effective_input_length": 31430, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31430, "latency_s": 0.843350411974825, "output_length": 66, "proxy_request_id": "1260327:4:1277974:154", "request_id": "1260327:4:1277974:154", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1260327", "t_dispatch_unix": 1779820827.700185, "t_finish_unix": 1779820828.543535, "t_first_token_unix": 1779820827.78915, "tpot_s": 0.011599316153352936, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041], "trace_timestamp_s": 140.76100000000042, "ttft_s": 0.08896285900846124, "turn_id": 4} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 27221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27221, "latency_s": 4.196792816976085, "output_length": 97, "proxy_request_id": "1277428:1:1277428:149", "request_id": "1277428:1:1277428:149", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1277428", "t_dispatch_unix": 1779820825.6474864, "t_finish_unix": 1779820829.8442793, "t_first_token_unix": 1779820829.0252523, "tpot_s": 0.008528466416464653, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12713186], "trace_timestamp_s": 138.70600000000013, "ttft_s": 3.377764113014564, "turn_id": 1} +{"actual_output_tokens": 237, "cached_tokens": 19648, "effective_input_length": 31845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31845, "latency_s": 5.495605850999709, "output_length": 237, "proxy_request_id": "1268831:3:1277112:147", "request_id": "1268831:3:1277112:147", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1268831", "t_dispatch_unix": 1779820824.492094, "t_finish_unix": 1779820829.9876995, "t_first_token_unix": 1779820826.85753, "tpot_s": 0.01326170735163772, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12709565], "trace_timestamp_s": 137.54899999999998, "ttft_s": 2.3654336610343307, "turn_id": 3} +{"actual_output_tokens": 272, "cached_tokens": 22512, "effective_input_length": 22573, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22573, "latency_s": 3.475078031013254, "output_length": 272, "proxy_request_id": "1273203:2:1277744:152", "request_id": "1273203:2:1277744:152", "request_type": "coder", "requested_output_tokens": 272, "session_id": "1273203", "t_dispatch_unix": 1779820826.8006003, "t_finish_unix": 1779820830.2756784, "t_first_token_unix": 1779820827.5468466, "tpot_s": 0.01006794547231703, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 788374, 12645257, 12645258, 109688, 109689, 109690, 109691, 109692, 109693, 12645259, 12645260, 2777791, 2777792, 12645261, 12645262, 12671102, 12671103, 12671104, 12717031, 12717032], "trace_timestamp_s": 139.86200000000008, "ttft_s": 0.7462435240158811, "turn_id": 2} +{"actual_output_tokens": 147, "cached_tokens": 3584, "effective_input_length": 102074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102074, "latency_s": 36.229966717015486, "output_length": 147, "proxy_request_id": "1268630:1:1268630:98", "request_id": "1268630:1:1268630:98", "request_type": "coder", "requested_output_tokens": 147, "session_id": "1268630", "t_dispatch_unix": 1779820794.793528, "t_finish_unix": 1779820831.0234947, "t_first_token_unix": 1779820828.8511465, "tpot_s": 0.014876822520395077, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 5771, 5772, 5773, 5774, 5775, 5776, 5777, 5778, 5779, 5780, 5781, 5782, 5783, 317795, 317796, 317797, 3750293, 3750294, 3750295, 1646386, 11179983, 11179984, 270680, 270681, 11179985, 470650, 11179986, 11179987, 11179988, 11179989, 11179990, 11179991, 11179992, 11179993, 11179994, 11179995, 11179996, 11179997, 11179998, 11179999, 11180000, 11180001, 11180002, 11180003, 11180004, 11180005, 11180006, 11180007, 11180008, 11180009, 11180010, 395622, 395623, 282458, 2459748, 11180011, 419587, 419588, 419589, 427120, 11180012, 11180013, 11180014, 11180015, 11180016, 11180017, 11180018, 11180019, 11180020, 11180021, 11180022, 11180023, 11180024, 11180025, 11180026, 11180027, 11180028, 11180029, 11180030, 11180031, 11180032, 11180033, 11180034, 11180035, 11180036, 11180037, 12624518, 12624519, 12624520, 12624521, 12624522, 12624523, 12624524, 12624525, 12624526, 12624527, 12624528, 12624529, 12624530, 12624531, 12624532, 12624533, 12624534, 12624535, 12624536, 12624537, 12624538, 12624539, 12624540, 12624541, 12624542, 12624543, 12624544, 12624545, 12624546, 12624547, 12624548, 12624549, 12624550, 12624551, 12624552, 12624553, 12624554, 12624555, 12624556, 12624557, 12624558, 12624559, 12624560, 12624561, 12624562, 12624563, 12624564, 12624565, 12624566, 12624567, 12624568, 12624569, 12624570, 12624571, 12624572, 12624573, 12624574, 12624575, 12624576, 12624577, 12624578, 12624579, 12624580, 12624581, 12624582, 12624583, 12624584, 12624585, 12624586, 12624587, 12624588, 12624589, 12624590, 12624591, 12624592, 12624593, 12624594, 12624595, 12624596, 12624597, 12624598, 12624599, 12624600, 12624601, 12624602, 12624603, 12624604, 12624605, 12624606, 12624607, 12624608, 12624609, 12624610, 12624611, 12624612, 12624613, 12624614, 12624615, 12624616, 12624617, 12624618, 12624619, 12624620, 12624621, 12624622], "trace_timestamp_s": 107.81600000000071, "ttft_s": 34.057615915022325, "turn_id": 1} +{"actual_output_tokens": 437, "cached_tokens": 0, "effective_input_length": 8884, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8884, "latency_s": 5.058145886985585, "output_length": 437, "proxy_request_id": "1271459:2:1277544:151", "request_id": "1271459:2:1277544:151", "request_type": "coder", "requested_output_tokens": 437, "session_id": "1271459", "t_dispatch_unix": 1779820826.1169336, "t_finish_unix": 1779820831.1750796, "t_first_token_unix": 1779820827.5387743, "tpot_s": 0.008339614704050499, "trace_hash_ids": [12654275, 12668550, 12668551, 12668552, 12668553, 12668554, 12668555, 12668556, 12681215, 12681216, 12703400, 12703401, 12703402, 12703403, 12714450, 12714451, 12714452, 12714453], "trace_timestamp_s": 139.17600000000039, "ttft_s": 1.421836871013511, "turn_id": 2} +{"actual_output_tokens": 170, "cached_tokens": 0, "effective_input_length": 93430, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93430, "latency_s": 30.795762716967147, "output_length": 170, "proxy_request_id": "1270606:1:1270606:113", "request_id": "1270606:1:1270606:113", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1270606", "t_dispatch_unix": 1779820801.4896655, "t_finish_unix": 1779820832.2854283, "t_first_token_unix": 1779820830.3697624, "tpot_s": 0.011333456065246736, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 12643740, 12643741, 12643742, 12643743, 12643744, 12643745, 12643746, 12643747, 12643748, 12643749, 12643750, 12643751, 12643752, 12643753, 12643754, 12643755, 12643756, 12643757, 12643758, 12643759, 12643760, 12643761, 12643762, 12643763, 12643764, 12643765, 12643766, 12643767, 12643768, 12643769, 12643770, 12643771, 12643772, 12643773, 12643774, 12643775, 12643776, 12643777, 12643778, 12643779, 12643780, 12643781, 12643782, 12643783, 12643784, 12643785, 12643786, 12643787, 12643788, 12643789, 12643790, 12643791, 12643792, 12643793, 12643794, 12643795, 12643796, 12643797, 12643798, 12643799, 12643800, 12643801, 12643802, 12643803, 12643804, 12643805, 12643806, 12643807, 12643808, 12643809, 12643810, 12643811, 12643812, 12643813, 12643814, 12643815, 12643816, 12643817, 12643818, 12643819, 12643820, 12643821, 12643822, 12643823, 12643824, 12643825, 12643826, 12643827], "trace_timestamp_s": 114.51500000000033, "ttft_s": 28.8800941479858, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 8752, "effective_input_length": 16650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16650, "latency_s": 1.4156510960310698, "output_length": 34, "proxy_request_id": "1276498:2:1278996:157", "request_id": "1276498:2:1278996:157", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1276498", "t_dispatch_unix": 1779820831.2312586, "t_finish_unix": 1779820832.64691, "t_first_token_unix": 1779820832.200332, "tpot_s": 0.01352157069645314, "trace_hash_ids": [12669649, 12669650, 12669651, 12669652, 12669653, 12669654, 12669655, 12669656, 12680491, 12680492, 12689566, 12689567, 12695712, 12695713, 12695714, 12695715, 12703411, 12712744, 12712745, 12712746, 12712747, 12712748, 12721667, 12721668, 12721669, 12721670, 12728508, 12728509, 12728510, 12728511, 12728512, 12728513, 12728514], "trace_timestamp_s": 144.28999999999996, "ttft_s": 0.9690711490111426, "turn_id": 2} +{"actual_output_tokens": 177, "cached_tokens": 32080, "effective_input_length": 32346, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32346, "latency_s": 2.06953270296799, "output_length": 177, "proxy_request_id": "1268831:4:1279168:158", "request_id": "1268831:4:1279168:158", "request_type": "coder", "requested_output_tokens": 177, "session_id": "1268831", "t_dispatch_unix": 1779820831.7148814, "t_finish_unix": 1779820833.7844138, "t_first_token_unix": 1779820832.3840945, "tpot_s": 0.007954462249802997, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12730103, 12730104], "trace_timestamp_s": 144.77600000000075, "ttft_s": 0.6692108740098774, "turn_id": 4} +{"actual_output_tokens": 210, "cached_tokens": 10864, "effective_input_length": 11549, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11549, "latency_s": 2.072318178950809, "output_length": 210, "proxy_request_id": "1272313:3:1279208:159", "request_id": "1272313:3:1279208:159", "request_type": "coder", "requested_output_tokens": 210, "session_id": "1272313", "t_dispatch_unix": 1779820831.894411, "t_finish_unix": 1779820833.9667294, "t_first_token_unix": 1779820832.3851533, "tpot_s": 0.007565816976052027, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12730483], "trace_timestamp_s": 144.95600000000013, "ttft_s": 0.4907412289758213, "turn_id": 3} +{"actual_output_tokens": 504, "cached_tokens": 57632, "effective_input_length": 58752, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58752, "latency_s": 5.095190268999431, "output_length": 504, "proxy_request_id": "1253804:5:1278488:156", "request_id": "1253804:5:1278488:156", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1253804", "t_dispatch_unix": 1779820829.376832, "t_finish_unix": 1779820834.472022, "t_first_token_unix": 1779820829.9404159, "tpot_s": 0.009008576946400632, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261], "trace_timestamp_s": 142.4350000000004, "ttft_s": 0.5635813469998538, "turn_id": 5} +{"actual_output_tokens": 36, "cached_tokens": 17344, "effective_input_length": 24519, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24519, "latency_s": 1.8513865600107238, "output_length": 36, "proxy_request_id": "1276136:2:1280145:162", "request_id": "1276136:2:1280145:162", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1276136", "t_dispatch_unix": 1779820835.0052407, "t_finish_unix": 1779820836.856627, "t_first_token_unix": 1779820836.2445977, "tpot_s": 0.01747707008616999, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12713815, 12713816, 12713817, 12713818, 12713819, 12713820, 12725899, 12725900, 12725901, 12725902, 12725903, 12725904, 12739099, 12739100, 12739101], "trace_timestamp_s": 148.0610000000006, "ttft_s": 1.239355137979146, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 33888, "effective_input_length": 33928, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33928, "latency_s": 1.1330531280254945, "output_length": 59, "proxy_request_id": "1262354:8:1280463:163", "request_id": "1262354:8:1280463:163", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1262354", "t_dispatch_unix": 1779820836.0104556, "t_finish_unix": 1779820837.1435084, "t_first_token_unix": 1779820836.2960215, "tpot_s": 0.014606185534423024, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12742762], "trace_timestamp_s": 149.07100000000082, "ttft_s": 0.28556335798930377, "turn_id": 8} +{"actual_output_tokens": 237, "cached_tokens": 12800, "effective_input_length": 20136, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20136, "latency_s": 4.668761626991909, "output_length": 237, "proxy_request_id": "1279412:1:1279412:160", "request_id": "1279412:1:1279412:160", "request_type": "coder", "requested_output_tokens": 237, "session_id": "1279412", "t_dispatch_unix": 1779820832.7006986, "t_finish_unix": 1779820837.36946, "t_first_token_unix": 1779820833.7546914, "tpot_s": 0.015315844139954375, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12732189], "trace_timestamp_s": 145.75700000000052, "ttft_s": 1.0539909869548865, "turn_id": 1} +{"actual_output_tokens": 3514, "cached_tokens": 0, "effective_input_length": 15283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15283, "latency_s": 64.87102279503597, "output_length": 3514, "proxy_request_id": "1262727:1:1262727:72", "request_id": "1262727:1:1262727:72", "request_type": "coder", "requested_output_tokens": 3514, "session_id": "1262727", "t_dispatch_unix": 1779820774.1104515, "t_finish_unix": 1779820838.9814742, "t_first_token_unix": 1779820775.531995, "tpot_s": 0.01806125521008747, "trace_hash_ids": [1978, 1979, 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007], "trace_timestamp_s": 87.16600000000017, "ttft_s": 1.4215419690008275, "turn_id": 1} +{"actual_output_tokens": 81, "cached_tokens": 24544, "effective_input_length": 25923, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25923, "latency_s": 2.2818799550295807, "output_length": 81, "proxy_request_id": "1276136:3:1280987:166", "request_id": "1276136:3:1280987:166", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1276136", "t_dispatch_unix": 1779820837.9527538, "t_finish_unix": 1779820840.2346334, "t_first_token_unix": 1779820838.300973, "tpot_s": 0.02416614366302383, "trace_hash_ids": [12699511, 12699512, 12699513, 12699514, 12699515, 12699516, 12699517, 12699518, 12699519, 12699520, 12699521, 12699522, 12699523, 12699524, 12699525, 12699526, 12699527, 12699528, 12699529, 12699530, 12699531, 12699532, 12699533, 12699534, 12699535, 12699536, 12699537, 12699538, 12699539, 12699540, 12699541, 12699542, 12699543, 12713815, 12713816, 12713817, 12713818, 12713819, 12713820, 12725899, 12725900, 12725901, 12725902, 12725903, 12725904, 12739099, 12739100, 12747337, 12747338, 12747339, 12747340], "trace_timestamp_s": 151.01400000000012, "ttft_s": 0.34821741899941117, "turn_id": 3} +{"actual_output_tokens": 606, "cached_tokens": 0, "effective_input_length": 16900, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16900, "latency_s": 15.197512685030233, "output_length": 606, "proxy_request_id": "1269373:3:1277365:148", "request_id": "1269373:3:1277365:148", "request_type": "coder", "requested_output_tokens": 606, "session_id": "1269373", "t_dispatch_unix": 1779820825.3692956, "t_finish_unix": 1779820840.566808, "t_first_token_unix": 1779820826.9883986, "tpot_s": 0.022443072196704234, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12712211], "trace_timestamp_s": 138.4300000000003, "ttft_s": 1.6191015689983033, "turn_id": 3} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 9370, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9370, "latency_s": 0.8781014349660836, "output_length": 33, "proxy_request_id": "1281887:1:1281887:171", "request_id": "1281887:1:1281887:171", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1281887", "t_dispatch_unix": 1779820840.8707805, "t_finish_unix": 1779820841.7488818, "t_first_token_unix": 1779820841.5967836, "tpot_s": 0.004745872438434162, "trace_hash_ids": [12732193, 12732194, 12749330, 12749331, 12749332, 12749333, 12749334, 12749335, 12749336, 12749337, 12749338, 12749339, 12749340, 12749341, 12754932, 12754933, 12754934, 12754935, 12754936], "trace_timestamp_s": 153.9290000000001, "ttft_s": 0.7260002099792473, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 4972, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4972, "latency_s": 0.5633720519836061, "output_length": 34, "proxy_request_id": "1282082:1:1282082:173", "request_id": "1282082:1:1282082:173", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1282082", "t_dispatch_unix": 1779820841.5462337, "t_finish_unix": 1779820842.1096056, "t_first_token_unix": 1779820841.8686805, "tpot_s": 0.007292696029639266, "trace_hash_ids": [12740904, 12740905, 12740906, 12740907, 12757070, 12757071, 12757072, 12757073, 12757074, 12757075], "trace_timestamp_s": 154.60600000000068, "ttft_s": 0.32244571298360825, "turn_id": 1} +{"actual_output_tokens": 221, "cached_tokens": 33984, "effective_input_length": 34028, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34028, "latency_s": 2.689149733982049, "output_length": 221, "proxy_request_id": "1262354:9:1281632:169", "request_id": "1262354:9:1281632:169", "request_type": "coder", "requested_output_tokens": 221, "session_id": "1262354", "t_dispatch_unix": 1779820840.0043452, "t_finish_unix": 1779820842.6934946, "t_first_token_unix": 1779820840.1038277, "tpot_s": 0.011769342949793843, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12752803], "trace_timestamp_s": 153.0650000000005, "ttft_s": 0.09948052902473137, "turn_id": 9} +{"actual_output_tokens": 63, "cached_tokens": 18944, "effective_input_length": 126924, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126924, "latency_s": 51.56339437700808, "output_length": 63, "proxy_request_id": "1267915:1:1267915:96", "request_id": "1267915:1:1267915:96", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1267915", "t_dispatch_unix": 1779820792.2095098, "t_finish_unix": 1779820843.7729037, "t_first_token_unix": 1779820842.4969928, "tpot_s": 0.02057369617696461, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12617736, 8430096, 227717, 2410525, 7163, 7164, 7165, 7166, 7167, 7168, 7169, 7170, 7171, 7172, 7173, 7174, 7175, 7176, 7177, 7178, 7179, 7180, 7181, 7182, 7183, 7184, 8430097, 8430098, 8430099, 8430100, 18464, 18465, 8430101, 8430102, 8546028, 9019404, 9169593, 9266923, 9266924, 9266925, 9266926, 9266927, 9266928, 9266929, 9266930, 9266931, 9266932, 9266933, 9266934, 9266935, 9266936, 9266937, 9266938, 9266939, 9341348, 9533636, 9533637, 9533638, 9533639, 9533640, 9533641, 9533642, 9533643, 9533644, 9533645, 9533646, 9533647, 9533648, 9533649, 9533650, 9533651, 9533652, 9533653, 9533654, 9706094, 9706095, 9865188, 9865189, 9865190, 9970890, 10129168, 10129169, 10129170, 10129171, 10129172, 10129173, 10129174, 10129175, 10129176, 10129177, 10129178, 10129179, 10129180, 10129181, 10129182, 10129183, 10129184, 10209871, 10209872, 10209873, 10209874, 10209875, 10209876, 10209877, 10209878, 10209879, 10209880, 10209881, 10209882, 10209883, 10209884, 10209885, 10209886, 10209887, 10274360, 10274361, 10377876, 10377877, 10562058, 10646138, 10646139, 10646140, 10826772, 10826773, 10961137, 10961138, 10961139, 10961140, 10961141, 10961142, 10961143, 11025646, 11025647, 11025648, 11025649, 11025650, 11025651, 11207611, 11207612, 11207613, 11207614, 11207615, 11207616, 11207617, 11395719, 11395720, 11395721, 11395722, 11395723, 11395724, 11395725, 11395726, 11395727, 11395728, 11395729, 11395730, 11395731, 11497760, 11742899, 11895597, 12087820, 12087821, 12087822, 12087823, 12087824, 12087825, 12087826, 12087827, 12087828, 12087829, 12087830, 12087831, 12134161, 12292796, 12292797, 12239354, 12239355, 12239356, 12239357, 12239358, 12239359, 12239360, 12239361, 12239362, 12292798, 12292799, 12292800, 12292801, 12292802, 12292803, 12292804, 12292805, 12292806, 12292807, 12292808, 12292809, 12395930, 12395931, 12395932, 12395933, 12395934, 12395935, 12395936, 12395937, 12395938, 12395939, 12395940, 12395941, 12395942, 12455493, 12617737], "trace_timestamp_s": 105.23199999999997, "ttft_s": 50.28748031001305, "turn_id": 1} +{"actual_output_tokens": 120, "cached_tokens": 14096, "effective_input_length": 23650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23650, "latency_s": 39.06833514501341, "output_length": 120, "proxy_request_id": "1265128:2:1271655:122", "request_id": "1265128:2:1271655:122", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1265128", "t_dispatch_unix": 1779820805.0619912, "t_finish_unix": 1779820844.1303263, "t_first_token_unix": 1779820842.999313, "tpot_s": 0.009502350125743561, "trace_hash_ids": [12656235, 12656236, 12656237, 12656238, 12656239, 12656240, 12656241, 12656242, 12656243, 12656244, 12656245, 12656246, 12656247, 12656248, 12656249, 12656250, 12656251, 12656252, 12656253, 12656254, 12656255, 12656256, 12656257, 12656258, 12656259, 12656260, 12656261, 12656262, 12656263, 12656264, 12656265, 12656266, 12656267, 12656268, 12656269, 12656270, 12656271, 12656272, 12656273, 12656274, 12656275, 12656276, 12656277, 12656278, 12656279, 12656280, 12656281], "trace_timestamp_s": 118.11500000000069, "ttft_s": 37.937319683027454, "turn_id": 2} +{"actual_output_tokens": 93, "cached_tokens": 31488, "effective_input_length": 42023, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42023, "latency_s": 3.4952510350267403, "output_length": 93, "proxy_request_id": "1260327:5:1281915:172", "request_id": "1260327:5:1281915:172", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1260327", "t_dispatch_unix": 1779820840.98361, "t_finish_unix": 1779820844.4788609, "t_first_token_unix": 1779820843.7277825, "tpot_s": 0.008161469510726063, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12755397], "trace_timestamp_s": 154.04100000000017, "ttft_s": 2.7441690760315396, "turn_id": 5} +{"actual_output_tokens": 607, "cached_tokens": 113840, "effective_input_length": 118097, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118097, "latency_s": 16.684782048978377, "output_length": 607, "proxy_request_id": "1258859:3:1278118:155", "request_id": "1258859:3:1278118:155", "request_type": "coder", "requested_output_tokens": 607, "session_id": "1258859", "t_dispatch_unix": 1779820828.2089248, "t_finish_unix": 1779820844.8937063, "t_first_token_unix": 1779820832.8590138, "tpot_s": 0.01985875522768165, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12719963, 12719964, 12719965, 12719966, 12719967, 12719968, 12719969, 12719970, 12719971, 12719972], "trace_timestamp_s": 141.26500000000033, "ttft_s": 4.650087854010053, "turn_id": 3} +{"actual_output_tokens": 273, "cached_tokens": 11744, "effective_input_length": 13901, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13901, "latency_s": 4.798736372962594, "output_length": 273, "proxy_request_id": "1272313:4:1281720:170", "request_id": "1272313:4:1281720:170", "request_type": "coder", "requested_output_tokens": 273, "session_id": "1272313", "t_dispatch_unix": 1779820840.3043106, "t_finish_unix": 1779820845.103047, "t_first_token_unix": 1779820840.65771, "tpot_s": 0.016342056959675735, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12753629], "trace_timestamp_s": 153.3650000000007, "ttft_s": 0.35339812497841194, "turn_id": 4} +{"actual_output_tokens": 6, "cached_tokens": 0, "effective_input_length": 16299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16299, "latency_s": 1.5114750349894166, "output_length": 6, "proxy_request_id": "1277533:2:1282872:175", "request_id": "1277533:2:1282872:175", "request_type": "coder", "requested_output_tokens": 6, "session_id": "1277533", "t_dispatch_unix": 1779820844.2876136, "t_finish_unix": 1779820845.7990885, "t_first_token_unix": 1779820845.7859225, "tpot_s": 0.002582012198399752, "trace_hash_ids": [12764556, 12764557, 12764558, 12764559, 12764560, 12764561, 12764562, 12764563, 12764564, 12764565, 12764566, 12764567, 12764568, 12764569, 12764570, 12764571, 12764572, 12764573, 12764574, 12764575, 12764576, 12764577, 12764578, 12764579, 12764580, 12764581, 12764582, 12764583, 12764584, 12764585, 12764586, 12764587], "trace_timestamp_s": 157.34400000000005, "ttft_s": 1.4983067100401968, "turn_id": 2} +{"actual_output_tokens": 618, "cached_tokens": 20368, "effective_input_length": 26426, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26426, "latency_s": 7.382247827015817, "output_length": 618, "proxy_request_id": "1279412:2:1281113:167", "request_id": "1279412:2:1281113:167", "request_type": "coder", "requested_output_tokens": 618, "session_id": "1279412", "t_dispatch_unix": 1779820838.4877741, "t_finish_unix": 1779820845.8700218, "t_first_token_unix": 1779820839.6240294, "tpot_s": 0.010122774786020009, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12748544], "trace_timestamp_s": 151.54700000000048, "ttft_s": 1.1362526710145175, "turn_id": 2} +{"actual_output_tokens": 659, "cached_tokens": 7680, "effective_input_length": 24222, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24222, "latency_s": 18.55713866004953, "output_length": 659, "proxy_request_id": "1277909:1:1277909:153", "request_id": "1277909:1:1277909:153", "request_type": "coder", "requested_output_tokens": 659, "session_id": "1277909", "t_dispatch_unix": 1779820827.5028894, "t_finish_unix": 1779820846.0600278, "t_first_token_unix": 1779820832.8357189, "tpot_s": 0.02009729204552905, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12718539], "trace_timestamp_s": 140.558, "ttft_s": 5.332828047045041, "turn_id": 1} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 8510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8510, "latency_s": 0.9413192899664864, "output_length": 60, "proxy_request_id": "1283642:1:1283642:178", "request_id": "1283642:1:1283642:178", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1283642", "t_dispatch_unix": 1779820846.7248704, "t_finish_unix": 1779820847.6661892, "t_first_token_unix": 1779820847.3597808, "tpot_s": 0.0051885124915516225, "trace_hash_ids": [12764037, 12764038, 12764039, 12764040, 12764041, 12764042, 12764043, 12764044, 12764045, 12772097, 12772098, 12772099, 12772100, 12772101, 12772102, 12772103, 12772104], "trace_timestamp_s": 159.78400000000056, "ttft_s": 0.6349097369820811, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 34240, "effective_input_length": 34282, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34282, "latency_s": 0.6736118869739585, "output_length": 66, "proxy_request_id": "1262354:10:1283773:180", "request_id": "1262354:10:1283773:180", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1262354", "t_dispatch_unix": 1779820847.155732, "t_finish_unix": 1779820847.8293438, "t_first_token_unix": 1779820847.2517383, "tpot_s": 0.00888118061523598, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490], "trace_timestamp_s": 160.21700000000055, "ttft_s": 0.09600452601443976, "turn_id": 10} +{"actual_output_tokens": 266, "cached_tokens": 17504, "effective_input_length": 30262, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30262, "latency_s": 8.626059138041455, "output_length": 266, "proxy_request_id": "1269373:4:1280765:165", "request_id": "1269373:4:1280765:165", "request_type": "coder", "requested_output_tokens": 266, "session_id": "1269373", "t_dispatch_unix": 1779820840.5733235, "t_finish_unix": 1779820849.1993828, "t_first_token_unix": 1779820843.0125737, "tpot_s": 0.02334523333219003, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12745691], "trace_timestamp_s": 150.16900000000078, "ttft_s": 2.4392484090058133, "turn_id": 4} +{"actual_output_tokens": 3746, "cached_tokens": 22352, "effective_input_length": 25187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25187, "latency_s": 64.70526725397212, "output_length": 3746, "proxy_request_id": "1242838:4:1265709:87", "request_id": "1242838:4:1265709:87", "request_type": "coder", "requested_output_tokens": 3746, "session_id": "1242838", "t_dispatch_unix": 1779820784.6921299, "t_finish_unix": 1779820849.3973963, "t_first_token_unix": 1779820820.9060702, "tpot_s": 0.007607757798936939, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 12596375], "trace_timestamp_s": 97.75300000000061, "ttft_s": 36.213938716973644, "turn_id": 4} +{"actual_output_tokens": 5747, "cached_tokens": 22624, "effective_input_length": 27639, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27639, "latency_s": 65.97445077903103, "output_length": 5747, "proxy_request_id": "1239034:4:1263738:78", "request_id": "1239034:4:1263738:78", "request_type": "coder", "requested_output_tokens": 5747, "session_id": "1239034", "t_dispatch_unix": 1779820783.530939, "t_finish_unix": 1779820849.50539, "t_first_token_unix": 1779820784.5468287, "tpot_s": 0.011304953956150401, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 12336726, 12336727, 12336728, 12336729, 12351436, 12351437, 12351438, 12351439, 12351440, 12351441, 12351442, 12351443, 12351444, 12351445, 12562130, 12562131, 12562132, 12562133, 12562134, 12562135, 12562136, 12562137, 12576042, 12576043, 12576044, 12576045, 12576046, 12576047, 12576048, 12576049, 12576050, 12576051], "trace_timestamp_s": 90.9380000000001, "ttft_s": 1.015887102985289, "turn_id": 4} +{"actual_output_tokens": 347, "cached_tokens": 118688, "effective_input_length": 118736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118736, "latency_s": 7.532773825048935, "output_length": 347, "proxy_request_id": "1258859:4:1282900:176", "request_id": "1258859:4:1282900:176", "request_type": "coder", "requested_output_tokens": 347, "session_id": "1258859", "t_dispatch_unix": 1779820844.900108, "t_finish_unix": 1779820852.4328816, "t_first_token_unix": 1779820845.1672976, "tpot_s": 0.020998108728298905, "trace_hash_ids": [12430567, 12430568, 12430569, 12430570, 12430571, 12430572, 12430573, 12430574, 12430575, 12430576, 12430577, 12430578, 12430579, 12430580, 12430581, 130102, 12430582, 12430583, 12430584, 566066, 12430585, 12430586, 12430587, 12430588, 12430589, 12430590, 12430591, 12430592, 12430593, 12430594, 12430595, 12430596, 12430597, 12430598, 12430599, 12430600, 12430601, 12430602, 12430603, 12430604, 12430605, 12430606, 12430607, 12430608, 12430609, 12430610, 12430611, 12430612, 12430613, 12430614, 12430615, 12430616, 12430617, 12430618, 12430619, 12430620, 12430621, 12430622, 12430623, 1795157, 1795158, 12430624, 12430625, 12430626, 12430627, 12430628, 12430629, 12430630, 12430631, 12430632, 12430633, 12430634, 12430635, 12430636, 12430637, 12430638, 12430639, 12430640, 12430641, 12430642, 12430643, 12430644, 12430645, 12430646, 12430647, 12430648, 12430649, 12430650, 12430651, 12430652, 12430653, 12430654, 12430655, 12430656, 12430657, 12430658, 12430659, 12430660, 12430661, 12430662, 12430663, 12430664, 12430665, 12430666, 12430667, 12430668, 12430669, 12430670, 12430671, 12430672, 12430673, 12430674, 12430675, 12430676, 12430677, 12430678, 12430679, 12430680, 12430681, 12430682, 12430683, 12430684, 12430685, 12430686, 12430687, 12430688, 12430689, 12430690, 12430691, 12430692, 12430693, 12430694, 12430695, 12430696, 12430697, 12430698, 12430699, 12430700, 12430701, 12430702, 12430703, 12430704, 12430705, 12430706, 12430707, 12430708, 12430709, 12430710, 12430711, 12430712, 12430713, 12430714, 12430715, 12430716, 12430717, 12430718, 12430719, 12430720, 12430721, 12430722, 12430723, 12430724, 12430725, 12430726, 12430727, 12430728, 12430729, 12430730, 12430731, 12430732, 12430733, 12430734, 12430735, 12430736, 12430737, 12430738, 12430739, 12430740, 12430741, 12430742, 12430743, 12430744, 12430745, 12430746, 12430747, 12430748, 12430749, 12430750, 12430751, 12430752, 12430753, 12430754, 12430755, 12430756, 12430757, 12430758, 12430759, 12430760, 12430761, 12430762, 12430763, 12430764, 12430765, 12430766, 12430767, 12430768, 12430769, 12430770, 12430771, 12430772, 12430773, 12430774, 12430775, 12430776, 12430777, 12430778, 12430779, 12430780, 12430781, 12430782, 12529503, 12719963, 12719964, 12719965, 12719966, 12719967, 12719968, 12719969, 12719970, 12719971, 12719972, 12765270], "trace_timestamp_s": 157.40900000000056, "ttft_s": 0.267187207005918, "turn_id": 4} +{"actual_output_tokens": 14, "cached_tokens": 27040, "effective_input_length": 27077, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27077, "latency_s": 0.17766837199451402, "output_length": 14, "proxy_request_id": "1279412:3:1285475:187", "request_id": "1279412:3:1285475:187", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1279412", "t_dispatch_unix": 1779820853.1882935, "t_finish_unix": 1779820853.3659616, "t_first_token_unix": 1779820853.26931, "tpot_s": 0.007414487230842217, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281], "trace_timestamp_s": 166.2490000000007, "ttft_s": 0.08101463795173913, "turn_id": 3} +{"actual_output_tokens": 186, "cached_tokens": 32512, "effective_input_length": 42264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42264, "latency_s": 4.383470056985971, "output_length": 186, "proxy_request_id": "1268831:5:1284640:184", "request_id": "1268831:5:1284640:184", "request_type": "coder", "requested_output_tokens": 186, "session_id": "1268831", "t_dispatch_unix": 1779820850.2369807, "t_finish_unix": 1779820854.6204505, "t_first_token_unix": 1779820852.9088006, "tpot_s": 0.009250847427048594, "trace_hash_ids": [13836, 13837, 13838, 13839, 13840, 13841, 13842, 13843, 13844, 13845, 13846, 13847, 13848, 3218953, 3218954, 3218955, 3218956, 3218957, 3218958, 439849, 3218959, 3218960, 12626770, 12626771, 12649740, 12649741, 12649742, 12649743, 12649744, 12649745, 12649746, 12649747, 12649748, 12649749, 12649750, 12649751, 12649752, 12649753, 12709541, 12709542, 12709543, 12709544, 12709545, 12709546, 12709547, 12709548, 12709549, 12709550, 12709551, 12709552, 12709553, 12709554, 12709555, 12709556, 12709557, 12709558, 12709559, 12709560, 12709561, 12709562, 12709563, 12709564, 12730103, 12782348, 12782349, 12782350, 12782351, 12782352, 12782353, 12782354, 12782355, 12782356, 12782357, 12782358, 12782359, 12782360, 12782361, 12782362, 12782363, 12782364, 12782365, 12782366, 12782367], "trace_timestamp_s": 163.29400000000078, "ttft_s": 2.671817035006825, "turn_id": 5} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 4510, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4510, "latency_s": 0.7138850329793058, "output_length": 55, "proxy_request_id": "1285800:1:1285800:191", "request_id": "1285800:1:1285800:191", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1285800", "t_dispatch_unix": 1779820854.3016295, "t_finish_unix": 1779820855.0155141, "t_first_token_unix": 1779820854.5971668, "tpot_s": 0.0077427590925556915, "trace_hash_ids": [12776768, 12784744, 12784745, 12784746, 12793479, 12793480, 12793481, 12793482, 12793483], "trace_timestamp_s": 167.36200000000008, "ttft_s": 0.2955366270034574, "turn_id": 1} +{"actual_output_tokens": 70, "cached_tokens": 8560, "effective_input_length": 14192, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14192, "latency_s": 1.1592970179626718, "output_length": 70, "proxy_request_id": "1283642:2:1285731:190", "request_id": "1283642:2:1285731:190", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1283642", "t_dispatch_unix": 1779820854.0467834, "t_finish_unix": 1779820855.20608, "t_first_token_unix": 1779820854.7469823, "tpot_s": 0.006650316434493963, "trace_hash_ids": [12764037, 12764038, 12764039, 12764040, 12764041, 12764042, 12764043, 12764044, 12764045, 12772097, 12772098, 12772099, 12772100, 12772101, 12772102, 12772103, 12782108, 12782109, 12782110, 12782111, 12782112, 12782113, 12782114, 12792906, 12792907, 12792908, 12792909, 12792910], "trace_timestamp_s": 167.10600000000068, "ttft_s": 0.700197918980848, "turn_id": 2} +{"actual_output_tokens": 523, "cached_tokens": 30512, "effective_input_length": 30594, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30594, "latency_s": 6.372846820973791, "output_length": 523, "proxy_request_id": "1269373:5:1282812:174", "request_id": "1269373:5:1282812:174", "request_type": "coder", "requested_output_tokens": 523, "session_id": "1269373", "t_dispatch_unix": 1779820849.2007306, "t_finish_unix": 1779820855.5735776, "t_first_token_unix": 1779820849.3393266, "tpot_s": 0.01194241327203282, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12764050], "trace_timestamp_s": 157.13600000000042, "ttft_s": 0.13859056995715946, "turn_id": 5} +{"actual_output_tokens": 347, "cached_tokens": 0, "effective_input_length": 11, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11, "latency_s": 2.4972609079559334, "output_length": 347, "proxy_request_id": "1285558:1:1285558:188", "request_id": "1285558:1:1285558:188", "request_type": "coder", "requested_output_tokens": 347, "session_id": "1285558", "t_dispatch_unix": 1779820853.394426, "t_finish_unix": 1779820855.8916872, "t_first_token_unix": 1779820853.4134285, "tpot_s": 0.007161683829419175, "trace_hash_ids": [26603], "trace_timestamp_s": 166.45700000000033, "ttft_s": 0.019001459993887693, "turn_id": 1} +{"actual_output_tokens": 486, "cached_tokens": 14160, "effective_input_length": 14885, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14885, "latency_s": 5.662718511011917, "output_length": 486, "proxy_request_id": "1272313:5:1284744:185", "request_id": "1272313:5:1284744:185", "request_type": "coder", "requested_output_tokens": 486, "session_id": "1272313", "t_dispatch_unix": 1779820850.6788588, "t_finish_unix": 1779820856.3415773, "t_first_token_unix": 1779820852.9697764, "tpot_s": 0.006951567692893375, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12783550], "trace_timestamp_s": 163.7400000000007, "ttft_s": 2.290916080994066, "turn_id": 5} +{"actual_output_tokens": 683, "cached_tokens": 34336, "effective_input_length": 34353, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34353, "latency_s": 5.132506715017371, "output_length": 683, "proxy_request_id": "1262354:11:1284987:186", "request_id": "1262354:11:1284987:186", "request_type": "coder", "requested_output_tokens": 683, "session_id": "1262354", "t_dispatch_unix": 1779820851.6398375, "t_finish_unix": 1779820856.7723444, "t_first_token_unix": 1779820851.719658, "tpot_s": 0.007408196885613971, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12786017], "trace_timestamp_s": 164.70100000000002, "ttft_s": 0.0798184490413405, "turn_id": 11} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 1700, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1700, "latency_s": 0.3090438849758357, "output_length": 40, "proxy_request_id": "1286551:1:1286551:194", "request_id": "1286551:1:1286551:194", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1286551", "t_dispatch_unix": 1779820857.264746, "t_finish_unix": 1779820857.5737898, "t_first_token_unix": 1779820857.383323, "tpot_s": 0.004876044359452163, "trace_hash_ids": [12800256, 12800257, 12800258, 12800259], "trace_timestamp_s": 170.32600000000002, "ttft_s": 0.11857514095027, "turn_id": 1} +{"actual_output_tokens": 681, "cached_tokens": 24880, "effective_input_length": 30965, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30965, "latency_s": 11.414476831967477, "output_length": 681, "proxy_request_id": "1277909:2:1283679:179", "request_id": "1277909:2:1283679:179", "request_type": "coder", "requested_output_tokens": 681, "session_id": "1277909", "t_dispatch_unix": 1779820846.8296802, "t_finish_unix": 1779820858.2441568, "t_first_token_unix": 1779820848.1344285, "tpot_s": 0.014866862902914255, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12772584, 12772585, 12772586, 12772587, 12772588, 12772589, 12772590, 12772591, 12772592, 12772593, 12772594, 12772595, 12772596, 12772597], "trace_timestamp_s": 159.88799999999992, "ttft_s": 1.3047464530100115, "turn_id": 2} +{"actual_output_tokens": 242, "cached_tokens": 27088, "effective_input_length": 31898, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31898, "latency_s": 2.6967464039917104, "output_length": 242, "proxy_request_id": "1279412:4:1286447:193", "request_id": "1279412:4:1286447:193", "request_type": "coder", "requested_output_tokens": 242, "session_id": "1279412", "t_dispatch_unix": 1779820856.8603585, "t_finish_unix": 1779820859.5571046, "t_first_token_unix": 1779820857.9474983, "tpot_s": 0.006677568481493108, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12799351], "trace_timestamp_s": 169.92000000000007, "ttft_s": 1.0871374279959127, "turn_id": 4} +{"actual_output_tokens": 124, "cached_tokens": 0, "effective_input_length": 13962, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13962, "latency_s": 1.8994202869944274, "output_length": 124, "proxy_request_id": "1286804:1:1286804:195", "request_id": "1286804:1:1286804:195", "request_type": "coder", "requested_output_tokens": 124, "session_id": "1286804", "t_dispatch_unix": 1779820857.9959064, "t_finish_unix": 1779820859.8953266, "t_first_token_unix": 1779820859.2005389, "tpot_s": 0.005642819536350123, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12802941], "trace_timestamp_s": 171.0530000000008, "ttft_s": 1.2046308050048538, "turn_id": 1} +{"actual_output_tokens": 444, "cached_tokens": 31104, "effective_input_length": 38788, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38788, "latency_s": 5.238168041978497, "output_length": 444, "proxy_request_id": "1269373:6:1285668:189", "request_id": "1269373:6:1285668:189", "request_type": "coder", "requested_output_tokens": 444, "session_id": "1269373", "t_dispatch_unix": 1779820855.5784657, "t_finish_unix": 1779820860.816634, "t_first_token_unix": 1779820857.4927695, "tpot_s": 0.007502487386023924, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12792393], "trace_timestamp_s": 166.90500000000065, "ttft_s": 1.9143017209717073, "turn_id": 6} +{"actual_output_tokens": 93, "cached_tokens": 0, "effective_input_length": 88317, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 88317, "latency_s": 26.89427038305439, "output_length": 93, "proxy_request_id": "1279994:1:1279994:161", "request_id": "1279994:1:1279994:161", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1279994", "t_dispatch_unix": 1779820834.568714, "t_finish_unix": 1779820861.462984, "t_first_token_unix": 1779820860.623217, "tpot_s": 0.009124603097797777, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12737958, 12737959, 12737960, 12737961, 12737962, 12737963, 12737964, 12737965, 12737966, 12737967, 12737968], "trace_timestamp_s": 147.59200000000055, "ttft_s": 26.054501563019585, "turn_id": 1} +{"actual_output_tokens": 240, "cached_tokens": 0, "effective_input_length": 9925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9925, "latency_s": 2.11034880601801, "output_length": 240, "proxy_request_id": "1287588:1:1287588:198", "request_id": "1287588:1:1287588:198", "request_type": "coder", "requested_output_tokens": 240, "session_id": "1287588", "t_dispatch_unix": 1779820860.5475154, "t_finish_unix": 1779820862.6578639, "t_first_token_unix": 1779820861.3583624, "tpot_s": 0.00543609568625143, "trace_hash_ids": [12755829, 12755830, 12755831, 12755832, 12755833, 12755834, 12768457, 12768458, 12768459, 12768460, 12768461, 12768462, 12768463, 12768464, 12768465, 12768466, 12768467, 12810245, 12810246, 12810247], "trace_timestamp_s": 173.60500000000047, "ttft_s": 0.8108461750089191, "turn_id": 1} +{"actual_output_tokens": 87, "cached_tokens": 88400, "effective_input_length": 88940, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 88940, "latency_s": 1.2615938540548086, "output_length": 87, "proxy_request_id": "1279994:2:1283011:177", "request_id": "1279994:2:1283011:177", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1279994", "t_dispatch_unix": 1779820861.4691992, "t_finish_unix": 1779820862.7307928, "t_first_token_unix": 1779820861.954075, "tpot_s": 0.00902832767433422, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 303055, 12766561, 12766562, 12766563, 12766564, 12766565, 12766566, 12766567, 12766568, 12766569], "trace_timestamp_s": 157.82100000000082, "ttft_s": 0.4848736240528524, "turn_id": 2} +{"actual_output_tokens": 106, "cached_tokens": 0, "effective_input_length": 448, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 448, "latency_s": 0.5649206410162151, "output_length": 106, "proxy_request_id": "1288143:1:1288143:200", "request_id": "1288143:1:1288143:200", "request_type": "coder", "requested_output_tokens": 106, "session_id": "1288143", "t_dispatch_unix": 1779820862.5131438, "t_finish_unix": 1779820863.0780642, "t_first_token_unix": 1779820862.5633552, "tpot_s": 0.004898882409491177, "trace_hash_ids": [12815534], "trace_timestamp_s": 175.57500000000073, "ttft_s": 0.05021046003093943, "turn_id": 1} +{"actual_output_tokens": 869, "cached_tokens": 0, "effective_input_length": 49619, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49619, "latency_s": 15.879041366977617, "output_length": 869, "proxy_request_id": "1284132:1:1284132:182", "request_id": "1284132:1:1284132:182", "request_type": "coder", "requested_output_tokens": 869, "session_id": "1284132", "t_dispatch_unix": 1779820848.5126657, "t_finish_unix": 1779820864.3917072, "t_first_token_unix": 1779820857.7671022, "tpot_s": 0.007631479349072641, "trace_hash_ids": [12776618, 12776619, 12776620, 12776621, 12776622, 12776623, 12776624, 12776625, 12776626, 12776627, 12776628, 12776629, 12776630, 12776631, 12776632, 12776633, 12776634, 12776635, 12776636, 12776637, 12776638, 12776639, 12776640, 12776641, 12776642, 12776643, 12776644, 12776645, 12776646, 12776647, 12776648, 12776649, 12776650, 12776651, 12776652, 12776653, 12776654, 12776655, 12776656, 12776657, 12776658, 12776659, 12776660, 12776661, 12776662, 12776663, 12776664, 12776665, 12776666, 12776667, 12776668, 12776669, 12776670, 12776671, 12776672, 12776673, 12776674, 12776675, 12776676, 12776677, 12776678, 12776679, 12776680, 12776681, 12776682, 12776683, 12776684, 12776685, 12776686, 12776687, 12776688, 12776689, 12776690, 12776691, 12776692, 12776693, 12776694, 12776695, 12776696, 12776697, 12776698, 12776699, 12776700, 12776701, 12776702, 12776703, 12776704, 12776705, 12776706, 12776707, 12776708, 12776709, 12776710, 12776711, 12776712, 12776713, 12776714], "trace_timestamp_s": 161.5550000000003, "ttft_s": 9.254433826019522, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 6288, "effective_input_length": 6360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6360, "latency_s": 41.94584694498917, "output_length": 34, "proxy_request_id": "1274405:2:1276717:144", "request_id": "1274405:2:1276717:144", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1274405", "t_dispatch_unix": 1779820823.0613496, "t_finish_unix": 1779820865.0071967, "t_first_token_unix": 1779820864.4486616, "tpot_s": 0.01691797933237853, "trace_hash_ids": [12683425, 12683426, 12683427, 12683428, 12683429, 12683430, 12683431, 12683432, 12683433, 12683434, 12683435, 12683436, 12705637], "trace_timestamp_s": 136.1230000000005, "ttft_s": 41.38731102697784, "turn_id": 2} +{"actual_output_tokens": 481, "cached_tokens": 89024, "effective_input_length": 89226, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89226, "latency_s": 4.967951649043243, "output_length": 481, "proxy_request_id": "1279994:3:1286181:192", "request_id": "1279994:3:1286181:192", "request_type": "coder", "requested_output_tokens": 481, "session_id": "1279994", "t_dispatch_unix": 1779820862.7378778, "t_finish_unix": 1779820867.705829, "t_first_token_unix": 1779820863.0530815, "tpot_s": 0.009692729470771155, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 12796644, 12796645, 12796646, 12796647, 12796648, 12796649, 12796650, 12796651, 12796652, 12796653, 12796654], "trace_timestamp_s": 168.88300000000072, "ttft_s": 0.315201738034375, "turn_id": 3} +{"actual_output_tokens": 69, "cached_tokens": 1728, "effective_input_length": 9610, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9610, "latency_s": 0.9877487979829311, "output_length": 69, "proxy_request_id": "1286551:2:1289450:202", "request_id": "1286551:2:1289450:202", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1286551", "t_dispatch_unix": 1779820866.8570461, "t_finish_unix": 1779820867.8447945, "t_first_token_unix": 1779820867.4834714, "tpot_s": 0.0053100986029569275, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12827808], "trace_timestamp_s": 179.91600000000017, "ttft_s": 0.6264240070013329, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 10160, "effective_input_length": 10195, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10195, "latency_s": 0.14023649896262214, "output_length": 13, "proxy_request_id": "1287588:2:1289701:205", "request_id": "1287588:2:1289701:205", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1287588", "t_dispatch_unix": 1779820867.7733529, "t_finish_unix": 1779820867.9135897, "t_first_token_unix": 1779820867.8234174, "tpot_s": 0.007487543417179647, "trace_hash_ids": [12755829, 12755830, 12755831, 12755832, 12755833, 12755834, 12768457, 12768458, 12768459, 12768460, 12768461, 12768462, 12768463, 12768464, 12768465, 12768466, 12768467, 12810245, 12810246, 12830253], "trace_timestamp_s": 180.83500000000004, "ttft_s": 0.050063133996445686, "turn_id": 2} +{"actual_output_tokens": 155, "cached_tokens": 32128, "effective_input_length": 32191, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32191, "latency_s": 1.134731874044519, "output_length": 155, "proxy_request_id": "1279412:4:1289482:203", "request_id": "1279412:4:1289482:203", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1279412", "t_dispatch_unix": 1779820866.9339228, "t_finish_unix": 1779820868.0686543, "t_first_token_unix": 1779820867.0212088, "tpot_s": 0.006800095071447651, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932], "trace_timestamp_s": 179.9950000000008, "ttft_s": 0.08728432201314718, "turn_id": 4} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 7261, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7261, "latency_s": 0.6404489889973775, "output_length": 29, "proxy_request_id": "1290442:1:1290442:210", "request_id": "1290442:1:1290442:210", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1290442", "t_dispatch_unix": 1779820870.127716, "t_finish_unix": 1779820870.7681653, "t_first_token_unix": 1779820870.6264038, "tpot_s": 0.005052948965125584, "trace_hash_ids": [12815773, 12815774, 12815775, 12824652, 12824653, 12824654, 12824655, 12824656, 12824657, 12836855, 12836856, 12836857, 12836858, 12836859, 12836860], "trace_timestamp_s": 183.1870000000008, "ttft_s": 0.49868605099618435, "turn_id": 1} +{"actual_output_tokens": 409, "cached_tokens": 12688, "effective_input_length": 12765, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12765, "latency_s": 34.84195394295966, "output_length": 409, "proxy_request_id": "1268861:2:1280530:164", "request_id": "1268861:2:1280530:164", "request_type": "coder", "requested_output_tokens": 409, "session_id": "1268861", "t_dispatch_unix": 1779820836.2278743, "t_finish_unix": 1779820871.069828, "t_first_token_unix": 1779820864.4481993, "tpot_s": 0.016228913806330906, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481], "trace_timestamp_s": 149.28999999999996, "ttft_s": 28.220323515008204, "turn_id": 2} +{"actual_output_tokens": 68, "cached_tokens": 1536, "effective_input_length": 13552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13552, "latency_s": 1.4613678050227463, "output_length": 68, "proxy_request_id": "1290426:1:1290426:209", "request_id": "1290426:1:1290426:209", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1290426", "t_dispatch_unix": 1779820870.10212, "t_finish_unix": 1779820871.5634878, "t_first_token_unix": 1779820871.1945112, "tpot_s": 0.005503421552903227, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12836762, 12836763, 12836764, 12836765, 12836766, 12836767, 12836768, 12836769, 12836770], "trace_timestamp_s": 183.16300000000047, "ttft_s": 1.0923894160077907, "turn_id": 1} +{"actual_output_tokens": 531, "cached_tokens": 34080, "effective_input_length": 49380, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49380, "latency_s": 50.50259293796262, "output_length": 531, "proxy_request_id": "1266668:4:1276519:143", "request_id": "1266668:4:1276519:143", "request_type": "coder", "requested_output_tokens": 531, "session_id": "1266668", "t_dispatch_unix": 1779820822.332984, "t_finish_unix": 1779820872.8355768, "t_first_token_unix": 1779820864.4471986, "tpot_s": 0.01582664123391469, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12703762], "trace_timestamp_s": 135.38799999999992, "ttft_s": 42.114212645974476, "turn_id": 4} +{"actual_output_tokens": 80, "cached_tokens": 0, "effective_input_length": 1744, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1744, "latency_s": 0.5507110600010492, "output_length": 80, "proxy_request_id": "1291100:1:1291100:212", "request_id": "1291100:1:1291100:212", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1291100", "t_dispatch_unix": 1779820872.3429863, "t_finish_unix": 1779820872.8936973, "t_first_token_unix": 1779820872.505069, "tpot_s": 0.00491634464551565, "trace_hash_ids": [12831468, 12842817, 12842818, 12842819], "trace_timestamp_s": 185.40500000000065, "ttft_s": 0.16208125004777685, "turn_id": 1} +{"actual_output_tokens": 119, "cached_tokens": 0, "effective_input_length": 23228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23228, "latency_s": 3.989945561042987, "output_length": 119, "proxy_request_id": "1290365:1:1290365:208", "request_id": "1290365:1:1290365:208", "request_type": "coder", "requested_output_tokens": 119, "session_id": "1290365", "t_dispatch_unix": 1779820869.9200437, "t_finish_unix": 1779820873.9099894, "t_first_token_unix": 1779820872.5115392, "tpot_s": 0.01184840606756398, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12836049], "trace_timestamp_s": 182.97400000000016, "ttft_s": 2.5914935170440003, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 35024, "effective_input_length": 35099, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35099, "latency_s": 0.7450430889730342, "output_length": 80, "proxy_request_id": "1262354:12:1291548:213", "request_id": "1262354:12:1291548:213", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1262354", "t_dispatch_unix": 1779820873.9803307, "t_finish_unix": 1779820874.7253737, "t_first_token_unix": 1779820874.0879326, "tpot_s": 0.008065915177281521, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12846191], "trace_timestamp_s": 187.04100000000017, "ttft_s": 0.10759963595774025, "turn_id": 12} +{"actual_output_tokens": 207, "cached_tokens": 89696, "effective_input_length": 89749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89749, "latency_s": 3.804245589999482, "output_length": 207, "proxy_request_id": "1279994:4:1290711:211", "request_id": "1279994:4:1290711:211", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1279994", "t_dispatch_unix": 1779820870.9931772, "t_finish_unix": 1779820874.7974226, "t_first_token_unix": 1779820872.6329913, "tpot_s": 0.010505735849310617, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 48458, 48459, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4413, 4414, 35237, 35238, 35239, 35240, 35241, 35242, 12737831, 2298635, 12737832, 12737833, 12737834, 12737835, 12737836, 12737837, 12737838, 12737839, 12737840, 12737841, 12737842, 12737843, 12737844, 12737845, 12737846, 12737847, 12737848, 12737849, 12737850, 12737851, 12737852, 12737853, 12737854, 12737855, 12737856, 12737857, 12737858, 12737859, 12737860, 12737861, 12737862, 12737863, 12737864, 12737865, 12737866, 12737867, 12737868, 12737869, 12737870, 12737871, 12737872, 12737873, 12737874, 12737875, 12737876, 12737877, 12737878, 12737879, 12737880, 12737881, 12737882, 12737883, 12737884, 12737885, 12737886, 12737887, 12737888, 12737889, 12737890, 12737891, 12737892, 12737893, 12737894, 12737895, 12737896, 12737897, 12737898, 12737899, 12737900, 12737901, 12737902, 12737903, 12737904, 12737905, 12737906, 12737907, 12737908, 12737909, 12737910, 12737911, 12737912, 12737913, 12737914, 12737915, 12737916, 12737917, 12737918, 12737919, 12737920, 12737921, 12737922, 12737923, 12737924, 12737925, 12737926, 12737927, 12737928, 12737929, 12737930, 12737931, 12737932, 12737933, 12737934, 12737935, 12737936, 12737937, 12737938, 12737939, 12737940, 12737941, 12737942, 12737943, 12737944, 12737945, 12737946, 12737947, 12737948, 12737949, 12737950, 12737951, 12737952, 12737953, 12737954, 12737955, 12737956, 12737957, 12766559, 12766560, 12839503, 12839504, 12839505, 12839506, 12839507, 12839508, 12839509, 12839510, 12839511, 12839512, 12839513, 12839514], "trace_timestamp_s": 184.05000000000018, "ttft_s": 1.6398113010218367, "turn_id": 4} +{"actual_output_tokens": 89, "cached_tokens": 32336, "effective_input_length": 32359, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32359, "latency_s": 0.7505225469940342, "output_length": 89, "proxy_request_id": "1279412:5:1291651:214", "request_id": "1279412:5:1291651:214", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1279412", "t_dispatch_unix": 1779820874.2645059, "t_finish_unix": 1779820875.0150282, "t_first_token_unix": 1779820874.3362224, "tpot_s": 0.007711123647988477, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12846974], "trace_timestamp_s": 187.32600000000002, "ttft_s": 0.07171490998007357, "turn_id": 5} +{"actual_output_tokens": 54, "cached_tokens": 23344, "effective_input_length": 23414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23414, "latency_s": 0.390149766986724, "output_length": 54, "proxy_request_id": "1290365:2:1292000:217", "request_id": "1290365:2:1292000:217", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1290365", "t_dispatch_unix": 1779820875.5168633, "t_finish_unix": 1779820875.9070127, "t_first_token_unix": 1779820875.5955966, "tpot_s": 0.00587044154702387, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942], "trace_timestamp_s": 188.57900000000063, "ttft_s": 0.07873148302314803, "turn_id": 2} +{"actual_output_tokens": 29, "cached_tokens": 0, "effective_input_length": 8144, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8144, "latency_s": 0.713443715008907, "output_length": 29, "proxy_request_id": "1291944:1:1291944:216", "request_id": "1291944:1:1291944:216", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1291944", "t_dispatch_unix": 1779820875.3224473, "t_finish_unix": 1779820876.035891, "t_first_token_unix": 1779820875.8945196, "tpot_s": 0.005040902821097656, "trace_hash_ids": [12831732, 12831733, 12831734, 12831735, 12831736, 12831737, 12831738, 12844495, 12844496, 12844497, 12844498, 12850497, 12850498, 12850499, 12850500, 12850501], "trace_timestamp_s": 188.38200000000052, "ttft_s": 0.5720709210145287, "turn_id": 1} +{"actual_output_tokens": 546, "cached_tokens": 39216, "effective_input_length": 42745, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42745, "latency_s": 6.722016712010372, "output_length": 546, "proxy_request_id": "1269373:7:1290314:207", "request_id": "1269373:7:1290314:207", "request_type": "coder", "requested_output_tokens": 546, "session_id": "1269373", "t_dispatch_unix": 1779820869.7530782, "t_finish_unix": 1779820876.475095, "t_first_token_unix": 1779820870.875644, "tpot_s": 0.010273542249609434, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12835840], "trace_timestamp_s": 182.8120000000008, "ttft_s": 1.1225632519926876, "turn_id": 7} +{"actual_output_tokens": 34, "cached_tokens": 9664, "effective_input_length": 16914, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16914, "latency_s": 1.0778903160244226, "output_length": 34, "proxy_request_id": "1286551:3:1292589:219", "request_id": "1286551:3:1292589:219", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1286551", "t_dispatch_unix": 1779820877.188234, "t_finish_unix": 1779820878.2661242, "t_first_token_unix": 1779820878.0889077, "tpot_s": 0.005361198636378642, "trace_hash_ids": [12800256, 12800257, 12800258, 12807767, 12807768, 12820147, 12820148, 12820149, 12820150, 12820151, 12820152, 12820153, 12820154, 12820155, 12827804, 12827805, 12827806, 12827807, 12836762, 12836763, 12836764, 12836765, 12836766, 12836767, 12836768, 12836769, 12845101, 12845102, 12857466, 12857467, 12857468, 12857469, 12857470, 12857471], "trace_timestamp_s": 190.2490000000007, "ttft_s": 0.9006716440198943, "turn_id": 3} +{"actual_output_tokens": 86, "cached_tokens": 0, "effective_input_length": 4684, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4684, "latency_s": 0.7406185109866783, "output_length": 86, "proxy_request_id": "1292750:1:1292750:220", "request_id": "1292750:1:1292750:220", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1292750", "t_dispatch_unix": 1779820877.8263385, "t_finish_unix": 1779820878.5669572, "t_first_token_unix": 1779820878.131755, "tpot_s": 0.005116774647167938, "trace_hash_ids": [12851054, 12851055, 12851056, 12851057, 12851058, 12851059, 12851060, 12858884, 12858885, 12858886], "trace_timestamp_s": 190.88500000000022, "ttft_s": 0.30541535100201145, "turn_id": 1} +{"actual_output_tokens": 91, "cached_tokens": 35168, "effective_input_length": 35210, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35210, "latency_s": 0.675408540002536, "output_length": 91, "proxy_request_id": "1262354:13:1293000:221", "request_id": "1262354:13:1293000:221", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1262354", "t_dispatch_unix": 1779820878.6664252, "t_finish_unix": 1779820879.3418338, "t_first_token_unix": 1779820878.7481782, "tpot_s": 0.0065929572886994315, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540], "trace_timestamp_s": 191.72700000000077, "ttft_s": 0.08175148203736171, "turn_id": 13} +{"actual_output_tokens": 31, "cached_tokens": 1808, "effective_input_length": 2572, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2572, "latency_s": 0.22948630899190903, "output_length": 31, "proxy_request_id": "1291100:2:1293458:223", "request_id": "1291100:2:1293458:223", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1291100", "t_dispatch_unix": 1779820880.3142107, "t_finish_unix": 1779820880.5436966, "t_first_token_unix": 1779820880.3953226, "tpot_s": 0.004937541201555481, "trace_hash_ids": [12831468, 12842817, 12842818, 12852078, 12865966, 12865967], "trace_timestamp_s": 193.3760000000002, "ttft_s": 0.08111024694517255, "turn_id": 2} +{"actual_output_tokens": 64, "cached_tokens": 0, "effective_input_length": 77805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77805, "latency_s": 21.783136210986413, "output_length": 64, "proxy_request_id": "1287100:1:1287100:196", "request_id": "1287100:1:1287100:196", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1287100", "t_dispatch_unix": 1779820858.9582186, "t_finish_unix": 1779820880.741354, "t_first_token_unix": 1779820879.6199558, "tpot_s": 0.017796669793795676, "trace_hash_ids": [61256, 776286, 192478, 776287, 776288, 776289, 776290, 776291, 776292, 776293, 776294, 776295, 776296, 776297, 776298, 776299, 776300, 776301, 776302, 776303, 776304, 776305, 776306, 776307, 776308, 776309, 776310, 776311, 776312, 776313, 776314, 776315, 776316, 12805558, 167529, 167530, 1729741, 1729742, 1729743, 527276, 527277, 611084, 611085, 6750692, 6750693, 6750694, 6750695, 6750696, 6750697, 6750698, 6750699, 6750700, 6750701, 6750702, 6750703, 6750704, 9671050, 9671051, 9671052, 9671053, 9671054, 9671055, 9671056, 2149400, 2149401, 2149402, 9671057, 7270289, 173464, 9671058, 9671059, 9671060, 9671061, 9671062, 9671063, 9671064, 9671065, 9671066, 9671067, 9671068, 9671069, 9739253, 9739254, 9739255, 9739256, 10166701, 10457216, 10457217, 10457218, 10457219, 10457220, 10457221, 10457222, 10457223, 10457224, 10457225, 10457226, 10457227, 10457228, 10457229, 10457230, 10457231, 10457232, 10457233, 10457234, 10457235, 10642319, 10642320, 10642321, 10642322, 10642323, 10642324, 10642325, 10642326, 10843616, 10843617, 10843618, 10843619, 11736040, 11736041, 11736042, 11736043, 11736044, 11736045, 11736046, 11736047, 11736048, 11736049, 11736050, 11736051, 11736052, 11736053, 11736054, 11736055, 11736056, 11736057, 11736058, 11736059, 12076230, 12076231, 12076232, 12076233, 12179754, 12179755, 12408409, 12408410, 12408411, 12442683, 12643996, 12643997, 12805559, 12805560], "trace_timestamp_s": 171.99099999999999, "ttft_s": 20.66173437796533, "turn_id": 1} +{"actual_output_tokens": 68, "cached_tokens": 42112, "effective_input_length": 42153, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42153, "latency_s": 5.834036323009059, "output_length": 68, "proxy_request_id": "1260327:6:1291827:215", "request_id": "1260327:6:1291827:215", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1260327", "t_dispatch_unix": 1779820874.9486668, "t_finish_unix": 1779820880.7827034, "t_first_token_unix": 1779820879.6611915, "tpot_s": 0.01673460222429721, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182], "trace_timestamp_s": 188.01000000000022, "ttft_s": 4.712522224988788, "turn_id": 6} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 6460, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6460, "latency_s": 0.5467856940231286, "output_length": 25, "proxy_request_id": "1293507:1:1293507:224", "request_id": "1293507:1:1293507:224", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1293507", "t_dispatch_unix": 1779820880.5017767, "t_finish_unix": 1779820881.0485625, "t_first_token_unix": 1779820880.930708, "tpot_s": 0.004900196458038408, "trace_hash_ids": [12835633, 12835634, 12835635, 12835636, 12835637, 12835638, 12835639, 12835640, 12843654, 12851154, 12851155, 12866668, 12866669], "trace_timestamp_s": 193.5600000000004, "ttft_s": 0.4289299950469285, "turn_id": 1} +{"actual_output_tokens": 380, "cached_tokens": 49904, "effective_input_length": 58032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58032, "latency_s": 8.6786459289724, "output_length": 380, "proxy_request_id": "1266668:5:1281133:168", "request_id": "1266668:5:1281133:168", "request_type": "coder", "requested_output_tokens": 380, "session_id": "1266668", "t_dispatch_unix": 1779820872.841814, "t_finish_unix": 1779820881.52046, "t_first_token_unix": 1779820875.788691, "tpot_s": 0.01512279854884671, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12748644], "trace_timestamp_s": 151.59799999999996, "ttft_s": 2.9468746799975634, "turn_id": 5} +{"actual_output_tokens": 329, "cached_tokens": 23456, "effective_input_length": 24482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24482, "latency_s": 2.3041424770490266, "output_length": 329, "proxy_request_id": "1290365:3:1293216:222", "request_id": "1290365:3:1293216:222", "request_type": "coder", "requested_output_tokens": 329, "session_id": "1290365", "t_dispatch_unix": 1779820879.4512243, "t_finish_unix": 1779820881.7553663, "t_first_token_unix": 1779820879.7249537, "tpot_s": 0.006189623399333824, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486], "trace_timestamp_s": 192.51299999999992, "ttft_s": 0.27372745104366913, "turn_id": 3} +{"actual_output_tokens": 273, "cached_tokens": 15360, "effective_input_length": 15547, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15547, "latency_s": 20.857821887999307, "output_length": 273, "proxy_request_id": "1272313:6:1287745:199", "request_id": "1272313:6:1287745:199", "request_type": "coder", "requested_output_tokens": 273, "session_id": "1272313", "t_dispatch_unix": 1779820861.0949073, "t_finish_unix": 1779820881.9527297, "t_first_token_unix": 1779820879.6085725, "tpot_s": 0.008617308606463828, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12811862], "trace_timestamp_s": 174.15700000000015, "ttft_s": 18.513662604033016, "turn_id": 6} +{"actual_output_tokens": 63, "cached_tokens": 8160, "effective_input_length": 12388, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12388, "latency_s": 0.8067198719945736, "output_length": 63, "proxy_request_id": "1291944:2:1293798:227", "request_id": "1291944:2:1293798:227", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1291944", "t_dispatch_unix": 1779820881.5842366, "t_finish_unix": 1779820882.3909569, "t_first_token_unix": 1779820882.0552146, "tpot_s": 0.005411632274532871, "trace_hash_ids": [12831732, 12831733, 12831734, 12831735, 12831736, 12831737, 12831738, 12844495, 12844496, 12844497, 12844498, 12850497, 12850498, 12850499, 12850500, 12861564, 12861565, 12861566, 12861567, 12861568, 12861569, 12869790, 12869791, 12869792, 12869793], "trace_timestamp_s": 194.64500000000044, "ttft_s": 0.4709764049621299, "turn_id": 2} +{"actual_output_tokens": 338, "cached_tokens": 15808, "effective_input_length": 15969, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15969, "latency_s": 2.044897081970703, "output_length": 338, "proxy_request_id": "1272313:7:1290281:206", "request_id": "1272313:7:1290281:206", "request_type": "coder", "requested_output_tokens": 338, "session_id": "1272313", "t_dispatch_unix": 1779820881.9537964, "t_finish_unix": 1779820883.9986935, "t_first_token_unix": 1779820882.0332868, "tpot_s": 0.005831215258076986, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12835696], "trace_timestamp_s": 182.72299999999996, "ttft_s": 0.07948949001729488, "turn_id": 7} +{"actual_output_tokens": 201, "cached_tokens": 35296, "effective_input_length": 35435, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35435, "latency_s": 2.33868776995223, "output_length": 201, "proxy_request_id": "1262354:14:1294243:228", "request_id": "1262354:14:1294243:228", "request_type": "coder", "requested_output_tokens": 201, "session_id": "1262354", "t_dispatch_unix": 1779820882.7494562, "t_finish_unix": 1779820885.0881438, "t_first_token_unix": 1779820883.2072215, "tpot_s": 0.00940338846994564, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540, 12873922], "trace_timestamp_s": 195.8110000000006, "ttft_s": 0.45776332099922, "turn_id": 14} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 21947, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21947, "latency_s": 3.0348399420036003, "output_length": 111, "proxy_request_id": "1294611:1:1294611:229", "request_id": "1294611:1:1294611:229", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1294611", "t_dispatch_unix": 1779820884.0445604, "t_finish_unix": 1779820887.0794005, "t_first_token_unix": 1779820886.4251337, "tpot_s": 0.005945328708780421, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479], "trace_timestamp_s": 197.10300000000007, "ttft_s": 2.3805712240282446, "turn_id": 1} +{"actual_output_tokens": 491, "cached_tokens": 32432, "effective_input_length": 40278, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40278, "latency_s": 6.079424424038734, "output_length": 491, "proxy_request_id": "1279412:6:1293655:225", "request_id": "1279412:6:1293655:225", "request_type": "coder", "requested_output_tokens": 491, "session_id": "1279412", "t_dispatch_unix": 1779820881.075324, "t_finish_unix": 1779820887.1547487, "t_first_token_unix": 1779820883.1196592, "tpot_s": 0.008234395740829332, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278], "trace_timestamp_s": 194.13400000000001, "ttft_s": 2.044332758989185, "turn_id": 6} +{"actual_output_tokens": 279, "cached_tokens": 16304, "effective_input_length": 28796, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28796, "latency_s": 3.976919296954293, "output_length": 279, "proxy_request_id": "1272313:8:1293738:226", "request_id": "1272313:8:1293738:226", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1272313", "t_dispatch_unix": 1779820884.0046246, "t_finish_unix": 1779820887.981544, "t_first_token_unix": 1779820886.1974828, "tpot_s": 0.006416479510878273, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12868987], "trace_timestamp_s": 194.49099999999999, "ttft_s": 2.192855240951758, "turn_id": 8} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 10857, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10857, "latency_s": 1.292839271016419, "output_length": 82, "proxy_request_id": "1295690:1:1295690:232", "request_id": "1295690:1:1295690:232", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1295690", "t_dispatch_unix": 1779820887.949433, "t_finish_unix": 1779820889.2422721, "t_first_token_unix": 1779820888.8123052, "tpot_s": 0.005304594000335783, "trace_hash_ids": [12865131, 12865132, 12865133, 12865134, 12865135, 12865136, 12865137, 12877451, 12877452, 12877453, 12877454, 12877455, 12888257, 12888258, 12888259, 12888260, 12888261, 12888262, 12888263, 12888264, 12888265, 12888266], "trace_timestamp_s": 201.00700000000052, "ttft_s": 0.8628708479809575, "turn_id": 1} +{"actual_output_tokens": 220, "cached_tokens": 22048, "effective_input_length": 23610, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23610, "latency_s": 1.711399779014755, "output_length": 220, "proxy_request_id": "1294611:2:1295852:233", "request_id": "1294611:2:1295852:233", "request_type": "coder", "requested_output_tokens": 220, "session_id": "1294611", "t_dispatch_unix": 1779820888.4526656, "t_finish_unix": 1779820890.1640656, "t_first_token_unix": 1779820888.817336, "tpot_s": 0.006148008986367721, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12890138], "trace_timestamp_s": 201.51299999999992, "ttft_s": 0.3646685649873689, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 82014, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82014, "latency_s": 23.21499953197781, "output_length": 61, "proxy_request_id": "1289570:1:1289570:204", "request_id": "1289570:1:1289570:204", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1289570", "t_dispatch_unix": 1779820867.2814586, "t_finish_unix": 1779820890.496458, "t_first_token_unix": 1779820889.9930604, "tpot_s": 0.008385579582924645, "trace_hash_ids": [44148, 44149, 44150, 44151, 44152, 44153, 326399, 326400, 326401, 192485, 192486, 326402, 326403, 326404, 326405, 186604, 326406, 326407, 326408, 326409, 326410, 326411, 8410093, 8410094, 8410095, 8410096, 334886, 8410097, 8410098, 8410099, 8410100, 8410101, 8410102, 8410103, 8410104, 8410105, 8410106, 8410107, 8410108, 12828955, 127129, 127130, 127131, 127132, 9195123, 124871, 124872, 2501130, 2501131, 9195124, 9195125, 9195126, 9195127, 9195128, 9195129, 9195130, 9195131, 9195132, 9195133, 9195134, 9195135, 9195136, 9195137, 9195138, 9195139, 9195140, 9195141, 9195142, 9932953, 9932954, 9932955, 9932956, 9798604, 10563697, 10563698, 10563699, 10563700, 10563701, 10563702, 10563703, 10563704, 10563705, 10563706, 10563707, 10563708, 10563709, 10563710, 10563711, 10563712, 10563713, 11618308, 11618309, 11618310, 11618311, 11922778, 11922779, 11922780, 11922781, 11922782, 11922783, 11922784, 11922785, 11922786, 11922787, 11922788, 11922789, 11922790, 11922791, 11922792, 11922793, 11922794, 11922795, 11922796, 11922797, 11922798, 11922799, 11922800, 11922801, 11922802, 11922803, 11922804, 11922805, 11922806, 11922807, 11922808, 11922809, 11922810, 11922811, 11922812, 11922813, 11922814, 11922815, 11922816, 11922817, 11922818, 11922819, 11922820, 11922821, 11922822, 11922823, 11922824, 11922825, 11922826, 11922827, 11922828, 11922829, 11922830, 11922831, 11922832, 11922833, 12148250, 12148251, 12148252, 12442632, 12442633, 12442634, 12542377, 12828956, 12828957, 12828958, 12828959], "trace_timestamp_s": 180.3120000000008, "ttft_s": 22.71159965300467, "turn_id": 1} +{"actual_output_tokens": 355, "cached_tokens": 35632, "effective_input_length": 35669, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35669, "latency_s": 2.503773560980335, "output_length": 355, "proxy_request_id": "1262354:15:1296106:234", "request_id": "1262354:15:1296106:234", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1262354", "t_dispatch_unix": 1779820889.3980932, "t_finish_unix": 1779820891.9018667, "t_first_token_unix": 1779820889.4838622, "tpot_s": 0.006829857127083266, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6380, 6381, 6382, 6383, 6384, 6385, 6386, 136735, 12545503, 2768543, 2768544, 2768545, 2768546, 2768547, 2768548, 2768549, 12562241, 12574478, 12616928, 12616929, 12616930, 12616931, 12616932, 2447522, 12616933, 12616934, 12616935, 12616936, 12616937, 12616938, 12616939, 12644058, 12644059, 12644060, 12644061, 12644062, 12644063, 12644064, 12644065, 12709526, 12742761, 12773490, 12846190, 12861540, 12892843], "trace_timestamp_s": 202.45900000000074, "ttft_s": 0.08576663199346513, "turn_id": 15} +{"actual_output_tokens": 22, "cached_tokens": 0, "effective_input_length": 624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 624, "latency_s": 0.16723335499409586, "output_length": 22, "proxy_request_id": "1296872:1:1296872:235", "request_id": "1296872:1:1296872:235", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1296872", "t_dispatch_unix": 1779820892.0146182, "t_finish_unix": 1779820892.1818511, "t_first_token_unix": 1779820892.0806649, "tpot_s": 0.004807268809859774, "trace_hash_ids": [12899223, 12899224], "trace_timestamp_s": 205.07600000000002, "ttft_s": 0.06604575499659404, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 1791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1791, "latency_s": 0.3760280499700457, "output_length": 46, "proxy_request_id": "1296983:1:1296983:236", "request_id": "1296983:1:1296983:236", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1296983", "t_dispatch_unix": 1779820892.4476933, "t_finish_unix": 1779820892.8237216, "t_first_token_unix": 1779820892.6032817, "tpot_s": 0.004891804954968393, "trace_hash_ids": [12890444, 12900454, 12900455, 12900456], "trace_timestamp_s": 205.50900000000001, "ttft_s": 0.15558701200643554, "turn_id": 1} +{"actual_output_tokens": 513, "cached_tokens": 43280, "effective_input_length": 50680, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50680, "latency_s": 8.033086472016294, "output_length": 513, "proxy_request_id": "1269373:8:1295332:230", "request_id": "1269373:8:1295332:230", "request_type": "coder", "requested_output_tokens": 513, "session_id": "1269373", "t_dispatch_unix": 1779820886.5916598, "t_finish_unix": 1779820894.6247463, "t_first_token_unix": 1779820888.9394717, "tpot_s": 0.011103573292984947, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629], "trace_timestamp_s": 199.65000000000055, "ttft_s": 2.347809404018335, "turn_id": 8} +{"actual_output_tokens": 36, "cached_tokens": 42208, "effective_input_length": 42363, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42363, "latency_s": 0.3852504789829254, "output_length": 36, "proxy_request_id": "1260327:7:1297673:242", "request_id": "1260327:7:1297673:242", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1260327", "t_dispatch_unix": 1779820894.6306465, "t_finish_unix": 1779820895.015897, "t_first_token_unix": 1779820894.7971966, "tpot_s": 0.006242086372471281, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182], "trace_timestamp_s": 207.692, "ttft_s": 0.16654806799488142, "turn_id": 7} +{"actual_output_tokens": 144, "cached_tokens": 29072, "effective_input_length": 29149, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29149, "latency_s": 1.0086936570005491, "output_length": 144, "proxy_request_id": "1272313:9:1297810:243", "request_id": "1272313:9:1297810:243", "request_type": "coder", "requested_output_tokens": 144, "session_id": "1272313", "t_dispatch_unix": 1779820895.103719, "t_finish_unix": 1779820896.1124122, "t_first_token_unix": 1779820895.217053, "tpot_s": 0.006259532000175905, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593], "trace_timestamp_s": 208.16499999999996, "ttft_s": 0.1133321079541929, "turn_id": 9} +{"actual_output_tokens": 2687, "cached_tokens": 31632, "effective_input_length": 44920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44920, "latency_s": 30.40709059301298, "output_length": 2687, "proxy_request_id": "1277909:3:1289205:201", "request_id": "1277909:3:1289205:201", "request_type": "coder", "requested_output_tokens": 2687, "session_id": "1277909", "t_dispatch_unix": 1779820865.9872918, "t_finish_unix": 1779820896.3943818, "t_first_token_unix": 1779820869.5617502, "tpot_s": 0.00998972907632226, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 604423, 12620519, 12620520, 12617596, 12620521, 12620522, 12620523, 12718514, 12718515, 12718516, 12718517, 12718518, 12718519, 12718520, 12718521, 12718522, 12718523, 12718524, 12718525, 12718526, 12718527, 12718528, 12718529, 12718530, 12718531, 12718532, 12718533, 12718534, 12718535, 12718536, 12718537, 12718538, 12772584, 12772585, 12772586, 12772587, 12772588, 12772589, 12772590, 12772591, 12772592, 12772593, 12772594, 12772595, 12772596, 12825757, 12825758, 12825759, 12825760, 12825761, 12825762, 12825763, 12825764, 12825765, 12825766, 12825767, 12825768, 12825769, 12825770, 12825771, 12825772, 12825773, 12825774, 12825775, 12825776, 12825777, 12825778, 12825779, 12825780, 12825781, 12825782, 12825783, 12825784], "trace_timestamp_s": 179.04300000000057, "ttft_s": 3.574437915987801, "turn_id": 3} +{"actual_output_tokens": 226, "cached_tokens": 0, "effective_input_length": 13992, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13992, "latency_s": 2.493811125983484, "output_length": 226, "proxy_request_id": "1297811:1:1297811:244", "request_id": "1297811:1:1297811:244", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1297811", "t_dispatch_unix": 1779820895.1112542, "t_finish_unix": 1779820897.6050658, "t_first_token_unix": 1779820896.329525, "tpot_s": 0.005667938920151857, "trace_hash_ids": [3411, 3412, 3413, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 2642723, 18908, 18909, 18910, 2642724, 1369412, 12886430, 12886431, 12907594, 12907595, 41662, 12907596], "trace_timestamp_s": 208.16600000000017, "ttft_s": 1.2182695199735463, "turn_id": 1} +{"actual_output_tokens": 169, "cached_tokens": 24800, "effective_input_length": 25103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25103, "latency_s": 1.1677846759557724, "output_length": 169, "proxy_request_id": "1290365:4:1298540:247", "request_id": "1290365:4:1298540:247", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1290365", "t_dispatch_unix": 1779820897.6877222, "t_finish_unix": 1779820898.8555067, "t_first_token_unix": 1779820897.8066373, "tpot_s": 0.006241801976492363, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486, 12914159, 12914160], "trace_timestamp_s": 210.7490000000007, "ttft_s": 0.11891321395523846, "turn_id": 4} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 9530, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9530, "latency_s": 0.943033117975574, "output_length": 36, "proxy_request_id": "1298970:1:1298970:248", "request_id": "1298970:1:1298970:248", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1298970", "t_dispatch_unix": 1779820899.2547996, "t_finish_unix": 1779820900.1978328, "t_first_token_unix": 1779820900.015325, "tpot_s": 0.005206725543497929, "trace_hash_ids": [12901321, 12901322, 12901323, 12901324, 12901325, 12901326, 12901327, 12906384, 12906385, 12911458, 12918873, 12918874, 12918875, 12918876, 12918877, 12918878, 12918879, 12918880, 12918881], "trace_timestamp_s": 212.3110000000006, "ttft_s": 0.7605242819990963, "turn_id": 1} +{"actual_output_tokens": 492, "cached_tokens": 58400, "effective_input_length": 80055, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80055, "latency_s": 19.134930121013895, "output_length": 492, "proxy_request_id": "1266668:6:1284003:181", "request_id": "1266668:6:1284003:181", "request_type": "coder", "requested_output_tokens": 492, "session_id": "1266668", "t_dispatch_unix": 1779820881.531485, "t_finish_unix": 1779820900.6664155, "t_first_token_unix": 1779820891.0973754, "tpot_s": 0.019488320568203737, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12775718], "trace_timestamp_s": 161.10300000000007, "ttft_s": 9.565887390985154, "turn_id": 6} +{"actual_output_tokens": 226, "cached_tokens": 0, "effective_input_length": 881, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 881, "latency_s": 1.190428684989456, "output_length": 226, "proxy_request_id": "1299073:1:1299073:249", "request_id": "1299073:1:1299073:249", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1299073", "t_dispatch_unix": 1779820899.613296, "t_finish_unix": 1779820900.8037245, "t_first_token_unix": 1779820899.6924071, "tpot_s": 0.0049379659645880265, "trace_hash_ids": [7025, 12919848], "trace_timestamp_s": 212.67500000000018, "ttft_s": 0.07911019696621224, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 7963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7963, "latency_s": 0.7478580989991315, "output_length": 38, "proxy_request_id": "1296983:2:1299368:250", "request_id": "1296983:2:1299368:250", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1296983", "t_dispatch_unix": 1779820900.4372435, "t_finish_unix": 1779820901.1851015, "t_first_token_unix": 1779820900.9960623, "tpot_s": 0.005102406809660229, "trace_hash_ids": [12890444, 12900454, 12900455, 12907879, 12907880, 12907881, 12907882, 12914282, 12914283, 12914284, 12921804, 12921805, 12921806, 12921807, 12921808, 12921809], "trace_timestamp_s": 213.4970000000003, "ttft_s": 0.5588172230054624, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 640, "effective_input_length": 8352, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8352, "latency_s": 0.6929274320136756, "output_length": 27, "proxy_request_id": "1296872:2:1299394:251", "request_id": "1296872:2:1299394:251", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1296872", "t_dispatch_unix": 1779820900.5511875, "t_finish_unix": 1779820901.2441149, "t_first_token_unix": 1779820901.1130002, "tpot_s": 0.005033114423545508, "trace_hash_ids": [12899223, 12908829, 12908830, 12908831, 12908832, 12915224, 12915225, 12915226, 12915227, 12915228, 12915229, 12915230, 12921915, 12921916, 12921917, 12921918, 12921919], "trace_timestamp_s": 213.61000000000058, "ttft_s": 0.5618106769979931, "turn_id": 2} +{"actual_output_tokens": 224, "cached_tokens": 40768, "effective_input_length": 60193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60193, "latency_s": 8.35229084501043, "output_length": 224, "proxy_request_id": "1279412:7:1297236:238", "request_id": "1279412:7:1297236:238", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1279412", "t_dispatch_unix": 1779820893.4438019, "t_finish_unix": 1779820901.7960927, "t_first_token_unix": 1779820899.9902754, "tpot_s": 0.00809655674877305, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12902561], "trace_timestamp_s": 206.4970000000003, "ttft_s": 6.546471302979626, "turn_id": 7} +{"actual_output_tokens": 18, "cached_tokens": 0, "effective_input_length": 19157, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19157, "latency_s": 2.1202787359943613, "output_length": 18, "proxy_request_id": "1292750:2:1299406:252", "request_id": "1292750:2:1299406:252", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1292750", "t_dispatch_unix": 1779820900.590113, "t_finish_unix": 1779820902.7103918, "t_first_token_unix": 1779820902.5172331, "tpot_s": 0.01134518617490197, "trace_hash_ids": [12922192, 12922193, 12922194, 12922195, 12922196, 12922197, 12922198, 12922199, 12922200, 12922201, 12922202, 12922203, 12922204, 12922205, 12922206, 12922207, 12922208, 12922209, 12922210, 12922211, 12922212, 12922213, 12922214, 12922215, 12922216, 12922217, 12922218, 12922219, 12922220, 12922221, 12922222, 12922223, 12922224, 12922225, 12922226, 12922227, 12922228, 12922229], "trace_timestamp_s": 213.64500000000044, "ttft_s": 1.9271168140112422, "turn_id": 2} +{"actual_output_tokens": 222, "cached_tokens": 29280, "effective_input_length": 29486, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29486, "latency_s": 2.097153401002288, "output_length": 222, "proxy_request_id": "1272313:10:1299814:254", "request_id": "1272313:10:1299814:254", "request_type": "coder", "requested_output_tokens": 222, "session_id": "1272313", "t_dispatch_unix": 1779820901.9676597, "t_finish_unix": 1779820904.0648127, "t_first_token_unix": 1779820902.5984457, "tpot_s": 0.006633588692333499, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593, 12926791], "trace_timestamp_s": 215.02900000000045, "ttft_s": 0.6307831059675664, "turn_id": 10} +{"actual_output_tokens": 211, "cached_tokens": 60416, "effective_input_length": 60678, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60678, "latency_s": 1.9385051040444523, "output_length": 211, "proxy_request_id": "1279412:8:1300001:255", "request_id": "1279412:8:1300001:255", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1279412", "t_dispatch_unix": 1779820902.6493278, "t_finish_unix": 1779820904.587833, "t_first_token_unix": 1779820902.8768938, "tpot_s": 0.008145946395372795, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12928377], "trace_timestamp_s": 215.70900000000074, "ttft_s": 0.22756344202207401, "turn_id": 8} +{"actual_output_tokens": 18, "cached_tokens": 7280, "effective_input_length": 11994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11994, "latency_s": 10.231038515048567, "output_length": 18, "proxy_request_id": "1290442:2:1298058:246", "request_id": "1290442:2:1298058:246", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1290442", "t_dispatch_unix": 1779820895.983049, "t_finish_unix": 1779820906.214088, "t_first_token_unix": 1779820906.0970764, "tpot_s": 0.0068553312346065305, "trace_hash_ids": [12909662, 12909663, 12909664, 12909665, 12909666, 12909667, 12909668, 12909669, 12909670, 12909671, 12909672, 12909673, 12909674, 12909675, 12909676, 12909677, 12909678, 12909679, 12909680, 12909681, 12909682, 12909683, 12909684, 12909685], "trace_timestamp_s": 209.04100000000017, "ttft_s": 10.114026010036469, "turn_id": 2} +{"actual_output_tokens": 44, "cached_tokens": 18944, "effective_input_length": 62414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62414, "latency_s": 12.522447437979281, "output_length": 44, "proxy_request_id": "1297473:1:1297473:239", "request_id": "1297473:1:1297473:239", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1297473", "t_dispatch_unix": 1779820894.1816025, "t_finish_unix": 1779820906.7040498, "t_first_token_unix": 1779820906.2935188, "tpot_s": 0.009539907023873787, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 12904663, 5910591, 5910592, 5910593, 185213, 185214, 185215, 185216, 185217, 185218, 185219, 185220, 185221, 185222, 185223, 185224, 185225, 185226, 185227, 185228, 185229, 185230, 185231, 185232, 185233, 185234, 5910594, 5910595, 5910596, 5910597, 5910598, 5910599, 5910600, 5910601, 5910602, 5910603, 5910604, 5910605, 5910606, 5910607, 5910608, 5910609, 10616321, 10652041, 10652042, 10652043, 10652044, 10652045, 10652046, 10652047, 10652048, 10652049, 10652050, 10652051, 494688, 494689, 494690, 494691, 494692, 494693, 494694, 494695, 494696, 494697, 10806837, 10877108, 10877109, 10877110, 11193681, 11243946, 11449317, 11449318, 11562111, 11620173, 11788107, 11788108, 11788109, 11935542, 11935543, 12633973, 12633974, 12633975, 12904664, 12904665, 12904666], "trace_timestamp_s": 207.22700000000077, "ttft_s": 12.11191425297875, "turn_id": 1} +{"actual_output_tokens": 114, "cached_tokens": 14080, "effective_input_length": 14213, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14213, "latency_s": 3.69061484397389, "output_length": 114, "proxy_request_id": "1286804:2:1300234:256", "request_id": "1286804:2:1300234:256", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1286804", "t_dispatch_unix": 1779820903.4171999, "t_finish_unix": 1779820907.1078146, "t_first_token_unix": 1779820906.3004467, "tpot_s": 0.00714286344241252, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548], "trace_timestamp_s": 216.47900000000027, "ttft_s": 2.8832460659905337, "turn_id": 2} +{"actual_output_tokens": 353, "cached_tokens": 13168, "effective_input_length": 21630, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21630, "latency_s": 11.591014990000986, "output_length": 353, "proxy_request_id": "1268861:3:1298057:245", "request_id": "1268861:3:1298057:245", "request_type": "coder", "requested_output_tokens": 353, "session_id": "1268861", "t_dispatch_unix": 1779820895.9686716, "t_finish_unix": 1779820907.5596864, "t_first_token_unix": 1779820897.304676, "tpot_s": 0.029132443519880657, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 12909661], "trace_timestamp_s": 209.02700000000004, "ttft_s": 1.336003040021751, "turn_id": 3} +{"actual_output_tokens": 224, "cached_tokens": 0, "effective_input_length": 59507, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59507, "latency_s": 15.367733330000192, "output_length": 224, "proxy_request_id": "1297117:1:1297117:237", "request_id": "1297117:1:1297117:237", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1297117", "t_dispatch_unix": 1779820892.920366, "t_finish_unix": 1779820908.2880993, "t_first_token_unix": 1779820906.0919056, "tpot_s": 0.009847326273612277, "trace_hash_ids": [260868, 260869, 260870, 519720, 519721, 519722, 519723, 519724, 8258402, 8258403, 8258404, 8258405, 8258406, 8258407, 8258408, 8258409, 8258410, 8258411, 8258412, 8258413, 11600903, 407435, 11420699, 11420700, 11600904, 11600905, 11600906, 11600907, 11600908, 11600909, 11600910, 11600911, 11600912, 11600913, 11600914, 11600915, 11600916, 11600917, 11600918, 11600919, 11600920, 11600921, 11600922, 11600923, 11600924, 11600925, 11600926, 11600927, 11600928, 11600929, 11600930, 11600931, 11600932, 11600933, 11600934, 11600935, 11600936, 11600937, 11600938, 11600939, 11600940, 11600941, 11600942, 11600943, 11600944, 11600945, 11600946, 11600947, 11600948, 11600949, 11600950, 11600951, 11600952, 11600953, 11600954, 11600955, 11600956, 11600957, 11600958, 11600959, 11600960, 11600961, 11600962, 11600963, 11600964, 11600965, 11600966, 11600967, 11779968, 11779969, 11779970, 11888331, 11888332, 12280028, 12280029, 12280030, 12280031, 12280032, 12280033, 12280034, 12280035, 12280036, 12386666, 12386667, 12386668, 12386669, 12386670, 12480643, 12480644, 12480645, 12480646, 12480647, 12672549, 12672550, 12901437, 12901438, 12901439], "trace_timestamp_s": 205.96000000000004, "ttft_s": 13.171536388981622, "turn_id": 1} +{"actual_output_tokens": 935, "cached_tokens": 0, "effective_input_length": 18893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18893, "latency_s": 7.51963826600695, "output_length": 935, "proxy_request_id": "1299507:1:1299507:253", "request_id": "1299507:1:1299507:253", "request_type": "coder", "requested_output_tokens": 935, "session_id": "1299507", "t_dispatch_unix": 1779820900.850595, "t_finish_unix": 1779820908.3702333, "t_first_token_unix": 1779820902.7854154, "tpot_s": 0.005979226493614185, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4629805, 12866561, 12923203, 12923204, 12923205, 12923206, 12923207, 12923208, 12923209, 12923210, 12923211, 12923212, 12923213, 12923214], "trace_timestamp_s": 213.91000000000076, "ttft_s": 1.9348184330156073, "turn_id": 1} +{"actual_output_tokens": 488, "cached_tokens": 23824, "effective_input_length": 23863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23863, "latency_s": 15.647866040002555, "output_length": 488, "proxy_request_id": "1294611:3:1297534:240", "request_id": "1294611:3:1297534:240", "request_type": "coder", "requested_output_tokens": 488, "session_id": "1294611", "t_dispatch_unix": 1779820894.289099, "t_finish_unix": 1779820909.9369652, "t_first_token_unix": 1779820906.0946372, "tpot_s": 0.007888926928064517, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12905263], "trace_timestamp_s": 207.35100000000057, "ttft_s": 11.805533264006954, "turn_id": 3} +{"actual_output_tokens": 61, "cached_tokens": 24336, "effective_input_length": 24384, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24384, "latency_s": 0.4250475789885968, "output_length": 61, "proxy_request_id": "1294611:4:1300505:257", "request_id": "1294611:4:1300505:257", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1294611", "t_dispatch_unix": 1779820909.939204, "t_finish_unix": 1779820910.3642514, "t_first_token_unix": 1779820910.0101864, "tpot_s": 0.005896120049874299, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12933072], "trace_timestamp_s": 217.4960000000001, "ttft_s": 0.07098077901173383, "turn_id": 4} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 6527, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6527, "latency_s": 0.8837861409992911, "output_length": 48, "proxy_request_id": "1302071:1:1302071:267", "request_id": "1302071:1:1302071:267", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1302071", "t_dispatch_unix": 1779820909.96931, "t_finish_unix": 1779820910.8530965, "t_first_token_unix": 1779820910.4178562, "tpot_s": 0.009254622233516358, "trace_hash_ids": [12922724, 12922725, 12922726, 12922727, 12932131, 12932132, 12932133, 12932134, 12932135, 12948308, 12948309, 12948310, 12948311], "trace_timestamp_s": 223.02900000000045, "ttft_s": 0.448544826998841, "turn_id": 1} +{"actual_output_tokens": 487, "cached_tokens": 51184, "effective_input_length": 54451, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54451, "latency_s": 5.573913214029744, "output_length": 487, "proxy_request_id": "1269373:9:1300958:261", "request_id": "1269373:9:1300958:261", "request_type": "coder", "requested_output_tokens": 487, "session_id": "1269373", "t_dispatch_unix": 1779820906.1029177, "t_finish_unix": 1779820911.6768305, "t_first_token_unix": 1779820907.3917215, "tpot_s": 0.008816593893015099, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12937628], "trace_timestamp_s": 219.15800000000036, "ttft_s": 1.2888017160003074, "turn_id": 9} +{"actual_output_tokens": 406, "cached_tokens": 80544, "effective_input_length": 87741, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87741, "latency_s": 11.041607516992372, "output_length": 406, "proxy_request_id": "1266668:7:1287468:197", "request_id": "1266668:7:1287468:197", "request_type": "coder", "requested_output_tokens": 406, "session_id": "1266668", "t_dispatch_unix": 1779820900.674075, "t_finish_unix": 1779820911.715682, "t_first_token_unix": 1779820904.5872123, "tpot_s": 0.017600339316090362, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12809031], "trace_timestamp_s": 173.22299999999996, "ttft_s": 3.913133965979796, "turn_id": 7} +{"actual_output_tokens": 45, "cached_tokens": 10928, "effective_input_length": 28972, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28972, "latency_s": 3.188254666980356, "output_length": 45, "proxy_request_id": "1295690:2:1301706:264", "request_id": "1295690:2:1301706:264", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1295690", "t_dispatch_unix": 1779820908.5430892, "t_finish_unix": 1779820911.7313433, "t_first_token_unix": 1779820911.467002, "tpot_s": 0.005996498636456884, "trace_hash_ids": [12944696, 12944697, 12944698, 12944699, 12944700, 12944701, 12944702, 12944703, 12944704, 12944705, 12944706, 12944707, 12944708, 12944709, 12944710, 12944711, 12944712, 12944713, 12944714, 12944715, 12944716, 12944717, 12944718, 12944719, 12944720, 12944721, 12944722, 12944723, 12944724, 12944725, 12944726, 12944727, 12944728, 12944729, 12944730, 12944731, 12944732, 12944733, 12944734, 12944735, 12944736, 12944737, 12944738, 12944739, 12944740, 12944741, 12944742, 12944743, 12944744, 12944745, 12944746, 12944747, 12944748, 12944749, 12944750, 12944751, 12944752], "trace_timestamp_s": 221.59400000000005, "ttft_s": 2.923910671030171, "turn_id": 2} +{"actual_output_tokens": 90, "cached_tokens": 0, "effective_input_length": 1105, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1105, "latency_s": 1.1483709100284614, "output_length": 90, "proxy_request_id": "1302449:1:1302449:269", "request_id": "1302449:1:1302449:269", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1302449", "t_dispatch_unix": 1779820911.5134027, "t_finish_unix": 1779820912.6617737, "t_first_token_unix": 1779820911.673695, "tpot_s": 0.011097463168952028, "trace_hash_ids": [12952117, 12952118, 12952119], "trace_timestamp_s": 224.57500000000073, "ttft_s": 0.1602904599858448, "turn_id": 1} +{"actual_output_tokens": 43, "cached_tokens": 0, "effective_input_length": 26441, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26441, "latency_s": 3.473795474972576, "output_length": 43, "proxy_request_id": "1302063:1:1302063:266", "request_id": "1302063:1:1302063:266", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1302063", "t_dispatch_unix": 1779820909.9623342, "t_finish_unix": 1779820913.4361296, "t_first_token_unix": 1779820913.1913073, "tpot_s": 0.0058226668334100395, "trace_hash_ids": [12896607, 12896608, 12896609, 12896610, 12896611, 12896612, 12896613, 12896614, 12896615, 12896616, 12896617, 12896618, 12896619, 12896620, 12896621, 12896622, 12896623, 12896624, 12896625, 12896626, 12896627, 12896628, 12896629, 12905071, 12905072, 12905073, 12905074, 12920854, 12920855, 12920856, 12920857, 12920858, 12920859, 12920860, 12920861, 12920862, 12920863, 12920864, 12928167, 12928168, 12928169, 12928170, 12928171, 12935909, 12935910, 12935911, 12935912, 12948081, 12948082, 12948083, 12948084, 12948085], "trace_timestamp_s": 223.01400000000012, "ttft_s": 3.228971272998024, "turn_id": 1} +{"actual_output_tokens": 660, "cached_tokens": 42384, "effective_input_length": 43181, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43181, "latency_s": 6.0234752200194634, "output_length": 660, "proxy_request_id": "1260327:8:1301686:263", "request_id": "1260327:8:1301686:263", "request_type": "coder", "requested_output_tokens": 660, "session_id": "1260327", "t_dispatch_unix": 1779820908.4558797, "t_finish_unix": 1779820914.4793549, "t_first_token_unix": 1779820908.7995095, "tpot_s": 0.008618526619135463, "trace_hash_ids": [2883, 12423067, 12423068, 12423069, 8133766, 6652261, 12423070, 12423071, 12423072, 12423073, 12423074, 12423075, 365849, 365850, 365851, 365852, 12423076, 12423077, 75654, 75655, 3259149, 3259150, 12423078, 12423079, 716, 12423080, 12423081, 5098233, 5098234, 12423082, 12423083, 12423084, 5169469, 5169470, 12423085, 12423086, 12423087, 12423088, 12423089, 12423090, 12423091, 12423092, 3840421, 6687468, 828553, 12423093, 12423094, 164579, 164580, 164581, 415352, 12423095, 12423096, 12423097, 12423098, 12423099, 12423100, 12423101, 12423102, 12423103, 12677038, 12719041, 12755377, 12755378, 12755379, 12755380, 12755381, 12755382, 12755383, 12755384, 12755385, 12755386, 12755387, 12755388, 12755389, 12755390, 12755391, 12755392, 12755393, 12755394, 12755395, 12755396, 12849182, 12944584, 12944585], "trace_timestamp_s": 221.51600000000053, "ttft_s": 0.343627380032558, "turn_id": 8} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 15958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15958, "latency_s": 1.6596754859783687, "output_length": 37, "proxy_request_id": "1302907:1:1302907:272", "request_id": "1302907:1:1302907:272", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1302907", "t_dispatch_unix": 1779820912.8779218, "t_finish_unix": 1779820914.5375972, "t_first_token_unix": 1779820914.3481653, "tpot_s": 0.0052552734171816455, "trace_hash_ids": [12894270, 12894271, 12894272, 12894273, 12894274, 12894275, 12894276, 12894277, 12894278, 12894279, 12894280, 12894281, 12894282, 12894283, 12894284, 12894285, 12894286, 12894287, 12902788, 12902789, 12902790, 12902791, 12911614, 12911615, 12911616, 12911617, 12942345, 12942346, 12942347, 12956121, 12956122, 12956123], "trace_timestamp_s": 225.9340000000002, "ttft_s": 1.4702411349862814, "turn_id": 1} +{"actual_output_tokens": 330, "cached_tokens": 25264, "effective_input_length": 25948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25948, "latency_s": 9.705564422009047, "output_length": 330, "proxy_request_id": "1290365:5:1300807:259", "request_id": "1290365:5:1300807:259", "request_type": "coder", "requested_output_tokens": 330, "session_id": "1290365", "t_dispatch_unix": 1779820905.6113896, "t_finish_unix": 1779820915.316954, "t_first_token_unix": 1779820912.2839816, "tpot_s": 0.009218023814640283, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 7779, 7780, 7781, 7782, 466354, 466355, 466356, 466357, 466358, 1938804, 1108615, 1108616, 1108617, 1108618, 2263178, 2263179, 2263180, 292313, 292314, 292315, 292316, 239491, 239492, 239493, 239494, 6563491, 491246, 491247, 1199545, 16061, 6563492, 95811, 95812, 95813, 95814, 6563493, 11892141, 12238627, 12850942, 12863485, 12863486, 12914159, 12936005, 12936006], "trace_timestamp_s": 218.67300000000068, "ttft_s": 6.672590234025847, "turn_id": 5} +{"actual_output_tokens": 51, "cached_tokens": 24432, "effective_input_length": 25650, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25650, "latency_s": 5.047945443016943, "output_length": 51, "proxy_request_id": "1294611:5:1301356:262", "request_id": "1294611:5:1301356:262", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1294611", "t_dispatch_unix": 1779820910.3661811, "t_finish_unix": 1779820915.4141266, "t_first_token_unix": 1779820910.6577885, "tpot_s": 0.09512068181997164, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 11891732], "trace_timestamp_s": 220.3160000000007, "ttft_s": 0.2916049170307815, "turn_id": 5} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 3709, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3709, "latency_s": 0.45208111201645806, "output_length": 45, "proxy_request_id": "1302449:2:1303563:277", "request_id": "1302449:2:1303563:277", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1302449", "t_dispatch_unix": 1779820915.2042856, "t_finish_unix": 1779820915.6563666, "t_first_token_unix": 1779820915.436044, "tpot_s": 0.005001153773099015, "trace_hash_ids": [12952117, 12952118, 12962314, 12962315, 12962316, 12962317, 12962318, 12962319], "trace_timestamp_s": 228.26500000000033, "ttft_s": 0.2317575659835711, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 3065, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3065, "latency_s": 0.5638083709636703, "output_length": 46, "proxy_request_id": "1303651:1:1303651:278", "request_id": "1303651:1:1303651:278", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1303651", "t_dispatch_unix": 1779820915.5111144, "t_finish_unix": 1779820916.0749228, "t_first_token_unix": 1779820915.731264, "tpot_s": 0.00762995731137279, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324], "trace_timestamp_s": 228.57200000000012, "ttft_s": 0.2201484949910082, "turn_id": 1} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 15081, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15081, "latency_s": 1.6772465409594588, "output_length": 61, "proxy_request_id": "1303517:1:1303517:275", "request_id": "1303517:1:1303517:275", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1303517", "t_dispatch_unix": 1779820915.0743656, "t_finish_unix": 1779820916.751612, "t_first_token_unix": 1779820916.421616, "tpot_s": 0.00549534451662718, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12961789], "trace_timestamp_s": 228.1310000000003, "ttft_s": 1.3472491499851458, "turn_id": 1} +{"actual_output_tokens": 1887, "cached_tokens": 0, "effective_input_length": 114612, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 114612, "latency_s": 99.35685001302045, "output_length": 1887, "proxy_request_id": "1275274:1:1275274:136", "request_id": "1275274:1:1275274:136", "request_type": "coder", "requested_output_tokens": 1887, "session_id": "1275274", "t_dispatch_unix": 1779820817.8162441, "t_finish_unix": 1779820917.173094, "t_first_token_unix": 1779820860.194841, "tpot_s": 0.030211031568952176, "trace_hash_ids": [9491467, 195037, 195038, 195039, 195040, 195041, 195042, 195043, 195044, 10319406, 10319407, 10319408, 10319409, 10319410, 10319411, 10319412, 10319413, 10319414, 5374859, 10319415, 10319416, 816846, 10319417, 10319418, 10319419, 10319420, 194680, 194681, 10319421, 10319422, 10319423, 10319424, 10319425, 10319426, 10319427, 10319428, 10319429, 10319430, 10319431, 10319432, 10319433, 10319434, 10319435, 10319436, 10319437, 10319438, 10319439, 10319440, 10319441, 10319442, 10319443, 10319444, 10319445, 10319446, 10319447, 10319448, 10319449, 10319450, 10319451, 10319452, 10319453, 10319454, 10319455, 10319456, 10319457, 10319458, 10319459, 10319460, 10319461, 10319462, 10319463, 10319464, 10319465, 10319466, 10319467, 10319468, 10319469, 10319470, 10319471, 10319472, 10319473, 10319474, 10319475, 10319476, 10319477, 10319478, 10319479, 10319480, 10319481, 10319482, 10319483, 10319484, 10319485, 10319486, 10319487, 10319488, 10319489, 10319490, 10319491, 10319492, 10319493, 10319494, 10319495, 10319496, 10319497, 10319498, 10319499, 10319500, 10319501, 10319502, 10319503, 10319504, 10319505, 10319506, 10319507, 10319508, 10319509, 10319510, 10319511, 10319512, 10319513, 10319514, 10319515, 10319516, 10319517, 10319518, 10319519, 10319520, 10319521, 10319522, 10319523, 10319524, 10319525, 10319526, 10319527, 10319528, 10319529, 10319530, 10319531, 10319532, 10319533, 10319534, 10319535, 10319536, 10319537, 10319538, 10319539, 10319540, 10319541, 10319542, 10319543, 10319544, 10319545, 10319546, 10319547, 10319548, 10319549, 10319550, 10319551, 10319552, 10319553, 10319554, 10319555, 10319556, 10319557, 10319558, 10319559, 10319560, 10319561, 10319562, 10319563, 10319564, 10319565, 10319566, 10319567, 10319568, 10319569, 10319570, 10319571, 10319572, 10319573, 10451843, 10538212, 10538213, 10590028, 10695557, 10848849, 10848850, 10848851, 10949071, 11065667, 11650526, 11650527, 11650528, 11717015, 11717016, 11717017, 11717018, 11717019, 11717020, 11796353, 11796354, 11796355, 11796356, 11895285, 12041647, 12041648, 12041649, 12041650, 12193888, 12247657, 12247658, 12247659, 12247660, 12374859, 12374860, 12374861, 12437166, 12437167, 12596754, 12596755, 12690937, 12690938, 12690939], "trace_timestamp_s": 130.82999999999993, "ttft_s": 42.37859416898573, "turn_id": 1} +{"actual_output_tokens": 52, "cached_tokens": 26480, "effective_input_length": 30248, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30248, "latency_s": 1.256048634997569, "output_length": 52, "proxy_request_id": "1302063:2:1303816:279", "request_id": "1302063:2:1303816:279", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1302063", "t_dispatch_unix": 1779820916.181025, "t_finish_unix": 1779820917.4370737, "t_first_token_unix": 1779820917.0752423, "tpot_s": 0.007089045568707162, "trace_hash_ids": [12965292, 12965293, 12965294, 12965295, 12965296, 12965297, 12965298, 12965299, 12965300, 12965301, 12965302, 12965303, 12965304, 12965305, 12965306, 12965307, 12965308, 12965309, 12965310, 12965311, 12965312, 12965313, 12965314, 12965315, 12965316, 12965317, 12965318, 12965319, 12965320, 12965321, 12965322, 12965323, 12965324, 12965325, 12965326, 12965327, 12965328, 12965329, 12965330, 12965331, 12965332, 12965333, 12965334, 12965335, 12965336, 12965337, 12965338, 12965339, 12965340, 12965341, 12965342, 12965343, 12965344, 12965345, 12965346, 12965347, 12965348, 12965349, 12965350, 12965351], "trace_timestamp_s": 229.23100000000068, "ttft_s": 0.894214681989979, "turn_id": 2} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 14944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14944, "latency_s": 2.5285956479492597, "output_length": 54, "proxy_request_id": "1303462:1:1303462:274", "request_id": "1303462:1:1303462:274", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1303462", "t_dispatch_unix": 1779820914.9098926, "t_finish_unix": 1779820917.4384878, "t_first_token_unix": 1779820916.2458332, "tpot_s": 0.02249744832120344, "trace_hash_ids": [12910193, 12910194, 12919198, 12919199, 12919200, 12919201, 12919202, 12919203, 12919204, 12928156, 12928157, 12928158, 12928159, 12928160, 12928161, 12928162, 12945250, 12945251, 12945252, 12945253, 12952336, 12952337, 12952338, 12952339, 12961346, 12961347, 12961348, 12961349, 12961350, 12961351], "trace_timestamp_s": 227.96600000000035, "ttft_s": 1.3359398059546947, "turn_id": 1} +{"actual_output_tokens": 96, "cached_tokens": 88144, "effective_input_length": 96105, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96105, "latency_s": 5.883338964020368, "output_length": 96, "proxy_request_id": "1266668:8:1292408:218", "request_id": "1266668:8:1292408:218", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1266668", "t_dispatch_unix": 1779820911.7243562, "t_finish_unix": 1779820917.6076953, "t_first_token_unix": 1779820916.33921, "tpot_s": 0.01334851843145627, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12855425], "trace_timestamp_s": 189.6910000000007, "ttft_s": 4.614850207988638, "turn_id": 8} +{"actual_output_tokens": 30, "cached_tokens": 0, "effective_input_length": 1300, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1300, "latency_s": 0.2691538159851916, "output_length": 30, "proxy_request_id": "1304239:1:1304239:280", "request_id": "1304239:1:1304239:280", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1304239", "t_dispatch_unix": 1779820917.7103384, "t_finish_unix": 1779820917.9794924, "t_first_token_unix": 1779820917.8387523, "tpot_s": 0.0048447050342882245, "trace_hash_ids": [12969576, 12969577, 12969578], "trace_timestamp_s": 230.77199999999993, "ttft_s": 0.1284126229584217, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 96192, "effective_input_length": 96717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96717, "latency_s": 0.8386016489821486, "output_length": 35, "proxy_request_id": "1266668:9:1295576:231", "request_id": "1266668:9:1295576:231", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1266668", "t_dispatch_unix": 1779820917.6132674, "t_finish_unix": 1779820918.4518688, "t_first_token_unix": 1779820918.1820188, "tpot_s": 0.007929834028747043, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825], "trace_timestamp_s": 200.66200000000026, "ttft_s": 0.568749096011743, "turn_id": 9} +{"actual_output_tokens": 30, "cached_tokens": 1328, "effective_input_length": 7798, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7798, "latency_s": 0.6308569859829731, "output_length": 30, "proxy_request_id": "1304239:2:1304866:281", "request_id": "1304239:2:1304866:281", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1304239", "t_dispatch_unix": 1779820919.857986, "t_finish_unix": 1779820920.488843, "t_first_token_unix": 1779820920.344205, "tpot_s": 0.004979308622343273, "trace_hash_ids": [12969576, 12969577, 12975186, 12975187, 12975188, 12975189, 12975190, 12975191, 12975192, 12975193, 12975194, 12975195, 12975196, 12975197, 12975198, 12975199], "trace_timestamp_s": 232.91800000000057, "ttft_s": 0.4862176139722578, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 2772, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2772, "latency_s": 0.4998159100068733, "output_length": 60, "proxy_request_id": "1304943:1:1304943:283", "request_id": "1304943:1:1304943:283", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1304943", "t_dispatch_unix": 1779820920.110761, "t_finish_unix": 1779820920.6105769, "t_first_token_unix": 1779820920.3153014, "tpot_s": 0.005000347593183614, "trace_hash_ids": [12975642, 12975643, 12975644, 12975645, 12975646, 12975647], "trace_timestamp_s": 233.17200000000048, "ttft_s": 0.20453888800693676, "turn_id": 1} +{"actual_output_tokens": 270, "cached_tokens": 96736, "effective_input_length": 97145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97145, "latency_s": 3.214478646987118, "output_length": 270, "proxy_request_id": "1266668:10:1297641:241", "request_id": "1266668:10:1297641:241", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1266668", "t_dispatch_unix": 1779820918.4565732, "t_finish_unix": 1779820921.6710515, "t_first_token_unix": 1779820918.9690022, "tpot_s": 0.010043857367942974, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12905917], "trace_timestamp_s": 207.59799999999996, "ttft_s": 0.512426064000465, "turn_id": 10} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 49855, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49855, "latency_s": 11.079649157996755, "output_length": 81, "proxy_request_id": "1253743:3:1302294:268", "request_id": "1253743:3:1302294:268", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253743", "t_dispatch_unix": 1779820910.8924718, "t_finish_unix": 1779820921.9721208, "t_first_token_unix": 1779820921.2118256, "tpot_s": 0.009500667561951559, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12950606], "trace_timestamp_s": 223.95300000000043, "ttft_s": 10.319351373997051, "turn_id": 3} +{"actual_output_tokens": 234, "cached_tokens": 54928, "effective_input_length": 59146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59146, "latency_s": 3.5185657629626803, "output_length": 234, "proxy_request_id": "1269373:10:1304899:282", "request_id": "1269373:10:1304899:282", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1269373", "t_dispatch_unix": 1779820919.9801278, "t_finish_unix": 1779820923.4986932, "t_first_token_unix": 1779820921.640131, "tpot_s": 0.007975334669573257, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12975438], "trace_timestamp_s": 233.03900000000067, "ttft_s": 1.6600016849697568, "turn_id": 10} +{"actual_output_tokens": 317, "cached_tokens": 25696, "effective_input_length": 30645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30645, "latency_s": 8.120436778001022, "output_length": 317, "proxy_request_id": "1294611:6:1302460:270", "request_id": "1294611:6:1302460:270", "request_type": "coder", "requested_output_tokens": 317, "session_id": "1294611", "t_dispatch_unix": 1779820915.417242, "t_finish_unix": 1779820923.5376792, "t_first_token_unix": 1779820921.2145157, "tpot_s": 0.007350920595094573, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210], "trace_timestamp_s": 224.59000000000015, "ttft_s": 5.797271938004997, "turn_id": 6} +{"actual_output_tokens": 109, "cached_tokens": 60880, "effective_input_length": 61291, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61291, "latency_s": 1.4880228390102275, "output_length": 109, "proxy_request_id": "1279412:9:1305633:286", "request_id": "1279412:9:1305633:286", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1279412", "t_dispatch_unix": 1779820922.7818696, "t_finish_unix": 1779820924.269892, "t_first_token_unix": 1779820923.1459754, "tpot_s": 0.010404404833227292, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330], "trace_timestamp_s": 235.84100000000035, "ttft_s": 0.36410395498387516, "turn_id": 9} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 12795, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12795, "latency_s": 1.2308684150339104, "output_length": 24, "proxy_request_id": "1303651:2:1305707:287", "request_id": "1303651:2:1305707:287", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1303651", "t_dispatch_unix": 1779820923.051299, "t_finish_unix": 1779820924.2821672, "t_first_token_unix": 1779820924.1255891, "tpot_s": 0.006790932303335032, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324, 12971828, 12971829, 12971830, 12971831, 12971832, 12971833, 12976416, 12976417, 12976418, 12976419, 12976420, 12976421, 12982240, 12982241, 12982242, 12982243, 12982244, 12982245, 12982246], "trace_timestamp_s": 236.11000000000058, "ttft_s": 1.0742885820218362, "turn_id": 2} +{"actual_output_tokens": 200, "cached_tokens": 30960, "effective_input_length": 30995, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30995, "latency_s": 1.3754479110357352, "output_length": 200, "proxy_request_id": "1294611:6:1305080:284", "request_id": "1294611:6:1305080:284", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1294611", "t_dispatch_unix": 1779820923.5391943, "t_finish_unix": 1779820924.9146426, "t_first_token_unix": 1779820923.6150155, "tpot_s": 0.006529332291283388, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12976597], "trace_timestamp_s": 233.6790000000001, "ttft_s": 0.07581907202256843, "turn_id": 6} +{"actual_output_tokens": 1838, "cached_tokens": 29696, "effective_input_length": 29948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29948, "latency_s": 13.351793729001656, "output_length": 1838, "proxy_request_id": "1272313:11:1302571:271", "request_id": "1272313:11:1302571:271", "request_type": "coder", "requested_output_tokens": 1838, "session_id": "1272313", "t_dispatch_unix": 1779820911.8351939, "t_finish_unix": 1779820925.1869872, "t_first_token_unix": 1779820911.9632525, "tpot_s": 0.007198429385434114, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 968405, 968406, 2831974, 12662675, 12697305, 12730481, 12730482, 12753624, 12753625, 12753626, 12753627, 12753628, 12783548, 12783549, 12811861, 12835695, 12868962, 12868963, 12868964, 12868965, 12868966, 12868967, 12868968, 12868969, 12868970, 12868971, 12868972, 12868973, 12868974, 12868975, 12868976, 12868977, 12868978, 12868979, 12868980, 12868981, 12868982, 12868983, 12868984, 12868985, 12868986, 12907593, 12953259, 12953260], "trace_timestamp_s": 224.89600000000064, "ttft_s": 0.12805677199503407, "turn_id": 11} +{"actual_output_tokens": 308, "cached_tokens": 97408, "effective_input_length": 97811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97811, "latency_s": 3.6155111239640974, "output_length": 308, "proxy_request_id": "1266668:11:1300918:260", "request_id": "1266668:11:1300918:260", "request_type": "coder", "requested_output_tokens": 308, "session_id": "1266668", "t_dispatch_unix": 1779820921.675607, "t_finish_unix": 1779820925.2911181, "t_first_token_unix": 1779820922.1967165, "tpot_s": 0.01007871291864093, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12937140, 12937141, 1592266], "trace_timestamp_s": 219.01100000000042, "ttft_s": 0.521106386964675, "turn_id": 11} +{"actual_output_tokens": 75, "cached_tokens": 0, "effective_input_length": 897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 897, "latency_s": 0.4374950809869915, "output_length": 75, "proxy_request_id": "1306347:1:1306347:291", "request_id": "1306347:1:1306347:291", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1306347", "t_dispatch_unix": 1779820925.0694108, "t_finish_unix": 1779820925.5069058, "t_first_token_unix": 1779820925.145279, "tpot_s": 0.0048830609051258985, "trace_hash_ids": [12988101, 12988102], "trace_timestamp_s": 238.1310000000003, "ttft_s": 0.07586731802439317, "turn_id": 1} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 14027, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14027, "latency_s": 2.240819194994401, "output_length": 183, "proxy_request_id": "1305906:1:1305906:289", "request_id": "1305906:1:1305906:289", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1305906", "t_dispatch_unix": 1779820923.6626296, "t_finish_unix": 1779820925.9034493, "t_first_token_unix": 1779820924.8765404, "tpot_s": 0.005640775159098576, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 12984070], "trace_timestamp_s": 236.72000000000025, "ttft_s": 1.2139086830429733, "turn_id": 1} +{"actual_output_tokens": 224, "cached_tokens": 18912, "effective_input_length": 18915, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18915, "latency_s": 3.166959649999626, "output_length": 224, "proxy_request_id": "1299507:2:1305770:288", "request_id": "1299507:2:1305770:288", "request_type": "coder", "requested_output_tokens": 224, "session_id": "1299507", "t_dispatch_unix": 1779820923.2447867, "t_finish_unix": 1779820926.4117467, "t_first_token_unix": 1779820924.1650589, "tpot_s": 0.010073206394507796, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4629805, 12866561, 12923203, 12923204, 12923205, 12923206, 12923207, 12923208, 12923209, 12923210, 12923211, 12923212, 12923213, 12983096], "trace_timestamp_s": 236.3070000000007, "ttft_s": 0.9202689210069366, "turn_id": 2} +{"actual_output_tokens": 524, "cached_tokens": 27312, "effective_input_length": 31058, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31058, "latency_s": 4.410344829026144, "output_length": 524, "proxy_request_id": "1277428:2:1306373:292", "request_id": "1277428:2:1306373:292", "request_type": "coder", "requested_output_tokens": 524, "session_id": "1277428", "t_dispatch_unix": 1779820925.1758518, "t_finish_unix": 1779820929.5861962, "t_first_token_unix": 1779820926.0590749, "tpot_s": 0.006743533852760347, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395], "trace_timestamp_s": 238.2360000000008, "ttft_s": 0.8832215710426681, "turn_id": 2} +{"actual_output_tokens": 64, "cached_tokens": 49920, "effective_input_length": 49975, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49975, "latency_s": 3.119642657984514, "output_length": 64, "proxy_request_id": "1253743:4:1307058:295", "request_id": "1253743:4:1307058:295", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1253743", "t_dispatch_unix": 1779820927.6175976, "t_finish_unix": 1779820930.7372406, "t_first_token_unix": 1779820930.135376, "tpot_s": 0.009548641920518425, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 12479411, 12995459], "trace_timestamp_s": 240.6780000000008, "ttft_s": 2.5177761259838007, "turn_id": 4} +{"actual_output_tokens": 155, "cached_tokens": 31184, "effective_input_length": 43378, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43378, "latency_s": 4.5136981140240096, "output_length": 155, "proxy_request_id": "1294611:7:1306822:293", "request_id": "1294611:7:1306822:293", "request_type": "coder", "requested_output_tokens": 155, "session_id": "1294611", "t_dispatch_unix": 1779820926.887081, "t_finish_unix": 1779820931.4007785, "t_first_token_unix": 1779820930.0592604, "tpot_s": 0.008709407266374532, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800], "trace_timestamp_s": 239.9430000000002, "ttft_s": 3.1721772070159204, "turn_id": 7} +{"actual_output_tokens": 65, "cached_tokens": 15136, "effective_input_length": 23131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23131, "latency_s": 1.6323608749662526, "output_length": 65, "proxy_request_id": "1303517:2:1307703:297", "request_id": "1303517:2:1307703:297", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1303517", "t_dispatch_unix": 1779820929.9466438, "t_finish_unix": 1779820931.579004, "t_first_token_unix": 1779820931.199855, "tpot_s": 0.005919465390434198, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13001399], "trace_timestamp_s": 243.0050000000001, "ttft_s": 1.2532098129740916, "turn_id": 2} +{"actual_output_tokens": 18, "cached_tokens": 1184, "effective_input_length": 8729, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8729, "latency_s": 0.6519902339787222, "output_length": 18, "proxy_request_id": "1302449:3:1308121:299", "request_id": "1302449:3:1308121:299", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1302449", "t_dispatch_unix": 1779820931.3557696, "t_finish_unix": 1779820932.00776, "t_first_token_unix": 1779820931.9267566, "tpot_s": 0.004750450059552403, "trace_hash_ids": [13004569, 13004570, 13004571, 13004572, 13004573, 13004574, 13004575, 13004576, 13004577, 13004578, 13004579, 13004580, 13004581, 13004582, 13004583, 13004584, 13004585, 115654], "trace_timestamp_s": 244.41499999999996, "ttft_s": 0.5709848669939674, "turn_id": 3} +{"actual_output_tokens": 98, "cached_tokens": 61392, "effective_input_length": 61505, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61505, "latency_s": 1.2206896169809625, "output_length": 98, "proxy_request_id": "1279412:10:1308091:298", "request_id": "1279412:10:1308091:298", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1279412", "t_dispatch_unix": 1779820931.2525756, "t_finish_unix": 1779820932.4732654, "t_first_token_unix": 1779820931.4371114, "tpot_s": 0.010679145526025714, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13004461], "trace_timestamp_s": 244.3130000000001, "ttft_s": 0.18453329900512472, "turn_id": 10} +{"actual_output_tokens": 504, "cached_tokens": 59376, "effective_input_length": 59446, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59446, "latency_s": 4.235981845995411, "output_length": 504, "proxy_request_id": "1269373:11:1307381:296", "request_id": "1269373:11:1307381:296", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1269373", "t_dispatch_unix": 1779820928.7861276, "t_finish_unix": 1779820933.022109, "t_first_token_unix": 1779820928.951285, "tpot_s": 0.008092588612325601, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 12998344], "trace_timestamp_s": 241.84600000000046, "ttft_s": 0.16515559703111649, "turn_id": 11} +{"actual_output_tokens": 16, "cached_tokens": 12816, "effective_input_length": 22896, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22896, "latency_s": 1.6455518340226263, "output_length": 16, "proxy_request_id": "1303651:3:1308202:300", "request_id": "1303651:3:1308202:300", "request_type": "coder", "requested_output_tokens": 16, "session_id": "1303651", "t_dispatch_unix": 1779820931.6101909, "t_finish_unix": 1779820933.255743, "t_first_token_unix": 1779820933.1827285, "tpot_s": 0.00485076226759702, "trace_hash_ids": [12963319, 12963320, 12963321, 12963322, 12963323, 12963324, 12971828, 12971829, 12971830, 12971831, 12971832, 12971833, 12976416, 12976417, 12976418, 12976419, 12976420, 12976421, 12982240, 12982241, 12982242, 12982243, 12982244, 12982245, 12982246, 12989553, 12989554, 12989555, 12989556, 12997676, 12997677, 12997678, 12997679, 12997680, 12997681, 12997682, 13005482, 13005483, 13005484, 13005485, 13005486, 13005487, 13005488, 13005489, 13005490], "trace_timestamp_s": 244.66800000000057, "ttft_s": 1.5725349170388654, "turn_id": 3} +{"actual_output_tokens": 2669, "cached_tokens": 0, "effective_input_length": 34706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34706, "latency_s": 24.817860630049836, "output_length": 2669, "proxy_request_id": "1301929:1:1301929:265", "request_id": "1301929:1:1301929:265", "request_type": "coder", "requested_output_tokens": 2669, "session_id": "1301929", "t_dispatch_unix": 1779820909.4105182, "t_finish_unix": 1779820934.2283785, "t_first_token_unix": 1779820914.4749029, "tpot_s": 0.007403760750751316, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950], "trace_timestamp_s": 222.46100000000024, "ttft_s": 5.064383114047814, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 23184, "effective_input_length": 23259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23259, "latency_s": 0.12727800296852365, "output_length": 12, "proxy_request_id": "1303517:3:1309213:303", "request_id": "1303517:3:1309213:303", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1303517", "t_dispatch_unix": 1779820935.3526418, "t_finish_unix": 1779820935.4799197, "t_first_token_unix": 1779820935.4320025, "tpot_s": 0.004335754640950737, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13015129], "trace_timestamp_s": 248.41400000000067, "ttft_s": 0.07935928995721042, "turn_id": 3} +{"actual_output_tokens": 96, "cached_tokens": 0, "effective_input_length": 4679, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4679, "latency_s": 0.7857861290103756, "output_length": 96, "proxy_request_id": "1309040:1:1309040:302", "request_id": "1309040:1:1309040:302", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1309040", "t_dispatch_unix": 1779820934.7280283, "t_finish_unix": 1779820935.5138142, "t_first_token_unix": 1779820935.0256565, "tpot_s": 0.0051365001580530876, "trace_hash_ids": [13004558, 13004559, 13004560, 13004561, 13004562, 13013455, 13013456, 13013457, 13013458, 13013459], "trace_timestamp_s": 247.78800000000047, "ttft_s": 0.2976272039813921, "turn_id": 1} +{"actual_output_tokens": 176, "cached_tokens": 43520, "effective_input_length": 43710, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43710, "latency_s": 1.4245560669805855, "output_length": 176, "proxy_request_id": "1294611:8:1308970:301", "request_id": "1294611:8:1308970:301", "request_type": "coder", "requested_output_tokens": 176, "session_id": "1294611", "t_dispatch_unix": 1779820934.3928974, "t_finish_unix": 1779820935.8174531, "t_first_token_unix": 1779820934.5742157, "tpot_s": 0.007102946468429374, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13012865], "trace_timestamp_s": 247.45400000000063, "ttft_s": 0.18131635198369622, "turn_id": 8} +{"actual_output_tokens": 300, "cached_tokens": 0, "effective_input_length": 24545, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24545, "latency_s": 4.690353890007827, "output_length": 300, "proxy_request_id": "1309252:1:1309252:304", "request_id": "1309252:1:1309252:304", "request_type": "coder", "requested_output_tokens": 300, "session_id": "1309252", "t_dispatch_unix": 1779820935.5555177, "t_finish_unix": 1779820940.2458718, "t_first_token_unix": 1779820938.398614, "tpot_s": 0.006176781428107263, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13015384, 13015385, 13015386, 13015387, 13015388, 13015389, 13015390, 13015391, 13015392, 13015393, 13015394, 13015395, 13015396, 13015397, 13015398, 13015399, 13015400, 13015401, 13015402, 13015403, 13015404, 13015405, 13015406, 13015407, 13015408, 13015409, 13015410, 13015411], "trace_timestamp_s": 248.60900000000038, "ttft_s": 2.843093567993492, "turn_id": 1} +{"actual_output_tokens": 166, "cached_tokens": 61600, "effective_input_length": 64558, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64558, "latency_s": 2.7047600930090994, "output_length": 166, "proxy_request_id": "1279412:11:1310014:305", "request_id": "1279412:11:1310014:305", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1279412", "t_dispatch_unix": 1779820938.1900034, "t_finish_unix": 1779820940.8947632, "t_first_token_unix": 1779820939.5279083, "tpot_s": 0.008281934751677468, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13022377], "trace_timestamp_s": 251.2470000000003, "ttft_s": 1.3379033299861476, "turn_id": 11} +{"actual_output_tokens": 85, "cached_tokens": 0, "effective_input_length": 18089, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18089, "latency_s": 2.2917051310068928, "output_length": 85, "proxy_request_id": "1310590:1:1310590:306", "request_id": "1310590:1:1310590:306", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1310590", "t_dispatch_unix": 1779820940.1412864, "t_finish_unix": 1779820942.432991, "t_first_token_unix": 1779820941.9517596, "tpot_s": 0.005726082881058876, "trace_hash_ids": [12996713, 12996714, 12996715, 12996716, 12996717, 12996718, 12996719, 12996720, 12996721, 12996722, 12996723, 12996724, 12996725, 12996726, 12996727, 12996728, 12996729, 12996730, 12996731, 12996732, 12996733, 12996734, 12996735, 12996736, 13016155, 13016156, 13016157, 13016158, 13016159, 13016160, 13027764, 13027765, 13027766, 13027767, 13027768, 13027769], "trace_timestamp_s": 253.19500000000062, "ttft_s": 1.8104713729699142, "turn_id": 1} +{"actual_output_tokens": 9, "cached_tokens": 14992, "effective_input_length": 18631, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18631, "latency_s": 18.44198545598192, "output_length": 9, "proxy_request_id": "1303462:2:1306126:290", "request_id": "1303462:2:1306126:290", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1303462", "t_dispatch_unix": 1779820924.279306, "t_finish_unix": 1779820942.721291, "t_first_token_unix": 1779820942.3162084, "tpot_s": 0.05059559787332546, "trace_hash_ids": [12985881, 12985882, 12985883, 12985884, 12985885, 12985886, 12985887, 12985888, 12985889, 12985890, 12985891, 12985892, 12985893, 12985894, 12985895, 12985896, 12985897, 12985898, 12985899, 12985900, 12985901, 12985902, 12985903, 12985904, 12985905, 12985906, 12985907, 12985908, 12985909, 12985910, 12985911, 12985912, 12985913, 12985914, 12985915, 12985916, 12985917], "trace_timestamp_s": 237.33400000000074, "ttft_s": 18.03689960297197, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 7824, "effective_input_length": 13840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13840, "latency_s": 15.542625419970136, "output_length": 31, "proxy_request_id": "1304239:3:1307007:294", "request_id": "1304239:3:1307007:294", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1304239", "t_dispatch_unix": 1779820927.4216702, "t_finish_unix": 1779820942.9642956, "t_first_token_unix": 1779820942.654884, "tpot_s": 0.01030095456711327, "trace_hash_ids": [12969576, 12969577, 12975186, 12975187, 12975188, 12975189, 12975190, 12975191, 12975192, 12975193, 12975194, 12975195, 12975196, 12975197, 12975198, 12980422, 12980423, 12980424, 12980425, 12980426, 12980427, 12980428, 12980429, 12987843, 12994759, 12994760, 12994761, 12994762], "trace_timestamp_s": 240.48100000000068, "ttft_s": 15.233212954946794, "turn_id": 3} +{"actual_output_tokens": 75, "cached_tokens": 0, "effective_input_length": 75826, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75826, "latency_s": 21.489137971017044, "output_length": 75, "proxy_request_id": "1305420:1:1305420:285", "request_id": "1305420:1:1305420:285", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1305420", "t_dispatch_unix": 1779820921.8650975, "t_finish_unix": 1779820943.3542356, "t_first_token_unix": 1779820942.3249905, "tpot_s": 0.013905099580517492, "trace_hash_ids": [442944, 442945, 442946, 442947, 442948, 442949, 442950, 442951, 442952, 442953, 442954, 442955, 442956, 442957, 442958, 442959, 1172223, 1172224, 1172225, 1172226, 1172227, 1172228, 1172229, 4960061, 8457619, 8457620, 8457621, 8457622, 8457623, 8457624, 8457625, 8457626, 8457627, 8457628, 8457629, 8457630, 8457631, 8457632, 8457633, 8457634, 8457635, 8457636, 8457637, 8457638, 8457639, 8457640, 8457641, 8457642, 8457643, 8457644, 8457645, 8457646, 8457647, 8457648, 8457649, 8457650, 8457651, 8457652, 8457653, 8457654, 8457655, 8457656, 8457657, 8457658, 8457659, 8457660, 8457661, 8457662, 8457663, 8457664, 8457665, 8457666, 8457667, 8457668, 8457669, 8457670, 8457671, 8457672, 8457673, 8457674, 8457675, 8457676, 8457677, 8457678, 8457679, 8457680, 8457681, 8457682, 8457683, 9708906, 9708907, 9708908, 9708909, 9708910, 9708911, 9708912, 9708913, 9708914, 9708915, 9708916, 9708917, 9708918, 9708919, 9708920, 9708921, 9708922, 9708923, 10055928, 10055929, 10055930, 10055931, 10055932, 10055933, 10055934, 10055935, 10055936, 10055937, 10481518, 10481519, 10481520, 10481521, 10481522, 10481523, 10481524, 12979484, 12979485, 12979486, 12979487, 12979488, 12979489, 12979490, 12979491, 12979492, 12979493, 12979494, 12979495, 12979496, 12979497, 12979498, 12979499, 12979500, 12979501, 12979502, 12979503, 12979504, 12979505, 12979506, 12979507, 12979508], "trace_timestamp_s": 234.89900000000034, "ttft_s": 20.459890821017325, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 2816, "effective_input_length": 13164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13164, "latency_s": 1.3221859890036285, "output_length": 12, "proxy_request_id": "1304943:2:1311189:307", "request_id": "1304943:2:1311189:307", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1304943", "t_dispatch_unix": 1779820942.2721548, "t_finish_unix": 1779820943.5943406, "t_first_token_unix": 1779820943.2438338, "tpot_s": 0.03183303327320821, "trace_hash_ids": [12975642, 12975643, 12975644, 12975645, 12975646, 12982335, 12982336, 12991755, 12991756, 12991757, 12991758, 13001111, 13001112, 13001113, 13001114, 13008530, 13008531, 13008532, 13008533, 13008534, 13008535, 13016603, 13016604, 13016605, 13025488, 13033993], "trace_timestamp_s": 255.32999999999993, "ttft_s": 0.9716772779938765, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 23264, "effective_input_length": 24638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24638, "latency_s": 1.1315537649788894, "output_length": 31, "proxy_request_id": "1303517:4:1311293:308", "request_id": "1303517:4:1311293:308", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1303517", "t_dispatch_unix": 1779820942.5869284, "t_finish_unix": 1779820943.7184823, "t_first_token_unix": 1779820943.540097, "tpot_s": 0.00593839210147659, "trace_hash_ids": [12961760, 12961761, 12961762, 12961763, 12961764, 12961765, 12961766, 12961767, 12961768, 12961769, 12961770, 12961771, 12961772, 12961773, 12961774, 12961775, 12961776, 12961777, 12961778, 12961779, 12961780, 12961781, 12961782, 12961783, 12961784, 12961785, 12961786, 12961787, 12961788, 12983155, 12983156, 12983157, 12983158, 12983159, 12983160, 12983161, 12983162, 12983163, 13001392, 13001393, 13001394, 13001395, 13001396, 13001397, 13001398, 13021779, 13021780, 13034659, 13034660], "trace_timestamp_s": 255.64800000000014, "ttft_s": 0.9531667339615524, "turn_id": 4} +{"actual_output_tokens": 4192, "cached_tokens": 0, "effective_input_length": 43607, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43607, "latency_s": 39.50825211202027, "output_length": 4192, "proxy_request_id": "1297811:2:1300578:258", "request_id": "1297811:2:1300578:258", "request_type": "coder", "requested_output_tokens": 4192, "session_id": "1297811", "t_dispatch_unix": 1779820904.7525113, "t_finish_unix": 1779820944.2607632, "t_first_token_unix": 1779820912.2817223, "tpot_s": 0.007630353940597377, "trace_hash_ids": [3411, 3412, 3413, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 2642723, 18908, 18909, 18910, 2642724, 1369412, 12886430, 12886431, 12907594, 12907595, 41662, 12933568, 12933569, 12933570, 12933571, 12933572, 12933573, 12933574, 12933575, 12933576, 12933577, 12933578, 12933579, 12933580, 12933581, 12933582, 12933583, 12933584, 12933585, 12933586, 12933587, 12933588, 12933589, 12933590, 12933591, 12933592, 12933593, 12933594, 12933595, 12933596, 12933597, 12933598, 12933599, 12933600, 12933601, 12933602, 12933603, 12933604, 12933605, 12933606, 12933607, 12933608, 12933609, 12933610, 12933611, 12933612, 12933613, 12933614, 12933615, 12933616, 12933617, 12933618, 12933619, 12933620, 12933621, 12933622, 12933623, 12933624, 12933625, 12933626], "trace_timestamp_s": 217.8030000000008, "ttft_s": 7.52920902997721, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 31568, "effective_input_length": 31611, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31611, "latency_s": 0.40643956302665174, "output_length": 55, "proxy_request_id": "1277428:3:1311644:311", "request_id": "1277428:3:1311644:311", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1277428", "t_dispatch_unix": 1779820943.893191, "t_finish_unix": 1779820944.2996306, "t_first_token_unix": 1779820943.9667656, "tpot_s": 0.006160005684553956, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512], "trace_timestamp_s": 256.9549999999999, "ttft_s": 0.07357222802238539, "turn_id": 3} +{"actual_output_tokens": 346, "cached_tokens": 0, "effective_input_length": 8996, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8996, "latency_s": 2.554596906004008, "output_length": 346, "proxy_request_id": "1258908:2:1311606:310", "request_id": "1258908:2:1311606:310", "request_type": "coder", "requested_output_tokens": 346, "session_id": "1258908", "t_dispatch_unix": 1779820943.7167509, "t_finish_unix": 1779820946.2713475, "t_first_token_unix": 1779820944.3982325, "tpot_s": 0.00542836748401, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13037147, 13037148], "trace_timestamp_s": 256.77800000000025, "ttft_s": 0.6814806390320882, "turn_id": 2} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 20175, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20175, "latency_s": 2.278320561046712, "output_length": 33, "proxy_request_id": "1311753:1:1311753:312", "request_id": "1311753:1:1311753:312", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1311753", "t_dispatch_unix": 1779820944.287897, "t_finish_unix": 1779820946.5662177, "t_first_token_unix": 1779820946.3941803, "tpot_s": 0.005368246936996002, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13038944], "trace_timestamp_s": 257.34200000000055, "ttft_s": 2.106281016021967, "turn_id": 1} +{"actual_output_tokens": 178, "cached_tokens": 43872, "effective_input_length": 44335, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44335, "latency_s": 1.535783207975328, "output_length": 178, "proxy_request_id": "1294611:9:1312398:313", "request_id": "1294611:9:1312398:313", "request_type": "coder", "requested_output_tokens": 178, "session_id": "1294611", "t_dispatch_unix": 1779820946.5688674, "t_finish_unix": 1779820948.1046507, "t_first_token_unix": 1779820946.8279579, "tpot_s": 0.007211350282393712, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13044795], "trace_timestamp_s": 259.6290000000008, "ttft_s": 0.25908798398450017, "turn_id": 9} +{"actual_output_tokens": 9, "cached_tokens": 24656, "effective_input_length": 25637, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25637, "latency_s": 0.30937185004586354, "output_length": 9, "proxy_request_id": "1303517:5:1313040:317", "request_id": "1303517:5:1313040:317", "request_type": "coder", "requested_output_tokens": 9, "session_id": "1303517", "t_dispatch_unix": 1779820948.6331904, "t_finish_unix": 1779820948.9425623, "t_first_token_unix": 1779820948.9146514, "tpot_s": 0.0034572300064610317, "trace_hash_ids": [13050284, 13050285, 13050286, 13050287, 13050288, 13050289, 13050290, 13050291, 13050292, 13050293, 13050294, 13050295, 13050296, 13050297, 13050298, 13050299, 13050300, 13050301, 13050302, 13050303, 13050304, 13050305, 13050306, 13050307, 13050308, 13050309, 13050310, 13050311, 13050312, 13050313, 13050314, 13050315, 13050316, 13050317, 13050318, 13050319, 13050320, 13050321, 13050322, 13050323, 13050324, 13050325, 13050326, 13050327, 13050328, 13050329, 13050330, 13050331, 13050332, 13050333, 13050334], "trace_timestamp_s": 261.6860000000006, "ttft_s": 0.2814588850014843, "turn_id": 5} +{"actual_output_tokens": 96, "cached_tokens": 24832, "effective_input_length": 44792, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44792, "latency_s": 5.559344289009459, "output_length": 96, "proxy_request_id": "1309252:2:1311531:309", "request_id": "1309252:2:1311531:309", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1309252", "t_dispatch_unix": 1779820943.4822645, "t_finish_unix": 1779820949.0416088, "t_first_token_unix": 1779820948.376537, "tpot_s": 0.006998123537356916, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13036739, 13036740, 13036741, 13036742, 13036743, 13036744, 13036745, 13036746, 13036747, 13036748, 13036749, 13036750, 13036751, 13036752, 13036753, 13036754, 13036755, 13036756, 13036757, 13036758, 13036759, 13036760, 13036761, 13036762, 13036763, 13036764, 13036765, 13036766, 13036767], "trace_timestamp_s": 256.53099999999995, "ttft_s": 4.894270277989563, "turn_id": 2} +{"actual_output_tokens": 99, "cached_tokens": 0, "effective_input_length": 13360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13360, "latency_s": 1.6756442239857279, "output_length": 99, "proxy_request_id": "1306347:2:1312642:314", "request_id": "1306347:2:1312642:314", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1306347", "t_dispatch_unix": 1779820947.4627078, "t_finish_unix": 1779820949.1383517, "t_first_token_unix": 1779820948.6007762, "tpot_s": 0.005482967540845085, "trace_hash_ids": [12988101, 12997381, 12997382, 12997383, 12997384, 13005782, 13011406, 13018410, 13018411, 13018412, 13033270, 13033271, 13033272, 13033273, 13033274, 13033275, 13033276, 13039898, 13046883, 13046884, 13046885, 13046886, 13046887, 13046888, 13046889, 13046890, 13046891], "trace_timestamp_s": 260.52000000000044, "ttft_s": 1.1380669079953805, "turn_id": 2} +{"actual_output_tokens": 198, "cached_tokens": 21968, "effective_input_length": 26885, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26885, "latency_s": 3.715315109002404, "output_length": 198, "proxy_request_id": "1268861:4:1312689:315", "request_id": "1268861:4:1312689:315", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1268861", "t_dispatch_unix": 1779820947.6290689, "t_finish_unix": 1779820951.344384, "t_first_token_unix": 1779820948.6116707, "tpot_s": 0.013870023385985628, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13047223], "trace_timestamp_s": 260.6890000000003, "ttft_s": 0.9826003289781511, "turn_id": 4} +{"actual_output_tokens": 157, "cached_tokens": 64720, "effective_input_length": 64755, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64755, "latency_s": 1.420481373963412, "output_length": 157, "proxy_request_id": "1279412:12:1313518:319", "request_id": "1279412:12:1313518:319", "request_type": "coder", "requested_output_tokens": 157, "session_id": "1279412", "t_dispatch_unix": 1779820950.366743, "t_finish_unix": 1779820951.7872243, "t_first_token_unix": 1779820950.4972737, "tpot_s": 0.008267420884714318, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13054780], "trace_timestamp_s": 263.4270000000006, "ttft_s": 0.13052845798665658, "turn_id": 12} +{"actual_output_tokens": 372, "cached_tokens": 59936, "effective_input_length": 62840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62840, "latency_s": 4.365947165992111, "output_length": 372, "proxy_request_id": "1269373:12:1312836:316", "request_id": "1269373:12:1312836:316", "request_type": "coder", "requested_output_tokens": 372, "session_id": "1269373", "t_dispatch_unix": 1779820947.9969234, "t_finish_unix": 1779820952.3628707, "t_first_token_unix": 1779820949.2841809, "tpot_s": 0.008297712180632947, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13048674], "trace_timestamp_s": 261.0560000000005, "ttft_s": 1.2872548130108044, "turn_id": 12} +{"actual_output_tokens": 109, "cached_tokens": 0, "effective_input_length": 22686, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22686, "latency_s": 3.164412126992829, "output_length": 109, "proxy_request_id": "1313181:1:1313181:318", "request_id": "1313181:1:1313181:318", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1313181", "t_dispatch_unix": 1779820949.2500777, "t_finish_unix": 1779820952.4144895, "t_first_token_unix": 1779820951.75984, "tpot_s": 0.006059623481835135, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13052042], "trace_timestamp_s": 262.308, "ttft_s": 2.5097604999900796, "turn_id": 1} +{"actual_output_tokens": 198, "cached_tokens": 44512, "effective_input_length": 45362, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45362, "latency_s": 1.8058691520127468, "output_length": 198, "proxy_request_id": "1294611:10:1314495:322", "request_id": "1294611:10:1314495:322", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1294611", "t_dispatch_unix": 1779820954.0250428, "t_finish_unix": 1779820955.8309116, "t_first_token_unix": 1779820954.3873346, "tpot_s": 0.007326461213137387, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13063311], "trace_timestamp_s": 267.08600000000024, "ttft_s": 0.3622895640437491, "turn_id": 10} +{"actual_output_tokens": 2, "cached_tokens": 0, "effective_input_length": 7, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7, "latency_s": 0.020801545993890613, "output_length": 2, "proxy_request_id": "1315313:1:1315313:325", "request_id": "1315313:1:1315313:325", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1315313", "t_dispatch_unix": 1779820956.6737685, "t_finish_unix": 1779820956.69457, "t_first_token_unix": 1779820956.690175, "tpot_s": 0.004094859992619604, "trace_hash_ids": [37638], "trace_timestamp_s": 269.7360000000008, "ttft_s": 0.016405304020736367, "turn_id": 1} +{"actual_output_tokens": 26, "cached_tokens": 18160, "effective_input_length": 32440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32440, "latency_s": 2.8648933130316436, "output_length": 26, "proxy_request_id": "1310590:2:1315212:324", "request_id": "1310590:2:1315212:324", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1310590", "t_dispatch_unix": 1779820956.3184805, "t_finish_unix": 1779820959.1833735, "t_first_token_unix": 1779820959.0416713, "tpot_s": 0.005656339679844678, "trace_hash_ids": [12996713, 12996714, 12996715, 12996716, 12996717, 12996718, 12996719, 12996720, 12996721, 12996722, 12996723, 12996724, 12996725, 12996726, 12996727, 12996728, 12996729, 12996730, 12996731, 12996732, 12996733, 12996734, 12996735, 12996736, 13016155, 13016156, 13016157, 13016158, 13016159, 13016160, 13027764, 13027765, 13027766, 13027767, 13027768, 13036928, 13036929, 13036930, 13036931, 13036932, 13036933, 13036934, 13036935, 13048761, 13048762, 13048763, 13048764, 13048765, 13048766, 13048767, 13048768, 13048769, 13048770, 13048771, 13048772, 13048773, 13060483, 13060484, 13060485, 13060486, 13060487, 13060488, 13060489, 13070580], "trace_timestamp_s": 269.3740000000007, "ttft_s": 2.7231884140055627, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 23097, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23097, "latency_s": 2.9308653170010075, "output_length": 61, "proxy_request_id": "1309040:2:1315488:326", "request_id": "1309040:2:1315488:326", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1309040", "t_dispatch_unix": 1779820957.3910687, "t_finish_unix": 1779820960.321934, "t_first_token_unix": 1779820959.9679956, "tpot_s": 0.005894321283752409, "trace_hash_ids": [13072947, 13072948, 13072949, 13072950, 13072951, 13072952, 13072953, 13072954, 13072955, 13072956, 13072957, 13072958, 13072959, 13072960, 13072961, 13072962, 13072963, 13072964, 13072965, 13072966, 13072967, 13072968, 13072969, 13072970, 13072971, 13072972, 13072973, 13072974, 13072975, 13072976, 13072977, 13072978, 13072979, 13072980, 13072981, 13072982, 13072983, 13072984, 13072985, 13072986, 13072987, 13072988, 13072989, 13072990, 13072991, 13072992], "trace_timestamp_s": 270.4440000000004, "ttft_s": 2.5769254179904237, "turn_id": 2} +{"actual_output_tokens": 307, "cached_tokens": 64896, "effective_input_length": 64949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64949, "latency_s": 2.736218938953243, "output_length": 307, "proxy_request_id": "1279412:13:1315780:328", "request_id": "1279412:13:1315780:328", "request_type": "coder", "requested_output_tokens": 307, "session_id": "1279412", "t_dispatch_unix": 1779820958.4511209, "t_finish_unix": 1779820961.1873395, "t_first_token_unix": 1779820958.6087985, "tpot_s": 0.008425710571768505, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834], "trace_timestamp_s": 271.5110000000004, "ttft_s": 0.15767516300547868, "turn_id": 13} +{"actual_output_tokens": 528, "cached_tokens": 7680, "effective_input_length": 16960, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16960, "latency_s": 4.186121136008296, "output_length": 528, "proxy_request_id": "1315567:1:1315567:327", "request_id": "1315567:1:1315567:327", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1315567", "t_dispatch_unix": 1779820957.66098, "t_finish_unix": 1779820961.8471012, "t_first_token_unix": 1779820958.7793658, "tpot_s": 0.005820510474447182, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13073863], "trace_timestamp_s": 270.71900000000005, "ttft_s": 1.1183837529970333, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 1024, "effective_input_length": 5985, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5985, "latency_s": 0.527014312974643, "output_length": 37, "proxy_request_id": "1316848:1:1316848:331", "request_id": "1316848:1:1316848:331", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1316848", "t_dispatch_unix": 1779820962.0142667, "t_finish_unix": 1779820962.5412807, "t_first_token_unix": 1779820962.3593364, "tpot_s": 0.005047230806667358, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13085635], "trace_timestamp_s": 275.0750000000007, "ttft_s": 0.3450685499701649, "turn_id": 1} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 24487, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24487, "latency_s": 3.084384776011575, "output_length": 50, "proxy_request_id": "1316201:1:1316201:329", "request_id": "1316201:1:1316201:329", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1316201", "t_dispatch_unix": 1779820959.9241188, "t_finish_unix": 1779820963.0085032, "t_first_token_unix": 1779820962.72381, "tpot_s": 0.005805048143624195, "trace_hash_ids": [79834, 1044525, 1044526, 1044527, 1044528, 1044529, 1044530, 2181165, 2181166, 2181167, 2181168, 2181169, 2181170, 2181171, 2181172, 2181173, 2181174, 2181175, 2181176, 2181177, 2181178, 2181179, 2181180, 2181181, 2181182, 2181183, 2181184, 11014457, 11014458, 9320, 11014459, 79866, 11014460, 13079135, 11014462, 11014463, 11014464, 11014465, 11014466, 11014467, 11014468, 11014469, 11014470, 11014471, 11014472, 11014473, 11014474, 11014475], "trace_timestamp_s": 272.97700000000077, "ttft_s": 2.799689434992615, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 3441, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3441, "latency_s": 0.36923786700936034, "output_length": 32, "proxy_request_id": "1317160:1:1317160:332", "request_id": "1317160:1:1317160:332", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1317160", "t_dispatch_unix": 1779820963.1695786, "t_finish_unix": 1779820963.5388162, "t_first_token_unix": 1779820963.3841794, "tpot_s": 0.004979879580317966, "trace_hash_ids": [13073227, 13079093, 13088584, 13088585, 13088586, 13088587, 13088588], "trace_timestamp_s": 276.2300000000005, "ttft_s": 0.21459965803660452, "turn_id": 1} +{"actual_output_tokens": 80, "cached_tokens": 6016, "effective_input_length": 6040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6040, "latency_s": 0.43548027297947556, "output_length": 80, "proxy_request_id": "1316848:2:1317438:333", "request_id": "1316848:2:1317438:333", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1316848", "t_dispatch_unix": 1779820964.2508516, "t_finish_unix": 1779820964.6863317, "t_first_token_unix": 1779820964.2808368, "tpot_s": 0.005129438797689833, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13090822], "trace_timestamp_s": 277.3120000000008, "ttft_s": 0.029984328954014927, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 3472, "effective_input_length": 7440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7440, "latency_s": 0.4601381269749254, "output_length": 26, "proxy_request_id": "1317160:2:1317773:336", "request_id": "1317160:2:1317773:336", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1317160", "t_dispatch_unix": 1779820965.5672786, "t_finish_unix": 1779820966.0274165, "t_first_token_unix": 1779820965.9051504, "tpot_s": 0.004881203840486705, "trace_hash_ids": [13073227, 13079093, 13088584, 13088585, 13088586, 13088587, 13093585, 13093586, 13093587, 13093588, 13093589, 13093590, 13093591, 13093592, 13093593], "trace_timestamp_s": 278.6280000000006, "ttft_s": 0.3378700509783812, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 22784, "effective_input_length": 24306, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24306, "latency_s": 11.109537862997968, "output_length": 98, "proxy_request_id": "1313181:2:1314940:323", "request_id": "1313181:2:1314940:323", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1313181", "t_dispatch_unix": 1779820955.440764, "t_finish_unix": 1779820966.5503018, "t_first_token_unix": 1779820965.616451, "tpot_s": 0.009624497051057933, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13067419], "trace_timestamp_s": 268.5010000000002, "ttft_s": 10.175685667025391, "turn_id": 2} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 5219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5219, "latency_s": 0.5591004269663244, "output_length": 44, "proxy_request_id": "1318031:1:1318031:338", "request_id": "1318031:1:1318031:338", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1318031", "t_dispatch_unix": 1779820966.2297773, "t_finish_unix": 1779820966.788878, "t_first_token_unix": 1779820966.5700366, "tpot_s": 0.005083510348963183, "trace_hash_ids": [13085657, 13085658, 13085659, 13085660, 13085661, 13090893, 13090894, 13090895, 13095689, 13095690, 13095691], "trace_timestamp_s": 279.28999999999996, "ttft_s": 0.34025813097832724, "turn_id": 1} +{"actual_output_tokens": 90, "cached_tokens": 24528, "effective_input_length": 24768, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24768, "latency_s": 1.223458458960522, "output_length": 90, "proxy_request_id": "1316201:2:1317776:337", "request_id": "1316201:2:1317776:337", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1316201", "t_dispatch_unix": 1779820965.5846484, "t_finish_unix": 1779820966.808107, "t_first_token_unix": 1779820965.8998666, "tpot_s": 0.01020174866327702, "trace_hash_ids": [79834, 1044525, 1044526, 1044527, 1044528, 1044529, 1044530, 2181165, 2181166, 2181167, 2181168, 2181169, 2181170, 2181171, 2181172, 2181173, 2181174, 2181175, 2181176, 2181177, 2181178, 2181179, 2181180, 2181181, 2181182, 2181183, 2181184, 11014457, 11014458, 9320, 11014459, 79866, 11014460, 13079135, 11014462, 11014463, 11014464, 11014465, 11014466, 11014467, 11014468, 11014469, 11014470, 11014471, 11014472, 11014473, 11014474, 11014475, 13093608], "trace_timestamp_s": 278.64600000000064, "ttft_s": 0.3152160279569216, "turn_id": 2} +{"actual_output_tokens": 97, "cached_tokens": 0, "effective_input_length": 2696, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2696, "latency_s": 0.6528154389816336, "output_length": 97, "proxy_request_id": "1318036:1:1318036:339", "request_id": "1318036:1:1318036:339", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1318036", "t_dispatch_unix": 1779820966.234783, "t_finish_unix": 1779820966.8875985, "t_first_token_unix": 1779820966.4043922, "tpot_s": 0.005030041187637835, "trace_hash_ids": [13077094, 13085876, 13085877, 13085878, 13085879, 13095707], "trace_timestamp_s": 279.2960000000003, "ttft_s": 0.16960782994283363, "turn_id": 1} +{"actual_output_tokens": 241, "cached_tokens": 0, "effective_input_length": 57051, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57051, "latency_s": 14.130156865983736, "output_length": 241, "proxy_request_id": "1314357:1:1314357:321", "request_id": "1314357:1:1314357:321", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1314357", "t_dispatch_unix": 1779820953.5626137, "t_finish_unix": 1779820967.6927707, "t_first_token_unix": 1779820965.4002903, "tpot_s": 0.009550936720673538, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13062231, 13062232], "trace_timestamp_s": 266.60400000000027, "ttft_s": 11.837673954025377, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 14412, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14412, "latency_s": 1.4323379120323807, "output_length": 35, "proxy_request_id": "1318604:1:1318604:341", "request_id": "1318604:1:1318604:341", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1318604", "t_dispatch_unix": 1779820968.2772076, "t_finish_unix": 1779820969.7095451, "t_first_token_unix": 1779820969.5280774, "tpot_s": 0.005330417294959154, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13101221], "trace_timestamp_s": 281.33400000000074, "ttft_s": 1.2508673850097694, "turn_id": 1} +{"actual_output_tokens": 470, "cached_tokens": 63200, "effective_input_length": 66135, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66135, "latency_s": 5.5422896560048684, "output_length": 470, "proxy_request_id": "1269373:13:1317516:334", "request_id": "1269373:13:1317516:334", "request_type": "coder", "requested_output_tokens": 470, "session_id": "1269373", "t_dispatch_unix": 1779820964.5041974, "t_finish_unix": 1779820970.0464869, "t_first_token_unix": 1779820965.8532016, "tpot_s": 0.008940377626875872, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13091422], "trace_timestamp_s": 277.5630000000001, "ttft_s": 1.349001926020719, "turn_id": 13} +{"actual_output_tokens": 54, "cached_tokens": 6112, "effective_input_length": 6298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6298, "latency_s": 0.5748301249695942, "output_length": 54, "proxy_request_id": "1316848:3:1318975:343", "request_id": "1316848:3:1318975:343", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1316848", "t_dispatch_unix": 1779820969.6502163, "t_finish_unix": 1779820970.2250466, "t_first_token_unix": 1779820969.7240262, "tpot_s": 0.00944854426395394, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13104212], "trace_timestamp_s": 282.71200000000044, "ttft_s": 0.07380833697970957, "turn_id": 3} +{"actual_output_tokens": 35, "cached_tokens": 14432, "effective_input_length": 15745, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15745, "latency_s": 2.419856406049803, "output_length": 35, "proxy_request_id": "1318604:2:1319895:347", "request_id": "1318604:2:1319895:347", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1318604", "t_dispatch_unix": 1779820972.7857902, "t_finish_unix": 1779820975.2056468, "t_first_token_unix": 1779820974.9794688, "tpot_s": 0.00664457694031572, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13112541], "trace_timestamp_s": 285.82900000000063, "ttft_s": 2.193677531031426, "turn_id": 2} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 3099, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3099, "latency_s": 0.39332643401576206, "output_length": 40, "proxy_request_id": "1320630:1:1320630:348", "request_id": "1320630:1:1320630:348", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1320630", "t_dispatch_unix": 1779820975.5690312, "t_finish_unix": 1779820975.9623578, "t_first_token_unix": 1779820975.7684946, "tpot_s": 0.004964446359409545, "trace_hash_ids": [13120494, 13120495, 13120496, 13120497, 13120498, 13120499, 13120500], "trace_timestamp_s": 288.6300000000001, "ttft_s": 0.19946240400895476, "turn_id": 1} +{"actual_output_tokens": 41, "cached_tokens": 15776, "effective_input_length": 17883, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17883, "latency_s": 0.6601294039865024, "output_length": 41, "proxy_request_id": "1318604:3:1320865:350", "request_id": "1318604:3:1320865:350", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1318604", "t_dispatch_unix": 1779820976.4112985, "t_finish_unix": 1779820977.0714276, "t_first_token_unix": 1779820976.7656376, "tpot_s": 0.00762537414993858, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13122653, 13122654, 13122655, 13122656, 13122657], "trace_timestamp_s": 289.47200000000066, "ttft_s": 0.3543376970337704, "turn_id": 3} +{"actual_output_tokens": 302, "cached_tokens": 0, "effective_input_length": 21140, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21140, "latency_s": 4.665382448991295, "output_length": 302, "proxy_request_id": "1316848:4:1319820:345", "request_id": "1316848:4:1319820:345", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1316848", "t_dispatch_unix": 1779820972.555888, "t_finish_unix": 1779820977.2212703, "t_first_token_unix": 1779820974.9780383, "tpot_s": 0.007451853641205192, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13111733], "trace_timestamp_s": 285.6120000000001, "ttft_s": 2.4221483150031418, "turn_id": 4} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 8095, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8095, "latency_s": 0.8740335060283542, "output_length": 60, "proxy_request_id": "1321042:1:1321042:351", "request_id": "1321042:1:1321042:351", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1321042", "t_dispatch_unix": 1779820977.0661786, "t_finish_unix": 1779820977.940212, "t_first_token_unix": 1779820977.6336176, "tpot_s": 0.005192732626880061, "trace_hash_ids": [13106720, 13106721, 13114808, 13114809, 13114810, 13114811, 13114812, 13114813, 13114814, 13114815, 13124503, 13124504, 13124505, 13124506, 13124507, 13124508], "trace_timestamp_s": 290.1220000000003, "ttft_s": 0.5674376700189896, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 31664, "effective_input_length": 33906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33906, "latency_s": 1.2517821250366978, "output_length": 97, "proxy_request_id": "1277428:4:1321259:352", "request_id": "1277428:4:1321259:352", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1277428", "t_dispatch_unix": 1779820977.8177588, "t_finish_unix": 1779820979.0695405, "t_first_token_unix": 1779820978.4413862, "tpot_s": 0.006540114343806636, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13126544], "trace_timestamp_s": 290.8780000000006, "ttft_s": 0.6236225190223195, "turn_id": 4} +{"actual_output_tokens": 42, "cached_tokens": 17920, "effective_input_length": 21033, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21033, "latency_s": 0.7610153310233727, "output_length": 42, "proxy_request_id": "1318604:4:1321889:356", "request_id": "1318604:4:1321889:356", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1318604", "t_dispatch_unix": 1779820980.002814, "t_finish_unix": 1779820980.7638292, "t_first_token_unix": 1779820980.5357823, "tpot_s": 0.005556325511950091, "trace_hash_ids": [13084363, 13084364, 13084365, 13084366, 13084367, 13084368, 13084369, 13084370, 13084371, 13084372, 13084373, 13084374, 13084375, 13084376, 13084377, 13084378, 13084379, 13084380, 13084381, 13084382, 13084383, 13084384, 13084385, 13084386, 13084387, 13094288, 13094289, 13094290, 13112539, 13112540, 13122653, 13122654, 13122655, 13122656, 13122657, 13132633, 13132634, 13132635, 13132636, 13132637, 13132638, 13132639], "trace_timestamp_s": 293.0630000000001, "ttft_s": 0.5329662170261145, "turn_id": 4} +{"actual_output_tokens": 256, "cached_tokens": 66592, "effective_input_length": 66840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66840, "latency_s": 2.4075814280076884, "output_length": 256, "proxy_request_id": "1269373:14:1321512:354", "request_id": "1269373:14:1321512:354", "request_type": "coder", "requested_output_tokens": 256, "session_id": "1269373", "t_dispatch_unix": 1779820978.6522686, "t_finish_unix": 1779820981.0598497, "t_first_token_unix": 1779820978.8973355, "tpot_s": 0.008479529054945006, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13129270], "trace_timestamp_s": 291.71100000000024, "ttft_s": 0.24506391200702637, "turn_id": 14} +{"actual_output_tokens": 3, "cached_tokens": 2672, "effective_input_length": 2677, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2677, "latency_s": 4.18889238499105, "output_length": 3, "proxy_request_id": "1318036:2:1321282:353", "request_id": "1318036:2:1321282:353", "request_type": "coder", "requested_output_tokens": 3, "session_id": "1318036", "t_dispatch_unix": 1779820977.8734443, "t_finish_unix": 1779820982.0623367, "t_first_token_unix": 1779820982.0258963, "tpot_s": 0.018085082003381103, "trace_hash_ids": [13126973, 13126974, 13126975, 13126976, 13126977, 13126978], "trace_timestamp_s": 290.9350000000004, "ttft_s": 4.152450383990072, "turn_id": 2} +{"actual_output_tokens": 50, "cached_tokens": 0, "effective_input_length": 8939, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8939, "latency_s": 0.92987086501671, "output_length": 50, "proxy_request_id": "1322540:1:1322540:359", "request_id": "1322540:1:1322540:359", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1322540", "t_dispatch_unix": 1779820982.4639904, "t_finish_unix": 1779820983.3938613, "t_first_token_unix": 1779820983.1371171, "tpot_s": 0.005234644470299233, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13138570], "trace_timestamp_s": 295.52300000000014, "ttft_s": 0.6731252599856816, "turn_id": 1} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 11145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11145, "latency_s": 0.937490415002685, "output_length": 12, "proxy_request_id": "1318031:2:1322552:360", "request_id": "1318031:2:1322552:360", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1318031", "t_dispatch_unix": 1779820982.516495, "t_finish_unix": 1779820983.4539855, "t_first_token_unix": 1779820983.4041958, "tpot_s": 0.004504535818176175, "trace_hash_ids": [13138691, 13138692, 13138693, 13138694, 13138695, 13138696, 13138697, 13138698, 13138699, 13138700, 13138701, 13138702, 13138703, 13138704, 13138705, 13138706, 13138707, 13138708, 13138709, 13138710, 13138711, 13138712], "trace_timestamp_s": 295.5750000000007, "ttft_s": 0.8876989319687709, "turn_id": 2} +{"actual_output_tokens": 355, "cached_tokens": 17472, "effective_input_length": 54546, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54546, "latency_s": 11.997397869010456, "output_length": 355, "proxy_request_id": "1315567:2:1319894:346", "request_id": "1315567:2:1319894:346", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1315567", "t_dispatch_unix": 1779820972.7807198, "t_finish_unix": 1779820984.7781177, "t_first_token_unix": 1779820982.0327094, "tpot_s": 0.007754690183680452, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13112465, 13112466, 13112467, 13112468, 13112469, 13112470, 13112471, 13112472, 13112473, 13112474, 13112475, 13112476, 13112477, 13112478, 13112479, 13112480, 13112481, 13112482, 13112483, 13112484, 13112485, 13112486, 13112487, 13112488, 13112489, 13112490, 13112491, 13112492, 13112493, 13112494, 13112495, 13112496, 13112497, 13112498, 13112499, 13112500, 13112501, 13112502, 13112503, 13112504, 13112505, 13112506, 13112507, 13112508, 13112509, 13112510, 13112511, 13112512, 13112513, 13112514, 13112515, 13112516, 13112517, 13112518, 13112519, 13112520, 13112521, 13112522, 13112523, 13112524, 13112525, 13112526, 13112527, 13112528, 13112529, 13112530, 13112531, 13112532, 13112533, 13112534, 13112535, 13112536, 13112537, 13112538], "trace_timestamp_s": 285.82800000000043, "ttft_s": 9.25198719499167, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 8976, "effective_input_length": 9016, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9016, "latency_s": 0.1599034090177156, "output_length": 25, "proxy_request_id": "1322540:2:1323519:362", "request_id": "1322540:2:1323519:362", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1322540", "t_dispatch_unix": 1779820985.7605186, "t_finish_unix": 1779820985.9204218, "t_first_token_unix": 1779820985.797778, "tpot_s": 0.005099438373387481, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13147526], "trace_timestamp_s": 298.8220000000001, "ttft_s": 0.037257964024320245, "turn_id": 2} +{"actual_output_tokens": 90, "cached_tokens": 21440, "effective_input_length": 21471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21471, "latency_s": 5.3751839980250224, "output_length": 90, "proxy_request_id": "1316848:5:1322192:357", "request_id": "1316848:5:1322192:357", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1316848", "t_dispatch_unix": 1779820981.1804953, "t_finish_unix": 1779820986.5556793, "t_first_token_unix": 1779820981.2537794, "tpot_s": 0.05956826906708812, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116], "trace_timestamp_s": 294.2420000000002, "ttft_s": 0.07328142301412299, "turn_id": 5} +{"actual_output_tokens": 72, "cached_tokens": 8144, "effective_input_length": 13008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13008, "latency_s": 0.9265885429922491, "output_length": 72, "proxy_request_id": "1321042:2:1323492:361", "request_id": "1321042:2:1323492:361", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1321042", "t_dispatch_unix": 1779820985.690692, "t_finish_unix": 1779820986.61728, "t_first_token_unix": 1779820986.2317977, "tpot_s": 0.005425570450696937, "trace_hash_ids": [13106720, 13106721, 13114808, 13114809, 13114810, 13114811, 13114812, 13114813, 13114814, 13114815, 13124503, 13124504, 13124505, 13124506, 13124507, 13132187, 13132188, 13132189, 13147309, 13147310, 13147311, 13147312, 13147313, 13147314, 13147315, 13147316], "trace_timestamp_s": 298.7510000000002, "ttft_s": 0.5411042050109245, "turn_id": 2} +{"actual_output_tokens": 52, "cached_tokens": 3136, "effective_input_length": 11298, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11298, "latency_s": 0.9943695749971084, "output_length": 52, "proxy_request_id": "1320630:2:1323748:364", "request_id": "1320630:2:1323748:364", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1320630", "t_dispatch_unix": 1779820986.531966, "t_finish_unix": 1779820987.5263352, "t_first_token_unix": 1779820987.2521229, "tpot_s": 0.005370624568861197, "trace_hash_ids": [13120494, 13120495, 13120496, 13120497, 13120498, 13120499, 13127257, 13127258, 13135970, 13135971, 13135972, 13135973, 13135974, 13135975, 13143084, 13143085, 13143086, 13143087, 13143088, 13149788, 13149789, 13149790, 13149791], "trace_timestamp_s": 299.59100000000035, "ttft_s": 0.7201545569696464, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 21552, "effective_input_length": 24395, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24395, "latency_s": 1.4358718669973314, "output_length": 98, "proxy_request_id": "1316848:6:1323535:363", "request_id": "1316848:6:1323535:363", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1316848", "t_dispatch_unix": 1779820986.5576074, "t_finish_unix": 1779820987.9934795, "t_first_token_unix": 1779820987.1867733, "tpot_s": 0.008312365278414422, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13147765], "trace_timestamp_s": 298.8690000000006, "ttft_s": 0.6291633060318418, "turn_id": 6} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 14863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14863, "latency_s": 1.6793624389683828, "output_length": 46, "proxy_request_id": "1324227:1:1324227:367", "request_id": "1324227:1:1324227:367", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1324227", "t_dispatch_unix": 1779820988.3216577, "t_finish_unix": 1779820990.00102, "t_first_token_unix": 1779820989.6503248, "tpot_s": 0.007785398156071702, "trace_hash_ids": [13121168, 13121169, 13121170, 13121171, 13121172, 13121173, 13121174, 13121175, 13121176, 13121177, 13121178, 13121179, 13129551, 13129552, 13129553, 13129554, 13137620, 13137621, 13146223, 13146224, 13146225, 13146226, 13146227, 13155024, 13155025, 13155026, 13155027, 13155028, 13155029, 13155030], "trace_timestamp_s": 301.3780000000006, "ttft_s": 1.3286657669814304, "turn_id": 1} +{"actual_output_tokens": 103, "cached_tokens": 24480, "effective_input_length": 26994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26994, "latency_s": 1.45321565202903, "output_length": 103, "proxy_request_id": "1316848:7:1325031:371", "request_id": "1316848:7:1325031:371", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1316848", "t_dispatch_unix": 1779820990.982007, "t_finish_unix": 1779820992.4352226, "t_first_token_unix": 1779820991.5536463, "tpot_s": 0.008639884529425306, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13162818], "trace_timestamp_s": 304.0430000000006, "ttft_s": 0.5716376309865154, "turn_id": 7} +{"actual_output_tokens": 313, "cached_tokens": 0, "effective_input_length": 4312, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4312, "latency_s": 1.8737953919917345, "output_length": 313, "proxy_request_id": "1324964:1:1324964:370", "request_id": "1324964:1:1324964:370", "request_type": "coder", "requested_output_tokens": 313, "session_id": "1324964", "t_dispatch_unix": 1779820990.7399535, "t_finish_unix": 1779820992.6137486, "t_first_token_unix": 1779820991.012353, "tpot_s": 0.005131597205129368, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13162336], "trace_timestamp_s": 303.8010000000004, "ttft_s": 0.27239882096182555, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 9040, "effective_input_length": 12118, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12118, "latency_s": 0.48286582599394023, "output_length": 25, "proxy_request_id": "1322540:3:1325410:373", "request_id": "1322540:3:1325410:373", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1322540", "t_dispatch_unix": 1779820992.3561625, "t_finish_unix": 1779820992.8390281, "t_first_token_unix": 1779820992.7164738, "tpot_s": 0.005095122665807139, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13153725, 13153726, 13160450, 13160451, 13167028, 13167029, 13167030], "trace_timestamp_s": 305.41700000000037, "ttft_s": 0.36030985199613497, "turn_id": 3} +{"actual_output_tokens": 326, "cached_tokens": 65248, "effective_input_length": 71854, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71854, "latency_s": 23.739009570970666, "output_length": 326, "proxy_request_id": "1279412:14:1319059:344", "request_id": "1279412:14:1319059:344", "request_type": "coder", "requested_output_tokens": 326, "session_id": "1279412", "t_dispatch_unix": 1779820970.0008621, "t_finish_unix": 1779820993.7398717, "t_first_token_unix": 1779820989.3241699, "tpot_s": 0.013585759547646516, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13104852], "trace_timestamp_s": 283.058, "ttft_s": 19.323304746998474, "turn_id": 14} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 1823, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1823, "latency_s": 0.4683266539941542, "output_length": 38, "proxy_request_id": "1325987:1:1325987:376", "request_id": "1325987:1:1325987:376", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1325987", "t_dispatch_unix": 1779820994.4511256, "t_finish_unix": 1779820994.919452, "t_first_token_unix": 1779820994.6286206, "tpot_s": 0.00785176713504149, "trace_hash_ids": [13172375, 13172376, 13172377, 13172378], "trace_timestamp_s": 307.5129999999999, "ttft_s": 0.17749408999225125, "turn_id": 1} +{"actual_output_tokens": 100, "cached_tokens": 0, "effective_input_length": 9513, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9513, "latency_s": 1.2610838929540478, "output_length": 100, "proxy_request_id": "1326192:1:1326192:378", "request_id": "1326192:1:1326192:378", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1326192", "t_dispatch_unix": 1779820995.3345914, "t_finish_unix": 1779820996.5956755, "t_first_token_unix": 1779820996.063227, "tpot_s": 0.005375280283095146, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13174254], "trace_timestamp_s": 308.3890000000001, "ttft_s": 0.7286340189748444, "turn_id": 1} +{"actual_output_tokens": 255, "cached_tokens": 72176, "effective_input_length": 72402, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72402, "latency_s": 3.7313822360010818, "output_length": 255, "proxy_request_id": "1279412:15:1321613:355", "request_id": "1279412:15:1321613:355", "request_type": "coder", "requested_output_tokens": 255, "session_id": "1279412", "t_dispatch_unix": 1779820993.7435899, "t_finish_unix": 1779820997.474972, "t_first_token_unix": 1779820994.0111477, "tpot_s": 0.013635593157547607, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13129897], "trace_timestamp_s": 292.0450000000001, "ttft_s": 0.26755506300833076, "turn_id": 15} +{"actual_output_tokens": 4682, "cached_tokens": 98112, "effective_input_length": 121968, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121968, "latency_s": 72.45182415400632, "output_length": 4682, "proxy_request_id": "1266668:12:1303535:276", "request_id": "1266668:12:1303535:276", "request_type": "coder", "requested_output_tokens": 4682, "session_id": "1266668", "t_dispatch_unix": 1779820925.3068013, "t_finish_unix": 1779820997.7586253, "t_first_token_unix": 1779820941.250879, "tpot_s": 0.012071670296085059, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 155001, 155002, 155003, 155004, 155005, 155006, 155007, 155008, 155009, 155010, 155011, 155012, 155013, 155014, 12569649, 12569650, 12569651, 12605177, 12605178, 12644223, 12644224, 12644225, 12644226, 12644227, 12644228, 12644229, 12644230, 12644231, 12644232, 12644233, 12644234, 12644235, 12644236, 12644237, 12644238, 12644239, 12644240, 12644241, 12644242, 12644243, 12670169, 12670170, 12670171, 12670172, 12670173, 12670174, 12670175, 12670176, 12670177, 12670178, 12703731, 12703732, 12703733, 12703734, 12703735, 12703736, 12703737, 12703738, 12703739, 12703740, 12703741, 12703742, 12703743, 12703744, 12703745, 12703746, 12703747, 12703748, 12703749, 12703750, 12703751, 12703752, 12703753, 12703754, 12703755, 12703756, 12703757, 12703758, 12703759, 12703760, 12703761, 12748627, 12748628, 12748629, 12748630, 12748631, 12748632, 12748633, 12748634, 12748635, 12748636, 12748637, 12748638, 12748639, 12748640, 12748641, 12748642, 12748643, 12775675, 12775676, 12775677, 12775678, 12775679, 12775680, 12775681, 12775682, 12775683, 12775684, 12775685, 12775686, 12775687, 12775688, 12775689, 12775690, 12775691, 12775692, 12775693, 12775694, 12775695, 12775696, 12775697, 12775698, 12775699, 12775700, 12775701, 12775702, 12775703, 12775704, 12775705, 12775706, 12775707, 12775708, 12775709, 12775710, 12775711, 12775712, 12775713, 12775714, 12775715, 12775716, 12775717, 12809016, 12809017, 12809018, 12809019, 12809020, 12809021, 12809022, 12809023, 12809024, 12809025, 12809026, 12809027, 12809028, 12809029, 12809030, 12855409, 12855410, 12855411, 12855412, 12855413, 12855414, 12855415, 12855416, 12855417, 12855418, 12855419, 12855420, 12855421, 12855422, 12855423, 12855424, 12886824, 12886825, 12937140, 12937141, 12961861, 12961862, 12961863, 12961864, 12961865, 12961866, 12961867, 12961868, 12961869, 12961870, 12961871, 12961872, 12961873, 12961874, 12961875, 12961876, 12961877, 12961878, 12961879, 12961880, 12961881, 12961882, 12961883, 12961884, 12961885, 12961886, 12961887, 12961888, 12961889, 12961890, 12961891, 12961892, 12961893, 12961894, 12961895, 12961896, 12961897, 12961898, 12961899, 12961900, 12961901, 12961902, 12961903, 12961904, 12961905, 12961906, 12961907, 12961908], "trace_timestamp_s": 228.19700000000012, "ttft_s": 15.94407470303122, "turn_id": 12} +{"actual_output_tokens": 26, "cached_tokens": 12128, "effective_input_length": 13249, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13249, "latency_s": 0.3144296819809824, "output_length": 26, "proxy_request_id": "1322540:4:1326861:380", "request_id": "1322540:4:1326861:380", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1322540", "t_dispatch_unix": 1779820997.6062877, "t_finish_unix": 1779820997.920717, "t_first_token_unix": 1779820997.7943625, "tpot_s": 0.005044656360987574, "trace_hash_ids": [13138553, 13138554, 13138555, 13138556, 13138557, 13138558, 13138559, 13138560, 13138561, 13138562, 13138563, 13138564, 13138565, 13138566, 13138567, 13138568, 13138569, 13153725, 13153726, 13160450, 13160451, 13167028, 13167029, 13180706, 13180707, 13180708], "trace_timestamp_s": 310.6680000000006, "ttft_s": 0.18807340797502548, "turn_id": 4} +{"actual_output_tokens": 296, "cached_tokens": 27088, "effective_input_length": 28120, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28120, "latency_s": 2.985821722948458, "output_length": 296, "proxy_request_id": "1316848:8:1326380:379", "request_id": "1316848:8:1326380:379", "request_type": "coder", "requested_output_tokens": 296, "session_id": "1316848", "t_dispatch_unix": 1779820995.9397795, "t_finish_unix": 1779820998.9256008, "t_first_token_unix": 1779820996.3022642, "tpot_s": 0.008891341145647595, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273], "trace_timestamp_s": 309.0010000000002, "ttft_s": 0.3624827269813977, "turn_id": 8} +{"actual_output_tokens": 552, "cached_tokens": 67088, "effective_input_length": 69041, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69041, "latency_s": 5.87366992799798, "output_length": 552, "proxy_request_id": "1269373:15:1325630:375", "request_id": "1269373:15:1325630:375", "request_type": "coder", "requested_output_tokens": 552, "session_id": "1269373", "t_dispatch_unix": 1779820993.1930714, "t_finish_unix": 1779820999.066741, "t_first_token_unix": 1779820994.26285, "tpot_s": 0.008718046626142022, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187], "trace_timestamp_s": 306.2520000000004, "ttft_s": 1.0697765339864418, "turn_id": 15} +{"actual_output_tokens": 69, "cached_tokens": 9600, "effective_input_length": 15253, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15253, "latency_s": 1.0697249780059792, "output_length": 69, "proxy_request_id": "1326192:2:1327234:381", "request_id": "1326192:2:1327234:381", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1326192", "t_dispatch_unix": 1779820998.8900986, "t_finish_unix": 1779820999.9598236, "t_first_token_unix": 1779820999.5828836, "tpot_s": 0.005538827706272166, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13183880, 13183881, 13183882, 13183883, 13183884, 13183885, 13183886, 13183887, 13183888, 13183889, 13183890, 13183891], "trace_timestamp_s": 311.9490000000005, "ttft_s": 0.6927834789967164, "turn_id": 2} +{"actual_output_tokens": 772, "cached_tokens": 0, "effective_input_length": 79663, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79663, "latency_s": 36.632739207998384, "output_length": 772, "proxy_request_id": "1317598:1:1317598:335", "request_id": "1317598:1:1317598:335", "request_type": "coder", "requested_output_tokens": 772, "session_id": "1317598", "t_dispatch_unix": 1779820964.807432, "t_finish_unix": 1779821001.4401712, "t_first_token_unix": 1779820987.4113386, "tpot_s": 0.018195204586186235, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044], "trace_timestamp_s": 277.83700000000044, "ttft_s": 22.60390352504328, "turn_id": 1} +{"actual_output_tokens": 282, "cached_tokens": 72656, "effective_input_length": 75624, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75624, "latency_s": 5.882280135992914, "output_length": 282, "proxy_request_id": "1279412:16:1323780:365", "request_id": "1279412:16:1323780:365", "request_type": "coder", "requested_output_tokens": 282, "session_id": "1279412", "t_dispatch_unix": 1779820997.480076, "t_finish_unix": 1779821003.362356, "t_first_token_unix": 1779820999.024185, "tpot_s": 0.015437173729412775, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117], "trace_timestamp_s": 299.6800000000003, "ttft_s": 1.5441070850356482, "turn_id": 16} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 9292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9292, "latency_s": 1.0093401710037142, "output_length": 59, "proxy_request_id": "1329110:1:1329110:389", "request_id": "1329110:1:1329110:389", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1329110", "t_dispatch_unix": 1779821005.7226627, "t_finish_unix": 1779821006.7320027, "t_first_token_unix": 1779821006.4256222, "tpot_s": 0.005276799413720788, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13201495], "trace_timestamp_s": 318.78099999999995, "ttft_s": 0.702953553001862, "turn_id": 1} +{"actual_output_tokens": 260, "cached_tokens": 28400, "effective_input_length": 28615, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28615, "latency_s": 2.836951981007587, "output_length": 260, "proxy_request_id": "1316848:9:1328693:386", "request_id": "1316848:9:1328693:386", "request_type": "coder", "requested_output_tokens": 260, "session_id": "1316848", "t_dispatch_unix": 1779821004.2213032, "t_finish_unix": 1779821007.058255, "t_first_token_unix": 1779821004.353181, "tpot_s": 0.010442638887959068, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13198070], "trace_timestamp_s": 317.28300000000036, "ttft_s": 0.1318759759888053, "turn_id": 9} +{"actual_output_tokens": 40, "cached_tokens": 1856, "effective_input_length": 7423, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7423, "latency_s": 0.7855919980211183, "output_length": 40, "proxy_request_id": "1325987:2:1329336:391", "request_id": "1325987:2:1329336:391", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1325987", "t_dispatch_unix": 1779821006.5703113, "t_finish_unix": 1779821007.3559034, "t_first_token_unix": 1779821007.0307581, "tpot_s": 0.008329143077552987, "trace_hash_ids": [13172375, 13172376, 13172377, 13189325, 13189326, 13189327, 13189328, 13189329, 13189330, 13203552, 13203553, 13203554, 13203555, 13203556, 13203557], "trace_timestamp_s": 319.6300000000001, "ttft_s": 0.4604452659841627, "turn_id": 2} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 66703, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66703, "latency_s": 15.932501475035679, "output_length": 37, "proxy_request_id": "1325541:1:1325541:374", "request_id": "1325541:1:1325541:374", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1325541", "t_dispatch_unix": 1779820992.9351075, "t_finish_unix": 1779821008.8676093, "t_first_token_unix": 1779821008.5854743, "tpot_s": 0.007828248693840578, "trace_hash_ids": [13148586, 13148587, 13148588, 13148589, 13148590, 13148591, 13148592, 13148593, 13148594, 13148595, 13148596, 13148597, 13148598, 13148599, 13148600, 13148601, 13148602, 13148603, 13148604, 13148605, 13148606, 13148607, 13148608, 13148609, 13148610, 13148611, 13148612, 13148613, 13148614, 13148615, 13148616, 13148617, 13148618, 13148619, 13148620, 13148621, 13148622, 13148623, 13148624, 13148625, 13148626, 13148627, 13148628, 13148629, 13148630, 13148631, 13148632, 13148633, 13148634, 13148635, 13148636, 13148637, 13148638, 13148639, 13148640, 13148641, 13148642, 13148643, 13148644, 13148645, 13148646, 13148647, 13148648, 13148649, 13148650, 13148651, 13148652, 13148653, 13148654, 13148655, 13148656, 13148657, 13148658, 13148659, 13148660, 13148661, 13148662, 13148663, 13148664, 13148665, 13148666, 13148667, 13148668, 13148669, 13148670, 13148671, 13148672, 13148673, 13148674, 13148675, 13148676, 13148677, 13148678, 13148679, 13148680, 13148681, 13148682, 13148683, 13148684, 13148685, 13148686, 13148687, 13148688, 13148689, 13148690, 13148691, 13148692, 13148693, 13148694, 13148695, 13148696, 13148697, 13148698, 13148699, 13148700, 13148701, 13148702, 13148703, 13148704, 13148705, 13148706, 13148707, 13148708, 13148709, 13148710, 13148711, 13168103, 13168104, 13168105, 13168106, 13168107], "trace_timestamp_s": 305.97200000000066, "ttft_s": 15.650364796048962, "turn_id": 1} +{"actual_output_tokens": 88, "cached_tokens": 4624, "effective_input_length": 5146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5146, "latency_s": 9.63521244795993, "output_length": 88, "proxy_request_id": "1324964:2:1327382:382", "request_id": "1324964:2:1327382:382", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1324964", "t_dispatch_unix": 1779820999.4949899, "t_finish_unix": 1779821009.130202, "t_first_token_unix": 1779821008.5760086, "tpot_s": 0.006367309896767825, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13184956], "trace_timestamp_s": 312.5560000000005, "ttft_s": 9.081017569988035, "turn_id": 2} +{"actual_output_tokens": 42, "cached_tokens": 5232, "effective_input_length": 5234, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5234, "latency_s": 0.2324987939791754, "output_length": 42, "proxy_request_id": "1324964:3:1328499:384", "request_id": "1324964:3:1328499:384", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1324964", "t_dispatch_unix": 1779821009.1307082, "t_finish_unix": 1779821009.363207, "t_first_token_unix": 1779821009.1538868, "tpot_s": 0.005097864146014993, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13195781], "trace_timestamp_s": 316.5720000000001, "ttft_s": 0.023176979972049594, "turn_id": 3} +{"actual_output_tokens": 274, "cached_tokens": 0, "effective_input_length": 10847, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10847, "latency_s": 2.3485246039927006, "output_length": 274, "proxy_request_id": "1329470:1:1329470:392", "request_id": "1329470:1:1329470:392", "request_type": "coder", "requested_output_tokens": 274, "session_id": "1329470", "t_dispatch_unix": 1779821007.0562005, "t_finish_unix": 1779821009.404725, "t_first_token_unix": 1779821007.9158394, "tpot_s": 0.005452894076923311, "trace_hash_ids": [13131336, 13131337, 13131338, 13142097, 13142098, 13142099, 13149758, 13149759, 13149760, 13149761, 13160564, 13160565, 13160566, 13160567, 13181977, 13181978, 13181979, 13181980, 13205182, 13205183, 13205184, 13205185], "trace_timestamp_s": 320.1140000000005, "ttft_s": 0.85963769297814, "turn_id": 1} +{"actual_output_tokens": 76, "cached_tokens": 5264, "effective_input_length": 5414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5414, "latency_s": 0.43295986199518666, "output_length": 76, "proxy_request_id": "1324964:4:1329201:390", "request_id": "1324964:4:1329201:390", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1324964", "t_dispatch_unix": 1779821009.3637762, "t_finish_unix": 1779821009.7967362, "t_first_token_unix": 1779821009.4114876, "tpot_s": 0.005132892520632595, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13202375], "trace_timestamp_s": 319.09500000000025, "ttft_s": 0.04770989797543734, "turn_id": 4} +{"actual_output_tokens": 403, "cached_tokens": 27072, "effective_input_length": 34264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34264, "latency_s": 4.366639223997481, "output_length": 403, "proxy_request_id": "1268861:5:1329060:388", "request_id": "1268861:5:1329060:388", "request_type": "coder", "requested_output_tokens": 403, "session_id": "1268861", "t_dispatch_unix": 1779821005.5914953, "t_finish_unix": 1779821009.958134, "t_first_token_unix": 1779821007.2265968, "tpot_s": 0.006794291833387827, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049], "trace_timestamp_s": 318.65000000000055, "ttft_s": 1.635098222992383, "turn_id": 5} +{"actual_output_tokens": 41, "cached_tokens": 5488, "effective_input_length": 6691, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6691, "latency_s": 0.3359780359896831, "output_length": 41, "proxy_request_id": "1324964:5:1330169:397", "request_id": "1324964:5:1330169:397", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1324964", "t_dispatch_unix": 1779821009.7978663, "t_finish_unix": 1779821010.1338449, "t_first_token_unix": 1779821009.9305096, "tpot_s": 0.005076375749194994, "trace_hash_ids": [13162328, 13162329, 13162330, 13162331, 13162332, 13162333, 13162334, 13162335, 13184954, 13184955, 13211094, 13211095, 13211096, 13211097], "trace_timestamp_s": 322.4890000000005, "ttft_s": 0.13264181901467964, "turn_id": 5} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 36880, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36880, "latency_s": 5.932181884010788, "output_length": 59, "proxy_request_id": "1328753:1:1328753:387", "request_id": "1328753:1:1328753:387", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1328753", "t_dispatch_unix": 1779821004.453424, "t_finish_unix": 1779821010.3856058, "t_first_token_unix": 1779821010.0175073, "tpot_s": 0.006341650293224716, "trace_hash_ids": [13155620, 13155621, 13155622, 13155623, 13155624, 13155625, 13155626, 13155627, 13155628, 13155629, 13155630, 13155631, 13155632, 13155633, 13155634, 13155635, 13155636, 13155637, 13155638, 13155639, 13155640, 13155641, 13155642, 13155643, 13155644, 13155645, 13155646, 13155647, 13155648, 13155649, 13155650, 13155651, 13155652, 13155653, 13155654, 13155655, 13155656, 13155657, 13155658, 13155659, 13155660, 13155661, 13155662, 13155663, 13155664, 13155665, 13155666, 13155667, 13155668, 13155669, 13155670, 13155671, 13155672, 13155673, 13155674, 13155675, 13155676, 13155677, 13155678, 13155679, 13155680, 13172041, 13182089, 13182090, 13182091, 13182092, 13182093, 13182094, 13182095, 13198580, 13198581, 13198582, 13198583], "trace_timestamp_s": 317.5010000000002, "ttft_s": 5.564080458017997, "turn_id": 1} +{"actual_output_tokens": 69, "cached_tokens": 36928, "effective_input_length": 37007, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37007, "latency_s": 0.5592071670107543, "output_length": 69, "proxy_request_id": "1328753:2:1330033:395", "request_id": "1328753:2:1330033:395", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1328753", "t_dispatch_unix": 1779821010.3872578, "t_finish_unix": 1779821010.946465, "t_first_token_unix": 1779821010.5069613, "tpot_s": 0.006459000264465644, "trace_hash_ids": [13155620, 13155621, 13155622, 13155623, 13155624, 13155625, 13155626, 13155627, 13155628, 13155629, 13155630, 13155631, 13155632, 13155633, 13155634, 13155635, 13155636, 13155637, 13155638, 13155639, 13155640, 13155641, 13155642, 13155643, 13155644, 13155645, 13155646, 13155647, 13155648, 13155649, 13155650, 13155651, 13155652, 13155653, 13155654, 13155655, 13155656, 13155657, 13155658, 13155659, 13155660, 13155661, 13155662, 13155663, 13155664, 13155665, 13155666, 13155667, 13155668, 13155669, 13155670, 13155671, 13155672, 13155673, 13155674, 13155675, 13155676, 13155677, 13155678, 13155679, 13155680, 13172041, 13182089, 13182090, 13182091, 13182092, 13182093, 13182094, 13182095, 13198580, 13198581, 13198582, 13209966], "trace_timestamp_s": 322.0010000000002, "ttft_s": 0.11970052705146372, "turn_id": 2} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 11725, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11725, "latency_s": 1.7807127720443532, "output_length": 83, "proxy_request_id": "1330130:1:1330130:396", "request_id": "1330130:1:1330130:396", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1330130", "t_dispatch_unix": 1779821009.3253443, "t_finish_unix": 1779821011.106057, "t_first_token_unix": 1779821010.2942424, "tpot_s": 0.009895559621793105, "trace_hash_ids": [13186800, 13186801, 13186802, 13186803, 13186804, 13186805, 13186806, 13186807, 13186808, 13186809, 13186810, 13186811, 13186812, 13186813, 13197582, 13197583, 13197584, 13197585, 13197586, 13210629, 13210630, 13210631, 13210632], "trace_timestamp_s": 322.3830000000007, "ttft_s": 0.968895947036799, "turn_id": 1} +{"actual_output_tokens": 2884, "cached_tokens": 0, "effective_input_length": 33182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33182, "latency_s": 31.097699742007535, "output_length": 2884, "proxy_request_id": "1322225:1:1322225:358", "request_id": "1322225:1:1322225:358", "request_type": "coder", "requested_output_tokens": 2884, "session_id": "1322225", "t_dispatch_unix": 1779820981.293448, "t_finish_unix": 1779821012.3911476, "t_first_token_unix": 1779820985.9910026, "tpot_s": 0.009157085457510317, "trace_hash_ids": [12158201, 426358, 11990609, 11990610, 5741838, 11990611, 5631170, 426364, 426365, 426366, 426367, 426368, 113957, 113958, 13135430, 9465731, 9465732, 9465733, 9465734, 9465735, 13135431, 13135432, 13135433, 13135434, 13135435, 13135436, 13135437, 13135438, 13135439, 13135440, 13135441, 13135442, 13135443, 13135444, 13135445, 13135446, 13135447, 13135448, 13135449, 13135450, 13135451, 13135452, 13135453, 13135454, 13135455, 13135456, 13135457, 13135458, 13135459, 13135460, 13135461, 13135462, 13135463, 13135464, 13135465, 13135466, 13135467, 13135468, 13135469, 13135470, 13135471, 13135472, 13135473, 13135474, 13135475], "trace_timestamp_s": 294.33300000000054, "ttft_s": 4.697551459015813, "turn_id": 1} +{"actual_output_tokens": 72, "cached_tokens": 0, "effective_input_length": 3866, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3866, "latency_s": 0.5990864820196293, "output_length": 72, "proxy_request_id": "1330881:1:1330881:400", "request_id": "1330881:1:1330881:400", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1330881", "t_dispatch_unix": 1779821012.085589, "t_finish_unix": 1779821012.6846752, "t_first_token_unix": 1779821012.3301132, "tpot_s": 0.004990157225287296, "trace_hash_ids": [13217939, 13217940, 13217941, 13217942, 13217943, 13217944, 13217945, 13217946], "trace_timestamp_s": 325.14600000000064, "ttft_s": 0.2445233190082945, "turn_id": 1} +{"actual_output_tokens": 48, "cached_tokens": 15312, "effective_input_length": 25688, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25688, "latency_s": 2.027908797026612, "output_length": 48, "proxy_request_id": "1326192:3:1330643:399", "request_id": "1326192:3:1330643:399", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1326192", "t_dispatch_unix": 1779821011.2240787, "t_finish_unix": 1779821013.2519872, "t_first_token_unix": 1779821012.9749281, "tpot_s": 0.005889878234271198, "trace_hash_ids": [13152928, 13152929, 13152930, 13152931, 13152932, 13152933, 13164676, 13164677, 13164678, 13164679, 13174246, 13174247, 13174248, 13174249, 13174250, 13174251, 13174252, 13174253, 13183880, 13183881, 13183882, 13183883, 13183884, 13183885, 13183886, 13183887, 13183888, 13183889, 13183890, 13193351, 13193352, 13193353, 13193354, 13193355, 13200805, 13200806, 13200807, 13200808, 13200809, 13200810, 13200811, 13200812, 13200813, 13208998, 13208999, 13209000, 13215467, 13215468, 13215469, 13215470, 13215471], "trace_timestamp_s": 324.28200000000015, "ttft_s": 1.750847892020829, "turn_id": 3} +{"actual_output_tokens": 468, "cached_tokens": 28864, "effective_input_length": 28977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28977, "latency_s": 3.658318331988994, "output_length": 468, "proxy_request_id": "1316848:10:1330509:398", "request_id": "1316848:10:1330509:398", "request_type": "coder", "requested_output_tokens": 468, "session_id": "1316848", "t_dispatch_unix": 1779821010.6938257, "t_finish_unix": 1779821014.3521442, "t_first_token_unix": 1779821010.8193257, "tpot_s": 0.007564371355512125, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13214124], "trace_timestamp_s": 323.7550000000001, "ttft_s": 0.12549800798296928, "turn_id": 10} +{"actual_output_tokens": 57, "cached_tokens": 25728, "effective_input_length": 27049, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27049, "latency_s": 1.1557875529979356, "output_length": 57, "proxy_request_id": "1326192:4:1331370:401", "request_id": "1326192:4:1331370:401", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1326192", "t_dispatch_unix": 1779821013.8569658, "t_finish_unix": 1779821015.0127535, "t_first_token_unix": 1779821014.2108765, "tpot_s": 0.01431476700028205, "trace_hash_ids": [13222275, 13222276, 13222277, 13222278, 13222279, 13222280, 13222281, 13222282, 13222283, 13222284, 13222285, 13222286, 13222287, 13222288, 13222289, 13222290, 13222291, 13222292, 13222293, 13222294, 13222295, 13222296, 13222297, 13222298, 13222299, 13222300, 13222301, 13222302, 13222303, 13222304, 13222305, 13222306, 13222307, 13222308, 13222309, 13222310, 13222311, 13222312, 13222313, 13222314, 13222315, 13222316, 13222317, 13222318, 13222319, 13222320, 13222321, 13222322, 13222323, 13222324, 13222325, 13222326, 13222327], "trace_timestamp_s": 326.90800000000036, "ttft_s": 0.35390835197176784, "turn_id": 4} +{"actual_output_tokens": 68, "cached_tokens": 9344, "effective_input_length": 12781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12781, "latency_s": 1.1479754960164428, "output_length": 68, "proxy_request_id": "1329110:2:1331399:402", "request_id": "1329110:2:1331399:402", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1329110", "t_dispatch_unix": 1779821013.9359577, "t_finish_unix": 1779821015.0839329, "t_first_token_unix": 1779821014.5901902, "tpot_s": 0.007365927447690003, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13211079, 13211080, 13211081, 13211082, 13222555, 13222556, 13222557], "trace_timestamp_s": 326.9970000000003, "ttft_s": 0.6542309570359066, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 11792, "effective_input_length": 14067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14067, "latency_s": 0.45985914597986266, "output_length": 27, "proxy_request_id": "1330130:2:1331784:403", "request_id": "1330130:2:1331784:403", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1330130", "t_dispatch_unix": 1779821015.1302812, "t_finish_unix": 1779821015.5901403, "t_first_token_unix": 1779821015.456466, "tpot_s": 0.005132347269234463, "trace_hash_ids": [13186800, 13186801, 13186802, 13186803, 13186804, 13186805, 13186806, 13186807, 13186808, 13186809, 13186810, 13186811, 13186812, 13186813, 13197582, 13197583, 13197584, 13197585, 13197586, 13210629, 13210630, 13210631, 13220514, 13226126, 13226127, 13226128, 13226129, 13226130], "trace_timestamp_s": 328.1910000000007, "ttft_s": 0.3261833150172606, "turn_id": 2} +{"actual_output_tokens": 14, "cached_tokens": 11120, "effective_input_length": 11766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11766, "latency_s": 0.8576449049869552, "output_length": 14, "proxy_request_id": "1329470:2:1332133:409", "request_id": "1329470:2:1332133:409", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1329470", "t_dispatch_unix": 1779821016.2886665, "t_finish_unix": 1779821017.1463113, "t_first_token_unix": 1779821017.0675635, "tpot_s": 0.006031462000324749, "trace_hash_ids": [13131336, 13131337, 13131338, 13142097, 13142098, 13142099, 13149758, 13149759, 13149760, 13149761, 13160564, 13160565, 13160566, 13160567, 13181977, 13181978, 13181979, 13181980, 13205182, 13205183, 13205184, 13229764, 13229765], "trace_timestamp_s": 329.35000000000036, "ttft_s": 0.7788955270079896, "turn_id": 2} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 12421, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12421, "latency_s": 1.4004348490270786, "output_length": 48, "proxy_request_id": "1332021:1:1332021:407", "request_id": "1332021:1:1332021:407", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1332021", "t_dispatch_unix": 1779821015.929801, "t_finish_unix": 1779821017.330236, "t_first_token_unix": 1779821017.00037, "tpot_s": 0.0070135337449213925, "trace_hash_ids": [29988, 29989, 29990, 29991, 29992, 29993, 29994, 29995, 29996, 29997, 29998, 29999, 30000, 12895103, 12895104, 12895105, 12895106, 12895107, 13045377, 13061172, 13096182, 13114659, 13149439, 13200204, 13228947], "trace_timestamp_s": 328.9870000000001, "ttft_s": 1.0705668380251154, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 12848, "effective_input_length": 13479, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13479, "latency_s": 0.4955269590136595, "output_length": 66, "proxy_request_id": "1329110:3:1332476:411", "request_id": "1329110:3:1332476:411", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1329110", "t_dispatch_unix": 1779821017.6117144, "t_finish_unix": 1779821018.1072412, "t_first_token_unix": 1779821017.7555008, "tpot_s": 0.005407820291853009, "trace_hash_ids": [13185032, 13185033, 13185034, 13185035, 13185036, 13185037, 13185038, 13185039, 13201485, 13201486, 13201487, 13201488, 13201489, 13201490, 13201491, 13201492, 13201493, 13201494, 13211079, 13211080, 13211081, 13211082, 13222555, 13222556, 13222557, 13232695, 13232696], "trace_timestamp_s": 330.6730000000007, "ttft_s": 0.14378509001107886, "turn_id": 3} +{"actual_output_tokens": 13, "cached_tokens": 66736, "effective_input_length": 73234, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73234, "latency_s": 2.9811315209954046, "output_length": 13, "proxy_request_id": "1325541:2:1331846:404", "request_id": "1325541:2:1331846:404", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1325541", "t_dispatch_unix": 1779821015.3252246, "t_finish_unix": 1779821018.306356, "t_first_token_unix": 1779821018.268295, "tpot_s": 0.0031509997497778386, "trace_hash_ids": [13148586, 13148587, 13148588, 13148589, 13148590, 13148591, 13148592, 13148593, 13148594, 13148595, 13148596, 13148597, 13148598, 13148599, 13148600, 13148601, 13148602, 13148603, 13148604, 13148605, 13148606, 13148607, 13148608, 13148609, 13148610, 13148611, 13148612, 13148613, 13148614, 13148615, 13148616, 13148617, 13148618, 13148619, 13148620, 13148621, 13148622, 13148623, 13148624, 13148625, 13148626, 13148627, 13148628, 13148629, 13148630, 13148631, 13148632, 13148633, 13148634, 13148635, 13148636, 13148637, 13148638, 13148639, 13148640, 13148641, 13148642, 13148643, 13148644, 13148645, 13148646, 13148647, 13148648, 13148649, 13148650, 13148651, 13148652, 13148653, 13148654, 13148655, 13148656, 13148657, 13148658, 13148659, 13148660, 13148661, 13148662, 13148663, 13148664, 13148665, 13148666, 13148667, 13148668, 13148669, 13148670, 13148671, 13148672, 13148673, 13148674, 13148675, 13148676, 13148677, 13148678, 13148679, 13148680, 13148681, 13148682, 13148683, 13148684, 13148685, 13148686, 13148687, 13148688, 13148689, 13148690, 13148691, 13148692, 13148693, 13148694, 13148695, 13148696, 13148697, 13148698, 13148699, 13148700, 13148701, 13148702, 13148703, 13148704, 13148705, 13148706, 13148707, 13148708, 13148709, 13148710, 13148711, 13168103, 13168104, 13168105, 13168106, 13183375, 13195564, 13195565, 13195566, 13210778, 13210779, 13210780, 13210781, 13210782, 13210783, 13227100, 13227101, 13227102, 13227103], "trace_timestamp_s": 328.3820000000005, "ttft_s": 2.943068158987444, "turn_id": 2} +{"actual_output_tokens": 300, "cached_tokens": 69584, "effective_input_length": 71777, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71777, "latency_s": 3.811217962997034, "output_length": 300, "proxy_request_id": "1269373:16:1331896:405", "request_id": "1269373:16:1331896:405", "request_type": "coder", "requested_output_tokens": 300, "session_id": "1269373", "t_dispatch_unix": 1779821015.51919, "t_finish_unix": 1779821019.330408, "t_first_token_unix": 1779821016.7399175, "tpot_s": 0.008663043622153322, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13227519], "trace_timestamp_s": 328.57800000000043, "ttft_s": 1.22072451695567, "turn_id": 16} +{"actual_output_tokens": 140, "cached_tokens": 0, "effective_input_length": 1810, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1810, "latency_s": 1.7963247550069354, "output_length": 140, "proxy_request_id": "1332472:1:1332472:410", "request_id": "1332472:1:1332472:410", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1332472", "t_dispatch_unix": 1779821017.5873432, "t_finish_unix": 1779821019.3836677, "t_first_token_unix": 1779821018.3613927, "tpot_s": 0.0073512595254934575, "trace_hash_ids": [13232681, 13232682, 13232683, 13232684], "trace_timestamp_s": 330.64900000000034, "ttft_s": 0.7740488660056144, "turn_id": 1} +{"actual_output_tokens": 187, "cached_tokens": 0, "effective_input_length": 21680, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21680, "latency_s": 3.7441966110491194, "output_length": 187, "proxy_request_id": "1332013:1:1332013:406", "request_id": "1332013:1:1332013:406", "request_type": "coder", "requested_output_tokens": 187, "session_id": "1332013", "t_dispatch_unix": 1779821015.912649, "t_finish_unix": 1779821019.6568456, "t_first_token_unix": 1779821018.2510056, "tpot_s": 0.007556917623714393, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 52726, 52727, 52728, 52729, 52730, 52731, 52732, 52733, 52734, 13228755, 13228756, 13228757, 13228758, 13228759, 13228760, 13228761, 13228762, 13228763], "trace_timestamp_s": 328.97100000000046, "ttft_s": 2.338354588020593, "turn_id": 1} +{"actual_output_tokens": 83, "cached_tokens": 0, "effective_input_length": 19766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19766, "latency_s": 2.502512436010875, "output_length": 83, "proxy_request_id": "1332754:1:1332754:412", "request_id": "1332754:1:1332754:412", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1332754", "t_dispatch_unix": 1779821018.6121545, "t_finish_unix": 1779821021.1146667, "t_first_token_unix": 1779821020.6427712, "tpot_s": 0.005751492085060241, "trace_hash_ids": [13174116, 13174117, 13180993, 13180994, 13180995, 13180996, 13180997, 13180998, 13180999, 13190141, 13190142, 13190143, 13190144, 13190145, 13200026, 13200027, 13200028, 13200029, 13200030, 13200031, 13200032, 13206846, 13206847, 13206848, 13206849, 13206850, 13223085, 13223086, 13223087, 13223088, 13223089, 13223090, 13223091, 13235741, 13235742, 13235743, 13235744, 13235745, 13235746], "trace_timestamp_s": 331.66700000000037, "ttft_s": 2.030614716000855, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 29440, "effective_input_length": 29656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29656, "latency_s": 0.40677205298561603, "output_length": 47, "proxy_request_id": "1316848:11:1333994:416", "request_id": "1316848:11:1333994:416", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779821022.986682, "t_finish_unix": 1779821023.3934538, "t_first_token_unix": 1779821023.1190338, "tpot_s": 0.005959413064967679, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823], "trace_timestamp_s": 336.0480000000007, "ttft_s": 0.13234985998133197, "turn_id": 11} +{"actual_output_tokens": 219, "cached_tokens": 44880, "effective_input_length": 45601, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45601, "latency_s": 2.8251858620205894, "output_length": 219, "proxy_request_id": "1309252:2:1334746:419", "request_id": "1309252:2:1334746:419", "request_type": "coder", "requested_output_tokens": 219, "session_id": "1309252", "t_dispatch_unix": 1779821025.8255384, "t_finish_unix": 1779821028.6507242, "t_first_token_unix": 1779821026.1931996, "tpot_s": 0.011271771091600418, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13254144, 13254145, 13254146, 13254147, 13254148, 13254149, 13254150, 13254151, 13254152, 13254153, 13254154, 13254155, 13254156, 13254157, 13254158, 13254159, 13254160, 13254161, 13254162, 13254163, 13254164, 13254165, 13254166, 13254167, 13254168, 13254169, 13254170, 13254171, 13254172, 13254173, 13254174], "trace_timestamp_s": 338.8730000000005, "ttft_s": 0.3676588940434158, "turn_id": 2} +{"actual_output_tokens": 31, "cached_tokens": 3936, "effective_input_length": 11989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11989, "latency_s": 0.9013449250487611, "output_length": 31, "proxy_request_id": "1330881:2:1336222:422", "request_id": "1330881:2:1336222:422", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1330881", "t_dispatch_unix": 1779821030.9436524, "t_finish_unix": 1779821031.8449974, "t_first_token_unix": 1779821031.6901524, "tpot_s": 0.005153341700012485, "trace_hash_ids": [13217939, 13217940, 13217941, 13217942, 13217943, 13217944, 13217945, 13226639, 13226640, 13226641, 13226642, 13226643, 13226644, 13238415, 13238416, 13238417, 13247360, 13247361, 13247362, 13258417, 13258418, 13258419, 13258420, 13266737], "trace_timestamp_s": 344.0030000000006, "ttft_s": 0.7464982100063935, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 0, "effective_input_length": 23689, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23689, "latency_s": 9.68636230303673, "output_length": 98, "proxy_request_id": "1334223:1:1334223:417", "request_id": "1334223:1:1334223:417", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1334223", "t_dispatch_unix": 1779821023.859047, "t_finish_unix": 1779821033.5454092, "t_first_token_unix": 1779821026.5364306, "tpot_s": 0.07225455430914773, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13248824, 13248825, 13248826, 13248827, 13248828], "trace_timestamp_s": 336.91200000000026, "ttft_s": 2.677381862013135, "turn_id": 1} +{"actual_output_tokens": 130, "cached_tokens": 29696, "effective_input_length": 44664, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44664, "latency_s": 8.118103177985176, "output_length": 130, "proxy_request_id": "1316848:12:1334743:418", "request_id": "1316848:12:1334743:418", "request_type": "coder", "requested_output_tokens": 130, "session_id": "1316848", "t_dispatch_unix": 1779821025.814108, "t_finish_unix": 1779821033.9322107, "t_first_token_unix": 1779821030.3410242, "tpot_s": 0.027836485488372746, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13254136], "trace_timestamp_s": 338.8700000000008, "ttft_s": 4.526913959998637, "turn_id": 12} +{"actual_output_tokens": 169, "cached_tokens": 7680, "effective_input_length": 14666, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14666, "latency_s": 1.7362390800262801, "output_length": 169, "proxy_request_id": "1336620:1:1336620:423", "request_id": "1336620:1:1336620:423", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1336620", "t_dispatch_unix": 1779821032.2457223, "t_finish_unix": 1779821033.9819615, "t_first_token_unix": 1779821033.035147, "tpot_s": 0.005634307744219855, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13270075], "trace_timestamp_s": 345.3050000000003, "ttft_s": 0.789422978006769, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 12644, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12644, "latency_s": 1.2273435100214556, "output_length": 34, "proxy_request_id": "1337035:1:1337035:425", "request_id": "1337035:1:1337035:425", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1337035", "t_dispatch_unix": 1779821033.7391849, "t_finish_unix": 1779821034.966528, "t_first_token_unix": 1779821034.7932234, "tpot_s": 0.005244307242912438, "trace_hash_ids": [13244966, 13244967, 13244968, 13251581, 13251582, 13251583, 13251584, 13251585, 13251586, 13259082, 13259083, 13259084, 13267038, 13267039, 13267040, 13267041, 13267042, 13267043, 13267044, 13267045, 13274119, 13274120, 13274121, 13274122, 13274123], "trace_timestamp_s": 346.7960000000003, "ttft_s": 1.0540375330019742, "turn_id": 1} +{"actual_output_tokens": 40, "cached_tokens": 512, "effective_input_length": 90605, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90605, "latency_s": 28.076553062011953, "output_length": 40, "proxy_request_id": "1257323:2:1329541:393", "request_id": "1257323:2:1329541:393", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1257323", "t_dispatch_unix": 1779821007.4931154, "t_finish_unix": 1779821035.5696683, "t_first_token_unix": 1779821034.8523035, "tpot_s": 0.01838551928104164, "trace_hash_ids": [2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518, 46994, 46995, 46996, 46997, 46998, 46999, 47000, 47001, 47002, 47003, 47004, 47005, 47006, 47007, 47008, 47009, 47010, 47011, 47012, 4751454, 2379937, 2379938, 2379939, 2379940, 2379941, 4751455, 4751456, 4751457, 4751458, 4751459, 4751460, 4751461, 4751462, 4751463, 4751464, 4751465, 4751466, 4751467, 4751468, 4751469, 4751470, 4751471, 4751472, 4751473, 4751474, 4751475, 4751476, 4751477, 4751478, 4751479, 4751480, 4751481, 4751482, 4751483, 4751484, 4751485, 10670236, 10670237, 10670238, 10670239, 10670240, 10670241, 10670242, 10670243, 10670244, 10670245, 10670246, 10670247, 10670248, 10670249, 10670250, 10670251, 10670252, 10670253, 10670254, 10670255, 10670256, 10670257, 10670258, 10670259, 10670260, 10670261, 10994656, 10994657, 10994658, 10994659, 10994660, 10994661, 10994662, 10994663, 10994664, 10994665, 10994666, 10994667, 10994668, 10994669, 10994670, 10994671, 10994672, 10994673, 10994674, 10994675, 10994676, 10994677, 10994678, 10994679, 10994680, 10994681, 10994682, 10994683, 10994684, 10994685, 10994686, 10994687, 10994688, 10994689, 10994690, 10994691, 10994692, 10994693, 10994694, 10994695, 10994696, 10994697, 10994698, 10994699, 10994700, 10994701, 10994702, 10994703, 10994704, 10994705, 10994706, 10994707, 10994708, 10994709, 10994710, 10994711, 10994712, 10994713, 10994714, 10994715, 10994716, 10994717, 10994718, 10994719, 10994720, 10994721, 10994722, 10994723, 10994724, 10994725, 10994726, 10994727, 11134572, 11161915, 11261064, 11282181, 11360636, 11420052, 11420053, 11446131, 11701929, 12264742, 12297965, 12385798, 12385799, 12514819, 13206085], "trace_timestamp_s": 320.5510000000004, "ttft_s": 27.359185815032106, "turn_id": 2} +{"actual_output_tokens": 137, "cached_tokens": 0, "effective_input_length": 20009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20009, "latency_s": 2.866948517039418, "output_length": 137, "proxy_request_id": "1259178:2:1336768:424", "request_id": "1259178:2:1336768:424", "request_type": "coder", "requested_output_tokens": 137, "session_id": "1259178", "t_dispatch_unix": 1779821032.7100554, "t_finish_unix": 1779821035.5770037, "t_first_token_unix": 1779821034.7767887, "tpot_s": 0.005848416845444316, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13271726], "trace_timestamp_s": 345.77000000000044, "ttft_s": 2.0667312130099162, "turn_id": 2} +{"actual_output_tokens": 305, "cached_tokens": 80432, "effective_input_length": 81220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81220, "latency_s": 34.7292385820183, "output_length": 305, "proxy_request_id": "1317598:2:1324364:368", "request_id": "1317598:2:1324364:368", "request_type": "coder", "requested_output_tokens": 305, "session_id": "1317598", "t_dispatch_unix": 1779821001.44589, "t_finish_unix": 1779821036.1751282, "t_first_token_unix": 1779821002.0480182, "tpot_s": 0.11225943991111738, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196], "trace_timestamp_s": 301.8890000000001, "ttft_s": 0.602125124016311, "turn_id": 2} +{"actual_output_tokens": 142, "cached_tokens": 20144, "effective_input_length": 22398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22398, "latency_s": 1.2922304919920862, "output_length": 142, "proxy_request_id": "1259178:3:1337653:429", "request_id": "1259178:3:1337653:429", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1259178", "t_dispatch_unix": 1779821036.0216541, "t_finish_unix": 1779821037.3138845, "t_first_token_unix": 1779821036.4731266, "tpot_s": 0.005961121042202894, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13280050, 13280051, 13280052, 13280053, 13280054], "trace_timestamp_s": 349.08100000000013, "ttft_s": 0.45147078501759097, "turn_id": 3} +{"actual_output_tokens": 163, "cached_tokens": 81520, "effective_input_length": 81827, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81827, "latency_s": 2.778708507947158, "output_length": 163, "proxy_request_id": "1317598:3:1328678:385", "request_id": "1317598:3:1328678:385", "request_type": "coder", "requested_output_tokens": 163, "session_id": "1317598", "t_dispatch_unix": 1779821036.1787126, "t_finish_unix": 1779821038.9574208, "t_first_token_unix": 1779821036.6081822, "tpot_s": 0.014499949407404473, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980], "trace_timestamp_s": 317.2350000000006, "ttft_s": 0.42946748598478734, "turn_id": 3} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 9325, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9325, "latency_s": 0.8242207459989004, "output_length": 24, "proxy_request_id": "1338292:1:1338292:432", "request_id": "1338292:1:1338292:432", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1338292", "t_dispatch_unix": 1779821038.2263083, "t_finish_unix": 1779821039.050529, "t_first_token_unix": 1779821038.9352856, "tpot_s": 0.0050007740855621905, "trace_hash_ids": [13265284, 13265285, 13265286, 13265287, 13265288, 13265289, 13265290, 13265291, 13265292, 13265293, 13265294, 13265295, 13273919, 13273920, 13286188, 13286189, 13286190, 13286191, 13286192], "trace_timestamp_s": 351.28500000000076, "ttft_s": 0.7089758290094323, "turn_id": 1} +{"actual_output_tokens": 154, "cached_tokens": 14832, "effective_input_length": 14918, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14918, "latency_s": 1.7069131099851802, "output_length": 154, "proxy_request_id": "1336620:2:1338440:434", "request_id": "1336620:2:1338440:434", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1336620", "t_dispatch_unix": 1779821038.6365306, "t_finish_unix": 1779821040.3434439, "t_first_token_unix": 1779821038.7166405, "tpot_s": 0.010630829797318095, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13287309, 13287310], "trace_timestamp_s": 351.6980000000003, "ttft_s": 0.08010828599799424, "turn_id": 2} +{"actual_output_tokens": 241, "cached_tokens": 57280, "effective_input_length": 61229, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61229, "latency_s": 13.237694945943076, "output_length": 241, "proxy_request_id": "1314357:2:1335184:420", "request_id": "1314357:2:1335184:420", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1314357", "t_dispatch_unix": 1779821027.1886497, "t_finish_unix": 1779821040.426344, "t_first_token_unix": 1779821031.8788931, "tpot_s": 0.0356126838834219, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13257866], "trace_timestamp_s": 340.2470000000003, "ttft_s": 4.690242108947132, "turn_id": 2} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 36518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36518, "latency_s": 5.926442558004055, "output_length": 34, "proxy_request_id": "1311753:2:1337278:426", "request_id": "1311753:2:1337278:426", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1311753", "t_dispatch_unix": 1779821034.5983462, "t_finish_unix": 1779821040.524789, "t_first_token_unix": 1779821040.1673052, "tpot_s": 0.010820068757642399, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13276135, 13276136, 13276137, 13276138, 13276139, 13276140, 13276141, 13276142, 13276143, 13276144, 13276145, 13276146, 13276147, 13276148, 13276149, 13276150, 13276151, 13276152, 13276153, 13276154, 13276155, 13276156, 13276157, 13276158, 13276159, 13276160, 13276161, 13276162, 13276163, 13276164, 13276165, 13276166, 13276167], "trace_timestamp_s": 347.65400000000045, "ttft_s": 5.568955707014538, "turn_id": 2} +{"actual_output_tokens": 47, "cached_tokens": 44784, "effective_input_length": 45005, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45005, "latency_s": 5.04520335898269, "output_length": 47, "proxy_request_id": "1316848:13:1337519:427", "request_id": "1316848:13:1337519:427", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779821035.5736606, "t_finish_unix": 1779821040.6188638, "t_first_token_unix": 1779821040.188674, "tpot_s": 0.009345681218015354, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605], "trace_timestamp_s": 348.6350000000002, "ttft_s": 4.615010223991703, "turn_id": 13} +{"actual_output_tokens": 271, "cached_tokens": 72064, "effective_input_length": 73073, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73073, "latency_s": 3.3632579499972053, "output_length": 271, "proxy_request_id": "1269373:17:1338104:431", "request_id": "1269373:17:1338104:431", "request_type": "coder", "requested_output_tokens": 271, "session_id": "1269373", "t_dispatch_unix": 1779821037.6769931, "t_finish_unix": 1779821041.0402505, "t_first_token_unix": 1779821038.3916173, "tpot_s": 0.00980891474820156, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13284368], "trace_timestamp_s": 350.7370000000001, "ttft_s": 0.7146222129813395, "turn_id": 17} +{"actual_output_tokens": 397, "cached_tokens": 50032, "effective_input_length": 50215, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50215, "latency_s": 3.1780846099718474, "output_length": 397, "proxy_request_id": "1253743:5:1338406:433", "request_id": "1253743:5:1338406:433", "request_type": "coder", "requested_output_tokens": 397, "session_id": "1253743", "t_dispatch_unix": 1779821038.5434847, "t_finish_unix": 1779821041.7215688, "t_first_token_unix": 1779821038.7316322, "tpot_s": 0.0075496587448993305, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13287121, 13287122], "trace_timestamp_s": 351.60400000000027, "ttft_s": 0.1881457039853558, "turn_id": 5} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 13816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13816, "latency_s": 1.3945928259636275, "output_length": 37, "proxy_request_id": "1339977:1:1339977:442", "request_id": "1339977:1:1339977:442", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1339977", "t_dispatch_unix": 1779821044.2804112, "t_finish_unix": 1779821045.675004, "t_first_token_unix": 1779821045.4869223, "tpot_s": 0.00521613080571923, "trace_hash_ids": [13245098, 13245099, 13245100, 13245101, 13253631, 13253632, 13253633, 13253634, 13253635, 13253636, 13266203, 13266204, 13266205, 13266206, 13266207, 13266208, 13273953, 13273954, 13280192, 13280193, 13280194, 13288772, 13288773, 13296702, 13296703, 13296704, 13302390], "trace_timestamp_s": 357.33800000000065, "ttft_s": 1.2065099879982881, "turn_id": 1} +{"actual_output_tokens": 6362, "cached_tokens": 54896, "effective_input_length": 55130, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55130, "latency_s": 53.72300726902904, "output_length": 6362, "proxy_request_id": "1315567:3:1325346:372", "request_id": "1315567:3:1325346:372", "request_type": "coder", "requested_output_tokens": 6362, "session_id": "1315567", "t_dispatch_unix": 1779820992.123504, "t_finish_unix": 1779821045.846511, "t_first_token_unix": 1779820992.3341897, "tpot_s": 0.008412521382959375, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 7245982, 81996, 13049398, 13049399, 13073849, 13073850, 13073851, 13073852, 13073853, 13073854, 13073855, 13073856, 13073857, 13073858, 13073859, 13073860, 13073861, 13073862, 13112465, 13112466, 13112467, 13112468, 13112469, 13112470, 13112471, 13112472, 13112473, 13112474, 13112475, 13112476, 13112477, 13112478, 13112479, 13112480, 13112481, 13112482, 13112483, 13112484, 13112485, 13112486, 13112487, 13112488, 13112489, 13112490, 13112491, 13112492, 13112493, 13112494, 13112495, 13112496, 13112497, 13112498, 13112499, 13112500, 13112501, 13112502, 13112503, 13112504, 13112505, 13112506, 13112507, 13112508, 13112509, 13112510, 13112511, 13112512, 13112513, 13112514, 13112515, 13112516, 13112517, 13112518, 13112519, 13112520, 13112521, 13112522, 13112523, 13112524, 13112525, 13112526, 13112527, 13112528, 13112529, 13112530, 13112531, 13112532, 13112533, 13112534, 13112535, 13112536, 13112537, 13166089, 13166090], "trace_timestamp_s": 305.1810000000005, "ttft_s": 0.21068371104774997, "turn_id": 3} +{"actual_output_tokens": 489, "cached_tokens": 81984, "effective_input_length": 82142, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82142, "latency_s": 7.4869117609923705, "output_length": 489, "proxy_request_id": "1317598:4:1332127:408", "request_id": "1317598:4:1332127:408", "request_type": "coder", "requested_output_tokens": 489, "session_id": "1317598", "t_dispatch_unix": 1779821038.9608092, "t_finish_unix": 1779821046.447721, "t_first_token_unix": 1779821039.2564178, "tpot_s": 0.014735774665958339, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753], "trace_timestamp_s": 329.33500000000004, "ttft_s": 0.29560539696831256, "turn_id": 4} +{"actual_output_tokens": 684, "cached_tokens": 22528, "effective_input_length": 24462, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24462, "latency_s": 5.592905636003707, "output_length": 684, "proxy_request_id": "1259178:4:1339295:439", "request_id": "1259178:4:1339295:439", "request_type": "coder", "requested_output_tokens": 684, "session_id": "1259178", "t_dispatch_unix": 1779821041.6967156, "t_finish_unix": 1779821047.2896209, "t_first_token_unix": 1779821042.1334043, "tpot_s": 0.007548969229877589, "trace_hash_ids": [5658, 5659, 36953, 12532295, 12532296, 12532297, 12532298, 12532299, 12532300, 12532301, 12532302, 12532303, 12532304, 12532305, 12532306, 12532307, 12532308, 12532309, 12532310, 12532311, 12532312, 12532313, 12532314, 12532315, 12532316, 12532317, 12532318, 12532319, 13271715, 13271716, 13271717, 13271718, 13271719, 13271720, 13271721, 13271722, 13271723, 13271724, 13271725, 13280050, 13280051, 13280052, 13280053, 13280054, 13295757, 13295758, 13295759, 13295760], "trace_timestamp_s": 354.7580000000007, "ttft_s": 0.43668615800561383, "turn_id": 4} +{"actual_output_tokens": 905, "cached_tokens": 75904, "effective_input_length": 81008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81008, "latency_s": 43.96007886098232, "output_length": 905, "proxy_request_id": "1279412:17:1326166:377", "request_id": "1279412:17:1326166:377", "request_type": "coder", "requested_output_tokens": 905, "session_id": "1279412", "t_dispatch_unix": 1779821003.3686485, "t_finish_unix": 1779821047.328727, "t_first_token_unix": 1779821006.0265892, "tpot_s": 0.045687721798619345, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13174094], "trace_timestamp_s": 308.22500000000036, "ttft_s": 2.6579385710065253, "turn_id": 17} +{"actual_output_tokens": 455, "cached_tokens": 45808, "effective_input_length": 45994, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45994, "latency_s": 4.314827620983124, "output_length": 455, "proxy_request_id": "1309252:3:1339771:441", "request_id": "1309252:3:1339771:441", "request_type": "coder", "requested_output_tokens": 455, "session_id": "1309252", "t_dispatch_unix": 1779821043.5182936, "t_finish_unix": 1779821047.8331206, "t_first_token_unix": 1779821043.7017891, "tpot_s": 0.009099325513244619, "trace_hash_ids": [88938, 88939, 88940, 88941, 88942, 88943, 5122946, 13015371, 13015372, 13015373, 13015374, 13015375, 13015376, 13015377, 13015378, 13015379, 13015380, 13015381, 13015382, 13015383, 13036700, 13036701, 13036702, 13036703, 13036704, 13036705, 13036706, 13036707, 13036708, 13036709, 13036710, 13036711, 13036712, 13036713, 13036714, 13036715, 13036716, 13036717, 13036718, 13036719, 13036720, 13036721, 13036722, 13036723, 13036724, 13036725, 13036726, 13036727, 13036728, 13036729, 13036730, 13036731, 13036732, 13036733, 13036734, 13036735, 13036736, 13036737, 13036738, 13254144, 13254145, 13300607, 13300608, 13300609, 13300610, 13300611, 13300612, 13300613, 13300614, 13300615, 13300616, 13300617, 13300618, 13300619, 13300620, 13300621, 13300622, 13300623, 13300624, 13300625, 13300626, 13300627, 13300628, 13300629, 13300630, 13300631, 13300632, 13300633, 13300634, 13300635], "trace_timestamp_s": 356.5730000000003, "ttft_s": 0.1834935829974711, "turn_id": 3} +{"actual_output_tokens": 65, "cached_tokens": 82624, "effective_input_length": 83088, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83088, "latency_s": 1.6244917000294663, "output_length": 65, "proxy_request_id": "1317598:5:1337780:430", "request_id": "1317598:5:1337780:430", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1317598", "t_dispatch_unix": 1779821046.4522533, "t_finish_unix": 1779821048.0767457, "t_first_token_unix": 1779821046.9012191, "tpot_s": 0.018362986625106714, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753, 13281236, 13281237], "trace_timestamp_s": 349.5450000000001, "ttft_s": 0.4489633470075205, "turn_id": 5} +{"actual_output_tokens": 70, "cached_tokens": 0, "effective_input_length": 5280, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5280, "latency_s": 0.7848521390114911, "output_length": 70, "proxy_request_id": "1341005:1:1341005:447", "request_id": "1341005:1:1341005:447", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1341005", "t_dispatch_unix": 1779821047.7526586, "t_finish_unix": 1779821048.5375109, "t_first_token_unix": 1779821048.0990987, "tpot_s": 0.006348538435185733, "trace_hash_ids": [13311826, 13311827, 13311828, 13311829, 13311830, 13311831, 13311832, 13311833, 13311834, 13311835, 13311836], "trace_timestamp_s": 360.8130000000001, "ttft_s": 0.3464388129650615, "turn_id": 1} +{"actual_output_tokens": 200, "cached_tokens": 0, "effective_input_length": 2279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2279, "latency_s": 1.608055590011645, "output_length": 200, "proxy_request_id": "1340903:1:1340903:446", "request_id": "1340903:1:1340903:446", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1340903", "t_dispatch_unix": 1779821047.412992, "t_finish_unix": 1779821049.021048, "t_first_token_unix": 1779821047.6050477, "tpot_s": 0.0071141905427428345, "trace_hash_ids": [13297157, 13304628, 13304629, 13311075, 13311076], "trace_timestamp_s": 360.47400000000016, "ttft_s": 0.19205453101312742, "turn_id": 1} +{"actual_output_tokens": 293, "cached_tokens": 0, "effective_input_length": 21221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21221, "latency_s": 4.619585313019343, "output_length": 293, "proxy_request_id": "1340290:1:1340290:445", "request_id": "1340290:1:1340290:445", "request_type": "coder", "requested_output_tokens": 293, "session_id": "1340290", "t_dispatch_unix": 1779821045.4013975, "t_finish_unix": 1779821050.020983, "t_first_token_unix": 1779821047.6620085, "tpot_s": 0.008077763068634851, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13305218], "trace_timestamp_s": 358.45600000000013, "ttft_s": 2.26060968398815, "turn_id": 1} +{"actual_output_tokens": 296, "cached_tokens": 81904, "effective_input_length": 82488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 82488, "latency_s": 3.3069102610461414, "output_length": 296, "proxy_request_id": "1279412:18:1332945:413", "request_id": "1279412:18:1332945:413", "request_type": "coder", "requested_output_tokens": 296, "session_id": "1279412", "t_dispatch_unix": 1779821047.333329, "t_finish_unix": 1779821050.640239, "t_first_token_unix": 1779821047.7886796, "tpot_s": 0.009665231332301273, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13237340], "trace_timestamp_s": 332.5, "ttft_s": 0.4553481769980863, "turn_id": 18} +{"actual_output_tokens": 92, "cached_tokens": 0, "effective_input_length": 9909, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9909, "latency_s": 1.250431445951108, "output_length": 92, "proxy_request_id": "1341912:1:1341912:449", "request_id": "1341912:1:1341912:449", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1341912", "t_dispatch_unix": 1779821050.789557, "t_finish_unix": 1779821052.0399883, "t_first_token_unix": 1779821051.5519924, "tpot_s": 0.005359874066006351, "trace_hash_ids": [13307661, 13307662, 13307663, 13314126, 13314127, 13314128, 13314129, 13314130, 13314131, 13314132, 13314133, 13314134, 13314135, 13314136, 13314137, 13314138, 13319756, 13319757, 13319758, 13319759], "trace_timestamp_s": 363.84799999999996, "ttft_s": 0.7624340879847296, "turn_id": 1} +{"actual_output_tokens": 114, "cached_tokens": 21376, "effective_input_length": 21380, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21380, "latency_s": 0.9756671729846857, "output_length": 114, "proxy_request_id": "1340290:2:1342119:451", "request_id": "1340290:2:1342119:451", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1340290", "t_dispatch_unix": 1779821051.4440682, "t_finish_unix": 1779821052.419735, "t_first_token_unix": 1779821051.5034254, "tpot_s": 0.008105555760975004, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13321903], "trace_timestamp_s": 364.5060000000003, "ttft_s": 0.05935573799069971, "turn_id": 2} +{"actual_output_tokens": 59, "cached_tokens": 0, "effective_input_length": 6180, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6180, "latency_s": 0.7003627610392869, "output_length": 59, "proxy_request_id": "1342327:1:1342327:452", "request_id": "1342327:1:1342327:452", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1342327", "t_dispatch_unix": 1779821052.212577, "t_finish_unix": 1779821052.91294, "t_first_token_unix": 1779821052.616583, "tpot_s": 0.00510492418985011, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13323580], "trace_timestamp_s": 365.27199999999993, "ttft_s": 0.4040036600199528, "turn_id": 1} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 19887, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19887, "latency_s": 2.3200395019957796, "output_length": 45, "proxy_request_id": "1341948:1:1341948:450", "request_id": "1341948:1:1341948:450", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1341948", "t_dispatch_unix": 1779821050.9073691, "t_finish_unix": 1779821053.227409, "t_first_token_unix": 1779821052.9809887, "tpot_s": 0.005593873909674585, "trace_hash_ids": [13296198, 13296199, 13296200, 13296201, 13296202, 13296203, 13296204, 13296205, 13296206, 13296207, 13296208, 13296209, 13296210, 13296211, 13296212, 13296213, 13296214, 13296215, 13296216, 13296217, 13296218, 13296219, 13296220, 13296221, 13296222, 13296223, 13296224, 13296225, 13296226, 13296227, 13296228, 13296229, 13296230, 13308586, 13308587, 13308588, 13308589, 13320340, 13320341], "trace_timestamp_s": 363.96200000000044, "ttft_s": 2.073617652989924, "turn_id": 1} +{"actual_output_tokens": 16, "cached_tokens": 2128, "effective_input_length": 2129, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2129, "latency_s": 0.0890163509757258, "output_length": 16, "proxy_request_id": "1340903:2:1342632:453", "request_id": "1340903:2:1342632:453", "request_type": "coder", "requested_output_tokens": 16, "session_id": "1340903", "t_dispatch_unix": 1779821053.2500112, "t_finish_unix": 1779821053.3390274, "t_first_token_unix": 1779821053.3011742, "tpot_s": 0.0025075438665226103, "trace_hash_ids": [13326527, 13326528, 13326529, 13326530, 13326531], "trace_timestamp_s": 366.3110000000006, "ttft_s": 0.0511619690223597, "turn_id": 2} +{"actual_output_tokens": 547, "cached_tokens": 45040, "effective_input_length": 49688, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49688, "latency_s": 12.995307912991848, "output_length": 547, "proxy_request_id": "1316848:14:1338658:435", "request_id": "1316848:14:1338658:435", "request_type": "coder", "requested_output_tokens": 547, "session_id": "1316848", "t_dispatch_unix": 1779821040.623868, "t_finish_unix": 1779821053.6191754, "t_first_token_unix": 1779821042.139447, "tpot_s": 0.02102463510629018, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13289620], "trace_timestamp_s": 352.51800000000003, "ttft_s": 1.5155764179653488, "turn_id": 14} +{"actual_output_tokens": 81, "cached_tokens": 0, "effective_input_length": 48381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48381, "latency_s": 9.35608618601691, "output_length": 81, "proxy_request_id": "1340278:1:1340278:444", "request_id": "1340278:1:1340278:444", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1340278", "t_dispatch_unix": 1779821045.375284, "t_finish_unix": 1779821054.7313702, "t_first_token_unix": 1779821054.15945, "tpot_s": 0.007145465412031626, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13305070, 13305071, 13305072, 13305073, 13305074, 13305075, 13305076, 13305077, 13305078, 13305079, 13305080, 13305081, 13305082, 13305083, 13305084, 13305085, 13305086, 13305087, 13305088, 13305089, 13305090, 13305091, 13305092, 13305093, 13305094, 13305095, 13305096, 13305097, 13305098, 13305099, 13305100, 13305101, 13305102, 13305103, 13305104, 13305105, 13305106, 13305107, 13305108, 13305109, 13305110, 13305111, 13305112, 13305113, 13305114, 13305115, 13305116, 13305117, 13305118, 13305119, 13305120, 13305121, 13305122, 13305123, 13305124, 13305125, 13305126, 13305127, 13305128, 13305129, 13305130, 13305131, 13305132, 13305133, 13305134, 13305135, 13305136, 13305137, 13305138, 13305139, 13305140, 13305141, 13305142, 13305143, 13305144], "trace_timestamp_s": 358.4190000000008, "ttft_s": 8.784163550008088, "turn_id": 1} +{"actual_output_tokens": 209, "cached_tokens": 82768, "effective_input_length": 87264, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87264, "latency_s": 4.472038892970886, "output_length": 209, "proxy_request_id": "1279412:19:1335444:421", "request_id": "1279412:19:1335444:421", "request_type": "coder", "requested_output_tokens": 209, "session_id": "1279412", "t_dispatch_unix": 1779821050.6463726, "t_finish_unix": 1779821055.1184115, "t_first_token_unix": 1779821053.1745, "tpot_s": 0.009344567658655042, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13260063], "trace_timestamp_s": 341.1690000000008, "ttft_s": 2.528124129981734, "turn_id": 19} +{"actual_output_tokens": 12, "cached_tokens": 0, "effective_input_length": 11912, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11912, "latency_s": 1.012351914017927, "output_length": 12, "proxy_request_id": "1343191:1:1343191:457", "request_id": "1343191:1:1343191:457", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1343191", "t_dispatch_unix": 1779821055.3205671, "t_finish_unix": 1779821056.3329191, "t_first_token_unix": 1779821056.2832322, "tpot_s": 0.004495401729152284, "trace_hash_ids": [13317487, 13317488, 13317489, 13317490, 13317491, 13317492, 13317493, 13317494, 13317495, 13317496, 13317497, 13317498, 13317499, 13317500, 13317501, 13317502, 13317503, 13317504, 13317505, 13317506, 13324213, 13331765, 13331766, 13331767], "trace_timestamp_s": 368.3780000000006, "ttft_s": 0.9626635320018977, "turn_id": 1} +{"actual_output_tokens": 272, "cached_tokens": 23776, "effective_input_length": 37527, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37527, "latency_s": 6.175183498009574, "output_length": 272, "proxy_request_id": "1334223:2:1341796:448", "request_id": "1334223:2:1341796:448", "request_type": "coder", "requested_output_tokens": 272, "session_id": "1334223", "t_dispatch_unix": 1779821050.3534045, "t_finish_unix": 1779821056.528587, "t_first_token_unix": 1779821053.4256768, "tpot_s": 0.011448951501861503, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13248824, 13248825, 13248826, 13248827, 13318839, 13318840, 13318841, 13318842, 13318843, 13318844, 13318845, 13318846, 13318847, 13318848, 13318849, 13318850, 13318851, 13318852, 13318853, 13318854, 13318855, 13318856, 13318857, 13318858, 13318859, 13318860, 13318861, 13318862, 13318863, 13318864, 13318865, 13318866], "trace_timestamp_s": 363.41000000000076, "ttft_s": 3.072267538984306, "turn_id": 2} +{"actual_output_tokens": 14, "cached_tokens": 9344, "effective_input_length": 14103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14103, "latency_s": 0.6532190750003792, "output_length": 14, "proxy_request_id": "1338292:2:1343599:460", "request_id": "1338292:2:1343599:460", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1338292", "t_dispatch_unix": 1779821056.5265255, "t_finish_unix": 1779821057.1797445, "t_first_token_unix": 1779821057.0980408, "tpot_s": 0.006265084693530718, "trace_hash_ids": [13336050, 13336051, 13336052, 13336053, 13336054, 13336055, 13336056, 13336057, 13336058, 13336059, 13336060, 13336061, 13336062, 13336063, 13336064, 13336065, 13336066, 13336067, 13336068, 13336069, 13336070, 13336071, 13336072, 13336073, 13336074, 13336075, 13336076, 13336077], "trace_timestamp_s": 369.58300000000054, "ttft_s": 0.5715138840023428, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 21402, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21402, "latency_s": 2.3901536750490777, "output_length": 13, "proxy_request_id": "1343312:1:1343312:459", "request_id": "1343312:1:1343312:459", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1343312", "t_dispatch_unix": 1779821055.6834402, "t_finish_unix": 1779821058.0735931, "t_first_token_unix": 1779821057.9934046, "tpot_s": 0.0066606159137639525, "trace_hash_ids": [13332570, 13332571, 13332572, 13332573, 13332574, 13332575, 13332576, 13332577, 13332578, 13332579, 13332580, 13332581, 13332582, 13332583, 13332584, 13332585, 13332586, 13332587, 13332588, 13332589, 13332590, 13332591, 13332592, 13332593, 13332594, 13332595, 13332596, 13332597, 13332598, 13332599, 13332600, 13332601, 13332602, 13332603, 13332604, 13332605, 13332606, 13332607, 13332608, 13332609, 13332610, 13332611], "trace_timestamp_s": 368.7370000000001, "ttft_s": 2.3099630580400117, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 50224, "effective_input_length": 50447, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50447, "latency_s": 0.7015846769791096, "output_length": 47, "proxy_request_id": "1316848:15:1344261:463", "request_id": "1316848:15:1344261:463", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1316848", "t_dispatch_unix": 1779821058.7532759, "t_finish_unix": 1779821059.45486, "t_first_token_unix": 1779821058.9604023, "tpot_s": 0.010742265130038899, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13341597, 13341598], "trace_timestamp_s": 371.8140000000003, "ttft_s": 0.20712427998660132, "turn_id": 15} +{"actual_output_tokens": 152, "cached_tokens": 87472, "effective_input_length": 95383, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95383, "latency_s": 6.029225850012153, "output_length": 152, "proxy_request_id": "1279412:20:1337591:428", "request_id": "1279412:20:1337591:428", "request_type": "coder", "requested_output_tokens": 152, "session_id": "1279412", "t_dispatch_unix": 1779821055.1269913, "t_finish_unix": 1779821061.1562173, "t_first_token_unix": 1779821059.6880832, "tpot_s": 0.009720821033420028, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13279440], "trace_timestamp_s": 348.8720000000003, "ttft_s": 4.561089502996765, "turn_id": 20} +{"actual_output_tokens": 230, "cached_tokens": 95520, "effective_input_length": 95543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95543, "latency_s": 2.437042406992987, "output_length": 230, "proxy_request_id": "1279412:21:1339581:440", "request_id": "1279412:21:1339581:440", "request_type": "coder", "requested_output_tokens": 230, "session_id": "1279412", "t_dispatch_unix": 1779821061.1609757, "t_finish_unix": 1779821063.5980177, "t_first_token_unix": 1779821061.3306675, "tpot_s": 0.009899954471684276, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13298376], "trace_timestamp_s": 355.84200000000055, "ttft_s": 0.16968960396479815, "turn_id": 21} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 505, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 505, "latency_s": 0.3723498070030473, "output_length": 67, "proxy_request_id": "1345921:1:1345921:469", "request_id": "1345921:1:1345921:469", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1345921", "t_dispatch_unix": 1779821064.451386, "t_finish_unix": 1779821064.8237355, "t_first_token_unix": 1779821064.502871, "tpot_s": 0.004857467545662075, "trace_hash_ids": [13357030], "trace_timestamp_s": 377.5140000000001, "ttft_s": 0.051484449999406934, "turn_id": 1} +{"actual_output_tokens": 212, "cached_tokens": 95760, "effective_input_length": 95781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95781, "latency_s": 2.2537630570004694, "output_length": 212, "proxy_request_id": "1279412:22:1344210:462", "request_id": "1279412:22:1344210:462", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1279412", "t_dispatch_unix": 1779821063.604405, "t_finish_unix": 1779821065.8581681, "t_first_token_unix": 1779821063.774042, "tpot_s": 0.009875799056972372, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13341145], "trace_timestamp_s": 371.66499999999996, "ttft_s": 0.16963386797579005, "turn_id": 22} +{"actual_output_tokens": 45, "cached_tokens": 6224, "effective_input_length": 9820, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9820, "latency_s": 9.301647852000315, "output_length": 45, "proxy_request_id": "1342327:2:1343857:461", "request_id": "1342327:2:1343857:461", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1342327", "t_dispatch_unix": 1779821057.3482494, "t_finish_unix": 1779821066.649897, "t_first_token_unix": 1779821066.2161603, "tpot_s": 0.009848166204226965, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13338087], "trace_timestamp_s": 370.40900000000056, "ttft_s": 8.867909185006283, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 9856, "effective_input_length": 12398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12398, "latency_s": 0.6168099020142108, "output_length": 28, "proxy_request_id": "1342327:3:1344788:466", "request_id": "1342327:3:1344788:466", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1342327", "t_dispatch_unix": 1779821066.6516838, "t_finish_unix": 1779821067.2684941, "t_first_token_unix": 1779821066.9895773, "tpot_s": 0.0103113176646056, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13346828, 13346829, 13346830, 13346831, 13346832, 13346833], "trace_timestamp_s": 373.65100000000075, "ttft_s": 0.33789206203073263, "turn_id": 3} +{"actual_output_tokens": 371, "cached_tokens": 73328, "effective_input_length": 73946, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73946, "latency_s": 4.530967204016633, "output_length": 371, "proxy_request_id": "1269373:18:1345570:467", "request_id": "1269373:18:1345570:467", "request_type": "coder", "requested_output_tokens": 371, "session_id": "1269373", "t_dispatch_unix": 1779821063.1140513, "t_finish_unix": 1779821067.6450183, "t_first_token_unix": 1779821063.5850751, "tpot_s": 0.010971989056781387, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13353639], "trace_timestamp_s": 376.174, "ttft_s": 0.4710212870268151, "turn_id": 18} +{"actual_output_tokens": 11, "cached_tokens": 12416, "effective_input_length": 14842, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14842, "latency_s": 0.5237637469545007, "output_length": 11, "proxy_request_id": "1342327:4:1346218:471", "request_id": "1342327:4:1346218:471", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1342327", "t_dispatch_unix": 1779821067.270088, "t_finish_unix": 1779821067.7938519, "t_first_token_unix": 1779821067.6728554, "tpot_s": 0.012075309897772968, "trace_hash_ids": [13306604, 13323569, 13323570, 13323571, 13323572, 13323573, 13323574, 13323575, 13323576, 13323577, 13323578, 13323579, 13338080, 13338081, 13338082, 13338083, 13338084, 13338085, 13338086, 13346828, 13346829, 13346830, 13346831, 13346832, 13352845, 13352846, 13352847, 13352848, 13359282], "trace_timestamp_s": 378.6120000000001, "ttft_s": 0.40276547300163656, "turn_id": 4} +{"actual_output_tokens": 121, "cached_tokens": 0, "effective_input_length": 59219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59219, "latency_s": 14.745373095967807, "output_length": 121, "proxy_request_id": "1342634:1:1342634:454", "request_id": "1342634:1:1342634:454", "request_type": "coder", "requested_output_tokens": 121, "session_id": "1342634", "t_dispatch_unix": 1779821053.2933323, "t_finish_unix": 1779821068.0387044, "t_first_token_unix": 1779821066.2246912, "tpot_s": 0.015114445725339464, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 4565053, 4565054, 4565055, 127456, 127457, 127458, 127459, 4565056, 4565057, 61286, 4565058, 4565059, 4565060, 4565061, 4565062, 4565063, 4565064, 4565065, 4565066, 4565067, 4565068, 4565069, 4565070, 4565071, 4565072, 4565073, 4565074, 4565075, 4565076, 4565077, 4565078, 4565079, 4565080, 4565081, 4565082, 4565083, 4565084, 4565085, 4565086, 4565087, 4565088, 4565089, 13036298, 13036299, 13036300, 13036301, 13036302, 13036303, 13036304, 13036305, 13036306, 13036307, 13036308, 13036309, 13036310, 13036311, 13036312, 13036313, 13036314, 13036315, 13036316, 13036317, 13036318, 13036319, 13036320, 13036321, 13036322, 13036323, 13036324, 13036325, 13036326, 13036327, 13036328, 13036329, 13036330, 13036331, 13036332, 13036333, 13036334, 13036335, 13036336, 13036337, 13068093, 13326543, 13326544, 13326545, 13326546, 13326547, 13326548, 13326549, 13326550, 13326551, 13326552, 13326553, 13326554, 13326555, 13326556, 13326557, 13326558, 13326559, 13326560, 13326561, 13326562, 13326563, 13326564, 13326565, 13326566, 13326567, 13326568, 13326569, 13326570], "trace_timestamp_s": 366.3150000000005, "ttft_s": 12.931357327965088, "turn_id": 1} +{"actual_output_tokens": 159, "cached_tokens": 10000, "effective_input_length": 10232, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10232, "latency_s": 12.846620800031815, "output_length": 159, "proxy_request_id": "1341912:2:1343220:458", "request_id": "1341912:2:1343220:458", "request_type": "coder", "requested_output_tokens": 159, "session_id": "1341912", "t_dispatch_unix": 1779821055.396534, "t_finish_unix": 1779821068.2431548, "t_first_token_unix": 1779821066.216906, "tpot_s": 0.012822801607537166, "trace_hash_ids": [13307661, 13307662, 13307663, 13314126, 13314127, 13314128, 13314129, 13314130, 13314131, 13314132, 13314133, 13314134, 13314135, 13314136, 13314137, 13314138, 13319756, 13319757, 13319758, 13331957], "trace_timestamp_s": 368.45900000000074, "ttft_s": 10.820370777044445, "turn_id": 2} +{"actual_output_tokens": 20, "cached_tokens": 50480, "effective_input_length": 58815, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58815, "latency_s": 4.831519154948182, "output_length": 20, "proxy_request_id": "1316848:16:1345678:468", "request_id": "1316848:16:1345678:468", "request_type": "coder", "requested_output_tokens": 20, "session_id": "1316848", "t_dispatch_unix": 1779821063.561897, "t_finish_unix": 1779821068.3934157, "t_first_token_unix": 1779821068.1684105, "tpot_s": 0.011829965735638612, "trace_hash_ids": [2749, 2750, 24349, 56619, 71670, 71671, 71672, 71673, 71674, 71675, 71676, 13104211, 13111704, 13111705, 13111706, 13111707, 13111708, 13111709, 13111710, 13111711, 13111712, 13111713, 13111714, 13111715, 13111716, 13111717, 13111718, 13111719, 13111720, 13111721, 13111722, 13111723, 13111724, 13111725, 13111726, 13111727, 13111728, 13111729, 13111730, 13111731, 13111732, 13135116, 13147760, 13147761, 13147762, 13147763, 13147764, 13162813, 13162814, 13162815, 13162816, 13162817, 13176271, 13176272, 13176273, 13214123, 13246822, 13246823, 13254107, 13254108, 13254109, 13254110, 13254111, 13254112, 13254113, 13254114, 13254115, 13254116, 13254117, 13254118, 13254119, 13254120, 13254121, 13254122, 13254123, 13254124, 13254125, 13254126, 13254127, 13254128, 13254129, 13254130, 13254131, 13254132, 13254133, 13254134, 13254135, 13278605, 13289611, 13289612, 13289613, 13289614, 13289615, 13289616, 13289617, 13289618, 13289619, 13341597, 13355058, 13355059, 13355060, 13355061, 13355062, 13355063, 13355064, 13355065, 13355066, 13355067, 13355068, 13355069, 13355070, 13355071, 13355072, 13355073, 13355074], "trace_timestamp_s": 376.6190000000006, "ttft_s": 4.6065116209792905, "turn_id": 16} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 32816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32816, "latency_s": 7.877824530005455, "output_length": 25, "proxy_request_id": "1344773:1:1344773:465", "request_id": "1344773:1:1344773:465", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1344773", "t_dispatch_unix": 1779821060.5495858, "t_finish_unix": 1779821068.4274106, "t_first_token_unix": 1779821065.1534324, "tpot_s": 0.1364064823331622, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13346692], "trace_timestamp_s": 373.59900000000016, "ttft_s": 4.603844308003318, "turn_id": 1} +{"actual_output_tokens": 263, "cached_tokens": 34656, "effective_input_length": 37019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37019, "latency_s": 2.8788173610228114, "output_length": 263, "proxy_request_id": "1268861:6:1346340:472", "request_id": "1268861:6:1346340:472", "request_type": "coder", "requested_output_tokens": 263, "session_id": "1268861", "t_dispatch_unix": 1779821065.9904053, "t_finish_unix": 1779821068.8692224, "t_first_token_unix": 1779821066.6659586, "tpot_s": 0.008408457824590666, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13360572], "trace_timestamp_s": 379.0500000000002, "ttft_s": 0.6755507509806193, "turn_id": 6} +{"actual_output_tokens": 30, "cached_tokens": 32832, "effective_input_length": 33008, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33008, "latency_s": 0.44501641002716497, "output_length": 30, "proxy_request_id": "1344773:2:1346419:473", "request_id": "1344773:2:1346419:473", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1344773", "t_dispatch_unix": 1779821068.429068, "t_finish_unix": 1779821068.8740842, "t_first_token_unix": 1779821068.579184, "tpot_s": 0.010162294966746765, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13361257], "trace_timestamp_s": 379.3780000000006, "ttft_s": 0.15011327399406582, "turn_id": 2} +{"actual_output_tokens": 52, "cached_tokens": 560, "effective_input_length": 773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 773, "latency_s": 0.2842494450160302, "output_length": 52, "proxy_request_id": "1345921:2:1347089:474", "request_id": "1345921:2:1347089:474", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1345921", "t_dispatch_unix": 1779821068.6377022, "t_finish_unix": 1779821068.9219515, "t_first_token_unix": 1779821068.675124, "tpot_s": 0.0048330209409708485, "trace_hash_ids": [13357030, 13367292], "trace_timestamp_s": 381.7000000000007, "ttft_s": 0.03742083301767707, "turn_id": 2} +{"actual_output_tokens": 1409, "cached_tokens": 61456, "effective_input_length": 66152, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66152, "latency_s": 29.139201660989784, "output_length": 1409, "proxy_request_id": "1314357:3:1338999:437", "request_id": "1314357:3:1338999:437", "request_type": "coder", "requested_output_tokens": 1409, "session_id": "1314357", "t_dispatch_unix": 1779821040.6571844, "t_finish_unix": 1779821069.7963858, "t_first_token_unix": 1779821044.1210687, "tpot_s": 0.018235093849398254, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13292862, 13292863], "trace_timestamp_s": 353.71500000000015, "ttft_s": 3.46388171199942, "turn_id": 3} +{"actual_output_tokens": 50, "cached_tokens": 19920, "effective_input_length": 25661, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25661, "latency_s": 1.8539990380522795, "output_length": 50, "proxy_request_id": "1341948:2:1347296:475", "request_id": "1341948:2:1347296:475", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1341948", "t_dispatch_unix": 1779821069.3513818, "t_finish_unix": 1779821071.2053797, "t_first_token_unix": 1779821070.6254964, "tpot_s": 0.011829844551227455, "trace_hash_ids": [13296198, 13296199, 13296200, 13296201, 13296202, 13296203, 13296204, 13296205, 13296206, 13296207, 13296208, 13296209, 13296210, 13296211, 13296212, 13296213, 13296214, 13296215, 13296216, 13296217, 13296218, 13296219, 13296220, 13296221, 13296222, 13296223, 13296224, 13296225, 13296226, 13296227, 13296228, 13296229, 13296230, 13308586, 13308587, 13308588, 13308589, 13320340, 13328210, 13335592, 13335593, 13335594, 13351220, 13351221, 13351222, 13360455, 13360456, 13368789, 13368790, 13368791, 13368792], "trace_timestamp_s": 382.41100000000006, "ttft_s": 1.2741129550267942, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 5344, "effective_input_length": 9360, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9360, "latency_s": 16.81881849799538, "output_length": 55, "proxy_request_id": "1341005:2:1342961:456", "request_id": "1341005:2:1342961:456", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1341005", "t_dispatch_unix": 1779821054.4155438, "t_finish_unix": 1779821071.2343621, "t_first_token_unix": 1779821069.6239316, "tpot_s": 0.02981868044460296, "trace_hash_ids": [13311826, 13311827, 13311828, 13311829, 13311830, 13311831, 13311832, 13311833, 13311834, 13311835, 13319583, 13319584, 13319585, 13329855, 13329856, 13329857, 13329858, 13329859, 13329860], "trace_timestamp_s": 367.47600000000057, "ttft_s": 15.208386638958473, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 5465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5465, "latency_s": 0.48497528495499864, "output_length": 26, "proxy_request_id": "1347763:1:1347763:476", "request_id": "1347763:1:1347763:476", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1347763", "t_dispatch_unix": 1779821070.9623396, "t_finish_unix": 1779821071.4473147, "t_first_token_unix": 1779821071.3237672, "tpot_s": 0.004933567121624947, "trace_hash_ids": [13347549, 13347550, 13358055, 13358056, 13358057, 13358058, 13367259, 13373800, 13373801, 13373802, 13373803], "trace_timestamp_s": 384.02199999999993, "ttft_s": 0.36142687196843326, "turn_id": 1} +{"actual_output_tokens": 4929, "cached_tokens": 0, "effective_input_length": 7065, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7065, "latency_s": 31.048606173018925, "output_length": 4929, "proxy_request_id": "1339070:1:1339070:438", "request_id": "1339070:1:1339070:438", "request_type": "coder", "requested_output_tokens": 4929, "session_id": "1339070", "t_dispatch_unix": 1779821040.8719687, "t_finish_unix": 1779821071.9205747, "t_first_token_unix": 1779821041.3528883, "tpot_s": 0.006202791667006254, "trace_hash_ids": [720115, 720116, 720117, 720118, 720119, 720120, 720121, 720122, 720123, 720124, 13293798, 13293799, 13293800, 13293801], "trace_timestamp_s": 353.9320000000007, "ttft_s": 0.480917849985417, "turn_id": 1} +{"actual_output_tokens": 397, "cached_tokens": 0, "effective_input_length": 65289, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65289, "latency_s": 19.83589986700099, "output_length": 397, "proxy_request_id": "1342921:1:1342921:455", "request_id": "1342921:1:1342921:455", "request_type": "coder", "requested_output_tokens": 397, "session_id": "1342921", "t_dispatch_unix": 1779821054.3182886, "t_finish_unix": 1779821074.1541884, "t_first_token_unix": 1779821069.3620684, "tpot_s": 0.012100605744923785, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13329706], "trace_timestamp_s": 367.3550000000005, "ttft_s": 15.043777735962067, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 816, "effective_input_length": 1397, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1397, "latency_s": 0.1813681760104373, "output_length": 25, "proxy_request_id": "1345921:3:1348784:483", "request_id": "1345921:3:1348784:483", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1345921", "t_dispatch_unix": 1779821074.6357546, "t_finish_unix": 1779821074.8171227, "t_first_token_unix": 1779821074.7003772, "tpot_s": 0.004853870998582958, "trace_hash_ids": [13357030, 13375155, 13383042], "trace_timestamp_s": 387.6980000000003, "ttft_s": 0.06462195399217308, "turn_id": 3} +{"actual_output_tokens": 44, "cached_tokens": 36544, "effective_input_length": 39636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39636, "latency_s": 1.6205721709993668, "output_length": 44, "proxy_request_id": "1311753:3:1348389:480", "request_id": "1311753:3:1348389:480", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1311753", "t_dispatch_unix": 1779821073.43908, "t_finish_unix": 1779821075.0596516, "t_first_token_unix": 1779821074.6737397, "tpot_s": 0.008966171744463663, "trace_hash_ids": [94090, 94091, 94092, 94093, 94094, 508947, 176859, 508948, 508949, 508950, 508951, 508952, 508953, 508954, 508955, 508956, 508957, 508958, 508959, 508960, 10647989, 10647990, 10647991, 10647992, 13038929, 13038930, 13038931, 13038932, 13038933, 13038934, 13038935, 13038936, 13038937, 13038938, 13038939, 13038940, 13038941, 13038942, 13038943, 13276135, 13276136, 13276137, 13276138, 13276139, 13276140, 13276141, 13276142, 13276143, 13276144, 13276145, 13276146, 13276147, 13276148, 13276149, 13276150, 13276151, 13276152, 13276153, 13276154, 13276155, 13276156, 13276157, 13276158, 13276159, 13276160, 13276161, 13276162, 13276163, 13276164, 13276165, 13276166, 13379352, 13379353, 13379354, 13379355, 13379356, 13379357, 13379358], "trace_timestamp_s": 386.4990000000007, "ttft_s": 1.2346583390026353, "turn_id": 3} +{"actual_output_tokens": 67, "cached_tokens": 0, "effective_input_length": 17217, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17217, "latency_s": 2.0339868959854357, "output_length": 67, "proxy_request_id": "1348394:1:1348394:481", "request_id": "1348394:1:1348394:481", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1348394", "t_dispatch_unix": 1779821073.4698048, "t_finish_unix": 1779821075.5037918, "t_first_token_unix": 1779821075.1402645, "tpot_s": 0.005502992924338094, "trace_hash_ids": [13379385, 13379386, 13379387, 13379388, 13379389, 13379390, 13379391, 13379392, 13379393, 13379394, 13379395, 13379396, 13379397, 13379398, 13379399, 13379400, 13379401, 13379402, 13379403, 13379404, 13379405, 13379406, 13379407, 13379408, 13379409, 13379410, 13379411, 13379412, 13379413, 13379414, 13379415, 13379416, 13379417, 13379418], "trace_timestamp_s": 386.52600000000075, "ttft_s": 1.6704571939771995, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 0, "effective_input_length": 12701, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12701, "latency_s": 1.4089995180256665, "output_length": 66, "proxy_request_id": "1348691:1:1348691:482", "request_id": "1348691:1:1348691:482", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1348691", "t_dispatch_unix": 1779821074.3334806, "t_finish_unix": 1779821075.74248, "t_first_token_unix": 1779821075.3902855, "tpot_s": 0.005414373092711545, "trace_hash_ids": [13351879, 13351880, 13351881, 13351882, 13351883, 13351884, 13351885, 13351886, 13351887, 13373772, 13373773, 13373774, 13373775, 13373776, 13373777, 13373778, 13373779, 13373780, 13373781, 13382121, 13382122, 13382123, 13382124, 13382125, 13382126], "trace_timestamp_s": 387.39100000000053, "ttft_s": 1.0568032449809834, "turn_id": 1} +{"actual_output_tokens": 63, "cached_tokens": 0, "effective_input_length": 4988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4988, "latency_s": 0.6350104649900459, "output_length": 63, "proxy_request_id": "1349975:1:1349975:487", "request_id": "1349975:1:1349975:487", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1349975", "t_dispatch_unix": 1779821078.8590026, "t_finish_unix": 1779821079.4940128, "t_first_token_unix": 1779821079.17957, "tpot_s": 0.00506624806439504, "trace_hash_ids": [13378687, 13378688, 13378689, 13394474, 13394475, 13394476, 13394477, 13394478, 13394479, 13394480], "trace_timestamp_s": 391.9190000000008, "ttft_s": 0.3205662359832786, "turn_id": 1} +{"actual_output_tokens": 216, "cached_tokens": 33024, "effective_input_length": 33334, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33334, "latency_s": 2.231247654010076, "output_length": 216, "proxy_request_id": "1344773:3:1349525:486", "request_id": "1344773:3:1349525:486", "request_type": "coder", "requested_output_tokens": 216, "session_id": "1344773", "t_dispatch_unix": 1779821077.2673564, "t_finish_unix": 1779821079.4986033, "t_first_token_unix": 1779821077.4718802, "tpot_s": 0.009425220595466969, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13389569], "trace_timestamp_s": 390.3270000000002, "ttft_s": 0.20452199300052598, "turn_id": 3} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 4594, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4594, "latency_s": 0.40487804904114455, "output_length": 24, "proxy_request_id": "1350162:1:1350162:488", "request_id": "1350162:1:1350162:488", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1350162", "t_dispatch_unix": 1779821079.5457468, "t_finish_unix": 1779821079.9506245, "t_first_token_unix": 1779821079.837783, "tpot_s": 0.004895411001558861, "trace_hash_ids": [13396122, 13396123, 13396124, 13396125, 13396126, 13396127, 13396128, 13396129, 13396130], "trace_timestamp_s": 392.6050000000005, "ttft_s": 0.2920352999935858, "turn_id": 1} +{"actual_output_tokens": 381, "cached_tokens": 74304, "effective_input_length": 76493, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76493, "latency_s": 5.488871908048168, "output_length": 381, "proxy_request_id": "1269373:19:1349406:485", "request_id": "1269373:19:1349406:485", "request_type": "coder", "requested_output_tokens": 381, "session_id": "1269373", "t_dispatch_unix": 1779821076.9146044, "t_finish_unix": 1779821082.403476, "t_first_token_unix": 1779821078.175279, "tpot_s": 0.011126180750005389, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13388487], "trace_timestamp_s": 389.97200000000066, "ttft_s": 1.2606720700277947, "turn_id": 19} +{"actual_output_tokens": 74, "cached_tokens": 0, "effective_input_length": 1471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1471, "latency_s": 0.4594106180011295, "output_length": 74, "proxy_request_id": "1350896:1:1350896:489", "request_id": "1350896:1:1350896:489", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1350896", "t_dispatch_unix": 1779821081.9913685, "t_finish_unix": 1779821082.4507792, "t_first_token_unix": 1779821082.0936759, "tpot_s": 0.0048885809182674204, "trace_hash_ids": [13402641, 13402642, 13402643], "trace_timestamp_s": 395.0530000000008, "ttft_s": 0.10230608197161928, "turn_id": 1} +{"actual_output_tokens": 1107, "cached_tokens": 37792, "effective_input_length": 41202, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41202, "latency_s": 10.53077143500559, "output_length": 1107, "proxy_request_id": "1334223:3:1348241:479", "request_id": "1334223:3:1348241:479", "request_type": "coder", "requested_output_tokens": 1107, "session_id": "1334223", "t_dispatch_unix": 1779821072.870612, "t_finish_unix": 1779821083.4013834, "t_first_token_unix": 1779821073.8596327, "tpot_s": 0.00862698710941841, "trace_hash_ids": [184985, 184986, 184987, 184988, 184989, 184990, 184991, 184992, 184993, 184994, 184995, 184996, 184997, 107094, 184998, 184999, 185000, 185001, 185002, 13248808, 371190, 371191, 371192, 13248809, 13248810, 69229, 69230, 69231, 1237267, 13248811, 13248812, 13248813, 13248814, 13248815, 13248816, 13248817, 13248818, 13248819, 13248820, 13248821, 13248822, 13248823, 13377885, 13377886, 13377887, 13377888, 13377889, 13377890, 13377891, 13377892, 13377893, 13377894, 13377895, 13377896, 13377897, 13377898, 13377899, 13377900, 13377901, 13377902, 13377903, 13377904, 13377905, 13377906, 13377907, 13377908, 13377909, 13377910, 13377911, 13377912, 13377913, 13377914, 13377915, 13377916, 13377917, 13377918, 13377919, 13377920, 13377921, 13377922, 13377923], "trace_timestamp_s": 385.924, "ttft_s": 0.9890183340176009, "turn_id": 3} +{"actual_output_tokens": 10, "cached_tokens": 0, "effective_input_length": 15313, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15313, "latency_s": 1.4085920570068993, "output_length": 10, "proxy_request_id": "1350980:1:1350980:490", "request_id": "1350980:1:1350980:490", "request_type": "coder", "requested_output_tokens": 10, "session_id": "1350980", "t_dispatch_unix": 1779821082.238049, "t_finish_unix": 1779821083.64664, "t_first_token_unix": 1779821083.6099346, "tpot_s": 0.004048604893291162, "trace_hash_ids": [13395393, 13395394, 13395395, 13395396, 13395397, 13395398, 13395399, 13395400, 13395401, 13395402, 13395403, 13395404, 13395405, 13395406, 13395407, 13395408, 13395409, 13395410, 13395411, 13395412, 13395413, 13395414, 13395415, 13395416, 13395417, 13395418, 13395419, 13395420, 13403335, 13403336], "trace_timestamp_s": 395.2940000000008, "ttft_s": 1.3718844979885034, "turn_id": 1} +{"actual_output_tokens": 60, "cached_tokens": 50608, "effective_input_length": 51340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51340, "latency_s": 0.812859344005119, "output_length": 60, "proxy_request_id": "1253743:5:1351907:492", "request_id": "1253743:5:1351907:492", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1253743", "t_dispatch_unix": 1779821085.7675648, "t_finish_unix": 1779821086.5804236, "t_first_token_unix": 1779821086.1709638, "tpot_s": 0.00693591488170106, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 971291], "trace_timestamp_s": 398.82800000000043, "ttft_s": 0.40339736896567047, "turn_id": 5} +{"actual_output_tokens": 29, "cached_tokens": 33536, "effective_input_length": 33579, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33579, "latency_s": 0.24237580702174455, "output_length": 29, "proxy_request_id": "1344773:4:1352462:494", "request_id": "1344773:4:1352462:494", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1344773", "t_dispatch_unix": 1779821087.5658278, "t_finish_unix": 1779821087.808203, "t_first_token_unix": 1779821087.6465027, "tpot_s": 0.005766017892580878, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13417820], "trace_timestamp_s": 400.6270000000004, "ttft_s": 0.08067341503920034, "turn_id": 4} +{"actual_output_tokens": 40, "cached_tokens": 12752, "effective_input_length": 21436, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21436, "latency_s": 1.511163659975864, "output_length": 40, "proxy_request_id": "1348691:2:1352277:493", "request_id": "1348691:2:1352277:493", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1348691", "t_dispatch_unix": 1779821086.956763, "t_finish_unix": 1779821088.4679265, "t_first_token_unix": 1779821088.2482717, "tpot_s": 0.005624667999561494, "trace_hash_ids": [13351879, 13351880, 13351881, 13351882, 13351883, 13351884, 13351885, 13351886, 13351887, 13373772, 13373773, 13373774, 13373775, 13373776, 13373777, 13373778, 13373779, 13373780, 13373781, 13382121, 13382122, 13382123, 13382124, 13382125, 13389881, 13389882, 13389883, 13389884, 13389885, 13389886, 13389887, 13389888, 13402829, 13402830, 13402831, 13402832, 13402833, 13415762, 13415763, 13415764, 13415765, 13415766], "trace_timestamp_s": 400.0150000000003, "ttft_s": 1.2915072519681416, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 10575, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10575, "latency_s": 0.9457784740370698, "output_length": 25, "proxy_request_id": "1350162:2:1352468:495", "request_id": "1350162:2:1352468:495", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1350162", "t_dispatch_unix": 1779821087.582582, "t_finish_unix": 1779821088.5283606, "t_first_token_unix": 1779821088.4070797, "tpot_s": 0.005042617456638254, "trace_hash_ids": [13396122, 13396123, 13396124, 13396125, 13396126, 13396127, 13396128, 13396129, 13396130, 13407504, 13407505, 13407506, 13407507, 13407508, 13411995, 13411996, 13417843, 13417844, 13417845, 13417846, 13417847], "trace_timestamp_s": 400.64200000000073, "ttft_s": 0.8244963220204227, "turn_id": 2} +{"actual_output_tokens": 2, "cached_tokens": 1408, "effective_input_length": 6935, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6935, "latency_s": 0.4047111230320297, "output_length": 2, "proxy_request_id": "1345921:4:1353010:501", "request_id": "1345921:4:1353010:501", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1345921", "t_dispatch_unix": 1779821089.5624497, "t_finish_unix": 1779821089.9671605, "t_first_token_unix": 1779821089.9653575, "tpot_s": 0.0014507719897665083, "trace_hash_ids": [13421944, 13421945, 13421946, 13421947, 13421948, 13421949, 13421950, 13421951, 13421952, 13421953, 13421954, 13421955, 13421956, 13421957], "trace_timestamp_s": 402.6220000000003, "ttft_s": 0.40290616103447974, "turn_id": 4} +{"actual_output_tokens": 36, "cached_tokens": 5040, "effective_input_length": 14239, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14239, "latency_s": 1.1616308349766769, "output_length": 36, "proxy_request_id": "1349975:2:1352986:500", "request_id": "1349975:2:1352986:500", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1349975", "t_dispatch_unix": 1779821089.5215724, "t_finish_unix": 1779821090.6832032, "t_first_token_unix": 1779821090.4977262, "tpot_s": 0.00529187931346574, "trace_hash_ids": [13378687, 13378688, 13378689, 13394474, 13394475, 13394476, 13394477, 13394478, 13394479, 13402114, 13402115, 13402116, 13402117, 13402118, 13408855, 13408856, 13408857, 13408858, 13408859, 13408860, 13415611, 13415612, 13415613, 13415614, 13415615, 13421803, 13421804, 13421805], "trace_timestamp_s": 402.5799999999999, "ttft_s": 0.9761523799970746, "turn_id": 2} +{"actual_output_tokens": 77, "cached_tokens": 0, "effective_input_length": 18840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18840, "latency_s": 3.2294072239892557, "output_length": 77, "proxy_request_id": "1352606:1:1352606:496", "request_id": "1352606:1:1352606:496", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1352606", "t_dispatch_unix": 1779821088.1487353, "t_finish_unix": 1779821091.3781424, "t_first_token_unix": 1779821090.4499562, "tpot_s": 0.012208558460483082, "trace_hash_ids": [13400902, 13400903, 13400904, 13400905, 13400906, 13400907, 13400908, 13400909, 13400910, 13400911, 13409153, 13409154, 13409155, 13409156, 13409157, 13409158, 13409159, 13409160, 13409161, 13418934, 13418935, 13418936, 13418937, 13418938, 13418939, 13418940, 13418941, 13418942, 13418943, 13418944, 13418945, 13418946, 13418947, 13418948, 13418949, 13418950, 13418951], "trace_timestamp_s": 401.20400000000063, "ttft_s": 2.301217661006376, "turn_id": 1} +{"actual_output_tokens": 115, "cached_tokens": 83152, "effective_input_length": 83326, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83326, "latency_s": 1.9740701430127956, "output_length": 115, "proxy_request_id": "1317598:6:1352957:499", "request_id": "1317598:6:1352957:499", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1317598", "t_dispatch_unix": 1779821089.411645, "t_finish_unix": 1779821091.385715, "t_first_token_unix": 1779821089.7095075, "tpot_s": 0.014700961491223751, "trace_hash_ids": [2511, 74916, 74917, 484810, 484811, 484812, 484813, 2859763, 2859764, 2859765, 2859766, 2859767, 2859768, 2859769, 2859770, 2859771, 2859772, 2859773, 6375382, 6375383, 6375384, 6375385, 6375386, 633349, 633350, 633351, 633352, 10711289, 10711290, 10711291, 10711292, 10711293, 10711294, 10711295, 10711296, 10711297, 10711298, 10711299, 10711300, 10711301, 10711302, 10711303, 10711304, 10711305, 10711306, 10711307, 10711308, 10711309, 10711310, 10711311, 10711312, 10711313, 10711314, 10711315, 10711316, 10711317, 10711318, 10711319, 10711320, 10711321, 10711322, 10711323, 10711324, 10711325, 10711326, 10711327, 10711328, 10711329, 10711330, 10711331, 10711332, 10711333, 10711334, 10711335, 10711336, 10711337, 10711338, 10711339, 10711340, 10711341, 10711342, 10711343, 10711344, 10711345, 10711346, 10711347, 10711348, 10711349, 10711350, 10711351, 10711352, 10711353, 10711354, 10711355, 10711356, 10711357, 10711358, 10711359, 10711360, 10711361, 10711362, 10711363, 10711364, 10711365, 10711366, 10711367, 10711368, 10711369, 10711370, 10711371, 10711372, 10711373, 10711374, 10711375, 10711376, 10774787, 10859995, 10911325, 10993134, 11067045, 11130368, 11152362, 11202481, 11369367, 11394229, 11422395, 11422396, 11422397, 11422398, 11422399, 11422400, 11422401, 11422402, 11422403, 11422404, 11422405, 11462275, 11462276, 11462277, 11462278, 11462279, 11462280, 11528700, 11591837, 11779456, 13055928, 13055929, 13055930, 13055931, 13055932, 13092039, 13092040, 13092041, 13092042, 13092043, 13092044, 13156194, 13156195, 13156196, 13197980, 13229753, 13281236, 13421614], "trace_timestamp_s": 402.47100000000046, "ttft_s": 0.2978602150105871, "turn_id": 6} +{"actual_output_tokens": 233, "cached_tokens": 76864, "effective_input_length": 77790, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77790, "latency_s": 3.314097852970008, "output_length": 233, "proxy_request_id": "1269373:20:1352797:498", "request_id": "1269373:20:1352797:498", "request_type": "coder", "requested_output_tokens": 233, "session_id": "1269373", "t_dispatch_unix": 1779821088.8152695, "t_finish_unix": 1779821092.129367, "t_first_token_unix": 1779821089.4632583, "tpot_s": 0.0114897568318752, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385], "trace_timestamp_s": 401.8740000000007, "ttft_s": 0.6479866839945316, "turn_id": 20} +{"actual_output_tokens": 1948, "cached_tokens": 95984, "effective_input_length": 96026, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96026, "latency_s": 20.91893521201564, "output_length": 1948, "proxy_request_id": "1279412:23:1348089:477", "request_id": "1279412:23:1348089:477", "request_type": "coder", "requested_output_tokens": 1948, "session_id": "1279412", "t_dispatch_unix": 1779821072.2493398, "t_finish_unix": 1779821093.1682749, "t_first_token_unix": 1779821072.4369, "tpot_s": 0.010647732153077839, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13376365], "trace_timestamp_s": 385.3070000000007, "ttft_s": 0.18755671399412677, "turn_id": 23} +{"actual_output_tokens": 270, "cached_tokens": 33600, "effective_input_length": 33875, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33875, "latency_s": 3.1973507939837873, "output_length": 270, "proxy_request_id": "1344773:5:1353365:502", "request_id": "1344773:5:1353365:502", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1344773", "t_dispatch_unix": 1779821091.0254807, "t_finish_unix": 1779821094.2228317, "t_first_token_unix": 1779821091.229687, "tpot_s": 0.01112572168784223, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13425453], "trace_timestamp_s": 404.08600000000024, "ttft_s": 0.20420436398126185, "turn_id": 5} +{"actual_output_tokens": 14236, "cached_tokens": 59248, "effective_input_length": 62618, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62618, "latency_s": 126.70925299503142, "output_length": 14236, "proxy_request_id": "1253804:6:1318560:340", "request_id": "1253804:6:1318560:340", "request_type": "coder", "requested_output_tokens": 14236, "session_id": "1253804", "t_dispatch_unix": 1779820968.060989, "t_finish_unix": 1779821094.7702417, "t_first_token_unix": 1779820969.476818, "tpot_s": 0.008801755929749472, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 13100557], "trace_timestamp_s": 281.1200000000008, "ttft_s": 1.4158265240257606, "turn_id": 6} +{"actual_output_tokens": 59, "cached_tokens": 51392, "effective_input_length": 51436, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51436, "latency_s": 0.5197501200018451, "output_length": 59, "proxy_request_id": "1253743:6:1354346:505", "request_id": "1253743:6:1354346:505", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1253743", "t_dispatch_unix": 1779821094.269082, "t_finish_unix": 1779821094.788832, "t_first_token_unix": 1779821094.379113, "tpot_s": 0.007059752948156655, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 13433516], "trace_timestamp_s": 407.3299999999999, "ttft_s": 0.11002875200938433, "turn_id": 6} +{"actual_output_tokens": 127, "cached_tokens": 0, "effective_input_length": 27651, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27651, "latency_s": 4.227203143003862, "output_length": 127, "proxy_request_id": "1353821:1:1353821:503", "request_id": "1353821:1:1353821:503", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1353821", "t_dispatch_unix": 1779821092.441823, "t_finish_unix": 1779821096.669026, "t_first_token_unix": 1779821095.8735218, "tpot_s": 0.006311517880974515, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13429918], "trace_timestamp_s": 405.4940000000006, "ttft_s": 3.431697226013057, "turn_id": 1} +{"actual_output_tokens": 102, "cached_tokens": 12800, "effective_input_length": 19366, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19366, "latency_s": 1.5327989319921471, "output_length": 102, "proxy_request_id": "1355484:1:1355484:508", "request_id": "1355484:1:1355484:508", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1355484", "t_dispatch_unix": 1779821098.1506157, "t_finish_unix": 1779821099.6834145, "t_first_token_unix": 1779821099.0953703, "tpot_s": 0.0058197523265533, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13443776], "trace_timestamp_s": 411.21000000000004, "ttft_s": 0.9447530679753982, "turn_id": 1} +{"actual_output_tokens": 278, "cached_tokens": 0, "effective_input_length": 15519, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15519, "latency_s": 4.201341220992617, "output_length": 278, "proxy_request_id": "1286804:3:1354910:506", "request_id": "1286804:3:1354910:506", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1286804", "t_dispatch_unix": 1779821096.2462683, "t_finish_unix": 1779821100.4476094, "t_first_token_unix": 1779821097.6622014, "tpot_s": 0.010054264823226964, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13438558], "trace_timestamp_s": 409.308, "ttft_s": 1.4159308960079215, "turn_id": 3} +{"actual_output_tokens": 11, "cached_tokens": 0, "effective_input_length": 24503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24503, "latency_s": 2.8714898320031352, "output_length": 11, "proxy_request_id": "1355325:1:1355325:507", "request_id": "1355325:1:1355325:507", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1355325", "t_dispatch_unix": 1779821097.7174275, "t_finish_unix": 1779821100.5889173, "t_first_token_unix": 1779821100.5479536, "tpot_s": 0.004073020798387006, "trace_hash_ids": [2091, 2092, 2093, 41146, 41147, 41148, 41149, 41150, 41151, 41152, 41153, 41154, 41155, 41156, 41157, 41158, 41159, 41160, 41161, 41162, 41163, 41164, 252986, 252987, 252988, 252989, 6349953, 6349954, 6349955, 6349956, 6349957, 6349958, 6349959, 5104499, 10973669, 10973670, 13442398, 496454, 496455, 1203620, 1203621, 13442399, 459358, 459359, 1000032, 57326, 13442400, 13442401], "trace_timestamp_s": 410.77000000000044, "ttft_s": 2.830523353011813, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 34144, "effective_input_length": 34198, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34198, "latency_s": 0.37282314500771463, "output_length": 27, "proxy_request_id": "1344773:6:1356097:513", "request_id": "1344773:6:1356097:513", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1344773", "t_dispatch_unix": 1779821100.4043093, "t_finish_unix": 1779821100.7771323, "t_first_token_unix": 1779821100.5116544, "tpot_s": 0.01020158157692864, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13450022], "trace_timestamp_s": 413.46500000000015, "ttft_s": 0.10734235000563785, "turn_id": 6} +{"actual_output_tokens": 408, "cached_tokens": 78016, "effective_input_length": 78089, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78089, "latency_s": 4.900330071046483, "output_length": 408, "proxy_request_id": "1269373:21:1355702:509", "request_id": "1269373:21:1355702:509", "request_type": "coder", "requested_output_tokens": 408, "session_id": "1269373", "t_dispatch_unix": 1779821098.8270652, "t_finish_unix": 1779821103.7273955, "t_first_token_unix": 1779821099.058107, "tpot_s": 0.011471861238300764, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385, 13446158], "trace_timestamp_s": 411.8860000000004, "ttft_s": 0.2310390720376745, "turn_id": 21} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 6711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6711, "latency_s": 0.7211964940070175, "output_length": 54, "proxy_request_id": "1356948:1:1356948:515", "request_id": "1356948:1:1356948:515", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1356948", "t_dispatch_unix": 1779821103.4368029, "t_finish_unix": 1779821104.157999, "t_first_token_unix": 1779821103.8894324, "tpot_s": 0.0050621744528641256, "trace_hash_ids": [13432238, 13432239, 13432240, 13432241, 13442185, 13452093, 13452094, 13452095, 13452096, 13452097, 13457944, 13457945, 13457946, 13457947], "trace_timestamp_s": 416.4960000000001, "ttft_s": 0.4526282630395144, "turn_id": 1} +{"actual_output_tokens": 61, "cached_tokens": 0, "effective_input_length": 35308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35308, "latency_s": 5.564087813021615, "output_length": 61, "proxy_request_id": "1355951:1:1355951:511", "request_id": "1355951:1:1355951:511", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1355951", "t_dispatch_unix": 1779821099.7420826, "t_finish_unix": 1779821105.3061702, "t_first_token_unix": 1779821104.9239035, "tpot_s": 0.006366984633496031, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626], "trace_timestamp_s": 412.78999999999996, "ttft_s": 5.181818629032932, "turn_id": 1} +{"actual_output_tokens": 109, "cached_tokens": 0, "effective_input_length": 13520, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13520, "latency_s": 2.056902242009528, "output_length": 109, "proxy_request_id": "1357132:1:1357132:516", "request_id": "1357132:1:1357132:516", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1357132", "t_dispatch_unix": 1779821103.9770122, "t_finish_unix": 1779821106.0339143, "t_first_token_unix": 1779821105.13295, "tpot_s": 0.008338843463139643, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13459305], "trace_timestamp_s": 417.03400000000056, "ttft_s": 1.1559284619870596, "turn_id": 1} +{"actual_output_tokens": 119, "cached_tokens": 27776, "effective_input_length": 27805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27805, "latency_s": 1.2848959650145844, "output_length": 119, "proxy_request_id": "1353821:2:1357420:517", "request_id": "1353821:2:1357420:517", "request_type": "coder", "requested_output_tokens": 119, "session_id": "1353821", "t_dispatch_unix": 1779821104.8263113, "t_finish_unix": 1779821106.1112072, "t_first_token_unix": 1779821105.1703246, "tpot_s": 0.007971737593495272, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13462486], "trace_timestamp_s": 417.8879999999999, "ttft_s": 0.34401143400464207, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 34224, "effective_input_length": 34351, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34351, "latency_s": 0.7934823799878359, "output_length": 61, "proxy_request_id": "1344773:7:1357714:518", "request_id": "1344773:7:1357714:518", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1344773", "t_dispatch_unix": 1779821105.9092252, "t_finish_unix": 1779821106.7027073, "t_first_token_unix": 1779821106.0471568, "tpot_s": 0.01092022096660609, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13465009], "trace_timestamp_s": 418.96900000000005, "ttft_s": 0.13792990596266463, "turn_id": 7} +{"actual_output_tokens": 27, "cached_tokens": 51488, "effective_input_length": 51509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51509, "latency_s": 0.37295518995961174, "output_length": 27, "proxy_request_id": "1253743:7:1359251:524", "request_id": "1253743:7:1359251:524", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1253743", "t_dispatch_unix": 1779821111.468613, "t_finish_unix": 1779821111.841568, "t_first_token_unix": 1779821111.591835, "tpot_s": 0.009591648115579469, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12324507, 59081, 59082, 59083, 336603, 12324508, 75684, 75685, 75686, 75687, 75688, 12324509, 12324510, 12385576, 12385577, 12385578, 12385579, 12385580, 12385581, 12385582, 12385583, 12385584, 12385585, 12385586, 12385587, 12385588, 12385589, 12385590, 12385591, 12385592, 12385593, 12385594, 12385595, 12385596, 12385597, 12385598, 12385599, 12385600, 12385601, 12385602, 12385603, 12385604, 12385605, 12385606, 12385607, 12385608, 12385609, 12385610, 12385611, 12385612, 12385613, 12385614, 12385615, 12385616, 12385617, 12385618, 12385619, 12385620, 12385621, 12385622, 12385623, 12385624, 13287120, 13412488, 13412489, 13412490, 13480204], "trace_timestamp_s": 424.52900000000045, "ttft_s": 0.12321962497662753, "turn_id": 7} +{"actual_output_tokens": 189, "cached_tokens": 19456, "effective_input_length": 19493, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19493, "latency_s": 1.1687059910036623, "output_length": 189, "proxy_request_id": "1355484:2:1359370:525", "request_id": "1355484:2:1359370:525", "request_type": "coder", "requested_output_tokens": 189, "session_id": "1355484", "t_dispatch_unix": 1779821111.9271305, "t_finish_unix": 1779821113.095836, "t_first_token_unix": 1779821111.9835896, "tpot_s": 0.005914743298025643, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13481586], "trace_timestamp_s": 424.9890000000005, "ttft_s": 0.056457194965332747, "turn_id": 2} +{"actual_output_tokens": 972, "cached_tokens": 0, "effective_input_length": 48193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48193, "latency_s": 16.245112829026766, "output_length": 972, "proxy_request_id": "1294611:11:1355750:510", "request_id": "1294611:11:1355750:510", "request_type": "coder", "requested_output_tokens": 972, "session_id": "1294611", "t_dispatch_unix": 1779821098.927631, "t_finish_unix": 1779821115.1727433, "t_first_token_unix": 1779821107.6812508, "tpot_s": 0.007714968069010998, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 13446612], "trace_timestamp_s": 411.9870000000001, "ttft_s": 8.753617328999098, "turn_id": 11} +{"actual_output_tokens": 92, "cached_tokens": 48448, "effective_input_length": 48977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48977, "latency_s": 17.353758191980887, "output_length": 92, "proxy_request_id": "1340278:2:1356079:512", "request_id": "1340278:2:1356079:512", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1340278", "t_dispatch_unix": 1779821100.339855, "t_finish_unix": 1779821117.6936126, "t_first_token_unix": 1779821116.6535234, "tpot_s": 0.011426468021594562, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13449829, 13449830, 13449831, 13449832, 13449833, 13449834, 13449835, 13449836, 13449837, 13449838, 13449839, 13449840, 13449841, 13449842, 13449843, 13449844, 13449845, 13449846, 13449847, 13449848, 13449849, 13449850, 13449851, 13449852, 13449853, 13449854, 13449855, 13449856, 13449857, 13449858, 13449859, 13449860, 13449861, 13449862, 13449863, 13449864, 13449865, 13449866, 13449867, 13449868, 13449869, 13449870, 13449871, 13449872, 13449873, 13449874, 13449875, 13449876, 13449877, 13449878, 13449879, 13449880, 13449881, 13449882, 13449883, 13449884, 13449885, 13449886, 13449887, 13449888, 13449889, 13449890, 13449891, 13449892, 13449893, 13449894, 13449895, 13449896, 13449897, 13449898, 13449899, 13449900, 13449901, 13449902], "trace_timestamp_s": 413.3860000000004, "ttft_s": 16.31366700702347, "turn_id": 2} +{"actual_output_tokens": 150, "cached_tokens": 0, "effective_input_length": 83526, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83526, "latency_s": 25.329328585008625, "output_length": 150, "proxy_request_id": "1353951:1:1353951:504", "request_id": "1353951:1:1353951:504", "request_type": "coder", "requested_output_tokens": 150, "session_id": "1353951", "t_dispatch_unix": 1779821092.9204862, "t_finish_unix": 1779821118.2498145, "t_first_token_unix": 1779821116.6495144, "tpot_s": 0.010738269637663842, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 63992, 63993, 63994, 63995, 63996, 63997, 63998, 63999, 64000, 64001, 64002, 64003, 64004, 64005, 64006, 64007, 64008, 64009, 8107570, 8107571, 2409606, 2409607, 8107572, 8107573, 2891280, 8107574, 8107575, 8107576, 8107577, 8107578, 8107579, 8107580, 8107581, 8107582, 9028327, 9028328, 9028329, 10714983, 10714984, 10714985, 10714986, 10714987, 10714988, 10714989, 10714990, 10714991, 10714992, 10714993, 10714994, 10714995, 10714996, 10714997, 10714998, 10714999, 10715000, 10715001, 10715002, 10715003, 10715004, 10715005, 10715006, 10715007, 10715008, 10715009, 10715010, 10715011, 10715012, 10715013, 10715014, 10715015, 10715016, 10715017, 10715018, 10715019, 10715020, 10715021, 10715022, 10715023, 10715024, 10715025, 10715026, 10715027, 10715028, 10715029, 10715030, 10715031, 10715032, 10715033, 10715034, 10715035, 10715036, 10715037, 10715038, 10715039, 10715040, 10715041, 10715042, 10715043, 10715044, 10715045, 10715046, 10715047, 10715048, 10715049, 10715050, 10715051, 10715052, 10715053, 10715054, 10715055, 10715056, 10715057, 10715058, 10715059, 10715060, 10715061, 10715062, 10759522, 10759523, 10759524, 10759525, 10759526, 10759527, 10759528, 10759529, 10759530, 10778264, 10805988, 10825765, 10910663, 10910664, 10910665, 11006287, 11006288, 11333088, 11333089, 11432622, 11432623, 11610384, 11610385, 13198983, 13198984, 13198985, 13198986, 13409591, 13409592, 13409593, 13409594, 13430835, 13430836, 13430837, 13430838, 13430839, 13430840, 13430841, 13430842], "trace_timestamp_s": 405.9470000000001, "ttft_s": 23.729026118002366, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 19680, "effective_input_length": 19714, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19714, "latency_s": 0.4331422229879536, "output_length": 66, "proxy_request_id": "1355484:3:1361065:531", "request_id": "1355484:3:1361065:531", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1355484", "t_dispatch_unix": 1779821117.875653, "t_finish_unix": 1779821118.308795, "t_first_token_unix": 1779821117.9402027, "tpot_s": 0.005666793107341688, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13497881], "trace_timestamp_s": 430.9370000000008, "ttft_s": 0.06454764900263399, "turn_id": 3} +{"actual_output_tokens": 48, "cached_tokens": 65680, "effective_input_length": 66032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66032, "latency_s": 0.7063463050290011, "output_length": 48, "proxy_request_id": "1342921:2:1361022:530", "request_id": "1342921:2:1361022:530", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1342921", "t_dispatch_unix": 1779821117.704753, "t_finish_unix": 1779821118.4110987, "t_first_token_unix": 1779821118.0647995, "tpot_s": 0.007362383573831237, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390], "trace_timestamp_s": 430.7650000000003, "ttft_s": 0.3600433790124953, "turn_id": 2} +{"actual_output_tokens": 22, "cached_tokens": 83664, "effective_input_length": 83905, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83905, "latency_s": 0.4297325700172223, "output_length": 22, "proxy_request_id": "1353951:2:1358300:520", "request_id": "1353951:2:1358300:520", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1353951", "t_dispatch_unix": 1779821118.2546632, "t_finish_unix": 1779821118.6843991, "t_first_token_unix": 1779821118.5523574, "tpot_s": 0.0062764124761867735, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 63992, 63993, 63994, 63995, 63996, 63997, 63998, 63999, 64000, 64001, 64002, 64003, 64004, 64005, 64006, 64007, 64008, 64009, 8107570, 8107571, 2409606, 2409607, 8107572, 8107573, 2891280, 8107574, 8107575, 8107576, 8107577, 8107578, 8107579, 8107580, 8107581, 8107582, 9028327, 9028328, 9028329, 10714983, 10714984, 10714985, 10714986, 10714987, 10714988, 10714989, 10714990, 10714991, 10714992, 10714993, 10714994, 10714995, 10714996, 10714997, 10714998, 10714999, 10715000, 10715001, 10715002, 10715003, 10715004, 10715005, 10715006, 10715007, 10715008, 10715009, 10715010, 10715011, 10715012, 10715013, 10715014, 10715015, 10715016, 10715017, 10715018, 10715019, 10715020, 10715021, 10715022, 10715023, 10715024, 10715025, 10715026, 10715027, 10715028, 10715029, 10715030, 10715031, 10715032, 10715033, 10715034, 10715035, 10715036, 10715037, 10715038, 10715039, 10715040, 10715041, 10715042, 10715043, 10715044, 10715045, 10715046, 10715047, 10715048, 10715049, 10715050, 10715051, 10715052, 10715053, 10715054, 10715055, 10715056, 10715057, 10715058, 10715059, 10715060, 10715061, 10715062, 10759522, 10759523, 10759524, 10759525, 10759526, 10759527, 10759528, 10759529, 10759530, 10778264, 10805988, 10825765, 10910663, 10910664, 10910665, 11006287, 11006288, 11333088, 11333089, 11432622, 11432623, 11610384, 11610385, 13198983, 13198984, 13198985, 13198986, 13409591, 13409592, 13409593, 13409594, 13430835, 13471008, 13471009, 13471010, 13471011, 13471012, 13471013, 13471014], "trace_timestamp_s": 420.991, "ttft_s": 0.29769226198550314, "turn_id": 2} +{"actual_output_tokens": 41, "cached_tokens": 34400, "effective_input_length": 34552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34552, "latency_s": 9.755618843017146, "output_length": 41, "proxy_request_id": "1344773:8:1358989:523", "request_id": "1344773:8:1358989:523", "request_type": "coder", "requested_output_tokens": 41, "session_id": "1344773", "t_dispatch_unix": 1779821110.4333005, "t_finish_unix": 1779821120.1889193, "t_first_token_unix": 1779821119.6519291, "tpot_s": 0.013418367599660997, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13477517], "trace_timestamp_s": 423.4950000000008, "ttft_s": 9.218626783054788, "turn_id": 8} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 16480, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16480, "latency_s": 1.6994232069700956, "output_length": 31, "proxy_request_id": "1356948:2:1361262:532", "request_id": "1356948:2:1361262:532", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1356948", "t_dispatch_unix": 1779821118.7226255, "t_finish_unix": 1779821120.4220486, "t_first_token_unix": 1779821120.2793167, "tpot_s": 0.0047471661663924655, "trace_hash_ids": [13499396, 13499397, 13499398, 13499399, 13499400, 13499401, 13499402, 13499403, 13499404, 13499405, 13499406, 13499407, 13499408, 13499409, 13499410, 13499411, 13499412, 13499413, 13499414, 13499415, 13499416, 13499417, 13499418, 13499419, 13499420, 13499421, 13499422, 13499423, 13499424, 13499425, 13499426, 13499427, 13499428], "trace_timestamp_s": 431.77800000000025, "ttft_s": 1.5566901519778185, "turn_id": 2} +{"actual_output_tokens": 61, "cached_tokens": 34592, "effective_input_length": 34611, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34611, "latency_s": 0.9813912030076608, "output_length": 61, "proxy_request_id": "1344773:9:1360064:526", "request_id": "1344773:9:1360064:526", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1344773", "t_dispatch_unix": 1779821120.1902394, "t_finish_unix": 1779821121.171631, "t_first_token_unix": 1779821120.2963493, "tpot_s": 0.014581271283289728, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13488056], "trace_timestamp_s": 427.4940000000006, "ttft_s": 0.10610711801564321, "turn_id": 9} +{"actual_output_tokens": 64, "cached_tokens": 27920, "effective_input_length": 27933, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27933, "latency_s": 4.643165646994021, "output_length": 64, "proxy_request_id": "1353821:3:1360898:529", "request_id": "1353821:3:1360898:529", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1353821", "t_dispatch_unix": 1779821117.24262, "t_finish_unix": 1779821121.8857853, "t_first_token_unix": 1779821121.3354049, "tpot_s": 0.008731225951729963, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13496092], "trace_timestamp_s": 430.3040000000001, "ttft_s": 4.092782971041743, "turn_id": 3} +{"actual_output_tokens": 78, "cached_tokens": 0, "effective_input_length": 33478, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33478, "latency_s": 5.400162050966173, "output_length": 78, "proxy_request_id": "1270340:3:1360716:528", "request_id": "1270340:3:1360716:528", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1270340", "t_dispatch_unix": 1779821116.5794132, "t_finish_unix": 1779821121.9795752, "t_first_token_unix": 1779821121.3330812, "tpot_s": 0.008392739571576527, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13494265], "trace_timestamp_s": 429.6390000000001, "ttft_s": 4.753666161966976, "turn_id": 3} +{"actual_output_tokens": 28, "cached_tokens": 0, "effective_input_length": 8113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8113, "latency_s": 0.7071401620050892, "output_length": 28, "proxy_request_id": "1361992:1:1361992:535", "request_id": "1361992:1:1361992:535", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1361992", "t_dispatch_unix": 1779821121.2997322, "t_finish_unix": 1779821122.0068724, "t_first_token_unix": 1779821121.8738074, "tpot_s": 0.004921306222159829, "trace_hash_ids": [13476591, 13499228, 13499229, 13499230, 13499231, 13499232, 13499233, 13499234, 13499235, 13499236, 13506610, 13506611, 13506612, 13506613, 13506614, 13506615], "trace_timestamp_s": 434.3590000000004, "ttft_s": 0.5740738949971274, "turn_id": 1} +{"actual_output_tokens": 8887, "cached_tokens": 15056, "effective_input_length": 21371, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21371, "latency_s": 77.69307799299713, "output_length": 8887, "proxy_request_id": "1336620:3:1339999:443", "request_id": "1336620:3:1339999:443", "request_type": "coder", "requested_output_tokens": 8887, "session_id": "1336620", "t_dispatch_unix": 1779821044.3297336, "t_finish_unix": 1779821122.0228114, "t_first_token_unix": 1779821045.3112543, "tpot_s": 0.008632817460504288, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 26293, 5406119, 13257908, 5406121, 5406122, 5406123, 13270068, 13270069, 13270070, 13270071, 13270072, 13270073, 13270074, 13287309, 13302600, 13302601, 13302602, 13302603, 13302604, 13302605, 13302606, 13302607, 13302608, 13302609, 13302610, 13302611, 13302612], "trace_timestamp_s": 357.3890000000001, "ttft_s": 0.9815187850035727, "turn_id": 3} +{"actual_output_tokens": 197, "cached_tokens": 0, "effective_input_length": 8825, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8825, "latency_s": 1.723047828010749, "output_length": 197, "proxy_request_id": "1362265:1:1362265:536", "request_id": "1362265:1:1362265:536", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1362265", "t_dispatch_unix": 1779821122.1461165, "t_finish_unix": 1779821123.8691645, "t_first_token_unix": 1779821122.8217938, "tpot_s": 0.005342280836977844, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13509133], "trace_timestamp_s": 435.2049999999999, "ttft_s": 0.6756752689834684, "turn_id": 1} +{"actual_output_tokens": 29, "cached_tokens": 8128, "effective_input_length": 10347, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10347, "latency_s": 0.40970362501684576, "output_length": 29, "proxy_request_id": "1361992:2:1362904:537", "request_id": "1361992:2:1362904:537", "request_type": "coder", "requested_output_tokens": 29, "session_id": "1361992", "t_dispatch_unix": 1779821124.3909018, "t_finish_unix": 1779821124.8006055, "t_first_token_unix": 1779821124.6556368, "tpot_s": 0.005168307144361149, "trace_hash_ids": [13476591, 13499228, 13499229, 13499230, 13499231, 13499232, 13499233, 13499234, 13499235, 13499236, 13506610, 13506611, 13506612, 13506613, 13506614, 13515206, 13515207, 13515208, 13515209, 13515210, 13515211], "trace_timestamp_s": 437.4520000000002, "ttft_s": 0.26473287696717307, "turn_id": 2} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 543, "latency_s": 0.2357997729559429, "output_length": 37, "proxy_request_id": "1363440:1:1363440:542", "request_id": "1363440:1:1363440:542", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1363440", "t_dispatch_unix": 1779821126.3407774, "t_finish_unix": 1779821126.5765774, "t_first_token_unix": 1779821126.40202, "tpot_s": 0.004838217526816556, "trace_hash_ids": [13519619, 13519620], "trace_timestamp_s": 439.40300000000025, "ttft_s": 0.061241246992722154, "turn_id": 1} +{"actual_output_tokens": 356, "cached_tokens": 34656, "effective_input_length": 34679, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34679, "latency_s": 5.413734349014703, "output_length": 356, "proxy_request_id": "1344773:10:1361326:533", "request_id": "1344773:10:1361326:533", "request_type": "coder", "requested_output_tokens": 356, "session_id": "1344773", "t_dispatch_unix": 1779821121.1730077, "t_finish_unix": 1779821126.586742, "t_first_token_unix": 1779821121.2754915, "tpot_s": 0.014960214822441602, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13500244], "trace_timestamp_s": 432.02500000000055, "ttft_s": 0.10248161002527922, "turn_id": 10} +{"actual_output_tokens": 96, "cached_tokens": 35360, "effective_input_length": 37232, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37232, "latency_s": 1.1899273190065287, "output_length": 96, "proxy_request_id": "1355951:2:1363365:540", "request_id": "1355951:2:1363365:540", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1355951", "t_dispatch_unix": 1779821126.0451458, "t_finish_unix": 1779821127.235073, "t_first_token_unix": 1779821126.597798, "tpot_s": 0.0067053602732668974, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978], "trace_timestamp_s": 439.1050000000005, "ttft_s": 0.5526493560173549, "turn_id": 2} +{"actual_output_tokens": 242, "cached_tokens": 0, "effective_input_length": 12636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12636, "latency_s": 2.38999158894876, "output_length": 242, "proxy_request_id": "1363943:1:1363943:543", "request_id": "1363943:1:1363943:543", "request_type": "coder", "requested_output_tokens": 242, "session_id": "1363943", "t_dispatch_unix": 1779821128.0224268, "t_finish_unix": 1779821130.4124184, "t_first_token_unix": 1779821129.0790024, "tpot_s": 0.005531714879666142, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13524052], "trace_timestamp_s": 441.08300000000054, "ttft_s": 1.0565740329911932, "turn_id": 1} +{"actual_output_tokens": 723, "cached_tokens": 0, "effective_input_length": 58758, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58758, "latency_s": 23.657332888047677, "output_length": 723, "proxy_request_id": "1313181:2:1358046:519", "request_id": "1313181:2:1358046:519", "request_type": "coder", "requested_output_tokens": 723, "session_id": "1313181", "t_dispatch_unix": 1779821107.1067562, "t_finish_unix": 1779821130.764089, "t_first_token_unix": 1779821119.6495812, "tpot_s": 0.015393545439062444, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720], "trace_timestamp_s": 420.15500000000065, "ttft_s": 12.542822780029383, "turn_id": 2} +{"actual_output_tokens": 148, "cached_tokens": 0, "effective_input_length": 8706, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8706, "latency_s": 2.7373443079995923, "output_length": 148, "proxy_request_id": "1364128:1:1364128:545", "request_id": "1364128:1:1364128:545", "request_type": "coder", "requested_output_tokens": 148, "session_id": "1364128", "t_dispatch_unix": 1779821128.5085685, "t_finish_unix": 1779821131.245913, "t_first_token_unix": 1779821129.2686324, "tpot_s": 0.013447504965778517, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13525789], "trace_timestamp_s": 441.5700000000006, "ttft_s": 0.7600618349970318, "turn_id": 1} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 2019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2019, "latency_s": 0.31286190304672346, "output_length": 37, "proxy_request_id": "1364960:1:1364960:549", "request_id": "1364960:1:1364960:549", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1364960", "t_dispatch_unix": 1779821131.4333735, "t_finish_unix": 1779821131.7462351, "t_first_token_unix": 1779821131.5702684, "tpot_s": 0.004879821834038012, "trace_hash_ids": [13526287, 13526288, 13526289, 13533401], "trace_timestamp_s": 444.4950000000008, "ttft_s": 0.13689443102339283, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 24448, "effective_input_length": 24451, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24451, "latency_s": 1.1154681110056117, "output_length": 97, "proxy_request_id": "1313181:3:1316742:330", "request_id": "1313181:3:1316742:330", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1313181", "t_dispatch_unix": 1779821130.766384, "t_finish_unix": 1779821131.8818521, "t_first_token_unix": 1779821130.8337824, "tpot_s": 0.010913400020702587, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713], "trace_timestamp_s": 274.71900000000005, "ttft_s": 0.06739732599817216, "turn_id": 3} +{"actual_output_tokens": 196, "cached_tokens": 97968, "effective_input_length": 98038, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98038, "latency_s": 3.5381737199495547, "output_length": 196, "proxy_request_id": "1279412:24:1364169:546", "request_id": "1279412:24:1364169:546", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1279412", "t_dispatch_unix": 1779821128.6397212, "t_finish_unix": 1779821132.1778934, "t_first_token_unix": 1779821129.7934616, "tpot_s": 0.012225882805143603, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13526218], "trace_timestamp_s": 441.6970000000001, "ttft_s": 1.1537388769793324, "turn_id": 24} +{"actual_output_tokens": 51, "cached_tokens": 576, "effective_input_length": 3866, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3866, "latency_s": 0.46582859300542623, "output_length": 51, "proxy_request_id": "1363440:2:1365095:551", "request_id": "1363440:2:1365095:551", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1363440", "t_dispatch_unix": 1779821132.0176837, "t_finish_unix": 1779821132.4835126, "t_first_token_unix": 1779821132.233254, "tpot_s": 0.005000030460068956, "trace_hash_ids": [13519619, 13526758, 13526759, 13534597, 13534598, 13534599, 13534600, 13534601], "trace_timestamp_s": 445.0770000000002, "ttft_s": 0.21556855901144445, "turn_id": 2} +{"actual_output_tokens": 188, "cached_tokens": 19776, "effective_input_length": 19806, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19806, "latency_s": 2.034778486995492, "output_length": 188, "proxy_request_id": "1355484:4:1364784:548", "request_id": "1355484:4:1364784:548", "request_type": "coder", "requested_output_tokens": 188, "session_id": "1355484", "t_dispatch_unix": 1779821130.819243, "t_finish_unix": 1779821132.8540213, "t_first_token_unix": 1779821130.901616, "tpot_s": 0.010439088406541789, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13531652], "trace_timestamp_s": 443.8810000000003, "ttft_s": 0.08237193099921569, "turn_id": 4} +{"actual_output_tokens": 663, "cached_tokens": 12240, "effective_input_length": 16057, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16057, "latency_s": 7.969299665011931, "output_length": 663, "proxy_request_id": "1305906:2:1363233:539", "request_id": "1305906:2:1363233:539", "request_type": "coder", "requested_output_tokens": 663, "session_id": "1305906", "t_dispatch_unix": 1779821125.506527, "t_finish_unix": 1779821133.4758267, "t_first_token_unix": 1779821126.0539162, "tpot_s": 0.011210718078558472, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13517857, 13517858, 13517859, 13517860, 13517861], "trace_timestamp_s": 438.5680000000002, "ttft_s": 0.5473877239855938, "turn_id": 2} +{"actual_output_tokens": 23, "cached_tokens": 0, "effective_input_length": 9913, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9913, "latency_s": 0.8741649280418642, "output_length": 23, "proxy_request_id": "1365440:1:1365440:552", "request_id": "1365440:1:1365440:552", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1365440", "t_dispatch_unix": 1779821133.2372272, "t_finish_unix": 1779821134.111392, "t_first_token_unix": 1779821134.0010512, "tpot_s": 0.005004046863177791, "trace_hash_ids": [13493986, 13493987, 13493988, 13493989, 13493990, 13502611, 13502612, 13502613, 13502614, 13502615, 13512497, 13512498, 13521747, 13521748, 13529243, 13529244, 13529245, 13529246, 13537645, 13537646], "trace_timestamp_s": 446.2930000000006, "ttft_s": 0.7638225300470367, "turn_id": 1} +{"actual_output_tokens": 584, "cached_tokens": 0, "effective_input_length": 13897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13897, "latency_s": 6.149693278013729, "output_length": 584, "proxy_request_id": "1364090:1:1364090:544", "request_id": "1364090:1:1364090:544", "request_type": "coder", "requested_output_tokens": 584, "session_id": "1364090", "t_dispatch_unix": 1779821128.4007938, "t_finish_unix": 1779821134.5504873, "t_first_token_unix": 1779821129.6266432, "tpot_s": 0.00844525986795967, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 11789930], "trace_timestamp_s": 441.46200000000044, "ttft_s": 1.2258473580004647, "turn_id": 1} +{"actual_output_tokens": 94, "cached_tokens": 0, "effective_input_length": 11154, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11154, "latency_s": 2.0136267780326307, "output_length": 94, "proxy_request_id": "1366128:1:1366128:553", "request_id": "1366128:1:1366128:553", "request_type": "coder", "requested_output_tokens": 94, "session_id": "1366128", "t_dispatch_unix": 1779821135.5285811, "t_finish_unix": 1779821137.542208, "t_first_token_unix": 1779821136.423957, "tpot_s": 0.012020559322404405, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2239018, 2239019, 2239020, 2239021, 2239022, 177637, 177638, 177639, 2239023, 2239024, 2239025, 2239026, 2239027], "trace_timestamp_s": 448.58700000000044, "ttft_s": 0.8953744090395048, "turn_id": 1} +{"actual_output_tokens": 322, "cached_tokens": 12864, "effective_input_length": 12984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12984, "latency_s": 1.8523021910223179, "output_length": 322, "proxy_request_id": "1363943:2:1366428:556", "request_id": "1363943:2:1366428:556", "request_type": "coder", "requested_output_tokens": 322, "session_id": "1363943", "t_dispatch_unix": 1779821136.6387455, "t_finish_unix": 1779821138.491048, "t_first_token_unix": 1779821136.701364, "tpot_s": 0.0055744145950447545, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13546053], "trace_timestamp_s": 449.7000000000007, "ttft_s": 0.06261645501945168, "turn_id": 2} +{"actual_output_tokens": 60, "cached_tokens": 19984, "effective_input_length": 20026, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20026, "latency_s": 0.7997060350026004, "output_length": 60, "proxy_request_id": "1355484:5:1366753:560", "request_id": "1355484:5:1366753:560", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1355484", "t_dispatch_unix": 1779821137.7023497, "t_finish_unix": 1779821138.5020554, "t_first_token_unix": 1779821137.7932658, "tpot_s": 0.01200797533916341, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13549316], "trace_timestamp_s": 450.7640000000001, "ttft_s": 0.09091423597419634, "turn_id": 5} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 3392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3392, "latency_s": 0.6175680509768426, "output_length": 13, "proxy_request_id": "1367424:1:1367424:569", "request_id": "1367424:1:1367424:569", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1367424", "t_dispatch_unix": 1779821140.2663503, "t_finish_unix": 1779821140.8839183, "t_first_token_unix": 1779821140.7138133, "tpot_s": 0.014154644168835754, "trace_hash_ids": [13550847, 13550848, 13555750, 13555751, 13555752, 13555753, 13555754], "trace_timestamp_s": 453.3270000000002, "ttft_s": 0.4474616939551197, "turn_id": 1} +{"actual_output_tokens": 34, "cached_tokens": 9008, "effective_input_length": 10134, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10134, "latency_s": 1.1512116040103137, "output_length": 34, "proxy_request_id": "1362265:2:1367373:568", "request_id": "1362265:2:1367373:568", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1362265", "t_dispatch_unix": 1779821140.0665631, "t_finish_unix": 1779821141.2177749, "t_first_token_unix": 1779821140.3743422, "tpot_s": 0.025547903242774984, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218], "trace_timestamp_s": 453.1280000000006, "ttft_s": 0.307777673995588, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 27984, "effective_input_length": 28093, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28093, "latency_s": 15.115998948982451, "output_length": 28, "proxy_request_id": "1353821:4:1363399:541", "request_id": "1353821:4:1363399:541", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1353821", "t_dispatch_unix": 1779821126.1640103, "t_finish_unix": 1779821141.2800093, "t_first_token_unix": 1779821139.0908418, "tpot_s": 0.08107195781431747, "trace_hash_ids": [13429891, 13429892, 574397, 574398, 3094139, 3094140, 3094141, 769383, 3094142, 170398, 170399, 13429893, 13429894, 13429895, 13429896, 13429897, 13429898, 13429899, 13429900, 13429901, 13429902, 13429903, 13429904, 11202130, 11202131, 345479, 345480, 345481, 345482, 345483, 345484, 345485, 345486, 345487, 13429905, 2388375, 2388376, 13429906, 2885088, 13429907, 54678, 54679, 54680, 54681, 13429908, 13429909, 13429910, 13429911, 13429912, 13429913, 13429914, 13429915, 13429916, 13429917, 13496092], "trace_timestamp_s": 439.22600000000057, "ttft_s": 12.926829333999194, "turn_id": 4} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 13749, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13749, "latency_s": 1.809320663975086, "output_length": 60, "proxy_request_id": "1367312:1:1367312:566", "request_id": "1367312:1:1367312:566", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1367312", "t_dispatch_unix": 1779821139.8611977, "t_finish_unix": 1779821141.6705186, "t_first_token_unix": 1779821141.0492725, "tpot_s": 0.010523797745887443, "trace_hash_ids": [13521767, 13521768, 13521769, 13521770, 13521771, 13521772, 13529702, 13529703, 13529704, 13529705, 13529706, 13529707, 13537903, 13537904, 13537905, 13537906, 13537907, 13537908, 13537909, 13537910, 13554581, 13554582, 13554583, 13554584, 13554585, 13554586, 13554587], "trace_timestamp_s": 452.9180000000006, "ttft_s": 1.1880734239821322, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 11232, "effective_input_length": 15411, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15411, "latency_s": 2.333206543989945, "output_length": 92, "proxy_request_id": "1366128:2:1367220:563", "request_id": "1366128:2:1367220:563", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1366128", "t_dispatch_unix": 1779821139.5642767, "t_finish_unix": 1779821141.897483, "t_first_token_unix": 1779821140.1321218, "tpot_s": 0.01939595381314815, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13553898], "trace_timestamp_s": 452.6220000000003, "ttft_s": 0.5678429689723998, "turn_id": 2} +{"actual_output_tokens": 68, "cached_tokens": 0, "effective_input_length": 62685, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62685, "latency_s": 16.923444878018927, "output_length": 68, "proxy_request_id": "1363093:1:1363093:538", "request_id": "1363093:1:1363093:538", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1363093", "t_dispatch_unix": 1779821125.0194643, "t_finish_unix": 1779821141.9429088, "t_first_token_unix": 1779821139.095082, "tpot_s": 0.042501490133981315, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933], "trace_timestamp_s": 438.0560000000005, "ttft_s": 14.075615954003297, "turn_id": 1} +{"actual_output_tokens": 65, "cached_tokens": 8848, "effective_input_length": 9095, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9095, "latency_s": 3.510720719990786, "output_length": 65, "proxy_request_id": "1364128:2:1367249:565", "request_id": "1364128:2:1367249:565", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1364128", "t_dispatch_unix": 1779821139.6589553, "t_finish_unix": 1779821143.1696756, "t_first_token_unix": 1779821141.8587637, "tpot_s": 0.020477822499742615, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13554127], "trace_timestamp_s": 452.72100000000046, "ttft_s": 2.1998076629824936, "turn_id": 2} +{"actual_output_tokens": 89, "cached_tokens": 35024, "effective_input_length": 35071, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35071, "latency_s": 7.216211961000226, "output_length": 89, "proxy_request_id": "1344773:11:1366387:555", "request_id": "1344773:11:1366387:555", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1344773", "t_dispatch_unix": 1779821136.4994977, "t_finish_unix": 1779821143.7157094, "t_first_token_unix": 1779821141.8434, "tpot_s": 0.02127209303382022, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13545744], "trace_timestamp_s": 449.5610000000006, "ttft_s": 5.3439004010288045, "turn_id": 11} +{"actual_output_tokens": 58, "cached_tokens": 13808, "effective_input_length": 15501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15501, "latency_s": 1.3826516389963217, "output_length": 58, "proxy_request_id": "1367312:2:1368064:574", "request_id": "1367312:2:1368064:574", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1367312", "t_dispatch_unix": 1779821142.5572891, "t_finish_unix": 1779821143.9399407, "t_first_token_unix": 1779821142.8402452, "tpot_s": 0.01928877578987005, "trace_hash_ids": [13521767, 13521768, 13521769, 13521770, 13521771, 13521772, 13529702, 13529703, 13529704, 13529705, 13529706, 13529707, 13537903, 13537904, 13537905, 13537906, 13537907, 13537908, 13537909, 13537910, 13554581, 13554582, 13554583, 13554584, 13554585, 13554586, 13561194, 13561195, 13561196, 13561197, 13561198], "trace_timestamp_s": 455.6180000000004, "ttft_s": 0.2829544689739123, "turn_id": 2} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 7048, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7048, "latency_s": 1.118649528012611, "output_length": 57, "proxy_request_id": "1364960:2:1368239:578", "request_id": "1364960:2:1368239:578", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1364960", "t_dispatch_unix": 1779821143.1581845, "t_finish_unix": 1779821144.276834, "t_first_token_unix": 1779821143.649723, "tpot_s": 0.01119357353517054, "trace_hash_ids": [13526287, 13526288, 13526289, 13533401, 13540695, 13540696, 13540697, 13540698, 13540699, 13549445, 13549446, 13556212, 13562654, 13562655], "trace_timestamp_s": 456.21800000000076, "ttft_s": 0.4915371320093982, "turn_id": 2} +{"actual_output_tokens": 153, "cached_tokens": 13616, "effective_input_length": 14721, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14721, "latency_s": 13.740514119970612, "output_length": 153, "proxy_request_id": "1357132:2:1364990:550", "request_id": "1357132:2:1364990:550", "request_type": "coder", "requested_output_tokens": 153, "session_id": "1357132", "t_dispatch_unix": 1779821131.5077312, "t_finish_unix": 1779821145.2482455, "t_first_token_unix": 1779821139.0891714, "tpot_s": 0.04051695583544451, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13533536], "trace_timestamp_s": 444.5690000000004, "ttft_s": 7.581438464985695, "turn_id": 2} +{"actual_output_tokens": 95, "cached_tokens": 0, "effective_input_length": 26837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26837, "latency_s": 5.347640432009939, "output_length": 95, "proxy_request_id": "1367329:1:1367329:567", "request_id": "1367329:1:1367329:567", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1367329", "t_dispatch_unix": 1779821139.9200075, "t_finish_unix": 1779821145.2676477, "t_first_token_unix": 1779821144.4854963, "tpot_s": 0.00831795863787386, "trace_hash_ids": [13554866, 13554867, 13554868, 13554869, 13554870, 13554871, 13554872, 13554873, 13554874, 13554875, 13554876, 13554877, 13554878, 13554879, 13554880, 13554881, 13554882, 13554883, 13554884, 13554885, 13554886, 13554887, 13554888, 13554889, 13554890, 13554891, 13554892, 13554893, 13554894, 13554895, 13554896, 13554897, 13554898, 13554899, 13554900, 13554901, 13554902, 13554903, 13554904, 13554905, 13554906, 13554907, 13554908, 13554909, 13554910, 13554911, 13554912, 13554913, 13554914, 13554915, 13554916, 13554917, 13554918], "trace_timestamp_s": 452.97200000000066, "ttft_s": 4.56548696703976, "turn_id": 1} +{"actual_output_tokens": 161, "cached_tokens": 33552, "effective_input_length": 41017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41017, "latency_s": 8.137453809031285, "output_length": 161, "proxy_request_id": "1270340:4:1366608:558", "request_id": "1270340:4:1366608:558", "request_type": "coder", "requested_output_tokens": 161, "session_id": "1270340", "t_dispatch_unix": 1779821137.2532725, "t_finish_unix": 1779821145.390726, "t_first_token_unix": 1779821140.9446151, "tpot_s": 0.02778585320629645, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 13547874], "trace_timestamp_s": 450.3120000000008, "ttft_s": 3.691340861027129, "turn_id": 4} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 21773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21773, "latency_s": 2.9336840140167624, "output_length": 26, "proxy_request_id": "1368070:1:1368070:575", "request_id": "1368070:1:1368070:575", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1368070", "t_dispatch_unix": 1779821142.5794294, "t_finish_unix": 1779821145.5131135, "t_first_token_unix": 1779821144.9531193, "tpot_s": 0.02238673419924453, "trace_hash_ids": [13522908, 13522909, 13522910, 13522911, 13529691, 13529692, 13529693, 13529694, 13529695, 13529696, 13529697, 13529698, 13529699, 13537845, 13537846, 13537847, 13537848, 13547043, 13547044, 13547045, 13547046, 13547047, 13547048, 13547049, 13556102, 13556103, 13556104, 13556105, 13556106, 13556107, 13556108, 13556109, 13556110, 13556111, 13556112, 13561206, 13561207, 13561208, 13561209, 13561210, 13561211, 13561212, 13561213], "trace_timestamp_s": 455.634, "ttft_s": 2.373687401995994, "turn_id": 1} +{"actual_output_tokens": 27, "cached_tokens": 14800, "effective_input_length": 14816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14816, "latency_s": 0.37274204596178606, "output_length": 27, "proxy_request_id": "1357132:3:1366582:557", "request_id": "1357132:3:1366582:557", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1357132", "t_dispatch_unix": 1779821145.2493348, "t_finish_unix": 1779821145.622077, "t_first_token_unix": 1779821145.3285055, "tpot_s": 0.011276644770987332, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710], "trace_timestamp_s": 450.241, "ttft_s": 0.07916978496359661, "turn_id": 3} +{"actual_output_tokens": 33, "cached_tokens": 14832, "effective_input_length": 14949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14949, "latency_s": 0.3855191460461356, "output_length": 33, "proxy_request_id": "1357132:4:1367654:570", "request_id": "1357132:4:1367654:570", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1357132", "t_dispatch_unix": 1779821145.6229916, "t_finish_unix": 1779821146.008511, "t_first_token_unix": 1779821145.7036536, "tpot_s": 0.00950679721790948, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710, 13557420], "trace_timestamp_s": 454.02500000000055, "ttft_s": 0.08066003303974867, "turn_id": 4} +{"actual_output_tokens": 254, "cached_tokens": 0, "effective_input_length": 18815, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18815, "latency_s": 6.823594388028141, "output_length": 254, "proxy_request_id": "1367169:1:1367169:562", "request_id": "1367169:1:1367169:562", "request_type": "coder", "requested_output_tokens": 254, "session_id": "1367169", "t_dispatch_unix": 1779821139.3764594, "t_finish_unix": 1779821146.2000535, "t_first_token_unix": 1779821141.589659, "tpot_s": 0.018221954458481505, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 1489202, 13282259, 13553463, 13553464, 3656637, 13553465, 13553466, 13553467, 13424449, 13424450, 13424451, 13424452, 13553468, 13553469], "trace_timestamp_s": 452.4360000000006, "ttft_s": 2.213197638047859, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 14976, "effective_input_length": 15871, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15871, "latency_s": 0.4992919420474209, "output_length": 32, "proxy_request_id": "1357132:5:1368445:579", "request_id": "1357132:5:1368445:579", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1357132", "t_dispatch_unix": 1779821146.0095706, "t_finish_unix": 1779821146.5088625, "t_first_token_unix": 1779821146.2147007, "tpot_s": 0.00948185206488556, "trace_hash_ids": [131688, 13459280, 13459281, 13459282, 13459283, 13459284, 13459285, 13459286, 13459287, 13459288, 13459289, 13459290, 13459291, 13459292, 13459293, 13459294, 13459295, 13459296, 13459297, 13459298, 13459299, 13459300, 13459301, 13459302, 13459303, 13459304, 13533534, 13533535, 13547710, 13564577, 13564578], "trace_timestamp_s": 457.0070000000005, "ttft_s": 0.20512873702682555, "turn_id": 5} +{"actual_output_tokens": 162, "cached_tokens": 62752, "effective_input_length": 63235, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63235, "latency_s": 2.2459738830220886, "output_length": 162, "proxy_request_id": "1363093:2:1368700:580", "request_id": "1363093:2:1368700:580", "request_type": "coder", "requested_output_tokens": 162, "session_id": "1363093", "t_dispatch_unix": 1779821144.7343774, "t_finish_unix": 1779821146.9803507, "t_first_token_unix": 1779821145.2590358, "tpot_s": 0.010689959173692356, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147], "trace_timestamp_s": 457.7940000000008, "ttft_s": 0.5246563060209155, "turn_id": 2} +{"actual_output_tokens": 48, "cached_tokens": 0, "effective_input_length": 6345, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6345, "latency_s": 0.6601722209597938, "output_length": 48, "proxy_request_id": "1369172:1:1369172:581", "request_id": "1369172:1:1369172:581", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1369172", "t_dispatch_unix": 1779821146.425839, "t_finish_unix": 1779821147.086011, "t_first_token_unix": 1779821146.8471887, "tpot_s": 0.0050758176800259885, "trace_hash_ids": [13562302, 13562303, 13562304, 13562305, 13562306, 13562307, 13562308, 13562309, 13571383, 13571384, 13571385, 13571386, 13571387], "trace_timestamp_s": 459.4850000000006, "ttft_s": 0.4213488289969973, "turn_id": 1} +{"actual_output_tokens": 191, "cached_tokens": 35152, "effective_input_length": 35194, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35194, "latency_s": 3.3904965210240334, "output_length": 191, "proxy_request_id": "1344773:12:1367864:571", "request_id": "1344773:12:1367864:571", "request_type": "coder", "requested_output_tokens": 191, "session_id": "1344773", "t_dispatch_unix": 1779821143.71704, "t_finish_unix": 1779821147.1075366, "t_first_token_unix": 1779821143.837371, "tpot_s": 0.01720951896828697, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13559222], "trace_timestamp_s": 454.8190000000004, "ttft_s": 0.12032893404830247, "turn_id": 12} +{"actual_output_tokens": 120, "cached_tokens": 0, "effective_input_length": 76969, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76969, "latency_s": 27.520402484980877, "output_length": 120, "proxy_request_id": "1361694:1:1361694:534", "request_id": "1361694:1:1361694:534", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1361694", "t_dispatch_unix": 1779821120.2686992, "t_finish_unix": 1779821147.7891016, "t_first_token_unix": 1779821140.552417, "tpot_s": 0.060809646210214514, "trace_hash_ids": [44767, 44768, 44769, 44770, 44771, 44772, 44773, 44774, 44775, 44776, 44777, 44778, 44779, 44780, 44781, 44782, 44783, 44784, 44785, 44786, 44787, 44788, 44789, 44790, 44791, 44792, 44793, 44794, 44795, 44796, 44797, 44798, 44799, 44800, 3558548, 3558549, 3558550, 3558551, 3558552, 3558553, 13503874, 1011240, 1011241, 1011242, 1011243, 3586252, 74020, 74021, 74022, 74023, 3586253, 3586254, 3586255, 3586256, 3586257, 3586258, 3586259, 3586260, 3586261, 3586262, 3586263, 3586264, 3586265, 3586266, 3586267, 3586268, 3586269, 3586270, 3586271, 3586272, 3586273, 3586274, 3586275, 3586276, 3586277, 3586278, 3663116, 4797128, 4797129, 4797130, 4797131, 4797132, 5846177, 5846178, 5846179, 5846180, 5865004, 8339969, 8339970, 8339971, 8339972, 8339973, 8339974, 10027756, 10027757, 10027758, 10027759, 10027760, 10027761, 10027762, 11077600, 11077601, 11077602, 11077603, 11077604, 11077605, 11077606, 11077607, 11077608, 11077609, 11077610, 11866485, 11866486, 11866487, 11866488, 11866489, 11866490, 11866491, 11866492, 11866493, 11866494, 11866495, 11866496, 11866497, 11866498, 11866499, 11866500, 11866501, 11866502, 11866503, 11866504, 11866505, 11866506, 11986357, 11986358, 12039293, 12039294, 12105265, 12125556, 12125557, 13503875, 13503876, 13503877, 13503878, 13503879, 13503880, 13503881, 13503882, 13503883, 13503884, 13503885], "trace_timestamp_s": 433.3020000000006, "ttft_s": 20.283715798985213, "turn_id": 1} +{"actual_output_tokens": 127, "cached_tokens": 0, "effective_input_length": 36301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36301, "latency_s": 10.585009246016853, "output_length": 127, "proxy_request_id": "1277428:5:1366630:559", "request_id": "1277428:5:1366630:559", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1277428", "t_dispatch_unix": 1779821137.3250096, "t_finish_unix": 1779821147.9100184, "t_first_token_unix": 1779821146.047616, "tpot_s": 0.014778594515981182, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983], "trace_timestamp_s": 450.3850000000002, "ttft_s": 8.72260457102675, "turn_id": 5} +{"actual_output_tokens": 330, "cached_tokens": 6656, "effective_input_length": 8845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8845, "latency_s": 5.8478379910229705, "output_length": 330, "proxy_request_id": "1368132:1:1368132:577", "request_id": "1368132:1:1368132:577", "request_type": "coder", "requested_output_tokens": 330, "session_id": "1368132", "t_dispatch_unix": 1779821142.8272595, "t_finish_unix": 1779821148.675098, "t_first_token_unix": 1779821143.1051953, "tpot_s": 0.016928614513689544, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13561809, 13561810, 13561811, 8518241, 13561812], "trace_timestamp_s": 455.8890000000001, "ttft_s": 0.27793420100351796, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7712, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7712, "latency_s": 0.6491538209957071, "output_length": 24, "proxy_request_id": "1369768:1:1369768:584", "request_id": "1369768:1:1369768:584", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1369768", "t_dispatch_unix": 1779821148.4284286, "t_finish_unix": 1779821149.0775821, "t_first_token_unix": 1779821148.965812, "tpot_s": 0.004848493521263742, "trace_hash_ids": [13550468, 13550469, 13550470, 13550471, 13562017, 13562018, 13562019, 13562020, 13562021, 13562022, 13562023, 13568764, 13568765, 13568766, 13576622, 13576623], "trace_timestamp_s": 461.4880000000003, "ttft_s": 0.5373824189882725, "turn_id": 1} +{"actual_output_tokens": 457, "cached_tokens": 24544, "effective_input_length": 59514, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59514, "latency_s": 17.635670476011, "output_length": 457, "proxy_request_id": "1313181:3:1364311:547", "request_id": "1313181:3:1364311:547", "request_type": "coder", "requested_output_tokens": 457, "session_id": "1313181", "t_dispatch_unix": 1779821131.8848088, "t_finish_unix": 1779821149.5204792, "t_first_token_unix": 1779821141.840149, "tpot_s": 0.016842165855275214, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13527469], "trace_timestamp_s": 442.174, "ttft_s": 9.955338242987636, "turn_id": 3} +{"actual_output_tokens": 232, "cached_tokens": 13296, "effective_input_length": 18160, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18160, "latency_s": 2.0559015219914727, "output_length": 232, "proxy_request_id": "1363943:3:1369535:582", "request_id": "1363943:3:1369535:582", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1363943", "t_dispatch_unix": 1779821147.6056087, "t_finish_unix": 1779821149.6615102, "t_first_token_unix": 1779821148.296102, "tpot_s": 0.005908890108243276, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13574495], "trace_timestamp_s": 460.66499999999996, "ttft_s": 0.6904918780201115, "turn_id": 3} +{"actual_output_tokens": 375, "cached_tokens": 49056, "effective_input_length": 49483, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49483, "latency_s": 10.19281499000499, "output_length": 375, "proxy_request_id": "1340278:2:1367225:564", "request_id": "1340278:2:1367225:564", "request_type": "coder", "requested_output_tokens": 375, "session_id": "1340278", "t_dispatch_unix": 1779821139.618649, "t_finish_unix": 1779821149.8114638, "t_first_token_unix": 1779821146.0524726, "tpot_s": 0.010050077513476615, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13553910, 13553911, 13553912, 13553913, 13553914, 13553915, 13553916, 13553917, 13553918, 13553919, 13553920, 13553921, 13553922, 13553923, 13553924, 13553925, 13553926, 13553927, 13553928, 13553929, 13553930, 13553931, 13553932, 13553933, 13553934, 13553935, 13553936, 13553937, 13553938, 13553939, 13553940, 13553941, 13553942, 13553943, 13553944, 13553945, 13553946, 13553947, 13553948, 13553949, 13553950, 13553951, 13553952, 13553953, 13553954, 13553955, 13553956, 13553957, 13553958, 13553959, 13553960, 13553961, 13553962, 13553963, 13553964, 13553965, 13553966, 13553967, 13553968, 13553969, 13553970, 13553971, 13553972, 13553973, 13553974, 13553975, 13553976, 13553977, 13553978, 13553979, 13553980, 13553981, 13553982, 13553983, 13553984], "trace_timestamp_s": 452.65300000000025, "ttft_s": 6.433821217971854, "turn_id": 2} +{"actual_output_tokens": 5, "cached_tokens": 49856, "effective_input_length": 50124, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50124, "latency_s": 0.22149262897437438, "output_length": 5, "proxy_request_id": "1340278:3:1368072:576", "request_id": "1340278:3:1368072:576", "request_type": "coder", "requested_output_tokens": 5, "session_id": "1340278", "t_dispatch_unix": 1779821149.8279986, "t_finish_unix": 1779821150.0494912, "t_first_token_unix": 1779821150.0284595, "tpot_s": 0.005150878758286126, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13561220, 13561221, 13561222, 13561223, 13561224, 13561225, 13561226, 13561227, 13561228, 13561229, 13561230, 13561231, 13561232, 13561233, 13561234, 13561235, 13561236, 13561237, 13561238, 13561239, 13561240, 13561241, 13561242, 13561243, 13561244, 13561245, 13561246, 13561247, 13561248, 13561249, 13561250, 13561251, 13561252, 13561253, 13561254, 13561255, 13561256, 13561257, 13561258, 13561259, 13561260, 13561261, 13561262, 13561263, 13561264, 13561265, 13561266, 13561267, 13561268, 13561269, 13561270, 13561271, 13561272, 13561273, 13561274, 13561275, 13561276, 13561277, 13561278, 13561279, 13561280, 13561281, 13561282, 13561283, 13561284, 13561285, 13561286, 13561287, 13561288, 13561289, 13561290, 13561291, 13561292, 13561293], "trace_timestamp_s": 455.64100000000053, "ttft_s": 0.20045840897364542, "turn_id": 3} +{"actual_output_tokens": 89, "cached_tokens": 0, "effective_input_length": 2381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2381, "latency_s": 0.5917234409716912, "output_length": 89, "proxy_request_id": "1370269:1:1370269:591", "request_id": "1370269:1:1370269:591", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1370269", "t_dispatch_unix": 1779821150.1622381, "t_finish_unix": 1779821150.753962, "t_first_token_unix": 1779821150.3124042, "tpot_s": 0.005014562704838516, "trace_hash_ids": [13582035, 13582036, 13582037, 13582038, 13582039], "trace_timestamp_s": 463.22400000000016, "ttft_s": 0.15016444196226075, "turn_id": 1} +{"actual_output_tokens": 7, "cached_tokens": 35376, "effective_input_length": 35413, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35413, "latency_s": 0.8764262339682318, "output_length": 7, "proxy_request_id": "1344773:13:1370257:589", "request_id": "1344773:13:1370257:589", "request_type": "coder", "requested_output_tokens": 7, "session_id": "1344773", "t_dispatch_unix": 1779821150.0957491, "t_finish_unix": 1779821150.9721751, "t_first_token_unix": 1779821150.8922415, "tpot_s": 0.01318130332704944, "trace_hash_ids": [557830, 557831, 12455087, 12455088, 12455089, 12455090, 12455091, 12455092, 12455093, 8661488, 12455094, 12455095, 12455096, 12455097, 13346642, 13346643, 13346644, 13346645, 13346646, 13346647, 13346648, 13346649, 13346650, 13346651, 13346652, 13346653, 13346654, 13346655, 13346656, 13346657, 13346658, 13346659, 13346660, 13346661, 13346662, 13346663, 13346664, 13346665, 13346666, 13346667, 13346668, 13346669, 13346670, 13346671, 13346672, 13346673, 13346674, 13346675, 13346676, 13346677, 13346678, 13346679, 13346680, 13346681, 13346682, 13346683, 13346684, 13346685, 13346686, 13346687, 13346688, 13346689, 13346690, 13346691, 13389568, 13425452, 13465008, 13545743, 13581991, 13581992], "trace_timestamp_s": 463.15700000000015, "ttft_s": 0.7964903920073994, "turn_id": 13} +{"actual_output_tokens": 14, "cached_tokens": 0, "effective_input_length": 11133, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11133, "latency_s": 1.139286171994172, "output_length": 14, "proxy_request_id": "1367424:2:1370211:588", "request_id": "1367424:2:1370211:588", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1367424", "t_dispatch_unix": 1779821149.9046423, "t_finish_unix": 1779821151.0439284, "t_first_token_unix": 1779821150.8221803, "tpot_s": 0.017036987692475893, "trace_hash_ids": [13550847, 13550848, 13555750, 13555751, 13555752, 13555753, 13566763, 13566764, 13566765, 13566766, 13566767, 13571939, 13571940, 13571941, 13571942, 13581578, 13581579, 13581580, 13581581, 13581582, 13581583, 13581584], "trace_timestamp_s": 462.96300000000065, "ttft_s": 0.9175371410092339, "turn_id": 2} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7710, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7710, "latency_s": 0.655443923023995, "output_length": 24, "proxy_request_id": "1370466:1:1370466:592", "request_id": "1370466:1:1370466:592", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1370466", "t_dispatch_unix": 1779821150.9517741, "t_finish_unix": 1779821151.607218, "t_first_token_unix": 1779821151.4949293, "tpot_s": 0.004869524260436226, "trace_hash_ids": [13584429, 13584430, 13584431, 13584432, 13584433, 13584434, 13584435, 13584436, 13584437, 13584438, 13584439, 13584440, 13584441, 13584442, 13584443, 13584444], "trace_timestamp_s": 464.0110000000004, "ttft_s": 0.5431539900018834, "turn_id": 1} +{"actual_output_tokens": 97, "cached_tokens": 42688, "effective_input_length": 42704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42704, "latency_s": 2.1754526649601758, "output_length": 97, "proxy_request_id": "1313181:4:1318843:342", "request_id": "1313181:4:1318843:342", "request_type": "coder", "requested_output_tokens": 97, "session_id": "1313181", "t_dispatch_unix": 1779821149.5296938, "t_finish_unix": 1779821151.7051468, "t_first_token_unix": 1779821149.634694, "tpot_s": 0.02156307272889535, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13103391], "trace_timestamp_s": 282.26900000000023, "ttft_s": 0.10499807598534971, "turn_id": 4} +{"actual_output_tokens": 42, "cached_tokens": 0, "effective_input_length": 23307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23307, "latency_s": 3.066511371987872, "output_length": 42, "proxy_request_id": "1366128:3:1369902:585", "request_id": "1366128:3:1369902:585", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1366128", "t_dispatch_unix": 1779821148.8932953, "t_finish_unix": 1779821151.9598067, "t_first_token_unix": 1779821151.5081651, "tpot_s": 0.011005935609829045, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13578302], "trace_timestamp_s": 461.9520000000002, "ttft_s": 2.6148683539940976, "turn_id": 3} +{"actual_output_tokens": 190, "cached_tokens": 6656, "effective_input_length": 122597, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 122597, "latency_s": 49.932246373035014, "output_length": 190, "proxy_request_id": "1356885:1:1356885:514", "request_id": "1356885:1:1356885:514", "request_type": "coder", "requested_output_tokens": 190, "session_id": "1356885", "t_dispatch_unix": 1779821103.172664, "t_finish_unix": 1779821153.1049101, "t_first_token_unix": 1779821150.9710023, "tpot_s": 0.011287872423294676, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250], "trace_timestamp_s": 416.1880000000001, "ttft_s": 47.79833637701813, "turn_id": 1} +{"actual_output_tokens": 51, "cached_tokens": 36416, "effective_input_length": 36583, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36583, "latency_s": 0.4656596750137396, "output_length": 51, "proxy_request_id": "1277428:6:1371101:593", "request_id": "1277428:6:1371101:593", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1277428", "t_dispatch_unix": 1779821152.982272, "t_finish_unix": 1779821153.447931, "t_first_token_unix": 1779821153.1289604, "tpot_s": 0.0063717251410707835, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983, 13590659], "trace_timestamp_s": 466.0430000000006, "ttft_s": 0.146685991960112, "turn_id": 6} +{"actual_output_tokens": 26, "cached_tokens": 21792, "effective_input_length": 29501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29501, "latency_s": 3.993698777980171, "output_length": 26, "proxy_request_id": "1368070:2:1370108:586", "request_id": "1368070:2:1370108:586", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1368070", "t_dispatch_unix": 1779821149.6088035, "t_finish_unix": 1779821153.602502, "t_first_token_unix": 1779821151.1155725, "tpot_s": 0.09946244992082938, "trace_hash_ids": [13580541, 13580542, 13580543, 13580544, 13580545, 13580546, 13580547, 13580548, 13580549, 13580550, 13580551, 13580552, 13580553, 13580554, 13580555, 13580556, 13580557, 13580558, 13580559, 13580560, 13580561, 13580562, 13580563, 13580564, 13580565, 13580566, 13580567, 13580568, 13580569, 13580570, 13580571, 13580572, 13580573, 13580574, 13580575, 13580576, 13580577, 13580578, 13580579, 13580580, 13580581, 13580582, 13580583, 13580584, 13580585, 13580586, 13580587, 13580588, 13580589, 13580590, 13580591, 13580592, 13580593, 13580594, 13580595, 13580596, 13580597, 13580598], "trace_timestamp_s": 462.65900000000056, "ttft_s": 1.5067674259771593, "turn_id": 2} +{"actual_output_tokens": 104, "cached_tokens": 58816, "effective_input_length": 64531, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64531, "latency_s": 4.150237118010409, "output_length": 104, "proxy_request_id": "1342634:2:1370263:590", "request_id": "1342634:2:1370263:590", "request_type": "coder", "requested_output_tokens": 104, "session_id": "1342634", "t_dispatch_unix": 1779821150.1364563, "t_finish_unix": 1779821154.2866936, "t_first_token_unix": 1779821153.4207673, "tpot_s": 0.008404068534095203, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 4565053, 4565054, 4565055, 127456, 127457, 127458, 127459, 4565056, 4565057, 61286, 4565058, 4565059, 4565060, 4565061, 4565062, 4565063, 4565064, 4565065, 4565066, 4565067, 4565068, 4565069, 4565070, 4565071, 4565072, 4565073, 4565074, 4565075, 4565076, 4565077, 4565078, 4565079, 4565080, 4565081, 4565082, 4565083, 4565084, 4565085, 4565086, 4565087, 4565088, 4565089, 13036298, 13036299, 13036300, 13036301, 13036302, 13036303, 13036304, 13036305, 13036306, 13036307, 13036308, 13036309, 13036310, 13036311, 13036312, 13036313, 13036314, 13036315, 13036316, 13036317, 13036318, 13036319, 13036320, 13036321, 13036322, 13036323, 13036324, 13036325, 13036326, 13036327, 13036328, 13036329, 13036330, 13036331, 13036332, 13036333, 13036334, 13036335, 13036336, 13036337, 13068093, 13326543, 13326544, 13326545, 13326546, 13326547, 13326548, 13326549, 13326550, 13326551, 13326552, 13326553, 13326554, 13326555, 13326556, 13326557, 13326558, 13326559, 13326560, 13326561, 13326562, 13326563, 13326564, 13326565, 13326566, 13326567, 13326568, 13326569, 13326570, 13582003, 13582004, 13582005, 13582006, 13582007, 13582008, 13582009, 13582010, 13582011, 13582012, 13582013], "trace_timestamp_s": 463.1940000000004, "ttft_s": 3.284308036963921, "turn_id": 2} +{"actual_output_tokens": 99, "cached_tokens": 0, "effective_input_length": 9399, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9399, "latency_s": 1.2352200570167042, "output_length": 99, "proxy_request_id": "1371337:1:1371337:597", "request_id": "1371337:1:1371337:597", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1371337", "t_dispatch_unix": 1779821153.821127, "t_finish_unix": 1779821155.0563471, "t_first_token_unix": 1779821154.5296586, "tpot_s": 0.005371591121989435, "trace_hash_ids": [13566840, 13566841, 13566842, 13566843, 13566844, 13566845, 13566846, 13566847, 13581073, 13592764, 13592765, 13592766, 13592767, 13592768, 13592769, 13592770, 13592771, 13592772, 13592773], "trace_timestamp_s": 466.8800000000001, "ttft_s": 0.7085296190343797, "turn_id": 1} +{"actual_output_tokens": 109, "cached_tokens": 26928, "effective_input_length": 32814, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32814, "latency_s": 2.2078340809675865, "output_length": 109, "proxy_request_id": "1367329:2:1371226:595", "request_id": "1367329:2:1371226:595", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1367329", "t_dispatch_unix": 1779821153.3913662, "t_finish_unix": 1779821155.5992, "t_first_token_unix": 1779821154.6828852, "tpot_s": 0.008481621194665355, "trace_hash_ids": [13554866, 13554867, 13554868, 13554869, 13554870, 13554871, 13554872, 13554873, 13554874, 13554875, 13554876, 13554877, 13554878, 13554879, 13554880, 13554881, 13554882, 13554883, 13554884, 13554885, 13554886, 13554887, 13554888, 13554889, 13554890, 13554891, 13554892, 13554893, 13554894, 13554895, 13554896, 13554897, 13554898, 13554899, 13554900, 13554901, 13554902, 13554903, 13554904, 13554905, 13554906, 13554907, 13554908, 13554909, 13554910, 13554911, 13554912, 13554913, 13554914, 13554915, 13554916, 13554917, 13580089, 13580090, 13580091, 13580092, 13580093, 13580094, 13580095, 13580096, 13591778, 13591779, 13591780, 13591781, 13591782], "trace_timestamp_s": 466.4480000000003, "ttft_s": 1.2915164969745092, "turn_id": 2} +{"actual_output_tokens": 512, "cached_tokens": 4096, "effective_input_length": 18301, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18301, "latency_s": 6.12104413396446, "output_length": 512, "proxy_request_id": "1370129:1:1370129:587", "request_id": "1370129:1:1370129:587", "request_type": "coder", "requested_output_tokens": 512, "session_id": "1370129", "t_dispatch_unix": 1779821149.680727, "t_finish_unix": 1779821155.8017714, "t_first_token_unix": 1779821151.23767, "tpot_s": 0.008930561984315107, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13580719], "trace_timestamp_s": 462.7390000000005, "ttft_s": 1.5569406779832207, "turn_id": 1} +{"actual_output_tokens": 131, "cached_tokens": 0, "effective_input_length": 13616, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13616, "latency_s": 1.8971093079890124, "output_length": 131, "proxy_request_id": "1371622:1:1371622:598", "request_id": "1371622:1:1371622:598", "request_type": "coder", "requested_output_tokens": 131, "session_id": "1371622", "t_dispatch_unix": 1779821154.8235326, "t_finish_unix": 1779821156.7206419, "t_first_token_unix": 1779821155.989625, "tpot_s": 0.005620991415344179, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 13595701], "trace_timestamp_s": 467.8850000000002, "ttft_s": 1.1660907469922677, "turn_id": 1} +{"actual_output_tokens": 88, "cached_tokens": 18384, "effective_input_length": 18396, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18396, "latency_s": 0.5515216370113194, "output_length": 88, "proxy_request_id": "1363943:4:1372250:603", "request_id": "1363943:4:1372250:603", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1363943", "t_dispatch_unix": 1779821157.1675196, "t_finish_unix": 1779821157.7190413, "t_first_token_unix": 1779821157.2158668, "tpot_s": 0.005779902436690213, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124], "trace_timestamp_s": 470.22900000000027, "ttft_s": 0.04834557499270886, "turn_id": 4} +{"actual_output_tokens": 42, "cached_tokens": 23344, "effective_input_length": 35037, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35037, "latency_s": 2.9950241740443744, "output_length": 42, "proxy_request_id": "1366128:4:1371629:599", "request_id": "1366128:4:1371629:599", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1366128", "t_dispatch_unix": 1779821154.8434787, "t_finish_unix": 1779821157.8385026, "t_first_token_unix": 1779821157.3767223, "tpot_s": 0.01125384760997826, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13595748], "trace_timestamp_s": 467.90000000000055, "ttft_s": 2.533241741009988, "turn_id": 4} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 17407, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17407, "latency_s": 2.1580814869957976, "output_length": 82, "proxy_request_id": "1371929:1:1371929:601", "request_id": "1371929:1:1371929:601", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1371929", "t_dispatch_unix": 1779821155.9302845, "t_finish_unix": 1779821158.0883656, "t_first_token_unix": 1779821157.6299691, "tpot_s": 0.005656203987324081, "trace_hash_ids": [13547800, 13547801, 13547802, 13547803, 13547804, 13547805, 13547806, 13558211, 13558212, 13558213, 13558214, 13558215, 13558216, 13558217, 13558218, 13558219, 13558220, 13558221, 13558222, 13558223, 13558224, 13558225, 13558226, 13566670, 13566671, 13566672, 13566673, 13566674, 13566675, 13576731, 13576732, 13590638, 13599021, 13599022], "trace_timestamp_s": 468.9850000000006, "ttft_s": 1.69968337303726, "turn_id": 1} +{"actual_output_tokens": 36, "cached_tokens": 0, "effective_input_length": 4811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4811, "latency_s": 0.481737926020287, "output_length": 36, "proxy_request_id": "1372791:1:1372791:604", "request_id": "1372791:1:1372791:604", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1372791", "t_dispatch_unix": 1779821158.9411006, "t_finish_unix": 1779821159.4228384, "t_first_token_unix": 1779821159.2464812, "tpot_s": 0.005030263029038906, "trace_hash_ids": [13606288, 13606289, 13606290, 13606291, 13606292, 13606293, 13606294, 13606295, 13606296, 13606297], "trace_timestamp_s": 471.9970000000003, "ttft_s": 0.30537967098644003, "turn_id": 1} +{"actual_output_tokens": 21, "cached_tokens": 0, "effective_input_length": 10284, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10284, "latency_s": 0.9001762519474141, "output_length": 21, "proxy_request_id": "1362265:3:1373357:605", "request_id": "1362265:3:1373357:605", "request_type": "coder", "requested_output_tokens": 21, "session_id": "1362265", "t_dispatch_unix": 1779821160.93827, "t_finish_unix": 1779821161.8384464, "t_first_token_unix": 1779821161.7384865, "tpot_s": 0.0049350524524925275, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13610624], "trace_timestamp_s": 474.0, "ttft_s": 0.8002144039492123, "turn_id": 3} +{"actual_output_tokens": 82, "cached_tokens": 0, "effective_input_length": 72919, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72919, "latency_s": 19.74341676698532, "output_length": 82, "proxy_request_id": "1367957:1:1367957:572", "request_id": "1367957:1:1367957:572", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1367957", "t_dispatch_unix": 1779821142.137923, "t_finish_unix": 1779821161.8813396, "t_first_token_unix": 1779821160.586966, "tpot_s": 0.015975921148187078, "trace_hash_ids": [987, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023, 13560201, 5631592, 280979, 5631593, 1028, 1029, 1030, 1031, 1032, 1033, 1034, 1035, 1036, 1037, 1038, 1039, 1040, 1041, 1042, 1043, 1044, 1045, 1046, 1047, 1048, 1049, 5631594, 5631595, 5631596, 5631597, 5631598, 5631599, 706016, 706017, 1656985, 1656986, 1656987, 1656988, 1656989, 5631600, 10791724, 10856701, 11045334, 11180683, 11180684, 11180685, 11180686, 11180687, 11180688, 11180689, 11180690, 11180691, 11180692, 11180693, 11180694, 11395208, 11395209, 11395210, 11395211, 11395212, 11395213, 11395214, 11395215, 11395216, 11395217, 11395218, 11395219, 11416612, 11498725, 11563787, 11669770, 11900719, 11900720, 11900721, 11900722, 11900723, 11900724, 11900725, 11900726, 11900727, 11900728, 11900729, 11900730, 11900731, 12056875, 12056876, 12056877, 12056878, 12719496, 12719497, 12719498, 12719499, 12719500, 12719501, 12752184, 12786713, 12836975, 12926110, 12926111, 12926112, 12955719, 13336475, 13382319, 13469603, 13469604, 13560202], "trace_timestamp_s": 455.1790000000001, "ttft_s": 18.449039451021235, "turn_id": 1} +{"actual_output_tokens": 92, "cached_tokens": 20080, "effective_input_length": 20158, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20158, "latency_s": 13.79873681400204, "output_length": 92, "proxy_request_id": "1355484:6:1369697:583", "request_id": "1355484:6:1369697:583", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1355484", "t_dispatch_unix": 1779821148.206167, "t_finish_unix": 1779821162.0049033, "t_first_token_unix": 1779821160.5757337, "tpot_s": 0.01567727729683271, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13576108], "trace_timestamp_s": 461.26800000000003, "ttft_s": 12.369564672000706, "turn_id": 6} +{"actual_output_tokens": 520, "cached_tokens": 36624, "effective_input_length": 38252, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38252, "latency_s": 7.062048731022514, "output_length": 520, "proxy_request_id": "1277428:7:1372183:602", "request_id": "1277428:7:1372183:602", "request_type": "coder", "requested_output_tokens": 520, "session_id": "1277428", "t_dispatch_unix": 1779821156.895305, "t_finish_unix": 1779821163.9573538, "t_first_token_unix": 1779821159.1954684, "tpot_s": 0.009174470136772934, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 12713184, 12713185, 12988388, 12988389, 12988390, 12988391, 12988392, 12988393, 12988394, 12988395, 13037512, 13126540, 13126541, 13126542, 13126543, 13547979, 13547980, 13547981, 13547982, 13547983, 13601623, 13601624, 13601625, 13601626], "trace_timestamp_s": 469.9549999999999, "ttft_s": 2.300161160004791, "turn_id": 7} +{"actual_output_tokens": 288, "cached_tokens": 20240, "effective_input_length": 22992, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22992, "latency_s": 4.04078554303851, "output_length": 288, "proxy_request_id": "1355484:7:1371284:596", "request_id": "1355484:7:1371284:596", "request_type": "coder", "requested_output_tokens": 288, "session_id": "1355484", "t_dispatch_unix": 1779821162.006755, "t_finish_unix": 1779821166.0475407, "t_first_token_unix": 1779821162.5699031, "tpot_s": 0.012116104191597487, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13592323], "trace_timestamp_s": 466.6750000000002, "ttft_s": 0.5631452920497395, "turn_id": 7} +{"actual_output_tokens": 33, "cached_tokens": 35072, "effective_input_length": 46764, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46764, "latency_s": 3.6828296330058947, "output_length": 33, "proxy_request_id": "1366128:5:1373829:610", "request_id": "1366128:5:1373829:610", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1366128", "t_dispatch_unix": 1779821162.654192, "t_finish_unix": 1779821166.337021, "t_first_token_unix": 1779821165.9713898, "tpot_s": 0.011413957030526944, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13614741], "trace_timestamp_s": 475.71100000000024, "ttft_s": 3.317195729003288, "turn_id": 5} +{"actual_output_tokens": 956, "cached_tokens": 0, "effective_input_length": 26705, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26705, "latency_s": 11.333356234012172, "output_length": 956, "proxy_request_id": "1364090:2:1371798:600", "request_id": "1364090:2:1371798:600", "request_type": "coder", "requested_output_tokens": 956, "session_id": "1364090", "t_dispatch_unix": 1779821155.4647045, "t_finish_unix": 1779821166.7980602, "t_first_token_unix": 1779821159.190694, "tpot_s": 0.007965517112088063, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13597497], "trace_timestamp_s": 468.52000000000044, "ttft_s": 3.725987745972816, "turn_id": 2} +{"actual_output_tokens": 65, "cached_tokens": 0, "effective_input_length": 19862, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19862, "latency_s": 3.0303203759831376, "output_length": 65, "proxy_request_id": "1374347:1:1374347:611", "request_id": "1374347:1:1374347:611", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1374347", "t_dispatch_unix": 1779821164.4454606, "t_finish_unix": 1779821167.4757807, "t_first_token_unix": 1779821166.5185208, "tpot_s": 0.014952133453334682, "trace_hash_ids": [13586651, 13586652, 13586653, 13586654, 13586655, 13586656, 13586657, 13586658, 13586659, 13586660, 13586661, 13586662, 13586663, 13586664, 13586665, 13586666, 13586667, 13586668, 13586669, 13586670, 13586671, 13598853, 13598854, 13598855, 13598856, 13598857, 13598858, 13598859, 13598860, 13608483, 13608484, 13608485, 13608486, 13608487, 13619670, 13619671, 13619672, 13619673, 13619674], "trace_timestamp_s": 477.5, "ttft_s": 2.0730586900026537, "turn_id": 1} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 18497, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18497, "latency_s": 3.591740090982057, "output_length": 38, "proxy_request_id": "1374465:1:1374465:613", "request_id": "1374465:1:1374465:613", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1374465", "t_dispatch_unix": 1779821164.887083, "t_finish_unix": 1779821168.478823, "t_first_token_unix": 1779821167.9339142, "tpot_s": 0.014715107027252481, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867], "trace_timestamp_s": 477.942, "ttft_s": 3.046829530969262, "turn_id": 1} +{"actual_output_tokens": 821, "cached_tokens": 42800, "effective_input_length": 60004, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60004, "latency_s": 18.58727917500073, "output_length": 821, "proxy_request_id": "1313181:4:1368020:573", "request_id": "1313181:4:1368020:573", "request_type": "coder", "requested_output_tokens": 821, "session_id": "1313181", "t_dispatch_unix": 1779821151.708445, "t_finish_unix": 1779821170.295713, "t_first_token_unix": 1779821157.561624, "tpot_s": 0.015528915381689396, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13560946], "trace_timestamp_s": 455.47700000000077, "ttft_s": 5.853187419997994, "turn_id": 4} +{"actual_output_tokens": 206, "cached_tokens": 37280, "effective_input_length": 41508, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41508, "latency_s": 5.529218659969047, "output_length": 206, "proxy_request_id": "1268861:7:1374579:614", "request_id": "1268861:7:1374579:614", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1268861", "t_dispatch_unix": 1779821165.3500628, "t_finish_unix": 1779821170.879281, "t_first_token_unix": 1779821167.9407756, "tpot_s": 0.014332586219363914, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13621774], "trace_timestamp_s": 478.40900000000056, "ttft_s": 2.59071054297965, "turn_id": 7} +{"actual_output_tokens": 614, "cached_tokens": 0, "effective_input_length": 117888, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117888, "latency_s": 55.848558489000425, "output_length": 614, "proxy_request_id": "1360649:1:1360649:527", "request_id": "1360649:1:1360649:527", "request_type": "coder", "requested_output_tokens": 614, "session_id": "1360649", "t_dispatch_unix": 1779821116.4439712, "t_finish_unix": 1779821172.2925293, "t_first_token_unix": 1779821161.2633727, "tpot_s": 0.017991676571004877, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 102342, 102343, 102344, 102345, 102346, 102347, 102348, 102349, 102350, 102351, 1097540, 1097541, 1097542, 1097543, 1097544, 1097545, 1097546, 1097547, 1097548, 1097549, 1097550, 1097551, 1097552, 2097078, 2097079, 2097080, 6400718, 6400719, 6400720, 6400721, 6400722, 6400723, 6400724, 6400725, 6400726, 6400727, 6400728, 6400729, 6400730, 6400731, 6400732, 6400733, 6400734, 6400735, 6400736, 6400737, 6400738, 6400739, 6400740, 6400741, 6400742, 6400743, 6400744, 6400745, 6400746, 6400747, 6400748, 6400749, 6400750, 6400751, 6400752, 6400753, 6400754, 6400755, 6400756, 6400757, 8009133, 8009134, 8009135, 8009136, 8009137, 8009138, 8009139, 8009140, 8009141, 8009142, 8009143, 8009144, 8009145, 8009146, 8009147, 8009148, 8009149, 8009150, 8009151, 8348761, 8348762, 9534642, 9534643, 9534644, 9534645, 9534646, 9534647, 9534648, 9534649, 9534650, 9534651, 9534652, 9534653, 9534654, 9868654, 9868655, 9868656, 10214275, 10214276, 10214277, 10237087, 10237088, 10237089, 10271265, 10271266, 10765786, 10765787, 10765788, 10765789, 10765790, 10765791, 10765792, 10795530, 10795531, 10795532, 10876221, 10876222, 10876223, 11181494, 11232572, 11232573, 11277307, 11277308, 11298127, 11298128, 11298129, 11490882, 11490883, 11490884, 11490885, 12220320, 12220321, 12220322, 12220323, 12220324, 12220325, 12220326, 12220327, 12241076, 12241077, 12241078, 12241079, 12241080, 12241081, 12703418, 12703419, 12703420, 12703421, 12703422, 12703423, 12703424, 12703425, 12703426, 12703427, 12703428, 12703429, 12773085, 12833183, 12857953, 12905536, 12905537, 12905538, 12948771, 12948772, 13065333, 13065334, 13102786, 13102787, 13102788, 13102789, 13121628, 13174865, 13174866, 13240785, 13240786, 13240787, 13311934, 13311935, 13311936, 13468170, 13468171, 13493539, 13493540, 13493541, 13493542, 13493543, 13493544, 13493545, 13493546, 13493547, 13493548, 13493549, 13493550, 13493551, 13493552, 13493553, 13493554, 13493555, 13493556, 13493557, 13493558, 13493559, 13493560, 13493561, 13493562, 13493563, 13493564, 13493565, 13493566, 13493567, 13493568, 13493569, 13493570, 13493571, 13493572, 13493573, 13493574], "trace_timestamp_s": 429.46200000000044, "ttft_s": 44.81939911498921, "turn_id": 1} +{"actual_output_tokens": 56, "cached_tokens": 18528, "effective_input_length": 21588, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21588, "latency_s": 1.6917958850390278, "output_length": 56, "proxy_request_id": "1374465:2:1376358:620", "request_id": "1374465:2:1376358:620", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1374465", "t_dispatch_unix": 1779821171.288719, "t_finish_unix": 1779821172.9805145, "t_first_token_unix": 1779821171.8916233, "tpot_s": 0.019791797164361923, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867, 13637304, 5578065, 5578066, 5578067, 5578068, 5578069], "trace_timestamp_s": 484.35000000000036, "ttft_s": 0.602902606013231, "turn_id": 2} +{"actual_output_tokens": 212, "cached_tokens": 46784, "effective_input_length": 58511, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58511, "latency_s": 6.843339754967019, "output_length": 212, "proxy_request_id": "1366128:6:1375094:616", "request_id": "1366128:6:1375094:616", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1366128", "t_dispatch_unix": 1779821167.148777, "t_finish_unix": 1779821173.9921162, "t_first_token_unix": 1779821171.2477705, "tpot_s": 0.013004769284225188, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13626307], "trace_timestamp_s": 480.20400000000063, "ttft_s": 4.098991894978099, "turn_id": 6} +{"actual_output_tokens": 120, "cached_tokens": 118496, "effective_input_length": 119052, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119052, "latency_s": 1.9384930520318449, "output_length": 120, "proxy_request_id": "1360649:2:1367022:561", "request_id": "1360649:2:1367022:561", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1360649", "t_dispatch_unix": 1779821172.3049653, "t_finish_unix": 1779821174.2434583, "t_first_token_unix": 1779821172.9493747, "tpot_s": 0.010872687319266227, "trace_hash_ids": [57650, 57651, 63986, 63987, 63988, 63989, 63990, 63991, 102342, 102343, 102344, 102345, 102346, 102347, 102348, 102349, 102350, 102351, 1097540, 1097541, 1097542, 1097543, 1097544, 1097545, 1097546, 1097547, 1097548, 1097549, 1097550, 1097551, 1097552, 2097078, 2097079, 2097080, 6400718, 6400719, 6400720, 6400721, 6400722, 6400723, 6400724, 6400725, 6400726, 6400727, 6400728, 6400729, 6400730, 6400731, 6400732, 6400733, 6400734, 6400735, 6400736, 6400737, 6400738, 6400739, 6400740, 6400741, 6400742, 6400743, 6400744, 6400745, 6400746, 6400747, 6400748, 6400749, 6400750, 6400751, 6400752, 6400753, 6400754, 6400755, 6400756, 6400757, 8009133, 8009134, 8009135, 8009136, 8009137, 8009138, 8009139, 8009140, 8009141, 8009142, 8009143, 8009144, 8009145, 8009146, 8009147, 8009148, 8009149, 8009150, 8009151, 8348761, 8348762, 9534642, 9534643, 9534644, 9534645, 9534646, 9534647, 9534648, 9534649, 9534650, 9534651, 9534652, 9534653, 9534654, 9868654, 9868655, 9868656, 10214275, 10214276, 10214277, 10237087, 10237088, 10237089, 10271265, 10271266, 10765786, 10765787, 10765788, 10765789, 10765790, 10765791, 10765792, 10795530, 10795531, 10795532, 10876221, 10876222, 10876223, 11181494, 11232572, 11232573, 11277307, 11277308, 11298127, 11298128, 11298129, 11490882, 11490883, 11490884, 11490885, 12220320, 12220321, 12220322, 12220323, 12220324, 12220325, 12220326, 12220327, 12241076, 12241077, 12241078, 12241079, 12241080, 12241081, 12703418, 12703419, 12703420, 12703421, 12703422, 12703423, 12703424, 12703425, 12703426, 12703427, 12703428, 12703429, 12773085, 12833183, 12857953, 12905536, 12905537, 12905538, 12948771, 12948772, 13065333, 13065334, 13102786, 13102787, 13102788, 13102789, 13121628, 13174865, 13174866, 13240785, 13240786, 13240787, 13311934, 13311935, 13311936, 13468170, 13468171, 13493539, 13551893, 13551894, 13551895, 13551896, 13551897, 13551898, 13551899, 13551900, 13551901, 13551902, 13551903, 13551904, 13551905, 13551906, 13551907, 13551908, 13551909, 13551910, 13551911, 13551912, 13551913, 13551914, 13551915, 13551916, 13551917, 13551918, 13551919, 13551920, 13551921, 13551922, 13551923, 13551924, 13551925, 13551926, 13551927, 13551928, 13551929], "trace_timestamp_s": 451.77600000000075, "ttft_s": 0.6444067180273123, "turn_id": 2} +{"actual_output_tokens": 98, "cached_tokens": 9488, "effective_input_length": 24323, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24323, "latency_s": 2.7079686200013384, "output_length": 98, "proxy_request_id": "1371337:2:1376534:621", "request_id": "1371337:2:1376534:621", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1371337", "t_dispatch_unix": 1779821171.9538286, "t_finish_unix": 1779821174.6617973, "t_first_token_unix": 1779821174.0775192, "tpot_s": 0.0060204983918121105, "trace_hash_ids": [13566840, 13566841, 13566842, 13566843, 13566844, 13566845, 13566846, 13566847, 13581073, 13592764, 13592765, 13592766, 13592767, 13592768, 13592769, 13592770, 13592771, 13592772, 13602976, 13602977, 13602978, 13602979, 13602980, 13602981, 13602982, 13602983, 13602984, 13611256, 13611257, 13611258, 13611259, 13611260, 13611261, 13611262, 13621634, 13621635, 13621636, 13621637, 13621638, 13621639, 13621640, 13630722, 13630723, 13630724, 13639093, 13639094, 13639095, 13639096], "trace_timestamp_s": 485.0100000000002, "ttft_s": 2.12368834100198, "turn_id": 2} +{"actual_output_tokens": 28, "cached_tokens": 0, "effective_input_length": 16241, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16241, "latency_s": 1.7571704790461808, "output_length": 28, "proxy_request_id": "1377061:1:1377061:622", "request_id": "1377061:1:1377061:622", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1377061", "t_dispatch_unix": 1779821173.9167671, "t_finish_unix": 1779821175.6739376, "t_first_token_unix": 1779821175.4291577, "tpot_s": 0.009045806407273092, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13643801], "trace_timestamp_s": 486.97299999999996, "ttft_s": 1.5123878640006296, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 19200, "effective_input_length": 38041, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38041, "latency_s": 7.591292641998734, "output_length": 55, "proxy_request_id": "1355951:3:1375866:619", "request_id": "1355951:3:1375866:619", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1355951", "t_dispatch_unix": 1779821169.828154, "t_finish_unix": 1779821177.4194462, "t_first_token_unix": 1779821176.5785794, "tpot_s": 0.015562989388989215, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 482.8890000000001, "ttft_s": 6.750423072022386, "turn_id": 3} +{"actual_output_tokens": 37, "cached_tokens": 0, "effective_input_length": 14851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14851, "latency_s": 1.5113196260062978, "output_length": 37, "proxy_request_id": "1372791:2:1377698:624", "request_id": "1372791:2:1377698:624", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1372791", "t_dispatch_unix": 1779821176.1565695, "t_finish_unix": 1779821177.6678889, "t_first_token_unix": 1779821177.4768288, "tpot_s": 0.005301716999383643, "trace_hash_ids": [13606288, 13606289, 13606290, 13606291, 13606292, 13606293, 13606294, 13606295, 13606296, 13634971, 13634972, 13634973, 13634974, 13634975, 13634976, 13634977, 13642781, 13642782, 13642783, 13642784, 13642785, 13642786, 13650522, 13650523, 13650524, 13650525, 13650526, 13650527, 13650528, 13650529], "trace_timestamp_s": 489.21500000000015, "ttft_s": 1.32025785301812, "turn_id": 2} +{"actual_output_tokens": 567, "cached_tokens": 0, "effective_input_length": 56286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56286, "latency_s": 17.500275900994893, "output_length": 567, "proxy_request_id": "1370129:2:1373467:607", "request_id": "1370129:2:1373467:607", "request_type": "coder", "requested_output_tokens": 567, "session_id": "1370129", "t_dispatch_unix": 1779821161.4126532, "t_finish_unix": 1779821178.9129293, "t_first_token_unix": 1779821172.902689, "tpot_s": 0.010618144683823707, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500], "trace_timestamp_s": 474.45900000000074, "ttft_s": 11.490033226960804, "turn_id": 2} +{"actual_output_tokens": 99, "cached_tokens": 58720, "effective_input_length": 59007, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59007, "latency_s": 1.5440234699635766, "output_length": 99, "proxy_request_id": "1366128:7:1378071:626", "request_id": "1366128:7:1378071:626", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1366128", "t_dispatch_unix": 1779821177.402999, "t_finish_unix": 1779821178.9470224, "t_first_token_unix": 1779821177.697198, "tpot_s": 0.012749229030379531, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13653793], "trace_timestamp_s": 490.46300000000065, "ttft_s": 0.29419665201567113, "turn_id": 7} +{"actual_output_tokens": 15, "cached_tokens": 16256, "effective_input_length": 16515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16515, "latency_s": 0.3564442280330695, "output_length": 15, "proxy_request_id": "1377061:2:1378590:631", "request_id": "1377061:2:1378590:631", "request_type": "coder", "requested_output_tokens": 15, "session_id": "1377061", "t_dispatch_unix": 1779821179.1867886, "t_finish_unix": 1779821179.5432324, "t_first_token_unix": 1779821179.4603524, "tpot_s": 0.005891575640167243, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13658414, 13658415], "trace_timestamp_s": 492.2480000000005, "ttft_s": 0.2735621430329047, "turn_id": 2} +{"actual_output_tokens": 52, "cached_tokens": 0, "effective_input_length": 7810, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7810, "latency_s": 0.8090397859923542, "output_length": 52, "proxy_request_id": "1378684:1:1378684:632", "request_id": "1378684:1:1378684:632", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1378684", "t_dispatch_unix": 1779821179.5238254, "t_finish_unix": 1779821180.3328652, "t_first_token_unix": 1779821180.0705645, "tpot_s": 0.005138470275400609, "trace_hash_ids": [13630792, 13630793, 13630794, 13630795, 13645188, 13645189, 13645190, 13645191, 13659421, 13659422, 13659423, 13659424, 13659425, 13659426, 13659427, 13659428], "trace_timestamp_s": 492.58300000000054, "ttft_s": 0.5467375119915232, "turn_id": 1} +{"actual_output_tokens": 206, "cached_tokens": 0, "effective_input_length": 5458, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5458, "latency_s": 1.495167009998113, "output_length": 206, "proxy_request_id": "1378543:1:1378543:630", "request_id": "1378543:1:1378543:630", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1378543", "t_dispatch_unix": 1779821179.0340767, "t_finish_unix": 1779821180.5292437, "t_first_token_unix": 1779821179.3920236, "tpot_s": 0.005546406751339573, "trace_hash_ids": [13642933, 13642934, 13642935, 13642936, 13652140, 13652141, 13657982, 13657983, 13657984, 13657985, 13657986], "trace_timestamp_s": 492.09200000000055, "ttft_s": 0.3579448039527051, "turn_id": 1} +{"actual_output_tokens": 5258, "cached_tokens": 78496, "effective_input_length": 80246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80246, "latency_s": 70.62544979102677, "output_length": 5258, "proxy_request_id": "1269373:22:1358956:522", "request_id": "1269373:22:1358956:522", "request_type": "coder", "requested_output_tokens": 5258, "session_id": "1269373", "t_dispatch_unix": 1779821110.3340702, "t_finish_unix": 1779821180.9595199, "t_first_token_unix": 1779821111.3628168, "tpot_s": 0.013238813757845667, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 12579854, 12579855, 12579856, 12632632, 12632633, 12655306, 12712206, 12712207, 12712208, 12712209, 12712210, 12745665, 12745666, 12745667, 12745668, 12745669, 12745670, 12745671, 12745672, 12745673, 12745674, 12745675, 12745676, 12745677, 12745678, 12745679, 12745680, 12745681, 12745682, 12745683, 12745684, 12745685, 12745686, 12745687, 12745688, 12745689, 12745690, 12792377, 12792378, 12792379, 12792380, 12792381, 12792382, 12792383, 12792384, 12792385, 12792386, 12792387, 12792388, 12792389, 12792390, 12792391, 12792392, 12835832, 12835833, 12835834, 12835835, 12835836, 12835837, 12835838, 12835839, 12884614, 12884615, 12884616, 12884617, 12884618, 12884619, 12884620, 12884621, 12884622, 12884623, 12884624, 12884625, 12884626, 12884627, 12884628, 12884629, 12937621, 12937622, 12937623, 12937624, 12937625, 12937626, 12937627, 12975429, 12975430, 12975431, 12975432, 12975433, 12975434, 12975435, 12975436, 12975437, 12998343, 13048668, 13048669, 13048670, 13048671, 13048672, 13048673, 13091415, 13091416, 13091417, 13091418, 13091419, 13091420, 13091421, 13129269, 13169183, 13169184, 13169185, 13169186, 13169187, 13227514, 13227515, 13227516, 13227517, 13227518, 13284366, 13284367, 13353637, 13353638, 13388482, 13388483, 13388484, 13388485, 13388486, 13420383, 13420384, 13420385, 13476943, 13476944, 13476945, 13476946, 13476947], "trace_timestamp_s": 423.39200000000073, "ttft_s": 1.0287438569939695, "turn_id": 22} +{"actual_output_tokens": 228, "cached_tokens": 0, "effective_input_length": 23457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23457, "latency_s": 4.027412505005486, "output_length": 228, "proxy_request_id": "1355484:8:1377993:625", "request_id": "1355484:8:1377993:625", "request_type": "coder", "requested_output_tokens": 228, "session_id": "1355484", "t_dispatch_unix": 1779821177.136544, "t_finish_unix": 1779821181.1639564, "t_first_token_unix": 1779821179.7678664, "tpot_s": 0.006148181273089106, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13653201], "trace_timestamp_s": 490.1980000000003, "ttft_s": 2.631320111977402, "turn_id": 8} +{"actual_output_tokens": 38, "cached_tokens": 0, "effective_input_length": 1422, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1422, "latency_s": 0.2800081199966371, "output_length": 38, "proxy_request_id": "1379185:1:1379185:634", "request_id": "1379185:1:1379185:634", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1379185", "t_dispatch_unix": 1779821181.243519, "t_finish_unix": 1779821181.5235271, "t_first_token_unix": 1779821181.342621, "tpot_s": 0.004880905837273678, "trace_hash_ids": [13664231, 13664232, 13664233], "trace_timestamp_s": 494.3050000000003, "ttft_s": 0.0991007870179601, "turn_id": 1} +{"actual_output_tokens": 87, "cached_tokens": 0, "effective_input_length": 2632, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2632, "latency_s": 0.6850307889981195, "output_length": 87, "proxy_request_id": "1379569:1:1379569:638", "request_id": "1379569:1:1379569:638", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1379569", "t_dispatch_unix": 1779821182.4729655, "t_finish_unix": 1779821183.1579962, "t_first_token_unix": 1779821182.6678462, "tpot_s": 0.005696654267647022, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13667379], "trace_timestamp_s": 495.53400000000056, "ttft_s": 0.19487938901875168, "turn_id": 1} +{"actual_output_tokens": 131, "cached_tokens": 23680, "effective_input_length": 23717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23717, "latency_s": 0.8713521880563349, "output_length": 131, "proxy_request_id": "1355484:9:1379722:640", "request_id": "1355484:9:1379722:640", "request_type": "coder", "requested_output_tokens": 131, "session_id": "1355484", "t_dispatch_unix": 1779821182.9852314, "t_finish_unix": 1779821183.8565834, "t_first_token_unix": 1779821183.0457263, "tpot_s": 0.0062353724461550325, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13668401], "trace_timestamp_s": 496.0470000000005, "ttft_s": 0.06049309601075947, "turn_id": 9} +{"actual_output_tokens": 20, "cached_tokens": 16528, "effective_input_length": 17368, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17368, "latency_s": 0.37987060099840164, "output_length": 20, "proxy_request_id": "1377061:3:1380174:641", "request_id": "1377061:3:1380174:641", "request_type": "coder", "requested_output_tokens": 20, "session_id": "1377061", "t_dispatch_unix": 1779821184.5925264, "t_finish_unix": 1779821184.972397, "t_first_token_unix": 1779821184.795987, "tpot_s": 0.009269934211931142, "trace_hash_ids": [13622967, 13622968, 13622969, 13622970, 13622971, 13622972, 13622973, 13622974, 13622975, 13622976, 13622977, 13622978, 13622979, 13622980, 13622981, 13622982, 13622983, 13622984, 13622985, 13622986, 13622987, 13622988, 13622989, 13622990, 13633616, 13633617, 13633618, 13633619, 13643798, 13643799, 13643800, 13658414, 13666839, 13672311], "trace_timestamp_s": 497.65400000000045, "ttft_s": 0.2034589439863339, "turn_id": 3} +{"actual_output_tokens": 2, "cached_tokens": 5312, "effective_input_length": 5314, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5314, "latency_s": 0.03779356996528804, "output_length": 2, "proxy_request_id": "1378543:2:1380447:644", "request_id": "1378543:2:1380447:644", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1378543", "t_dispatch_unix": 1779821185.5114858, "t_finish_unix": 1779821185.5492792, "t_first_token_unix": 1779821185.5435085, "tpot_s": 0.005505406006705016, "trace_hash_ids": [13674795, 13674796, 13674797, 13674798, 13674799, 13674800, 13674801, 13674802, 13674803, 13674804, 13674805], "trace_timestamp_s": 498.5710000000008, "ttft_s": 0.03202182397944853, "turn_id": 2} +{"actual_output_tokens": 82, "cached_tokens": 59104, "effective_input_length": 59230, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59230, "latency_s": 0.7947149510146119, "output_length": 82, "proxy_request_id": "1366128:8:1380438:643", "request_id": "1366128:8:1380438:643", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1366128", "t_dispatch_unix": 1779821185.465367, "t_finish_unix": 1779821186.260082, "t_first_token_unix": 1779821185.64741, "tpot_s": 0.007560072296419767, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13674751], "trace_timestamp_s": 498.52500000000055, "ttft_s": 0.1820401800214313, "turn_id": 8} +{"actual_output_tokens": 117, "cached_tokens": 2704, "effective_input_length": 6767, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6767, "latency_s": 0.9301884309970774, "output_length": 117, "proxy_request_id": "1379569:2:1380473:645", "request_id": "1379569:2:1380473:645", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1379569", "t_dispatch_unix": 1779821185.6573741, "t_finish_unix": 1779821186.5875628, "t_first_token_unix": 1779821185.976933, "tpot_s": 0.005261440094508198, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13674978], "trace_timestamp_s": 498.71800000000076, "ttft_s": 0.3195574179990217, "turn_id": 2} +{"actual_output_tokens": 99, "cached_tokens": 21632, "effective_input_length": 30907, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30907, "latency_s": 2.6859964089817367, "output_length": 99, "proxy_request_id": "1374465:3:1380413:642", "request_id": "1374465:3:1380413:642", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1374465", "t_dispatch_unix": 1779821185.3841236, "t_finish_unix": 1779821188.0701199, "t_first_token_unix": 1779821187.2681055, "tpot_s": 0.00817995205074929, "trace_hash_ids": [6133, 6134, 6135, 6136, 6137, 6138, 6139, 6140, 6141, 6142, 6143, 6144, 6145, 6146, 6147, 6148, 6149, 6150, 6151, 6152, 6153, 6154, 6155, 6156, 6157, 6158, 6159, 6160, 6161, 6162, 6163, 6351, 6352, 6353, 6167, 6168, 13620867, 13637304, 5578065, 5578066, 5578067, 5578068, 5578069, 13674597, 13674598, 2474295, 13674599, 13674600, 13674601, 13674602, 13674603, 13674604, 13674605, 13674606, 13674607, 13674608, 13674609, 13674610, 13674611, 13674612, 13674613], "trace_timestamp_s": 498.4410000000007, "ttft_s": 1.8839800310088322, "turn_id": 3} +{"actual_output_tokens": 387, "cached_tokens": 2560, "effective_input_length": 79495, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79495, "latency_s": 26.43045725300908, "output_length": 387, "proxy_request_id": "1373577:1:1373577:608", "request_id": "1373577:1:1373577:608", "request_type": "coder", "requested_output_tokens": 387, "session_id": "1373577", "t_dispatch_unix": 1779821161.831312, "t_finish_unix": 1779821188.2617695, "t_first_token_unix": 1779821183.2208807, "tpot_s": 0.01305850137566781, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13612453], "trace_timestamp_s": 474.8630000000003, "ttft_s": 21.389564484998118, "turn_id": 1} +{"actual_output_tokens": 633, "cached_tokens": 56848, "effective_input_length": 61457, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61457, "latency_s": 7.232750384020619, "output_length": 633, "proxy_request_id": "1370129:3:1379538:637", "request_id": "1370129:3:1379538:637", "request_type": "coder", "requested_output_tokens": 633, "session_id": "1370129", "t_dispatch_unix": 1779821182.3579876, "t_finish_unix": 1779821189.5907378, "t_first_token_unix": 1779821184.1931129, "tpot_s": 0.008540063117143752, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13667066], "trace_timestamp_s": 495.41600000000017, "ttft_s": 1.835122643969953, "turn_id": 3} +{"actual_output_tokens": 96, "cached_tokens": 6880, "effective_input_length": 7620, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7620, "latency_s": 0.6153389630489983, "output_length": 96, "proxy_request_id": "1379569:3:1381510:649", "request_id": "1379569:3:1381510:649", "request_type": "coder", "requested_output_tokens": 96, "session_id": "1379569", "t_dispatch_unix": 1779821189.2850041, "t_finish_unix": 1779821189.900343, "t_first_token_unix": 1779821189.399271, "tpot_s": 0.005270099421154316, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13685191, 13685192], "trace_timestamp_s": 502.34700000000066, "ttft_s": 0.11426617304095998, "turn_id": 3} +{"actual_output_tokens": 31, "cached_tokens": 0, "effective_input_length": 1391, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1391, "latency_s": 0.2671061319997534, "output_length": 31, "proxy_request_id": "1381728:1:1381728:651", "request_id": "1381728:1:1381728:651", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1381728", "t_dispatch_unix": 1779821190.1911306, "t_finish_unix": 1779821190.4582365, "t_first_token_unix": 1779821190.3022804, "tpot_s": 0.005180222700194766, "trace_hash_ids": [13687007, 13687008, 13687009], "trace_timestamp_s": 503.2530000000006, "ttft_s": 0.11114880198147148, "turn_id": 1} +{"actual_output_tokens": 42, "cached_tokens": 10304, "effective_input_length": 10645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10645, "latency_s": 0.8192672480363399, "output_length": 42, "proxy_request_id": "1362265:4:1381673:650", "request_id": "1362265:4:1381673:650", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1362265", "t_dispatch_unix": 1779821189.9684732, "t_finish_unix": 1779821190.7877402, "t_first_token_unix": 1779821190.083502, "tpot_s": 0.01717020434088914, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588], "trace_timestamp_s": 503.03000000000065, "ttft_s": 0.11502784304320812, "turn_id": 4} +{"actual_output_tokens": 51, "cached_tokens": 59296, "effective_input_length": 59374, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59374, "latency_s": 0.5957435280433856, "output_length": 51, "proxy_request_id": "1366128:9:1381799:652", "request_id": "1366128:9:1381799:652", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1366128", "t_dispatch_unix": 1779821190.4402804, "t_finish_unix": 1779821191.0360236, "t_first_token_unix": 1779821190.6074243, "tpot_s": 0.00856612173956819, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389], "trace_timestamp_s": 503.5010000000002, "ttft_s": 0.1671425310196355, "turn_id": 9} +{"actual_output_tokens": 2009, "cached_tokens": 98224, "effective_input_length": 98267, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98267, "latency_s": 55.29148521699244, "output_length": 2009, "proxy_request_id": "1279412:25:1366203:554", "request_id": "1279412:25:1366203:554", "request_type": "coder", "requested_output_tokens": 2009, "session_id": "1279412", "t_dispatch_unix": 1779821135.811507, "t_finish_unix": 1779821191.102992, "t_first_token_unix": 1779821136.5336256, "tpot_s": 0.027175825598098446, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104], "trace_timestamp_s": 448.8700000000008, "ttft_s": 0.7221162130008452, "turn_id": 25} +{"actual_output_tokens": 267, "cached_tokens": 0, "effective_input_length": 13989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13989, "latency_s": 2.9744894499890506, "output_length": 267, "proxy_request_id": "1381387:1:1381387:648", "request_id": "1381387:1:1381387:648", "request_type": "coder", "requested_output_tokens": 267, "session_id": "1381387", "t_dispatch_unix": 1779821188.8705165, "t_finish_unix": 1779821191.845006, "t_first_token_unix": 1779821190.0757282, "tpot_s": 0.006650273530145309, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13684112], "trace_timestamp_s": 501.9280000000008, "ttft_s": 1.2052104159956798, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 0, "effective_input_length": 3034, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3034, "latency_s": 0.33991467201849446, "output_length": 32, "proxy_request_id": "1382294:1:1382294:656", "request_id": "1382294:1:1382294:656", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1382294", "t_dispatch_unix": 1779821192.1942523, "t_finish_unix": 1779821192.534167, "t_first_token_unix": 1779821192.3805583, "tpot_s": 0.004947119354901295, "trace_hash_ids": [13692603, 13692604, 13692605, 13692606, 13692607, 13692608], "trace_timestamp_s": 505.2550000000001, "ttft_s": 0.1863050729734823, "turn_id": 1} +{"actual_output_tokens": 135, "cached_tokens": 100272, "effective_input_length": 100340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100340, "latency_s": 1.9391363120521419, "output_length": 135, "proxy_request_id": "1279412:26:1378269:628", "request_id": "1279412:26:1378269:628", "request_type": "coder", "requested_output_tokens": 135, "session_id": "1279412", "t_dispatch_unix": 1779821191.1096494, "t_finish_unix": 1779821193.048786, "t_first_token_unix": 1779821191.354047, "tpot_s": 0.01264435338045804, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367], "trace_timestamp_s": 491.1310000000003, "ttft_s": 0.24439578101737425, "turn_id": 26} +{"actual_output_tokens": 338, "cached_tokens": 79872, "effective_input_length": 81147, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81147, "latency_s": 5.744589816953521, "output_length": 338, "proxy_request_id": "1373577:2:1380740:647", "request_id": "1373577:2:1380740:647", "request_type": "coder", "requested_output_tokens": 338, "session_id": "1373577", "t_dispatch_unix": 1779821188.2657838, "t_finish_unix": 1779821194.0103734, "t_first_token_unix": 1779821189.1532497, "tpot_s": 0.01441213732636437, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13677773], "trace_timestamp_s": 499.7430000000004, "ttft_s": 0.8874638919951394, "turn_id": 2} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 3190, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3190, "latency_s": 0.374661804002244, "output_length": 26, "proxy_request_id": "1382710:1:1382710:659", "request_id": "1382710:1:1382710:659", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1382710", "t_dispatch_unix": 1779821193.7087464, "t_finish_unix": 1779821194.0834079, "t_first_token_unix": 1779821193.9285662, "tpot_s": 0.006184117200318724, "trace_hash_ids": [13684985, 13690307, 13696041, 13696042, 13696043, 13696044, 13696045], "trace_timestamp_s": 506.77000000000044, "ttft_s": 0.21981768001569435, "turn_id": 1} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 1955, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1955, "latency_s": 0.6926754440064542, "output_length": 47, "proxy_request_id": "1382667:1:1382667:658", "request_id": "1382667:1:1382667:658", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1382667", "t_dispatch_unix": 1779821193.6103296, "t_finish_unix": 1779821194.303005, "t_first_token_unix": 1779821193.738362, "tpot_s": 0.012266689064942868, "trace_hash_ids": [13695912, 13695913, 13695914, 13695915], "trace_timestamp_s": 506.6720000000005, "ttft_s": 0.1280318659846671, "turn_id": 1} +{"actual_output_tokens": 35, "cached_tokens": 0, "effective_input_length": 627, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 627, "latency_s": 0.5077540869824588, "output_length": 35, "proxy_request_id": "1382804:1:1382804:660", "request_id": "1382804:1:1382804:660", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1382804", "t_dispatch_unix": 1779821193.939486, "t_finish_unix": 1779821194.4472396, "t_first_token_unix": 1779821194.1270037, "tpot_s": 0.009410233971293029, "trace_hash_ids": [13696917, 13696918], "trace_timestamp_s": 507.0010000000002, "ttft_s": 0.18751686997711658, "turn_id": 1} +{"actual_output_tokens": 66, "cached_tokens": 59424, "effective_input_length": 59506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59506, "latency_s": 0.6468616789788939, "output_length": 66, "proxy_request_id": "1366128:10:1382843:661", "request_id": "1366128:10:1382843:661", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1366128", "t_dispatch_unix": 1779821194.0569987, "t_finish_unix": 1779821194.7038603, "t_first_token_unix": 1779821194.2013128, "tpot_s": 0.007727294861195752, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13697230], "trace_timestamp_s": 507.1170000000002, "ttft_s": 0.144311951007694, "turn_id": 10} +{"actual_output_tokens": 53, "cached_tokens": 0, "effective_input_length": 5135, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5135, "latency_s": 0.8449357899953611, "output_length": 53, "proxy_request_id": "1383009:1:1383009:663", "request_id": "1383009:1:1383009:663", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1383009", "t_dispatch_unix": 1779821194.5814054, "t_finish_unix": 1779821195.4263408, "t_first_token_unix": 1779821194.94573, "tpot_s": 0.009235852808790067, "trace_hash_ids": [13680021, 13680022, 13690856, 13690857, 13690858, 13690859, 13690860, 13690861, 13690862, 13698936, 13698937], "trace_timestamp_s": 507.64200000000073, "ttft_s": 0.36432369396789, "turn_id": 1} +{"actual_output_tokens": 195, "cached_tokens": 100464, "effective_input_length": 100538, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100538, "latency_s": 2.7518561159959063, "output_length": 195, "proxy_request_id": "1279412:27:1380696:646", "request_id": "1279412:27:1380696:646", "request_type": "coder", "requested_output_tokens": 195, "session_id": "1279412", "t_dispatch_unix": 1779821193.0545442, "t_finish_unix": 1779821195.8064, "t_first_token_unix": 1779821193.302106, "tpot_s": 0.012906672438419396, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13677275], "trace_timestamp_s": 499.58100000000013, "ttft_s": 0.24755931994877756, "turn_id": 27} +{"actual_output_tokens": 48, "cached_tokens": 3056, "effective_input_length": 5164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5164, "latency_s": 1.1411693000118248, "output_length": 48, "proxy_request_id": "1382294:2:1383073:664", "request_id": "1382294:2:1383073:664", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1382294", "t_dispatch_unix": 1779821194.8052342, "t_finish_unix": 1779821195.9464033, "t_first_token_unix": 1779821194.98575, "tpot_s": 0.020430835254956037, "trace_hash_ids": [13692603, 13692604, 13692605, 13692606, 13692607, 13692608, 13699684, 13699685, 13699686, 13699687, 13699688], "trace_timestamp_s": 507.8670000000002, "ttft_s": 0.18051486101467162, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 9305, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9305, "latency_s": 1.103035444044508, "output_length": 46, "proxy_request_id": "1383090:1:1383090:665", "request_id": "1383090:1:1383090:665", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1383090", "t_dispatch_unix": 1779821194.8473785, "t_finish_unix": 1779821195.9504135, "t_first_token_unix": 1779821195.667454, "tpot_s": 0.006283865510744767, "trace_hash_ids": [13676594, 13676595, 13676596, 13676597, 13676598, 13676599, 13676600, 13684524, 13684525, 13684526, 13684527, 13693279, 13693280, 13693281, 13693282, 13693283, 13699848, 13699849, 13699850], "trace_timestamp_s": 507.90599999999995, "ttft_s": 0.8200743410270661, "turn_id": 1} +{"actual_output_tokens": 57, "cached_tokens": 7712, "effective_input_length": 10217, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10217, "latency_s": 1.8918209309922531, "output_length": 57, "proxy_request_id": "1379569:4:1383116:666", "request_id": "1379569:4:1383116:666", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1379569", "t_dispatch_unix": 1779821194.9377718, "t_finish_unix": 1779821196.829593, "t_first_token_unix": 1779821196.343574, "tpot_s": 0.008672617553591928, "trace_hash_ids": [13667374, 13667375, 13667376, 13667377, 13667378, 13674970, 13674971, 13674972, 13674973, 13674974, 13674975, 13674976, 13674977, 13685191, 13692448, 13692449, 13699991, 13699992, 13699993, 13699994], "trace_timestamp_s": 507.9990000000007, "ttft_s": 1.4057967570261098, "turn_id": 4} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 3186, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3186, "latency_s": 0.33468493999680504, "output_length": 27, "proxy_request_id": "1383625:1:1383625:668", "request_id": "1383625:1:1383625:668", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1383625", "t_dispatch_unix": 1779821196.7796376, "t_finish_unix": 1779821197.1143224, "t_first_token_unix": 1779821196.9777484, "tpot_s": 0.005244471307378262, "trace_hash_ids": [13696954, 13704618, 13704619, 13704620, 13704621, 13704622, 13704623], "trace_timestamp_s": 509.84100000000035, "ttft_s": 0.1981079470133409, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 0, "effective_input_length": 38111, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38111, "latency_s": 6.024359843984712, "output_length": 25, "proxy_request_id": "1382089:1:1382089:655", "request_id": "1382089:1:1382089:655", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1382089", "t_dispatch_unix": 1779821191.466975, "t_finish_unix": 1779821197.491335, "t_first_token_unix": 1779821197.3545558, "tpot_s": 0.00567941645810303, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 504.5050000000001, "ttft_s": 5.887569474987686, "turn_id": 1} +{"actual_output_tokens": 203, "cached_tokens": 100720, "effective_input_length": 100766, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 100766, "latency_s": 2.8421105690067634, "output_length": 203, "proxy_request_id": "1279412:28:1382526:657", "request_id": "1279412:28:1382526:657", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1279412", "t_dispatch_unix": 1779821195.8114855, "t_finish_unix": 1779821198.653596, "t_first_token_unix": 1779821196.035263, "tpot_s": 0.012960438366453763, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899], "trace_timestamp_s": 506.16000000000076, "ttft_s": 0.2237749519990757, "turn_id": 28} +{"actual_output_tokens": 60, "cached_tokens": 0, "effective_input_length": 5989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5989, "latency_s": 0.7008426859974861, "output_length": 60, "proxy_request_id": "1382667:2:1384299:674", "request_id": "1382667:2:1384299:674", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1382667", "t_dispatch_unix": 1779821199.2627602, "t_finish_unix": 1779821199.9636025, "t_first_token_unix": 1779821199.6618788, "tpot_s": 0.0051083562883816784, "trace_hash_ids": [13695912, 13695913, 13695914, 13703943, 13703944, 13703945, 13703946, 13710107, 13710108, 13710109, 13710110, 13710111], "trace_timestamp_s": 512.3230000000003, "ttft_s": 0.3991176409763284, "turn_id": 2} +{"actual_output_tokens": 302, "cached_tokens": 0, "effective_input_length": 22132, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22132, "latency_s": 23.388653812988196, "output_length": 302, "proxy_request_id": "1286804:4:1378156:627", "request_id": "1286804:4:1378156:627", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1286804", "t_dispatch_unix": 1779821177.6618104, "t_finish_unix": 1779821201.050464, "t_first_token_unix": 1779821195.8292398, "tpot_s": 0.017344374478441907, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13654392, 13654393, 13654394, 13654395, 13654396, 13654397, 13654398, 13654399, 13654400, 13654401, 13654402, 13654403, 13654404, 13654405], "trace_timestamp_s": 490.72100000000046, "ttft_s": 18.16742680600146, "turn_id": 4} +{"actual_output_tokens": 2085, "cached_tokens": 0, "effective_input_length": 35888, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35888, "latency_s": 34.374165573040955, "output_length": 2085, "proxy_request_id": "1301929:2:1375154:617", "request_id": "1301929:2:1375154:617", "request_type": "coder", "requested_output_tokens": 2085, "session_id": "1301929", "t_dispatch_unix": 1779821167.3373153, "t_finish_unix": 1779821201.7114806, "t_first_token_unix": 1779821173.4956644, "tpot_s": 0.013539126743761386, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 5975800], "trace_timestamp_s": 480.39800000000014, "ttft_s": 6.1583467540331185, "turn_id": 2} +{"actual_output_tokens": 141, "cached_tokens": 49856, "effective_input_length": 49865, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49865, "latency_s": 2.0684668560279533, "output_length": 141, "proxy_request_id": "1340278:3:1384549:676", "request_id": "1340278:3:1384549:676", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1340278", "t_dispatch_unix": 1779821200.0231616, "t_finish_unix": 1779821202.0916286, "t_first_token_unix": 1779821200.2591074, "tpot_s": 0.01308645767858252, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13712170, 13712171, 13712172, 13712173, 13712174, 13712175, 13712176, 13712177, 13712178, 13712179, 13712180, 13712181, 13712182, 13712183, 13712184, 13712185, 13712186, 13712187, 13712188, 13712189, 13712190, 13712191, 13712192, 13712193, 13712194, 13712195, 13712196, 13712197, 13712198, 13712199, 13712200, 13712201, 13712202, 13712203, 13712204, 13712205, 13712206, 13712207, 13712208, 13712209, 13712210, 13712211, 13712212, 13712213, 13712214, 13712215, 13712216, 13712217, 13712218, 13712219, 13712220, 13712221, 13712222, 13712223, 13712224, 13712225, 13712226, 13712227, 13712228, 13712229, 13712230, 13712231, 13712232, 13712233, 13712234, 13712235, 13712236, 13712237, 13712238, 13712239, 13712240, 13712241, 13712242, 13712243], "trace_timestamp_s": 513.0550000000003, "ttft_s": 0.23594134498853236, "turn_id": 3} +{"actual_output_tokens": 32, "cached_tokens": 5184, "effective_input_length": 11113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11113, "latency_s": 0.8864903339999728, "output_length": 32, "proxy_request_id": "1383009:2:1384930:679", "request_id": "1383009:2:1384930:679", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1383009", "t_dispatch_unix": 1779821201.2330806, "t_finish_unix": 1779821202.1195707, "t_first_token_unix": 1779821201.8184748, "tpot_s": 0.009704919451201756, "trace_hash_ids": [13680021, 13680022, 13690856, 13690857, 13690858, 13690859, 13690860, 13690861, 13690862, 13698936, 13705525, 13705526, 13705527, 13705528, 13705529, 13705530, 13705531, 13716553, 13716554, 13716555, 13716556, 13716557], "trace_timestamp_s": 514.2930000000006, "ttft_s": 0.5853932669851929, "turn_id": 2} +{"actual_output_tokens": 232, "cached_tokens": 23840, "effective_input_length": 25226, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25226, "latency_s": 3.095973067043815, "output_length": 232, "proxy_request_id": "1355484:10:1384484:675", "request_id": "1355484:10:1384484:675", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1355484", "t_dispatch_unix": 1779821199.8638473, "t_finish_unix": 1779821202.9598205, "t_first_token_unix": 1779821200.2048745, "tpot_s": 0.011924933649204446, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13711657], "trace_timestamp_s": 512.9250000000002, "ttft_s": 0.3410251430468634, "turn_id": 10} +{"actual_output_tokens": 5, "cached_tokens": 50000, "effective_input_length": 50272, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50272, "latency_s": 0.19927302602445707, "output_length": 5, "proxy_request_id": "1340278:3:1385417:683", "request_id": "1340278:3:1385417:683", "request_type": "coder", "requested_output_tokens": 5, "session_id": "1340278", "t_dispatch_unix": 1779821203.0222063, "t_finish_unix": 1779821203.2214792, "t_first_token_unix": 1779821203.2157621, "tpot_s": 0.0013543352542910725, "trace_hash_ids": [13234886, 35393, 35394, 35395, 35396, 13234887, 54678, 54679, 54680, 54681, 13234888, 13234889, 13234890, 13234891, 319871, 13234892, 13234893, 13234894, 13234895, 13234896, 13449827, 13449828, 13561218, 13561219, 13720652, 1600817, 13720653, 13720654, 13720655, 13720656, 13720657, 13720658, 13720659, 13720660, 13720661, 13720662, 13720663, 13720664, 13720665, 13720666, 13720667, 13720668, 13720669, 13720670, 13720671, 13720672, 13720673, 13720674, 13720675, 13720676, 13720677, 13720678, 13720679, 13720680, 13720681, 13720682, 13720683, 13720684, 13720685, 13720686, 13720687, 13720688, 13720689, 13720690, 13720691, 13720692, 13720693, 13720694, 13720695, 13720696, 13720697, 13720698, 13720699, 13720700, 13720701, 13720702, 13720703, 13720704, 13720705, 13720706, 13720707, 13720708, 13720709, 13720710, 13720711, 13720712, 13720713, 13720714, 13720715, 13720716, 13720717, 13720718, 13720719, 13720720, 13720721, 13720722, 13720723, 13720724, 13720725], "trace_timestamp_s": 516.067, "ttft_s": 0.19355346099473536, "turn_id": 3} +{"actual_output_tokens": 151, "cached_tokens": 0, "effective_input_length": 54012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54012, "latency_s": 12.16356881998945, "output_length": 151, "proxy_request_id": "1382086:1:1382086:654", "request_id": "1382086:1:1382086:654", "request_type": "coder", "requested_output_tokens": 151, "session_id": "1382086", "t_dispatch_unix": 1779821191.4542317, "t_finish_unix": 1779821203.6178002, "t_first_token_unix": 1779821202.198248, "tpot_s": 0.009461425920017063, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977], "trace_timestamp_s": 504.4960000000001, "ttft_s": 10.744013749004807, "turn_id": 1} +{"actual_output_tokens": 370, "cached_tokens": 60816, "effective_input_length": 105902, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105902, "latency_s": 33.67569421901135, "output_length": 370, "proxy_request_id": "1313181:5:1320817:349", "request_id": "1313181:5:1320817:349", "request_type": "coder", "requested_output_tokens": 370, "session_id": "1313181", "t_dispatch_unix": 1779821170.3243122, "t_finish_unix": 1779821204.0000067, "t_first_token_unix": 1779821193.753197, "tpot_s": 0.02776743597565547, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275], "trace_timestamp_s": 289.299, "ttft_s": 23.428882351960056, "turn_id": 5} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 19034, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19034, "latency_s": 2.7318227969808504, "output_length": 47, "proxy_request_id": "1384947:1:1384947:680", "request_id": "1384947:1:1384947:680", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1384947", "t_dispatch_unix": 1779821201.2907522, "t_finish_unix": 1779821204.0225751, "t_first_token_unix": 1779821203.2666993, "tpot_s": 0.016422008522330663, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13716768, 13716769, 13716770, 13716771, 13716772, 13716773, 13716774, 13716775, 13716776, 13716777], "trace_timestamp_s": 514.3460000000005, "ttft_s": 1.9759451399440877, "turn_id": 1} +{"actual_output_tokens": 824, "cached_tokens": 27648, "effective_input_length": 47401, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47401, "latency_s": 13.115967869991437, "output_length": 824, "proxy_request_id": "1364090:3:1381959:653", "request_id": "1364090:3:1381959:653", "request_type": "coder", "requested_output_tokens": 824, "session_id": "1364090", "t_dispatch_unix": 1779821190.9692593, "t_finish_unix": 1779821204.0852265, "t_first_token_unix": 1779821196.1032052, "tpot_s": 0.009698140098405538, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13688849], "trace_timestamp_s": 504.02300000000014, "ttft_s": 5.133943199005444, "turn_id": 3} +{"actual_output_tokens": 1861, "cached_tokens": 63392, "effective_input_length": 63536, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63536, "latency_s": 40.151763972011395, "output_length": 1861, "proxy_request_id": "1363093:3:1374394:612", "request_id": "1363093:3:1374394:612", "request_type": "coder", "requested_output_tokens": 1861, "session_id": "1363093", "t_dispatch_unix": 1779821164.594938, "t_finish_unix": 1779821204.7467024, "t_first_token_unix": 1779821183.2262018, "tpot_s": 0.011569999555915705, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062], "trace_timestamp_s": 477.65500000000065, "ttft_s": 18.631261236034334, "turn_id": 3} +{"actual_output_tokens": 73, "cached_tokens": 100960, "effective_input_length": 101200, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101200, "latency_s": 1.025956344034057, "output_length": 73, "proxy_request_id": "1279412:29:1385688:685", "request_id": "1279412:29:1385688:685", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1279412", "t_dispatch_unix": 1779821204.0588987, "t_finish_unix": 1779821205.084855, "t_first_token_unix": 1779821204.4047925, "tpot_s": 0.009441452458203357, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276], "trace_timestamp_s": 517.1180000000004, "ttft_s": 0.3458916380186565, "turn_id": 29} +{"actual_output_tokens": 27, "cached_tokens": 3200, "effective_input_length": 4150, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4150, "latency_s": 8.62054801499471, "output_length": 27, "proxy_request_id": "1383625:2:1384279:673", "request_id": "1383625:2:1384279:673", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1383625", "t_dispatch_unix": 1779821199.197829, "t_finish_unix": 1779821207.8183773, "t_first_token_unix": 1779821207.320325, "tpot_s": 0.019141433191879723, "trace_hash_ids": [13696954, 13704618, 13704619, 13704620, 13704621, 13704622, 13709928, 13709929, 13709930], "trace_timestamp_s": 512.2600000000002, "ttft_s": 8.12249395501567, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 9344, "effective_input_length": 16734, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16734, "latency_s": 5.692061729030684, "output_length": 46, "proxy_request_id": "1383090:2:1385262:682", "request_id": "1383090:2:1385262:682", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1383090", "t_dispatch_unix": 1779821202.4800797, "t_finish_unix": 1779821208.172141, "t_first_token_unix": 1779821207.3973694, "tpot_s": 0.017210575754547285, "trace_hash_ids": [13676594, 13676595, 13676596, 13676597, 13676598, 13676599, 13676600, 13684524, 13684525, 13684526, 13684527, 13693279, 13693280, 13693281, 13693282, 13693283, 13699848, 13699849, 13706451, 13706452, 13706453, 13706454, 13706455, 13711662, 13711663, 13711664, 13711665, 13711666, 13711667, 13711668, 13711669, 13719432, 13719433], "trace_timestamp_s": 515.5390000000007, "ttft_s": 4.917288229044061, "turn_id": 2} +{"actual_output_tokens": 18, "cached_tokens": 1408, "effective_input_length": 12399, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12399, "latency_s": 1.0413059429847635, "output_length": 18, "proxy_request_id": "1381728:2:1387040:690", "request_id": "1381728:2:1387040:690", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1381728", "t_dispatch_unix": 1779821208.5140822, "t_finish_unix": 1779821209.5553882, "t_first_token_unix": 1779821209.472816, "tpot_s": 0.004841713176574558, "trace_hash_ids": [13687007, 13687008, 13696180, 13696181, 13696182, 13696183, 13696184, 13703126, 13703127, 13703128, 13711511, 13711512, 13711513, 13711514, 13721898, 13721899, 13721900, 13721901, 13721902, 13729312, 13729313, 13729314, 13729315, 13735232, 13735233], "trace_timestamp_s": 521.5710000000008, "ttft_s": 0.9587320909486152, "turn_id": 2} +{"actual_output_tokens": 168, "cached_tokens": 59568, "effective_input_length": 71254, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71254, "latency_s": 11.940830313018523, "output_length": 168, "proxy_request_id": "1366128:11:1384044:671", "request_id": "1366128:11:1384044:671", "request_type": "coder", "requested_output_tokens": 168, "session_id": "1366128", "t_dispatch_unix": 1779821198.2632911, "t_finish_unix": 1779821210.2041214, "t_first_token_unix": 1779821204.5397644, "tpot_s": 0.03391573766475086, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13708083], "trace_timestamp_s": 511.3190000000004, "ttft_s": 6.276469553005882, "turn_id": 11} +{"actual_output_tokens": 81, "cached_tokens": 101264, "effective_input_length": 101396, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101396, "latency_s": 1.0342795149772428, "output_length": 81, "proxy_request_id": "1279412:30:1387344:694", "request_id": "1279412:30:1387344:694", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1279412", "t_dispatch_unix": 1779821209.6349547, "t_finish_unix": 1779821210.6692343, "t_first_token_unix": 1779821209.891854, "tpot_s": 0.009713833387650084, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276, 13738467], "trace_timestamp_s": 522.6910000000007, "ttft_s": 0.2568968999548815, "turn_id": 30} +{"actual_output_tokens": 197, "cached_tokens": 0, "effective_input_length": 21221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21221, "latency_s": 12.145976261002943, "output_length": 197, "proxy_request_id": "1340290:3:1384149:672", "request_id": "1340290:3:1384149:672", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1340290", "t_dispatch_unix": 1779821198.7186437, "t_finish_unix": 1779821210.8646202, "t_first_token_unix": 1779821207.3223803, "tpot_s": 0.01807063058160046, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13305218], "trace_timestamp_s": 511.78099999999995, "ttft_s": 8.603735324984882, "turn_id": 3} +{"actual_output_tokens": 27, "cached_tokens": 0, "effective_input_length": 4690, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4690, "latency_s": 11.134382189949974, "output_length": 27, "proxy_request_id": "1384772:1:1384772:677", "request_id": "1384772:1:1384772:677", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1384772", "t_dispatch_unix": 1779821200.7256222, "t_finish_unix": 1779821211.8600044, "t_first_token_unix": 1779821201.0300534, "tpot_s": 0.4165262355012461, "trace_hash_ids": [13696008, 13696009, 13702186, 13702187, 13702188, 13702189, 13702190, 13707543, 13707544, 13714402], "trace_timestamp_s": 513.7860000000001, "ttft_s": 0.3044299489702098, "turn_id": 1} +{"actual_output_tokens": 58, "cached_tokens": 71408, "effective_input_length": 71578, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71578, "latency_s": 1.9326638290076517, "output_length": 58, "proxy_request_id": "1366128:12:1386045:687", "request_id": "1366128:12:1386045:687", "request_type": "coder", "requested_output_tokens": 58, "session_id": "1366128", "t_dispatch_unix": 1779821210.2081, "t_finish_unix": 1779821212.1407642, "t_first_token_unix": 1779821210.4638197, "tpot_s": 0.029413616034537227, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175], "trace_timestamp_s": 518.5060000000003, "ttft_s": 0.2557170370128006, "turn_id": 12} +{"actual_output_tokens": 53, "cached_tokens": 21408, "effective_input_length": 26146, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26146, "latency_s": 1.6402254150016233, "output_length": 53, "proxy_request_id": "1340290:4:1385568:684", "request_id": "1340290:4:1385568:684", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1340290", "t_dispatch_unix": 1779821210.868133, "t_finish_unix": 1779821212.5083585, "t_first_token_unix": 1779821211.779706, "tpot_s": 0.014007564518788759, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13722203], "trace_timestamp_s": 516.6480000000001, "ttft_s": 0.9115710000041872, "turn_id": 4} +{"actual_output_tokens": 652, "cached_tokens": 60848, "effective_input_length": 60858, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60858, "latency_s": 8.718795179971494, "output_length": 652, "proxy_request_id": "1313181:5:1374956:615", "request_id": "1313181:5:1374956:615", "request_type": "coder", "requested_output_tokens": 652, "session_id": "1313181", "t_dispatch_unix": 1779821204.0056539, "t_finish_unix": 1779821212.7244487, "t_first_token_unix": 1779821204.1208375, "tpot_s": 0.013215602893981734, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981], "trace_timestamp_s": 479.66400000000067, "ttft_s": 0.11518158100079745, "turn_id": 5} +{"actual_output_tokens": 13, "cached_tokens": 0, "effective_input_length": 11530, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11530, "latency_s": 0.9846092950319871, "output_length": 13, "proxy_request_id": "1384772:2:1387335:693", "request_id": "1384772:2:1387335:693", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1384772", "t_dispatch_unix": 1779821211.8631115, "t_finish_unix": 1779821212.8477204, "t_first_token_unix": 1779821212.7932866, "tpot_s": 0.004507289166213013, "trace_hash_ids": [13696008, 13696009, 13702186, 13702187, 13702188, 13702189, 13702190, 13707543, 13707544, 13719995, 13719996, 13719997, 13719998, 13725304, 13732414, 13732415, 13732416, 13732417, 13732418, 13738419, 13738420, 13738421, 13738422], "trace_timestamp_s": 522.6730000000007, "ttft_s": 0.9301740730297752, "turn_id": 2} +{"actual_output_tokens": 279, "cached_tokens": 14240, "effective_input_length": 28383, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28383, "latency_s": 15.934165079030208, "output_length": 279, "proxy_request_id": "1381387:2:1383735:669", "request_id": "1381387:2:1383735:669", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1381387", "t_dispatch_unix": 1779821197.088857, "t_finish_unix": 1779821213.0230224, "t_first_token_unix": 1779821199.4605777, "tpot_s": 0.0487838449172689, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13705337], "trace_timestamp_s": 510.14500000000044, "ttft_s": 2.3717182420077734, "turn_id": 2} +{"actual_output_tokens": 3119, "cached_tokens": 0, "effective_input_length": 15283, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15283, "latency_s": 32.798691823962145, "output_length": 3119, "proxy_request_id": "1378979:1:1378979:633", "request_id": "1378979:1:1378979:633", "request_type": "coder", "requested_output_tokens": 3119, "session_id": "1378979", "t_dispatch_unix": 1779821180.5064046, "t_finish_unix": 1779821213.3050966, "t_first_token_unix": 1779821181.8765948, "tpot_s": 0.010079613379407387, "trace_hash_ids": [1978, 1979, 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007], "trace_timestamp_s": 493.5690000000004, "ttft_s": 1.3701876259874552, "turn_id": 1} +{"actual_output_tokens": 166, "cached_tokens": 25456, "effective_input_length": 26837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26837, "latency_s": 1.3906182540231384, "output_length": 166, "proxy_request_id": "1355484:11:1388276:696", "request_id": "1355484:11:1388276:696", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1355484", "t_dispatch_unix": 1779821212.8448396, "t_finish_unix": 1779821214.2354574, "t_first_token_unix": 1779821213.1962335, "tpot_s": 0.006296693418301981, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13748329], "trace_timestamp_s": 525.906, "ttft_s": 0.35139124101260677, "turn_id": 11} +{"actual_output_tokens": 12, "cached_tokens": 656, "effective_input_length": 3678, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3678, "latency_s": 0.25739079498453066, "output_length": 12, "proxy_request_id": "1382804:2:1388620:698", "request_id": "1382804:2:1388620:698", "request_type": "coder", "requested_output_tokens": 12, "session_id": "1382804", "t_dispatch_unix": 1779821214.224268, "t_finish_unix": 1779821214.481659, "t_first_token_unix": 1779821214.4298785, "tpot_s": 0.004681332454889674, "trace_hash_ids": [13696917, 13723655, 13723656, 13723657, 13723658, 13736021, 13736022, 13751607], "trace_timestamp_s": 527.2850000000008, "ttft_s": 0.20560844999272376, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 71632, "effective_input_length": 71708, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71708, "latency_s": 2.808634982968215, "output_length": 46, "proxy_request_id": "1366128:13:1387308:692", "request_id": "1366128:13:1387308:692", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1366128", "t_dispatch_unix": 1779821212.1443586, "t_finish_unix": 1779821214.952993, "t_first_token_unix": 1779821212.3282447, "tpot_s": 0.058311084734224194, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13738057], "trace_timestamp_s": 522.5910000000003, "ttft_s": 0.18388390296604484, "turn_id": 13} +{"actual_output_tokens": 582, "cached_tokens": 62080, "effective_input_length": 85184, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85184, "latency_s": 16.357992517005187, "output_length": 582, "proxy_request_id": "1370129:4:1384856:678", "request_id": "1370129:4:1384856:678", "request_type": "coder", "requested_output_tokens": 582, "session_id": "1370129", "t_dispatch_unix": 1779821200.992027, "t_finish_unix": 1779821217.3500192, "t_first_token_unix": 1779821211.7511322, "tpot_s": 0.009636091980974955, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13715535], "trace_timestamp_s": 514.0410000000002, "ttft_s": 10.759102913027164, "turn_id": 4} +{"actual_output_tokens": 54, "cached_tokens": 0, "effective_input_length": 5110, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5110, "latency_s": 0.6067723390297033, "output_length": 54, "proxy_request_id": "1390240:1:1390240:705", "request_id": "1390240:1:1390240:705", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1390240", "t_dispatch_unix": 1779821220.1596568, "t_finish_unix": 1779821220.766429, "t_first_token_unix": 1779821220.496282, "tpot_s": 0.005092109038433025, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529], "trace_timestamp_s": 533.2200000000003, "ttft_s": 0.3366234040004201, "turn_id": 1} +{"actual_output_tokens": 337, "cached_tokens": 0, "effective_input_length": 1349, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1349, "latency_s": 1.7544923829846084, "output_length": 337, "proxy_request_id": "1390356:1:1390356:706", "request_id": "1390356:1:1390356:706", "request_type": "coder", "requested_output_tokens": 337, "session_id": "1390356", "t_dispatch_unix": 1779821220.6012163, "t_finish_unix": 1779821222.3557086, "t_first_token_unix": 1779821220.6984947, "tpot_s": 0.00493131105655006, "trace_hash_ids": [498451, 7523068, 6847035], "trace_timestamp_s": 533.6630000000005, "ttft_s": 0.09727726597338915, "turn_id": 1} +{"actual_output_tokens": 438, "cached_tokens": 65392, "effective_input_length": 68187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68187, "latency_s": 5.016062356007751, "output_length": 438, "proxy_request_id": "1363093:4:1390050:704", "request_id": "1363093:4:1390050:704", "request_type": "coder", "requested_output_tokens": 438, "session_id": "1363093", "t_dispatch_unix": 1779821219.3890703, "t_finish_unix": 1779821224.4051318, "t_first_token_unix": 1779821220.6671066, "tpot_s": 0.00855318927451184, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678], "trace_timestamp_s": 532.4470000000001, "ttft_s": 1.278034329006914, "turn_id": 4} +{"actual_output_tokens": 36, "cached_tokens": 26192, "effective_input_length": 27220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27220, "latency_s": 12.23059196700342, "output_length": 36, "proxy_request_id": "1340290:5:1386504:688", "request_id": "1340290:5:1386504:688", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779821212.509922, "t_finish_unix": 1779821224.740514, "t_first_token_unix": 1779821212.8085728, "tpot_s": 0.3409039580579182, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13730728], "trace_timestamp_s": 519.7940000000008, "ttft_s": 0.29864860500674695, "turn_id": 5} +{"actual_output_tokens": 103, "cached_tokens": 71744, "effective_input_length": 83404, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83404, "latency_s": 10.007218916958664, "output_length": 103, "proxy_request_id": "1366128:14:1389156:701", "request_id": "1366128:14:1389156:701", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1366128", "t_dispatch_unix": 1779821216.200025, "t_finish_unix": 1779821226.2072434, "t_first_token_unix": 1779821224.7158825, "tpot_s": 0.014618374794201158, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710], "trace_timestamp_s": 529.2550000000001, "ttft_s": 8.5158546489547, "turn_id": 14} +{"actual_output_tokens": 40, "cached_tokens": 0, "effective_input_length": 15302, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15302, "latency_s": 1.5794502710341476, "output_length": 40, "proxy_request_id": "1391584:1:1391584:713", "request_id": "1391584:1:1391584:713", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1391584", "t_dispatch_unix": 1779821224.6720672, "t_finish_unix": 1779821226.2515168, "t_first_token_unix": 1779821226.0417264, "tpot_s": 0.0053728214623287125, "trace_hash_ids": [13707702, 13707703, 13720726, 13720727, 13720728, 13720729, 13733320, 13733321, 13733322, 13733323, 13733324, 13733325, 13733326, 13746256, 13746257, 13746258, 13746259, 13754848, 13763119, 13763120, 13763121, 13763122, 13763123, 13770106, 13770107, 13770108, 13770109, 13779081, 13779082, 13779083], "trace_timestamp_s": 537.7290000000003, "ttft_s": 1.3696582289994694, "turn_id": 1} +{"actual_output_tokens": 457, "cached_tokens": 85760, "effective_input_length": 87687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87687, "latency_s": 5.699478999013081, "output_length": 457, "proxy_request_id": "1370129:5:1390477:708", "request_id": "1370129:5:1390477:708", "request_type": "coder", "requested_output_tokens": 457, "session_id": "1370129", "t_dispatch_unix": 1779821221.122107, "t_finish_unix": 1779821226.8215857, "t_first_token_unix": 1779821222.3962362, "tpot_s": 0.009704053999979678, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13768317, 13768318, 13768319, 13768320, 13768321, 13768322], "trace_timestamp_s": 534.1800000000003, "ttft_s": 1.2741270560072735, "turn_id": 5} +{"actual_output_tokens": 175, "cached_tokens": 27248, "effective_input_length": 27285, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27285, "latency_s": 2.772129549004603, "output_length": 175, "proxy_request_id": "1340290:6:1387365:695", "request_id": "1340290:6:1387365:695", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1340290", "t_dispatch_unix": 1779821224.742211, "t_finish_unix": 1779821227.5143406, "t_first_token_unix": 1779821224.8427415, "tpot_s": 0.015352020028780547, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13738577], "trace_timestamp_s": 522.7670000000007, "ttft_s": 0.1005290140165016, "turn_id": 6} +{"actual_output_tokens": 118, "cached_tokens": 83504, "effective_input_length": 83622, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83622, "latency_s": 1.8370749459718354, "output_length": 118, "proxy_request_id": "1366128:15:1390663:709", "request_id": "1366128:15:1390663:709", "request_type": "coder", "requested_output_tokens": 118, "session_id": "1366128", "t_dispatch_unix": 1779821226.2107716, "t_finish_unix": 1779821228.047846, "t_first_token_unix": 1779821226.4268587, "tpot_s": 0.013852012298929576, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13769857], "trace_timestamp_s": 534.7930000000006, "ttft_s": 0.21608528401702642, "turn_id": 15} +{"actual_output_tokens": 265, "cached_tokens": 28656, "effective_input_length": 50793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50793, "latency_s": 15.29138176201377, "output_length": 265, "proxy_request_id": "1381387:3:1387093:691", "request_id": "1381387:3:1387093:691", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1381387", "t_dispatch_unix": 1779821213.0345142, "t_finish_unix": 1779821228.3258958, "t_first_token_unix": 1779821219.023227, "tpot_s": 0.03523627381064492, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13736168], "trace_timestamp_s": 521.7730000000001, "ttft_s": 5.9887097390019335, "turn_id": 3} +{"actual_output_tokens": 70, "cached_tokens": 15328, "effective_input_length": 15483, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15483, "latency_s": 0.4617062979959883, "output_length": 70, "proxy_request_id": "1391584:2:1392466:715", "request_id": "1391584:2:1392466:715", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1391584", "t_dispatch_unix": 1779821227.9891965, "t_finish_unix": 1779821228.4509025, "t_first_token_unix": 1779821228.0756721, "tpot_s": 0.00543461060843201, "trace_hash_ids": [13786395, 13786396, 13786397, 13786398, 13786399, 13786400, 13786401, 13786402, 13786403, 13786404, 13786405, 13786406, 13786407, 13786408, 13786409, 13786410, 13786411, 13786412, 13786413, 13786414, 13786415, 13786416, 13786417, 13786418, 13786419, 13786420, 13786421, 13786422, 13786423, 13786424, 13786425], "trace_timestamp_s": 541.0450000000001, "ttft_s": 0.08647380501497537, "turn_id": 2} +{"actual_output_tokens": 204, "cached_tokens": 0, "effective_input_length": 28307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28307, "latency_s": 5.624369210039731, "output_length": 204, "proxy_request_id": "1391404:1:1391404:712", "request_id": "1391404:1:1391404:712", "request_type": "coder", "requested_output_tokens": 204, "session_id": "1391404", "t_dispatch_unix": 1779821224.1553304, "t_finish_unix": 1779821229.7796988, "t_first_token_unix": 1779821227.7197673, "tpot_s": 0.010145498384329321, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 94557, 94558, 94559, 94560, 94561, 94562, 94563, 94564, 94565, 238090, 238091, 3841644, 3841645, 3841646, 3841647, 3841648, 3841649, 13750192, 3809872, 13750193, 13750194, 13777397, 13777398, 13777399, 13777400, 13777401, 13777402, 13777403, 13777404, 13777405, 13777406, 13777407, 13777408, 13777409, 13777410, 13777411, 13777412, 13777413, 13777414, 13777415, 13777416, 13777417, 13777418, 13777419, 13777420, 13777421, 13777422, 13777423, 13777424, 13777425, 13777426], "trace_timestamp_s": 537.2080000000005, "ttft_s": 3.5644347179913893, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 5152, "effective_input_length": 7440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7440, "latency_s": 0.44962703197961673, "output_length": 44, "proxy_request_id": "1390240:2:1392954:717", "request_id": "1390240:2:1392954:717", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1390240", "t_dispatch_unix": 1779821229.7070217, "t_finish_unix": 1779821230.1566489, "t_first_token_unix": 1779821229.9328403, "tpot_s": 0.00519502111629388, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529, 13772017, 13790409, 13790410, 13790411, 13790412], "trace_timestamp_s": 542.768, "ttft_s": 0.2258167620166205, "turn_id": 2} +{"actual_output_tokens": 251, "cached_tokens": 26992, "effective_input_length": 28382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28382, "latency_s": 4.710003062034957, "output_length": 251, "proxy_request_id": "1355484:12:1391879:714", "request_id": "1355484:12:1391879:714", "request_type": "coder", "requested_output_tokens": 251, "session_id": "1355484", "t_dispatch_unix": 1779821225.8088007, "t_finish_unix": 1779821230.5188036, "t_first_token_unix": 1779821228.0354233, "tpot_s": 0.009932162571931257, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13781560], "trace_timestamp_s": 538.8690000000006, "ttft_s": 2.2266202900209464, "turn_id": 12} +{"actual_output_tokens": 206, "cached_tokens": 83728, "effective_input_length": 84897, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 84897, "latency_s": 2.6597526440164074, "output_length": 206, "proxy_request_id": "1366128:16:1392704:716", "request_id": "1366128:16:1392704:716", "request_type": "coder", "requested_output_tokens": 206, "session_id": "1366128", "t_dispatch_unix": 1779821228.8789594, "t_finish_unix": 1779821231.5387118, "t_first_token_unix": 1779821229.653531, "tpot_s": 0.009194579829246078, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167], "trace_timestamp_s": 541.9360000000006, "ttft_s": 0.7745694739860483, "turn_id": 16} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 71899, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71899, "latency_s": 19.117100495961495, "output_length": 45, "proxy_request_id": "1388507:1:1388507:697", "request_id": "1388507:1:1388507:697", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1388507", "t_dispatch_unix": 1779821213.7601652, "t_finish_unix": 1779821232.8772652, "t_first_token_unix": 1779821232.17892, "tpot_s": 0.015864994749956004, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728], "trace_timestamp_s": 526.7930000000006, "ttft_s": 18.418752309982665, "turn_id": 1} +{"actual_output_tokens": 46, "cached_tokens": 38080, "effective_input_length": 38242, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38242, "latency_s": 14.126600830000825, "output_length": 46, "proxy_request_id": "1355951:4:1389858:703", "request_id": "1355951:4:1389858:703", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1355951", "t_dispatch_unix": 1779821218.7630525, "t_finish_unix": 1779821232.8896532, "t_first_token_unix": 1779821232.184291, "tpot_s": 0.01566954019945115, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424], "trace_timestamp_s": 531.8220000000001, "ttft_s": 13.42123601201456, "turn_id": 4} +{"actual_output_tokens": 2, "cached_tokens": 0, "effective_input_length": 982, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 982, "latency_s": 0.09284231200581416, "output_length": 2, "proxy_request_id": "1394428:1:1394428:724", "request_id": "1394428:1:1394428:724", "request_type": "coder", "requested_output_tokens": 2, "session_id": "1394428", "t_dispatch_unix": 1779821234.860786, "t_finish_unix": 1779821234.9536278, "t_first_token_unix": 1779821234.9497864, "tpot_s": 0.003544738981872797, "trace_hash_ids": [7025, 13804096], "trace_timestamp_s": 547.9230000000007, "ttft_s": 0.08899927500169724, "turn_id": 1} +{"actual_output_tokens": 265, "cached_tokens": 101472, "effective_input_length": 101993, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101993, "latency_s": 11.531308235949837, "output_length": 265, "proxy_request_id": "1279412:31:1391216:711", "request_id": "1279412:31:1391216:711", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1279412", "t_dispatch_unix": 1779821223.693065, "t_finish_unix": 1779821235.2243724, "t_first_token_unix": 1779821232.1978285, "tpot_s": 0.011463179693126938, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 12658712, 12658713, 1055526, 12658714, 12658715, 12658716, 12658717, 12658718, 12711656, 12711657, 12711658, 12711659, 12711660, 12711661, 12748532, 12748533, 12748534, 12748535, 12748536, 12748537, 12748538, 12748539, 12748540, 12748541, 12748542, 12748543, 12790280, 12790281, 12799342, 12799343, 12799344, 12799345, 12799346, 12799347, 12799348, 12799349, 12799350, 12827932, 12868263, 12868264, 12868265, 12868266, 12868267, 12868268, 12868269, 12868270, 12868271, 12868272, 12868273, 12868274, 12868275, 12868276, 12868277, 12868278, 12902523, 12902524, 12902525, 12902526, 12902527, 12902528, 12902529, 12902530, 12902531, 12902532, 12902533, 12902534, 12902535, 12902536, 12902537, 12902538, 12902539, 12902540, 12902541, 12902542, 12902543, 12902544, 12902545, 12902546, 12902547, 12902548, 12902549, 12902550, 12902551, 12902552, 12902553, 12902554, 12902555, 12902556, 12902557, 12902558, 12902559, 12902560, 12928376, 12981329, 12981330, 13022371, 13022372, 13022373, 13022374, 13022375, 13022376, 13075834, 13104839, 13104840, 13104841, 13104842, 13104843, 13104844, 13104845, 13104846, 13104847, 13104848, 13104849, 13104850, 13104851, 13129896, 13150111, 13150112, 13150113, 13150114, 13150115, 13150116, 13150117, 13174084, 13174085, 13174086, 13174087, 13174088, 13174089, 13174090, 13174091, 13174092, 13174093, 13237337, 13237338, 13237339, 13260054, 13260055, 13260056, 13260057, 13260058, 13260059, 13260060, 13260061, 13260062, 13279424, 13279425, 13279426, 13279427, 13279428, 13279429, 13279430, 13279431, 13279432, 13279433, 13279434, 13279435, 13279436, 13279437, 13279438, 13279439, 13341144, 13526214, 13526215, 13526216, 13526217, 13544104, 13655364, 13655365, 13655366, 13655367, 13694899, 13723276, 13775473, 13775474], "trace_timestamp_s": 536.75, "ttft_s": 8.504761315998621, "turn_id": 31} +{"actual_output_tokens": 51, "cached_tokens": 0, "effective_input_length": 4736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4736, "latency_s": 0.5667982879676856, "output_length": 51, "proxy_request_id": "1394432:1:1394432:725", "request_id": "1394432:1:1394432:725", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1394432", "t_dispatch_unix": 1779821234.8774698, "t_finish_unix": 1779821235.444268, "t_first_token_unix": 1779821235.18963, "tpot_s": 0.005087252679513768, "trace_hash_ids": [13788220, 13788221, 13788222, 13788223, 13788224, 13804106, 13804107, 13804108, 13804109, 13804110], "trace_timestamp_s": 547.9380000000001, "ttft_s": 0.31215913698542863, "turn_id": 1} +{"actual_output_tokens": 19, "cached_tokens": 0, "effective_input_length": 4428, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4428, "latency_s": 0.3633338499930687, "output_length": 19, "proxy_request_id": "1394482:1:1394482:726", "request_id": "1394482:1:1394482:726", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1394482", "t_dispatch_unix": 1779821235.1315422, "t_finish_unix": 1779821235.494876, "t_first_token_unix": 1779821235.4090474, "tpot_s": 0.004754685279395845, "trace_hash_ids": [13785573, 13792906, 13792907, 13792908, 13792909, 13798843, 13804481, 13804482, 13804483], "trace_timestamp_s": 548.192, "ttft_s": 0.27750325901433825, "turn_id": 1} +{"actual_output_tokens": 71, "cached_tokens": 28624, "effective_input_length": 28665, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28665, "latency_s": 0.9671007660217583, "output_length": 71, "proxy_request_id": "1355484:13:1394384:723", "request_id": "1355484:13:1394384:723", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1355484", "t_dispatch_unix": 1779821234.7147326, "t_finish_unix": 1779821235.6818326, "t_first_token_unix": 1779821234.8067176, "tpot_s": 0.012494441856896238, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562], "trace_timestamp_s": 547.7760000000007, "ttft_s": 0.0919828080222942, "turn_id": 13} +{"actual_output_tokens": 613, "cached_tokens": 48224, "effective_input_length": 48944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48944, "latency_s": 7.027218204981182, "output_length": 613, "proxy_request_id": "1364090:4:1392998:718", "request_id": "1364090:4:1392998:718", "request_type": "coder", "requested_output_tokens": 613, "session_id": "1364090", "t_dispatch_unix": 1779821229.8083158, "t_finish_unix": 1779821236.8355336, "t_first_token_unix": 1779821230.1911862, "tpot_s": 0.01085624396568925, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13790837], "trace_timestamp_s": 542.8680000000004, "ttft_s": 0.38286877499194816, "turn_id": 4} +{"actual_output_tokens": 49, "cached_tokens": 4784, "effective_input_length": 6892, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6892, "latency_s": 0.448020012001507, "output_length": 49, "proxy_request_id": "1394432:2:1395186:729", "request_id": "1394432:2:1395186:729", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1394432", "t_dispatch_unix": 1779821237.4663885, "t_finish_unix": 1779821237.9144084, "t_first_token_unix": 1779821237.6661909, "tpot_s": 0.005164645229039404, "trace_hash_ids": [13788220, 13788221, 13788222, 13788223, 13788224, 13804106, 13804107, 13804108, 13804109, 13810289, 13810290, 13810291, 13810292, 13810293], "trace_timestamp_s": 550.527, "ttft_s": 0.19980143097927794, "turn_id": 2} +{"actual_output_tokens": 179, "cached_tokens": 19072, "effective_input_length": 20183, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20183, "latency_s": 24.045621653960552, "output_length": 179, "proxy_request_id": "1384947:2:1388842:700", "request_id": "1384947:2:1388842:700", "request_type": "coder", "requested_output_tokens": 179, "session_id": "1384947", "t_dispatch_unix": 1779821214.9812498, "t_finish_unix": 1779821239.026871, "t_first_token_unix": 1779821236.0144212, "tpot_s": 0.016922605797855098, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13753560, 13753561, 13753562, 13753563, 13753564, 13753565, 13753566, 13753567, 13753568, 13753569, 13753570, 13753571], "trace_timestamp_s": 528.0410000000002, "ttft_s": 21.033169397967868, "turn_id": 2} +{"actual_output_tokens": 185, "cached_tokens": 61504, "effective_input_length": 106305, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106305, "latency_s": 26.469017730036285, "output_length": 185, "proxy_request_id": "1313181:6:1324908:369", "request_id": "1313181:6:1324908:369", "request_type": "coder", "requested_output_tokens": 185, "session_id": "1313181", "t_dispatch_unix": 1779821212.729634, "t_finish_unix": 1779821239.1986516, "t_first_token_unix": 1779821236.028383, "tpot_s": 0.017227964456453818, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13161676], "trace_timestamp_s": 303.64200000000073, "ttft_s": 23.29874648503028, "turn_id": 6} +{"actual_output_tokens": 5049, "cached_tokens": 67552, "effective_input_length": 68259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68259, "latency_s": 151.15138419700088, "output_length": 5049, "proxy_request_id": "1314357:4:1352612:497", "request_id": "1314357:4:1352612:497", "request_type": "coder", "requested_output_tokens": 5049, "session_id": "1314357", "t_dispatch_unix": 1779821088.172465, "t_finish_unix": 1779821239.3238494, "t_first_token_unix": 1779821090.4625576, "tpot_s": 0.029489110648168417, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13419015, 13419016], "trace_timestamp_s": 401.23199999999997, "ttft_s": 2.2900880810339004, "turn_id": 4} +{"actual_output_tokens": 99, "cached_tokens": 85088, "effective_input_length": 85276, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85276, "latency_s": 1.1842207679874264, "output_length": 99, "proxy_request_id": "1366128:17:1395596:731", "request_id": "1366128:17:1395596:731", "request_type": "coder", "requested_output_tokens": 99, "session_id": "1366128", "t_dispatch_unix": 1779821239.0059872, "t_finish_unix": 1779821240.1902082, "t_first_token_unix": 1779821239.3049617, "tpot_s": 0.009029969397803997, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13813611], "trace_timestamp_s": 552.0660000000007, "ttft_s": 0.2989724579965696, "turn_id": 17} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 57656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57656, "latency_s": 59.693707407976035, "output_length": 57, "proxy_request_id": "1263749:2:1379302:636", "request_id": "1263749:2:1379302:636", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1263749", "t_dispatch_unix": 1779821181.71577, "t_finish_unix": 1779821241.4094775, "t_first_token_unix": 1779821223.703913, "tpot_s": 0.31616285542882644, "trace_hash_ids": [51262, 61305, 61306, 637504, 637505, 637506, 637507, 637508, 637509, 637510, 637511, 637512, 637513, 637514, 637515, 637516, 637517, 637518, 637519, 637520, 637521, 637522, 637523, 637524, 637525, 637526, 584014, 637527, 637528, 1022562, 637530, 1022563, 637532, 637533, 248930, 1022564, 4415649, 4415650, 4415651, 12449838, 12449839, 12449840, 12449841, 12449842, 12449843, 12449844, 12449845, 12449846, 12449847, 12449848, 12449849, 12449850, 12449851, 12449852, 12449853, 12449854, 12449855, 12449856, 12449857, 12449858, 12449859, 12449860, 12449861, 12449862, 12449863, 12449864, 12449865, 12449866, 12449867, 12449868, 12449869, 12449870, 12449871, 12449872, 12449873, 12449874, 12449875, 12449876, 12449877, 12449878, 12449879, 12449880, 12449881, 12449882, 12449883, 12449884, 12449885, 12449886, 12449887, 12449888, 12449889, 12449890, 12449891, 12449892, 12449893, 12449894, 12449895, 12449896, 12449897, 12553020, 12553021, 12553022, 12553023, 12553024, 12553025, 12553026, 12553027, 12553028, 12553029, 12553030, 12911454, 13469821, 13639785], "trace_timestamp_s": 494.77500000000055, "ttft_s": 41.988140514993574, "turn_id": 2} +{"actual_output_tokens": 65, "cached_tokens": 0, "effective_input_length": 35450, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35450, "latency_s": 5.639104648027569, "output_length": 65, "proxy_request_id": "1394696:1:1394696:727", "request_id": "1394696:1:1394696:727", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1394696", "t_dispatch_unix": 1779821235.9048283, "t_finish_unix": 1779821241.5439327, "t_first_token_unix": 1779821241.132972, "tpot_s": 0.006417170952772722, "trace_hash_ids": [13806090, 13806091, 13806092, 13806093, 13806094, 13806095, 13806096, 13806097, 13806098, 13806099, 13806100, 13806101, 13806102, 13806103, 13806104, 13806105, 13806106, 13806107, 13806108, 13806109, 13806110, 13806111, 13806112, 13806113, 13806114, 13806115, 13806116, 9511238, 9511239, 9511240, 9511241, 13806117, 13806118, 13806119, 13806120, 13806121, 13806122, 13806123, 13806124, 13806125, 13806126, 13806127, 13806128, 13806129, 13806130, 13806131, 13806132, 13806133, 13806134, 13806135, 13806136, 13806137, 13806138, 13806139, 13806140, 13806141, 13806142, 13806143, 13806144, 13806145, 13806146, 13806147, 13806148, 13806149, 13806150, 13806151, 13806152, 13806153, 13806154, 13806155], "trace_timestamp_s": 548.9520000000002, "ttft_s": 5.228142063017003, "turn_id": 1} +{"actual_output_tokens": 117, "cached_tokens": 0, "effective_input_length": 69465, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69465, "latency_s": 44.501835283997934, "output_length": 117, "proxy_request_id": "1342921:3:1384020:670", "request_id": "1342921:3:1384020:670", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1342921", "t_dispatch_unix": 1779821198.146846, "t_finish_unix": 1779821242.648681, "t_first_token_unix": 1779821240.0296903, "tpot_s": 0.022575045474162645, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13707851], "trace_timestamp_s": 511.20600000000013, "ttft_s": 41.88284209399717, "turn_id": 3} +{"actual_output_tokens": 213, "cached_tokens": 0, "effective_input_length": 21241, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21241, "latency_s": 3.55745400901651, "output_length": 213, "proxy_request_id": "1395933:1:1395933:732", "request_id": "1395933:1:1395933:732", "request_type": "coder", "requested_output_tokens": 213, "session_id": "1395933", "t_dispatch_unix": 1779821240.198439, "t_finish_unix": 1779821243.755888, "t_first_token_unix": 1779821242.4817832, "tpot_s": 0.0060086187498560525, "trace_hash_ids": [13657, 13658, 13659, 13660, 13661, 13662, 13663, 13664, 13665, 13666, 13667, 13668, 13669, 13670, 13671, 13672, 13673, 13674, 13675, 13676, 13677, 13678, 13679, 4820695, 12527506, 12667198, 12747031, 12878182, 12930465, 13027097, 13219058, 13256881, 13445564, 13599228, 13718544, 13817211, 13817212, 13817213, 13817214, 13817215, 13817216, 13817217], "trace_timestamp_s": 553.2570000000005, "ttft_s": 2.2833476630039513, "turn_id": 1} +{"actual_output_tokens": 181, "cached_tokens": 18480, "effective_input_length": 18676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18676, "latency_s": 82.17996042600134, "output_length": 181, "proxy_request_id": "1363943:5:1373637:609", "request_id": "1363943:5:1373637:609", "request_type": "coder", "requested_output_tokens": 181, "session_id": "1363943", "t_dispatch_unix": 1779821162.0030901, "t_finish_unix": 1779821244.1830509, "t_first_token_unix": 1779821211.9311838, "tpot_s": 0.17917381721134815, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13613147], "trace_timestamp_s": 475.0650000000005, "ttft_s": 49.92809133295668, "turn_id": 5} +{"actual_output_tokens": 132, "cached_tokens": 0, "effective_input_length": 17047, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17047, "latency_s": 2.5983928790083155, "output_length": 132, "proxy_request_id": "1305906:3:1396717:733", "request_id": "1305906:3:1396717:733", "request_type": "coder", "requested_output_tokens": 132, "session_id": "1305906", "t_dispatch_unix": 1779821242.7890368, "t_finish_unix": 1779821245.3874295, "t_first_token_unix": 1779821244.4419878, "tpot_s": 0.007213739793790319, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 13824632], "trace_timestamp_s": 555.8500000000004, "ttft_s": 1.6529495069989935, "turn_id": 3} +{"actual_output_tokens": 87, "cached_tokens": 85360, "effective_input_length": 85504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85504, "latency_s": 1.0231761069735512, "output_length": 87, "proxy_request_id": "1366128:18:1397382:735", "request_id": "1366128:18:1397382:735", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1366128", "t_dispatch_unix": 1779821245.0522578, "t_finish_unix": 1779821246.075433, "t_first_token_unix": 1779821245.2833695, "tpot_s": 0.009206132837408764, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174], "trace_timestamp_s": 558.107, "ttft_s": 0.23110968299442902, "turn_id": 18} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 4675, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4675, "latency_s": 12.255712992977351, "output_length": 73, "proxy_request_id": "1394167:1:1394167:721", "request_id": "1394167:1:1394167:721", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1394167", "t_dispatch_unix": 1779821233.9719312, "t_finish_unix": 1779821246.227644, "t_first_token_unix": 1779821234.2709193, "tpot_s": 0.16606197851393112, "trace_hash_ids": [13801402, 13801403, 13801404, 13801405, 13801406, 13801407, 13801408, 13801409, 13801410, 13801411], "trace_timestamp_s": 547.0320000000002, "ttft_s": 0.2989872549660504, "turn_id": 1} +{"actual_output_tokens": 107, "cached_tokens": 7472, "effective_input_length": 10890, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10890, "latency_s": 8.519961810961831, "output_length": 107, "proxy_request_id": "1390240:3:1395387:730", "request_id": "1390240:3:1395387:730", "request_type": "coder", "requested_output_tokens": 107, "session_id": "1390240", "t_dispatch_unix": 1779821238.259042, "t_finish_unix": 1779821246.7790043, "t_first_token_unix": 1779821245.3603594, "tpot_s": 0.013380819603796381, "trace_hash_ids": [13760644, 13760645, 13760646, 13760647, 13760648, 13760649, 13760650, 13760651, 13760652, 13766529, 13772017, 13790409, 13790410, 13790411, 13798738, 13798739, 13805950, 13805951, 13805952, 13812101, 13812102, 13812103], "trace_timestamp_s": 551.3200000000006, "ttft_s": 7.1013157069683075, "turn_id": 3} +{"actual_output_tokens": 160, "cached_tokens": 18848, "effective_input_length": 19116, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19116, "latency_s": 2.997998851002194, "output_length": 160, "proxy_request_id": "1363943:6:1375416:618", "request_id": "1363943:6:1375416:618", "request_type": "coder", "requested_output_tokens": 160, "session_id": "1363943", "t_dispatch_unix": 1779821244.184255, "t_finish_unix": 1779821247.182254, "t_first_token_unix": 1779821244.3213334, "tpot_s": 0.01799114531458139, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13629311], "trace_timestamp_s": 481.2580000000007, "ttft_s": 0.13707708497531712, "turn_id": 6} +{"actual_output_tokens": 117, "cached_tokens": 4736, "effective_input_length": 4863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4863, "latency_s": 1.546491804998368, "output_length": 117, "proxy_request_id": "1394167:2:1395165:728", "request_id": "1394167:2:1395165:728", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1394167", "t_dispatch_unix": 1779821246.2281237, "t_finish_unix": 1779821247.7746158, "t_first_token_unix": 1779821246.29351, "tpot_s": 0.012763886517295132, "trace_hash_ids": [13801402, 13801403, 13801404, 13801405, 13801406, 13801407, 13801408, 13801409, 13801410, 13810026], "trace_timestamp_s": 550.4650000000001, "ttft_s": 0.06538478698348626, "turn_id": 2} +{"actual_output_tokens": 531, "cached_tokens": 0, "effective_input_length": 13134, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 13134, "latency_s": 4.064964115037583, "output_length": 531, "proxy_request_id": "1397223:1:1397223:734", "request_id": "1397223:1:1397223:734", "request_type": "coder", "requested_output_tokens": 531, "session_id": "1397223", "t_dispatch_unix": 1779821244.430277, "t_finish_unix": 1779821248.4952412, "t_first_token_unix": 1779821245.543864, "tpot_s": 0.005568155958449011, "trace_hash_ids": [13793541, 13793542, 13793543, 13802362, 13802363, 13802364, 13802365, 13802366, 13802367, 13811273, 13811274, 13811275, 13811276, 13811277, 13811278, 13811279, 13811280, 13819026, 13819027, 13819028, 13819029, 13828841, 13828842, 13828843, 13828844, 13828845], "trace_timestamp_s": 557.4880000000003, "ttft_s": 1.113585930026602, "turn_id": 1} +{"actual_output_tokens": 64, "cached_tokens": 0, "effective_input_length": 3891, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3891, "latency_s": 0.5595784990000539, "output_length": 64, "proxy_request_id": "1398213:1:1398213:742", "request_id": "1398213:1:1398213:742", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1398213", "t_dispatch_unix": 1779821248.0936491, "t_finish_unix": 1779821248.6532276, "t_first_token_unix": 1779821248.3361328, "tpot_s": 0.005028712539194477, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13837656], "trace_timestamp_s": 561.1540000000005, "ttft_s": 0.24248188198544085, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 16550, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16550, "latency_s": 1.8000300449784845, "output_length": 44, "proxy_request_id": "1397840:1:1397840:737", "request_id": "1397840:1:1397840:737", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1397840", "t_dispatch_unix": 1779821246.8809502, "t_finish_unix": 1779821248.6809802, "t_first_token_unix": 1779821248.465055, "tpot_s": 0.0050154159070252505, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13834593], "trace_timestamp_s": 559.9370000000008, "ttft_s": 1.5841031820164062, "turn_id": 1} +{"actual_output_tokens": 22, "cached_tokens": 0, "effective_input_length": 3213, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3213, "latency_s": 1.0389469840447418, "output_length": 22, "proxy_request_id": "1398145:1:1398145:739", "request_id": "1398145:1:1398145:739", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1398145", "t_dispatch_unix": 1779821247.952303, "t_finish_unix": 1779821248.991249, "t_first_token_unix": 1779821248.1926026, "tpot_s": 0.03800999238211218, "trace_hash_ids": [13836943, 13836944, 13836945, 13836946, 13836947, 13836948, 13836949], "trace_timestamp_s": 561.0129999999999, "ttft_s": 0.24029915302526206, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 0, "effective_input_length": 7877, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7877, "latency_s": 0.6602877710247412, "output_length": 24, "proxy_request_id": "1398594:1:1398594:744", "request_id": "1398594:1:1398594:744", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1398594", "t_dispatch_unix": 1779821249.32023, "t_finish_unix": 1779821249.9805174, "t_first_token_unix": 1779821249.8655925, "tpot_s": 0.0049830443914169855, "trace_hash_ids": [13835320, 13835321, 13835322, 13835323, 13835324, 13835325, 13835326, 13841636, 13841637, 13841638, 13841639, 13841640, 13841641, 13841642, 13841643, 13841644], "trace_timestamp_s": 562.3790000000008, "ttft_s": 0.5453613069839776, "turn_id": 1} +{"actual_output_tokens": 25, "cached_tokens": 85584, "effective_input_length": 85663, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85663, "latency_s": 0.380922999989707, "output_length": 25, "proxy_request_id": "1366128:19:1398824:745", "request_id": "1366128:19:1398824:745", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1366128", "t_dispatch_unix": 1779821250.2077858, "t_finish_unix": 1779821250.5887084, "t_first_token_unix": 1779821250.4237728, "tpot_s": 0.0068614272483197665, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13843754], "trace_timestamp_s": 563.2670000000007, "ttft_s": 0.215984667011071, "turn_id": 19} +{"actual_output_tokens": 213, "cached_tokens": 28720, "effective_input_length": 31224, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31224, "latency_s": 2.7488617839990184, "output_length": 213, "proxy_request_id": "1355484:14:1398178:740", "request_id": "1355484:14:1398178:740", "request_type": "coder", "requested_output_tokens": 213, "session_id": "1355484", "t_dispatch_unix": 1779821248.0278857, "t_finish_unix": 1779821250.7767472, "t_first_token_unix": 1779821248.8109984, "tpot_s": 0.009270859971743534, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299], "trace_timestamp_s": 561.0889999999999, "ttft_s": 0.783110674994532, "turn_id": 14} +{"actual_output_tokens": 2641, "cached_tokens": 28496, "effective_input_length": 33321, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33321, "latency_s": 21.614119419944473, "output_length": 2641, "proxy_request_id": "1391404:2:1393919:720", "request_id": "1391404:2:1393919:720", "request_type": "coder", "requested_output_tokens": 2641, "session_id": "1391404", "t_dispatch_unix": 1779821233.014032, "t_finish_unix": 1779821254.6281512, "t_first_token_unix": 1779821234.139174, "tpot_s": 0.007760785984481283, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 94557, 94558, 94559, 94560, 94561, 94562, 94563, 94564, 94565, 238090, 238091, 3841644, 3841645, 3841646, 3841647, 3841648, 3841649, 13750192, 3809872, 13750193, 13750194, 13777397, 13777398, 13777399, 13777400, 13777401, 13777402, 13777403, 13777404, 13777405, 13777406, 13777407, 13777408, 13777409, 13777410, 13777411, 13777412, 13777413, 13777414, 13777415, 13777416, 13777417, 13777418, 13777419, 13777420, 13777421, 13777422, 13777423, 13777424, 13777425, 13799002, 13799003, 13799004, 13799005, 13799006, 13799007, 13799008, 13799009, 13799010, 13799011, 13799012], "trace_timestamp_s": 546.0730000000003, "ttft_s": 1.1251398669555783, "turn_id": 2} +{"actual_output_tokens": 79, "cached_tokens": 31424, "effective_input_length": 31469, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31469, "latency_s": 0.8274727460229769, "output_length": 79, "proxy_request_id": "1355484:15:1400281:750", "request_id": "1355484:15:1400281:750", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1355484", "t_dispatch_unix": 1779821255.1338084, "t_finish_unix": 1779821255.961281, "t_first_token_unix": 1779821255.2106054, "tpot_s": 0.009617742384598853, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299, 13857350], "trace_timestamp_s": 568.1950000000006, "ttft_s": 0.07679538504453376, "turn_id": 15} +{"actual_output_tokens": 57, "cached_tokens": 0, "effective_input_length": 3707, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3707, "latency_s": 0.6237431579502299, "output_length": 57, "proxy_request_id": "1400379:1:1400379:751", "request_id": "1400379:1:1400379:751", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1400379", "t_dispatch_unix": 1779821255.447569, "t_finish_unix": 1779821256.0713122, "t_first_token_unix": 1779821255.7036347, "tpot_s": 0.006561560321383045, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13858195], "trace_timestamp_s": 568.5080000000007, "ttft_s": 0.25606489297933877, "turn_id": 1} +{"actual_output_tokens": 73, "cached_tokens": 0, "effective_input_length": 11414, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11414, "latency_s": 1.3074533700128086, "output_length": 73, "proxy_request_id": "1398213:2:1400590:753", "request_id": "1398213:2:1400590:753", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1398213", "t_dispatch_unix": 1779821256.2337449, "t_finish_unix": 1779821257.5411983, "t_first_token_unix": 1779821257.14937, "tpot_s": 0.005438431138625472, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13846300, 13846301, 13846302, 13846303, 13846304, 13851656, 13851657, 13851658, 13851659, 13851660, 13851661, 13860134, 13860135, 13860136, 13860137, 13860138], "trace_timestamp_s": 569.2930000000006, "ttft_s": 0.9156232679961249, "turn_id": 2} +{"actual_output_tokens": 194, "cached_tokens": 20352, "effective_input_length": 20683, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20683, "latency_s": 18.54479656094918, "output_length": 194, "proxy_request_id": "1384947:3:1390898:710", "request_id": "1384947:3:1390898:710", "request_type": "coder", "requested_output_tokens": 194, "session_id": "1384947", "t_dispatch_unix": 1779821239.0296264, "t_finish_unix": 1779821257.574423, "t_first_token_unix": 1779821239.1782117, "tpot_s": 0.0953159486890621, "trace_hash_ids": [4956072, 8815665, 13716742, 13716743, 13716744, 13716745, 13716746, 13716747, 13716748, 13716749, 13716750, 13716751, 13716752, 13716753, 13716754, 13716755, 13716756, 13716757, 13716758, 13716759, 13716760, 13716761, 13716762, 13716763, 13716764, 13716765, 13716766, 13716767, 13753560, 13753561, 13753562, 13772382, 13772383, 13772384, 13772385, 13772386, 13772387, 13772388, 13772389, 13772390, 13772391], "trace_timestamp_s": 535.8690000000006, "ttft_s": 0.14858336799079552, "turn_id": 3} +{"actual_output_tokens": 277, "cached_tokens": 69568, "effective_input_length": 70990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70990, "latency_s": 17.71491124201566, "output_length": 277, "proxy_request_id": "1342921:4:1389290:702", "request_id": "1342921:4:1389290:702", "request_type": "coder", "requested_output_tokens": 277, "session_id": "1342921", "t_dispatch_unix": 1779821242.6531389, "t_finish_unix": 1779821260.36805, "t_first_token_unix": 1779821243.4460382, "tpot_s": 0.061310422616045704, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 13758038], "trace_timestamp_s": 529.6910000000007, "ttft_s": 0.7928974870010279, "turn_id": 4} +{"actual_output_tokens": 442, "cached_tokens": 61536, "effective_input_length": 61543, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61543, "latency_s": 22.207247465965338, "output_length": 442, "proxy_request_id": "1313181:6:1379623:639", "request_id": "1313181:6:1379623:639", "request_type": "coder", "requested_output_tokens": 442, "session_id": "1313181", "t_dispatch_unix": 1779821239.2026, "t_finish_unix": 1779821261.4098475, "t_first_token_unix": 1779821239.3225262, "tpot_s": 0.0500840661859049, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13667684], "trace_timestamp_s": 495.71700000000055, "ttft_s": 0.11992335598915815, "turn_id": 6} +{"actual_output_tokens": 67, "cached_tokens": 3760, "effective_input_length": 3863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3863, "latency_s": 5.633333461009897, "output_length": 67, "proxy_request_id": "1400379:2:1401201:757", "request_id": "1400379:2:1401201:757", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1400379", "t_dispatch_unix": 1779821258.5628664, "t_finish_unix": 1779821264.1962, "t_first_token_unix": 1779821263.2527206, "tpot_s": 0.014290926909201185, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13866334], "trace_timestamp_s": 571.625, "ttft_s": 4.689853210002184, "turn_id": 2} +{"actual_output_tokens": 528, "cached_tokens": 0, "effective_input_length": 126340, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126340, "latency_s": 103.42886312899645, "output_length": 528, "proxy_request_id": "1373431:1:1373431:606", "request_id": "1373431:1:1373431:606", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1373431", "t_dispatch_unix": 1779821161.313523, "t_finish_unix": 1779821264.742386, "t_first_token_unix": 1779821211.9487948, "tpot_s": 0.10017673873624887, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13611159], "trace_timestamp_s": 474.3240000000005, "ttft_s": 50.63526941102464, "turn_id": 1} +{"actual_output_tokens": 189, "cached_tokens": 19264, "effective_input_length": 20727, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20727, "latency_s": 17.6447100850055, "output_length": 189, "proxy_request_id": "1363943:7:1377305:623", "request_id": "1363943:7:1377305:623", "request_type": "coder", "requested_output_tokens": 189, "session_id": "1363943", "t_dispatch_unix": 1779821247.1841087, "t_finish_unix": 1779821264.828819, "t_first_token_unix": 1779821247.541696, "tpot_s": 0.09195087750521587, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13646868], "trace_timestamp_s": 487.90300000000025, "ttft_s": 0.3575844559818506, "turn_id": 7} +{"actual_output_tokens": 133, "cached_tokens": 0, "effective_input_length": 63258, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63258, "latency_s": 17.06343844800722, "output_length": 133, "proxy_request_id": "1253743:8:1398344:743", "request_id": "1253743:8:1398344:743", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1253743", "t_dispatch_unix": 1779821248.4581428, "t_finish_unix": 1779821265.5215812, "t_first_token_unix": 1779821262.7308562, "tpot_s": 0.02113976871954616, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 481346, 481347, 481348, 710670, 710671, 710672, 710673, 710674, 710675, 710676, 710677, 710678, 710679, 13839194, 13839195, 13839196, 13839197, 13839198, 13839199, 13839200, 13839201, 13839202, 13839203, 13839204, 13839205, 13839206, 13839207, 13839208, 13839209, 13839210, 13839211, 13839212, 13839213, 13839214, 13839215, 13839216, 13839217, 13839218, 13839219, 184023, 184024, 567789, 13839220, 13839221, 146857, 146858, 146859, 146860, 13839222, 11521, 13839223, 13839224, 13839225, 13839226, 13839227, 13839228, 13839229, 13839230, 13839231, 13839232, 13839233, 13839234, 13839235, 13839236, 13839237, 13839238, 13839239, 13839240, 13839241, 13839242, 13839243, 13839244, 13839245, 13839246, 13839247, 13839248, 13839249, 13839250, 13839251, 13839252, 13839253, 13839254, 13839255, 13839256, 13839257, 11719668, 13839258, 13839259, 13839260, 13839261, 13839262, 13839263, 13839264, 13839265, 13839266, 13839267, 13839268, 13839269, 13839270, 13839271, 13839272, 13839273], "trace_timestamp_s": 561.4990000000007, "ttft_s": 14.272708204982337, "turn_id": 8} +{"actual_output_tokens": 46, "cached_tokens": 0, "effective_input_length": 11216, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11216, "latency_s": 1.1334647519979626, "output_length": 46, "proxy_request_id": "1400379:3:1402972:763", "request_id": "1400379:3:1402972:763", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1400379", "t_dispatch_unix": 1779821264.7742283, "t_finish_unix": 1779821265.9076931, "t_first_token_unix": 1779821265.6711788, "tpot_s": 0.005247097243813591, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13882808], "trace_timestamp_s": 577.8340000000007, "ttft_s": 0.896949190995656, "turn_id": 3} +{"actual_output_tokens": 108, "cached_tokens": 0, "effective_input_length": 8848, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8848, "latency_s": 1.2420979890157469, "output_length": 108, "proxy_request_id": "1403188:1:1403188:764", "request_id": "1403188:1:1403188:764", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1403188", "t_dispatch_unix": 1779821265.6749675, "t_finish_unix": 1779821266.9170656, "t_first_token_unix": 1779821266.3546405, "tpot_s": 0.0052538361959594574, "trace_hash_ids": [13861837, 13861838, 13861839, 13861840, 13861841, 13861842, 13861843, 13861844, 13873939, 13873940, 13873941, 13873942, 13884865, 13884866, 13884867, 13884868, 13884869, 13884870], "trace_timestamp_s": 578.7340000000004, "ttft_s": 0.6796715730451979, "turn_id": 1} +{"actual_output_tokens": 140, "cached_tokens": 126864, "effective_input_length": 127267, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127267, "latency_s": 2.518425870977808, "output_length": 140, "proxy_request_id": "1373431:2:1378320:629", "request_id": "1373431:2:1378320:629", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1373431", "t_dispatch_unix": 1779821264.7500026, "t_finish_unix": 1779821267.2684283, "t_first_token_unix": 1779821265.4220126, "tpot_s": 0.013281241863322772, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13655780, 13655781, 13655782], "trace_timestamp_s": 491.299, "ttft_s": 0.6720074389595538, "turn_id": 2} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 1954, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1954, "latency_s": 0.4773705039988272, "output_length": 71, "proxy_request_id": "1403989:1:1403989:767", "request_id": "1403989:1:1403989:767", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1403989", "t_dispatch_unix": 1779821268.1707807, "t_finish_unix": 1779821268.648151, "t_first_token_unix": 1779821268.303578, "tpot_s": 0.004917139928355547, "trace_hash_ids": [13892332, 13892333, 13892334, 13892335], "trace_timestamp_s": 581.232, "ttft_s": 0.13279676798265427, "turn_id": 1} +{"actual_output_tokens": 90, "cached_tokens": 127392, "effective_input_length": 128201, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128201, "latency_s": 2.1992843910120428, "output_length": 90, "proxy_request_id": "1373431:3:1383388:667", "request_id": "1373431:3:1383388:667", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1373431", "t_dispatch_unix": 1779821267.2741053, "t_finish_unix": 1779821269.4733899, "t_first_token_unix": 1779821268.1851482, "tpot_s": 0.014470689853501579, "trace_hash_ids": [57650, 57651, 57652, 57653, 57654, 57655, 57656, 57657, 57658, 57659, 57660, 57661, 57662, 57663, 57664, 57665, 57666, 57667, 57668, 57669, 57670, 57671, 57672, 57673, 57674, 57675, 57676, 57677, 57678, 57679, 57680, 57681, 57682, 11083275, 11083276, 11083277, 11083278, 11083279, 11268407, 11268408, 11268409, 11268410, 11268411, 11268412, 11268413, 11268414, 11268415, 12839907, 12839908, 12839909, 12839910, 12839911, 12839912, 12839913, 12839914, 12839915, 12839916, 12839917, 12839918, 12839919, 12839920, 12839921, 12839922, 12839923, 12839924, 12839925, 12839926, 12839927, 12839928, 12839929, 12839930, 12839931, 12839932, 12839933, 12839934, 12839935, 12839936, 12839937, 12839938, 12839939, 12839940, 12839941, 12839942, 12839943, 12839944, 12839945, 12839946, 12839947, 12839948, 12839949, 12839950, 12839951, 12839952, 12839953, 12839954, 12839955, 12839956, 12839957, 12839958, 12839959, 12839960, 12839961, 12839962, 12839963, 12839964, 12839965, 12839966, 12839967, 12839968, 12839969, 12839970, 12839971, 12839972, 12839973, 12839974, 12839975, 12839976, 12839977, 12839978, 12839979, 12839980, 12839981, 12839982, 12839983, 12839984, 12839985, 12839986, 12839987, 12839988, 12839989, 12839990, 12839991, 12839992, 12839993, 12839994, 12839995, 12839996, 12839997, 12839998, 12839999, 12840000, 12840001, 12840002, 12840003, 12840004, 12840005, 12840006, 12840007, 12840008, 12840009, 12840010, 12840011, 12840012, 12840013, 12840014, 12840015, 12840016, 12840017, 12840018, 12840019, 12840020, 12840021, 12840022, 13567592, 13567593, 13567594, 13567595, 13567596, 13567597, 13567598, 13567599, 13567600, 13567601, 13567602, 13567603, 13567604, 13567605, 13567606, 13567607, 13567608, 13567609, 13567610, 13567611, 13567612, 13567613, 13567614, 13567615, 13567616, 13567617, 13567618, 13567619, 13567620, 13567621, 13567622, 13567623, 13567624, 13567625, 13567626, 13567627, 13567628, 13567629, 13567630, 13567631, 13567632, 13567633, 13567634, 13567635, 13567636, 13567637, 13567638, 13567639, 13567640, 13567641, 13567642, 13567643, 13567644, 13567645, 13567646, 13567647, 13567648, 13567649, 13567650, 13567651, 13567652, 13567653, 13567654, 13567655, 13567656, 13567657, 13567658, 13567659, 13567660, 13567661, 13567662, 13567663, 13567664, 13567665, 13567666, 13567667, 13567668, 13567669, 13567670, 13567671, 13567672, 13567673, 13611158, 13655780, 13655781, 13702464, 13702465, 13702466], "trace_timestamp_s": 508.9840000000004, "ttft_s": 0.9110395430470817, "turn_id": 3} +{"actual_output_tokens": 81, "cached_tokens": 63376, "effective_input_length": 63643, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63643, "latency_s": 1.063107846013736, "output_length": 81, "proxy_request_id": "1253743:8:1404284:769", "request_id": "1253743:8:1404284:769", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253743", "t_dispatch_unix": 1779821269.1908836, "t_finish_unix": 1779821270.2539914, "t_first_token_unix": 1779821269.4785223, "tpot_s": 0.009690249037521425, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 481346, 481347, 481348, 710670, 710671, 710672, 710673, 710674, 710675, 710676, 710677, 710678, 710679, 13839194, 13839195, 13839196, 13839197, 13839198, 13839199, 13839200, 13839201, 13839202, 13839203, 13839204, 13839205, 13839206, 13839207, 13839208, 13839209, 13839210, 13839211, 13839212, 13839213, 13839214, 13839215, 13839216, 13839217, 13839218, 13839219, 184023, 184024, 567789, 13839220, 13839221, 146857, 146858, 146859, 146860, 13839222, 11521, 13839223, 13839224, 13839225, 13839226, 13839227, 13839228, 13839229, 13839230, 13839231, 13839232, 13839233, 13839234, 13839235, 13839236, 13839237, 13839238, 13839239, 13839240, 13839241, 13839242, 13839243, 13839244, 13839245, 13839246, 13839247, 13839248, 13839249, 13839250, 13839251, 13839252, 13839253, 13839254, 13839255, 13839256, 13839257, 11719668, 13839258, 13839259, 13839260, 13839261, 13839262, 13839263, 13839264, 13839265, 13839266, 13839267, 13839268, 13839269, 13839270, 13839271, 13839272, 13839273, 13894363], "trace_timestamp_s": 582.25, "ttft_s": 0.28763650299515575, "turn_id": 8} +{"actual_output_tokens": 458, "cached_tokens": 11472, "effective_input_length": 12910, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12910, "latency_s": 10.83918770001037, "output_length": 458, "proxy_request_id": "1398213:3:1401507:759", "request_id": "1398213:3:1401507:759", "request_type": "coder", "requested_output_tokens": 458, "session_id": "1398213", "t_dispatch_unix": 1779821259.6589577, "t_finish_unix": 1779821270.4981453, "t_first_token_unix": 1779821263.2516422, "tpot_s": 0.015855696603948255, "trace_hash_ids": [13837649, 13837650, 13837651, 13837652, 13837653, 13837654, 13837655, 13846300, 13846301, 13846302, 13846303, 13846304, 13851656, 13851657, 13851658, 13851659, 13851660, 13851661, 13860134, 13860135, 13860136, 13860137, 13869190, 13869191, 13869192, 13869193], "trace_timestamp_s": 572.7200000000003, "ttft_s": 3.5926827900111675, "turn_id": 3} +{"actual_output_tokens": 128, "cached_tokens": 0, "effective_input_length": 4991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4991, "latency_s": 16.372633939026855, "output_length": 128, "proxy_request_id": "1399948:1:1399948:748", "request_id": "1399948:1:1399948:748", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1399948", "t_dispatch_unix": 1779821254.1303055, "t_finish_unix": 1779821270.502939, "t_first_token_unix": 1779821254.4474971, "tpot_s": 0.12641776695262685, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13854387], "trace_timestamp_s": 567.1910000000007, "ttft_s": 0.3171902120229788, "turn_id": 1} +{"actual_output_tokens": 32, "cached_tokens": 16592, "effective_input_length": 26440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26440, "latency_s": 15.642362218990456, "output_length": 32, "proxy_request_id": "1397840:2:1400216:749", "request_id": "1397840:2:1400216:749", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1397840", "t_dispatch_unix": 1779821254.9284856, "t_finish_unix": 1779821270.5708477, "t_first_token_unix": 1779821256.6474698, "tpot_s": 0.4491276210643381, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13843674, 13843675, 13843676, 13843677, 13843678, 13843679, 13843680, 13843681, 13843682, 13843683, 13843684, 13856781, 13856782, 13856783, 13856784, 13856785, 13856786, 13856787, 13856788, 13856789], "trace_timestamp_s": 567.9860000000008, "ttft_s": 1.7189823120133951, "turn_id": 2} +{"actual_output_tokens": 27, "cached_tokens": 26464, "effective_input_length": 28603, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28603, "latency_s": 0.9795285019790754, "output_length": 27, "proxy_request_id": "1397840:3:1402568:761", "request_id": "1397840:3:1402568:761", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1397840", "t_dispatch_unix": 1779821270.5730994, "t_finish_unix": 1779821271.552628, "t_first_token_unix": 1779821271.1194193, "tpot_s": 0.016645145307008464, "trace_hash_ids": [13834561, 13834562, 13834563, 13834564, 13834565, 13834566, 13834567, 13834568, 13834569, 13834570, 13834571, 13834572, 13834573, 13834574, 13834575, 13834576, 13834577, 13834578, 13834579, 13834580, 13834581, 13834582, 13834583, 13834584, 13834585, 13834586, 13834587, 13834588, 13834589, 13834590, 13834591, 13834592, 13843674, 13843675, 13843676, 13843677, 13843678, 13843679, 13843680, 13843681, 13843682, 13843683, 13843684, 13856781, 13856782, 13856783, 13856784, 13856785, 13856786, 13856787, 13856788, 13878865, 13878866, 13878867, 13878868, 13878869], "trace_timestamp_s": 576.335, "ttft_s": 0.546317629981786, "turn_id": 3} +{"actual_output_tokens": 556, "cached_tokens": 49552, "effective_input_length": 62630, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62630, "latency_s": 13.487399260047823, "output_length": 556, "proxy_request_id": "1364090:5:1401054:756", "request_id": "1364090:5:1401054:756", "request_type": "coder", "requested_output_tokens": 556, "session_id": "1364090", "t_dispatch_unix": 1779821258.0709593, "t_finish_unix": 1779821271.5583587, "t_first_token_unix": 1779821262.8774486, "tpot_s": 0.015640803270339797, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13865242], "trace_timestamp_s": 571.1260000000002, "ttft_s": 4.806486246001441, "turn_id": 5} +{"actual_output_tokens": 568, "cached_tokens": 31536, "effective_input_length": 32332, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32332, "latency_s": 12.633460074022878, "output_length": 568, "proxy_request_id": "1355484:16:1401320:758", "request_id": "1355484:16:1401320:758", "request_type": "coder", "requested_output_tokens": 568, "session_id": "1355484", "t_dispatch_unix": 1779821259.0105627, "t_finish_unix": 1779821271.6440222, "t_first_token_unix": 1779821263.250467, "tpot_s": 0.01480302349208465, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 6808, 6809, 6810, 6811, 6812, 6813, 6814, 13396659, 13421576, 1252840, 1252841, 1252842, 13481585, 13549315, 13592318, 13592319, 13592320, 13592321, 13592322, 13653200, 13668400, 13711654, 13711655, 13711656, 13748326, 13748327, 13748328, 13781557, 13781558, 13781559, 13803562, 13837295, 13837296, 13837297, 13837298, 13837299, 13867393, 13867394, 13867395], "trace_timestamp_s": 572.0710000000008, "ttft_s": 4.239901766995899, "turn_id": 16} +{"actual_output_tokens": 88, "cached_tokens": 85680, "effective_input_length": 97657, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97657, "latency_s": 16.265903140010778, "output_length": 88, "proxy_request_id": "1366128:20:1400446:752", "request_id": "1366128:20:1400446:752", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1366128", "t_dispatch_unix": 1779821255.6910765, "t_finish_unix": 1779821271.9569793, "t_first_token_unix": 1779821263.5145714, "tpot_s": 0.09703565157492292, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600], "trace_timestamp_s": 568.7440000000006, "ttft_s": 7.823492327996064, "turn_id": 20} +{"actual_output_tokens": 47, "cached_tokens": 38128, "effective_input_length": 39203, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39203, "latency_s": 1.0208428089972585, "output_length": 47, "proxy_request_id": "1382089:2:1404847:773", "request_id": "1382089:2:1404847:773", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1382089", "t_dispatch_unix": 1779821271.1845653, "t_finish_unix": 1779821272.2054074, "t_first_token_unix": 1779821271.5870497, "tpot_s": 0.0134359024346138, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463], "trace_timestamp_s": 584.2460000000001, "ttft_s": 0.40248219401109964, "turn_id": 2} +{"actual_output_tokens": 43, "cached_tokens": 97744, "effective_input_length": 97814, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97814, "latency_s": 0.9862507090438157, "output_length": 43, "proxy_request_id": "1366128:21:1402408:760", "request_id": "1366128:21:1402408:760", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1366128", "t_dispatch_unix": 1779821271.9612412, "t_finish_unix": 1779821272.9474924, "t_first_token_unix": 1779821272.2047346, "tpot_s": 0.01767372242812555, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13877569], "trace_timestamp_s": 575.7920000000004, "ttft_s": 0.24349008302669972, "turn_id": 21} +{"actual_output_tokens": 34, "cached_tokens": 0, "effective_input_length": 21009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21009, "latency_s": 2.4444450280279852, "output_length": 34, "proxy_request_id": "1398594:2:1404702:771", "request_id": "1398594:2:1404702:771", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1398594", "t_dispatch_unix": 1779821270.6806579, "t_finish_unix": 1779821273.125103, "t_first_token_unix": 1779821272.8893306, "tpot_s": 0.007133245543985994, "trace_hash_ids": [13835320, 13835321, 13835322, 13835323, 13835324, 13835325, 13835326, 13841636, 13841637, 13841638, 13841639, 13841640, 13841641, 13841642, 13841643, 13848797, 13848798, 13848799, 13848800, 13848801, 13848802, 13858752, 13858753, 13858754, 13858755, 13858756, 13858757, 13858758, 13858759, 13858760, 13858761, 13867990, 13867991, 13867992, 13867993, 13877954, 13877955, 13884204, 13884205, 13897216, 13897217, 13897218], "trace_timestamp_s": 583.7370000000001, "ttft_s": 2.208671383035835, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 5104, "effective_input_length": 6149, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6149, "latency_s": 0.5172255639918149, "output_length": 13, "proxy_request_id": "1399948:2:1405276:778", "request_id": "1399948:2:1405276:778", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1399948", "t_dispatch_unix": 1779821272.6410909, "t_finish_unix": 1779821273.1583169, "t_first_token_unix": 1779821272.9027226, "tpot_s": 0.02125004441283333, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13902108], "trace_timestamp_s": 585.7030000000004, "ttft_s": 0.26162969903089106, "turn_id": 2} +{"actual_output_tokens": 13, "cached_tokens": 97856, "effective_input_length": 97917, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97917, "latency_s": 0.319241036020685, "output_length": 13, "proxy_request_id": "1366128:22:1403837:766", "request_id": "1366128:22:1403837:766", "request_type": "coder", "requested_output_tokens": 13, "session_id": "1366128", "t_dispatch_unix": 1779821272.95435, "t_finish_unix": 1779821273.2735908, "t_first_token_unix": 1779821273.1770983, "tpot_s": 0.008009766165438728, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13890604], "trace_timestamp_s": 580.759, "ttft_s": 0.22274484002264217, "turn_id": 22} +{"actual_output_tokens": 283, "cached_tokens": 51056, "effective_input_length": 68109, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 68109, "latency_s": 17.575664919044357, "output_length": 283, "proxy_request_id": "1381387:4:1400724:754", "request_id": "1381387:4:1400724:754", "request_type": "coder", "requested_output_tokens": 283, "session_id": "1381387", "t_dispatch_unix": 1779821256.802645, "t_finish_unix": 1779821274.3783102, "t_first_token_unix": 1779821270.0824249, "tpot_s": 0.015232397751768734, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13861879], "trace_timestamp_s": 569.8560000000007, "ttft_s": 13.27977748104604, "turn_id": 4} +{"actual_output_tokens": 49, "cached_tokens": 11248, "effective_input_length": 19966, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19966, "latency_s": 1.5983010409981944, "output_length": 49, "proxy_request_id": "1400379:4:1405483:779", "request_id": "1400379:4:1405483:779", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1400379", "t_dispatch_unix": 1779821273.3055873, "t_finish_unix": 1779821274.9038887, "t_first_token_unix": 1779821274.5373552, "tpot_s": 0.007629986062966054, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13889270, 13889271, 13889272, 13889273, 13889274, 13895605, 13895606, 13895607, 13895608, 13895609, 13903871, 13903872, 13903873, 13903874, 13903875, 13903876, 13903877, 13903878], "trace_timestamp_s": 586.3600000000006, "ttft_s": 1.231765104981605, "turn_id": 4} +{"actual_output_tokens": 1054, "cached_tokens": 20912, "effective_input_length": 20948, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20948, "latency_s": 12.099458826007321, "output_length": 1054, "proxy_request_id": "1363943:8:1379215:635", "request_id": "1363943:8:1379215:635", "request_type": "coder", "requested_output_tokens": 1054, "session_id": "1363943", "t_dispatch_unix": 1779821264.8301485, "t_finish_unix": 1779821276.9296067, "t_first_token_unix": 1779821265.4908729, "tpot_s": 0.010862714694242426, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416], "trace_timestamp_s": 494.45700000000033, "ttft_s": 0.6607218579738401, "turn_id": 8} +{"actual_output_tokens": 64, "cached_tokens": 20000, "effective_input_length": 22009, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22009, "latency_s": 0.9099920620210469, "output_length": 64, "proxy_request_id": "1400379:5:1406380:784", "request_id": "1400379:5:1406380:784", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1400379", "t_dispatch_unix": 1779821276.6811907, "t_finish_unix": 1779821277.5911827, "t_first_token_unix": 1779821277.0877042, "tpot_s": 0.007986874936798971, "trace_hash_ids": [13858188, 13858189, 13858190, 13858191, 13858192, 13858193, 13858194, 13875507, 13875508, 13875509, 13875510, 13875511, 13875512, 13875513, 13875514, 13875515, 13882803, 13882804, 13882805, 13882806, 13882807, 13889270, 13889271, 13889272, 13889273, 13889274, 13895605, 13895606, 13895607, 13895608, 13895609, 13903871, 13903872, 13903873, 13903874, 13903875, 13903876, 13903877, 13903878, 13912279, 13912280, 13912281, 13912282], "trace_timestamp_s": 589.7420000000002, "ttft_s": 0.4065117569989525, "turn_id": 5} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 2115, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2115, "latency_s": 0.8761743990471587, "output_length": 47, "proxy_request_id": "1406966:1:1406966:785", "request_id": "1406966:1:1406966:785", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1406966", "t_dispatch_unix": 1779821278.6707768, "t_finish_unix": 1779821279.546951, "t_first_token_unix": 1779821278.99371, "tpot_s": 0.01202059795690255, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13917925], "trace_timestamp_s": 591.732, "ttft_s": 0.32293255301192403, "turn_id": 1} +{"actual_output_tokens": 55, "cached_tokens": 0, "effective_input_length": 1531, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1531, "latency_s": 0.5351025099516846, "output_length": 55, "proxy_request_id": "1407494:1:1407494:787", "request_id": "1407494:1:1407494:787", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1407494", "t_dispatch_unix": 1779821280.4670582, "t_finish_unix": 1779821281.0021603, "t_first_token_unix": 1779821280.6077223, "tpot_s": 0.007298439610706366, "trace_hash_ids": [13922818, 13922819, 13922820], "trace_timestamp_s": 593.5290000000005, "ttft_s": 0.14066375099355355, "turn_id": 1} +{"actual_output_tokens": 1206, "cached_tokens": 0, "effective_input_length": 21684, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21684, "latency_s": 11.485356179007795, "output_length": 1206, "proxy_request_id": "1404395:1:1404395:770", "request_id": "1404395:1:1404395:770", "request_type": "coder", "requested_output_tokens": 1206, "session_id": "1404395", "t_dispatch_unix": 1779821269.5841854, "t_finish_unix": 1779821281.0695412, "t_first_token_unix": 1779821271.9248924, "tpot_s": 0.007588719829909225, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13895255], "trace_timestamp_s": 582.6379999999999, "ttft_s": 2.340705527982209, "turn_id": 1} +{"actual_output_tokens": 44, "cached_tokens": 0, "effective_input_length": 4789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4789, "latency_s": 0.5201106969616376, "output_length": 44, "proxy_request_id": "1406966:2:1407710:789", "request_id": "1406966:2:1407710:789", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1406966", "t_dispatch_unix": 1779821281.1485407, "t_finish_unix": 1779821281.6686513, "t_first_token_unix": 1779821281.450061, "tpot_s": 0.005076555418781936, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13924515, 13924516, 13924517, 13924518, 13924519, 13924520], "trace_timestamp_s": 594.21, "ttft_s": 0.30151916097383946, "turn_id": 2} +{"actual_output_tokens": 743, "cached_tokens": 22000, "effective_input_length": 23641, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23641, "latency_s": 5.147988591983449, "output_length": 743, "proxy_request_id": "1363943:9:1390468:707", "request_id": "1363943:9:1390468:707", "request_type": "coder", "requested_output_tokens": 743, "session_id": "1363943", "t_dispatch_unix": 1779821276.9318516, "t_finish_unix": 1779821282.07984, "t_first_token_unix": 1779821277.2968113, "tpot_s": 0.006445781582187626, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13768294], "trace_timestamp_s": 534.134, "ttft_s": 0.36495725001441315, "turn_id": 9} +{"actual_output_tokens": 76, "cached_tokens": 0, "effective_input_length": 2944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 2944, "latency_s": 0.5883245120057836, "output_length": 76, "proxy_request_id": "1407995:1:1407995:793", "request_id": "1407995:1:1407995:793", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1407995", "t_dispatch_unix": 1779821282.2819822, "t_finish_unix": 1779821282.8703067, "t_first_token_unix": 1779821282.4941416, "tpot_s": 0.005012359599738072, "trace_hash_ids": [13926947, 13926948, 13926949, 13926950, 13926951, 13926952], "trace_timestamp_s": 595.3430000000008, "ttft_s": 0.21215818304335698, "turn_id": 1} +{"actual_output_tokens": 193, "cached_tokens": 0, "effective_input_length": 1501, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1501, "latency_s": 2.6063509180094115, "output_length": 193, "proxy_request_id": "1407599:1:1407599:788", "request_id": "1407599:1:1407599:788", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1407599", "t_dispatch_unix": 1779821280.8148172, "t_finish_unix": 1779821283.421168, "t_first_token_unix": 1779821281.1057243, "tpot_s": 0.012058314968574754, "trace_hash_ids": [10764018, 13923669, 13923670], "trace_timestamp_s": 593.8770000000004, "ttft_s": 0.29090630600694567, "turn_id": 1} +{"actual_output_tokens": 56, "cached_tokens": 6160, "effective_input_length": 7995, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7995, "latency_s": 8.729113821987994, "output_length": 56, "proxy_request_id": "1399948:3:1405988:782", "request_id": "1399948:3:1405988:782", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1399948", "t_dispatch_unix": 1779821275.2617605, "t_finish_unix": 1779821283.990874, "t_first_token_unix": 1779821282.728585, "tpot_s": 0.022943712163462558, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13907778], "trace_timestamp_s": 588.3230000000003, "ttft_s": 7.466822622984182, "turn_id": 3} +{"actual_output_tokens": 23, "cached_tokens": 8048, "effective_input_length": 8540, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8540, "latency_s": 0.5290908999741077, "output_length": 23, "proxy_request_id": "1399948:4:1407140:786", "request_id": "1399948:4:1407140:786", "request_type": "coder", "requested_output_tokens": 23, "session_id": "1399948", "t_dispatch_unix": 1779821283.991642, "t_finish_unix": 1779821284.5207329, "t_first_token_unix": 1779821284.1227376, "tpot_s": 0.018075313953555782, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13919490], "trace_timestamp_s": 592.2640000000001, "ttft_s": 0.13109412899939343, "turn_id": 4} +{"actual_output_tokens": 39, "cached_tokens": 0, "effective_input_length": 7553, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7553, "latency_s": 0.7129832679638639, "output_length": 39, "proxy_request_id": "1408430:1:1408430:797", "request_id": "1408430:1:1408430:797", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1408430", "t_dispatch_unix": 1779821283.8120298, "t_finish_unix": 1779821284.5250127, "t_first_token_unix": 1779821284.3302286, "tpot_s": 0.00512054986871877, "trace_hash_ids": [13895286, 13899747, 13899748, 13906888, 13906889, 13914310, 13914311, 13914312, 13925471, 13925472, 13930592, 13930593, 13930594, 13930595, 13930596], "trace_timestamp_s": 596.8710000000001, "ttft_s": 0.518197972967755, "turn_id": 1} +{"actual_output_tokens": 24, "cached_tokens": 8560, "effective_input_length": 8612, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 8612, "latency_s": 0.5028369860374369, "output_length": 24, "proxy_request_id": "1399948:5:1407922:791", "request_id": "1399948:5:1407922:791", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1399948", "t_dispatch_unix": 1779821284.5212922, "t_finish_unix": 1779821285.0241299, "t_first_token_unix": 1779821284.6126678, "tpot_s": 0.017850083043373634, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13926411], "trace_timestamp_s": 595.0500000000002, "ttft_s": 0.09137407504022121, "turn_id": 5} +{"actual_output_tokens": 109, "cached_tokens": 97920, "effective_input_length": 109574, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109574, "latency_s": 10.120893180021085, "output_length": 109, "proxy_request_id": "1366128:23:1405900:781", "request_id": "1366128:23:1405900:781", "request_type": "coder", "requested_output_tokens": 109, "session_id": "1366128", "t_dispatch_unix": 1779821274.9233568, "t_finish_unix": 1779821285.0442493, "t_first_token_unix": 1779821282.5683393, "tpot_s": 0.022922909342688164, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13907243], "trace_timestamp_s": 587.9760000000006, "ttft_s": 7.644980748009402, "turn_id": 23} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 1801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1801, "latency_s": 0.3598286979831755, "output_length": 47, "proxy_request_id": "1408779:1:1408779:802", "request_id": "1408779:1:1408779:802", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1408779", "t_dispatch_unix": 1779821284.9192367, "t_finish_unix": 1779821285.2790656, "t_first_token_unix": 1779821285.0563276, "tpot_s": 0.004835385391387441, "trace_hash_ids": [13934169, 13934170, 13934171, 13934172], "trace_timestamp_s": 597.9740000000002, "ttft_s": 0.13708985998528078, "turn_id": 1} +{"actual_output_tokens": 110, "cached_tokens": 27456, "effective_input_length": 27786, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27786, "latency_s": 2.5449625040055253, "output_length": 110, "proxy_request_id": "1340290:7:1408176:795", "request_id": "1340290:7:1408176:795", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1340290", "t_dispatch_unix": 1779821282.9666991, "t_finish_unix": 1779821285.5116613, "t_first_token_unix": 1779821283.1603873, "tpot_s": 0.021567754476831014, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13928402], "trace_timestamp_s": 596.0280000000002, "ttft_s": 0.19368647801456973, "turn_id": 7} +{"actual_output_tokens": 3525, "cached_tokens": 88128, "effective_input_length": 106143, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106143, "latency_s": 51.50337138900068, "output_length": 3525, "proxy_request_id": "1370129:6:1394177:722", "request_id": "1370129:6:1394177:722", "request_type": "coder", "requested_output_tokens": 3525, "session_id": "1370129", "t_dispatch_unix": 1779821234.0100837, "t_finish_unix": 1779821285.513455, "t_first_token_unix": 1779821245.376234, "tpot_s": 0.011389611751147308, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 1068963, 1068964, 1068965, 1068966, 13089180, 13089181, 13520174, 13580706, 13580707, 13580708, 13580709, 13580710, 13580711, 13580712, 13580713, 13580714, 13580715, 13580716, 13580717, 13580718, 13611426, 13611427, 13611428, 13611429, 13611430, 13611431, 13611432, 13611433, 13611434, 13611435, 13611436, 13611437, 13611438, 13611439, 13611440, 13611441, 13611442, 13611443, 13611444, 13611445, 13611446, 13611447, 13611448, 13611449, 13611450, 13611451, 13611452, 13611453, 13611454, 13611455, 13611456, 13611457, 13611458, 13611459, 13611460, 13611461, 13611462, 13611463, 13611464, 13611465, 13611466, 13611467, 13611468, 13611469, 13611470, 13611471, 13611472, 13611473, 13611474, 13611475, 13611476, 13611477, 13611478, 13611479, 13611480, 13611481, 13611482, 13611483, 13611484, 13611485, 13611486, 13611487, 13611488, 13611489, 13611490, 13611491, 13611492, 13611493, 13611494, 13611495, 13611496, 13611497, 13611498, 13611499, 13611500, 13667056, 13667057, 13667058, 13667059, 13667060, 13667061, 13667062, 13667063, 13667064, 13667065, 13715489, 13715490, 13715491, 13715492, 13715493, 13715494, 13715495, 13715496, 13715497, 13715498, 13715499, 13715500, 13715501, 13715502, 13715503, 13715504, 13715505, 13715506, 13715507, 13715508, 13715509, 13715510, 13715511, 13715512, 13715513, 13715514, 13715515, 13715516, 13715517, 13715518, 13715519, 13715520, 13715521, 13715522, 13715523, 13715524, 13715525, 13715526, 13715527, 13715528, 13715529, 13715530, 13715531, 13715532, 13715533, 13715534, 13768317, 13768318, 13768319, 13768320, 13768321, 13801467, 13801468, 13801469, 13801470, 13801471, 13801472, 13801473, 13801474, 13801475, 13801476, 13801477, 13801478, 13801479, 13801480, 13801481, 13801482, 13801483, 13801484, 13801485, 13801486, 13801487, 13801488, 13801489, 13801490, 13801491, 13801492, 13801493, 13801494, 13801495, 13801496, 13801497, 13801498, 13801499, 13801500, 13801501, 13801502, 13801503], "trace_timestamp_s": 547.0610000000006, "ttft_s": 11.36614787200233, "turn_id": 6} +{"actual_output_tokens": 26, "cached_tokens": 0, "effective_input_length": 3230, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 3230, "latency_s": 0.3208358749980107, "output_length": 26, "proxy_request_id": "1408889:1:1408889:804", "request_id": "1408889:1:1408889:804", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1408889", "t_dispatch_unix": 1779821285.283606, "t_finish_unix": 1779821285.6044414, "t_first_token_unix": 1779821285.4811392, "tpot_s": 0.004921236999798566, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13935101], "trace_timestamp_s": 598.344, "ttft_s": 0.19753229204798117, "turn_id": 1} +{"actual_output_tokens": 39, "cached_tokens": 109680, "effective_input_length": 109775, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109775, "latency_s": 0.8330219119670801, "output_length": 39, "proxy_request_id": "1366128:24:1407996:794", "request_id": "1366128:24:1407996:794", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1366128", "t_dispatch_unix": 1779821285.048388, "t_finish_unix": 1779821285.8814101, "t_first_token_unix": 1779821285.348623, "tpot_s": 0.014012201315429258, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13926953], "trace_timestamp_s": 595.344, "ttft_s": 0.30023231299128383, "turn_id": 24} +{"actual_output_tokens": 191, "cached_tokens": 68384, "effective_input_length": 69508, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69508, "latency_s": 11.797055378032383, "output_length": 191, "proxy_request_id": "1381387:5:1404170:768", "request_id": "1381387:5:1404170:768", "request_type": "coder", "requested_output_tokens": 191, "session_id": "1381387", "t_dispatch_unix": 1779821274.3840258, "t_finish_unix": 1779821286.181081, "t_first_token_unix": 1779821275.0486808, "tpot_s": 0.05858990832103269, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13893570], "trace_timestamp_s": 581.8360000000002, "ttft_s": 0.6646520260255784, "turn_id": 5} +{"actual_output_tokens": 207, "cached_tokens": 0, "effective_input_length": 6377, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 6377, "latency_s": 1.9655909040011466, "output_length": 207, "proxy_request_id": "1408578:1:1408578:798", "request_id": "1408578:1:1408578:798", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1408578", "t_dispatch_unix": 1779821284.2328308, "t_finish_unix": 1779821286.1984217, "t_first_token_unix": 1779821284.6616647, "tpot_s": 0.007458102592104341, "trace_hash_ids": [13916254, 13916255, 13916256, 13916257, 13916258, 13916259, 13916260, 13921648, 13926172, 13926173, 13926174, 13931865, 13931866], "trace_timestamp_s": 597.2930000000006, "ttft_s": 0.428832917008549, "turn_id": 1} +{"actual_output_tokens": 641, "cached_tokens": 24368, "effective_input_length": 24442, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24442, "latency_s": 4.713118619984016, "output_length": 641, "proxy_request_id": "1363943:10:1401002:755", "request_id": "1363943:10:1401002:755", "request_type": "coder", "requested_output_tokens": 641, "session_id": "1363943", "t_dispatch_unix": 1779821282.0815418, "t_finish_unix": 1779821286.7946608, "t_first_token_unix": 1779821282.1597195, "tpot_s": 0.007241619290562084, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 13864501], "trace_timestamp_s": 570.9030000000002, "ttft_s": 0.07817544101271778, "turn_id": 10} +{"actual_output_tokens": 33, "cached_tokens": 0, "effective_input_length": 10736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10736, "latency_s": 40.4130793850054, "output_length": 33, "proxy_request_id": "1362265:5:1398180:741", "request_id": "1362265:5:1398180:741", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1362265", "t_dispatch_unix": 1779821248.0317442, "t_finish_unix": 1779821288.4448237, "t_first_token_unix": 1779821275.9200928, "tpot_s": 0.39138169940633816, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588], "trace_timestamp_s": 561.094, "ttft_s": 27.888347342028283, "turn_id": 5} +{"actual_output_tokens": 110, "cached_tokens": 69696, "effective_input_length": 71570, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71570, "latency_s": 2.360295794031117, "output_length": 110, "proxy_request_id": "1381387:6:1409195:806", "request_id": "1381387:6:1409195:806", "request_type": "coder", "requested_output_tokens": 110, "session_id": "1381387", "t_dispatch_unix": 1779821286.5458095, "t_finish_unix": 1779821288.906105, "t_first_token_unix": 1779821287.7266939, "tpot_s": 0.010817368844323235, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13937687, 13937688, 13937689, 13937690, 13937691], "trace_timestamp_s": 599.6050000000005, "ttft_s": 1.1808816560078412, "turn_id": 6} +{"actual_output_tokens": 65, "cached_tokens": 68624, "effective_input_length": 73188, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73188, "latency_s": 7.648806271958165, "output_length": 65, "proxy_request_id": "1363093:5:1407810:790", "request_id": "1363093:5:1407810:790", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1363093", "t_dispatch_unix": 1779821281.5916219, "t_finish_unix": 1779821289.2404284, "t_first_token_unix": 1779821287.9135036, "tpot_s": 0.020727933578200464, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678, 13925441, 13925442, 13925443, 13925444, 13925445, 13925446, 13925447, 13925448, 13925449], "trace_timestamp_s": 594.6500000000005, "ttft_s": 6.321879157971125, "turn_id": 5} +{"actual_output_tokens": 46, "cached_tokens": 10768, "effective_input_length": 10816, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10816, "latency_s": 0.9990137440036051, "output_length": 46, "proxy_request_id": "1362265:6:1399937:747", "request_id": "1362265:6:1399937:747", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1362265", "t_dispatch_unix": 1779821288.4455876, "t_finish_unix": 1779821289.4446015, "t_first_token_unix": 1779821288.547021, "tpot_s": 0.01993528820005142, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 13854355], "trace_timestamp_s": 567.1610000000001, "ttft_s": 0.10143089899793267, "turn_id": 6} +{"actual_output_tokens": 196, "cached_tokens": 27888, "effective_input_length": 29730, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29730, "latency_s": 3.1724377339705825, "output_length": 196, "proxy_request_id": "1340290:8:1409129:805", "request_id": "1340290:8:1409129:805", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1340290", "t_dispatch_unix": 1779821286.2893384, "t_finish_unix": 1779821289.4617758, "t_first_token_unix": 1779821286.741756, "tpot_s": 0.0139475832409703, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13936967], "trace_timestamp_s": 599.3500000000004, "ttft_s": 0.4524152569938451, "turn_id": 8} +{"actual_output_tokens": 30, "cached_tokens": 1840, "effective_input_length": 5001, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 5001, "latency_s": 0.6525516029796563, "output_length": 30, "proxy_request_id": "1408779:2:1410032:807", "request_id": "1408779:2:1410032:807", "request_type": "coder", "requested_output_tokens": 30, "session_id": "1408779", "t_dispatch_unix": 1779821289.433144, "t_finish_unix": 1779821290.0856955, "t_first_token_unix": 1779821289.66891, "tpot_s": 0.014361125896765112, "trace_hash_ids": [13934169, 13934170, 13934171, 13940285, 13940286, 13945464, 13945465, 13945466, 13945467, 13945468], "trace_timestamp_s": 602.4940000000006, "ttft_s": 0.23576460196636617, "turn_id": 2} +{"actual_output_tokens": 39, "cached_tokens": 4832, "effective_input_length": 7893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7893, "latency_s": 0.4937338190502487, "output_length": 39, "proxy_request_id": "1406966:3:1410097:808", "request_id": "1406966:3:1410097:808", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1406966", "t_dispatch_unix": 1779821289.666394, "t_finish_unix": 1779821290.1601276, "t_first_token_unix": 1779821289.9468372, "tpot_s": 0.005604469209701117, "trace_hash_ids": [13917921, 13917922, 13917923, 13917924, 13924515, 13924516, 13924517, 13924518, 13924519, 13938672, 13938673, 13938674, 13938675, 13938676, 13945877, 13945878], "trace_timestamp_s": 602.7270000000008, "ttft_s": 0.28044147102627903, "turn_id": 3} +{"actual_output_tokens": 28, "cached_tokens": 1584, "effective_input_length": 4728, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4728, "latency_s": 0.3641014590393752, "output_length": 28, "proxy_request_id": "1407494:2:1410400:809", "request_id": "1407494:2:1410400:809", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1407494", "t_dispatch_unix": 1779821290.5322776, "t_finish_unix": 1779821290.8963785, "t_first_token_unix": 1779821290.7609398, "tpot_s": 0.00500704240726514, "trace_hash_ids": [13922818, 13922819, 13922820, 13939528, 13939529, 13939530, 13948712, 13948713, 13948714, 13948715], "trace_timestamp_s": 603.5920000000006, "ttft_s": 0.22866089700255543, "turn_id": 2} +{"actual_output_tokens": 91, "cached_tokens": 10848, "effective_input_length": 11070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11070, "latency_s": 1.6389088950236328, "output_length": 91, "proxy_request_id": "1362265:7:1408772:800", "request_id": "1362265:7:1408772:800", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1362265", "t_dispatch_unix": 1779821289.4454448, "t_finish_unix": 1779821291.0843542, "t_first_token_unix": 1779821289.5456514, "tpot_s": 0.017092745244735853, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 13934071], "trace_timestamp_s": 597.9570000000003, "ttft_s": 0.10020485799759626, "turn_id": 7} +{"actual_output_tokens": 56, "cached_tokens": 3248, "effective_input_length": 4825, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 4825, "latency_s": 0.42746547097340226, "output_length": 56, "proxy_request_id": "1408889:2:1410453:810", "request_id": "1408889:2:1410453:810", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1408889", "t_dispatch_unix": 1779821290.6696954, "t_finish_unix": 1779821291.0971603, "t_first_token_unix": 1779821290.8164663, "tpot_s": 0.0050999609816988764, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13940392, 13940393, 13948965, 13948966], "trace_timestamp_s": 603.7310000000007, "ttft_s": 0.1467700419598259, "turn_id": 2} +{"actual_output_tokens": 196, "cached_tokens": 0, "effective_input_length": 93040, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93040, "latency_s": 45.87228856998263, "output_length": 196, "proxy_request_id": "1397515:1:1397515:736", "request_id": "1397515:1:1397515:736", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1397515", "t_dispatch_unix": 1779821245.5351937, "t_finish_unix": 1779821291.407482, "t_first_token_unix": 1779821274.4048965, "tpot_s": 0.08719109709237297, "trace_hash_ids": [61256, 61257, 9334, 61258, 61259, 61260, 61261, 61262, 61263, 61264, 61265, 139791, 92491, 139792, 139793, 139794, 139795, 139796, 139797, 139798, 740834, 740835, 740836, 740837, 1942273, 1942274, 1942275, 1942276, 1942277, 1942278, 1942279, 1942280, 1942281, 590845, 590846, 590847, 590848, 1942282, 161018, 161019, 161020, 161021, 1942283, 10351134, 10351135, 10351136, 10351137, 10351138, 10351139, 10351140, 10351141, 10351142, 10351143, 13831505, 2806911, 13831506, 13831507, 13831508, 13831509, 13831510, 13831511, 13831512, 13831513, 13831514, 13831515, 13831516, 13831517, 13831518, 13831519, 13831520, 13831521, 13831522, 13831523, 13831524, 13831525, 13831526, 13831527, 13831528, 13831529, 13831530, 13831531, 13831532, 13831533, 13831534, 13831535, 13831536, 13831537, 13831538, 13831539, 13831540, 13831541, 13831542, 13831543, 13831544, 13831545, 13831546, 13831547, 13831548, 13831549, 13831550, 13831551, 13831552, 13831553, 13831554, 13831555, 13831556, 13831557, 13831558, 13831559, 13831560, 13831561, 13831562, 13831563, 13831564, 13831565, 13831566, 13831567, 13831568, 13831569, 13831570, 13831571, 13831572, 13831573, 13831574, 13831575, 13831576, 13831577, 13831578, 13831579, 13831580, 13831581, 13831582, 13831583, 13831584, 13831585, 13831586, 13831587, 13831588, 13831589, 13831590, 13831591, 13831592, 13831593, 13831594, 13831595, 13831596, 13831597, 13831598, 13831599, 13831600, 13831601, 13831602, 13831603, 13831604, 13831605, 13831606, 13831607, 13831608, 13831609, 13831610, 13831611, 13831612, 13831613, 13831614, 13831615, 13831616, 13831617, 13831618, 13831619, 13831620, 13831621, 13831622, 13831623, 13831624, 13831625, 13831626, 13831627, 13831628, 13831629, 13831630, 13831631, 13831632], "trace_timestamp_s": 558.5540000000001, "ttft_s": 28.869700340961572, "turn_id": 1} +{"actual_output_tokens": 49, "cached_tokens": 29920, "effective_input_length": 29958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29958, "latency_s": 0.666962624003645, "output_length": 49, "proxy_request_id": "1340290:9:1410595:811", "request_id": "1340290:9:1410595:811", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1340290", "t_dispatch_unix": 1779821291.0855267, "t_finish_unix": 1779821291.7524893, "t_first_token_unix": 1779821291.1606176, "tpot_s": 0.012322597707679961, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13950218], "trace_timestamp_s": 604.1469999999999, "ttft_s": 0.07508826203411445, "turn_id": 9} +{"actual_output_tokens": 18, "cached_tokens": 8624, "effective_input_length": 11381, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11381, "latency_s": 0.4211102079716511, "output_length": 18, "proxy_request_id": "1399948:6:1410696:812", "request_id": "1399948:6:1410696:812", "request_type": "coder", "requested_output_tokens": 18, "session_id": "1399948", "t_dispatch_unix": 1779821291.418036, "t_finish_unix": 1779821291.8391461, "t_first_token_unix": 1779821291.7519588, "tpot_s": 0.005109618120032418, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 13951145], "trace_timestamp_s": 604.4790000000003, "ttft_s": 0.33392087696120143, "turn_id": 6} +{"actual_output_tokens": 249, "cached_tokens": 61552, "effective_input_length": 85438, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85438, "latency_s": 20.486166879010852, "output_length": 249, "proxy_request_id": "1373577:3:1404917:774", "request_id": "1373577:3:1404917:774", "request_type": "coder", "requested_output_tokens": 249, "session_id": "1373577", "t_dispatch_unix": 1779821271.4724836, "t_finish_unix": 1779821291.95865, "t_first_token_unix": 1779821285.868311, "tpot_s": 0.024556518056347305, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13898584, 13898585, 13898586, 13898587, 13898588, 13898589, 13898590, 13898591, 13898592], "trace_timestamp_s": 584.531, "ttft_s": 14.395825659041293, "turn_id": 3} +{"actual_output_tokens": 31, "cached_tokens": 5024, "effective_input_length": 7110, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7110, "latency_s": 0.3536489889957011, "output_length": 31, "proxy_request_id": "1408779:3:1411249:815", "request_id": "1408779:3:1411249:815", "request_type": "coder", "requested_output_tokens": 31, "session_id": "1408779", "t_dispatch_unix": 1779821293.447217, "t_finish_unix": 1779821293.8008657, "t_first_token_unix": 1779821293.6487536, "tpot_s": 0.005060386300707857, "trace_hash_ids": [13934169, 13934170, 13934171, 13940285, 13940286, 13945464, 13945465, 13945466, 13945467, 13956042, 13956043, 13956044, 13956045, 13956046], "trace_timestamp_s": 606.5080000000007, "ttft_s": 0.2015345260151662, "turn_id": 3} +{"actual_output_tokens": 192, "cached_tokens": 85680, "effective_input_length": 90818, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90818, "latency_s": 4.76577030000044, "output_length": 192, "proxy_request_id": "1373577:4:1408642:799", "request_id": "1373577:4:1408642:799", "request_type": "coder", "requested_output_tokens": 192, "session_id": "1373577", "t_dispatch_unix": 1779821291.9647648, "t_finish_unix": 1779821296.7305353, "t_first_token_unix": 1779821294.897032, "tpot_s": 0.009597542639017222, "trace_hash_ids": [30055, 231418, 231419, 231420, 231421, 231422, 231423, 252744, 252745, 252746, 252747, 3133, 3651868, 3651869, 3651870, 3651871, 3651872, 3651873, 3651874, 3904549, 10482905, 6324555, 13612320, 13612321, 13612322, 13612323, 13612324, 13612325, 13612326, 13612327, 13612328, 13612329, 13612330, 13612331, 13612332, 13612333, 13612334, 13612335, 13612336, 13612337, 13612338, 13612339, 13612340, 13612341, 13612342, 13612343, 13612344, 13612345, 13612346, 13612347, 13612348, 13612349, 13612350, 13612351, 13612352, 13612353, 13612354, 13612355, 13612356, 13612357, 13612358, 13612359, 13612360, 13612361, 13612362, 13612363, 13612364, 13612365, 13612366, 13612367, 13612368, 13612369, 13612370, 13612371, 13612372, 13612373, 13612374, 13612375, 13612376, 13612377, 13612378, 13612379, 13612380, 13612381, 13612382, 13612383, 13612384, 13612385, 13612386, 13612387, 13612388, 13612389, 13612390, 13612391, 13612392, 13612393, 13612394, 13612395, 13612396, 13612397, 13612398, 13612399, 13612400, 13612401, 13612402, 13612403, 13612404, 13612405, 13612406, 13612407, 13612408, 13612409, 13612410, 13612411, 13612412, 13612413, 13612414, 13612415, 13612416, 13612417, 13612418, 13612419, 13612420, 13612421, 13612422, 13612423, 13612424, 13612425, 13612426, 13612427, 13612428, 13612429, 13612430, 13612431, 13612432, 13612433, 13612434, 13612435, 13612436, 13612437, 13612438, 13612439, 13612440, 13612441, 13612442, 13612443, 13612444, 13612445, 13612446, 13612447, 13612448, 13612449, 13612450, 13612451, 13612452, 13677770, 13677771, 13677772, 13898584, 13898585, 13898586, 13898587, 13898588, 13898589, 13898590, 13898591, 13898592, 13932466, 13932467, 13932468, 13932469, 13932470, 13932471, 13932472, 13932473, 13932474, 13932475, 13932476], "trace_timestamp_s": 597.5, "ttft_s": 2.9322633799747564, "turn_id": 4} +{"actual_output_tokens": 46, "cached_tokens": 109808, "effective_input_length": 117746, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117746, "latency_s": 6.844642548006959, "output_length": 46, "proxy_request_id": "1366128:25:1411126:813", "request_id": "1366128:25:1411126:813", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1366128", "t_dispatch_unix": 1779821293.0335782, "t_finish_unix": 1779821299.8782198, "t_first_token_unix": 1779821298.6150284, "tpot_s": 0.028065242044006785, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916], "trace_timestamp_s": 606.0870000000004, "ttft_s": 5.581448762037326, "turn_id": 25} +{"actual_output_tokens": 115, "cached_tokens": 61984, "effective_input_length": 121811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121811, "latency_s": 39.158308170037344, "output_length": 115, "proxy_request_id": "1313181:7:1327489:383", "request_id": "1313181:7:1327489:383", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1313181", "t_dispatch_unix": 1779821261.4233994, "t_finish_unix": 1779821300.5817075, "t_first_token_unix": 1779821295.34622, "tpot_s": 0.045922893025961364, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321], "trace_timestamp_s": 313.01800000000003, "ttft_s": 33.92281765904045, "turn_id": 7} +{"actual_output_tokens": 212, "cached_tokens": 0, "effective_input_length": 27676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27676, "latency_s": 20.04945414199028, "output_length": 212, "proxy_request_id": "1286804:5:1407989:792", "request_id": "1286804:5:1407989:792", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1286804", "t_dispatch_unix": 1779821282.2531137, "t_finish_unix": 1779821302.302568, "t_first_token_unix": 1779821298.349015, "tpot_s": 0.018735605867202194, "trace_hash_ids": [3411, 3412, 3413, 3414, 3415, 3416, 3417, 3418, 160223, 160224, 160225, 160226, 160227, 197179, 188284, 197180, 197181, 197182, 988980, 159427, 159428, 159429, 12663534, 12663535, 12802938, 12802939, 12802940, 12930548, 13438556, 13438557, 13654392, 13654393, 13654394, 13654395, 13654396, 13654397, 13654398, 13654399, 13654400, 13654401, 13654402, 13654403, 13654404, 13926882, 13926883, 13926884, 13926885, 13926886, 13926887, 13926888, 13926889, 13926890, 13926891, 13926892, 13926893], "trace_timestamp_s": 595.3130000000001, "ttft_s": 16.095899206004106, "turn_id": 5} +{"actual_output_tokens": 63, "cached_tokens": 0, "effective_input_length": 9801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9801, "latency_s": 1.084876541979611, "output_length": 63, "proxy_request_id": "1407494:3:1413526:825", "request_id": "1407494:3:1413526:825", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1407494", "t_dispatch_unix": 1779821301.4806457, "t_finish_unix": 1779821302.565522, "t_first_token_unix": 1779821302.2388027, "tpot_s": 0.0052658829193997884, "trace_hash_ids": [13922818, 13922819, 13922820, 13939528, 13939529, 13939530, 13948712, 13948713, 13948714, 13962495, 13962496, 13962497, 13962498, 13962499, 13962500, 13962501, 13962502, 13977212, 13977213, 13977214], "trace_timestamp_s": 614.5410000000002, "ttft_s": 0.758155828982126, "turn_id": 3} +{"actual_output_tokens": 74, "cached_tokens": 0, "effective_input_length": 22392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22392, "latency_s": 2.8837402840144932, "output_length": 74, "proxy_request_id": "1407995:2:1413725:826", "request_id": "1407995:2:1413725:826", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1407995", "t_dispatch_unix": 1779821302.1069129, "t_finish_unix": 1779821304.990653, "t_first_token_unix": 1779821304.5639567, "tpot_s": 0.005841316725446345, "trace_hash_ids": [13926947, 13926948, 13926949, 13926950, 13926951, 13936036, 13936037, 13936038, 13936039, 13936040, 13945776, 13945777, 13945778, 13945779, 13955974, 13955975, 13955976, 13955977, 13955978, 13955979, 13955980, 13964295, 13964296, 13964297, 13964298, 13964299, 13964300, 13964301, 13964302, 13971392, 13971393, 13971394, 13971395, 13971396, 13971397, 13971398, 13978636, 13978637, 13978638, 13978639, 13978640, 13978641, 13978642, 13978643], "trace_timestamp_s": 615.1620000000003, "ttft_s": 2.4570420240052044, "turn_id": 2} +{"actual_output_tokens": 185, "cached_tokens": 4880, "effective_input_length": 10633, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10633, "latency_s": 1.5349107880028896, "output_length": 185, "proxy_request_id": "1408889:3:1414177:827", "request_id": "1408889:3:1414177:827", "request_type": "coder", "requested_output_tokens": 185, "session_id": "1408889", "t_dispatch_unix": 1779821303.6111786, "t_finish_unix": 1779821305.1460896, "t_first_token_unix": 1779821304.1482997, "tpot_s": 0.0054213212826415775, "trace_hash_ids": [13935095, 13935096, 13935097, 13935098, 13935099, 13935100, 13940392, 13940393, 13948965, 13956064, 13956065, 13962134, 13962135, 13962136, 13968978, 13968979, 13968980, 13968981, 13968982, 13983352, 13983353], "trace_timestamp_s": 616.6710000000003, "ttft_s": 0.5371196210035123, "turn_id": 3} +{"actual_output_tokens": 393, "cached_tokens": 62016, "effective_input_length": 62018, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62018, "latency_s": 6.215101779031102, "output_length": 393, "proxy_request_id": "1313181:7:1382851:662", "request_id": "1313181:7:1382851:662", "request_type": "coder", "requested_output_tokens": 393, "session_id": "1313181", "t_dispatch_unix": 1779821300.5852664, "t_finish_unix": 1779821306.8003683, "t_first_token_unix": 1779821300.7103693, "tpot_s": 0.015535038892935239, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13697374], "trace_timestamp_s": 507.1290000000008, "ttft_s": 0.1251006789971143, "turn_id": 7} +{"actual_output_tokens": 43, "cached_tokens": 11392, "effective_input_length": 11537, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11537, "latency_s": 8.57617219601525, "output_length": 43, "proxy_request_id": "1399948:7:1413205:824", "request_id": "1399948:7:1413205:824", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1399948", "t_dispatch_unix": 1779821300.2948446, "t_finish_unix": 1779821308.8710172, "t_first_token_unix": 1779821307.7381659, "tpot_s": 0.026964082381233483, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 13974423], "trace_timestamp_s": 613.357, "ttft_s": 7.443319624988362, "turn_id": 7} +{"actual_output_tokens": 280, "cached_tokens": 30000, "effective_input_length": 30154, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30154, "latency_s": 18.27569036197383, "output_length": 280, "proxy_request_id": "1340290:10:1411397:816", "request_id": "1340290:10:1411397:816", "request_type": "coder", "requested_output_tokens": 280, "session_id": "1340290", "t_dispatch_unix": 1779821294.0718167, "t_finish_unix": 1779821312.3475068, "t_first_token_unix": 1779821299.18523, "tpot_s": 0.04717515661643224, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145], "trace_timestamp_s": 607.1330000000007, "ttft_s": 5.11341051798081, "turn_id": 10} +{"actual_output_tokens": 241, "cached_tokens": 117776, "effective_input_length": 127989, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127989, "latency_s": 13.818407098005991, "output_length": 241, "proxy_request_id": "1366128:26:1413108:823", "request_id": "1366128:26:1413108:823", "request_type": "coder", "requested_output_tokens": 241, "session_id": "1366128", "t_dispatch_unix": 1779821299.9100146, "t_finish_unix": 1779821313.7284217, "t_first_token_unix": 1779821307.7236784, "tpot_s": 0.025018134416798905, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401], "trace_timestamp_s": 612.9639999999999, "ttft_s": 7.8136612349771895, "turn_id": 26} +{"actual_output_tokens": 249, "cached_tokens": 30432, "effective_input_length": 35022, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35022, "latency_s": 4.106423838005867, "output_length": 249, "proxy_request_id": "1340290:11:1413050:822", "request_id": "1340290:11:1413050:822", "request_type": "coder", "requested_output_tokens": 249, "session_id": "1340290", "t_dispatch_unix": 1779821312.3506057, "t_finish_unix": 1779821316.4570298, "t_first_token_unix": 1779821313.52521, "tpot_s": 0.011820548387233077, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 13972768], "trace_timestamp_s": 612.7440000000006, "ttft_s": 1.1746012159856036, "turn_id": 11} +{"actual_output_tokens": 90, "cached_tokens": 128224, "effective_input_length": 128433, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128433, "latency_s": 1.778633457957767, "output_length": 90, "proxy_request_id": "1366128:27:1417788:831", "request_id": "1366128:27:1417788:831", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1366128", "t_dispatch_unix": 1779821316.5001569, "t_finish_unix": 1779821318.2787902, "t_first_token_unix": 1779821316.9359074, "tpot_s": 0.015084936157303204, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401, 14013930], "trace_timestamp_s": 629.5560000000005, "ttft_s": 0.4357477379962802, "turn_id": 27} +{"actual_output_tokens": 53, "cached_tokens": 8944, "effective_input_length": 14728, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14728, "latency_s": 39.26170459704008, "output_length": 53, "proxy_request_id": "1403188:2:1408249:796", "request_id": "1403188:2:1408249:796", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1403188", "t_dispatch_unix": 1779821283.228274, "t_finish_unix": 1779821322.4899788, "t_first_token_unix": 1779821321.6376758, "tpot_s": 0.016383763462027464, "trace_hash_ids": [13929233, 13929234, 13929235, 13929236, 13929237, 13929238, 13929239, 13929240, 13929241, 13929242, 13929243, 13929244, 13929245, 13929246, 13929247, 13929248, 13929249, 13929250, 13929251, 13929252, 13929253, 13929254, 13929255, 13929256, 13929257, 13929258, 13929259, 13929260, 13929261], "trace_timestamp_s": 596.2850000000008, "ttft_s": 38.40939945500577, "turn_id": 2} +{"actual_output_tokens": 111, "cached_tokens": 0, "effective_input_length": 119977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119977, "latency_s": 49.27118721802253, "output_length": 111, "proxy_request_id": "1275274:2:1405679:780", "request_id": "1275274:2:1405679:780", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1275274", "t_dispatch_unix": 1779821274.081227, "t_finish_unix": 1779821323.3524137, "t_first_token_unix": 1779821321.345511, "tpot_s": 0.018241939700039272, "trace_hash_ids": [9491467, 195037, 195038, 195039, 195040, 195041, 195042, 195043, 195044, 10319406, 10319407, 10319408, 10319409, 10319410, 10319411, 10319412, 10319413, 10319414, 5374859, 10319415, 10319416, 816846, 10319417, 10319418, 10319419, 10319420, 194680, 194681, 10319421, 10319422, 10319423, 10319424, 10319425, 10319426, 10319427, 10319428, 10319429, 10319430, 10319431, 10319432, 10319433, 10319434, 10319435, 10319436, 10319437, 10319438, 10319439, 10319440, 10319441, 10319442, 10319443, 10319444, 10319445, 10319446, 10319447, 10319448, 10319449, 10319450, 10319451, 10319452, 10319453, 10319454, 10319455, 10319456, 10319457, 10319458, 10319459, 10319460, 10319461, 10319462, 10319463, 10319464, 10319465, 10319466, 10319467, 10319468, 10319469, 10319470, 10319471, 10319472, 10319473, 10319474, 10319475, 10319476, 10319477, 10319478, 10319479, 10319480, 10319481, 10319482, 10319483, 10319484, 10319485, 10319486, 10319487, 10319488, 10319489, 10319490, 10319491, 10319492, 10319493, 10319494, 10319495, 10319496, 10319497, 10319498, 10319499, 10319500, 10319501, 10319502, 10319503, 10319504, 10319505, 10319506, 10319507, 10319508, 10319509, 10319510, 10319511, 10319512, 10319513, 10319514, 10319515, 10319516, 10319517, 10319518, 10319519, 10319520, 10319521, 10319522, 10319523, 10319524, 10319525, 10319526, 10319527, 10319528, 10319529, 10319530, 10319531, 10319532, 10319533, 10319534, 10319535, 10319536, 10319537, 10319538, 10319539, 10319540, 10319541, 10319542, 10319543, 10319544, 10319545, 10319546, 10319547, 10319548, 10319549, 10319550, 10319551, 10319552, 10319553, 10319554, 10319555, 10319556, 10319557, 10319558, 10319559, 10319560, 10319561, 10319562, 10319563, 10319564, 10319565, 10319566, 10319567, 10319568, 10319569, 10319570, 10319571, 10319572, 10319573, 10451843, 10538212, 10538213, 10590028, 10695557, 10848849, 10848850, 10848851, 10949071, 11065667, 11650526, 11650527, 11650528, 11717015, 11717016, 11717017, 11717018, 11717019, 11717020, 11796353, 11796354, 11796355, 11796356, 11895285, 12041647, 12041648, 12041649, 12041650, 12193888, 12247657, 12247658, 12247659, 12247660, 12374859, 12374860, 12374861, 12437166, 12437167, 12596754, 12596755, 12690937, 12844572, 12844573, 12844574, 12844575, 12958938, 13103548, 13103549, 13454539, 13674772, 13905368, 13905369, 13905370, 13905371], "trace_timestamp_s": 587.1360000000004, "ttft_s": 47.264281990006566, "turn_id": 2} +{"actual_output_tokens": 46, "cached_tokens": 11120, "effective_input_length": 11132, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11132, "latency_s": 0.4299926530220546, "output_length": 46, "proxy_request_id": "1362265:8:1419710:834", "request_id": "1362265:8:1419710:834", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1362265", "t_dispatch_unix": 1779821323.1965017, "t_finish_unix": 1779821323.6264942, "t_first_token_unix": 1779821323.248632, "tpot_s": 0.008391877778598832, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065], "trace_timestamp_s": 636.2580000000007, "ttft_s": 0.052128073992207646, "turn_id": 8} +{"actual_output_tokens": 264, "cached_tokens": 0, "effective_input_length": 44148, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44148, "latency_s": 56.94234958902234, "output_length": 264, "proxy_request_id": "1268861:8:1403753:765", "request_id": "1268861:8:1403753:765", "request_type": "coder", "requested_output_tokens": 264, "session_id": "1268861", "t_dispatch_unix": 1779821267.4190383, "t_finish_unix": 1779821324.3613877, "t_first_token_unix": 1779821275.0535011, "tpot_s": 0.1874793300227202, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 13890053], "trace_timestamp_s": 580.4790000000003, "ttft_s": 7.634460118017159, "turn_id": 8} +{"actual_output_tokens": 47, "cached_tokens": 0, "effective_input_length": 11503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11503, "latency_s": 58.38504317298066, "output_length": 47, "proxy_request_id": "1405199:1:1405199:776", "request_id": "1405199:1:1405199:776", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1405199", "t_dispatch_unix": 1779821272.4197037, "t_finish_unix": 1779821330.804747, "t_first_token_unix": 1779821278.0073442, "tpot_s": 1.1477610588696299, "trace_hash_ids": [13880436, 13880437, 13880438, 13880439, 13880440, 13880441, 13880442, 13880443, 13880444, 13880445, 13880446, 13880447, 13880448, 13880449, 13886683, 13886684, 13886685, 13893489, 13901376, 13901377, 13901378, 13901379, 13901380], "trace_timestamp_s": 585.4770000000008, "ttft_s": 5.5876387630123645, "turn_id": 1} +{"actual_output_tokens": 212, "cached_tokens": 35264, "effective_input_length": 35303, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35303, "latency_s": 2.5503875120193698, "output_length": 212, "proxy_request_id": "1340290:12:1421294:835", "request_id": "1340290:12:1421294:835", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1340290", "t_dispatch_unix": 1779821328.8429635, "t_finish_unix": 1779821331.3933513, "t_first_token_unix": 1779821328.952044, "tpot_s": 0.01156885730807771, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840], "trace_timestamp_s": 641.9040000000005, "ttft_s": 0.10907837201375514, "turn_id": 12} +{"actual_output_tokens": 35, "cached_tokens": 11168, "effective_input_length": 11879, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11879, "latency_s": 0.4510381579748355, "output_length": 35, "proxy_request_id": "1362265:9:1422050:838", "request_id": "1362265:9:1422050:838", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1362265", "t_dispatch_unix": 1779821331.661809, "t_finish_unix": 1779821332.1128473, "t_first_token_unix": 1779821331.8232415, "tpot_s": 0.008506996353389695, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065, 14053142, 14053143], "trace_timestamp_s": 644.7240000000002, "ttft_s": 0.16143121797358617, "turn_id": 9} +{"actual_output_tokens": 221, "cached_tokens": 44400, "effective_input_length": 49308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49308, "latency_s": 3.2308052540174685, "output_length": 221, "proxy_request_id": "1268861:9:1421319:836", "request_id": "1268861:9:1421319:836", "request_type": "coder", "requested_output_tokens": 221, "session_id": "1268861", "t_dispatch_unix": 1779821328.923894, "t_finish_unix": 1779821332.154699, "t_first_token_unix": 1779821330.5140238, "tpot_s": 0.007456298550029963, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14046030], "trace_timestamp_s": 641.9830000000002, "ttft_s": 1.5901198019855656, "turn_id": 9} +{"actual_output_tokens": 49, "cached_tokens": 128512, "effective_input_length": 128642, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128642, "latency_s": 1.11716946400702, "output_length": 49, "proxy_request_id": "1366128:28:1421998:837", "request_id": "1366128:28:1421998:837", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1366128", "t_dispatch_unix": 1779821331.4783916, "t_finish_unix": 1779821332.5955606, "t_first_token_unix": 1779821331.9121835, "tpot_s": 0.014232074354367796, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2253022, 13553881, 13553882, 13553883, 13553884, 13553885, 13553886, 13553887, 13553888, 13553889, 15762, 15763, 15764, 13553890, 13553891, 13553892, 13553893, 13553894, 13553895, 13553896, 13553897, 13578287, 13578288, 13578289, 13578290, 13578291, 13578292, 13578293, 13578294, 13578295, 13578296, 13578297, 13578298, 13578299, 13578300, 13578301, 13595725, 13595726, 13595727, 13595728, 13595729, 13595730, 13595731, 13595732, 13595733, 13595734, 13595735, 13595736, 13595737, 13595738, 13595739, 13595740, 13595741, 13595742, 13595743, 13595744, 13595745, 13595746, 13595747, 13614718, 13614719, 13614720, 13614721, 13614722, 13614723, 13614724, 13614725, 13614726, 13614727, 13614728, 13614729, 13614730, 13614731, 13614732, 13614733, 13614734, 13614735, 13614736, 13614737, 13614738, 13614739, 13614740, 13626284, 13626285, 13626286, 13626287, 13626288, 13626289, 13626290, 13626291, 13626292, 13626293, 13626294, 13626295, 13626296, 13626297, 13626298, 13626299, 13626300, 13626301, 13626302, 13626303, 13626304, 13626305, 13626306, 13653792, 13687389, 13708060, 13708061, 13708062, 13708063, 13708064, 13708065, 13708066, 13708067, 13708068, 13708069, 13708070, 13708071, 13708072, 13708073, 13708074, 13708075, 13708076, 13708077, 13708078, 13708079, 13708080, 13708081, 13708082, 13726175, 13756688, 13756689, 13756690, 13756691, 13756692, 13756693, 13756694, 13756695, 13756696, 13756697, 13756698, 13756699, 13756700, 13756701, 13756702, 13756703, 13756704, 13756705, 13756706, 13756707, 13756708, 13756709, 13756710, 13788165, 13788166, 13788167, 13830174, 13858577, 13858578, 13858579, 13858580, 13858581, 13858582, 13858583, 13858584, 13858585, 13858586, 13858587, 13858588, 13858589, 13858590, 13858591, 13858592, 13858593, 13858594, 13858595, 13858596, 13858597, 13858598, 13858599, 13858600, 13907224, 3302398, 3302399, 3302400, 3302401, 13907225, 13907226, 13907227, 13907228, 13907229, 13907230, 13907231, 13907232, 13907233, 13907234, 13907235, 13907236, 13907237, 13907238, 13907239, 13907240, 13907241, 13907242, 13954901, 13954902, 13954903, 13954904, 13954905, 13954906, 13954907, 13954908, 13954909, 13954910, 13954911, 13954912, 13954913, 13954914, 13954915, 13954916, 13973382, 13973383, 13973384, 13973385, 13973386, 13973387, 13973388, 13973389, 13973390, 13973391, 13973392, 13973393, 13973394, 13973395, 13973396, 13973397, 13973398, 13973399, 13973400, 13973401, 14013930, 14052730], "trace_timestamp_s": 644.5350000000008, "ttft_s": 0.4337894199998118, "turn_id": 28} +{"actual_output_tokens": 1465, "cached_tokens": 0, "effective_input_length": 43763, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43763, "latency_s": 18.48674053302966, "output_length": 1465, "proxy_request_id": "1270340:5:1417075:829", "request_id": "1270340:5:1417075:829", "request_type": "coder", "requested_output_tokens": 1465, "session_id": "1270340", "t_dispatch_unix": 1779821314.1590574, "t_finish_unix": 1779821332.645798, "t_first_token_unix": 1779821321.623266, "tpot_s": 0.007528860753423107, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 14007776, 14007777, 14007778, 14007779, 14007780, 14007781], "trace_timestamp_s": 627.219, "ttft_s": 7.4642061199992895, "turn_id": 5} +{"actual_output_tokens": 129, "cached_tokens": 0, "effective_input_length": 107292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107292, "latency_s": 38.3934329720214, "output_length": 129, "proxy_request_id": "1270606:2:1411654:817", "request_id": "1270606:2:1411654:817", "request_type": "coder", "requested_output_tokens": 129, "session_id": "1270606", "t_dispatch_unix": 1779821295.0829387, "t_finish_unix": 1779821333.476371, "t_first_token_unix": 1779821332.1762104, "tpot_s": 0.010155614546874858, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 13959615, 13959616, 13959617, 13959618, 13959619, 13959620, 13959621, 13959622, 13959623, 13959624, 13959625, 13959626, 13959627, 13959628, 13959629, 13959630, 13959631, 13959632, 13959633, 13959634, 13959635, 13959636, 13959637, 13959638, 13959639, 13959640, 13959641, 13959642, 13959643, 13959644, 13959645, 13959646, 13959647, 13959648, 13959649, 13959650, 13959651, 13959652, 13959653, 13959654, 13959655, 13959656, 13959657, 13959658, 13959659, 13959660, 13959661, 13959662, 13959663, 13959664, 13959665, 13959666, 13959667, 13959668, 13959669, 13959670, 13959671, 13959672, 13959673, 13959674, 13959675, 13959676, 13959677, 13959678, 13959679, 13959680, 13959681, 13959682, 13959683, 13959684, 13959685, 13959686, 13959687, 13959688, 13959689, 13959690, 13959691, 13959692, 13959693, 13959694, 13959695, 13959696, 13959697, 13959698, 13959699, 13959700, 13959701, 13959702, 13959703, 13959704, 13959705, 13959706, 13959707, 13959708, 13959709, 13959710, 13959711, 13959712, 13959713, 13959714, 13959715, 13959716, 13959717, 13959718, 13959719, 13959720, 13959721, 13959722, 13959723, 13959724, 13959725, 13959726, 13959727, 13959728], "trace_timestamp_s": 608.1200000000008, "ttft_s": 37.09327029599808, "turn_id": 2} +{"actual_output_tokens": 193, "cached_tokens": 0, "effective_input_length": 40273, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40273, "latency_s": 35.97245543298777, "output_length": 193, "proxy_request_id": "1277428:8:1412675:821", "request_id": "1277428:8:1412675:821", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1277428", "t_dispatch_unix": 1779821298.3978283, "t_finish_unix": 1779821334.3702838, "t_first_token_unix": 1779821330.000514, "tpot_s": 0.022757793770930828, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 13969076], "trace_timestamp_s": 611.4540000000006, "ttft_s": 31.602683731005527, "turn_id": 8} +{"actual_output_tokens": 1859, "cached_tokens": 0, "effective_input_length": 37398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37398, "latency_s": 18.751194765034597, "output_length": 1859, "proxy_request_id": "1301929:3:1417873:832", "request_id": "1301929:3:1417873:832", "request_type": "coder", "requested_output_tokens": 1859, "session_id": "1301929", "t_dispatch_unix": 1779821316.7918901, "t_finish_unix": 1779821335.5430849, "t_first_token_unix": 1779821322.436426, "tpot_s": 0.007054016955344225, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 14014871, 14014872, 14014873, 14014874], "trace_timestamp_s": 629.8510000000006, "ttft_s": 5.644534096994903, "turn_id": 3} +{"actual_output_tokens": 1565, "cached_tokens": 0, "effective_input_length": 32179, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32179, "latency_s": 14.96158365701558, "output_length": 1565, "proxy_request_id": "1364128:3:1419644:833", "request_id": "1364128:3:1419644:833", "request_type": "coder", "requested_output_tokens": 1565, "session_id": "1364128", "t_dispatch_unix": 1779821322.9705827, "t_finish_unix": 1779821337.9321666, "t_first_token_unix": 1779821327.3775034, "tpot_s": 0.006748303342723738, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13525787, 2139676, 2139677, 13525788, 13554127, 14030453, 14030454, 14030455, 14030456, 14030457, 14030458, 14030459, 14030460, 14030461, 14030462, 14030463, 14030464, 14030465, 14030466, 14030467, 14030468, 14030469, 14030470, 14030471, 14030472, 14030473, 14030474, 14030475, 14030476, 14030477, 14030478, 14030479, 14030480, 14030481, 14030482, 14030483, 14030484, 14030485, 14030486, 14030487, 14030488, 14030489, 14030490, 14030491, 14030492, 14030493, 14030494, 14030495, 14030496, 14030497], "trace_timestamp_s": 636.0240000000003, "ttft_s": 4.406914488004986, "turn_id": 3} +{"actual_output_tokens": 417, "cached_tokens": 63184, "effective_input_length": 73392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73392, "latency_s": 53.52976927999407, "output_length": 417, "proxy_request_id": "1364090:6:1408777:801", "request_id": "1364090:6:1408777:801", "request_type": "coder", "requested_output_tokens": 417, "session_id": "1364090", "t_dispatch_unix": 1779821284.912747, "t_finish_unix": 1779821338.4425163, "t_first_token_unix": 1779821323.7821522, "tpot_s": 0.03524057906962788, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13934141], "trace_timestamp_s": 597.969, "ttft_s": 38.869403394986875, "turn_id": 6} +{"actual_output_tokens": 156, "cached_tokens": 25072, "effective_input_length": 25225, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25225, "latency_s": 1.0840637889923528, "output_length": 156, "proxy_request_id": "1363943:11:1424840:842", "request_id": "1363943:11:1424840:842", "request_type": "coder", "requested_output_tokens": 156, "session_id": "1363943", "t_dispatch_unix": 1779821341.5050209, "t_finish_unix": 1779821342.5890844, "t_first_token_unix": 1779821341.6222193, "tpot_s": 0.006236008361297389, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14078449], "trace_timestamp_s": 654.5660000000007, "ttft_s": 0.1171964299865067, "turn_id": 11} +{"actual_output_tokens": 71, "cached_tokens": 62400, "effective_input_length": 124090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 124090, "latency_s": 36.35561869305093, "output_length": 71, "proxy_request_id": "1313181:8:1329951:394", "request_id": "1313181:8:1329951:394", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1313181", "t_dispatch_unix": 1779821306.8055072, "t_finish_unix": 1779821343.161126, "t_first_token_unix": 1779821341.9897113, "tpot_s": 0.016730763057213542, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13209153], "trace_timestamp_s": 321.7550000000001, "ttft_s": 35.18420172401238, "turn_id": 8} +{"actual_output_tokens": 25, "cached_tokens": 11568, "effective_input_length": 11736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11736, "latency_s": 0.5518743880093098, "output_length": 25, "proxy_request_id": "1399948:8:1425345:844", "request_id": "1399948:8:1425345:844", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1399948", "t_dispatch_unix": 1779821343.38939, "t_finish_unix": 1779821343.9412646, "t_first_token_unix": 1779821343.506475, "tpot_s": 0.018106214459597442, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14082944], "trace_timestamp_s": 656.451, "ttft_s": 0.11708227096823975, "turn_id": 8} +{"actual_output_tokens": 64, "cached_tokens": 62432, "effective_input_length": 62444, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62444, "latency_s": 1.0060487639857456, "output_length": 64, "proxy_request_id": "1313181:8:1385690:686", "request_id": "1313181:8:1385690:686", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1313181", "t_dispatch_unix": 1779821343.1644542, "t_finish_unix": 1779821344.170503, "t_first_token_unix": 1779821343.2841952, "tpot_s": 0.014064518459481262, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278], "trace_timestamp_s": 517.1500000000005, "ttft_s": 0.11973869003122672, "turn_id": 8} +{"actual_output_tokens": 24, "cached_tokens": 6896, "effective_input_length": 39789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39789, "latency_s": 6.066152774030343, "output_length": 24, "proxy_request_id": "1355951:5:1425005:843", "request_id": "1355951:5:1425005:843", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1355951", "t_dispatch_unix": 1779821342.1527076, "t_finish_unix": 1779821348.2188601, "t_first_token_unix": 1779821348.0882611, "tpot_s": 0.005666239303536713, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463, 14061275], "trace_timestamp_s": 655.2139999999999, "ttft_s": 5.935551522008609, "turn_id": 5} +{"actual_output_tokens": 620, "cached_tokens": 126192, "effective_input_length": 126198, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 126198, "latency_s": 10.626021477975883, "output_length": 620, "proxy_request_id": "1366128:29:1424316:841", "request_id": "1366128:29:1424316:841", "request_type": "coder", "requested_output_tokens": 620, "session_id": "1366128", "t_dispatch_unix": 1779821339.6710408, "t_finish_unix": 1779821350.297062, "t_first_token_unix": 1779821339.894672, "tpot_s": 0.01680449977536311, "trace_hash_ids": [2239009, 2239010, 2239011, 2239012, 2239013, 2239014, 2239015, 2239016, 2239017, 2239018, 2239019, 2239020, 2239021, 2239022, 177637, 177638, 177639, 2239023, 2239024, 2239025, 2239026, 2239027, 14073495, 14073496, 14073497, 14073498, 6887633, 6887634, 6887635, 6887636, 14073499, 14073500, 14073501, 14073502, 14073503, 14073504, 14073505, 14073506, 14073507, 14073508, 14073509, 14073510, 14073511, 14073512, 14073513, 14073514, 14073515, 14073516, 14073517, 14073518, 14073519, 14073520, 14073521, 14073522, 14073523, 14073524, 14073525, 14073526, 14073527, 14073528, 14073529, 14073530, 14073531, 14073532, 14073533, 14073534, 14073535, 14073536, 14073537, 14073538, 14073539, 14073540, 14073541, 14073542, 14073543, 14073544, 14073545, 14073546, 14073547, 14073548, 14073549, 14073550, 14073551, 14073552, 14073553, 14073554, 14073555, 14073556, 14073557, 14073558, 14073559, 14073560, 14073561, 14073562, 14073563, 14073564, 14073565, 14073566, 14073567, 14073568, 14073569, 14073570, 14073571, 14073572, 14073573, 14073574, 14073575, 14073576, 14073577, 14073578, 14073579, 14073580, 14073581, 14073582, 14073583, 14073584, 14073585, 14073586, 14073587, 14073588, 14073589, 14073590, 14073591, 14073592, 14073593, 14073594, 14073595, 14073596, 14073597, 14073598, 14073599, 14073600, 14073601, 14073602, 14073603, 14073604, 14073605, 14073606, 14073607, 14073608, 14073609, 14073610, 14073611, 14073612, 14073613, 14073614, 14073615, 14073616, 14073617, 14073618, 14073619, 14073620, 14073621, 14073622, 14073623, 14073624, 14073625, 14073626, 14073627, 14073628, 14073629, 14073630, 14073631, 14073632, 14073633, 7128120, 7128121, 7128122, 7128123, 14073634, 14073635, 14073636, 14073637, 14073638, 14073639, 14073640, 14073641, 14073642, 14073643, 14073644, 14073645, 14073646, 14073647, 14073648, 14073649, 14073650, 14073651, 14073652, 14073653, 14073654, 14073655, 14073656, 14073657, 14073658, 14073659, 14073660, 14073661, 14073662, 14073663, 14073664, 14073665, 14073666, 14073667, 14073668, 14073669, 14073670, 14073671, 14073672, 14073673, 14073674, 14073675, 14073676, 14073677, 14073678, 14073679, 14073680, 14073681, 14073682, 14073683, 14073684, 14073685, 14073686, 14073687, 14073688, 14073689, 14073690, 14073691, 14073692, 14073693, 14073694, 14073695, 14073696, 14073697, 14073698, 14073699, 14073700, 14073701, 14073702, 14073703, 14073704, 14073705, 14073706, 14073707, 14073708, 14073709, 14073710, 14073711], "trace_timestamp_s": 652.6850000000004, "ttft_s": 0.22362712200265378, "turn_id": 29} +{"actual_output_tokens": 33, "cached_tokens": 107408, "effective_input_length": 108318, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108318, "latency_s": 1.1009633119683713, "output_length": 33, "proxy_request_id": "1270606:3:1427164:848", "request_id": "1270606:3:1427164:848", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1270606", "t_dispatch_unix": 1779821349.812312, "t_finish_unix": 1779821350.9132745, "t_first_token_unix": 1779821350.5952342, "tpot_s": 0.009927504155712086, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 13959615, 13959616, 13959617, 13959618, 13959619, 13959620, 13959621, 13959622, 13959623, 13959624, 13959625, 13959626, 13959627, 13959628, 13959629, 13959630, 13959631, 13959632, 13959633, 13959634, 13959635, 13959636, 13959637, 13959638, 13959639, 13959640, 13959641, 14099892, 14099893, 14099894, 14099895, 14099896, 14099897, 14099898, 14099899, 14099900, 14099901, 14099902, 14099903, 14099904, 14099905, 14099906, 14099907, 14099908, 14099909, 14099910, 14099911, 14099912, 14099913, 14099914, 14099915, 14099916, 14099917, 14099918, 14099919, 14099920, 14099921, 14099922, 14099923, 14099924, 14099925, 14099926, 14099927, 14099928, 14099929, 14099930, 14099931, 14099932, 14099933, 14099934, 14099935, 14099936, 14099937, 14099938, 14099939, 14099940, 14099941, 14099942, 14099943, 14099944, 14099945, 14099946, 14099947, 14099948, 14099949, 14099950, 14099951, 14099952, 14099953, 14099954, 14099955, 14099956, 14099957, 14099958, 14099959, 14099960, 14099961, 14099962, 14099963, 14099964, 14099965, 14099966, 14099967, 14099968, 14099969, 14099970, 14099971, 14099972, 14099973, 14099974, 14099975, 14099976, 14099977, 14099978, 14099979, 14099980], "trace_timestamp_s": 662.8530000000001, "ttft_s": 0.7829211389762349, "turn_id": 3} +{"actual_output_tokens": 747, "cached_tokens": 0, "effective_input_length": 32944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32944, "latency_s": 80.64005228597671, "output_length": 747, "proxy_request_id": "1405155:1:1405155:775", "request_id": "1405155:1:1405155:775", "request_type": "coder", "requested_output_tokens": 747, "session_id": "1405155", "t_dispatch_unix": 1779821272.2857242, "t_finish_unix": 1779821352.9257767, "t_first_token_unix": 1779821277.3948023, "tpot_s": 0.10124736794901965, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13900957], "trace_timestamp_s": 585.3360000000002, "ttft_s": 5.109075316984672, "turn_id": 1} +{"actual_output_tokens": 599, "cached_tokens": 25376, "effective_input_length": 26923, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26923, "latency_s": 5.025276810978539, "output_length": 599, "proxy_request_id": "1363943:12:1426646:845", "request_id": "1363943:12:1426646:845", "request_type": "coder", "requested_output_tokens": 599, "session_id": "1363943", "t_dispatch_unix": 1779821347.9781718, "t_finish_unix": 1779821353.0034478, "t_first_token_unix": 1779821348.3396907, "tpot_s": 0.007798549894653853, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14094824], "trace_timestamp_s": 661.0390000000007, "ttft_s": 0.3615170369739644, "turn_id": 12} +{"actual_output_tokens": 339, "cached_tokens": 11904, "effective_input_length": 12596, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12596, "latency_s": 2.0242038469878025, "output_length": 339, "proxy_request_id": "1362265:10:1427606:850", "request_id": "1362265:10:1427606:850", "request_type": "coder", "requested_output_tokens": 339, "session_id": "1362265", "t_dispatch_unix": 1779821351.0837045, "t_finish_unix": 1779821353.1079082, "t_first_token_unix": 1779821351.2272644, "tpot_s": 0.005563221784024747, "trace_hash_ids": [149671, 501453, 501454, 501455, 501456, 1081583, 1081584, 1081585, 1081586, 1232857, 2138683, 2138684, 2138685, 13509130, 13509131, 13509132, 5217026, 13555216, 13555217, 13555218, 13686588, 14031065, 14053142, 14104310, 14104311], "trace_timestamp_s": 664.1450000000004, "ttft_s": 0.14355879399226978, "turn_id": 10} +{"actual_output_tokens": 3818, "cached_tokens": 71664, "effective_input_length": 72608, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72608, "latency_s": 57.327282054000534, "output_length": 3818, "proxy_request_id": "1381387:7:1411928:819", "request_id": "1381387:7:1411928:819", "request_type": "coder", "requested_output_tokens": 3818, "session_id": "1381387", "t_dispatch_unix": 1779821295.9058163, "t_finish_unix": 1779821353.233098, "t_first_token_unix": 1779821299.194824, "tpot_s": 0.01415720324862257, "trace_hash_ids": [10318, 37068, 37069, 59296, 59297, 76553, 76554, 76555, 76556, 76557, 76558, 76559, 544656, 544657, 544658, 544659, 544660, 544661, 7618, 8714416, 13664428, 776966, 13684107, 13684108, 13684109, 13684110, 13684111, 13705309, 13705310, 13705311, 13705312, 13705313, 13705314, 13705315, 13705316, 13705317, 13705318, 13705319, 13705320, 13705321, 13705322, 13705323, 13705324, 13705325, 13705326, 13705327, 13705328, 13705329, 13705330, 13705331, 13705332, 13705333, 13705334, 13705335, 13705336, 13736124, 13736125, 13736126, 13736127, 13736128, 13736129, 13736130, 13736131, 13736132, 13736133, 13736134, 13736135, 13736136, 13736137, 13736138, 13736139, 13736140, 13736141, 13736142, 13736143, 13736144, 13736145, 13736146, 13736147, 13736148, 13736149, 13736150, 13736151, 13736152, 13736153, 13736154, 13736155, 13736156, 13736157, 13736158, 13736159, 13736160, 13736161, 13736162, 13736163, 13736164, 13736165, 13736166, 13736167, 13861846, 13861847, 13861848, 13861849, 13861850, 13861851, 13861852, 13861853, 13861854, 13861855, 13861856, 13861857, 13861858, 13861859, 8957641, 13861860, 13861861, 13861862, 13861863, 13861864, 13861865, 13861866, 13861867, 13861868, 13861869, 13861870, 13861871, 13861872, 13861873, 13861874, 13861875, 13861876, 13861877, 13861878, 13893568, 13893569, 13937687, 13937688, 13937689, 13937690, 13937691, 13962250, 13962251], "trace_timestamp_s": 608.9650000000001, "ttft_s": 3.289004891004879, "turn_id": 7} +{"actual_output_tokens": 510, "cached_tokens": 73808, "effective_input_length": 86193, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86193, "latency_s": 20.49686686898349, "output_length": 510, "proxy_request_id": "1364090:7:1412644:820", "request_id": "1364090:7:1412644:820", "request_type": "coder", "requested_output_tokens": 510, "session_id": "1364090", "t_dispatch_unix": 1779821338.450804, "t_finish_unix": 1779821358.9476707, "t_first_token_unix": 1779821344.8007147, "tpot_s": 0.027792609491145828, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 13968786], "trace_timestamp_s": 611.3520000000008, "ttft_s": 6.349907952011563, "turn_id": 7} +{"actual_output_tokens": 1126, "cached_tokens": 0, "effective_input_length": 113258, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113258, "latency_s": 91.25496192998253, "output_length": 1126, "proxy_request_id": "1264679:2:1405259:777", "request_id": "1264679:2:1405259:777", "request_type": "coder", "requested_output_tokens": 1126, "session_id": "1264679", "t_dispatch_unix": 1779821272.6023734, "t_finish_unix": 1779821363.8573356, "t_first_token_unix": 1779821321.7068822, "tpot_s": 0.0374667761919813, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281, 13901868, 13901869, 13901870, 13901871, 13901872, 13901873, 13901874], "trace_timestamp_s": 585.6600000000008, "ttft_s": 49.10450680699432, "turn_id": 2} +{"actual_output_tokens": 589, "cached_tokens": 40464, "effective_input_length": 42342, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42342, "latency_s": 24.248770428006537, "output_length": 589, "proxy_request_id": "1277428:8:1426669:846", "request_id": "1277428:8:1426669:846", "request_type": "coder", "requested_output_tokens": 589, "session_id": "1277428", "t_dispatch_unix": 1779821348.0599928, "t_finish_unix": 1779821372.3087635, "t_first_token_unix": 1779821348.7423384, "tpot_s": 0.04007805497278649, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14095200, 14095201, 14095202, 14095203, 14095204], "trace_timestamp_s": 661.1190000000006, "ttft_s": 0.6823427630006336, "turn_id": 8} +{"actual_output_tokens": 14, "cached_tokens": 11760, "effective_input_length": 11993, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11993, "latency_s": 0.13643987098475918, "output_length": 14, "proxy_request_id": "1399948:9:1433544:857", "request_id": "1399948:9:1433544:857", "request_type": "coder", "requested_output_tokens": 14, "session_id": "1399948", "t_dispatch_unix": 1779821372.2777855, "t_finish_unix": 1779821372.4142253, "t_first_token_unix": 1779821372.3529758, "tpot_s": 0.004690648307307408, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14161913], "trace_timestamp_s": 685.3389999999999, "ttft_s": 0.07518822600832209, "turn_id": 9} +{"actual_output_tokens": 2116, "cached_tokens": 1680, "effective_input_length": 1840, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 1840, "latency_s": 12.09750414598966, "output_length": 2116, "proxy_request_id": "1407599:2:1430593:852", "request_id": "1407599:2:1430593:852", "request_type": "coder", "requested_output_tokens": 2116, "session_id": "1407599", "t_dispatch_unix": 1779821361.8139663, "t_finish_unix": 1779821373.9114707, "t_first_token_unix": 1779821361.8502831, "tpot_s": 0.005702520174471921, "trace_hash_ids": [10764018, 14132941, 14132942, 14132943], "trace_timestamp_s": 674.8760000000002, "ttft_s": 0.03631611599121243, "turn_id": 2} +{"actual_output_tokens": 298, "cached_tokens": 39248, "effective_input_length": 40567, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40567, "latency_s": 2.9565526310470887, "output_length": 298, "proxy_request_id": "1382089:3:1433211:856", "request_id": "1382089:3:1433211:856", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1382089", "t_dispatch_unix": 1779821371.055744, "t_finish_unix": 1779821374.0122962, "t_first_token_unix": 1779821371.5420144, "tpot_s": 0.008316671218831242, "trace_hash_ids": [13286289, 13286290, 13286291, 13286292, 13286293, 13286294, 13286295, 13286296, 13286297, 13286298, 13286299, 13286300, 13286301, 13286302, 13286303, 13286304, 13286305, 13286306, 13286307, 13286308, 13286309, 13286310, 13286311, 13286312, 13286313, 13286314, 13286315, 13286316, 13286317, 13286318, 13286319, 13286320, 13286321, 13286322, 13286323, 13286324, 13286325, 13286326, 654631, 13286327, 3468547, 13286328, 13286329, 13286330, 13286331, 13286332, 13286333, 13286334, 13286335, 13286336, 13286337, 13286338, 13286339, 13286340, 13286341, 13286342, 13286343, 13286344, 13286345, 13286346, 13340426, 13340427, 13340428, 13340429, 13340430, 13410882, 13448624, 13448625, 13448626, 13501229, 13518976, 13518977, 13518978, 13573217, 13633424, 13776305, 13841463, 14061275, 14158620, 14158621], "trace_timestamp_s": 684.116, "ttft_s": 0.48626896901987493, "turn_id": 3} +{"actual_output_tokens": 40, "cached_tokens": 12000, "effective_input_length": 12032, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12032, "latency_s": 0.24683234200347215, "output_length": 40, "proxy_request_id": "1399948:10:1434418:858", "request_id": "1399948:10:1434418:858", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1399948", "t_dispatch_unix": 1779821375.2910695, "t_finish_unix": 1779821375.5379014, "t_first_token_unix": 1779821375.3359587, "tpot_s": 0.005171396256161806, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14170064], "trace_timestamp_s": 688.3510000000006, "ttft_s": 0.04488809499889612, "turn_id": 10} +{"actual_output_tokens": 11, "cached_tokens": 12064, "effective_input_length": 12106, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12106, "latency_s": 0.09082603198476136, "output_length": 11, "proxy_request_id": "1399948:11:1435163:860", "request_id": "1399948:11:1435163:860", "request_type": "coder", "requested_output_tokens": 11, "session_id": "1399948", "t_dispatch_unix": 1779821377.991836, "t_finish_unix": 1779821378.0826623, "t_first_token_unix": 1779821378.037139, "tpot_s": 0.004527374904137104, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14176836], "trace_timestamp_s": 691.0540000000001, "ttft_s": 0.04530127195175737, "turn_id": 11} +{"actual_output_tokens": 200, "cached_tokens": 45216, "effective_input_length": 45269, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45269, "latency_s": 1.5740365590318106, "output_length": 200, "proxy_request_id": "1270340:6:1434904:859", "request_id": "1270340:6:1434904:859", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1270340", "t_dispatch_unix": 1779821376.9290338, "t_finish_unix": 1779821378.50307, "t_first_token_unix": 1779821377.0466857, "tpot_s": 0.007317033205848262, "trace_hash_ids": [3888, 3889, 3890, 643144, 643145, 643146, 6738203, 6674441, 6674442, 2964677, 2964678, 6738204, 78869, 6738205, 6738206, 514915, 6738207, 6738208, 6738209, 6738210, 6738211, 6738212, 6738213, 170410, 170411, 6738214, 10389014, 9079666, 9079667, 9079668, 10389015, 10389016, 12641636, 12641637, 12641638, 12641639, 12641640, 23594, 23595, 23596, 12641641, 12641642, 1307367, 1307368, 1307369, 1307370, 12641643, 8927, 8928, 8929, 8930, 8931, 12641644, 12641645, 12641646, 13494255, 13494256, 13494257, 13494258, 13494259, 13494260, 13494261, 13494262, 13494263, 13494264, 13547859, 13547860, 13547861, 13547862, 13547863, 13547864, 13547865, 13547866, 13547867, 13547868, 13547869, 13547870, 13547871, 13547872, 13547873, 14007776, 14007777, 14007778, 14007779, 14007780, 14174577, 14174578, 14174579, 14174580], "trace_timestamp_s": 689.9880000000003, "ttft_s": 0.11764959403080866, "turn_id": 6} +{"actual_output_tokens": 26, "cached_tokens": 12112, "effective_input_length": 12164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12164, "latency_s": 0.17788363300496712, "output_length": 26, "proxy_request_id": "1399948:12:1436179:863", "request_id": "1399948:12:1436179:863", "request_type": "coder", "requested_output_tokens": 26, "session_id": "1399948", "t_dispatch_unix": 1779821381.4198422, "t_finish_unix": 1779821381.5977206, "t_first_token_unix": 1779821381.4710855, "tpot_s": 0.0050558053981512785, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14186143], "trace_timestamp_s": 694.4800000000005, "ttft_s": 0.05124667001655325, "turn_id": 12} +{"actual_output_tokens": 149, "cached_tokens": 62496, "effective_input_length": 129673, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129673, "latency_s": 41.98782691999804, "output_length": 149, "proxy_request_id": "1313181:9:1333349:415", "request_id": "1313181:9:1333349:415", "request_type": "coder", "requested_output_tokens": 149, "session_id": "1313181", "t_dispatch_unix": 1779821344.1770453, "t_finish_unix": 1779821386.1648724, "t_first_token_unix": 1779821383.5409207, "tpot_s": 0.017727813587879535, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13240573], "trace_timestamp_s": 333.6930000000002, "ttft_s": 39.36387319100322, "turn_id": 9} +{"actual_output_tokens": 129, "cached_tokens": 0, "effective_input_length": 73878, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73878, "latency_s": 20.445398342970293, "output_length": 129, "proxy_request_id": "1342921:5:1433192:855", "request_id": "1342921:5:1433192:855", "request_type": "coder", "requested_output_tokens": 129, "session_id": "1342921", "t_dispatch_unix": 1779821370.9796243, "t_finish_unix": 1779821391.4250224, "t_first_token_unix": 1779821389.8372173, "tpot_s": 0.012402091702824691, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14158436], "trace_timestamp_s": 684.0380000000005, "ttft_s": 18.857590413012076, "turn_id": 5} +{"actual_output_tokens": 493, "cached_tokens": 27520, "effective_input_length": 28711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28711, "latency_s": 4.413658207980916, "output_length": 493, "proxy_request_id": "1363943:13:1438562:865", "request_id": "1363943:13:1438562:865", "request_type": "coder", "requested_output_tokens": 493, "session_id": "1363943", "t_dispatch_unix": 1779821389.3871331, "t_finish_unix": 1779821393.8007915, "t_first_token_unix": 1779821390.0401835, "tpot_s": 0.007642762965477276, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14206732], "trace_timestamp_s": 702.4480000000003, "ttft_s": 0.6530484479735605, "turn_id": 13} +{"actual_output_tokens": 145, "cached_tokens": 49520, "effective_input_length": 52920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52920, "latency_s": 2.3127094210358337, "output_length": 145, "proxy_request_id": "1268861:10:1439325:866", "request_id": "1268861:10:1439325:866", "request_type": "coder", "requested_output_tokens": 145, "session_id": "1268861", "t_dispatch_unix": 1779821391.9406269, "t_finish_unix": 1779821394.2533367, "t_first_token_unix": 1779821393.164123, "tpot_s": 0.007562029611209355, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14214018], "trace_timestamp_s": 705.0, "ttft_s": 1.2234926840174012, "turn_id": 10} +{"actual_output_tokens": 528, "cached_tokens": 33680, "effective_input_length": 40330, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40330, "latency_s": 42.379113627946936, "output_length": 528, "proxy_request_id": "1405155:2:1414214:828", "request_id": "1405155:2:1414214:828", "request_type": "coder", "requested_output_tokens": 528, "session_id": "1405155", "t_dispatch_unix": 1779821352.9312203, "t_finish_unix": 1779821395.310334, "t_first_token_unix": 1779821360.698344, "tpot_s": 0.06567694321069319, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13983589, 13983590, 13983591, 13983592, 13983593, 13983594, 13983595, 13983596, 13983597, 13983598, 13983599, 13983600, 13983601, 13983602, 13983603], "trace_timestamp_s": 616.817, "ttft_s": 7.7671216409653425, "turn_id": 2} +{"actual_output_tokens": 444, "cached_tokens": 83632, "effective_input_length": 96849, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96849, "latency_s": 38.327880477998406, "output_length": 444, "proxy_request_id": "1364090:8:1417347:830", "request_id": "1364090:8:1417347:830", "request_type": "coder", "requested_output_tokens": 444, "session_id": "1364090", "t_dispatch_unix": 1779821358.9562523, "t_finish_unix": 1779821397.2841332, "t_first_token_unix": 1779821371.37974, "tpot_s": 0.05847419375849627, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14010113], "trace_timestamp_s": 628.009, "ttft_s": 12.423484872968402, "turn_id": 8} +{"actual_output_tokens": 2679, "cached_tokens": 22880, "effective_input_length": 29412, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29412, "latency_s": 19.095967876026407, "output_length": 2679, "proxy_request_id": "1404395:2:1435941:862", "request_id": "1404395:2:1435941:862", "request_type": "coder", "requested_output_tokens": 2679, "session_id": "1404395", "t_dispatch_unix": 1779821380.575646, "t_finish_unix": 1779821399.6716135, "t_first_token_unix": 1779821381.8724167, "tpot_s": 0.006646333992158851, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14183679], "trace_timestamp_s": 693.6320000000005, "ttft_s": 1.2967689280048944, "turn_id": 2} +{"actual_output_tokens": 90, "cached_tokens": 0, "effective_input_length": 19056, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19056, "latency_s": 2.4415140920318663, "output_length": 90, "proxy_request_id": "1371622:2:1442319:869", "request_id": "1371622:2:1442319:869", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1371622", "t_dispatch_unix": 1779821401.7939684, "t_finish_unix": 1779821404.2354822, "t_first_token_unix": 1779821403.71952, "tpot_s": 0.0057942942249211956, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14240621], "trace_timestamp_s": 714.8530000000001, "ttft_s": 1.9255493790260516, "turn_id": 2} +{"actual_output_tokens": 344, "cached_tokens": 97280, "effective_input_length": 101432, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101432, "latency_s": 9.026917810027953, "output_length": 344, "proxy_request_id": "1364090:9:1423736:840", "request_id": "1364090:9:1423736:840", "request_type": "coder", "requested_output_tokens": 344, "session_id": "1364090", "t_dispatch_unix": 1779821397.2898881, "t_finish_unix": 1779821406.316806, "t_first_token_unix": 1779821400.0370145, "tpot_s": 0.01830744295911836, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14068318, 14068319, 14068320, 14068321, 14068322, 14068323, 14068324, 14068325, 14068326, 14068327], "trace_timestamp_s": 650.826, "ttft_s": 2.7471237220452167, "turn_id": 9} +{"actual_output_tokens": 1070, "cached_tokens": 19136, "effective_input_length": 19292, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19292, "latency_s": 6.480907941004261, "output_length": 1070, "proxy_request_id": "1371622:3:1443876:871", "request_id": "1371622:3:1443876:871", "request_type": "coder", "requested_output_tokens": 1070, "session_id": "1371622", "t_dispatch_unix": 1779821406.902333, "t_finish_unix": 1779821413.3832412, "t_first_token_unix": 1779821406.9941247, "tpot_s": 0.0059765052029987584, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523], "trace_timestamp_s": 719.9639999999999, "ttft_s": 0.0917897520121187, "turn_id": 3} +{"actual_output_tokens": 302, "cached_tokens": 0, "effective_input_length": 63153, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63153, "latency_s": 16.495146599016152, "output_length": 302, "proxy_request_id": "1294611:12:1441557:868", "request_id": "1294611:12:1441557:868", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1294611", "t_dispatch_unix": 1779821399.0582447, "t_finish_unix": 1779821415.5533912, "t_first_token_unix": 1779821413.0851045, "tpot_s": 0.00819939060138223, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14232859], "trace_timestamp_s": 712.1100000000006, "ttft_s": 14.026857621967793, "turn_id": 12} +{"actual_output_tokens": 123, "cached_tokens": 63440, "effective_input_length": 63488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63488, "latency_s": 1.1006923919776455, "output_length": 123, "proxy_request_id": "1294611:13:1446349:872", "request_id": "1294611:13:1446349:872", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1294611", "t_dispatch_unix": 1779821415.5565193, "t_finish_unix": 1779821416.6572113, "t_first_token_unix": 1779821415.6838706, "tpot_s": 0.007976221384911905, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911], "trace_timestamp_s": 728.4270000000006, "ttft_s": 0.12734935199841857, "turn_id": 13} +{"actual_output_tokens": 2012, "cached_tokens": 62512, "effective_input_length": 62513, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 62513, "latency_s": 30.653460137022194, "output_length": 2012, "proxy_request_id": "1313181:9:1386945:689", "request_id": "1313181:9:1386945:689", "request_type": "coder", "requested_output_tokens": 2012, "session_id": "1313181", "t_dispatch_unix": 1779821386.16812, "t_finish_unix": 1779821416.8215797, "t_first_token_unix": 1779821386.2822523, "tpot_s": 0.01518602426900088, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13734424], "trace_timestamp_s": 521.2310000000007, "ttft_s": 0.1141301030293107, "turn_id": 9} +{"actual_output_tokens": 46, "cached_tokens": 74000, "effective_input_length": 75761, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75761, "latency_s": 1.324906338006258, "output_length": 46, "proxy_request_id": "1342921:6:1448548:876", "request_id": "1342921:6:1448548:876", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1342921", "t_dispatch_unix": 1779821422.5270958, "t_finish_unix": 1779821423.8520021, "t_first_token_unix": 1779821423.5038478, "tpot_s": 0.007730730555744635, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705], "trace_timestamp_s": 735.5860000000002, "ttft_s": 0.9767500910093077, "turn_id": 6} +{"actual_output_tokens": 575, "cached_tokens": 63600, "effective_input_length": 63616, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63616, "latency_s": 4.903501724998932, "output_length": 575, "proxy_request_id": "1294611:14:1449074:877", "request_id": "1294611:14:1449074:877", "request_type": "coder", "requested_output_tokens": 575, "session_id": "1294611", "t_dispatch_unix": 1779821424.3531387, "t_finish_unix": 1779821429.2566404, "t_first_token_unix": 1779821424.4663918, "tpot_s": 0.008344750456513597, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 14306306], "trace_timestamp_s": 737.4130000000005, "ttft_s": 0.11325101798865944, "turn_id": 14} +{"actual_output_tokens": 89, "cached_tokens": 20352, "effective_input_length": 20439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20439, "latency_s": 0.6091976620373316, "output_length": 89, "proxy_request_id": "1371622:4:1452210:881", "request_id": "1371622:4:1452210:881", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1371622", "t_dispatch_unix": 1779821434.777628, "t_finish_unix": 1779821435.3868256, "t_first_token_unix": 1779821434.8666215, "tpot_s": 0.005905202636230652, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572], "trace_timestamp_s": 747.8389999999999, "ttft_s": 0.08899055304937065, "turn_id": 4} +{"actual_output_tokens": 65, "cached_tokens": 53056, "effective_input_length": 55050, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55050, "latency_s": 1.3094389960169792, "output_length": 65, "proxy_request_id": "1268861:11:1452208:880", "request_id": "1268861:11:1452208:880", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1268861", "t_dispatch_unix": 1779821434.768593, "t_finish_unix": 1779821436.0780315, "t_first_token_unix": 1779821435.6161306, "tpot_s": 0.007211022468254669, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14334566], "trace_timestamp_s": 747.8280000000004, "ttft_s": 0.8475352440145798, "turn_id": 11} +{"actual_output_tokens": 140, "cached_tokens": 23472, "effective_input_length": 127488, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 127488, "latency_s": 50.710880558006465, "output_length": 140, "proxy_request_id": "1356885:2:1438037:864", "request_id": "1356885:2:1438037:864", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1356885", "t_dispatch_unix": 1779821387.6682491, "t_finish_unix": 1779821438.3791296, "t_first_token_unix": 1779821436.8313222, "tpot_s": 0.011133070057760522, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14202196, 14202197, 14202198, 14202199, 14202200, 14202201, 14202202, 14202203, 14202204], "trace_timestamp_s": 700.7250000000004, "ttft_s": 49.16307016700739, "turn_id": 2} +{"actual_output_tokens": 2588, "cached_tokens": 100976, "effective_input_length": 125947, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 125947, "latency_s": 79.83960092597408, "output_length": 2588, "proxy_request_id": "1264679:3:1431512:853", "request_id": "1264679:3:1431512:853", "request_type": "coder", "requested_output_tokens": 2588, "session_id": "1264679", "t_dispatch_unix": 1779821364.7916925, "t_finish_unix": 1779821444.6312935, "t_first_token_unix": 1779821389.7651086, "tpot_s": 0.021208323414373034, "trace_hash_ids": [53669, 53670, 53671, 53672, 53673, 53674, 53675, 53676, 53677, 53678, 53679, 53680, 53681, 53682, 53683, 53684, 53685, 53686, 53687, 53688, 53689, 53690, 165825, 165826, 928597, 928598, 928599, 928600, 928601, 928602, 928603, 928604, 928605, 928606, 928607, 928608, 928609, 928610, 928611, 928612, 928613, 928614, 928615, 1194856, 1194857, 1194858, 1194859, 1194860, 1194861, 1194862, 1194863, 1194864, 1194865, 4751603, 4751604, 4906135, 4906136, 4906137, 4906138, 4906139, 4906140, 4906141, 4906142, 4906143, 4906144, 4906145, 4906146, 4906147, 9918891, 9918892, 9918893, 9918894, 9918895, 9918896, 9918897, 9918898, 9918899, 9918900, 9918901, 9918902, 9918903, 9918904, 9918905, 9918906, 9918907, 9918908, 9918909, 9918910, 9918911, 9918912, 9918913, 9918914, 9918915, 9918916, 9918917, 9918918, 9918919, 9918920, 9918921, 9918922, 9918923, 9918924, 9918925, 9918926, 9918927, 9918928, 9918929, 9918930, 9918931, 9918932, 9918933, 9918934, 9918935, 9918936, 9918937, 9918938, 9918939, 9918940, 9918941, 9918942, 9918943, 9918944, 9918945, 9918946, 9918947, 9918948, 9918949, 9918950, 9918951, 9918952, 9918953, 9918954, 9918955, 9918956, 9918957, 9918958, 9918959, 9918960, 9918961, 9918962, 9918963, 9918964, 9918965, 9918966, 9918967, 9918968, 9918969, 9918970, 9918971, 9918972, 9918973, 9918974, 9918975, 9918976, 9918977, 9918978, 9918979, 9918980, 9918981, 9918982, 9918983, 9918984, 9918985, 9918986, 9918987, 9918988, 9918989, 9918990, 9918991, 9918992, 9918993, 9918994, 9918995, 9918996, 9918997, 9918998, 9918999, 11660422, 11660423, 11660424, 11660425, 11660426, 11660427, 11660428, 11660429, 11660430, 11660431, 11660432, 11660433, 11660434, 11660435, 11660436, 11660437, 11660438, 11660439, 11660440, 11660441, 11660442, 12172627, 12172628, 12172629, 12172630, 12542438, 12542439, 12542440, 12586272, 12586273, 12586274, 12586275, 12586276, 12586277, 12586278, 12586279, 12586280, 12586281, 13901868, 13901869, 13901870, 13901871, 13901872, 13901873, 13901874, 14141972, 14141973, 14141974, 14141975, 14141976, 14141977, 14141978, 14141979, 14141980, 14141981, 14141982, 14141983, 14141984, 14141985, 14141986, 14141987, 14141988, 14141989, 14141990, 14141991, 14141992, 14141993, 14141994, 14141995], "trace_timestamp_s": 677.8460000000005, "ttft_s": 24.973413722997066, "turn_id": 3} +{"actual_output_tokens": 76, "cached_tokens": 20512, "effective_input_length": 21518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21518, "latency_s": 0.684811640996486, "output_length": 76, "proxy_request_id": "1371622:5:1455608:884", "request_id": "1371622:5:1455608:884", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1371622", "t_dispatch_unix": 1779821446.559671, "t_finish_unix": 1779821447.2444828, "t_first_token_unix": 1779821446.8039339, "tpot_s": 0.005869856533439209, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14366141], "trace_timestamp_s": 759.6210000000001, "ttft_s": 0.24426086398307234, "turn_id": 5} +{"actual_output_tokens": 1368, "cached_tokens": 127616, "effective_input_length": 128563, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 128563, "latency_s": 17.554749828006607, "output_length": 1368, "proxy_request_id": "1356885:3:1451307:879", "request_id": "1356885:3:1451307:879", "request_type": "coder", "requested_output_tokens": 1368, "session_id": "1356885", "t_dispatch_unix": 1779821438.3845298, "t_finish_unix": 1779821455.9392798, "t_first_token_unix": 1779821439.529528, "tpot_s": 0.01200402524947695, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14202196, 14202197, 14202198, 14202199, 14202200, 14202201, 14202202, 14202203, 14202204, 14325634, 14325635, 14325636], "trace_timestamp_s": 744.8150000000005, "ttft_s": 1.14499534398783, "turn_id": 3} +{"actual_output_tokens": 79, "cached_tokens": 64512, "effective_input_length": 129839, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129839, "latency_s": 39.852226502029225, "output_length": 79, "proxy_request_id": "1313181:10:1338837:436", "request_id": "1313181:10:1338837:436", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1313181", "t_dispatch_unix": 1779821416.8261695, "t_finish_unix": 1779821456.6783962, "t_first_token_unix": 1779821455.3551962, "tpot_s": 0.01695786882117271, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13291139], "trace_timestamp_s": 353.08300000000054, "ttft_s": 38.529024276998825, "turn_id": 10} +{"actual_output_tokens": 90, "cached_tokens": 29200, "effective_input_length": 29268, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29268, "latency_s": 0.6490894699818455, "output_length": 90, "proxy_request_id": "1363943:14:1458616:885", "request_id": "1363943:14:1458616:885", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1363943", "t_dispatch_unix": 1779821456.5045059, "t_finish_unix": 1779821457.1535952, "t_first_token_unix": 1779821456.5994594, "tpot_s": 0.006223352067434134, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14395120], "trace_timestamp_s": 769.5660000000007, "ttft_s": 0.09495040395995602, "turn_id": 14} +{"actual_output_tokens": 366, "cached_tokens": 64720, "effective_input_length": 64724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 64724, "latency_s": 5.642605056986213, "output_length": 366, "proxy_request_id": "1313181:10:1399867:746", "request_id": "1313181:10:1399867:746", "request_type": "coder", "requested_output_tokens": 366, "session_id": "1313181", "t_dispatch_unix": 1779821456.684203, "t_finish_unix": 1779821462.3268075, "t_first_token_unix": 1779821456.8044872, "tpot_s": 0.015128979594478613, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13853445], "trace_timestamp_s": 566.9639999999999, "ttft_s": 0.12028257001657039, "turn_id": 10} +{"actual_output_tokens": 352, "cached_tokens": 32080, "effective_input_length": 34392, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34392, "latency_s": 3.017546505026985, "output_length": 352, "proxy_request_id": "1404395:3:1460072:887", "request_id": "1404395:3:1460072:887", "request_type": "coder", "requested_output_tokens": 352, "session_id": "1404395", "t_dispatch_unix": 1779821461.1417487, "t_finish_unix": 1779821464.159295, "t_first_token_unix": 1779821461.7703245, "tpot_s": 0.006805469034049936, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14408522], "trace_timestamp_s": 774.201, "ttft_s": 0.6285734200500883, "turn_id": 3} +{"actual_output_tokens": 210, "cached_tokens": 29344, "effective_input_length": 29651, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29651, "latency_s": 1.5507028169813566, "output_length": 210, "proxy_request_id": "1363943:15:1461716:889", "request_id": "1363943:15:1461716:889", "request_type": "coder", "requested_output_tokens": 210, "session_id": "1363943", "t_dispatch_unix": 1779821466.4280658, "t_finish_unix": 1779821467.978768, "t_first_token_unix": 1779821466.6158378, "tpot_s": 0.006519493641071111, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564], "trace_timestamp_s": 779.4890000000005, "ttft_s": 0.18776937999064103, "turn_id": 15} +{"actual_output_tokens": 303, "cached_tokens": 0, "effective_input_length": 26406, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26406, "latency_s": 7.261768386990298, "output_length": 303, "proxy_request_id": "1242838:5:1460026:886", "request_id": "1242838:5:1460026:886", "request_type": "coder", "requested_output_tokens": 303, "session_id": "1242838", "t_dispatch_unix": 1779821460.9933453, "t_finish_unix": 1779821468.2551138, "t_first_token_unix": 1779821464.264528, "tpot_s": 0.013212850993300251, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082], "trace_timestamp_s": 774.0540000000001, "ttft_s": 3.271180594980251, "turn_id": 5} +{"actual_output_tokens": 215, "cached_tokens": 29856, "effective_input_length": 34671, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34671, "latency_s": 2.605995921010617, "output_length": 215, "proxy_request_id": "1363943:16:1463626:890", "request_id": "1363943:16:1463626:890", "request_type": "coder", "requested_output_tokens": 215, "session_id": "1363943", "t_dispatch_unix": 1779821472.8976336, "t_finish_unix": 1779821475.5036297, "t_first_token_unix": 1779821474.0573773, "tpot_s": 0.006756656658759549, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14441618], "trace_timestamp_s": 785.9570000000003, "ttft_s": 1.1597411580150947, "turn_id": 16} +{"actual_output_tokens": 116, "cached_tokens": 55104, "effective_input_length": 56147, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56147, "latency_s": 1.4160877470276318, "output_length": 116, "proxy_request_id": "1268861:12:1463977:891", "request_id": "1268861:12:1463977:891", "request_type": "coder", "requested_output_tokens": 116, "session_id": "1268861", "t_dispatch_unix": 1779821474.1808076, "t_finish_unix": 1779821475.5968955, "t_first_token_unix": 1779821474.7192595, "tpot_s": 0.007629683930123144, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14445190], "trace_timestamp_s": 787.241, "ttft_s": 0.5384487390401773, "turn_id": 12} +{"actual_output_tokens": 4542, "cached_tokens": 101760, "effective_input_length": 108020, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108020, "latency_s": 71.95786093402421, "output_length": 4542, "proxy_request_id": "1364090:10:1426859:847", "request_id": "1364090:10:1426859:847", "request_type": "coder", "requested_output_tokens": 4542, "session_id": "1364090", "t_dispatch_unix": 1779821406.3239834, "t_finish_unix": 1779821478.2818449, "t_first_token_unix": 1779821410.5636399, "tpot_s": 0.014912548449907807, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 3796, 3797, 3798, 3799, 3800, 3143, 3801, 81990, 110342, 110343, 110344, 110345, 110346, 110347, 13458533, 13458534, 13458535, 13525464, 13525465, 13597472, 13597473, 13597474, 13597475, 13597476, 13597477, 13597478, 13597479, 13597480, 13597481, 13597482, 13597483, 13597484, 13597485, 13597486, 13597487, 13597488, 13597489, 13597490, 13597491, 13597492, 13597493, 13597494, 13597495, 13597496, 13688809, 13688810, 13688811, 13688812, 13688813, 13688814, 13688815, 13688816, 13688817, 13688818, 13688819, 13688820, 13688821, 13688822, 13688823, 13688824, 13688825, 13688826, 13688827, 13688828, 13688829, 13688830, 13688831, 13688832, 13688833, 13688834, 13688835, 13688836, 13688837, 13688838, 13688839, 13688840, 13688841, 13688842, 13688843, 13688844, 13688845, 13688846, 13688847, 13688848, 13790834, 13790835, 13790836, 13865215, 13865216, 13865217, 13865218, 13865219, 13865220, 13865221, 13865222, 13865223, 13865224, 13865225, 13865226, 13865227, 13865228, 13865229, 13865230, 13865231, 13865232, 13865233, 13865234, 13865235, 13865236, 13865237, 13865238, 13865239, 13865240, 13865241, 13934120, 13934121, 13934122, 13934123, 13934124, 13934125, 13934126, 13934127, 13934128, 13934129, 13934130, 13934131, 13934132, 13934133, 13934134, 13934135, 13934136, 13934137, 13934138, 13934139, 13934140, 13968761, 13968762, 13968763, 13968764, 13968765, 13968766, 13968767, 13968768, 13968769, 13968770, 13968771, 13968772, 13968773, 13968774, 13968775, 13968776, 13968777, 13968778, 13968779, 13968780, 13968781, 13968782, 13968783, 13968784, 13968785, 14010092, 14010093, 14010094, 14010095, 14010096, 14010097, 14010098, 14010099, 14010100, 14010101, 14010102, 14010103, 14010104, 14010105, 14010106, 14010107, 14010108, 14010109, 14010110, 14010111, 14010112, 14068318, 14068319, 14068320, 14068321, 14068322, 14068323, 14068324, 14068325, 14068326, 14096917, 14096918, 14096919, 14096920, 14096921, 14096922, 14096923, 14096924, 14096925, 14096926, 14096927, 14096928, 14096929], "trace_timestamp_s": 661.8389999999999, "ttft_s": 4.239653857017402, "turn_id": 10} +{"actual_output_tokens": 166, "cached_tokens": 34880, "effective_input_length": 35991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35991, "latency_s": 1.480991578020621, "output_length": 166, "proxy_request_id": "1363943:17:1466811:893", "request_id": "1363943:17:1466811:893", "request_type": "coder", "requested_output_tokens": 166, "session_id": "1363943", "t_dispatch_unix": 1779821483.5790532, "t_finish_unix": 1779821485.0600443, "t_first_token_unix": 1779821483.9512882, "tpot_s": 0.006718036975838583, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14471076], "trace_timestamp_s": 796.6350000000002, "ttft_s": 0.37223314098082483, "turn_id": 17} +{"actual_output_tokens": 71, "cached_tokens": 0, "effective_input_length": 81299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 81299, "latency_s": 23.27580104401568, "output_length": 71, "proxy_request_id": "1363093:6:1460799:888", "request_id": "1363093:6:1460799:888", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1363093", "t_dispatch_unix": 1779821463.5649748, "t_finish_unix": 1779821486.8407753, "t_first_token_unix": 1779821485.9272885, "tpot_s": 0.013046223328482093, "trace_hash_ids": [47587, 4719049, 4719050, 4719051, 4719052, 4719053, 4719054, 403834, 403835, 403836, 403837, 403838, 403839, 4719055, 4719056, 4719057, 4719058, 4719059, 4719060, 4719061, 4719062, 4719063, 4719064, 4719065, 4719066, 4719067, 4719068, 4719069, 4719070, 4719071, 13516841, 13516842, 13516843, 13516844, 13516845, 13516846, 13516847, 13516848, 13516849, 13516850, 13516851, 13516852, 13516853, 13516854, 13516855, 13516856, 13516857, 13516858, 13516859, 13516860, 13516861, 13516862, 13516863, 13516864, 13516865, 13516866, 13516867, 13516868, 13516869, 13516870, 13516871, 13516872, 13516873, 13516874, 13516875, 13516876, 13516877, 13516878, 13516879, 13516880, 13516881, 13516882, 13516883, 13516884, 13516885, 13516886, 13516887, 13516888, 13516889, 13516890, 13516891, 13516892, 13516893, 13516894, 13516895, 13516896, 13516897, 13516898, 13516899, 13516900, 13516901, 13516902, 13516903, 13516904, 13516905, 13516906, 13516907, 13516908, 13516909, 13516910, 13516911, 13516912, 13516913, 13516914, 13516915, 13516916, 13516917, 13516918, 13516919, 13516920, 13516921, 13516922, 13516923, 13516924, 13516925, 13516926, 13516927, 13516928, 13516929, 13516930, 13516931, 13516932, 13516933, 13567147, 13620062, 13764670, 13764671, 13764672, 13764673, 13764674, 13764675, 13764676, 13764677, 13764678, 13925441, 13925442, 13925443, 13925444, 13925445, 13925446, 13925447, 13925448, 13925449, 14416033, 14416034, 14416035, 14416036, 14416037, 14416038, 14416039, 14416040, 14416041, 14416042, 14416043, 14416044, 14416045, 14416046, 14416047, 14416048], "trace_timestamp_s": 776.6220000000003, "ttft_s": 22.362311687029433, "turn_id": 6} +{"actual_output_tokens": 86, "cached_tokens": 21584, "effective_input_length": 23079, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23079, "latency_s": 8.496385842037853, "output_length": 86, "proxy_request_id": "1371622:6:1465333:892", "request_id": "1371622:6:1465333:892", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1371622", "t_dispatch_unix": 1779821478.4411874, "t_finish_unix": 1779821486.937573, "t_first_token_unix": 1779821486.097306, "tpot_s": 0.009882545411614154, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14456423], "trace_timestamp_s": 791.5020000000004, "ttft_s": 7.656116779020522, "turn_id": 6} +{"actual_output_tokens": 183, "cached_tokens": 34736, "effective_input_length": 34863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34863, "latency_s": 1.3419576509622857, "output_length": 183, "proxy_request_id": "1404395:4:1467473:894", "request_id": "1404395:4:1467473:894", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1404395", "t_dispatch_unix": 1779821485.8940592, "t_finish_unix": 1779821487.2360168, "t_first_token_unix": 1779821486.0100338, "tpot_s": 0.006734795725116363, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14477863], "trace_timestamp_s": 798.9530000000004, "ttft_s": 0.11597298597916961, "turn_id": 4} +{"actual_output_tokens": 137, "cached_tokens": 23152, "effective_input_length": 24036, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24036, "latency_s": 1.055176765017677, "output_length": 137, "proxy_request_id": "1371622:7:1468305:895", "request_id": "1371622:7:1468305:895", "request_type": "coder", "requested_output_tokens": 137, "session_id": "1371622", "t_dispatch_unix": 1779821488.6663647, "t_finish_unix": 1779821489.7215414, "t_first_token_unix": 1779821488.8923342, "tpot_s": 0.006095127360501518, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666], "trace_timestamp_s": 801.7260000000006, "ttft_s": 0.2259673840017058, "turn_id": 7} +{"actual_output_tokens": 366, "cached_tokens": 36144, "effective_input_length": 47303, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47303, "latency_s": 5.937616651994176, "output_length": 366, "proxy_request_id": "1363943:18:1469143:896", "request_id": "1363943:18:1469143:896", "request_type": "coder", "requested_output_tokens": 366, "session_id": "1363943", "t_dispatch_unix": 1779821491.4807518, "t_finish_unix": 1779821497.4183683, "t_first_token_unix": 1779821494.700102, "tpot_s": 0.007446470104113272, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14493422], "trace_timestamp_s": 804.5360000000001, "ttft_s": 3.2193476139800623, "turn_id": 18} +{"actual_output_tokens": 76, "cached_tokens": 65088, "effective_input_length": 129931, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 129931, "latency_s": 39.76862931397045, "output_length": 76, "proxy_request_id": "1313181:11:1344301:464", "request_id": "1313181:11:1344301:464", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1313181", "t_dispatch_unix": 1779821462.3312356, "t_finish_unix": 1779821502.0998647, "t_first_token_unix": 1779821500.7752235, "tpot_s": 0.017658500052833308, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342], "trace_timestamp_s": 371.9440000000004, "ttft_s": 38.443984388024546, "turn_id": 11} +{"actual_output_tokens": 3875, "cached_tokens": 73296, "effective_input_length": 101803, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101803, "latency_s": 263.22470990003785, "output_length": 3875, "proxy_request_id": "1314357:5:1393659:719", "request_id": "1314357:5:1393659:719", "request_type": "coder", "requested_output_tokens": 3875, "session_id": "1314357", "t_dispatch_unix": 1779821239.3532495, "t_finish_unix": 1779821502.5779595, "t_first_token_unix": 1779821254.7380948, "tpot_s": 0.06397508454826893, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 13796640], "trace_timestamp_s": 545.116, "ttft_s": 15.384842143044807, "turn_id": 5} +{"actual_output_tokens": 51, "cached_tokens": 65120, "effective_input_length": 65123, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65123, "latency_s": 0.8356934370240197, "output_length": 51, "proxy_request_id": "1313181:11:1402841:762", "request_id": "1313181:11:1402841:762", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1313181", "t_dispatch_unix": 1779821502.1038854, "t_finish_unix": 1779821502.9395788, "t_first_token_unix": 1779821502.2210405, "tpot_s": 0.01436541911913082, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13881594], "trace_timestamp_s": 577.3000000000002, "ttft_s": 0.11715201003244147, "turn_id": 11} +{"actual_output_tokens": 27, "cached_tokens": 12176, "effective_input_length": 12247, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 12247, "latency_s": 0.1970707310247235, "output_length": 27, "proxy_request_id": "1399948:13:1472968:898", "request_id": "1399948:13:1472968:898", "request_type": "coder", "requested_output_tokens": 27, "session_id": "1399948", "t_dispatch_unix": 1779821504.0193284, "t_finish_unix": 1779821504.216399, "t_first_token_unix": 1779821504.0834863, "tpot_s": 0.005102812462540057, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14529718], "trace_timestamp_s": 817.0790000000006, "ttft_s": 0.06415650498820469, "turn_id": 13} +{"actual_output_tokens": 217, "cached_tokens": 13552, "effective_input_length": 66246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66246, "latency_s": 16.20645386900287, "output_length": 217, "proxy_request_id": "1405155:3:1469167:897", "request_id": "1405155:3:1469167:897", "request_type": "coder", "requested_output_tokens": 217, "session_id": "1405155", "t_dispatch_unix": 1779821491.5563583, "t_finish_unix": 1779821507.7628121, "t_first_token_unix": 1779821505.9803226, "tpot_s": 0.008250915009099387, "trace_hash_ids": [10318, 19962, 19963, 6857595, 285666, 285667, 285668, 285669, 285670, 46040, 5773882, 5773883, 1206371, 5773884, 5773885, 5773886, 13900916, 133747, 5372951, 5372952, 5372953, 5372954, 5372955, 5372956, 13900917, 13900918, 13900919, 13900920, 13900921, 13900922, 13900923, 13900924, 13900925, 13900926, 13900927, 13900928, 13900929, 13900930, 13900931, 13900932, 13900933, 13900934, 13900935, 13900936, 13900937, 13900938, 13900939, 13900940, 13900941, 13900942, 13900943, 13900944, 13900945, 13900946, 13900947, 13900948, 13900949, 13900950, 13900951, 13900952, 13900953, 13900954, 13900955, 13900956, 13983589, 13983590, 13983591, 13983592, 13983593, 13983594, 13983595, 13983596, 13983597, 13983598, 13983599, 13983600, 13983601, 13983602, 13983603, 14163102, 14163103, 14163104, 14163105, 14163106, 14163107, 14163108, 14163109, 14163110, 14163111, 14163112, 14163113, 14163114, 14163115, 14163116, 14493552, 14493553, 14493554, 14493555, 14493556, 14493557, 14493558, 14493559, 14493560, 14493561, 14493562, 14493563, 14493564, 14493565, 14493566, 14493567, 14493568, 14493569, 14493570, 14493571, 14493572, 14493573, 14493574, 14493575, 14493576, 14493577, 14493578, 14493579, 14493580, 14493581, 14493582, 14493583, 14493584, 14493585, 14493586, 14493587], "trace_timestamp_s": 804.6080000000002, "ttft_s": 14.423962123051751, "turn_id": 3} +{"actual_output_tokens": 499, "cached_tokens": 24160, "effective_input_length": 24569, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24569, "latency_s": 3.2713286919752136, "output_length": 499, "proxy_request_id": "1371622:8:1473416:899", "request_id": "1371622:8:1473416:899", "request_type": "coder", "requested_output_tokens": 499, "session_id": "1371622", "t_dispatch_unix": 1779821505.6863124, "t_finish_unix": 1779821508.957641, "t_first_token_unix": 1779821505.8533993, "tpot_s": 0.006232772728925698, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666, 14534121], "trace_timestamp_s": 818.7460000000001, "ttft_s": 0.16708460595691577, "turn_id": 8} +{"actual_output_tokens": 150, "cached_tokens": 75792, "effective_input_length": 76600, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76600, "latency_s": 5.252710847998969, "output_length": 150, "proxy_request_id": "1342921:7:1473812:900", "request_id": "1342921:7:1473812:900", "request_type": "coder", "requested_output_tokens": 150, "session_id": "1342921", "t_dispatch_unix": 1779821506.973388, "t_finish_unix": 1779821512.226098, "t_first_token_unix": 1779821507.552126, "tpot_s": 0.03136599077155576, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14537884], "trace_timestamp_s": 820.0320000000002, "ttft_s": 0.5787355700158514, "turn_id": 7} +{"actual_output_tokens": 235, "cached_tokens": 47664, "effective_input_length": 56056, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56056, "latency_s": 5.675791244022548, "output_length": 235, "proxy_request_id": "1363943:19:1473899:901", "request_id": "1363943:19:1473899:901", "request_type": "coder", "requested_output_tokens": 235, "session_id": "1363943", "t_dispatch_unix": 1779821507.2551634, "t_finish_unix": 1779821512.9309547, "t_first_token_unix": 1779821510.4077945, "tpot_s": 0.010781472636651423, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14538809], "trace_timestamp_s": 820.3120000000008, "ttft_s": 3.1526283060084097, "turn_id": 19} +{"actual_output_tokens": 419, "cached_tokens": 56288, "effective_input_length": 60761, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60761, "latency_s": 5.225774041027762, "output_length": 419, "proxy_request_id": "1363943:20:1476805:903", "request_id": "1363943:20:1476805:903", "request_type": "coder", "requested_output_tokens": 419, "session_id": "1363943", "t_dispatch_unix": 1779821517.2219021, "t_finish_unix": 1779821522.4476757, "t_first_token_unix": 1779821519.0247092, "tpot_s": 0.00818817533968177, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14566556], "trace_timestamp_s": 830.2800000000007, "ttft_s": 1.8028041090001352, "turn_id": 20} +{"actual_output_tokens": 183, "cached_tokens": 0, "effective_input_length": 44949, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44949, "latency_s": 9.117402850009967, "output_length": 183, "proxy_request_id": "1305906:4:1476757:902", "request_id": "1305906:4:1476757:902", "request_type": "coder", "requested_output_tokens": 183, "session_id": "1305906", "t_dispatch_unix": 1779821517.045834, "t_finish_unix": 1779821526.1632364, "t_first_token_unix": 1779821524.8483713, "tpot_s": 0.0072230571045560745, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14566041, 14566042], "trace_timestamp_s": 830.094, "ttft_s": 7.802535017021, "turn_id": 4} +{"actual_output_tokens": 90, "cached_tokens": 25056, "effective_input_length": 25286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25286, "latency_s": 0.6593710840097629, "output_length": 90, "proxy_request_id": "1371622:9:1479535:905", "request_id": "1371622:9:1479535:905", "request_type": "coder", "requested_output_tokens": 90, "session_id": "1371622", "t_dispatch_unix": 1779821526.361404, "t_finish_unix": 1779821527.020775, "t_first_token_unix": 1779821526.4825864, "tpot_s": 0.0060438342586034135, "trace_hash_ids": [364052, 364053, 364054, 12336707, 12336708, 12336709, 12336710, 12336711, 12336712, 12336713, 12336714, 12336715, 12336716, 12336717, 12336718, 12336719, 12336720, 12336721, 12336722, 12336723, 12336724, 12336725, 13595697, 13595698, 13595699, 13595700, 14240610, 14240611, 14240612, 14240613, 14240614, 14240615, 14240616, 14240617, 14240618, 14240619, 14240620, 14256523, 14334571, 14334572, 14366139, 14366140, 14456420, 14456421, 14456422, 14485665, 14485666, 14534121, 14590128, 14590129], "trace_timestamp_s": 839.4230000000007, "ttft_s": 0.12117995298467577, "turn_id": 9} +{"actual_output_tokens": 378, "cached_tokens": 35040, "effective_input_length": 36988, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36988, "latency_s": 4.186369217990432, "output_length": 378, "proxy_request_id": "1404395:5:1480170:906", "request_id": "1404395:5:1480170:906", "request_type": "coder", "requested_output_tokens": 378, "session_id": "1404395", "t_dispatch_unix": 1779821528.6011407, "t_finish_unix": 1779821532.7875097, "t_first_token_unix": 1779821529.1971183, "tpot_s": 0.009522713130075652, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14596005], "trace_timestamp_s": 841.6610000000001, "ttft_s": 0.5959747739834711, "turn_id": 5} +{"actual_output_tokens": 164, "cached_tokens": 56256, "effective_input_length": 57130, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57130, "latency_s": 1.7096772529766895, "output_length": 164, "proxy_request_id": "1268861:13:1481831:907", "request_id": "1268861:13:1481831:907", "request_type": "coder", "requested_output_tokens": 164, "session_id": "1268861", "t_dispatch_unix": 1779821534.1907187, "t_finish_unix": 1779821535.9003959, "t_first_token_unix": 1779821534.6363108, "tpot_s": 0.007753396276070342, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14610203], "trace_timestamp_s": 847.2510000000002, "ttft_s": 0.4455893919803202, "turn_id": 13} +{"actual_output_tokens": 1604, "cached_tokens": 38816, "effective_input_length": 38827, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38827, "latency_s": 12.966362342005596, "output_length": 1604, "proxy_request_id": "1301929:4:1479037:904", "request_id": "1301929:4:1479037:904", "request_type": "coder", "requested_output_tokens": 1604, "session_id": "1301929", "t_dispatch_unix": 1779821524.6166458, "t_finish_unix": 1779821537.5830073, "t_first_token_unix": 1779821524.6943555, "tpot_s": 0.008040168130388617, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 244222, 244223, 8074420, 8074421, 12946894, 12946895, 12946896, 12946897, 12946898, 12946899, 12946900, 12946901, 12946902, 12946903, 12946904, 12946905, 12946906, 12946907, 12946908, 12946909, 12946910, 12946911, 12946912, 12946913, 12946914, 12946915, 12946916, 12946917, 12946918, 12946919, 12946920, 12946921, 12946922, 12946923, 12946924, 12946925, 12946926, 12946927, 12946928, 12946929, 12946930, 12946931, 12946932, 12946933, 12946934, 12946935, 12946936, 12946937, 12946938, 12946939, 12946940, 12946941, 12946942, 12946943, 12946944, 12946945, 12946946, 12946947, 12946948, 12946949, 12946950, 13626958, 13626959, 14014871, 14014872, 14014873, 14585791, 14585792, 14585793], "trace_timestamp_s": 837.6770000000006, "ttft_s": 0.07770826498745009, "turn_id": 4} +{"actual_output_tokens": 370, "cached_tokens": 61168, "effective_input_length": 65658, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65658, "latency_s": 5.0490036780247465, "output_length": 370, "proxy_request_id": "1363943:21:1482184:908", "request_id": "1363943:21:1482184:908", "request_type": "coder", "requested_output_tokens": 370, "session_id": "1363943", "t_dispatch_unix": 1779821535.520645, "t_finish_unix": 1779821540.569648, "t_first_token_unix": 1779821537.4667196, "tpot_s": 0.008408179525746573, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14613732], "trace_timestamp_s": 848.5780000000004, "ttft_s": 1.9460730369901285, "turn_id": 21} +{"actual_output_tokens": 81, "cached_tokens": 65168, "effective_input_length": 130479, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130479, "latency_s": 40.11382164404495, "output_length": 81, "proxy_request_id": "1313181:12:1346194:470", "request_id": "1313181:12:1346194:470", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1313181", "t_dispatch_unix": 1779821502.943926, "t_finish_unix": 1779821543.057748, "t_first_token_unix": 1779821541.6646705, "tpot_s": 0.017409401162149153, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182], "trace_timestamp_s": 378.5650000000005, "ttft_s": 38.72074129304383, "turn_id": 12} +{"actual_output_tokens": 359, "cached_tokens": 37360, "effective_input_length": 37689, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37689, "latency_s": 2.704580088960938, "output_length": 359, "proxy_request_id": "1404395:6:1483967:909", "request_id": "1404395:6:1483967:909", "request_type": "coder", "requested_output_tokens": 359, "session_id": "1404395", "t_dispatch_unix": 1779821541.4444165, "t_finish_unix": 1779821544.1489966, "t_first_token_unix": 1779821541.6688862, "tpot_s": 0.006926984209489264, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14632577], "trace_timestamp_s": 854.5040000000008, "ttft_s": 0.2244683419703506, "turn_id": 6} +{"actual_output_tokens": 69, "cached_tokens": 65168, "effective_input_length": 65179, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65179, "latency_s": 1.0985923510161228, "output_length": 69, "proxy_request_id": "1313181:12:1404813:772", "request_id": "1313181:12:1404813:772", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1313181", "t_dispatch_unix": 1779821543.0615954, "t_finish_unix": 1779821544.1601877, "t_first_token_unix": 1779821543.1887813, "tpot_s": 0.014282390588264474, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13897933], "trace_timestamp_s": 584.0840000000007, "ttft_s": 0.1271837119711563, "turn_id": 12} +{"actual_output_tokens": 398, "cached_tokens": 66016, "effective_input_length": 70238, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70238, "latency_s": 5.384751912963111, "output_length": 398, "proxy_request_id": "1363943:22:1485341:910", "request_id": "1363943:22:1485341:910", "request_type": "coder", "requested_output_tokens": 398, "session_id": "1363943", "t_dispatch_unix": 1779821546.1756475, "t_finish_unix": 1779821551.560399, "t_first_token_unix": 1779821548.1123166, "tpot_s": 0.008684626589406056, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14647276], "trace_timestamp_s": 859.232, "ttft_s": 1.9366669179871678, "turn_id": 22} +{"actual_output_tokens": 205, "cached_tokens": 26704, "effective_input_length": 29903, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29903, "latency_s": 2.0728220930323005, "output_length": 205, "proxy_request_id": "1242838:6:1486863:911", "request_id": "1242838:6:1486863:911", "request_type": "coder", "requested_output_tokens": 205, "session_id": "1242838", "t_dispatch_unix": 1779821551.19915, "t_finish_unix": 1779821553.2719722, "t_first_token_unix": 1779821551.9455254, "tpot_s": 0.006500710754920089, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082, 14660531, 14660532, 14660533, 14660534, 14660535, 14660536, 14660537], "trace_timestamp_s": 864.2580000000007, "ttft_s": 0.746373002009932, "turn_id": 6} +{"actual_output_tokens": 226, "cached_tokens": 70624, "effective_input_length": 72516, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72516, "latency_s": 3.019929890986532, "output_length": 226, "proxy_request_id": "1363943:23:1488713:912", "request_id": "1363943:23:1488713:912", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1363943", "t_dispatch_unix": 1779821557.3252249, "t_finish_unix": 1779821560.3451543, "t_first_token_unix": 1779821558.387297, "tpot_s": 0.008700360688898299, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14678082], "trace_timestamp_s": 870.3830000000007, "ttft_s": 1.0620697810081765, "turn_id": 23} +{"actual_output_tokens": 45, "cached_tokens": 38032, "effective_input_length": 39569, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39569, "latency_s": 0.7715881959884427, "output_length": 45, "proxy_request_id": "1404395:7:1491186:914", "request_id": "1404395:7:1491186:914", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1404395", "t_dispatch_unix": 1779821565.9884903, "t_finish_unix": 1779821566.7600777, "t_first_token_unix": 1779821566.477421, "tpot_s": 0.0064181225223530255, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14668041, 14668042, 14668043, 14701438, 14701439], "trace_timestamp_s": 879.0480000000007, "ttft_s": 0.4889287779806182, "turn_id": 7} +{"actual_output_tokens": 181, "cached_tokens": 72736, "effective_input_length": 74939, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74939, "latency_s": 2.8116270839818753, "output_length": 181, "proxy_request_id": "1363943:24:1491020:913", "request_id": "1363943:24:1491020:913", "request_type": "coder", "requested_output_tokens": 181, "session_id": "1363943", "t_dispatch_unix": 1779821565.5893028, "t_finish_unix": 1779821568.4009295, "t_first_token_unix": 1779821566.8255453, "tpot_s": 0.008750771616663162, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14700163], "trace_timestamp_s": 878.643, "ttft_s": 1.2362403309671208, "turn_id": 24} +{"actual_output_tokens": 246, "cached_tokens": 75104, "effective_input_length": 75711, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75711, "latency_s": 2.5903446649899706, "output_length": 246, "proxy_request_id": "1363943:25:1493325:915", "request_id": "1363943:25:1493325:915", "request_type": "coder", "requested_output_tokens": 246, "session_id": "1363943", "t_dispatch_unix": 1779821573.0682623, "t_finish_unix": 1779821575.6586065, "t_first_token_unix": 1779821573.4957411, "tpot_s": 0.008826948224557374, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986], "trace_timestamp_s": 886.1260000000002, "ttft_s": 0.4274769829935394, "turn_id": 25} +{"actual_output_tokens": 504, "cached_tokens": 39600, "effective_input_length": 39820, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39820, "latency_s": 3.7220026740105823, "output_length": 504, "proxy_request_id": "1404395:8:1494219:916", "request_id": "1404395:8:1494219:916", "request_type": "coder", "requested_output_tokens": 504, "session_id": "1404395", "t_dispatch_unix": 1779821576.0976028, "t_finish_unix": 1779821579.8196056, "t_first_token_unix": 1779821576.2535431, "tpot_s": 0.007088912161095827, "trace_hash_ids": [3411, 61623, 61624, 61625, 61626, 214265, 507617, 507618, 123579, 123580, 123581, 507619, 507620, 507621, 507622, 507623, 507624, 507625, 507626, 507627, 507628, 13709703, 6799325, 6799326, 5480446, 3649098, 7753009, 7753010, 13709704, 13709705, 13709706, 13709707, 13813546, 13813547, 13835885, 13867009, 13895249, 13895250, 13895251, 13895252, 13895253, 13895254, 13995780, 13995781, 13995782, 14019419, 14019420, 14019421, 14019422, 14019423, 14038599, 14052822, 14183674, 14183675, 14183676, 14183677, 14183678, 14311771, 14311772, 14311773, 14311774, 14311775, 14311776, 14356042, 14356043, 14408520, 14408521, 14457322, 14549647, 14549648, 14596003, 14596004, 14632576, 14668041, 14668042, 14668043, 14701438, 14730229], "trace_timestamp_s": 889.1580000000004, "ttft_s": 0.15593832900049165, "turn_id": 8} +{"actual_output_tokens": 143, "cached_tokens": 65232, "effective_input_length": 131699, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131699, "latency_s": 42.445984282996505, "output_length": 143, "proxy_request_id": "1313181:13:1349104:484", "request_id": "1313181:13:1349104:484", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1313181", "t_dispatch_unix": 1779821544.1646864, "t_finish_unix": 1779821586.6106706, "t_first_token_unix": 1779821584.0826766, "tpot_s": 0.017800789922443022, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182, 13385557, 13385558, 13385559], "trace_timestamp_s": 388.8780000000006, "ttft_s": 39.91798717301572, "turn_id": 13} +{"actual_output_tokens": 197, "cached_tokens": 75952, "effective_input_length": 83861, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83861, "latency_s": 5.839512135018595, "output_length": 197, "proxy_request_id": "1363943:26:1495648:917", "request_id": "1363943:26:1495648:917", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1363943", "t_dispatch_unix": 1779821580.8345094, "t_finish_unix": 1779821586.6740205, "t_first_token_unix": 1779821584.8577707, "tpot_s": 0.009265437831493969, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228], "trace_timestamp_s": 893.8879999999999, "ttft_s": 4.023259680019692, "turn_id": 26} +{"actual_output_tokens": 525, "cached_tokens": 105664, "effective_input_length": 105709, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105709, "latency_s": 86.74790270399535, "output_length": 525, "proxy_request_id": "1314357:6:1422517:839", "request_id": "1314357:6:1422517:839", "request_type": "coder", "requested_output_tokens": 525, "session_id": "1314357", "t_dispatch_unix": 1779821502.5847406, "t_finish_unix": 1779821589.3326435, "t_first_token_unix": 1779821502.7856858, "tpot_s": 0.1651652858110246, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14056875, 14056876], "trace_timestamp_s": 646.2290000000003, "ttft_s": 0.20094234601128846, "turn_id": 6} +{"actual_output_tokens": 257, "cached_tokens": 65264, "effective_input_length": 65279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65279, "latency_s": 3.934273455000948, "output_length": 257, "proxy_request_id": "1313181:13:1406095:783", "request_id": "1313181:13:1406095:783", "request_type": "coder", "requested_output_tokens": 257, "session_id": "1313181", "t_dispatch_unix": 1779821586.6140523, "t_finish_unix": 1779821590.5483258, "t_first_token_unix": 1779821586.740777, "tpot_s": 0.014872266156089609, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13909100], "trace_timestamp_s": 588.6900000000005, "ttft_s": 0.12672274000942707, "turn_id": 13} +{"actual_output_tokens": 376, "cached_tokens": 84048, "effective_input_length": 84090, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 84090, "latency_s": 3.690722191007808, "output_length": 376, "proxy_request_id": "1363943:27:1497882:919", "request_id": "1363943:27:1497882:919", "request_type": "coder", "requested_output_tokens": 376, "session_id": "1363943", "t_dispatch_unix": 1779821588.1043944, "t_finish_unix": 1779821591.7951167, "t_first_token_unix": 1779821588.2641227, "tpot_s": 0.009415308855939657, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14764349], "trace_timestamp_s": 901.1640000000007, "ttft_s": 0.1597257440444082, "turn_id": 27} +{"actual_output_tokens": 74, "cached_tokens": 57280, "effective_input_length": 61910, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61910, "latency_s": 2.4134492090088315, "output_length": 74, "proxy_request_id": "1268861:14:1498281:920", "request_id": "1268861:14:1498281:920", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1268861", "t_dispatch_unix": 1779821589.5805376, "t_finish_unix": 1779821591.9939868, "t_first_token_unix": 1779821591.439449, "tpot_s": 0.007592940821841819, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224], "trace_timestamp_s": 902.6390000000001, "ttft_s": 1.8589092639740556, "turn_id": 14} +{"actual_output_tokens": 298, "cached_tokens": 30096, "effective_input_length": 33352, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33352, "latency_s": 2.7943657219875604, "output_length": 298, "proxy_request_id": "1242838:7:1499476:921", "request_id": "1242838:7:1499476:921", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1242838", "t_dispatch_unix": 1779821593.4184937, "t_finish_unix": 1779821596.212859, "t_first_token_unix": 1779821594.2310507, "tpot_s": 0.006671809306390182, "trace_hash_ids": [55644, 55645, 55646, 55647, 55648, 55649, 55650, 12372250, 2951112, 12372251, 12372252, 12372253, 12372254, 12372255, 12372256, 12372257, 12372258, 12372259, 12372260, 12372261, 12372262, 12372263, 12372264, 12372265, 12372266, 12372267, 12372268, 12372269, 12372270, 12372271, 12372272, 12372273, 12372274, 12372275, 12446379, 12446380, 12446381, 12446382, 12446383, 12446384, 12446385, 12446386, 12522891, 12522892, 12596370, 12596371, 12596372, 12596373, 12596374, 14408080, 14408081, 14408082, 14660531, 14660532, 14660533, 14660534, 14660535, 14660536, 14660537, 14778951, 14778952, 14778953, 14778954, 14778955, 14778956, 14778957], "trace_timestamp_s": 906.4770000000008, "ttft_s": 0.8125547269592062, "turn_id": 7} +{"actual_output_tokens": 229, "cached_tokens": 84464, "effective_input_length": 86984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86984, "latency_s": 3.7233635000302456, "output_length": 229, "proxy_request_id": "1363943:28:1500984:922", "request_id": "1363943:28:1500984:922", "request_type": "coder", "requested_output_tokens": 229, "session_id": "1363943", "t_dispatch_unix": 1779821598.4162629, "t_finish_unix": 1779821602.1396258, "t_first_token_unix": 1779821599.995584, "tpot_s": 0.009402406793812764, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559], "trace_timestamp_s": 911.473, "ttft_s": 1.5793180820182897, "turn_id": 28} +{"actual_output_tokens": 184, "cached_tokens": 0, "effective_input_length": 75760, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75760, "latency_s": 21.28305825596908, "output_length": 184, "proxy_request_id": "1388507:2:1496686:918", "request_id": "1388507:2:1496686:918", "request_type": "coder", "requested_output_tokens": 184, "session_id": "1388507", "t_dispatch_unix": 1779821584.1949074, "t_finish_unix": 1779821605.4779656, "t_first_token_unix": 1779821603.875806, "tpot_s": 0.008753417573787801, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728, 14709792, 14709793, 14709794, 14709795, 14709796, 14709797, 14709798], "trace_timestamp_s": 897.2540000000008, "ttft_s": 19.68089501099894, "turn_id": 2} +{"actual_output_tokens": 25, "cached_tokens": 76736, "effective_input_length": 78722, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78722, "latency_s": 2.524463634006679, "output_length": 25, "proxy_request_id": "1342921:8:1503584:925", "request_id": "1342921:8:1503584:925", "request_type": "coder", "requested_output_tokens": 25, "session_id": "1342921", "t_dispatch_unix": 1779821607.2713308, "t_finish_unix": 1779821609.7957945, "t_first_token_unix": 1779821609.5403392, "tpot_s": 0.010632912749618603, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14818583, 14818584, 14818585, 14818586, 14818587], "trace_timestamp_s": 920.3299999999999, "ttft_s": 2.269005289999768, "turn_id": 8} +{"actual_output_tokens": 53, "cached_tokens": 12272, "effective_input_length": 14189, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14189, "latency_s": 0.5749964690185152, "output_length": 53, "proxy_request_id": "1399948:14:1504493:926", "request_id": "1399948:14:1504493:926", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1399948", "t_dispatch_unix": 1779821610.0587566, "t_finish_unix": 1779821610.633753, "t_first_token_unix": 1779821610.348727, "tpot_s": 0.005475493461395113, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14827845], "trace_timestamp_s": 923.1200000000008, "ttft_s": 0.28996823402121663, "turn_id": 14} +{"actual_output_tokens": 212, "cached_tokens": 87200, "effective_input_length": 89469, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89469, "latency_s": 4.597080140025355, "output_length": 212, "proxy_request_id": "1363943:29:1503515:924", "request_id": "1363943:29:1503515:924", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1363943", "t_dispatch_unix": 1779821607.0186775, "t_finish_unix": 1779821611.6157572, "t_first_token_unix": 1779821608.4779825, "tpot_s": 0.014869300914780453, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14817740], "trace_timestamp_s": 920.0750000000007, "ttft_s": 1.4593022760236636, "turn_id": 29} +{"actual_output_tokens": 73, "cached_tokens": 89680, "effective_input_length": 89713, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89713, "latency_s": 0.8089396649738774, "output_length": 73, "proxy_request_id": "1363943:30:1506171:927", "request_id": "1363943:30:1506171:927", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1363943", "t_dispatch_unix": 1779821615.8561473, "t_finish_unix": 1779821616.6650863, "t_first_token_unix": 1779821616.021245, "tpot_s": 0.00893834073617149, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 14843115], "trace_timestamp_s": 928.9100000000008, "ttft_s": 0.16509506496367976, "turn_id": 30} +{"actual_output_tokens": 174, "cached_tokens": 61968, "effective_input_length": 63035, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63035, "latency_s": 2.0107963460031897, "output_length": 174, "proxy_request_id": "1268861:15:1508874:928", "request_id": "1268861:15:1508874:928", "request_type": "coder", "requested_output_tokens": 174, "session_id": "1268861", "t_dispatch_unix": 1779821624.9095733, "t_finish_unix": 1779821626.920369, "t_first_token_unix": 1779821625.5166247, "tpot_s": 0.008112707514466577, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 14868809], "trace_timestamp_s": 937.9670000000006, "ttft_s": 0.6070486140088178, "turn_id": 15} +{"actual_output_tokens": 46, "cached_tokens": 14240, "effective_input_length": 15669, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15669, "latency_s": 0.49765590304741636, "output_length": 46, "proxy_request_id": "1399948:15:1512300:930", "request_id": "1399948:15:1512300:930", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1399948", "t_dispatch_unix": 1779821636.3751435, "t_finish_unix": 1779821636.8727992, "t_first_token_unix": 1779821636.6286066, "tpot_s": 0.00542132371208734, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14902700], "trace_timestamp_s": 949.4360000000006, "ttft_s": 0.25346148799872026, "turn_id": 15} +{"actual_output_tokens": 355, "cached_tokens": 2544, "effective_input_length": 103893, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103893, "latency_s": 38.754183115961496, "output_length": 355, "proxy_request_id": "1397515:2:1502033:923", "request_id": "1397515:2:1502033:923", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1397515", "t_dispatch_unix": 1779821601.9726727, "t_finish_unix": 1779821640.7268555, "t_first_token_unix": 1779821637.0019517, "tpot_s": 0.010520942056502905, "trace_hash_ids": [61256, 61257, 9334, 61258, 61259, 61260, 61261, 61262, 61263, 61264, 61265, 139791, 92491, 139792, 139793, 139794, 139795, 139796, 139797, 139798, 740834, 740835, 740836, 740837, 1942273, 1942274, 1942275, 1942276, 1942277, 1942278, 1942279, 1942280, 1942281, 590845, 590846, 590847, 590848, 1942282, 161018, 161019, 161020, 161021, 1942283, 10351134, 10351135, 10351136, 10351137, 10351138, 10351139, 10351140, 10351141, 10351142, 10351143, 13831505, 2806911, 13831506, 13831507, 13831508, 13831509, 13831510, 13831511, 13831512, 13831513, 13831514, 13831515, 13831516, 13831517, 13831518, 13831519, 13831520, 13831521, 13831522, 13831523, 13831524, 13831525, 13831526, 13831527, 13831528, 13831529, 13831530, 13831531, 13831532, 13831533, 13831534, 13831535, 13831536, 13831537, 13831538, 13831539, 13831540, 13831541, 13831542, 13831543, 13831544, 13831545, 13831546, 13831547, 13831548, 13831549, 13831550, 13831551, 13831552, 13831553, 13831554, 13831555, 13831556, 13831557, 13831558, 13831559, 13831560, 13831561, 13831562, 13831563, 13831564, 13831565, 13831566, 13831567, 13831568, 13831569, 13831570, 13831571, 13831572, 13831573, 13831574, 13831575, 13831576, 13831577, 13831578, 13831579, 13831580, 13831581, 13831582, 13831583, 13831584, 13831585, 13831586, 13831587, 13831588, 13831589, 13831590, 13831591, 13831592, 13831593, 13831594, 13831595, 13831596, 13831597, 13831598, 13831599, 13831600, 13831601, 13831602, 13831603, 13831604, 13831605, 13831606, 13831607, 13831608, 13831609, 13831610, 13831611, 13831612, 13831613, 13831614, 13831615, 13831616, 13831617, 13831618, 13831619, 13831620, 13831621, 13831622, 13831623, 13831624, 13831625, 13831626, 13831627, 13831628, 14027210, 14027211, 14027212, 14697579, 14697580, 14697581, 14697582, 14697583, 14697584, 14697585, 14697586, 14697587, 14697588, 14697589, 14697590, 14697591, 14803950, 14803951, 14803952, 14803953, 14803954, 14803955, 14803956, 14803957, 14803958], "trace_timestamp_s": 915.0260000000007, "ttft_s": 35.02927707199706, "turn_id": 2} +{"actual_output_tokens": 76, "cached_tokens": 15712, "effective_input_length": 15913, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 15913, "latency_s": 0.5078458450152539, "output_length": 76, "proxy_request_id": "1399948:16:1513839:933", "request_id": "1399948:16:1513839:933", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1399948", "t_dispatch_unix": 1779821641.555761, "t_finish_unix": 1779821642.0636067, "t_first_token_unix": 1779821641.6393135, "tpot_s": 0.005653514106913159, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14917327], "trace_timestamp_s": 954.6170000000002, "ttft_s": 0.08355114603182301, "turn_id": 16} +{"actual_output_tokens": 288, "cached_tokens": 129920, "effective_input_length": 130532, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130532, "latency_s": 4.090237371972762, "output_length": 288, "proxy_request_id": "1356885:4:1512902:931", "request_id": "1356885:4:1512902:931", "request_type": "coder", "requested_output_tokens": 288, "session_id": "1356885", "t_dispatch_unix": 1779821638.2536604, "t_finish_unix": 1779821642.343898, "t_first_token_unix": 1779821638.9462507, "tpot_s": 0.011837473892012954, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770], "trace_timestamp_s": 951.308, "ttft_s": 0.692587313009426, "turn_id": 4} +{"actual_output_tokens": 485, "cached_tokens": 106224, "effective_input_length": 106279, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106279, "latency_s": 54.446814196999185, "output_length": 485, "proxy_request_id": "1314357:7:1427957:851", "request_id": "1314357:7:1427957:851", "request_type": "coder", "requested_output_tokens": 485, "session_id": "1314357", "t_dispatch_unix": 1779821589.3377986, "t_finish_unix": 1779821643.784613, "t_first_token_unix": 1779821589.5546405, "tpot_s": 0.11204466346481984, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14107729], "trace_timestamp_s": 665.424, "ttft_s": 0.2168394360342063, "turn_id": 7} +{"actual_output_tokens": 122, "cached_tokens": 106752, "effective_input_length": 106805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106805, "latency_s": 2.457555531000253, "output_length": 122, "proxy_request_id": "1314357:8:1431749:854", "request_id": "1314357:8:1431749:854", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1314357", "t_dispatch_unix": 1779821643.7894957, "t_finish_unix": 1779821646.2470512, "t_first_token_unix": 1779821644.0453641, "tpot_s": 0.01819371450394161, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14144523], "trace_timestamp_s": 678.8120000000008, "ttft_s": 0.25586633902275935, "turn_id": 8} +{"actual_output_tokens": 45, "cached_tokens": 0, "effective_input_length": 44364, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44364, "latency_s": 7.873387677012943, "output_length": 45, "proxy_request_id": "1277428:9:1513231:932", "request_id": "1277428:9:1513231:932", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779821639.3881845, "t_finish_unix": 1779821647.2615716, "t_first_token_unix": 1779821646.9720716, "tpot_s": 0.0065737667490876365, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14911410], "trace_timestamp_s": 952.4470000000001, "ttft_s": 7.583885677042417, "turn_id": 9} +{"actual_output_tokens": 662, "cached_tokens": 65520, "effective_input_length": 139357, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 139357, "latency_s": 58.31772803096101, "output_length": 662, "proxy_request_id": "1313181:14:1351342:491", "request_id": "1313181:14:1351342:491", "request_type": "coder", "requested_output_tokens": 662, "session_id": "1313181", "t_dispatch_unix": 1779821590.55592, "t_finish_unix": 1779821648.8736482, "t_first_token_unix": 1779821636.3577223, "tpot_s": 0.01893435656279748, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13067416, 13067417, 13067418, 13084713, 13103356, 13103357, 13103358, 13103359, 13103360, 13103361, 13103362, 13103363, 13103364, 13103365, 13103366, 13103367, 13103368, 13103369, 13103370, 13103371, 13103372, 13103373, 13103374, 13103375, 13103376, 13103377, 13103378, 13103379, 13103380, 13103381, 13103382, 13103383, 13103384, 13103385, 13103386, 13103387, 13103388, 13103389, 13103390, 13122153, 13122154, 13122155, 13122156, 13122157, 13122158, 13122159, 13122160, 13122161, 13122162, 13122163, 13122164, 13122165, 13122166, 13122167, 13122168, 13122169, 13122170, 13122171, 13122172, 13122173, 13122174, 13122175, 13122176, 13122177, 13122178, 13122179, 13122180, 13122181, 13122182, 13122183, 13122184, 13122185, 13122186, 13122187, 13122188, 13122189, 13122190, 13122191, 13122192, 13122193, 13122194, 13122195, 13122196, 13122197, 13122198, 13122199, 13122200, 13122201, 13122202, 13122203, 13122204, 13122205, 13122206, 13122207, 13122208, 13122209, 13122210, 13122211, 13122212, 13122213, 13122214, 13122215, 13122216, 13122217, 13122218, 13122219, 13122220, 13122221, 13122222, 13122223, 13122224, 13122225, 13122226, 13122227, 13122228, 13122229, 13122230, 13122231, 13122232, 13122233, 13122234, 13122235, 13122236, 13122237, 13122238, 13122239, 13122240, 13122241, 13122242, 13122243, 13122244, 13122245, 13122246, 13122215, 13122247, 13122248, 13122249, 13122250, 13122251, 13122252, 13122253, 13122254, 13122255, 13122256, 13122257, 13122258, 13122259, 13122260, 13122261, 13122262, 13122263, 13122264, 13122265, 13122266, 13122267, 13122268, 13122269, 13122270, 13122271, 13122272, 13122273, 13122274, 13122275, 13185889, 13185890, 13185891, 13185892, 13185893, 13185894, 13185895, 13185896, 13185897, 13185898, 13185899, 13185900, 13185901, 13185902, 13185903, 13185904, 13185905, 13185906, 13185907, 13185908, 13185909, 13185910, 13185911, 13185912, 13185913, 13185914, 13185915, 158393, 1711319, 1711320, 1711321, 13209152, 389991, 389992, 389993, 13240566, 10048470, 10048471, 10048472, 10048473, 13240567, 13240568, 13240569, 13240570, 13240571, 13240572, 13342342, 13359182, 13385557, 13385558, 13407607, 13407608, 13407609, 13407610, 13407611, 13407612, 13407613, 13407614, 13407615, 13407616, 13407617, 13407618, 13407619, 13407620, 13407621, 13407622], "trace_timestamp_s": 396.7470000000003, "ttft_s": 45.80179971898906, "turn_id": 14} +{"actual_output_tokens": 243, "cached_tokens": 106912, "effective_input_length": 106959, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106959, "latency_s": 4.348195541009773, "output_length": 243, "proxy_request_id": "1314357:9:1435219:861", "request_id": "1314357:9:1435219:861", "request_type": "coder", "requested_output_tokens": 243, "session_id": "1314357", "t_dispatch_unix": 1779821646.2517445, "t_finish_unix": 1779821650.5999403, "t_first_token_unix": 1779821646.4906912, "tpot_s": 0.01697888781007741, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14177399], "trace_timestamp_s": 691.2760000000007, "ttft_s": 0.23894414800452068, "turn_id": 9} +{"actual_output_tokens": 33, "cached_tokens": 107200, "effective_input_length": 107228, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107228, "latency_s": 0.6154314729501493, "output_length": 33, "proxy_request_id": "1314357:10:1439373:867", "request_id": "1314357:10:1439373:867", "request_type": "coder", "requested_output_tokens": 33, "session_id": "1314357", "t_dispatch_unix": 1779821650.6056197, "t_finish_unix": 1779821651.2210512, "t_first_token_unix": 1779821650.795762, "tpot_s": 0.01327927790589456, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14214206, 14214207], "trace_timestamp_s": 705.1230000000005, "ttft_s": 0.19014003197662532, "turn_id": 10} +{"actual_output_tokens": 193, "cached_tokens": 107248, "effective_input_length": 108166, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108166, "latency_s": 3.783098039973993, "output_length": 193, "proxy_request_id": "1314357:11:1442554:870", "request_id": "1314357:11:1442554:870", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1314357", "t_dispatch_unix": 1779821651.2268994, "t_finish_unix": 1779821655.0099976, "t_first_token_unix": 1779821652.100378, "tpot_s": 0.015152903552007047, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14243700, 14243701], "trace_timestamp_s": 715.6370000000006, "ttft_s": 0.873476003005635, "turn_id": 11} +{"actual_output_tokens": 350, "cached_tokens": 65872, "effective_input_length": 65876, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 65876, "latency_s": 6.162623091018759, "output_length": 350, "proxy_request_id": "1313181:14:1408792:803", "request_id": "1313181:14:1408792:803", "request_type": "coder", "requested_output_tokens": 350, "session_id": "1313181", "t_dispatch_unix": 1779821648.878382, "t_finish_unix": 1779821655.041005, "t_first_token_unix": 1779821648.9990742, "tpot_s": 0.017311532088898303, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13934257, 13934258], "trace_timestamp_s": 598.0260000000007, "ttft_s": 0.12068977300077677, "turn_id": 14} +{"actual_output_tokens": 284, "cached_tokens": 44400, "effective_input_length": 45851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45851, "latency_s": 2.6197984049795195, "output_length": 284, "proxy_request_id": "1277428:10:1517408:935", "request_id": "1277428:10:1517408:935", "request_type": "coder", "requested_output_tokens": 284, "session_id": "1277428", "t_dispatch_unix": 1779821653.1816473, "t_finish_unix": 1779821655.8014455, "t_first_token_unix": 1779821653.7333128, "tpot_s": 0.007306902413503283, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14951061], "trace_timestamp_s": 966.2420000000002, "ttft_s": 0.5516634739469737, "turn_id": 10} +{"actual_output_tokens": 63, "cached_tokens": 15984, "effective_input_length": 16604, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 16604, "latency_s": 0.48937102098716423, "output_length": 63, "proxy_request_id": "1399948:17:1518102:936", "request_id": "1399948:17:1518102:936", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779821655.6684515, "t_finish_unix": 1779821656.1578221, "t_first_token_unix": 1779821655.810958, "tpot_s": 0.005590157339259261, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 14957862], "trace_timestamp_s": 968.7300000000005, "ttft_s": 0.1425046999938786, "turn_id": 17} +{"actual_output_tokens": 61, "cached_tokens": 108352, "effective_input_length": 108409, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108409, "latency_s": 1.14785645599477, "output_length": 61, "proxy_request_id": "1314357:12:1446681:873", "request_id": "1314357:12:1446681:873", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1314357", "t_dispatch_unix": 1779821655.0146508, "t_finish_unix": 1779821656.1625073, "t_first_token_unix": 1779821655.2715666, "tpot_s": 0.014845141349360347, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14283553], "trace_timestamp_s": 729.3620000000001, "ttft_s": 0.2569130950141698, "turn_id": 12} +{"actual_output_tokens": 169, "cached_tokens": 108464, "effective_input_length": 108791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108791, "latency_s": 3.1223263469873928, "output_length": 169, "proxy_request_id": "1314357:13:1448346:875", "request_id": "1314357:13:1448346:875", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1314357", "t_dispatch_unix": 1779821656.1672375, "t_finish_unix": 1779821659.2895641, "t_first_token_unix": 1779821656.7223253, "tpot_s": 0.015278942285693205, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14298706], "trace_timestamp_s": 735.0250000000005, "ttft_s": 0.5550850709551014, "turn_id": 13} +{"actual_output_tokens": 122, "cached_tokens": 108944, "effective_input_length": 109010, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109010, "latency_s": 2.091135951981414, "output_length": 122, "proxy_request_id": "1314357:14:1450740:878", "request_id": "1314357:14:1450740:878", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1314357", "t_dispatch_unix": 1779821659.2951064, "t_finish_unix": 1779821661.3862424, "t_first_token_unix": 1779821659.5714877, "tpot_s": 0.014995361545531095, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14320601], "trace_timestamp_s": 742.8560000000007, "ttft_s": 0.276379206974525, "turn_id": 14} +{"actual_output_tokens": 382, "cached_tokens": 66224, "effective_input_length": 66259, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66259, "latency_s": 6.590092696016654, "output_length": 382, "proxy_request_id": "1313181:15:1411723:818", "request_id": "1313181:15:1411723:818", "request_type": "coder", "requested_output_tokens": 382, "session_id": "1313181", "t_dispatch_unix": 1779821655.0441635, "t_finish_unix": 1779821661.634256, "t_first_token_unix": 1779821655.3507967, "tpot_s": 0.01649111977153827, "trace_hash_ids": [6355, 6356, 6357, 6358, 6359, 6360, 6361, 6362, 6363, 6364, 6365, 6366, 6367, 6368, 6369, 6370, 6371, 6372, 6373, 6374, 6375, 6376, 6377, 6378, 6379, 64783, 64784, 64785, 64786, 64787, 64788, 64789, 64790, 13011409, 13029705, 13029706, 13029707, 13029708, 13029709, 13029710, 13029711, 13029712, 13029713, 13052041, 13468655, 13468656, 13468657, 13468658, 13468659, 13468660, 13468661, 13468662, 13468663, 13468664, 13468665, 13468666, 13468667, 13468668, 13468669, 13468670, 13468671, 13468672, 13468673, 13468674, 13468675, 13468676, 13468677, 13468678, 13468679, 13468680, 13468681, 13468682, 13468683, 13468684, 13468685, 13468686, 13468687, 7103552, 7103553, 13468688, 2469726, 2469727, 2469728, 13468689, 13468690, 13468691, 13468692, 13468693, 13468694, 13468695, 13468696, 13468697, 13468698, 13468699, 13468700, 13468701, 13468702, 13468703, 13468704, 13468705, 13468706, 13468707, 13468708, 13468709, 13468710, 13468711, 13468712, 13468713, 13468714, 13468715, 13468716, 13468717, 13468718, 13468719, 13468720, 13527468, 13560945, 13624980, 13624981, 13667683, 13697373, 13723278, 13853441, 13853442, 13853443, 13853444, 13881593, 13934257, 13934258, 13960252], "trace_timestamp_s": 608.4310000000005, "ttft_s": 0.30663099203957245, "turn_id": 15} +{"actual_output_tokens": 3516, "cached_tokens": 89776, "effective_input_length": 89790, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89790, "latency_s": 35.196159284969326, "output_length": 3516, "proxy_request_id": "1363943:31:1509815:929", "request_id": "1363943:31:1509815:929", "request_type": "coder", "requested_output_tokens": 3516, "session_id": "1363943", "t_dispatch_unix": 1779821627.9300008, "t_finish_unix": 1779821663.1261597, "t_first_token_unix": 1779821628.0787826, "tpot_s": 0.00997071428448664, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 14877475], "trace_timestamp_s": 940.9880000000003, "ttft_s": 0.14877925999462605, "turn_id": 31} +{"actual_output_tokens": 57, "cached_tokens": 46128, "effective_input_length": 46361, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46361, "latency_s": 0.5652141839964315, "output_length": 57, "proxy_request_id": "1277428:11:1520449:937", "request_id": "1277428:11:1520449:937", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1277428", "t_dispatch_unix": 1779821663.1690507, "t_finish_unix": 1779821663.7342649, "t_first_token_unix": 1779821663.3503618, "tpot_s": 0.006850257374545825, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 14979348], "trace_timestamp_s": 976.2290000000003, "ttft_s": 0.18130900303367525, "turn_id": 11} +{"actual_output_tokens": 365, "cached_tokens": 109120, "effective_input_length": 109164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109164, "latency_s": 4.144322807958815, "output_length": 365, "proxy_request_id": "1314357:15:1452292:882", "request_id": "1314357:15:1452292:882", "request_type": "coder", "requested_output_tokens": 365, "session_id": "1314357", "t_dispatch_unix": 1779821661.392169, "t_finish_unix": 1779821665.536492, "t_first_token_unix": 1779821661.5971656, "tpot_s": 0.010821633986299754, "trace_hash_ids": [7776, 7777, 697, 5765, 5766, 5767, 7778, 85399, 85400, 85401, 85402, 85403, 85404, 85405, 85406, 85407, 85408, 85409, 85410, 85411, 85412, 85413, 85414, 85415, 85416, 85417, 85418, 85419, 85420, 248920, 248921, 248922, 248923, 248924, 248925, 248926, 248927, 248928, 248929, 248930, 248931, 13014868, 17890, 17891, 17892, 17893, 13014869, 13014870, 13014871, 13014872, 13014873, 13014874, 13014875, 13014876, 13014877, 13014878, 13014879, 13014880, 13014881, 13014882, 13014883, 13014884, 13014885, 13014886, 13014887, 13014888, 13014889, 13014890, 13014891, 13014892, 13014893, 13014894, 13014895, 13014896, 13014897, 13014898, 13014899, 13014900, 13014901, 13014902, 13014903, 13014904, 13014905, 13014906, 13014907, 13014908, 13014909, 13014910, 13014911, 13014912, 13014913, 13014914, 13014915, 13014916, 13014917, 13014918, 13014919, 13014920, 13014921, 13014922, 13014923, 13014924, 13014925, 13014926, 13014927, 13014928, 13014929, 13014930, 13014931, 13014932, 13257857, 13257858, 13257859, 13257860, 13257861, 13257862, 13257863, 13257864, 13257865, 13292853, 13292854, 13292855, 13292856, 13292857, 13292858, 13292859, 13292860, 13292861, 13419011, 13419012, 13419013, 13419014, 13796574, 13796575, 13796576, 13796577, 13796578, 13796579, 13796580, 13796581, 13796582, 13796583, 13796584, 13796585, 13796586, 13796587, 13796588, 13796589, 13796590, 13796591, 13796592, 13796593, 13796594, 13796595, 13796596, 13796597, 13796598, 13796599, 13796600, 13796601, 13796602, 13796603, 13796604, 13796605, 13796606, 13796607, 13796608, 13796609, 13796610, 13796611, 13796612, 13796613, 13796614, 13796615, 13796616, 13796617, 13796618, 13796619, 13796620, 13796621, 13796622, 13796623, 13796624, 13796625, 13796626, 13796627, 13796628, 13796629, 13796630, 13796631, 13796632, 13796633, 13796634, 13796635, 13796636, 13796637, 13796638, 13796639, 14056868, 14056869, 14056870, 14056871, 14056872, 14056873, 14056874, 14107727, 14107728, 14144522, 14243698, 14243699, 14283552, 14298705, 14335068, 14335069], "trace_timestamp_s": 748.0830000000005, "ttft_s": 0.20499374094652012, "turn_id": 15} +{"actual_output_tokens": 63, "cached_tokens": 16656, "effective_input_length": 17276, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17276, "latency_s": 0.4881435330025852, "output_length": 63, "proxy_request_id": "1399948:18:1524432:938", "request_id": "1399948:18:1524432:938", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779821676.7262874, "t_finish_unix": 1779821677.2144308, "t_first_token_unix": 1779821676.8669274, "tpot_s": 0.005601062564246897, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15019330], "trace_timestamp_s": 989.781, "ttft_s": 0.1406374599901028, "turn_id": 18} +{"actual_output_tokens": 15, "cached_tokens": 78736, "effective_input_length": 79086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79086, "latency_s": 0.4881078730104491, "output_length": 15, "proxy_request_id": "1342921:9:1525898:939", "request_id": "1342921:9:1525898:939", "request_type": "coder", "requested_output_tokens": 15, "session_id": "1342921", "t_dispatch_unix": 1779821681.7565386, "t_finish_unix": 1779821682.2446456, "t_first_token_unix": 1779821682.1785893, "tpot_s": 0.004699659641898636, "trace_hash_ids": [820582, 1266982, 13329581, 13329582, 13329583, 13329584, 13329585, 13329586, 13329587, 13329588, 13329589, 13329590, 13329591, 13329592, 13329593, 13329594, 13329595, 13329596, 13329597, 13329598, 13329599, 13329600, 13329601, 13329602, 13329603, 13329604, 13329605, 13329606, 13329607, 13329608, 13329609, 13329610, 13329611, 13329612, 13329613, 13329614, 13329615, 13329616, 13329617, 13329618, 13329619, 13329620, 13329621, 13329622, 13329623, 13329624, 13329625, 13329626, 13329627, 13329628, 13329629, 13329630, 13329631, 13329632, 13329633, 13329634, 13329635, 13329636, 13329637, 13329638, 13329639, 13329640, 13329641, 13329642, 13329643, 13329644, 13329645, 13329646, 13329647, 13329648, 13329649, 13329650, 13329651, 13329652, 13329653, 13329654, 13329655, 13329656, 13329657, 13329658, 13329659, 13329660, 13329661, 13329662, 13329663, 13329664, 13329665, 13329666, 13329667, 13329668, 13329669, 13329670, 13329671, 13329672, 13329673, 13329674, 13329675, 13329676, 13329677, 13329678, 13329679, 13329680, 13329681, 13329682, 13329683, 13329684, 13329685, 13329686, 13329687, 13329688, 13329689, 13329690, 13329691, 13329692, 13329693, 13329694, 13329695, 13329696, 13329697, 13329698, 13329699, 13329700, 13329701, 13329702, 13329703, 13329704, 13329705, 13497389, 13497390, 13707845, 13707846, 13707847, 13707848, 13707849, 13707850, 13758035, 13758036, 13758037, 14158430, 14158431, 14158432, 14158433, 14158434, 14158435, 14300702, 14300703, 14300704, 14300705, 14537883, 14818583, 14818584, 14818585, 14818586, 15032686, 15032687], "trace_timestamp_s": 994.8110000000006, "ttft_s": 0.4220483400276862, "turn_id": 9} +{"actual_output_tokens": 50, "cached_tokens": 17328, "effective_input_length": 18091, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18091, "latency_s": 0.45658733299933374, "output_length": 50, "proxy_request_id": "1399948:19:1526739:941", "request_id": "1399948:19:1526739:941", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1399948", "t_dispatch_unix": 1779821684.6407356, "t_finish_unix": 1779821685.097323, "t_first_token_unix": 1779821684.820068, "tpot_s": 0.005652328590833943, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15040983], "trace_timestamp_s": 997.7020000000002, "ttft_s": 0.1793297550175339, "turn_id": 19} +{"actual_output_tokens": 92, "cached_tokens": 18128, "effective_input_length": 18164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18164, "latency_s": 0.5824642209918238, "output_length": 92, "proxy_request_id": "1399948:20:1527857:942", "request_id": "1399948:20:1527857:942", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1399948", "t_dispatch_unix": 1779821688.1418731, "t_finish_unix": 1779821688.7243369, "t_first_token_unix": 1779821688.1965172, "tpot_s": 0.005797441494855825, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15053152], "trace_timestamp_s": 1001.2000000000007, "ttft_s": 0.054642106988467276, "turn_id": 20} +{"actual_output_tokens": 100, "cached_tokens": 18240, "effective_input_length": 18388, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18388, "latency_s": 0.6640975089976564, "output_length": 100, "proxy_request_id": "1399948:21:1528978:944", "request_id": "1399948:21:1528978:944", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1399948", "t_dispatch_unix": 1779821692.085834, "t_finish_unix": 1779821692.749931, "t_first_token_unix": 1779821692.1742806, "tpot_s": 0.005812121747470827, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128], "trace_timestamp_s": 1005.1450000000004, "ttft_s": 0.0884453670005314, "turn_id": 21} +{"actual_output_tokens": 45, "cached_tokens": 18480, "effective_input_length": 18563, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 18563, "latency_s": 0.31065506202867255, "output_length": 45, "proxy_request_id": "1399948:22:1530122:947", "request_id": "1399948:22:1530122:947", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779821695.9139009, "t_finish_unix": 1779821696.2245555, "t_first_token_unix": 1779821695.9781249, "tpot_s": 0.005595169318522411, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15074294], "trace_timestamp_s": 1008.9760000000006, "ttft_s": 0.0642222739988938, "turn_id": 22} +{"actual_output_tokens": 607, "cached_tokens": 0, "effective_input_length": 36568, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36568, "latency_s": 9.71048468502704, "output_length": 607, "proxy_request_id": "1243831:2:1528168:943", "request_id": "1243831:2:1528168:943", "request_type": "coder", "requested_output_tokens": 607, "session_id": "1243831", "t_dispatch_unix": 1779821689.344641, "t_finish_unix": 1779821699.0551252, "t_first_token_unix": 1779821694.8324661, "tpot_s": 0.006967652133699021, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 15055359, 15055360, 15055361, 15055362, 15055363, 15055364, 15055365, 15055366, 15055367, 15055368, 15055369, 15055370, 15055371, 15055372, 15055373, 15055374, 15055375, 15055376, 15055377, 15055378, 15055379, 15055380, 15055381, 15055382, 15055383, 15055384, 15055385, 15055386, 15055387, 15055388, 15055389, 15055390, 15055391, 15055392, 15055393, 15055394, 15055395, 15055396, 15055397, 15055398, 15055399, 15055400, 15055401, 15055402, 15055403, 15055404, 15055405, 15055406, 15055407, 15055408], "trace_timestamp_s": 1002.3960000000006, "ttft_s": 5.487822488998063, "turn_id": 2} +{"actual_output_tokens": 133, "cached_tokens": 63200, "effective_input_length": 71192, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71192, "latency_s": 4.594889703032095, "output_length": 133, "proxy_request_id": "1268861:16:1529894:946", "request_id": "1268861:16:1529894:946", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1268861", "t_dispatch_unix": 1779821695.0941226, "t_finish_unix": 1779821699.6890125, "t_first_token_unix": 1779821698.587359, "tpot_s": 0.00834395542430381, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15072129], "trace_timestamp_s": 1008.1510000000007, "ttft_s": 3.493233992019668, "turn_id": 16} +{"actual_output_tokens": 151, "cached_tokens": 11568, "effective_input_length": 11584, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 11584, "latency_s": 0.8637415730045177, "output_length": 151, "proxy_request_id": "1243831:3:1270336:110", "request_id": "1243831:3:1270336:110", "request_type": "coder", "requested_output_tokens": 151, "session_id": "1243831", "t_dispatch_unix": 1779821699.0562923, "t_finish_unix": 1779821699.9200344, "t_first_token_unix": 1779821699.0916073, "tpot_s": 0.0055211373934677494, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12641626], "trace_timestamp_s": 113.52800000000025, "ttft_s": 0.035313083964865655, "turn_id": 3} +{"actual_output_tokens": 77, "cached_tokens": 11728, "effective_input_length": 14515, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14515, "latency_s": 0.7971275750314817, "output_length": 77, "proxy_request_id": "1243831:4:1284306:183", "request_id": "1243831:4:1284306:183", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1243831", "t_dispatch_unix": 1779821699.9220645, "t_finish_unix": 1779821700.7191925, "t_first_token_unix": 1779821700.2967858, "tpot_s": 0.00555442602643253, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 12778587], "trace_timestamp_s": 162.09900000000016, "ttft_s": 0.3747180600184947, "turn_id": 4} +{"actual_output_tokens": 81, "cached_tokens": 14576, "effective_input_length": 14627, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 14627, "latency_s": 0.4966563659836538, "output_length": 81, "proxy_request_id": "1243831:5:1303288:273", "request_id": "1243831:5:1303288:273", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1243831", "t_dispatch_unix": 1779821700.7199688, "t_finish_unix": 1779821701.2166255, "t_first_token_unix": 1779821700.7712476, "tpot_s": 0.005563574812549632, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 12959828], "trace_timestamp_s": 227.3050000000003, "ttft_s": 0.051276865997351706, "turn_id": 5} +{"actual_output_tokens": 80, "cached_tokens": 14704, "effective_input_length": 17410, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 17410, "latency_s": 0.8654689100221731, "output_length": 80, "proxy_request_id": "1243831:6:1313694:320", "request_id": "1243831:6:1313694:320", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1243831", "t_dispatch_unix": 1779821701.2186408, "t_finish_unix": 1779821702.0841098, "t_first_token_unix": 1779821701.6367257, "tpot_s": 0.005659326910972595, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13056746], "trace_timestamp_s": 264.14500000000044, "ttft_s": 0.4180820560432039, "turn_id": 6} +{"actual_output_tokens": 103, "cached_tokens": 17488, "effective_input_length": 19460, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 19460, "latency_s": 0.9518658799934201, "output_length": 103, "proxy_request_id": "1243831:7:1323865:366", "request_id": "1243831:7:1323865:366", "request_type": "coder", "requested_output_tokens": 103, "session_id": "1243831", "t_dispatch_unix": 1779821702.0858138, "t_finish_unix": 1779821703.0376801, "t_first_token_unix": 1779821702.4432085, "tpot_s": 0.005825686539002859, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13151112], "trace_timestamp_s": 300.0500000000002, "ttft_s": 0.357392197009176, "turn_id": 7} +{"actual_output_tokens": 111, "cached_tokens": 19552, "effective_input_length": 24512, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24512, "latency_s": 1.543364611978177, "output_length": 111, "proxy_request_id": "1243831:8:1333049:414", "request_id": "1243831:8:1333049:414", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1243831", "t_dispatch_unix": 1779821703.0402968, "t_finish_unix": 1779821704.5836618, "t_first_token_unix": 1779821703.9151611, "tpot_s": 0.006074857518119229, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173], "trace_timestamp_s": 332.8090000000002, "ttft_s": 0.8748616069788113, "turn_id": 8} +{"actual_output_tokens": 67, "cached_tokens": 24608, "effective_input_length": 25075, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 25075, "latency_s": 0.5699105030507781, "output_length": 67, "proxy_request_id": "1243831:9:1348240:478", "request_id": "1243831:9:1348240:478", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1243831", "t_dispatch_unix": 1779821704.5847576, "t_finish_unix": 1779821705.1546683, "t_first_token_unix": 1779821704.7544425, "tpot_s": 0.0060601447123300395, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884], "trace_timestamp_s": 385.9180000000006, "ttft_s": 0.1696757010067813, "turn_id": 9} +{"actual_output_tokens": 112, "cached_tokens": 25136, "effective_input_length": 26343, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26343, "latency_s": 0.9798146709799767, "output_length": 112, "proxy_request_id": "1243831:10:1358921:521", "request_id": "1243831:10:1358921:521", "request_type": "coder", "requested_output_tokens": 112, "session_id": "1243831", "t_dispatch_unix": 1779821705.1562448, "t_finish_unix": 1779821706.1360598, "t_first_token_unix": 1779821705.4502096, "tpot_s": 0.006176592225234049, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13476530], "trace_timestamp_s": 423.28400000000056, "ttft_s": 0.29396166995866224, "turn_id": 10} +{"actual_output_tokens": 75, "cached_tokens": 26448, "effective_input_length": 26818, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 26818, "latency_s": 0.6210903900209814, "output_length": 75, "proxy_request_id": "1243831:11:1371191:594", "request_id": "1243831:11:1371191:594", "request_type": "coder", "requested_output_tokens": 75, "session_id": "1243831", "t_dispatch_unix": 1779821706.1375377, "t_finish_unix": 1779821706.7586281, "t_first_token_unix": 1779821706.3090217, "tpot_s": 0.006071961243366319, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13591639], "trace_timestamp_s": 466.35400000000027, "ttft_s": 0.17148112104041502, "turn_id": 11} +{"actual_output_tokens": 66, "cached_tokens": 26880, "effective_input_length": 27164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27164, "latency_s": 0.5204968930338509, "output_length": 66, "proxy_request_id": "1243831:12:1385174:681", "request_id": "1243831:12:1385174:681", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1243831", "t_dispatch_unix": 1779821706.7600129, "t_finish_unix": 1779821707.28051, "t_first_token_unix": 1779821706.8792872, "tpot_s": 0.0061684031075296495, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13718858], "trace_timestamp_s": 515.2120000000004, "ttft_s": 0.11927222699159756, "turn_id": 12} +{"actual_output_tokens": 85, "cached_tokens": 27216, "effective_input_length": 27286, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 27286, "latency_s": 0.605856042006053, "output_length": 85, "proxy_request_id": "1243831:13:1398072:738", "request_id": "1243831:13:1398072:738", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1243831", "t_dispatch_unix": 1779821707.2817535, "t_finish_unix": 1779821707.88761, "t_first_token_unix": 1779821707.363136, "tpot_s": 0.006240632678132637, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13836022], "trace_timestamp_s": 560.7880000000005, "ttft_s": 0.08138019201578572, "turn_id": 13} +{"actual_output_tokens": 85, "cached_tokens": 27360, "effective_input_length": 28085, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28085, "latency_s": 0.7662737980135716, "output_length": 85, "proxy_request_id": "1243831:14:1411189:814", "request_id": "1243831:14:1411189:814", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1243831", "t_dispatch_unix": 1779821707.8889961, "t_finish_unix": 1779821708.6552699, "t_first_token_unix": 1779821708.1323783, "tpot_s": 0.0062221176069994855, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434], "trace_timestamp_s": 606.2490000000007, "ttft_s": 0.24337960401317105, "turn_id": 14} +{"actual_output_tokens": 133, "cached_tokens": 28160, "effective_input_length": 29382, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29382, "latency_s": 1.1615214769844897, "output_length": 133, "proxy_request_id": "1243831:15:1427593:849", "request_id": "1243831:15:1427593:849", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1243831", "t_dispatch_unix": 1779821708.656884, "t_finish_unix": 1779821709.8184056, "t_first_token_unix": 1779821708.975789, "tpot_s": 0.00638104887118309, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14104163], "trace_timestamp_s": 664.1060000000007, "ttft_s": 0.31890210398705676, "turn_id": 15} +{"actual_output_tokens": 68, "cached_tokens": 29504, "effective_input_length": 29571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 29571, "latency_s": 0.5161274260026403, "output_length": 68, "proxy_request_id": "1243831:16:1446717:874", "request_id": "1243831:16:1446717:874", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1243831", "t_dispatch_unix": 1779821709.8197985, "t_finish_unix": 1779821710.335926, "t_first_token_unix": 1779821709.9176817, "tpot_s": 0.006238490328324764, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14283881], "trace_timestamp_s": 729.4750000000004, "ttft_s": 0.0978809500229545, "turn_id": 16} +{"actual_output_tokens": 187, "cached_tokens": 130816, "effective_input_length": 130906, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 130906, "latency_s": 5.640117383969482, "output_length": 187, "proxy_request_id": "1356885:5:1533696:948", "request_id": "1356885:5:1533696:948", "request_type": "coder", "requested_output_tokens": 187, "session_id": "1356885", "t_dispatch_unix": 1779821707.7392263, "t_finish_unix": 1779821713.3793433, "t_first_token_unix": 1779821710.2017994, "tpot_s": 0.017081852462480687, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124], "trace_timestamp_s": 1020.7970000000005, "ttft_s": 2.4625705299549736, "turn_id": 5} +{"actual_output_tokens": 314, "cached_tokens": 64176, "effective_input_length": 71987, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71987, "latency_s": 6.217310498002917, "output_length": 314, "proxy_request_id": "1294611:15:1533841:949", "request_id": "1294611:15:1533841:949", "request_type": "coder", "requested_output_tokens": 314, "session_id": "1294611", "t_dispatch_unix": 1779821708.2137709, "t_finish_unix": 1779821714.431081, "t_first_token_unix": 1779821711.6865695, "tpot_s": 0.008767604801845484, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15109253, 15109254, 15109255, 15109256, 15109257, 15109258, 15109259, 15109260, 15109261, 15109262, 15109263, 15109264, 15109265, 15109266, 15109267, 15109268, 15109269], "trace_timestamp_s": 1021.2700000000004, "ttft_s": 3.472796816029586, "turn_id": 15} +{"actual_output_tokens": 196, "cached_tokens": 93296, "effective_input_length": 93368, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93368, "latency_s": 2.1280885729938745, "output_length": 196, "proxy_request_id": "1363943:32:1537767:950", "request_id": "1363943:32:1537767:950", "request_type": "coder", "requested_output_tokens": 196, "session_id": "1363943", "t_dispatch_unix": 1779821721.5355253, "t_finish_unix": 1779821723.6636138, "t_first_token_unix": 1779821721.7654245, "tpot_s": 0.009732886605287113, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 15147439, 15147440, 15147441, 15147442, 15147443, 15147444, 15147445, 15147446], "trace_timestamp_s": 1034.5930000000008, "ttft_s": 0.22989704296924174, "turn_id": 32} +{"actual_output_tokens": 1497, "cached_tokens": 0, "effective_input_length": 87576, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 87576, "latency_s": 42.07579963799799, "output_length": 1497, "proxy_request_id": "1253804:7:1526643:940", "request_id": "1253804:7:1526643:940", "request_type": "coder", "requested_output_tokens": 1497, "session_id": "1253804", "t_dispatch_unix": 1779821684.1992917, "t_finish_unix": 1779821726.275091, "t_first_token_unix": 1779821709.9726126, "tpot_s": 0.01089721656619057, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15040216], "trace_timestamp_s": 997.2470000000003, "ttft_s": 25.773319121974055, "turn_id": 7} +{"actual_output_tokens": 48, "cached_tokens": 89072, "effective_input_length": 89116, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 89116, "latency_s": 0.5677748669986613, "output_length": 48, "proxy_request_id": "1253804:8:1541192:953", "request_id": "1253804:8:1541192:953", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1253804", "t_dispatch_unix": 1779821732.6817908, "t_finish_unix": 1779821733.2495658, "t_first_token_unix": 1779821732.8531907, "tpot_s": 0.008427173085015347, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15182013], "trace_timestamp_s": 1045.741, "ttft_s": 0.1713972520083189, "turn_id": 8} +{"actual_output_tokens": 165, "cached_tokens": 71312, "effective_input_length": 75693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75693, "latency_s": 3.6487012180150487, "output_length": 165, "proxy_request_id": "1268861:17:1540278:951", "request_id": "1268861:17:1540278:951", "request_type": "coder", "requested_output_tokens": 165, "session_id": "1268861", "t_dispatch_unix": 1779821729.618857, "t_finish_unix": 1779821733.267558, "t_first_token_unix": 1779821731.8392518, "tpot_s": 0.008707650414335815, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15173450], "trace_timestamp_s": 1042.6770000000006, "ttft_s": 2.2203929720562883, "turn_id": 17} +{"actual_output_tokens": 643, "cached_tokens": 93552, "effective_input_length": 93596, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93596, "latency_s": 6.5890318140154704, "output_length": 643, "proxy_request_id": "1363943:33:1541065:952", "request_id": "1363943:33:1541065:952", "request_type": "coder", "requested_output_tokens": 643, "session_id": "1363943", "t_dispatch_unix": 1779821732.2656338, "t_finish_unix": 1779821738.8546653, "t_first_token_unix": 1779821732.4430313, "tpot_s": 0.00998643372739909, "trace_hash_ids": [948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959, 960, 961, 962, 963, 964, 89115, 3609306, 3609307, 13501156, 13501157, 13501158, 13501159, 13546052, 13574485, 13574486, 13574487, 13574488, 13574489, 13574490, 13574491, 13574492, 13574493, 13574494, 13602124, 13629310, 13646865, 13646866, 13646867, 13664416, 13768289, 13768290, 13768291, 13768292, 13768293, 13864500, 14078447, 14078448, 14094821, 14094822, 14094823, 14206728, 14206729, 14206730, 14206731, 14395119, 14424564, 14441609, 14441610, 14441611, 14441612, 14441613, 14441614, 14441615, 14441616, 14441617, 14471073, 14471074, 14471075, 14493400, 14493401, 14493402, 14493403, 14493404, 14493405, 14493406, 14493407, 14493408, 14493409, 14493410, 14493411, 14493412, 14493413, 14493414, 14493415, 14493416, 14493417, 14493418, 14493419, 14493420, 14493421, 14538792, 14538793, 14538794, 14538795, 14538796, 14538797, 14538798, 14538799, 14538800, 14538801, 14538802, 14538803, 14538804, 14538805, 14538806, 14538807, 14538808, 14566547, 14566548, 14566549, 14566550, 14566551, 14566552, 14566553, 14566554, 14566555, 14613722, 14613723, 14613724, 14613725, 14613726, 14613727, 14613728, 14613729, 14613730, 14613731, 14647267, 14647268, 14647269, 14647270, 14647271, 14647272, 14647273, 14647274, 14647275, 14678078, 14678079, 14678080, 14678081, 14700158, 14700159, 14700160, 14700161, 14700162, 14721985, 14721986, 14744213, 14744214, 14744215, 14744216, 14744217, 14744218, 14744219, 14744220, 14744221, 14744222, 14744223, 14744224, 14744225, 14744226, 14744227, 14744228, 14793554, 14793555, 14793556, 14793557, 14793558, 14793559, 14817736, 14817737, 14817738, 14817739, 14843114, 15147439, 15147440, 15147441, 15147442, 15147443, 15147444, 15147445, 15180688], "trace_timestamp_s": 1045.3250000000007, "ttft_s": 0.17739554302534088, "turn_id": 33} +{"actual_output_tokens": 76, "cached_tokens": 18592, "effective_input_length": 20031, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 20031, "latency_s": 0.7183918299851939, "output_length": 76, "proxy_request_id": "1399948:23:1544108:954", "request_id": "1399948:23:1544108:954", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1399948", "t_dispatch_unix": 1779821742.1373003, "t_finish_unix": 1779821742.8556921, "t_first_token_unix": 1779821742.4275784, "tpot_s": 0.005704388692975044, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15209349], "trace_timestamp_s": 1055.1980000000003, "ttft_s": 0.2902744970051572, "turn_id": 23} +{"actual_output_tokens": 45, "cached_tokens": 20096, "effective_input_length": 21809, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 21809, "latency_s": 0.6012980350060388, "output_length": 45, "proxy_request_id": "1399948:24:1546940:955", "request_id": "1399948:24:1546940:955", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779821751.5845425, "t_finish_unix": 1779821752.1858404, "t_first_token_unix": 1779821751.9354272, "tpot_s": 0.005685230681344613, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15237108], "trace_timestamp_s": 1064.6450000000004, "ttft_s": 0.3508828839985654, "turn_id": 24} +{"actual_output_tokens": 7535, "cached_tokens": 29632, "effective_input_length": 31161, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31161, "latency_s": 52.3013291109819, "output_length": 7535, "proxy_request_id": "1243831:17:1453633:883", "request_id": "1243831:17:1453633:883", "request_type": "coder", "requested_output_tokens": 7535, "session_id": "1243831", "t_dispatch_unix": 1779821710.3376067, "t_finish_unix": 1779821762.6389358, "t_first_token_unix": 1779821710.7352335, "tpot_s": 0.0068892282511299596, "trace_hash_ids": [4545, 4546, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 137500, 137501, 12381648, 12381649, 137504, 137505, 137506, 12381650, 12381651, 12381652, 12504840, 12778581, 12778582, 12778583, 12778584, 12778585, 12778586, 13056740, 13056741, 13056742, 13056743, 13056744, 13056745, 13151108, 13151109, 13151110, 13151111, 13238164, 13238165, 13238166, 13238167, 13238168, 13238169, 13238170, 13238171, 13238172, 13238173, 13377884, 13476528, 13476529, 13591638, 13718857, 13955433, 13955434, 14104161, 14104162, 14283881, 14347482, 14347483, 14347484], "trace_timestamp_s": 752.9440000000004, "ttft_s": 0.39762492396403104, "turn_id": 17} +{"actual_output_tokens": 92, "cached_tokens": 21840, "effective_input_length": 22250, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 22250, "latency_s": 0.694675370992627, "output_length": 92, "proxy_request_id": "1399948:25:1553234:957", "request_id": "1399948:25:1553234:957", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1399948", "t_dispatch_unix": 1779821772.1172163, "t_finish_unix": 1779821772.8118916, "t_first_token_unix": 1779821772.2737908, "tpot_s": 0.005910672703476438, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15296678], "trace_timestamp_s": 1085.179, "ttft_s": 0.15657270496012643, "turn_id": 25} +{"actual_output_tokens": 117, "cached_tokens": 75856, "effective_input_length": 76017, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76017, "latency_s": 1.2751050070510246, "output_length": 117, "proxy_request_id": "1268861:18:1553083:956", "request_id": "1268861:18:1553083:956", "request_type": "coder", "requested_output_tokens": 117, "session_id": "1268861", "t_dispatch_unix": 1779821771.6787643, "t_finish_unix": 1779821772.9538689, "t_first_token_unix": 1779821771.948999, "tpot_s": 0.00866051364623829, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15295378], "trace_timestamp_s": 1084.7290000000003, "ttft_s": 0.2702296150382608, "turn_id": 18} +{"actual_output_tokens": 49, "cached_tokens": 22336, "effective_input_length": 23042, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 23042, "latency_s": 0.4942462019971572, "output_length": 49, "proxy_request_id": "1399948:26:1557859:959", "request_id": "1399948:26:1557859:959", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1399948", "t_dispatch_unix": 1779821788.0808103, "t_finish_unix": 1779821788.5750558, "t_first_token_unix": 1779821788.2959087, "tpot_s": 0.005810673291610631, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15340884], "trace_timestamp_s": 1101.1350000000002, "ttft_s": 0.215095971012488, "turn_id": 26} +{"actual_output_tokens": 156, "cached_tokens": 23088, "effective_input_length": 24139, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24139, "latency_s": 1.2193842589622363, "output_length": 156, "proxy_request_id": "1399948:27:1559017:960", "request_id": "1399948:27:1559017:960", "request_type": "coder", "requested_output_tokens": 156, "session_id": "1399948", "t_dispatch_unix": 1779821791.7441978, "t_finish_unix": 1779821792.9635813, "t_first_token_unix": 1779821792.0166101, "tpot_s": 0.006107871728994313, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15352258], "trace_timestamp_s": 1104.8010000000004, "ttft_s": 0.2724102159845643, "turn_id": 27} +{"actual_output_tokens": 205, "cached_tokens": 24288, "effective_input_length": 24386, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 24386, "latency_s": 1.3461730290437117, "output_length": 205, "proxy_request_id": "1399948:28:1560859:961", "request_id": "1399948:28:1560859:961", "request_type": "coder", "requested_output_tokens": 205, "session_id": "1399948", "t_dispatch_unix": 1779821797.8721597, "t_finish_unix": 1779821799.2183328, "t_first_token_unix": 1779821797.9623685, "tpot_s": 0.006155433774670111, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15369258], "trace_timestamp_s": 1110.929, "ttft_s": 0.09020592801971361, "turn_id": 28} +{"actual_output_tokens": 45, "cached_tokens": 24576, "effective_input_length": 28781, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 28781, "latency_s": 1.1478797330055386, "output_length": 45, "proxy_request_id": "1399948:29:1571125:963", "request_id": "1399948:29:1571125:963", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1399948", "t_dispatch_unix": 1779821831.73584, "t_finish_unix": 1779821832.8837197, "t_first_token_unix": 1779821832.621743, "tpot_s": 0.005948185910132121, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15466683], "trace_timestamp_s": 1144.795, "ttft_s": 0.8859004219993949, "turn_id": 29} +{"actual_output_tokens": 184, "cached_tokens": 131088, "effective_input_length": 131413, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131413, "latency_s": 2.833552428986877, "output_length": 184, "proxy_request_id": "1356885:6:1570780:962", "request_id": "1356885:6:1570780:962", "request_type": "coder", "requested_output_tokens": 184, "session_id": "1356885", "t_dispatch_unix": 1779821830.6977293, "t_finish_unix": 1779821833.531281, "t_first_token_unix": 1779821831.3797138, "tpot_s": 0.011755687546600776, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784], "trace_timestamp_s": 1143.7480000000005, "ttft_s": 0.6819809720036574, "turn_id": 6} +{"actual_output_tokens": 89, "cached_tokens": 76128, "effective_input_length": 76963, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 76963, "latency_s": 1.3193536110338755, "output_length": 89, "proxy_request_id": "1268861:19:1578134:966", "request_id": "1268861:19:1578134:966", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1268861", "t_dispatch_unix": 1779821855.5807714, "t_finish_unix": 1779821856.900125, "t_first_token_unix": 1779821856.1523979, "tpot_s": 0.00849393722720296, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15533477], "trace_timestamp_s": 1168.6400000000003, "ttft_s": 0.5716238460154273, "turn_id": 19} +{"actual_output_tokens": 49, "cached_tokens": 28816, "effective_input_length": 30773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30773, "latency_s": 0.8030505190254189, "output_length": 49, "proxy_request_id": "1399948:30:1578524:967", "request_id": "1399948:30:1578524:967", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1399948", "t_dispatch_unix": 1779821856.925229, "t_finish_unix": 1779821857.7282796, "t_first_token_unix": 1779821857.43603, "tpot_s": 0.006083655041341747, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15536842], "trace_timestamp_s": 1169.9860000000008, "ttft_s": 0.5107984450296499, "turn_id": 30} +{"actual_output_tokens": 203, "cached_tokens": 30816, "effective_input_length": 30925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 30925, "latency_s": 1.4222765250015073, "output_length": 203, "proxy_request_id": "1399948:31:1579418:968", "request_id": "1399948:31:1579418:968", "request_type": "coder", "requested_output_tokens": 203, "session_id": "1399948", "t_dispatch_unix": 1779821860.1516614, "t_finish_unix": 1779821861.5739377, "t_first_token_unix": 1779821860.2585578, "tpot_s": 0.006510486584248962, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15544685], "trace_timestamp_s": 1173.21, "ttft_s": 0.10689344897400588, "turn_id": 31} +{"actual_output_tokens": 170, "cached_tokens": 131584, "effective_input_length": 131775, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 131775, "latency_s": 2.4245075340149924, "output_length": 170, "proxy_request_id": "1356885:7:1580925:969", "request_id": "1356885:7:1580925:969", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1356885", "t_dispatch_unix": 1779821865.450675, "t_finish_unix": 1779821867.8751824, "t_first_token_unix": 1779821865.8898828, "tpot_s": 0.011745723514795612, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 15560627], "trace_timestamp_s": 1178.5070000000005, "ttft_s": 0.43920486100250855, "turn_id": 7} +{"actual_output_tokens": 154, "cached_tokens": 31120, "effective_input_length": 31231, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31231, "latency_s": 1.1038627609959804, "output_length": 154, "proxy_request_id": "1399948:32:1581424:970", "request_id": "1399948:32:1581424:970", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1399948", "t_dispatch_unix": 1779821866.903218, "t_finish_unix": 1779821868.0070806, "t_first_token_unix": 1779821867.0167737, "tpot_s": 0.00647095626134888, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283], "trace_timestamp_s": 1179.964, "ttft_s": 0.1135534149943851, "turn_id": 32} +{"actual_output_tokens": 102, "cached_tokens": 31376, "effective_input_length": 31445, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 31445, "latency_s": 0.7400452919537202, "output_length": 102, "proxy_request_id": "1399948:33:1583165:972", "request_id": "1399948:33:1583165:972", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1399948", "t_dispatch_unix": 1779821872.813876, "t_finish_unix": 1779821873.5539207, "t_first_token_unix": 1779821872.908884, "tpot_s": 0.006383913723028053, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15583196], "trace_timestamp_s": 1185.8700000000008, "ttft_s": 0.09500609297538176, "turn_id": 33} +{"actual_output_tokens": 84, "cached_tokens": 46416, "effective_input_length": 47660, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47660, "latency_s": 1.0711531289853156, "output_length": 84, "proxy_request_id": "1277428:12:1586139:973", "request_id": "1277428:12:1586139:973", "request_type": "coder", "requested_output_tokens": 84, "session_id": "1277428", "t_dispatch_unix": 1779821882.9493895, "t_finish_unix": 1779821884.020542, "t_first_token_unix": 1779821883.423876, "tpot_s": 0.00718584081932274, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 15609252, 15609253, 15609254, 15609255], "trace_timestamp_s": 1196.0, "ttft_s": 0.47448428597999737, "turn_id": 12} +{"actual_output_tokens": 136, "cached_tokens": 31536, "effective_input_length": 32143, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 32143, "latency_s": 1.1039358240086585, "output_length": 136, "proxy_request_id": "1399948:34:1586232:974", "request_id": "1399948:34:1586232:974", "request_type": "coder", "requested_output_tokens": 136, "session_id": "1399948", "t_dispatch_unix": 1779821883.3012276, "t_finish_unix": 1779821884.405163, "t_first_token_unix": 1779821883.5218592, "tpot_s": 0.006540916444457792, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15610086], "trace_timestamp_s": 1196.362, "ttft_s": 0.2206293279887177, "turn_id": 34} +{"actual_output_tokens": 46, "cached_tokens": 35344, "effective_input_length": 109083, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109083, "latency_s": 33.79916598694399, "output_length": 46, "proxy_request_id": "1270606:4:1578042:965", "request_id": "1270606:4:1578042:965", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1270606", "t_dispatch_unix": 1779821855.3508108, "t_finish_unix": 1779821889.1499763, "t_first_token_unix": 1779821888.742152, "tpot_s": 0.009055316110607236, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 15532602, 15532603, 15532604, 15532605, 15532606, 15532607, 15532608, 15532609, 15532610, 15532611, 15532612, 15532613, 15532614, 15532615, 15532616, 15532617, 15532618, 15532619, 15532620, 15532621, 15532622, 15532623, 15532624, 15532625, 15532626, 15532627, 15532628, 15532629, 15532630, 15532631, 15532632, 15532633, 15532634, 15532635, 15532636, 15532637, 15532638, 15532639, 15532640, 15532641, 15532642, 15532643, 15532644, 15532645, 15532646, 15532647, 15532648, 15532649, 15532650, 15532651, 15532652, 15532653, 15532654, 15532655, 15532656, 15532657, 15532658, 15532659, 15532660, 15532661, 15532662, 15532663, 15532664, 15532665, 15532666, 15532667, 15532668, 15532669, 15532670, 15532671, 15532672, 15532673, 15532674, 15532675, 15532676, 15532677, 15532678, 15532679, 15532680, 15532681, 15532682, 15532683, 15532684, 15532685, 15532686, 15532687, 15532688, 15532689, 15532690, 15532691, 15532692, 15532693, 15532694, 15532695, 15532696, 15532697, 15532698, 15532699, 15532700, 15532701, 15532702, 15532703, 15532704, 15532705, 15532706, 15532707, 15532708, 15532709, 15532710, 15532711, 15532712, 15532713, 15532714, 15532715], "trace_timestamp_s": 1168.3640000000005, "ttft_s": 33.39133883698378, "turn_id": 4} +{"actual_output_tokens": 260, "cached_tokens": 109120, "effective_input_length": 111387, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111387, "latency_s": 4.576790476043243, "output_length": 260, "proxy_request_id": "1270606:5:1581455:971", "request_id": "1270606:5:1581455:971", "request_type": "coder", "requested_output_tokens": 260, "session_id": "1270606", "t_dispatch_unix": 1779821889.1770127, "t_finish_unix": 1779821893.753803, "t_first_token_unix": 1779821890.9608965, "tpot_s": 0.010782503868582654, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 15532602, 15565484, 15565485, 15565486, 15565487, 15565488, 15565489, 15565490, 15565491, 15565492, 15565493, 15565494, 15565495, 15565496, 15565497, 15565498, 15565499, 15565500, 15565501, 15565502, 15565503, 15565504, 15565505, 15565506, 15565507, 15565508, 15565509, 15565510, 15565511, 15565512, 15565513, 15565514, 15565515, 15565516, 15565517, 15565518, 15565519, 15565520, 15565521, 15565522, 15565523, 15565524, 15565525, 15565526, 15565527, 15565528, 15565529, 15565530, 15565531, 15565532, 15565533, 15565534, 15565535, 15565536, 15565537, 15565538, 15565539, 15565540, 15565541, 15565542, 15565543, 15565544, 15565545, 15565546, 15565547, 15565548, 15565549, 15565550, 15565551, 15565552, 15565553, 15565554, 15565555, 15565556, 15565557, 15565558, 15565559, 15565560, 15565561, 15565562, 15565563, 15565564, 15565565, 15565566, 15565567, 15565568, 15565569, 15565570, 15565571, 15565572, 15565573, 15565574, 15565575, 15565576, 15565577, 15565578, 15565579, 15565580, 15565581, 15565582, 15565583, 15565584, 15565585, 15565586, 15565587, 15565588, 15565589, 15565590, 15565591, 15565592, 15565593, 15565594, 15565595, 15565596, 15565597, 15565598, 15565599, 15565600], "trace_timestamp_s": 1180.0900000000001, "ttft_s": 1.7838807300431654, "turn_id": 5} +{"actual_output_tokens": 302, "cached_tokens": 72288, "effective_input_length": 75249, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75249, "latency_s": 4.189915775030386, "output_length": 302, "proxy_request_id": "1294611:15:1590202:975", "request_id": "1294611:15:1590202:975", "request_type": "coder", "requested_output_tokens": 302, "session_id": "1294611", "t_dispatch_unix": 1779821896.4846811, "t_finish_unix": 1779821900.6745963, "t_first_token_unix": 1779821898.0026913, "tpot_s": 0.008875886720923886, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15647388, 15647389, 15647390, 15647391, 15647392, 15647393, 15647394, 15647395, 15647396, 15647397, 15647398, 15647399, 15647400, 15647401, 15647402, 15647403, 15647404, 15647405, 15647406, 15647407, 15647408, 15647409, 15647410], "trace_timestamp_s": 1209.5380000000005, "ttft_s": 1.518007741018664, "turn_id": 15} +{"actual_output_tokens": 202, "cached_tokens": 47728, "effective_input_length": 49316, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49316, "latency_s": 2.164667533012107, "output_length": 202, "proxy_request_id": "1277428:13:1593499:976", "request_id": "1277428:13:1593499:976", "request_type": "coder", "requested_output_tokens": 202, "session_id": "1277428", "t_dispatch_unix": 1779821908.1325345, "t_finish_unix": 1779821910.2972016, "t_first_token_unix": 1779821908.7945101, "tpot_s": 0.007474516572277826, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 14951058, 14951059, 14951060, 14979347, 15609252, 15609253, 15609254, 15678100, 15678101, 15678102, 15678103], "trace_timestamp_s": 1221.1850000000004, "ttft_s": 0.6619731179671362, "turn_id": 13} +{"actual_output_tokens": 127, "cached_tokens": 75536, "effective_input_length": 75584, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75584, "latency_s": 1.2370209770160727, "output_length": 127, "proxy_request_id": "1294611:15:1594038:977", "request_id": "1294611:15:1594038:977", "request_type": "coder", "requested_output_tokens": 127, "session_id": "1294611", "t_dispatch_unix": 1779821909.847095, "t_finish_unix": 1779821911.0841157, "t_first_token_unix": 1779821910.000646, "tpot_s": 0.008596897825583934, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15684252, 15684253, 15684254, 15684255, 15684256, 15684257, 15684258, 15684259, 15684260, 15684261, 15684262, 15684263, 15684264, 15684265, 15684266, 15684267, 15684268, 15684269, 15684270, 15684271, 15684272, 15684273, 15684274, 15684275], "trace_timestamp_s": 1222.902, "ttft_s": 0.15354910999303684, "turn_id": 15} +{"actual_output_tokens": 63, "cached_tokens": 77040, "effective_input_length": 77218, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77218, "latency_s": 0.7801095829927363, "output_length": 63, "proxy_request_id": "1268861:20:1595141:978", "request_id": "1268861:20:1595141:978", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1268861", "t_dispatch_unix": 1779821913.8247917, "t_finish_unix": 1779821914.6049001, "t_first_token_unix": 1779821914.0976346, "tpot_s": 0.008177815870787468, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15693702], "trace_timestamp_s": 1226.8830000000007, "ttft_s": 0.2728410229901783, "turn_id": 20} +{"actual_output_tokens": 153, "cached_tokens": 32272, "effective_input_length": 33533, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 33533, "latency_s": 1.41912732104538, "output_length": 153, "proxy_request_id": "1399948:35:1602048:980", "request_id": "1399948:35:1602048:980", "request_type": "coder", "requested_output_tokens": 153, "session_id": "1399948", "t_dispatch_unix": 1779821937.203873, "t_finish_unix": 1779821938.6230004, "t_first_token_unix": 1779821937.6212258, "tpot_s": 0.006588252809275505, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15759381], "trace_timestamp_s": 1250.2640000000001, "ttft_s": 0.417350328003522, "turn_id": 35} +{"actual_output_tokens": 365, "cached_tokens": 89152, "effective_input_length": 90656, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 90656, "latency_s": 4.581205620022956, "output_length": 365, "proxy_request_id": "1253804:9:1605110:981", "request_id": "1253804:9:1605110:981", "request_type": "coder", "requested_output_tokens": 365, "session_id": "1253804", "t_dispatch_unix": 1779821947.188284, "t_finish_unix": 1779821951.7694895, "t_first_token_unix": 1779821948.1890075, "tpot_s": 0.009834745601567971, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15786880], "trace_timestamp_s": 1260.2450000000008, "ttft_s": 1.0007201920379885, "turn_id": 9} +{"actual_output_tokens": 4115, "cached_tokens": 75696, "effective_input_length": 75716, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75716, "latency_s": 38.08519301196793, "output_length": 4115, "proxy_request_id": "1294611:15:1596163:979", "request_id": "1294611:15:1596163:979", "request_type": "coder", "requested_output_tokens": 4115, "session_id": "1294611", "t_dispatch_unix": 1779821917.0105608, "t_finish_unix": 1779821955.0957534, "t_first_token_unix": 1779821917.161651, "tpot_s": 0.009220664261060522, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 15703736, 15703737, 15703738, 15703739, 15703740, 15703741, 15703742, 15703743, 15703744, 15703745, 15703746, 15703747, 15703748, 15703749, 15703750, 15703751, 15703752, 15703753, 15703754, 15703755, 15703756, 15703757, 15703758, 15703759], "trace_timestamp_s": 1230.063, "ttft_s": 0.15108795301057398, "turn_id": 15} +{"actual_output_tokens": 178, "cached_tokens": 77280, "effective_input_length": 77293, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77293, "latency_s": 1.7014530829619616, "output_length": 178, "proxy_request_id": "1268861:21:1609831:982", "request_id": "1268861:21:1609831:982", "request_type": "coder", "requested_output_tokens": 178, "session_id": "1268861", "t_dispatch_unix": 1779821962.9357271, "t_finish_unix": 1779821964.6371796, "t_first_token_unix": 1779821963.0671844, "tpot_s": 0.008868636254294866, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363], "trace_timestamp_s": 1275.9880000000003, "ttft_s": 0.13145524397259578, "turn_id": 21} +{"actual_output_tokens": 19, "cached_tokens": 91008, "effective_input_length": 91103, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91103, "latency_s": 0.3131502729956992, "output_length": 19, "proxy_request_id": "1253804:10:1611505:983", "request_id": "1253804:10:1611505:983", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1253804", "t_dispatch_unix": 1779821968.4099216, "t_finish_unix": 1779821968.7230704, "t_first_token_unix": 1779821968.6070714, "tpot_s": 0.006430843835308527, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080], "trace_timestamp_s": 1281.4660000000003, "ttft_s": 0.19714844797272235, "turn_id": 10} +{"actual_output_tokens": 83, "cached_tokens": 33680, "effective_input_length": 34773, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 34773, "latency_s": 0.8955535989953205, "output_length": 83, "proxy_request_id": "1399948:36:1612467:984", "request_id": "1399948:36:1612467:984", "request_type": "coder", "requested_output_tokens": 83, "session_id": "1399948", "t_dispatch_unix": 1779821971.5210612, "t_finish_unix": 1779821972.4166138, "t_first_token_unix": 1779821971.879718, "tpot_s": 0.006544368280518073, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946], "trace_timestamp_s": 1284.5810000000001, "ttft_s": 0.3586554600042291, "turn_id": 36} +{"actual_output_tokens": 212, "cached_tokens": 91120, "effective_input_length": 91131, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91131, "latency_s": 2.2047752939979546, "output_length": 212, "proxy_request_id": "1253804:11:1613030:985", "request_id": "1253804:11:1613030:985", "request_type": "coder", "requested_output_tokens": 212, "session_id": "1253804", "t_dispatch_unix": 1779821973.7446933, "t_finish_unix": 1779821975.9494681, "t_first_token_unix": 1779821973.8991487, "tpot_s": 0.00971586168252629, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080], "trace_timestamp_s": 1286.8030000000008, "ttft_s": 0.1544523949851282, "turn_id": 11} +{"actual_output_tokens": 168, "cached_tokens": 34848, "effective_input_length": 35308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35308, "latency_s": 1.348903096979484, "output_length": 168, "proxy_request_id": "1399948:37:1613628:986", "request_id": "1399948:37:1613628:986", "request_type": "coder", "requested_output_tokens": 168, "session_id": "1399948", "t_dispatch_unix": 1779821975.5977929, "t_finish_unix": 1779821976.946696, "t_first_token_unix": 1779821975.8230298, "tpot_s": 0.006726924473249693, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752], "trace_timestamp_s": 1288.6590000000006, "ttft_s": 0.225235077959951, "turn_id": 37} +{"actual_output_tokens": 79, "cached_tokens": 35472, "effective_input_length": 35581, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35581, "latency_s": 0.6311111840186641, "output_length": 79, "proxy_request_id": "1399948:38:1616890:987", "request_id": "1399948:38:1616890:987", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1399948", "t_dispatch_unix": 1779821986.7762783, "t_finish_unix": 1779821987.407389, "t_first_token_unix": 1779821986.8975775, "tpot_s": 0.0065326136283170525, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15894792], "trace_timestamp_s": 1299.8360000000002, "ttft_s": 0.12129726202692837, "turn_id": 38} +{"actual_output_tokens": 68, "cached_tokens": 35648, "effective_input_length": 35682, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35682, "latency_s": 0.5141074529965408, "output_length": 68, "proxy_request_id": "1399948:39:1618250:989", "request_id": "1399948:39:1618250:989", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1399948", "t_dispatch_unix": 1779821991.47681, "t_finish_unix": 1779821991.9909172, "t_first_token_unix": 1779821991.5568454, "tpot_s": 0.00647514900053615, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15907502], "trace_timestamp_s": 1304.5330000000004, "ttft_s": 0.08003385097254068, "turn_id": 39} +{"actual_output_tokens": 57, "cached_tokens": 35744, "effective_input_length": 35958, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 35958, "latency_s": 0.5062818040023558, "output_length": 57, "proxy_request_id": "1399948:40:1620970:991", "request_id": "1399948:40:1620970:991", "request_type": "coder", "requested_output_tokens": 57, "session_id": "1399948", "t_dispatch_unix": 1779822000.4630709, "t_finish_unix": 1779822000.9693522, "t_first_token_unix": 1779822000.6162643, "tpot_s": 0.0063009067141268004, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 15932234], "trace_timestamp_s": 1313.5230000000001, "ttft_s": 0.15319108398398384, "turn_id": 40} +{"actual_output_tokens": 141, "cached_tokens": 77456, "effective_input_length": 78439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78439, "latency_s": 1.9686909479787573, "output_length": 141, "proxy_request_id": "1268861:22:1620830:990", "request_id": "1268861:22:1620830:990", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1268861", "t_dispatch_unix": 1779821999.9991093, "t_finish_unix": 1779822001.9678004, "t_first_token_unix": 1779822000.7511728, "tpot_s": 0.008688318278707032, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 15930461], "trace_timestamp_s": 1313.0500000000002, "ttft_s": 0.7520619179704227, "turn_id": 22} +{"actual_output_tokens": 35, "cached_tokens": 91328, "effective_input_length": 91389, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91389, "latency_s": 0.48132393800187856, "output_length": 35, "proxy_request_id": "1253804:12:1621957:992", "request_id": "1253804:12:1621957:992", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779822003.9030735, "t_finish_unix": 1779822004.3843975, "t_first_token_unix": 1779822004.1099124, "tpot_s": 0.008065794676761417, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810], "trace_timestamp_s": 1316.96, "ttft_s": 0.2068359119584784, "turn_id": 12} +{"actual_output_tokens": 100, "cached_tokens": 36000, "effective_input_length": 36168, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36168, "latency_s": 0.8013780050096102, "output_length": 100, "proxy_request_id": "1399948:41:1624143:993", "request_id": "1399948:41:1624143:993", "request_type": "coder", "requested_output_tokens": 100, "session_id": "1399948", "t_dispatch_unix": 1779822011.2750084, "t_finish_unix": 1779822012.0763857, "t_first_token_unix": 1779822011.4188526, "tpot_s": 0.006639430909111833, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 15963281], "trace_timestamp_s": 1324.3290000000006, "ttft_s": 0.1438422169885598, "turn_id": 41} +{"actual_output_tokens": 105, "cached_tokens": 91408, "effective_input_length": 91440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 91440, "latency_s": 1.1342383949668147, "output_length": 105, "proxy_request_id": "1253804:13:1624613:994", "request_id": "1253804:13:1624613:994", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1253804", "t_dispatch_unix": 1779822012.8418412, "t_finish_unix": 1779822013.9760787, "t_first_token_unix": 1779822012.9983177, "tpot_s": 0.009399104759862754, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810], "trace_timestamp_s": 1325.9010000000007, "ttft_s": 0.15647489298135042, "turn_id": 13} +{"actual_output_tokens": 85, "cached_tokens": 91536, "effective_input_length": 92367, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92367, "latency_s": 1.4542587339528836, "output_length": 85, "proxy_request_id": "1253804:14:1626575:995", "request_id": "1253804:14:1626575:995", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1253804", "t_dispatch_unix": 1779822019.352752, "t_finish_unix": 1779822020.80701, "t_first_token_unix": 1779822020.0202348, "tpot_s": 0.009363007237663538, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 15986054], "trace_timestamp_s": 1332.411, "ttft_s": 0.6674799399916083, "turn_id": 14} +{"actual_output_tokens": 43, "cached_tokens": 92448, "effective_input_length": 92701, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92701, "latency_s": 0.6788457160000689, "output_length": 43, "proxy_request_id": "1253804:15:1628485:997", "request_id": "1253804:15:1628485:997", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1253804", "t_dispatch_unix": 1779822025.6816978, "t_finish_unix": 1779822026.3605435, "t_first_token_unix": 1779822025.9997613, "tpot_s": 0.008583446572412782, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16004240], "trace_timestamp_s": 1338.7400000000007, "ttft_s": 0.3180618020123802, "turn_id": 15} +{"actual_output_tokens": 175, "cached_tokens": 36256, "effective_input_length": 36984, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 36984, "latency_s": 1.4924453559797257, "output_length": 175, "proxy_request_id": "1399948:42:1628429:996", "request_id": "1399948:42:1628429:996", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1399948", "t_dispatch_unix": 1779822025.4667702, "t_finish_unix": 1779822026.9592154, "t_first_token_unix": 1779822025.7662113, "tpot_s": 0.00685503534489611, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16003843], "trace_timestamp_s": 1338.5230000000001, "ttft_s": 0.29943959100637585, "turn_id": 42} +{"actual_output_tokens": 65, "cached_tokens": 75936, "effective_input_length": 79074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79074, "latency_s": 2.2779391270014457, "output_length": 65, "proxy_request_id": "1388507:3:1629072:998", "request_id": "1388507:3:1629072:998", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1388507", "t_dispatch_unix": 1779822027.7715108, "t_finish_unix": 1779822030.0494494, "t_first_token_unix": 1779822029.515455, "tpot_s": 0.008339253906342492, "trace_hash_ids": [10601431, 21251, 21252, 21253, 7175275, 7175276, 7175277, 10601432, 10601433, 10601434, 10601435, 10601436, 10601437, 10601438, 10601439, 10601440, 10601441, 10601442, 10601443, 10601444, 10601445, 10601446, 10601447, 10601448, 10601449, 10601450, 10601451, 10601452, 10601453, 10601454, 10601455, 10601456, 10601457, 10601458, 10601459, 10601460, 10601461, 10601462, 10601463, 10601464, 10601465, 10601466, 10601467, 10601468, 10601469, 10601470, 10601471, 3889792, 10601472, 10479693, 10479694, 10479695, 10601473, 10601474, 76714, 76715, 76716, 10601475, 10601476, 10601477, 10601478, 10601479, 10601480, 10601481, 10601482, 10601483, 10601484, 10601485, 10601486, 10601487, 10601488, 10601489, 10601490, 10601491, 10601492, 10601493, 10601494, 10601495, 10601496, 10601497, 10601498, 10601499, 10601500, 10601501, 10601502, 10601503, 10601504, 10601505, 10601506, 10601507, 10601508, 10601509, 10601510, 10601511, 10601512, 10601513, 10601514, 11402004, 11402005, 11402006, 11402007, 11402008, 11402009, 11402010, 11402011, 11402012, 11402013, 11402014, 11402015, 11402016, 11402017, 11402018, 11402019, 11402020, 11402021, 11402022, 11402023, 11402024, 11402025, 11402026, 11402027, 11402028, 11402029, 11402030, 11402031, 11402032, 11853944, 11853945, 11853946, 11853947, 11853948, 11853949, 11853950, 11853951, 12251200, 12251201, 12251202, 12251203, 12251204, 12251205, 13699728, 14709792, 14709793, 14709794, 14709795, 14709796, 14709797, 14709798, 16009495, 16009496, 16009497, 16009498, 16009499, 16009500, 16009501], "trace_timestamp_s": 1340.8290000000006, "ttft_s": 1.7439410269726068, "turn_id": 3} +{"actual_output_tokens": 102, "cached_tokens": 92736, "effective_input_length": 92953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 92953, "latency_s": 1.274999574990943, "output_length": 102, "proxy_request_id": "1253804:16:1629713:999", "request_id": "1253804:16:1629713:999", "request_type": "coder", "requested_output_tokens": 102, "session_id": "1253804", "t_dispatch_unix": 1779822029.7310953, "t_finish_unix": 1779822031.0060952, "t_first_token_unix": 1779822030.048005, "tpot_s": 0.00948334290095061, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597], "trace_timestamp_s": 1342.79, "ttft_s": 0.31690731801791117, "turn_id": 16} +{"actual_output_tokens": 81, "cached_tokens": 93040, "effective_input_length": 93219, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93219, "latency_s": 1.06083132798085, "output_length": 81, "proxy_request_id": "1253804:17:1631602:1002", "request_id": "1253804:17:1631602:1002", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1253804", "t_dispatch_unix": 1779822035.8043876, "t_finish_unix": 1779822036.865219, "t_first_token_unix": 1779822036.1232955, "tpot_s": 0.009270848950109212, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16034156], "trace_timestamp_s": 1348.8640000000005, "ttft_s": 0.3189054869581014, "turn_id": 17} +{"actual_output_tokens": 74, "cached_tokens": 78576, "effective_input_length": 79693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79693, "latency_s": 1.3506610929616727, "output_length": 74, "proxy_request_id": "1268861:23:1631587:1001", "request_id": "1268861:23:1631587:1001", "request_type": "coder", "requested_output_tokens": 74, "session_id": "1268861", "t_dispatch_unix": 1779822035.730735, "t_finish_unix": 1779822037.0813963, "t_first_token_unix": 1779822036.4631903, "tpot_s": 0.008465369027076059, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16034091], "trace_timestamp_s": 1348.79, "ttft_s": 0.7324529640027322, "turn_id": 23} +{"actual_output_tokens": 298, "cached_tokens": 79824, "effective_input_length": 79890, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79890, "latency_s": 2.9137032679864205, "output_length": 298, "proxy_request_id": "1294611:15:1631116:1000", "request_id": "1294611:15:1631116:1000", "request_type": "coder", "requested_output_tokens": 298, "session_id": "1294611", "t_dispatch_unix": 1779822034.3163779, "t_finish_unix": 1779822037.2300808, "t_first_token_unix": 1779822034.520472, "tpot_s": 0.00912250527937235, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16029362, 16029363, 16029364, 16029365, 16029366, 16029367, 16029368, 16029369, 16029370, 16029371, 16029372, 16029373, 16029374, 16029375, 16029376, 16029377, 16029378, 16029379, 16029380, 16029381, 16029382, 16029383, 16029384, 16029385, 16029386, 16029387, 16029388, 16029389, 16029390, 16029391, 16029392, 16029393, 16029394], "trace_timestamp_s": 1347.3670000000002, "ttft_s": 0.20409175503300503, "turn_id": 15} +{"actual_output_tokens": 93, "cached_tokens": 93296, "effective_input_length": 93509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93509, "latency_s": 1.1833833970013075, "output_length": 93, "proxy_request_id": "1253804:18:1633257:1003", "request_id": "1253804:18:1633257:1003", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1253804", "t_dispatch_unix": 1779822041.2557447, "t_finish_unix": 1779822042.4391274, "t_first_token_unix": 1779822041.5718987, "tpot_s": 0.00942308745668371, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428], "trace_timestamp_s": 1354.3140000000003, "ttft_s": 0.31615200196392834, "turn_id": 18} +{"actual_output_tokens": 65, "cached_tokens": 80176, "effective_input_length": 80221, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80221, "latency_s": 0.6910055649932474, "output_length": 65, "proxy_request_id": "1294611:15:1634779:1004", "request_id": "1294611:15:1634779:1004", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1294611", "t_dispatch_unix": 1779822046.4267166, "t_finish_unix": 1779822047.1177223, "t_first_token_unix": 1779822046.5781322, "tpot_s": 0.008427239344200643, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16063555, 15647389, 15647390, 15647391, 15647392, 15647393, 15647394, 15647395, 15647396, 15647397, 15647398, 15647399, 15647400, 15647401, 15647402, 15647403, 15647404, 15647405, 15647406, 15647407, 15647408, 15647409, 15647410, 16063556, 16063557, 16063558, 16063559, 16063560, 16063561, 16063562, 16063563, 16063564, 16063565], "trace_timestamp_s": 1359.4810000000007, "ttft_s": 0.15141325898002833, "turn_id": 15} +{"actual_output_tokens": 399, "cached_tokens": 93600, "effective_input_length": 93664, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 93664, "latency_s": 4.1829181559733115, "output_length": 399, "proxy_request_id": "1253804:19:1634903:1005", "request_id": "1253804:19:1634903:1005", "request_type": "coder", "requested_output_tokens": 399, "session_id": "1253804", "t_dispatch_unix": 1779822046.7993991, "t_finish_unix": 1779822050.982317, "t_first_token_unix": 1779822047.0087464, "tpot_s": 0.009982687648123682, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428], "trace_timestamp_s": 1359.8590000000004, "ttft_s": 0.20934554701671004, "turn_id": 19} +{"actual_output_tokens": 87, "cached_tokens": 94048, "effective_input_length": 94111, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 94111, "latency_s": 1.024786046007648, "output_length": 87, "proxy_request_id": "1253804:20:1638889:1007", "request_id": "1253804:20:1638889:1007", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1253804", "t_dispatch_unix": 1779822059.9771435, "t_finish_unix": 1779822061.0019293, "t_first_token_unix": 1779822060.197746, "tpot_s": 0.009347479453386176, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467], "trace_timestamp_s": 1373.0350000000008, "ttft_s": 0.22059665498090908, "turn_id": 20} +{"actual_output_tokens": 285, "cached_tokens": 0, "effective_input_length": 9804, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9804, "latency_s": 3.820591853989754, "output_length": 285, "proxy_request_id": "1258908:2:1639411:1008", "request_id": "1258908:2:1639411:1008", "request_type": "coder", "requested_output_tokens": 285, "session_id": "1258908", "t_dispatch_unix": 1779822061.7881174, "t_finish_unix": 1779822065.608709, "t_first_token_unix": 1779822062.6046674, "tpot_s": 0.010576666095031714, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 16107627, 16107628, 16107629, 16107630, 16107631], "trace_timestamp_s": 1374.8490000000002, "ttft_s": 0.8165486709913239, "turn_id": 2} +{"actual_output_tokens": 55, "cached_tokens": 79760, "effective_input_length": 80019, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80019, "latency_s": 0.7284864850225858, "output_length": 55, "proxy_request_id": "1268861:24:1643502:1011", "request_id": "1268861:24:1643502:1011", "request_type": "coder", "requested_output_tokens": 55, "session_id": "1268861", "t_dispatch_unix": 1779822075.6042073, "t_finish_unix": 1779822076.3326938, "t_first_token_unix": 1779822075.8919368, "tpot_s": 0.008157396111292419, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16147319, 16147320], "trace_timestamp_s": 1388.6640000000007, "ttft_s": 0.2877273350022733, "turn_id": 24} +{"actual_output_tokens": 115, "cached_tokens": 37152, "effective_input_length": 38102, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38102, "latency_s": 1.1544556180015206, "output_length": 115, "proxy_request_id": "1399948:43:1643413:1010", "request_id": "1399948:43:1643413:1010", "request_type": "coder", "requested_output_tokens": 115, "session_id": "1399948", "t_dispatch_unix": 1779822075.261707, "t_finish_unix": 1779822076.4161623, "t_first_token_unix": 1779822075.6458735, "tpot_s": 0.006754706648950416, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16146472], "trace_timestamp_s": 1388.3220000000001, "ttft_s": 0.38416507199872285, "turn_id": 43} +{"actual_output_tokens": 2429, "cached_tokens": 80272, "effective_input_length": 80717, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80717, "latency_s": 24.455414713011123, "output_length": 2429, "proxy_request_id": "1294611:15:1636645:1006", "request_id": "1294611:15:1636645:1006", "request_type": "coder", "requested_output_tokens": 2429, "session_id": "1294611", "t_dispatch_unix": 1779822052.4684563, "t_finish_unix": 1779822076.9238706, "t_first_token_unix": 1779822052.9028814, "tpot_s": 0.009893223838543111, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16080826, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859], "trace_timestamp_s": 1365.5200000000004, "ttft_s": 0.43442196102114394, "turn_id": 15} +{"actual_output_tokens": 1400, "cached_tokens": 94192, "effective_input_length": 94269, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 94269, "latency_s": 14.539562143967487, "output_length": 1400, "proxy_request_id": "1253804:21:1640487:1009", "request_id": "1253804:21:1640487:1009", "request_type": "coder", "requested_output_tokens": 1400, "session_id": "1253804", "t_dispatch_unix": 1779822065.2639039, "t_finish_unix": 1779822079.8034658, "t_first_token_unix": 1779822065.4916825, "tpot_s": 0.010229805443889253, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16119050], "trace_timestamp_s": 1378.3230000000003, "ttft_s": 0.22777682699961588, "turn_id": 21} +{"actual_output_tokens": 219, "cached_tokens": 38208, "effective_input_length": 38308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38308, "latency_s": 1.6258173320093192, "output_length": 219, "proxy_request_id": "1399948:44:1644970:1012", "request_id": "1399948:44:1644970:1012", "request_type": "coder", "requested_output_tokens": 219, "session_id": "1399948", "t_dispatch_unix": 1779822080.3872323, "t_finish_unix": 1779822082.0130491, "t_first_token_unix": 1779822080.51215, "tpot_s": 0.006883694866934894, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765], "trace_timestamp_s": 1393.4470000000001, "ttft_s": 0.12491531705018133, "turn_id": 44} +{"actual_output_tokens": 54, "cached_tokens": 95664, "effective_input_length": 95715, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 95715, "latency_s": 0.6919568770099431, "output_length": 54, "proxy_request_id": "1253804:22:1650001:1013", "request_id": "1253804:22:1650001:1013", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1253804", "t_dispatch_unix": 1779822096.966344, "t_finish_unix": 1779822097.6583004, "t_first_token_unix": 1779822097.1871135, "tpot_s": 0.00888567783030734, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630], "trace_timestamp_s": 1410.0170000000007, "ttft_s": 0.22076705400831997, "turn_id": 22} +{"actual_output_tokens": 87, "cached_tokens": 38512, "effective_input_length": 38758, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 38758, "latency_s": 0.7400179809774272, "output_length": 87, "proxy_request_id": "1399948:45:1650679:1014", "request_id": "1399948:45:1650679:1014", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1399948", "t_dispatch_unix": 1779822099.429086, "t_finish_unix": 1779822100.169103, "t_first_token_unix": 1779822099.5873263, "tpot_s": 0.006761771686331824, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16213486], "trace_timestamp_s": 1412.487, "ttft_s": 0.15823896700749174, "turn_id": 45} +{"actual_output_tokens": 45, "cached_tokens": 95760, "effective_input_length": 96944, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 96944, "latency_s": 1.2629330250201747, "output_length": 45, "proxy_request_id": "1253804:23:1651448:1015", "request_id": "1253804:23:1651448:1015", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822101.7204907, "t_finish_unix": 1779822102.9834232, "t_first_token_unix": 1779822102.5941567, "tpot_s": 0.008841120909148065, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16220458], "trace_timestamp_s": 1414.777, "ttft_s": 0.8736632519867271, "turn_id": 23} +{"actual_output_tokens": 123, "cached_tokens": 38832, "effective_input_length": 39837, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 39837, "latency_s": 1.2488787969923578, "output_length": 123, "proxy_request_id": "1399948:46:1658183:1018", "request_id": "1399948:46:1658183:1018", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1399948", "t_dispatch_unix": 1779822124.5623946, "t_finish_unix": 1779822125.8112736, "t_first_token_unix": 1779822124.96445, "tpot_s": 0.006938651352491016, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828], "trace_timestamp_s": 1437.6230000000005, "ttft_s": 0.40205270901788026, "turn_id": 46} +{"actual_output_tokens": 45, "cached_tokens": 96976, "effective_input_length": 97769, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 97769, "latency_s": 1.0844819020130672, "output_length": 45, "proxy_request_id": "1253804:24:1659020:1019", "request_id": "1253804:24:1659020:1019", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822127.4512942, "t_finish_unix": 1779822128.5357757, "t_first_token_unix": 1779822128.1470635, "tpot_s": 0.008828650249845603, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091], "trace_timestamp_s": 1440.5100000000002, "ttft_s": 0.695767222030554, "turn_id": 24} +{"actual_output_tokens": 2557, "cached_tokens": 80064, "effective_input_length": 80406, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 80406, "latency_s": 24.566222423978616, "output_length": 2557, "proxy_request_id": "1268861:25:1653400:1016", "request_id": "1268861:25:1653400:1016", "request_type": "coder", "requested_output_tokens": 2557, "session_id": "1268861", "t_dispatch_unix": 1779822108.1609604, "t_finish_unix": 1779822132.7271829, "t_first_token_unix": 1779822108.592794, "tpot_s": 0.009442151582539146, "trace_hash_ids": [121761, 121762, 121763, 121764, 734386, 734387, 734388, 734389, 734390, 734391, 734392, 734393, 734394, 734395, 734396, 734397, 734398, 734399, 734400, 734401, 734402, 734403, 734404, 12627027, 12743481, 12909644, 12909645, 12909646, 12909647, 12909648, 12909649, 12909650, 12909651, 12909652, 12909653, 12909654, 12909655, 12909656, 12909657, 12909658, 12909659, 12909660, 13047213, 13047214, 13047215, 13047216, 13047217, 13047218, 13047219, 13047220, 13047221, 13047222, 13201035, 13201036, 13201037, 13201038, 13201039, 13201040, 13201041, 13201042, 13201043, 13201044, 13201045, 13201046, 13201047, 13201048, 13201049, 13360567, 13360568, 13360569, 13360570, 13360571, 13621765, 13621766, 13621767, 13621768, 13621769, 13621770, 13621771, 13621772, 13621773, 13890048, 13890049, 13890050, 13890051, 13890052, 14046020, 14046021, 14046022, 14046023, 14046024, 14046025, 14046026, 14046027, 14046028, 14046029, 14214011, 14214012, 14214013, 14214014, 14214015, 14214016, 14214017, 14334562, 14334563, 14334564, 14334565, 14445188, 14445189, 14610201, 14610202, 14768215, 14768216, 14768217, 14768218, 14768219, 14768220, 14768221, 14768222, 14768223, 14768224, 14868807, 14868808, 15072113, 15072114, 15072115, 15072116, 15072117, 15072118, 15072119, 15072120, 15072121, 15072122, 15072123, 15072124, 15072125, 15072126, 15072127, 15072128, 15173442, 15173443, 15173444, 15173445, 15173446, 15173447, 15173448, 15173449, 15295377, 15533475, 15533476, 15829363, 15930459, 15930460, 16034089, 16034090, 16147319, 16238847, 16238848], "trace_timestamp_s": 1421.2150000000001, "ttft_s": 0.4318306280183606, "turn_id": 25} +{"actual_output_tokens": 45, "cached_tokens": 97808, "effective_input_length": 98187, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98187, "latency_s": 0.8976823359844275, "output_length": 45, "proxy_request_id": "1253804:25:1662273:1020", "request_id": "1253804:25:1662273:1020", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822138.3149276, "t_finish_unix": 1779822139.2126098, "t_first_token_unix": 1779822138.8253386, "tpot_s": 0.008794899273198098, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784], "trace_timestamp_s": 1451.3740000000007, "ttft_s": 0.5104085319908336, "turn_id": 25} +{"actual_output_tokens": 2280, "cached_tokens": 83136, "effective_input_length": 83204, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 83204, "latency_s": 22.025546602963004, "output_length": 2280, "proxy_request_id": "1294611:15:1657992:1017", "request_id": "1294611:15:1657992:1017", "request_type": "coder", "requested_output_tokens": 2280, "session_id": "1294611", "t_dispatch_unix": 1779822124.0798557, "t_finish_unix": 1779822146.1054018, "t_first_token_unix": 1779822124.2910717, "tpot_s": 0.009571778147442355, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16281887, 16281888, 16281889, 16281890, 16281891, 16281892, 16281893, 16281894, 16281895, 16281896, 16281897, 16281898, 16281899, 16281900, 16281901, 16281902, 16281903, 16281904, 16281905, 16281906, 16281907, 16281908, 16281909, 16281910, 16281911, 16281912, 16281913, 16281914, 16281915, 16281916, 16281917, 16281918, 16281919, 16281920, 16281921, 16281922, 16281923, 16281924, 16281925], "trace_timestamp_s": 1437.1310000000003, "ttft_s": 0.21121390297776088, "turn_id": 15} +{"actual_output_tokens": 63, "cached_tokens": 39952, "effective_input_length": 40261, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40261, "latency_s": 0.6448233150294982, "output_length": 63, "proxy_request_id": "1399948:47:1664702:1022", "request_id": "1399948:47:1664702:1022", "request_type": "coder", "requested_output_tokens": 63, "session_id": "1399948", "t_dispatch_unix": 1779822146.923941, "t_finish_unix": 1779822147.5687642, "t_first_token_unix": 1779822147.1573534, "tpot_s": 0.006631566725123013, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16343814], "trace_timestamp_s": 1459.9850000000006, "ttft_s": 0.23341042501851916, "turn_id": 47} +{"actual_output_tokens": 152, "cached_tokens": 131936, "effective_input_length": 132537, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 132537, "latency_s": 3.2892846690374427, "output_length": 152, "proxy_request_id": "1356885:8:1665690:1023", "request_id": "1356885:8:1665690:1023", "request_type": "coder", "requested_output_tokens": 152, "session_id": "1356885", "t_dispatch_unix": 1779822150.1278749, "t_finish_unix": 1779822153.4171588, "t_first_token_unix": 1779822150.8230371, "tpot_s": 0.017176550754811615, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835], "trace_timestamp_s": 1463.1860000000006, "ttft_s": 0.6951594820129685, "turn_id": 8} +{"actual_output_tokens": 197, "cached_tokens": 40320, "effective_input_length": 40343, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40343, "latency_s": 1.4593951670103706, "output_length": 197, "proxy_request_id": "1399948:48:1666394:1024", "request_id": "1399948:48:1666394:1024", "request_type": "coder", "requested_output_tokens": 197, "session_id": "1399948", "t_dispatch_unix": 1779822152.5556602, "t_finish_unix": 1779822154.0150554, "t_first_token_unix": 1779822152.6452494, "tpot_s": 0.006987521928564018, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763], "trace_timestamp_s": 1465.6150000000007, "ttft_s": 0.08958692802116275, "turn_id": 48} +{"actual_output_tokens": 154, "cached_tokens": 40528, "effective_input_length": 40642, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40642, "latency_s": 1.1952337530092336, "output_length": 154, "proxy_request_id": "1399948:49:1668825:1025", "request_id": "1399948:49:1668825:1025", "request_type": "coder", "requested_output_tokens": 154, "session_id": "1399948", "t_dispatch_unix": 1779822161.1177046, "t_finish_unix": 1779822162.312938, "t_first_token_unix": 1779822161.2499795, "tpot_s": 0.006945394248141621, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16382119], "trace_timestamp_s": 1474.1770000000006, "ttft_s": 0.13227315503172576, "turn_id": 49} +{"actual_output_tokens": 169, "cached_tokens": 85472, "effective_input_length": 85542, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85542, "latency_s": 1.78563556302106, "output_length": 169, "proxy_request_id": "1294611:15:1673197:1026", "request_id": "1294611:15:1673197:1026", "request_type": "coder", "requested_output_tokens": 169, "session_id": "1294611", "t_dispatch_unix": 1779822176.3266096, "t_finish_unix": 1779822178.112245, "t_first_token_unix": 1779822176.5421503, "tpot_s": 0.009344163321310632, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16425840, 16425841, 16425842, 16425843, 16425844, 16425845, 16425846, 16425847, 16425848, 16425849, 16425850, 16425851, 16425852, 16425853, 16425854, 16425855, 16425856, 16425857, 16425858, 16425859, 16425860, 16425861, 16425862, 16425863, 16425864, 16425865, 16425866, 16425867, 16425868, 16425869, 16425870, 16425871, 16425872, 16425873, 16425874, 16425875, 16425876, 16425877, 16425878, 16425879, 16425880, 16425881, 16425882, 16425883], "trace_timestamp_s": 1489.3780000000006, "ttft_s": 0.21553788403980434, "turn_id": 15} +{"actual_output_tokens": 3441, "cached_tokens": 98224, "effective_input_length": 98254, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 98254, "latency_s": 37.88220674695913, "output_length": 3441, "proxy_request_id": "1253804:26:1663639:1021", "request_id": "1253804:26:1663639:1021", "request_type": "coder", "requested_output_tokens": 3441, "session_id": "1253804", "t_dispatch_unix": 1779822143.149065, "t_finish_unix": 1779822181.0312715, "t_first_token_unix": 1779822143.3201005, "tpot_s": 0.010962470554067147, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784], "trace_timestamp_s": 1456.2080000000005, "ttft_s": 0.17103354597929865, "turn_id": 26} +{"actual_output_tokens": 270, "cached_tokens": 85696, "effective_input_length": 85722, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 85722, "latency_s": 2.708693847001996, "output_length": 270, "proxy_request_id": "1294611:15:1676489:1027", "request_id": "1294611:15:1676489:1027", "request_type": "coder", "requested_output_tokens": 270, "session_id": "1294611", "t_dispatch_unix": 1779822187.715847, "t_finish_unix": 1779822190.4245398, "t_first_token_unix": 1779822187.9093175, "tpot_s": 0.009349211156117249, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16456400, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859, 16456401, 16456402, 16456403, 16456404, 16456405, 16456406, 16456407, 16456408, 16456409, 16456410], "trace_timestamp_s": 1500.7660000000005, "ttft_s": 0.1934682999853976, "turn_id": 15} +{"actual_output_tokens": 500, "cached_tokens": 40784, "effective_input_length": 42648, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42648, "latency_s": 4.221226428984664, "output_length": 500, "proxy_request_id": "1399948:50:1677482:1028", "request_id": "1399948:50:1677482:1028", "request_type": "coder", "requested_output_tokens": 500, "session_id": "1399948", "t_dispatch_unix": 1779822190.9718978, "t_finish_unix": 1779822195.1931238, "t_first_token_unix": 1779822191.5719957, "tpot_s": 0.0072562354328698725, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16467283], "trace_timestamp_s": 1504.031, "ttft_s": 0.6000955919735134, "turn_id": 50} +{"actual_output_tokens": 290, "cached_tokens": 85984, "effective_input_length": 86602, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86602, "latency_s": 3.220635987003334, "output_length": 290, "proxy_request_id": "1294611:15:1679070:1029", "request_id": "1294611:15:1679070:1029", "request_type": "coder", "requested_output_tokens": 290, "session_id": "1294611", "t_dispatch_unix": 1779822196.393444, "t_finish_unix": 1779822199.614069, "t_first_token_unix": 1779822196.8714092, "tpot_s": 0.00948905897573294, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16482842, 15703737, 15703738, 15703739, 15703740, 15703741, 15703742, 15703743, 15703744, 15703745, 15703746, 15703747, 15703748, 15703749, 15703750, 15703751, 15703752, 15703753, 15703754, 15703755, 15703756, 15703757, 15703758, 15703759, 16482843, 16482844, 16482845, 16482846, 16482847, 16482848, 16482849, 16482850, 16482851, 16482852, 16482853, 16482854, 16482855, 16482856, 16482857, 16482858, 16482859, 16482860, 16482861, 16482862, 16482863, 16482864], "trace_timestamp_s": 1509.4470000000001, "ttft_s": 0.4779735860065557, "turn_id": 15} +{"actual_output_tokens": 35, "cached_tokens": 101680, "effective_input_length": 101743, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101743, "latency_s": 0.5225934970076196, "output_length": 35, "proxy_request_id": "1253804:27:1683133:1031", "request_id": "1253804:27:1683133:1031", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779822210.0219846, "t_finish_unix": 1779822210.5445778, "t_first_token_unix": 1779822210.2773783, "tpot_s": 0.007850954059155328, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388], "trace_timestamp_s": 1523.0790000000006, "ttft_s": 0.25539101898903027, "turn_id": 27} +{"actual_output_tokens": 412, "cached_tokens": 86880, "effective_input_length": 86925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 86925, "latency_s": 4.0981055769952945, "output_length": 412, "proxy_request_id": "1294611:15:1682649:1030", "request_id": "1294611:15:1682649:1030", "request_type": "coder", "requested_output_tokens": 412, "session_id": "1294611", "t_dispatch_unix": 1779822208.3002808, "t_finish_unix": 1779822212.3983862, "t_first_token_unix": 1779822208.4671507, "tpot_s": 0.009564446073071917, "trace_hash_ids": [189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 737309, 737310, 737311, 737312, 737313, 737314, 737315, 737316, 737317, 12861599, 12861600, 12861601, 12861602, 3595333, 12861603, 12861604, 12861605, 12877479, 12890135, 12890136, 12890137, 12933071, 12941603, 12941604, 234568, 12952201, 12952202, 12952203, 12952204, 12952205, 12952206, 12952207, 12952208, 12952209, 12952210, 12992776, 12992777, 12992778, 12992779, 12992780, 12992781, 12992782, 12992783, 12992784, 12992785, 12992786, 12992787, 12992788, 12992789, 12992790, 12992791, 12992792, 12992793, 12992794, 12992795, 12992796, 12992797, 12992798, 12992799, 12992800, 13044794, 13063309, 13063310, 13446606, 13446607, 13446608, 13446609, 13446610, 13446611, 14232830, 14232831, 14232832, 14232833, 14232834, 14232835, 14232836, 14232837, 14232838, 14232839, 14232840, 14232841, 14232842, 14232843, 14232844, 14232845, 14232846, 14232847, 14232848, 14232849, 14232850, 14232851, 14232852, 14232853, 14232854, 14232855, 14232856, 14232857, 14232858, 14280911, 16515797, 16080827, 16080828, 16080829, 16080830, 16080831, 16080832, 16080833, 16080834, 16080835, 16080836, 16080837, 16080838, 16080839, 16080840, 16080841, 16080842, 16080843, 16080844, 16080845, 16080846, 16080847, 16080848, 16080849, 16080850, 16080851, 16080852, 16080853, 16080854, 16080855, 16080856, 16080857, 16080858, 16080859, 16456401, 16456402, 16456403, 16456404, 16456405, 16456406, 16456407, 16456408, 16456409, 16456410, 16515798, 16515799], "trace_timestamp_s": 1521.3540000000003, "ttft_s": 0.16686722601298243, "turn_id": 15} +{"actual_output_tokens": 73, "cached_tokens": 101776, "effective_input_length": 101794, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 101794, "latency_s": 0.8681871289736591, "output_length": 73, "proxy_request_id": "1253804:28:1685257:1032", "request_id": "1253804:28:1685257:1032", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1253804", "t_dispatch_unix": 1779822217.0223045, "t_finish_unix": 1779822217.8904912, "t_first_token_unix": 1779822217.1932406, "tpot_s": 0.009680473347543739, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388], "trace_timestamp_s": 1530.0770000000002, "ttft_s": 0.17093324899906293, "turn_id": 28} +{"actual_output_tokens": 199, "cached_tokens": 43136, "effective_input_length": 43407, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43407, "latency_s": 1.5952209740062244, "output_length": 199, "proxy_request_id": "1399948:51:1686626:1033", "request_id": "1399948:51:1686626:1033", "request_type": "coder", "requested_output_tokens": 199, "session_id": "1399948", "t_dispatch_unix": 1779822221.960965, "t_finish_unix": 1779822223.556186, "t_first_token_unix": 1779822222.1353216, "tpot_s": 0.007174649020372372, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913], "trace_timestamp_s": 1535.0170000000007, "ttft_s": 0.1743540859897621, "turn_id": 51} +{"actual_output_tokens": 101, "cached_tokens": 101856, "effective_input_length": 102067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102067, "latency_s": 1.3373923170147464, "output_length": 101, "proxy_request_id": "1253804:29:1688398:1034", "request_id": "1253804:29:1688398:1034", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1253804", "t_dispatch_unix": 1779822228.009383, "t_finish_unix": 1779822229.3467748, "t_first_token_unix": 1779822228.3523612, "tpot_s": 0.009941404269775377, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16571621], "trace_timestamp_s": 1541.063, "ttft_s": 0.3429757970152423, "turn_id": 29} +{"actual_output_tokens": 105, "cached_tokens": 43600, "effective_input_length": 43673, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43673, "latency_s": 0.8466987460269593, "output_length": 105, "proxy_request_id": "1399948:52:1689144:1035", "request_id": "1399948:52:1689144:1035", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1399948", "t_dispatch_unix": 1779822230.5972338, "t_finish_unix": 1779822231.4439316, "t_first_token_unix": 1779822230.7215981, "tpot_s": 0.00694271024034466, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16578337], "trace_timestamp_s": 1543.656, "ttft_s": 0.12436303100548685, "turn_id": 52} +{"actual_output_tokens": 144, "cached_tokens": 132688, "effective_input_length": 132823, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 132823, "latency_s": 2.22581342398189, "output_length": 144, "proxy_request_id": "1356885:9:1689871:1036", "request_id": "1356885:9:1689871:1036", "request_type": "coder", "requested_output_tokens": 144, "session_id": "1356885", "t_dispatch_unix": 1779822232.965748, "t_finish_unix": 1779822235.191561, "t_first_token_unix": 1779822233.292075, "tpot_s": 0.01328113458731531, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16586340], "trace_timestamp_s": 1546.0200000000004, "ttft_s": 0.32632450200617313, "turn_id": 9} +{"actual_output_tokens": 77, "cached_tokens": 102160, "effective_input_length": 102214, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102214, "latency_s": 1.1547259719809517, "output_length": 77, "proxy_request_id": "1253804:30:1690362:1037", "request_id": "1253804:30:1690362:1037", "request_type": "coder", "requested_output_tokens": 77, "session_id": "1253804", "t_dispatch_unix": 1779822234.620036, "t_finish_unix": 1779822235.7747614, "t_first_token_unix": 1779822234.8634012, "tpot_s": 0.011988175776327568, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691], "trace_timestamp_s": 1547.679, "ttft_s": 0.24336349399527535, "turn_id": 30} +{"actual_output_tokens": 42, "cached_tokens": 102288, "effective_input_length": 102322, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102322, "latency_s": 0.5484102129703388, "output_length": 42, "proxy_request_id": "1253804:31:1691981:1038", "request_id": "1253804:31:1691981:1038", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1253804", "t_dispatch_unix": 1779822240.1966052, "t_finish_unix": 1779822240.7450154, "t_first_token_unix": 1779822240.3781903, "tpot_s": 0.008941307537564327, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691], "trace_timestamp_s": 1553.2520000000004, "ttft_s": 0.18158289894927293, "turn_id": 31} +{"actual_output_tokens": 188, "cached_tokens": 43776, "effective_input_length": 43938, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 43938, "latency_s": 1.5243605360155925, "output_length": 188, "proxy_request_id": "1399948:53:1692115:1039", "request_id": "1399948:53:1692115:1039", "request_type": "coder", "requested_output_tokens": 188, "session_id": "1399948", "t_dispatch_unix": 1779822240.7184277, "t_finish_unix": 1779822242.2427883, "t_first_token_unix": 1779822240.8903515, "tpot_s": 0.00723055377540323, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324], "trace_timestamp_s": 1553.7790000000005, "ttft_s": 0.1719218019861728, "turn_id": 53} +{"actual_output_tokens": 79, "cached_tokens": 102352, "effective_input_length": 102509, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102509, "latency_s": 1.102952464018017, "output_length": 79, "proxy_request_id": "1253804:32:1693715:1040", "request_id": "1253804:32:1693715:1040", "request_type": "coder", "requested_output_tokens": 79, "session_id": "1253804", "t_dispatch_unix": 1779822246.2841318, "t_finish_unix": 1779822247.3870838, "t_first_token_unix": 1779822246.6271226, "tpot_s": 0.009739503230845842, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16624791], "trace_timestamp_s": 1559.3360000000002, "ttft_s": 0.34298781701363623, "turn_id": 32} +{"actual_output_tokens": 42, "cached_tokens": 44112, "effective_input_length": 44182, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 44182, "latency_s": 0.391269615967758, "output_length": 42, "proxy_request_id": "1399948:54:1694570:1041", "request_id": "1399948:54:1694570:1041", "request_type": "coder", "requested_output_tokens": 42, "session_id": "1399948", "t_dispatch_unix": 1779822249.3773725, "t_finish_unix": 1779822249.7686417, "t_first_token_unix": 1779822249.4992592, "tpot_s": 0.006563572366381201, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16632677], "trace_timestamp_s": 1562.4360000000006, "ttft_s": 0.12188447098014876, "turn_id": 54} +{"actual_output_tokens": 53, "cached_tokens": 102576, "effective_input_length": 102632, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102632, "latency_s": 0.7043642890057527, "output_length": 53, "proxy_request_id": "1253804:33:1695393:1042", "request_id": "1253804:33:1695393:1042", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1253804", "t_dispatch_unix": 1779822252.0346737, "t_finish_unix": 1779822252.7390378, "t_first_token_unix": 1779822252.257335, "tpot_s": 0.009258011980609108, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284], "trace_timestamp_s": 1565.0910000000003, "ttft_s": 0.2226593159721233, "turn_id": 33} +{"actual_output_tokens": 323, "cached_tokens": 102672, "effective_input_length": 102792, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 102792, "latency_s": 3.6443469329969957, "output_length": 323, "proxy_request_id": "1253804:34:1697569:1043", "request_id": "1253804:34:1697569:1043", "request_type": "coder", "requested_output_tokens": 323, "session_id": "1253804", "t_dispatch_unix": 1779822259.871068, "t_finish_unix": 1779822263.5154142, "t_first_token_unix": 1779822260.1518884, "tpot_s": 0.010444807757656755, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284], "trace_timestamp_s": 1572.9230000000007, "ttft_s": 0.28081764798844233, "turn_id": 34} +{"actual_output_tokens": 35, "cached_tokens": 103104, "effective_input_length": 103349, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103349, "latency_s": 0.638315414020326, "output_length": 35, "proxy_request_id": "1253804:35:1701250:1044", "request_id": "1253804:35:1701250:1044", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779822272.4143972, "t_finish_unix": 1779822273.0527122, "t_first_token_unix": 1779822272.7634609, "tpot_s": 0.008498315824373789, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908], "trace_timestamp_s": 1585.4650000000001, "ttft_s": 0.34906128799775615, "turn_id": 35} +{"actual_output_tokens": 48, "cached_tokens": 103376, "effective_input_length": 103400, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103400, "latency_s": 0.6062829699949361, "output_length": 48, "proxy_request_id": "1253804:36:1702697:1045", "request_id": "1253804:36:1702697:1045", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1253804", "t_dispatch_unix": 1779822277.5654871, "t_finish_unix": 1779822278.17177, "t_first_token_unix": 1779822277.742509, "tpot_s": 0.009127205574607595, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908], "trace_timestamp_s": 1590.6190000000006, "ttft_s": 0.1770177249563858, "turn_id": 36} +{"actual_output_tokens": 226, "cached_tokens": 44208, "effective_input_length": 45284, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45284, "latency_s": 2.10562619601842, "output_length": 226, "proxy_request_id": "1399948:55:1704272:1047", "request_id": "1399948:55:1704272:1047", "request_type": "coder", "requested_output_tokens": 226, "session_id": "1399948", "t_dispatch_unix": 1779822282.8417816, "t_finish_unix": 1779822284.9474077, "t_first_token_unix": 1779822283.2993135, "tpot_s": 0.007323490542152689, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16728012], "trace_timestamp_s": 1595.9010000000007, "ttft_s": 0.45752960100071505, "turn_id": 55} +{"actual_output_tokens": 126, "cached_tokens": 132960, "effective_input_length": 133014, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 133014, "latency_s": 2.527320674038492, "output_length": 126, "proxy_request_id": "1356885:10:1706624:1048", "request_id": "1356885:10:1706624:1048", "request_type": "coder", "requested_output_tokens": 126, "session_id": "1356885", "t_dispatch_unix": 1779822291.1576595, "t_finish_unix": 1779822293.68498, "t_first_token_unix": 1779822291.4265378, "tpot_s": 0.018064499496016653, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16751243], "trace_timestamp_s": 1604.2150000000001, "ttft_s": 0.26887609501136467, "turn_id": 10} +{"actual_output_tokens": 123, "cached_tokens": 45504, "effective_input_length": 45571, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45571, "latency_s": 1.0113308019936085, "output_length": 123, "proxy_request_id": "1399948:56:1708284:1049", "request_id": "1399948:56:1708284:1049", "request_type": "coder", "requested_output_tokens": 123, "session_id": "1399948", "t_dispatch_unix": 1779822296.879143, "t_finish_unix": 1779822297.890474, "t_first_token_unix": 1779822297.0082424, "tpot_s": 0.0072290465000971055, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16766349], "trace_timestamp_s": 1609.9390000000003, "ttft_s": 0.1290975229931064, "turn_id": 56} +{"actual_output_tokens": 1433, "cached_tokens": 103440, "effective_input_length": 103471, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 103471, "latency_s": 16.635276341985445, "output_length": 1433, "proxy_request_id": "1253804:37:1704071:1046", "request_id": "1253804:37:1704071:1046", "request_type": "coder", "requested_output_tokens": 1433, "session_id": "1253804", "t_dispatch_unix": 1779822282.0392034, "t_finish_unix": 1779822298.674479, "t_first_token_unix": 1779822282.2135258, "tpot_s": 0.01149488746086311, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16725569], "trace_timestamp_s": 1595.0930000000008, "ttft_s": 0.17432021902641281, "turn_id": 37} +{"actual_output_tokens": 336, "cached_tokens": 45680, "effective_input_length": 45756, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 45756, "latency_s": 2.576815648993943, "output_length": 336, "proxy_request_id": "1399948:57:1711464:1050", "request_id": "1399948:57:1711464:1050", "request_type": "coder", "requested_output_tokens": 336, "session_id": "1399948", "t_dispatch_unix": 1779822307.673979, "t_finish_unix": 1779822310.2507942, "t_first_token_unix": 1779822307.802479, "tpot_s": 0.007307597561287624, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16797835], "trace_timestamp_s": 1620.7250000000004, "ttft_s": 0.12849783297860995, "turn_id": 57} +{"actual_output_tokens": 35, "cached_tokens": 104896, "effective_input_length": 104953, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 104953, "latency_s": 0.5250291689881124, "output_length": 35, "proxy_request_id": "1253804:38:1712824:1051", "request_id": "1253804:38:1712824:1051", "request_type": "coder", "requested_output_tokens": 35, "session_id": "1253804", "t_dispatch_unix": 1779822312.4915738, "t_finish_unix": 1779822313.0166032, "t_first_token_unix": 1779822312.7223096, "tpot_s": 0.00864831467590514, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701], "trace_timestamp_s": 1625.5480000000007, "ttft_s": 0.23073318699607626, "turn_id": 38} +{"actual_output_tokens": 59, "cached_tokens": 104976, "effective_input_length": 105004, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105004, "latency_s": 0.7300320359645411, "output_length": 59, "proxy_request_id": "1253804:39:1714767:1052", "request_id": "1253804:39:1714767:1052", "request_type": "coder", "requested_output_tokens": 59, "session_id": "1253804", "t_dispatch_unix": 1779822319.0770097, "t_finish_unix": 1779822319.807042, "t_first_token_unix": 1779822319.252663, "tpot_s": 0.009553543138438193, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16829979], "trace_timestamp_s": 1632.1290000000008, "ttft_s": 0.17565034196013585, "turn_id": 39} +{"actual_output_tokens": 435, "cached_tokens": 105056, "effective_input_length": 105156, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105156, "latency_s": 4.897658917994704, "output_length": 435, "proxy_request_id": "1253804:40:1716790:1053", "request_id": "1253804:40:1716790:1053", "request_type": "coder", "requested_output_tokens": 435, "session_id": "1253804", "t_dispatch_unix": 1779822325.7821965, "t_finish_unix": 1779822330.6798553, "t_first_token_unix": 1779822326.065017, "tpot_s": 0.010632532506844261, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093], "trace_timestamp_s": 1638.8400000000001, "ttft_s": 0.2828184299869463, "turn_id": 40} +{"actual_output_tokens": 278, "cached_tokens": 45120, "effective_input_length": 47861, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47861, "latency_s": 2.9857576090143993, "output_length": 278, "proxy_request_id": "1305906:4:1718131:1054", "request_id": "1305906:4:1718131:1054", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1305906", "t_dispatch_unix": 1779822330.2420905, "t_finish_unix": 1779822333.227848, "t_first_token_unix": 1779822331.1781282, "tpot_s": 0.007398732101111017, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16863272], "trace_timestamp_s": 1643.3010000000004, "ttft_s": 0.9360348979826085, "turn_id": 4} +{"actual_output_tokens": 92, "cached_tokens": 48128, "effective_input_length": 49817, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49817, "latency_s": 1.3340122789959423, "output_length": 92, "proxy_request_id": "1305906:5:1514292:934", "request_id": "1305906:5:1514292:934", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1305906", "t_dispatch_unix": 1779822333.2320056, "t_finish_unix": 1779822334.566018, "t_first_token_unix": 1779822333.9126446, "tpot_s": 0.007177104780087145, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 14922071, 14922072], "trace_timestamp_s": 956.3870000000006, "ttft_s": 0.6806360949994996, "turn_id": 5} +{"actual_output_tokens": 233, "cached_tokens": 28784, "effective_input_length": 37173, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37173, "latency_s": 3.630294668022543, "output_length": 233, "proxy_request_id": "1340290:13:1718889:1055", "request_id": "1340290:13:1718889:1055", "request_type": "coder", "requested_output_tokens": 233, "session_id": "1340290", "t_dispatch_unix": 1779822332.8768404, "t_finish_unix": 1779822336.5071347, "t_first_token_unix": 1779822334.9100842, "tpot_s": 0.00688260099133035, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832], "trace_timestamp_s": 1645.9370000000008, "ttft_s": 2.0332416830351576, "turn_id": 13} +{"actual_output_tokens": 66, "cached_tokens": 105584, "effective_input_length": 105638, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105638, "latency_s": 0.8595641939900815, "output_length": 66, "proxy_request_id": "1253804:41:1721979:1057", "request_id": "1253804:41:1721979:1057", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1253804", "t_dispatch_unix": 1779822343.463355, "t_finish_unix": 1779822344.3229191, "t_first_token_unix": 1779822343.6965241, "tpot_s": 0.009632892738311336, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16901523], "trace_timestamp_s": 1656.522, "ttft_s": 0.23316684301244095, "turn_id": 41} +{"actual_output_tokens": 254, "cached_tokens": 37392, "effective_input_length": 37438, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37438, "latency_s": 1.837315060023684, "output_length": 254, "proxy_request_id": "1340290:14:1721731:1056", "request_id": "1340290:14:1721731:1056", "request_type": "coder", "requested_output_tokens": 254, "session_id": "1340290", "t_dispatch_unix": 1779822342.5960152, "t_finish_unix": 1779822344.4333298, "t_first_token_unix": 1779822342.6933737, "tpot_s": 0.006876327889316196, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16899322], "trace_timestamp_s": 1655.656, "ttft_s": 0.09735655301483348, "turn_id": 14} +{"actual_output_tokens": 78, "cached_tokens": 105696, "effective_input_length": 105715, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105715, "latency_s": 0.936199661984574, "output_length": 78, "proxy_request_id": "1253804:42:1724453:1058", "request_id": "1253804:42:1724453:1058", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1253804", "t_dispatch_unix": 1779822351.965274, "t_finish_unix": 1779822352.9014738, "t_first_token_unix": 1779822352.1429224, "tpot_s": 0.009848126753795795, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815], "trace_timestamp_s": 1665.0170000000007, "ttft_s": 0.17764579597860575, "turn_id": 42} +{"actual_output_tokens": 70, "cached_tokens": 105792, "effective_input_length": 105845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 105845, "latency_s": 0.9013395070214756, "output_length": 70, "proxy_request_id": "1253804:43:1726322:1060", "request_id": "1253804:43:1726322:1060", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1253804", "t_dispatch_unix": 1779822358.0368965, "t_finish_unix": 1779822358.9382362, "t_first_token_unix": 1779822358.2655675, "tpot_s": 0.009744834304159589, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815], "trace_timestamp_s": 1671.0960000000005, "ttft_s": 0.22866914101177827, "turn_id": 43} +{"actual_output_tokens": 22, "cached_tokens": 46080, "effective_input_length": 46886, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46886, "latency_s": 0.554011546948459, "output_length": 22, "proxy_request_id": "1399948:58:1726693:1061", "request_id": "1399948:58:1726693:1061", "request_type": "coder", "requested_output_tokens": 22, "session_id": "1399948", "t_dispatch_unix": 1779822359.2637117, "t_finish_unix": 1779822359.8177238, "t_first_token_unix": 1779822359.6367352, "tpot_s": 0.008597222239976483, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 16945463], "trace_timestamp_s": 1672.3230000000003, "ttft_s": 0.3730209259665571, "turn_id": 58} +{"actual_output_tokens": 24, "cached_tokens": 46896, "effective_input_length": 46927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 46927, "latency_s": 0.3089797109714709, "output_length": 24, "proxy_request_id": "1399948:59:1728305:1062", "request_id": "1399948:59:1728305:1062", "request_type": "coder", "requested_output_tokens": 24, "session_id": "1399948", "t_dispatch_unix": 1779822364.5560203, "t_finish_unix": 1779822364.8649998, "t_first_token_unix": 1779822364.667662, "tpot_s": 0.00856914417312035, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 16960933], "trace_timestamp_s": 1677.616, "ttft_s": 0.11164013697998598, "turn_id": 59} +{"actual_output_tokens": 101, "cached_tokens": 105904, "effective_input_length": 106070, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106070, "latency_s": 1.3732935380539857, "output_length": 101, "proxy_request_id": "1253804:44:1728625:1063", "request_id": "1253804:44:1728625:1063", "request_type": "coder", "requested_output_tokens": 101, "session_id": "1253804", "t_dispatch_unix": 1779822365.7408674, "t_finish_unix": 1779822367.114161, "t_first_token_unix": 1779822366.1235247, "tpot_s": 0.009903936150367372, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 16964762], "trace_timestamp_s": 1678.799, "ttft_s": 0.3826549799996428, "turn_id": 44} +{"actual_output_tokens": 2444, "cached_tokens": 37680, "effective_input_length": 37724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 37724, "latency_s": 17.911560520005878, "output_length": 2444, "proxy_request_id": "1340290:15:1725612:1059", "request_id": "1340290:15:1725612:1059", "request_type": "coder", "requested_output_tokens": 2444, "session_id": "1340290", "t_dispatch_unix": 1779822355.7821462, "t_finish_unix": 1779822373.6937068, "t_first_token_unix": 1779822355.8722153, "tpot_s": 0.007294714213669151, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638], "trace_timestamp_s": 1668.8400000000001, "ttft_s": 0.09006625897018239, "turn_id": 15} +{"actual_output_tokens": 40, "cached_tokens": 106160, "effective_input_length": 106394, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106394, "latency_s": 0.7073514900403097, "output_length": 40, "proxy_request_id": "1253804:45:1732408:1064", "request_id": "1253804:45:1732408:1064", "request_type": "coder", "requested_output_tokens": 40, "session_id": "1253804", "t_dispatch_unix": 1779822378.7077599, "t_finish_unix": 1779822379.4151108, "t_first_token_unix": 1779822379.0634995, "tpot_s": 0.009008648615772238, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607], "trace_timestamp_s": 1691.7610000000004, "ttft_s": 0.35573744401335716, "turn_id": 45} +{"actual_output_tokens": 54, "cached_tokens": 46944, "effective_input_length": 47074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47074, "latency_s": 0.49932322301901877, "output_length": 54, "proxy_request_id": "1399948:60:1732843:1065", "request_id": "1399948:60:1732843:1065", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1399948", "t_dispatch_unix": 1779822380.3088574, "t_finish_unix": 1779822380.8081799, "t_first_token_unix": 1779822380.4476132, "tpot_s": 0.00679857292506879, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902], "trace_timestamp_s": 1693.3680000000004, "ttft_s": 0.13875405897852033, "turn_id": 60} +{"actual_output_tokens": 71, "cached_tokens": 106432, "effective_input_length": 106443, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 106443, "latency_s": 0.857391819008626, "output_length": 71, "proxy_request_id": "1253804:46:1733935:1066", "request_id": "1253804:46:1733935:1066", "request_type": "coder", "requested_output_tokens": 71, "session_id": "1253804", "t_dispatch_unix": 1779822383.7998304, "t_finish_unix": 1779822384.6572216, "t_first_token_unix": 1779822383.96677, "tpot_s": 0.009859367543166237, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607], "trace_timestamp_s": 1696.8550000000005, "ttft_s": 0.16693786502582952, "turn_id": 46} +{"actual_output_tokens": 207, "cached_tokens": 47120, "effective_input_length": 47205, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 47205, "latency_s": 1.6336320380214602, "output_length": 207, "proxy_request_id": "1399948:61:1735933:1067", "request_id": "1399948:61:1735933:1067", "request_type": "coder", "requested_output_tokens": 207, "session_id": "1399948", "t_dispatch_unix": 1779822390.5054529, "t_finish_unix": 1779822392.1390848, "t_first_token_unix": 1779822390.6232607, "tpot_s": 0.007357154315613319, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17034825], "trace_timestamp_s": 1703.5600000000004, "ttft_s": 0.11780542298220098, "turn_id": 61} +{"actual_output_tokens": 44, "cached_tokens": 106512, "effective_input_length": 107137, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 107137, "latency_s": 1.143306957965251, "output_length": 44, "proxy_request_id": "1253804:47:1736337:1068", "request_id": "1253804:47:1736337:1068", "request_type": "coder", "requested_output_tokens": 44, "session_id": "1253804", "t_dispatch_unix": 1779822391.7756512, "t_finish_unix": 1779822392.9189584, "t_first_token_unix": 1779822392.5248127, "tpot_s": 0.009160392603642025, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17038931], "trace_timestamp_s": 1704.8340000000007, "ttft_s": 0.7491588389966637, "turn_id": 47} +{"actual_output_tokens": 45, "cached_tokens": 107168, "effective_input_length": 108145, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 108145, "latency_s": 1.3560077550355345, "output_length": 45, "proxy_request_id": "1253804:48:1737694:1069", "request_id": "1253804:48:1737694:1069", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822396.211472, "t_finish_unix": 1779822397.5674796, "t_first_token_unix": 1779822397.1612763, "tpot_s": 0.009226226886808448, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17053260], "trace_timestamp_s": 1709.268, "ttft_s": 0.9498022409970872, "turn_id": 48} +{"actual_output_tokens": 45, "cached_tokens": 108176, "effective_input_length": 109454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 109454, "latency_s": 1.5693084329832345, "output_length": 45, "proxy_request_id": "1253804:49:1739030:1070", "request_id": "1253804:49:1739030:1070", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822400.5972178, "t_finish_unix": 1779822402.1665263, "t_first_token_unix": 1779822401.757413, "tpot_s": 0.009292235955151475, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558], "trace_timestamp_s": 1713.652, "ttft_s": 1.160189071961213, "turn_id": 49} +{"actual_output_tokens": 45, "cached_tokens": 109488, "effective_input_length": 110854, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 110854, "latency_s": 1.5953600269858725, "output_length": 45, "proxy_request_id": "1253804:50:1741670:1071", "request_id": "1253804:50:1741670:1071", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822409.5766137, "t_finish_unix": 1779822411.1719737, "t_first_token_unix": 1779822410.7572162, "tpot_s": 0.009420603295438923, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030], "trace_timestamp_s": 1722.6290000000008, "ttft_s": 1.1805996900075115, "turn_id": 50} +{"actual_output_tokens": 45, "cached_tokens": 110896, "effective_input_length": 111661, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111661, "latency_s": 1.193727589037735, "output_length": 45, "proxy_request_id": "1253804:51:1744514:1072", "request_id": "1253804:51:1744514:1072", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1253804", "t_dispatch_unix": 1779822419.0019052, "t_finish_unix": 1779822420.1956327, "t_first_token_unix": 1779822419.785481, "tpot_s": 0.009314402089909312, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17117868], "trace_timestamp_s": 1732.054, "ttft_s": 0.7835728950449266, "turn_id": 51} +{"actual_output_tokens": 105, "cached_tokens": 40160, "effective_input_length": 40200, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40200, "latency_s": 0.8044261579634622, "output_length": 105, "proxy_request_id": "1340290:16:1745847:1073", "request_id": "1340290:16:1745847:1073", "request_type": "coder", "requested_output_tokens": 105, "session_id": "1340290", "t_dispatch_unix": 1779822423.6171353, "t_finish_unix": 1779822424.421561, "t_first_token_unix": 1779822423.7080574, "tpot_s": 0.006858140201634692, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 17129420], "trace_timestamp_s": 1736.6730000000007, "ttft_s": 0.09091951698064804, "turn_id": 16} +{"actual_output_tokens": 76, "cached_tokens": 111696, "effective_input_length": 111724, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111724, "latency_s": 0.945529118005652, "output_length": 76, "proxy_request_id": "1253804:52:1746191:1074", "request_id": "1253804:52:1746191:1074", "request_type": "coder", "requested_output_tokens": 76, "session_id": "1253804", "t_dispatch_unix": 1779822424.6415844, "t_finish_unix": 1779822425.5871131, "t_first_token_unix": 1779822424.824468, "tpot_s": 0.010165027053250621, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17132107], "trace_timestamp_s": 1737.7000000000007, "ttft_s": 0.18288136896444485, "turn_id": 52} +{"actual_output_tokens": 50, "cached_tokens": 111792, "effective_input_length": 111811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111811, "latency_s": 0.6533258239505813, "output_length": 50, "proxy_request_id": "1253804:53:1748377:1075", "request_id": "1253804:53:1748377:1075", "request_type": "coder", "requested_output_tokens": 50, "session_id": "1253804", "t_dispatch_unix": 1779822431.9802327, "t_finish_unix": 1779822432.6335585, "t_first_token_unix": 1779822432.164196, "tpot_s": 0.009573315836878836, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17153201], "trace_timestamp_s": 1745.0320000000002, "ttft_s": 0.18396110995672643, "turn_id": 53} +{"actual_output_tokens": 78, "cached_tokens": 47408, "effective_input_length": 48212, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48212, "latency_s": 0.9189062580117024, "output_length": 78, "proxy_request_id": "1399948:62:1749028:1076", "request_id": "1399948:62:1749028:1076", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1399948", "t_dispatch_unix": 1779822434.1479604, "t_finish_unix": 1779822435.0668664, "t_first_token_unix": 1779822434.524415, "tpot_s": 0.0070416182982614385, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17159596], "trace_timestamp_s": 1747.2060000000001, "ttft_s": 0.3764522320125252, "turn_id": 62} +{"actual_output_tokens": 534, "cached_tokens": 111856, "effective_input_length": 112074, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112074, "latency_s": 6.25359291798668, "output_length": 534, "proxy_request_id": "1253804:54:1750056:1077", "request_id": "1253804:54:1750056:1077", "request_type": "coder", "requested_output_tokens": 534, "session_id": "1253804", "t_dispatch_unix": 1779822437.5723836, "t_finish_unix": 1779822443.8259766, "t_first_token_unix": 1779822437.9455726, "tpot_s": 0.011032192632237075, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 12480111, 12480112, 12480113, 12480114, 12524934, 12524935, 12524936, 12524937, 12524938, 12524939, 12524940, 12524941, 12524942, 12524943, 12524944, 12524945, 12524946, 12524947, 12524948, 12524949, 12524950, 12524951, 12524952, 12524953, 12524954, 12524955, 12524956, 12524957, 12524958, 12524959, 12524960, 12524961, 12524962, 12524963, 12524964, 12524965, 12524966, 12524967, 12524968, 12549984, 12549985, 12549986, 12549987, 12566183, 12723961, 12723962, 12723963, 12723964, 12723965, 6549261, 13100550, 13100551, 13100552, 13100553, 13100554, 13100555, 13100556, 15040167, 15040168, 15040169, 15040170, 15040171, 15040172, 15040173, 15040174, 15040175, 15040176, 15040177, 15040178, 15040179, 15040180, 15040181, 15040182, 15040183, 15040184, 15040185, 15040186, 15040187, 15040188, 15040189, 15040190, 15040191, 15040192, 15040193, 15040194, 15040195, 15040196, 15040197, 15040198, 15040199, 15040200, 15040201, 15040202, 15040203, 15040204, 15040205, 15040206, 15040207, 15040208, 15040209, 15040210, 15040211, 15040212, 15040213, 15040214, 15040215, 15182010, 15182011, 15182012, 15786877, 15786878, 15786879, 15845080, 15941810, 15986053, 16004239, 16015597, 16048428, 16103467, 16206628, 16206629, 16206630, 16220456, 16220457, 16291090, 16291091, 16320784, 16519382, 16519383, 16519384, 16519385, 16519386, 16519387, 16519388, 16591691, 16640284, 16697908, 16811699, 16811700, 16811701, 16850093, 16923815, 17002607, 17038930, 17053258, 17053259, 17065556, 17065557, 17065558, 17091028, 17091029, 17091030, 17117867, 17153201], "trace_timestamp_s": 1750.6280000000006, "ttft_s": 0.37318658200092614, "turn_id": 54} +{"actual_output_tokens": 19, "cached_tokens": 48288, "effective_input_length": 48636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48636, "latency_s": 0.3775661640102044, "output_length": 19, "proxy_request_id": "1399948:63:1753316:1079", "request_id": "1399948:63:1753316:1079", "request_type": "coder", "requested_output_tokens": 19, "session_id": "1399948", "t_dispatch_unix": 1779822448.4431229, "t_finish_unix": 1779822448.820689, "t_first_token_unix": 1779822448.7209623, "tpot_s": 0.005526291222647867, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857], "trace_timestamp_s": 1761.5030000000006, "ttft_s": 0.27783772902330384, "turn_id": 63} +{"actual_output_tokens": 171, "cached_tokens": 48640, "effective_input_length": 48693, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48693, "latency_s": 1.3902612819802016, "output_length": 171, "proxy_request_id": "1399948:64:1754453:1080", "request_id": "1399948:64:1754453:1080", "request_type": "coder", "requested_output_tokens": 171, "session_id": "1399948", "t_dispatch_unix": 1779822452.3563318, "t_finish_unix": 1779822453.7465932, "t_first_token_unix": 1779822452.509975, "tpot_s": 0.007272420876645757, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17212612], "trace_timestamp_s": 1765.4160000000002, "ttft_s": 0.15363865596009418, "turn_id": 64} +{"actual_output_tokens": 1391, "cached_tokens": 133136, "effective_input_length": 133552, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 133552, "latency_s": 17.930795097956434, "output_length": 1391, "proxy_request_id": "1356885:11:1753167:1078", "request_id": "1356885:11:1753167:1078", "request_type": "coder", "requested_output_tokens": 1391, "session_id": "1356885", "t_dispatch_unix": 1779822448.0104654, "t_finish_unix": 1779822465.9412599, "t_first_token_unix": 1779822448.694908, "tpot_s": 0.012407273432388968, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 15107124, 15462784, 16351834, 16351835, 16751243, 17201151], "trace_timestamp_s": 1761.0650000000005, "ttft_s": 0.6844401949783787, "turn_id": 11} +{"actual_output_tokens": 725, "cached_tokens": 48848, "effective_input_length": 49220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49220, "latency_s": 5.801198236993514, "output_length": 725, "proxy_request_id": "1399948:65:1759200:1081", "request_id": "1399948:65:1759200:1081", "request_type": "coder", "requested_output_tokens": 725, "session_id": "1399948", "t_dispatch_unix": 1779822468.854155, "t_finish_unix": 1779822474.655353, "t_first_token_unix": 1779822469.137228, "tpot_s": 0.0076213908397518, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17258496], "trace_timestamp_s": 1781.9100000000008, "ttft_s": 0.2830702899955213, "turn_id": 65} +{"actual_output_tokens": 140, "cached_tokens": 49504, "effective_input_length": 49716, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49716, "latency_s": 1.2184679040219635, "output_length": 140, "proxy_request_id": "1277428:14:1767578:1082", "request_id": "1277428:14:1767578:1082", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1277428", "t_dispatch_unix": 1779822497.7000318, "t_finish_unix": 1779822498.9184995, "t_first_token_unix": 1779822497.8939335, "tpot_s": 0.007368996050527064, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17338220], "trace_timestamp_s": 1810.7580000000007, "ttft_s": 0.19389916100772098, "turn_id": 14} +{"actual_output_tokens": 45, "cached_tokens": 49840, "effective_input_length": 49925, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49925, "latency_s": 0.4283178329933435, "output_length": 45, "proxy_request_id": "1277428:14:1770237:1083", "request_id": "1277428:14:1770237:1083", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779822507.060277, "t_finish_unix": 1779822507.4885945, "t_first_token_unix": 1779822507.186857, "tpot_s": 0.006851278318208642, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17363127], "trace_timestamp_s": 1820.1130000000003, "ttft_s": 0.12657760200090706, "turn_id": 14} +{"actual_output_tokens": 450, "cached_tokens": 49968, "effective_input_length": 51398, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51398, "latency_s": 4.056651282007806, "output_length": 450, "proxy_request_id": "1277428:15:1771467:1084", "request_id": "1277428:15:1771467:1084", "request_type": "coder", "requested_output_tokens": 450, "session_id": "1277428", "t_dispatch_unix": 1779822511.130463, "t_finish_unix": 1779822515.187114, "t_first_token_unix": 1779822511.7268314, "tpot_s": 0.007705942761720281, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17375444], "trace_timestamp_s": 1824.1870000000008, "ttft_s": 0.5963658859836869, "turn_id": 15} +{"actual_output_tokens": 382, "cached_tokens": 49936, "effective_input_length": 51012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51012, "latency_s": 3.423867627978325, "output_length": 382, "proxy_request_id": "1399948:66:1772336:1085", "request_id": "1399948:66:1772336:1085", "request_type": "coder", "requested_output_tokens": 382, "session_id": "1399948", "t_dispatch_unix": 1779822514.080137, "t_finish_unix": 1779822517.504004, "t_first_token_unix": 1779822514.5866184, "tpot_s": 0.007656503650860915, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17382969], "trace_timestamp_s": 1827.1390000000001, "ttft_s": 0.5064795030048117, "turn_id": 66} +{"actual_output_tokens": 555, "cached_tokens": 51392, "effective_input_length": 52331, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52331, "latency_s": 4.782773946993984, "output_length": 555, "proxy_request_id": "1399948:67:1777074:1086", "request_id": "1399948:67:1777074:1086", "request_type": "coder", "requested_output_tokens": 555, "session_id": "1399948", "t_dispatch_unix": 1779822530.1511407, "t_finish_unix": 1779822534.9339144, "t_first_token_unix": 1779822530.6512723, "tpot_s": 0.007729846037905798, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17430076], "trace_timestamp_s": 1843.1980000000003, "ttft_s": 0.5001295189722441, "turn_id": 67} +{"actual_output_tokens": 544, "cached_tokens": 52880, "effective_input_length": 53289, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53289, "latency_s": 4.571910118043888, "output_length": 544, "proxy_request_id": "1399948:68:1784799:1087", "request_id": "1399948:68:1784799:1087", "request_type": "coder", "requested_output_tokens": 544, "session_id": "1399948", "t_dispatch_unix": 1779822556.642124, "t_finish_unix": 1779822561.2140338, "t_first_token_unix": 1779822556.943664, "tpot_s": 0.007863876086524233, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17500500], "trace_timestamp_s": 1869.6820000000007, "ttft_s": 0.30153731105383486, "turn_id": 68} +{"actual_output_tokens": 81, "cached_tokens": 51840, "effective_input_length": 52754, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52754, "latency_s": 0.9948056470020674, "output_length": 81, "proxy_request_id": "1277428:16:1787662:1088", "request_id": "1277428:16:1787662:1088", "request_type": "coder", "requested_output_tokens": 81, "session_id": "1277428", "t_dispatch_unix": 1779822567.0832515, "t_finish_unix": 1779822568.0780573, "t_first_token_unix": 1779822567.4966593, "tpot_s": 0.00726348263779073, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 303055], "trace_timestamp_s": 1880.138, "ttft_s": 0.41340528696309775, "turn_id": 16} +{"actual_output_tokens": 70, "cached_tokens": 49904, "effective_input_length": 52461, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52461, "latency_s": 1.4958681659772992, "output_length": 70, "proxy_request_id": "1305906:5:1788459:1089", "request_id": "1305906:5:1788459:1089", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1305906", "t_dispatch_unix": 1779822569.6204112, "t_finish_unix": 1779822571.1162784, "t_first_token_unix": 1779822570.6227863, "tpot_s": 0.007148334420745032, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17479967], "trace_timestamp_s": 1882.6760000000004, "ttft_s": 1.0023731219698675, "turn_id": 5} +{"actual_output_tokens": 492, "cached_tokens": 53824, "effective_input_length": 54141, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54141, "latency_s": 4.153351503016893, "output_length": 492, "proxy_request_id": "1399948:69:1790968:1090", "request_id": "1399948:69:1790968:1090", "request_type": "coder", "requested_output_tokens": 492, "session_id": "1399948", "t_dispatch_unix": 1779822578.214067, "t_finish_unix": 1779822582.3674185, "t_first_token_unix": 1779822578.5159364, "tpot_s": 0.007843573729089384, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437], "trace_timestamp_s": 1891.2740000000003, "ttft_s": 0.30186776601476595, "turn_id": 69} +{"actual_output_tokens": 1904, "cached_tokens": 51248, "effective_input_length": 51255, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 51255, "latency_s": 14.940467801992781, "output_length": 1904, "proxy_request_id": "1305906:6:1529600:945", "request_id": "1305906:6:1529600:945", "request_type": "coder", "requested_output_tokens": 1904, "session_id": "1305906", "t_dispatch_unix": 1779822571.1191874, "t_finish_unix": 1779822586.0596552, "t_first_token_unix": 1779822571.2075007, "tpot_s": 0.007804452429856631, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 15068951, 15068952, 15068953, 15068954, 15068955], "trace_timestamp_s": 1007.1970000000001, "ttft_s": 0.08831118897069246, "turn_id": 6} +{"actual_output_tokens": 170, "cached_tokens": 52832, "effective_input_length": 53574, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53574, "latency_s": 1.7056099449982867, "output_length": 170, "proxy_request_id": "1277428:17:1793546:1091", "request_id": "1277428:17:1793546:1091", "request_type": "coder", "requested_output_tokens": 170, "session_id": "1277428", "t_dispatch_unix": 1779822587.2169175, "t_finish_unix": 1779822588.9225273, "t_first_token_unix": 1779822587.6243026, "tpot_s": 0.007680141810636372, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 17586052, 17586053], "trace_timestamp_s": 1900.2750000000005, "ttft_s": 0.4073824430233799, "turn_id": 17} +{"actual_output_tokens": 122, "cached_tokens": 54624, "effective_input_length": 54654, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54654, "latency_s": 1.0237199460389093, "output_length": 122, "proxy_request_id": "1399948:70:1795589:1092", "request_id": "1399948:70:1795589:1092", "request_type": "coder", "requested_output_tokens": 122, "session_id": "1399948", "t_dispatch_unix": 1779822594.5380821, "t_finish_unix": 1779822595.561801, "t_first_token_unix": 1779822594.64453, "tpot_s": 0.0075786617110206265, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564], "trace_timestamp_s": 1907.5920000000006, "ttft_s": 0.1064459879999049, "turn_id": 70} +{"actual_output_tokens": 52, "cached_tokens": 53728, "effective_input_length": 53805, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53805, "latency_s": 0.5106735670124181, "output_length": 52, "proxy_request_id": "1277428:18:1796824:1093", "request_id": "1277428:18:1796824:1093", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1277428", "t_dispatch_unix": 1779822599.1317976, "t_finish_unix": 1779822599.6424708, "t_first_token_unix": 1779822599.2801168, "tpot_s": 0.0070995144116893115, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17375441, 17375442, 17375443, 17529218, 17529219, 17529220, 17586052, 17617726, 17617727], "trace_timestamp_s": 1912.1900000000005, "ttft_s": 0.1483165529789403, "turn_id": 18} +{"actual_output_tokens": 265, "cached_tokens": 54768, "effective_input_length": 54920, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54920, "latency_s": 2.249195184034761, "output_length": 265, "proxy_request_id": "1399948:71:1800797:1094", "request_id": "1399948:71:1800797:1094", "request_type": "coder", "requested_output_tokens": 265, "session_id": "1399948", "t_dispatch_unix": 1779822612.722858, "t_finish_unix": 1779822614.9720528, "t_first_token_unix": 1779822612.9219635, "tpot_s": 0.0077645403221002635, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17654371], "trace_timestamp_s": 1925.7700000000004, "ttft_s": 0.1991035609971732, "turn_id": 71} +{"actual_output_tokens": 54, "cached_tokens": 55184, "effective_input_length": 55246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55246, "latency_s": 0.5218797370325774, "output_length": 54, "proxy_request_id": "1399948:72:1804699:1097", "request_id": "1399948:72:1804699:1097", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1399948", "t_dispatch_unix": 1779822626.1738222, "t_finish_unix": 1779822626.6957018, "t_first_token_unix": 1779822626.3200645, "tpot_s": 0.007081614018699049, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778], "trace_timestamp_s": 1939.2340000000004, "ttft_s": 0.14624010602710769, "turn_id": 72} +{"actual_output_tokens": 164, "cached_tokens": 55296, "effective_input_length": 55559, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55559, "latency_s": 1.4828546520438977, "output_length": 164, "proxy_request_id": "1399948:73:1805981:1098", "request_id": "1399948:73:1805981:1098", "request_type": "coder", "requested_output_tokens": 164, "session_id": "1399948", "t_dispatch_unix": 1779822630.3560572, "t_finish_unix": 1779822631.8389115, "t_first_token_unix": 1779822630.5672207, "tpot_s": 0.00780002952144807, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17704700], "trace_timestamp_s": 1943.415, "ttft_s": 0.21116077905753627, "turn_id": 73} +{"actual_output_tokens": 95, "cached_tokens": 52928, "effective_input_length": 52932, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 52932, "latency_s": 0.7893732120282948, "output_length": 95, "proxy_request_id": "1305906:6:1806419:1099", "request_id": "1305906:6:1806419:1099", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1305906", "t_dispatch_unix": 1779822631.8660107, "t_finish_unix": 1779822632.6553833, "t_first_token_unix": 1779822631.9598567, "tpot_s": 0.007394944201842783, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17708612], "trace_timestamp_s": 1944.9260000000004, "ttft_s": 0.09384380304254591, "turn_id": 6} +{"actual_output_tokens": 43, "cached_tokens": 53024, "effective_input_length": 54789, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54789, "latency_s": 1.0333709840197116, "output_length": 43, "proxy_request_id": "1305906:7:1572780:964", "request_id": "1305906:7:1572780:964", "request_type": "coder", "requested_output_tokens": 43, "session_id": "1305906", "t_dispatch_unix": 1779822632.661401, "t_finish_unix": 1779822633.6947718, "t_first_token_unix": 1779822633.4065003, "tpot_s": 0.006857590381211291, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 14922061, 14922062, 14922063, 14922064, 14922065, 14922066, 14922067, 14922068, 14922069, 14922070, 15068951, 15068952, 15068953, 15068954, 15254840, 15254841, 15254842, 15254843, 15321386, 15404408, 15482090, 15482091], "trace_timestamp_s": 1150.469, "ttft_s": 0.7450971659854986, "turn_id": 7} +{"actual_output_tokens": 236, "cached_tokens": 55712, "effective_input_length": 55791, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55791, "latency_s": 1.9999907960300334, "output_length": 236, "proxy_request_id": "1399948:74:1808473:1100", "request_id": "1399948:74:1808473:1100", "request_type": "coder", "requested_output_tokens": 236, "session_id": "1399948", "t_dispatch_unix": 1779822639.057339, "t_finish_unix": 1779822641.0573292, "t_first_token_unix": 1779822639.206233, "tpot_s": 0.007875779740254772, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098], "trace_timestamp_s": 1952.1170000000002, "ttft_s": 0.1488927670288831, "turn_id": 74} +{"actual_output_tokens": 3764, "cached_tokens": 111632, "effective_input_length": 111736, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 111736, "latency_s": 42.465304304030724, "output_length": 3764, "proxy_request_id": "1270606:6:1804345:1096", "request_id": "1270606:6:1804345:1096", "request_type": "coder", "requested_output_tokens": 3764, "session_id": "1270606", "t_dispatch_unix": 1779822625.0031648, "t_finish_unix": 1779822667.4684684, "t_first_token_unix": 1779822625.3283563, "tpot_s": 0.011198401939665387, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17689050, 17689051, 17689052, 17689053, 17689054, 17689055, 17689056, 17689057, 17689058, 17689059, 17689060, 17689061, 17689062, 17689063, 17689064, 17689065, 17689066, 17689067, 17689068, 17689069, 17689070, 17689071, 17689072, 17689073, 17689074, 17689075, 17689076, 17689077, 17689078, 17689079, 17689080, 17689081, 17689082, 17689083, 17689084, 17689085, 17689086, 17689087, 17689088, 17689089, 17689090, 17689091, 17689092, 17689093, 17689094, 17689095, 17689096, 17689097, 17689098, 17689099, 17689100, 17689101, 17689102, 17689103, 17689104, 17689105, 17689106, 17689107, 17689108, 17689109, 17689110, 17689111, 17689112, 17689113, 17689114, 17689115, 17689116, 17689117, 17689118, 17689119, 17689120, 17689121, 17689122, 17689123, 17689124, 17689125, 17689126, 17689127, 17689128, 17689129, 17689130, 17689131, 17689132, 17689133, 17689134, 17689135, 17689136, 17689137, 17689138, 17689139, 17689140, 17689141, 17689142, 17689143, 17689144, 17689145, 17689146, 17689147, 17689148, 17689149, 17689150, 17689151, 17689152, 17689153, 17689154, 17689155, 17689156, 17689157, 17689158, 17689159, 17689160, 17689161, 17689162], "trace_timestamp_s": 1938.0380000000005, "ttft_s": 0.325189424038399, "turn_id": 6} +{"actual_output_tokens": 108, "cached_tokens": 56016, "effective_input_length": 57308, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57308, "latency_s": 1.4641026409808546, "output_length": 108, "proxy_request_id": "1399948:75:1817312:1101", "request_id": "1399948:75:1817312:1101", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1399948", "t_dispatch_unix": 1779822667.592928, "t_finish_unix": 1779822669.0570312, "t_first_token_unix": 1779822668.2390032, "tpot_s": 0.0076424183087884755, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098, 17807927, 17807928, 17807929], "trace_timestamp_s": 1980.652, "ttft_s": 0.6460729669779539, "turn_id": 75} +{"actual_output_tokens": 85, "cached_tokens": 57408, "effective_input_length": 57659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57659, "latency_s": 0.8581889789784327, "output_length": 85, "proxy_request_id": "1399948:76:1821495:1102", "request_id": "1399948:76:1821495:1102", "request_type": "coder", "requested_output_tokens": 85, "session_id": "1399948", "t_dispatch_unix": 1779822681.249707, "t_finish_unix": 1779822682.1078959, "t_first_token_unix": 1779822681.4640608, "tpot_s": 0.0076618609995681, "trace_hash_ids": [13854383, 13854384, 7477998, 7477999, 7478000, 7478001, 7478002, 13854385, 13854386, 13902105, 13902106, 13902107, 13907775, 13907776, 13907777, 13919489, 13951139, 13951140, 13951141, 13951142, 13951143, 13951144, 14161912, 14827841, 14827842, 14827843, 14827844, 14902697, 14902698, 14902699, 14917326, 14957861, 15019329, 15040981, 15040982, 15063128, 15209346, 15209347, 15209348, 15237105, 15237106, 15237107, 15296677, 15340882, 15340883, 15352256, 15352257, 15466674, 15466675, 15466676, 15466677, 15466678, 15466679, 15466680, 15466681, 15466682, 15536838, 15536839, 15536840, 15536841, 15565283, 15610085, 15759378, 15759379, 15759380, 15853944, 15853945, 15853946, 15864752, 15932233, 16003841, 16003842, 16146470, 16146471, 16159765, 16283826, 16283827, 16283828, 16358763, 16467279, 16467280, 16467281, 16467282, 16553912, 16553913, 16609324, 16728010, 16728011, 16766348, 16945461, 16945462, 17006902, 17159594, 17159595, 17202857, 17258495, 17382966, 17382967, 17382968, 17430073, 17430074, 17430075, 17500498, 17500499, 17560436, 17560437, 17605564, 17692778, 17727098, 17807927, 17807928, 17807929, 17846855], "trace_timestamp_s": 1994.3100000000004, "ttft_s": 0.2143522300175391, "turn_id": 76} +{"actual_output_tokens": 86, "cached_tokens": 112176, "effective_input_length": 112180, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112180, "latency_s": 1.0400911169708706, "output_length": 86, "proxy_request_id": "1270606:6:1822681:1103", "request_id": "1270606:6:1822681:1103", "request_type": "coder", "requested_output_tokens": 86, "session_id": "1270606", "t_dispatch_unix": 1779822685.0847971, "t_finish_unix": 1779822686.1248882, "t_first_token_unix": 1779822685.2720048, "tpot_s": 0.010031118258998236, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17857677, 17857678, 17857679, 17857680, 17857681, 17857682, 17857683, 17857684, 17857685, 17857686, 17857687, 17857688, 17857689, 17857690, 17857691, 17857692, 17857693, 17857694, 17857695, 17857696, 17857697, 17857698, 17857699, 17857700, 17857701, 17857702, 17857703, 17857704, 17857705, 17857706, 17857707, 17857708, 17857709, 17857710, 17857711, 17857712, 17857713, 17857714, 17857715, 17857716, 17857717, 17857718, 17857719, 17857720, 17857721, 17857722, 17857723, 17857724, 17857725, 17857726, 17857727, 17857728, 17857729, 17857730, 17857731, 17857732, 17857733, 17857734, 17857735, 17857736, 17857737, 17857738, 17857739, 17857740, 17857741, 17857742, 17857743, 17857744, 17857745, 17857746, 17857747, 17857748, 17857749, 17857750, 17857751, 17857752, 17857753, 17857754, 17857755, 17857756, 17857757, 17857758, 17857759, 17857760, 17857761, 17857762, 17857763, 17857764, 17857765, 17857766, 17857767, 17857768, 17857769, 17857770, 17857771, 17857772, 17857773, 17857774, 17857775, 17857776, 17857777, 17857778, 17857779, 17857780, 17857781, 17857782, 17857783, 17857784, 17857785, 17857786, 17857787, 17857788, 17857789], "trace_timestamp_s": 1998.1220000000003, "ttft_s": 0.18720538797788322, "turn_id": 6} +{"actual_output_tokens": 367, "cached_tokens": 112256, "effective_input_length": 112645, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112645, "latency_s": 4.589064507978037, "output_length": 367, "proxy_request_id": "1270606:7:1825806:1104", "request_id": "1270606:7:1825806:1104", "request_type": "coder", "requested_output_tokens": 367, "session_id": "1270606", "t_dispatch_unix": 1779822695.6985095, "t_finish_unix": 1779822700.2875738, "t_first_token_unix": 1779822696.2877626, "tpot_s": 0.010927581002800904, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 17887190, 17887191, 17887192, 17887193, 17887194, 17887195, 17887196, 17887197, 17887198, 17887199, 17887200, 17887201, 17887202, 17887203, 17887204, 17887205, 17887206, 17887207, 17887208, 17887209, 17887210, 17887211, 17887212, 17887213, 17887214, 17887215, 17887216, 17887217, 17887218, 17887219, 17887220, 17887221, 17887222, 17887223, 17887224, 17887225, 17887226, 17887227, 17887228, 17887229, 17887230, 17887231, 17887232, 17887233, 17887234, 17887235, 17887236, 17887237, 17887238, 17887239, 17887240, 17887241, 17887242, 17887243, 17887244, 17887245, 17887246, 17887247, 17887248, 17887249, 17887250, 17887251, 17887252, 17887253, 17887254, 17887255, 17887256, 17887257, 17887258, 17887259, 17887260, 17887261, 17887262, 17887263, 17887264, 17887265, 17887266, 17887267, 17887268, 17887269, 17887270, 17887271, 17887272, 17887273, 17887274, 17887275, 17887276, 17887277, 17887278, 17887279, 17887280, 17887281, 17887282, 17887283, 17887284, 17887285, 17887286, 17887287, 17887288, 17887289, 17887290, 17887291, 17887292, 17887293, 17887294, 17887295, 17887296, 17887297, 17887298, 17887299, 17887300, 17887301, 17887302], "trace_timestamp_s": 2008.7350000000006, "ttft_s": 0.5892503769719042, "turn_id": 7} +{"actual_output_tokens": 46, "cached_tokens": 53856, "effective_input_length": 58474, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58474, "latency_s": 2.0714710539905354, "output_length": 46, "proxy_request_id": "1277428:19:1834491:1105", "request_id": "1277428:19:1834491:1105", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1277428", "t_dispatch_unix": 1779822724.976784, "t_finish_unix": 1779822727.048255, "t_first_token_unix": 1779822726.7270932, "tpot_s": 0.007131244600491805, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 17970607, 17970608, 17970609, 17970610, 17970611, 17970612, 17970613, 17970614], "trace_timestamp_s": 2038.0340000000006, "ttft_s": 1.7503066739882343, "turn_id": 19} +{"actual_output_tokens": 45, "cached_tokens": 113008, "effective_input_length": 113482, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 113482, "latency_s": 1.0025038800085895, "output_length": 45, "proxy_request_id": "1270606:8:1837578:1106", "request_id": "1270606:8:1837578:1106", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1270606", "t_dispatch_unix": 1779822735.8020651, "t_finish_unix": 1779822736.8045685, "t_first_token_unix": 1779822736.4005253, "tpot_s": 0.009176330795691518, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18001581, 18001582, 18001583, 18001584, 18001585, 18001586, 18001587, 18001588, 18001589, 18001590, 18001591, 18001592, 18001593, 18001594, 18001595, 18001596, 18001597, 18001598, 18001599, 18001600, 18001601, 18001602, 18001603, 18001604, 18001605, 18001606, 18001607, 18001608, 18001609, 18001610, 18001611, 18001612, 18001613, 18001614, 18001615, 18001616, 18001617, 18001618, 18001619, 18001620, 18001621, 18001622, 18001623, 18001624, 18001625, 18001626, 18001627, 18001628, 18001629, 18001630, 18001631, 18001632, 18001633, 18001634, 18001635, 18001636, 18001637, 18001638, 18001639, 18001640, 18001641, 18001642, 18001643, 18001644, 18001645, 18001646, 18001647, 18001648, 18001649, 18001650, 18001651, 18001652, 18001653, 18001654, 18001655, 18001656, 18001657, 18001658, 18001659, 18001660, 18001661, 18001662, 18001663, 18001664, 18001665, 18001666, 18001667, 18001668, 18001669, 18001670, 18001671, 18001672, 18001673, 18001674, 18001675, 18001676, 18001677, 18001678, 18001679, 18001680, 18001681, 18001682, 18001683, 18001684, 18001685, 18001686, 18001687, 18001688, 18001689, 18001690, 18001691, 18001692], "trace_timestamp_s": 2048.8380000000006, "ttft_s": 0.5984578190254979, "turn_id": 8} +{"actual_output_tokens": 10766, "cached_tokens": 112592, "effective_input_length": 112634, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112634, "latency_s": 124.02636938798241, "output_length": 10766, "proxy_request_id": "1253804:55:1803044:1095", "request_id": "1253804:55:1803044:1095", "request_type": "coder", "requested_output_tokens": 10766, "session_id": "1253804", "t_dispatch_unix": 1779822620.5905132, "t_finish_unix": 1779822744.6168818, "t_first_token_unix": 1779822620.7948182, "tpot_s": 0.011502255808174457, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 17676585, 17676586, 17676587, 17676588, 17676589, 17676590, 17676591, 17676592, 17676593, 17676594, 17676595, 17676596, 17676597, 17676598, 17676599, 17676600, 17676601, 17676602, 17676603, 17676604, 17676605, 17676606, 17676607, 17676608, 17676609, 17676610, 17676611, 17676612, 17676613, 17676614, 17676615, 17676616, 17676617, 17676618, 17676619, 17676620, 17676621, 17676622, 17676623, 17676624, 17676625, 17676626, 17676627, 17676628, 17676629, 5483415, 17676630, 17676631, 17676632, 17676633, 17676634, 17676635, 17676636, 17676637, 17676638, 17676639, 17676640, 17676641, 17676642, 17676643, 17676644, 17676645, 17676646, 17676647, 17676648, 17676649, 17676650, 17676651, 17676652, 17676653, 17676654, 17676655, 17676656, 17676657, 17676658, 17676659, 17676660, 17676661, 17676662, 17676663, 17676664, 17676665, 17676666, 17676667, 17676668, 17676669, 17676670, 17676671, 17676672, 17676673, 17676674, 17676675, 17676676, 17676677, 17676678, 17676679, 17676680, 17676681, 17676682, 17676683, 17676684, 17676685, 17676686, 17676687, 17676688, 17676689, 17676690, 17676691, 17676692, 17676693, 17676694, 17676695, 17676696, 17676697, 17676698, 17676699, 17676700, 17676701, 17676702, 17676703, 17676704, 17676705, 17676706, 17676707, 17676708, 17676709, 17676710, 17676711, 17676712, 17676713, 17676714, 17676715, 17676716, 17676717, 17676718, 17676719, 17676720, 17676721, 17676722, 17676723, 17676724, 17676725, 17676726, 17676727, 17676728, 17676729, 17676730, 17676731, 17676732, 17676733, 17676734, 17676735, 17676736, 17676737, 17676738], "trace_timestamp_s": 1933.6150000000007, "ttft_s": 0.20430248498450965, "turn_id": 55} +{"actual_output_tokens": 141, "cached_tokens": 113520, "effective_input_length": 116467, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 116467, "latency_s": 3.789533907023724, "output_length": 141, "proxy_request_id": "1270606:9:1847569:1107", "request_id": "1270606:9:1847569:1107", "request_type": "coder", "requested_output_tokens": 141, "session_id": "1270606", "t_dispatch_unix": 1779822769.7062502, "t_finish_unix": 1779822773.4957836, "t_first_token_unix": 1779822771.9967768, "tpot_s": 0.010703176050031158, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18099243, 18099244, 18099245, 18099246, 18099247, 18099248, 18099249, 18099250, 18099251, 18099252, 18099253, 18099254, 18099255, 18099256, 18099257, 18099258, 18099259, 18099260, 18099261, 18099262, 18099263, 18099264, 18099265, 18099266, 18099267, 18099268, 18099269, 18099270, 18099271, 18099272, 18099273, 18099274, 18099275, 18099276, 18099277, 18099278, 18099279, 18099280, 18099281, 18099282, 18099283, 18099284, 18099285, 18099286, 18099287, 18099288, 18099289, 18099290, 18099291, 18099292, 18099293, 18099294, 18099295, 18099296, 18099297, 18099298, 18099299, 18099300, 18099301, 18099302, 18099303, 18099304, 18099305, 18099306, 18099307, 18099308, 18099309, 18099310, 18099311, 18099312, 18099313, 18099314, 18099315, 18099316, 18099317, 18099318, 18099319, 18099320, 18099321, 18099322, 18099323, 18099324, 18099325, 18099326, 18099327, 18099328, 18099329, 18099330, 18099331, 18099332, 18099333, 18099334, 18099335, 18099336, 18099337, 18099338, 18099339, 18099340, 18099341, 18099342, 18099343, 18099344, 18099345, 18099346, 18099347, 18099348, 18099349, 18099350, 18099351, 18099352, 18099353, 18099354, 18099355, 18099356, 18099357, 18099358, 18099359, 18099360], "trace_timestamp_s": 2082.7170000000006, "ttft_s": 2.290523978008423, "turn_id": 9} +{"actual_output_tokens": 73, "cached_tokens": 116592, "effective_input_length": 116659, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 116659, "latency_s": 1.0156576970475726, "output_length": 73, "proxy_request_id": "1270606:10:1851128:1108", "request_id": "1270606:10:1851128:1108", "request_type": "coder", "requested_output_tokens": 73, "session_id": "1270606", "t_dispatch_unix": 1779822781.786005, "t_finish_unix": 1779822782.8016624, "t_first_token_unix": 1779822782.0742936, "tpot_s": 0.010098041985960057, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 17857676, 17887189, 18001579, 18001580, 18099243, 18099244, 18099245, 18099246, 18099247, 18133288, 18133289, 18133290, 18133291, 18133292, 18133293, 18133294, 18133295, 18133296, 18133297, 18133298, 18133299, 18133300, 18133301, 18133302, 18133303, 18133304, 18133305, 18133306, 18133307, 18133308, 18133309, 18133310, 18133311, 18133312, 18133313, 18133314, 18133315, 18133316, 18133317, 18133318, 18133319, 18133320, 18133321, 18133322, 18133323, 18133324, 18133325, 18133326, 18133327, 18133328, 18133329, 18133330, 18133331, 18133332, 18133333, 18133334, 18133335, 18133336, 18133337, 18133338, 18133339, 18133340, 18133341, 18133342, 18133343, 18133344, 18133345, 18133346, 18133347, 18133348, 18133349, 18133350, 18133351, 18133352, 18133353, 18133354, 18133355, 18133356, 18133357, 18133358, 18133359, 18133360, 18133361, 18133362, 18133363, 18133364, 18133365, 18133366, 18133367, 18133368, 18133369, 18133370, 18133371, 18133372, 18133373, 18133374, 18133375, 18133376, 18133377, 18133378, 18133379, 18133380, 18133381, 18133382, 18133383, 18133384, 18133385, 18133386, 18133387, 18133388, 18133389, 18133390, 18133391, 18133392, 18133393, 18133394, 18133395, 18133396, 18133397, 18133398, 18133399, 18133400], "trace_timestamp_s": 2094.818, "ttft_s": 0.2882858810480684, "turn_id": 10} +{"actual_output_tokens": 279, "cached_tokens": 54816, "effective_input_length": 58042, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58042, "latency_s": 3.5463722129934467, "output_length": 279, "proxy_request_id": "1305906:7:1851943:1109", "request_id": "1305906:7:1851943:1109", "request_type": "coder", "requested_output_tokens": 279, "session_id": "1305906", "t_dispatch_unix": 1779822784.3356032, "t_finish_unix": 1779822787.881975, "t_first_token_unix": 1779822785.6542017, "tpot_s": 0.008012431967675204, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18141935], "trace_timestamp_s": 2097.389, "ttft_s": 1.3185961589915678, "turn_id": 7} +{"actual_output_tokens": 234, "cached_tokens": 58320, "effective_input_length": 58687, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58687, "latency_s": 2.188480813987553, "output_length": 234, "proxy_request_id": "1305906:8:1866131:1110", "request_id": "1305906:8:1866131:1110", "request_type": "coder", "requested_output_tokens": 234, "session_id": "1305906", "t_dispatch_unix": 1779822832.8011634, "t_finish_unix": 1779822834.989644, "t_first_token_unix": 1779822833.1311226, "tpot_s": 0.00797529857507767, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18280928], "trace_timestamp_s": 2145.857, "ttft_s": 0.3299568509683013, "turn_id": 8} +{"actual_output_tokens": 157, "cached_tokens": 116720, "effective_input_length": 117828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 117828, "latency_s": 2.745862540032249, "output_length": 157, "proxy_request_id": "1270606:11:1868274:1111", "request_id": "1270606:11:1868274:1111", "request_type": "coder", "requested_output_tokens": 157, "session_id": "1270606", "t_dispatch_unix": 1779822840.0723238, "t_finish_unix": 1779822842.818186, "t_first_token_unix": 1779822841.115157, "tpot_s": 0.010915211576875897, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18302637, 18302638, 18302639, 18302640, 18302641, 18302642, 18302643, 18302644, 18302645, 18302646, 18302647, 18302648, 18302649, 18302650, 18302651, 18302652, 18302653, 18302654, 18302655, 18302656, 18302657, 18302658, 18302659, 18302660, 18302661, 18302662, 18302663, 18302664, 18302665, 18302666, 18302667, 18302668, 18302669, 18302670, 18302671, 18302672, 18302673, 18302674, 18302675, 18302676, 18302677, 18302678, 18302679, 18302680, 18302681, 18302682, 18302683, 18302684, 18302685, 18302686, 18302687, 18302688, 18302689, 18302690, 18302691, 18302692, 18302693, 18302694, 18302695, 18302696, 18302697, 18302698, 18302699, 18302700, 18302701, 18302702, 18302703, 18302704, 18302705, 18302706, 18302707, 18302708, 18302709, 18302710, 18302711, 18302712, 18302713, 18302714, 18302715, 18302716, 18302717, 18302718, 18302719, 18302720, 18302721, 18302722, 18302723, 18302724, 18302725, 18302726, 18302727, 18302728, 18302729, 18302730, 18302731, 18302732, 18302733, 18302734, 18302735, 18302736, 18302737, 18302738, 18302739, 18302740, 18302741, 18302742, 18302743, 18302744, 18302745, 18302746, 18302747, 18302748, 18302749], "trace_timestamp_s": 2153.103, "ttft_s": 1.0428307370166294, "turn_id": 11} +{"actual_output_tokens": 51, "cached_tokens": 117984, "effective_input_length": 118012, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118012, "latency_s": 0.699482531985268, "output_length": 51, "proxy_request_id": "1270606:11:1870810:1113", "request_id": "1270606:11:1870810:1113", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1270606", "t_dispatch_unix": 1779822848.569736, "t_finish_unix": 1779822849.269218, "t_first_token_unix": 1779822848.8007395, "tpot_s": 0.009364452039590106, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18328449, 18328450, 18328451, 18328452, 18328453, 18328454, 18328455, 18328456, 18328457, 18328458, 18328459, 18328460, 18328461, 18328462, 18328463, 18328464, 18328465, 18328466, 18328467, 18328468, 18328469, 18328470, 18328471, 18328472, 18328473, 18328474, 18328475, 18328476, 18328477, 18328478, 18328479, 18328480, 18328481, 18328482, 18328483, 18328484, 18328485, 18328486, 18328487, 18328488, 18328489, 18328490, 18328491, 18328492, 18328493, 18328494, 18328495, 18328496, 18328497, 18328498, 18328499, 18328500, 18328501, 18328502, 18328503, 18328504, 18328505, 18328506, 18328507, 18328508, 18328509, 18328510, 18328511, 18328512, 18328513, 18328514, 18328515, 18328516, 18328517, 18328518, 18328519, 18328520, 18328521, 18328522, 18328523, 18328524, 18328525, 18328526, 18328527, 18328528, 18328529, 18328530, 18328531, 18328532, 18328533, 18328534, 18328535, 18328536, 18328537, 18328538, 18328539, 18328540, 18328541, 18328542, 18328543, 18328544, 18328545, 18328546, 18328547, 18328548, 18328549, 18328550, 18328551, 18328552, 18328553, 18328554, 18328555, 18328556, 18328557, 18328558, 18328559, 18328560, 18328561], "trace_timestamp_s": 2161.6060000000007, "ttft_s": 0.23100133100524545, "turn_id": 11} +{"actual_output_tokens": 211, "cached_tokens": 134928, "effective_input_length": 135435, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 135435, "latency_s": 4.607792523980606, "output_length": 211, "proxy_request_id": "1356885:12:1874205:1114", "request_id": "1356885:12:1874205:1114", "request_type": "coder", "requested_output_tokens": 211, "session_id": "1356885", "t_dispatch_unix": 1779822860.0331025, "t_finish_unix": 1779822864.6408944, "t_first_token_unix": 1779822860.7434285, "tpot_s": 0.018558119376289792, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18360942], "trace_timestamp_s": 2173.0870000000004, "ttft_s": 0.7103233709931374, "turn_id": 12} +{"actual_output_tokens": 436, "cached_tokens": 40304, "effective_input_length": 40328, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40328, "latency_s": 3.166987590957433, "output_length": 436, "proxy_request_id": "1340290:17:1875101:1115", "request_id": "1340290:17:1875101:1115", "request_type": "coder", "requested_output_tokens": 436, "session_id": "1340290", "t_dispatch_unix": 1779822862.9745452, "t_finish_unix": 1779822866.1415327, "t_first_token_unix": 1779822863.061862, "tpot_s": 0.007079122942503028, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956], "trace_timestamp_s": 2176.0350000000008, "ttft_s": 0.0873142319614999, "turn_id": 17} +{"actual_output_tokens": 194, "cached_tokens": 118048, "effective_input_length": 118600, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 118600, "latency_s": 2.753612858999986, "output_length": 194, "proxy_request_id": "1270606:12:1876851:1116", "request_id": "1270606:12:1876851:1116", "request_type": "coder", "requested_output_tokens": 194, "session_id": "1270606", "t_dispatch_unix": 1779822868.9307027, "t_finish_unix": 1779822871.6843154, "t_first_token_unix": 1779822869.5555758, "tpot_s": 0.011027992813705607, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18387421, 18387422, 18387423, 18387424, 18387425, 18387426, 18387427, 18387428, 18387429, 18387430, 18387431, 18387432, 18387433, 18387434, 18387435, 18387436, 18387437, 18387438, 18387439, 18387440, 18387441, 18387442, 18387443, 18387444, 18387445, 18387446, 18387447, 18387448, 18387449, 18387450, 18387451, 18387452, 18387453, 18387454, 18387455, 18387456, 18387457, 18387458, 18387459, 18387460, 18387461, 18387462, 18387463, 18387464, 18387465, 18387466, 18387467, 18387468, 18387469, 18387470, 18387471, 18387472, 18387473, 18387474, 18387475, 18387476, 18387477, 18387478, 18387479, 18387480, 18387481, 18387482, 18387483, 18387484, 18387485, 18387486, 18387487, 18387488, 18387489, 18387490, 18387491, 18387492, 18387493, 18387494, 18387495, 18387496, 18387497, 18387498, 18387499, 18387500, 18387501, 18387502, 18387503, 18387504, 18387505, 18387506, 18387507, 18387508, 18387509, 18387510, 18387511, 18387512, 18387513, 18387514, 18387515, 18387516, 18387517, 18387518, 18387519, 18387520, 18387521, 18387522, 18387523, 18387524, 18387525, 18387526, 18387527, 18387528, 18387529, 18387530, 18387531, 18387532, 18387533], "trace_timestamp_s": 2181.9670000000006, "ttft_s": 0.624870971951168, "turn_id": 12} +{"actual_output_tokens": 34, "cached_tokens": 40576, "effective_input_length": 40583, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40583, "latency_s": 0.28046216996153817, "output_length": 34, "proxy_request_id": "1340290:18:1878955:1117", "request_id": "1340290:18:1878955:1117", "request_type": "coder", "requested_output_tokens": 34, "session_id": "1340290", "t_dispatch_unix": 1779822876.6501985, "t_finish_unix": 1779822876.93066, "t_first_token_unix": 1779822876.72617, "tpot_s": 0.0061890518479754755, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18407653], "trace_timestamp_s": 2189.7110000000002, "ttft_s": 0.07596991799073294, "turn_id": 18} +{"actual_output_tokens": 82, "cached_tokens": 40608, "effective_input_length": 40676, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40676, "latency_s": 0.6621315829688683, "output_length": 82, "proxy_request_id": "1340290:19:1880565:1118", "request_id": "1340290:19:1880565:1118", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1340290", "t_dispatch_unix": 1779822881.923917, "t_finish_unix": 1779822882.586048, "t_first_token_unix": 1779822882.0383246, "tpot_s": 0.0067590471230631255, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18422775], "trace_timestamp_s": 2194.9840000000004, "ttft_s": 0.11440581700298935, "turn_id": 19} +{"actual_output_tokens": 49, "cached_tokens": 40752, "effective_input_length": 40883, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 40883, "latency_s": 0.4390479810535908, "output_length": 49, "proxy_request_id": "1340290:20:1882251:1120", "request_id": "1340290:20:1882251:1120", "request_type": "coder", "requested_output_tokens": 49, "session_id": "1340290", "t_dispatch_unix": 1779822887.7318406, "t_finish_unix": 1779822888.1708884, "t_first_token_unix": 1779822887.8541632, "tpot_s": 0.006592851916745228, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436], "trace_timestamp_s": 2200.7930000000006, "ttft_s": 0.12232043803669512, "turn_id": 20} +{"actual_output_tokens": 355, "cached_tokens": 118784, "effective_input_length": 119030, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119030, "latency_s": 4.392139934992883, "output_length": 355, "proxy_request_id": "1270606:12:1881189:1119", "request_id": "1270606:12:1881189:1119", "request_type": "coder", "requested_output_tokens": 355, "session_id": "1270606", "t_dispatch_unix": 1779822884.319733, "t_finish_unix": 1779822888.7118728, "t_first_token_unix": 1779822884.734296, "tpot_s": 0.01123522061576388, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18428324, 18428325, 18428326, 18428327, 18428328, 18428329, 18428330, 18428331, 18428332, 18428333, 18428334, 18428335, 18428336, 18428337, 18428338, 18428339, 18428340, 18428341, 18428342, 18428343, 18428344, 18428345, 18428346, 18428347, 18428348, 18428349, 18428350, 18428351, 18428352, 18428353, 18428354, 18428355, 18428356, 18428357, 18428358, 18428359, 18428360, 18428361, 18428362, 18428363, 18428364, 18428365, 18428366, 18428367, 18428368, 18428369, 18428370, 18428371, 18428372, 18428373, 18428374, 18428375, 18428376, 18428377, 18428378, 18428379, 18428380, 18428381, 18428382, 18428383, 18428384, 18428385, 18428386, 18428387, 18428388, 18428389, 18428390, 18428391, 18428392, 18428393, 18428394, 18428395, 18428396, 18428397, 18428398, 18428399, 18428400, 18428401, 18428402, 18428403, 18428404, 18428405, 18428406, 18428407, 18428408, 18428409, 18428410, 18428411, 18428412, 18428413, 18428414, 18428415, 18428416, 18428417, 18428418, 18428419, 18428420, 18428421, 18428422, 18428423, 18428424, 18428425, 18428426, 18428427, 18428428, 18428429, 18428430, 18428431, 18428432, 18428433, 18428434, 18428435, 18428436], "trace_timestamp_s": 2197.3560000000007, "ttft_s": 0.4145603340002708, "turn_id": 12} +{"actual_output_tokens": 39, "cached_tokens": 40928, "effective_input_length": 41002, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41002, "latency_s": 0.3637632039608434, "output_length": 39, "proxy_request_id": "1340290:21:1883855:1121", "request_id": "1340290:21:1883855:1121", "request_type": "coder", "requested_output_tokens": 39, "session_id": "1340290", "t_dispatch_unix": 1779822893.2011425, "t_finish_unix": 1779822893.5649052, "t_first_token_unix": 1779822893.3207622, "tpot_s": 0.006417833711327005, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18454570], "trace_timestamp_s": 2206.2620000000006, "ttft_s": 0.11961734195938334, "turn_id": 21} +{"actual_output_tokens": 51, "cached_tokens": 41040, "effective_input_length": 41909, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 41909, "latency_s": 0.6723108229925856, "output_length": 51, "proxy_request_id": "1340290:22:1884847:1122", "request_id": "1340290:22:1884847:1122", "request_type": "coder", "requested_output_tokens": 51, "session_id": "1340290", "t_dispatch_unix": 1779822896.6734662, "t_finish_unix": 1779822897.3457763, "t_first_token_unix": 1779822897.014993, "tpot_s": 0.006610720719909296, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633], "trace_timestamp_s": 2209.7340000000004, "ttft_s": 0.3415251999977045, "turn_id": 22} +{"actual_output_tokens": 4631, "cached_tokens": 112912, "effective_input_length": 112926, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 112926, "latency_s": 54.83063147304347, "output_length": 4631, "proxy_request_id": "1253804:55:1869941:1112", "request_id": "1253804:55:1869941:1112", "request_type": "coder", "requested_output_tokens": 4631, "session_id": "1253804", "t_dispatch_unix": 1779822845.7042837, "t_finish_unix": 1779822900.5349147, "t_first_token_unix": 1779822845.8810024, "tpot_s": 0.011804242318794815, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 34048, 34049, 34050, 34051, 34052, 34053, 34054, 34055, 34056, 34057, 34058, 34059, 34060, 34061, 34062, 50244, 50245, 50246, 50247, 16525, 72495, 72496, 72497, 72498, 72499, 72500, 72501, 72502, 72503, 72504, 72505, 72506, 72507, 72508, 72509, 12212965, 152607, 152608, 152609, 152610, 12212966, 544537, 544538, 544539, 544540, 12212967, 12212968, 242046, 242047, 12212969, 12212970, 12212971, 12212972, 12212973, 12212974, 12212975, 12212976, 12212977, 17676585, 17676586, 17676587, 17676588, 17676589, 17676590, 17676591, 17676592, 17676593, 17676594, 17676595, 17676596, 17676597, 17676598, 17676599, 17676600, 17676601, 17676602, 17676603, 17676604, 17676605, 17676606, 17676607, 17676608, 17676609, 17676610, 17676611, 17676612, 17676613, 17676614, 17676615, 17676616, 17676617, 17676618, 17676619, 17676620, 17676621, 17676622, 17676623, 17676624, 17676625, 17676626, 17676627, 17676628, 17676629, 5483415, 17676630, 17676631, 17676632, 17676633, 17676634, 17676635, 17676636, 17676637, 17676638, 17676639, 17676640, 17676641, 17676642, 17676643, 17676644, 17676645, 17676646, 17676647, 17676648, 17676649, 17676650, 17676651, 17676652, 17676653, 17676654, 17676655, 17676656, 17676657, 17676658, 17676659, 17676660, 17676661, 17676662, 17676663, 17676664, 17676665, 17676666, 17676667, 17676668, 17676669, 17676670, 17676671, 17676672, 17676673, 17676674, 17676675, 17676676, 17676677, 17676678, 17676679, 17676680, 17676681, 17676682, 17676683, 17676684, 17676685, 17676686, 17676687, 17676688, 17676689, 17676690, 17676691, 17676692, 17676693, 17676694, 17676695, 17676696, 17676697, 17676698, 17676699, 17676700, 17676701, 17676702, 17676703, 17676704, 17676705, 17676706, 17676707, 17676708, 18319657, 18319658, 18319659, 18319660, 18319661, 18319662, 18319663, 18319664, 18319665, 18319666, 18319667, 18319668, 18319669, 18319670, 18319671, 18319672, 18319673, 18319674, 18319675, 18319676, 18319677, 18319678, 18319679, 18319680, 18319681, 18319682, 18319683, 18319684, 18319685, 18319686, 18319687], "trace_timestamp_s": 2158.754000000001, "ttft_s": 0.17671595502179116, "turn_id": 55} +{"actual_output_tokens": 45, "cached_tokens": 41952, "effective_input_length": 42086, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42086, "latency_s": 0.40914864803198725, "output_length": 45, "proxy_request_id": "1340290:23:1886013:1124", "request_id": "1340290:23:1886013:1124", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1340290", "t_dispatch_unix": 1779822900.7025936, "t_finish_unix": 1779822901.1117435, "t_first_token_unix": 1779822900.8253348, "tpot_s": 0.006503814908104356, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18475697], "trace_timestamp_s": 2213.763, "ttft_s": 0.12273952102987096, "turn_id": 23} +{"actual_output_tokens": 98, "cached_tokens": 119376, "effective_input_length": 119440, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119440, "latency_s": 1.2984945200150833, "output_length": 98, "proxy_request_id": "1270606:12:1886765:1125", "request_id": "1270606:12:1886765:1125", "request_type": "coder", "requested_output_tokens": 98, "session_id": "1270606", "t_dispatch_unix": 1779822903.4376059, "t_finish_unix": 1779822904.7361002, "t_first_token_unix": 1779822903.7142973, "tpot_s": 0.010535724237249185, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18483775, 18483776, 18483777, 18483778, 18483779, 18483780, 18483781, 18483782, 18483783, 18483784, 18483785, 18483786, 18483787, 18483788, 18483789, 18483790, 18483791, 18483792, 18483793, 18483794, 18483795, 18483796, 18483797, 18483798, 18483799, 18483800, 18483801, 18483802, 18483803, 18483804, 18483805, 18483806, 18483807, 18483808, 18483809, 18483810, 18483811, 18483812, 18483813, 18483814, 18483815, 18483816, 18483817, 18483818, 18483819, 18483820, 18483821, 18483822, 18483823, 18483824, 18483825, 18483826, 18483827, 18483828, 18483829, 18483830, 18483831, 18483832, 18483833, 18483834, 18483835, 18483836, 18483837, 18483838, 18483839, 18483840, 18483841, 18483842, 18483843, 18483844, 18483845, 18483846, 18483847, 18483848, 18483849, 18483850, 18483851, 18483852, 18483853, 18483854, 18483855, 18483856, 18483857, 18483858, 18483859, 18483860, 18483861, 18483862, 18483863, 18483864, 18483865, 18483866, 18483867, 18483868, 18483869, 18483870, 18483871, 18483872, 18483873, 18483874, 18483875, 18483876, 18483877, 18483878, 18483879, 18483880, 18483881, 18483882, 18483883, 18483884, 18483885, 18483886, 18483887], "trace_timestamp_s": 2216.473, "ttft_s": 0.2762870399747044, "turn_id": 12} +{"actual_output_tokens": 28, "cached_tokens": 42128, "effective_input_length": 42199, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42199, "latency_s": 0.2913763279793784, "output_length": 28, "proxy_request_id": "1340290:24:1887125:1126", "request_id": "1340290:24:1887125:1126", "request_type": "coder", "requested_output_tokens": 28, "session_id": "1340290", "t_dispatch_unix": 1779822904.4797926, "t_finish_unix": 1779822904.7711685, "t_first_token_unix": 1779822904.6074579, "tpot_s": 0.0060550207035029655, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18487325], "trace_timestamp_s": 2217.541, "ttft_s": 0.12766288896091282, "turn_id": 24} +{"actual_output_tokens": 46, "cached_tokens": 42224, "effective_input_length": 42444, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 42444, "latency_s": 0.4613461989792995, "output_length": 46, "proxy_request_id": "1340290:25:1888447:1127", "request_id": "1340290:25:1888447:1127", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1340290", "t_dispatch_unix": 1779822908.8728898, "t_finish_unix": 1779822909.3342361, "t_first_token_unix": 1779822909.0403857, "tpot_s": 0.006523680888737241, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279], "trace_timestamp_s": 2221.934, "ttft_s": 0.16749394097132608, "turn_id": 25} +{"actual_output_tokens": 1188, "cached_tokens": 58512, "effective_input_length": 63845, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 63845, "latency_s": 12.281659307016525, "output_length": 1188, "proxy_request_id": "1277428:20:1885419:1123", "request_id": "1277428:20:1885419:1123", "request_type": "coder", "requested_output_tokens": 1188, "session_id": "1277428", "t_dispatch_unix": 1779822898.5874283, "t_finish_unix": 1779822910.869087, "t_first_token_unix": 1779822900.8128192, "tpot_s": 0.008471758679875974, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 18468806, 18468807, 18468808, 18468809, 18468810, 18468811, 18468812, 18468813, 18468814, 18468815, 18468816, 18468817, 18468818], "trace_timestamp_s": 2211.6440000000002, "ttft_s": 2.225389557017479, "turn_id": 20} +{"actual_output_tokens": 32, "cached_tokens": 42480, "effective_input_length": 48504, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 48504, "latency_s": 2.0984719460248016, "output_length": 32, "proxy_request_id": "1340290:26:1889402:1128", "request_id": "1340290:26:1889402:1128", "request_type": "coder", "requested_output_tokens": 32, "session_id": "1340290", "t_dispatch_unix": 1779822912.1924489, "t_finish_unix": 1779822914.290919, "t_first_token_unix": 1779822914.095044, "tpot_s": 0.006309255386792844, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944], "trace_timestamp_s": 2225.25, "ttft_s": 1.902593031001743, "turn_id": 26} +{"actual_output_tokens": 87, "cached_tokens": 119536, "effective_input_length": 119686, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119686, "latency_s": 1.2967797940364107, "output_length": 87, "proxy_request_id": "1270606:13:1890252:1129", "request_id": "1270606:13:1890252:1129", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1270606", "t_dispatch_unix": 1779822915.1660447, "t_finish_unix": 1779822916.4628239, "t_first_token_unix": 1779822915.5668578, "tpot_s": 0.010415342779218241, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18517741, 18517742, 18517743, 18517744, 18517745, 18517746, 18517747, 18517748, 18517749, 18517750, 18517751, 18517752, 18517753, 18517754, 18517755, 18517756, 18517757, 18517758, 18517759, 18517760, 18517761, 18517762, 18517763, 18517764, 18517765, 18517766, 18517767, 18517768, 18517769, 18517770, 18517771, 18517772, 18517773, 18517774, 18517775, 18517776, 18517777, 18517778, 18517779, 18517780, 18517781, 18517782, 18517783, 18517784, 18517785, 18517786, 18517787, 18517788, 18517789, 18517790, 18517791, 18517792, 18517793, 18517794, 18517795, 18517796, 18517797, 18517798, 18517799, 18517800, 18517801, 18517802, 18517803, 18517804, 18517805, 18517806, 18517807, 18517808, 18517809, 18517810, 18517811, 18517812, 18517813, 18517814, 18517815, 18517816, 18517817, 18517818, 18517819, 18517820, 18517821, 18517822, 18517823, 18517824, 18517825, 18517826, 18517827, 18517828, 18517829, 18517830, 18517831, 18517832, 18517833, 18517834, 18517835, 18517836, 18517837, 18517838, 18517839, 18517840, 18517841, 18517842, 18517843, 18517844, 18517845, 18517846, 18517847, 18517848, 18517849, 18517850, 18517851, 18517852, 18517853], "trace_timestamp_s": 2228.202, "ttft_s": 0.40081051900051534, "turn_id": 13} +{"actual_output_tokens": 47, "cached_tokens": 48528, "effective_input_length": 49361, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49361, "latency_s": 0.7005980139947496, "output_length": 47, "proxy_request_id": "1340290:27:1892591:1131", "request_id": "1340290:27:1892591:1131", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1340290", "t_dispatch_unix": 1779822922.7795763, "t_finish_unix": 1779822923.480174, "t_first_token_unix": 1779822923.1667955, "tpot_s": 0.00680713039195246, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18539337], "trace_timestamp_s": 2235.84, "ttft_s": 0.3872154889977537, "turn_id": 27} +{"actual_output_tokens": 175, "cached_tokens": 119760, "effective_input_length": 119828, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 119828, "latency_s": 2.223753599973861, "output_length": 175, "proxy_request_id": "1270606:14:1892412:1130", "request_id": "1270606:14:1892412:1130", "request_type": "coder", "requested_output_tokens": 175, "session_id": "1270606", "t_dispatch_unix": 1779822922.1124783, "t_finish_unix": 1779822924.3362315, "t_first_token_unix": 1779822922.4050088, "tpot_s": 0.011097534385044128, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18537949, 18537950, 18537951, 18537952, 18537953, 18537954, 18537955, 18537956, 18537957, 18537958, 18537959, 18537960, 18537961, 18537962, 18537963, 18537964, 18537965, 18537966, 18537967, 18537968, 18537969, 18537970, 18537971, 18537972, 18537973, 18537974, 18537975, 18537976, 18537977, 18537978, 18537979, 18537980, 18537981, 18537982, 18537983, 18537984, 18537985, 18537986, 18537987, 18537988, 18537989, 18537990, 18537991, 18537992, 18537993, 18537994, 18537995, 18537996, 18537997, 18537998, 18537999, 18538000, 18538001, 18538002, 18538003, 18538004, 18538005, 18538006, 18538007, 18538008, 18538009, 18538010, 18538011, 18538012, 18538013, 18538014, 18538015, 18538016, 18538017, 18538018, 18538019, 18538020, 18538021, 18538022, 18538023, 18538024, 18538025, 18538026, 18538027, 18538028, 18538029, 18538030, 18538031, 18538032, 18538033, 18538034, 18538035, 18538036, 18538037, 18538038, 18538039, 18538040, 18538041, 18538042, 18538043, 18538044, 18538045, 18538046, 18538047, 18538048, 18538049, 18538050, 18538051, 18538052, 18538053, 18538054, 18538055, 18538056, 18538057, 18538058, 18538059, 18538060, 18538061, 18538062], "trace_timestamp_s": 2235.143, "ttft_s": 0.29252799396635965, "turn_id": 14} +{"actual_output_tokens": 38, "cached_tokens": 49392, "effective_input_length": 49454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49454, "latency_s": 0.36858810199191794, "output_length": 38, "proxy_request_id": "1340290:28:1893837:1132", "request_id": "1340290:28:1893837:1132", "request_type": "coder", "requested_output_tokens": 38, "session_id": "1340290", "t_dispatch_unix": 1779822927.0882468, "t_finish_unix": 1779822927.4568346, "t_first_token_unix": 1779822927.215431, "tpot_s": 0.006518199135285072, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462], "trace_timestamp_s": 2240.1460000000006, "ttft_s": 0.12718172400491312, "turn_id": 28} +{"actual_output_tokens": 80, "cached_tokens": 58912, "effective_input_length": 59265, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59265, "latency_s": 0.9500108429929242, "output_length": 80, "proxy_request_id": "1305906:9:1893880:1133", "request_id": "1305906:9:1893880:1133", "request_type": "coder", "requested_output_tokens": 80, "session_id": "1305906", "t_dispatch_unix": 1779822927.2535007, "t_finish_unix": 1779822928.2035117, "t_first_token_unix": 1779822927.6036603, "tpot_s": 0.007589901784947731, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509], "trace_timestamp_s": 2240.313, "ttft_s": 0.35015750100137666, "turn_id": 9} +{"actual_output_tokens": 91, "cached_tokens": 120000, "effective_input_length": 120058, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 120058, "latency_s": 1.2585174099658616, "output_length": 91, "proxy_request_id": "1270606:15:1895310:1134", "request_id": "1270606:15:1895310:1134", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1270606", "t_dispatch_unix": 1779822931.9002886, "t_finish_unix": 1779822933.1588051, "t_first_token_unix": 1779822932.206429, "tpot_s": 0.010578771033194951, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18566130, 18566131, 18566132, 18566133, 18566134, 18566135, 18566136, 18566137, 18566138, 18566139, 18566140, 18566141, 18566142, 18566143, 18566144, 18566145, 18566146, 18566147, 18566148, 18566149, 18566150, 18566151, 18566152, 18566153, 18566154, 18566155, 18566156, 18566157, 18566158, 18566159, 18566160, 18566161, 18566162, 18566163, 18566164, 18566165, 18566166, 18566167, 18566168, 18566169, 18566170, 18566171, 18566172, 18566173, 18566174, 18566175, 18566176, 18566177, 18566178, 18566179, 18566180, 18566181, 18566182, 18566183, 18566184, 18566185, 18566186, 18566187, 18566188, 18566189, 18566190, 18566191, 18566192, 18566193, 18566194, 18566195, 18566196, 18566197, 18566198, 18566199, 18566200, 18566201, 18566202, 18566203, 18566204, 18566205, 18566206, 18566207, 18566208, 18566209, 18566210, 18566211, 18566212, 18566213, 18566214, 18566215, 18566216, 18566217, 18566218, 18566219, 18566220, 18566221, 18566222, 18566223, 18566224, 18566225, 18566226, 18566227, 18566228, 18566229, 18566230, 18566231, 18566232, 18566233, 18566234, 18566235, 18566236, 18566237, 18566238, 18566239, 18566240, 18566241, 18566242], "trace_timestamp_s": 2244.9320000000007, "ttft_s": 0.3061382200103253, "turn_id": 15} +{"actual_output_tokens": 37, "cached_tokens": 49488, "effective_input_length": 49576, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49576, "latency_s": 0.3649956570006907, "output_length": 37, "proxy_request_id": "1340290:29:1896119:1136", "request_id": "1340290:29:1896119:1136", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1340290", "t_dispatch_unix": 1779822934.412104, "t_finish_unix": 1779822934.7770996, "t_first_token_unix": 1779822934.5351343, "tpot_s": 0.006714390055599829, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462], "trace_timestamp_s": 2247.473, "ttft_s": 0.12302845501108095, "turn_id": 29} +{"actual_output_tokens": 200, "cached_tokens": 135632, "effective_input_length": 135905, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 135905, "latency_s": 2.8830134689924307, "output_length": 200, "proxy_request_id": "1356885:13:1895311:1135", "request_id": "1356885:13:1895311:1135", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1356885", "t_dispatch_unix": 1779822931.912147, "t_finish_unix": 1779822934.7951603, "t_first_token_unix": 1779822932.4142673, "tpot_s": 0.011963375673240902, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 18566244], "trace_timestamp_s": 2244.933, "ttft_s": 0.5021178930182941, "turn_id": 13} +{"actual_output_tokens": 200, "cached_tokens": 49600, "effective_input_length": 49695, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49695, "latency_s": 1.6140818599960767, "output_length": 200, "proxy_request_id": "1340290:30:1896991:1137", "request_id": "1340290:30:1896991:1137", "request_type": "coder", "requested_output_tokens": 200, "session_id": "1340290", "t_dispatch_unix": 1779822937.3860672, "t_finish_unix": 1779822939.000149, "t_first_token_unix": 1779822937.5199533, "tpot_s": 0.007436980316403729, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18582285], "trace_timestamp_s": 2250.4440000000004, "ttft_s": 0.13387287699151784, "turn_id": 30} +{"actual_output_tokens": 89, "cached_tokens": 49888, "effective_input_length": 49927, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 49927, "latency_s": 0.7528319090488367, "output_length": 89, "proxy_request_id": "1340290:31:1899492:1138", "request_id": "1340290:31:1899492:1138", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1340290", "t_dispatch_unix": 1779822945.7705863, "t_finish_unix": 1779822946.5234182, "t_first_token_unix": 1779822945.8784583, "tpot_s": 0.007326498226823539, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609], "trace_timestamp_s": 2258.8240000000005, "ttft_s": 0.10786973003996536, "turn_id": 31} +{"actual_output_tokens": 89, "cached_tokens": 120144, "effective_input_length": 120572, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 120572, "latency_s": 1.695176430977881, "output_length": 89, "proxy_request_id": "1270606:16:1902252:1140", "request_id": "1270606:16:1902252:1140", "request_type": "coder", "requested_output_tokens": 89, "session_id": "1270606", "t_dispatch_unix": 1779822954.262389, "t_finish_unix": 1779822955.957565, "t_first_token_unix": 1779822955.0298588, "tpot_s": 0.010537616863571615, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18635959, 18635960, 18635961, 18635962, 18635963, 18635964, 18635965, 18635966, 18635967, 18635968, 18635969, 18635970, 18635971, 18635972, 18635973, 18635974, 18635975, 18635976, 18635977, 18635978, 18635979, 18635980, 18635981, 18635982, 18635983, 18635984, 18635985, 18635986, 18635987, 18635988, 18635989, 18635990, 18635991, 18635992, 18635993, 18635994, 18635995, 18635996, 18635997, 18635998, 18635999, 18636000, 18636001, 18636002, 18636003, 18636004, 18636005, 18636006, 18636007, 18636008, 18636009, 18636010, 18636011, 18636012, 18636013, 18636014, 18636015, 18636016, 18636017, 18636018, 18636019, 18636020, 18636021, 18636022, 18636023, 18636024, 18636025, 18636026, 18636027, 18636028, 18636029, 18636030, 18636031, 18636032, 18636033, 18636034, 18636035, 18636036, 18636037, 18636038, 18636039, 18636040, 18636041, 18636042, 18636043, 18636044, 18636045, 18636046, 18636047, 18636048, 18636049, 18636050, 18636051, 18636052, 18636053, 18636054, 18636055, 18636056, 18636057, 18636058, 18636059, 18636060, 18636061, 18636062, 18636063, 18636064, 18636065, 18636066, 18636067, 18636068, 18636069, 18636070, 18636071], "trace_timestamp_s": 2267.299, "ttft_s": 0.7674673869623803, "turn_id": 16} +{"actual_output_tokens": 60, "cached_tokens": 120656, "effective_input_length": 121006, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121006, "latency_s": 1.2139194149640389, "output_length": 60, "proxy_request_id": "1270606:17:1908800:1141", "request_id": "1270606:17:1908800:1141", "request_type": "coder", "requested_output_tokens": 60, "session_id": "1270606", "t_dispatch_unix": 1779822975.8581624, "t_finish_unix": 1779822977.0720816, "t_first_token_unix": 1779822976.4843426, "tpot_s": 0.009956987898291672, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18700457, 18700458, 18700459, 18700460, 18700461, 18700462, 18700463, 18700464, 18700465, 18700466, 18700467, 18700468, 18700469, 18700470, 18700471, 18700472, 18700473, 18700474, 18700475, 18700476, 18700477, 18700478, 18700479, 18700480, 18700481, 18700482, 18700483, 18700484, 18700485, 18700486, 18700487, 18700488, 18700489, 18700490, 18700491, 18700492, 18700493, 18700494, 18700495, 18700496, 18700497, 18700498, 18700499, 18700500, 18700501, 18700502, 18700503, 18700504, 18700505, 18700506, 18700507, 18700508, 18700509, 18700510, 18700511, 18700512, 18700513, 18700514, 18700515, 18700516, 18700517, 18700518, 18700519, 18700520, 18700521, 18700522, 18700523, 18700524, 18700525, 18700526, 18700527, 18700528, 18700529, 18700530, 18700531, 18700532, 18700533, 18700534, 18700535, 18700536, 18700537, 18700538, 18700539, 18700540, 18700541, 18700542, 18700543, 18700544, 18700545, 18700546, 18700547, 18700548, 18700549, 18700550, 18700551, 18700552, 18700553, 18700554, 18700555, 18700556, 18700557, 18700558, 18700559, 18700560, 18700561, 18700562, 18700563, 18700564, 18700565, 18700566, 18700567, 18700568, 18700569], "trace_timestamp_s": 2288.8940000000002, "ttft_s": 0.6261780869681388, "turn_id": 17} +{"actual_output_tokens": 3883, "cached_tokens": 50000, "effective_input_length": 50078, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 50078, "latency_s": 30.446272959990893, "output_length": 3883, "proxy_request_id": "1340290:32:1901260:1139", "request_id": "1340290:32:1901260:1139", "request_type": "coder", "requested_output_tokens": 3883, "session_id": "1340290", "t_dispatch_unix": 1779822951.1804256, "t_finish_unix": 1779822981.6266983, "t_first_token_unix": 1779822951.319641, "tpot_s": 0.0078070038003657, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609], "trace_timestamp_s": 2264.237, "ttft_s": 0.1392133209737949, "turn_id": 32} +{"actual_output_tokens": 82, "cached_tokens": 121056, "effective_input_length": 121288, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121288, "latency_s": 1.255401725997217, "output_length": 82, "proxy_request_id": "1270606:18:1915824:1142", "request_id": "1270606:18:1915824:1142", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1270606", "t_dispatch_unix": 1779822998.8392928, "t_finish_unix": 1779823000.0946937, "t_first_token_unix": 1779822999.2536647, "tpot_s": 0.010379689210238234, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18770157, 18770158, 18770159, 18770160, 18770161, 18770162, 18770163, 18770164, 18770165, 18770166, 18770167, 18770168, 18770169, 18770170, 18770171, 18770172, 18770173, 18770174, 18770175, 18770176, 18770177, 18770178, 18770179, 18770180, 18770181, 18770182, 18770183, 18770184, 18770185, 18770186, 18770187, 18770188, 18770189, 18770190, 18770191, 18770192, 18770193, 18770194, 18770195, 18770196, 18770197, 18770198, 18770199, 18770200, 18770201, 18770202, 18770203, 18770204, 18770205, 18770206, 18770207, 18770208, 18770209, 18770210, 18770211, 18770212, 18770213, 18770214, 18770215, 18770216, 18770217, 18770218, 18770219, 18770220, 18770221, 18770222, 18770223, 18770224, 18770225, 18770226, 18770227, 18770228, 18770229, 18770230, 18770231, 18770232, 18770233, 18770234, 18770235, 18770236, 18770237, 18770238, 18770239, 18770240, 18770241, 18770242, 18770243, 18770244, 18770245, 18770246, 18770247, 18770248, 18770249, 18770250, 18770251, 18770252, 18770253, 18770254, 18770255, 18770256, 18770257, 18770258, 18770259, 18770260, 18770261, 18770262, 18770263, 18770264, 18770265, 18770266, 18770267, 18770268, 18770269], "trace_timestamp_s": 2311.8590000000004, "ttft_s": 0.4143699199776165, "turn_id": 18} +{"actual_output_tokens": 91, "cached_tokens": 121360, "effective_input_length": 121560, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121560, "latency_s": 1.362459581985604, "output_length": 91, "proxy_request_id": "1270606:19:1920499:1143", "request_id": "1270606:19:1920499:1143", "request_type": "coder", "requested_output_tokens": 91, "session_id": "1270606", "t_dispatch_unix": 1779823013.991143, "t_finish_unix": 1779823015.353602, "t_first_token_unix": 1779823014.404255, "tpot_s": 0.010545466599675516, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18814461, 18814462, 18814463, 18814464, 18814465, 18814466, 18814467, 18814468, 18814469, 18814470, 18814471, 18814472, 18814473, 18814474, 18814475, 18814476, 18814477, 18814478, 18814479, 18814480, 18814481, 18814482, 18814483, 18814484, 18814485, 18814486, 18814487, 18814488, 18814489, 18814490, 18814491, 18814492, 18814493, 18814494, 18814495, 18814496, 18814497, 18814498, 18814499, 18814500, 18814501, 18814502, 18814503, 18814504, 18814505, 18814506, 18814507, 18814508, 18814509, 18814510, 18814511, 18814512, 18814513, 18814514, 18814515, 18814516, 18814517, 18814518, 18814519, 18814520, 18814521, 18814522, 18814523, 18814524, 18814525, 18814526, 18814527, 18814528, 18814529, 18814530, 18814531, 18814532, 18814533, 18814534, 18814535, 18814536, 18814537, 18814538, 18814539, 18814540, 18814541, 18814542, 18814543, 18814544, 18814545, 18814546, 18814547, 18814548, 18814549, 18814550, 18814551, 18814552, 18814553, 18814554, 18814555, 18814556, 18814557, 18814558, 18814559, 18814560, 18814561, 18814562, 18814563, 18814564, 18814565, 18814566, 18814567, 18814568, 18814569, 18814570, 18814571, 18814572, 18814573, 18814574], "trace_timestamp_s": 2327.013, "ttft_s": 0.4131097299978137, "turn_id": 19} +{"actual_output_tokens": 120, "cached_tokens": 121648, "effective_input_length": 121704, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 121704, "latency_s": 1.562629393010866, "output_length": 120, "proxy_request_id": "1270606:20:1922639:1144", "request_id": "1270606:20:1922639:1144", "request_type": "coder", "requested_output_tokens": 120, "session_id": "1270606", "t_dispatch_unix": 1779823021.4305747, "t_finish_unix": 1779823022.9932032, "t_first_token_unix": 1779823021.7049215, "tpot_s": 0.01082353770611573, "trace_hash_ids": [3888, 3889, 3890, 3891, 3892, 3893, 3894, 41971, 41972, 41973, 41974, 3659190, 3659191, 1242153, 690661, 699491, 699492, 3659192, 3659193, 237473, 237474, 326423, 3659194, 235260, 235261, 235262, 235263, 235264, 3659195, 3659196, 3659197, 3659198, 3659199, 3659200, 3659201, 3659202, 3659203, 3659204, 3659205, 3659206, 3659207, 3659208, 3659209, 3659210, 3659211, 3659212, 3659213, 3659214, 3659215, 3659216, 3659217, 3659218, 3659219, 3659220, 3659221, 3659222, 3659223, 3659224, 3659225, 3659226, 3659227, 3659228, 3659229, 3659230, 3659231, 3659232, 3659233, 3659234, 3659235, 3659236, 3659237, 3659238, 3659239, 3659240, 3659241, 3659242, 3659243, 3659244, 3659245, 3659246, 3659247, 3659248, 3659249, 3659250, 3659251, 3659252, 3659253, 3659254, 3659255, 3659256, 3659257, 3659258, 3659259, 3659260, 12643739, 13959614, 15532598, 15532599, 15532600, 15532601, 17689044, 17689045, 17689046, 17689047, 17689048, 17689049, 18302625, 18302626, 18302627, 18302628, 18302629, 18302630, 18302631, 18302632, 18302633, 18302634, 18302635, 18302636, 18387420, 18428323, 18483774, 18566129, 18635958, 18700456, 18814461, 18833388, 18833389, 18833390, 18833391, 18833392, 18833393, 18833394, 18833395, 18833396, 18833397, 18833398, 18833399, 18833400, 18833401, 18833402, 18833403, 18833404, 18833405, 18833406, 18833407, 18833408, 18833409, 18833410, 18833411, 18833412, 18833413, 18833414, 18833415, 18833416, 18833417, 18833418, 18833419, 18833420, 18833421, 18833422, 18833423, 18833424, 18833425, 18833426, 18833427, 18833428, 18833429, 18833430, 18833431, 18833432, 18833433, 18833434, 18833435, 18833436, 18833437, 18833438, 18833439, 18833440, 18833441, 18833442, 18833443, 18833444, 18833445, 18833446, 18833447, 18833448, 18833449, 18833450, 18833451, 18833452, 18833453, 18833454, 18833455, 18833456, 18833457, 18833458, 18833459, 18833460, 18833461, 18833462, 18833463, 18833464, 18833465, 18833466, 18833467, 18833468, 18833469, 18833470, 18833471, 18833472, 18833473, 18833474, 18833475, 18833476, 18833477, 18833478, 18833479, 18833480, 18833481, 18833482, 18833483, 18833484, 18833485, 18833486, 18833487, 18833488, 18833489, 18833490, 18833491, 18833492, 18833493, 18833494, 18833495, 18833496, 18833497, 18833498, 18833499, 18833500], "trace_timestamp_s": 2334.46, "ttft_s": 0.27434467000421137, "turn_id": 20} +{"actual_output_tokens": 48, "cached_tokens": 59344, "effective_input_length": 61801, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61801, "latency_s": 1.396665827021934, "output_length": 48, "proxy_request_id": "1305906:10:1928316:1145", "request_id": "1305906:10:1928316:1145", "request_type": "coder", "requested_output_tokens": 48, "session_id": "1305906", "t_dispatch_unix": 1779823040.000407, "t_finish_unix": 1779823041.3970723, "t_first_token_unix": 1779823041.0548618, "tpot_s": 0.007275535722580204, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509, 18736108, 18851869, 18889037, 18889038, 18889039], "trace_timestamp_s": 2353.0420000000004, "ttft_s": 1.054451987030916, "turn_id": 10} +{"actual_output_tokens": 142, "cached_tokens": 53952, "effective_input_length": 53990, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 53990, "latency_s": 1.1897145589464344, "output_length": 142, "proxy_request_id": "1340290:33:1939781:1146", "request_id": "1340290:33:1939781:1146", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1340290", "t_dispatch_unix": 1779823077.761656, "t_finish_unix": 1779823078.9513702, "t_first_token_unix": 1779823077.8749862, "tpot_s": 0.007632279496537588, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 18997503], "trace_timestamp_s": 2390.7840000000006, "ttft_s": 0.11332787096034735, "turn_id": 33} +{"actual_output_tokens": 314, "cached_tokens": 54128, "effective_input_length": 54164, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54164, "latency_s": 2.5508475059759803, "output_length": 314, "proxy_request_id": "1340290:34:1942249:1147", "request_id": "1340290:34:1942249:1147", "request_type": "coder", "requested_output_tokens": 314, "session_id": "1340290", "t_dispatch_unix": 1779823085.601893, "t_finish_unix": 1779823088.1527395, "t_first_token_unix": 1779823085.7121785, "tpot_s": 0.007796230035076757, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002], "trace_timestamp_s": 2398.6550000000007, "ttft_s": 0.11028350400738418, "turn_id": 34} +{"actual_output_tokens": 142, "cached_tokens": 136096, "effective_input_length": 136210, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136210, "latency_s": 2.044301263988018, "output_length": 142, "proxy_request_id": "1356885:14:1948151:1148", "request_id": "1356885:14:1948151:1148", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1356885", "t_dispatch_unix": 1779823105.3576057, "t_finish_unix": 1779823107.4019065, "t_first_token_unix": 1779823105.7345116, "tpot_s": 0.011823341021304355, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19076313], "trace_timestamp_s": 2418.398, "ttft_s": 0.3769036770099774, "turn_id": 14} +{"actual_output_tokens": 480, "cached_tokens": 54464, "effective_input_length": 54498, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54498, "latency_s": 3.8691297809709795, "output_length": 480, "proxy_request_id": "1340290:35:1964727:1149", "request_id": "1340290:35:1964727:1149", "request_type": "coder", "requested_output_tokens": 480, "session_id": "1340290", "t_dispatch_unix": 1779823160.0836427, "t_finish_unix": 1779823163.952772, "t_first_token_unix": 1779823160.1971762, "tpot_s": 0.007839841004154822, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19236085], "trace_timestamp_s": 2473.0910000000003, "ttft_s": 0.11353148595662788, "turn_id": 35} +{"actual_output_tokens": 62, "cached_tokens": 54800, "effective_input_length": 54811, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 54811, "latency_s": 0.5406496459618211, "output_length": 62, "proxy_request_id": "1340290:36:1969509:1150", "request_id": "1340290:36:1969509:1150", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1340290", "t_dispatch_unix": 1779823175.8348267, "t_finish_unix": 1779823176.3754756, "t_first_token_unix": 1779823175.9340641, "tpot_s": 0.007230799475333608, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19281054], "trace_timestamp_s": 2488.8830000000007, "ttft_s": 0.09923568199155852, "turn_id": 36} +{"actual_output_tokens": 62, "cached_tokens": 54864, "effective_input_length": 55358, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 55358, "latency_s": 0.7610437839757651, "output_length": 62, "proxy_request_id": "1340290:37:1971106:1151", "request_id": "1340290:37:1971106:1151", "request_type": "coder", "requested_output_tokens": 62, "session_id": "1340290", "t_dispatch_unix": 1779823180.9789371, "t_finish_unix": 1779823181.7399802, "t_first_token_unix": 1779823181.2912073, "tpot_s": 0.007352883065859864, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19296412], "trace_timestamp_s": 2494.0340000000006, "ttft_s": 0.3122676970087923, "turn_id": 37} +{"actual_output_tokens": 87, "cached_tokens": 55408, "effective_input_length": 56006, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56006, "latency_s": 0.9726439649821259, "output_length": 87, "proxy_request_id": "1340290:38:1972289:1152", "request_id": "1340290:38:1972289:1152", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779823184.9073536, "t_finish_unix": 1779823185.8799973, "t_first_token_unix": 1779823185.2311423, "tpot_s": 0.007541835139543468, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19308727], "trace_timestamp_s": 2497.964, "ttft_s": 0.32378668000455946, "turn_id": 38} +{"actual_output_tokens": 87, "cached_tokens": 56080, "effective_input_length": 56242, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56242, "latency_s": 0.8543742769979872, "output_length": 87, "proxy_request_id": "1340290:39:1973889:1153", "request_id": "1340290:39:1973889:1153", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779823190.3338635, "t_finish_unix": 1779823191.188237, "t_first_token_unix": 1779823190.5378942, "tpot_s": 0.007559370034953666, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773], "trace_timestamp_s": 2503.389, "ttft_s": 0.20402867998927832, "turn_id": 39} +{"actual_output_tokens": 65, "cached_tokens": 56320, "effective_input_length": 56416, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 56416, "latency_s": 0.6066915820119902, "output_length": 65, "proxy_request_id": "1340290:40:1975278:1154", "request_id": "1340290:40:1975278:1154", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779823194.8949122, "t_finish_unix": 1779823195.5016036, "t_first_token_unix": 1779823195.026607, "tpot_s": 0.007417736015668197, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19337746], "trace_timestamp_s": 2507.952, "ttft_s": 0.1316923350095749, "turn_id": 40} +{"actual_output_tokens": 250, "cached_tokens": 56480, "effective_input_length": 57181, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57181, "latency_s": 2.3923447690322064, "output_length": 250, "proxy_request_id": "1340290:41:1977055:1156", "request_id": "1340290:41:1977055:1156", "request_type": "coder", "requested_output_tokens": 250, "session_id": "1340290", "t_dispatch_unix": 1779823200.831274, "t_finish_unix": 1779823203.2236187, "t_first_token_unix": 1779823201.2633424, "tpot_s": 0.007871427690847796, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819], "trace_timestamp_s": 2513.8910000000005, "ttft_s": 0.432065644999966, "turn_id": 41} +{"actual_output_tokens": 677, "cached_tokens": 65024, "effective_input_length": 67793, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 67793, "latency_s": 7.096386615012307, "output_length": 677, "proxy_request_id": "1277428:21:1976968:1155", "request_id": "1277428:21:1976968:1155", "request_type": "coder", "requested_output_tokens": 677, "session_id": "1277428", "t_dispatch_unix": 1779823200.545873, "t_finish_unix": 1779823207.6422596, "t_first_token_unix": 1779823201.818112, "tpot_s": 0.008615171539903061, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19354134, 19354135, 19354136, 19354137, 19354138, 19354139, 19354140, 19354141, 19354142, 19354143, 19354144], "trace_timestamp_s": 2513.5970000000007, "ttft_s": 1.2722368510439992, "turn_id": 21} +{"actual_output_tokens": 66, "cached_tokens": 57424, "effective_input_length": 57463, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57463, "latency_s": 0.5974888769560494, "output_length": 66, "proxy_request_id": "1340290:42:1982198:1157", "request_id": "1340290:42:1982198:1157", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1340290", "t_dispatch_unix": 1779823217.7323768, "t_finish_unix": 1779823218.3298655, "t_first_token_unix": 1779823217.8662722, "tpot_s": 0.0071281243688785115, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19402723], "trace_timestamp_s": 2530.7870000000003, "ttft_s": 0.13389192399336025, "turn_id": 42} +{"actual_output_tokens": 68, "cached_tokens": 57520, "effective_input_length": 57640, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57640, "latency_s": 0.6755404509603977, "output_length": 68, "proxy_request_id": "1340290:43:1983901:1158", "request_id": "1340290:43:1983901:1158", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779823223.1301937, "t_finish_unix": 1779823223.8057337, "t_first_token_unix": 1779823223.3001974, "tpot_s": 0.007541283939916418, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878], "trace_timestamp_s": 2536.1860000000006, "ttft_s": 0.17000210098922253, "turn_id": 43} +{"actual_output_tokens": 92, "cached_tokens": 57696, "effective_input_length": 57809, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 57809, "latency_s": 0.8730591629864648, "output_length": 92, "proxy_request_id": "1340290:44:1986230:1159", "request_id": "1340290:44:1986230:1159", "request_type": "coder", "requested_output_tokens": 92, "session_id": "1340290", "t_dispatch_unix": 1779823231.2128167, "t_finish_unix": 1779823232.0858757, "t_first_token_unix": 1779823231.386097, "tpot_s": 0.007687163538591179, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878], "trace_timestamp_s": 2544.2660000000005, "ttft_s": 0.1732781159807928, "turn_id": 44} +{"actual_output_tokens": 45, "cached_tokens": 68464, "effective_input_length": 69987, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69987, "latency_s": 1.1200991210062057, "output_length": 45, "proxy_request_id": "1277428:21:1989132:1160", "request_id": "1277428:21:1989132:1160", "request_type": "coder", "requested_output_tokens": 45, "session_id": "1277428", "t_dispatch_unix": 1779823240.6304276, "t_finish_unix": 1779823241.7505262, "t_first_token_unix": 1779823241.4179251, "tpot_s": 0.0075533089085101065, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19467851, 19467852, 19467853, 19467854, 19467855, 19467856, 19467857, 19467858, 19467859, 19467860, 19467861, 19467862, 19467863, 19467864, 19467865], "trace_timestamp_s": 2553.679, "ttft_s": 0.7874954480212182, "turn_id": 21} +{"actual_output_tokens": 52, "cached_tokens": 70016, "effective_input_length": 70055, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70055, "latency_s": 0.5324836560175754, "output_length": 52, "proxy_request_id": "1277428:22:1990436:1161", "request_id": "1277428:22:1990436:1161", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1277428", "t_dispatch_unix": 1779823245.1706889, "t_finish_unix": 1779823245.7031722, "t_first_token_unix": 1779823245.307164, "tpot_s": 0.0077595511170597195, "trace_hash_ids": [1143, 1144, 697, 5765, 5766, 5767, 5768, 5769, 5770, 7594, 7595, 7596, 7597, 7598, 7599, 7600, 7601, 7602, 7603, 7604, 7605, 7606, 7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615, 7616, 7617, 7618, 12713176, 107108, 107109, 107110, 161463, 12713177, 40585, 40586, 40587, 199395, 199396, 12713178, 12713179, 12713180, 12713181, 12713182, 12713183, 13969049, 13969050, 13969051, 13969052, 13969053, 13969054, 13969055, 13969056, 13969057, 13969058, 13969059, 13969060, 13969061, 13969062, 13969063, 13969064, 13969065, 13969066, 13969067, 13969068, 13969069, 13969070, 13969071, 13969072, 13969073, 13969074, 13969075, 14911402, 14911403, 14911404, 14911405, 14911406, 14911407, 14911408, 14911409, 17338209, 17338210, 17338211, 17338212, 17338213, 17338214, 17338215, 17338216, 17338217, 17338218, 17338219, 17970597, 17970598, 17970599, 17970600, 17970601, 17970602, 17970603, 17970604, 17970605, 17970606, 18468801, 18468802, 18468803, 18468804, 18468805, 19354124, 19354125, 19354126, 19354127, 19354128, 19354129, 19354130, 19354131, 19354132, 19354133, 19467851, 19467852, 19467853, 19467854, 19479910, 19479911, 19479912, 19479913, 19479914, 19479915, 19479916, 19479917, 19479918, 19479919, 19479920], "trace_timestamp_s": 2558.2250000000004, "ttft_s": 0.1364731690264307, "turn_id": 22} +{"actual_output_tokens": 36, "cached_tokens": 57888, "effective_input_length": 58053, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58053, "latency_s": 0.451928589027375, "output_length": 36, "proxy_request_id": "1340290:45:1991694:1162", "request_id": "1340290:45:1991694:1162", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779823249.1862512, "t_finish_unix": 1779823249.6381795, "t_first_token_unix": 1779823249.3966968, "tpot_s": 0.006891886229693357, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19491520], "trace_timestamp_s": 2562.2430000000004, "ttft_s": 0.21044295298634097, "turn_id": 45} +{"actual_output_tokens": 56, "cached_tokens": 58080, "effective_input_length": 58122, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58122, "latency_s": 0.5252005470101722, "output_length": 56, "proxy_request_id": "1340290:46:1992980:1163", "request_id": "1340290:46:1992980:1163", "request_type": "coder", "requested_output_tokens": 56, "session_id": "1340290", "t_dispatch_unix": 1779823253.411085, "t_finish_unix": 1779823253.9362855, "t_first_token_unix": 1779823253.532588, "tpot_s": 0.0073356086906807665, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2566.4670000000006, "ttft_s": 0.12149939802475274, "turn_id": 46} +{"actual_output_tokens": 36, "cached_tokens": 58176, "effective_input_length": 58307, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58307, "latency_s": 0.4002806440112181, "output_length": 36, "proxy_request_id": "1340290:47:1995358:1164", "request_id": "1340290:47:1995358:1164", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779823261.2733593, "t_finish_unix": 1779823261.67364, "t_first_token_unix": 1779823261.4327075, "tpot_s": 0.0068765119998715814, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2574.327, "ttft_s": 0.15934571798425168, "turn_id": 47} +{"actual_output_tokens": 251, "cached_tokens": 58336, "effective_input_length": 58339, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58339, "latency_s": 2.09985721798148, "output_length": 251, "proxy_request_id": "1340290:48:1996945:1165", "request_id": "1340290:48:1996945:1165", "request_type": "coder", "requested_output_tokens": 251, "session_id": "1340290", "t_dispatch_unix": 1779823266.57827, "t_finish_unix": 1779823268.6781268, "t_first_token_unix": 1779823266.6762822, "tpot_s": 0.008006276076193898, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652], "trace_timestamp_s": 2579.634, "ttft_s": 0.09801039297599345, "turn_id": 48} +{"actual_output_tokens": 140, "cached_tokens": 136336, "effective_input_length": 136653, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136653, "latency_s": 2.346003891027067, "output_length": 140, "proxy_request_id": "1356885:15:1998292:1166", "request_id": "1356885:15:1998292:1166", "request_type": "coder", "requested_output_tokens": 140, "session_id": "1356885", "t_dispatch_unix": 1779823271.0391, "t_finish_unix": 1779823273.3851035, "t_first_token_unix": 1779823271.7438676, "tpot_s": 0.01180563561857859, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016], "trace_timestamp_s": 2584.094, "ttft_s": 0.7047653190093115, "turn_id": 15} +{"actual_output_tokens": 78, "cached_tokens": 58576, "effective_input_length": 58622, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58622, "latency_s": 0.7047166309785098, "output_length": 78, "proxy_request_id": "1340290:48:1999591:1167", "request_id": "1340290:48:1999591:1167", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1340290", "t_dispatch_unix": 1779823275.5942247, "t_finish_unix": 1779823276.2989407, "t_first_token_unix": 1779823275.7128203, "tpot_s": 0.0076088977013049385, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958], "trace_timestamp_s": 2588.652, "ttft_s": 0.11859354597982019, "turn_id": 48} +{"actual_output_tokens": 68, "cached_tokens": 58688, "effective_input_length": 58808, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58808, "latency_s": 0.6794702280312777, "output_length": 68, "proxy_request_id": "1340290:48:2001313:1168", "request_id": "1340290:48:2001313:1168", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779823281.0604908, "t_finish_unix": 1779823281.7399604, "t_first_token_unix": 1779823281.2355263, "tpot_s": 0.00752533317904975, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958], "trace_timestamp_s": 2594.116, "ttft_s": 0.17503387603210285, "turn_id": 48} +{"actual_output_tokens": 113, "cached_tokens": 58864, "effective_input_length": 58977, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 58977, "latency_s": 1.0460049390094355, "output_length": 113, "proxy_request_id": "1340290:48:2003195:1169", "request_id": "1340290:48:2003195:1169", "request_type": "coder", "requested_output_tokens": 113, "session_id": "1340290", "t_dispatch_unix": 1779823287.3846498, "t_finish_unix": 1779823288.4306545, "t_first_token_unix": 1779823287.5611649, "tpot_s": 0.007761038437560533, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19598292], "trace_timestamp_s": 2600.4390000000003, "ttft_s": 0.17651307804044336, "turn_id": 48} +{"actual_output_tokens": 108, "cached_tokens": 59088, "effective_input_length": 59220, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59220, "latency_s": 0.9903762030298822, "output_length": 108, "proxy_request_id": "1340290:48:2005449:1170", "request_id": "1340290:48:2005449:1170", "request_type": "coder", "requested_output_tokens": 108, "session_id": "1340290", "t_dispatch_unix": 1779823294.7737603, "t_finish_unix": 1779823295.7641366, "t_first_token_unix": 1779823294.9324322, "tpot_s": 0.007769910093161895, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999], "trace_timestamp_s": 2607.8280000000004, "ttft_s": 0.15866985003231093, "turn_id": 48} +{"actual_output_tokens": 52, "cached_tokens": 59312, "effective_input_length": 59487, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 59487, "latency_s": 0.5854158700094558, "output_length": 52, "proxy_request_id": "1340290:48:2007287:1171", "request_id": "1340290:48:2007287:1171", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1340290", "t_dispatch_unix": 1779823300.899186, "t_finish_unix": 1779823301.4846013, "t_first_token_unix": 1779823301.1126142, "tpot_s": 0.007288042314387127, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19641799], "trace_timestamp_s": 2613.9540000000006, "ttft_s": 0.21342581597855315, "turn_id": 48} +{"actual_output_tokens": 88, "cached_tokens": 59536, "effective_input_length": 60935, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 60935, "latency_s": 1.3627694070455618, "output_length": 88, "proxy_request_id": "1340290:48:2008380:1173", "request_id": "1340290:48:2008380:1173", "request_type": "coder", "requested_output_tokens": 88, "session_id": "1340290", "t_dispatch_unix": 1779823305.0019255, "t_finish_unix": 1779823306.3646946, "t_first_token_unix": 1779823305.6879885, "tpot_s": 0.007775209896967629, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19653243], "trace_timestamp_s": 2618.0600000000004, "ttft_s": 0.6860608420101926, "turn_id": 48} +{"actual_output_tokens": 278, "cached_tokens": 61840, "effective_input_length": 66506, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 66506, "latency_s": 4.289066230994649, "output_length": 278, "proxy_request_id": "1305906:11:2008110:1172", "request_id": "1305906:11:2008110:1172", "request_type": "coder", "requested_output_tokens": 278, "session_id": "1305906", "t_dispatch_unix": 1779823303.9903116, "t_finish_unix": 1779823308.2793772, "t_first_token_unix": 1779823305.958119, "tpot_s": 0.008378933671574421, "trace_hash_ids": [81015, 119408, 119409, 119410, 119411, 119412, 119413, 119414, 119415, 119416, 119417, 119418, 119419, 119420, 119421, 119422, 119423, 119424, 119425, 119426, 119427, 119428, 119429, 119430, 119431, 119432, 12984069, 13824626, 13824627, 13824628, 13824629, 13824630, 13824631, 14497899, 14497900, 14497901, 14497902, 14497903, 14497904, 14497905, 14497906, 14497907, 14497908, 14497909, 14497910, 14497911, 14497912, 14497913, 14497914, 14497915, 14497916, 14497917, 14497918, 14497919, 14497920, 14497921, 14497922, 14497923, 14497924, 14497925, 14497926, 14497927, 14497928, 14497929, 14497930, 14497931, 14497932, 14497933, 14497934, 14497935, 14497936, 14497937, 14497938, 14497939, 14497940, 14497941, 14497942, 14497943, 14497944, 14497945, 14497946, 14497947, 14497948, 14497949, 14497950, 14497951, 16863265, 16863266, 16863267, 16863268, 16863269, 16863270, 16863271, 16939043, 16939044, 17029267, 17143004, 17257585, 17257586, 17301507, 17353892, 17402620, 17564006, 17791145, 17852509, 17915536, 18044476, 18044477, 18044478, 18044479, 18044480, 18044481, 18109010, 18280927, 18397304, 18518509, 18736108, 18851869, 18889037, 18889038, 18889039, 19018877, 19530559, 19650064, 19650065, 19650066, 19650067, 19650068, 19650069, 19650070], "trace_timestamp_s": 2617.0460000000003, "ttft_s": 1.9678057190030813, "turn_id": 11} +{"actual_output_tokens": 128, "cached_tokens": 61008, "effective_input_length": 61080, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61080, "latency_s": 1.167329631978646, "output_length": 128, "proxy_request_id": "1340290:48:2010180:1174", "request_id": "1340290:48:2010180:1174", "request_type": "coder", "requested_output_tokens": 128, "session_id": "1340290", "t_dispatch_unix": 1779823310.8595135, "t_finish_unix": 1779823312.0268424, "t_first_token_unix": 1779823311.0177572, "tpot_s": 0.007943583889791052, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19669693], "trace_timestamp_s": 2623.916, "ttft_s": 0.15824096195865422, "turn_id": 48} +{"actual_output_tokens": 68, "cached_tokens": 61200, "effective_input_length": 61365, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61365, "latency_s": 0.730529916996602, "output_length": 68, "proxy_request_id": "1340290:48:2012871:1175", "request_id": "1340290:48:2012871:1175", "request_type": "coder", "requested_output_tokens": 68, "session_id": "1340290", "t_dispatch_unix": 1779823319.5370042, "t_finish_unix": 1779823320.2675338, "t_first_token_unix": 1779823319.7576544, "tpot_s": 0.007604564672141378, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456], "trace_timestamp_s": 2632.5910000000003, "ttft_s": 0.22064861794933677, "turn_id": 48} +{"actual_output_tokens": 65, "cached_tokens": 61424, "effective_input_length": 61518, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 61518, "latency_s": 0.6303328840294853, "output_length": 65, "proxy_request_id": "1340290:48:2014153:1176", "request_id": "1340290:48:2014153:1176", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779823323.9349177, "t_finish_unix": 1779823324.5652502, "t_first_token_unix": 1779823324.0813375, "tpot_s": 0.007557574750535423, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19707873], "trace_timestamp_s": 2636.992, "ttft_s": 0.1464177219895646, "turn_id": 48} +{"actual_output_tokens": 281, "cached_tokens": 61568, "effective_input_length": 69113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69113, "latency_s": 5.6536735810223036, "output_length": 281, "proxy_request_id": "1340290:48:2015982:1177", "request_id": "1340290:48:2015982:1177", "request_type": "coder", "requested_output_tokens": 281, "session_id": "1340290", "t_dispatch_unix": 1779823330.0348234, "t_finish_unix": 1779823335.6884968, "t_first_token_unix": 1779823333.2706692, "tpot_s": 0.008634204278600269, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875], "trace_timestamp_s": 2643.0860000000002, "ttft_s": 3.2358434550114907, "turn_id": 48} +{"actual_output_tokens": 72, "cached_tokens": 69392, "effective_input_length": 69426, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69426, "latency_s": 0.7130438489839435, "output_length": 72, "proxy_request_id": "1340290:48:2018973:1178", "request_id": "1340290:48:2018973:1178", "request_type": "coder", "requested_output_tokens": 72, "session_id": "1340290", "t_dispatch_unix": 1779823339.815624, "t_finish_unix": 1779823340.5286674, "t_first_token_unix": 1779823339.95457, "tpot_s": 0.008081994478551435, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176], "trace_timestamp_s": 2652.8720000000003, "ttft_s": 0.13894410600187257, "turn_id": 48} +{"actual_output_tokens": 70, "cached_tokens": 69488, "effective_input_length": 69601, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69601, "latency_s": 0.7605773920076899, "output_length": 70, "proxy_request_id": "1340290:48:2020779:1179", "request_id": "1340290:48:2020779:1179", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1340290", "t_dispatch_unix": 1779823345.8715591, "t_finish_unix": 1779823346.632136, "t_first_token_unix": 1779823346.0739164, "tpot_s": 0.008086249724104731, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176], "trace_timestamp_s": 2658.928000000001, "ttft_s": 0.2023548610159196, "turn_id": 48} +{"actual_output_tokens": 106, "cached_tokens": 69664, "effective_input_length": 69951, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 69951, "latency_s": 1.1256595139857382, "output_length": 106, "proxy_request_id": "1340290:48:2023753:1180", "request_id": "1340290:48:2023753:1180", "request_type": "coder", "requested_output_tokens": 106, "session_id": "1340290", "t_dispatch_unix": 1779823355.4915707, "t_finish_unix": 1779823356.61723, "t_first_token_unix": 1779823355.74254, "tpot_s": 0.00832822405722081, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067], "trace_timestamp_s": 2668.5430000000006, "ttft_s": 0.2509664369863458, "turn_id": 48} +{"actual_output_tokens": 65, "cached_tokens": 70048, "effective_input_length": 70342, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70342, "latency_s": 0.766869154991582, "output_length": 65, "proxy_request_id": "1340290:48:2026751:1181", "request_id": "1340290:48:2026751:1181", "request_type": "coder", "requested_output_tokens": 65, "session_id": "1340290", "t_dispatch_unix": 1779823365.7676353, "t_finish_unix": 1779823366.5345044, "t_first_token_unix": 1779823366.0245175, "tpot_s": 0.007963279734212847, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19829875], "trace_timestamp_s": 2678.8200000000006, "ttft_s": 0.25687918200856075, "turn_id": 48} +{"actual_output_tokens": 107, "cached_tokens": 70400, "effective_input_length": 70503, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70503, "latency_s": 1.0881747800158337, "output_length": 107, "proxy_request_id": "1340290:48:2028652:1182", "request_id": "1340290:48:2028652:1182", "request_type": "coder", "requested_output_tokens": 107, "session_id": "1340290", "t_dispatch_unix": 1779823372.0227897, "t_finish_unix": 1779823373.110964, "t_first_token_unix": 1779823372.2291996, "tpot_s": 0.008315109962461306, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190], "trace_timestamp_s": 2685.077, "ttft_s": 0.2064070519991219, "turn_id": 48} +{"actual_output_tokens": 78, "cached_tokens": 70608, "effective_input_length": 70851, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 70851, "latency_s": 0.8787191649898887, "output_length": 78, "proxy_request_id": "1340290:48:2033065:1183", "request_id": "1340290:48:2033065:1183", "request_type": "coder", "requested_output_tokens": 78, "session_id": "1340290", "t_dispatch_unix": 1779823386.750306, "t_finish_unix": 1779823387.6290247, "t_first_token_unix": 1779823387.002928, "tpot_s": 0.00812787501301689, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19891018], "trace_timestamp_s": 2699.7960000000003, "ttft_s": 0.25261978700291365, "turn_id": 48} +{"actual_output_tokens": 64, "cached_tokens": 70928, "effective_input_length": 71067, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71067, "latency_s": 0.6868883850402199, "output_length": 64, "proxy_request_id": "1340290:48:2034908:1184", "request_id": "1340290:48:2034908:1184", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1340290", "t_dispatch_unix": 1779823392.9729052, "t_finish_unix": 1779823393.6597931, "t_first_token_unix": 1779823393.1560297, "tpot_s": 0.0079917215551841, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243], "trace_timestamp_s": 2706.0260000000007, "ttft_s": 0.1831227750517428, "turn_id": 48} +{"actual_output_tokens": 193, "cached_tokens": 7840, "effective_input_length": 7844, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 7844, "latency_s": 1.0493140760227107, "output_length": 193, "proxy_request_id": "1258908:2:2035438:1185", "request_id": "1258908:2:2035438:1185", "request_type": "coder", "requested_output_tokens": 193, "session_id": "1258908", "t_dispatch_unix": 1779823394.7880392, "t_finish_unix": 1779823395.837353, "t_first_token_unix": 1779823394.8208082, "tpot_s": 0.00529331124471355, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 19912315], "trace_timestamp_s": 2707.849, "ttft_s": 0.03276730905054137, "turn_id": 2} +{"actual_output_tokens": 125, "cached_tokens": 8032, "effective_input_length": 9120, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9120, "latency_s": 0.8213273109868169, "output_length": 125, "proxy_request_id": "1258908:3:1388683:699", "request_id": "1258908:3:1388683:699", "request_type": "coder", "requested_output_tokens": 125, "session_id": "1258908", "t_dispatch_unix": 1779823395.838176, "t_finish_unix": 1779823396.659504, "t_first_token_unix": 1779823395.988209, "tpot_s": 0.0054113853468386935, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 13752030], "trace_timestamp_s": 527.4590000000007, "ttft_s": 0.15003122302005067, "turn_id": 3} +{"actual_output_tokens": 87, "cached_tokens": 71120, "effective_input_length": 71240, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71240, "latency_s": 0.9133689610171132, "output_length": 87, "proxy_request_id": "1340290:48:2036994:1186", "request_id": "1340290:48:2036994:1186", "request_type": "coder", "requested_output_tokens": 87, "session_id": "1340290", "t_dispatch_unix": 1779823399.91353, "t_finish_unix": 1779823400.8268983, "t_first_token_unix": 1779823400.120526, "tpot_s": 0.008210014930227771, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19926625], "trace_timestamp_s": 2712.9700000000003, "ttft_s": 0.2069938729982823, "turn_id": 48} +{"actual_output_tokens": 133, "cached_tokens": 71312, "effective_input_length": 71545, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71545, "latency_s": 1.386006613029167, "output_length": 133, "proxy_request_id": "1340290:48:2040473:1187", "request_id": "1340290:48:2040473:1187", "request_type": "coder", "requested_output_tokens": 133, "session_id": "1340290", "t_dispatch_unix": 1779823411.4399116, "t_finish_unix": 1779823412.825918, "t_first_token_unix": 1779823411.700095, "tpot_s": 0.00852685406800557, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166], "trace_timestamp_s": 2724.4890000000005, "ttft_s": 0.26018140400992706, "turn_id": 48} +{"actual_output_tokens": 70, "cached_tokens": 71664, "effective_input_length": 71867, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 71867, "latency_s": 0.8169052120065317, "output_length": 70, "proxy_request_id": "1340290:48:2043771:1188", "request_id": "1340290:48:2043771:1188", "request_type": "coder", "requested_output_tokens": 70, "session_id": "1340290", "t_dispatch_unix": 1779823422.460222, "t_finish_unix": 1779823423.277127, "t_first_token_unix": 1779823422.7161496, "tpot_s": 0.00812652755100145, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 19990868], "trace_timestamp_s": 2735.509, "ttft_s": 0.25592484197113663, "turn_id": 48} +{"actual_output_tokens": 82, "cached_tokens": 71936, "effective_input_length": 72025, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72025, "latency_s": 0.8354486509924755, "output_length": 82, "proxy_request_id": "1340290:48:2045403:1189", "request_id": "1340290:48:2045403:1189", "request_type": "coder", "requested_output_tokens": 82, "session_id": "1340290", "t_dispatch_unix": 1779823427.967691, "t_finish_unix": 1779823428.8031392, "t_first_token_unix": 1779823428.134581, "tpot_s": 0.00825058391323474, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917], "trace_timestamp_s": 2741.0240000000003, "ttft_s": 0.16688793298089877, "turn_id": 48} +{"actual_output_tokens": 67, "cached_tokens": 72096, "effective_input_length": 72211, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72211, "latency_s": 0.7465627180063166, "output_length": 67, "proxy_request_id": "1340290:48:2047167:1190", "request_id": "1340290:48:2047167:1190", "request_type": "coder", "requested_output_tokens": 67, "session_id": "1340290", "t_dispatch_unix": 1779823433.7337172, "t_finish_unix": 1779823434.48028, "t_first_token_unix": 1779823433.943456, "tpot_s": 0.00813006456045321, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20025386], "trace_timestamp_s": 2746.7890000000007, "ttft_s": 0.2097364620422013, "turn_id": 48} +{"actual_output_tokens": 64, "cached_tokens": 72272, "effective_input_length": 72777, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72777, "latency_s": 0.9054504850064404, "output_length": 64, "proxy_request_id": "1340290:48:2048793:1191", "request_id": "1340290:48:2048793:1191", "request_type": "coder", "requested_output_tokens": 64, "session_id": "1340290", "t_dispatch_unix": 1779823439.1668186, "t_finish_unix": 1779823440.0722687, "t_first_token_unix": 1779823439.5666528, "tpot_s": 0.008021404126858605, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20040840], "trace_timestamp_s": 2752.2220000000007, "ttft_s": 0.3998317320365459, "turn_id": 48} +{"actual_output_tokens": 46, "cached_tokens": 72832, "effective_input_length": 72952, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 72952, "latency_s": 0.5588875890243798, "output_length": 46, "proxy_request_id": "1340290:48:2050838:1192", "request_id": "1340290:48:2050838:1192", "request_type": "coder", "requested_output_tokens": 46, "session_id": "1340290", "t_dispatch_unix": 1779823446.38942, "t_finish_unix": 1779823446.9483073, "t_first_token_unix": 1779823446.5996954, "tpot_s": 0.007741803000681102, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229], "trace_timestamp_s": 2759.443, "ttft_s": 0.21027214801870286, "turn_id": 48} +{"actual_output_tokens": 93, "cached_tokens": 72992, "effective_input_length": 73208, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73208, "latency_s": 1.02635378803825, "output_length": 93, "proxy_request_id": "1340290:48:2052523:1193", "request_id": "1340290:48:2052523:1193", "request_type": "coder", "requested_output_tokens": 93, "session_id": "1340290", "t_dispatch_unix": 1779823451.956535, "t_finish_unix": 1779823452.9828887, "t_first_token_unix": 1779823452.2156897, "tpot_s": 0.008335746087022531, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229], "trace_timestamp_s": 2765.0120000000006, "ttft_s": 0.25915219500893727, "turn_id": 48} +{"actual_output_tokens": 53, "cached_tokens": 73296, "effective_input_length": 73454, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73454, "latency_s": 0.6668912280001678, "output_length": 53, "proxy_request_id": "1340290:48:2055365:1194", "request_id": "1340290:48:2055365:1194", "request_type": "coder", "requested_output_tokens": 53, "session_id": "1340290", "t_dispatch_unix": 1779823461.6695347, "t_finish_unix": 1779823462.3364255, "t_first_token_unix": 1779823461.9253798, "tpot_s": 0.007899721403821157, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2774.7220000000007, "ttft_s": 0.25584078702377155, "turn_id": 48} +{"actual_output_tokens": 36, "cached_tokens": 73504, "effective_input_length": 73636, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73636, "latency_s": 0.44974735501455143, "output_length": 36, "proxy_request_id": "1340290:48:2057042:1195", "request_id": "1340290:48:2057042:1195", "request_type": "coder", "requested_output_tokens": 36, "session_id": "1340290", "t_dispatch_unix": 1779823467.0425384, "t_finish_unix": 1779823467.4922855, "t_first_token_unix": 1779823467.2341585, "tpot_s": 0.007367901572225882, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2780.098, "ttft_s": 0.1916175420046784, "turn_id": 48} +{"actual_output_tokens": 199, "cached_tokens": 73648, "effective_input_length": 73653, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73653, "latency_s": 1.8557253510225564, "output_length": 199, "proxy_request_id": "1340290:48:2058614:1196", "request_id": "1340290:48:2058614:1196", "request_type": "coder", "requested_output_tokens": 199, "session_id": "1340290", "t_dispatch_unix": 1779823472.1863613, "t_finish_unix": 1779823474.0420866, "t_first_token_unix": 1779823472.3098965, "tpot_s": 0.00874640454533463, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841], "trace_timestamp_s": 2785.241, "ttft_s": 0.12353161501232535, "turn_id": 48} +{"actual_output_tokens": 66, "cached_tokens": 73840, "effective_input_length": 73858, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 73858, "latency_s": 0.6682052009855397, "output_length": 66, "proxy_request_id": "1340290:48:2061834:1197", "request_id": "1340290:48:2061834:1197", "request_type": "coder", "requested_output_tokens": 66, "session_id": "1340290", "t_dispatch_unix": 1779823482.3337915, "t_finish_unix": 1779823483.001996, "t_first_token_unix": 1779823482.464893, "tpot_s": 0.008259494891927507, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20166404], "trace_timestamp_s": 2795.3860000000004, "ttft_s": 0.13110004097688943, "turn_id": 48} +{"actual_output_tokens": 198, "cached_tokens": 9232, "effective_input_length": 9359, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9359, "latency_s": 1.11976448999485, "output_length": 198, "proxy_request_id": "1258908:3:2063441:1198", "request_id": "1258908:3:2063441:1198", "request_type": "coder", "requested_output_tokens": 198, "session_id": "1258908", "t_dispatch_unix": 1779823487.3805633, "t_finish_unix": 1779823488.5003269, "t_first_token_unix": 1779823487.434044, "tpot_s": 0.0054114306346172945, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 20179862, 20179863, 20179864, 20179865], "trace_timestamp_s": 2800.4400000000005, "ttft_s": 0.053479645983316004, "turn_id": 3} +{"actual_output_tokens": 69, "cached_tokens": 73920, "effective_input_length": 74011, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74011, "latency_s": 0.7298808270134032, "output_length": 69, "proxy_request_id": "1340290:48:2063837:1199", "request_id": "1340290:48:2063837:1199", "request_type": "coder", "requested_output_tokens": 69, "session_id": "1340290", "t_dispatch_unix": 1779823488.7273986, "t_finish_unix": 1779823489.4572794, "t_first_token_unix": 1779823488.8936741, "tpot_s": 0.008284843176678644, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245], "trace_timestamp_s": 2801.7870000000003, "ttft_s": 0.16627343196887523, "turn_id": 48} +{"actual_output_tokens": 348, "cached_tokens": 9552, "effective_input_length": 9740, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 9740, "latency_s": 1.9492562600062229, "output_length": 348, "proxy_request_id": "1258908:4:1553508:958", "request_id": "1258908:4:1553508:958", "request_type": "coder", "requested_output_tokens": 348, "session_id": "1258908", "t_dispatch_unix": 1779823488.5013652, "t_finish_unix": 1779823490.4506218, "t_first_token_unix": 1779823488.5623312, "tpot_s": 0.005440883907779343, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 15299521, 15299522, 15299523], "trace_timestamp_s": 1086.2330000000002, "ttft_s": 0.06096425198484212, "turn_id": 4} +{"actual_output_tokens": 377, "cached_tokens": 10080, "effective_input_length": 10201, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 10201, "latency_s": 2.101651350967586, "output_length": 377, "proxy_request_id": "1258908:5:1617181:988", "request_id": "1258908:5:1617181:988", "request_type": "coder", "requested_output_tokens": 377, "session_id": "1258908", "t_dispatch_unix": 1779823490.451536, "t_finish_unix": 1779823492.5531871, "t_first_token_unix": 1779823490.5066738, "tpot_s": 0.005442196909496759, "trace_hash_ids": [65396, 65397, 65398, 65399, 65400, 11972612, 11972613, 11972614, 11972615, 11972616, 11972617, 11972618, 11972619, 11972620, 11972621, 13037146, 13752029, 15299521, 15299522, 15897219], "trace_timestamp_s": 1300.7890000000007, "ttft_s": 0.05513670900836587, "turn_id": 5} +{"actual_output_tokens": 142, "cached_tokens": 74064, "effective_input_length": 74557, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74557, "latency_s": 1.6300577449728735, "output_length": 142, "proxy_request_id": "1340290:48:2066647:1200", "request_id": "1340290:48:2066647:1200", "request_type": "coder", "requested_output_tokens": 142, "session_id": "1340290", "t_dispatch_unix": 1779823498.166193, "t_finish_unix": 1779823499.7962503, "t_first_token_unix": 1779823498.571407, "tpot_s": 0.008684603368586048, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606], "trace_timestamp_s": 2811.2200000000003, "ttft_s": 0.4052122010034509, "turn_id": 48} +{"actual_output_tokens": 95, "cached_tokens": 74688, "effective_input_length": 74863, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 74863, "latency_s": 1.059111849986948, "output_length": 95, "proxy_request_id": "1340290:48:2071598:1201", "request_id": "1340290:48:2071598:1201", "request_type": "coder", "requested_output_tokens": 95, "session_id": "1340290", "t_dispatch_unix": 1779823514.8231306, "t_finish_unix": 1779823515.8822417, "t_first_token_unix": 1779823515.0864887, "tpot_s": 0.008462792968357656, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20256523], "trace_timestamp_s": 2827.867, "ttft_s": 0.26335605198983103, "turn_id": 48} +{"actual_output_tokens": 54, "cached_tokens": 74944, "effective_input_length": 75113, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75113, "latency_s": 0.6900233239866793, "output_length": 54, "proxy_request_id": "1340290:48:2076822:1202", "request_id": "1340290:48:2076822:1202", "request_type": "coder", "requested_output_tokens": 54, "session_id": "1340290", "t_dispatch_unix": 1779823532.338645, "t_finish_unix": 1779823533.028668, "t_first_token_unix": 1779823532.6047547, "tpot_s": 0.0079925316978984, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700], "trace_timestamp_s": 2845.3820000000005, "ttft_s": 0.266107899020426, "turn_id": 48} +{"actual_output_tokens": 37, "cached_tokens": 75152, "effective_input_length": 75299, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75299, "latency_s": 0.532668023952283, "output_length": 37, "proxy_request_id": "1340290:48:2078461:1203", "request_id": "1340290:48:2078461:1203", "request_type": "coder", "requested_output_tokens": 37, "session_id": "1340290", "t_dispatch_unix": 1779823537.6290126, "t_finish_unix": 1779823538.1616802, "t_first_token_unix": 1779823537.8933928, "tpot_s": 0.007443549472049603, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20321756], "trace_timestamp_s": 2850.683, "ttft_s": 0.2643775359611027, "turn_id": 48} +{"actual_output_tokens": 47, "cached_tokens": 75328, "effective_input_length": 75338, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75338, "latency_s": 0.48856889602029696, "output_length": 47, "proxy_request_id": "1340290:48:2080016:1204", "request_id": "1340290:48:2080016:1204", "request_type": "coder", "requested_output_tokens": 47, "session_id": "1340290", "t_dispatch_unix": 1779823542.9190848, "t_finish_unix": 1779823543.407653, "t_first_token_unix": 1779823543.0703495, "tpot_s": 0.007325443217743431, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20335310], "trace_timestamp_s": 2855.973, "ttft_s": 0.1512625030009076, "turn_id": 48} +{"actual_output_tokens": 114, "cached_tokens": 75376, "effective_input_length": 75439, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 75439, "latency_s": 1.14931876398623, "output_length": 114, "proxy_request_id": "1340290:48:2082644:1206", "request_id": "1340290:48:2082644:1206", "request_type": "coder", "requested_output_tokens": 114, "session_id": "1340290", "t_dispatch_unix": 1779823551.5933614, "t_finish_unix": 1779823552.7426796, "t_first_token_unix": 1779823551.7726998, "tpot_s": 0.008581224407081747, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630], "trace_timestamp_s": 2864.6510000000007, "ttft_s": 0.17933557298965752, "turn_id": 48} +{"actual_output_tokens": 232, "cached_tokens": 136784, "effective_input_length": 136991, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 136991, "latency_s": 3.266264592995867, "output_length": 232, "proxy_request_id": "1356885:16:2084239:1207", "request_id": "1356885:16:2084239:1207", "request_type": "coder", "requested_output_tokens": 232, "session_id": "1356885", "t_dispatch_unix": 1779823556.6826024, "t_finish_unix": 1779823559.9488666, "t_first_token_unix": 1779823557.1486907, "tpot_s": 0.012120817017386713, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016, 20375498], "trace_timestamp_s": 2869.7350000000006, "ttft_s": 0.466085619002115, "turn_id": 16} +{"actual_output_tokens": 61, "cached_tokens": 75552, "effective_input_length": 77337, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 77337, "latency_s": 1.4879733900306746, "output_length": 61, "proxy_request_id": "1340290:48:2085626:1208", "request_id": "1340290:48:2085626:1208", "request_type": "coder", "requested_output_tokens": 61, "session_id": "1340290", "t_dispatch_unix": 1779823561.6696627, "t_finish_unix": 1779823563.157636, "t_first_token_unix": 1779823562.6627839, "tpot_s": 0.008243063599608528, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20388781], "trace_timestamp_s": 2874.7270000000008, "ttft_s": 0.9931172400247306, "turn_id": 48} +{"actual_output_tokens": 162, "cached_tokens": 77392, "effective_input_length": 78683, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 78683, "latency_s": 2.3006332170334645, "output_length": 162, "proxy_request_id": "1340290:48:2087584:1209", "request_id": "1340290:48:2087584:1209", "request_type": "coder", "requested_output_tokens": 162, "session_id": "1340290", "t_dispatch_unix": 1779823568.2475796, "t_finish_unix": 1779823570.5482125, "t_first_token_unix": 1779823569.1087441, "tpot_s": 0.008939282111794636, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20407911, 20407912, 20407913], "trace_timestamp_s": 2881.3010000000004, "ttft_s": 0.8611623730394058, "turn_id": 48} +{"actual_output_tokens": 143, "cached_tokens": 78832, "effective_input_length": 79023, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 79023, "latency_s": 1.5476524740224704, "output_length": 143, "proxy_request_id": "1340290:48:2092759:1211", "request_id": "1340290:48:2092759:1211", "request_type": "coder", "requested_output_tokens": 143, "session_id": "1340290", "t_dispatch_unix": 1779823585.5343282, "t_finish_unix": 1779823587.0819805, "t_first_token_unix": 1779823585.8149688, "tpot_s": 0.008920472133724334, "trace_hash_ids": [5658, 5659, 5660, 1903418, 1903419, 1903420, 1903421, 1903422, 1903423, 1903424, 1903425, 1903426, 1903427, 1903428, 1903429, 1903430, 1903431, 1903432, 1903433, 1903434, 1560323, 1560324, 1903435, 1903436, 1903437, 1903438, 1903439, 1903440, 1903441, 1903442, 1903443, 1903444, 1903445, 1903446, 1903447, 1903448, 1903449, 1903450, 1903451, 1903452, 1903453, 13722193, 13722194, 13722195, 13722196, 13722197, 13722198, 13722199, 13722200, 13722201, 13722202, 13730726, 13730727, 13928401, 13936963, 13936964, 13936965, 13936966, 13957145, 13972759, 13972760, 13972761, 13972762, 13972763, 13972764, 13972765, 13972766, 13972767, 14045840, 16870829, 16870830, 16870831, 16870832, 16934638, 17129416, 17129417, 17129418, 17129419, 18369956, 18438436, 18464632, 18464633, 18500279, 18508933, 18508934, 18508935, 18508936, 18508937, 18508938, 18508939, 18508940, 18508941, 18508942, 18508943, 18508944, 18539336, 18551462, 18607609, 18997496, 18997497, 18997498, 18997499, 18997500, 18997501, 18997502, 19021002, 19281053, 19296411, 19308726, 19324773, 19354818, 19354819, 19418878, 19503652, 19565958, 19622999, 19653240, 19653241, 19653242, 19695456, 19724861, 19724862, 19724863, 19724864, 19724865, 19724866, 19724867, 19724868, 19724869, 19724870, 19724871, 19724872, 19724873, 19724874, 19724875, 19754176, 19801067, 19849190, 19908243, 19961166, 20006917, 20040839, 20061229, 20104841, 20183245, 20208606, 20305700, 20361630, 20388778, 20388779, 20388780, 20407911, 20407912, 20407913, 20456176], "trace_timestamp_s": 2898.5790000000006, "ttft_s": 0.28063808800652623, "turn_id": 48} +{"actual_output_tokens": 111, "cached_tokens": 9760, "effective_input_length": 114971, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 114971, "latency_s": 43.24580519198207, "output_length": 111, "proxy_request_id": "1382086:2:2082052:1205", "request_id": "1382086:2:2082052:1205", "request_type": "coder", "requested_output_tokens": 111, "session_id": "1382086", "t_dispatch_unix": 1779823549.5756664, "t_finish_unix": 1779823592.8214715, "t_first_token_unix": 1779823591.6791928, "tpot_s": 0.010382012000032277, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756], "trace_timestamp_s": 2862.6050000000005, "ttft_s": 42.103523381985724, "turn_id": 2} +{"actual_output_tokens": 52, "cached_tokens": 115072, "effective_input_length": 115184, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 115184, "latency_s": 0.8050341720227152, "output_length": 52, "proxy_request_id": "1382086:3:2089879:1210", "request_id": "1382086:3:2089879:1210", "request_type": "coder", "requested_output_tokens": 52, "session_id": "1382086", "t_dispatch_unix": 1779823592.8255265, "t_finish_unix": 1779823593.6305609, "t_first_token_unix": 1779823593.1836023, "tpot_s": 0.008758877333271884, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756], "trace_timestamp_s": 2888.9900000000007, "ttft_s": 0.35807174298679456, "turn_id": 3} +{"actual_output_tokens": 626, "cached_tokens": 115232, "effective_input_length": 115246, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 115246, "latency_s": 7.1996919010416605, "output_length": 626, "proxy_request_id": "1382086:4:2092953:1212", "request_id": "1382086:4:2092953:1212", "request_type": "coder", "requested_output_tokens": 626, "session_id": "1382086", "t_dispatch_unix": 1779823593.6351905, "t_finish_unix": 1779823600.834882, "t_first_token_unix": 1779823593.8216712, "tpot_s": 0.011220764606352896, "trace_hash_ids": [304046, 5767491, 5767492, 13689891, 13689892, 13689893, 13689894, 13689895, 13689896, 13689897, 13689898, 13689899, 1286259, 13689900, 13689901, 13689902, 13689903, 13689904, 1739228, 1739229, 1739230, 1739231, 13689905, 13689906, 13689907, 13689908, 13689909, 13689910, 13689911, 13689912, 13689913, 13689914, 13689915, 13689916, 13689917, 13689918, 13689919, 13689920, 13689921, 13689922, 13689923, 13689924, 13689925, 13689926, 13689927, 13689928, 13689929, 13689930, 13689931, 13689932, 13689933, 2269381, 13689934, 13689935, 669748, 669749, 669750, 669751, 13689936, 13689937, 192972, 192973, 13689938, 13689939, 13689940, 6755536, 13689941, 13689942, 13689943, 3519703, 13689944, 13689945, 13689946, 13689947, 13689948, 13689949, 13689950, 13689951, 13689952, 13689953, 13689954, 13689955, 13689956, 13689957, 13689958, 13689959, 13689960, 13689961, 13689962, 13689963, 13689964, 13689965, 13689966, 13689967, 13689968, 13689969, 13689970, 13689971, 13689972, 13689973, 13689974, 13689975, 13689976, 363720, 363721, 13689977, 20355639, 20355640, 20355641, 20355642, 20355643, 20355644, 20355645, 20355646, 20355647, 20355648, 20355649, 20355650, 20355651, 20355652, 20355653, 20355654, 20355655, 20355656, 20355657, 20355658, 20355659, 20355660, 20355661, 20355662, 20355663, 20355664, 20355665, 20355666, 20355667, 20355668, 20355669, 20355670, 20355671, 20355672, 20355673, 20355674, 20355675, 20355676, 20355677, 20355678, 20355679, 20355680, 20355681, 20355682, 20355683, 20355684, 20355685, 20355686, 20355687, 20355688, 20355689, 20355690, 20355691, 20355692, 20355693, 16349874, 20355694, 20355695, 20355696, 20355697, 20355698, 20355699, 20355700, 20355701, 20355702, 20355703, 20355704, 20355705, 20355706, 20355707, 20355708, 20355709, 20355710, 20355711, 20355712, 20355713, 20355714, 20355715, 20355716, 20355717, 20355718, 20355719, 20355720, 20355721, 20355722, 20355723, 20355724, 20355725, 20355726, 20355727, 20355728, 20355729, 20355730, 20355731, 20355732, 20355733, 20355734, 20355735, 20355736, 20355737, 20355738, 20355739, 20355740, 20355741, 20355742, 20355743, 20355744, 20355745, 20355746, 20355747, 20355748, 20355749, 20355750, 20355751, 20355752, 20355753, 20355754, 20355755, 20355756, 20458115], "trace_timestamp_s": 2899.327, "ttft_s": 0.18647797004086897, "turn_id": 4} +{"actual_output_tokens": 220, "cached_tokens": 137216, "effective_input_length": 137546, "endpoint_url": "http://127.0.0.1:9300", "error": null, "finish_reason": "length", "input_length": 137546, "latency_s": 3.3564348649815656, "output_length": 220, "proxy_request_id": "1356885:17:2097011:1213", "request_id": "1356885:17:2097011:1213", "request_type": "coder", "requested_output_tokens": 220, "session_id": "1356885", "t_dispatch_unix": 1779823599.395203, "t_finish_unix": 1779823602.7516377, "t_first_token_unix": 1779823600.0967095, "tpot_s": 0.012121734753427559, "trace_hash_ids": [2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 41739, 41740, 66491, 41742, 41743, 41744, 50119, 50120, 50121, 50122, 50123, 50124, 50125, 50126, 50127, 50128, 50129, 50130, 107220, 13401324, 13401325, 13401326, 13401327, 13401328, 13401329, 13401330, 13401331, 13401332, 13401333, 13401334, 13401335, 13401336, 13401337, 13401338, 13401339, 13401340, 13401341, 13401342, 13401343, 13401344, 13401345, 13401346, 13401347, 13401348, 13401349, 13401350, 13401351, 13401352, 13401353, 13401354, 13401355, 13401356, 13401357, 13401358, 13401359, 13401360, 13401361, 13401362, 13401363, 13401364, 13401365, 13401366, 13401367, 13401368, 13401369, 13401370, 13401371, 13401372, 13401373, 13401374, 13401375, 13401376, 13401377, 13401378, 13401379, 13401380, 13401381, 13401382, 13401383, 13401384, 13401385, 13401386, 13401387, 13401388, 13401389, 13401390, 13401391, 13401392, 13401393, 13401394, 13401395, 13401396, 13401397, 13401398, 13401399, 13401400, 13401401, 13401402, 13401403, 13401404, 13401405, 13401406, 13401407, 13401408, 13401409, 13401410, 13401411, 13401412, 13401413, 13401414, 13401415, 13401416, 13401417, 13401418, 13401419, 13401420, 13401421, 13401422, 13401423, 13401424, 13401425, 13401426, 13401427, 13401428, 13401429, 13401430, 13401431, 13401432, 13401433, 13401434, 13401435, 13401436, 13401437, 13401438, 13401439, 13401440, 13401441, 13401442, 13401443, 13401444, 13401445, 13401446, 13401447, 13401448, 13401449, 13401450, 13401451, 13401452, 13401453, 13401454, 13401455, 13401456, 13401457, 13401458, 13401459, 13401460, 13401461, 13401462, 13401463, 13401464, 13401465, 13401466, 13401467, 13401468, 13401469, 13401470, 13401471, 13401472, 13401473, 13401474, 13401475, 13401476, 13401477, 13401478, 13401479, 13401480, 13401481, 13401482, 13401483, 13401484, 13401485, 13401486, 13401487, 13401488, 13401489, 13401490, 13401491, 13401492, 13401493, 13401494, 13401495, 13401496, 13401497, 13401498, 13401499, 13401500, 13401501, 13401502, 13401503, 13401504, 13401505, 13401506, 13401507, 13401508, 13401509, 13401510, 13401511, 13401512, 13401513, 13401514, 13401515, 13401516, 13401517, 13401518, 13401519, 13401520, 13401521, 13401522, 13401523, 13401524, 13401525, 13401526, 13401527, 13401528, 13401529, 13401530, 13457250, 14908756, 14908757, 14908758, 14908759, 14908760, 14908761, 14908762, 14908763, 14908764, 14908765, 14908766, 14908767, 14908768, 14908769, 14908770, 18360933, 18360934, 18360935, 18360936, 18360937, 18360938, 18360939, 18360940, 18360941, 18566243, 19076312, 19553016, 20494065, 20494066], "trace_timestamp_s": 2912.4530000000004, "ttft_s": 0.7015038039535284, "turn_id": 17} diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/metrics.summary.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/metrics.summary.json new file mode 100644 index 0000000..475d0ee --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/metrics.summary.json @@ -0,0 +1,50 @@ +{ + "actual_output_tokens_stats": { + "count": 1214.0, + "mean": 309.1507413509061, + "p50": 92.0, + "p90": 511.4000000000001, + "p99": 4181.989999999992 + }, + "cache_hit_request_count": 884, + "cached_tokens_stats": { + "count": 1214.0, + "mean": 34984.83031301483, + "p50": 24352.0, + "p90": 93219.20000000001, + "p99": 130699.5199999999 + }, + "error_count": 0, + "external_cache_hit_ratio": 0.0, + "external_cache_hits_tokens": 0, + "external_cache_queries_tokens": 0, + "latency_stats_s": { + "count": 1214.0, + "mean": 7.183769712352909, + "p50": 1.8075949079939164, + "p90": 18.172221782768624, + "p99": 72.3876089354086 + }, + "prefix_cache_hit_ratio": 0.0, + "prefix_cache_hits_tokens": 0, + "prefix_cache_queries_tokens": 0, + "request_count": 1214, + "success_count": 1214, + "total_cached_tokens": 42471584, + "total_input_tokens": 53335690, + "tpot_stats_s": { + "count": 1214.0, + "mean": 0.014171222740603976, + "p50": 0.008089419168215166, + "p90": 0.017776012932020836, + "p99": 0.12457718443722908 + }, + "ttft_stats_s": { + "count": 1214.0, + "mean": 3.1033856407702305, + "p50": 0.4855456190125551, + "p90": 7.6192877857247385, + "p99": 41.97445172026403 + }, + "wall_clock_s": 2915.82019165199 +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/run_window.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/run_window.json new file mode 100644 index 0000000..f2cf41d --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/run_window.json @@ -0,0 +1,7 @@ +{ + "policy": "unified_kv_both", + "trace": "/home/admin/cpfs/wjh/agentic-kv/traces/w600_r0.0015_st30.jsonl", + "t_start_unix": 1779820686.3177474, + "t_end_unix": 1779823603.2265427, + "isolated": true +} \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/stats.json b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/stats.json new file mode 100644 index 0000000..1b93be6 --- /dev/null +++ b/microbench/connector_tax/cache_sweep/results/trace_replay_20260526_1652/unified_kv_both_drfix/stats.json @@ -0,0 +1 @@ +[{"url":"http://127.0.0.1:8000","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2292},{"url":"http://127.0.0.1:8001","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1741},{"url":"http://127.0.0.1:8002","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2520},{"url":"http://127.0.0.1:8003","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2325},{"url":"http://127.0.0.1:8004","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1773},{"url":"http://127.0.0.1:8005","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1828},{"url":"http://127.0.0.1:8006","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":1862},{"url":"http://127.0.0.1:8007","role":"combined","ongoing_tokens":0,"pending_prefill_tokens":0,"ongoing_decode_tokens":0,"num_requests":0,"active_p_offloads":0,"cached_blocks":2091}] \ No newline at end of file diff --git a/microbench/connector_tax/cache_sweep/run_cache_sweep.py b/microbench/connector_tax/cache_sweep/run_cache_sweep.py index d4b34c6..e6bdcab 100755 --- a/microbench/connector_tax/cache_sweep/run_cache_sweep.py +++ b/microbench/connector_tax/cache_sweep/run_cache_sweep.py @@ -56,21 +56,25 @@ class ReqMetric: error: str | None = None -def make_random_prompt(target_tokens: int) -> str: +def make_random_prompt(target_tokens: int, rng: random.Random) -> str: """Same calibration as the bench_loop.py used elsewhere: - 'Block N: <32-hex>' tokenizes to ~35 tokens on Qwen3-Coder.""" + 'Block N: <32-hex>' tokenizes to ~35 tokens on Qwen3-Coder. + + Deterministic given `rng` — same RNG state produces the same prompt. + Used so two runs with the same --seed get bit-identical request streams. + """ n_parts = max(1, target_tokens // 35) - seed = uuid.uuid4().hex + # 32 random hex chars from rng (uuid.uuid4 would use os.urandom, unseedable) + seed = "".join(f"{rng.randrange(16):x}" for _ in range(32)) parts = [] for i in range(n_parts): - h = hashlib.md5(f"{seed}_{i}_{time.time_ns()}".encode()).hexdigest() + h = hashlib.md5(f"{seed}_{i}".encode()).hexdigest() parts.append(f"Block {i}: {h}") return " ".join(parts) -async def send_one(client, url, model, inp_tokens, out_tokens, - rate, inflight, inflight_cap, fh): - rid = uuid.uuid4().hex[:16] +async def send_one(client, url, model, prompt, inp_tokens, out_tokens, + rate, inflight, inflight_cap, fh, rid): if inflight[0] >= inflight_cap: m = ReqMetric(req_id=rid, rate_target=rate, input_tokens_target=inp_tokens, @@ -88,7 +92,6 @@ async def send_one(client, url, model, inp_tokens, out_tokens, t_send_ns=time.perf_counter_ns(), inflight_at_send=inflight[0]) try: - prompt = make_random_prompt(inp_tokens) payload = { "model": model, "messages": [{"role": "user", "content": prompt}], @@ -141,25 +144,39 @@ async def main_async(args): inflight = [0] pending: list[asyncio.Task] = [] interval_mean = 1.0 / args.rate - rng = random.Random(int(time.time_ns()) & 0xFFFFFFFF) - print(f"[bench] rate={args.rate} shape=({args.input_tokens},{args.output_tokens}) " - f"duration={args.duration}s output={out_dir}") + # Shared seed across configs gives bit-identical arrival times AND prompt + # content. arrival_rng feeds expovariate, content_rng feeds make_random_prompt, + # rid_rng feeds the per-request id. All three derive from --seed so two runs + # with the same seed are bit-identical from the producer side; only server + # response timing differs (which is what we want to measure). + if args.seed is not None: + seed = args.seed + else: + seed = int(time.time_ns()) & 0xFFFFFFFF + print(f"[bench] seed={seed} rate={args.rate} shape=({args.input_tokens}," + f"{args.output_tokens}) duration={args.duration}s output={out_dir}") + arrival_rng = random.Random(seed) + content_rng = random.Random(seed ^ 0xC0FFEE) + rid_rng = random.Random(seed ^ 0xDEADBEEF) fh = open(req_path, "a", buffering=1) t0 = time.perf_counter() last_print = t0 async with httpx.AsyncClient(timeout=httpx.Timeout(600.0)) as client: - # producer + # producer — prompts generated here in order so async scheduling can't + # reorder the content RNG draw across requests. async def producer(): while time.perf_counter() - t0 < args.duration: + prompt = make_random_prompt(args.input_tokens, content_rng) + rid = f"{rid_rng.randrange(1 << 64):016x}" pending.append(asyncio.create_task( - send_one(client, args.url, args.model, + send_one(client, args.url, args.model, prompt, args.input_tokens, args.output_tokens, - args.rate, inflight, args.inflight_cap, fh) + args.rate, inflight, args.inflight_cap, fh, rid) )) - await asyncio.sleep(rng.expovariate(1.0 / interval_mean)) + await asyncio.sleep(arrival_rng.expovariate(1.0 / interval_mean)) # heartbeat async def heartbeat(): @@ -210,6 +227,10 @@ def main(): ap.add_argument("--output-tokens", type=int, default=256) ap.add_argument("--duration", type=float, default=480.0, help="Total run duration in seconds (default 8 min)") + ap.add_argument("--seed", type=int, default=None, + help="Master seed; same value across configs gives " + "bit-identical Poisson arrivals and prompt content. " + "Default: time-based (different each run).") ap.add_argument("--inflight-cap", type=int, default=256) ap.add_argument("--output-dir", required=True) args = ap.parse_args() diff --git a/microbench/connector_tax/cache_sweep/run_drfix.sh b/microbench/connector_tax/cache_sweep/run_drfix.sh index 4b00156..40713ac 100755 --- a/microbench/connector_tax/cache_sweep/run_drfix.sh +++ b/microbench/connector_tax/cache_sweep/run_drfix.sh @@ -25,6 +25,7 @@ PORT="${PORT:-8000}" GPU_ID="${GPU_ID:-0}" MODEL_PATH="${MODEL_PATH:-$HOME/models/Qwen/Qwen3-Coder-30B-A3B-Instruct}" CONFIGS="${CONFIGS:-plain mooncake_both mooncake_both_drfix}" +SEED="${SEED:-12345}" # shared seed across configs → identical Poisson + content DATE="$(date +%Y%m%d_%H%M)" RUN_ROOT="$HERE/results/${DATE}_drfix" @@ -33,7 +34,7 @@ mkdir -p "$RUN_ROOT" echo "=== Cache-size sweep + DR-fix A/B ===" echo "Run dir : $RUN_ROOT" echo "Configs : $CONFIGS" -echo "Rate : $RATE Duration: ${DURATION}s" +echo "Rate : $RATE Duration: ${DURATION}s Seed: $SEED" echo "" kill_all_vllm() { @@ -114,6 +115,7 @@ for cfg in $CONFIGS; do --url "http://127.0.0.1:$PORT/v1/chat/completions" \ --model "$MODEL_PATH" \ --rate "$RATE" --duration "$DURATION" \ + --seed "$SEED" \ --output-dir "$cfg_dir" 2>&1 | tail -8 curl -s "http://127.0.0.1:$PORT/metrics" > "$cfg_dir/metrics_final.txt" 2>&1 || true diff --git a/microbench/connector_tax/cache_sweep/run_trace_replay_drfix.sh b/microbench/connector_tax/cache_sweep/run_trace_replay_drfix.sh new file mode 100755 index 0000000..f0d4e6f --- /dev/null +++ b/microbench/connector_tax/cache_sweep/run_trace_replay_drfix.sh @@ -0,0 +1,86 @@ +#!/usr/bin/env bash +# Re-run the elastic_migration_v2 trace replay (8x TP1 + unified policy) +# with the DR-fix applied, to test whether the +45% TTFT p90 gap closes. +# +# Three policies in sequence on the SAME trace and SAME machine: +# unified — plain (no connector) control +# unified_kv_both — Mooncake kv_both, DR sync ON baseline +# unified_kv_both_drfix — Mooncake kv_both, DR sync OFF fix under test +# +# The DR-fix patch is applied at the start and reverted at the end. +# When env VLLM_MOONCAKE_DISABLE_DIRECT_READ_SYNC=1 is set, the patched +# build_connector_meta skips the O(|cache|) hash sync. + +set -uo pipefail + +PROJ_DIR="${PROJ_DIR:-/home/admin/cpfs/wjh/agentic-kv}" +TRACE="${TRACE:-$PROJ_DIR/traces/w600_r0.0015_st30.jsonl}" +DATE="$(date +%Y%m%d_%H%M)" +OUTROOT="${OUTROOT:-$PROJ_DIR/outputs/trace_replay_drfix_${DATE}}" +PYTHON="$PROJ_DIR/.venv/bin/python" +DR_FIX_SCRIPT="$PROJ_DIR/microbench/connector_tax/cache_sweep/apply_direct_read_fix.py" +VLLM_ROOT="${VLLM_ROOT:-$PROJ_DIR/.venv/lib/python3.12/site-packages/vllm}" + +mkdir -p "$OUTROOT" +echo "=== Trace-replay DR-fix A/B/C ===" +echo "Trace : $TRACE" +echo "Out : $OUTROOT" +echo "Policies in order: unified → unified_kv_both → unified_kv_both_drfix" +echo "" + +cleanup_all() { + pkill -9 -f cache_aware_proxy 2>/dev/null || true + pkill -9 -f "vllm serve" 2>/dev/null || true + pkill -9 -f "EngineCore" 2>/dev/null || true + sleep 5 + "$PYTHON" "$DR_FIX_SCRIPT" --revert --vllm-root "$VLLM_ROOT" 2>/dev/null || true +} +trap cleanup_all EXIT +cleanup_all + +echo "[stage 0] applying CT_DR_FIX patch (skip flag still respects env var)" +"$PYTHON" "$DR_FIX_SCRIPT" --apply --vllm-root "$VLLM_ROOT" + +run_policy() { + local policy="$1" + local rundir="$2" + local skip_dr="$3" + echo "" + echo "====== $policy → $(basename $rundir) ; VLLM_MOONCAKE_DISABLE_DIRECT_READ_SYNC=$skip_dr ======" + mkdir -p "$rundir" + # Pass-through to the existing isolated runner; it spawns 8 vLLMs and + # the replayer. The env var is inherited by all vLLM child processes. + if [ "$skip_dr" = "1" ]; then + export VLLM_MOONCAKE_DISABLE_DIRECT_READ_SYNC=1 + else + unset VLLM_MOONCAKE_DISABLE_DIRECT_READ_SYNC + fi + bash "$PROJ_DIR/scripts/b3_isolated_policy.sh" "$policy" "$TRACE" "$rundir" \ + 2>&1 | tee "$rundir/orchestrator.log" | tail -30 + rc="${PIPESTATUS[0]}" + if [ "$rc" != "0" ]; then + echo "[FAIL] policy $policy rc=$rc" + fi + # Hard cleanup between policies (b3_isolated_policy.sh's trap should + # have already done it but belt-and-braces) + pkill -9 -f cache_aware_proxy 2>/dev/null || true + pkill -9 -f "vllm serve" 2>/dev/null || true + pkill -9 -f "EngineCore" 2>/dev/null || true + sleep 10 + return 0 +} + +run_policy "unified" "$OUTROOT/unified" "0" +run_policy "unified_kv_both" "$OUTROOT/unified_kv_both" "0" +# Same policy + launcher; the env-gated skip is what makes this differ. +run_policy "unified_kv_both" "$OUTROOT/unified_kv_both_drfix" "1" + +echo "" +echo "[stage Z] reverting CT_DR_FIX patch" +"$PYTHON" "$DR_FIX_SCRIPT" --revert --vllm-root "$VLLM_ROOT" + +echo "" +echo "Done. Artifacts: $OUTROOT" +echo " unified : $OUTROOT/unified/metrics.jsonl" +echo " unified_kv_both : $OUTROOT/unified_kv_both/metrics.jsonl" +echo " unified_kv_both_drfix: $OUTROOT/unified_kv_both_drfix/metrics.jsonl"